Our model is the first public work showing how to achieve GPT-4 level long-context retrieval performance.