Breakthroughs in Big Data

An Astronomical Breakthrough

The first mission results from Gaia, the European Space Agency’s billion-star surveyor, were released on September 14, 2016. This first Gaia data release includes the position and G magnitude for about one billion stars using observations recorded between July 25, 2014 and September 16, 2015.

The final Gaia results (available in the early 2020’s) will provide positions, parallaxes and proper motions for these stars at an unprecedented accuracy level, far below a milliarcsecond. These accuracies can only be achieved after a complex data processing that requires observations taken throughout Gaia’s 5-year nominal mission.

InterSystems Caché is used in the Gaia project for its AGIS positioning subsystem and the important Initial Data Treatment/First Look (IDT/FL) database. Caché was chosen for its proven ability to rapidly ingest large amounts of data, populate extremely complex astrometric data models, and instantly make the data available for just-in-time analytics using SQL, NoSQL, and object paradigms.

Keep up with the latest news about Gaia with a recent article by the BBC or visit the ESA Gaia site.

How we help you make breakthroughs

Big Data performance and scalability

Big Data solutions typically need to handle very high volumes of data at very high velocity. Our data platform gives you performance and scalability to spare.

  • Built for speed
    Our advanced technology enables rapid data insertion, ingesting huge volumes of data at insanely high velocity. And, because of our platform’s unique architecture, performance doesn’t degrade as data volumes scale up.
  • Built for scalability
    Our platform’s lean design lets it scale – very economically – to extremely large core counts and tens of thousands of users. So when one of the world’s largest equity trading systems needed to process 1 billion transactions in a day, our platform handled it. Without missing a beat.

Plus, we believe that big, complex systems don’t need a big, complex platform – just the opposite. Our technology delivers power though simplicity, with straightforward code pathways, so applications are more reliable, more available, and easier to manage.

Big Data variety

Big Data is typically generated at a variety sources, and comes in a dizzying variety of formats. The interoperability capabilities and “multi-modal” nature of our data platform enable you to access and gain insights from ALL your data – structured and unstructured, SQL and NoSQL, centralized and distributed.

  • Built for data variety
    In addition to enabling analysis of any format of structured data you want to name (relational tables, objects, key-value pairs, flat files, etc.) we uniquely provide semantic analysis technology that does not require the up-front creation and maintenance of a cumbersome dictionary or ontology.
  • Built for connectivity
    Our strategic interoperability capabilities enable you to connect to any kind of data store, or pull data from any kind of application. For example, do you need to connect to every hospital, laboratory, clinic, and physician’s office within a region, state, or even country? People are doing that with our technology.

Plus, our ability to handle many different and complex types of data does not adversely affect our platform’s speed. There’s no mapping to get in the way of our lightning-fast performance.

Big Data and the cloud

Big Data solutions frequently lives in the cloud. Whether you use a public or private cloud, hosted, on-premise, or hybrid architecture, we let you make that a business choice, while we take care of provisioning and horizontal scaling.