Does solar Pro Preview perform better on a single GPU?

Our experimental findings indicate that among models that can be deployed on a single GPU, Solar Pro Preview shows superior performance in intelligence and instruction-following capabilities, as measured by MMLU-Pro and IFEval scores respectively.

Is solar Pro A good GPU?

Solar Pro provides a substantial leap in performance while maintaining the best performance among single-GPU models. Key highlights include: On the IFEval benchmark, a trusted measure of instruction-following capabilities, Solar Pro outperformed all the models designed for single GPUs across all three target languages.

Is solar pro better than solar Pro Preview?

East Asian language mastery: With an up to 64% improvement in Korean and Japanese benchmarks compared to Solar Pro Preview and consistent excellence in English. Built for high-stakes industries: From finance to healthcare to the legal domains, Solar Pro achieves the highest performance among the models running on a single GPU.

Does solar pro perform well in Korean language?

For Korean language, Solar Pro demonstrates exceptional performance in benchmarks like MMLU, KMMLU, HAERAE and Ko-IFEval, where Ko-IFEval is the translated version of IFEval. Across these four benchmark tests, it shows a performance gap ranging from at least 11% to as much as 98% compared to competing models.

How do I access solar pro?

API from Upstage Console: If setting up your own infrastructure isn't preferable, access Solar Pro through the Upstage Console. This platform provides a user-friendly interface to interact with Solar Pro's capabilities, offering a pay-as-you-go model for flexibility.

Should I use a quantized version of solar pro?

To save costs, consider using the quantized version of Solar Pro which shows a performance degradation of less than 0.5%. The quantized Solar Pro requires two NVIDIA A10G GPUs, so an AWS ml.g5.12xlarge instance, which includes four A10G GPUs, can support two Solar Pro deployments simultaneously.