Quickly deploy Llama3

To facilitate a quick experience with Llama3, Firefly team has provided an out-of-the-box rapid deployment package, which can be obtained from Download Center.

Deployment process

Transfer the deployment package to the AIBOX-1684X machine, using the scp command is recommended:

1. Run the ifconfig command on AIBOX-1684X to view the IP address.

2. Run the scp command to transmit the deployment package, for example: scp llama3.tar linar@ <aibox-ip-addr>:~/, where is the IP address of AIBOX-1684X.

Decompress the deployment package: tar -xvf ./llama3.tar.

One command to deploy Llama3: ./talk_to_llama3.sh.

Note: Networking is not required during the deployment. The first deployment of Llama3 requires a long period of time (3-5 minutes) for software installation.