update prompt

Author: gregfrasco

classifier/Dockerfile

@@ -2,8 +2,6 @@ FROM python:3.11-slim as build
 
 WORKDIR /app
 
-COPY . .
-
 ARG NOCO_DB_URL
 ARG NOCO_XC_TOKEN
 ARG LLM_URL
@@ -14,8 +12,12 @@ ENV LLM_URL=${LLM_URL}
 
 ENV PYTHONUNBUFFERED=1
 
+COPY requirements.txt .
+
 RUN pip install --no-cache-dir -r requirements.txt
 
+COPY . .
+
 EXPOSE 5001
 
 CMD ["python", "./app.py"]

classifier/app.py

@@ -25,48 +25,32 @@ class LLMOutput(BaseModel):
 
 prompt = """Conduct an evaluation of the provided content using the following rubric.
 Assess whether the headline and body indicate financial activities where a Chinese financial institution
-is acting as the lender. Evaluate each factor separately, make an overall assessment, and then provide a justification for the overall score.
-Keep the justification concise, up to 25 words.
-
-Be very strict in the overall assessment score—if any of the required factors is not met, the overall score should be 1.
+is acting as the lender. Evaluate each factor separately, providing a score from 1-5 and a justification for it. Keep the justification concise, up to 25 words.
 
 Scoring Rubric:
 
-A. Chinese Lender in a Loan for Development or Infrastructure Projects
-Score 5: The content explicitly names a Chinese financial institution, such as the Import-Export Bank of China
-or the China Development Bank, as the lender in a loan or financial agreement.
-
-Score 3: A Chinese lender is mentioned in connection with financial activities,
-but its role as the lender in the transaction is unclear or speculative.
-
-Score 1: No reference to a Chinese lender, or only mentions 'foreign banks' or 'international financial institutions'
-without specifying China.
-
-B. Loan Agreements and Transactions
-Score 5: The content describes a loan agreement or financial transaction where a Chinese lender is providing funds,
-including details such as loan amounts, agreements, or signing ceremonies.
-
-Score 3: The content discusses potential loans or ongoing negotiations involving a Chinese lender
-but does not confirm a formal agreement.
-
-Score 1: No mention of loan agreements, signing ceremonies, or related transactions involving a Chinese lender.
+A. Recipient
+Score 5: Clearly identifies a recipient of the loan, either by explicitly stating the loan is received or by indicating that a project is being undertaken in a specific country, implying it as the borrower/host.
+Score 3: Mentions a country or entity in connection with financing but does not clearly establish it as the loan recipient.
+Score 1: No recipient is mentioned, or there is no clear indication of who is receiving the loan.
 
-C. Information on Loans or Debt
-Score 5: The content provides detailed information on outstanding loans, repayment terms, or debt obligations
-linked to a Chinese lender.
 
-Score 3: The content references loans or debt but lacks specific details about the involvement of a Chinese lender.
+B. Chinese Lender 
+Score 5: The content explicitly names a Chinese financial institution, such as the Import-Export Bank of China (Exim bank) or the China Development Bank (CDB), as the lender in a loan or financial agreement.
+Score 3: A Chinese lender or actor is mentioned in connection with financial activities, but its role as the lender in the transaction is unclear or speculative.
+Score 1: No reference to a Chinese funder or the given project is associated with non-Chinese lenders such as the World Bank or another country’s finance institution.
 
-Score 1: No mention of loans, debt, or financial obligations involving China.
 
-D. Chinese Financial Institutions Investing in or Extending Credit
-Score 5: The content discusses Chinese financial institutions investing in or providing credit to a government,
-organization, or entity as part of a financial agreement.
+C. Financial Instrument
+Score 5: Clearly identifies the transaction as a loan, using terms like lending, borrowing, debt, or loan.
+Score 3: Mentions financing or general support but does not explicitly confirm it as a loan. The description is vague regarding the financial instrument.
+Score 1: Indicates the transaction is not a loan, instead describing it as an equity investment, grant, or donation.
 
-Score 3: There is mention of Chinese economic engagement, but it is unclear whether it directly involves lending
-or financial transactions.
 
-Score 1: No indication of Chinese financial institutions participating in lending or financial activities.
+D. Activity Precision
+Score 5: Specifies a clear infrastructure project or a defined cooperation model where China and the recipient work together on development, such as infrastructure or a technical agreement. If the recipient is a bank, it is stated that the facility is for on-lending purposes.
+Score 3: Refers to general development support without specifying a particular project or cooperation model. Or refers to a specific activity such as infrastructure development but does the connection with Chinese financing is not clear.
+Score 1: Mentions China’s support but provides no details on the specific activity or project involved.
 """