xa.get_daily("SH600036",) does not work !

[evendata-git]

{'data': {'items': [], 'items_size': 0},
'error_code': 0,
'error_description': ''}

File ~/opt/anaconda3/lib/python3.10/site-packages/xalpha/universal.py:171, in get_historical_fromxq(code, count, type_, full)
--> 171 df = pd.DataFrame(data=r["data"]["item"], columns=r["data"]["column"])
172 df["date"] = (df["timestamp"]).apply(ts2pdts) # reset hours to zero
173 return df

KeyError: 'item'

[refraction-ray]

works for me, need more info on the settings and environments to locate and reproduce the error

[evendata-git]

os: Ubuntu 22.04 LTS
python version: 3.10.9 (main, Mar 1 2023, 18:23:06) [GCC 11.2.0]
xalpha version: 0.11.11

os: macos Ventura 13.0.1
python version: 3.10.13 (main, Sep 11 2023, 08:16:02) [Clang 14.0.6 ]
xalpha version: 0.12.0

both have the same error.

KeyError Traceback (most recent call last)
File ~/anaconda3/lib/python3.10/site-packages/xalpha/universal.py:1993, in cachedio..cached..wrapper(*args, **kws)
1992 elif backend == "memory":
-> 1993 df0 = getattr(thismodule, "cached_dict")[key]
1994 else:

KeyError: 'SH600036'

During handling of the above exception, another exception occurred:

KeyError Traceback (most recent call last)
Cell In[5], line 6
----> 6 xa.get_daily("SH600036", prev=15)

File ~/anaconda3/lib/python3.10/site-packages/xalpha/universal.py:2051, in cachedio..cached..wrapper(*args, **kws)
2047 kws["end"] = (
2048 today_obj() - dt.timedelta(days=1)
2049 ).strftime("%Y%m%d")
2050 is_changed = True
-> 2051 df0 = f(*args, **kws)
2053 if df0 is not None and len(df0) > 0 and is_changed:
2054 if backend == "csv":

File ~/anaconda3/lib/python3.10/site-packages/xalpha/universal.py:1128, in get_daily(code, start, end, prev, from, wrapper, handler, **kws)
1125 elif from in ["xueqiu", "xq", "snowball", "XQ"]:
1126 code, type = decouple_code(code)
-> 1128 df = get_historical_fromxq(code, count, type=type)
1129 df = prettify(df)
1130 elif _from in ["zhongjianjia", "zjj", "chinamoney", "ZJJ"]:

File ~/anaconda3/lib/python3.10/site-packages/xalpha/universal.py:168, in get_historical_fromxq(code, count, type_, full)
160 # pe 是 TTM 数据
161 r = rget_json(
162 url.format(
163 code=code, tomorrow=int(tomorrow_ts() * 1000), count=count, type_=type_
(...)
166 headers={"user-agent": "Mozilla/5.0"},
167 )
--> 168 df = pd.DataFrame(data=r["data"]["item"], columns=r["data"]["column"])
169 df["date"] = (df["timestamp"]).apply(ts2pdts) # reset hours to zero
170 return df

KeyError: 'item'

[ohmyboy12]

I use xalpha 0.12.0, also the get_daily does not work

[refraction-ray]

refer to #190 (comment)

[ohmyboy12]

邮件已收到~~我会查看之后回复您

[evendata-git]

monkey_patches.py

import xalpha
import requests
import functools

_session_state = {"session": None, "token": None}

def get_initialized_session():

global _session_state

if _session_state["session"] is None:
    session = requests.Session()

    session.get("https://xueqiu.com/", headers={"User-Agent": "Mozilla/5.0"})

    r = session.get(
        "https://xueqiu.com/hq",
        headers={"User-Agent": "Mozilla/5.0", "Referer": "https://xueqiu.com/"}
    )

    if "xq_a_token" in r.cookies:
        _session_state["token"] = r.cookies["xq_a_token"]

        session.headers.update({
            "User-Agent": "Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/91.0.4472.124 Safari/537.36",
            "Accept": "application/json",
            "Referer": "https://xueqiu.com/hq",
            "X-Requested-With": "XMLHttpRequest"
        })
        _session_state["session"] = session
    else:
        raise ValueError("Failed to retrieve xq_a_token after session warm-up.")

return _session_state["session"], _session_state["token"]

def patched_get_token():

_, token = get_initialized_session()
return token

@functools.wraps(xalpha.universal.rget_json) # Preserve metadata
def patched_rget_json(url, cookies=None, headers=None, **kwargs):

session, _ = get_initialized_session()

final_cookies = session.cookies.copy()
if cookies:
    final_cookies.update(cookies)

r = session.get(url, cookies=final_cookies, headers=headers, **kwargs)
r.raise_for_status() # Raise exception for bad status codes
return r.json() # Assuming it returns JSON data

def apply_xalpha_patches():

xalpha.universal.get_token = patched_get_token
xalpha.universal.rget_json = patched_rget_json

finally, fixed above & get_token error problems. steps are as follow:

1. save above code in a python file, like monkey_patches.py
2. import apply_xalpha_patches
   apply_xalpha_patches(()
   then you can run xalpha.get_daily("SH600036") successful!

[ohmyboy12]

邮件已收到~~我会查看之后回复您