spark13b开源模型服务部署异常提示

ERROR:    Exception in ASGI application
Traceback (most recent call last):
  File "/root/miniconda3/envs/mindspore_py39/lib/python3.9/site-packages/uvicorn/protocols/http/h11_impl.py", line 404, in run_asgi
    result = await app(  # type: ignore[func-returns-value]
  File "/root/miniconda3/envs/mindspore_py39/lib/python3.9/site-packages/uvicorn/middleware/proxy_headers.py", line 84, in __call__
    return await self.app(scope, receive, send)
  File "/root/miniconda3/envs/mindspore_py39/lib/python3.9/site-packages/fastapi/applications.py", line 1054, in __call__
    await super().__call__(scope, receive, send)
  File "/root/miniconda3/envs/mindspore_py39/lib/python3.9/site-packages/starlette/applications.py", line 123, in __call__
    await self.middleware_stack(scope, receive, send)
  File "/root/miniconda3/envs/mindspore_py39/lib/python3.9/site-packages/starlette/middleware/errors.py", line 186, in __call__
    raise exc
  File "/root/miniconda3/envs/mindspore_py39/lib/python3.9/site-packages/starlette/middleware/errors.py", line 164, in __call__
    await self.app(scope, receive, _send)
  File "/root/miniconda3/envs/mindspore_py39/lib/python3.9/site-packages/starlette/middleware/exceptions.py", line 62, in __call__
    await wrap_app_handling_exceptions(self.app, conn)(scope, receive, send)
  File "/root/miniconda3/envs/mindspore_py39/lib/python3.9/site-packages/starlette/_exception_handler.py", line 64, in wrapped_app
    raise exc
  File "/root/miniconda3/envs/mindspore_py39/lib/python3.9/site-packages/starlette/_exception_handler.py", line 53, in wrapped_app
    await app(scope, receive, sender)
  File "/root/miniconda3/envs/mindspore_py39/lib/python3.9/site-packages/starlette/routing.py", line 758, in __call__
    await self.middleware_stack(scope, receive, send)
  File "/root/miniconda3/envs/mindspore_py39/lib/python3.9/site-packages/starlette/routing.py", line 778, in app
    await route.handle(scope, receive, send)
  File "/root/miniconda3/envs/mindspore_py39/lib/python3.9/site-packages/starlette/routing.py", line 299, in handle
    await self.app(scope, receive, send)
  File "/root/miniconda3/envs/mindspore_py39/lib/python3.9/site-packages/starlette/routing.py", line 79, in app
    await wrap_app_handling_exceptions(app, request)(scope, receive, send)
  File "/root/miniconda3/envs/mindspore_py39/lib/python3.9/site-packages/starlette/_exception_handler.py", line 64, in wrapped_app
    raise exc
  File "/root/miniconda3/envs/mindspore_py39/lib/python3.9/site-packages/starlette/_exception_handler.py", line 53, in wrapped_app
    await app(scope, receive, sender)
  File "/root/miniconda3/envs/mindspore_py39/lib/python3.9/site-packages/starlette/routing.py", line 74, in app
    response = await func(request)
  File "/root/miniconda3/envs/mindspore_py39/lib/python3.9/site-packages/fastapi/routing.py", line 299, in app
    raise e
  File "/root/miniconda3/envs/mindspore_py39/lib/python3.9/site-packages/fastapi/routing.py", line 294, in app
    raw_response = await run_endpoint_function(
  File "/root/miniconda3/envs/mindspore_py39/lib/python3.9/site-packages/fastapi/routing.py", line 193, in run_endpoint_function
    return await run_in_threadpool(dependant.call, **values)
  File "/root/miniconda3/envs/mindspore_py39/lib/python3.9/site-packages/starlette/concurrency.py", line 42, in run_in_threadpool
    return await anyio.to_thread.run_sync(func, *args)
  File "/root/miniconda3/envs/mindspore_py39/lib/python3.9/site-packages/anyio/to_thread.py", line 56, in run_sync
    return await get_async_backend().run_sync_in_worker_thread(
  File "/root/miniconda3/envs/mindspore_py39/lib/python3.9/site-packages/anyio/_backends/_asyncio.py", line 2134, in run_sync_in_worker_thread
    return await future
  File "/root/miniconda3/envs/mindspore_py39/lib/python3.9/site-packages/anyio/_backends/_asyncio.py", line 851, in run
    result = context.run(func, *args)
  File "/root/workspace/mindformers/research/iflytekspark/spark_13b_service.py", line 112, in infer
    outputs = iflytek_spark_predict(**info.dict())
  File "/root/workspace/mindformers/research/iflytekspark/spark_13b_service.py", line 171, in iflytek_spark_predict
    outs = model.predict(inputs["input_ids"])
  File "/root/workspace/mindformers/research/iflytekspark/iflytekspark_infer.py", line 54, in predict
    out = self.infer(question_list)
  File "/root/workspace/mindformers/research/iflytekspark/iflytekspark_infer.py", line 117, in infer
    cur = self.model.generate([question],
  File "/root/workspace/mindformers/research/iflytekspark/iflytekspark_text_generator.py", line 1134, in generate
    output_ids = self._greedy_search(
  File "/root/workspace/mindformers/research/iflytekspark/iflytekspark_text_generator.py", line 401, in _greedy_search
    res = self._incremental_infer(
  File "/root/workspace/mindformers/research/iflytekspark/iflytekspark_text_generator.py", line 230, in _incremental_infer
    res = self(
  File "/root/miniconda3/envs/mindspore_py39/lib/python3.9/site-packages/mindspore/nn/cell.py", line 680, in __call__
    out = self.compile_and_run(*args, **kwargs)
  File "/root/miniconda3/envs/mindspore_py39/lib/python3.9/site-packages/mindspore/nn/cell.py", line 1023, in compile_and_run
    return _cell_graph_executor(self, *new_args, phase=self.phase)
  File "/root/miniconda3/envs/mindspore_py39/lib/python3.9/site-packages/mindspore/common/api.py", line 1589, in __call__
    return self.run(obj, *args, phase=phase)
  File "/root/miniconda3/envs/mindspore_py39/lib/python3.9/site-packages/mindspore/common/api.py", line 1628, in run
    return self._exec_pip(obj, *args, phase=phase_real)
  File "/root/miniconda3/envs/mindspore_py39/lib/python3.9/site-packages/mindspore/common/api.py", line 121, in wrapper
    results = fn(*arg, **kwargs)
  File "/root/miniconda3/envs/mindspore_py39/lib/python3.9/site-packages/mindspore/common/api.py", line 1608, in _exec_pip
    return self._graph_executor(args, phase)
RuntimeError: Sync stream failed:Ascend_0

----------------------------------------------------
- C++ Call Stack: (For framework developers)
----------------------------------------------------
mindspore/ccsrc/runtime/graph_scheduler/graph_scheduler.cc:682 Run

讯飞星火开源/iFlytekSpark-13B

内容风险标识

评论 (0)

讯飞星火开源/iFlytekSpark-13B .gitee-modal { width: 500px !important; }

内容风险标识