Skip to content

--force-decode does not work on CPU #1022

@hdeval1

Description

@hdeval1

Bug description

Other marian-decoder functions work, but using --force-decode results in this error

[2024-02-15 18:55:11] Error: CopyCastTo to type uint32 not implemented
[2024-02-15 18:55:11] Error: Aborted from void marian::cpu::CopyCastFrom(marian::Tensor, const T*, int) [with bool add = false; T = float; marian::Tensor = IntrusivePtr<marian::TensorBase>] in /marian/src/tensors/cpu/tensor_operators.cpp:59

How to reproduce

Model: https://github.com/Helsinki-NLP/Tatoeba-Challenge/tree/master/models/kor-eng
Using a CPU container with Marian 1.12, no CUDA, and Open BLAS
Prefixes.txt file and src.txt file are same amount of lines
/marian/build/marian-decoder -c decoder.yml --force-decode --beam-size 10 --cpu-threads=16 --n-best -o output.txt
log.txt

Context

  • Marian version: Paste the output of --version here
    1.12

  • CMake command: Type the cmake command you used and attach the output of --build-info all
    cmake -DUSE_SENTENCEPIECE=on -DCOMPILE_CUDA=OFF -DBUILD_ARCH=x86-64 -DUSE_OPENBLAS=on -DCOMPILE_CPU=on -DPROTOBUF_LIBRARY=/usr/lib/x86_64-linux-gnu/libprotobuf.so.9 -DPROTOBUF_INCLUDE_DIR=/usr/include/google/protobuf -DPROTOBUF_PROTOC_EXECUTABLE=/usr/bin/protoc -DUSE_MKL=off && make -j4

  • Log file: Attach your training/decoding logs

Add any other information about the problem here.

Metadata

Metadata

Assignees

No one assigned

    Labels

    Type

    No type
    No fields configured for issues without a type.

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions