Jul 09 18:58:21.376793 ip-10-0-139-134 systemd[1]: Starting Kubernetes Kubelet...
Jul 09 18:58:21.802952 ip-10-0-139-134 kubenswrapper[2578]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 09 18:58:21.802952 ip-10-0-139-134 kubenswrapper[2578]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version.
Jul 09 18:58:21.802952 ip-10-0-139-134 kubenswrapper[2578]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 09 18:58:21.802952 ip-10-0-139-134 kubenswrapper[2578]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI.
Jul 09 18:58:21.802952 ip-10-0-139-134 kubenswrapper[2578]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 09 18:58:21.805500 ip-10-0-139-134 kubenswrapper[2578]: I0709 18:58:21.805358    2578 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime"
Jul 09 18:58:21.810153 ip-10-0-139-134 kubenswrapper[2578]: W0709 18:58:21.810128    2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 09 18:58:21.810153 ip-10-0-139-134 kubenswrapper[2578]: W0709 18:58:21.810153    2578 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 09 18:58:21.810225 ip-10-0-139-134 kubenswrapper[2578]: W0709 18:58:21.810157    2578 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 09 18:58:21.810225 ip-10-0-139-134 kubenswrapper[2578]: W0709 18:58:21.810160    2578 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 09 18:58:21.810225 ip-10-0-139-134 kubenswrapper[2578]: W0709 18:58:21.810163    2578 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 09 18:58:21.810225 ip-10-0-139-134 kubenswrapper[2578]: W0709 18:58:21.810167    2578 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 09 18:58:21.810225 ip-10-0-139-134 kubenswrapper[2578]: W0709 18:58:21.810170    2578 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 09 18:58:21.810225 ip-10-0-139-134 kubenswrapper[2578]: W0709 18:58:21.810173    2578 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 09 18:58:21.810225 ip-10-0-139-134 kubenswrapper[2578]: W0709 18:58:21.810175    2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 09 18:58:21.810225 ip-10-0-139-134 kubenswrapper[2578]: W0709 18:58:21.810178    2578 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 09 18:58:21.810225 ip-10-0-139-134 kubenswrapper[2578]: W0709 18:58:21.810181    2578 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 09 18:58:21.810225 ip-10-0-139-134 kubenswrapper[2578]: W0709 18:58:21.810190    2578 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 09 18:58:21.810225 ip-10-0-139-134 kubenswrapper[2578]: W0709 18:58:21.810192    2578 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 09 18:58:21.810225 ip-10-0-139-134 kubenswrapper[2578]: W0709 18:58:21.810196    2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 09 18:58:21.810225 ip-10-0-139-134 kubenswrapper[2578]: W0709 18:58:21.810198    2578 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 09 18:58:21.810225 ip-10-0-139-134 kubenswrapper[2578]: W0709 18:58:21.810200    2578 feature_gate.go:328] unrecognized feature gate: Example
Jul 09 18:58:21.810225 ip-10-0-139-134 kubenswrapper[2578]: W0709 18:58:21.810203    2578 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 09 18:58:21.810225 ip-10-0-139-134 kubenswrapper[2578]: W0709 18:58:21.810206    2578 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 09 18:58:21.810225 ip-10-0-139-134 kubenswrapper[2578]: W0709 18:58:21.810210    2578 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 09 18:58:21.810225 ip-10-0-139-134 kubenswrapper[2578]: W0709 18:58:21.810214    2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 09 18:58:21.810225 ip-10-0-139-134 kubenswrapper[2578]: W0709 18:58:21.810217    2578 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 09 18:58:21.810225 ip-10-0-139-134 kubenswrapper[2578]: W0709 18:58:21.810220    2578 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 09 18:58:21.810723 ip-10-0-139-134 kubenswrapper[2578]: W0709 18:58:21.810222    2578 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 09 18:58:21.810723 ip-10-0-139-134 kubenswrapper[2578]: W0709 18:58:21.810225    2578 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 09 18:58:21.810723 ip-10-0-139-134 kubenswrapper[2578]: W0709 18:58:21.810227    2578 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 09 18:58:21.810723 ip-10-0-139-134 kubenswrapper[2578]: W0709 18:58:21.810230    2578 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 09 18:58:21.810723 ip-10-0-139-134 kubenswrapper[2578]: W0709 18:58:21.810233    2578 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 09 18:58:21.810723 ip-10-0-139-134 kubenswrapper[2578]: W0709 18:58:21.810236    2578 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 09 18:58:21.810723 ip-10-0-139-134 kubenswrapper[2578]: W0709 18:58:21.810239    2578 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 09 18:58:21.810723 ip-10-0-139-134 kubenswrapper[2578]: W0709 18:58:21.810241    2578 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 09 18:58:21.810723 ip-10-0-139-134 kubenswrapper[2578]: W0709 18:58:21.810244    2578 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 09 18:58:21.810723 ip-10-0-139-134 kubenswrapper[2578]: W0709 18:58:21.810246    2578 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 09 18:58:21.810723 ip-10-0-139-134 kubenswrapper[2578]: W0709 18:58:21.810249    2578 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 09 18:58:21.810723 ip-10-0-139-134 kubenswrapper[2578]: W0709 18:58:21.810251    2578 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 09 18:58:21.810723 ip-10-0-139-134 kubenswrapper[2578]: W0709 18:58:21.810254    2578 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 09 18:58:21.810723 ip-10-0-139-134 kubenswrapper[2578]: W0709 18:58:21.810257    2578 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 09 18:58:21.810723 ip-10-0-139-134 kubenswrapper[2578]: W0709 18:58:21.810259    2578 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 09 18:58:21.810723 ip-10-0-139-134 kubenswrapper[2578]: W0709 18:58:21.810261    2578 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 09 18:58:21.810723 ip-10-0-139-134 kubenswrapper[2578]: W0709 18:58:21.810264    2578 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 09 18:58:21.810723 ip-10-0-139-134 kubenswrapper[2578]: W0709 18:58:21.810267    2578 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 09 18:58:21.810723 ip-10-0-139-134 kubenswrapper[2578]: W0709 18:58:21.810269    2578 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 09 18:58:21.810723 ip-10-0-139-134 kubenswrapper[2578]: W0709 18:58:21.810271    2578 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 09 18:58:21.811236 ip-10-0-139-134 kubenswrapper[2578]: W0709 18:58:21.810275    2578 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 09 18:58:21.811236 ip-10-0-139-134 kubenswrapper[2578]: W0709 18:58:21.810277    2578 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 09 18:58:21.811236 ip-10-0-139-134 kubenswrapper[2578]: W0709 18:58:21.810280    2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 09 18:58:21.811236 ip-10-0-139-134 kubenswrapper[2578]: W0709 18:58:21.810283    2578 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 09 18:58:21.811236 ip-10-0-139-134 kubenswrapper[2578]: W0709 18:58:21.810287    2578 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 09 18:58:21.811236 ip-10-0-139-134 kubenswrapper[2578]: W0709 18:58:21.810290    2578 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 09 18:58:21.811236 ip-10-0-139-134 kubenswrapper[2578]: W0709 18:58:21.810294    2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 09 18:58:21.811236 ip-10-0-139-134 kubenswrapper[2578]: W0709 18:58:21.810296    2578 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 09 18:58:21.811236 ip-10-0-139-134 kubenswrapper[2578]: W0709 18:58:21.810299    2578 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 09 18:58:21.811236 ip-10-0-139-134 kubenswrapper[2578]: W0709 18:58:21.810302    2578 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 09 18:58:21.811236 ip-10-0-139-134 kubenswrapper[2578]: W0709 18:58:21.810304    2578 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 09 18:58:21.811236 ip-10-0-139-134 kubenswrapper[2578]: W0709 18:58:21.810306    2578 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 09 18:58:21.811236 ip-10-0-139-134 kubenswrapper[2578]: W0709 18:58:21.810309    2578 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 09 18:58:21.811236 ip-10-0-139-134 kubenswrapper[2578]: W0709 18:58:21.810312    2578 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 09 18:58:21.811236 ip-10-0-139-134 kubenswrapper[2578]: W0709 18:58:21.810315    2578 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 09 18:58:21.811236 ip-10-0-139-134 kubenswrapper[2578]: W0709 18:58:21.810319    2578 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 09 18:58:21.811236 ip-10-0-139-134 kubenswrapper[2578]: W0709 18:58:21.810321    2578 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 09 18:58:21.811236 ip-10-0-139-134 kubenswrapper[2578]: W0709 18:58:21.810324    2578 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 09 18:58:21.811236 ip-10-0-139-134 kubenswrapper[2578]: W0709 18:58:21.810326    2578 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 09 18:58:21.811236 ip-10-0-139-134 kubenswrapper[2578]: W0709 18:58:21.810329    2578 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 09 18:58:21.811764 ip-10-0-139-134 kubenswrapper[2578]: W0709 18:58:21.810331    2578 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 09 18:58:21.811764 ip-10-0-139-134 kubenswrapper[2578]: W0709 18:58:21.810334    2578 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 09 18:58:21.811764 ip-10-0-139-134 kubenswrapper[2578]: W0709 18:58:21.810336    2578 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 09 18:58:21.811764 ip-10-0-139-134 kubenswrapper[2578]: W0709 18:58:21.810339    2578 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 09 18:58:21.811764 ip-10-0-139-134 kubenswrapper[2578]: W0709 18:58:21.810342    2578 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 09 18:58:21.811764 ip-10-0-139-134 kubenswrapper[2578]: W0709 18:58:21.810344    2578 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 09 18:58:21.811764 ip-10-0-139-134 kubenswrapper[2578]: W0709 18:58:21.810348    2578 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 09 18:58:21.811764 ip-10-0-139-134 kubenswrapper[2578]: W0709 18:58:21.810351    2578 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 09 18:58:21.811764 ip-10-0-139-134 kubenswrapper[2578]: W0709 18:58:21.810354    2578 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 09 18:58:21.811764 ip-10-0-139-134 kubenswrapper[2578]: W0709 18:58:21.810357    2578 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 09 18:58:21.811764 ip-10-0-139-134 kubenswrapper[2578]: W0709 18:58:21.810359    2578 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 09 18:58:21.811764 ip-10-0-139-134 kubenswrapper[2578]: W0709 18:58:21.810362    2578 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 09 18:58:21.811764 ip-10-0-139-134 kubenswrapper[2578]: W0709 18:58:21.810364    2578 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 09 18:58:21.811764 ip-10-0-139-134 kubenswrapper[2578]: W0709 18:58:21.810367    2578 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 09 18:58:21.811764 ip-10-0-139-134 kubenswrapper[2578]: W0709 18:58:21.810369    2578 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 09 18:58:21.811764 ip-10-0-139-134 kubenswrapper[2578]: W0709 18:58:21.810372    2578 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 09 18:58:21.811764 ip-10-0-139-134 kubenswrapper[2578]: W0709 18:58:21.810375    2578 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 09 18:58:21.811764 ip-10-0-139-134 kubenswrapper[2578]: W0709 18:58:21.810377    2578 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 09 18:58:21.811764 ip-10-0-139-134 kubenswrapper[2578]: W0709 18:58:21.810379    2578 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 09 18:58:21.812261 ip-10-0-139-134 kubenswrapper[2578]: W0709 18:58:21.810382    2578 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 09 18:58:21.812261 ip-10-0-139-134 kubenswrapper[2578]: W0709 18:58:21.810385    2578 feature_gate.go:328] unrecognized feature gate: Example2
Jul 09 18:58:21.812261 ip-10-0-139-134 kubenswrapper[2578]: W0709 18:58:21.810387    2578 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 09 18:58:21.812261 ip-10-0-139-134 kubenswrapper[2578]: W0709 18:58:21.810389    2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 09 18:58:21.812261 ip-10-0-139-134 kubenswrapper[2578]: W0709 18:58:21.810392    2578 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 09 18:58:21.812261 ip-10-0-139-134 kubenswrapper[2578]: W0709 18:58:21.810395    2578 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 09 18:58:21.812261 ip-10-0-139-134 kubenswrapper[2578]: W0709 18:58:21.810397    2578 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 09 18:58:21.812261 ip-10-0-139-134 kubenswrapper[2578]: W0709 18:58:21.810400    2578 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 09 18:58:21.812261 ip-10-0-139-134 kubenswrapper[2578]: W0709 18:58:21.810403    2578 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 09 18:58:21.812261 ip-10-0-139-134 kubenswrapper[2578]: W0709 18:58:21.810405    2578 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 09 18:58:21.812261 ip-10-0-139-134 kubenswrapper[2578]: W0709 18:58:21.810407    2578 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 09 18:58:21.812261 ip-10-0-139-134 kubenswrapper[2578]: W0709 18:58:21.810410    2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 09 18:58:21.812261 ip-10-0-139-134 kubenswrapper[2578]: W0709 18:58:21.810412    2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 09 18:58:21.812261 ip-10-0-139-134 kubenswrapper[2578]: W0709 18:58:21.810415    2578 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 09 18:58:21.812261 ip-10-0-139-134 kubenswrapper[2578]: W0709 18:58:21.810417    2578 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 09 18:58:21.812261 ip-10-0-139-134 kubenswrapper[2578]: W0709 18:58:21.810420    2578 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 09 18:58:21.812261 ip-10-0-139-134 kubenswrapper[2578]: W0709 18:58:21.810422    2578 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 09 18:58:21.812261 ip-10-0-139-134 kubenswrapper[2578]: W0709 18:58:21.810424    2578 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 09 18:58:21.812261 ip-10-0-139-134 kubenswrapper[2578]: W0709 18:58:21.811144    2578 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 09 18:58:21.812261 ip-10-0-139-134 kubenswrapper[2578]: W0709 18:58:21.811151    2578 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 09 18:58:21.812765 ip-10-0-139-134 kubenswrapper[2578]: W0709 18:58:21.811154    2578 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 09 18:58:21.812765 ip-10-0-139-134 kubenswrapper[2578]: W0709 18:58:21.811156    2578 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 09 18:58:21.812765 ip-10-0-139-134 kubenswrapper[2578]: W0709 18:58:21.811159    2578 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 09 18:58:21.812765 ip-10-0-139-134 kubenswrapper[2578]: W0709 18:58:21.811162    2578 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 09 18:58:21.812765 ip-10-0-139-134 kubenswrapper[2578]: W0709 18:58:21.811164    2578 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 09 18:58:21.812765 ip-10-0-139-134 kubenswrapper[2578]: W0709 18:58:21.811166    2578 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 09 18:58:21.812765 ip-10-0-139-134 kubenswrapper[2578]: W0709 18:58:21.811169    2578 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 09 18:58:21.812765 ip-10-0-139-134 kubenswrapper[2578]: W0709 18:58:21.811172    2578 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 09 18:58:21.812765 ip-10-0-139-134 kubenswrapper[2578]: W0709 18:58:21.811177    2578 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 09 18:58:21.812765 ip-10-0-139-134 kubenswrapper[2578]: W0709 18:58:21.811181    2578 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 09 18:58:21.812765 ip-10-0-139-134 kubenswrapper[2578]: W0709 18:58:21.811184    2578 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 09 18:58:21.812765 ip-10-0-139-134 kubenswrapper[2578]: W0709 18:58:21.811187    2578 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 09 18:58:21.812765 ip-10-0-139-134 kubenswrapper[2578]: W0709 18:58:21.811189    2578 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 09 18:58:21.812765 ip-10-0-139-134 kubenswrapper[2578]: W0709 18:58:21.811195    2578 feature_gate.go:328] unrecognized feature gate: Example2
Jul 09 18:58:21.812765 ip-10-0-139-134 kubenswrapper[2578]: W0709 18:58:21.811198    2578 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 09 18:58:21.812765 ip-10-0-139-134 kubenswrapper[2578]: W0709 18:58:21.811201    2578 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 09 18:58:21.812765 ip-10-0-139-134 kubenswrapper[2578]: W0709 18:58:21.811204    2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 09 18:58:21.812765 ip-10-0-139-134 kubenswrapper[2578]: W0709 18:58:21.811207    2578 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 09 18:58:21.812765 ip-10-0-139-134 kubenswrapper[2578]: W0709 18:58:21.811211    2578 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 09 18:58:21.812765 ip-10-0-139-134 kubenswrapper[2578]: W0709 18:58:21.811213    2578 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 09 18:58:21.813262 ip-10-0-139-134 kubenswrapper[2578]: W0709 18:58:21.811216    2578 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 09 18:58:21.813262 ip-10-0-139-134 kubenswrapper[2578]: W0709 18:58:21.811219    2578 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 09 18:58:21.813262 ip-10-0-139-134 kubenswrapper[2578]: W0709 18:58:21.811222    2578 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 09 18:58:21.813262 ip-10-0-139-134 kubenswrapper[2578]: W0709 18:58:21.811225    2578 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 09 18:58:21.813262 ip-10-0-139-134 kubenswrapper[2578]: W0709 18:58:21.811227    2578 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 09 18:58:21.813262 ip-10-0-139-134 kubenswrapper[2578]: W0709 18:58:21.811230    2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 09 18:58:21.813262 ip-10-0-139-134 kubenswrapper[2578]: W0709 18:58:21.811232    2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 09 18:58:21.813262 ip-10-0-139-134 kubenswrapper[2578]: W0709 18:58:21.811235    2578 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 09 18:58:21.813262 ip-10-0-139-134 kubenswrapper[2578]: W0709 18:58:21.811238    2578 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 09 18:58:21.813262 ip-10-0-139-134 kubenswrapper[2578]: W0709 18:58:21.811240    2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 09 18:58:21.813262 ip-10-0-139-134 kubenswrapper[2578]: W0709 18:58:21.811243    2578 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 09 18:58:21.813262 ip-10-0-139-134 kubenswrapper[2578]: W0709 18:58:21.811245    2578 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 09 18:58:21.813262 ip-10-0-139-134 kubenswrapper[2578]: W0709 18:58:21.811248    2578 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 09 18:58:21.813262 ip-10-0-139-134 kubenswrapper[2578]: W0709 18:58:21.811250    2578 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 09 18:58:21.813262 ip-10-0-139-134 kubenswrapper[2578]: W0709 18:58:21.811254    2578 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 09 18:58:21.813262 ip-10-0-139-134 kubenswrapper[2578]: W0709 18:58:21.811257    2578 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 09 18:58:21.813262 ip-10-0-139-134 kubenswrapper[2578]: W0709 18:58:21.811259    2578 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 09 18:58:21.813262 ip-10-0-139-134 kubenswrapper[2578]: W0709 18:58:21.811262    2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 09 18:58:21.813262 ip-10-0-139-134 kubenswrapper[2578]: W0709 18:58:21.811264    2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 09 18:58:21.813262 ip-10-0-139-134 kubenswrapper[2578]: W0709 18:58:21.811267    2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 09 18:58:21.813810 ip-10-0-139-134 kubenswrapper[2578]: W0709 18:58:21.811269    2578 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 09 18:58:21.813810 ip-10-0-139-134 kubenswrapper[2578]: W0709 18:58:21.811271    2578 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 09 18:58:21.813810 ip-10-0-139-134 kubenswrapper[2578]: W0709 18:58:21.811274    2578 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 09 18:58:21.813810 ip-10-0-139-134 kubenswrapper[2578]: W0709 18:58:21.811277    2578 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 09 18:58:21.813810 ip-10-0-139-134 kubenswrapper[2578]: W0709 18:58:21.811279    2578 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 09 18:58:21.813810 ip-10-0-139-134 kubenswrapper[2578]: W0709 18:58:21.811282    2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 09 18:58:21.813810 ip-10-0-139-134 kubenswrapper[2578]: W0709 18:58:21.811285    2578 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 09 18:58:21.813810 ip-10-0-139-134 kubenswrapper[2578]: W0709 18:58:21.811287    2578 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 09 18:58:21.813810 ip-10-0-139-134 kubenswrapper[2578]: W0709 18:58:21.811290    2578 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 09 18:58:21.813810 ip-10-0-139-134 kubenswrapper[2578]: W0709 18:58:21.811292    2578 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 09 18:58:21.813810 ip-10-0-139-134 kubenswrapper[2578]: W0709 18:58:21.811295    2578 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 09 18:58:21.813810 ip-10-0-139-134 kubenswrapper[2578]: W0709 18:58:21.811298    2578 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 09 18:58:21.813810 ip-10-0-139-134 kubenswrapper[2578]: W0709 18:58:21.811300    2578 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 09 18:58:21.813810 ip-10-0-139-134 kubenswrapper[2578]: W0709 18:58:21.811303    2578 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 09 18:58:21.813810 ip-10-0-139-134 kubenswrapper[2578]: W0709 18:58:21.811305    2578 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 09 18:58:21.813810 ip-10-0-139-134 kubenswrapper[2578]: W0709 18:58:21.811307    2578 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 09 18:58:21.813810 ip-10-0-139-134 kubenswrapper[2578]: W0709 18:58:21.811310    2578 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 09 18:58:21.813810 ip-10-0-139-134 kubenswrapper[2578]: W0709 18:58:21.811312    2578 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 09 18:58:21.813810 ip-10-0-139-134 kubenswrapper[2578]: W0709 18:58:21.811314    2578 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 09 18:58:21.814285 ip-10-0-139-134 kubenswrapper[2578]: W0709 18:58:21.811317    2578 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 09 18:58:21.814285 ip-10-0-139-134 kubenswrapper[2578]: W0709 18:58:21.811319    2578 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 09 18:58:21.814285 ip-10-0-139-134 kubenswrapper[2578]: W0709 18:58:21.811322    2578 feature_gate.go:328] unrecognized feature gate: Example
Jul 09 18:58:21.814285 ip-10-0-139-134 kubenswrapper[2578]: W0709 18:58:21.811324    2578 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 09 18:58:21.814285 ip-10-0-139-134 kubenswrapper[2578]: W0709 18:58:21.811327    2578 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 09 18:58:21.814285 ip-10-0-139-134 kubenswrapper[2578]: W0709 18:58:21.811329    2578 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 09 18:58:21.814285 ip-10-0-139-134 kubenswrapper[2578]: W0709 18:58:21.811332    2578 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 09 18:58:21.814285 ip-10-0-139-134 kubenswrapper[2578]: W0709 18:58:21.811334    2578 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 09 18:58:21.814285 ip-10-0-139-134 kubenswrapper[2578]: W0709 18:58:21.811336    2578 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 09 18:58:21.814285 ip-10-0-139-134 kubenswrapper[2578]: W0709 18:58:21.811339    2578 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 09 18:58:21.814285 ip-10-0-139-134 kubenswrapper[2578]: W0709 18:58:21.811341    2578 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 09 18:58:21.814285 ip-10-0-139-134 kubenswrapper[2578]: W0709 18:58:21.811343    2578 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 09 18:58:21.814285 ip-10-0-139-134 kubenswrapper[2578]: W0709 18:58:21.811346    2578 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 09 18:58:21.814285 ip-10-0-139-134 kubenswrapper[2578]: W0709 18:58:21.811348    2578 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 09 18:58:21.814285 ip-10-0-139-134 kubenswrapper[2578]: W0709 18:58:21.811350    2578 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 09 18:58:21.814285 ip-10-0-139-134 kubenswrapper[2578]: W0709 18:58:21.811353    2578 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 09 18:58:21.814285 ip-10-0-139-134 kubenswrapper[2578]: W0709 18:58:21.811356    2578 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 09 18:58:21.814285 ip-10-0-139-134 kubenswrapper[2578]: W0709 18:58:21.811359    2578 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 09 18:58:21.814285 ip-10-0-139-134 kubenswrapper[2578]: W0709 18:58:21.811361    2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 09 18:58:21.814285 ip-10-0-139-134 kubenswrapper[2578]: W0709 18:58:21.811364    2578 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 09 18:58:21.814788 ip-10-0-139-134 kubenswrapper[2578]: W0709 18:58:21.811366    2578 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 09 18:58:21.814788 ip-10-0-139-134 kubenswrapper[2578]: W0709 18:58:21.811369    2578 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 09 18:58:21.814788 ip-10-0-139-134 kubenswrapper[2578]: W0709 18:58:21.811372    2578 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 09 18:58:21.814788 ip-10-0-139-134 kubenswrapper[2578]: W0709 18:58:21.811375    2578 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 09 18:58:21.814788 ip-10-0-139-134 kubenswrapper[2578]: W0709 18:58:21.811378    2578 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 09 18:58:21.814788 ip-10-0-139-134 kubenswrapper[2578]: W0709 18:58:21.811381    2578 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 09 18:58:21.814788 ip-10-0-139-134 kubenswrapper[2578]: W0709 18:58:21.811383    2578 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 09 18:58:21.814788 ip-10-0-139-134 kubenswrapper[2578]: W0709 18:58:21.811385    2578 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 09 18:58:21.814788 ip-10-0-139-134 kubenswrapper[2578]: W0709 18:58:21.811388    2578 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 09 18:58:21.814788 ip-10-0-139-134 kubenswrapper[2578]: W0709 18:58:21.811392    2578 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 09 18:58:21.814788 ip-10-0-139-134 kubenswrapper[2578]: W0709 18:58:21.811395    2578 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 09 18:58:21.814788 ip-10-0-139-134 kubenswrapper[2578]: W0709 18:58:21.811398    2578 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 09 18:58:21.814788 ip-10-0-139-134 kubenswrapper[2578]: W0709 18:58:21.811401    2578 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 09 18:58:21.814788 ip-10-0-139-134 kubenswrapper[2578]: W0709 18:58:21.811403    2578 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 09 18:58:21.814788 ip-10-0-139-134 kubenswrapper[2578]: W0709 18:58:21.811406    2578 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 09 18:58:21.814788 ip-10-0-139-134 kubenswrapper[2578]: W0709 18:58:21.811409    2578 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 09 18:58:21.814788 ip-10-0-139-134 kubenswrapper[2578]: W0709 18:58:21.811411    2578 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 09 18:58:21.814788 ip-10-0-139-134 kubenswrapper[2578]: W0709 18:58:21.811413    2578 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 09 18:58:21.814788 ip-10-0-139-134 kubenswrapper[2578]: W0709 18:58:21.811843    2578 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 09 18:58:21.815260 ip-10-0-139-134 kubenswrapper[2578]: W0709 18:58:21.811850    2578 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 09 18:58:21.815260 ip-10-0-139-134 kubenswrapper[2578]: W0709 18:58:21.811853    2578 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 09 18:58:21.815260 ip-10-0-139-134 kubenswrapper[2578]: W0709 18:58:21.811856    2578 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 09 18:58:21.815260 ip-10-0-139-134 kubenswrapper[2578]: W0709 18:58:21.811858    2578 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 09 18:58:21.815260 ip-10-0-139-134 kubenswrapper[2578]: W0709 18:58:21.811861    2578 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 09 18:58:21.815260 ip-10-0-139-134 kubenswrapper[2578]: W0709 18:58:21.811864    2578 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 09 18:58:21.815260 ip-10-0-139-134 kubenswrapper[2578]: W0709 18:58:21.811867    2578 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 09 18:58:21.815260 ip-10-0-139-134 kubenswrapper[2578]: W0709 18:58:21.811870    2578 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 09 18:58:21.815260 ip-10-0-139-134 kubenswrapper[2578]: W0709 18:58:21.811873    2578 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 09 18:58:21.815260 ip-10-0-139-134 kubenswrapper[2578]: W0709 18:58:21.811877    2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 09 18:58:21.815260 ip-10-0-139-134 kubenswrapper[2578]: W0709 18:58:21.811879    2578 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 09 18:58:21.815260 ip-10-0-139-134 kubenswrapper[2578]: W0709 18:58:21.811882    2578 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 09 18:58:21.815260 ip-10-0-139-134 kubenswrapper[2578]: W0709 18:58:21.811885    2578 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 09 18:58:21.815260 ip-10-0-139-134 kubenswrapper[2578]: W0709 18:58:21.811888    2578 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 09 18:58:21.815260 ip-10-0-139-134 kubenswrapper[2578]: W0709 18:58:21.811890    2578 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 09 18:58:21.815260 ip-10-0-139-134 kubenswrapper[2578]: W0709 18:58:21.811893    2578 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 09 18:58:21.815260 ip-10-0-139-134 kubenswrapper[2578]: W0709 18:58:21.811896    2578 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 09 18:58:21.815260 ip-10-0-139-134 kubenswrapper[2578]: W0709 18:58:21.811899    2578 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 09 18:58:21.815260 ip-10-0-139-134 kubenswrapper[2578]: W0709 18:58:21.811901    2578 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 09 18:58:21.815260 ip-10-0-139-134 kubenswrapper[2578]: W0709 18:58:21.811904    2578 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 09 18:58:21.815775 ip-10-0-139-134 kubenswrapper[2578]: W0709 18:58:21.811908    2578 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 09 18:58:21.815775 ip-10-0-139-134 kubenswrapper[2578]: W0709 18:58:21.811911    2578 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 09 18:58:21.815775 ip-10-0-139-134 kubenswrapper[2578]: W0709 18:58:21.811915    2578 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 09 18:58:21.815775 ip-10-0-139-134 kubenswrapper[2578]: W0709 18:58:21.811917    2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 09 18:58:21.815775 ip-10-0-139-134 kubenswrapper[2578]: W0709 18:58:21.811921    2578 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 09 18:58:21.815775 ip-10-0-139-134 kubenswrapper[2578]: W0709 18:58:21.811923    2578 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 09 18:58:21.815775 ip-10-0-139-134 kubenswrapper[2578]: W0709 18:58:21.811926    2578 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 09 18:58:21.815775 ip-10-0-139-134 kubenswrapper[2578]: W0709 18:58:21.811929    2578 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 09 18:58:21.815775 ip-10-0-139-134 kubenswrapper[2578]: W0709 18:58:21.811933    2578 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 09 18:58:21.815775 ip-10-0-139-134 kubenswrapper[2578]: W0709 18:58:21.811935    2578 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 09 18:58:21.815775 ip-10-0-139-134 kubenswrapper[2578]: W0709 18:58:21.811938    2578 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 09 18:58:21.815775 ip-10-0-139-134 kubenswrapper[2578]: W0709 18:58:21.811942    2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 09 18:58:21.815775 ip-10-0-139-134 kubenswrapper[2578]: W0709 18:58:21.811944    2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 09 18:58:21.815775 ip-10-0-139-134 kubenswrapper[2578]: W0709 18:58:21.811947    2578 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 09 18:58:21.815775 ip-10-0-139-134 kubenswrapper[2578]: W0709 18:58:21.811950    2578 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 09 18:58:21.815775 ip-10-0-139-134 kubenswrapper[2578]: W0709 18:58:21.811952    2578 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 09 18:58:21.815775 ip-10-0-139-134 kubenswrapper[2578]: W0709 18:58:21.811955    2578 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 09 18:58:21.815775 ip-10-0-139-134 kubenswrapper[2578]: W0709 18:58:21.811958    2578 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 09 18:58:21.815775 ip-10-0-139-134 kubenswrapper[2578]: W0709 18:58:21.811961    2578 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 09 18:58:21.816239 ip-10-0-139-134 kubenswrapper[2578]: W0709 18:58:21.811964    2578 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 09 18:58:21.816239 ip-10-0-139-134 kubenswrapper[2578]: W0709 18:58:21.811967    2578 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 09 18:58:21.816239 ip-10-0-139-134 kubenswrapper[2578]: W0709 18:58:21.811970    2578 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 09 18:58:21.816239 ip-10-0-139-134 kubenswrapper[2578]: W0709 18:58:21.811973    2578 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 09 18:58:21.816239 ip-10-0-139-134 kubenswrapper[2578]: W0709 18:58:21.811976    2578 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 09 18:58:21.816239 ip-10-0-139-134 kubenswrapper[2578]: W0709 18:58:21.811978    2578 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 09 18:58:21.816239 ip-10-0-139-134 kubenswrapper[2578]: W0709 18:58:21.811981    2578 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 09 18:58:21.816239 ip-10-0-139-134 kubenswrapper[2578]: W0709 18:58:21.811983    2578 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 09 18:58:21.816239 ip-10-0-139-134 kubenswrapper[2578]: W0709 18:58:21.811985    2578 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 09 18:58:21.816239 ip-10-0-139-134 kubenswrapper[2578]: W0709 18:58:21.811988    2578 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 09 18:58:21.816239 ip-10-0-139-134 kubenswrapper[2578]: W0709 18:58:21.811991    2578 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 09 18:58:21.816239 ip-10-0-139-134 kubenswrapper[2578]: W0709 18:58:21.811993    2578 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 09 18:58:21.816239 ip-10-0-139-134 kubenswrapper[2578]: W0709 18:58:21.811996    2578 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 09 18:58:21.816239 ip-10-0-139-134 kubenswrapper[2578]: W0709 18:58:21.811998    2578 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 09 18:58:21.816239 ip-10-0-139-134 kubenswrapper[2578]: W0709 18:58:21.812001    2578 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 09 18:58:21.816239 ip-10-0-139-134 kubenswrapper[2578]: W0709 18:58:21.812003    2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 09 18:58:21.816239 ip-10-0-139-134 kubenswrapper[2578]: W0709 18:58:21.812005    2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 09 18:58:21.816239 ip-10-0-139-134 kubenswrapper[2578]: W0709 18:58:21.812008    2578 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 09 18:58:21.816239 ip-10-0-139-134 kubenswrapper[2578]: W0709 18:58:21.812011    2578 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 09 18:58:21.816719 ip-10-0-139-134 kubenswrapper[2578]: W0709 18:58:21.812015    2578 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 09 18:58:21.816719 ip-10-0-139-134 kubenswrapper[2578]: W0709 18:58:21.812018    2578 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 09 18:58:21.816719 ip-10-0-139-134 kubenswrapper[2578]: W0709 18:58:21.812023    2578 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 09 18:58:21.816719 ip-10-0-139-134 kubenswrapper[2578]: W0709 18:58:21.812026    2578 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 09 18:58:21.816719 ip-10-0-139-134 kubenswrapper[2578]: W0709 18:58:21.812029    2578 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 09 18:58:21.816719 ip-10-0-139-134 kubenswrapper[2578]: W0709 18:58:21.812031    2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 09 18:58:21.816719 ip-10-0-139-134 kubenswrapper[2578]: W0709 18:58:21.812034    2578 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 09 18:58:21.816719 ip-10-0-139-134 kubenswrapper[2578]: W0709 18:58:21.812036    2578 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 09 18:58:21.816719 ip-10-0-139-134 kubenswrapper[2578]: W0709 18:58:21.812038    2578 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 09 18:58:21.816719 ip-10-0-139-134 kubenswrapper[2578]: W0709 18:58:21.812041    2578 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 09 18:58:21.816719 ip-10-0-139-134 kubenswrapper[2578]: W0709 18:58:21.812043    2578 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 09 18:58:21.816719 ip-10-0-139-134 kubenswrapper[2578]: W0709 18:58:21.812045    2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 09 18:58:21.816719 ip-10-0-139-134 kubenswrapper[2578]: W0709 18:58:21.812048    2578 feature_gate.go:328] unrecognized feature gate: Example2
Jul 09 18:58:21.816719 ip-10-0-139-134 kubenswrapper[2578]: W0709 18:58:21.812050    2578 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 09 18:58:21.816719 ip-10-0-139-134 kubenswrapper[2578]: W0709 18:58:21.812053    2578 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 09 18:58:21.816719 ip-10-0-139-134 kubenswrapper[2578]: W0709 18:58:21.812056    2578 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 09 18:58:21.816719 ip-10-0-139-134 kubenswrapper[2578]: W0709 18:58:21.812058    2578 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 09 18:58:21.816719 ip-10-0-139-134 kubenswrapper[2578]: W0709 18:58:21.812061    2578 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 09 18:58:21.816719 ip-10-0-139-134 kubenswrapper[2578]: W0709 18:58:21.812063    2578 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 09 18:58:21.817195 ip-10-0-139-134 kubenswrapper[2578]: W0709 18:58:21.812066    2578 feature_gate.go:328] unrecognized feature gate: Example
Jul 09 18:58:21.817195 ip-10-0-139-134 kubenswrapper[2578]: W0709 18:58:21.812068    2578 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 09 18:58:21.817195 ip-10-0-139-134 kubenswrapper[2578]: W0709 18:58:21.812071    2578 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 09 18:58:21.817195 ip-10-0-139-134 kubenswrapper[2578]: W0709 18:58:21.812075    2578 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 09 18:58:21.817195 ip-10-0-139-134 kubenswrapper[2578]: W0709 18:58:21.812077    2578 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 09 18:58:21.817195 ip-10-0-139-134 kubenswrapper[2578]: W0709 18:58:21.812080    2578 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 09 18:58:21.817195 ip-10-0-139-134 kubenswrapper[2578]: W0709 18:58:21.812082    2578 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 09 18:58:21.817195 ip-10-0-139-134 kubenswrapper[2578]: W0709 18:58:21.812085    2578 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 09 18:58:21.817195 ip-10-0-139-134 kubenswrapper[2578]: W0709 18:58:21.812087    2578 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 09 18:58:21.817195 ip-10-0-139-134 kubenswrapper[2578]: W0709 18:58:21.812089    2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 09 18:58:21.817195 ip-10-0-139-134 kubenswrapper[2578]: W0709 18:58:21.812092    2578 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 09 18:58:21.817195 ip-10-0-139-134 kubenswrapper[2578]: W0709 18:58:21.812094    2578 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 09 18:58:21.817195 ip-10-0-139-134 kubenswrapper[2578]: W0709 18:58:21.812096    2578 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 09 18:58:21.817195 ip-10-0-139-134 kubenswrapper[2578]: W0709 18:58:21.812099    2578 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 09 18:58:21.817195 ip-10-0-139-134 kubenswrapper[2578]: W0709 18:58:21.812101    2578 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 09 18:58:21.817195 ip-10-0-139-134 kubenswrapper[2578]: W0709 18:58:21.812105    2578 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 09 18:58:21.817195 ip-10-0-139-134 kubenswrapper[2578]: W0709 18:58:21.812108    2578 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 09 18:58:21.817195 ip-10-0-139-134 kubenswrapper[2578]: W0709 18:58:21.812110    2578 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 09 18:58:21.817195 ip-10-0-139-134 kubenswrapper[2578]: W0709 18:58:21.812112    2578 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 09 18:58:21.817195 ip-10-0-139-134 kubenswrapper[2578]: W0709 18:58:21.812115    2578 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 09 18:58:21.817702 ip-10-0-139-134 kubenswrapper[2578]: W0709 18:58:21.812117    2578 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 09 18:58:21.817702 ip-10-0-139-134 kubenswrapper[2578]: I0709 18:58:21.812186    2578 flags.go:64] FLAG: --address="0.0.0.0"
Jul 09 18:58:21.817702 ip-10-0-139-134 kubenswrapper[2578]: I0709 18:58:21.812194    2578 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]"
Jul 09 18:58:21.817702 ip-10-0-139-134 kubenswrapper[2578]: I0709 18:58:21.812200    2578 flags.go:64] FLAG: --anonymous-auth="true"
Jul 09 18:58:21.817702 ip-10-0-139-134 kubenswrapper[2578]: I0709 18:58:21.812205    2578 flags.go:64] FLAG: --application-metrics-count-limit="100"
Jul 09 18:58:21.817702 ip-10-0-139-134 kubenswrapper[2578]: I0709 18:58:21.812211    2578 flags.go:64] FLAG: --authentication-token-webhook="false"
Jul 09 18:58:21.817702 ip-10-0-139-134 kubenswrapper[2578]: I0709 18:58:21.812216    2578 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s"
Jul 09 18:58:21.817702 ip-10-0-139-134 kubenswrapper[2578]: I0709 18:58:21.812222    2578 flags.go:64] FLAG: --authorization-mode="AlwaysAllow"
Jul 09 18:58:21.817702 ip-10-0-139-134 kubenswrapper[2578]: I0709 18:58:21.812228    2578 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s"
Jul 09 18:58:21.817702 ip-10-0-139-134 kubenswrapper[2578]: I0709 18:58:21.812233    2578 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s"
Jul 09 18:58:21.817702 ip-10-0-139-134 kubenswrapper[2578]: I0709 18:58:21.812238    2578 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id"
Jul 09 18:58:21.817702 ip-10-0-139-134 kubenswrapper[2578]: I0709 18:58:21.812244    2578 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig"
Jul 09 18:58:21.817702 ip-10-0-139-134 kubenswrapper[2578]: I0709 18:58:21.812247    2578 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki"
Jul 09 18:58:21.817702 ip-10-0-139-134 kubenswrapper[2578]: I0709 18:58:21.812250    2578 flags.go:64] FLAG: --cgroup-driver="cgroupfs"
Jul 09 18:58:21.817702 ip-10-0-139-134 kubenswrapper[2578]: I0709 18:58:21.812253    2578 flags.go:64] FLAG: --cgroup-root=""
Jul 09 18:58:21.817702 ip-10-0-139-134 kubenswrapper[2578]: I0709 18:58:21.812258    2578 flags.go:64] FLAG: --cgroups-per-qos="true"
Jul 09 18:58:21.817702 ip-10-0-139-134 kubenswrapper[2578]: I0709 18:58:21.812261    2578 flags.go:64] FLAG: --client-ca-file=""
Jul 09 18:58:21.817702 ip-10-0-139-134 kubenswrapper[2578]: I0709 18:58:21.812264    2578 flags.go:64] FLAG: --cloud-provider="external"
Jul 09 18:58:21.817702 ip-10-0-139-134 kubenswrapper[2578]: I0709 18:58:21.812266    2578 flags.go:64] FLAG: --cluster-dns="[]"
Jul 09 18:58:21.817702 ip-10-0-139-134 kubenswrapper[2578]: I0709 18:58:21.812270    2578 flags.go:64] FLAG: --cluster-domain=""
Jul 09 18:58:21.817702 ip-10-0-139-134 kubenswrapper[2578]: I0709 18:58:21.812273    2578 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf"
Jul 09 18:58:21.817702 ip-10-0-139-134 kubenswrapper[2578]: I0709 18:58:21.812277    2578 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d"
Jul 09 18:58:21.817702 ip-10-0-139-134 kubenswrapper[2578]: I0709 18:58:21.812280    2578 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json"
Jul 09 18:58:21.817702 ip-10-0-139-134 kubenswrapper[2578]: I0709 18:58:21.812283    2578 flags.go:64] FLAG: --container-log-max-files="5"
Jul 09 18:58:21.818292 ip-10-0-139-134 kubenswrapper[2578]: I0709 18:58:21.812287    2578 flags.go:64] FLAG: --container-log-max-size="10Mi"
Jul 09 18:58:21.818292 ip-10-0-139-134 kubenswrapper[2578]: I0709 18:58:21.812290    2578 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock"
Jul 09 18:58:21.818292 ip-10-0-139-134 kubenswrapper[2578]: I0709 18:58:21.812293    2578 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock"
Jul 09 18:58:21.818292 ip-10-0-139-134 kubenswrapper[2578]: I0709 18:58:21.812298    2578 flags.go:64] FLAG: --containerd-namespace="k8s.io"
Jul 09 18:58:21.818292 ip-10-0-139-134 kubenswrapper[2578]: I0709 18:58:21.812301    2578 flags.go:64] FLAG: --contention-profiling="false"
Jul 09 18:58:21.818292 ip-10-0-139-134 kubenswrapper[2578]: I0709 18:58:21.812304    2578 flags.go:64] FLAG: --cpu-cfs-quota="true"
Jul 09 18:58:21.818292 ip-10-0-139-134 kubenswrapper[2578]: I0709 18:58:21.812307    2578 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms"
Jul 09 18:58:21.818292 ip-10-0-139-134 kubenswrapper[2578]: I0709 18:58:21.812310    2578 flags.go:64] FLAG: --cpu-manager-policy="none"
Jul 09 18:58:21.818292 ip-10-0-139-134 kubenswrapper[2578]: I0709 18:58:21.812313    2578 flags.go:64] FLAG: --cpu-manager-policy-options=""
Jul 09 18:58:21.818292 ip-10-0-139-134 kubenswrapper[2578]: I0709 18:58:21.812317    2578 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s"
Jul 09 18:58:21.818292 ip-10-0-139-134 kubenswrapper[2578]: I0709 18:58:21.812320    2578 flags.go:64] FLAG: --enable-controller-attach-detach="true"
Jul 09 18:58:21.818292 ip-10-0-139-134 kubenswrapper[2578]: I0709 18:58:21.812323    2578 flags.go:64] FLAG: --enable-debugging-handlers="true"
Jul 09 18:58:21.818292 ip-10-0-139-134 kubenswrapper[2578]: I0709 18:58:21.812326    2578 flags.go:64] FLAG: --enable-load-reader="false"
Jul 09 18:58:21.818292 ip-10-0-139-134 kubenswrapper[2578]: I0709 18:58:21.812329    2578 flags.go:64] FLAG: --enable-server="true"
Jul 09 18:58:21.818292 ip-10-0-139-134 kubenswrapper[2578]: I0709 18:58:21.812332    2578 flags.go:64] FLAG: --enforce-node-allocatable="[pods]"
Jul 09 18:58:21.818292 ip-10-0-139-134 kubenswrapper[2578]: I0709 18:58:21.812336    2578 flags.go:64] FLAG: --event-burst="100"
Jul 09 18:58:21.818292 ip-10-0-139-134 kubenswrapper[2578]: I0709 18:58:21.812339    2578 flags.go:64] FLAG: --event-qps="50"
Jul 09 18:58:21.818292 ip-10-0-139-134 kubenswrapper[2578]: I0709 18:58:21.812342    2578 flags.go:64] FLAG: --event-storage-age-limit="default=0"
Jul 09 18:58:21.818292 ip-10-0-139-134 kubenswrapper[2578]: I0709 18:58:21.812345    2578 flags.go:64] FLAG: --event-storage-event-limit="default=0"
Jul 09 18:58:21.818292 ip-10-0-139-134 kubenswrapper[2578]: I0709 18:58:21.812348    2578 flags.go:64] FLAG: --eviction-hard=""
Jul 09 18:58:21.818292 ip-10-0-139-134 kubenswrapper[2578]: I0709 18:58:21.812352    2578 flags.go:64] FLAG: --eviction-max-pod-grace-period="0"
Jul 09 18:58:21.818292 ip-10-0-139-134 kubenswrapper[2578]: I0709 18:58:21.812355    2578 flags.go:64] FLAG: --eviction-minimum-reclaim=""
Jul 09 18:58:21.818292 ip-10-0-139-134 kubenswrapper[2578]: I0709 18:58:21.812358    2578 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s"
Jul 09 18:58:21.818292 ip-10-0-139-134 kubenswrapper[2578]: I0709 18:58:21.812362    2578 flags.go:64] FLAG: --eviction-soft=""
Jul 09 18:58:21.818292 ip-10-0-139-134 kubenswrapper[2578]: I0709 18:58:21.812365    2578 flags.go:64] FLAG: --eviction-soft-grace-period=""
Jul 09 18:58:21.818917 ip-10-0-139-134 kubenswrapper[2578]: I0709 18:58:21.812368    2578 flags.go:64] FLAG: --exit-on-lock-contention="false"
Jul 09 18:58:21.818917 ip-10-0-139-134 kubenswrapper[2578]: I0709 18:58:21.812371    2578 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false"
Jul 09 18:58:21.818917 ip-10-0-139-134 kubenswrapper[2578]: I0709 18:58:21.812374    2578 flags.go:64] FLAG: --experimental-mounter-path=""
Jul 09 18:58:21.818917 ip-10-0-139-134 kubenswrapper[2578]: I0709 18:58:21.812377    2578 flags.go:64] FLAG: --fail-cgroupv1="false"
Jul 09 18:58:21.818917 ip-10-0-139-134 kubenswrapper[2578]: I0709 18:58:21.812379    2578 flags.go:64] FLAG: --fail-swap-on="true"
Jul 09 18:58:21.818917 ip-10-0-139-134 kubenswrapper[2578]: I0709 18:58:21.812382    2578 flags.go:64] FLAG: --feature-gates=""
Jul 09 18:58:21.818917 ip-10-0-139-134 kubenswrapper[2578]: I0709 18:58:21.812386    2578 flags.go:64] FLAG: --file-check-frequency="20s"
Jul 09 18:58:21.818917 ip-10-0-139-134 kubenswrapper[2578]: I0709 18:58:21.812388    2578 flags.go:64] FLAG: --global-housekeeping-interval="1m0s"
Jul 09 18:58:21.818917 ip-10-0-139-134 kubenswrapper[2578]: I0709 18:58:21.812391    2578 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge"
Jul 09 18:58:21.818917 ip-10-0-139-134 kubenswrapper[2578]: I0709 18:58:21.812394    2578 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1"
Jul 09 18:58:21.818917 ip-10-0-139-134 kubenswrapper[2578]: I0709 18:58:21.812398    2578 flags.go:64] FLAG: --healthz-port="10248"
Jul 09 18:58:21.818917 ip-10-0-139-134 kubenswrapper[2578]: I0709 18:58:21.812402    2578 flags.go:64] FLAG: --help="false"
Jul 09 18:58:21.818917 ip-10-0-139-134 kubenswrapper[2578]: I0709 18:58:21.812405    2578 flags.go:64] FLAG: --hostname-override="ip-10-0-139-134.ec2.internal"
Jul 09 18:58:21.818917 ip-10-0-139-134 kubenswrapper[2578]: I0709 18:58:21.812408    2578 flags.go:64] FLAG: --housekeeping-interval="10s"
Jul 09 18:58:21.818917 ip-10-0-139-134 kubenswrapper[2578]: I0709 18:58:21.812411    2578 flags.go:64] FLAG: --http-check-frequency="20s"
Jul 09 18:58:21.818917 ip-10-0-139-134 kubenswrapper[2578]: I0709 18:58:21.812413    2578 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins"
Jul 09 18:58:21.818917 ip-10-0-139-134 kubenswrapper[2578]: I0709 18:58:21.812417    2578 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml"
Jul 09 18:58:21.818917 ip-10-0-139-134 kubenswrapper[2578]: I0709 18:58:21.812420    2578 flags.go:64] FLAG: --image-gc-high-threshold="85"
Jul 09 18:58:21.818917 ip-10-0-139-134 kubenswrapper[2578]: I0709 18:58:21.812422    2578 flags.go:64] FLAG: --image-gc-low-threshold="80"
Jul 09 18:58:21.818917 ip-10-0-139-134 kubenswrapper[2578]: I0709 18:58:21.812426    2578 flags.go:64] FLAG: --image-service-endpoint=""
Jul 09 18:58:21.818917 ip-10-0-139-134 kubenswrapper[2578]: I0709 18:58:21.812428    2578 flags.go:64] FLAG: --kernel-memcg-notification="false"
Jul 09 18:58:21.818917 ip-10-0-139-134 kubenswrapper[2578]: I0709 18:58:21.812431    2578 flags.go:64] FLAG: --kube-api-burst="100"
Jul 09 18:58:21.818917 ip-10-0-139-134 kubenswrapper[2578]: I0709 18:58:21.812434    2578 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf"
Jul 09 18:58:21.819659 ip-10-0-139-134 kubenswrapper[2578]: I0709 18:58:21.812437    2578 flags.go:64] FLAG: --kube-api-qps="50"
Jul 09 18:58:21.819659 ip-10-0-139-134 kubenswrapper[2578]: I0709 18:58:21.812440    2578 flags.go:64] FLAG: --kube-reserved=""
Jul 09 18:58:21.819659 ip-10-0-139-134 kubenswrapper[2578]: I0709 18:58:21.812443    2578 flags.go:64] FLAG: --kube-reserved-cgroup=""
Jul 09 18:58:21.819659 ip-10-0-139-134 kubenswrapper[2578]: I0709 18:58:21.812446    2578 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig"
Jul 09 18:58:21.819659 ip-10-0-139-134 kubenswrapper[2578]: I0709 18:58:21.812449    2578 flags.go:64] FLAG: --kubelet-cgroups=""
Jul 09 18:58:21.819659 ip-10-0-139-134 kubenswrapper[2578]: I0709 18:58:21.812452    2578 flags.go:64] FLAG: --local-storage-capacity-isolation="true"
Jul 09 18:58:21.819659 ip-10-0-139-134 kubenswrapper[2578]: I0709 18:58:21.812455    2578 flags.go:64] FLAG: --lock-file=""
Jul 09 18:58:21.819659 ip-10-0-139-134 kubenswrapper[2578]: I0709 18:58:21.812459    2578 flags.go:64] FLAG: --log-cadvisor-usage="false"
Jul 09 18:58:21.819659 ip-10-0-139-134 kubenswrapper[2578]: I0709 18:58:21.812462    2578 flags.go:64] FLAG: --log-flush-frequency="5s"
Jul 09 18:58:21.819659 ip-10-0-139-134 kubenswrapper[2578]: I0709 18:58:21.812479    2578 flags.go:64] FLAG: --log-json-info-buffer-size="0"
Jul 09 18:58:21.819659 ip-10-0-139-134 kubenswrapper[2578]: I0709 18:58:21.812485    2578 flags.go:64] FLAG: --log-json-split-stream="false"
Jul 09 18:58:21.819659 ip-10-0-139-134 kubenswrapper[2578]: I0709 18:58:21.812488    2578 flags.go:64] FLAG: --log-text-info-buffer-size="0"
Jul 09 18:58:21.819659 ip-10-0-139-134 kubenswrapper[2578]: I0709 18:58:21.812491    2578 flags.go:64] FLAG: --log-text-split-stream="false"
Jul 09 18:58:21.819659 ip-10-0-139-134 kubenswrapper[2578]: I0709 18:58:21.812494    2578 flags.go:64] FLAG: --logging-format="text"
Jul 09 18:58:21.819659 ip-10-0-139-134 kubenswrapper[2578]: I0709 18:58:21.812496    2578 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id"
Jul 09 18:58:21.819659 ip-10-0-139-134 kubenswrapper[2578]: I0709 18:58:21.812500    2578 flags.go:64] FLAG: --make-iptables-util-chains="true"
Jul 09 18:58:21.819659 ip-10-0-139-134 kubenswrapper[2578]: I0709 18:58:21.812502    2578 flags.go:64] FLAG: --manifest-url=""
Jul 09 18:58:21.819659 ip-10-0-139-134 kubenswrapper[2578]: I0709 18:58:21.812505    2578 flags.go:64] FLAG: --manifest-url-header=""
Jul 09 18:58:21.819659 ip-10-0-139-134 kubenswrapper[2578]: I0709 18:58:21.812510    2578 flags.go:64] FLAG: --max-housekeeping-interval="15s"
Jul 09 18:58:21.819659 ip-10-0-139-134 kubenswrapper[2578]: I0709 18:58:21.812514    2578 flags.go:64] FLAG: --max-open-files="1000000"
Jul 09 18:58:21.819659 ip-10-0-139-134 kubenswrapper[2578]: I0709 18:58:21.812518    2578 flags.go:64] FLAG: --max-pods="110"
Jul 09 18:58:21.819659 ip-10-0-139-134 kubenswrapper[2578]: I0709 18:58:21.812521    2578 flags.go:64] FLAG: --maximum-dead-containers="-1"
Jul 09 18:58:21.819659 ip-10-0-139-134 kubenswrapper[2578]: I0709 18:58:21.812523    2578 flags.go:64] FLAG: --maximum-dead-containers-per-container="1"
Jul 09 18:58:21.819659 ip-10-0-139-134 kubenswrapper[2578]: I0709 18:58:21.812527    2578 flags.go:64] FLAG: --memory-manager-policy="None"
Jul 09 18:58:21.819659 ip-10-0-139-134 kubenswrapper[2578]: I0709 18:58:21.812530    2578 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s"
Jul 09 18:58:21.820643 ip-10-0-139-134 kubenswrapper[2578]: I0709 18:58:21.812532    2578 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s"
Jul 09 18:58:21.820643 ip-10-0-139-134 kubenswrapper[2578]: I0709 18:58:21.812535    2578 flags.go:64] FLAG: --node-ip="0.0.0.0"
Jul 09 18:58:21.820643 ip-10-0-139-134 kubenswrapper[2578]: I0709 18:58:21.812538    2578 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel"
Jul 09 18:58:21.820643 ip-10-0-139-134 kubenswrapper[2578]: I0709 18:58:21.812545    2578 flags.go:64] FLAG: --node-status-max-images="50"
Jul 09 18:58:21.820643 ip-10-0-139-134 kubenswrapper[2578]: I0709 18:58:21.812548    2578 flags.go:64] FLAG: --node-status-update-frequency="10s"
Jul 09 18:58:21.820643 ip-10-0-139-134 kubenswrapper[2578]: I0709 18:58:21.812551    2578 flags.go:64] FLAG: --oom-score-adj="-999"
Jul 09 18:58:21.820643 ip-10-0-139-134 kubenswrapper[2578]: I0709 18:58:21.812554    2578 flags.go:64] FLAG: --pod-cidr=""
Jul 09 18:58:21.820643 ip-10-0-139-134 kubenswrapper[2578]: I0709 18:58:21.812557    2578 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:b04c0b1f73af4d021dd8f0b51bfeb302c24482c093de5f2c43654ab56c506926"
Jul 09 18:58:21.820643 ip-10-0-139-134 kubenswrapper[2578]: I0709 18:58:21.812562    2578 flags.go:64] FLAG: --pod-manifest-path=""
Jul 09 18:58:21.820643 ip-10-0-139-134 kubenswrapper[2578]: I0709 18:58:21.812565    2578 flags.go:64] FLAG: --pod-max-pids="-1"
Jul 09 18:58:21.820643 ip-10-0-139-134 kubenswrapper[2578]: I0709 18:58:21.812568    2578 flags.go:64] FLAG: --pods-per-core="0"
Jul 09 18:58:21.820643 ip-10-0-139-134 kubenswrapper[2578]: I0709 18:58:21.812571    2578 flags.go:64] FLAG: --port="10250"
Jul 09 18:58:21.820643 ip-10-0-139-134 kubenswrapper[2578]: I0709 18:58:21.812574    2578 flags.go:64] FLAG: --protect-kernel-defaults="false"
Jul 09 18:58:21.820643 ip-10-0-139-134 kubenswrapper[2578]: I0709 18:58:21.812577    2578 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-00ea108559f0ac0e5"
Jul 09 18:58:21.820643 ip-10-0-139-134 kubenswrapper[2578]: I0709 18:58:21.812582    2578 flags.go:64] FLAG: --qos-reserved=""
Jul 09 18:58:21.820643 ip-10-0-139-134 kubenswrapper[2578]: I0709 18:58:21.812585    2578 flags.go:64] FLAG: --read-only-port="10255"
Jul 09 18:58:21.820643 ip-10-0-139-134 kubenswrapper[2578]: I0709 18:58:21.812588    2578 flags.go:64] FLAG: --register-node="true"
Jul 09 18:58:21.820643 ip-10-0-139-134 kubenswrapper[2578]: I0709 18:58:21.812591    2578 flags.go:64] FLAG: --register-with-taints=""
Jul 09 18:58:21.820643 ip-10-0-139-134 kubenswrapper[2578]: I0709 18:58:21.812594    2578 flags.go:64] FLAG: --registry-burst="10"
Jul 09 18:58:21.820643 ip-10-0-139-134 kubenswrapper[2578]: I0709 18:58:21.812597    2578 flags.go:64] FLAG: --registry-qps="5"
Jul 09 18:58:21.820643 ip-10-0-139-134 kubenswrapper[2578]: I0709 18:58:21.812600    2578 flags.go:64] FLAG: --reserved-cpus=""
Jul 09 18:58:21.820643 ip-10-0-139-134 kubenswrapper[2578]: I0709 18:58:21.812602    2578 flags.go:64] FLAG: --reserved-memory=""
Jul 09 18:58:21.820643 ip-10-0-139-134 kubenswrapper[2578]: I0709 18:58:21.812606    2578 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf"
Jul 09 18:58:21.820643 ip-10-0-139-134 kubenswrapper[2578]: I0709 18:58:21.812609    2578 flags.go:64] FLAG: --root-dir="/var/lib/kubelet"
Jul 09 18:58:21.820643 ip-10-0-139-134 kubenswrapper[2578]: I0709 18:58:21.812612    2578 flags.go:64] FLAG: --rotate-certificates="false"
Jul 09 18:58:21.821304 ip-10-0-139-134 kubenswrapper[2578]: I0709 18:58:21.812615    2578 flags.go:64] FLAG: --rotate-server-certificates="false"
Jul 09 18:58:21.821304 ip-10-0-139-134 kubenswrapper[2578]: I0709 18:58:21.812618    2578 flags.go:64] FLAG: --runonce="false"
Jul 09 18:58:21.821304 ip-10-0-139-134 kubenswrapper[2578]: I0709 18:58:21.812623    2578 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service"
Jul 09 18:58:21.821304 ip-10-0-139-134 kubenswrapper[2578]: I0709 18:58:21.812626    2578 flags.go:64] FLAG: --runtime-request-timeout="2m0s"
Jul 09 18:58:21.821304 ip-10-0-139-134 kubenswrapper[2578]: I0709 18:58:21.812629    2578 flags.go:64] FLAG: --seccomp-default="false"
Jul 09 18:58:21.821304 ip-10-0-139-134 kubenswrapper[2578]: I0709 18:58:21.812632    2578 flags.go:64] FLAG: --serialize-image-pulls="true"
Jul 09 18:58:21.821304 ip-10-0-139-134 kubenswrapper[2578]: I0709 18:58:21.812635    2578 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s"
Jul 09 18:58:21.821304 ip-10-0-139-134 kubenswrapper[2578]: I0709 18:58:21.812638    2578 flags.go:64] FLAG: --storage-driver-db="cadvisor"
Jul 09 18:58:21.821304 ip-10-0-139-134 kubenswrapper[2578]: I0709 18:58:21.812641    2578 flags.go:64] FLAG: --storage-driver-host="localhost:8086"
Jul 09 18:58:21.821304 ip-10-0-139-134 kubenswrapper[2578]: I0709 18:58:21.812644    2578 flags.go:64] FLAG: --storage-driver-password="root"
Jul 09 18:58:21.821304 ip-10-0-139-134 kubenswrapper[2578]: I0709 18:58:21.812647    2578 flags.go:64] FLAG: --storage-driver-secure="false"
Jul 09 18:58:21.821304 ip-10-0-139-134 kubenswrapper[2578]: I0709 18:58:21.812649    2578 flags.go:64] FLAG: --storage-driver-table="stats"
Jul 09 18:58:21.821304 ip-10-0-139-134 kubenswrapper[2578]: I0709 18:58:21.812653    2578 flags.go:64] FLAG: --storage-driver-user="root"
Jul 09 18:58:21.821304 ip-10-0-139-134 kubenswrapper[2578]: I0709 18:58:21.812655    2578 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s"
Jul 09 18:58:21.821304 ip-10-0-139-134 kubenswrapper[2578]: I0709 18:58:21.812658    2578 flags.go:64] FLAG: --sync-frequency="1m0s"
Jul 09 18:58:21.821304 ip-10-0-139-134 kubenswrapper[2578]: I0709 18:58:21.812661    2578 flags.go:64] FLAG: --system-cgroups=""
Jul 09 18:58:21.821304 ip-10-0-139-134 kubenswrapper[2578]: I0709 18:58:21.812664    2578 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi"
Jul 09 18:58:21.821304 ip-10-0-139-134 kubenswrapper[2578]: I0709 18:58:21.812669    2578 flags.go:64] FLAG: --system-reserved-cgroup=""
Jul 09 18:58:21.821304 ip-10-0-139-134 kubenswrapper[2578]: I0709 18:58:21.812672    2578 flags.go:64] FLAG: --tls-cert-file=""
Jul 09 18:58:21.821304 ip-10-0-139-134 kubenswrapper[2578]: I0709 18:58:21.812675    2578 flags.go:64] FLAG: --tls-cipher-suites="[]"
Jul 09 18:58:21.821304 ip-10-0-139-134 kubenswrapper[2578]: I0709 18:58:21.812678    2578 flags.go:64] FLAG: --tls-min-version=""
Jul 09 18:58:21.821304 ip-10-0-139-134 kubenswrapper[2578]: I0709 18:58:21.812684    2578 flags.go:64] FLAG: --tls-private-key-file=""
Jul 09 18:58:21.821304 ip-10-0-139-134 kubenswrapper[2578]: I0709 18:58:21.812687    2578 flags.go:64] FLAG: --topology-manager-policy="none"
Jul 09 18:58:21.821304 ip-10-0-139-134 kubenswrapper[2578]: I0709 18:58:21.812689    2578 flags.go:64] FLAG: --topology-manager-policy-options=""
Jul 09 18:58:21.821304 ip-10-0-139-134 kubenswrapper[2578]: I0709 18:58:21.812692    2578 flags.go:64] FLAG: --topology-manager-scope="container"
Jul 09 18:58:21.821936 ip-10-0-139-134 kubenswrapper[2578]: I0709 18:58:21.812695    2578 flags.go:64] FLAG: --v="2"
Jul 09 18:58:21.821936 ip-10-0-139-134 kubenswrapper[2578]: I0709 18:58:21.812698    2578 flags.go:64] FLAG: --version="false"
Jul 09 18:58:21.821936 ip-10-0-139-134 kubenswrapper[2578]: I0709 18:58:21.812702    2578 flags.go:64] FLAG: --vmodule=""
Jul 09 18:58:21.821936 ip-10-0-139-134 kubenswrapper[2578]: I0709 18:58:21.812706    2578 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec"
Jul 09 18:58:21.821936 ip-10-0-139-134 kubenswrapper[2578]: I0709 18:58:21.812709    2578 flags.go:64] FLAG: --volume-stats-agg-period="1m0s"
Jul 09 18:58:21.821936 ip-10-0-139-134 kubenswrapper[2578]: W0709 18:58:21.812828    2578 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 09 18:58:21.821936 ip-10-0-139-134 kubenswrapper[2578]: W0709 18:58:21.812832    2578 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 09 18:58:21.821936 ip-10-0-139-134 kubenswrapper[2578]: W0709 18:58:21.812835    2578 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 09 18:58:21.821936 ip-10-0-139-134 kubenswrapper[2578]: W0709 18:58:21.812838    2578 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 09 18:58:21.821936 ip-10-0-139-134 kubenswrapper[2578]: W0709 18:58:21.812842    2578 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 09 18:58:21.821936 ip-10-0-139-134 kubenswrapper[2578]: W0709 18:58:21.812844    2578 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 09 18:58:21.821936 ip-10-0-139-134 kubenswrapper[2578]: W0709 18:58:21.812847    2578 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 09 18:58:21.821936 ip-10-0-139-134 kubenswrapper[2578]: W0709 18:58:21.812850    2578 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 09 18:58:21.821936 ip-10-0-139-134 kubenswrapper[2578]: W0709 18:58:21.812852    2578 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 09 18:58:21.821936 ip-10-0-139-134 kubenswrapper[2578]: W0709 18:58:21.812855    2578 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 09 18:58:21.821936 ip-10-0-139-134 kubenswrapper[2578]: W0709 18:58:21.812857    2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 09 18:58:21.821936 ip-10-0-139-134 kubenswrapper[2578]: W0709 18:58:21.812859    2578 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 09 18:58:21.821936 ip-10-0-139-134 kubenswrapper[2578]: W0709 18:58:21.812862    2578 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 09 18:58:21.821936 ip-10-0-139-134 kubenswrapper[2578]: W0709 18:58:21.812865    2578 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 09 18:58:21.821936 ip-10-0-139-134 kubenswrapper[2578]: W0709 18:58:21.812867    2578 feature_gate.go:328] unrecognized feature gate: Example2
Jul 09 18:58:21.821936 ip-10-0-139-134 kubenswrapper[2578]: W0709 18:58:21.812869    2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 09 18:58:21.822486 ip-10-0-139-134 kubenswrapper[2578]: W0709 18:58:21.812872    2578 feature_gate.go:328] unrecognized feature gate: Example
Jul 09 18:58:21.822486 ip-10-0-139-134 kubenswrapper[2578]: W0709 18:58:21.812874    2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 09 18:58:21.822486 ip-10-0-139-134 kubenswrapper[2578]: W0709 18:58:21.812877    2578 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 09 18:58:21.822486 ip-10-0-139-134 kubenswrapper[2578]: W0709 18:58:21.812879    2578 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 09 18:58:21.822486 ip-10-0-139-134 kubenswrapper[2578]: W0709 18:58:21.812882    2578 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 09 18:58:21.822486 ip-10-0-139-134 kubenswrapper[2578]: W0709 18:58:21.812884    2578 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 09 18:58:21.822486 ip-10-0-139-134 kubenswrapper[2578]: W0709 18:58:21.812886    2578 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 09 18:58:21.822486 ip-10-0-139-134 kubenswrapper[2578]: W0709 18:58:21.812890    2578 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 09 18:58:21.822486 ip-10-0-139-134 kubenswrapper[2578]: W0709 18:58:21.812893    2578 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 09 18:58:21.822486 ip-10-0-139-134 kubenswrapper[2578]: W0709 18:58:21.812895    2578 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 09 18:58:21.822486 ip-10-0-139-134 kubenswrapper[2578]: W0709 18:58:21.812898    2578 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 09 18:58:21.822486 ip-10-0-139-134 kubenswrapper[2578]: W0709 18:58:21.812900    2578 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 09 18:58:21.822486 ip-10-0-139-134 kubenswrapper[2578]: W0709 18:58:21.812903    2578 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 09 18:58:21.822486 ip-10-0-139-134 kubenswrapper[2578]: W0709 18:58:21.812905    2578 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 09 18:58:21.822486 ip-10-0-139-134 kubenswrapper[2578]: W0709 18:58:21.812908    2578 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 09 18:58:21.822486 ip-10-0-139-134 kubenswrapper[2578]: W0709 18:58:21.812910    2578 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 09 18:58:21.822486 ip-10-0-139-134 kubenswrapper[2578]: W0709 18:58:21.812913    2578 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 09 18:58:21.822486 ip-10-0-139-134 kubenswrapper[2578]: W0709 18:58:21.812915    2578 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 09 18:58:21.822486 ip-10-0-139-134 kubenswrapper[2578]: W0709 18:58:21.812918    2578 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 09 18:58:21.822486 ip-10-0-139-134 kubenswrapper[2578]: W0709 18:58:21.812920    2578 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 09 18:58:21.822980 ip-10-0-139-134 kubenswrapper[2578]: W0709 18:58:21.812924    2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 09 18:58:21.822980 ip-10-0-139-134 kubenswrapper[2578]: W0709 18:58:21.812928    2578 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 09 18:58:21.822980 ip-10-0-139-134 kubenswrapper[2578]: W0709 18:58:21.812932    2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 09 18:58:21.822980 ip-10-0-139-134 kubenswrapper[2578]: W0709 18:58:21.812934    2578 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 09 18:58:21.822980 ip-10-0-139-134 kubenswrapper[2578]: W0709 18:58:21.812937    2578 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 09 18:58:21.822980 ip-10-0-139-134 kubenswrapper[2578]: W0709 18:58:21.812939    2578 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 09 18:58:21.822980 ip-10-0-139-134 kubenswrapper[2578]: W0709 18:58:21.812942    2578 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 09 18:58:21.822980 ip-10-0-139-134 kubenswrapper[2578]: W0709 18:58:21.812945    2578 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 09 18:58:21.822980 ip-10-0-139-134 kubenswrapper[2578]: W0709 18:58:21.812947    2578 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 09 18:58:21.822980 ip-10-0-139-134 kubenswrapper[2578]: W0709 18:58:21.812950    2578 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 09 18:58:21.822980 ip-10-0-139-134 kubenswrapper[2578]: W0709 18:58:21.812952    2578 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 09 18:58:21.822980 ip-10-0-139-134 kubenswrapper[2578]: W0709 18:58:21.812955    2578 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 09 18:58:21.822980 ip-10-0-139-134 kubenswrapper[2578]: W0709 18:58:21.812957    2578 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 09 18:58:21.822980 ip-10-0-139-134 kubenswrapper[2578]: W0709 18:58:21.812959    2578 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 09 18:58:21.822980 ip-10-0-139-134 kubenswrapper[2578]: W0709 18:58:21.812962    2578 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 09 18:58:21.822980 ip-10-0-139-134 kubenswrapper[2578]: W0709 18:58:21.812964    2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 09 18:58:21.822980 ip-10-0-139-134 kubenswrapper[2578]: W0709 18:58:21.812967    2578 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 09 18:58:21.822980 ip-10-0-139-134 kubenswrapper[2578]: W0709 18:58:21.812969    2578 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 09 18:58:21.822980 ip-10-0-139-134 kubenswrapper[2578]: W0709 18:58:21.812971    2578 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 09 18:58:21.823457 ip-10-0-139-134 kubenswrapper[2578]: W0709 18:58:21.812978    2578 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 09 18:58:21.823457 ip-10-0-139-134 kubenswrapper[2578]: W0709 18:58:21.812981    2578 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 09 18:58:21.823457 ip-10-0-139-134 kubenswrapper[2578]: W0709 18:58:21.812984    2578 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 09 18:58:21.823457 ip-10-0-139-134 kubenswrapper[2578]: W0709 18:58:21.812987    2578 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 09 18:58:21.823457 ip-10-0-139-134 kubenswrapper[2578]: W0709 18:58:21.812990    2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 09 18:58:21.823457 ip-10-0-139-134 kubenswrapper[2578]: W0709 18:58:21.812992    2578 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 09 18:58:21.823457 ip-10-0-139-134 kubenswrapper[2578]: W0709 18:58:21.812995    2578 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 09 18:58:21.823457 ip-10-0-139-134 kubenswrapper[2578]: W0709 18:58:21.812997    2578 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 09 18:58:21.823457 ip-10-0-139-134 kubenswrapper[2578]: W0709 18:58:21.812999    2578 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 09 18:58:21.823457 ip-10-0-139-134 kubenswrapper[2578]: W0709 18:58:21.813002    2578 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 09 18:58:21.823457 ip-10-0-139-134 kubenswrapper[2578]: W0709 18:58:21.813004    2578 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 09 18:58:21.823457 ip-10-0-139-134 kubenswrapper[2578]: W0709 18:58:21.813007    2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 09 18:58:21.823457 ip-10-0-139-134 kubenswrapper[2578]: W0709 18:58:21.813009    2578 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 09 18:58:21.823457 ip-10-0-139-134 kubenswrapper[2578]: W0709 18:58:21.813013    2578 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 09 18:58:21.823457 ip-10-0-139-134 kubenswrapper[2578]: W0709 18:58:21.813015    2578 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 09 18:58:21.823457 ip-10-0-139-134 kubenswrapper[2578]: W0709 18:58:21.813019    2578 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 09 18:58:21.823457 ip-10-0-139-134 kubenswrapper[2578]: W0709 18:58:21.813023    2578 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 09 18:58:21.823457 ip-10-0-139-134 kubenswrapper[2578]: W0709 18:58:21.813026    2578 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 09 18:58:21.823457 ip-10-0-139-134 kubenswrapper[2578]: W0709 18:58:21.813029    2578 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 09 18:58:21.823457 ip-10-0-139-134 kubenswrapper[2578]: W0709 18:58:21.813032    2578 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 09 18:58:21.824066 ip-10-0-139-134 kubenswrapper[2578]: W0709 18:58:21.813035    2578 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 09 18:58:21.824066 ip-10-0-139-134 kubenswrapper[2578]: W0709 18:58:21.813038    2578 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 09 18:58:21.824066 ip-10-0-139-134 kubenswrapper[2578]: W0709 18:58:21.813040    2578 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 09 18:58:21.824066 ip-10-0-139-134 kubenswrapper[2578]: W0709 18:58:21.813043    2578 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 09 18:58:21.824066 ip-10-0-139-134 kubenswrapper[2578]: W0709 18:58:21.813045    2578 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 09 18:58:21.824066 ip-10-0-139-134 kubenswrapper[2578]: W0709 18:58:21.813047    2578 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 09 18:58:21.824066 ip-10-0-139-134 kubenswrapper[2578]: W0709 18:58:21.813050    2578 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 09 18:58:21.824066 ip-10-0-139-134 kubenswrapper[2578]: W0709 18:58:21.813052    2578 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 09 18:58:21.824066 ip-10-0-139-134 kubenswrapper[2578]: W0709 18:58:21.813055    2578 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 09 18:58:21.824066 ip-10-0-139-134 kubenswrapper[2578]: W0709 18:58:21.813057    2578 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 09 18:58:21.824066 ip-10-0-139-134 kubenswrapper[2578]: W0709 18:58:21.813059    2578 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 09 18:58:21.824066 ip-10-0-139-134 kubenswrapper[2578]: W0709 18:58:21.813063    2578 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 09 18:58:21.824066 ip-10-0-139-134 kubenswrapper[2578]: W0709 18:58:21.813068    2578 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 09 18:58:21.824066 ip-10-0-139-134 kubenswrapper[2578]: W0709 18:58:21.813071    2578 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 09 18:58:21.824066 ip-10-0-139-134 kubenswrapper[2578]: W0709 18:58:21.813074    2578 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 09 18:58:21.824066 ip-10-0-139-134 kubenswrapper[2578]: W0709 18:58:21.813077    2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 09 18:58:21.824066 ip-10-0-139-134 kubenswrapper[2578]: W0709 18:58:21.813079    2578 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 09 18:58:21.824066 ip-10-0-139-134 kubenswrapper[2578]: W0709 18:58:21.813082    2578 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 09 18:58:21.824066 ip-10-0-139-134 kubenswrapper[2578]: W0709 18:58:21.813084    2578 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 09 18:58:21.824066 ip-10-0-139-134 kubenswrapper[2578]: W0709 18:58:21.813087    2578 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 09 18:58:21.824598 ip-10-0-139-134 kubenswrapper[2578]: W0709 18:58:21.813089    2578 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 09 18:58:21.824598 ip-10-0-139-134 kubenswrapper[2578]: W0709 18:58:21.813092    2578 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 09 18:58:21.824598 ip-10-0-139-134 kubenswrapper[2578]: W0709 18:58:21.813094    2578 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 09 18:58:21.824598 ip-10-0-139-134 kubenswrapper[2578]: W0709 18:58:21.813097    2578 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 09 18:58:21.824598 ip-10-0-139-134 kubenswrapper[2578]: I0709 18:58:21.813748    2578 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 09 18:58:21.824598 ip-10-0-139-134 kubenswrapper[2578]: I0709 18:58:21.822202    2578 server.go:529] "Kubelet version" kubeletVersion="v1.34.9"
Jul 09 18:58:21.824598 ip-10-0-139-134 kubenswrapper[2578]: I0709 18:58:21.822219    2578 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK=""
Jul 09 18:58:21.824598 ip-10-0-139-134 kubenswrapper[2578]: I0709 18:58:21.823019    2578 watchdog_linux.go:95] "Systemd watchdog is not enabled"
Jul 09 18:58:21.824598 ip-10-0-139-134 kubenswrapper[2578]: I0709 18:58:21.823030    2578 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started."
Jul 09 18:58:21.824598 ip-10-0-139-134 kubenswrapper[2578]: W0709 18:58:21.823089    2578 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 09 18:58:21.824598 ip-10-0-139-134 kubenswrapper[2578]: W0709 18:58:21.823095    2578 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 09 18:58:21.824598 ip-10-0-139-134 kubenswrapper[2578]: W0709 18:58:21.823099    2578 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 09 18:58:21.824598 ip-10-0-139-134 kubenswrapper[2578]: W0709 18:58:21.823101    2578 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 09 18:58:21.824598 ip-10-0-139-134 kubenswrapper[2578]: W0709 18:58:21.823104    2578 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 09 18:58:21.824951 ip-10-0-139-134 kubenswrapper[2578]: W0709 18:58:21.823106    2578 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 09 18:58:21.824951 ip-10-0-139-134 kubenswrapper[2578]: W0709 18:58:21.823109    2578 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 09 18:58:21.824951 ip-10-0-139-134 kubenswrapper[2578]: W0709 18:58:21.823112    2578 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 09 18:58:21.824951 ip-10-0-139-134 kubenswrapper[2578]: W0709 18:58:21.823114    2578 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 09 18:58:21.824951 ip-10-0-139-134 kubenswrapper[2578]: W0709 18:58:21.823117    2578 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 09 18:58:21.824951 ip-10-0-139-134 kubenswrapper[2578]: W0709 18:58:21.823119    2578 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 09 18:58:21.824951 ip-10-0-139-134 kubenswrapper[2578]: W0709 18:58:21.823122    2578 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 09 18:58:21.824951 ip-10-0-139-134 kubenswrapper[2578]: W0709 18:58:21.823126    2578 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 09 18:58:21.824951 ip-10-0-139-134 kubenswrapper[2578]: W0709 18:58:21.823130    2578 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 09 18:58:21.824951 ip-10-0-139-134 kubenswrapper[2578]: W0709 18:58:21.823133    2578 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 09 18:58:21.824951 ip-10-0-139-134 kubenswrapper[2578]: W0709 18:58:21.823136    2578 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 09 18:58:21.824951 ip-10-0-139-134 kubenswrapper[2578]: W0709 18:58:21.823141    2578 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 09 18:58:21.824951 ip-10-0-139-134 kubenswrapper[2578]: W0709 18:58:21.823145    2578 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 09 18:58:21.824951 ip-10-0-139-134 kubenswrapper[2578]: W0709 18:58:21.823149    2578 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 09 18:58:21.824951 ip-10-0-139-134 kubenswrapper[2578]: W0709 18:58:21.823152    2578 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 09 18:58:21.824951 ip-10-0-139-134 kubenswrapper[2578]: W0709 18:58:21.823155    2578 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 09 18:58:21.824951 ip-10-0-139-134 kubenswrapper[2578]: W0709 18:58:21.823157    2578 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 09 18:58:21.824951 ip-10-0-139-134 kubenswrapper[2578]: W0709 18:58:21.823160    2578 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 09 18:58:21.824951 ip-10-0-139-134 kubenswrapper[2578]: W0709 18:58:21.823163    2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 09 18:58:21.825411 ip-10-0-139-134 kubenswrapper[2578]: W0709 18:58:21.823165    2578 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 09 18:58:21.825411 ip-10-0-139-134 kubenswrapper[2578]: W0709 18:58:21.823168    2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 09 18:58:21.825411 ip-10-0-139-134 kubenswrapper[2578]: W0709 18:58:21.823170    2578 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 09 18:58:21.825411 ip-10-0-139-134 kubenswrapper[2578]: W0709 18:58:21.823173    2578 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 09 18:58:21.825411 ip-10-0-139-134 kubenswrapper[2578]: W0709 18:58:21.823176    2578 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 09 18:58:21.825411 ip-10-0-139-134 kubenswrapper[2578]: W0709 18:58:21.823179    2578 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 09 18:58:21.825411 ip-10-0-139-134 kubenswrapper[2578]: W0709 18:58:21.823181    2578 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 09 18:58:21.825411 ip-10-0-139-134 kubenswrapper[2578]: W0709 18:58:21.823184    2578 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 09 18:58:21.825411 ip-10-0-139-134 kubenswrapper[2578]: W0709 18:58:21.823187    2578 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 09 18:58:21.825411 ip-10-0-139-134 kubenswrapper[2578]: W0709 18:58:21.823189    2578 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 09 18:58:21.825411 ip-10-0-139-134 kubenswrapper[2578]: W0709 18:58:21.823192    2578 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 09 18:58:21.825411 ip-10-0-139-134 kubenswrapper[2578]: W0709 18:58:21.823194    2578 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 09 18:58:21.825411 ip-10-0-139-134 kubenswrapper[2578]: W0709 18:58:21.823197    2578 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 09 18:58:21.825411 ip-10-0-139-134 kubenswrapper[2578]: W0709 18:58:21.823200    2578 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 09 18:58:21.825411 ip-10-0-139-134 kubenswrapper[2578]: W0709 18:58:21.823202    2578 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 09 18:58:21.825411 ip-10-0-139-134 kubenswrapper[2578]: W0709 18:58:21.823205    2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 09 18:58:21.825411 ip-10-0-139-134 kubenswrapper[2578]: W0709 18:58:21.823207    2578 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 09 18:58:21.825411 ip-10-0-139-134 kubenswrapper[2578]: W0709 18:58:21.823210    2578 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 09 18:58:21.825411 ip-10-0-139-134 kubenswrapper[2578]: W0709 18:58:21.823212    2578 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 09 18:58:21.825411 ip-10-0-139-134 kubenswrapper[2578]: W0709 18:58:21.823215    2578 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 09 18:58:21.825915 ip-10-0-139-134 kubenswrapper[2578]: W0709 18:58:21.823217    2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 09 18:58:21.825915 ip-10-0-139-134 kubenswrapper[2578]: W0709 18:58:21.823225    2578 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 09 18:58:21.825915 ip-10-0-139-134 kubenswrapper[2578]: W0709 18:58:21.823229    2578 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 09 18:58:21.825915 ip-10-0-139-134 kubenswrapper[2578]: W0709 18:58:21.823231    2578 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 09 18:58:21.825915 ip-10-0-139-134 kubenswrapper[2578]: W0709 18:58:21.823234    2578 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 09 18:58:21.825915 ip-10-0-139-134 kubenswrapper[2578]: W0709 18:58:21.823237    2578 feature_gate.go:328] unrecognized feature gate: Example
Jul 09 18:58:21.825915 ip-10-0-139-134 kubenswrapper[2578]: W0709 18:58:21.823240    2578 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 09 18:58:21.825915 ip-10-0-139-134 kubenswrapper[2578]: W0709 18:58:21.823242    2578 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 09 18:58:21.825915 ip-10-0-139-134 kubenswrapper[2578]: W0709 18:58:21.823244    2578 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 09 18:58:21.825915 ip-10-0-139-134 kubenswrapper[2578]: W0709 18:58:21.823247    2578 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 09 18:58:21.825915 ip-10-0-139-134 kubenswrapper[2578]: W0709 18:58:21.823250    2578 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 09 18:58:21.825915 ip-10-0-139-134 kubenswrapper[2578]: W0709 18:58:21.823252    2578 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 09 18:58:21.825915 ip-10-0-139-134 kubenswrapper[2578]: W0709 18:58:21.823255    2578 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 09 18:58:21.825915 ip-10-0-139-134 kubenswrapper[2578]: W0709 18:58:21.823257    2578 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 09 18:58:21.825915 ip-10-0-139-134 kubenswrapper[2578]: W0709 18:58:21.823260    2578 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 09 18:58:21.825915 ip-10-0-139-134 kubenswrapper[2578]: W0709 18:58:21.823262    2578 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 09 18:58:21.825915 ip-10-0-139-134 kubenswrapper[2578]: W0709 18:58:21.823265    2578 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 09 18:58:21.825915 ip-10-0-139-134 kubenswrapper[2578]: W0709 18:58:21.823268    2578 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 09 18:58:21.825915 ip-10-0-139-134 kubenswrapper[2578]: W0709 18:58:21.823270    2578 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 09 18:58:21.825915 ip-10-0-139-134 kubenswrapper[2578]: W0709 18:58:21.823273    2578 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 09 18:58:21.826493 ip-10-0-139-134 kubenswrapper[2578]: W0709 18:58:21.823276    2578 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 09 18:58:21.826493 ip-10-0-139-134 kubenswrapper[2578]: W0709 18:58:21.823278    2578 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 09 18:58:21.826493 ip-10-0-139-134 kubenswrapper[2578]: W0709 18:58:21.823281    2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 09 18:58:21.826493 ip-10-0-139-134 kubenswrapper[2578]: W0709 18:58:21.823283    2578 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 09 18:58:21.826493 ip-10-0-139-134 kubenswrapper[2578]: W0709 18:58:21.823286    2578 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 09 18:58:21.826493 ip-10-0-139-134 kubenswrapper[2578]: W0709 18:58:21.823288    2578 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 09 18:58:21.826493 ip-10-0-139-134 kubenswrapper[2578]: W0709 18:58:21.823290    2578 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 09 18:58:21.826493 ip-10-0-139-134 kubenswrapper[2578]: W0709 18:58:21.823293    2578 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 09 18:58:21.826493 ip-10-0-139-134 kubenswrapper[2578]: W0709 18:58:21.823295    2578 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 09 18:58:21.826493 ip-10-0-139-134 kubenswrapper[2578]: W0709 18:58:21.823298    2578 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 09 18:58:21.826493 ip-10-0-139-134 kubenswrapper[2578]: W0709 18:58:21.823300    2578 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 09 18:58:21.826493 ip-10-0-139-134 kubenswrapper[2578]: W0709 18:58:21.823303    2578 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 09 18:58:21.826493 ip-10-0-139-134 kubenswrapper[2578]: W0709 18:58:21.823306    2578 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 09 18:58:21.826493 ip-10-0-139-134 kubenswrapper[2578]: W0709 18:58:21.823308    2578 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 09 18:58:21.826493 ip-10-0-139-134 kubenswrapper[2578]: W0709 18:58:21.823310    2578 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 09 18:58:21.826493 ip-10-0-139-134 kubenswrapper[2578]: W0709 18:58:21.823314    2578 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 09 18:58:21.826493 ip-10-0-139-134 kubenswrapper[2578]: W0709 18:58:21.823317    2578 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 09 18:58:21.826493 ip-10-0-139-134 kubenswrapper[2578]: W0709 18:58:21.823319    2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 09 18:58:21.826493 ip-10-0-139-134 kubenswrapper[2578]: W0709 18:58:21.823322    2578 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 09 18:58:21.826493 ip-10-0-139-134 kubenswrapper[2578]: W0709 18:58:21.823324    2578 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 09 18:58:21.827045 ip-10-0-139-134 kubenswrapper[2578]: W0709 18:58:21.823326    2578 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 09 18:58:21.827045 ip-10-0-139-134 kubenswrapper[2578]: W0709 18:58:21.823329    2578 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 09 18:58:21.827045 ip-10-0-139-134 kubenswrapper[2578]: W0709 18:58:21.823331    2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 09 18:58:21.827045 ip-10-0-139-134 kubenswrapper[2578]: W0709 18:58:21.823334    2578 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 09 18:58:21.827045 ip-10-0-139-134 kubenswrapper[2578]: W0709 18:58:21.823336    2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 09 18:58:21.827045 ip-10-0-139-134 kubenswrapper[2578]: W0709 18:58:21.823338    2578 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 09 18:58:21.827045 ip-10-0-139-134 kubenswrapper[2578]: W0709 18:58:21.823342    2578 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 09 18:58:21.827045 ip-10-0-139-134 kubenswrapper[2578]: W0709 18:58:21.823345    2578 feature_gate.go:328] unrecognized feature gate: Example2
Jul 09 18:58:21.827045 ip-10-0-139-134 kubenswrapper[2578]: W0709 18:58:21.823348    2578 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 09 18:58:21.827045 ip-10-0-139-134 kubenswrapper[2578]: W0709 18:58:21.823351    2578 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 09 18:58:21.827045 ip-10-0-139-134 kubenswrapper[2578]: W0709 18:58:21.823354    2578 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 09 18:58:21.827045 ip-10-0-139-134 kubenswrapper[2578]: W0709 18:58:21.823357    2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 09 18:58:21.827045 ip-10-0-139-134 kubenswrapper[2578]: W0709 18:58:21.823360    2578 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 09 18:58:21.827045 ip-10-0-139-134 kubenswrapper[2578]: W0709 18:58:21.823363    2578 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 09 18:58:21.827045 ip-10-0-139-134 kubenswrapper[2578]: W0709 18:58:21.823365    2578 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 09 18:58:21.827414 ip-10-0-139-134 kubenswrapper[2578]: I0709 18:58:21.823370    2578 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 09 18:58:21.827414 ip-10-0-139-134 kubenswrapper[2578]: W0709 18:58:21.823504    2578 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 09 18:58:21.827414 ip-10-0-139-134 kubenswrapper[2578]: W0709 18:58:21.823510    2578 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 09 18:58:21.827414 ip-10-0-139-134 kubenswrapper[2578]: W0709 18:58:21.823514    2578 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 09 18:58:21.827414 ip-10-0-139-134 kubenswrapper[2578]: W0709 18:58:21.823519    2578 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 09 18:58:21.827414 ip-10-0-139-134 kubenswrapper[2578]: W0709 18:58:21.823522    2578 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 09 18:58:21.827414 ip-10-0-139-134 kubenswrapper[2578]: W0709 18:58:21.823525    2578 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 09 18:58:21.827414 ip-10-0-139-134 kubenswrapper[2578]: W0709 18:58:21.823527    2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 09 18:58:21.827414 ip-10-0-139-134 kubenswrapper[2578]: W0709 18:58:21.823531    2578 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 09 18:58:21.827414 ip-10-0-139-134 kubenswrapper[2578]: W0709 18:58:21.823534    2578 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 09 18:58:21.827414 ip-10-0-139-134 kubenswrapper[2578]: W0709 18:58:21.823538    2578 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 09 18:58:21.827414 ip-10-0-139-134 kubenswrapper[2578]: W0709 18:58:21.823540    2578 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 09 18:58:21.827414 ip-10-0-139-134 kubenswrapper[2578]: W0709 18:58:21.823543    2578 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 09 18:58:21.827414 ip-10-0-139-134 kubenswrapper[2578]: W0709 18:58:21.823547    2578 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 09 18:58:21.827836 ip-10-0-139-134 kubenswrapper[2578]: W0709 18:58:21.823550    2578 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 09 18:58:21.827836 ip-10-0-139-134 kubenswrapper[2578]: W0709 18:58:21.823553    2578 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 09 18:58:21.827836 ip-10-0-139-134 kubenswrapper[2578]: W0709 18:58:21.823555    2578 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 09 18:58:21.827836 ip-10-0-139-134 kubenswrapper[2578]: W0709 18:58:21.823558    2578 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 09 18:58:21.827836 ip-10-0-139-134 kubenswrapper[2578]: W0709 18:58:21.823560    2578 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 09 18:58:21.827836 ip-10-0-139-134 kubenswrapper[2578]: W0709 18:58:21.823563    2578 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 09 18:58:21.827836 ip-10-0-139-134 kubenswrapper[2578]: W0709 18:58:21.823565    2578 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 09 18:58:21.827836 ip-10-0-139-134 kubenswrapper[2578]: W0709 18:58:21.823568    2578 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 09 18:58:21.827836 ip-10-0-139-134 kubenswrapper[2578]: W0709 18:58:21.823570    2578 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 09 18:58:21.827836 ip-10-0-139-134 kubenswrapper[2578]: W0709 18:58:21.823573    2578 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 09 18:58:21.827836 ip-10-0-139-134 kubenswrapper[2578]: W0709 18:58:21.823576    2578 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 09 18:58:21.827836 ip-10-0-139-134 kubenswrapper[2578]: W0709 18:58:21.823578    2578 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 09 18:58:21.827836 ip-10-0-139-134 kubenswrapper[2578]: W0709 18:58:21.823580    2578 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 09 18:58:21.827836 ip-10-0-139-134 kubenswrapper[2578]: W0709 18:58:21.823583    2578 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 09 18:58:21.827836 ip-10-0-139-134 kubenswrapper[2578]: W0709 18:58:21.823587    2578 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 09 18:58:21.827836 ip-10-0-139-134 kubenswrapper[2578]: W0709 18:58:21.823590    2578 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 09 18:58:21.827836 ip-10-0-139-134 kubenswrapper[2578]: W0709 18:58:21.823593    2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 09 18:58:21.827836 ip-10-0-139-134 kubenswrapper[2578]: W0709 18:58:21.823596    2578 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 09 18:58:21.827836 ip-10-0-139-134 kubenswrapper[2578]: W0709 18:58:21.823600    2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 09 18:58:21.828300 ip-10-0-139-134 kubenswrapper[2578]: W0709 18:58:21.823602    2578 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 09 18:58:21.828300 ip-10-0-139-134 kubenswrapper[2578]: W0709 18:58:21.823606    2578 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 09 18:58:21.828300 ip-10-0-139-134 kubenswrapper[2578]: W0709 18:58:21.823608    2578 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 09 18:58:21.828300 ip-10-0-139-134 kubenswrapper[2578]: W0709 18:58:21.823611    2578 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 09 18:58:21.828300 ip-10-0-139-134 kubenswrapper[2578]: W0709 18:58:21.823613    2578 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 09 18:58:21.828300 ip-10-0-139-134 kubenswrapper[2578]: W0709 18:58:21.823616    2578 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 09 18:58:21.828300 ip-10-0-139-134 kubenswrapper[2578]: W0709 18:58:21.823618    2578 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 09 18:58:21.828300 ip-10-0-139-134 kubenswrapper[2578]: W0709 18:58:21.823621    2578 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 09 18:58:21.828300 ip-10-0-139-134 kubenswrapper[2578]: W0709 18:58:21.823623    2578 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 09 18:58:21.828300 ip-10-0-139-134 kubenswrapper[2578]: W0709 18:58:21.823626    2578 feature_gate.go:328] unrecognized feature gate: Example2
Jul 09 18:58:21.828300 ip-10-0-139-134 kubenswrapper[2578]: W0709 18:58:21.823628    2578 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 09 18:58:21.828300 ip-10-0-139-134 kubenswrapper[2578]: W0709 18:58:21.823631    2578 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 09 18:58:21.828300 ip-10-0-139-134 kubenswrapper[2578]: W0709 18:58:21.823634    2578 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 09 18:58:21.828300 ip-10-0-139-134 kubenswrapper[2578]: W0709 18:58:21.823638    2578 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 09 18:58:21.828300 ip-10-0-139-134 kubenswrapper[2578]: W0709 18:58:21.823640    2578 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 09 18:58:21.828300 ip-10-0-139-134 kubenswrapper[2578]: W0709 18:58:21.823643    2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 09 18:58:21.828300 ip-10-0-139-134 kubenswrapper[2578]: W0709 18:58:21.823645    2578 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 09 18:58:21.828300 ip-10-0-139-134 kubenswrapper[2578]: W0709 18:58:21.823648    2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 09 18:58:21.828300 ip-10-0-139-134 kubenswrapper[2578]: W0709 18:58:21.823650    2578 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 09 18:58:21.828300 ip-10-0-139-134 kubenswrapper[2578]: W0709 18:58:21.823652    2578 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 09 18:58:21.828792 ip-10-0-139-134 kubenswrapper[2578]: W0709 18:58:21.823655    2578 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 09 18:58:21.828792 ip-10-0-139-134 kubenswrapper[2578]: W0709 18:58:21.823657    2578 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 09 18:58:21.828792 ip-10-0-139-134 kubenswrapper[2578]: W0709 18:58:21.823660    2578 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 09 18:58:21.828792 ip-10-0-139-134 kubenswrapper[2578]: W0709 18:58:21.823662    2578 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 09 18:58:21.828792 ip-10-0-139-134 kubenswrapper[2578]: W0709 18:58:21.823664    2578 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 09 18:58:21.828792 ip-10-0-139-134 kubenswrapper[2578]: W0709 18:58:21.823667    2578 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 09 18:58:21.828792 ip-10-0-139-134 kubenswrapper[2578]: W0709 18:58:21.823670    2578 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 09 18:58:21.828792 ip-10-0-139-134 kubenswrapper[2578]: W0709 18:58:21.823672    2578 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 09 18:58:21.828792 ip-10-0-139-134 kubenswrapper[2578]: W0709 18:58:21.823675    2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 09 18:58:21.828792 ip-10-0-139-134 kubenswrapper[2578]: W0709 18:58:21.823677    2578 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 09 18:58:21.828792 ip-10-0-139-134 kubenswrapper[2578]: W0709 18:58:21.823680    2578 feature_gate.go:328] unrecognized feature gate: Example
Jul 09 18:58:21.828792 ip-10-0-139-134 kubenswrapper[2578]: W0709 18:58:21.823682    2578 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 09 18:58:21.828792 ip-10-0-139-134 kubenswrapper[2578]: W0709 18:58:21.823685    2578 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 09 18:58:21.828792 ip-10-0-139-134 kubenswrapper[2578]: W0709 18:58:21.823688    2578 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 09 18:58:21.828792 ip-10-0-139-134 kubenswrapper[2578]: W0709 18:58:21.823690    2578 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 09 18:58:21.828792 ip-10-0-139-134 kubenswrapper[2578]: W0709 18:58:21.823692    2578 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 09 18:58:21.828792 ip-10-0-139-134 kubenswrapper[2578]: W0709 18:58:21.823695    2578 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 09 18:58:21.828792 ip-10-0-139-134 kubenswrapper[2578]: W0709 18:58:21.823697    2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 09 18:58:21.828792 ip-10-0-139-134 kubenswrapper[2578]: W0709 18:58:21.823700    2578 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 09 18:58:21.828792 ip-10-0-139-134 kubenswrapper[2578]: W0709 18:58:21.823702    2578 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 09 18:58:21.829275 ip-10-0-139-134 kubenswrapper[2578]: W0709 18:58:21.823704    2578 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 09 18:58:21.829275 ip-10-0-139-134 kubenswrapper[2578]: W0709 18:58:21.823707    2578 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 09 18:58:21.829275 ip-10-0-139-134 kubenswrapper[2578]: W0709 18:58:21.823709    2578 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 09 18:58:21.829275 ip-10-0-139-134 kubenswrapper[2578]: W0709 18:58:21.823711    2578 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 09 18:58:21.829275 ip-10-0-139-134 kubenswrapper[2578]: W0709 18:58:21.823714    2578 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 09 18:58:21.829275 ip-10-0-139-134 kubenswrapper[2578]: W0709 18:58:21.823717    2578 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 09 18:58:21.829275 ip-10-0-139-134 kubenswrapper[2578]: W0709 18:58:21.823720    2578 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 09 18:58:21.829275 ip-10-0-139-134 kubenswrapper[2578]: W0709 18:58:21.823723    2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 09 18:58:21.829275 ip-10-0-139-134 kubenswrapper[2578]: W0709 18:58:21.823725    2578 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 09 18:58:21.829275 ip-10-0-139-134 kubenswrapper[2578]: W0709 18:58:21.823727    2578 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 09 18:58:21.829275 ip-10-0-139-134 kubenswrapper[2578]: W0709 18:58:21.823730    2578 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 09 18:58:21.829275 ip-10-0-139-134 kubenswrapper[2578]: W0709 18:58:21.823732    2578 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 09 18:58:21.829275 ip-10-0-139-134 kubenswrapper[2578]: W0709 18:58:21.823734    2578 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 09 18:58:21.829275 ip-10-0-139-134 kubenswrapper[2578]: W0709 18:58:21.823737    2578 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 09 18:58:21.829275 ip-10-0-139-134 kubenswrapper[2578]: W0709 18:58:21.823739    2578 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 09 18:58:21.829275 ip-10-0-139-134 kubenswrapper[2578]: W0709 18:58:21.823742    2578 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 09 18:58:21.829275 ip-10-0-139-134 kubenswrapper[2578]: W0709 18:58:21.823744    2578 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 09 18:58:21.829275 ip-10-0-139-134 kubenswrapper[2578]: W0709 18:58:21.823747    2578 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 09 18:58:21.829275 ip-10-0-139-134 kubenswrapper[2578]: W0709 18:58:21.823749    2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 09 18:58:21.829753 ip-10-0-139-134 kubenswrapper[2578]: W0709 18:58:21.823752    2578 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 09 18:58:21.829753 ip-10-0-139-134 kubenswrapper[2578]: W0709 18:58:21.823754    2578 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 09 18:58:21.829753 ip-10-0-139-134 kubenswrapper[2578]: W0709 18:58:21.823757    2578 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 09 18:58:21.829753 ip-10-0-139-134 kubenswrapper[2578]: W0709 18:58:21.823759    2578 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 09 18:58:21.829753 ip-10-0-139-134 kubenswrapper[2578]: W0709 18:58:21.823762    2578 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 09 18:58:21.829753 ip-10-0-139-134 kubenswrapper[2578]: W0709 18:58:21.823764    2578 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 09 18:58:21.829753 ip-10-0-139-134 kubenswrapper[2578]: W0709 18:58:21.823766    2578 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 09 18:58:21.829753 ip-10-0-139-134 kubenswrapper[2578]: W0709 18:58:21.823769    2578 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 09 18:58:21.829753 ip-10-0-139-134 kubenswrapper[2578]: I0709 18:58:21.823774    2578 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 09 18:58:21.829753 ip-10-0-139-134 kubenswrapper[2578]: I0709 18:58:21.823896    2578 server.go:962] "Client rotation is on, will bootstrap in background"
Jul 09 18:58:21.829753 ip-10-0-139-134 kubenswrapper[2578]: I0709 18:58:21.827054    2578 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir"
Jul 09 18:58:21.829753 ip-10-0-139-134 kubenswrapper[2578]: I0709 18:58:21.828517    2578 server.go:1019] "Starting client certificate rotation"
Jul 09 18:58:21.829753 ip-10-0-139-134 kubenswrapper[2578]: I0709 18:58:21.828618    2578 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet"
Jul 09 18:58:21.829753 ip-10-0-139-134 kubenswrapper[2578]: I0709 18:58:21.828659    2578 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet"
Jul 09 18:58:21.831895 ip-10-0-139-134 kubenswrapper[2578]: I0709 18:58:21.831878    2578 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Jul 09 18:58:21.835434 ip-10-0-139-134 kubenswrapper[2578]: I0709 18:58:21.835421    2578 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Jul 09 18:58:21.846726 ip-10-0-139-134 kubenswrapper[2578]: I0709 18:58:21.846700    2578 log.go:25] "Validated CRI v1 runtime API"
Jul 09 18:58:21.849458 ip-10-0-139-134 kubenswrapper[2578]: I0709 18:58:21.849444    2578 log.go:25] "Validated CRI v1 image API"
Jul 09 18:58:21.850306 ip-10-0-139-134 kubenswrapper[2578]: I0709 18:58:21.850292    2578 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd"
Jul 09 18:58:21.855706 ip-10-0-139-134 kubenswrapper[2578]: I0709 18:58:21.855688    2578 fs.go:135] Filesystem UUIDs: map[2dd3ac1f-ff5e-4c19-9016-bcf66ca79c35:/dev/nvme0n1p4 7121dff6-a391-4238-bf38-1a2e0c358c04:/dev/nvme0n1p3 7B77-95E7:/dev/nvme0n1p2]
Jul 09 18:58:21.855751 ip-10-0-139-134 kubenswrapper[2578]: I0709 18:58:21.855707    2578 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}]
Jul 09 18:58:21.858086 ip-10-0-139-134 kubenswrapper[2578]: I0709 18:58:21.858059    2578 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Jul 09 18:58:21.861629 ip-10-0-139-134 kubenswrapper[2578]: I0709 18:58:21.861520    2578 manager.go:216] Machine: {Timestamp:2026-07-09 18:58:21.861011078 +0000 UTC m=+0.355587565 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3100087 MemoryCapacity:32812175360 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec2d81632f654ae3bb7d8ca181654786 SystemUUID:ec2d8163-2f65-4ae3-bb7d-8ca181654786 BootID:82865c13-9d91-4d02-a9a9-c2dc974dfb13 Filesystems:[{Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6107136 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16406089728 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16406085632 Type:vfs Inodes:4005392 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6562435072 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:a6:76:bd:c8:09 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:a6:76:bd:c8:09 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:4a:fb:3d:ce:52:3c Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:32812175360 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:34603008 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None}
Jul 09 18:58:21.861629 ip-10-0-139-134 kubenswrapper[2578]: I0709 18:58:21.861623    2578 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available.
Jul 09 18:58:21.861739 ip-10-0-139-134 kubenswrapper[2578]: I0709 18:58:21.861704    2578 manager.go:232] Version: {KernelVersion:5.14.0-570.126.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260702-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:}
Jul 09 18:58:21.865260 ip-10-0-139-134 kubenswrapper[2578]: I0709 18:58:21.865233    2578 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[]
Jul 09 18:58:21.865394 ip-10-0-139-134 kubenswrapper[2578]: I0709 18:58:21.865263    2578 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-139-134.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2}
Jul 09 18:58:21.866156 ip-10-0-139-134 kubenswrapper[2578]: I0709 18:58:21.866146    2578 topology_manager.go:138] "Creating topology manager with none policy"
Jul 09 18:58:21.866189 ip-10-0-139-134 kubenswrapper[2578]: I0709 18:58:21.866158    2578 container_manager_linux.go:309] "Creating device plugin manager"
Jul 09 18:58:21.866189 ip-10-0-139-134 kubenswrapper[2578]: I0709 18:58:21.866166    2578 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock"
Jul 09 18:58:21.866963 ip-10-0-139-134 kubenswrapper[2578]: I0709 18:58:21.866953    2578 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock"
Jul 09 18:58:21.867929 ip-10-0-139-134 kubenswrapper[2578]: I0709 18:58:21.867920    2578 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager"
Jul 09 18:58:21.871676 ip-10-0-139-134 kubenswrapper[2578]: I0709 18:58:21.871664    2578 state_mem.go:36] "Initialized new in-memory state store"
Jul 09 18:58:21.871816 ip-10-0-139-134 kubenswrapper[2578]: I0709 18:58:21.871807    2578 server.go:1240] "Using root directory" path="/var/lib/kubelet"
Jul 09 18:58:21.871845 ip-10-0-139-134 kubenswrapper[2578]: I0709 18:58:21.871838    2578 kubelet.go:486] "Attempting to sync node with API server"
Jul 09 18:58:21.871872 ip-10-0-139-134 kubenswrapper[2578]: I0709 18:58:21.871848    2578 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests"
Jul 09 18:58:21.871872 ip-10-0-139-134 kubenswrapper[2578]: I0709 18:58:21.871866    2578 file.go:69] "Watching path" path="/etc/kubernetes/manifests"
Jul 09 18:58:21.871921 ip-10-0-139-134 kubenswrapper[2578]: I0709 18:58:21.871875    2578 kubelet.go:398] "Adding apiserver pod source"
Jul 09 18:58:21.871921 ip-10-0-139-134 kubenswrapper[2578]: I0709 18:58:21.871884    2578 apiserver.go:42] "Waiting for node sync before watching apiserver pods"
Jul 09 18:58:21.872245 ip-10-0-139-134 kubenswrapper[2578]: I0709 18:58:21.872235    2578 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Jul 09 18:58:21.872279 ip-10-0-139-134 kubenswrapper[2578]: I0709 18:58:21.872252    2578 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Jul 09 18:58:21.874746 ip-10-0-139-134 kubenswrapper[2578]: I0709 18:58:21.874724    2578 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.10-2.rhaos4.21.git83ee25b.el9" apiVersion="v1"
Jul 09 18:58:21.876911 ip-10-0-139-134 kubenswrapper[2578]: I0709 18:58:21.876898    2578 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled"
Jul 09 18:58:21.876961 ip-10-0-139-134 kubenswrapper[2578]: I0709 18:58:21.876928    2578 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled"
Jul 09 18:58:21.877618 ip-10-0-139-134 kubenswrapper[2578]: I0709 18:58:21.877607    2578 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume"
Jul 09 18:58:21.877658 ip-10-0-139-134 kubenswrapper[2578]: I0709 18:58:21.877622    2578 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir"
Jul 09 18:58:21.877658 ip-10-0-139-134 kubenswrapper[2578]: I0709 18:58:21.877629    2578 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo"
Jul 09 18:58:21.877658 ip-10-0-139-134 kubenswrapper[2578]: I0709 18:58:21.877635    2578 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path"
Jul 09 18:58:21.877658 ip-10-0-139-134 kubenswrapper[2578]: I0709 18:58:21.877644    2578 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs"
Jul 09 18:58:21.877658 ip-10-0-139-134 kubenswrapper[2578]: I0709 18:58:21.877649    2578 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret"
Jul 09 18:58:21.877658 ip-10-0-139-134 kubenswrapper[2578]: I0709 18:58:21.877656    2578 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi"
Jul 09 18:58:21.877848 ip-10-0-139-134 kubenswrapper[2578]: I0709 18:58:21.877661    2578 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api"
Jul 09 18:58:21.877848 ip-10-0-139-134 kubenswrapper[2578]: I0709 18:58:21.877668    2578 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc"
Jul 09 18:58:21.877848 ip-10-0-139-134 kubenswrapper[2578]: I0709 18:58:21.877673    2578 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap"
Jul 09 18:58:21.877848 ip-10-0-139-134 kubenswrapper[2578]: I0709 18:58:21.877683    2578 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected"
Jul 09 18:58:21.877848 ip-10-0-139-134 kubenswrapper[2578]: I0709 18:58:21.877688    2578 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume"
Jul 09 18:58:21.878712 ip-10-0-139-134 kubenswrapper[2578]: I0709 18:58:21.878699    2578 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi"
Jul 09 18:58:21.878757 ip-10-0-139-134 kubenswrapper[2578]: I0709 18:58:21.878714    2578 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image"
Jul 09 18:58:21.879654 ip-10-0-139-134 kubenswrapper[2578]: E0709 18:58:21.879623    2578 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service"
Jul 09 18:58:21.879718 ip-10-0-139-134 kubenswrapper[2578]: E0709 18:58:21.879694    2578 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-139-134.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node"
Jul 09 18:58:21.881131 ip-10-0-139-134 kubenswrapper[2578]: I0709 18:58:21.881115    2578 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-xlc2f"
Jul 09 18:58:21.882121 ip-10-0-139-134 kubenswrapper[2578]: I0709 18:58:21.882104    2578 server.go:1268] "Started kubelet"
Jul 09 18:58:21.882242 ip-10-0-139-134 kubenswrapper[2578]: I0709 18:58:21.882189    2578 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10
Jul 09 18:58:21.882298 ip-10-0-139-134 kubenswrapper[2578]: I0709 18:58:21.882263    2578 server_v1.go:49] "podresources" method="list" useActivePods=true
Jul 09 18:58:21.882556 ip-10-0-139-134 kubenswrapper[2578]: I0709 18:58:21.882462    2578 server.go:180] "Starting to listen" address="0.0.0.0" port=10250
Jul 09 18:58:21.882991 ip-10-0-139-134 systemd[1]: Started Kubernetes Kubelet.
Jul 09 18:58:21.883983 ip-10-0-139-134 kubenswrapper[2578]: I0709 18:58:21.883967    2578 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock"
Jul 09 18:58:21.885381 ip-10-0-139-134 kubenswrapper[2578]: I0709 18:58:21.885363    2578 server.go:310] "Adding debug handlers to kubelet server"
Jul 09 18:58:21.886207 ip-10-0-139-134 kubenswrapper[2578]: I0709 18:58:21.886187    2578 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-139-134.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope
Jul 09 18:58:21.888441 ip-10-0-139-134 kubenswrapper[2578]: E0709 18:58:21.888421    2578 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache"
Jul 09 18:58:21.888777 ip-10-0-139-134 kubenswrapper[2578]: I0709 18:58:21.888763    2578 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-xlc2f"
Jul 09 18:58:21.889663 ip-10-0-139-134 kubenswrapper[2578]: E0709 18:58:21.888572    2578 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-139-134.ec2.internal.18c0b41ffab828f9  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-139-134.ec2.internal,UID:ip-10-0-139-134.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-139-134.ec2.internal,},FirstTimestamp:2026-07-09 18:58:21.882075385 +0000 UTC m=+0.376651851,LastTimestamp:2026-07-09 18:58:21.882075385 +0000 UTC m=+0.376651851,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-139-134.ec2.internal,}"
Jul 09 18:58:21.890744 ip-10-0-139-134 kubenswrapper[2578]: I0709 18:58:21.890729    2578 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer"
Jul 09 18:58:21.890811 ip-10-0-139-134 kubenswrapper[2578]: I0709 18:58:21.890797    2578 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving"
Jul 09 18:58:21.891116 ip-10-0-139-134 kubenswrapper[2578]: E0709 18:58:21.891094    2578 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-139-134.ec2.internal\" not found"
Jul 09 18:58:21.891316 ip-10-0-139-134 kubenswrapper[2578]: I0709 18:58:21.891299    2578 volume_manager.go:311] "The desired_state_of_world populator starts"
Jul 09 18:58:21.891316 ip-10-0-139-134 kubenswrapper[2578]: I0709 18:58:21.891314    2578 desired_state_of_world_populator.go:146] "Desired state populator starts to run"
Jul 09 18:58:21.891432 ip-10-0-139-134 kubenswrapper[2578]: I0709 18:58:21.891318    2578 volume_manager.go:313] "Starting Kubelet Volume Manager"
Jul 09 18:58:21.891432 ip-10-0-139-134 kubenswrapper[2578]: I0709 18:58:21.891399    2578 reconstruct.go:97] "Volume reconstruction finished"
Jul 09 18:58:21.891432 ip-10-0-139-134 kubenswrapper[2578]: I0709 18:58:21.891406    2578 reconciler.go:29] "Reconciler: start to sync state"
Jul 09 18:58:21.891544 ip-10-0-139-134 kubenswrapper[2578]: I0709 18:58:21.891534    2578 factory.go:55] Registering systemd factory
Jul 09 18:58:21.891583 ip-10-0-139-134 kubenswrapper[2578]: I0709 18:58:21.891570    2578 factory.go:223] Registration of the systemd container factory successfully
Jul 09 18:58:21.891888 ip-10-0-139-134 kubenswrapper[2578]: I0709 18:58:21.891872    2578 factory.go:153] Registering CRI-O factory
Jul 09 18:58:21.891888 ip-10-0-139-134 kubenswrapper[2578]: I0709 18:58:21.891890    2578 factory.go:223] Registration of the crio container factory successfully
Jul 09 18:58:21.892035 ip-10-0-139-134 kubenswrapper[2578]: I0709 18:58:21.891935    2578 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory
Jul 09 18:58:21.892035 ip-10-0-139-134 kubenswrapper[2578]: I0709 18:58:21.891955    2578 factory.go:103] Registering Raw factory
Jul 09 18:58:21.892035 ip-10-0-139-134 kubenswrapper[2578]: I0709 18:58:21.891966    2578 manager.go:1196] Started watching for new ooms in manager
Jul 09 18:58:21.894005 ip-10-0-139-134 kubenswrapper[2578]: I0709 18:58:21.893628    2578 manager.go:349] Starting recovery of all containers
Jul 09 18:58:21.898147 ip-10-0-139-134 kubenswrapper[2578]: E0709 18:58:21.898109    2578 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-139-134.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms"
Jul 09 18:58:21.898287 ip-10-0-139-134 kubenswrapper[2578]: E0709 18:58:21.898263    2578 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver"
Jul 09 18:58:21.903164 ip-10-0-139-134 kubenswrapper[2578]: I0709 18:58:21.903140    2578 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6"
Jul 09 18:58:21.906408 ip-10-0-139-134 kubenswrapper[2578]: I0709 18:58:21.906282    2578 manager.go:354] Recovery completed
Jul 09 18:58:21.910441 ip-10-0-139-134 kubenswrapper[2578]: I0709 18:58:21.910427    2578 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 09 18:58:21.912337 ip-10-0-139-134 kubenswrapper[2578]: I0709 18:58:21.912317    2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-134.ec2.internal" event="NodeHasSufficientMemory"
Jul 09 18:58:21.912422 ip-10-0-139-134 kubenswrapper[2578]: I0709 18:58:21.912357    2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-134.ec2.internal" event="NodeHasNoDiskPressure"
Jul 09 18:58:21.912422 ip-10-0-139-134 kubenswrapper[2578]: I0709 18:58:21.912370    2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-134.ec2.internal" event="NodeHasSufficientPID"
Jul 09 18:58:21.912918 ip-10-0-139-134 kubenswrapper[2578]: I0709 18:58:21.912902    2578 cpu_manager.go:222] "Starting CPU manager" policy="none"
Jul 09 18:58:21.912988 ip-10-0-139-134 kubenswrapper[2578]: I0709 18:58:21.912919    2578 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s"
Jul 09 18:58:21.912988 ip-10-0-139-134 kubenswrapper[2578]: I0709 18:58:21.912909    2578 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 09 18:58:21.912988 ip-10-0-139-134 kubenswrapper[2578]: I0709 18:58:21.912938    2578 state_mem.go:36] "Initialized new in-memory state store"
Jul 09 18:58:21.913560 ip-10-0-139-134 kubenswrapper[2578]: I0709 18:58:21.913546    2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-134.ec2.internal" event="NodeHasSufficientMemory"
Jul 09 18:58:21.913623 ip-10-0-139-134 kubenswrapper[2578]: I0709 18:58:21.913572    2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-134.ec2.internal" event="NodeHasNoDiskPressure"
Jul 09 18:58:21.913623 ip-10-0-139-134 kubenswrapper[2578]: I0709 18:58:21.913587    2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-134.ec2.internal" event="NodeHasSufficientPID"
Jul 09 18:58:21.914303 ip-10-0-139-134 kubenswrapper[2578]: I0709 18:58:21.914290    2578 policy_none.go:49] "None policy: Start"
Jul 09 18:58:21.914360 ip-10-0-139-134 kubenswrapper[2578]: I0709 18:58:21.914309    2578 memory_manager.go:187] "Starting memorymanager" policy="None"
Jul 09 18:58:21.914360 ip-10-0-139-134 kubenswrapper[2578]: I0709 18:58:21.914323    2578 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint"
Jul 09 18:58:21.915598 ip-10-0-139-134 kubenswrapper[2578]: I0709 18:58:21.915586    2578 policy_none.go:47] "Start"
Jul 09 18:58:21.953064 ip-10-0-139-134 kubenswrapper[2578]: I0709 18:58:21.953048    2578 manager.go:337] "Starting Device Plugin manager"
Jul 09 18:58:21.975743 ip-10-0-139-134 kubenswrapper[2578]: E0709 18:58:21.953091    2578 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint"
Jul 09 18:58:21.975743 ip-10-0-139-134 kubenswrapper[2578]: I0709 18:58:21.953105    2578 server.go:87] "Starting device plugin registration server"
Jul 09 18:58:21.975743 ip-10-0-139-134 kubenswrapper[2578]: I0709 18:58:21.953355    2578 eviction_manager.go:189] "Eviction manager: starting control loop"
Jul 09 18:58:21.975743 ip-10-0-139-134 kubenswrapper[2578]: I0709 18:58:21.953369    2578 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s"
Jul 09 18:58:21.975743 ip-10-0-139-134 kubenswrapper[2578]: I0709 18:58:21.953490    2578 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry"
Jul 09 18:58:21.975743 ip-10-0-139-134 kubenswrapper[2578]: I0709 18:58:21.953564    2578 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts"
Jul 09 18:58:21.975743 ip-10-0-139-134 kubenswrapper[2578]: I0709 18:58:21.953572    2578 plugin_manager.go:118] "Starting Kubelet Plugin Manager"
Jul 09 18:58:21.975743 ip-10-0-139-134 kubenswrapper[2578]: E0709 18:58:21.954186    2578 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\""
Jul 09 18:58:21.975743 ip-10-0-139-134 kubenswrapper[2578]: E0709 18:58:21.954232    2578 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-139-134.ec2.internal\" not found"
Jul 09 18:58:21.975743 ip-10-0-139-134 kubenswrapper[2578]: I0709 18:58:21.963511    2578 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4"
Jul 09 18:58:21.975743 ip-10-0-139-134 kubenswrapper[2578]: I0709 18:58:21.963552    2578 status_manager.go:244] "Starting to sync pod status with apiserver"
Jul 09 18:58:21.975743 ip-10-0-139-134 kubenswrapper[2578]: I0709 18:58:21.963572    2578 kubelet.go:2448] "Starting kubelet main sync loop"
Jul 09 18:58:21.975743 ip-10-0-139-134 kubenswrapper[2578]: E0709 18:58:21.963609    2578 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful"
Jul 09 18:58:21.975743 ip-10-0-139-134 kubenswrapper[2578]: I0709 18:58:21.965186    2578 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 09 18:58:22.053706 ip-10-0-139-134 kubenswrapper[2578]: I0709 18:58:22.053635    2578 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 09 18:58:22.054715 ip-10-0-139-134 kubenswrapper[2578]: I0709 18:58:22.054698    2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-134.ec2.internal" event="NodeHasSufficientMemory"
Jul 09 18:58:22.054787 ip-10-0-139-134 kubenswrapper[2578]: I0709 18:58:22.054729    2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-134.ec2.internal" event="NodeHasNoDiskPressure"
Jul 09 18:58:22.054787 ip-10-0-139-134 kubenswrapper[2578]: I0709 18:58:22.054741    2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-134.ec2.internal" event="NodeHasSufficientPID"
Jul 09 18:58:22.054787 ip-10-0-139-134 kubenswrapper[2578]: I0709 18:58:22.054763    2578 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-139-134.ec2.internal"
Jul 09 18:58:22.062372 ip-10-0-139-134 kubenswrapper[2578]: I0709 18:58:22.062357    2578 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-139-134.ec2.internal"
Jul 09 18:58:22.062416 ip-10-0-139-134 kubenswrapper[2578]: E0709 18:58:22.062381    2578 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-139-134.ec2.internal\": node \"ip-10-0-139-134.ec2.internal\" not found"
Jul 09 18:58:22.063739 ip-10-0-139-134 kubenswrapper[2578]: I0709 18:58:22.063720    2578 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-134.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-139-134.ec2.internal"]
Jul 09 18:58:22.063798 ip-10-0-139-134 kubenswrapper[2578]: I0709 18:58:22.063788    2578 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 09 18:58:22.065301 ip-10-0-139-134 kubenswrapper[2578]: I0709 18:58:22.065287    2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-134.ec2.internal" event="NodeHasSufficientMemory"
Jul 09 18:58:22.065390 ip-10-0-139-134 kubenswrapper[2578]: I0709 18:58:22.065313    2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-134.ec2.internal" event="NodeHasNoDiskPressure"
Jul 09 18:58:22.065390 ip-10-0-139-134 kubenswrapper[2578]: I0709 18:58:22.065322    2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-134.ec2.internal" event="NodeHasSufficientPID"
Jul 09 18:58:22.066788 ip-10-0-139-134 kubenswrapper[2578]: I0709 18:58:22.066775    2578 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 09 18:58:22.067259 ip-10-0-139-134 kubenswrapper[2578]: I0709 18:58:22.067243    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-134.ec2.internal"
Jul 09 18:58:22.067317 ip-10-0-139-134 kubenswrapper[2578]: I0709 18:58:22.067281    2578 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 09 18:58:22.069657 ip-10-0-139-134 kubenswrapper[2578]: I0709 18:58:22.069633    2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-134.ec2.internal" event="NodeHasSufficientMemory"
Jul 09 18:58:22.069764 ip-10-0-139-134 kubenswrapper[2578]: I0709 18:58:22.069663    2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-134.ec2.internal" event="NodeHasNoDiskPressure"
Jul 09 18:58:22.069764 ip-10-0-139-134 kubenswrapper[2578]: I0709 18:58:22.069670    2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-134.ec2.internal" event="NodeHasSufficientMemory"
Jul 09 18:58:22.069764 ip-10-0-139-134 kubenswrapper[2578]: I0709 18:58:22.069677    2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-134.ec2.internal" event="NodeHasSufficientPID"
Jul 09 18:58:22.069764 ip-10-0-139-134 kubenswrapper[2578]: I0709 18:58:22.069692    2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-134.ec2.internal" event="NodeHasNoDiskPressure"
Jul 09 18:58:22.069764 ip-10-0-139-134 kubenswrapper[2578]: I0709 18:58:22.069709    2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-134.ec2.internal" event="NodeHasSufficientPID"
Jul 09 18:58:22.071445 ip-10-0-139-134 kubenswrapper[2578]: I0709 18:58:22.071428    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-139-134.ec2.internal"
Jul 09 18:58:22.071551 ip-10-0-139-134 kubenswrapper[2578]: I0709 18:58:22.071460    2578 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 09 18:58:22.072201 ip-10-0-139-134 kubenswrapper[2578]: I0709 18:58:22.072185    2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-134.ec2.internal" event="NodeHasSufficientMemory"
Jul 09 18:58:22.072286 ip-10-0-139-134 kubenswrapper[2578]: I0709 18:58:22.072212    2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-134.ec2.internal" event="NodeHasNoDiskPressure"
Jul 09 18:58:22.072286 ip-10-0-139-134 kubenswrapper[2578]: I0709 18:58:22.072225    2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-134.ec2.internal" event="NodeHasSufficientPID"
Jul 09 18:58:22.075551 ip-10-0-139-134 kubenswrapper[2578]: E0709 18:58:22.075535    2578 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-139-134.ec2.internal\" not found"
Jul 09 18:58:22.103354 ip-10-0-139-134 kubenswrapper[2578]: E0709 18:58:22.103329    2578 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-139-134.ec2.internal\" not found" node="ip-10-0-139-134.ec2.internal"
Jul 09 18:58:22.107911 ip-10-0-139-134 kubenswrapper[2578]: E0709 18:58:22.107890    2578 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-139-134.ec2.internal\" not found" node="ip-10-0-139-134.ec2.internal"
Jul 09 18:58:22.176234 ip-10-0-139-134 kubenswrapper[2578]: E0709 18:58:22.176194    2578 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-139-134.ec2.internal\" not found"
Jul 09 18:58:22.192852 ip-10-0-139-134 kubenswrapper[2578]: I0709 18:58:22.192824    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/6c8631cd46f5ef2fe2e7fec413f6f8d7-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-139-134.ec2.internal\" (UID: \"6c8631cd46f5ef2fe2e7fec413f6f8d7\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-134.ec2.internal"
Jul 09 18:58:22.192982 ip-10-0-139-134 kubenswrapper[2578]: I0709 18:58:22.192856    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/6d1a4d271968fb37c56f11e30e3e00f8-config\") pod \"kube-apiserver-proxy-ip-10-0-139-134.ec2.internal\" (UID: \"6d1a4d271968fb37c56f11e30e3e00f8\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-139-134.ec2.internal"
Jul 09 18:58:22.192982 ip-10-0-139-134 kubenswrapper[2578]: I0709 18:58:22.192876    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/6c8631cd46f5ef2fe2e7fec413f6f8d7-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-139-134.ec2.internal\" (UID: \"6c8631cd46f5ef2fe2e7fec413f6f8d7\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-134.ec2.internal"
Jul 09 18:58:22.277155 ip-10-0-139-134 kubenswrapper[2578]: E0709 18:58:22.277114    2578 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-139-134.ec2.internal\" not found"
Jul 09 18:58:22.293523 ip-10-0-139-134 kubenswrapper[2578]: I0709 18:58:22.293494    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/6c8631cd46f5ef2fe2e7fec413f6f8d7-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-139-134.ec2.internal\" (UID: \"6c8631cd46f5ef2fe2e7fec413f6f8d7\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-134.ec2.internal"
Jul 09 18:58:22.293621 ip-10-0-139-134 kubenswrapper[2578]: I0709 18:58:22.293529    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/6d1a4d271968fb37c56f11e30e3e00f8-config\") pod \"kube-apiserver-proxy-ip-10-0-139-134.ec2.internal\" (UID: \"6d1a4d271968fb37c56f11e30e3e00f8\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-139-134.ec2.internal"
Jul 09 18:58:22.293621 ip-10-0-139-134 kubenswrapper[2578]: I0709 18:58:22.293549    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/6c8631cd46f5ef2fe2e7fec413f6f8d7-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-139-134.ec2.internal\" (UID: \"6c8631cd46f5ef2fe2e7fec413f6f8d7\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-134.ec2.internal"
Jul 09 18:58:22.293621 ip-10-0-139-134 kubenswrapper[2578]: I0709 18:58:22.293602    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/6d1a4d271968fb37c56f11e30e3e00f8-config\") pod \"kube-apiserver-proxy-ip-10-0-139-134.ec2.internal\" (UID: \"6d1a4d271968fb37c56f11e30e3e00f8\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-139-134.ec2.internal"
Jul 09 18:58:22.293621 ip-10-0-139-134 kubenswrapper[2578]: I0709 18:58:22.293602    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/6c8631cd46f5ef2fe2e7fec413f6f8d7-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-139-134.ec2.internal\" (UID: \"6c8631cd46f5ef2fe2e7fec413f6f8d7\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-134.ec2.internal"
Jul 09 18:58:22.293760 ip-10-0-139-134 kubenswrapper[2578]: I0709 18:58:22.293629    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/6c8631cd46f5ef2fe2e7fec413f6f8d7-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-139-134.ec2.internal\" (UID: \"6c8631cd46f5ef2fe2e7fec413f6f8d7\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-134.ec2.internal"
Jul 09 18:58:22.378023 ip-10-0-139-134 kubenswrapper[2578]: E0709 18:58:22.377957    2578 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-139-134.ec2.internal\" not found"
Jul 09 18:58:22.405568 ip-10-0-139-134 kubenswrapper[2578]: I0709 18:58:22.405523    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-134.ec2.internal"
Jul 09 18:58:22.410879 ip-10-0-139-134 kubenswrapper[2578]: I0709 18:58:22.410859    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-139-134.ec2.internal"
Jul 09 18:58:22.478891 ip-10-0-139-134 kubenswrapper[2578]: E0709 18:58:22.478853    2578 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-139-134.ec2.internal\" not found"
Jul 09 18:58:22.579420 ip-10-0-139-134 kubenswrapper[2578]: E0709 18:58:22.579387    2578 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-139-134.ec2.internal\" not found"
Jul 09 18:58:22.679990 ip-10-0-139-134 kubenswrapper[2578]: E0709 18:58:22.679916    2578 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-139-134.ec2.internal\" not found"
Jul 09 18:58:22.745584 ip-10-0-139-134 kubenswrapper[2578]: I0709 18:58:22.745554    2578 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 09 18:58:22.781028 ip-10-0-139-134 kubenswrapper[2578]: E0709 18:58:22.780997    2578 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-139-134.ec2.internal\" not found"
Jul 09 18:58:22.827582 ip-10-0-139-134 kubenswrapper[2578]: I0709 18:58:22.827547    2578 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials"
Jul 09 18:58:22.828182 ip-10-0-139-134 kubenswrapper[2578]: I0709 18:58:22.827726    2578 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
Jul 09 18:58:22.828182 ip-10-0-139-134 kubenswrapper[2578]: I0709 18:58:22.827778    2578 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
Jul 09 18:58:22.882059 ip-10-0-139-134 kubenswrapper[2578]: E0709 18:58:22.882026    2578 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-139-134.ec2.internal\" not found"
Jul 09 18:58:22.899249 ip-10-0-139-134 kubenswrapper[2578]: I0709 18:58:22.899202    2578 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-07-08 18:53:23 +0000 UTC" deadline="2028-02-07 14:35:05.783213578 +0000 UTC"
Jul 09 18:58:22.899249 ip-10-0-139-134 kubenswrapper[2578]: I0709 18:58:22.899243    2578 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="13867h36m42.883975742s"
Jul 09 18:58:22.938969 ip-10-0-139-134 kubenswrapper[2578]: W0709 18:58:22.938925    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6d1a4d271968fb37c56f11e30e3e00f8.slice/crio-b301ee7e8f3c624235157501e212689ff3f30c5426d15981b1eedbbc9c29791a WatchSource:0}: Error finding container b301ee7e8f3c624235157501e212689ff3f30c5426d15981b1eedbbc9c29791a: Status 404 returned error can't find the container with id b301ee7e8f3c624235157501e212689ff3f30c5426d15981b1eedbbc9c29791a
Jul 09 18:58:22.939202 ip-10-0-139-134 kubenswrapper[2578]: W0709 18:58:22.939187    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6c8631cd46f5ef2fe2e7fec413f6f8d7.slice/crio-4cbef617359b2ef005c96db8f66124acc42afb7b313a2d5f2755c024a4ccd8c6 WatchSource:0}: Error finding container 4cbef617359b2ef005c96db8f66124acc42afb7b313a2d5f2755c024a4ccd8c6: Status 404 returned error can't find the container with id 4cbef617359b2ef005c96db8f66124acc42afb7b313a2d5f2755c024a4ccd8c6
Jul 09 18:58:22.944866 ip-10-0-139-134 kubenswrapper[2578]: I0709 18:58:22.944846    2578 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 09 18:58:22.966694 ip-10-0-139-134 kubenswrapper[2578]: I0709 18:58:22.966648    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-134.ec2.internal" event={"ID":"6c8631cd46f5ef2fe2e7fec413f6f8d7","Type":"ContainerStarted","Data":"4cbef617359b2ef005c96db8f66124acc42afb7b313a2d5f2755c024a4ccd8c6"}
Jul 09 18:58:22.967635 ip-10-0-139-134 kubenswrapper[2578]: I0709 18:58:22.967611    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-139-134.ec2.internal" event={"ID":"6d1a4d271968fb37c56f11e30e3e00f8","Type":"ContainerStarted","Data":"b301ee7e8f3c624235157501e212689ff3f30c5426d15981b1eedbbc9c29791a"}
Jul 09 18:58:22.982794 ip-10-0-139-134 kubenswrapper[2578]: E0709 18:58:22.982765    2578 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-139-134.ec2.internal\" not found"
Jul 09 18:58:22.993902 ip-10-0-139-134 kubenswrapper[2578]: I0709 18:58:22.993878    2578 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 09 18:58:23.083596 ip-10-0-139-134 kubenswrapper[2578]: E0709 18:58:23.083551    2578 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-139-134.ec2.internal\" not found"
Jul 09 18:58:23.184177 ip-10-0-139-134 kubenswrapper[2578]: E0709 18:58:23.184083    2578 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-139-134.ec2.internal\" not found"
Jul 09 18:58:23.284736 ip-10-0-139-134 kubenswrapper[2578]: E0709 18:58:23.284704    2578 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-139-134.ec2.internal\" not found"
Jul 09 18:58:25.254048 ip-10-0-139-134 kubenswrapper[2578]: E0709 18:58:25.254023    2578 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-139-134.ec2.internal\" not found"
Jul 09 18:58:25.264832 ip-10-0-139-134 kubenswrapper[2578]: I0709 18:58:25.264804    2578 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 09 18:58:25.360215 ip-10-0-139-134 kubenswrapper[2578]: I0709 18:58:25.360135    2578 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-139-134.ec2.internal"
Jul 09 18:58:25.368219 ip-10-0-139-134 kubenswrapper[2578]: I0709 18:58:25.368193    2578 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Jul 09 18:58:25.369729 ip-10-0-139-134 kubenswrapper[2578]: I0709 18:58:25.369696    2578 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-134.ec2.internal"
Jul 09 18:58:25.380467 ip-10-0-139-134 kubenswrapper[2578]: I0709 18:58:25.380437    2578 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Jul 09 18:58:25.617370 ip-10-0-139-134 kubenswrapper[2578]: I0709 18:58:25.617278    2578 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 09 18:58:25.741966 ip-10-0-139-134 kubenswrapper[2578]: I0709 18:58:25.741938    2578 apiserver.go:52] "Watching apiserver"
Jul 09 18:58:25.751434 ip-10-0-139-134 kubenswrapper[2578]: I0709 18:58:25.751405    2578 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66"
Jul 09 18:58:25.754877 ip-10-0-139-134 kubenswrapper[2578]: I0709 18:58:25.754847    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kube-system/konnectivity-agent-vnnqd","openshift-cluster-node-tuning-operator/tuned-zj6hn","openshift-dns/node-resolver-4ntmk","openshift-multus/network-metrics-daemon-dztbt","openshift-network-operator/iptables-alerter-m9cp9","openshift-ovn-kubernetes/ovnkube-node-8gqbs","kube-system/global-pull-secret-syncer-kmr4m","kube-system/kube-apiserver-proxy-ip-10-0-139-134.ec2.internal","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fghgd","openshift-image-registry/node-ca-zwps8","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-134.ec2.internal","openshift-multus/multus-7mdng","openshift-multus/multus-additional-cni-plugins-cs7mq","openshift-network-diagnostics/network-check-target-9n6nc"]
Jul 09 18:58:25.756571 ip-10-0-139-134 kubenswrapper[2578]: I0709 18:58:25.756538    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fghgd"
Jul 09 18:58:25.757882 ip-10-0-139-134 kubenswrapper[2578]: I0709 18:58:25.757841    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-zj6hn"
Jul 09 18:58:25.759628 ip-10-0-139-134 kubenswrapper[2578]: I0709 18:58:25.759596    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\""
Jul 09 18:58:25.759723 ip-10-0-139-134 kubenswrapper[2578]: I0709 18:58:25.759601    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\""
Jul 09 18:58:25.759893 ip-10-0-139-134 kubenswrapper[2578]: I0709 18:58:25.759873    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-jr259\""
Jul 09 18:58:25.760063 ip-10-0-139-134 kubenswrapper[2578]: I0709 18:58:25.760046    2578 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving"
Jul 09 18:58:25.760333 ip-10-0-139-134 kubenswrapper[2578]: I0709 18:58:25.760315    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-4ntmk"
Jul 09 18:58:25.760777 ip-10-0-139-134 kubenswrapper[2578]: I0709 18:58:25.760756    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\""
Jul 09 18:58:25.760858 ip-10-0-139-134 kubenswrapper[2578]: I0709 18:58:25.760790    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\""
Jul 09 18:58:25.761260 ip-10-0-139-134 kubenswrapper[2578]: I0709 18:58:25.761236    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-sj4v7\""
Jul 09 18:58:25.763506 ip-10-0-139-134 kubenswrapper[2578]: I0709 18:58:25.761642    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\""
Jul 09 18:58:25.764528 ip-10-0-139-134 kubenswrapper[2578]: I0709 18:58:25.764508    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-dztbt"
Jul 09 18:58:25.764628 ip-10-0-139-134 kubenswrapper[2578]: E0709 18:58:25.764593    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-dztbt" podUID="a6f6e738-06b0-41d1-bcc4-3627871fe3d6"
Jul 09 18:58:25.765022 ip-10-0-139-134 kubenswrapper[2578]: I0709 18:58:25.764984    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-cs7mq"
Jul 09 18:58:25.767514 ip-10-0-139-134 kubenswrapper[2578]: I0709 18:58:25.767472    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-7s27s\""
Jul 09 18:58:25.767514 ip-10-0-139-134 kubenswrapper[2578]: I0709 18:58:25.767474    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\""
Jul 09 18:58:25.767731 ip-10-0-139-134 kubenswrapper[2578]: I0709 18:58:25.767539    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\""
Jul 09 18:58:25.768046 ip-10-0-139-134 kubenswrapper[2578]: I0709 18:58:25.768025    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-65lmx\""
Jul 09 18:58:25.768140 ip-10-0-139-134 kubenswrapper[2578]: I0709 18:58:25.768085    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-7mdng"
Jul 09 18:58:25.769180 ip-10-0-139-134 kubenswrapper[2578]: I0709 18:58:25.769158    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\""
Jul 09 18:58:25.769282 ip-10-0-139-134 kubenswrapper[2578]: I0709 18:58:25.769204    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\""
Jul 09 18:58:25.769502 ip-10-0-139-134 kubenswrapper[2578]: I0709 18:58:25.769337    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\""
Jul 09 18:58:25.769502 ip-10-0-139-134 kubenswrapper[2578]: I0709 18:58:25.769451    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\""
Jul 09 18:58:25.769626 ip-10-0-139-134 kubenswrapper[2578]: I0709 18:58:25.769454    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\""
Jul 09 18:58:25.770544 ip-10-0-139-134 kubenswrapper[2578]: I0709 18:58:25.770527    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-kmr4m"
Jul 09 18:58:25.770643 ip-10-0-139-134 kubenswrapper[2578]: E0709 18:58:25.770613    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-kmr4m" podUID="4e35097c-426a-4343-aa9d-befa17cabda5"
Jul 09 18:58:25.770886 ip-10-0-139-134 kubenswrapper[2578]: I0709 18:58:25.770869    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\""
Jul 09 18:58:25.770979 ip-10-0-139-134 kubenswrapper[2578]: I0709 18:58:25.770904    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-krgmb\""
Jul 09 18:58:25.771698 ip-10-0-139-134 kubenswrapper[2578]: I0709 18:58:25.771681    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-vnnqd"
Jul 09 18:58:25.771785 ip-10-0-139-134 kubenswrapper[2578]: I0709 18:58:25.771705    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/31909fe7-f400-486f-8437-87c8674edc61-kubelet-dir\") pod \"aws-ebs-csi-driver-node-fghgd\" (UID: \"31909fe7-f400-486f-8437-87c8674edc61\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fghgd"
Jul 09 18:58:25.771785 ip-10-0-139-134 kubenswrapper[2578]: I0709 18:58:25.771728    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/31909fe7-f400-486f-8437-87c8674edc61-socket-dir\") pod \"aws-ebs-csi-driver-node-fghgd\" (UID: \"31909fe7-f400-486f-8437-87c8674edc61\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fghgd"
Jul 09 18:58:25.771785 ip-10-0-139-134 kubenswrapper[2578]: I0709 18:58:25.771753    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/31909fe7-f400-486f-8437-87c8674edc61-registration-dir\") pod \"aws-ebs-csi-driver-node-fghgd\" (UID: \"31909fe7-f400-486f-8437-87c8674edc61\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fghgd"
Jul 09 18:58:25.771943 ip-10-0-139-134 kubenswrapper[2578]: I0709 18:58:25.771802    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/31909fe7-f400-486f-8437-87c8674edc61-device-dir\") pod \"aws-ebs-csi-driver-node-fghgd\" (UID: \"31909fe7-f400-486f-8437-87c8674edc61\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fghgd"
Jul 09 18:58:25.771943 ip-10-0-139-134 kubenswrapper[2578]: I0709 18:58:25.771870    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/31909fe7-f400-486f-8437-87c8674edc61-etc-selinux\") pod \"aws-ebs-csi-driver-node-fghgd\" (UID: \"31909fe7-f400-486f-8437-87c8674edc61\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fghgd"
Jul 09 18:58:25.771943 ip-10-0-139-134 kubenswrapper[2578]: I0709 18:58:25.771921    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bllj5\" (UniqueName: \"kubernetes.io/projected/31909fe7-f400-486f-8437-87c8674edc61-kube-api-access-bllj5\") pod \"aws-ebs-csi-driver-node-fghgd\" (UID: \"31909fe7-f400-486f-8437-87c8674edc61\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fghgd"
Jul 09 18:58:25.772110 ip-10-0-139-134 kubenswrapper[2578]: I0709 18:58:25.771960    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/3e4f13a3-c390-4ad2-9816-b389fa5abe57-etc-systemd\") pod \"tuned-zj6hn\" (UID: \"3e4f13a3-c390-4ad2-9816-b389fa5abe57\") " pod="openshift-cluster-node-tuning-operator/tuned-zj6hn"
Jul 09 18:58:25.772110 ip-10-0-139-134 kubenswrapper[2578]: I0709 18:58:25.772021    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/31909fe7-f400-486f-8437-87c8674edc61-sys-fs\") pod \"aws-ebs-csi-driver-node-fghgd\" (UID: \"31909fe7-f400-486f-8437-87c8674edc61\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fghgd"
Jul 09 18:58:25.772110 ip-10-0-139-134 kubenswrapper[2578]: I0709 18:58:25.772045    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/3e4f13a3-c390-4ad2-9816-b389fa5abe57-etc-sysconfig\") pod \"tuned-zj6hn\" (UID: \"3e4f13a3-c390-4ad2-9816-b389fa5abe57\") " pod="openshift-cluster-node-tuning-operator/tuned-zj6hn"
Jul 09 18:58:25.772258 ip-10-0-139-134 kubenswrapper[2578]: I0709 18:58:25.772108    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/3e4f13a3-c390-4ad2-9816-b389fa5abe57-sys\") pod \"tuned-zj6hn\" (UID: \"3e4f13a3-c390-4ad2-9816-b389fa5abe57\") " pod="openshift-cluster-node-tuning-operator/tuned-zj6hn"
Jul 09 18:58:25.772258 ip-10-0-139-134 kubenswrapper[2578]: I0709 18:58:25.772156    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/4b9891d4-d137-4996-ba20-f037de730093-hosts-file\") pod \"node-resolver-4ntmk\" (UID: \"4b9891d4-d137-4996-ba20-f037de730093\") " pod="openshift-dns/node-resolver-4ntmk"
Jul 09 18:58:25.772258 ip-10-0-139-134 kubenswrapper[2578]: I0709 18:58:25.772188    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/3e4f13a3-c390-4ad2-9816-b389fa5abe57-etc-modprobe-d\") pod \"tuned-zj6hn\" (UID: \"3e4f13a3-c390-4ad2-9816-b389fa5abe57\") " pod="openshift-cluster-node-tuning-operator/tuned-zj6hn"
Jul 09 18:58:25.772258 ip-10-0-139-134 kubenswrapper[2578]: I0709 18:58:25.772214    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/3e4f13a3-c390-4ad2-9816-b389fa5abe57-etc-sysctl-d\") pod \"tuned-zj6hn\" (UID: \"3e4f13a3-c390-4ad2-9816-b389fa5abe57\") " pod="openshift-cluster-node-tuning-operator/tuned-zj6hn"
Jul 09 18:58:25.772258 ip-10-0-139-134 kubenswrapper[2578]: I0709 18:58:25.772237    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/3e4f13a3-c390-4ad2-9816-b389fa5abe57-etc-sysctl-conf\") pod \"tuned-zj6hn\" (UID: \"3e4f13a3-c390-4ad2-9816-b389fa5abe57\") " pod="openshift-cluster-node-tuning-operator/tuned-zj6hn"
Jul 09 18:58:25.772491 ip-10-0-139-134 kubenswrapper[2578]: I0709 18:58:25.772259    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/3e4f13a3-c390-4ad2-9816-b389fa5abe57-lib-modules\") pod \"tuned-zj6hn\" (UID: \"3e4f13a3-c390-4ad2-9816-b389fa5abe57\") " pod="openshift-cluster-node-tuning-operator/tuned-zj6hn"
Jul 09 18:58:25.772491 ip-10-0-139-134 kubenswrapper[2578]: I0709 18:58:25.772281    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/3e4f13a3-c390-4ad2-9816-b389fa5abe57-host\") pod \"tuned-zj6hn\" (UID: \"3e4f13a3-c390-4ad2-9816-b389fa5abe57\") " pod="openshift-cluster-node-tuning-operator/tuned-zj6hn"
Jul 09 18:58:25.772491 ip-10-0-139-134 kubenswrapper[2578]: I0709 18:58:25.772303    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/3e4f13a3-c390-4ad2-9816-b389fa5abe57-etc-tuned\") pod \"tuned-zj6hn\" (UID: \"3e4f13a3-c390-4ad2-9816-b389fa5abe57\") " pod="openshift-cluster-node-tuning-operator/tuned-zj6hn"
Jul 09 18:58:25.772491 ip-10-0-139-134 kubenswrapper[2578]: I0709 18:58:25.772338    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/3e4f13a3-c390-4ad2-9816-b389fa5abe57-etc-kubernetes\") pod \"tuned-zj6hn\" (UID: \"3e4f13a3-c390-4ad2-9816-b389fa5abe57\") " pod="openshift-cluster-node-tuning-operator/tuned-zj6hn"
Jul 09 18:58:25.772491 ip-10-0-139-134 kubenswrapper[2578]: I0709 18:58:25.772368    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/3e4f13a3-c390-4ad2-9816-b389fa5abe57-run\") pod \"tuned-zj6hn\" (UID: \"3e4f13a3-c390-4ad2-9816-b389fa5abe57\") " pod="openshift-cluster-node-tuning-operator/tuned-zj6hn"
Jul 09 18:58:25.772491 ip-10-0-139-134 kubenswrapper[2578]: I0709 18:58:25.772392    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/3e4f13a3-c390-4ad2-9816-b389fa5abe57-var-lib-kubelet\") pod \"tuned-zj6hn\" (UID: \"3e4f13a3-c390-4ad2-9816-b389fa5abe57\") " pod="openshift-cluster-node-tuning-operator/tuned-zj6hn"
Jul 09 18:58:25.772491 ip-10-0-139-134 kubenswrapper[2578]: I0709 18:58:25.772414    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/3e4f13a3-c390-4ad2-9816-b389fa5abe57-tmp\") pod \"tuned-zj6hn\" (UID: \"3e4f13a3-c390-4ad2-9816-b389fa5abe57\") " pod="openshift-cluster-node-tuning-operator/tuned-zj6hn"
Jul 09 18:58:25.772491 ip-10-0-139-134 kubenswrapper[2578]: I0709 18:58:25.772438    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-67gtk\" (UniqueName: \"kubernetes.io/projected/3e4f13a3-c390-4ad2-9816-b389fa5abe57-kube-api-access-67gtk\") pod \"tuned-zj6hn\" (UID: \"3e4f13a3-c390-4ad2-9816-b389fa5abe57\") " pod="openshift-cluster-node-tuning-operator/tuned-zj6hn"
Jul 09 18:58:25.772491 ip-10-0-139-134 kubenswrapper[2578]: I0709 18:58:25.772475    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/4b9891d4-d137-4996-ba20-f037de730093-tmp-dir\") pod \"node-resolver-4ntmk\" (UID: \"4b9891d4-d137-4996-ba20-f037de730093\") " pod="openshift-dns/node-resolver-4ntmk"
Jul 09 18:58:25.772828 ip-10-0-139-134 kubenswrapper[2578]: I0709 18:58:25.772509    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-drk5q\" (UniqueName: \"kubernetes.io/projected/4b9891d4-d137-4996-ba20-f037de730093-kube-api-access-drk5q\") pod \"node-resolver-4ntmk\" (UID: \"4b9891d4-d137-4996-ba20-f037de730093\") " pod="openshift-dns/node-resolver-4ntmk"
Jul 09 18:58:25.773391 ip-10-0-139-134 kubenswrapper[2578]: I0709 18:58:25.773375    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-zwps8"
Jul 09 18:58:25.774566 ip-10-0-139-134 kubenswrapper[2578]: I0709 18:58:25.774548    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\""
Jul 09 18:58:25.774566 ip-10-0-139-134 kubenswrapper[2578]: I0709 18:58:25.774564    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-gkt44\""
Jul 09 18:58:25.774712 ip-10-0-139-134 kubenswrapper[2578]: I0709 18:58:25.774694    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\""
Jul 09 18:58:25.774924 ip-10-0-139-134 kubenswrapper[2578]: I0709 18:58:25.774907    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-8gqbs"
Jul 09 18:58:25.775914 ip-10-0-139-134 kubenswrapper[2578]: I0709 18:58:25.775892    2578 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Jul 09 18:58:25.776189 ip-10-0-139-134 kubenswrapper[2578]: I0709 18:58:25.776173    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-svrl4\""
Jul 09 18:58:25.776356 ip-10-0-139-134 kubenswrapper[2578]: I0709 18:58:25.776336    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-m9cp9"
Jul 09 18:58:25.776873 ip-10-0-139-134 kubenswrapper[2578]: I0709 18:58:25.776849    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\""
Jul 09 18:58:25.776957 ip-10-0-139-134 kubenswrapper[2578]: I0709 18:58:25.776912    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\""
Jul 09 18:58:25.776957 ip-10-0-139-134 kubenswrapper[2578]: I0709 18:58:25.776949    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\""
Jul 09 18:58:25.777574 ip-10-0-139-134 kubenswrapper[2578]: I0709 18:58:25.777552    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\""
Jul 09 18:58:25.777738 ip-10-0-139-134 kubenswrapper[2578]: I0709 18:58:25.777718    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-htlzl\""
Jul 09 18:58:25.778416 ip-10-0-139-134 kubenswrapper[2578]: I0709 18:58:25.778398    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-9n6nc"
Jul 09 18:58:25.778501 ip-10-0-139-134 kubenswrapper[2578]: E0709 18:58:25.778459    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-9n6nc" podUID="2d052a65-da3a-4426-a441-83b9cc44217b"
Jul 09 18:58:25.779736 ip-10-0-139-134 kubenswrapper[2578]: I0709 18:58:25.779495    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\""
Jul 09 18:58:25.779736 ip-10-0-139-134 kubenswrapper[2578]: I0709 18:58:25.779533    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\""
Jul 09 18:58:25.779736 ip-10-0-139-134 kubenswrapper[2578]: I0709 18:58:25.779543    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\""
Jul 09 18:58:25.779736 ip-10-0-139-134 kubenswrapper[2578]: I0709 18:58:25.779546    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\""
Jul 09 18:58:25.779736 ip-10-0-139-134 kubenswrapper[2578]: I0709 18:58:25.779561    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\""
Jul 09 18:58:25.780032 ip-10-0-139-134 kubenswrapper[2578]: I0709 18:58:25.779834    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\""
Jul 09 18:58:25.780032 ip-10-0-139-134 kubenswrapper[2578]: I0709 18:58:25.779856    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-ftp8m\""
Jul 09 18:58:25.780032 ip-10-0-139-134 kubenswrapper[2578]: I0709 18:58:25.779917    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\""
Jul 09 18:58:25.780032 ip-10-0-139-134 kubenswrapper[2578]: I0709 18:58:25.779917    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\""
Jul 09 18:58:25.795602 ip-10-0-139-134 kubenswrapper[2578]: I0709 18:58:25.795577    2578 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-k7rlf"
Jul 09 18:58:25.803570 ip-10-0-139-134 kubenswrapper[2578]: I0709 18:58:25.803546    2578 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-k7rlf"
Jul 09 18:58:25.862141 ip-10-0-139-134 kubenswrapper[2578]: I0709 18:58:25.862110    2578 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world"
Jul 09 18:58:25.873283 ip-10-0-139-134 kubenswrapper[2578]: I0709 18:58:25.873203    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/4b9891d4-d137-4996-ba20-f037de730093-tmp-dir\") pod \"node-resolver-4ntmk\" (UID: \"4b9891d4-d137-4996-ba20-f037de730093\") " pod="openshift-dns/node-resolver-4ntmk"
Jul 09 18:58:25.873283 ip-10-0-139-134 kubenswrapper[2578]: I0709 18:58:25.873242    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/d83b5188-15a8-4450-803c-62524a249f65-tuning-conf-dir\") pod \"multus-additional-cni-plugins-cs7mq\" (UID: \"d83b5188-15a8-4450-803c-62524a249f65\") " pod="openshift-multus/multus-additional-cni-plugins-cs7mq"
Jul 09 18:58:25.873283 ip-10-0-139-134 kubenswrapper[2578]: I0709 18:58:25.873267    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/d83b5188-15a8-4450-803c-62524a249f65-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-cs7mq\" (UID: \"d83b5188-15a8-4450-803c-62524a249f65\") " pod="openshift-multus/multus-additional-cni-plugins-cs7mq"
Jul 09 18:58:25.873535 ip-10-0-139-134 kubenswrapper[2578]: I0709 18:58:25.873294    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/7a15b7a9-7525-426b-a051-3ece178b71bc-run-ovn\") pod \"ovnkube-node-8gqbs\" (UID: \"7a15b7a9-7525-426b-a051-3ece178b71bc\") " pod="openshift-ovn-kubernetes/ovnkube-node-8gqbs"
Jul 09 18:58:25.873535 ip-10-0-139-134 kubenswrapper[2578]: I0709 18:58:25.873403    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/7a15b7a9-7525-426b-a051-3ece178b71bc-host-cni-bin\") pod \"ovnkube-node-8gqbs\" (UID: \"7a15b7a9-7525-426b-a051-3ece178b71bc\") " pod="openshift-ovn-kubernetes/ovnkube-node-8gqbs"
Jul 09 18:58:25.873535 ip-10-0-139-134 kubenswrapper[2578]: I0709 18:58:25.873436    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/b322e6fc-5ae5-456b-a21c-364ba723d213-iptables-alerter-script\") pod \"iptables-alerter-m9cp9\" (UID: \"b322e6fc-5ae5-456b-a21c-364ba723d213\") " pod="openshift-network-operator/iptables-alerter-m9cp9"
Jul 09 18:58:25.873535 ip-10-0-139-134 kubenswrapper[2578]: I0709 18:58:25.873459    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/3e4f13a3-c390-4ad2-9816-b389fa5abe57-run\") pod \"tuned-zj6hn\" (UID: \"3e4f13a3-c390-4ad2-9816-b389fa5abe57\") " pod="openshift-cluster-node-tuning-operator/tuned-zj6hn"
Jul 09 18:58:25.873535 ip-10-0-139-134 kubenswrapper[2578]: I0709 18:58:25.873510    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ppg9j\" (UniqueName: \"kubernetes.io/projected/d83b5188-15a8-4450-803c-62524a249f65-kube-api-access-ppg9j\") pod \"multus-additional-cni-plugins-cs7mq\" (UID: \"d83b5188-15a8-4450-803c-62524a249f65\") " pod="openshift-multus/multus-additional-cni-plugins-cs7mq"
Jul 09 18:58:25.873535 ip-10-0-139-134 kubenswrapper[2578]: I0709 18:58:25.873526    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/3e4f13a3-c390-4ad2-9816-b389fa5abe57-run\") pod \"tuned-zj6hn\" (UID: \"3e4f13a3-c390-4ad2-9816-b389fa5abe57\") " pod="openshift-cluster-node-tuning-operator/tuned-zj6hn"
Jul 09 18:58:25.873821 ip-10-0-139-134 kubenswrapper[2578]: I0709 18:58:25.873549    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/c47bacce-dcdf-4fbf-af5f-5c781c502907-etc-kubernetes\") pod \"multus-7mdng\" (UID: \"c47bacce-dcdf-4fbf-af5f-5c781c502907\") " pod="openshift-multus/multus-7mdng"
Jul 09 18:58:25.873821 ip-10-0-139-134 kubenswrapper[2578]: I0709 18:58:25.873576    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9rx4q\" (UniqueName: \"kubernetes.io/projected/c47bacce-dcdf-4fbf-af5f-5c781c502907-kube-api-access-9rx4q\") pod \"multus-7mdng\" (UID: \"c47bacce-dcdf-4fbf-af5f-5c781c502907\") " pod="openshift-multus/multus-7mdng"
Jul 09 18:58:25.873821 ip-10-0-139-134 kubenswrapper[2578]: I0709 18:58:25.873593    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/4b9891d4-d137-4996-ba20-f037de730093-tmp-dir\") pod \"node-resolver-4ntmk\" (UID: \"4b9891d4-d137-4996-ba20-f037de730093\") " pod="openshift-dns/node-resolver-4ntmk"
Jul 09 18:58:25.873821 ip-10-0-139-134 kubenswrapper[2578]: I0709 18:58:25.873595    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/d9cc9b31-8c81-490e-911c-692cc55539c1-host\") pod \"node-ca-zwps8\" (UID: \"d9cc9b31-8c81-490e-911c-692cc55539c1\") " pod="openshift-image-registry/node-ca-zwps8"
Jul 09 18:58:25.873821 ip-10-0-139-134 kubenswrapper[2578]: I0709 18:58:25.873672    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/7a15b7a9-7525-426b-a051-3ece178b71bc-ovnkube-config\") pod \"ovnkube-node-8gqbs\" (UID: \"7a15b7a9-7525-426b-a051-3ece178b71bc\") " pod="openshift-ovn-kubernetes/ovnkube-node-8gqbs"
Jul 09 18:58:25.873821 ip-10-0-139-134 kubenswrapper[2578]: I0709 18:58:25.873697    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rfxj5\" (UniqueName: \"kubernetes.io/projected/a6f6e738-06b0-41d1-bcc4-3627871fe3d6-kube-api-access-rfxj5\") pod \"network-metrics-daemon-dztbt\" (UID: \"a6f6e738-06b0-41d1-bcc4-3627871fe3d6\") " pod="openshift-multus/network-metrics-daemon-dztbt"
Jul 09 18:58:25.873821 ip-10-0-139-134 kubenswrapper[2578]: I0709 18:58:25.873725    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/19c7b09c-711d-472b-95ef-ab437e64985c-konnectivity-ca\") pod \"konnectivity-agent-vnnqd\" (UID: \"19c7b09c-711d-472b-95ef-ab437e64985c\") " pod="kube-system/konnectivity-agent-vnnqd"
Jul 09 18:58:25.873821 ip-10-0-139-134 kubenswrapper[2578]: I0709 18:58:25.873747    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/31909fe7-f400-486f-8437-87c8674edc61-device-dir\") pod \"aws-ebs-csi-driver-node-fghgd\" (UID: \"31909fe7-f400-486f-8437-87c8674edc61\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fghgd"
Jul 09 18:58:25.873821 ip-10-0-139-134 kubenswrapper[2578]: I0709 18:58:25.873769    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/c47bacce-dcdf-4fbf-af5f-5c781c502907-multus-socket-dir-parent\") pod \"multus-7mdng\" (UID: \"c47bacce-dcdf-4fbf-af5f-5c781c502907\") " pod="openshift-multus/multus-7mdng"
Jul 09 18:58:25.873821 ip-10-0-139-134 kubenswrapper[2578]: I0709 18:58:25.873786    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/c47bacce-dcdf-4fbf-af5f-5c781c502907-host-var-lib-kubelet\") pod \"multus-7mdng\" (UID: \"c47bacce-dcdf-4fbf-af5f-5c781c502907\") " pod="openshift-multus/multus-7mdng"
Jul 09 18:58:25.873821 ip-10-0-139-134 kubenswrapper[2578]: I0709 18:58:25.873801    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/7a15b7a9-7525-426b-a051-3ece178b71bc-systemd-units\") pod \"ovnkube-node-8gqbs\" (UID: \"7a15b7a9-7525-426b-a051-3ece178b71bc\") " pod="openshift-ovn-kubernetes/ovnkube-node-8gqbs"
Jul 09 18:58:25.873821 ip-10-0-139-134 kubenswrapper[2578]: I0709 18:58:25.873814    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/19c7b09c-711d-472b-95ef-ab437e64985c-agent-certs\") pod \"konnectivity-agent-vnnqd\" (UID: \"19c7b09c-711d-472b-95ef-ab437e64985c\") " pod="kube-system/konnectivity-agent-vnnqd"
Jul 09 18:58:25.874368 ip-10-0-139-134 kubenswrapper[2578]: I0709 18:58:25.873827    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/31909fe7-f400-486f-8437-87c8674edc61-device-dir\") pod \"aws-ebs-csi-driver-node-fghgd\" (UID: \"31909fe7-f400-486f-8437-87c8674edc61\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fghgd"
Jul 09 18:58:25.874368 ip-10-0-139-134 kubenswrapper[2578]: I0709 18:58:25.873838    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/3e4f13a3-c390-4ad2-9816-b389fa5abe57-sys\") pod \"tuned-zj6hn\" (UID: \"3e4f13a3-c390-4ad2-9816-b389fa5abe57\") " pod="openshift-cluster-node-tuning-operator/tuned-zj6hn"
Jul 09 18:58:25.874368 ip-10-0-139-134 kubenswrapper[2578]: I0709 18:58:25.873882    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/c47bacce-dcdf-4fbf-af5f-5c781c502907-host-var-lib-cni-multus\") pod \"multus-7mdng\" (UID: \"c47bacce-dcdf-4fbf-af5f-5c781c502907\") " pod="openshift-multus/multus-7mdng"
Jul 09 18:58:25.874368 ip-10-0-139-134 kubenswrapper[2578]: I0709 18:58:25.873910    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/c47bacce-dcdf-4fbf-af5f-5c781c502907-host-run-multus-certs\") pod \"multus-7mdng\" (UID: \"c47bacce-dcdf-4fbf-af5f-5c781c502907\") " pod="openshift-multus/multus-7mdng"
Jul 09 18:58:25.874368 ip-10-0-139-134 kubenswrapper[2578]: I0709 18:58:25.873888    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/3e4f13a3-c390-4ad2-9816-b389fa5abe57-sys\") pod \"tuned-zj6hn\" (UID: \"3e4f13a3-c390-4ad2-9816-b389fa5abe57\") " pod="openshift-cluster-node-tuning-operator/tuned-zj6hn"
Jul 09 18:58:25.874368 ip-10-0-139-134 kubenswrapper[2578]: I0709 18:58:25.873933    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/4e35097c-426a-4343-aa9d-befa17cabda5-dbus\") pod \"global-pull-secret-syncer-kmr4m\" (UID: \"4e35097c-426a-4343-aa9d-befa17cabda5\") " pod="kube-system/global-pull-secret-syncer-kmr4m"
Jul 09 18:58:25.874368 ip-10-0-139-134 kubenswrapper[2578]: I0709 18:58:25.873961    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/3e4f13a3-c390-4ad2-9816-b389fa5abe57-etc-sysctl-conf\") pod \"tuned-zj6hn\" (UID: \"3e4f13a3-c390-4ad2-9816-b389fa5abe57\") " pod="openshift-cluster-node-tuning-operator/tuned-zj6hn"
Jul 09 18:58:25.874368 ip-10-0-139-134 kubenswrapper[2578]: I0709 18:58:25.873983    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-67gtk\" (UniqueName: \"kubernetes.io/projected/3e4f13a3-c390-4ad2-9816-b389fa5abe57-kube-api-access-67gtk\") pod \"tuned-zj6hn\" (UID: \"3e4f13a3-c390-4ad2-9816-b389fa5abe57\") " pod="openshift-cluster-node-tuning-operator/tuned-zj6hn"
Jul 09 18:58:25.874368 ip-10-0-139-134 kubenswrapper[2578]: I0709 18:58:25.874014    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/d83b5188-15a8-4450-803c-62524a249f65-cni-binary-copy\") pod \"multus-additional-cni-plugins-cs7mq\" (UID: \"d83b5188-15a8-4450-803c-62524a249f65\") " pod="openshift-multus/multus-additional-cni-plugins-cs7mq"
Jul 09 18:58:25.874368 ip-10-0-139-134 kubenswrapper[2578]: I0709 18:58:25.874028    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/7a15b7a9-7525-426b-a051-3ece178b71bc-etc-openvswitch\") pod \"ovnkube-node-8gqbs\" (UID: \"7a15b7a9-7525-426b-a051-3ece178b71bc\") " pod="openshift-ovn-kubernetes/ovnkube-node-8gqbs"
Jul 09 18:58:25.874368 ip-10-0-139-134 kubenswrapper[2578]: I0709 18:58:25.874052    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/b322e6fc-5ae5-456b-a21c-364ba723d213-host-slash\") pod \"iptables-alerter-m9cp9\" (UID: \"b322e6fc-5ae5-456b-a21c-364ba723d213\") " pod="openshift-network-operator/iptables-alerter-m9cp9"
Jul 09 18:58:25.874368 ip-10-0-139-134 kubenswrapper[2578]: I0709 18:58:25.874074    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xfhcf\" (UniqueName: \"kubernetes.io/projected/2d052a65-da3a-4426-a441-83b9cc44217b-kube-api-access-xfhcf\") pod \"network-check-target-9n6nc\" (UID: \"2d052a65-da3a-4426-a441-83b9cc44217b\") " pod="openshift-network-diagnostics/network-check-target-9n6nc"
Jul 09 18:58:25.874368 ip-10-0-139-134 kubenswrapper[2578]: I0709 18:58:25.874088    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/d83b5188-15a8-4450-803c-62524a249f65-system-cni-dir\") pod \"multus-additional-cni-plugins-cs7mq\" (UID: \"d83b5188-15a8-4450-803c-62524a249f65\") " pod="openshift-multus/multus-additional-cni-plugins-cs7mq"
Jul 09 18:58:25.874368 ip-10-0-139-134 kubenswrapper[2578]: I0709 18:58:25.874104    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/7a15b7a9-7525-426b-a051-3ece178b71bc-host-kubelet\") pod \"ovnkube-node-8gqbs\" (UID: \"7a15b7a9-7525-426b-a051-3ece178b71bc\") " pod="openshift-ovn-kubernetes/ovnkube-node-8gqbs"
Jul 09 18:58:25.874368 ip-10-0-139-134 kubenswrapper[2578]: I0709 18:58:25.874118    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/7a15b7a9-7525-426b-a051-3ece178b71bc-ovnkube-script-lib\") pod \"ovnkube-node-8gqbs\" (UID: \"7a15b7a9-7525-426b-a051-3ece178b71bc\") " pod="openshift-ovn-kubernetes/ovnkube-node-8gqbs"
Jul 09 18:58:25.874368 ip-10-0-139-134 kubenswrapper[2578]: I0709 18:58:25.874121    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/3e4f13a3-c390-4ad2-9816-b389fa5abe57-etc-sysctl-conf\") pod \"tuned-zj6hn\" (UID: \"3e4f13a3-c390-4ad2-9816-b389fa5abe57\") " pod="openshift-cluster-node-tuning-operator/tuned-zj6hn"
Jul 09 18:58:25.874368 ip-10-0-139-134 kubenswrapper[2578]: I0709 18:58:25.874134    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-m4k8g\" (UniqueName: \"kubernetes.io/projected/7a15b7a9-7525-426b-a051-3ece178b71bc-kube-api-access-m4k8g\") pod \"ovnkube-node-8gqbs\" (UID: \"7a15b7a9-7525-426b-a051-3ece178b71bc\") " pod="openshift-ovn-kubernetes/ovnkube-node-8gqbs"
Jul 09 18:58:25.875055 ip-10-0-139-134 kubenswrapper[2578]: I0709 18:58:25.874157    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/4e35097c-426a-4343-aa9d-befa17cabda5-original-pull-secret\") pod \"global-pull-secret-syncer-kmr4m\" (UID: \"4e35097c-426a-4343-aa9d-befa17cabda5\") " pod="kube-system/global-pull-secret-syncer-kmr4m"
Jul 09 18:58:25.875055 ip-10-0-139-134 kubenswrapper[2578]: I0709 18:58:25.874204    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/7a15b7a9-7525-426b-a051-3ece178b71bc-host-slash\") pod \"ovnkube-node-8gqbs\" (UID: \"7a15b7a9-7525-426b-a051-3ece178b71bc\") " pod="openshift-ovn-kubernetes/ovnkube-node-8gqbs"
Jul 09 18:58:25.875055 ip-10-0-139-134 kubenswrapper[2578]: I0709 18:58:25.874231    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/7a15b7a9-7525-426b-a051-3ece178b71bc-run-openvswitch\") pod \"ovnkube-node-8gqbs\" (UID: \"7a15b7a9-7525-426b-a051-3ece178b71bc\") " pod="openshift-ovn-kubernetes/ovnkube-node-8gqbs"
Jul 09 18:58:25.875055 ip-10-0-139-134 kubenswrapper[2578]: I0709 18:58:25.874254    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/7a15b7a9-7525-426b-a051-3ece178b71bc-log-socket\") pod \"ovnkube-node-8gqbs\" (UID: \"7a15b7a9-7525-426b-a051-3ece178b71bc\") " pod="openshift-ovn-kubernetes/ovnkube-node-8gqbs"
Jul 09 18:58:25.875055 ip-10-0-139-134 kubenswrapper[2578]: I0709 18:58:25.874277    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/7a15b7a9-7525-426b-a051-3ece178b71bc-env-overrides\") pod \"ovnkube-node-8gqbs\" (UID: \"7a15b7a9-7525-426b-a051-3ece178b71bc\") " pod="openshift-ovn-kubernetes/ovnkube-node-8gqbs"
Jul 09 18:58:25.875055 ip-10-0-139-134 kubenswrapper[2578]: I0709 18:58:25.874302    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ccx2l\" (UniqueName: \"kubernetes.io/projected/b322e6fc-5ae5-456b-a21c-364ba723d213-kube-api-access-ccx2l\") pod \"iptables-alerter-m9cp9\" (UID: \"b322e6fc-5ae5-456b-a21c-364ba723d213\") " pod="openshift-network-operator/iptables-alerter-m9cp9"
Jul 09 18:58:25.875055 ip-10-0-139-134 kubenswrapper[2578]: I0709 18:58:25.874325    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/c47bacce-dcdf-4fbf-af5f-5c781c502907-os-release\") pod \"multus-7mdng\" (UID: \"c47bacce-dcdf-4fbf-af5f-5c781c502907\") " pod="openshift-multus/multus-7mdng"
Jul 09 18:58:25.875055 ip-10-0-139-134 kubenswrapper[2578]: I0709 18:58:25.874379    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/c47bacce-dcdf-4fbf-af5f-5c781c502907-cni-binary-copy\") pod \"multus-7mdng\" (UID: \"c47bacce-dcdf-4fbf-af5f-5c781c502907\") " pod="openshift-multus/multus-7mdng"
Jul 09 18:58:25.875055 ip-10-0-139-134 kubenswrapper[2578]: I0709 18:58:25.874406    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/3e4f13a3-c390-4ad2-9816-b389fa5abe57-etc-sysctl-d\") pod \"tuned-zj6hn\" (UID: \"3e4f13a3-c390-4ad2-9816-b389fa5abe57\") " pod="openshift-cluster-node-tuning-operator/tuned-zj6hn"
Jul 09 18:58:25.875055 ip-10-0-139-134 kubenswrapper[2578]: I0709 18:58:25.874430    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/3e4f13a3-c390-4ad2-9816-b389fa5abe57-etc-tuned\") pod \"tuned-zj6hn\" (UID: \"3e4f13a3-c390-4ad2-9816-b389fa5abe57\") " pod="openshift-cluster-node-tuning-operator/tuned-zj6hn"
Jul 09 18:58:25.875055 ip-10-0-139-134 kubenswrapper[2578]: I0709 18:58:25.874463    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-drk5q\" (UniqueName: \"kubernetes.io/projected/4b9891d4-d137-4996-ba20-f037de730093-kube-api-access-drk5q\") pod \"node-resolver-4ntmk\" (UID: \"4b9891d4-d137-4996-ba20-f037de730093\") " pod="openshift-dns/node-resolver-4ntmk"
Jul 09 18:58:25.875055 ip-10-0-139-134 kubenswrapper[2578]: I0709 18:58:25.874756    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/d83b5188-15a8-4450-803c-62524a249f65-os-release\") pod \"multus-additional-cni-plugins-cs7mq\" (UID: \"d83b5188-15a8-4450-803c-62524a249f65\") " pod="openshift-multus/multus-additional-cni-plugins-cs7mq"
Jul 09 18:58:25.875055 ip-10-0-139-134 kubenswrapper[2578]: I0709 18:58:25.874753    2578 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory"
Jul 09 18:58:25.875055 ip-10-0-139-134 kubenswrapper[2578]: I0709 18:58:25.874792    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/7a15b7a9-7525-426b-a051-3ece178b71bc-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-8gqbs\" (UID: \"7a15b7a9-7525-426b-a051-3ece178b71bc\") " pod="openshift-ovn-kubernetes/ovnkube-node-8gqbs"
Jul 09 18:58:25.875055 ip-10-0-139-134 kubenswrapper[2578]: I0709 18:58:25.874815    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/4e35097c-426a-4343-aa9d-befa17cabda5-kubelet-config\") pod \"global-pull-secret-syncer-kmr4m\" (UID: \"4e35097c-426a-4343-aa9d-befa17cabda5\") " pod="kube-system/global-pull-secret-syncer-kmr4m"
Jul 09 18:58:25.875055 ip-10-0-139-134 kubenswrapper[2578]: I0709 18:58:25.874843    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/3e4f13a3-c390-4ad2-9816-b389fa5abe57-etc-kubernetes\") pod \"tuned-zj6hn\" (UID: \"3e4f13a3-c390-4ad2-9816-b389fa5abe57\") " pod="openshift-cluster-node-tuning-operator/tuned-zj6hn"
Jul 09 18:58:25.875055 ip-10-0-139-134 kubenswrapper[2578]: I0709 18:58:25.874864    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/3e4f13a3-c390-4ad2-9816-b389fa5abe57-etc-sysctl-d\") pod \"tuned-zj6hn\" (UID: \"3e4f13a3-c390-4ad2-9816-b389fa5abe57\") " pod="openshift-cluster-node-tuning-operator/tuned-zj6hn"
Jul 09 18:58:25.875784 ip-10-0-139-134 kubenswrapper[2578]: I0709 18:58:25.874867    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/c47bacce-dcdf-4fbf-af5f-5c781c502907-multus-daemon-config\") pod \"multus-7mdng\" (UID: \"c47bacce-dcdf-4fbf-af5f-5c781c502907\") " pod="openshift-multus/multus-7mdng"
Jul 09 18:58:25.875784 ip-10-0-139-134 kubenswrapper[2578]: I0709 18:58:25.874899    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/7a15b7a9-7525-426b-a051-3ece178b71bc-node-log\") pod \"ovnkube-node-8gqbs\" (UID: \"7a15b7a9-7525-426b-a051-3ece178b71bc\") " pod="openshift-ovn-kubernetes/ovnkube-node-8gqbs"
Jul 09 18:58:25.875784 ip-10-0-139-134 kubenswrapper[2578]: I0709 18:58:25.874943    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/3e4f13a3-c390-4ad2-9816-b389fa5abe57-etc-kubernetes\") pod \"tuned-zj6hn\" (UID: \"3e4f13a3-c390-4ad2-9816-b389fa5abe57\") " pod="openshift-cluster-node-tuning-operator/tuned-zj6hn"
Jul 09 18:58:25.875784 ip-10-0-139-134 kubenswrapper[2578]: I0709 18:58:25.874973    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/7a15b7a9-7525-426b-a051-3ece178b71bc-host-cni-netd\") pod \"ovnkube-node-8gqbs\" (UID: \"7a15b7a9-7525-426b-a051-3ece178b71bc\") " pod="openshift-ovn-kubernetes/ovnkube-node-8gqbs"
Jul 09 18:58:25.875784 ip-10-0-139-134 kubenswrapper[2578]: I0709 18:58:25.875008    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/31909fe7-f400-486f-8437-87c8674edc61-socket-dir\") pod \"aws-ebs-csi-driver-node-fghgd\" (UID: \"31909fe7-f400-486f-8437-87c8674edc61\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fghgd"
Jul 09 18:58:25.875784 ip-10-0-139-134 kubenswrapper[2578]: I0709 18:58:25.875056    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/31909fe7-f400-486f-8437-87c8674edc61-etc-selinux\") pod \"aws-ebs-csi-driver-node-fghgd\" (UID: \"31909fe7-f400-486f-8437-87c8674edc61\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fghgd"
Jul 09 18:58:25.875784 ip-10-0-139-134 kubenswrapper[2578]: I0709 18:58:25.875098    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bllj5\" (UniqueName: \"kubernetes.io/projected/31909fe7-f400-486f-8437-87c8674edc61-kube-api-access-bllj5\") pod \"aws-ebs-csi-driver-node-fghgd\" (UID: \"31909fe7-f400-486f-8437-87c8674edc61\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fghgd"
Jul 09 18:58:25.875784 ip-10-0-139-134 kubenswrapper[2578]: I0709 18:58:25.875101    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/31909fe7-f400-486f-8437-87c8674edc61-socket-dir\") pod \"aws-ebs-csi-driver-node-fghgd\" (UID: \"31909fe7-f400-486f-8437-87c8674edc61\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fghgd"
Jul 09 18:58:25.875784 ip-10-0-139-134 kubenswrapper[2578]: I0709 18:58:25.875156    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/3e4f13a3-c390-4ad2-9816-b389fa5abe57-etc-systemd\") pod \"tuned-zj6hn\" (UID: \"3e4f13a3-c390-4ad2-9816-b389fa5abe57\") " pod="openshift-cluster-node-tuning-operator/tuned-zj6hn"
Jul 09 18:58:25.875784 ip-10-0-139-134 kubenswrapper[2578]: I0709 18:58:25.875189    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/31909fe7-f400-486f-8437-87c8674edc61-etc-selinux\") pod \"aws-ebs-csi-driver-node-fghgd\" (UID: \"31909fe7-f400-486f-8437-87c8674edc61\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fghgd"
Jul 09 18:58:25.875784 ip-10-0-139-134 kubenswrapper[2578]: I0709 18:58:25.875263    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/d83b5188-15a8-4450-803c-62524a249f65-cnibin\") pod \"multus-additional-cni-plugins-cs7mq\" (UID: \"d83b5188-15a8-4450-803c-62524a249f65\") " pod="openshift-multus/multus-additional-cni-plugins-cs7mq"
Jul 09 18:58:25.875784 ip-10-0-139-134 kubenswrapper[2578]: I0709 18:58:25.875298    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/c47bacce-dcdf-4fbf-af5f-5c781c502907-host-run-k8s-cni-cncf-io\") pod \"multus-7mdng\" (UID: \"c47bacce-dcdf-4fbf-af5f-5c781c502907\") " pod="openshift-multus/multus-7mdng"
Jul 09 18:58:25.875784 ip-10-0-139-134 kubenswrapper[2578]: I0709 18:58:25.875343    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/c47bacce-dcdf-4fbf-af5f-5c781c502907-multus-conf-dir\") pod \"multus-7mdng\" (UID: \"c47bacce-dcdf-4fbf-af5f-5c781c502907\") " pod="openshift-multus/multus-7mdng"
Jul 09 18:58:25.875784 ip-10-0-139-134 kubenswrapper[2578]: I0709 18:58:25.875361    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/3e4f13a3-c390-4ad2-9816-b389fa5abe57-etc-systemd\") pod \"tuned-zj6hn\" (UID: \"3e4f13a3-c390-4ad2-9816-b389fa5abe57\") " pod="openshift-cluster-node-tuning-operator/tuned-zj6hn"
Jul 09 18:58:25.875784 ip-10-0-139-134 kubenswrapper[2578]: I0709 18:58:25.875389    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pqrsl\" (UniqueName: \"kubernetes.io/projected/d9cc9b31-8c81-490e-911c-692cc55539c1-kube-api-access-pqrsl\") pod \"node-ca-zwps8\" (UID: \"d9cc9b31-8c81-490e-911c-692cc55539c1\") " pod="openshift-image-registry/node-ca-zwps8"
Jul 09 18:58:25.875784 ip-10-0-139-134 kubenswrapper[2578]: I0709 18:58:25.875407    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/d83b5188-15a8-4450-803c-62524a249f65-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-cs7mq\" (UID: \"d83b5188-15a8-4450-803c-62524a249f65\") " pod="openshift-multus/multus-additional-cni-plugins-cs7mq"
Jul 09 18:58:25.875784 ip-10-0-139-134 kubenswrapper[2578]: I0709 18:58:25.875445    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/7a15b7a9-7525-426b-a051-3ece178b71bc-var-lib-openvswitch\") pod \"ovnkube-node-8gqbs\" (UID: \"7a15b7a9-7525-426b-a051-3ece178b71bc\") " pod="openshift-ovn-kubernetes/ovnkube-node-8gqbs"
Jul 09 18:58:25.876721 ip-10-0-139-134 kubenswrapper[2578]: I0709 18:58:25.875479    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a6f6e738-06b0-41d1-bcc4-3627871fe3d6-metrics-certs\") pod \"network-metrics-daemon-dztbt\" (UID: \"a6f6e738-06b0-41d1-bcc4-3627871fe3d6\") " pod="openshift-multus/network-metrics-daemon-dztbt"
Jul 09 18:58:25.876721 ip-10-0-139-134 kubenswrapper[2578]: I0709 18:58:25.875528    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/3e4f13a3-c390-4ad2-9816-b389fa5abe57-etc-modprobe-d\") pod \"tuned-zj6hn\" (UID: \"3e4f13a3-c390-4ad2-9816-b389fa5abe57\") " pod="openshift-cluster-node-tuning-operator/tuned-zj6hn"
Jul 09 18:58:25.876721 ip-10-0-139-134 kubenswrapper[2578]: I0709 18:58:25.875555    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/3e4f13a3-c390-4ad2-9816-b389fa5abe57-lib-modules\") pod \"tuned-zj6hn\" (UID: \"3e4f13a3-c390-4ad2-9816-b389fa5abe57\") " pod="openshift-cluster-node-tuning-operator/tuned-zj6hn"
Jul 09 18:58:25.876721 ip-10-0-139-134 kubenswrapper[2578]: I0709 18:58:25.875575    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/3e4f13a3-c390-4ad2-9816-b389fa5abe57-host\") pod \"tuned-zj6hn\" (UID: \"3e4f13a3-c390-4ad2-9816-b389fa5abe57\") " pod="openshift-cluster-node-tuning-operator/tuned-zj6hn"
Jul 09 18:58:25.876721 ip-10-0-139-134 kubenswrapper[2578]: I0709 18:58:25.875598    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/c47bacce-dcdf-4fbf-af5f-5c781c502907-host-run-netns\") pod \"multus-7mdng\" (UID: \"c47bacce-dcdf-4fbf-af5f-5c781c502907\") " pod="openshift-multus/multus-7mdng"
Jul 09 18:58:25.876721 ip-10-0-139-134 kubenswrapper[2578]: I0709 18:58:25.875620    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/d9cc9b31-8c81-490e-911c-692cc55539c1-serviceca\") pod \"node-ca-zwps8\" (UID: \"d9cc9b31-8c81-490e-911c-692cc55539c1\") " pod="openshift-image-registry/node-ca-zwps8"
Jul 09 18:58:25.876721 ip-10-0-139-134 kubenswrapper[2578]: I0709 18:58:25.875642    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/7a15b7a9-7525-426b-a051-3ece178b71bc-host-run-netns\") pod \"ovnkube-node-8gqbs\" (UID: \"7a15b7a9-7525-426b-a051-3ece178b71bc\") " pod="openshift-ovn-kubernetes/ovnkube-node-8gqbs"
Jul 09 18:58:25.876721 ip-10-0-139-134 kubenswrapper[2578]: I0709 18:58:25.875648    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/3e4f13a3-c390-4ad2-9816-b389fa5abe57-etc-modprobe-d\") pod \"tuned-zj6hn\" (UID: \"3e4f13a3-c390-4ad2-9816-b389fa5abe57\") " pod="openshift-cluster-node-tuning-operator/tuned-zj6hn"
Jul 09 18:58:25.876721 ip-10-0-139-134 kubenswrapper[2578]: I0709 18:58:25.875664    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/7a15b7a9-7525-426b-a051-3ece178b71bc-ovn-node-metrics-cert\") pod \"ovnkube-node-8gqbs\" (UID: \"7a15b7a9-7525-426b-a051-3ece178b71bc\") " pod="openshift-ovn-kubernetes/ovnkube-node-8gqbs"
Jul 09 18:58:25.876721 ip-10-0-139-134 kubenswrapper[2578]: I0709 18:58:25.875689    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/3e4f13a3-c390-4ad2-9816-b389fa5abe57-var-lib-kubelet\") pod \"tuned-zj6hn\" (UID: \"3e4f13a3-c390-4ad2-9816-b389fa5abe57\") " pod="openshift-cluster-node-tuning-operator/tuned-zj6hn"
Jul 09 18:58:25.876721 ip-10-0-139-134 kubenswrapper[2578]: I0709 18:58:25.875662    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/3e4f13a3-c390-4ad2-9816-b389fa5abe57-host\") pod \"tuned-zj6hn\" (UID: \"3e4f13a3-c390-4ad2-9816-b389fa5abe57\") " pod="openshift-cluster-node-tuning-operator/tuned-zj6hn"
Jul 09 18:58:25.876721 ip-10-0-139-134 kubenswrapper[2578]: I0709 18:58:25.875712    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/3e4f13a3-c390-4ad2-9816-b389fa5abe57-tmp\") pod \"tuned-zj6hn\" (UID: \"3e4f13a3-c390-4ad2-9816-b389fa5abe57\") " pod="openshift-cluster-node-tuning-operator/tuned-zj6hn"
Jul 09 18:58:25.876721 ip-10-0-139-134 kubenswrapper[2578]: I0709 18:58:25.875719    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/3e4f13a3-c390-4ad2-9816-b389fa5abe57-lib-modules\") pod \"tuned-zj6hn\" (UID: \"3e4f13a3-c390-4ad2-9816-b389fa5abe57\") " pod="openshift-cluster-node-tuning-operator/tuned-zj6hn"
Jul 09 18:58:25.876721 ip-10-0-139-134 kubenswrapper[2578]: I0709 18:58:25.875790    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/3e4f13a3-c390-4ad2-9816-b389fa5abe57-var-lib-kubelet\") pod \"tuned-zj6hn\" (UID: \"3e4f13a3-c390-4ad2-9816-b389fa5abe57\") " pod="openshift-cluster-node-tuning-operator/tuned-zj6hn"
Jul 09 18:58:25.876721 ip-10-0-139-134 kubenswrapper[2578]: I0709 18:58:25.875822    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/7a15b7a9-7525-426b-a051-3ece178b71bc-run-systemd\") pod \"ovnkube-node-8gqbs\" (UID: \"7a15b7a9-7525-426b-a051-3ece178b71bc\") " pod="openshift-ovn-kubernetes/ovnkube-node-8gqbs"
Jul 09 18:58:25.876721 ip-10-0-139-134 kubenswrapper[2578]: I0709 18:58:25.875880    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/31909fe7-f400-486f-8437-87c8674edc61-kubelet-dir\") pod \"aws-ebs-csi-driver-node-fghgd\" (UID: \"31909fe7-f400-486f-8437-87c8674edc61\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fghgd"
Jul 09 18:58:25.876721 ip-10-0-139-134 kubenswrapper[2578]: I0709 18:58:25.875959    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/31909fe7-f400-486f-8437-87c8674edc61-kubelet-dir\") pod \"aws-ebs-csi-driver-node-fghgd\" (UID: \"31909fe7-f400-486f-8437-87c8674edc61\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fghgd"
Jul 09 18:58:25.877530 ip-10-0-139-134 kubenswrapper[2578]: I0709 18:58:25.876016    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/31909fe7-f400-486f-8437-87c8674edc61-registration-dir\") pod \"aws-ebs-csi-driver-node-fghgd\" (UID: \"31909fe7-f400-486f-8437-87c8674edc61\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fghgd"
Jul 09 18:58:25.877530 ip-10-0-139-134 kubenswrapper[2578]: I0709 18:58:25.876038    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/4b9891d4-d137-4996-ba20-f037de730093-hosts-file\") pod \"node-resolver-4ntmk\" (UID: \"4b9891d4-d137-4996-ba20-f037de730093\") " pod="openshift-dns/node-resolver-4ntmk"
Jul 09 18:58:25.877530 ip-10-0-139-134 kubenswrapper[2578]: I0709 18:58:25.876054    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/31909fe7-f400-486f-8437-87c8674edc61-registration-dir\") pod \"aws-ebs-csi-driver-node-fghgd\" (UID: \"31909fe7-f400-486f-8437-87c8674edc61\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fghgd"
Jul 09 18:58:25.877530 ip-10-0-139-134 kubenswrapper[2578]: I0709 18:58:25.876052    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/c47bacce-dcdf-4fbf-af5f-5c781c502907-system-cni-dir\") pod \"multus-7mdng\" (UID: \"c47bacce-dcdf-4fbf-af5f-5c781c502907\") " pod="openshift-multus/multus-7mdng"
Jul 09 18:58:25.877530 ip-10-0-139-134 kubenswrapper[2578]: I0709 18:58:25.876092    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/c47bacce-dcdf-4fbf-af5f-5c781c502907-hostroot\") pod \"multus-7mdng\" (UID: \"c47bacce-dcdf-4fbf-af5f-5c781c502907\") " pod="openshift-multus/multus-7mdng"
Jul 09 18:58:25.877530 ip-10-0-139-134 kubenswrapper[2578]: I0709 18:58:25.876114    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/7a15b7a9-7525-426b-a051-3ece178b71bc-host-run-ovn-kubernetes\") pod \"ovnkube-node-8gqbs\" (UID: \"7a15b7a9-7525-426b-a051-3ece178b71bc\") " pod="openshift-ovn-kubernetes/ovnkube-node-8gqbs"
Jul 09 18:58:25.877530 ip-10-0-139-134 kubenswrapper[2578]: I0709 18:58:25.876138    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/31909fe7-f400-486f-8437-87c8674edc61-sys-fs\") pod \"aws-ebs-csi-driver-node-fghgd\" (UID: \"31909fe7-f400-486f-8437-87c8674edc61\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fghgd"
Jul 09 18:58:25.877530 ip-10-0-139-134 kubenswrapper[2578]: I0709 18:58:25.876148    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/4b9891d4-d137-4996-ba20-f037de730093-hosts-file\") pod \"node-resolver-4ntmk\" (UID: \"4b9891d4-d137-4996-ba20-f037de730093\") " pod="openshift-dns/node-resolver-4ntmk"
Jul 09 18:58:25.877530 ip-10-0-139-134 kubenswrapper[2578]: I0709 18:58:25.876157    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/3e4f13a3-c390-4ad2-9816-b389fa5abe57-etc-sysconfig\") pod \"tuned-zj6hn\" (UID: \"3e4f13a3-c390-4ad2-9816-b389fa5abe57\") " pod="openshift-cluster-node-tuning-operator/tuned-zj6hn"
Jul 09 18:58:25.877530 ip-10-0-139-134 kubenswrapper[2578]: I0709 18:58:25.876195    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/c47bacce-dcdf-4fbf-af5f-5c781c502907-multus-cni-dir\") pod \"multus-7mdng\" (UID: \"c47bacce-dcdf-4fbf-af5f-5c781c502907\") " pod="openshift-multus/multus-7mdng"
Jul 09 18:58:25.877530 ip-10-0-139-134 kubenswrapper[2578]: I0709 18:58:25.876198    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/3e4f13a3-c390-4ad2-9816-b389fa5abe57-etc-sysconfig\") pod \"tuned-zj6hn\" (UID: \"3e4f13a3-c390-4ad2-9816-b389fa5abe57\") " pod="openshift-cluster-node-tuning-operator/tuned-zj6hn"
Jul 09 18:58:25.877530 ip-10-0-139-134 kubenswrapper[2578]: I0709 18:58:25.876223    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/31909fe7-f400-486f-8437-87c8674edc61-sys-fs\") pod \"aws-ebs-csi-driver-node-fghgd\" (UID: \"31909fe7-f400-486f-8437-87c8674edc61\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fghgd"
Jul 09 18:58:25.877530 ip-10-0-139-134 kubenswrapper[2578]: I0709 18:58:25.876267    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/c47bacce-dcdf-4fbf-af5f-5c781c502907-cnibin\") pod \"multus-7mdng\" (UID: \"c47bacce-dcdf-4fbf-af5f-5c781c502907\") " pod="openshift-multus/multus-7mdng"
Jul 09 18:58:25.877530 ip-10-0-139-134 kubenswrapper[2578]: I0709 18:58:25.876301    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/c47bacce-dcdf-4fbf-af5f-5c781c502907-host-var-lib-cni-bin\") pod \"multus-7mdng\" (UID: \"c47bacce-dcdf-4fbf-af5f-5c781c502907\") " pod="openshift-multus/multus-7mdng"
Jul 09 18:58:25.878377 ip-10-0-139-134 kubenswrapper[2578]: I0709 18:58:25.878358    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/3e4f13a3-c390-4ad2-9816-b389fa5abe57-etc-tuned\") pod \"tuned-zj6hn\" (UID: \"3e4f13a3-c390-4ad2-9816-b389fa5abe57\") " pod="openshift-cluster-node-tuning-operator/tuned-zj6hn"
Jul 09 18:58:25.878446 ip-10-0-139-134 kubenswrapper[2578]: I0709 18:58:25.878391    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/3e4f13a3-c390-4ad2-9816-b389fa5abe57-tmp\") pod \"tuned-zj6hn\" (UID: \"3e4f13a3-c390-4ad2-9816-b389fa5abe57\") " pod="openshift-cluster-node-tuning-operator/tuned-zj6hn"
Jul 09 18:58:25.883305 ip-10-0-139-134 kubenswrapper[2578]: I0709 18:58:25.883284    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-drk5q\" (UniqueName: \"kubernetes.io/projected/4b9891d4-d137-4996-ba20-f037de730093-kube-api-access-drk5q\") pod \"node-resolver-4ntmk\" (UID: \"4b9891d4-d137-4996-ba20-f037de730093\") " pod="openshift-dns/node-resolver-4ntmk"
Jul 09 18:58:25.883305 ip-10-0-139-134 kubenswrapper[2578]: I0709 18:58:25.883296    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bllj5\" (UniqueName: \"kubernetes.io/projected/31909fe7-f400-486f-8437-87c8674edc61-kube-api-access-bllj5\") pod \"aws-ebs-csi-driver-node-fghgd\" (UID: \"31909fe7-f400-486f-8437-87c8674edc61\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fghgd"
Jul 09 18:58:25.883722 ip-10-0-139-134 kubenswrapper[2578]: I0709 18:58:25.883697    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-67gtk\" (UniqueName: \"kubernetes.io/projected/3e4f13a3-c390-4ad2-9816-b389fa5abe57-kube-api-access-67gtk\") pod \"tuned-zj6hn\" (UID: \"3e4f13a3-c390-4ad2-9816-b389fa5abe57\") " pod="openshift-cluster-node-tuning-operator/tuned-zj6hn"
Jul 09 18:58:25.976813 ip-10-0-139-134 kubenswrapper[2578]: I0709 18:58:25.976780    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/d83b5188-15a8-4450-803c-62524a249f65-cni-binary-copy\") pod \"multus-additional-cni-plugins-cs7mq\" (UID: \"d83b5188-15a8-4450-803c-62524a249f65\") " pod="openshift-multus/multus-additional-cni-plugins-cs7mq"
Jul 09 18:58:25.976813 ip-10-0-139-134 kubenswrapper[2578]: I0709 18:58:25.976823    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/7a15b7a9-7525-426b-a051-3ece178b71bc-etc-openvswitch\") pod \"ovnkube-node-8gqbs\" (UID: \"7a15b7a9-7525-426b-a051-3ece178b71bc\") " pod="openshift-ovn-kubernetes/ovnkube-node-8gqbs"
Jul 09 18:58:25.977072 ip-10-0-139-134 kubenswrapper[2578]: I0709 18:58:25.976848    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/b322e6fc-5ae5-456b-a21c-364ba723d213-host-slash\") pod \"iptables-alerter-m9cp9\" (UID: \"b322e6fc-5ae5-456b-a21c-364ba723d213\") " pod="openshift-network-operator/iptables-alerter-m9cp9"
Jul 09 18:58:25.977072 ip-10-0-139-134 kubenswrapper[2578]: I0709 18:58:25.976892    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xfhcf\" (UniqueName: \"kubernetes.io/projected/2d052a65-da3a-4426-a441-83b9cc44217b-kube-api-access-xfhcf\") pod \"network-check-target-9n6nc\" (UID: \"2d052a65-da3a-4426-a441-83b9cc44217b\") " pod="openshift-network-diagnostics/network-check-target-9n6nc"
Jul 09 18:58:25.977072 ip-10-0-139-134 kubenswrapper[2578]: I0709 18:58:25.976913    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/b322e6fc-5ae5-456b-a21c-364ba723d213-host-slash\") pod \"iptables-alerter-m9cp9\" (UID: \"b322e6fc-5ae5-456b-a21c-364ba723d213\") " pod="openshift-network-operator/iptables-alerter-m9cp9"
Jul 09 18:58:25.977072 ip-10-0-139-134 kubenswrapper[2578]: I0709 18:58:25.976920    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/d83b5188-15a8-4450-803c-62524a249f65-system-cni-dir\") pod \"multus-additional-cni-plugins-cs7mq\" (UID: \"d83b5188-15a8-4450-803c-62524a249f65\") " pod="openshift-multus/multus-additional-cni-plugins-cs7mq"
Jul 09 18:58:25.977072 ip-10-0-139-134 kubenswrapper[2578]: I0709 18:58:25.976936    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/7a15b7a9-7525-426b-a051-3ece178b71bc-host-kubelet\") pod \"ovnkube-node-8gqbs\" (UID: \"7a15b7a9-7525-426b-a051-3ece178b71bc\") " pod="openshift-ovn-kubernetes/ovnkube-node-8gqbs"
Jul 09 18:58:25.977072 ip-10-0-139-134 kubenswrapper[2578]: I0709 18:58:25.976959    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/7a15b7a9-7525-426b-a051-3ece178b71bc-ovnkube-script-lib\") pod \"ovnkube-node-8gqbs\" (UID: \"7a15b7a9-7525-426b-a051-3ece178b71bc\") " pod="openshift-ovn-kubernetes/ovnkube-node-8gqbs"
Jul 09 18:58:25.977072 ip-10-0-139-134 kubenswrapper[2578]: I0709 18:58:25.976975    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-m4k8g\" (UniqueName: \"kubernetes.io/projected/7a15b7a9-7525-426b-a051-3ece178b71bc-kube-api-access-m4k8g\") pod \"ovnkube-node-8gqbs\" (UID: \"7a15b7a9-7525-426b-a051-3ece178b71bc\") " pod="openshift-ovn-kubernetes/ovnkube-node-8gqbs"
Jul 09 18:58:25.977072 ip-10-0-139-134 kubenswrapper[2578]: I0709 18:58:25.977007    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/4e35097c-426a-4343-aa9d-befa17cabda5-original-pull-secret\") pod \"global-pull-secret-syncer-kmr4m\" (UID: \"4e35097c-426a-4343-aa9d-befa17cabda5\") " pod="kube-system/global-pull-secret-syncer-kmr4m"
Jul 09 18:58:25.977072 ip-10-0-139-134 kubenswrapper[2578]: I0709 18:58:25.977025    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/7a15b7a9-7525-426b-a051-3ece178b71bc-host-slash\") pod \"ovnkube-node-8gqbs\" (UID: \"7a15b7a9-7525-426b-a051-3ece178b71bc\") " pod="openshift-ovn-kubernetes/ovnkube-node-8gqbs"
Jul 09 18:58:25.977072 ip-10-0-139-134 kubenswrapper[2578]: I0709 18:58:25.977048    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/7a15b7a9-7525-426b-a051-3ece178b71bc-run-openvswitch\") pod \"ovnkube-node-8gqbs\" (UID: \"7a15b7a9-7525-426b-a051-3ece178b71bc\") " pod="openshift-ovn-kubernetes/ovnkube-node-8gqbs"
Jul 09 18:58:25.977072 ip-10-0-139-134 kubenswrapper[2578]: I0709 18:58:25.977048    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/7a15b7a9-7525-426b-a051-3ece178b71bc-etc-openvswitch\") pod \"ovnkube-node-8gqbs\" (UID: \"7a15b7a9-7525-426b-a051-3ece178b71bc\") " pod="openshift-ovn-kubernetes/ovnkube-node-8gqbs"
Jul 09 18:58:25.977072 ip-10-0-139-134 kubenswrapper[2578]: I0709 18:58:25.977049    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/7a15b7a9-7525-426b-a051-3ece178b71bc-host-kubelet\") pod \"ovnkube-node-8gqbs\" (UID: \"7a15b7a9-7525-426b-a051-3ece178b71bc\") " pod="openshift-ovn-kubernetes/ovnkube-node-8gqbs"
Jul 09 18:58:25.977649 ip-10-0-139-134 kubenswrapper[2578]: I0709 18:58:25.977079    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/7a15b7a9-7525-426b-a051-3ece178b71bc-log-socket\") pod \"ovnkube-node-8gqbs\" (UID: \"7a15b7a9-7525-426b-a051-3ece178b71bc\") " pod="openshift-ovn-kubernetes/ovnkube-node-8gqbs"
Jul 09 18:58:25.977649 ip-10-0-139-134 kubenswrapper[2578]: I0709 18:58:25.977108    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/7a15b7a9-7525-426b-a051-3ece178b71bc-env-overrides\") pod \"ovnkube-node-8gqbs\" (UID: \"7a15b7a9-7525-426b-a051-3ece178b71bc\") " pod="openshift-ovn-kubernetes/ovnkube-node-8gqbs"
Jul 09 18:58:25.977649 ip-10-0-139-134 kubenswrapper[2578]: I0709 18:58:25.977108    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/d83b5188-15a8-4450-803c-62524a249f65-system-cni-dir\") pod \"multus-additional-cni-plugins-cs7mq\" (UID: \"d83b5188-15a8-4450-803c-62524a249f65\") " pod="openshift-multus/multus-additional-cni-plugins-cs7mq"
Jul 09 18:58:25.977649 ip-10-0-139-134 kubenswrapper[2578]: I0709 18:58:25.977135    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ccx2l\" (UniqueName: \"kubernetes.io/projected/b322e6fc-5ae5-456b-a21c-364ba723d213-kube-api-access-ccx2l\") pod \"iptables-alerter-m9cp9\" (UID: \"b322e6fc-5ae5-456b-a21c-364ba723d213\") " pod="openshift-network-operator/iptables-alerter-m9cp9"
Jul 09 18:58:25.977649 ip-10-0-139-134 kubenswrapper[2578]: I0709 18:58:25.977103    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/7a15b7a9-7525-426b-a051-3ece178b71bc-host-slash\") pod \"ovnkube-node-8gqbs\" (UID: \"7a15b7a9-7525-426b-a051-3ece178b71bc\") " pod="openshift-ovn-kubernetes/ovnkube-node-8gqbs"
Jul 09 18:58:25.977649 ip-10-0-139-134 kubenswrapper[2578]: I0709 18:58:25.977163    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/c47bacce-dcdf-4fbf-af5f-5c781c502907-os-release\") pod \"multus-7mdng\" (UID: \"c47bacce-dcdf-4fbf-af5f-5c781c502907\") " pod="openshift-multus/multus-7mdng"
Jul 09 18:58:25.977649 ip-10-0-139-134 kubenswrapper[2578]: I0709 18:58:25.977167    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/7a15b7a9-7525-426b-a051-3ece178b71bc-run-openvswitch\") pod \"ovnkube-node-8gqbs\" (UID: \"7a15b7a9-7525-426b-a051-3ece178b71bc\") " pod="openshift-ovn-kubernetes/ovnkube-node-8gqbs"
Jul 09 18:58:25.977649 ip-10-0-139-134 kubenswrapper[2578]: E0709 18:58:25.977181    2578 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 09 18:58:25.977649 ip-10-0-139-134 kubenswrapper[2578]: I0709 18:58:25.977209    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/c47bacce-dcdf-4fbf-af5f-5c781c502907-cni-binary-copy\") pod \"multus-7mdng\" (UID: \"c47bacce-dcdf-4fbf-af5f-5c781c502907\") " pod="openshift-multus/multus-7mdng"
Jul 09 18:58:25.977649 ip-10-0-139-134 kubenswrapper[2578]: I0709 18:58:25.977237    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/c47bacce-dcdf-4fbf-af5f-5c781c502907-os-release\") pod \"multus-7mdng\" (UID: \"c47bacce-dcdf-4fbf-af5f-5c781c502907\") " pod="openshift-multus/multus-7mdng"
Jul 09 18:58:25.977649 ip-10-0-139-134 kubenswrapper[2578]: E0709 18:58:25.977357    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4e35097c-426a-4343-aa9d-befa17cabda5-original-pull-secret podName:4e35097c-426a-4343-aa9d-befa17cabda5 nodeName:}" failed. No retries permitted until 2026-07-09 18:58:26.47733405 +0000 UTC m=+3.103385368 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/4e35097c-426a-4343-aa9d-befa17cabda5-original-pull-secret") pod "global-pull-secret-syncer-kmr4m" (UID: "4e35097c-426a-4343-aa9d-befa17cabda5") : object "kube-system"/"original-pull-secret" not registered
Jul 09 18:58:25.977649 ip-10-0-139-134 kubenswrapper[2578]: I0709 18:58:25.977433    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/7a15b7a9-7525-426b-a051-3ece178b71bc-log-socket\") pod \"ovnkube-node-8gqbs\" (UID: \"7a15b7a9-7525-426b-a051-3ece178b71bc\") " pod="openshift-ovn-kubernetes/ovnkube-node-8gqbs"
Jul 09 18:58:25.977649 ip-10-0-139-134 kubenswrapper[2578]: I0709 18:58:25.977511    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/d83b5188-15a8-4450-803c-62524a249f65-cni-binary-copy\") pod \"multus-additional-cni-plugins-cs7mq\" (UID: \"d83b5188-15a8-4450-803c-62524a249f65\") " pod="openshift-multus/multus-additional-cni-plugins-cs7mq"
Jul 09 18:58:25.977649 ip-10-0-139-134 kubenswrapper[2578]: I0709 18:58:25.977578    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/d83b5188-15a8-4450-803c-62524a249f65-os-release\") pod \"multus-additional-cni-plugins-cs7mq\" (UID: \"d83b5188-15a8-4450-803c-62524a249f65\") " pod="openshift-multus/multus-additional-cni-plugins-cs7mq"
Jul 09 18:58:25.977649 ip-10-0-139-134 kubenswrapper[2578]: I0709 18:58:25.977609    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/7a15b7a9-7525-426b-a051-3ece178b71bc-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-8gqbs\" (UID: \"7a15b7a9-7525-426b-a051-3ece178b71bc\") " pod="openshift-ovn-kubernetes/ovnkube-node-8gqbs"
Jul 09 18:58:25.977649 ip-10-0-139-134 kubenswrapper[2578]: I0709 18:58:25.977636    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/4e35097c-426a-4343-aa9d-befa17cabda5-kubelet-config\") pod \"global-pull-secret-syncer-kmr4m\" (UID: \"4e35097c-426a-4343-aa9d-befa17cabda5\") " pod="kube-system/global-pull-secret-syncer-kmr4m"
Jul 09 18:58:25.977649 ip-10-0-139-134 kubenswrapper[2578]: I0709 18:58:25.977647    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/7a15b7a9-7525-426b-a051-3ece178b71bc-env-overrides\") pod \"ovnkube-node-8gqbs\" (UID: \"7a15b7a9-7525-426b-a051-3ece178b71bc\") " pod="openshift-ovn-kubernetes/ovnkube-node-8gqbs"
Jul 09 18:58:25.978502 ip-10-0-139-134 kubenswrapper[2578]: I0709 18:58:25.977664    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/c47bacce-dcdf-4fbf-af5f-5c781c502907-multus-daemon-config\") pod \"multus-7mdng\" (UID: \"c47bacce-dcdf-4fbf-af5f-5c781c502907\") " pod="openshift-multus/multus-7mdng"
Jul 09 18:58:25.978502 ip-10-0-139-134 kubenswrapper[2578]: I0709 18:58:25.977689    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/7a15b7a9-7525-426b-a051-3ece178b71bc-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-8gqbs\" (UID: \"7a15b7a9-7525-426b-a051-3ece178b71bc\") " pod="openshift-ovn-kubernetes/ovnkube-node-8gqbs"
Jul 09 18:58:25.978502 ip-10-0-139-134 kubenswrapper[2578]: I0709 18:58:25.977688    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/7a15b7a9-7525-426b-a051-3ece178b71bc-node-log\") pod \"ovnkube-node-8gqbs\" (UID: \"7a15b7a9-7525-426b-a051-3ece178b71bc\") " pod="openshift-ovn-kubernetes/ovnkube-node-8gqbs"
Jul 09 18:58:25.978502 ip-10-0-139-134 kubenswrapper[2578]: I0709 18:58:25.977696    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/d83b5188-15a8-4450-803c-62524a249f65-os-release\") pod \"multus-additional-cni-plugins-cs7mq\" (UID: \"d83b5188-15a8-4450-803c-62524a249f65\") " pod="openshift-multus/multus-additional-cni-plugins-cs7mq"
Jul 09 18:58:25.978502 ip-10-0-139-134 kubenswrapper[2578]: I0709 18:58:25.977720    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/4e35097c-426a-4343-aa9d-befa17cabda5-kubelet-config\") pod \"global-pull-secret-syncer-kmr4m\" (UID: \"4e35097c-426a-4343-aa9d-befa17cabda5\") " pod="kube-system/global-pull-secret-syncer-kmr4m"
Jul 09 18:58:25.978502 ip-10-0-139-134 kubenswrapper[2578]: I0709 18:58:25.977745    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/7a15b7a9-7525-426b-a051-3ece178b71bc-ovnkube-script-lib\") pod \"ovnkube-node-8gqbs\" (UID: \"7a15b7a9-7525-426b-a051-3ece178b71bc\") " pod="openshift-ovn-kubernetes/ovnkube-node-8gqbs"
Jul 09 18:58:25.978502 ip-10-0-139-134 kubenswrapper[2578]: I0709 18:58:25.977753    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/7a15b7a9-7525-426b-a051-3ece178b71bc-node-log\") pod \"ovnkube-node-8gqbs\" (UID: \"7a15b7a9-7525-426b-a051-3ece178b71bc\") " pod="openshift-ovn-kubernetes/ovnkube-node-8gqbs"
Jul 09 18:58:25.978502 ip-10-0-139-134 kubenswrapper[2578]: I0709 18:58:25.977779    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/7a15b7a9-7525-426b-a051-3ece178b71bc-host-cni-netd\") pod \"ovnkube-node-8gqbs\" (UID: \"7a15b7a9-7525-426b-a051-3ece178b71bc\") " pod="openshift-ovn-kubernetes/ovnkube-node-8gqbs"
Jul 09 18:58:25.978502 ip-10-0-139-134 kubenswrapper[2578]: I0709 18:58:25.977803    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/d83b5188-15a8-4450-803c-62524a249f65-cnibin\") pod \"multus-additional-cni-plugins-cs7mq\" (UID: \"d83b5188-15a8-4450-803c-62524a249f65\") " pod="openshift-multus/multus-additional-cni-plugins-cs7mq"
Jul 09 18:58:25.978502 ip-10-0-139-134 kubenswrapper[2578]: I0709 18:58:25.977817    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/c47bacce-dcdf-4fbf-af5f-5c781c502907-host-run-k8s-cni-cncf-io\") pod \"multus-7mdng\" (UID: \"c47bacce-dcdf-4fbf-af5f-5c781c502907\") " pod="openshift-multus/multus-7mdng"
Jul 09 18:58:25.978502 ip-10-0-139-134 kubenswrapper[2578]: I0709 18:58:25.977832    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/c47bacce-dcdf-4fbf-af5f-5c781c502907-multus-conf-dir\") pod \"multus-7mdng\" (UID: \"c47bacce-dcdf-4fbf-af5f-5c781c502907\") " pod="openshift-multus/multus-7mdng"
Jul 09 18:58:25.978502 ip-10-0-139-134 kubenswrapper[2578]: I0709 18:58:25.977845    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pqrsl\" (UniqueName: \"kubernetes.io/projected/d9cc9b31-8c81-490e-911c-692cc55539c1-kube-api-access-pqrsl\") pod \"node-ca-zwps8\" (UID: \"d9cc9b31-8c81-490e-911c-692cc55539c1\") " pod="openshift-image-registry/node-ca-zwps8"
Jul 09 18:58:25.978502 ip-10-0-139-134 kubenswrapper[2578]: I0709 18:58:25.977862    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/d83b5188-15a8-4450-803c-62524a249f65-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-cs7mq\" (UID: \"d83b5188-15a8-4450-803c-62524a249f65\") " pod="openshift-multus/multus-additional-cni-plugins-cs7mq"
Jul 09 18:58:25.978502 ip-10-0-139-134 kubenswrapper[2578]: I0709 18:58:25.977867    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/d83b5188-15a8-4450-803c-62524a249f65-cnibin\") pod \"multus-additional-cni-plugins-cs7mq\" (UID: \"d83b5188-15a8-4450-803c-62524a249f65\") " pod="openshift-multus/multus-additional-cni-plugins-cs7mq"
Jul 09 18:58:25.978502 ip-10-0-139-134 kubenswrapper[2578]: I0709 18:58:25.977878    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/7a15b7a9-7525-426b-a051-3ece178b71bc-var-lib-openvswitch\") pod \"ovnkube-node-8gqbs\" (UID: \"7a15b7a9-7525-426b-a051-3ece178b71bc\") " pod="openshift-ovn-kubernetes/ovnkube-node-8gqbs"
Jul 09 18:58:25.978502 ip-10-0-139-134 kubenswrapper[2578]: I0709 18:58:25.977892    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/7a15b7a9-7525-426b-a051-3ece178b71bc-host-cni-netd\") pod \"ovnkube-node-8gqbs\" (UID: \"7a15b7a9-7525-426b-a051-3ece178b71bc\") " pod="openshift-ovn-kubernetes/ovnkube-node-8gqbs"
Jul 09 18:58:25.978502 ip-10-0-139-134 kubenswrapper[2578]: I0709 18:58:25.977894    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a6f6e738-06b0-41d1-bcc4-3627871fe3d6-metrics-certs\") pod \"network-metrics-daemon-dztbt\" (UID: \"a6f6e738-06b0-41d1-bcc4-3627871fe3d6\") " pod="openshift-multus/network-metrics-daemon-dztbt"
Jul 09 18:58:25.979277 ip-10-0-139-134 kubenswrapper[2578]: I0709 18:58:25.977912    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/c47bacce-dcdf-4fbf-af5f-5c781c502907-host-run-netns\") pod \"multus-7mdng\" (UID: \"c47bacce-dcdf-4fbf-af5f-5c781c502907\") " pod="openshift-multus/multus-7mdng"
Jul 09 18:58:25.979277 ip-10-0-139-134 kubenswrapper[2578]: I0709 18:58:25.977927    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/d9cc9b31-8c81-490e-911c-692cc55539c1-serviceca\") pod \"node-ca-zwps8\" (UID: \"d9cc9b31-8c81-490e-911c-692cc55539c1\") " pod="openshift-image-registry/node-ca-zwps8"
Jul 09 18:58:25.979277 ip-10-0-139-134 kubenswrapper[2578]: I0709 18:58:25.977942    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/7a15b7a9-7525-426b-a051-3ece178b71bc-host-run-netns\") pod \"ovnkube-node-8gqbs\" (UID: \"7a15b7a9-7525-426b-a051-3ece178b71bc\") " pod="openshift-ovn-kubernetes/ovnkube-node-8gqbs"
Jul 09 18:58:25.979277 ip-10-0-139-134 kubenswrapper[2578]: I0709 18:58:25.977956    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/7a15b7a9-7525-426b-a051-3ece178b71bc-ovn-node-metrics-cert\") pod \"ovnkube-node-8gqbs\" (UID: \"7a15b7a9-7525-426b-a051-3ece178b71bc\") " pod="openshift-ovn-kubernetes/ovnkube-node-8gqbs"
Jul 09 18:58:25.979277 ip-10-0-139-134 kubenswrapper[2578]: I0709 18:58:25.977973    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/7a15b7a9-7525-426b-a051-3ece178b71bc-run-systemd\") pod \"ovnkube-node-8gqbs\" (UID: \"7a15b7a9-7525-426b-a051-3ece178b71bc\") " pod="openshift-ovn-kubernetes/ovnkube-node-8gqbs"
Jul 09 18:58:25.979277 ip-10-0-139-134 kubenswrapper[2578]: I0709 18:58:25.977975    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/c47bacce-dcdf-4fbf-af5f-5c781c502907-cni-binary-copy\") pod \"multus-7mdng\" (UID: \"c47bacce-dcdf-4fbf-af5f-5c781c502907\") " pod="openshift-multus/multus-7mdng"
Jul 09 18:58:25.979277 ip-10-0-139-134 kubenswrapper[2578]: I0709 18:58:25.978009    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/c47bacce-dcdf-4fbf-af5f-5c781c502907-system-cni-dir\") pod \"multus-7mdng\" (UID: \"c47bacce-dcdf-4fbf-af5f-5c781c502907\") " pod="openshift-multus/multus-7mdng"
Jul 09 18:58:25.979277 ip-10-0-139-134 kubenswrapper[2578]: I0709 18:58:25.978023    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/c47bacce-dcdf-4fbf-af5f-5c781c502907-hostroot\") pod \"multus-7mdng\" (UID: \"c47bacce-dcdf-4fbf-af5f-5c781c502907\") " pod="openshift-multus/multus-7mdng"
Jul 09 18:58:25.979277 ip-10-0-139-134 kubenswrapper[2578]: I0709 18:58:25.978047    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/7a15b7a9-7525-426b-a051-3ece178b71bc-host-run-ovn-kubernetes\") pod \"ovnkube-node-8gqbs\" (UID: \"7a15b7a9-7525-426b-a051-3ece178b71bc\") " pod="openshift-ovn-kubernetes/ovnkube-node-8gqbs"
Jul 09 18:58:25.979277 ip-10-0-139-134 kubenswrapper[2578]: I0709 18:58:25.978071    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/c47bacce-dcdf-4fbf-af5f-5c781c502907-multus-conf-dir\") pod \"multus-7mdng\" (UID: \"c47bacce-dcdf-4fbf-af5f-5c781c502907\") " pod="openshift-multus/multus-7mdng"
Jul 09 18:58:25.979277 ip-10-0-139-134 kubenswrapper[2578]: I0709 18:58:25.978079    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/7a15b7a9-7525-426b-a051-3ece178b71bc-var-lib-openvswitch\") pod \"ovnkube-node-8gqbs\" (UID: \"7a15b7a9-7525-426b-a051-3ece178b71bc\") " pod="openshift-ovn-kubernetes/ovnkube-node-8gqbs"
Jul 09 18:58:25.979277 ip-10-0-139-134 kubenswrapper[2578]: I0709 18:58:25.978084    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/c47bacce-dcdf-4fbf-af5f-5c781c502907-host-run-k8s-cni-cncf-io\") pod \"multus-7mdng\" (UID: \"c47bacce-dcdf-4fbf-af5f-5c781c502907\") " pod="openshift-multus/multus-7mdng"
Jul 09 18:58:25.979277 ip-10-0-139-134 kubenswrapper[2578]: I0709 18:58:25.978073    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/c47bacce-dcdf-4fbf-af5f-5c781c502907-multus-cni-dir\") pod \"multus-7mdng\" (UID: \"c47bacce-dcdf-4fbf-af5f-5c781c502907\") " pod="openshift-multus/multus-7mdng"
Jul 09 18:58:25.979277 ip-10-0-139-134 kubenswrapper[2578]: I0709 18:58:25.978069    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/c47bacce-dcdf-4fbf-af5f-5c781c502907-multus-daemon-config\") pod \"multus-7mdng\" (UID: \"c47bacce-dcdf-4fbf-af5f-5c781c502907\") " pod="openshift-multus/multus-7mdng"
Jul 09 18:58:25.979277 ip-10-0-139-134 kubenswrapper[2578]: I0709 18:58:25.978117    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/7a15b7a9-7525-426b-a051-3ece178b71bc-host-run-netns\") pod \"ovnkube-node-8gqbs\" (UID: \"7a15b7a9-7525-426b-a051-3ece178b71bc\") " pod="openshift-ovn-kubernetes/ovnkube-node-8gqbs"
Jul 09 18:58:25.979277 ip-10-0-139-134 kubenswrapper[2578]: I0709 18:58:25.978124    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/7a15b7a9-7525-426b-a051-3ece178b71bc-run-systemd\") pod \"ovnkube-node-8gqbs\" (UID: \"7a15b7a9-7525-426b-a051-3ece178b71bc\") " pod="openshift-ovn-kubernetes/ovnkube-node-8gqbs"
Jul 09 18:58:25.979277 ip-10-0-139-134 kubenswrapper[2578]: I0709 18:58:25.978145    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/7a15b7a9-7525-426b-a051-3ece178b71bc-host-run-ovn-kubernetes\") pod \"ovnkube-node-8gqbs\" (UID: \"7a15b7a9-7525-426b-a051-3ece178b71bc\") " pod="openshift-ovn-kubernetes/ovnkube-node-8gqbs"
Jul 09 18:58:25.979277 ip-10-0-139-134 kubenswrapper[2578]: I0709 18:58:25.978145    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/c47bacce-dcdf-4fbf-af5f-5c781c502907-cnibin\") pod \"multus-7mdng\" (UID: \"c47bacce-dcdf-4fbf-af5f-5c781c502907\") " pod="openshift-multus/multus-7mdng"
Jul 09 18:58:25.979927 ip-10-0-139-134 kubenswrapper[2578]: I0709 18:58:25.978161    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/c47bacce-dcdf-4fbf-af5f-5c781c502907-host-run-netns\") pod \"multus-7mdng\" (UID: \"c47bacce-dcdf-4fbf-af5f-5c781c502907\") " pod="openshift-multus/multus-7mdng"
Jul 09 18:58:25.979927 ip-10-0-139-134 kubenswrapper[2578]: E0709 18:58:25.978165    2578 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 09 18:58:25.979927 ip-10-0-139-134 kubenswrapper[2578]: I0709 18:58:25.978185    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/c47bacce-dcdf-4fbf-af5f-5c781c502907-host-var-lib-cni-bin\") pod \"multus-7mdng\" (UID: \"c47bacce-dcdf-4fbf-af5f-5c781c502907\") " pod="openshift-multus/multus-7mdng"
Jul 09 18:58:25.979927 ip-10-0-139-134 kubenswrapper[2578]: I0709 18:58:25.978190    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/c47bacce-dcdf-4fbf-af5f-5c781c502907-hostroot\") pod \"multus-7mdng\" (UID: \"c47bacce-dcdf-4fbf-af5f-5c781c502907\") " pod="openshift-multus/multus-7mdng"
Jul 09 18:58:25.979927 ip-10-0-139-134 kubenswrapper[2578]: I0709 18:58:25.978186    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/c47bacce-dcdf-4fbf-af5f-5c781c502907-cnibin\") pod \"multus-7mdng\" (UID: \"c47bacce-dcdf-4fbf-af5f-5c781c502907\") " pod="openshift-multus/multus-7mdng"
Jul 09 18:58:25.979927 ip-10-0-139-134 kubenswrapper[2578]: E0709 18:58:25.978213    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a6f6e738-06b0-41d1-bcc4-3627871fe3d6-metrics-certs podName:a6f6e738-06b0-41d1-bcc4-3627871fe3d6 nodeName:}" failed. No retries permitted until 2026-07-09 18:58:26.478196531 +0000 UTC m=+3.104247850 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/a6f6e738-06b0-41d1-bcc4-3627871fe3d6-metrics-certs") pod "network-metrics-daemon-dztbt" (UID: "a6f6e738-06b0-41d1-bcc4-3627871fe3d6") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 09 18:58:25.979927 ip-10-0-139-134 kubenswrapper[2578]: I0709 18:58:25.978166    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/c47bacce-dcdf-4fbf-af5f-5c781c502907-system-cni-dir\") pod \"multus-7mdng\" (UID: \"c47bacce-dcdf-4fbf-af5f-5c781c502907\") " pod="openshift-multus/multus-7mdng"
Jul 09 18:58:25.979927 ip-10-0-139-134 kubenswrapper[2578]: I0709 18:58:25.978222    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/c47bacce-dcdf-4fbf-af5f-5c781c502907-host-var-lib-cni-bin\") pod \"multus-7mdng\" (UID: \"c47bacce-dcdf-4fbf-af5f-5c781c502907\") " pod="openshift-multus/multus-7mdng"
Jul 09 18:58:25.979927 ip-10-0-139-134 kubenswrapper[2578]: I0709 18:58:25.978255    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/d83b5188-15a8-4450-803c-62524a249f65-tuning-conf-dir\") pod \"multus-additional-cni-plugins-cs7mq\" (UID: \"d83b5188-15a8-4450-803c-62524a249f65\") " pod="openshift-multus/multus-additional-cni-plugins-cs7mq"
Jul 09 18:58:25.979927 ip-10-0-139-134 kubenswrapper[2578]: I0709 18:58:25.978285    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/d83b5188-15a8-4450-803c-62524a249f65-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-cs7mq\" (UID: \"d83b5188-15a8-4450-803c-62524a249f65\") " pod="openshift-multus/multus-additional-cni-plugins-cs7mq"
Jul 09 18:58:25.979927 ip-10-0-139-134 kubenswrapper[2578]: I0709 18:58:25.978309    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/7a15b7a9-7525-426b-a051-3ece178b71bc-run-ovn\") pod \"ovnkube-node-8gqbs\" (UID: \"7a15b7a9-7525-426b-a051-3ece178b71bc\") " pod="openshift-ovn-kubernetes/ovnkube-node-8gqbs"
Jul 09 18:58:25.979927 ip-10-0-139-134 kubenswrapper[2578]: I0709 18:58:25.978343    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/7a15b7a9-7525-426b-a051-3ece178b71bc-run-ovn\") pod \"ovnkube-node-8gqbs\" (UID: \"7a15b7a9-7525-426b-a051-3ece178b71bc\") " pod="openshift-ovn-kubernetes/ovnkube-node-8gqbs"
Jul 09 18:58:25.979927 ip-10-0-139-134 kubenswrapper[2578]: I0709 18:58:25.978347    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/c47bacce-dcdf-4fbf-af5f-5c781c502907-multus-cni-dir\") pod \"multus-7mdng\" (UID: \"c47bacce-dcdf-4fbf-af5f-5c781c502907\") " pod="openshift-multus/multus-7mdng"
Jul 09 18:58:25.979927 ip-10-0-139-134 kubenswrapper[2578]: I0709 18:58:25.978396    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/d83b5188-15a8-4450-803c-62524a249f65-tuning-conf-dir\") pod \"multus-additional-cni-plugins-cs7mq\" (UID: \"d83b5188-15a8-4450-803c-62524a249f65\") " pod="openshift-multus/multus-additional-cni-plugins-cs7mq"
Jul 09 18:58:25.979927 ip-10-0-139-134 kubenswrapper[2578]: I0709 18:58:25.978377    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/7a15b7a9-7525-426b-a051-3ece178b71bc-host-cni-bin\") pod \"ovnkube-node-8gqbs\" (UID: \"7a15b7a9-7525-426b-a051-3ece178b71bc\") " pod="openshift-ovn-kubernetes/ovnkube-node-8gqbs"
Jul 09 18:58:25.979927 ip-10-0-139-134 kubenswrapper[2578]: I0709 18:58:25.978431    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/7a15b7a9-7525-426b-a051-3ece178b71bc-host-cni-bin\") pod \"ovnkube-node-8gqbs\" (UID: \"7a15b7a9-7525-426b-a051-3ece178b71bc\") " pod="openshift-ovn-kubernetes/ovnkube-node-8gqbs"
Jul 09 18:58:25.979927 ip-10-0-139-134 kubenswrapper[2578]: I0709 18:58:25.978437    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/b322e6fc-5ae5-456b-a21c-364ba723d213-iptables-alerter-script\") pod \"iptables-alerter-m9cp9\" (UID: \"b322e6fc-5ae5-456b-a21c-364ba723d213\") " pod="openshift-network-operator/iptables-alerter-m9cp9"
Jul 09 18:58:25.980474 ip-10-0-139-134 kubenswrapper[2578]: I0709 18:58:25.978464    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ppg9j\" (UniqueName: \"kubernetes.io/projected/d83b5188-15a8-4450-803c-62524a249f65-kube-api-access-ppg9j\") pod \"multus-additional-cni-plugins-cs7mq\" (UID: \"d83b5188-15a8-4450-803c-62524a249f65\") " pod="openshift-multus/multus-additional-cni-plugins-cs7mq"
Jul 09 18:58:25.980474 ip-10-0-139-134 kubenswrapper[2578]: I0709 18:58:25.978486    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/c47bacce-dcdf-4fbf-af5f-5c781c502907-etc-kubernetes\") pod \"multus-7mdng\" (UID: \"c47bacce-dcdf-4fbf-af5f-5c781c502907\") " pod="openshift-multus/multus-7mdng"
Jul 09 18:58:25.980474 ip-10-0-139-134 kubenswrapper[2578]: I0709 18:58:25.978439    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/d9cc9b31-8c81-490e-911c-692cc55539c1-serviceca\") pod \"node-ca-zwps8\" (UID: \"d9cc9b31-8c81-490e-911c-692cc55539c1\") " pod="openshift-image-registry/node-ca-zwps8"
Jul 09 18:58:25.980474 ip-10-0-139-134 kubenswrapper[2578]: I0709 18:58:25.978507    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9rx4q\" (UniqueName: \"kubernetes.io/projected/c47bacce-dcdf-4fbf-af5f-5c781c502907-kube-api-access-9rx4q\") pod \"multus-7mdng\" (UID: \"c47bacce-dcdf-4fbf-af5f-5c781c502907\") " pod="openshift-multus/multus-7mdng"
Jul 09 18:58:25.980474 ip-10-0-139-134 kubenswrapper[2578]: I0709 18:58:25.978530    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/d9cc9b31-8c81-490e-911c-692cc55539c1-host\") pod \"node-ca-zwps8\" (UID: \"d9cc9b31-8c81-490e-911c-692cc55539c1\") " pod="openshift-image-registry/node-ca-zwps8"
Jul 09 18:58:25.980474 ip-10-0-139-134 kubenswrapper[2578]: I0709 18:58:25.978551    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/c47bacce-dcdf-4fbf-af5f-5c781c502907-etc-kubernetes\") pod \"multus-7mdng\" (UID: \"c47bacce-dcdf-4fbf-af5f-5c781c502907\") " pod="openshift-multus/multus-7mdng"
Jul 09 18:58:25.980474 ip-10-0-139-134 kubenswrapper[2578]: I0709 18:58:25.978526    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/d83b5188-15a8-4450-803c-62524a249f65-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-cs7mq\" (UID: \"d83b5188-15a8-4450-803c-62524a249f65\") " pod="openshift-multus/multus-additional-cni-plugins-cs7mq"
Jul 09 18:58:25.980474 ip-10-0-139-134 kubenswrapper[2578]: I0709 18:58:25.978553    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/7a15b7a9-7525-426b-a051-3ece178b71bc-ovnkube-config\") pod \"ovnkube-node-8gqbs\" (UID: \"7a15b7a9-7525-426b-a051-3ece178b71bc\") " pod="openshift-ovn-kubernetes/ovnkube-node-8gqbs"
Jul 09 18:58:25.980474 ip-10-0-139-134 kubenswrapper[2578]: I0709 18:58:25.978591    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/d9cc9b31-8c81-490e-911c-692cc55539c1-host\") pod \"node-ca-zwps8\" (UID: \"d9cc9b31-8c81-490e-911c-692cc55539c1\") " pod="openshift-image-registry/node-ca-zwps8"
Jul 09 18:58:25.980474 ip-10-0-139-134 kubenswrapper[2578]: I0709 18:58:25.978599    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rfxj5\" (UniqueName: \"kubernetes.io/projected/a6f6e738-06b0-41d1-bcc4-3627871fe3d6-kube-api-access-rfxj5\") pod \"network-metrics-daemon-dztbt\" (UID: \"a6f6e738-06b0-41d1-bcc4-3627871fe3d6\") " pod="openshift-multus/network-metrics-daemon-dztbt"
Jul 09 18:58:25.980474 ip-10-0-139-134 kubenswrapper[2578]: I0709 18:58:25.978624    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/19c7b09c-711d-472b-95ef-ab437e64985c-konnectivity-ca\") pod \"konnectivity-agent-vnnqd\" (UID: \"19c7b09c-711d-472b-95ef-ab437e64985c\") " pod="kube-system/konnectivity-agent-vnnqd"
Jul 09 18:58:25.980474 ip-10-0-139-134 kubenswrapper[2578]: I0709 18:58:25.978650    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/c47bacce-dcdf-4fbf-af5f-5c781c502907-multus-socket-dir-parent\") pod \"multus-7mdng\" (UID: \"c47bacce-dcdf-4fbf-af5f-5c781c502907\") " pod="openshift-multus/multus-7mdng"
Jul 09 18:58:25.980474 ip-10-0-139-134 kubenswrapper[2578]: I0709 18:58:25.978682    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/c47bacce-dcdf-4fbf-af5f-5c781c502907-host-var-lib-kubelet\") pod \"multus-7mdng\" (UID: \"c47bacce-dcdf-4fbf-af5f-5c781c502907\") " pod="openshift-multus/multus-7mdng"
Jul 09 18:58:25.980474 ip-10-0-139-134 kubenswrapper[2578]: I0709 18:58:25.978707    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/7a15b7a9-7525-426b-a051-3ece178b71bc-systemd-units\") pod \"ovnkube-node-8gqbs\" (UID: \"7a15b7a9-7525-426b-a051-3ece178b71bc\") " pod="openshift-ovn-kubernetes/ovnkube-node-8gqbs"
Jul 09 18:58:25.980474 ip-10-0-139-134 kubenswrapper[2578]: I0709 18:58:25.978732    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/19c7b09c-711d-472b-95ef-ab437e64985c-agent-certs\") pod \"konnectivity-agent-vnnqd\" (UID: \"19c7b09c-711d-472b-95ef-ab437e64985c\") " pod="kube-system/konnectivity-agent-vnnqd"
Jul 09 18:58:25.980474 ip-10-0-139-134 kubenswrapper[2578]: I0709 18:58:25.978760    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/c47bacce-dcdf-4fbf-af5f-5c781c502907-host-var-lib-cni-multus\") pod \"multus-7mdng\" (UID: \"c47bacce-dcdf-4fbf-af5f-5c781c502907\") " pod="openshift-multus/multus-7mdng"
Jul 09 18:58:25.980474 ip-10-0-139-134 kubenswrapper[2578]: I0709 18:58:25.978786    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/c47bacce-dcdf-4fbf-af5f-5c781c502907-host-run-multus-certs\") pod \"multus-7mdng\" (UID: \"c47bacce-dcdf-4fbf-af5f-5c781c502907\") " pod="openshift-multus/multus-7mdng"
Jul 09 18:58:25.980474 ip-10-0-139-134 kubenswrapper[2578]: I0709 18:58:25.978811    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/4e35097c-426a-4343-aa9d-befa17cabda5-dbus\") pod \"global-pull-secret-syncer-kmr4m\" (UID: \"4e35097c-426a-4343-aa9d-befa17cabda5\") " pod="kube-system/global-pull-secret-syncer-kmr4m"
Jul 09 18:58:25.981346 ip-10-0-139-134 kubenswrapper[2578]: I0709 18:58:25.978824    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/d83b5188-15a8-4450-803c-62524a249f65-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-cs7mq\" (UID: \"d83b5188-15a8-4450-803c-62524a249f65\") " pod="openshift-multus/multus-additional-cni-plugins-cs7mq"
Jul 09 18:58:25.981346 ip-10-0-139-134 kubenswrapper[2578]: I0709 18:58:25.978786    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/c47bacce-dcdf-4fbf-af5f-5c781c502907-multus-socket-dir-parent\") pod \"multus-7mdng\" (UID: \"c47bacce-dcdf-4fbf-af5f-5c781c502907\") " pod="openshift-multus/multus-7mdng"
Jul 09 18:58:25.981346 ip-10-0-139-134 kubenswrapper[2578]: I0709 18:58:25.978895    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/c47bacce-dcdf-4fbf-af5f-5c781c502907-host-var-lib-kubelet\") pod \"multus-7mdng\" (UID: \"c47bacce-dcdf-4fbf-af5f-5c781c502907\") " pod="openshift-multus/multus-7mdng"
Jul 09 18:58:25.981346 ip-10-0-139-134 kubenswrapper[2578]: I0709 18:58:25.978925    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/b322e6fc-5ae5-456b-a21c-364ba723d213-iptables-alerter-script\") pod \"iptables-alerter-m9cp9\" (UID: \"b322e6fc-5ae5-456b-a21c-364ba723d213\") " pod="openshift-network-operator/iptables-alerter-m9cp9"
Jul 09 18:58:25.981346 ip-10-0-139-134 kubenswrapper[2578]: I0709 18:58:25.978962    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/c47bacce-dcdf-4fbf-af5f-5c781c502907-host-var-lib-cni-multus\") pod \"multus-7mdng\" (UID: \"c47bacce-dcdf-4fbf-af5f-5c781c502907\") " pod="openshift-multus/multus-7mdng"
Jul 09 18:58:25.981346 ip-10-0-139-134 kubenswrapper[2578]: I0709 18:58:25.979011    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/7a15b7a9-7525-426b-a051-3ece178b71bc-systemd-units\") pod \"ovnkube-node-8gqbs\" (UID: \"7a15b7a9-7525-426b-a051-3ece178b71bc\") " pod="openshift-ovn-kubernetes/ovnkube-node-8gqbs"
Jul 09 18:58:25.981346 ip-10-0-139-134 kubenswrapper[2578]: I0709 18:58:25.979015    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/4e35097c-426a-4343-aa9d-befa17cabda5-dbus\") pod \"global-pull-secret-syncer-kmr4m\" (UID: \"4e35097c-426a-4343-aa9d-befa17cabda5\") " pod="kube-system/global-pull-secret-syncer-kmr4m"
Jul 09 18:58:25.981346 ip-10-0-139-134 kubenswrapper[2578]: I0709 18:58:25.979066    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/c47bacce-dcdf-4fbf-af5f-5c781c502907-host-run-multus-certs\") pod \"multus-7mdng\" (UID: \"c47bacce-dcdf-4fbf-af5f-5c781c502907\") " pod="openshift-multus/multus-7mdng"
Jul 09 18:58:25.981346 ip-10-0-139-134 kubenswrapper[2578]: I0709 18:58:25.979305    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/19c7b09c-711d-472b-95ef-ab437e64985c-konnectivity-ca\") pod \"konnectivity-agent-vnnqd\" (UID: \"19c7b09c-711d-472b-95ef-ab437e64985c\") " pod="kube-system/konnectivity-agent-vnnqd"
Jul 09 18:58:25.981346 ip-10-0-139-134 kubenswrapper[2578]: I0709 18:58:25.979303    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/7a15b7a9-7525-426b-a051-3ece178b71bc-ovnkube-config\") pod \"ovnkube-node-8gqbs\" (UID: \"7a15b7a9-7525-426b-a051-3ece178b71bc\") " pod="openshift-ovn-kubernetes/ovnkube-node-8gqbs"
Jul 09 18:58:25.981346 ip-10-0-139-134 kubenswrapper[2578]: I0709 18:58:25.980795    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/7a15b7a9-7525-426b-a051-3ece178b71bc-ovn-node-metrics-cert\") pod \"ovnkube-node-8gqbs\" (UID: \"7a15b7a9-7525-426b-a051-3ece178b71bc\") " pod="openshift-ovn-kubernetes/ovnkube-node-8gqbs"
Jul 09 18:58:25.981346 ip-10-0-139-134 kubenswrapper[2578]: I0709 18:58:25.981336    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/19c7b09c-711d-472b-95ef-ab437e64985c-agent-certs\") pod \"konnectivity-agent-vnnqd\" (UID: \"19c7b09c-711d-472b-95ef-ab437e64985c\") " pod="kube-system/konnectivity-agent-vnnqd"
Jul 09 18:58:25.987808 ip-10-0-139-134 kubenswrapper[2578]: E0709 18:58:25.987787    2578 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 09 18:58:25.987915 ip-10-0-139-134 kubenswrapper[2578]: E0709 18:58:25.987817    2578 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 09 18:58:25.987915 ip-10-0-139-134 kubenswrapper[2578]: E0709 18:58:25.987831    2578 projected.go:196] Error preparing data for projected volume kube-api-access-xfhcf for pod openshift-network-diagnostics/network-check-target-9n6nc: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 09 18:58:25.987915 ip-10-0-139-134 kubenswrapper[2578]: E0709 18:58:25.987900    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/2d052a65-da3a-4426-a441-83b9cc44217b-kube-api-access-xfhcf podName:2d052a65-da3a-4426-a441-83b9cc44217b nodeName:}" failed. No retries permitted until 2026-07-09 18:58:26.487882019 +0000 UTC m=+3.113933329 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-xfhcf" (UniqueName: "kubernetes.io/projected/2d052a65-da3a-4426-a441-83b9cc44217b-kube-api-access-xfhcf") pod "network-check-target-9n6nc" (UID: "2d052a65-da3a-4426-a441-83b9cc44217b") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 09 18:58:25.991613 ip-10-0-139-134 kubenswrapper[2578]: I0709 18:58:25.991584    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rfxj5\" (UniqueName: \"kubernetes.io/projected/a6f6e738-06b0-41d1-bcc4-3627871fe3d6-kube-api-access-rfxj5\") pod \"network-metrics-daemon-dztbt\" (UID: \"a6f6e738-06b0-41d1-bcc4-3627871fe3d6\") " pod="openshift-multus/network-metrics-daemon-dztbt"
Jul 09 18:58:25.991613 ip-10-0-139-134 kubenswrapper[2578]: I0709 18:58:25.991608    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-m4k8g\" (UniqueName: \"kubernetes.io/projected/7a15b7a9-7525-426b-a051-3ece178b71bc-kube-api-access-m4k8g\") pod \"ovnkube-node-8gqbs\" (UID: \"7a15b7a9-7525-426b-a051-3ece178b71bc\") " pod="openshift-ovn-kubernetes/ovnkube-node-8gqbs"
Jul 09 18:58:25.991949 ip-10-0-139-134 kubenswrapper[2578]: I0709 18:58:25.991930    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9rx4q\" (UniqueName: \"kubernetes.io/projected/c47bacce-dcdf-4fbf-af5f-5c781c502907-kube-api-access-9rx4q\") pod \"multus-7mdng\" (UID: \"c47bacce-dcdf-4fbf-af5f-5c781c502907\") " pod="openshift-multus/multus-7mdng"
Jul 09 18:58:25.993635 ip-10-0-139-134 kubenswrapper[2578]: I0709 18:58:25.993606    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ppg9j\" (UniqueName: \"kubernetes.io/projected/d83b5188-15a8-4450-803c-62524a249f65-kube-api-access-ppg9j\") pod \"multus-additional-cni-plugins-cs7mq\" (UID: \"d83b5188-15a8-4450-803c-62524a249f65\") " pod="openshift-multus/multus-additional-cni-plugins-cs7mq"
Jul 09 18:58:25.995736 ip-10-0-139-134 kubenswrapper[2578]: I0709 18:58:25.995710    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pqrsl\" (UniqueName: \"kubernetes.io/projected/d9cc9b31-8c81-490e-911c-692cc55539c1-kube-api-access-pqrsl\") pod \"node-ca-zwps8\" (UID: \"d9cc9b31-8c81-490e-911c-692cc55539c1\") " pod="openshift-image-registry/node-ca-zwps8"
Jul 09 18:58:25.996847 ip-10-0-139-134 kubenswrapper[2578]: I0709 18:58:25.996825    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ccx2l\" (UniqueName: \"kubernetes.io/projected/b322e6fc-5ae5-456b-a21c-364ba723d213-kube-api-access-ccx2l\") pod \"iptables-alerter-m9cp9\" (UID: \"b322e6fc-5ae5-456b-a21c-364ba723d213\") " pod="openshift-network-operator/iptables-alerter-m9cp9"
Jul 09 18:58:26.070147 ip-10-0-139-134 kubenswrapper[2578]: I0709 18:58:26.070116    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fghgd"
Jul 09 18:58:26.078350 ip-10-0-139-134 kubenswrapper[2578]: I0709 18:58:26.078316    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-zj6hn"
Jul 09 18:58:26.086369 ip-10-0-139-134 kubenswrapper[2578]: I0709 18:58:26.086339    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-4ntmk"
Jul 09 18:58:26.092200 ip-10-0-139-134 kubenswrapper[2578]: I0709 18:58:26.092172    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-cs7mq"
Jul 09 18:58:26.098703 ip-10-0-139-134 kubenswrapper[2578]: I0709 18:58:26.098678    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-7mdng"
Jul 09 18:58:26.104555 ip-10-0-139-134 kubenswrapper[2578]: I0709 18:58:26.104534    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-vnnqd"
Jul 09 18:58:26.110949 ip-10-0-139-134 kubenswrapper[2578]: I0709 18:58:26.110927    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-zwps8"
Jul 09 18:58:26.117903 ip-10-0-139-134 kubenswrapper[2578]: I0709 18:58:26.117879    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-8gqbs"
Jul 09 18:58:26.123926 ip-10-0-139-134 kubenswrapper[2578]: I0709 18:58:26.123877    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-m9cp9"
Jul 09 18:58:26.482970 ip-10-0-139-134 kubenswrapper[2578]: I0709 18:58:26.482889    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/4e35097c-426a-4343-aa9d-befa17cabda5-original-pull-secret\") pod \"global-pull-secret-syncer-kmr4m\" (UID: \"4e35097c-426a-4343-aa9d-befa17cabda5\") " pod="kube-system/global-pull-secret-syncer-kmr4m"
Jul 09 18:58:26.482970 ip-10-0-139-134 kubenswrapper[2578]: I0709 18:58:26.482942    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a6f6e738-06b0-41d1-bcc4-3627871fe3d6-metrics-certs\") pod \"network-metrics-daemon-dztbt\" (UID: \"a6f6e738-06b0-41d1-bcc4-3627871fe3d6\") " pod="openshift-multus/network-metrics-daemon-dztbt"
Jul 09 18:58:26.483224 ip-10-0-139-134 kubenswrapper[2578]: E0709 18:58:26.483065    2578 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 09 18:58:26.483224 ip-10-0-139-134 kubenswrapper[2578]: E0709 18:58:26.483135    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4e35097c-426a-4343-aa9d-befa17cabda5-original-pull-secret podName:4e35097c-426a-4343-aa9d-befa17cabda5 nodeName:}" failed. No retries permitted until 2026-07-09 18:58:27.483115516 +0000 UTC m=+4.109166826 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/4e35097c-426a-4343-aa9d-befa17cabda5-original-pull-secret") pod "global-pull-secret-syncer-kmr4m" (UID: "4e35097c-426a-4343-aa9d-befa17cabda5") : object "kube-system"/"original-pull-secret" not registered
Jul 09 18:58:26.483224 ip-10-0-139-134 kubenswrapper[2578]: E0709 18:58:26.483066    2578 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 09 18:58:26.483224 ip-10-0-139-134 kubenswrapper[2578]: E0709 18:58:26.483223    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a6f6e738-06b0-41d1-bcc4-3627871fe3d6-metrics-certs podName:a6f6e738-06b0-41d1-bcc4-3627871fe3d6 nodeName:}" failed. No retries permitted until 2026-07-09 18:58:27.483208457 +0000 UTC m=+4.109259774 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/a6f6e738-06b0-41d1-bcc4-3627871fe3d6-metrics-certs") pod "network-metrics-daemon-dztbt" (UID: "a6f6e738-06b0-41d1-bcc4-3627871fe3d6") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 09 18:58:26.583541 ip-10-0-139-134 kubenswrapper[2578]: I0709 18:58:26.583503    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xfhcf\" (UniqueName: \"kubernetes.io/projected/2d052a65-da3a-4426-a441-83b9cc44217b-kube-api-access-xfhcf\") pod \"network-check-target-9n6nc\" (UID: \"2d052a65-da3a-4426-a441-83b9cc44217b\") " pod="openshift-network-diagnostics/network-check-target-9n6nc"
Jul 09 18:58:26.583724 ip-10-0-139-134 kubenswrapper[2578]: E0709 18:58:26.583680    2578 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 09 18:58:26.583724 ip-10-0-139-134 kubenswrapper[2578]: E0709 18:58:26.583703    2578 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 09 18:58:26.583724 ip-10-0-139-134 kubenswrapper[2578]: E0709 18:58:26.583717    2578 projected.go:196] Error preparing data for projected volume kube-api-access-xfhcf for pod openshift-network-diagnostics/network-check-target-9n6nc: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 09 18:58:26.583829 ip-10-0-139-134 kubenswrapper[2578]: E0709 18:58:26.583793    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/2d052a65-da3a-4426-a441-83b9cc44217b-kube-api-access-xfhcf podName:2d052a65-da3a-4426-a441-83b9cc44217b nodeName:}" failed. No retries permitted until 2026-07-09 18:58:27.583771255 +0000 UTC m=+4.209822564 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-xfhcf" (UniqueName: "kubernetes.io/projected/2d052a65-da3a-4426-a441-83b9cc44217b-kube-api-access-xfhcf") pod "network-check-target-9n6nc" (UID: "2d052a65-da3a-4426-a441-83b9cc44217b") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 09 18:58:26.806130 ip-10-0-139-134 kubenswrapper[2578]: I0709 18:58:26.806054    2578 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-08 18:53:25 +0000 UTC" deadline="2028-02-26 12:08:54.775799961 +0000 UTC"
Jul 09 18:58:26.806130 ip-10-0-139-134 kubenswrapper[2578]: I0709 18:58:26.806118    2578 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="14321h10m27.96968489s"
Jul 09 18:58:26.826259 ip-10-0-139-134 kubenswrapper[2578]: W0709 18:58:26.826234    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3e4f13a3_c390_4ad2_9816_b389fa5abe57.slice/crio-8492152425fc9a408758feca5bcf936e94a6a9e4ee223440c2c7d526893c2039 WatchSource:0}: Error finding container 8492152425fc9a408758feca5bcf936e94a6a9e4ee223440c2c7d526893c2039: Status 404 returned error can't find the container with id 8492152425fc9a408758feca5bcf936e94a6a9e4ee223440c2c7d526893c2039
Jul 09 18:58:26.827808 ip-10-0-139-134 kubenswrapper[2578]: W0709 18:58:26.827743    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd83b5188_15a8_4450_803c_62524a249f65.slice/crio-44f5817c10e9a1ebcf4d9153bc48a4aa74c915ea4ebd398ab0c5a1a7a979c0a0 WatchSource:0}: Error finding container 44f5817c10e9a1ebcf4d9153bc48a4aa74c915ea4ebd398ab0c5a1a7a979c0a0: Status 404 returned error can't find the container with id 44f5817c10e9a1ebcf4d9153bc48a4aa74c915ea4ebd398ab0c5a1a7a979c0a0
Jul 09 18:58:26.829448 ip-10-0-139-134 kubenswrapper[2578]: W0709 18:58:26.829375    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc47bacce_dcdf_4fbf_af5f_5c781c502907.slice/crio-0561cdcf1c48a530b872a147e57fe546eb35e4c47c7f2cf93c0d0e4178e29817 WatchSource:0}: Error finding container 0561cdcf1c48a530b872a147e57fe546eb35e4c47c7f2cf93c0d0e4178e29817: Status 404 returned error can't find the container with id 0561cdcf1c48a530b872a147e57fe546eb35e4c47c7f2cf93c0d0e4178e29817
Jul 09 18:58:26.832559 ip-10-0-139-134 kubenswrapper[2578]: W0709 18:58:26.832535    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod19c7b09c_711d_472b_95ef_ab437e64985c.slice/crio-20b13f8deaa10b86d995def36eabb24d077d90d415121fc0b01e841f85c8f755 WatchSource:0}: Error finding container 20b13f8deaa10b86d995def36eabb24d077d90d415121fc0b01e841f85c8f755: Status 404 returned error can't find the container with id 20b13f8deaa10b86d995def36eabb24d077d90d415121fc0b01e841f85c8f755
Jul 09 18:58:26.834702 ip-10-0-139-134 kubenswrapper[2578]: W0709 18:58:26.834674    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7a15b7a9_7525_426b_a051_3ece178b71bc.slice/crio-277f4acabe6eea48d651c40d0a3e9862d1a9cb12ea1f4c38be6e8e627d6dd6f5 WatchSource:0}: Error finding container 277f4acabe6eea48d651c40d0a3e9862d1a9cb12ea1f4c38be6e8e627d6dd6f5: Status 404 returned error can't find the container with id 277f4acabe6eea48d651c40d0a3e9862d1a9cb12ea1f4c38be6e8e627d6dd6f5
Jul 09 18:58:26.841686 ip-10-0-139-134 kubenswrapper[2578]: I0709 18:58:26.841571    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fghgd" event={"ID":"31909fe7-f400-486f-8437-87c8674edc61","Type":"ContainerStarted","Data":"9302de5af5844255a1f89930de229fb18d15fe86a792f0b5ad5c6597fa007656"}
Jul 09 18:58:26.843062 ip-10-0-139-134 kubenswrapper[2578]: I0709 18:58:26.842983    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-vnnqd" event={"ID":"19c7b09c-711d-472b-95ef-ab437e64985c","Type":"ContainerStarted","Data":"20b13f8deaa10b86d995def36eabb24d077d90d415121fc0b01e841f85c8f755"}
Jul 09 18:58:26.844839 ip-10-0-139-134 kubenswrapper[2578]: I0709 18:58:26.844813    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-8gqbs" event={"ID":"7a15b7a9-7525-426b-a051-3ece178b71bc","Type":"ContainerStarted","Data":"277f4acabe6eea48d651c40d0a3e9862d1a9cb12ea1f4c38be6e8e627d6dd6f5"}
Jul 09 18:58:26.846288 ip-10-0-139-134 kubenswrapper[2578]: I0709 18:58:26.846251    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-7mdng" event={"ID":"c47bacce-dcdf-4fbf-af5f-5c781c502907","Type":"ContainerStarted","Data":"0561cdcf1c48a530b872a147e57fe546eb35e4c47c7f2cf93c0d0e4178e29817"}
Jul 09 18:58:26.847489 ip-10-0-139-134 kubenswrapper[2578]: I0709 18:58:26.847465    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-cs7mq" event={"ID":"d83b5188-15a8-4450-803c-62524a249f65","Type":"ContainerStarted","Data":"44f5817c10e9a1ebcf4d9153bc48a4aa74c915ea4ebd398ab0c5a1a7a979c0a0"}
Jul 09 18:58:26.849259 ip-10-0-139-134 kubenswrapper[2578]: I0709 18:58:26.849227    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-zj6hn" event={"ID":"3e4f13a3-c390-4ad2-9816-b389fa5abe57","Type":"ContainerStarted","Data":"8492152425fc9a408758feca5bcf936e94a6a9e4ee223440c2c7d526893c2039"}
Jul 09 18:58:27.415957 ip-10-0-139-134 kubenswrapper[2578]: I0709 18:58:27.415513    2578 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 09 18:58:27.490827 ip-10-0-139-134 kubenswrapper[2578]: I0709 18:58:27.490792    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/4e35097c-426a-4343-aa9d-befa17cabda5-original-pull-secret\") pod \"global-pull-secret-syncer-kmr4m\" (UID: \"4e35097c-426a-4343-aa9d-befa17cabda5\") " pod="kube-system/global-pull-secret-syncer-kmr4m"
Jul 09 18:58:27.491011 ip-10-0-139-134 kubenswrapper[2578]: I0709 18:58:27.490854    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a6f6e738-06b0-41d1-bcc4-3627871fe3d6-metrics-certs\") pod \"network-metrics-daemon-dztbt\" (UID: \"a6f6e738-06b0-41d1-bcc4-3627871fe3d6\") " pod="openshift-multus/network-metrics-daemon-dztbt"
Jul 09 18:58:27.491097 ip-10-0-139-134 kubenswrapper[2578]: E0709 18:58:27.491049    2578 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 09 18:58:27.491167 ip-10-0-139-134 kubenswrapper[2578]: E0709 18:58:27.491155    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a6f6e738-06b0-41d1-bcc4-3627871fe3d6-metrics-certs podName:a6f6e738-06b0-41d1-bcc4-3627871fe3d6 nodeName:}" failed. No retries permitted until 2026-07-09 18:58:29.491135287 +0000 UTC m=+6.117186600 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/a6f6e738-06b0-41d1-bcc4-3627871fe3d6-metrics-certs") pod "network-metrics-daemon-dztbt" (UID: "a6f6e738-06b0-41d1-bcc4-3627871fe3d6") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 09 18:58:27.491604 ip-10-0-139-134 kubenswrapper[2578]: E0709 18:58:27.491584    2578 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 09 18:58:27.491728 ip-10-0-139-134 kubenswrapper[2578]: E0709 18:58:27.491649    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4e35097c-426a-4343-aa9d-befa17cabda5-original-pull-secret podName:4e35097c-426a-4343-aa9d-befa17cabda5 nodeName:}" failed. No retries permitted until 2026-07-09 18:58:29.491620183 +0000 UTC m=+6.117671490 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/4e35097c-426a-4343-aa9d-befa17cabda5-original-pull-secret") pod "global-pull-secret-syncer-kmr4m" (UID: "4e35097c-426a-4343-aa9d-befa17cabda5") : object "kube-system"/"original-pull-secret" not registered
Jul 09 18:58:27.591856 ip-10-0-139-134 kubenswrapper[2578]: I0709 18:58:27.591816    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xfhcf\" (UniqueName: \"kubernetes.io/projected/2d052a65-da3a-4426-a441-83b9cc44217b-kube-api-access-xfhcf\") pod \"network-check-target-9n6nc\" (UID: \"2d052a65-da3a-4426-a441-83b9cc44217b\") " pod="openshift-network-diagnostics/network-check-target-9n6nc"
Jul 09 18:58:27.592064 ip-10-0-139-134 kubenswrapper[2578]: E0709 18:58:27.592044    2578 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 09 18:58:27.592149 ip-10-0-139-134 kubenswrapper[2578]: E0709 18:58:27.592072    2578 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 09 18:58:27.592149 ip-10-0-139-134 kubenswrapper[2578]: E0709 18:58:27.592084    2578 projected.go:196] Error preparing data for projected volume kube-api-access-xfhcf for pod openshift-network-diagnostics/network-check-target-9n6nc: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 09 18:58:27.592149 ip-10-0-139-134 kubenswrapper[2578]: E0709 18:58:27.592142    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/2d052a65-da3a-4426-a441-83b9cc44217b-kube-api-access-xfhcf podName:2d052a65-da3a-4426-a441-83b9cc44217b nodeName:}" failed. No retries permitted until 2026-07-09 18:58:29.592124085 +0000 UTC m=+6.218175413 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-xfhcf" (UniqueName: "kubernetes.io/projected/2d052a65-da3a-4426-a441-83b9cc44217b-kube-api-access-xfhcf") pod "network-check-target-9n6nc" (UID: "2d052a65-da3a-4426-a441-83b9cc44217b") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 09 18:58:27.806688 ip-10-0-139-134 kubenswrapper[2578]: I0709 18:58:27.806586    2578 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-08 18:53:25 +0000 UTC" deadline="2027-12-26 09:44:47.102775394 +0000 UTC"
Jul 09 18:58:27.806688 ip-10-0-139-134 kubenswrapper[2578]: I0709 18:58:27.806629    2578 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="12830h46m19.296150777s"
Jul 09 18:58:27.835376 ip-10-0-139-134 kubenswrapper[2578]: I0709 18:58:27.835342    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-kmr4m"
Jul 09 18:58:27.835522 ip-10-0-139-134 kubenswrapper[2578]: E0709 18:58:27.835469    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-kmr4m" podUID="4e35097c-426a-4343-aa9d-befa17cabda5"
Jul 09 18:58:27.835862 ip-10-0-139-134 kubenswrapper[2578]: I0709 18:58:27.835838    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-9n6nc"
Jul 09 18:58:27.836008 ip-10-0-139-134 kubenswrapper[2578]: E0709 18:58:27.835973    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-9n6nc" podUID="2d052a65-da3a-4426-a441-83b9cc44217b"
Jul 09 18:58:27.836080 ip-10-0-139-134 kubenswrapper[2578]: I0709 18:58:27.836066    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-dztbt"
Jul 09 18:58:27.836210 ip-10-0-139-134 kubenswrapper[2578]: E0709 18:58:27.836153    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-dztbt" podUID="a6f6e738-06b0-41d1-bcc4-3627871fe3d6"
Jul 09 18:58:27.865854 ip-10-0-139-134 kubenswrapper[2578]: I0709 18:58:27.865817    2578 generic.go:356] "Generic (PLEG): container finished" podID="6c8631cd46f5ef2fe2e7fec413f6f8d7" containerID="b2f2f4f0c62147871a47d4401c1339013bff970ccde176cb549b52da5f5e626d" exitCode=0
Jul 09 18:58:27.866736 ip-10-0-139-134 kubenswrapper[2578]: I0709 18:58:27.866444    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-134.ec2.internal" event={"ID":"6c8631cd46f5ef2fe2e7fec413f6f8d7","Type":"ContainerDied","Data":"b2f2f4f0c62147871a47d4401c1339013bff970ccde176cb549b52da5f5e626d"}
Jul 09 18:58:27.879632 ip-10-0-139-134 kubenswrapper[2578]: I0709 18:58:27.879603    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-139-134.ec2.internal" event={"ID":"6d1a4d271968fb37c56f11e30e3e00f8","Type":"ContainerStarted","Data":"6413710ceaf375e328d20c646fcbedfcd434c6c9635c3472b075a36465d570bc"}
Jul 09 18:58:27.895628 ip-10-0-139-134 kubenswrapper[2578]: I0709 18:58:27.892914    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-4ntmk" event={"ID":"4b9891d4-d137-4996-ba20-f037de730093","Type":"ContainerStarted","Data":"05a6c316fa80688b06144653416cf35f49e51269601d41d9b5c1ef666372bcda"}
Jul 09 18:58:27.899503 ip-10-0-139-134 kubenswrapper[2578]: I0709 18:58:27.899467    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-m9cp9" event={"ID":"b322e6fc-5ae5-456b-a21c-364ba723d213","Type":"ContainerStarted","Data":"260aff1c77456f1c3eec67e7b04434036edd17e51978c134c1a81dcb1265ac29"}
Jul 09 18:58:27.902826 ip-10-0-139-134 kubenswrapper[2578]: I0709 18:58:27.902791    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-zwps8" event={"ID":"d9cc9b31-8c81-490e-911c-692cc55539c1","Type":"ContainerStarted","Data":"39f4fcbff763622d08c4bbb15f3d08679fcd0b0df375a55d1158f1023462d3f1"}
Jul 09 18:58:28.923196 ip-10-0-139-134 kubenswrapper[2578]: I0709 18:58:28.923160    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-134.ec2.internal" event={"ID":"6c8631cd46f5ef2fe2e7fec413f6f8d7","Type":"ContainerStarted","Data":"bbb3b738976bb74772cc2bc0f543f8badc7467ae236baad753ad5333f92dc1cd"}
Jul 09 18:58:28.939811 ip-10-0-139-134 kubenswrapper[2578]: I0709 18:58:28.939747    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-139-134.ec2.internal" podStartSLOduration=3.93972491 podStartE2EDuration="3.93972491s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-09 18:58:25 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 18:58:27.896266772 +0000 UTC m=+4.522318123" watchObservedRunningTime="2026-07-09 18:58:28.93972491 +0000 UTC m=+5.565776242"
Jul 09 18:58:29.508641 ip-10-0-139-134 kubenswrapper[2578]: I0709 18:58:29.508598    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/4e35097c-426a-4343-aa9d-befa17cabda5-original-pull-secret\") pod \"global-pull-secret-syncer-kmr4m\" (UID: \"4e35097c-426a-4343-aa9d-befa17cabda5\") " pod="kube-system/global-pull-secret-syncer-kmr4m"
Jul 09 18:58:29.508824 ip-10-0-139-134 kubenswrapper[2578]: I0709 18:58:29.508719    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a6f6e738-06b0-41d1-bcc4-3627871fe3d6-metrics-certs\") pod \"network-metrics-daemon-dztbt\" (UID: \"a6f6e738-06b0-41d1-bcc4-3627871fe3d6\") " pod="openshift-multus/network-metrics-daemon-dztbt"
Jul 09 18:58:29.508904 ip-10-0-139-134 kubenswrapper[2578]: E0709 18:58:29.508871    2578 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 09 18:58:29.508966 ip-10-0-139-134 kubenswrapper[2578]: E0709 18:58:29.508939    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a6f6e738-06b0-41d1-bcc4-3627871fe3d6-metrics-certs podName:a6f6e738-06b0-41d1-bcc4-3627871fe3d6 nodeName:}" failed. No retries permitted until 2026-07-09 18:58:33.508919812 +0000 UTC m=+10.134971143 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/a6f6e738-06b0-41d1-bcc4-3627871fe3d6-metrics-certs") pod "network-metrics-daemon-dztbt" (UID: "a6f6e738-06b0-41d1-bcc4-3627871fe3d6") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 09 18:58:29.509396 ip-10-0-139-134 kubenswrapper[2578]: E0709 18:58:29.509376    2578 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 09 18:58:29.509496 ip-10-0-139-134 kubenswrapper[2578]: E0709 18:58:29.509433    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4e35097c-426a-4343-aa9d-befa17cabda5-original-pull-secret podName:4e35097c-426a-4343-aa9d-befa17cabda5 nodeName:}" failed. No retries permitted until 2026-07-09 18:58:33.509417212 +0000 UTC m=+10.135468523 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/4e35097c-426a-4343-aa9d-befa17cabda5-original-pull-secret") pod "global-pull-secret-syncer-kmr4m" (UID: "4e35097c-426a-4343-aa9d-befa17cabda5") : object "kube-system"/"original-pull-secret" not registered
Jul 09 18:58:29.609170 ip-10-0-139-134 kubenswrapper[2578]: I0709 18:58:29.609128    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xfhcf\" (UniqueName: \"kubernetes.io/projected/2d052a65-da3a-4426-a441-83b9cc44217b-kube-api-access-xfhcf\") pod \"network-check-target-9n6nc\" (UID: \"2d052a65-da3a-4426-a441-83b9cc44217b\") " pod="openshift-network-diagnostics/network-check-target-9n6nc"
Jul 09 18:58:29.609342 ip-10-0-139-134 kubenswrapper[2578]: E0709 18:58:29.609320    2578 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 09 18:58:29.609342 ip-10-0-139-134 kubenswrapper[2578]: E0709 18:58:29.609343    2578 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 09 18:58:29.609464 ip-10-0-139-134 kubenswrapper[2578]: E0709 18:58:29.609355    2578 projected.go:196] Error preparing data for projected volume kube-api-access-xfhcf for pod openshift-network-diagnostics/network-check-target-9n6nc: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 09 18:58:29.609464 ip-10-0-139-134 kubenswrapper[2578]: E0709 18:58:29.609415    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/2d052a65-da3a-4426-a441-83b9cc44217b-kube-api-access-xfhcf podName:2d052a65-da3a-4426-a441-83b9cc44217b nodeName:}" failed. No retries permitted until 2026-07-09 18:58:33.609397504 +0000 UTC m=+10.235448828 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-xfhcf" (UniqueName: "kubernetes.io/projected/2d052a65-da3a-4426-a441-83b9cc44217b-kube-api-access-xfhcf") pod "network-check-target-9n6nc" (UID: "2d052a65-da3a-4426-a441-83b9cc44217b") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 09 18:58:29.833223 ip-10-0-139-134 kubenswrapper[2578]: I0709 18:58:29.833106    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-kmr4m"
Jul 09 18:58:29.833395 ip-10-0-139-134 kubenswrapper[2578]: E0709 18:58:29.833286    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-kmr4m" podUID="4e35097c-426a-4343-aa9d-befa17cabda5"
Jul 09 18:58:29.833746 ip-10-0-139-134 kubenswrapper[2578]: I0709 18:58:29.833725    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-9n6nc"
Jul 09 18:58:29.833872 ip-10-0-139-134 kubenswrapper[2578]: E0709 18:58:29.833827    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-9n6nc" podUID="2d052a65-da3a-4426-a441-83b9cc44217b"
Jul 09 18:58:29.834107 ip-10-0-139-134 kubenswrapper[2578]: I0709 18:58:29.834088    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-dztbt"
Jul 09 18:58:29.834227 ip-10-0-139-134 kubenswrapper[2578]: E0709 18:58:29.834191    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-dztbt" podUID="a6f6e738-06b0-41d1-bcc4-3627871fe3d6"
Jul 09 18:58:31.834612 ip-10-0-139-134 kubenswrapper[2578]: I0709 18:58:31.834109    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-9n6nc"
Jul 09 18:58:31.834612 ip-10-0-139-134 kubenswrapper[2578]: I0709 18:58:31.834109    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-dztbt"
Jul 09 18:58:31.834612 ip-10-0-139-134 kubenswrapper[2578]: E0709 18:58:31.834239    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-9n6nc" podUID="2d052a65-da3a-4426-a441-83b9cc44217b"
Jul 09 18:58:31.834612 ip-10-0-139-134 kubenswrapper[2578]: E0709 18:58:31.834393    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-dztbt" podUID="a6f6e738-06b0-41d1-bcc4-3627871fe3d6"
Jul 09 18:58:31.834612 ip-10-0-139-134 kubenswrapper[2578]: I0709 18:58:31.834429    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-kmr4m"
Jul 09 18:58:31.834612 ip-10-0-139-134 kubenswrapper[2578]: E0709 18:58:31.834525    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-kmr4m" podUID="4e35097c-426a-4343-aa9d-befa17cabda5"
Jul 09 18:58:33.543605 ip-10-0-139-134 kubenswrapper[2578]: I0709 18:58:33.543564    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/4e35097c-426a-4343-aa9d-befa17cabda5-original-pull-secret\") pod \"global-pull-secret-syncer-kmr4m\" (UID: \"4e35097c-426a-4343-aa9d-befa17cabda5\") " pod="kube-system/global-pull-secret-syncer-kmr4m"
Jul 09 18:58:33.544084 ip-10-0-139-134 kubenswrapper[2578]: I0709 18:58:33.543619    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a6f6e738-06b0-41d1-bcc4-3627871fe3d6-metrics-certs\") pod \"network-metrics-daemon-dztbt\" (UID: \"a6f6e738-06b0-41d1-bcc4-3627871fe3d6\") " pod="openshift-multus/network-metrics-daemon-dztbt"
Jul 09 18:58:33.544084 ip-10-0-139-134 kubenswrapper[2578]: E0709 18:58:33.543724    2578 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 09 18:58:33.544084 ip-10-0-139-134 kubenswrapper[2578]: E0709 18:58:33.543775    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a6f6e738-06b0-41d1-bcc4-3627871fe3d6-metrics-certs podName:a6f6e738-06b0-41d1-bcc4-3627871fe3d6 nodeName:}" failed. No retries permitted until 2026-07-09 18:58:41.543760781 +0000 UTC m=+18.169812090 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/a6f6e738-06b0-41d1-bcc4-3627871fe3d6-metrics-certs") pod "network-metrics-daemon-dztbt" (UID: "a6f6e738-06b0-41d1-bcc4-3627871fe3d6") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 09 18:58:33.544262 ip-10-0-139-134 kubenswrapper[2578]: E0709 18:58:33.544107    2578 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 09 18:58:33.544262 ip-10-0-139-134 kubenswrapper[2578]: E0709 18:58:33.544147    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4e35097c-426a-4343-aa9d-befa17cabda5-original-pull-secret podName:4e35097c-426a-4343-aa9d-befa17cabda5 nodeName:}" failed. No retries permitted until 2026-07-09 18:58:41.544135755 +0000 UTC m=+18.170187063 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/4e35097c-426a-4343-aa9d-befa17cabda5-original-pull-secret") pod "global-pull-secret-syncer-kmr4m" (UID: "4e35097c-426a-4343-aa9d-befa17cabda5") : object "kube-system"/"original-pull-secret" not registered
Jul 09 18:58:33.644398 ip-10-0-139-134 kubenswrapper[2578]: I0709 18:58:33.644358    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xfhcf\" (UniqueName: \"kubernetes.io/projected/2d052a65-da3a-4426-a441-83b9cc44217b-kube-api-access-xfhcf\") pod \"network-check-target-9n6nc\" (UID: \"2d052a65-da3a-4426-a441-83b9cc44217b\") " pod="openshift-network-diagnostics/network-check-target-9n6nc"
Jul 09 18:58:33.644574 ip-10-0-139-134 kubenswrapper[2578]: E0709 18:58:33.644542    2578 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 09 18:58:33.644574 ip-10-0-139-134 kubenswrapper[2578]: E0709 18:58:33.644565    2578 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 09 18:58:33.644669 ip-10-0-139-134 kubenswrapper[2578]: E0709 18:58:33.644578    2578 projected.go:196] Error preparing data for projected volume kube-api-access-xfhcf for pod openshift-network-diagnostics/network-check-target-9n6nc: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 09 18:58:33.644669 ip-10-0-139-134 kubenswrapper[2578]: E0709 18:58:33.644640    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/2d052a65-da3a-4426-a441-83b9cc44217b-kube-api-access-xfhcf podName:2d052a65-da3a-4426-a441-83b9cc44217b nodeName:}" failed. No retries permitted until 2026-07-09 18:58:41.644621023 +0000 UTC m=+18.270672338 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-xfhcf" (UniqueName: "kubernetes.io/projected/2d052a65-da3a-4426-a441-83b9cc44217b-kube-api-access-xfhcf") pod "network-check-target-9n6nc" (UID: "2d052a65-da3a-4426-a441-83b9cc44217b") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 09 18:58:33.833339 ip-10-0-139-134 kubenswrapper[2578]: I0709 18:58:33.833257    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-9n6nc"
Jul 09 18:58:33.833339 ip-10-0-139-134 kubenswrapper[2578]: I0709 18:58:33.833302    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-kmr4m"
Jul 09 18:58:33.833545 ip-10-0-139-134 kubenswrapper[2578]: E0709 18:58:33.833377    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-9n6nc" podUID="2d052a65-da3a-4426-a441-83b9cc44217b"
Jul 09 18:58:33.833545 ip-10-0-139-134 kubenswrapper[2578]: I0709 18:58:33.833428    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-dztbt"
Jul 09 18:58:33.833657 ip-10-0-139-134 kubenswrapper[2578]: E0709 18:58:33.833542    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-dztbt" podUID="a6f6e738-06b0-41d1-bcc4-3627871fe3d6"
Jul 09 18:58:33.833657 ip-10-0-139-134 kubenswrapper[2578]: E0709 18:58:33.833633    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-kmr4m" podUID="4e35097c-426a-4343-aa9d-befa17cabda5"
Jul 09 18:58:35.833237 ip-10-0-139-134 kubenswrapper[2578]: I0709 18:58:35.832688    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-dztbt"
Jul 09 18:58:35.833237 ip-10-0-139-134 kubenswrapper[2578]: I0709 18:58:35.833234    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-kmr4m"
Jul 09 18:58:35.833798 ip-10-0-139-134 kubenswrapper[2578]: I0709 18:58:35.832722    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-9n6nc"
Jul 09 18:58:35.833798 ip-10-0-139-134 kubenswrapper[2578]: E0709 18:58:35.833341    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-dztbt" podUID="a6f6e738-06b0-41d1-bcc4-3627871fe3d6"
Jul 09 18:58:35.833798 ip-10-0-139-134 kubenswrapper[2578]: E0709 18:58:35.833394    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-9n6nc" podUID="2d052a65-da3a-4426-a441-83b9cc44217b"
Jul 09 18:58:35.833798 ip-10-0-139-134 kubenswrapper[2578]: E0709 18:58:35.833466    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-kmr4m" podUID="4e35097c-426a-4343-aa9d-befa17cabda5"
Jul 09 18:58:37.832697 ip-10-0-139-134 kubenswrapper[2578]: I0709 18:58:37.832610    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-dztbt"
Jul 09 18:58:37.833159 ip-10-0-139-134 kubenswrapper[2578]: I0709 18:58:37.832611    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-9n6nc"
Jul 09 18:58:37.833159 ip-10-0-139-134 kubenswrapper[2578]: E0709 18:58:37.832758    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-dztbt" podUID="a6f6e738-06b0-41d1-bcc4-3627871fe3d6"
Jul 09 18:58:37.833159 ip-10-0-139-134 kubenswrapper[2578]: E0709 18:58:37.832816    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-9n6nc" podUID="2d052a65-da3a-4426-a441-83b9cc44217b"
Jul 09 18:58:37.833159 ip-10-0-139-134 kubenswrapper[2578]: I0709 18:58:37.832616    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-kmr4m"
Jul 09 18:58:37.833159 ip-10-0-139-134 kubenswrapper[2578]: E0709 18:58:37.832910    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-kmr4m" podUID="4e35097c-426a-4343-aa9d-befa17cabda5"
Jul 09 18:58:39.832592 ip-10-0-139-134 kubenswrapper[2578]: I0709 18:58:39.832553    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-kmr4m"
Jul 09 18:58:39.833029 ip-10-0-139-134 kubenswrapper[2578]: I0709 18:58:39.832556    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-dztbt"
Jul 09 18:58:39.833029 ip-10-0-139-134 kubenswrapper[2578]: E0709 18:58:39.832687    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-kmr4m" podUID="4e35097c-426a-4343-aa9d-befa17cabda5"
Jul 09 18:58:39.833029 ip-10-0-139-134 kubenswrapper[2578]: I0709 18:58:39.832720    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-9n6nc"
Jul 09 18:58:39.833029 ip-10-0-139-134 kubenswrapper[2578]: E0709 18:58:39.832846    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-dztbt" podUID="a6f6e738-06b0-41d1-bcc4-3627871fe3d6"
Jul 09 18:58:39.833029 ip-10-0-139-134 kubenswrapper[2578]: E0709 18:58:39.832937    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-9n6nc" podUID="2d052a65-da3a-4426-a441-83b9cc44217b"
Jul 09 18:58:41.604225 ip-10-0-139-134 kubenswrapper[2578]: I0709 18:58:41.604188    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a6f6e738-06b0-41d1-bcc4-3627871fe3d6-metrics-certs\") pod \"network-metrics-daemon-dztbt\" (UID: \"a6f6e738-06b0-41d1-bcc4-3627871fe3d6\") " pod="openshift-multus/network-metrics-daemon-dztbt"
Jul 09 18:58:41.604718 ip-10-0-139-134 kubenswrapper[2578]: I0709 18:58:41.604270    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/4e35097c-426a-4343-aa9d-befa17cabda5-original-pull-secret\") pod \"global-pull-secret-syncer-kmr4m\" (UID: \"4e35097c-426a-4343-aa9d-befa17cabda5\") " pod="kube-system/global-pull-secret-syncer-kmr4m"
Jul 09 18:58:41.604718 ip-10-0-139-134 kubenswrapper[2578]: E0709 18:58:41.604370    2578 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 09 18:58:41.604718 ip-10-0-139-134 kubenswrapper[2578]: E0709 18:58:41.604451    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a6f6e738-06b0-41d1-bcc4-3627871fe3d6-metrics-certs podName:a6f6e738-06b0-41d1-bcc4-3627871fe3d6 nodeName:}" failed. No retries permitted until 2026-07-09 18:58:57.60442734 +0000 UTC m=+34.230478651 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/a6f6e738-06b0-41d1-bcc4-3627871fe3d6-metrics-certs") pod "network-metrics-daemon-dztbt" (UID: "a6f6e738-06b0-41d1-bcc4-3627871fe3d6") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 09 18:58:41.604718 ip-10-0-139-134 kubenswrapper[2578]: E0709 18:58:41.604379    2578 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 09 18:58:41.604718 ip-10-0-139-134 kubenswrapper[2578]: E0709 18:58:41.604538    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4e35097c-426a-4343-aa9d-befa17cabda5-original-pull-secret podName:4e35097c-426a-4343-aa9d-befa17cabda5 nodeName:}" failed. No retries permitted until 2026-07-09 18:58:57.604519231 +0000 UTC m=+34.230570551 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/4e35097c-426a-4343-aa9d-befa17cabda5-original-pull-secret") pod "global-pull-secret-syncer-kmr4m" (UID: "4e35097c-426a-4343-aa9d-befa17cabda5") : object "kube-system"/"original-pull-secret" not registered
Jul 09 18:58:41.704980 ip-10-0-139-134 kubenswrapper[2578]: I0709 18:58:41.704941    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xfhcf\" (UniqueName: \"kubernetes.io/projected/2d052a65-da3a-4426-a441-83b9cc44217b-kube-api-access-xfhcf\") pod \"network-check-target-9n6nc\" (UID: \"2d052a65-da3a-4426-a441-83b9cc44217b\") " pod="openshift-network-diagnostics/network-check-target-9n6nc"
Jul 09 18:58:41.705177 ip-10-0-139-134 kubenswrapper[2578]: E0709 18:58:41.705144    2578 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 09 18:58:41.705177 ip-10-0-139-134 kubenswrapper[2578]: E0709 18:58:41.705170    2578 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 09 18:58:41.705278 ip-10-0-139-134 kubenswrapper[2578]: E0709 18:58:41.705184    2578 projected.go:196] Error preparing data for projected volume kube-api-access-xfhcf for pod openshift-network-diagnostics/network-check-target-9n6nc: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 09 18:58:41.705278 ip-10-0-139-134 kubenswrapper[2578]: E0709 18:58:41.705246    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/2d052a65-da3a-4426-a441-83b9cc44217b-kube-api-access-xfhcf podName:2d052a65-da3a-4426-a441-83b9cc44217b nodeName:}" failed. No retries permitted until 2026-07-09 18:58:57.705232122 +0000 UTC m=+34.331283434 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-xfhcf" (UniqueName: "kubernetes.io/projected/2d052a65-da3a-4426-a441-83b9cc44217b-kube-api-access-xfhcf") pod "network-check-target-9n6nc" (UID: "2d052a65-da3a-4426-a441-83b9cc44217b") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 09 18:58:41.832934 ip-10-0-139-134 kubenswrapper[2578]: I0709 18:58:41.832840    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-9n6nc"
Jul 09 18:58:41.833113 ip-10-0-139-134 kubenswrapper[2578]: I0709 18:58:41.832840    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-kmr4m"
Jul 09 18:58:41.833113 ip-10-0-139-134 kubenswrapper[2578]: E0709 18:58:41.832974    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-9n6nc" podUID="2d052a65-da3a-4426-a441-83b9cc44217b"
Jul 09 18:58:41.833113 ip-10-0-139-134 kubenswrapper[2578]: E0709 18:58:41.833076    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-kmr4m" podUID="4e35097c-426a-4343-aa9d-befa17cabda5"
Jul 09 18:58:41.833113 ip-10-0-139-134 kubenswrapper[2578]: I0709 18:58:41.832840    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-dztbt"
Jul 09 18:58:41.833302 ip-10-0-139-134 kubenswrapper[2578]: E0709 18:58:41.833195    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-dztbt" podUID="a6f6e738-06b0-41d1-bcc4-3627871fe3d6"
Jul 09 18:58:43.836066 ip-10-0-139-134 kubenswrapper[2578]: I0709 18:58:43.834873    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-dztbt"
Jul 09 18:58:43.836066 ip-10-0-139-134 kubenswrapper[2578]: E0709 18:58:43.835744    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-dztbt" podUID="a6f6e738-06b0-41d1-bcc4-3627871fe3d6"
Jul 09 18:58:43.836066 ip-10-0-139-134 kubenswrapper[2578]: I0709 18:58:43.836033    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-kmr4m"
Jul 09 18:58:43.836627 ip-10-0-139-134 kubenswrapper[2578]: I0709 18:58:43.836049    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-9n6nc"
Jul 09 18:58:43.836795 ip-10-0-139-134 kubenswrapper[2578]: E0709 18:58:43.836769    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-kmr4m" podUID="4e35097c-426a-4343-aa9d-befa17cabda5"
Jul 09 18:58:43.837180 ip-10-0-139-134 kubenswrapper[2578]: E0709 18:58:43.837153    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-9n6nc" podUID="2d052a65-da3a-4426-a441-83b9cc44217b"
Jul 09 18:58:45.833632 ip-10-0-139-134 kubenswrapper[2578]: I0709 18:58:45.833392    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-9n6nc"
Jul 09 18:58:45.834182 ip-10-0-139-134 kubenswrapper[2578]: E0709 18:58:45.833739    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-9n6nc" podUID="2d052a65-da3a-4426-a441-83b9cc44217b"
Jul 09 18:58:45.834182 ip-10-0-139-134 kubenswrapper[2578]: I0709 18:58:45.833827    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-dztbt"
Jul 09 18:58:45.834182 ip-10-0-139-134 kubenswrapper[2578]: E0709 18:58:45.833916    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-dztbt" podUID="a6f6e738-06b0-41d1-bcc4-3627871fe3d6"
Jul 09 18:58:45.834182 ip-10-0-139-134 kubenswrapper[2578]: I0709 18:58:45.833981    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-kmr4m"
Jul 09 18:58:45.834182 ip-10-0-139-134 kubenswrapper[2578]: E0709 18:58:45.834081    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-kmr4m" podUID="4e35097c-426a-4343-aa9d-befa17cabda5"
Jul 09 18:58:45.958590 ip-10-0-139-134 kubenswrapper[2578]: I0709 18:58:45.958554    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-zwps8" event={"ID":"d9cc9b31-8c81-490e-911c-692cc55539c1","Type":"ContainerStarted","Data":"011ffa91233e941297a8b4e55605ecd8a4e6955ca67607ae165027d19c4eb1d1"}
Jul 09 18:58:45.960543 ip-10-0-139-134 kubenswrapper[2578]: I0709 18:58:45.960514    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fghgd" event={"ID":"31909fe7-f400-486f-8437-87c8674edc61","Type":"ContainerStarted","Data":"b67e63a39e60f2889c96dbeed9b484be3278494b3b458eef2fdfa4ee049bd9c7"}
Jul 09 18:58:45.962367 ip-10-0-139-134 kubenswrapper[2578]: I0709 18:58:45.962339    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-vnnqd" event={"ID":"19c7b09c-711d-472b-95ef-ab437e64985c","Type":"ContainerStarted","Data":"72bc8374b6df5de0de0e6fa29288330c328cb70874126c55be8d1e7a6416d548"}
Jul 09 18:58:45.964694 ip-10-0-139-134 kubenswrapper[2578]: I0709 18:58:45.964667    2578 generic.go:356] "Generic (PLEG): container finished" podID="d83b5188-15a8-4450-803c-62524a249f65" containerID="314a1e6f85ca4d0f3f7aa0dcfb0bf07d31d4dbfd407af3a116f9ab997c6adf04" exitCode=0
Jul 09 18:58:45.964811 ip-10-0-139-134 kubenswrapper[2578]: I0709 18:58:45.964730    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-cs7mq" event={"ID":"d83b5188-15a8-4450-803c-62524a249f65","Type":"ContainerDied","Data":"314a1e6f85ca4d0f3f7aa0dcfb0bf07d31d4dbfd407af3a116f9ab997c6adf04"}
Jul 09 18:58:45.966368 ip-10-0-139-134 kubenswrapper[2578]: I0709 18:58:45.966340    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-zj6hn" event={"ID":"3e4f13a3-c390-4ad2-9816-b389fa5abe57","Type":"ContainerStarted","Data":"bcd4668c3ddaceffbffe0ddac4ea93d0c031dfbd2f0e6e721e1e474af58c0f97"}
Jul 09 18:58:45.967844 ip-10-0-139-134 kubenswrapper[2578]: I0709 18:58:45.967802    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-8gqbs_7a15b7a9-7525-426b-a051-3ece178b71bc/ovn-acl-logging/0.log"
Jul 09 18:58:45.968215 ip-10-0-139-134 kubenswrapper[2578]: I0709 18:58:45.968192    2578 generic.go:356] "Generic (PLEG): container finished" podID="7a15b7a9-7525-426b-a051-3ece178b71bc" containerID="a84bda7c3e9b51203539310efeb175d8f1b21bab98c880211fedb1e0c0f8653a" exitCode=1
Jul 09 18:58:45.968309 ip-10-0-139-134 kubenswrapper[2578]: I0709 18:58:45.968279    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-8gqbs" event={"ID":"7a15b7a9-7525-426b-a051-3ece178b71bc","Type":"ContainerDied","Data":"a84bda7c3e9b51203539310efeb175d8f1b21bab98c880211fedb1e0c0f8653a"}
Jul 09 18:58:45.968379 ip-10-0-139-134 kubenswrapper[2578]: I0709 18:58:45.968368    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-8gqbs" event={"ID":"7a15b7a9-7525-426b-a051-3ece178b71bc","Type":"ContainerStarted","Data":"76eb44770a91e8810e8d05b7732568598cd9c36698dc6dcaf5f4f6a4adc3059e"}
Jul 09 18:58:45.969803 ip-10-0-139-134 kubenswrapper[2578]: I0709 18:58:45.969778    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-7mdng" event={"ID":"c47bacce-dcdf-4fbf-af5f-5c781c502907","Type":"ContainerStarted","Data":"28805cf2649dbe3d3d2c2ef11edb0ba062f705b92fea9be69bad4522f7b0bf5c"}
Jul 09 18:58:45.971368 ip-10-0-139-134 kubenswrapper[2578]: I0709 18:58:45.971237    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-4ntmk" event={"ID":"4b9891d4-d137-4996-ba20-f037de730093","Type":"ContainerStarted","Data":"a13a71ccd99ddf0d8ab3c833f67d35bde831d4178085cde67415e71ef5ee0c20"}
Jul 09 18:58:45.976849 ip-10-0-139-134 kubenswrapper[2578]: I0709 18:58:45.976811    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-zwps8" podStartSLOduration=3.173410292 podStartE2EDuration="21.976799476s" totalImagesPullingTime="18.803389184s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-09 18:58:24 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 18:58:45.976609462 +0000 UTC m=+22.602660793" watchObservedRunningTime="2026-07-09 18:58:45.976799476 +0000 UTC m=+22.602850805"
Jul 09 18:58:45.976948 ip-10-0-139-134 kubenswrapper[2578]: I0709 18:58:45.976877    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-134.ec2.internal" podStartSLOduration=20.976871695 podStartE2EDuration="20.976871695s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-09 18:58:25 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 18:58:28.940911186 +0000 UTC m=+5.566962520" watchObservedRunningTime="2026-07-09 18:58:45.976871695 +0000 UTC m=+22.602923022"
Jul 09 18:58:45.991951 ip-10-0-139-134 kubenswrapper[2578]: I0709 18:58:45.991897    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-4ntmk" podStartSLOduration=4.188835422 podStartE2EDuration="22.991876987s" totalImagesPullingTime="18.803041565s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-09 18:58:23 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 18:58:45.991676717 +0000 UTC m=+22.617728047" watchObservedRunningTime="2026-07-09 18:58:45.991876987 +0000 UTC m=+22.617928318"
Jul 09 18:58:46.039815 ip-10-0-139-134 kubenswrapper[2578]: I0709 18:58:46.039418    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-7mdng" podStartSLOduration=4.176728787 podStartE2EDuration="23.039396708s" totalImagesPullingTime="18.862667921s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-09 18:58:23 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 18:58:46.038669997 +0000 UTC m=+22.664721349" watchObservedRunningTime="2026-07-09 18:58:46.039396708 +0000 UTC m=+22.665448036"
Jul 09 18:58:46.056858 ip-10-0-139-134 kubenswrapper[2578]: I0709 18:58:46.056710    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-zj6hn" podStartSLOduration=4.24377612 podStartE2EDuration="23.056695319s" totalImagesPullingTime="18.812919199s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-09 18:58:23 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 18:58:46.056283681 +0000 UTC m=+22.682335013" watchObservedRunningTime="2026-07-09 18:58:46.056695319 +0000 UTC m=+22.682746650"
Jul 09 18:58:46.076624 ip-10-0-139-134 kubenswrapper[2578]: I0709 18:58:46.075628    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-vnnqd" podStartSLOduration=3.267087016 podStartE2EDuration="22.075607826s" totalImagesPullingTime="18.80852081s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 18:58:24 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 18:58:46.07557635 +0000 UTC m=+22.701627705" watchObservedRunningTime="2026-07-09 18:58:46.075607826 +0000 UTC m=+22.701659159"
Jul 09 18:58:46.975161 ip-10-0-139-134 kubenswrapper[2578]: I0709 18:58:46.975141    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-8gqbs_7a15b7a9-7525-426b-a051-3ece178b71bc/ovn-acl-logging/0.log"
Jul 09 18:58:46.975778 ip-10-0-139-134 kubenswrapper[2578]: I0709 18:58:46.975436    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-8gqbs" event={"ID":"7a15b7a9-7525-426b-a051-3ece178b71bc","Type":"ContainerStarted","Data":"46e36d03e83c5edf0784cd181e91e260fd5b13aaf20606a609ecc9a8ecd851b0"}
Jul 09 18:58:46.975778 ip-10-0-139-134 kubenswrapper[2578]: I0709 18:58:46.975527    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-8gqbs" event={"ID":"7a15b7a9-7525-426b-a051-3ece178b71bc","Type":"ContainerStarted","Data":"4b25dab2a1ee94b337f8a7f2fad6eb7676ce3974b065f2bc5c8d8363d4fe3aa8"}
Jul 09 18:58:46.975778 ip-10-0-139-134 kubenswrapper[2578]: I0709 18:58:46.975567    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-8gqbs" event={"ID":"7a15b7a9-7525-426b-a051-3ece178b71bc","Type":"ContainerStarted","Data":"6e276fe2b334b9629e0573dbdda7352a525c178f2120eef87dd9579062e197c0"}
Jul 09 18:58:46.975778 ip-10-0-139-134 kubenswrapper[2578]: I0709 18:58:46.975597    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-8gqbs" event={"ID":"7a15b7a9-7525-426b-a051-3ece178b71bc","Type":"ContainerStarted","Data":"fbf83ec76b254f69a4c5937a5fa7a77422cf6db2e42491dc8eb4de2f90f32da4"}
Jul 09 18:58:46.976844 ip-10-0-139-134 kubenswrapper[2578]: I0709 18:58:46.976797    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-m9cp9" event={"ID":"b322e6fc-5ae5-456b-a21c-364ba723d213","Type":"ContainerStarted","Data":"803867dc2ed98d3774a75fad44fb181ba1cf1078264be06cd514c6d666a49adf"}
Jul 09 18:58:47.143750 ip-10-0-139-134 kubenswrapper[2578]: I0709 18:58:47.143729    2578 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock"
Jul 09 18:58:47.680820 ip-10-0-139-134 kubenswrapper[2578]: I0709 18:58:47.680787    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-vnnqd"
Jul 09 18:58:47.682082 ip-10-0-139-134 kubenswrapper[2578]: I0709 18:58:47.681616    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-vnnqd"
Jul 09 18:58:47.832402 ip-10-0-139-134 kubenswrapper[2578]: I0709 18:58:47.832367    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-9n6nc"
Jul 09 18:58:47.832402 ip-10-0-139-134 kubenswrapper[2578]: I0709 18:58:47.832378    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-dztbt"
Jul 09 18:58:47.832891 ip-10-0-139-134 kubenswrapper[2578]: I0709 18:58:47.832414    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-kmr4m"
Jul 09 18:58:47.832891 ip-10-0-139-134 kubenswrapper[2578]: E0709 18:58:47.832504    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-9n6nc" podUID="2d052a65-da3a-4426-a441-83b9cc44217b"
Jul 09 18:58:47.832891 ip-10-0-139-134 kubenswrapper[2578]: E0709 18:58:47.832647    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-dztbt" podUID="a6f6e738-06b0-41d1-bcc4-3627871fe3d6"
Jul 09 18:58:47.832891 ip-10-0-139-134 kubenswrapper[2578]: E0709 18:58:47.832732    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-kmr4m" podUID="4e35097c-426a-4343-aa9d-befa17cabda5"
Jul 09 18:58:47.834303 ip-10-0-139-134 kubenswrapper[2578]: I0709 18:58:47.834217    2578 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-07-09T18:58:47.143746879Z","UUID":"502e4e96-b833-4831-a7f2-d0d0bc1fff9e","Handler":null,"Name":"","Endpoint":""}
Jul 09 18:58:47.836328 ip-10-0-139-134 kubenswrapper[2578]: I0709 18:58:47.836310    2578 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0
Jul 09 18:58:47.836433 ip-10-0-139-134 kubenswrapper[2578]: I0709 18:58:47.836344    2578 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock
Jul 09 18:58:47.981228 ip-10-0-139-134 kubenswrapper[2578]: I0709 18:58:47.981138    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fghgd" event={"ID":"31909fe7-f400-486f-8437-87c8674edc61","Type":"ContainerStarted","Data":"f27742aacf5d2cea9c1f240a526c0b2ba426291271d01173c44a47303b6e8be0"}
Jul 09 18:58:47.982272 ip-10-0-139-134 kubenswrapper[2578]: I0709 18:58:47.982247    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-vnnqd"
Jul 09 18:58:47.982864 ip-10-0-139-134 kubenswrapper[2578]: I0709 18:58:47.982843    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-vnnqd"
Jul 09 18:58:48.001497 ip-10-0-139-134 kubenswrapper[2578]: I0709 18:58:48.001441    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-m9cp9" podStartSLOduration=5.191046032 podStartE2EDuration="24.001424556s" totalImagesPullingTime="18.810378524s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-09 18:58:24 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 18:58:48.001179105 +0000 UTC m=+24.627230439" watchObservedRunningTime="2026-07-09 18:58:48.001424556 +0000 UTC m=+24.627475938"
Jul 09 18:58:48.987584 ip-10-0-139-134 kubenswrapper[2578]: I0709 18:58:48.987551    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-8gqbs_7a15b7a9-7525-426b-a051-3ece178b71bc/ovn-acl-logging/0.log"
Jul 09 18:58:48.988106 ip-10-0-139-134 kubenswrapper[2578]: I0709 18:58:48.988026    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-8gqbs" event={"ID":"7a15b7a9-7525-426b-a051-3ece178b71bc","Type":"ContainerStarted","Data":"6c4c409ebfd80da346cd53a6e1aea13300a5fe0b63f5d26548bad2f3d8407080"}
Jul 09 18:58:48.990121 ip-10-0-139-134 kubenswrapper[2578]: I0709 18:58:48.990093    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fghgd" event={"ID":"31909fe7-f400-486f-8437-87c8674edc61","Type":"ContainerStarted","Data":"7b9f28f5bb91fb0d36fedc2286c2518eb4dc159111b76435cba18e176f73c8f6"}
Jul 09 18:58:49.011924 ip-10-0-139-134 kubenswrapper[2578]: I0709 18:58:49.011866    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fghgd" podStartSLOduration=4.9203986010000005 podStartE2EDuration="26.011846276s" totalImagesPullingTime="21.091447675s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-09 18:58:23 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 18:58:49.011059381 +0000 UTC m=+25.637110755" watchObservedRunningTime="2026-07-09 18:58:49.011846276 +0000 UTC m=+25.637897605"
Jul 09 18:58:49.832444 ip-10-0-139-134 kubenswrapper[2578]: I0709 18:58:49.832407    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-9n6nc"
Jul 09 18:58:49.832633 ip-10-0-139-134 kubenswrapper[2578]: I0709 18:58:49.832409    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-dztbt"
Jul 09 18:58:49.832633 ip-10-0-139-134 kubenswrapper[2578]: E0709 18:58:49.832546    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-9n6nc" podUID="2d052a65-da3a-4426-a441-83b9cc44217b"
Jul 09 18:58:49.832633 ip-10-0-139-134 kubenswrapper[2578]: E0709 18:58:49.832577    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-dztbt" podUID="a6f6e738-06b0-41d1-bcc4-3627871fe3d6"
Jul 09 18:58:49.832633 ip-10-0-139-134 kubenswrapper[2578]: I0709 18:58:49.832418    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-kmr4m"
Jul 09 18:58:49.832847 ip-10-0-139-134 kubenswrapper[2578]: E0709 18:58:49.832656    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-kmr4m" podUID="4e35097c-426a-4343-aa9d-befa17cabda5"
Jul 09 18:58:50.997588 ip-10-0-139-134 kubenswrapper[2578]: I0709 18:58:50.997559    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-8gqbs_7a15b7a9-7525-426b-a051-3ece178b71bc/ovn-acl-logging/0.log"
Jul 09 18:58:50.998494 ip-10-0-139-134 kubenswrapper[2578]: I0709 18:58:50.997947    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-8gqbs" event={"ID":"7a15b7a9-7525-426b-a051-3ece178b71bc","Type":"ContainerStarted","Data":"d5065127e59a08d029fe332df3731c3ca0e6df8778ee4cabdfbc55c069f34b52"}
Jul 09 18:58:50.998494 ip-10-0-139-134 kubenswrapper[2578]: I0709 18:58:50.998340    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-8gqbs"
Jul 09 18:58:50.998494 ip-10-0-139-134 kubenswrapper[2578]: I0709 18:58:50.998458    2578 scope.go:117] "RemoveContainer" containerID="a84bda7c3e9b51203539310efeb175d8f1b21bab98c880211fedb1e0c0f8653a"
Jul 09 18:58:51.000040 ip-10-0-139-134 kubenswrapper[2578]: I0709 18:58:51.000017    2578 generic.go:356] "Generic (PLEG): container finished" podID="d83b5188-15a8-4450-803c-62524a249f65" containerID="945db577d00aff4f047e9f9b08ba451f44b27d79560f1dd6191bfbc1967df4a0" exitCode=0
Jul 09 18:58:51.000135 ip-10-0-139-134 kubenswrapper[2578]: I0709 18:58:51.000062    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-cs7mq" event={"ID":"d83b5188-15a8-4450-803c-62524a249f65","Type":"ContainerDied","Data":"945db577d00aff4f047e9f9b08ba451f44b27d79560f1dd6191bfbc1967df4a0"}
Jul 09 18:58:51.015488 ip-10-0-139-134 kubenswrapper[2578]: I0709 18:58:51.015459    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-8gqbs"
Jul 09 18:58:51.832849 ip-10-0-139-134 kubenswrapper[2578]: I0709 18:58:51.832576    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-kmr4m"
Jul 09 18:58:51.833115 ip-10-0-139-134 kubenswrapper[2578]: I0709 18:58:51.832576    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-dztbt"
Jul 09 18:58:51.836227 ip-10-0-139-134 kubenswrapper[2578]: I0709 18:58:51.832576    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-9n6nc"
Jul 09 18:58:51.836227 ip-10-0-139-134 kubenswrapper[2578]: E0709 18:58:51.833236    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-kmr4m" podUID="4e35097c-426a-4343-aa9d-befa17cabda5"
Jul 09 18:58:51.836227 ip-10-0-139-134 kubenswrapper[2578]: E0709 18:58:51.833372    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-dztbt" podUID="a6f6e738-06b0-41d1-bcc4-3627871fe3d6"
Jul 09 18:58:51.836227 ip-10-0-139-134 kubenswrapper[2578]: E0709 18:58:51.833520    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-9n6nc" podUID="2d052a65-da3a-4426-a441-83b9cc44217b"
Jul 09 18:58:52.006741 ip-10-0-139-134 kubenswrapper[2578]: I0709 18:58:52.006711    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-8gqbs_7a15b7a9-7525-426b-a051-3ece178b71bc/ovn-acl-logging/0.log"
Jul 09 18:58:52.007193 ip-10-0-139-134 kubenswrapper[2578]: I0709 18:58:52.007053    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-8gqbs" event={"ID":"7a15b7a9-7525-426b-a051-3ece178b71bc","Type":"ContainerStarted","Data":"53393894cc787a236770f18478104d16fc34fde2ed7be5eb3fe7eebacab913b9"}
Jul 09 18:58:52.007193 ip-10-0-139-134 kubenswrapper[2578]: I0709 18:58:52.007162    2578 prober_manager.go:312] "Failed to trigger a manual run" probe="Readiness"
Jul 09 18:58:52.007387 ip-10-0-139-134 kubenswrapper[2578]: I0709 18:58:52.007367    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-8gqbs"
Jul 09 18:58:52.023850 ip-10-0-139-134 kubenswrapper[2578]: I0709 18:58:52.023817    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-8gqbs"
Jul 09 18:58:52.044941 ip-10-0-139-134 kubenswrapper[2578]: I0709 18:58:52.044884    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-8gqbs" podStartSLOduration=9.170956421 podStartE2EDuration="28.044870609s" totalImagesPullingTime="18.873914188s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-09 18:58:24 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 18:58:52.044334093 +0000 UTC m=+28.670385441" watchObservedRunningTime="2026-07-09 18:58:52.044870609 +0000 UTC m=+28.670921938"
Jul 09 18:58:52.822298 ip-10-0-139-134 kubenswrapper[2578]: I0709 18:58:52.822266    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-kmr4m"]
Jul 09 18:58:52.822489 ip-10-0-139-134 kubenswrapper[2578]: I0709 18:58:52.822381    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-kmr4m"
Jul 09 18:58:52.822489 ip-10-0-139-134 kubenswrapper[2578]: E0709 18:58:52.822461    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-kmr4m" podUID="4e35097c-426a-4343-aa9d-befa17cabda5"
Jul 09 18:58:52.825322 ip-10-0-139-134 kubenswrapper[2578]: I0709 18:58:52.825273    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-dztbt"]
Jul 09 18:58:52.825463 ip-10-0-139-134 kubenswrapper[2578]: I0709 18:58:52.825400    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-dztbt"
Jul 09 18:58:52.825523 ip-10-0-139-134 kubenswrapper[2578]: E0709 18:58:52.825495    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-dztbt" podUID="a6f6e738-06b0-41d1-bcc4-3627871fe3d6"
Jul 09 18:58:52.825885 ip-10-0-139-134 kubenswrapper[2578]: I0709 18:58:52.825853    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-9n6nc"]
Jul 09 18:58:52.825978 ip-10-0-139-134 kubenswrapper[2578]: I0709 18:58:52.825952    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-9n6nc"
Jul 09 18:58:52.826107 ip-10-0-139-134 kubenswrapper[2578]: E0709 18:58:52.826089    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-9n6nc" podUID="2d052a65-da3a-4426-a441-83b9cc44217b"
Jul 09 18:58:53.010931 ip-10-0-139-134 kubenswrapper[2578]: I0709 18:58:53.010899    2578 generic.go:356] "Generic (PLEG): container finished" podID="d83b5188-15a8-4450-803c-62524a249f65" containerID="0fd1f2417af27892d5ce824ab2769fa79f1b8438cb2b24d3ed7afe7e976e5d6f" exitCode=0
Jul 09 18:58:53.011413 ip-10-0-139-134 kubenswrapper[2578]: I0709 18:58:53.010987    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-cs7mq" event={"ID":"d83b5188-15a8-4450-803c-62524a249f65","Type":"ContainerDied","Data":"0fd1f2417af27892d5ce824ab2769fa79f1b8438cb2b24d3ed7afe7e976e5d6f"}
Jul 09 18:58:53.011413 ip-10-0-139-134 kubenswrapper[2578]: I0709 18:58:53.011045    2578 prober_manager.go:312] "Failed to trigger a manual run" probe="Readiness"
Jul 09 18:58:53.498400 ip-10-0-139-134 kubenswrapper[2578]: I0709 18:58:53.498357    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-8gqbs"
Jul 09 18:58:54.833229 ip-10-0-139-134 kubenswrapper[2578]: I0709 18:58:54.832968    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-dztbt"
Jul 09 18:58:54.833596 ip-10-0-139-134 kubenswrapper[2578]: I0709 18:58:54.832974    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-kmr4m"
Jul 09 18:58:54.833596 ip-10-0-139-134 kubenswrapper[2578]: E0709 18:58:54.833260    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-dztbt" podUID="a6f6e738-06b0-41d1-bcc4-3627871fe3d6"
Jul 09 18:58:54.833596 ip-10-0-139-134 kubenswrapper[2578]: I0709 18:58:54.833044    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-9n6nc"
Jul 09 18:58:54.833596 ip-10-0-139-134 kubenswrapper[2578]: E0709 18:58:54.833391    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-9n6nc" podUID="2d052a65-da3a-4426-a441-83b9cc44217b"
Jul 09 18:58:54.833596 ip-10-0-139-134 kubenswrapper[2578]: E0709 18:58:54.833327    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-kmr4m" podUID="4e35097c-426a-4343-aa9d-befa17cabda5"
Jul 09 18:58:55.018296 ip-10-0-139-134 kubenswrapper[2578]: I0709 18:58:55.018253    2578 generic.go:356] "Generic (PLEG): container finished" podID="d83b5188-15a8-4450-803c-62524a249f65" containerID="ac4c37aa0c418c0e44e9ab73060cfbf0619e29abfd369c0aa67de3469fde1d61" exitCode=0
Jul 09 18:58:55.018481 ip-10-0-139-134 kubenswrapper[2578]: I0709 18:58:55.018342    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-cs7mq" event={"ID":"d83b5188-15a8-4450-803c-62524a249f65","Type":"ContainerDied","Data":"ac4c37aa0c418c0e44e9ab73060cfbf0619e29abfd369c0aa67de3469fde1d61"}
Jul 09 18:58:55.039436 ip-10-0-139-134 kubenswrapper[2578]: I0709 18:58:55.039392    2578 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ovn-kubernetes/ovnkube-node-8gqbs" podUID="7a15b7a9-7525-426b-a051-3ece178b71bc" containerName="ovnkube-controller" probeResult="failure" output=""
Jul 09 18:58:56.832871 ip-10-0-139-134 kubenswrapper[2578]: I0709 18:58:56.832839    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-9n6nc"
Jul 09 18:58:56.832871 ip-10-0-139-134 kubenswrapper[2578]: I0709 18:58:56.832855    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-kmr4m"
Jul 09 18:58:56.833537 ip-10-0-139-134 kubenswrapper[2578]: I0709 18:58:56.832855    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-dztbt"
Jul 09 18:58:56.833537 ip-10-0-139-134 kubenswrapper[2578]: E0709 18:58:56.832942    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-9n6nc" podUID="2d052a65-da3a-4426-a441-83b9cc44217b"
Jul 09 18:58:56.833537 ip-10-0-139-134 kubenswrapper[2578]: E0709 18:58:56.833057    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-kmr4m" podUID="4e35097c-426a-4343-aa9d-befa17cabda5"
Jul 09 18:58:56.833537 ip-10-0-139-134 kubenswrapper[2578]: E0709 18:58:56.833175    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-dztbt" podUID="a6f6e738-06b0-41d1-bcc4-3627871fe3d6"
Jul 09 18:58:57.623932 ip-10-0-139-134 kubenswrapper[2578]: I0709 18:58:57.623874    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/4e35097c-426a-4343-aa9d-befa17cabda5-original-pull-secret\") pod \"global-pull-secret-syncer-kmr4m\" (UID: \"4e35097c-426a-4343-aa9d-befa17cabda5\") " pod="kube-system/global-pull-secret-syncer-kmr4m"
Jul 09 18:58:57.624133 ip-10-0-139-134 kubenswrapper[2578]: I0709 18:58:57.623944    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a6f6e738-06b0-41d1-bcc4-3627871fe3d6-metrics-certs\") pod \"network-metrics-daemon-dztbt\" (UID: \"a6f6e738-06b0-41d1-bcc4-3627871fe3d6\") " pod="openshift-multus/network-metrics-daemon-dztbt"
Jul 09 18:58:57.624133 ip-10-0-139-134 kubenswrapper[2578]: E0709 18:58:57.624080    2578 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 09 18:58:57.624232 ip-10-0-139-134 kubenswrapper[2578]: E0709 18:58:57.624152    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4e35097c-426a-4343-aa9d-befa17cabda5-original-pull-secret podName:4e35097c-426a-4343-aa9d-befa17cabda5 nodeName:}" failed. No retries permitted until 2026-07-09 18:59:29.624134618 +0000 UTC m=+66.250185926 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/4e35097c-426a-4343-aa9d-befa17cabda5-original-pull-secret") pod "global-pull-secret-syncer-kmr4m" (UID: "4e35097c-426a-4343-aa9d-befa17cabda5") : object "kube-system"/"original-pull-secret" not registered
Jul 09 18:58:57.624232 ip-10-0-139-134 kubenswrapper[2578]: E0709 18:58:57.624084    2578 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 09 18:58:57.624346 ip-10-0-139-134 kubenswrapper[2578]: E0709 18:58:57.624247    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a6f6e738-06b0-41d1-bcc4-3627871fe3d6-metrics-certs podName:a6f6e738-06b0-41d1-bcc4-3627871fe3d6 nodeName:}" failed. No retries permitted until 2026-07-09 18:59:29.624228594 +0000 UTC m=+66.250279908 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/a6f6e738-06b0-41d1-bcc4-3627871fe3d6-metrics-certs") pod "network-metrics-daemon-dztbt" (UID: "a6f6e738-06b0-41d1-bcc4-3627871fe3d6") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 09 18:58:57.724523 ip-10-0-139-134 kubenswrapper[2578]: I0709 18:58:57.724482    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xfhcf\" (UniqueName: \"kubernetes.io/projected/2d052a65-da3a-4426-a441-83b9cc44217b-kube-api-access-xfhcf\") pod \"network-check-target-9n6nc\" (UID: \"2d052a65-da3a-4426-a441-83b9cc44217b\") " pod="openshift-network-diagnostics/network-check-target-9n6nc"
Jul 09 18:58:57.724697 ip-10-0-139-134 kubenswrapper[2578]: E0709 18:58:57.724628    2578 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 09 18:58:57.724697 ip-10-0-139-134 kubenswrapper[2578]: E0709 18:58:57.724644    2578 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 09 18:58:57.724697 ip-10-0-139-134 kubenswrapper[2578]: E0709 18:58:57.724656    2578 projected.go:196] Error preparing data for projected volume kube-api-access-xfhcf for pod openshift-network-diagnostics/network-check-target-9n6nc: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 09 18:58:57.724842 ip-10-0-139-134 kubenswrapper[2578]: E0709 18:58:57.724715    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/2d052a65-da3a-4426-a441-83b9cc44217b-kube-api-access-xfhcf podName:2d052a65-da3a-4426-a441-83b9cc44217b nodeName:}" failed. No retries permitted until 2026-07-09 18:59:29.724700845 +0000 UTC m=+66.350752156 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-xfhcf" (UniqueName: "kubernetes.io/projected/2d052a65-da3a-4426-a441-83b9cc44217b-kube-api-access-xfhcf") pod "network-check-target-9n6nc" (UID: "2d052a65-da3a-4426-a441-83b9cc44217b") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 09 18:58:58.832879 ip-10-0-139-134 kubenswrapper[2578]: I0709 18:58:58.832845    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-9n6nc"
Jul 09 18:58:58.833462 ip-10-0-139-134 kubenswrapper[2578]: I0709 18:58:58.832963    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-dztbt"
Jul 09 18:58:58.833462 ip-10-0-139-134 kubenswrapper[2578]: E0709 18:58:58.832972    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-9n6nc" podUID="2d052a65-da3a-4426-a441-83b9cc44217b"
Jul 09 18:58:58.833462 ip-10-0-139-134 kubenswrapper[2578]: I0709 18:58:58.833032    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-kmr4m"
Jul 09 18:58:58.833462 ip-10-0-139-134 kubenswrapper[2578]: E0709 18:58:58.833136    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-dztbt" podUID="a6f6e738-06b0-41d1-bcc4-3627871fe3d6"
Jul 09 18:58:58.833462 ip-10-0-139-134 kubenswrapper[2578]: E0709 18:58:58.833216    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-kmr4m" podUID="4e35097c-426a-4343-aa9d-befa17cabda5"
Jul 09 18:58:59.663134 ip-10-0-139-134 kubenswrapper[2578]: I0709 18:58:59.663060    2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-134.ec2.internal" event="NodeReady"
Jul 09 18:58:59.663267 ip-10-0-139-134 kubenswrapper[2578]: I0709 18:58:59.663252    2578 kubelet_node_status.go:489] "Fast updating node status as it just became ready"
Jul 09 18:58:59.703872 ip-10-0-139-134 kubenswrapper[2578]: I0709 18:58:59.703835    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-pv4p5"]
Jul 09 18:58:59.705893 ip-10-0-139-134 kubenswrapper[2578]: I0709 18:58:59.705856    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-pv4p5"
Jul 09 18:58:59.706898 ip-10-0-139-134 kubenswrapper[2578]: I0709 18:58:59.706872    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-xc6m9"]
Jul 09 18:58:59.708642 ip-10-0-139-134 kubenswrapper[2578]: I0709 18:58:59.708610    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-xc6m9"
Jul 09 18:58:59.708804 ip-10-0-139-134 kubenswrapper[2578]: I0709 18:58:59.708786    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\""
Jul 09 18:58:59.708845 ip-10-0-139-134 kubenswrapper[2578]: I0709 18:58:59.708818    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-bw6lk\""
Jul 09 18:58:59.708885 ip-10-0-139-134 kubenswrapper[2578]: I0709 18:58:59.708613    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\""
Jul 09 18:58:59.711417 ip-10-0-139-134 kubenswrapper[2578]: I0709 18:58:59.711396    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\""
Jul 09 18:58:59.711517 ip-10-0-139-134 kubenswrapper[2578]: I0709 18:58:59.711399    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-65b7z\""
Jul 09 18:58:59.711517 ip-10-0-139-134 kubenswrapper[2578]: I0709 18:58:59.711485    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\""
Jul 09 18:58:59.711819 ip-10-0-139-134 kubenswrapper[2578]: I0709 18:58:59.711801    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\""
Jul 09 18:58:59.716125 ip-10-0-139-134 kubenswrapper[2578]: I0709 18:58:59.716105    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-pv4p5"]
Jul 09 18:58:59.720032 ip-10-0-139-134 kubenswrapper[2578]: I0709 18:58:59.719980    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-xc6m9"]
Jul 09 18:58:59.840205 ip-10-0-139-134 kubenswrapper[2578]: I0709 18:58:59.840176    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kg4p8\" (UniqueName: \"kubernetes.io/projected/c2465fe4-d9fa-4246-b5e6-399f6dbe9259-kube-api-access-kg4p8\") pod \"dns-default-pv4p5\" (UID: \"c2465fe4-d9fa-4246-b5e6-399f6dbe9259\") " pod="openshift-dns/dns-default-pv4p5"
Jul 09 18:58:59.840205 ip-10-0-139-134 kubenswrapper[2578]: I0709 18:58:59.840210    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/c2465fe4-d9fa-4246-b5e6-399f6dbe9259-config-volume\") pod \"dns-default-pv4p5\" (UID: \"c2465fe4-d9fa-4246-b5e6-399f6dbe9259\") " pod="openshift-dns/dns-default-pv4p5"
Jul 09 18:58:59.840728 ip-10-0-139-134 kubenswrapper[2578]: I0709 18:58:59.840239    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-s55vs\" (UniqueName: \"kubernetes.io/projected/f55f09d8-7f36-4939-bb1c-bb4195e64a93-kube-api-access-s55vs\") pod \"ingress-canary-xc6m9\" (UID: \"f55f09d8-7f36-4939-bb1c-bb4195e64a93\") " pod="openshift-ingress-canary/ingress-canary-xc6m9"
Jul 09 18:58:59.840728 ip-10-0-139-134 kubenswrapper[2578]: I0709 18:58:59.840262    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/c2465fe4-d9fa-4246-b5e6-399f6dbe9259-metrics-tls\") pod \"dns-default-pv4p5\" (UID: \"c2465fe4-d9fa-4246-b5e6-399f6dbe9259\") " pod="openshift-dns/dns-default-pv4p5"
Jul 09 18:58:59.840728 ip-10-0-139-134 kubenswrapper[2578]: I0709 18:58:59.840314    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/f55f09d8-7f36-4939-bb1c-bb4195e64a93-cert\") pod \"ingress-canary-xc6m9\" (UID: \"f55f09d8-7f36-4939-bb1c-bb4195e64a93\") " pod="openshift-ingress-canary/ingress-canary-xc6m9"
Jul 09 18:58:59.840728 ip-10-0-139-134 kubenswrapper[2578]: I0709 18:58:59.840327    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c2465fe4-d9fa-4246-b5e6-399f6dbe9259-tmp-dir\") pod \"dns-default-pv4p5\" (UID: \"c2465fe4-d9fa-4246-b5e6-399f6dbe9259\") " pod="openshift-dns/dns-default-pv4p5"
Jul 09 18:58:59.941586 ip-10-0-139-134 kubenswrapper[2578]: I0709 18:58:59.941510    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/f55f09d8-7f36-4939-bb1c-bb4195e64a93-cert\") pod \"ingress-canary-xc6m9\" (UID: \"f55f09d8-7f36-4939-bb1c-bb4195e64a93\") " pod="openshift-ingress-canary/ingress-canary-xc6m9"
Jul 09 18:58:59.941586 ip-10-0-139-134 kubenswrapper[2578]: I0709 18:58:59.941539    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c2465fe4-d9fa-4246-b5e6-399f6dbe9259-tmp-dir\") pod \"dns-default-pv4p5\" (UID: \"c2465fe4-d9fa-4246-b5e6-399f6dbe9259\") " pod="openshift-dns/dns-default-pv4p5"
Jul 09 18:58:59.941586 ip-10-0-139-134 kubenswrapper[2578]: I0709 18:58:59.941567    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kg4p8\" (UniqueName: \"kubernetes.io/projected/c2465fe4-d9fa-4246-b5e6-399f6dbe9259-kube-api-access-kg4p8\") pod \"dns-default-pv4p5\" (UID: \"c2465fe4-d9fa-4246-b5e6-399f6dbe9259\") " pod="openshift-dns/dns-default-pv4p5"
Jul 09 18:58:59.941805 ip-10-0-139-134 kubenswrapper[2578]: I0709 18:58:59.941690    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/c2465fe4-d9fa-4246-b5e6-399f6dbe9259-config-volume\") pod \"dns-default-pv4p5\" (UID: \"c2465fe4-d9fa-4246-b5e6-399f6dbe9259\") " pod="openshift-dns/dns-default-pv4p5"
Jul 09 18:58:59.941805 ip-10-0-139-134 kubenswrapper[2578]: I0709 18:58:59.941737    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-s55vs\" (UniqueName: \"kubernetes.io/projected/f55f09d8-7f36-4939-bb1c-bb4195e64a93-kube-api-access-s55vs\") pod \"ingress-canary-xc6m9\" (UID: \"f55f09d8-7f36-4939-bb1c-bb4195e64a93\") " pod="openshift-ingress-canary/ingress-canary-xc6m9"
Jul 09 18:58:59.941805 ip-10-0-139-134 kubenswrapper[2578]: I0709 18:58:59.941784    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/c2465fe4-d9fa-4246-b5e6-399f6dbe9259-metrics-tls\") pod \"dns-default-pv4p5\" (UID: \"c2465fe4-d9fa-4246-b5e6-399f6dbe9259\") " pod="openshift-dns/dns-default-pv4p5"
Jul 09 18:58:59.941933 ip-10-0-139-134 kubenswrapper[2578]: E0709 18:58:59.941885    2578 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 09 18:58:59.941933 ip-10-0-139-134 kubenswrapper[2578]: I0709 18:58:59.941920    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c2465fe4-d9fa-4246-b5e6-399f6dbe9259-tmp-dir\") pod \"dns-default-pv4p5\" (UID: \"c2465fe4-d9fa-4246-b5e6-399f6dbe9259\") " pod="openshift-dns/dns-default-pv4p5"
Jul 09 18:58:59.942040 ip-10-0-139-134 kubenswrapper[2578]: E0709 18:58:59.941942    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c2465fe4-d9fa-4246-b5e6-399f6dbe9259-metrics-tls podName:c2465fe4-d9fa-4246-b5e6-399f6dbe9259 nodeName:}" failed. No retries permitted until 2026-07-09 18:59:00.44192365 +0000 UTC m=+37.067974962 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/c2465fe4-d9fa-4246-b5e6-399f6dbe9259-metrics-tls") pod "dns-default-pv4p5" (UID: "c2465fe4-d9fa-4246-b5e6-399f6dbe9259") : secret "dns-default-metrics-tls" not found
Jul 09 18:58:59.942306 ip-10-0-139-134 kubenswrapper[2578]: I0709 18:58:59.942288    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/c2465fe4-d9fa-4246-b5e6-399f6dbe9259-config-volume\") pod \"dns-default-pv4p5\" (UID: \"c2465fe4-d9fa-4246-b5e6-399f6dbe9259\") " pod="openshift-dns/dns-default-pv4p5"
Jul 09 18:58:59.946085 ip-10-0-139-134 kubenswrapper[2578]: I0709 18:58:59.946063    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/f55f09d8-7f36-4939-bb1c-bb4195e64a93-cert\") pod \"ingress-canary-xc6m9\" (UID: \"f55f09d8-7f36-4939-bb1c-bb4195e64a93\") " pod="openshift-ingress-canary/ingress-canary-xc6m9"
Jul 09 18:58:59.950468 ip-10-0-139-134 kubenswrapper[2578]: I0709 18:58:59.950449    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kg4p8\" (UniqueName: \"kubernetes.io/projected/c2465fe4-d9fa-4246-b5e6-399f6dbe9259-kube-api-access-kg4p8\") pod \"dns-default-pv4p5\" (UID: \"c2465fe4-d9fa-4246-b5e6-399f6dbe9259\") " pod="openshift-dns/dns-default-pv4p5"
Jul 09 18:58:59.950586 ip-10-0-139-134 kubenswrapper[2578]: I0709 18:58:59.950570    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-s55vs\" (UniqueName: \"kubernetes.io/projected/f55f09d8-7f36-4939-bb1c-bb4195e64a93-kube-api-access-s55vs\") pod \"ingress-canary-xc6m9\" (UID: \"f55f09d8-7f36-4939-bb1c-bb4195e64a93\") " pod="openshift-ingress-canary/ingress-canary-xc6m9"
Jul 09 18:59:00.022687 ip-10-0-139-134 kubenswrapper[2578]: I0709 18:59:00.022650    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-xc6m9"
Jul 09 18:59:00.032415 ip-10-0-139-134 kubenswrapper[2578]: I0709 18:59:00.032387    2578 generic.go:356] "Generic (PLEG): container finished" podID="d83b5188-15a8-4450-803c-62524a249f65" containerID="807d54a73823381678073143dfad355abb60096612feadf75446d5b2ae912c5b" exitCode=0
Jul 09 18:59:00.032549 ip-10-0-139-134 kubenswrapper[2578]: I0709 18:59:00.032442    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-cs7mq" event={"ID":"d83b5188-15a8-4450-803c-62524a249f65","Type":"ContainerDied","Data":"807d54a73823381678073143dfad355abb60096612feadf75446d5b2ae912c5b"}
Jul 09 18:59:00.167083 ip-10-0-139-134 kubenswrapper[2578]: I0709 18:59:00.166887    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-xc6m9"]
Jul 09 18:59:00.201913 ip-10-0-139-134 kubenswrapper[2578]: W0709 18:59:00.201803    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf55f09d8_7f36_4939_bb1c_bb4195e64a93.slice/crio-542381bf6c23f026dd7cca8ebd23b37846e346e88f0edb866c9debf50e47f069 WatchSource:0}: Error finding container 542381bf6c23f026dd7cca8ebd23b37846e346e88f0edb866c9debf50e47f069: Status 404 returned error can't find the container with id 542381bf6c23f026dd7cca8ebd23b37846e346e88f0edb866c9debf50e47f069
Jul 09 18:59:00.446166 ip-10-0-139-134 kubenswrapper[2578]: I0709 18:59:00.446125    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/c2465fe4-d9fa-4246-b5e6-399f6dbe9259-metrics-tls\") pod \"dns-default-pv4p5\" (UID: \"c2465fe4-d9fa-4246-b5e6-399f6dbe9259\") " pod="openshift-dns/dns-default-pv4p5"
Jul 09 18:59:00.446332 ip-10-0-139-134 kubenswrapper[2578]: E0709 18:59:00.446282    2578 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 09 18:59:00.446380 ip-10-0-139-134 kubenswrapper[2578]: E0709 18:59:00.446351    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c2465fe4-d9fa-4246-b5e6-399f6dbe9259-metrics-tls podName:c2465fe4-d9fa-4246-b5e6-399f6dbe9259 nodeName:}" failed. No retries permitted until 2026-07-09 18:59:01.446331234 +0000 UTC m=+38.072382550 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/c2465fe4-d9fa-4246-b5e6-399f6dbe9259-metrics-tls") pod "dns-default-pv4p5" (UID: "c2465fe4-d9fa-4246-b5e6-399f6dbe9259") : secret "dns-default-metrics-tls" not found
Jul 09 18:59:00.832769 ip-10-0-139-134 kubenswrapper[2578]: I0709 18:59:00.832732    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-9n6nc"
Jul 09 18:59:00.832964 ip-10-0-139-134 kubenswrapper[2578]: I0709 18:59:00.832784    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-dztbt"
Jul 09 18:59:00.832964 ip-10-0-139-134 kubenswrapper[2578]: I0709 18:59:00.832898    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-kmr4m"
Jul 09 18:59:00.836113 ip-10-0-139-134 kubenswrapper[2578]: I0709 18:59:00.836090    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Jul 09 18:59:00.837542 ip-10-0-139-134 kubenswrapper[2578]: I0709 18:59:00.837519    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Jul 09 18:59:00.837658 ip-10-0-139-134 kubenswrapper[2578]: I0709 18:59:00.837592    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-rzlbw\""
Jul 09 18:59:00.837736 ip-10-0-139-134 kubenswrapper[2578]: I0709 18:59:00.837525    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Jul 09 18:59:00.837736 ip-10-0-139-134 kubenswrapper[2578]: I0709 18:59:00.837524    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Jul 09 18:59:00.837821 ip-10-0-139-134 kubenswrapper[2578]: I0709 18:59:00.837526    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-s4jjw\""
Jul 09 18:59:01.037316 ip-10-0-139-134 kubenswrapper[2578]: I0709 18:59:01.037281    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-xc6m9" event={"ID":"f55f09d8-7f36-4939-bb1c-bb4195e64a93","Type":"ContainerStarted","Data":"542381bf6c23f026dd7cca8ebd23b37846e346e88f0edb866c9debf50e47f069"}
Jul 09 18:59:01.040880 ip-10-0-139-134 kubenswrapper[2578]: I0709 18:59:01.040852    2578 generic.go:356] "Generic (PLEG): container finished" podID="d83b5188-15a8-4450-803c-62524a249f65" containerID="4eba07a4d1779cd5ea38e61e9428f890c328e598d14b43fea4c7e70c51a4d451" exitCode=0
Jul 09 18:59:01.041047 ip-10-0-139-134 kubenswrapper[2578]: I0709 18:59:01.040895    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-cs7mq" event={"ID":"d83b5188-15a8-4450-803c-62524a249f65","Type":"ContainerDied","Data":"4eba07a4d1779cd5ea38e61e9428f890c328e598d14b43fea4c7e70c51a4d451"}
Jul 09 18:59:01.454860 ip-10-0-139-134 kubenswrapper[2578]: I0709 18:59:01.454820    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/c2465fe4-d9fa-4246-b5e6-399f6dbe9259-metrics-tls\") pod \"dns-default-pv4p5\" (UID: \"c2465fe4-d9fa-4246-b5e6-399f6dbe9259\") " pod="openshift-dns/dns-default-pv4p5"
Jul 09 18:59:01.455037 ip-10-0-139-134 kubenswrapper[2578]: E0709 18:59:01.454961    2578 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 09 18:59:01.455098 ip-10-0-139-134 kubenswrapper[2578]: E0709 18:59:01.455055    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c2465fe4-d9fa-4246-b5e6-399f6dbe9259-metrics-tls podName:c2465fe4-d9fa-4246-b5e6-399f6dbe9259 nodeName:}" failed. No retries permitted until 2026-07-09 18:59:03.455036587 +0000 UTC m=+40.081087914 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/c2465fe4-d9fa-4246-b5e6-399f6dbe9259-metrics-tls") pod "dns-default-pv4p5" (UID: "c2465fe4-d9fa-4246-b5e6-399f6dbe9259") : secret "dns-default-metrics-tls" not found
Jul 09 18:59:02.048149 ip-10-0-139-134 kubenswrapper[2578]: I0709 18:59:02.048109    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-cs7mq" event={"ID":"d83b5188-15a8-4450-803c-62524a249f65","Type":"ContainerStarted","Data":"1c2e7ff7da6a84d339da14bd8044422a3fb05b9b0801806f2fe48132f451a29a"}
Jul 09 18:59:02.086524 ip-10-0-139-134 kubenswrapper[2578]: I0709 18:59:02.086461    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-cs7mq" podStartSLOduration=8.805524204 podStartE2EDuration="39.086440201s" totalImagesPullingTime="30.280915997s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-09 18:58:23 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 18:59:02.084170603 +0000 UTC m=+38.710221956" watchObservedRunningTime="2026-07-09 18:59:02.086440201 +0000 UTC m=+38.712491556"
Jul 09 18:59:03.052059 ip-10-0-139-134 kubenswrapper[2578]: I0709 18:59:03.052016    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-xc6m9" event={"ID":"f55f09d8-7f36-4939-bb1c-bb4195e64a93","Type":"ContainerStarted","Data":"cc6498ea568ab7c51de683627ca63b9ac3e67edc447dd5f5150f194b8000a402"}
Jul 09 18:59:03.069578 ip-10-0-139-134 kubenswrapper[2578]: I0709 18:59:03.069528    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-xc6m9" podStartSLOduration=1.8815500809999999 podStartE2EDuration="4.069514352s" totalImagesPullingTime="2.187964271s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 18:58:59 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 18:59:03.068595709 +0000 UTC m=+39.694647040" watchObservedRunningTime="2026-07-09 18:59:03.069514352 +0000 UTC m=+39.695565681"
Jul 09 18:59:03.469693 ip-10-0-139-134 kubenswrapper[2578]: I0709 18:59:03.469654    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/c2465fe4-d9fa-4246-b5e6-399f6dbe9259-metrics-tls\") pod \"dns-default-pv4p5\" (UID: \"c2465fe4-d9fa-4246-b5e6-399f6dbe9259\") " pod="openshift-dns/dns-default-pv4p5"
Jul 09 18:59:03.469852 ip-10-0-139-134 kubenswrapper[2578]: E0709 18:59:03.469803    2578 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 09 18:59:03.469892 ip-10-0-139-134 kubenswrapper[2578]: E0709 18:59:03.469871    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c2465fe4-d9fa-4246-b5e6-399f6dbe9259-metrics-tls podName:c2465fe4-d9fa-4246-b5e6-399f6dbe9259 nodeName:}" failed. No retries permitted until 2026-07-09 18:59:07.469855806 +0000 UTC m=+44.095907114 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/c2465fe4-d9fa-4246-b5e6-399f6dbe9259-metrics-tls") pod "dns-default-pv4p5" (UID: "c2465fe4-d9fa-4246-b5e6-399f6dbe9259") : secret "dns-default-metrics-tls" not found
Jul 09 18:59:07.497163 ip-10-0-139-134 kubenswrapper[2578]: I0709 18:59:07.497111    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/c2465fe4-d9fa-4246-b5e6-399f6dbe9259-metrics-tls\") pod \"dns-default-pv4p5\" (UID: \"c2465fe4-d9fa-4246-b5e6-399f6dbe9259\") " pod="openshift-dns/dns-default-pv4p5"
Jul 09 18:59:07.497565 ip-10-0-139-134 kubenswrapper[2578]: E0709 18:59:07.497267    2578 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 09 18:59:07.497565 ip-10-0-139-134 kubenswrapper[2578]: E0709 18:59:07.497330    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c2465fe4-d9fa-4246-b5e6-399f6dbe9259-metrics-tls podName:c2465fe4-d9fa-4246-b5e6-399f6dbe9259 nodeName:}" failed. No retries permitted until 2026-07-09 18:59:15.497312993 +0000 UTC m=+52.123364301 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/c2465fe4-d9fa-4246-b5e6-399f6dbe9259-metrics-tls") pod "dns-default-pv4p5" (UID: "c2465fe4-d9fa-4246-b5e6-399f6dbe9259") : secret "dns-default-metrics-tls" not found
Jul 09 18:59:15.555560 ip-10-0-139-134 kubenswrapper[2578]: I0709 18:59:15.555517    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/c2465fe4-d9fa-4246-b5e6-399f6dbe9259-metrics-tls\") pod \"dns-default-pv4p5\" (UID: \"c2465fe4-d9fa-4246-b5e6-399f6dbe9259\") " pod="openshift-dns/dns-default-pv4p5"
Jul 09 18:59:15.556168 ip-10-0-139-134 kubenswrapper[2578]: E0709 18:59:15.555695    2578 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 09 18:59:15.556168 ip-10-0-139-134 kubenswrapper[2578]: E0709 18:59:15.555778    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c2465fe4-d9fa-4246-b5e6-399f6dbe9259-metrics-tls podName:c2465fe4-d9fa-4246-b5e6-399f6dbe9259 nodeName:}" failed. No retries permitted until 2026-07-09 18:59:31.555755947 +0000 UTC m=+68.181807258 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/c2465fe4-d9fa-4246-b5e6-399f6dbe9259-metrics-tls") pod "dns-default-pv4p5" (UID: "c2465fe4-d9fa-4246-b5e6-399f6dbe9259") : secret "dns-default-metrics-tls" not found
Jul 09 18:59:25.028499 ip-10-0-139-134 kubenswrapper[2578]: I0709 18:59:25.028469    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-8gqbs"
Jul 09 18:59:29.650865 ip-10-0-139-134 kubenswrapper[2578]: I0709 18:59:29.650831    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/4e35097c-426a-4343-aa9d-befa17cabda5-original-pull-secret\") pod \"global-pull-secret-syncer-kmr4m\" (UID: \"4e35097c-426a-4343-aa9d-befa17cabda5\") " pod="kube-system/global-pull-secret-syncer-kmr4m"
Jul 09 18:59:29.650865 ip-10-0-139-134 kubenswrapper[2578]: I0709 18:59:29.650873    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a6f6e738-06b0-41d1-bcc4-3627871fe3d6-metrics-certs\") pod \"network-metrics-daemon-dztbt\" (UID: \"a6f6e738-06b0-41d1-bcc4-3627871fe3d6\") " pod="openshift-multus/network-metrics-daemon-dztbt"
Jul 09 18:59:29.654297 ip-10-0-139-134 kubenswrapper[2578]: I0709 18:59:29.654279    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Jul 09 18:59:29.654416 ip-10-0-139-134 kubenswrapper[2578]: I0709 18:59:29.654394    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Jul 09 18:59:29.661089 ip-10-0-139-134 kubenswrapper[2578]: E0709 18:59:29.661065    2578 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found
Jul 09 18:59:29.661191 ip-10-0-139-134 kubenswrapper[2578]: E0709 18:59:29.661124    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a6f6e738-06b0-41d1-bcc4-3627871fe3d6-metrics-certs podName:a6f6e738-06b0-41d1-bcc4-3627871fe3d6 nodeName:}" failed. No retries permitted until 2026-07-09 19:00:33.66110845 +0000 UTC m=+130.287159758 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/a6f6e738-06b0-41d1-bcc4-3627871fe3d6-metrics-certs") pod "network-metrics-daemon-dztbt" (UID: "a6f6e738-06b0-41d1-bcc4-3627871fe3d6") : secret "metrics-daemon-secret" not found
Jul 09 18:59:29.664980 ip-10-0-139-134 kubenswrapper[2578]: I0709 18:59:29.664960    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/4e35097c-426a-4343-aa9d-befa17cabda5-original-pull-secret\") pod \"global-pull-secret-syncer-kmr4m\" (UID: \"4e35097c-426a-4343-aa9d-befa17cabda5\") " pod="kube-system/global-pull-secret-syncer-kmr4m"
Jul 09 18:59:29.751360 ip-10-0-139-134 kubenswrapper[2578]: I0709 18:59:29.751321    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xfhcf\" (UniqueName: \"kubernetes.io/projected/2d052a65-da3a-4426-a441-83b9cc44217b-kube-api-access-xfhcf\") pod \"network-check-target-9n6nc\" (UID: \"2d052a65-da3a-4426-a441-83b9cc44217b\") " pod="openshift-network-diagnostics/network-check-target-9n6nc"
Jul 09 18:59:29.754722 ip-10-0-139-134 kubenswrapper[2578]: I0709 18:59:29.754698    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Jul 09 18:59:29.765144 ip-10-0-139-134 kubenswrapper[2578]: I0709 18:59:29.765115    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Jul 09 18:59:29.776163 ip-10-0-139-134 kubenswrapper[2578]: I0709 18:59:29.776138    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xfhcf\" (UniqueName: \"kubernetes.io/projected/2d052a65-da3a-4426-a441-83b9cc44217b-kube-api-access-xfhcf\") pod \"network-check-target-9n6nc\" (UID: \"2d052a65-da3a-4426-a441-83b9cc44217b\") " pod="openshift-network-diagnostics/network-check-target-9n6nc"
Jul 09 18:59:29.947525 ip-10-0-139-134 kubenswrapper[2578]: I0709 18:59:29.947444    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-rzlbw\""
Jul 09 18:59:29.955140 ip-10-0-139-134 kubenswrapper[2578]: I0709 18:59:29.955118    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-9n6nc"
Jul 09 18:59:29.957866 ip-10-0-139-134 kubenswrapper[2578]: I0709 18:59:29.957841    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-kmr4m"
Jul 09 18:59:30.090317 ip-10-0-139-134 kubenswrapper[2578]: I0709 18:59:30.090271    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-kmr4m"]
Jul 09 18:59:30.093154 ip-10-0-139-134 kubenswrapper[2578]: W0709 18:59:30.093116    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4e35097c_426a_4343_aa9d_befa17cabda5.slice/crio-e33f43f224996f847e10eac4efa698f2bab4a63c4d365b67f54c5af693acbf17 WatchSource:0}: Error finding container e33f43f224996f847e10eac4efa698f2bab4a63c4d365b67f54c5af693acbf17: Status 404 returned error can't find the container with id e33f43f224996f847e10eac4efa698f2bab4a63c4d365b67f54c5af693acbf17
Jul 09 18:59:30.105705 ip-10-0-139-134 kubenswrapper[2578]: I0709 18:59:30.105678    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-9n6nc"]
Jul 09 18:59:30.109260 ip-10-0-139-134 kubenswrapper[2578]: W0709 18:59:30.109233    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2d052a65_da3a_4426_a441_83b9cc44217b.slice/crio-445f17f3e51fd97499fc9008d8b14a5110340f8ad9c2ce9718e0fbbde1279a09 WatchSource:0}: Error finding container 445f17f3e51fd97499fc9008d8b14a5110340f8ad9c2ce9718e0fbbde1279a09: Status 404 returned error can't find the container with id 445f17f3e51fd97499fc9008d8b14a5110340f8ad9c2ce9718e0fbbde1279a09
Jul 09 18:59:30.115876 ip-10-0-139-134 kubenswrapper[2578]: I0709 18:59:30.115845    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-9n6nc" event={"ID":"2d052a65-da3a-4426-a441-83b9cc44217b","Type":"ContainerStarted","Data":"445f17f3e51fd97499fc9008d8b14a5110340f8ad9c2ce9718e0fbbde1279a09"}
Jul 09 18:59:30.116964 ip-10-0-139-134 kubenswrapper[2578]: I0709 18:59:30.116942    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-kmr4m" event={"ID":"4e35097c-426a-4343-aa9d-befa17cabda5","Type":"ContainerStarted","Data":"e33f43f224996f847e10eac4efa698f2bab4a63c4d365b67f54c5af693acbf17"}
Jul 09 18:59:31.560865 ip-10-0-139-134 kubenswrapper[2578]: I0709 18:59:31.560816    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/c2465fe4-d9fa-4246-b5e6-399f6dbe9259-metrics-tls\") pod \"dns-default-pv4p5\" (UID: \"c2465fe4-d9fa-4246-b5e6-399f6dbe9259\") " pod="openshift-dns/dns-default-pv4p5"
Jul 09 18:59:31.561365 ip-10-0-139-134 kubenswrapper[2578]: E0709 18:59:31.560972    2578 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 09 18:59:31.561365 ip-10-0-139-134 kubenswrapper[2578]: E0709 18:59:31.561059    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c2465fe4-d9fa-4246-b5e6-399f6dbe9259-metrics-tls podName:c2465fe4-d9fa-4246-b5e6-399f6dbe9259 nodeName:}" failed. No retries permitted until 2026-07-09 19:00:03.561041734 +0000 UTC m=+100.187093047 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/c2465fe4-d9fa-4246-b5e6-399f6dbe9259-metrics-tls") pod "dns-default-pv4p5" (UID: "c2465fe4-d9fa-4246-b5e6-399f6dbe9259") : secret "dns-default-metrics-tls" not found
Jul 09 18:59:35.132657 ip-10-0-139-134 kubenswrapper[2578]: I0709 18:59:35.132619    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-kmr4m" event={"ID":"4e35097c-426a-4343-aa9d-befa17cabda5","Type":"ContainerStarted","Data":"90bf24a3273a8615e4cd79afd62534b163ef8a7e73e627c9645299b0dfcd186d"}
Jul 09 18:59:35.134209 ip-10-0-139-134 kubenswrapper[2578]: I0709 18:59:35.134182    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-9n6nc" event={"ID":"2d052a65-da3a-4426-a441-83b9cc44217b","Type":"ContainerStarted","Data":"8850ad4cf7d48720128b81b27ee69fa4175f90060ca77953bb310f6e50c41326"}
Jul 09 18:59:35.134347 ip-10-0-139-134 kubenswrapper[2578]: I0709 18:59:35.134325    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-9n6nc"
Jul 09 18:59:35.148808 ip-10-0-139-134 kubenswrapper[2578]: I0709 18:59:35.148747    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-kmr4m" podStartSLOduration=66.228028164 podStartE2EDuration="1m11.148732965s" totalImagesPullingTime="4.920704801s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-09 18:58:24 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 18:59:35.148116903 +0000 UTC m=+71.774168232" watchObservedRunningTime="2026-07-09 18:59:35.148732965 +0000 UTC m=+71.774784294"
Jul 09 18:59:35.165235 ip-10-0-139-134 kubenswrapper[2578]: I0709 18:59:35.165180    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-9n6nc" podStartSLOduration=66.263811808 podStartE2EDuration="1m11.165163674s" totalImagesPullingTime="4.901351866s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 18:58:24 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 18:59:35.164531673 +0000 UTC m=+71.790583004" watchObservedRunningTime="2026-07-09 18:59:35.165163674 +0000 UTC m=+71.791215004"
Jul 09 19:00:03.573729 ip-10-0-139-134 kubenswrapper[2578]: I0709 19:00:03.573691    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/c2465fe4-d9fa-4246-b5e6-399f6dbe9259-metrics-tls\") pod \"dns-default-pv4p5\" (UID: \"c2465fe4-d9fa-4246-b5e6-399f6dbe9259\") " pod="openshift-dns/dns-default-pv4p5"
Jul 09 19:00:03.574217 ip-10-0-139-134 kubenswrapper[2578]: E0709 19:00:03.573807    2578 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 09 19:00:03.574217 ip-10-0-139-134 kubenswrapper[2578]: E0709 19:00:03.573859    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c2465fe4-d9fa-4246-b5e6-399f6dbe9259-metrics-tls podName:c2465fe4-d9fa-4246-b5e6-399f6dbe9259 nodeName:}" failed. No retries permitted until 2026-07-09 19:01:07.573845687 +0000 UTC m=+164.199896995 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/c2465fe4-d9fa-4246-b5e6-399f6dbe9259-metrics-tls") pod "dns-default-pv4p5" (UID: "c2465fe4-d9fa-4246-b5e6-399f6dbe9259") : secret "dns-default-metrics-tls" not found
Jul 09 19:00:06.138795 ip-10-0-139-134 kubenswrapper[2578]: I0709 19:00:06.138765    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-9n6nc"
Jul 09 19:00:10.792081 ip-10-0-139-134 kubenswrapper[2578]: I0709 19:00:10.792043    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-5bdb55b7bc-w2gjj"]
Jul 09 19:00:10.795280 ip-10-0-139-134 kubenswrapper[2578]: I0709 19:00:10.795261    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-5bdb55b7bc-w2gjj"
Jul 09 19:00:10.798292 ip-10-0-139-134 kubenswrapper[2578]: I0709 19:00:10.798266    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"open-cluster-management-image-pull-credentials\""
Jul 09 19:00:10.799078 ip-10-0-139-134 kubenswrapper[2578]: I0709 19:00:10.799056    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5cdf7bdc97-nqrj8"]
Jul 09 19:00:10.799303 ip-10-0-139-134 kubenswrapper[2578]: I0709 19:00:10.799281    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"kube-root-ca.crt\""
Jul 09 19:00:10.799403 ip-10-0-139-134 kubenswrapper[2578]: I0709 19:00:10.799314    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"openshift-service-ca.crt\""
Jul 09 19:00:10.799966 ip-10-0-139-134 kubenswrapper[2578]: I0709 19:00:10.799951    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"work-manager-hub-kubeconfig\""
Jul 09 19:00:10.801350 ip-10-0-139-134 kubenswrapper[2578]: I0709 19:00:10.801333    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5cdf7bdc97-nqrj8"
Jul 09 19:00:10.804223 ip-10-0-139-134 kubenswrapper[2578]: I0709 19:00:10.804205    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-ca\""
Jul 09 19:00:10.804319 ip-10-0-139-134 kubenswrapper[2578]: I0709 19:00:10.804260    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-hub-kubeconfig\""
Jul 09 19:00:10.804319 ip-10-0-139-134 kubenswrapper[2578]: I0709 19:00:10.804289    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-service-proxy-server-certificates\""
Jul 09 19:00:10.804423 ip-10-0-139-134 kubenswrapper[2578]: I0709 19:00:10.804371    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-open-cluster-management.io-proxy-agent-signer-client-cert\""
Jul 09 19:00:10.809759 ip-10-0-139-134 kubenswrapper[2578]: I0709 19:00:10.809738    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-5bdb55b7bc-w2gjj"]
Jul 09 19:00:10.813980 ip-10-0-139-134 kubenswrapper[2578]: I0709 19:00:10.813957    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5cdf7bdc97-nqrj8"]
Jul 09 19:00:10.822920 ip-10-0-139-134 kubenswrapper[2578]: I0709 19:00:10.822897    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/10f6207f-2326-464c-95a5-5e6a397ad9ca-klusterlet-config\") pod \"klusterlet-addon-workmgr-5bdb55b7bc-w2gjj\" (UID: \"10f6207f-2326-464c-95a5-5e6a397ad9ca\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-5bdb55b7bc-w2gjj"
Jul 09 19:00:10.823075 ip-10-0-139-134 kubenswrapper[2578]: I0709 19:00:10.822944    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/10f6207f-2326-464c-95a5-5e6a397ad9ca-tmp\") pod \"klusterlet-addon-workmgr-5bdb55b7bc-w2gjj\" (UID: \"10f6207f-2326-464c-95a5-5e6a397ad9ca\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-5bdb55b7bc-w2gjj"
Jul 09 19:00:10.823075 ip-10-0-139-134 kubenswrapper[2578]: I0709 19:00:10.823028    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fnnqc\" (UniqueName: \"kubernetes.io/projected/10f6207f-2326-464c-95a5-5e6a397ad9ca-kube-api-access-fnnqc\") pod \"klusterlet-addon-workmgr-5bdb55b7bc-w2gjj\" (UID: \"10f6207f-2326-464c-95a5-5e6a397ad9ca\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-5bdb55b7bc-w2gjj"
Jul 09 19:00:10.923834 ip-10-0-139-134 kubenswrapper[2578]: I0709 19:00:10.923795    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/10f6207f-2326-464c-95a5-5e6a397ad9ca-klusterlet-config\") pod \"klusterlet-addon-workmgr-5bdb55b7bc-w2gjj\" (UID: \"10f6207f-2326-464c-95a5-5e6a397ad9ca\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-5bdb55b7bc-w2gjj"
Jul 09 19:00:10.924083 ip-10-0-139-134 kubenswrapper[2578]: I0709 19:00:10.923856    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/10f6207f-2326-464c-95a5-5e6a397ad9ca-tmp\") pod \"klusterlet-addon-workmgr-5bdb55b7bc-w2gjj\" (UID: \"10f6207f-2326-464c-95a5-5e6a397ad9ca\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-5bdb55b7bc-w2gjj"
Jul 09 19:00:10.924083 ip-10-0-139-134 kubenswrapper[2578]: I0709 19:00:10.923884    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/6c449343-0730-4f37-9f01-6200aaf11fa6-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-5cdf7bdc97-nqrj8\" (UID: \"6c449343-0730-4f37-9f01-6200aaf11fa6\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5cdf7bdc97-nqrj8"
Jul 09 19:00:10.924083 ip-10-0-139-134 kubenswrapper[2578]: I0709 19:00:10.923917    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fnnqc\" (UniqueName: \"kubernetes.io/projected/10f6207f-2326-464c-95a5-5e6a397ad9ca-kube-api-access-fnnqc\") pod \"klusterlet-addon-workmgr-5bdb55b7bc-w2gjj\" (UID: \"10f6207f-2326-464c-95a5-5e6a397ad9ca\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-5bdb55b7bc-w2gjj"
Jul 09 19:00:10.924083 ip-10-0-139-134 kubenswrapper[2578]: I0709 19:00:10.923942    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4drjp\" (UniqueName: \"kubernetes.io/projected/6c449343-0730-4f37-9f01-6200aaf11fa6-kube-api-access-4drjp\") pod \"cluster-proxy-proxy-agent-5cdf7bdc97-nqrj8\" (UID: \"6c449343-0730-4f37-9f01-6200aaf11fa6\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5cdf7bdc97-nqrj8"
Jul 09 19:00:10.924083 ip-10-0-139-134 kubenswrapper[2578]: I0709 19:00:10.923976    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca\" (UniqueName: \"kubernetes.io/secret/6c449343-0730-4f37-9f01-6200aaf11fa6-ca\") pod \"cluster-proxy-proxy-agent-5cdf7bdc97-nqrj8\" (UID: \"6c449343-0730-4f37-9f01-6200aaf11fa6\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5cdf7bdc97-nqrj8"
Jul 09 19:00:10.924083 ip-10-0-139-134 kubenswrapper[2578]: I0709 19:00:10.924020    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub\" (UniqueName: \"kubernetes.io/secret/6c449343-0730-4f37-9f01-6200aaf11fa6-hub\") pod \"cluster-proxy-proxy-agent-5cdf7bdc97-nqrj8\" (UID: \"6c449343-0730-4f37-9f01-6200aaf11fa6\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5cdf7bdc97-nqrj8"
Jul 09 19:00:10.924083 ip-10-0-139-134 kubenswrapper[2578]: I0709 19:00:10.924044    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/6c449343-0730-4f37-9f01-6200aaf11fa6-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-5cdf7bdc97-nqrj8\" (UID: \"6c449343-0730-4f37-9f01-6200aaf11fa6\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5cdf7bdc97-nqrj8"
Jul 09 19:00:10.924083 ip-10-0-139-134 kubenswrapper[2578]: I0709 19:00:10.924068    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/6c449343-0730-4f37-9f01-6200aaf11fa6-additional-service-ca\") pod \"cluster-proxy-proxy-agent-5cdf7bdc97-nqrj8\" (UID: \"6c449343-0730-4f37-9f01-6200aaf11fa6\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5cdf7bdc97-nqrj8"
Jul 09 19:00:10.924370 ip-10-0-139-134 kubenswrapper[2578]: I0709 19:00:10.924242    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/10f6207f-2326-464c-95a5-5e6a397ad9ca-tmp\") pod \"klusterlet-addon-workmgr-5bdb55b7bc-w2gjj\" (UID: \"10f6207f-2326-464c-95a5-5e6a397ad9ca\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-5bdb55b7bc-w2gjj"
Jul 09 19:00:10.926483 ip-10-0-139-134 kubenswrapper[2578]: I0709 19:00:10.926458    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/10f6207f-2326-464c-95a5-5e6a397ad9ca-klusterlet-config\") pod \"klusterlet-addon-workmgr-5bdb55b7bc-w2gjj\" (UID: \"10f6207f-2326-464c-95a5-5e6a397ad9ca\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-5bdb55b7bc-w2gjj"
Jul 09 19:00:10.938049 ip-10-0-139-134 kubenswrapper[2578]: I0709 19:00:10.938018    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fnnqc\" (UniqueName: \"kubernetes.io/projected/10f6207f-2326-464c-95a5-5e6a397ad9ca-kube-api-access-fnnqc\") pod \"klusterlet-addon-workmgr-5bdb55b7bc-w2gjj\" (UID: \"10f6207f-2326-464c-95a5-5e6a397ad9ca\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-5bdb55b7bc-w2gjj"
Jul 09 19:00:11.025102 ip-10-0-139-134 kubenswrapper[2578]: I0709 19:00:11.025066    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca\" (UniqueName: \"kubernetes.io/secret/6c449343-0730-4f37-9f01-6200aaf11fa6-ca\") pod \"cluster-proxy-proxy-agent-5cdf7bdc97-nqrj8\" (UID: \"6c449343-0730-4f37-9f01-6200aaf11fa6\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5cdf7bdc97-nqrj8"
Jul 09 19:00:11.025102 ip-10-0-139-134 kubenswrapper[2578]: I0709 19:00:11.025101    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub\" (UniqueName: \"kubernetes.io/secret/6c449343-0730-4f37-9f01-6200aaf11fa6-hub\") pod \"cluster-proxy-proxy-agent-5cdf7bdc97-nqrj8\" (UID: \"6c449343-0730-4f37-9f01-6200aaf11fa6\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5cdf7bdc97-nqrj8"
Jul 09 19:00:11.025350 ip-10-0-139-134 kubenswrapper[2578]: I0709 19:00:11.025119    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/6c449343-0730-4f37-9f01-6200aaf11fa6-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-5cdf7bdc97-nqrj8\" (UID: \"6c449343-0730-4f37-9f01-6200aaf11fa6\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5cdf7bdc97-nqrj8"
Jul 09 19:00:11.025350 ip-10-0-139-134 kubenswrapper[2578]: I0709 19:00:11.025136    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/6c449343-0730-4f37-9f01-6200aaf11fa6-additional-service-ca\") pod \"cluster-proxy-proxy-agent-5cdf7bdc97-nqrj8\" (UID: \"6c449343-0730-4f37-9f01-6200aaf11fa6\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5cdf7bdc97-nqrj8"
Jul 09 19:00:11.025350 ip-10-0-139-134 kubenswrapper[2578]: I0709 19:00:11.025193    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/6c449343-0730-4f37-9f01-6200aaf11fa6-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-5cdf7bdc97-nqrj8\" (UID: \"6c449343-0730-4f37-9f01-6200aaf11fa6\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5cdf7bdc97-nqrj8"
Jul 09 19:00:11.025350 ip-10-0-139-134 kubenswrapper[2578]: I0709 19:00:11.025217    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4drjp\" (UniqueName: \"kubernetes.io/projected/6c449343-0730-4f37-9f01-6200aaf11fa6-kube-api-access-4drjp\") pod \"cluster-proxy-proxy-agent-5cdf7bdc97-nqrj8\" (UID: \"6c449343-0730-4f37-9f01-6200aaf11fa6\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5cdf7bdc97-nqrj8"
Jul 09 19:00:11.026190 ip-10-0-139-134 kubenswrapper[2578]: I0709 19:00:11.026159    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/6c449343-0730-4f37-9f01-6200aaf11fa6-additional-service-ca\") pod \"cluster-proxy-proxy-agent-5cdf7bdc97-nqrj8\" (UID: \"6c449343-0730-4f37-9f01-6200aaf11fa6\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5cdf7bdc97-nqrj8"
Jul 09 19:00:11.027849 ip-10-0-139-134 kubenswrapper[2578]: I0709 19:00:11.027813    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca\" (UniqueName: \"kubernetes.io/secret/6c449343-0730-4f37-9f01-6200aaf11fa6-ca\") pod \"cluster-proxy-proxy-agent-5cdf7bdc97-nqrj8\" (UID: \"6c449343-0730-4f37-9f01-6200aaf11fa6\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5cdf7bdc97-nqrj8"
Jul 09 19:00:11.027967 ip-10-0-139-134 kubenswrapper[2578]: I0709 19:00:11.027841    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hub\" (UniqueName: \"kubernetes.io/secret/6c449343-0730-4f37-9f01-6200aaf11fa6-hub\") pod \"cluster-proxy-proxy-agent-5cdf7bdc97-nqrj8\" (UID: \"6c449343-0730-4f37-9f01-6200aaf11fa6\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5cdf7bdc97-nqrj8"
Jul 09 19:00:11.027967 ip-10-0-139-134 kubenswrapper[2578]: I0709 19:00:11.027850    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/6c449343-0730-4f37-9f01-6200aaf11fa6-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-5cdf7bdc97-nqrj8\" (UID: \"6c449343-0730-4f37-9f01-6200aaf11fa6\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5cdf7bdc97-nqrj8"
Jul 09 19:00:11.028106 ip-10-0-139-134 kubenswrapper[2578]: I0709 19:00:11.028029    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/6c449343-0730-4f37-9f01-6200aaf11fa6-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-5cdf7bdc97-nqrj8\" (UID: \"6c449343-0730-4f37-9f01-6200aaf11fa6\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5cdf7bdc97-nqrj8"
Jul 09 19:00:11.035283 ip-10-0-139-134 kubenswrapper[2578]: I0709 19:00:11.035250    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4drjp\" (UniqueName: \"kubernetes.io/projected/6c449343-0730-4f37-9f01-6200aaf11fa6-kube-api-access-4drjp\") pod \"cluster-proxy-proxy-agent-5cdf7bdc97-nqrj8\" (UID: \"6c449343-0730-4f37-9f01-6200aaf11fa6\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5cdf7bdc97-nqrj8"
Jul 09 19:00:11.105195 ip-10-0-139-134 kubenswrapper[2578]: I0709 19:00:11.105110    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-5bdb55b7bc-w2gjj"
Jul 09 19:00:11.119465 ip-10-0-139-134 kubenswrapper[2578]: I0709 19:00:11.119437    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5cdf7bdc97-nqrj8"
Jul 09 19:00:11.249717 ip-10-0-139-134 kubenswrapper[2578]: I0709 19:00:11.249689    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-5bdb55b7bc-w2gjj"]
Jul 09 19:00:11.252757 ip-10-0-139-134 kubenswrapper[2578]: W0709 19:00:11.252730    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod10f6207f_2326_464c_95a5_5e6a397ad9ca.slice/crio-4c0746ba0610d6330955fb8bbc8a6f46a95f64b4f348a047d96b7e07eefa70d9 WatchSource:0}: Error finding container 4c0746ba0610d6330955fb8bbc8a6f46a95f64b4f348a047d96b7e07eefa70d9: Status 404 returned error can't find the container with id 4c0746ba0610d6330955fb8bbc8a6f46a95f64b4f348a047d96b7e07eefa70d9
Jul 09 19:00:11.264917 ip-10-0-139-134 kubenswrapper[2578]: I0709 19:00:11.264890    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5cdf7bdc97-nqrj8"]
Jul 09 19:00:11.267568 ip-10-0-139-134 kubenswrapper[2578]: W0709 19:00:11.267543    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod6c449343_0730_4f37_9f01_6200aaf11fa6.slice/crio-2e6d146a79e8825219b180ff091552cef088a0dd1cf68a14a635317490e5ce2b WatchSource:0}: Error finding container 2e6d146a79e8825219b180ff091552cef088a0dd1cf68a14a635317490e5ce2b: Status 404 returned error can't find the container with id 2e6d146a79e8825219b180ff091552cef088a0dd1cf68a14a635317490e5ce2b
Jul 09 19:00:12.231739 ip-10-0-139-134 kubenswrapper[2578]: I0709 19:00:12.231705    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5cdf7bdc97-nqrj8" event={"ID":"6c449343-0730-4f37-9f01-6200aaf11fa6","Type":"ContainerStarted","Data":"2e6d146a79e8825219b180ff091552cef088a0dd1cf68a14a635317490e5ce2b"}
Jul 09 19:00:12.233214 ip-10-0-139-134 kubenswrapper[2578]: I0709 19:00:12.233178    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-5bdb55b7bc-w2gjj" event={"ID":"10f6207f-2326-464c-95a5-5e6a397ad9ca","Type":"ContainerStarted","Data":"4c0746ba0610d6330955fb8bbc8a6f46a95f64b4f348a047d96b7e07eefa70d9"}
Jul 09 19:00:16.248084 ip-10-0-139-134 kubenswrapper[2578]: I0709 19:00:16.248045    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5cdf7bdc97-nqrj8" event={"ID":"6c449343-0730-4f37-9f01-6200aaf11fa6","Type":"ContainerStarted","Data":"9730c05591b8054be9cad9d4de6ec922f44f2528a824e28b474ef3158752dcba"}
Jul 09 19:00:16.248503 ip-10-0-139-134 kubenswrapper[2578]: I0709 19:00:16.248100    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5cdf7bdc97-nqrj8" event={"ID":"6c449343-0730-4f37-9f01-6200aaf11fa6","Type":"ContainerStarted","Data":"d40782a54fbb42b9b1cfe51699f4c75b11f53f297e65c60240d0bde8bf557ed3"}
Jul 09 19:00:16.248503 ip-10-0-139-134 kubenswrapper[2578]: I0709 19:00:16.248121    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5cdf7bdc97-nqrj8" event={"ID":"6c449343-0730-4f37-9f01-6200aaf11fa6","Type":"ContainerStarted","Data":"22eaf73b6359184d5f8375ab6ea7f34368ae302a010d728b3883cfb2ab711132"}
Jul 09 19:00:16.269799 ip-10-0-139-134 kubenswrapper[2578]: I0709 19:00:16.269737    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5cdf7bdc97-nqrj8" podStartSLOduration=2.291033853 podStartE2EDuration="6.269718418s" totalImagesPullingTime="3.978684565s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 19:00:10 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 19:00:16.269303412 +0000 UTC m=+112.895354742" watchObservedRunningTime="2026-07-09 19:00:16.269718418 +0000 UTC m=+112.895769749"
Jul 09 19:00:17.255397 ip-10-0-139-134 kubenswrapper[2578]: I0709 19:00:17.255363    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-5bdb55b7bc-w2gjj" event={"ID":"10f6207f-2326-464c-95a5-5e6a397ad9ca","Type":"ContainerStarted","Data":"3b104fb40bfdff455d7582c6ad527cd5c6636b1449ff7a2d208853614b798ff8"}
Jul 09 19:00:17.277548 ip-10-0-139-134 kubenswrapper[2578]: I0709 19:00:17.277494    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-5bdb55b7bc-w2gjj" podStartSLOduration=1.862509704 podStartE2EDuration="7.277478536s" totalImagesPullingTime="5.414968832s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 19:00:10 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 19:00:17.276687949 +0000 UTC m=+113.902739279" watchObservedRunningTime="2026-07-09 19:00:17.277478536 +0000 UTC m=+113.903529866"
Jul 09 19:00:18.258481 ip-10-0-139-134 kubenswrapper[2578]: I0709 19:00:18.258443    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-5bdb55b7bc-w2gjj"
Jul 09 19:00:18.260029 ip-10-0-139-134 kubenswrapper[2578]: I0709 19:00:18.260009    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-5bdb55b7bc-w2gjj"
Jul 09 19:00:33.690886 ip-10-0-139-134 kubenswrapper[2578]: I0709 19:00:33.690827    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a6f6e738-06b0-41d1-bcc4-3627871fe3d6-metrics-certs\") pod \"network-metrics-daemon-dztbt\" (UID: \"a6f6e738-06b0-41d1-bcc4-3627871fe3d6\") " pod="openshift-multus/network-metrics-daemon-dztbt"
Jul 09 19:00:33.691343 ip-10-0-139-134 kubenswrapper[2578]: E0709 19:00:33.690965    2578 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found
Jul 09 19:00:33.691343 ip-10-0-139-134 kubenswrapper[2578]: E0709 19:00:33.691073    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a6f6e738-06b0-41d1-bcc4-3627871fe3d6-metrics-certs podName:a6f6e738-06b0-41d1-bcc4-3627871fe3d6 nodeName:}" failed. No retries permitted until 2026-07-09 19:02:35.69105355 +0000 UTC m=+252.317104858 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/a6f6e738-06b0-41d1-bcc4-3627871fe3d6-metrics-certs") pod "network-metrics-daemon-dztbt" (UID: "a6f6e738-06b0-41d1-bcc4-3627871fe3d6") : secret "metrics-daemon-secret" not found
Jul 09 19:01:02.716762 ip-10-0-139-134 kubenswrapper[2578]: E0709 19:01:02.716717    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-pv4p5" podUID="c2465fe4-d9fa-4246-b5e6-399f6dbe9259"
Jul 09 19:01:03.392771 ip-10-0-139-134 kubenswrapper[2578]: I0709 19:01:03.392744    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-pv4p5"
Jul 09 19:01:03.851348 ip-10-0-139-134 kubenswrapper[2578]: E0709 19:01:03.851310    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-certs], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-multus/network-metrics-daemon-dztbt" podUID="a6f6e738-06b0-41d1-bcc4-3627871fe3d6"
Jul 09 19:01:07.623827 ip-10-0-139-134 kubenswrapper[2578]: I0709 19:01:07.623782    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/c2465fe4-d9fa-4246-b5e6-399f6dbe9259-metrics-tls\") pod \"dns-default-pv4p5\" (UID: \"c2465fe4-d9fa-4246-b5e6-399f6dbe9259\") " pod="openshift-dns/dns-default-pv4p5"
Jul 09 19:01:07.624251 ip-10-0-139-134 kubenswrapper[2578]: E0709 19:01:07.623910    2578 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 09 19:01:07.624251 ip-10-0-139-134 kubenswrapper[2578]: E0709 19:01:07.623971    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c2465fe4-d9fa-4246-b5e6-399f6dbe9259-metrics-tls podName:c2465fe4-d9fa-4246-b5e6-399f6dbe9259 nodeName:}" failed. No retries permitted until 2026-07-09 19:03:09.623956523 +0000 UTC m=+286.250007831 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/c2465fe4-d9fa-4246-b5e6-399f6dbe9259-metrics-tls") pod "dns-default-pv4p5" (UID: "c2465fe4-d9fa-4246-b5e6-399f6dbe9259") : secret "dns-default-metrics-tls" not found
Jul 09 19:01:16.833331 ip-10-0-139-134 kubenswrapper[2578]: I0709 19:01:16.833246    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-dztbt"
Jul 09 19:02:17.602055 ip-10-0-139-134 kubenswrapper[2578]: I0709 19:02:17.602019    2578 generic.go:356] "Generic (PLEG): container finished" podID="10f6207f-2326-464c-95a5-5e6a397ad9ca" containerID="3b104fb40bfdff455d7582c6ad527cd5c6636b1449ff7a2d208853614b798ff8" exitCode=1
Jul 09 19:02:17.602461 ip-10-0-139-134 kubenswrapper[2578]: I0709 19:02:17.602090    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-5bdb55b7bc-w2gjj" event={"ID":"10f6207f-2326-464c-95a5-5e6a397ad9ca","Type":"ContainerDied","Data":"3b104fb40bfdff455d7582c6ad527cd5c6636b1449ff7a2d208853614b798ff8"}
Jul 09 19:02:17.602461 ip-10-0-139-134 kubenswrapper[2578]: I0709 19:02:17.602396    2578 scope.go:117] "RemoveContainer" containerID="3b104fb40bfdff455d7582c6ad527cd5c6636b1449ff7a2d208853614b798ff8"
Jul 09 19:02:18.258625 ip-10-0-139-134 kubenswrapper[2578]: I0709 19:02:18.258576    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-5bdb55b7bc-w2gjj"
Jul 09 19:02:18.607281 ip-10-0-139-134 kubenswrapper[2578]: I0709 19:02:18.607201    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-5bdb55b7bc-w2gjj" event={"ID":"10f6207f-2326-464c-95a5-5e6a397ad9ca","Type":"ContainerStarted","Data":"7c17547eea59658baf7fc55cec9ee8cc9612163f43161c6e44ab1cf243818135"}
Jul 09 19:02:18.607667 ip-10-0-139-134 kubenswrapper[2578]: I0709 19:02:18.607396    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-5bdb55b7bc-w2gjj"
Jul 09 19:02:18.608046 ip-10-0-139-134 kubenswrapper[2578]: I0709 19:02:18.608025    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-5bdb55b7bc-w2gjj"
Jul 09 19:02:35.731308 ip-10-0-139-134 kubenswrapper[2578]: I0709 19:02:35.731264    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a6f6e738-06b0-41d1-bcc4-3627871fe3d6-metrics-certs\") pod \"network-metrics-daemon-dztbt\" (UID: \"a6f6e738-06b0-41d1-bcc4-3627871fe3d6\") " pod="openshift-multus/network-metrics-daemon-dztbt"
Jul 09 19:02:35.731706 ip-10-0-139-134 kubenswrapper[2578]: E0709 19:02:35.731420    2578 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found
Jul 09 19:02:35.731973 ip-10-0-139-134 kubenswrapper[2578]: E0709 19:02:35.731950    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a6f6e738-06b0-41d1-bcc4-3627871fe3d6-metrics-certs podName:a6f6e738-06b0-41d1-bcc4-3627871fe3d6 nodeName:}" failed. No retries permitted until 2026-07-09 19:04:37.731924555 +0000 UTC m=+374.357975865 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/a6f6e738-06b0-41d1-bcc4-3627871fe3d6-metrics-certs") pod "network-metrics-daemon-dztbt" (UID: "a6f6e738-06b0-41d1-bcc4-3627871fe3d6") : secret "metrics-daemon-secret" not found
Jul 09 19:02:44.313398 ip-10-0-139-134 kubenswrapper[2578]: I0709 19:02:44.313361    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-c67x7"]
Jul 09 19:02:44.315470 ip-10-0-139-134 kubenswrapper[2578]: I0709 19:02:44.315412    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-c67x7"
Jul 09 19:02:44.318927 ip-10-0-139-134 kubenswrapper[2578]: I0709 19:02:44.318905    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-rw89p\""
Jul 09 19:02:44.319075 ip-10-0-139-134 kubenswrapper[2578]: I0709 19:02:44.318935    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\""
Jul 09 19:02:44.319075 ip-10-0-139-134 kubenswrapper[2578]: I0709 19:02:44.318906    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\""
Jul 09 19:02:44.320633 ip-10-0-139-134 kubenswrapper[2578]: I0709 19:02:44.320613    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\""
Jul 09 19:02:44.320633 ip-10-0-139-134 kubenswrapper[2578]: I0709 19:02:44.320630    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\""
Jul 09 19:02:44.326347 ip-10-0-139-134 kubenswrapper[2578]: I0709 19:02:44.326318    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-c67x7"]
Jul 09 19:02:44.390280 ip-10-0-139-134 kubenswrapper[2578]: I0709 19:02:44.390243    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/26f7e025-e3eb-4289-8169-e40c6614d619-data-volume\") pod \"insights-runtime-extractor-c67x7\" (UID: \"26f7e025-e3eb-4289-8169-e40c6614d619\") " pod="openshift-insights/insights-runtime-extractor-c67x7"
Jul 09 19:02:44.390280 ip-10-0-139-134 kubenswrapper[2578]: I0709 19:02:44.390288    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/26f7e025-e3eb-4289-8169-e40c6614d619-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-c67x7\" (UID: \"26f7e025-e3eb-4289-8169-e40c6614d619\") " pod="openshift-insights/insights-runtime-extractor-c67x7"
Jul 09 19:02:44.390498 ip-10-0-139-134 kubenswrapper[2578]: I0709 19:02:44.390308    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-n26ht\" (UniqueName: \"kubernetes.io/projected/26f7e025-e3eb-4289-8169-e40c6614d619-kube-api-access-n26ht\") pod \"insights-runtime-extractor-c67x7\" (UID: \"26f7e025-e3eb-4289-8169-e40c6614d619\") " pod="openshift-insights/insights-runtime-extractor-c67x7"
Jul 09 19:02:44.390498 ip-10-0-139-134 kubenswrapper[2578]: I0709 19:02:44.390331    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/26f7e025-e3eb-4289-8169-e40c6614d619-crio-socket\") pod \"insights-runtime-extractor-c67x7\" (UID: \"26f7e025-e3eb-4289-8169-e40c6614d619\") " pod="openshift-insights/insights-runtime-extractor-c67x7"
Jul 09 19:02:44.390498 ip-10-0-139-134 kubenswrapper[2578]: I0709 19:02:44.390383    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/26f7e025-e3eb-4289-8169-e40c6614d619-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-c67x7\" (UID: \"26f7e025-e3eb-4289-8169-e40c6614d619\") " pod="openshift-insights/insights-runtime-extractor-c67x7"
Jul 09 19:02:44.491399 ip-10-0-139-134 kubenswrapper[2578]: I0709 19:02:44.491367    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/26f7e025-e3eb-4289-8169-e40c6614d619-data-volume\") pod \"insights-runtime-extractor-c67x7\" (UID: \"26f7e025-e3eb-4289-8169-e40c6614d619\") " pod="openshift-insights/insights-runtime-extractor-c67x7"
Jul 09 19:02:44.491399 ip-10-0-139-134 kubenswrapper[2578]: I0709 19:02:44.491406    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/26f7e025-e3eb-4289-8169-e40c6614d619-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-c67x7\" (UID: \"26f7e025-e3eb-4289-8169-e40c6614d619\") " pod="openshift-insights/insights-runtime-extractor-c67x7"
Jul 09 19:02:44.491639 ip-10-0-139-134 kubenswrapper[2578]: I0709 19:02:44.491422    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-n26ht\" (UniqueName: \"kubernetes.io/projected/26f7e025-e3eb-4289-8169-e40c6614d619-kube-api-access-n26ht\") pod \"insights-runtime-extractor-c67x7\" (UID: \"26f7e025-e3eb-4289-8169-e40c6614d619\") " pod="openshift-insights/insights-runtime-extractor-c67x7"
Jul 09 19:02:44.491639 ip-10-0-139-134 kubenswrapper[2578]: I0709 19:02:44.491443    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/26f7e025-e3eb-4289-8169-e40c6614d619-crio-socket\") pod \"insights-runtime-extractor-c67x7\" (UID: \"26f7e025-e3eb-4289-8169-e40c6614d619\") " pod="openshift-insights/insights-runtime-extractor-c67x7"
Jul 09 19:02:44.491639 ip-10-0-139-134 kubenswrapper[2578]: I0709 19:02:44.491456    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/26f7e025-e3eb-4289-8169-e40c6614d619-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-c67x7\" (UID: \"26f7e025-e3eb-4289-8169-e40c6614d619\") " pod="openshift-insights/insights-runtime-extractor-c67x7"
Jul 09 19:02:44.491639 ip-10-0-139-134 kubenswrapper[2578]: E0709 19:02:44.491517    2578 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 09 19:02:44.491639 ip-10-0-139-134 kubenswrapper[2578]: E0709 19:02:44.491542    2578 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 09 19:02:44.491639 ip-10-0-139-134 kubenswrapper[2578]: I0709 19:02:44.491549    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/26f7e025-e3eb-4289-8169-e40c6614d619-crio-socket\") pod \"insights-runtime-extractor-c67x7\" (UID: \"26f7e025-e3eb-4289-8169-e40c6614d619\") " pod="openshift-insights/insights-runtime-extractor-c67x7"
Jul 09 19:02:44.491639 ip-10-0-139-134 kubenswrapper[2578]: E0709 19:02:44.491573    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/26f7e025-e3eb-4289-8169-e40c6614d619-kube-rbac-proxy-cm podName:26f7e025-e3eb-4289-8169-e40c6614d619 nodeName:}" failed. No retries permitted until 2026-07-09 19:02:44.991559438 +0000 UTC m=+261.617610746 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/26f7e025-e3eb-4289-8169-e40c6614d619-kube-rbac-proxy-cm") pod "insights-runtime-extractor-c67x7" (UID: "26f7e025-e3eb-4289-8169-e40c6614d619") : configmap "kube-rbac-proxy" not found
Jul 09 19:02:44.491639 ip-10-0-139-134 kubenswrapper[2578]: E0709 19:02:44.491592    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/26f7e025-e3eb-4289-8169-e40c6614d619-insights-runtime-extractor-tls podName:26f7e025-e3eb-4289-8169-e40c6614d619 nodeName:}" failed. No retries permitted until 2026-07-09 19:02:44.991579379 +0000 UTC m=+261.617630687 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/26f7e025-e3eb-4289-8169-e40c6614d619-insights-runtime-extractor-tls") pod "insights-runtime-extractor-c67x7" (UID: "26f7e025-e3eb-4289-8169-e40c6614d619") : secret "insights-runtime-extractor-tls" not found
Jul 09 19:02:44.491884 ip-10-0-139-134 kubenswrapper[2578]: I0709 19:02:44.491761    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/26f7e025-e3eb-4289-8169-e40c6614d619-data-volume\") pod \"insights-runtime-extractor-c67x7\" (UID: \"26f7e025-e3eb-4289-8169-e40c6614d619\") " pod="openshift-insights/insights-runtime-extractor-c67x7"
Jul 09 19:02:44.501739 ip-10-0-139-134 kubenswrapper[2578]: I0709 19:02:44.501715    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-n26ht\" (UniqueName: \"kubernetes.io/projected/26f7e025-e3eb-4289-8169-e40c6614d619-kube-api-access-n26ht\") pod \"insights-runtime-extractor-c67x7\" (UID: \"26f7e025-e3eb-4289-8169-e40c6614d619\") " pod="openshift-insights/insights-runtime-extractor-c67x7"
Jul 09 19:02:44.994790 ip-10-0-139-134 kubenswrapper[2578]: I0709 19:02:44.994751    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/26f7e025-e3eb-4289-8169-e40c6614d619-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-c67x7\" (UID: \"26f7e025-e3eb-4289-8169-e40c6614d619\") " pod="openshift-insights/insights-runtime-extractor-c67x7"
Jul 09 19:02:44.994961 ip-10-0-139-134 kubenswrapper[2578]: I0709 19:02:44.994799    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/26f7e025-e3eb-4289-8169-e40c6614d619-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-c67x7\" (UID: \"26f7e025-e3eb-4289-8169-e40c6614d619\") " pod="openshift-insights/insights-runtime-extractor-c67x7"
Jul 09 19:02:44.994961 ip-10-0-139-134 kubenswrapper[2578]: E0709 19:02:44.994907    2578 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 09 19:02:44.994961 ip-10-0-139-134 kubenswrapper[2578]: E0709 19:02:44.994948    2578 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 09 19:02:44.995089 ip-10-0-139-134 kubenswrapper[2578]: E0709 19:02:44.994977    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/26f7e025-e3eb-4289-8169-e40c6614d619-insights-runtime-extractor-tls podName:26f7e025-e3eb-4289-8169-e40c6614d619 nodeName:}" failed. No retries permitted until 2026-07-09 19:02:45.994962209 +0000 UTC m=+262.621013517 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/26f7e025-e3eb-4289-8169-e40c6614d619-insights-runtime-extractor-tls") pod "insights-runtime-extractor-c67x7" (UID: "26f7e025-e3eb-4289-8169-e40c6614d619") : secret "insights-runtime-extractor-tls" not found
Jul 09 19:02:44.995089 ip-10-0-139-134 kubenswrapper[2578]: E0709 19:02:44.995029    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/26f7e025-e3eb-4289-8169-e40c6614d619-kube-rbac-proxy-cm podName:26f7e025-e3eb-4289-8169-e40c6614d619 nodeName:}" failed. No retries permitted until 2026-07-09 19:02:45.995011091 +0000 UTC m=+262.621062413 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/26f7e025-e3eb-4289-8169-e40c6614d619-kube-rbac-proxy-cm") pod "insights-runtime-extractor-c67x7" (UID: "26f7e025-e3eb-4289-8169-e40c6614d619") : configmap "kube-rbac-proxy" not found
Jul 09 19:02:46.002407 ip-10-0-139-134 kubenswrapper[2578]: I0709 19:02:46.002367    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/26f7e025-e3eb-4289-8169-e40c6614d619-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-c67x7\" (UID: \"26f7e025-e3eb-4289-8169-e40c6614d619\") " pod="openshift-insights/insights-runtime-extractor-c67x7"
Jul 09 19:02:46.002407 ip-10-0-139-134 kubenswrapper[2578]: I0709 19:02:46.002406    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/26f7e025-e3eb-4289-8169-e40c6614d619-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-c67x7\" (UID: \"26f7e025-e3eb-4289-8169-e40c6614d619\") " pod="openshift-insights/insights-runtime-extractor-c67x7"
Jul 09 19:02:46.002873 ip-10-0-139-134 kubenswrapper[2578]: E0709 19:02:46.002513    2578 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 09 19:02:46.002873 ip-10-0-139-134 kubenswrapper[2578]: E0709 19:02:46.002517    2578 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 09 19:02:46.002873 ip-10-0-139-134 kubenswrapper[2578]: E0709 19:02:46.002571    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/26f7e025-e3eb-4289-8169-e40c6614d619-kube-rbac-proxy-cm podName:26f7e025-e3eb-4289-8169-e40c6614d619 nodeName:}" failed. No retries permitted until 2026-07-09 19:02:48.002555772 +0000 UTC m=+264.628607082 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/26f7e025-e3eb-4289-8169-e40c6614d619-kube-rbac-proxy-cm") pod "insights-runtime-extractor-c67x7" (UID: "26f7e025-e3eb-4289-8169-e40c6614d619") : configmap "kube-rbac-proxy" not found
Jul 09 19:02:46.002873 ip-10-0-139-134 kubenswrapper[2578]: E0709 19:02:46.002584    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/26f7e025-e3eb-4289-8169-e40c6614d619-insights-runtime-extractor-tls podName:26f7e025-e3eb-4289-8169-e40c6614d619 nodeName:}" failed. No retries permitted until 2026-07-09 19:02:48.002578755 +0000 UTC m=+264.628630063 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/26f7e025-e3eb-4289-8169-e40c6614d619-insights-runtime-extractor-tls") pod "insights-runtime-extractor-c67x7" (UID: "26f7e025-e3eb-4289-8169-e40c6614d619") : secret "insights-runtime-extractor-tls" not found
Jul 09 19:02:46.175734 ip-10-0-139-134 kubenswrapper[2578]: I0709 19:02:46.175705    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-4ntmk_4b9891d4-d137-4996-ba20-f037de730093/dns-node-resolver/0.log"
Jul 09 19:02:47.576477 ip-10-0-139-134 kubenswrapper[2578]: I0709 19:02:47.576454    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-zwps8_d9cc9b31-8c81-490e-911c-692cc55539c1/node-ca/0.log"
Jul 09 19:02:48.017117 ip-10-0-139-134 kubenswrapper[2578]: I0709 19:02:48.017080    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/26f7e025-e3eb-4289-8169-e40c6614d619-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-c67x7\" (UID: \"26f7e025-e3eb-4289-8169-e40c6614d619\") " pod="openshift-insights/insights-runtime-extractor-c67x7"
Jul 09 19:02:48.017363 ip-10-0-139-134 kubenswrapper[2578]: I0709 19:02:48.017171    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/26f7e025-e3eb-4289-8169-e40c6614d619-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-c67x7\" (UID: \"26f7e025-e3eb-4289-8169-e40c6614d619\") " pod="openshift-insights/insights-runtime-extractor-c67x7"
Jul 09 19:02:48.017363 ip-10-0-139-134 kubenswrapper[2578]: E0709 19:02:48.017198    2578 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 09 19:02:48.017363 ip-10-0-139-134 kubenswrapper[2578]: E0709 19:02:48.017258    2578 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 09 19:02:48.017363 ip-10-0-139-134 kubenswrapper[2578]: E0709 19:02:48.017260    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/26f7e025-e3eb-4289-8169-e40c6614d619-kube-rbac-proxy-cm podName:26f7e025-e3eb-4289-8169-e40c6614d619 nodeName:}" failed. No retries permitted until 2026-07-09 19:02:52.017243317 +0000 UTC m=+268.643294625 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/26f7e025-e3eb-4289-8169-e40c6614d619-kube-rbac-proxy-cm") pod "insights-runtime-extractor-c67x7" (UID: "26f7e025-e3eb-4289-8169-e40c6614d619") : configmap "kube-rbac-proxy" not found
Jul 09 19:02:48.017363 ip-10-0-139-134 kubenswrapper[2578]: E0709 19:02:48.017303    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/26f7e025-e3eb-4289-8169-e40c6614d619-insights-runtime-extractor-tls podName:26f7e025-e3eb-4289-8169-e40c6614d619 nodeName:}" failed. No retries permitted until 2026-07-09 19:02:52.017292043 +0000 UTC m=+268.643343354 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/26f7e025-e3eb-4289-8169-e40c6614d619-insights-runtime-extractor-tls") pod "insights-runtime-extractor-c67x7" (UID: "26f7e025-e3eb-4289-8169-e40c6614d619") : secret "insights-runtime-extractor-tls" not found
Jul 09 19:02:48.376225 ip-10-0-139-134 kubenswrapper[2578]: I0709 19:02:48.376141    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-xc6m9_f55f09d8-7f36-4939-bb1c-bb4195e64a93/serve-healthcheck-canary/0.log"
Jul 09 19:02:52.047925 ip-10-0-139-134 kubenswrapper[2578]: I0709 19:02:52.047887    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/26f7e025-e3eb-4289-8169-e40c6614d619-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-c67x7\" (UID: \"26f7e025-e3eb-4289-8169-e40c6614d619\") " pod="openshift-insights/insights-runtime-extractor-c67x7"
Jul 09 19:02:52.047925 ip-10-0-139-134 kubenswrapper[2578]: I0709 19:02:52.047926    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/26f7e025-e3eb-4289-8169-e40c6614d619-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-c67x7\" (UID: \"26f7e025-e3eb-4289-8169-e40c6614d619\") " pod="openshift-insights/insights-runtime-extractor-c67x7"
Jul 09 19:02:52.048335 ip-10-0-139-134 kubenswrapper[2578]: E0709 19:02:52.048022    2578 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 09 19:02:52.048335 ip-10-0-139-134 kubenswrapper[2578]: E0709 19:02:52.048051    2578 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 09 19:02:52.048335 ip-10-0-139-134 kubenswrapper[2578]: E0709 19:02:52.048092    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/26f7e025-e3eb-4289-8169-e40c6614d619-kube-rbac-proxy-cm podName:26f7e025-e3eb-4289-8169-e40c6614d619 nodeName:}" failed. No retries permitted until 2026-07-09 19:03:00.048072079 +0000 UTC m=+276.674123388 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/26f7e025-e3eb-4289-8169-e40c6614d619-kube-rbac-proxy-cm") pod "insights-runtime-extractor-c67x7" (UID: "26f7e025-e3eb-4289-8169-e40c6614d619") : configmap "kube-rbac-proxy" not found
Jul 09 19:02:52.048335 ip-10-0-139-134 kubenswrapper[2578]: E0709 19:02:52.048107    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/26f7e025-e3eb-4289-8169-e40c6614d619-insights-runtime-extractor-tls podName:26f7e025-e3eb-4289-8169-e40c6614d619 nodeName:}" failed. No retries permitted until 2026-07-09 19:03:00.048100829 +0000 UTC m=+276.674152136 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/26f7e025-e3eb-4289-8169-e40c6614d619-insights-runtime-extractor-tls") pod "insights-runtime-extractor-c67x7" (UID: "26f7e025-e3eb-4289-8169-e40c6614d619") : secret "insights-runtime-extractor-tls" not found
Jul 09 19:03:00.108162 ip-10-0-139-134 kubenswrapper[2578]: I0709 19:03:00.108117    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/26f7e025-e3eb-4289-8169-e40c6614d619-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-c67x7\" (UID: \"26f7e025-e3eb-4289-8169-e40c6614d619\") " pod="openshift-insights/insights-runtime-extractor-c67x7"
Jul 09 19:03:00.108162 ip-10-0-139-134 kubenswrapper[2578]: I0709 19:03:00.108167    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/26f7e025-e3eb-4289-8169-e40c6614d619-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-c67x7\" (UID: \"26f7e025-e3eb-4289-8169-e40c6614d619\") " pod="openshift-insights/insights-runtime-extractor-c67x7"
Jul 09 19:03:00.108776 ip-10-0-139-134 kubenswrapper[2578]: I0709 19:03:00.108756    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/26f7e025-e3eb-4289-8169-e40c6614d619-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-c67x7\" (UID: \"26f7e025-e3eb-4289-8169-e40c6614d619\") " pod="openshift-insights/insights-runtime-extractor-c67x7"
Jul 09 19:03:00.110668 ip-10-0-139-134 kubenswrapper[2578]: I0709 19:03:00.110638    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/26f7e025-e3eb-4289-8169-e40c6614d619-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-c67x7\" (UID: \"26f7e025-e3eb-4289-8169-e40c6614d619\") " pod="openshift-insights/insights-runtime-extractor-c67x7"
Jul 09 19:03:00.228785 ip-10-0-139-134 kubenswrapper[2578]: I0709 19:03:00.228748    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-c67x7"
Jul 09 19:03:00.361262 ip-10-0-139-134 kubenswrapper[2578]: I0709 19:03:00.360411    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-c67x7"]
Jul 09 19:03:00.727235 ip-10-0-139-134 kubenswrapper[2578]: I0709 19:03:00.727192    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-c67x7" event={"ID":"26f7e025-e3eb-4289-8169-e40c6614d619","Type":"ContainerStarted","Data":"3d03ccb7c73260ae25434ccf9070b18f8251c45f1b182f2db492e3cf3c33ca37"}
Jul 09 19:03:04.741445 ip-10-0-139-134 kubenswrapper[2578]: I0709 19:03:04.741415    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-c67x7" event={"ID":"26f7e025-e3eb-4289-8169-e40c6614d619","Type":"ContainerStarted","Data":"da3a792bc240a164da391dcfa068ad96b96b094759be17cc44356115d50a0e72"}
Jul 09 19:03:05.746926 ip-10-0-139-134 kubenswrapper[2578]: I0709 19:03:05.746888    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-c67x7" event={"ID":"26f7e025-e3eb-4289-8169-e40c6614d619","Type":"ContainerStarted","Data":"52acc9fe77f1de67e84cb41b5e7dfe10bf8c670a8178b1d515b11e25a4dad988"}
Jul 09 19:03:06.393653 ip-10-0-139-134 kubenswrapper[2578]: E0709 19:03:06.393607    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-pv4p5" podUID="c2465fe4-d9fa-4246-b5e6-399f6dbe9259"
Jul 09 19:03:06.750867 ip-10-0-139-134 kubenswrapper[2578]: I0709 19:03:06.750840    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-pv4p5"
Jul 09 19:03:07.755958 ip-10-0-139-134 kubenswrapper[2578]: I0709 19:03:07.755912    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-c67x7" event={"ID":"26f7e025-e3eb-4289-8169-e40c6614d619","Type":"ContainerStarted","Data":"ddbed210de4b1db1c957e7be71b4992e7961464a4aa5cf056c3edb8ba467bc1c"}
Jul 09 19:03:07.774469 ip-10-0-139-134 kubenswrapper[2578]: I0709 19:03:07.774418    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-c67x7" podStartSLOduration=17.023805062 podStartE2EDuration="23.77440116s" totalImagesPullingTime="6.750596098s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-09 19:02:44 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 19:03:07.773587315 +0000 UTC m=+284.399638666" watchObservedRunningTime="2026-07-09 19:03:07.77440116 +0000 UTC m=+284.400452489"
Jul 09 19:03:09.672576 ip-10-0-139-134 kubenswrapper[2578]: I0709 19:03:09.672534    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/c2465fe4-d9fa-4246-b5e6-399f6dbe9259-metrics-tls\") pod \"dns-default-pv4p5\" (UID: \"c2465fe4-d9fa-4246-b5e6-399f6dbe9259\") " pod="openshift-dns/dns-default-pv4p5"
Jul 09 19:03:09.675059 ip-10-0-139-134 kubenswrapper[2578]: I0709 19:03:09.675034    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/c2465fe4-d9fa-4246-b5e6-399f6dbe9259-metrics-tls\") pod \"dns-default-pv4p5\" (UID: \"c2465fe4-d9fa-4246-b5e6-399f6dbe9259\") " pod="openshift-dns/dns-default-pv4p5"
Jul 09 19:03:09.754767 ip-10-0-139-134 kubenswrapper[2578]: I0709 19:03:09.754731    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-bw6lk\""
Jul 09 19:03:09.762168 ip-10-0-139-134 kubenswrapper[2578]: I0709 19:03:09.762148    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-pv4p5"
Jul 09 19:03:09.888758 ip-10-0-139-134 kubenswrapper[2578]: I0709 19:03:09.888727    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-pv4p5"]
Jul 09 19:03:09.891611 ip-10-0-139-134 kubenswrapper[2578]: W0709 19:03:09.891580    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc2465fe4_d9fa_4246_b5e6_399f6dbe9259.slice/crio-2af4cc637674880846e061be35808c0ee42a4c67ddb6dd4ca7f564cf3dace5df WatchSource:0}: Error finding container 2af4cc637674880846e061be35808c0ee42a4c67ddb6dd4ca7f564cf3dace5df: Status 404 returned error can't find the container with id 2af4cc637674880846e061be35808c0ee42a4c67ddb6dd4ca7f564cf3dace5df
Jul 09 19:03:10.766874 ip-10-0-139-134 kubenswrapper[2578]: I0709 19:03:10.766838    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-pv4p5" event={"ID":"c2465fe4-d9fa-4246-b5e6-399f6dbe9259","Type":"ContainerStarted","Data":"2af4cc637674880846e061be35808c0ee42a4c67ddb6dd4ca7f564cf3dace5df"}
Jul 09 19:03:11.772078 ip-10-0-139-134 kubenswrapper[2578]: I0709 19:03:11.771966    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-pv4p5" event={"ID":"c2465fe4-d9fa-4246-b5e6-399f6dbe9259","Type":"ContainerStarted","Data":"8c5b8f07d80a71bf2e327b5f9fb488648978ebd4613a1a2856aef1423ca0312d"}
Jul 09 19:03:11.772078 ip-10-0-139-134 kubenswrapper[2578]: I0709 19:03:11.772040    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-pv4p5" event={"ID":"c2465fe4-d9fa-4246-b5e6-399f6dbe9259","Type":"ContainerStarted","Data":"18cff65dfec2b9970d4a399d003dc70b806b189f034611447e3b4192561130cb"}
Jul 09 19:03:11.772474 ip-10-0-139-134 kubenswrapper[2578]: I0709 19:03:11.772125    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-pv4p5"
Jul 09 19:03:11.790493 ip-10-0-139-134 kubenswrapper[2578]: I0709 19:03:11.790440    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-pv4p5" podStartSLOduration=251.27842944 podStartE2EDuration="4m12.790424113s" totalImagesPullingTime="1.511994673s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 18:58:59 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 19:03:11.788361553 +0000 UTC m=+288.414412903" watchObservedRunningTime="2026-07-09 19:03:11.790424113 +0000 UTC m=+288.416475442"
Jul 09 19:03:14.517891 ip-10-0-139-134 kubenswrapper[2578]: I0709 19:03:14.517854    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-77d98bc786-qnmnx"]
Jul 09 19:03:14.520540 ip-10-0-139-134 kubenswrapper[2578]: I0709 19:03:14.520516    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-77d98bc786-qnmnx"
Jul 09 19:03:14.523438 ip-10-0-139-134 kubenswrapper[2578]: I0709 19:03:14.523419    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-dockercfg-x9jrz\""
Jul 09 19:03:14.523536 ip-10-0-139-134 kubenswrapper[2578]: I0709 19:03:14.523417    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-tls\""
Jul 09 19:03:14.528289 ip-10-0-139-134 kubenswrapper[2578]: I0709 19:03:14.528266    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-77d98bc786-qnmnx"]
Jul 09 19:03:14.606818 ip-10-0-139-134 kubenswrapper[2578]: I0709 19:03:14.606782    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/3368ad15-6140-4fbe-9d0e-dc8604ddfef0-tls-certificates\") pod \"prometheus-operator-admission-webhook-77d98bc786-qnmnx\" (UID: \"3368ad15-6140-4fbe-9d0e-dc8604ddfef0\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-77d98bc786-qnmnx"
Jul 09 19:03:14.707312 ip-10-0-139-134 kubenswrapper[2578]: I0709 19:03:14.707272    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/3368ad15-6140-4fbe-9d0e-dc8604ddfef0-tls-certificates\") pod \"prometheus-operator-admission-webhook-77d98bc786-qnmnx\" (UID: \"3368ad15-6140-4fbe-9d0e-dc8604ddfef0\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-77d98bc786-qnmnx"
Jul 09 19:03:14.709799 ip-10-0-139-134 kubenswrapper[2578]: I0709 19:03:14.709777    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/3368ad15-6140-4fbe-9d0e-dc8604ddfef0-tls-certificates\") pod \"prometheus-operator-admission-webhook-77d98bc786-qnmnx\" (UID: \"3368ad15-6140-4fbe-9d0e-dc8604ddfef0\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-77d98bc786-qnmnx"
Jul 09 19:03:14.829321 ip-10-0-139-134 kubenswrapper[2578]: I0709 19:03:14.829232    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-77d98bc786-qnmnx"
Jul 09 19:03:14.955408 ip-10-0-139-134 kubenswrapper[2578]: I0709 19:03:14.955373    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-77d98bc786-qnmnx"]
Jul 09 19:03:14.958361 ip-10-0-139-134 kubenswrapper[2578]: W0709 19:03:14.958334    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3368ad15_6140_4fbe_9d0e_dc8604ddfef0.slice/crio-00cf24db407f7cfafe60d79f93c099d5a58c415f534655f5945b451145c360b9 WatchSource:0}: Error finding container 00cf24db407f7cfafe60d79f93c099d5a58c415f534655f5945b451145c360b9: Status 404 returned error can't find the container with id 00cf24db407f7cfafe60d79f93c099d5a58c415f534655f5945b451145c360b9
Jul 09 19:03:15.786778 ip-10-0-139-134 kubenswrapper[2578]: I0709 19:03:15.786734    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-77d98bc786-qnmnx" event={"ID":"3368ad15-6140-4fbe-9d0e-dc8604ddfef0","Type":"ContainerStarted","Data":"00cf24db407f7cfafe60d79f93c099d5a58c415f534655f5945b451145c360b9"}
Jul 09 19:03:16.790845 ip-10-0-139-134 kubenswrapper[2578]: I0709 19:03:16.790809    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-77d98bc786-qnmnx" event={"ID":"3368ad15-6140-4fbe-9d0e-dc8604ddfef0","Type":"ContainerStarted","Data":"0e04d196ca2993e44cfaeba5fe7bbdf5b639ec6140730e57b4ea8d6243189c59"}
Jul 09 19:03:16.791263 ip-10-0-139-134 kubenswrapper[2578]: I0709 19:03:16.791042    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-77d98bc786-qnmnx"
Jul 09 19:03:16.795621 ip-10-0-139-134 kubenswrapper[2578]: I0709 19:03:16.795597    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-77d98bc786-qnmnx"
Jul 09 19:03:16.807764 ip-10-0-139-134 kubenswrapper[2578]: I0709 19:03:16.807719    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-admission-webhook-77d98bc786-qnmnx" podStartSLOduration=1.852695768 podStartE2EDuration="2.807704944s" totalImagesPullingTime="955.009176ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 19:03:14 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 19:03:16.8068738 +0000 UTC m=+293.432925149" watchObservedRunningTime="2026-07-09 19:03:16.807704944 +0000 UTC m=+293.433756275"
Jul 09 19:03:19.834377 ip-10-0-139-134 kubenswrapper[2578]: E0709 19:03:19.834332    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-certs], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-multus/network-metrics-daemon-dztbt" podUID="a6f6e738-06b0-41d1-bcc4-3627871fe3d6"
Jul 09 19:03:21.777798 ip-10-0-139-134 kubenswrapper[2578]: I0709 19:03:21.777769    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-pv4p5"
Jul 09 19:03:22.942488 ip-10-0-139-134 kubenswrapper[2578]: I0709 19:03:22.942455    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-p4k7z"]
Jul 09 19:03:22.946858 ip-10-0-139-134 kubenswrapper[2578]: I0709 19:03:22.946839    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-p4k7z"
Jul 09 19:03:22.950040 ip-10-0-139-134 kubenswrapper[2578]: I0709 19:03:22.950017    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-fv76w\""
Jul 09 19:03:22.950296 ip-10-0-139-134 kubenswrapper[2578]: I0709 19:03:22.950276    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\""
Jul 09 19:03:22.950545 ip-10-0-139-134 kubenswrapper[2578]: I0709 19:03:22.950527    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\""
Jul 09 19:03:22.950646 ip-10-0-139-134 kubenswrapper[2578]: I0709 19:03:22.950589    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\""
Jul 09 19:03:22.951415 ip-10-0-139-134 kubenswrapper[2578]: I0709 19:03:22.951398    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\""
Jul 09 19:03:22.951679 ip-10-0-139-134 kubenswrapper[2578]: I0709 19:03:22.951660    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\""
Jul 09 19:03:22.951774 ip-10-0-139-134 kubenswrapper[2578]: I0709 19:03:22.951696    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\""
Jul 09 19:03:22.971043 ip-10-0-139-134 kubenswrapper[2578]: I0709 19:03:22.970974    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/35211644-b8a6-419d-ba70-a479f336e1a6-node-exporter-accelerators-collector-config\") pod \"node-exporter-p4k7z\" (UID: \"35211644-b8a6-419d-ba70-a479f336e1a6\") " pod="openshift-monitoring/node-exporter-p4k7z"
Jul 09 19:03:22.971215 ip-10-0-139-134 kubenswrapper[2578]: I0709 19:03:22.971071    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/35211644-b8a6-419d-ba70-a479f336e1a6-sys\") pod \"node-exporter-p4k7z\" (UID: \"35211644-b8a6-419d-ba70-a479f336e1a6\") " pod="openshift-monitoring/node-exporter-p4k7z"
Jul 09 19:03:22.971215 ip-10-0-139-134 kubenswrapper[2578]: I0709 19:03:22.971105    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-z99nj\" (UniqueName: \"kubernetes.io/projected/35211644-b8a6-419d-ba70-a479f336e1a6-kube-api-access-z99nj\") pod \"node-exporter-p4k7z\" (UID: \"35211644-b8a6-419d-ba70-a479f336e1a6\") " pod="openshift-monitoring/node-exporter-p4k7z"
Jul 09 19:03:22.971215 ip-10-0-139-134 kubenswrapper[2578]: I0709 19:03:22.971131    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/35211644-b8a6-419d-ba70-a479f336e1a6-node-exporter-tls\") pod \"node-exporter-p4k7z\" (UID: \"35211644-b8a6-419d-ba70-a479f336e1a6\") " pod="openshift-monitoring/node-exporter-p4k7z"
Jul 09 19:03:22.971382 ip-10-0-139-134 kubenswrapper[2578]: I0709 19:03:22.971237    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/35211644-b8a6-419d-ba70-a479f336e1a6-metrics-client-ca\") pod \"node-exporter-p4k7z\" (UID: \"35211644-b8a6-419d-ba70-a479f336e1a6\") " pod="openshift-monitoring/node-exporter-p4k7z"
Jul 09 19:03:22.971382 ip-10-0-139-134 kubenswrapper[2578]: I0709 19:03:22.971298    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/35211644-b8a6-419d-ba70-a479f336e1a6-node-exporter-wtmp\") pod \"node-exporter-p4k7z\" (UID: \"35211644-b8a6-419d-ba70-a479f336e1a6\") " pod="openshift-monitoring/node-exporter-p4k7z"
Jul 09 19:03:22.971382 ip-10-0-139-134 kubenswrapper[2578]: I0709 19:03:22.971331    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/35211644-b8a6-419d-ba70-a479f336e1a6-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-p4k7z\" (UID: \"35211644-b8a6-419d-ba70-a479f336e1a6\") " pod="openshift-monitoring/node-exporter-p4k7z"
Jul 09 19:03:22.971382 ip-10-0-139-134 kubenswrapper[2578]: I0709 19:03:22.971363    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/35211644-b8a6-419d-ba70-a479f336e1a6-node-exporter-textfile\") pod \"node-exporter-p4k7z\" (UID: \"35211644-b8a6-419d-ba70-a479f336e1a6\") " pod="openshift-monitoring/node-exporter-p4k7z"
Jul 09 19:03:22.971504 ip-10-0-139-134 kubenswrapper[2578]: I0709 19:03:22.971420    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/35211644-b8a6-419d-ba70-a479f336e1a6-root\") pod \"node-exporter-p4k7z\" (UID: \"35211644-b8a6-419d-ba70-a479f336e1a6\") " pod="openshift-monitoring/node-exporter-p4k7z"
Jul 09 19:03:23.072097 ip-10-0-139-134 kubenswrapper[2578]: I0709 19:03:23.072063    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/35211644-b8a6-419d-ba70-a479f336e1a6-sys\") pod \"node-exporter-p4k7z\" (UID: \"35211644-b8a6-419d-ba70-a479f336e1a6\") " pod="openshift-monitoring/node-exporter-p4k7z"
Jul 09 19:03:23.072274 ip-10-0-139-134 kubenswrapper[2578]: I0709 19:03:23.072108    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-z99nj\" (UniqueName: \"kubernetes.io/projected/35211644-b8a6-419d-ba70-a479f336e1a6-kube-api-access-z99nj\") pod \"node-exporter-p4k7z\" (UID: \"35211644-b8a6-419d-ba70-a479f336e1a6\") " pod="openshift-monitoring/node-exporter-p4k7z"
Jul 09 19:03:23.072274 ip-10-0-139-134 kubenswrapper[2578]: I0709 19:03:23.072128    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/35211644-b8a6-419d-ba70-a479f336e1a6-node-exporter-tls\") pod \"node-exporter-p4k7z\" (UID: \"35211644-b8a6-419d-ba70-a479f336e1a6\") " pod="openshift-monitoring/node-exporter-p4k7z"
Jul 09 19:03:23.072274 ip-10-0-139-134 kubenswrapper[2578]: I0709 19:03:23.072172    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/35211644-b8a6-419d-ba70-a479f336e1a6-metrics-client-ca\") pod \"node-exporter-p4k7z\" (UID: \"35211644-b8a6-419d-ba70-a479f336e1a6\") " pod="openshift-monitoring/node-exporter-p4k7z"
Jul 09 19:03:23.072274 ip-10-0-139-134 kubenswrapper[2578]: I0709 19:03:23.072190    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/35211644-b8a6-419d-ba70-a479f336e1a6-sys\") pod \"node-exporter-p4k7z\" (UID: \"35211644-b8a6-419d-ba70-a479f336e1a6\") " pod="openshift-monitoring/node-exporter-p4k7z"
Jul 09 19:03:23.072274 ip-10-0-139-134 kubenswrapper[2578]: I0709 19:03:23.072202    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/35211644-b8a6-419d-ba70-a479f336e1a6-node-exporter-wtmp\") pod \"node-exporter-p4k7z\" (UID: \"35211644-b8a6-419d-ba70-a479f336e1a6\") " pod="openshift-monitoring/node-exporter-p4k7z"
Jul 09 19:03:23.072274 ip-10-0-139-134 kubenswrapper[2578]: I0709 19:03:23.072228    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/35211644-b8a6-419d-ba70-a479f336e1a6-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-p4k7z\" (UID: \"35211644-b8a6-419d-ba70-a479f336e1a6\") " pod="openshift-monitoring/node-exporter-p4k7z"
Jul 09 19:03:23.072274 ip-10-0-139-134 kubenswrapper[2578]: I0709 19:03:23.072250    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/35211644-b8a6-419d-ba70-a479f336e1a6-node-exporter-textfile\") pod \"node-exporter-p4k7z\" (UID: \"35211644-b8a6-419d-ba70-a479f336e1a6\") " pod="openshift-monitoring/node-exporter-p4k7z"
Jul 09 19:03:23.072274 ip-10-0-139-134 kubenswrapper[2578]: I0709 19:03:23.072272    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/35211644-b8a6-419d-ba70-a479f336e1a6-root\") pod \"node-exporter-p4k7z\" (UID: \"35211644-b8a6-419d-ba70-a479f336e1a6\") " pod="openshift-monitoring/node-exporter-p4k7z"
Jul 09 19:03:23.072626 ip-10-0-139-134 kubenswrapper[2578]: I0709 19:03:23.072300    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/35211644-b8a6-419d-ba70-a479f336e1a6-node-exporter-accelerators-collector-config\") pod \"node-exporter-p4k7z\" (UID: \"35211644-b8a6-419d-ba70-a479f336e1a6\") " pod="openshift-monitoring/node-exporter-p4k7z"
Jul 09 19:03:23.072626 ip-10-0-139-134 kubenswrapper[2578]: I0709 19:03:23.072364    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/35211644-b8a6-419d-ba70-a479f336e1a6-node-exporter-wtmp\") pod \"node-exporter-p4k7z\" (UID: \"35211644-b8a6-419d-ba70-a479f336e1a6\") " pod="openshift-monitoring/node-exporter-p4k7z"
Jul 09 19:03:23.072626 ip-10-0-139-134 kubenswrapper[2578]: I0709 19:03:23.072376    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/35211644-b8a6-419d-ba70-a479f336e1a6-root\") pod \"node-exporter-p4k7z\" (UID: \"35211644-b8a6-419d-ba70-a479f336e1a6\") " pod="openshift-monitoring/node-exporter-p4k7z"
Jul 09 19:03:23.072773 ip-10-0-139-134 kubenswrapper[2578]: I0709 19:03:23.072706    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/35211644-b8a6-419d-ba70-a479f336e1a6-node-exporter-textfile\") pod \"node-exporter-p4k7z\" (UID: \"35211644-b8a6-419d-ba70-a479f336e1a6\") " pod="openshift-monitoring/node-exporter-p4k7z"
Jul 09 19:03:23.072907 ip-10-0-139-134 kubenswrapper[2578]: I0709 19:03:23.072881    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/35211644-b8a6-419d-ba70-a479f336e1a6-node-exporter-accelerators-collector-config\") pod \"node-exporter-p4k7z\" (UID: \"35211644-b8a6-419d-ba70-a479f336e1a6\") " pod="openshift-monitoring/node-exporter-p4k7z"
Jul 09 19:03:23.073038 ip-10-0-139-134 kubenswrapper[2578]: I0709 19:03:23.072881    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/35211644-b8a6-419d-ba70-a479f336e1a6-metrics-client-ca\") pod \"node-exporter-p4k7z\" (UID: \"35211644-b8a6-419d-ba70-a479f336e1a6\") " pod="openshift-monitoring/node-exporter-p4k7z"
Jul 09 19:03:23.074825 ip-10-0-139-134 kubenswrapper[2578]: I0709 19:03:23.074794    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/35211644-b8a6-419d-ba70-a479f336e1a6-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-p4k7z\" (UID: \"35211644-b8a6-419d-ba70-a479f336e1a6\") " pod="openshift-monitoring/node-exporter-p4k7z"
Jul 09 19:03:23.074942 ip-10-0-139-134 kubenswrapper[2578]: I0709 19:03:23.074926    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/35211644-b8a6-419d-ba70-a479f336e1a6-node-exporter-tls\") pod \"node-exporter-p4k7z\" (UID: \"35211644-b8a6-419d-ba70-a479f336e1a6\") " pod="openshift-monitoring/node-exporter-p4k7z"
Jul 09 19:03:23.081554 ip-10-0-139-134 kubenswrapper[2578]: I0709 19:03:23.081524    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-z99nj\" (UniqueName: \"kubernetes.io/projected/35211644-b8a6-419d-ba70-a479f336e1a6-kube-api-access-z99nj\") pod \"node-exporter-p4k7z\" (UID: \"35211644-b8a6-419d-ba70-a479f336e1a6\") " pod="openshift-monitoring/node-exporter-p4k7z"
Jul 09 19:03:23.255769 ip-10-0-139-134 kubenswrapper[2578]: I0709 19:03:23.255675    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-p4k7z"
Jul 09 19:03:23.265632 ip-10-0-139-134 kubenswrapper[2578]: W0709 19:03:23.265600    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod35211644_b8a6_419d_ba70_a479f336e1a6.slice/crio-baa4f867774bab1854a5005f7d9621faad910d587d8dfe4af6afcf67d5af2818 WatchSource:0}: Error finding container baa4f867774bab1854a5005f7d9621faad910d587d8dfe4af6afcf67d5af2818: Status 404 returned error can't find the container with id baa4f867774bab1854a5005f7d9621faad910d587d8dfe4af6afcf67d5af2818
Jul 09 19:03:23.777882 ip-10-0-139-134 kubenswrapper[2578]: I0709 19:03:23.777855    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-8gqbs_7a15b7a9-7525-426b-a051-3ece178b71bc/ovn-acl-logging/0.log"
Jul 09 19:03:23.778088 ip-10-0-139-134 kubenswrapper[2578]: I0709 19:03:23.778034    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-8gqbs_7a15b7a9-7525-426b-a051-3ece178b71bc/ovn-acl-logging/0.log"
Jul 09 19:03:23.782734 ip-10-0-139-134 kubenswrapper[2578]: I0709 19:03:23.782707    2578 kubelet.go:1648] "Image garbage collection succeeded"
Jul 09 19:03:23.816429 ip-10-0-139-134 kubenswrapper[2578]: I0709 19:03:23.816393    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-p4k7z" event={"ID":"35211644-b8a6-419d-ba70-a479f336e1a6","Type":"ContainerStarted","Data":"baa4f867774bab1854a5005f7d9621faad910d587d8dfe4af6afcf67d5af2818"}
Jul 09 19:03:24.822065 ip-10-0-139-134 kubenswrapper[2578]: I0709 19:03:24.822027    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-p4k7z" event={"ID":"35211644-b8a6-419d-ba70-a479f336e1a6","Type":"ContainerStarted","Data":"d1efa5b0a99060a3a66fde4511d4369cfd08d7fc2b1c25ffab4a4d638a0e15b4"}
Jul 09 19:03:25.827423 ip-10-0-139-134 kubenswrapper[2578]: I0709 19:03:25.827390    2578 generic.go:356] "Generic (PLEG): container finished" podID="35211644-b8a6-419d-ba70-a479f336e1a6" containerID="d1efa5b0a99060a3a66fde4511d4369cfd08d7fc2b1c25ffab4a4d638a0e15b4" exitCode=0
Jul 09 19:03:25.827781 ip-10-0-139-134 kubenswrapper[2578]: I0709 19:03:25.827456    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-p4k7z" event={"ID":"35211644-b8a6-419d-ba70-a479f336e1a6","Type":"ContainerDied","Data":"d1efa5b0a99060a3a66fde4511d4369cfd08d7fc2b1c25ffab4a4d638a0e15b4"}
Jul 09 19:03:26.832929 ip-10-0-139-134 kubenswrapper[2578]: I0709 19:03:26.832892    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-p4k7z" event={"ID":"35211644-b8a6-419d-ba70-a479f336e1a6","Type":"ContainerStarted","Data":"84443ec8bce0d568ce3636962df53c8fdca2753bdd3fa20bdd5921ce86038678"}
Jul 09 19:03:26.833379 ip-10-0-139-134 kubenswrapper[2578]: I0709 19:03:26.832950    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-p4k7z" event={"ID":"35211644-b8a6-419d-ba70-a479f336e1a6","Type":"ContainerStarted","Data":"b7fc09ebed58b9b9cd156c868049a7b92d277e9e956480f01f6e7804c0e4658e"}
Jul 09 19:03:26.863315 ip-10-0-139-134 kubenswrapper[2578]: I0709 19:03:26.860727    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-p4k7z" podStartSLOduration=3.381587483 podStartE2EDuration="4.86070661s" totalImagesPullingTime="1.404534511s" totalInitContainerRuntime="74.584616ms" isStatefulPod=true podCreationTimestamp="2026-07-09 19:03:22 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 19:03:26.857955862 +0000 UTC m=+303.484007209" watchObservedRunningTime="2026-07-09 19:03:26.86070661 +0000 UTC m=+303.486757943"
Jul 09 19:03:27.223339 ip-10-0-139-134 kubenswrapper[2578]: I0709 19:03:27.223302    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/metrics-server-b94fdbcb7-mvzzq"]
Jul 09 19:03:27.331876 ip-10-0-139-134 kubenswrapper[2578]: I0709 19:03:27.331827    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-b94fdbcb7-mvzzq"]
Jul 09 19:03:27.332053 ip-10-0-139-134 kubenswrapper[2578]: I0709 19:03:27.331960    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-b94fdbcb7-mvzzq"
Jul 09 19:03:27.335475 ip-10-0-139-134 kubenswrapper[2578]: I0709 19:03:27.335450    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-server-audit-profiles\""
Jul 09 19:03:27.335615 ip-10-0-139-134 kubenswrapper[2578]: I0709 19:03:27.335516    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-dockercfg-x6v7j\""
Jul 09 19:03:27.335615 ip-10-0-139-134 kubenswrapper[2578]: I0709 19:03:27.335544    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-tls\""
Jul 09 19:03:27.337134 ip-10-0-139-134 kubenswrapper[2578]: I0709 19:03:27.337112    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\""
Jul 09 19:03:27.337323 ip-10-0-139-134 kubenswrapper[2578]: I0709 19:03:27.337182    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-client-certs\""
Jul 09 19:03:27.337494 ip-10-0-139-134 kubenswrapper[2578]: I0709 19:03:27.337478    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-6qes7brq2rd1m\""
Jul 09 19:03:27.405930 ip-10-0-139-134 kubenswrapper[2578]: I0709 19:03:27.405892    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/fafccd77-fb57-4fbe-8b15-ff8ec7cd9737-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-b94fdbcb7-mvzzq\" (UID: \"fafccd77-fb57-4fbe-8b15-ff8ec7cd9737\") " pod="openshift-monitoring/metrics-server-b94fdbcb7-mvzzq"
Jul 09 19:03:27.405930 ip-10-0-139-134 kubenswrapper[2578]: I0709 19:03:27.405932    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/fafccd77-fb57-4fbe-8b15-ff8ec7cd9737-client-ca-bundle\") pod \"metrics-server-b94fdbcb7-mvzzq\" (UID: \"fafccd77-fb57-4fbe-8b15-ff8ec7cd9737\") " pod="openshift-monitoring/metrics-server-b94fdbcb7-mvzzq"
Jul 09 19:03:27.406154 ip-10-0-139-134 kubenswrapper[2578]: I0709 19:03:27.405954    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/fafccd77-fb57-4fbe-8b15-ff8ec7cd9737-secret-metrics-server-tls\") pod \"metrics-server-b94fdbcb7-mvzzq\" (UID: \"fafccd77-fb57-4fbe-8b15-ff8ec7cd9737\") " pod="openshift-monitoring/metrics-server-b94fdbcb7-mvzzq"
Jul 09 19:03:27.406154 ip-10-0-139-134 kubenswrapper[2578]: I0709 19:03:27.406031    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zsrdz\" (UniqueName: \"kubernetes.io/projected/fafccd77-fb57-4fbe-8b15-ff8ec7cd9737-kube-api-access-zsrdz\") pod \"metrics-server-b94fdbcb7-mvzzq\" (UID: \"fafccd77-fb57-4fbe-8b15-ff8ec7cd9737\") " pod="openshift-monitoring/metrics-server-b94fdbcb7-mvzzq"
Jul 09 19:03:27.406154 ip-10-0-139-134 kubenswrapper[2578]: I0709 19:03:27.406060    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/fafccd77-fb57-4fbe-8b15-ff8ec7cd9737-audit-log\") pod \"metrics-server-b94fdbcb7-mvzzq\" (UID: \"fafccd77-fb57-4fbe-8b15-ff8ec7cd9737\") " pod="openshift-monitoring/metrics-server-b94fdbcb7-mvzzq"
Jul 09 19:03:27.406154 ip-10-0-139-134 kubenswrapper[2578]: I0709 19:03:27.406076    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/fafccd77-fb57-4fbe-8b15-ff8ec7cd9737-metrics-server-audit-profiles\") pod \"metrics-server-b94fdbcb7-mvzzq\" (UID: \"fafccd77-fb57-4fbe-8b15-ff8ec7cd9737\") " pod="openshift-monitoring/metrics-server-b94fdbcb7-mvzzq"
Jul 09 19:03:27.406154 ip-10-0-139-134 kubenswrapper[2578]: I0709 19:03:27.406108    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/fafccd77-fb57-4fbe-8b15-ff8ec7cd9737-secret-metrics-server-client-certs\") pod \"metrics-server-b94fdbcb7-mvzzq\" (UID: \"fafccd77-fb57-4fbe-8b15-ff8ec7cd9737\") " pod="openshift-monitoring/metrics-server-b94fdbcb7-mvzzq"
Jul 09 19:03:27.507302 ip-10-0-139-134 kubenswrapper[2578]: I0709 19:03:27.507217    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/fafccd77-fb57-4fbe-8b15-ff8ec7cd9737-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-b94fdbcb7-mvzzq\" (UID: \"fafccd77-fb57-4fbe-8b15-ff8ec7cd9737\") " pod="openshift-monitoring/metrics-server-b94fdbcb7-mvzzq"
Jul 09 19:03:27.507302 ip-10-0-139-134 kubenswrapper[2578]: I0709 19:03:27.507251    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/fafccd77-fb57-4fbe-8b15-ff8ec7cd9737-client-ca-bundle\") pod \"metrics-server-b94fdbcb7-mvzzq\" (UID: \"fafccd77-fb57-4fbe-8b15-ff8ec7cd9737\") " pod="openshift-monitoring/metrics-server-b94fdbcb7-mvzzq"
Jul 09 19:03:27.507302 ip-10-0-139-134 kubenswrapper[2578]: I0709 19:03:27.507274    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/fafccd77-fb57-4fbe-8b15-ff8ec7cd9737-secret-metrics-server-tls\") pod \"metrics-server-b94fdbcb7-mvzzq\" (UID: \"fafccd77-fb57-4fbe-8b15-ff8ec7cd9737\") " pod="openshift-monitoring/metrics-server-b94fdbcb7-mvzzq"
Jul 09 19:03:27.507588 ip-10-0-139-134 kubenswrapper[2578]: I0709 19:03:27.507309    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zsrdz\" (UniqueName: \"kubernetes.io/projected/fafccd77-fb57-4fbe-8b15-ff8ec7cd9737-kube-api-access-zsrdz\") pod \"metrics-server-b94fdbcb7-mvzzq\" (UID: \"fafccd77-fb57-4fbe-8b15-ff8ec7cd9737\") " pod="openshift-monitoring/metrics-server-b94fdbcb7-mvzzq"
Jul 09 19:03:27.507588 ip-10-0-139-134 kubenswrapper[2578]: I0709 19:03:27.507339    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/fafccd77-fb57-4fbe-8b15-ff8ec7cd9737-audit-log\") pod \"metrics-server-b94fdbcb7-mvzzq\" (UID: \"fafccd77-fb57-4fbe-8b15-ff8ec7cd9737\") " pod="openshift-monitoring/metrics-server-b94fdbcb7-mvzzq"
Jul 09 19:03:27.507588 ip-10-0-139-134 kubenswrapper[2578]: I0709 19:03:27.507362    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/fafccd77-fb57-4fbe-8b15-ff8ec7cd9737-metrics-server-audit-profiles\") pod \"metrics-server-b94fdbcb7-mvzzq\" (UID: \"fafccd77-fb57-4fbe-8b15-ff8ec7cd9737\") " pod="openshift-monitoring/metrics-server-b94fdbcb7-mvzzq"
Jul 09 19:03:27.507588 ip-10-0-139-134 kubenswrapper[2578]: I0709 19:03:27.507395    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/fafccd77-fb57-4fbe-8b15-ff8ec7cd9737-secret-metrics-server-client-certs\") pod \"metrics-server-b94fdbcb7-mvzzq\" (UID: \"fafccd77-fb57-4fbe-8b15-ff8ec7cd9737\") " pod="openshift-monitoring/metrics-server-b94fdbcb7-mvzzq"
Jul 09 19:03:27.507862 ip-10-0-139-134 kubenswrapper[2578]: I0709 19:03:27.507841    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/fafccd77-fb57-4fbe-8b15-ff8ec7cd9737-audit-log\") pod \"metrics-server-b94fdbcb7-mvzzq\" (UID: \"fafccd77-fb57-4fbe-8b15-ff8ec7cd9737\") " pod="openshift-monitoring/metrics-server-b94fdbcb7-mvzzq"
Jul 09 19:03:27.508069 ip-10-0-139-134 kubenswrapper[2578]: I0709 19:03:27.508049    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/fafccd77-fb57-4fbe-8b15-ff8ec7cd9737-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-b94fdbcb7-mvzzq\" (UID: \"fafccd77-fb57-4fbe-8b15-ff8ec7cd9737\") " pod="openshift-monitoring/metrics-server-b94fdbcb7-mvzzq"
Jul 09 19:03:27.508683 ip-10-0-139-134 kubenswrapper[2578]: I0709 19:03:27.508659    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/fafccd77-fb57-4fbe-8b15-ff8ec7cd9737-metrics-server-audit-profiles\") pod \"metrics-server-b94fdbcb7-mvzzq\" (UID: \"fafccd77-fb57-4fbe-8b15-ff8ec7cd9737\") " pod="openshift-monitoring/metrics-server-b94fdbcb7-mvzzq"
Jul 09 19:03:27.510072 ip-10-0-139-134 kubenswrapper[2578]: I0709 19:03:27.510050    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/fafccd77-fb57-4fbe-8b15-ff8ec7cd9737-secret-metrics-server-client-certs\") pod \"metrics-server-b94fdbcb7-mvzzq\" (UID: \"fafccd77-fb57-4fbe-8b15-ff8ec7cd9737\") " pod="openshift-monitoring/metrics-server-b94fdbcb7-mvzzq"
Jul 09 19:03:27.510391 ip-10-0-139-134 kubenswrapper[2578]: I0709 19:03:27.510375    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/fafccd77-fb57-4fbe-8b15-ff8ec7cd9737-secret-metrics-server-tls\") pod \"metrics-server-b94fdbcb7-mvzzq\" (UID: \"fafccd77-fb57-4fbe-8b15-ff8ec7cd9737\") " pod="openshift-monitoring/metrics-server-b94fdbcb7-mvzzq"
Jul 09 19:03:27.510472 ip-10-0-139-134 kubenswrapper[2578]: I0709 19:03:27.510457    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/fafccd77-fb57-4fbe-8b15-ff8ec7cd9737-client-ca-bundle\") pod \"metrics-server-b94fdbcb7-mvzzq\" (UID: \"fafccd77-fb57-4fbe-8b15-ff8ec7cd9737\") " pod="openshift-monitoring/metrics-server-b94fdbcb7-mvzzq"
Jul 09 19:03:27.516111 ip-10-0-139-134 kubenswrapper[2578]: I0709 19:03:27.516088    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zsrdz\" (UniqueName: \"kubernetes.io/projected/fafccd77-fb57-4fbe-8b15-ff8ec7cd9737-kube-api-access-zsrdz\") pod \"metrics-server-b94fdbcb7-mvzzq\" (UID: \"fafccd77-fb57-4fbe-8b15-ff8ec7cd9737\") " pod="openshift-monitoring/metrics-server-b94fdbcb7-mvzzq"
Jul 09 19:03:27.641464 ip-10-0-139-134 kubenswrapper[2578]: I0709 19:03:27.641425    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-b94fdbcb7-mvzzq"
Jul 09 19:03:27.818823 ip-10-0-139-134 kubenswrapper[2578]: I0709 19:03:27.818790    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-b94fdbcb7-mvzzq"]
Jul 09 19:03:27.822502 ip-10-0-139-134 kubenswrapper[2578]: W0709 19:03:27.822477    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfafccd77_fb57_4fbe_8b15_ff8ec7cd9737.slice/crio-d0c4c20543031a9c21ab4d507299bccbc1ad824c49d102b789cdee8ea1ab4e58 WatchSource:0}: Error finding container d0c4c20543031a9c21ab4d507299bccbc1ad824c49d102b789cdee8ea1ab4e58: Status 404 returned error can't find the container with id d0c4c20543031a9c21ab4d507299bccbc1ad824c49d102b789cdee8ea1ab4e58
Jul 09 19:03:27.824483 ip-10-0-139-134 kubenswrapper[2578]: I0709 19:03:27.824466    2578 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 09 19:03:27.837101 ip-10-0-139-134 kubenswrapper[2578]: I0709 19:03:27.837067    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-b94fdbcb7-mvzzq" event={"ID":"fafccd77-fb57-4fbe-8b15-ff8ec7cd9737","Type":"ContainerStarted","Data":"d0c4c20543031a9c21ab4d507299bccbc1ad824c49d102b789cdee8ea1ab4e58"}
Jul 09 19:03:30.846882 ip-10-0-139-134 kubenswrapper[2578]: I0709 19:03:30.846849    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-b94fdbcb7-mvzzq" event={"ID":"fafccd77-fb57-4fbe-8b15-ff8ec7cd9737","Type":"ContainerStarted","Data":"5fee3049a115a1a1d466d1832b170a84e3b6a962572ae7b3f37b5a0c6600f74b"}
Jul 09 19:03:30.879882 ip-10-0-139-134 kubenswrapper[2578]: I0709 19:03:30.879763    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/metrics-server-b94fdbcb7-mvzzq" podStartSLOduration=1.555684726 podStartE2EDuration="3.879739507s" totalImagesPullingTime="2.324054781s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 19:03:27 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 19:03:30.878945815 +0000 UTC m=+307.504997146" watchObservedRunningTime="2026-07-09 19:03:30.879739507 +0000 UTC m=+307.505790839"
Jul 09 19:03:31.841570 ip-10-0-139-134 kubenswrapper[2578]: I0709 19:03:31.841538    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-dztbt"
Jul 09 19:03:47.642061 ip-10-0-139-134 kubenswrapper[2578]: I0709 19:03:47.641980    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/metrics-server-b94fdbcb7-mvzzq"
Jul 09 19:03:47.642545 ip-10-0-139-134 kubenswrapper[2578]: I0709 19:03:47.642098    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/metrics-server-b94fdbcb7-mvzzq"
Jul 09 19:03:51.120964 ip-10-0-139-134 kubenswrapper[2578]: I0709 19:03:51.120928    2578 prober.go:120] "Probe failed" probeType="Liveness" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5cdf7bdc97-nqrj8" podUID="6c449343-0730-4f37-9f01-6200aaf11fa6" containerName="service-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 500"
Jul 09 19:04:01.121415 ip-10-0-139-134 kubenswrapper[2578]: I0709 19:04:01.121374    2578 prober.go:120] "Probe failed" probeType="Liveness" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5cdf7bdc97-nqrj8" podUID="6c449343-0730-4f37-9f01-6200aaf11fa6" containerName="service-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 500"
Jul 09 19:04:07.647974 ip-10-0-139-134 kubenswrapper[2578]: I0709 19:04:07.647944    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/metrics-server-b94fdbcb7-mvzzq"
Jul 09 19:04:07.651940 ip-10-0-139-134 kubenswrapper[2578]: I0709 19:04:07.651918    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/metrics-server-b94fdbcb7-mvzzq"
Jul 09 19:04:11.121506 ip-10-0-139-134 kubenswrapper[2578]: I0709 19:04:11.121466    2578 prober.go:120] "Probe failed" probeType="Liveness" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5cdf7bdc97-nqrj8" podUID="6c449343-0730-4f37-9f01-6200aaf11fa6" containerName="service-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 500"
Jul 09 19:04:11.121874 ip-10-0-139-134 kubenswrapper[2578]: I0709 19:04:11.121549    2578 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5cdf7bdc97-nqrj8"
Jul 09 19:04:11.122111 ip-10-0-139-134 kubenswrapper[2578]: I0709 19:04:11.122079    2578 kuberuntime_manager.go:1192] "Message for Container of pod" containerName="service-proxy" containerStatusID={"Type":"cri-o","ID":"9730c05591b8054be9cad9d4de6ec922f44f2528a824e28b474ef3158752dcba"} pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5cdf7bdc97-nqrj8" containerMessage="Container service-proxy failed liveness probe, will be restarted"
Jul 09 19:04:11.122179 ip-10-0-139-134 kubenswrapper[2578]: I0709 19:04:11.122134    2578 kuberuntime_container.go:873] "Killing container with a grace period" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5cdf7bdc97-nqrj8" podUID="6c449343-0730-4f37-9f01-6200aaf11fa6" containerName="service-proxy" containerID="cri-o://9730c05591b8054be9cad9d4de6ec922f44f2528a824e28b474ef3158752dcba" gracePeriod=30
Jul 09 19:04:11.977301 ip-10-0-139-134 kubenswrapper[2578]: I0709 19:04:11.977262    2578 generic.go:356] "Generic (PLEG): container finished" podID="6c449343-0730-4f37-9f01-6200aaf11fa6" containerID="9730c05591b8054be9cad9d4de6ec922f44f2528a824e28b474ef3158752dcba" exitCode=2
Jul 09 19:04:11.977458 ip-10-0-139-134 kubenswrapper[2578]: I0709 19:04:11.977329    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5cdf7bdc97-nqrj8" event={"ID":"6c449343-0730-4f37-9f01-6200aaf11fa6","Type":"ContainerDied","Data":"9730c05591b8054be9cad9d4de6ec922f44f2528a824e28b474ef3158752dcba"}
Jul 09 19:04:11.977458 ip-10-0-139-134 kubenswrapper[2578]: I0709 19:04:11.977377    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5cdf7bdc97-nqrj8" event={"ID":"6c449343-0730-4f37-9f01-6200aaf11fa6","Type":"ContainerStarted","Data":"e4cf702690a52fe56492d4cdc8d276496a842c59303c114c80cc00041c33d198"}
Jul 09 19:04:37.831449 ip-10-0-139-134 kubenswrapper[2578]: I0709 19:04:37.831344    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a6f6e738-06b0-41d1-bcc4-3627871fe3d6-metrics-certs\") pod \"network-metrics-daemon-dztbt\" (UID: \"a6f6e738-06b0-41d1-bcc4-3627871fe3d6\") " pod="openshift-multus/network-metrics-daemon-dztbt"
Jul 09 19:04:37.833862 ip-10-0-139-134 kubenswrapper[2578]: I0709 19:04:37.833839    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a6f6e738-06b0-41d1-bcc4-3627871fe3d6-metrics-certs\") pod \"network-metrics-daemon-dztbt\" (UID: \"a6f6e738-06b0-41d1-bcc4-3627871fe3d6\") " pod="openshift-multus/network-metrics-daemon-dztbt"
Jul 09 19:04:37.845840 ip-10-0-139-134 kubenswrapper[2578]: I0709 19:04:37.845817    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-s4jjw\""
Jul 09 19:04:37.852571 ip-10-0-139-134 kubenswrapper[2578]: I0709 19:04:37.852558    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-dztbt"
Jul 09 19:04:37.973207 ip-10-0-139-134 kubenswrapper[2578]: I0709 19:04:37.973182    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-dztbt"]
Jul 09 19:04:37.975313 ip-10-0-139-134 kubenswrapper[2578]: W0709 19:04:37.975289    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda6f6e738_06b0_41d1_bcc4_3627871fe3d6.slice/crio-1af1bc1ad88a29bf740b85ae8e97c960d76dd8a07c48b2e370957ddcb1fe2f5c WatchSource:0}: Error finding container 1af1bc1ad88a29bf740b85ae8e97c960d76dd8a07c48b2e370957ddcb1fe2f5c: Status 404 returned error can't find the container with id 1af1bc1ad88a29bf740b85ae8e97c960d76dd8a07c48b2e370957ddcb1fe2f5c
Jul 09 19:04:38.061934 ip-10-0-139-134 kubenswrapper[2578]: I0709 19:04:38.061890    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-dztbt" event={"ID":"a6f6e738-06b0-41d1-bcc4-3627871fe3d6","Type":"ContainerStarted","Data":"1af1bc1ad88a29bf740b85ae8e97c960d76dd8a07c48b2e370957ddcb1fe2f5c"}
Jul 09 19:04:40.070052 ip-10-0-139-134 kubenswrapper[2578]: I0709 19:04:40.070013    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-dztbt" event={"ID":"a6f6e738-06b0-41d1-bcc4-3627871fe3d6","Type":"ContainerStarted","Data":"8dc1653b6e6f7277a38150149c54414693ce0d0380276f95bf5dc0528423dd05"}
Jul 09 19:04:40.070444 ip-10-0-139-134 kubenswrapper[2578]: I0709 19:04:40.070070    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-dztbt" event={"ID":"a6f6e738-06b0-41d1-bcc4-3627871fe3d6","Type":"ContainerStarted","Data":"7ddbee7377a4df3a9ca9054f5e61b60c513eea08da3da4fe49d5400ac19a5ae4"}
Jul 09 19:06:14.028379 ip-10-0-139-134 kubenswrapper[2578]: I0709 19:06:14.028325    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-dztbt" podStartSLOduration=469.889472836 podStartE2EDuration="7m51.028303494s" totalImagesPullingTime="1.138830658s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 18:58:23 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 19:04:40.094280582 +0000 UTC m=+376.720331911" watchObservedRunningTime="2026-07-09 19:06:14.028303494 +0000 UTC m=+470.654354829"
Jul 09 19:06:14.028826 ip-10-0-139-134 kubenswrapper[2578]: I0709 19:06:14.028454    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-6gqfm"]
Jul 09 19:06:14.030670 ip-10-0-139-134 kubenswrapper[2578]: I0709 19:06:14.030654    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-6gqfm"
Jul 09 19:06:14.034126 ip-10-0-139-134 kubenswrapper[2578]: I0709 19:06:14.034098    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager-operator\"/\"kube-root-ca.crt\""
Jul 09 19:06:14.034240 ip-10-0-139-134 kubenswrapper[2578]: I0709 19:06:14.034109    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager-operator\"/\"openshift-service-ca.crt\""
Jul 09 19:06:14.034338 ip-10-0-139-134 kubenswrapper[2578]: I0709 19:06:14.034316    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager-operator\"/\"cert-manager-operator-controller-manager-dockercfg-8ktpm\""
Jul 09 19:06:14.045709 ip-10-0-139-134 kubenswrapper[2578]: I0709 19:06:14.045682    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-6gqfm"]
Jul 09 19:06:14.193342 ip-10-0-139-134 kubenswrapper[2578]: I0709 19:06:14.193307    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/90225b2d-4263-48fa-b936-e241fbccabf7-tmp\") pod \"cert-manager-operator-controller-manager-55c444bf86-6gqfm\" (UID: \"90225b2d-4263-48fa-b936-e241fbccabf7\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-6gqfm"
Jul 09 19:06:14.193511 ip-10-0-139-134 kubenswrapper[2578]: I0709 19:06:14.193367    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8px4z\" (UniqueName: \"kubernetes.io/projected/90225b2d-4263-48fa-b936-e241fbccabf7-kube-api-access-8px4z\") pod \"cert-manager-operator-controller-manager-55c444bf86-6gqfm\" (UID: \"90225b2d-4263-48fa-b936-e241fbccabf7\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-6gqfm"
Jul 09 19:06:14.294623 ip-10-0-139-134 kubenswrapper[2578]: I0709 19:06:14.294525    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8px4z\" (UniqueName: \"kubernetes.io/projected/90225b2d-4263-48fa-b936-e241fbccabf7-kube-api-access-8px4z\") pod \"cert-manager-operator-controller-manager-55c444bf86-6gqfm\" (UID: \"90225b2d-4263-48fa-b936-e241fbccabf7\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-6gqfm"
Jul 09 19:06:14.294623 ip-10-0-139-134 kubenswrapper[2578]: I0709 19:06:14.294589    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/90225b2d-4263-48fa-b936-e241fbccabf7-tmp\") pod \"cert-manager-operator-controller-manager-55c444bf86-6gqfm\" (UID: \"90225b2d-4263-48fa-b936-e241fbccabf7\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-6gqfm"
Jul 09 19:06:14.294983 ip-10-0-139-134 kubenswrapper[2578]: I0709 19:06:14.294964    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/90225b2d-4263-48fa-b936-e241fbccabf7-tmp\") pod \"cert-manager-operator-controller-manager-55c444bf86-6gqfm\" (UID: \"90225b2d-4263-48fa-b936-e241fbccabf7\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-6gqfm"
Jul 09 19:06:14.304214 ip-10-0-139-134 kubenswrapper[2578]: I0709 19:06:14.304191    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8px4z\" (UniqueName: \"kubernetes.io/projected/90225b2d-4263-48fa-b936-e241fbccabf7-kube-api-access-8px4z\") pod \"cert-manager-operator-controller-manager-55c444bf86-6gqfm\" (UID: \"90225b2d-4263-48fa-b936-e241fbccabf7\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-6gqfm"
Jul 09 19:06:14.340144 ip-10-0-139-134 kubenswrapper[2578]: I0709 19:06:14.340104    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-6gqfm"
Jul 09 19:06:14.477804 ip-10-0-139-134 kubenswrapper[2578]: I0709 19:06:14.477773    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-6gqfm"]
Jul 09 19:06:14.481677 ip-10-0-139-134 kubenswrapper[2578]: W0709 19:06:14.481651    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod90225b2d_4263_48fa_b936_e241fbccabf7.slice/crio-f798cb600d2329f666d1372f983f0785481788e811b960c0aed560ea05abe88f WatchSource:0}: Error finding container f798cb600d2329f666d1372f983f0785481788e811b960c0aed560ea05abe88f: Status 404 returned error can't find the container with id f798cb600d2329f666d1372f983f0785481788e811b960c0aed560ea05abe88f
Jul 09 19:06:15.385667 ip-10-0-139-134 kubenswrapper[2578]: I0709 19:06:15.385626    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-6gqfm" event={"ID":"90225b2d-4263-48fa-b936-e241fbccabf7","Type":"ContainerStarted","Data":"f798cb600d2329f666d1372f983f0785481788e811b960c0aed560ea05abe88f"}
Jul 09 19:06:17.395021 ip-10-0-139-134 kubenswrapper[2578]: I0709 19:06:17.394976    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-6gqfm" event={"ID":"90225b2d-4263-48fa-b936-e241fbccabf7","Type":"ContainerStarted","Data":"0d90ffb7c5a94393d14f79ac60803f5b74d08c32d6cb13f9b358f8e98249ea38"}
Jul 09 19:06:17.429614 ip-10-0-139-134 kubenswrapper[2578]: I0709 19:06:17.429532    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-6gqfm" podStartSLOduration=2.010759149 podStartE2EDuration="4.429510302s" totalImagesPullingTime="2.418751153s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 19:06:13 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 19:06:17.426372402 +0000 UTC m=+474.052423747" watchObservedRunningTime="2026-07-09 19:06:17.429510302 +0000 UTC m=+474.055561632"
Jul 09 19:06:20.781661 ip-10-0-139-134 kubenswrapper[2578]: I0709 19:06:20.781616    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-cainjector-559cdd8c87-vfh82"]
Jul 09 19:06:20.784048 ip-10-0-139-134 kubenswrapper[2578]: I0709 19:06:20.784024    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-cainjector-559cdd8c87-vfh82"
Jul 09 19:06:20.787646 ip-10-0-139-134 kubenswrapper[2578]: I0709 19:06:20.787621    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"kube-root-ca.crt\""
Jul 09 19:06:20.787770 ip-10-0-139-134 kubenswrapper[2578]: I0709 19:06:20.787621    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-cainjector-dockercfg-5tnxz\""
Jul 09 19:06:20.789233 ip-10-0-139-134 kubenswrapper[2578]: I0709 19:06:20.789208    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"openshift-service-ca.crt\""
Jul 09 19:06:20.794097 ip-10-0-139-134 kubenswrapper[2578]: I0709 19:06:20.794072    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-cainjector-559cdd8c87-vfh82"]
Jul 09 19:06:20.944922 ip-10-0-139-134 kubenswrapper[2578]: I0709 19:06:20.944873    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-m8n2w\" (UniqueName: \"kubernetes.io/projected/3cd95823-100a-487e-9017-93bd247ceea5-kube-api-access-m8n2w\") pod \"cert-manager-cainjector-559cdd8c87-vfh82\" (UID: \"3cd95823-100a-487e-9017-93bd247ceea5\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-vfh82"
Jul 09 19:06:20.945136 ip-10-0-139-134 kubenswrapper[2578]: I0709 19:06:20.944988    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/3cd95823-100a-487e-9017-93bd247ceea5-bound-sa-token\") pod \"cert-manager-cainjector-559cdd8c87-vfh82\" (UID: \"3cd95823-100a-487e-9017-93bd247ceea5\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-vfh82"
Jul 09 19:06:21.045581 ip-10-0-139-134 kubenswrapper[2578]: I0709 19:06:21.045473    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/3cd95823-100a-487e-9017-93bd247ceea5-bound-sa-token\") pod \"cert-manager-cainjector-559cdd8c87-vfh82\" (UID: \"3cd95823-100a-487e-9017-93bd247ceea5\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-vfh82"
Jul 09 19:06:21.045581 ip-10-0-139-134 kubenswrapper[2578]: I0709 19:06:21.045553    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-m8n2w\" (UniqueName: \"kubernetes.io/projected/3cd95823-100a-487e-9017-93bd247ceea5-kube-api-access-m8n2w\") pod \"cert-manager-cainjector-559cdd8c87-vfh82\" (UID: \"3cd95823-100a-487e-9017-93bd247ceea5\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-vfh82"
Jul 09 19:06:21.055360 ip-10-0-139-134 kubenswrapper[2578]: I0709 19:06:21.055327    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-m8n2w\" (UniqueName: \"kubernetes.io/projected/3cd95823-100a-487e-9017-93bd247ceea5-kube-api-access-m8n2w\") pod \"cert-manager-cainjector-559cdd8c87-vfh82\" (UID: \"3cd95823-100a-487e-9017-93bd247ceea5\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-vfh82"
Jul 09 19:06:21.055536 ip-10-0-139-134 kubenswrapper[2578]: I0709 19:06:21.055515    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/3cd95823-100a-487e-9017-93bd247ceea5-bound-sa-token\") pod \"cert-manager-cainjector-559cdd8c87-vfh82\" (UID: \"3cd95823-100a-487e-9017-93bd247ceea5\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-vfh82"
Jul 09 19:06:21.092700 ip-10-0-139-134 kubenswrapper[2578]: I0709 19:06:21.092658    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-cainjector-559cdd8c87-vfh82"
Jul 09 19:06:21.235832 ip-10-0-139-134 kubenswrapper[2578]: I0709 19:06:21.235803    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-cainjector-559cdd8c87-vfh82"]
Jul 09 19:06:21.238162 ip-10-0-139-134 kubenswrapper[2578]: W0709 19:06:21.238128    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod3cd95823_100a_487e_9017_93bd247ceea5.slice/crio-9a53fe47dfc0c2036d901974f97688b8336a5d5b60cc2624deac443464641835 WatchSource:0}: Error finding container 9a53fe47dfc0c2036d901974f97688b8336a5d5b60cc2624deac443464641835: Status 404 returned error can't find the container with id 9a53fe47dfc0c2036d901974f97688b8336a5d5b60cc2624deac443464641835
Jul 09 19:06:21.409516 ip-10-0-139-134 kubenswrapper[2578]: I0709 19:06:21.409481    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-cainjector-559cdd8c87-vfh82" event={"ID":"3cd95823-100a-487e-9017-93bd247ceea5","Type":"ContainerStarted","Data":"9a53fe47dfc0c2036d901974f97688b8336a5d5b60cc2624deac443464641835"}
Jul 09 19:06:24.423012 ip-10-0-139-134 kubenswrapper[2578]: I0709 19:06:24.422963    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-cainjector-559cdd8c87-vfh82" event={"ID":"3cd95823-100a-487e-9017-93bd247ceea5","Type":"ContainerStarted","Data":"d93c5b3756ff4b2f7d6e8d0bdbc24d1904a29b687563e778a36b801f15df9b95"}
Jul 09 19:06:24.444682 ip-10-0-139-134 kubenswrapper[2578]: I0709 19:06:24.444623    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-cainjector-559cdd8c87-vfh82" podStartSLOduration=1.709924123 podStartE2EDuration="4.44460852s" totalImagesPullingTime="2.734684397s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 19:06:20 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 19:06:24.444482595 +0000 UTC m=+481.070533925" watchObservedRunningTime="2026-07-09 19:06:24.44460852 +0000 UTC m=+481.070659850"
Jul 09 19:06:32.190423 ip-10-0-139-134 kubenswrapper[2578]: I0709 19:06:32.190386    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-cglkg"]
Jul 09 19:06:32.193162 ip-10-0-139-134 kubenswrapper[2578]: I0709 19:06:32.193146    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-cglkg"
Jul 09 19:06:32.196391 ip-10-0-139-134 kubenswrapper[2578]: I0709 19:06:32.196364    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"openshift-service-ca.crt\""
Jul 09 19:06:32.196577 ip-10-0-139-134 kubenswrapper[2578]: I0709 19:06:32.196554    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"openshift-lws-operator-dockercfg-4rckc\""
Jul 09 19:06:32.198107 ip-10-0-139-134 kubenswrapper[2578]: I0709 19:06:32.198086    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"kube-root-ca.crt\""
Jul 09 19:06:32.206049 ip-10-0-139-134 kubenswrapper[2578]: I0709 19:06:32.206026    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-cglkg"]
Jul 09 19:06:32.335216 ip-10-0-139-134 kubenswrapper[2578]: I0709 19:06:32.335175    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/dbc789a6-e269-46fd-a8b6-b3e6d8f9d914-tmp\") pod \"openshift-lws-operator-fd8ccff4c-cglkg\" (UID: \"dbc789a6-e269-46fd-a8b6-b3e6d8f9d914\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-cglkg"
Jul 09 19:06:32.335399 ip-10-0-139-134 kubenswrapper[2578]: I0709 19:06:32.335232    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-g4sfv\" (UniqueName: \"kubernetes.io/projected/dbc789a6-e269-46fd-a8b6-b3e6d8f9d914-kube-api-access-g4sfv\") pod \"openshift-lws-operator-fd8ccff4c-cglkg\" (UID: \"dbc789a6-e269-46fd-a8b6-b3e6d8f9d914\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-cglkg"
Jul 09 19:06:32.436049 ip-10-0-139-134 kubenswrapper[2578]: I0709 19:06:32.436011    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-g4sfv\" (UniqueName: \"kubernetes.io/projected/dbc789a6-e269-46fd-a8b6-b3e6d8f9d914-kube-api-access-g4sfv\") pod \"openshift-lws-operator-fd8ccff4c-cglkg\" (UID: \"dbc789a6-e269-46fd-a8b6-b3e6d8f9d914\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-cglkg"
Jul 09 19:06:32.436203 ip-10-0-139-134 kubenswrapper[2578]: I0709 19:06:32.436094    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/dbc789a6-e269-46fd-a8b6-b3e6d8f9d914-tmp\") pod \"openshift-lws-operator-fd8ccff4c-cglkg\" (UID: \"dbc789a6-e269-46fd-a8b6-b3e6d8f9d914\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-cglkg"
Jul 09 19:06:32.436430 ip-10-0-139-134 kubenswrapper[2578]: I0709 19:06:32.436408    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/dbc789a6-e269-46fd-a8b6-b3e6d8f9d914-tmp\") pod \"openshift-lws-operator-fd8ccff4c-cglkg\" (UID: \"dbc789a6-e269-46fd-a8b6-b3e6d8f9d914\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-cglkg"
Jul 09 19:06:32.445819 ip-10-0-139-134 kubenswrapper[2578]: I0709 19:06:32.445762    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-g4sfv\" (UniqueName: \"kubernetes.io/projected/dbc789a6-e269-46fd-a8b6-b3e6d8f9d914-kube-api-access-g4sfv\") pod \"openshift-lws-operator-fd8ccff4c-cglkg\" (UID: \"dbc789a6-e269-46fd-a8b6-b3e6d8f9d914\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-cglkg"
Jul 09 19:06:32.502203 ip-10-0-139-134 kubenswrapper[2578]: I0709 19:06:32.502166    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-cglkg"
Jul 09 19:06:32.638600 ip-10-0-139-134 kubenswrapper[2578]: I0709 19:06:32.638570    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-cglkg"]
Jul 09 19:06:32.642296 ip-10-0-139-134 kubenswrapper[2578]: W0709 19:06:32.642267    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-poddbc789a6_e269_46fd_a8b6_b3e6d8f9d914.slice/crio-c67dd799e21f44efd507153a30bf84c15c3ba993464f36c64e5e49eaaa04a803 WatchSource:0}: Error finding container c67dd799e21f44efd507153a30bf84c15c3ba993464f36c64e5e49eaaa04a803: Status 404 returned error can't find the container with id c67dd799e21f44efd507153a30bf84c15c3ba993464f36c64e5e49eaaa04a803
Jul 09 19:06:33.456788 ip-10-0-139-134 kubenswrapper[2578]: I0709 19:06:33.456747    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-cglkg" event={"ID":"dbc789a6-e269-46fd-a8b6-b3e6d8f9d914","Type":"ContainerStarted","Data":"c67dd799e21f44efd507153a30bf84c15c3ba993464f36c64e5e49eaaa04a803"}
Jul 09 19:06:35.466812 ip-10-0-139-134 kubenswrapper[2578]: I0709 19:06:35.466704    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-cglkg" event={"ID":"dbc789a6-e269-46fd-a8b6-b3e6d8f9d914","Type":"ContainerStarted","Data":"b70e06c7ced551468313dbdc7ab041deaa94db98459882c2238c854c7db141f8"}
Jul 09 19:06:35.485287 ip-10-0-139-134 kubenswrapper[2578]: I0709 19:06:35.485231    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-cglkg" podStartSLOduration=0.924299956 podStartE2EDuration="3.485212973s" totalImagesPullingTime="2.560913017s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 19:06:32 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 19:06:35.484350441 +0000 UTC m=+492.110401771" watchObservedRunningTime="2026-07-09 19:06:35.485212973 +0000 UTC m=+492.111264302"
Jul 09 19:06:53.898647 ip-10-0-139-134 kubenswrapper[2578]: I0709 19:06:53.898612    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-799d55cdcd-7q6d4"]
Jul 09 19:06:53.948681 ip-10-0-139-134 kubenswrapper[2578]: I0709 19:06:53.948644    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-799d55cdcd-7q6d4"]
Jul 09 19:06:53.948845 ip-10-0-139-134 kubenswrapper[2578]: I0709 19:06:53.948749    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-799d55cdcd-7q6d4"
Jul 09 19:06:53.952922 ip-10-0-139-134 kubenswrapper[2578]: I0709 19:06:53.952900    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-ffx4d\""
Jul 09 19:06:53.953217 ip-10-0-139-134 kubenswrapper[2578]: I0709 19:06:53.953198    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\""
Jul 09 19:06:53.953288 ip-10-0-139-134 kubenswrapper[2578]: I0709 19:06:53.953250    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\""
Jul 09 19:06:53.953346 ip-10-0-139-134 kubenswrapper[2578]: I0709 19:06:53.953322    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\""
Jul 09 19:06:53.953538 ip-10-0-139-134 kubenswrapper[2578]: I0709 19:06:53.953525    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\""
Jul 09 19:06:53.992285 ip-10-0-139-134 kubenswrapper[2578]: I0709 19:06:53.992247    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/2aaef575-ffa9-44f8-ac52-e2b01a71ae73-manifests\") pod \"opendatahub-operator-controller-manager-799d55cdcd-7q6d4\" (UID: \"2aaef575-ffa9-44f8-ac52-e2b01a71ae73\") " pod="opendatahub/opendatahub-operator-controller-manager-799d55cdcd-7q6d4"
Jul 09 19:06:53.992499 ip-10-0-139-134 kubenswrapper[2578]: I0709 19:06:53.992299    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/2aaef575-ffa9-44f8-ac52-e2b01a71ae73-tmp\") pod \"opendatahub-operator-controller-manager-799d55cdcd-7q6d4\" (UID: \"2aaef575-ffa9-44f8-ac52-e2b01a71ae73\") " pod="opendatahub/opendatahub-operator-controller-manager-799d55cdcd-7q6d4"
Jul 09 19:06:53.992499 ip-10-0-139-134 kubenswrapper[2578]: I0709 19:06:53.992371    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/2aaef575-ffa9-44f8-ac52-e2b01a71ae73-apiservice-cert\") pod \"opendatahub-operator-controller-manager-799d55cdcd-7q6d4\" (UID: \"2aaef575-ffa9-44f8-ac52-e2b01a71ae73\") " pod="opendatahub/opendatahub-operator-controller-manager-799d55cdcd-7q6d4"
Jul 09 19:06:53.992499 ip-10-0-139-134 kubenswrapper[2578]: I0709 19:06:53.992399    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/2aaef575-ffa9-44f8-ac52-e2b01a71ae73-webhook-cert\") pod \"opendatahub-operator-controller-manager-799d55cdcd-7q6d4\" (UID: \"2aaef575-ffa9-44f8-ac52-e2b01a71ae73\") " pod="opendatahub/opendatahub-operator-controller-manager-799d55cdcd-7q6d4"
Jul 09 19:06:53.992499 ip-10-0-139-134 kubenswrapper[2578]: I0709 19:06:53.992446    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fw4ps\" (UniqueName: \"kubernetes.io/projected/2aaef575-ffa9-44f8-ac52-e2b01a71ae73-kube-api-access-fw4ps\") pod \"opendatahub-operator-controller-manager-799d55cdcd-7q6d4\" (UID: \"2aaef575-ffa9-44f8-ac52-e2b01a71ae73\") " pod="opendatahub/opendatahub-operator-controller-manager-799d55cdcd-7q6d4"
Jul 09 19:06:54.093807 ip-10-0-139-134 kubenswrapper[2578]: I0709 19:06:54.093765    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fw4ps\" (UniqueName: \"kubernetes.io/projected/2aaef575-ffa9-44f8-ac52-e2b01a71ae73-kube-api-access-fw4ps\") pod \"opendatahub-operator-controller-manager-799d55cdcd-7q6d4\" (UID: \"2aaef575-ffa9-44f8-ac52-e2b01a71ae73\") " pod="opendatahub/opendatahub-operator-controller-manager-799d55cdcd-7q6d4"
Jul 09 19:06:54.093981 ip-10-0-139-134 kubenswrapper[2578]: I0709 19:06:54.093819    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/2aaef575-ffa9-44f8-ac52-e2b01a71ae73-manifests\") pod \"opendatahub-operator-controller-manager-799d55cdcd-7q6d4\" (UID: \"2aaef575-ffa9-44f8-ac52-e2b01a71ae73\") " pod="opendatahub/opendatahub-operator-controller-manager-799d55cdcd-7q6d4"
Jul 09 19:06:54.093981 ip-10-0-139-134 kubenswrapper[2578]: I0709 19:06:54.093842    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/2aaef575-ffa9-44f8-ac52-e2b01a71ae73-tmp\") pod \"opendatahub-operator-controller-manager-799d55cdcd-7q6d4\" (UID: \"2aaef575-ffa9-44f8-ac52-e2b01a71ae73\") " pod="opendatahub/opendatahub-operator-controller-manager-799d55cdcd-7q6d4"
Jul 09 19:06:54.093981 ip-10-0-139-134 kubenswrapper[2578]: I0709 19:06:54.093870    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/2aaef575-ffa9-44f8-ac52-e2b01a71ae73-apiservice-cert\") pod \"opendatahub-operator-controller-manager-799d55cdcd-7q6d4\" (UID: \"2aaef575-ffa9-44f8-ac52-e2b01a71ae73\") " pod="opendatahub/opendatahub-operator-controller-manager-799d55cdcd-7q6d4"
Jul 09 19:06:54.093981 ip-10-0-139-134 kubenswrapper[2578]: I0709 19:06:54.093891    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/2aaef575-ffa9-44f8-ac52-e2b01a71ae73-webhook-cert\") pod \"opendatahub-operator-controller-manager-799d55cdcd-7q6d4\" (UID: \"2aaef575-ffa9-44f8-ac52-e2b01a71ae73\") " pod="opendatahub/opendatahub-operator-controller-manager-799d55cdcd-7q6d4"
Jul 09 19:06:54.094329 ip-10-0-139-134 kubenswrapper[2578]: I0709 19:06:54.094310    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/2aaef575-ffa9-44f8-ac52-e2b01a71ae73-manifests\") pod \"opendatahub-operator-controller-manager-799d55cdcd-7q6d4\" (UID: \"2aaef575-ffa9-44f8-ac52-e2b01a71ae73\") " pod="opendatahub/opendatahub-operator-controller-manager-799d55cdcd-7q6d4"
Jul 09 19:06:54.096486 ip-10-0-139-134 kubenswrapper[2578]: I0709 19:06:54.096455    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/2aaef575-ffa9-44f8-ac52-e2b01a71ae73-apiservice-cert\") pod \"opendatahub-operator-controller-manager-799d55cdcd-7q6d4\" (UID: \"2aaef575-ffa9-44f8-ac52-e2b01a71ae73\") " pod="opendatahub/opendatahub-operator-controller-manager-799d55cdcd-7q6d4"
Jul 09 19:06:54.096832 ip-10-0-139-134 kubenswrapper[2578]: I0709 19:06:54.096807    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/2aaef575-ffa9-44f8-ac52-e2b01a71ae73-tmp\") pod \"opendatahub-operator-controller-manager-799d55cdcd-7q6d4\" (UID: \"2aaef575-ffa9-44f8-ac52-e2b01a71ae73\") " pod="opendatahub/opendatahub-operator-controller-manager-799d55cdcd-7q6d4"
Jul 09 19:06:54.096932 ip-10-0-139-134 kubenswrapper[2578]: I0709 19:06:54.096913    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/2aaef575-ffa9-44f8-ac52-e2b01a71ae73-webhook-cert\") pod \"opendatahub-operator-controller-manager-799d55cdcd-7q6d4\" (UID: \"2aaef575-ffa9-44f8-ac52-e2b01a71ae73\") " pod="opendatahub/opendatahub-operator-controller-manager-799d55cdcd-7q6d4"
Jul 09 19:06:54.103417 ip-10-0-139-134 kubenswrapper[2578]: I0709 19:06:54.103397    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fw4ps\" (UniqueName: \"kubernetes.io/projected/2aaef575-ffa9-44f8-ac52-e2b01a71ae73-kube-api-access-fw4ps\") pod \"opendatahub-operator-controller-manager-799d55cdcd-7q6d4\" (UID: \"2aaef575-ffa9-44f8-ac52-e2b01a71ae73\") " pod="opendatahub/opendatahub-operator-controller-manager-799d55cdcd-7q6d4"
Jul 09 19:06:54.258534 ip-10-0-139-134 kubenswrapper[2578]: I0709 19:06:54.258501    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-799d55cdcd-7q6d4"
Jul 09 19:06:54.395413 ip-10-0-139-134 kubenswrapper[2578]: I0709 19:06:54.395373    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-799d55cdcd-7q6d4"]
Jul 09 19:06:54.399027 ip-10-0-139-134 kubenswrapper[2578]: W0709 19:06:54.398965    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2aaef575_ffa9_44f8_ac52_e2b01a71ae73.slice/crio-bb401da6eeb8ce9f629891e9ed6d678b18952b6777d1bfaba08fe6132b65082d WatchSource:0}: Error finding container bb401da6eeb8ce9f629891e9ed6d678b18952b6777d1bfaba08fe6132b65082d: Status 404 returned error can't find the container with id bb401da6eeb8ce9f629891e9ed6d678b18952b6777d1bfaba08fe6132b65082d
Jul 09 19:06:54.537556 ip-10-0-139-134 kubenswrapper[2578]: I0709 19:06:54.537473    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-799d55cdcd-7q6d4" event={"ID":"2aaef575-ffa9-44f8-ac52-e2b01a71ae73","Type":"ContainerStarted","Data":"bb401da6eeb8ce9f629891e9ed6d678b18952b6777d1bfaba08fe6132b65082d"}
Jul 09 19:06:57.553194 ip-10-0-139-134 kubenswrapper[2578]: I0709 19:06:57.553090    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-799d55cdcd-7q6d4" event={"ID":"2aaef575-ffa9-44f8-ac52-e2b01a71ae73","Type":"ContainerStarted","Data":"c0627f642930974f2c9a58262ddb7a2e15e464aa603d94a0758c1d920fad909f"}
Jul 09 19:06:58.563164 ip-10-0-139-134 kubenswrapper[2578]: I0709 19:06:58.563123    2578 generic.go:356] "Generic (PLEG): container finished" podID="2aaef575-ffa9-44f8-ac52-e2b01a71ae73" containerID="c0627f642930974f2c9a58262ddb7a2e15e464aa603d94a0758c1d920fad909f" exitCode=0
Jul 09 19:06:58.563633 ip-10-0-139-134 kubenswrapper[2578]: I0709 19:06:58.563166    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-799d55cdcd-7q6d4" event={"ID":"2aaef575-ffa9-44f8-ac52-e2b01a71ae73","Type":"ContainerDied","Data":"c0627f642930974f2c9a58262ddb7a2e15e464aa603d94a0758c1d920fad909f"}
Jul 09 19:06:59.570151 ip-10-0-139-134 kubenswrapper[2578]: I0709 19:06:59.570117    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-799d55cdcd-7q6d4" event={"ID":"2aaef575-ffa9-44f8-ac52-e2b01a71ae73","Type":"ContainerStarted","Data":"36d47d340f9c2c486ce88d9edf7de9e4ffd9fda5a357b91e5563f8207f5f9ec6"}
Jul 09 19:06:59.570630 ip-10-0-139-134 kubenswrapper[2578]: I0709 19:06:59.570299    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-799d55cdcd-7q6d4"
Jul 09 19:06:59.597142 ip-10-0-139-134 kubenswrapper[2578]: I0709 19:06:59.597090    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-799d55cdcd-7q6d4" podStartSLOduration=2.1869350069999998 podStartE2EDuration="6.597071658s" totalImagesPullingTime="3.359463777s" totalInitContainerRuntime="1.050672874s" isStatefulPod=false podCreationTimestamp="2026-07-09 19:06:53 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 19:06:59.595189719 +0000 UTC m=+516.221241067" watchObservedRunningTime="2026-07-09 19:06:59.597071658 +0000 UTC m=+516.223123063"
Jul 09 19:07:10.576456 ip-10-0-139-134 kubenswrapper[2578]: I0709 19:07:10.576424    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-799d55cdcd-7q6d4"
Jul 09 19:07:10.952710 ip-10-0-139-134 kubenswrapper[2578]: I0709 19:07:10.952672    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/lws-controller-manager-868778c6d9-5nq78"]
Jul 09 19:07:10.958350 ip-10-0-139-134 kubenswrapper[2578]: I0709 19:07:10.958320    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-868778c6d9-5nq78"
Jul 09 19:07:10.961554 ip-10-0-139-134 kubenswrapper[2578]: I0709 19:07:10.961529    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"lws-controller-manager-dockercfg-tzt9f\""
Jul 09 19:07:10.962285 ip-10-0-139-134 kubenswrapper[2578]: I0709 19:07:10.962256    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"webhook-server-cert\""
Jul 09 19:07:10.962399 ip-10-0-139-134 kubenswrapper[2578]: I0709 19:07:10.962349    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"lws-manager-config\""
Jul 09 19:07:10.963062 ip-10-0-139-134 kubenswrapper[2578]: I0709 19:07:10.963047    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"metrics-server-cert\""
Jul 09 19:07:10.971260 ip-10-0-139-134 kubenswrapper[2578]: I0709 19:07:10.971234    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-868778c6d9-5nq78"]
Jul 09 19:07:11.021061 ip-10-0-139-134 kubenswrapper[2578]: I0709 19:07:11.021026    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pm9fq\" (UniqueName: \"kubernetes.io/projected/e9492e87-13a9-4746-8b52-bb36503ef496-kube-api-access-pm9fq\") pod \"lws-controller-manager-868778c6d9-5nq78\" (UID: \"e9492e87-13a9-4746-8b52-bb36503ef496\") " pod="openshift-lws-operator/lws-controller-manager-868778c6d9-5nq78"
Jul 09 19:07:11.021236 ip-10-0-139-134 kubenswrapper[2578]: I0709 19:07:11.021065    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/e9492e87-13a9-4746-8b52-bb36503ef496-metrics-cert\") pod \"lws-controller-manager-868778c6d9-5nq78\" (UID: \"e9492e87-13a9-4746-8b52-bb36503ef496\") " pod="openshift-lws-operator/lws-controller-manager-868778c6d9-5nq78"
Jul 09 19:07:11.021236 ip-10-0-139-134 kubenswrapper[2578]: I0709 19:07:11.021147    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/e9492e87-13a9-4746-8b52-bb36503ef496-manager-config\") pod \"lws-controller-manager-868778c6d9-5nq78\" (UID: \"e9492e87-13a9-4746-8b52-bb36503ef496\") " pod="openshift-lws-operator/lws-controller-manager-868778c6d9-5nq78"
Jul 09 19:07:11.021236 ip-10-0-139-134 kubenswrapper[2578]: I0709 19:07:11.021184    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/e9492e87-13a9-4746-8b52-bb36503ef496-cert\") pod \"lws-controller-manager-868778c6d9-5nq78\" (UID: \"e9492e87-13a9-4746-8b52-bb36503ef496\") " pod="openshift-lws-operator/lws-controller-manager-868778c6d9-5nq78"
Jul 09 19:07:11.121967 ip-10-0-139-134 kubenswrapper[2578]: I0709 19:07:11.121939    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/e9492e87-13a9-4746-8b52-bb36503ef496-manager-config\") pod \"lws-controller-manager-868778c6d9-5nq78\" (UID: \"e9492e87-13a9-4746-8b52-bb36503ef496\") " pod="openshift-lws-operator/lws-controller-manager-868778c6d9-5nq78"
Jul 09 19:07:11.122154 ip-10-0-139-134 kubenswrapper[2578]: I0709 19:07:11.121977    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/e9492e87-13a9-4746-8b52-bb36503ef496-cert\") pod \"lws-controller-manager-868778c6d9-5nq78\" (UID: \"e9492e87-13a9-4746-8b52-bb36503ef496\") " pod="openshift-lws-operator/lws-controller-manager-868778c6d9-5nq78"
Jul 09 19:07:11.122154 ip-10-0-139-134 kubenswrapper[2578]: I0709 19:07:11.122044    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pm9fq\" (UniqueName: \"kubernetes.io/projected/e9492e87-13a9-4746-8b52-bb36503ef496-kube-api-access-pm9fq\") pod \"lws-controller-manager-868778c6d9-5nq78\" (UID: \"e9492e87-13a9-4746-8b52-bb36503ef496\") " pod="openshift-lws-operator/lws-controller-manager-868778c6d9-5nq78"
Jul 09 19:07:11.122154 ip-10-0-139-134 kubenswrapper[2578]: I0709 19:07:11.122062    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/e9492e87-13a9-4746-8b52-bb36503ef496-metrics-cert\") pod \"lws-controller-manager-868778c6d9-5nq78\" (UID: \"e9492e87-13a9-4746-8b52-bb36503ef496\") " pod="openshift-lws-operator/lws-controller-manager-868778c6d9-5nq78"
Jul 09 19:07:11.122713 ip-10-0-139-134 kubenswrapper[2578]: I0709 19:07:11.122663    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/e9492e87-13a9-4746-8b52-bb36503ef496-manager-config\") pod \"lws-controller-manager-868778c6d9-5nq78\" (UID: \"e9492e87-13a9-4746-8b52-bb36503ef496\") " pod="openshift-lws-operator/lws-controller-manager-868778c6d9-5nq78"
Jul 09 19:07:11.124614 ip-10-0-139-134 kubenswrapper[2578]: I0709 19:07:11.124592    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/e9492e87-13a9-4746-8b52-bb36503ef496-metrics-cert\") pod \"lws-controller-manager-868778c6d9-5nq78\" (UID: \"e9492e87-13a9-4746-8b52-bb36503ef496\") " pod="openshift-lws-operator/lws-controller-manager-868778c6d9-5nq78"
Jul 09 19:07:11.124709 ip-10-0-139-134 kubenswrapper[2578]: I0709 19:07:11.124650    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/e9492e87-13a9-4746-8b52-bb36503ef496-cert\") pod \"lws-controller-manager-868778c6d9-5nq78\" (UID: \"e9492e87-13a9-4746-8b52-bb36503ef496\") " pod="openshift-lws-operator/lws-controller-manager-868778c6d9-5nq78"
Jul 09 19:07:11.131966 ip-10-0-139-134 kubenswrapper[2578]: I0709 19:07:11.131940    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pm9fq\" (UniqueName: \"kubernetes.io/projected/e9492e87-13a9-4746-8b52-bb36503ef496-kube-api-access-pm9fq\") pod \"lws-controller-manager-868778c6d9-5nq78\" (UID: \"e9492e87-13a9-4746-8b52-bb36503ef496\") " pod="openshift-lws-operator/lws-controller-manager-868778c6d9-5nq78"
Jul 09 19:07:11.267584 ip-10-0-139-134 kubenswrapper[2578]: I0709 19:07:11.267486    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-868778c6d9-5nq78"
Jul 09 19:07:11.400719 ip-10-0-139-134 kubenswrapper[2578]: I0709 19:07:11.400694    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-868778c6d9-5nq78"]
Jul 09 19:07:11.402785 ip-10-0-139-134 kubenswrapper[2578]: W0709 19:07:11.402747    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode9492e87_13a9_4746_8b52_bb36503ef496.slice/crio-a6a634f45dc26791469b267c7521d55ca1db0901cd6a577551b145ffe0580091 WatchSource:0}: Error finding container a6a634f45dc26791469b267c7521d55ca1db0901cd6a577551b145ffe0580091: Status 404 returned error can't find the container with id a6a634f45dc26791469b267c7521d55ca1db0901cd6a577551b145ffe0580091
Jul 09 19:07:11.619918 ip-10-0-139-134 kubenswrapper[2578]: I0709 19:07:11.619832    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-868778c6d9-5nq78" event={"ID":"e9492e87-13a9-4746-8b52-bb36503ef496","Type":"ContainerStarted","Data":"a6a634f45dc26791469b267c7521d55ca1db0901cd6a577551b145ffe0580091"}
Jul 09 19:07:13.630440 ip-10-0-139-134 kubenswrapper[2578]: I0709 19:07:13.630348    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-868778c6d9-5nq78" event={"ID":"e9492e87-13a9-4746-8b52-bb36503ef496","Type":"ContainerStarted","Data":"313cfe1a67a7dc9d769d1f7c97cdb5f2c2c18c53c64dcc887a56ce87faf7319d"}
Jul 09 19:07:13.630838 ip-10-0-139-134 kubenswrapper[2578]: I0709 19:07:13.630479    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-lws-operator/lws-controller-manager-868778c6d9-5nq78"
Jul 09 19:07:13.651263 ip-10-0-139-134 kubenswrapper[2578]: I0709 19:07:13.651193    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/lws-controller-manager-868778c6d9-5nq78" podStartSLOduration=1.702201235 podStartE2EDuration="3.651171423s" totalImagesPullingTime="1.948970188s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 19:07:10 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 19:07:13.648936314 +0000 UTC m=+530.274987649" watchObservedRunningTime="2026-07-09 19:07:13.651171423 +0000 UTC m=+530.277222754"
Jul 09 19:07:14.887110 ip-10-0-139-134 kubenswrapper[2578]: I0709 19:07:14.887029    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/model-serving-api-54d89bd5fc-8tnhv"]
Jul 09 19:07:14.889438 ip-10-0-139-134 kubenswrapper[2578]: I0709 19:07:14.889421    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/model-serving-api-54d89bd5fc-8tnhv"
Jul 09 19:07:14.894097 ip-10-0-139-134 kubenswrapper[2578]: I0709 19:07:14.894069    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"model-serving-api-tls\""
Jul 09 19:07:14.894097 ip-10-0-139-134 kubenswrapper[2578]: I0709 19:07:14.894093    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"model-serving-api-dockercfg-8rl98\""
Jul 09 19:07:14.903357 ip-10-0-139-134 kubenswrapper[2578]: I0709 19:07:14.903327    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/model-serving-api-54d89bd5fc-8tnhv"]
Jul 09 19:07:14.955271 ip-10-0-139-134 kubenswrapper[2578]: I0709 19:07:14.955227    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/28bc0231-f03b-4fb6-9217-76fb45581312-tls-certs\") pod \"model-serving-api-54d89bd5fc-8tnhv\" (UID: \"28bc0231-f03b-4fb6-9217-76fb45581312\") " pod="opendatahub/model-serving-api-54d89bd5fc-8tnhv"
Jul 09 19:07:14.955429 ip-10-0-139-134 kubenswrapper[2578]: I0709 19:07:14.955285    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hq67c\" (UniqueName: \"kubernetes.io/projected/28bc0231-f03b-4fb6-9217-76fb45581312-kube-api-access-hq67c\") pod \"model-serving-api-54d89bd5fc-8tnhv\" (UID: \"28bc0231-f03b-4fb6-9217-76fb45581312\") " pod="opendatahub/model-serving-api-54d89bd5fc-8tnhv"
Jul 09 19:07:15.056189 ip-10-0-139-134 kubenswrapper[2578]: I0709 19:07:15.056152    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/28bc0231-f03b-4fb6-9217-76fb45581312-tls-certs\") pod \"model-serving-api-54d89bd5fc-8tnhv\" (UID: \"28bc0231-f03b-4fb6-9217-76fb45581312\") " pod="opendatahub/model-serving-api-54d89bd5fc-8tnhv"
Jul 09 19:07:15.056189 ip-10-0-139-134 kubenswrapper[2578]: I0709 19:07:15.056189    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hq67c\" (UniqueName: \"kubernetes.io/projected/28bc0231-f03b-4fb6-9217-76fb45581312-kube-api-access-hq67c\") pod \"model-serving-api-54d89bd5fc-8tnhv\" (UID: \"28bc0231-f03b-4fb6-9217-76fb45581312\") " pod="opendatahub/model-serving-api-54d89bd5fc-8tnhv"
Jul 09 19:07:15.058972 ip-10-0-139-134 kubenswrapper[2578]: I0709 19:07:15.058940    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/28bc0231-f03b-4fb6-9217-76fb45581312-tls-certs\") pod \"model-serving-api-54d89bd5fc-8tnhv\" (UID: \"28bc0231-f03b-4fb6-9217-76fb45581312\") " pod="opendatahub/model-serving-api-54d89bd5fc-8tnhv"
Jul 09 19:07:15.065674 ip-10-0-139-134 kubenswrapper[2578]: I0709 19:07:15.065647    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hq67c\" (UniqueName: \"kubernetes.io/projected/28bc0231-f03b-4fb6-9217-76fb45581312-kube-api-access-hq67c\") pod \"model-serving-api-54d89bd5fc-8tnhv\" (UID: \"28bc0231-f03b-4fb6-9217-76fb45581312\") " pod="opendatahub/model-serving-api-54d89bd5fc-8tnhv"
Jul 09 19:07:15.203141 ip-10-0-139-134 kubenswrapper[2578]: I0709 19:07:15.203101    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/model-serving-api-54d89bd5fc-8tnhv"
Jul 09 19:07:15.340289 ip-10-0-139-134 kubenswrapper[2578]: I0709 19:07:15.340220    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/model-serving-api-54d89bd5fc-8tnhv"]
Jul 09 19:07:15.342502 ip-10-0-139-134 kubenswrapper[2578]: W0709 19:07:15.342458    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod28bc0231_f03b_4fb6_9217_76fb45581312.slice/crio-8c81d332496e874eedf2e0cc09ba428a08e4171a753d4275e19dc623e84ec1ee WatchSource:0}: Error finding container 8c81d332496e874eedf2e0cc09ba428a08e4171a753d4275e19dc623e84ec1ee: Status 404 returned error can't find the container with id 8c81d332496e874eedf2e0cc09ba428a08e4171a753d4275e19dc623e84ec1ee
Jul 09 19:07:15.639723 ip-10-0-139-134 kubenswrapper[2578]: I0709 19:07:15.639599    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/model-serving-api-54d89bd5fc-8tnhv" event={"ID":"28bc0231-f03b-4fb6-9217-76fb45581312","Type":"ContainerStarted","Data":"8c81d332496e874eedf2e0cc09ba428a08e4171a753d4275e19dc623e84ec1ee"}
Jul 09 19:07:17.648376 ip-10-0-139-134 kubenswrapper[2578]: I0709 19:07:17.648339    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/model-serving-api-54d89bd5fc-8tnhv" event={"ID":"28bc0231-f03b-4fb6-9217-76fb45581312","Type":"ContainerStarted","Data":"6beab8cb34d496c7bcf7c1d19a22269e11d3112900b4286ca89b6793e0ea3aee"}
Jul 09 19:07:17.648769 ip-10-0-139-134 kubenswrapper[2578]: I0709 19:07:17.648449    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/model-serving-api-54d89bd5fc-8tnhv"
Jul 09 19:07:17.667701 ip-10-0-139-134 kubenswrapper[2578]: I0709 19:07:17.667569    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/model-serving-api-54d89bd5fc-8tnhv" podStartSLOduration=1.6109174259999999 podStartE2EDuration="3.667548265s" totalImagesPullingTime="2.056630839s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 19:07:14 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 19:07:17.666779152 +0000 UTC m=+534.292830504" watchObservedRunningTime="2026-07-09 19:07:17.667548265 +0000 UTC m=+534.293599595"
Jul 09 19:07:20.888943 ip-10-0-139-134 kubenswrapper[2578]: I0709 19:07:20.888907    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/istiod-openshift-gateway-94bb8fbfd-kfdrm"]
Jul 09 19:07:20.891303 ip-10-0-139-134 kubenswrapper[2578]: I0709 19:07:20.891286    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-kfdrm"
Jul 09 19:07:20.894850 ip-10-0-139-134 kubenswrapper[2578]: I0709 19:07:20.894824    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istio-kubeconfig\""
Jul 09 19:07:20.895128 ip-10-0-139-134 kubenswrapper[2578]: I0709 19:07:20.895089    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"cacerts\""
Jul 09 19:07:20.895128 ip-10-0-139-134 kubenswrapper[2578]: I0709 19:07:20.895101    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\""
Jul 09 19:07:20.895279 ip-10-0-139-134 kubenswrapper[2578]: I0709 19:07:20.895155    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-tls\""
Jul 09 19:07:20.895279 ip-10-0-139-134 kubenswrapper[2578]: I0709 19:07:20.895174    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-openshift-gateway-dockercfg-76vfb\""
Jul 09 19:07:20.895279 ip-10-0-139-134 kubenswrapper[2578]: I0709 19:07:20.895181    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\""
Jul 09 19:07:20.895279 ip-10-0-139-134 kubenswrapper[2578]: I0709 19:07:20.895270    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\""
Jul 09 19:07:20.907064 ip-10-0-139-134 kubenswrapper[2578]: I0709 19:07:20.907028    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-94bb8fbfd-kfdrm"]
Jul 09 19:07:21.009049 ip-10-0-139-134 kubenswrapper[2578]: I0709 19:07:21.009018    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ae0a44de-9c1b-4ceb-b3d7-bd6f5adf64ac-istio-token\") pod \"istiod-openshift-gateway-94bb8fbfd-kfdrm\" (UID: \"ae0a44de-9c1b-4ceb-b3d7-bd6f5adf64ac\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-kfdrm"
Jul 09 19:07:21.009223 ip-10-0-139-134 kubenswrapper[2578]: I0709 19:07:21.009058    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/ae0a44de-9c1b-4ceb-b3d7-bd6f5adf64ac-cacerts\") pod \"istiod-openshift-gateway-94bb8fbfd-kfdrm\" (UID: \"ae0a44de-9c1b-4ceb-b3d7-bd6f5adf64ac\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-kfdrm"
Jul 09 19:07:21.009223 ip-10-0-139-134 kubenswrapper[2578]: I0709 19:07:21.009084    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/ae0a44de-9c1b-4ceb-b3d7-bd6f5adf64ac-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-94bb8fbfd-kfdrm\" (UID: \"ae0a44de-9c1b-4ceb-b3d7-bd6f5adf64ac\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-kfdrm"
Jul 09 19:07:21.009223 ip-10-0-139-134 kubenswrapper[2578]: I0709 19:07:21.009155    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vhxpl\" (UniqueName: \"kubernetes.io/projected/ae0a44de-9c1b-4ceb-b3d7-bd6f5adf64ac-kube-api-access-vhxpl\") pod \"istiod-openshift-gateway-94bb8fbfd-kfdrm\" (UID: \"ae0a44de-9c1b-4ceb-b3d7-bd6f5adf64ac\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-kfdrm"
Jul 09 19:07:21.009223 ip-10-0-139-134 kubenswrapper[2578]: I0709 19:07:21.009193    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/ae0a44de-9c1b-4ceb-b3d7-bd6f5adf64ac-local-certs\") pod \"istiod-openshift-gateway-94bb8fbfd-kfdrm\" (UID: \"ae0a44de-9c1b-4ceb-b3d7-bd6f5adf64ac\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-kfdrm"
Jul 09 19:07:21.009223 ip-10-0-139-134 kubenswrapper[2578]: I0709 19:07:21.009213    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/ae0a44de-9c1b-4ceb-b3d7-bd6f5adf64ac-istio-kubeconfig\") pod \"istiod-openshift-gateway-94bb8fbfd-kfdrm\" (UID: \"ae0a44de-9c1b-4ceb-b3d7-bd6f5adf64ac\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-kfdrm"
Jul 09 19:07:21.009412 ip-10-0-139-134 kubenswrapper[2578]: I0709 19:07:21.009243    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/ae0a44de-9c1b-4ceb-b3d7-bd6f5adf64ac-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-94bb8fbfd-kfdrm\" (UID: \"ae0a44de-9c1b-4ceb-b3d7-bd6f5adf64ac\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-kfdrm"
Jul 09 19:07:21.109720 ip-10-0-139-134 kubenswrapper[2578]: I0709 19:07:21.109687    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/ae0a44de-9c1b-4ceb-b3d7-bd6f5adf64ac-istio-kubeconfig\") pod \"istiod-openshift-gateway-94bb8fbfd-kfdrm\" (UID: \"ae0a44de-9c1b-4ceb-b3d7-bd6f5adf64ac\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-kfdrm"
Jul 09 19:07:21.109893 ip-10-0-139-134 kubenswrapper[2578]: I0709 19:07:21.109736    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/ae0a44de-9c1b-4ceb-b3d7-bd6f5adf64ac-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-94bb8fbfd-kfdrm\" (UID: \"ae0a44de-9c1b-4ceb-b3d7-bd6f5adf64ac\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-kfdrm"
Jul 09 19:07:21.109893 ip-10-0-139-134 kubenswrapper[2578]: I0709 19:07:21.109767    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ae0a44de-9c1b-4ceb-b3d7-bd6f5adf64ac-istio-token\") pod \"istiod-openshift-gateway-94bb8fbfd-kfdrm\" (UID: \"ae0a44de-9c1b-4ceb-b3d7-bd6f5adf64ac\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-kfdrm"
Jul 09 19:07:21.109893 ip-10-0-139-134 kubenswrapper[2578]: I0709 19:07:21.109802    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/ae0a44de-9c1b-4ceb-b3d7-bd6f5adf64ac-cacerts\") pod \"istiod-openshift-gateway-94bb8fbfd-kfdrm\" (UID: \"ae0a44de-9c1b-4ceb-b3d7-bd6f5adf64ac\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-kfdrm"
Jul 09 19:07:21.109893 ip-10-0-139-134 kubenswrapper[2578]: I0709 19:07:21.109845    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/ae0a44de-9c1b-4ceb-b3d7-bd6f5adf64ac-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-94bb8fbfd-kfdrm\" (UID: \"ae0a44de-9c1b-4ceb-b3d7-bd6f5adf64ac\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-kfdrm"
Jul 09 19:07:21.109893 ip-10-0-139-134 kubenswrapper[2578]: I0709 19:07:21.109882    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vhxpl\" (UniqueName: \"kubernetes.io/projected/ae0a44de-9c1b-4ceb-b3d7-bd6f5adf64ac-kube-api-access-vhxpl\") pod \"istiod-openshift-gateway-94bb8fbfd-kfdrm\" (UID: \"ae0a44de-9c1b-4ceb-b3d7-bd6f5adf64ac\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-kfdrm"
Jul 09 19:07:21.110222 ip-10-0-139-134 kubenswrapper[2578]: I0709 19:07:21.109918    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/ae0a44de-9c1b-4ceb-b3d7-bd6f5adf64ac-local-certs\") pod \"istiod-openshift-gateway-94bb8fbfd-kfdrm\" (UID: \"ae0a44de-9c1b-4ceb-b3d7-bd6f5adf64ac\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-kfdrm"
Jul 09 19:07:21.110453 ip-10-0-139-134 kubenswrapper[2578]: I0709 19:07:21.110423    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/ae0a44de-9c1b-4ceb-b3d7-bd6f5adf64ac-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-94bb8fbfd-kfdrm\" (UID: \"ae0a44de-9c1b-4ceb-b3d7-bd6f5adf64ac\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-kfdrm"
Jul 09 19:07:21.112877 ip-10-0-139-134 kubenswrapper[2578]: I0709 19:07:21.112845    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/ae0a44de-9c1b-4ceb-b3d7-bd6f5adf64ac-local-certs\") pod \"istiod-openshift-gateway-94bb8fbfd-kfdrm\" (UID: \"ae0a44de-9c1b-4ceb-b3d7-bd6f5adf64ac\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-kfdrm"
Jul 09 19:07:21.112981 ip-10-0-139-134 kubenswrapper[2578]: I0709 19:07:21.112923    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/ae0a44de-9c1b-4ceb-b3d7-bd6f5adf64ac-istio-kubeconfig\") pod \"istiod-openshift-gateway-94bb8fbfd-kfdrm\" (UID: \"ae0a44de-9c1b-4ceb-b3d7-bd6f5adf64ac\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-kfdrm"
Jul 09 19:07:21.113067 ip-10-0-139-134 kubenswrapper[2578]: I0709 19:07:21.112979    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/ae0a44de-9c1b-4ceb-b3d7-bd6f5adf64ac-cacerts\") pod \"istiod-openshift-gateway-94bb8fbfd-kfdrm\" (UID: \"ae0a44de-9c1b-4ceb-b3d7-bd6f5adf64ac\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-kfdrm"
Jul 09 19:07:21.113067 ip-10-0-139-134 kubenswrapper[2578]: I0709 19:07:21.113053    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/ae0a44de-9c1b-4ceb-b3d7-bd6f5adf64ac-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-94bb8fbfd-kfdrm\" (UID: \"ae0a44de-9c1b-4ceb-b3d7-bd6f5adf64ac\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-kfdrm"
Jul 09 19:07:21.126942 ip-10-0-139-134 kubenswrapper[2578]: I0709 19:07:21.126912    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ae0a44de-9c1b-4ceb-b3d7-bd6f5adf64ac-istio-token\") pod \"istiod-openshift-gateway-94bb8fbfd-kfdrm\" (UID: \"ae0a44de-9c1b-4ceb-b3d7-bd6f5adf64ac\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-kfdrm"
Jul 09 19:07:21.127767 ip-10-0-139-134 kubenswrapper[2578]: I0709 19:07:21.127748    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vhxpl\" (UniqueName: \"kubernetes.io/projected/ae0a44de-9c1b-4ceb-b3d7-bd6f5adf64ac-kube-api-access-vhxpl\") pod \"istiod-openshift-gateway-94bb8fbfd-kfdrm\" (UID: \"ae0a44de-9c1b-4ceb-b3d7-bd6f5adf64ac\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-kfdrm"
Jul 09 19:07:21.200799 ip-10-0-139-134 kubenswrapper[2578]: I0709 19:07:21.200765    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-kfdrm"
Jul 09 19:07:21.345801 ip-10-0-139-134 kubenswrapper[2578]: I0709 19:07:21.345772    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-94bb8fbfd-kfdrm"]
Jul 09 19:07:21.348343 ip-10-0-139-134 kubenswrapper[2578]: W0709 19:07:21.348312    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podae0a44de_9c1b_4ceb_b3d7_bd6f5adf64ac.slice/crio-5d84bf2fe75eebd2749c67acf15a4ed2e52053b79feaf7f7e2a1c6430ba25742 WatchSource:0}: Error finding container 5d84bf2fe75eebd2749c67acf15a4ed2e52053b79feaf7f7e2a1c6430ba25742: Status 404 returned error can't find the container with id 5d84bf2fe75eebd2749c67acf15a4ed2e52053b79feaf7f7e2a1c6430ba25742
Jul 09 19:07:21.667384 ip-10-0-139-134 kubenswrapper[2578]: I0709 19:07:21.667349    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-kfdrm" event={"ID":"ae0a44de-9c1b-4ceb-b3d7-bd6f5adf64ac","Type":"ContainerStarted","Data":"5d84bf2fe75eebd2749c67acf15a4ed2e52053b79feaf7f7e2a1c6430ba25742"}
Jul 09 19:07:23.910343 ip-10-0-139-134 kubenswrapper[2578]: I0709 19:07:23.910302    2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 09 19:07:23.910645 ip-10-0-139-134 kubenswrapper[2578]: I0709 19:07:23.910369    2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 09 19:07:24.637312 ip-10-0-139-134 kubenswrapper[2578]: I0709 19:07:24.637278    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-lws-operator/lws-controller-manager-868778c6d9-5nq78"
Jul 09 19:07:24.685057 ip-10-0-139-134 kubenswrapper[2578]: I0709 19:07:24.685024    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-kfdrm" event={"ID":"ae0a44de-9c1b-4ceb-b3d7-bd6f5adf64ac","Type":"ContainerStarted","Data":"b41aeb87a417a36a066f1845e9bcae7f406f19488a8a9469170c4e6a8be28607"}
Jul 09 19:07:24.685255 ip-10-0-139-134 kubenswrapper[2578]: I0709 19:07:24.685233    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-kfdrm"
Jul 09 19:07:24.686871 ip-10-0-139-134 kubenswrapper[2578]: I0709 19:07:24.686841    2578 patch_prober.go:28] interesting pod/istiod-openshift-gateway-94bb8fbfd-kfdrm container/discovery namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Jul 09 19:07:24.687019 ip-10-0-139-134 kubenswrapper[2578]: I0709 19:07:24.686895    2578 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-kfdrm" podUID="ae0a44de-9c1b-4ceb-b3d7-bd6f5adf64ac" containerName="discovery" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 09 19:07:24.707244 ip-10-0-139-134 kubenswrapper[2578]: I0709 19:07:24.707192    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-kfdrm" podStartSLOduration=2.147482004 podStartE2EDuration="4.707176136s" totalImagesPullingTime="2.559694132s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 19:07:20 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 19:07:24.705799707 +0000 UTC m=+541.331851062" watchObservedRunningTime="2026-07-09 19:07:24.707176136 +0000 UTC m=+541.333227465"
Jul 09 19:07:25.690633 ip-10-0-139-134 kubenswrapper[2578]: I0709 19:07:25.690606    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-kfdrm"
Jul 09 19:07:28.656898 ip-10-0-139-134 kubenswrapper[2578]: I0709 19:07:28.656870    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/model-serving-api-54d89bd5fc-8tnhv"
Jul 09 19:08:23.800059 ip-10-0-139-134 kubenswrapper[2578]: I0709 19:08:23.800029    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-8gqbs_7a15b7a9-7525-426b-a051-3ece178b71bc/ovn-acl-logging/0.log"
Jul 09 19:08:23.800620 ip-10-0-139-134 kubenswrapper[2578]: I0709 19:08:23.800156    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-8gqbs_7a15b7a9-7525-426b-a051-3ece178b71bc/ovn-acl-logging/0.log"
Jul 09 19:11:00.634586 ip-10-0-139-134 kubenswrapper[2578]: I0709 19:11:00.634525    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-58f86c7798-vwmmj"]
Jul 09 19:11:00.637288 ip-10-0-139-134 kubenswrapper[2578]: I0709 19:11:00.637270    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-58f86c7798-vwmmj"
Jul 09 19:11:00.640624 ip-10-0-139-134 kubenswrapper[2578]: I0709 19:11:00.640605    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins\""
Jul 09 19:11:00.640624 ip-10-0-139-134 kubenswrapper[2578]: I0709 19:11:00.640613    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-dockercfg-cqk8d\""
Jul 09 19:11:00.647740 ip-10-0-139-134 kubenswrapper[2578]: I0709 19:11:00.647711    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-58f86c7798-vwmmj"]
Jul 09 19:11:00.654277 ip-10-0-139-134 kubenswrapper[2578]: I0709 19:11:00.654249    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/8f0b65ac-44e7-4c22-b204-998168de7c2d-plugins-config-volume\") pod \"payload-processing-58f86c7798-vwmmj\" (UID: \"8f0b65ac-44e7-4c22-b204-998168de7c2d\") " pod="openshift-ingress/payload-processing-58f86c7798-vwmmj"
Jul 09 19:11:00.654415 ip-10-0-139-134 kubenswrapper[2578]: I0709 19:11:00.654287    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tl5cc\" (UniqueName: \"kubernetes.io/projected/8f0b65ac-44e7-4c22-b204-998168de7c2d-kube-api-access-tl5cc\") pod \"payload-processing-58f86c7798-vwmmj\" (UID: \"8f0b65ac-44e7-4c22-b204-998168de7c2d\") " pod="openshift-ingress/payload-processing-58f86c7798-vwmmj"
Jul 09 19:11:00.755630 ip-10-0-139-134 kubenswrapper[2578]: I0709 19:11:00.755598    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/8f0b65ac-44e7-4c22-b204-998168de7c2d-plugins-config-volume\") pod \"payload-processing-58f86c7798-vwmmj\" (UID: \"8f0b65ac-44e7-4c22-b204-998168de7c2d\") " pod="openshift-ingress/payload-processing-58f86c7798-vwmmj"
Jul 09 19:11:00.755792 ip-10-0-139-134 kubenswrapper[2578]: I0709 19:11:00.755643    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tl5cc\" (UniqueName: \"kubernetes.io/projected/8f0b65ac-44e7-4c22-b204-998168de7c2d-kube-api-access-tl5cc\") pod \"payload-processing-58f86c7798-vwmmj\" (UID: \"8f0b65ac-44e7-4c22-b204-998168de7c2d\") " pod="openshift-ingress/payload-processing-58f86c7798-vwmmj"
Jul 09 19:11:00.756303 ip-10-0-139-134 kubenswrapper[2578]: I0709 19:11:00.756285    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/8f0b65ac-44e7-4c22-b204-998168de7c2d-plugins-config-volume\") pod \"payload-processing-58f86c7798-vwmmj\" (UID: \"8f0b65ac-44e7-4c22-b204-998168de7c2d\") " pod="openshift-ingress/payload-processing-58f86c7798-vwmmj"
Jul 09 19:11:00.764071 ip-10-0-139-134 kubenswrapper[2578]: I0709 19:11:00.764047    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tl5cc\" (UniqueName: \"kubernetes.io/projected/8f0b65ac-44e7-4c22-b204-998168de7c2d-kube-api-access-tl5cc\") pod \"payload-processing-58f86c7798-vwmmj\" (UID: \"8f0b65ac-44e7-4c22-b204-998168de7c2d\") " pod="openshift-ingress/payload-processing-58f86c7798-vwmmj"
Jul 09 19:11:00.948110 ip-10-0-139-134 kubenswrapper[2578]: I0709 19:11:00.948075    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-58f86c7798-vwmmj"
Jul 09 19:11:01.081531 ip-10-0-139-134 kubenswrapper[2578]: I0709 19:11:01.081506    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-58f86c7798-vwmmj"]
Jul 09 19:11:01.083516 ip-10-0-139-134 kubenswrapper[2578]: W0709 19:11:01.083476    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8f0b65ac_44e7_4c22_b204_998168de7c2d.slice/crio-9c21894560260e2a48f20fefbe9cb370516ea85f175005d4ccbbfcd1802c9ee9 WatchSource:0}: Error finding container 9c21894560260e2a48f20fefbe9cb370516ea85f175005d4ccbbfcd1802c9ee9: Status 404 returned error can't find the container with id 9c21894560260e2a48f20fefbe9cb370516ea85f175005d4ccbbfcd1802c9ee9
Jul 09 19:11:01.085364 ip-10-0-139-134 kubenswrapper[2578]: I0709 19:11:01.085348    2578 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 09 19:11:01.562148 ip-10-0-139-134 kubenswrapper[2578]: I0709 19:11:01.562116    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-58f86c7798-vwmmj" event={"ID":"8f0b65ac-44e7-4c22-b204-998168de7c2d","Type":"ContainerStarted","Data":"9c21894560260e2a48f20fefbe9cb370516ea85f175005d4ccbbfcd1802c9ee9"}
Jul 09 19:11:02.572690 ip-10-0-139-134 kubenswrapper[2578]: I0709 19:11:02.572646    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-58f86c7798-vwmmj" event={"ID":"8f0b65ac-44e7-4c22-b204-998168de7c2d","Type":"ContainerStarted","Data":"a14a29885a0546af70ec8f0f2c94647c16e17b3ca95163f4ca183787072052d1"}
Jul 09 19:11:02.573177 ip-10-0-139-134 kubenswrapper[2578]: I0709 19:11:02.572900    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-58f86c7798-vwmmj"
Jul 09 19:11:02.593100 ip-10-0-139-134 kubenswrapper[2578]: I0709 19:11:02.593045    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-58f86c7798-vwmmj" podStartSLOduration=1.2394644750000001 podStartE2EDuration="2.593029236s" totalImagesPullingTime="1.353564761s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 19:11:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 19:11:02.591657655 +0000 UTC m=+759.217709001" watchObservedRunningTime="2026-07-09 19:11:02.593029236 +0000 UTC m=+759.219080566"
Jul 09 19:11:13.579207 ip-10-0-139-134 kubenswrapper[2578]: I0709 19:11:13.579174    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-58f86c7798-vwmmj"
Jul 09 19:11:42.060836 ip-10-0-139-134 kubenswrapper[2578]: I0709 19:11:42.060805    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-distinct-simulated-kserve-59975d69f9-7wsvs"]
Jul 09 19:11:42.063633 ip-10-0-139-134 kubenswrapper[2578]: I0709 19:11:42.063612    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-7wsvs"
Jul 09 19:11:42.066771 ip-10-0-139-134 kubenswrapper[2578]: I0709 19:11:42.066745    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\""
Jul 09 19:11:42.066898 ip-10-0-139-134 kubenswrapper[2578]: I0709 19:11:42.066799    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-5jbdw\""
Jul 09 19:11:42.066898 ip-10-0-139-134 kubenswrapper[2578]: I0709 19:11:42.066816    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\""
Jul 09 19:11:42.068219 ip-10-0-139-134 kubenswrapper[2578]: I0709 19:11:42.068205    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-distinct-simulated-kserve-self-signed-certs\""
Jul 09 19:11:42.075859 ip-10-0-139-134 kubenswrapper[2578]: I0709 19:11:42.075836    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-simulated-kserve-59975d69f9-7wsvs"]
Jul 09 19:11:42.200008 ip-10-0-139-134 kubenswrapper[2578]: I0709 19:11:42.199970    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/7f1d16eb-7526-4400-9c2d-613c4a819f18-tls-certs\") pod \"e2e-distinct-simulated-kserve-59975d69f9-7wsvs\" (UID: \"7f1d16eb-7526-4400-9c2d-613c4a819f18\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-7wsvs"
Jul 09 19:11:42.200185 ip-10-0-139-134 kubenswrapper[2578]: I0709 19:11:42.200091    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jkk8s\" (UniqueName: \"kubernetes.io/projected/7f1d16eb-7526-4400-9c2d-613c4a819f18-kube-api-access-jkk8s\") pod \"e2e-distinct-simulated-kserve-59975d69f9-7wsvs\" (UID: \"7f1d16eb-7526-4400-9c2d-613c4a819f18\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-7wsvs"
Jul 09 19:11:42.200185 ip-10-0-139-134 kubenswrapper[2578]: I0709 19:11:42.200155    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/7f1d16eb-7526-4400-9c2d-613c4a819f18-home\") pod \"e2e-distinct-simulated-kserve-59975d69f9-7wsvs\" (UID: \"7f1d16eb-7526-4400-9c2d-613c4a819f18\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-7wsvs"
Jul 09 19:11:42.200257 ip-10-0-139-134 kubenswrapper[2578]: I0709 19:11:42.200189    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/7f1d16eb-7526-4400-9c2d-613c4a819f18-dshm\") pod \"e2e-distinct-simulated-kserve-59975d69f9-7wsvs\" (UID: \"7f1d16eb-7526-4400-9c2d-613c4a819f18\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-7wsvs"
Jul 09 19:11:42.200257 ip-10-0-139-134 kubenswrapper[2578]: I0709 19:11:42.200216    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/7f1d16eb-7526-4400-9c2d-613c4a819f18-model-cache\") pod \"e2e-distinct-simulated-kserve-59975d69f9-7wsvs\" (UID: \"7f1d16eb-7526-4400-9c2d-613c4a819f18\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-7wsvs"
Jul 09 19:11:42.200257 ip-10-0-139-134 kubenswrapper[2578]: I0709 19:11:42.200241    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/7f1d16eb-7526-4400-9c2d-613c4a819f18-tmp-dir\") pod \"e2e-distinct-simulated-kserve-59975d69f9-7wsvs\" (UID: \"7f1d16eb-7526-4400-9c2d-613c4a819f18\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-7wsvs"
Jul 09 19:11:42.301013 ip-10-0-139-134 kubenswrapper[2578]: I0709 19:11:42.300953    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/7f1d16eb-7526-4400-9c2d-613c4a819f18-tls-certs\") pod \"e2e-distinct-simulated-kserve-59975d69f9-7wsvs\" (UID: \"7f1d16eb-7526-4400-9c2d-613c4a819f18\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-7wsvs"
Jul 09 19:11:42.301193 ip-10-0-139-134 kubenswrapper[2578]: I0709 19:11:42.301041    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jkk8s\" (UniqueName: \"kubernetes.io/projected/7f1d16eb-7526-4400-9c2d-613c4a819f18-kube-api-access-jkk8s\") pod \"e2e-distinct-simulated-kserve-59975d69f9-7wsvs\" (UID: \"7f1d16eb-7526-4400-9c2d-613c4a819f18\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-7wsvs"
Jul 09 19:11:42.301193 ip-10-0-139-134 kubenswrapper[2578]: I0709 19:11:42.301065    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/7f1d16eb-7526-4400-9c2d-613c4a819f18-home\") pod \"e2e-distinct-simulated-kserve-59975d69f9-7wsvs\" (UID: \"7f1d16eb-7526-4400-9c2d-613c4a819f18\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-7wsvs"
Jul 09 19:11:42.301193 ip-10-0-139-134 kubenswrapper[2578]: I0709 19:11:42.301087    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/7f1d16eb-7526-4400-9c2d-613c4a819f18-dshm\") pod \"e2e-distinct-simulated-kserve-59975d69f9-7wsvs\" (UID: \"7f1d16eb-7526-4400-9c2d-613c4a819f18\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-7wsvs"
Jul 09 19:11:42.301193 ip-10-0-139-134 kubenswrapper[2578]: I0709 19:11:42.301108    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/7f1d16eb-7526-4400-9c2d-613c4a819f18-model-cache\") pod \"e2e-distinct-simulated-kserve-59975d69f9-7wsvs\" (UID: \"7f1d16eb-7526-4400-9c2d-613c4a819f18\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-7wsvs"
Jul 09 19:11:42.301193 ip-10-0-139-134 kubenswrapper[2578]: I0709 19:11:42.301134    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/7f1d16eb-7526-4400-9c2d-613c4a819f18-tmp-dir\") pod \"e2e-distinct-simulated-kserve-59975d69f9-7wsvs\" (UID: \"7f1d16eb-7526-4400-9c2d-613c4a819f18\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-7wsvs"
Jul 09 19:11:42.301523 ip-10-0-139-134 kubenswrapper[2578]: I0709 19:11:42.301493    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/7f1d16eb-7526-4400-9c2d-613c4a819f18-tmp-dir\") pod \"e2e-distinct-simulated-kserve-59975d69f9-7wsvs\" (UID: \"7f1d16eb-7526-4400-9c2d-613c4a819f18\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-7wsvs"
Jul 09 19:11:42.301635 ip-10-0-139-134 kubenswrapper[2578]: I0709 19:11:42.301535    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/7f1d16eb-7526-4400-9c2d-613c4a819f18-model-cache\") pod \"e2e-distinct-simulated-kserve-59975d69f9-7wsvs\" (UID: \"7f1d16eb-7526-4400-9c2d-613c4a819f18\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-7wsvs"
Jul 09 19:11:42.301635 ip-10-0-139-134 kubenswrapper[2578]: I0709 19:11:42.301617    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/7f1d16eb-7526-4400-9c2d-613c4a819f18-home\") pod \"e2e-distinct-simulated-kserve-59975d69f9-7wsvs\" (UID: \"7f1d16eb-7526-4400-9c2d-613c4a819f18\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-7wsvs"
Jul 09 19:11:42.303522 ip-10-0-139-134 kubenswrapper[2578]: I0709 19:11:42.303500    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/7f1d16eb-7526-4400-9c2d-613c4a819f18-dshm\") pod \"e2e-distinct-simulated-kserve-59975d69f9-7wsvs\" (UID: \"7f1d16eb-7526-4400-9c2d-613c4a819f18\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-7wsvs"
Jul 09 19:11:42.303761 ip-10-0-139-134 kubenswrapper[2578]: I0709 19:11:42.303742    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/7f1d16eb-7526-4400-9c2d-613c4a819f18-tls-certs\") pod \"e2e-distinct-simulated-kserve-59975d69f9-7wsvs\" (UID: \"7f1d16eb-7526-4400-9c2d-613c4a819f18\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-7wsvs"
Jul 09 19:11:42.310350 ip-10-0-139-134 kubenswrapper[2578]: I0709 19:11:42.310327    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jkk8s\" (UniqueName: \"kubernetes.io/projected/7f1d16eb-7526-4400-9c2d-613c4a819f18-kube-api-access-jkk8s\") pod \"e2e-distinct-simulated-kserve-59975d69f9-7wsvs\" (UID: \"7f1d16eb-7526-4400-9c2d-613c4a819f18\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-7wsvs"
Jul 09 19:11:42.374294 ip-10-0-139-134 kubenswrapper[2578]: I0709 19:11:42.374205    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-7wsvs"
Jul 09 19:11:42.503234 ip-10-0-139-134 kubenswrapper[2578]: I0709 19:11:42.503212    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-simulated-kserve-59975d69f9-7wsvs"]
Jul 09 19:11:42.504862 ip-10-0-139-134 kubenswrapper[2578]: W0709 19:11:42.504826    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7f1d16eb_7526_4400_9c2d_613c4a819f18.slice/crio-2fcf1bfffb74e994bc4e78561b62d9935335f60c14e87ae4ff35095c4a3567d1 WatchSource:0}: Error finding container 2fcf1bfffb74e994bc4e78561b62d9935335f60c14e87ae4ff35095c4a3567d1: Status 404 returned error can't find the container with id 2fcf1bfffb74e994bc4e78561b62d9935335f60c14e87ae4ff35095c4a3567d1
Jul 09 19:11:42.743528 ip-10-0-139-134 kubenswrapper[2578]: I0709 19:11:42.743489    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-7wsvs" event={"ID":"7f1d16eb-7526-4400-9c2d-613c4a819f18","Type":"ContainerStarted","Data":"2fcf1bfffb74e994bc4e78561b62d9935335f60c14e87ae4ff35095c4a3567d1"}
Jul 09 19:11:43.749189 ip-10-0-139-134 kubenswrapper[2578]: I0709 19:11:43.749152    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-7wsvs" event={"ID":"7f1d16eb-7526-4400-9c2d-613c4a819f18","Type":"ContainerStarted","Data":"a377886e3388a4c762e15e88b3e6a718f36a4164b01ff49ca1710c0443130f6d"}
Jul 09 19:11:43.767303 ip-10-0-139-134 kubenswrapper[2578]: I0709 19:11:43.767208    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-7wsvs" podStartSLOduration=0.757874462 podStartE2EDuration="1.767192533s" totalImagesPullingTime="1.009318071s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 19:11:42 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 19:11:43.76596599 +0000 UTC m=+800.392017345" watchObservedRunningTime="2026-07-09 19:11:43.767192533 +0000 UTC m=+800.393243931"
Jul 09 19:11:52.374573 ip-10-0-139-134 kubenswrapper[2578]: I0709 19:11:52.374533    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-7wsvs"
Jul 09 19:11:52.374966 ip-10-0-139-134 kubenswrapper[2578]: I0709 19:11:52.374610    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-7wsvs"
Jul 09 19:11:52.387642 ip-10-0-139-134 kubenswrapper[2578]: I0709 19:11:52.387611    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-7wsvs"
Jul 09 19:11:52.803890 ip-10-0-139-134 kubenswrapper[2578]: I0709 19:11:52.803859    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-7wsvs"
Jul 09 19:12:01.965392 ip-10-0-139-134 kubenswrapper[2578]: I0709 19:12:01.965358    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db2ngmh"]
Jul 09 19:12:01.968791 ip-10-0-139-134 kubenswrapper[2578]: I0709 19:12:01.968770    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db2ngmh"
Jul 09 19:12:01.972230 ip-10-0-139-134 kubenswrapper[2578]: I0709 19:12:01.972197    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-unab60ef4d3a239b5143b412cab04acac3-kserve-self-signed-certs\""
Jul 09 19:12:01.978915 ip-10-0-139-134 kubenswrapper[2578]: I0709 19:12:01.978893    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db2ngmh"]
Jul 09 19:12:02.054363 ip-10-0-139-134 kubenswrapper[2578]: I0709 19:12:02.054327    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/32f685d1-4d07-4b29-82e0-721286d7182a-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db2ngmh\" (UID: \"32f685d1-4d07-4b29-82e0-721286d7182a\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db2ngmh"
Jul 09 19:12:02.054543 ip-10-0-139-134 kubenswrapper[2578]: I0709 19:12:02.054371    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/32f685d1-4d07-4b29-82e0-721286d7182a-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db2ngmh\" (UID: \"32f685d1-4d07-4b29-82e0-721286d7182a\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db2ngmh"
Jul 09 19:12:02.054543 ip-10-0-139-134 kubenswrapper[2578]: I0709 19:12:02.054408    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/32f685d1-4d07-4b29-82e0-721286d7182a-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db2ngmh\" (UID: \"32f685d1-4d07-4b29-82e0-721286d7182a\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db2ngmh"
Jul 09 19:12:02.054543 ip-10-0-139-134 kubenswrapper[2578]: I0709 19:12:02.054437    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/32f685d1-4d07-4b29-82e0-721286d7182a-tmp-dir\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db2ngmh\" (UID: \"32f685d1-4d07-4b29-82e0-721286d7182a\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db2ngmh"
Jul 09 19:12:02.054543 ip-10-0-139-134 kubenswrapper[2578]: I0709 19:12:02.054500    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/32f685d1-4d07-4b29-82e0-721286d7182a-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db2ngmh\" (UID: \"32f685d1-4d07-4b29-82e0-721286d7182a\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db2ngmh"
Jul 09 19:12:02.054543 ip-10-0-139-134 kubenswrapper[2578]: I0709 19:12:02.054535    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-phln2\" (UniqueName: \"kubernetes.io/projected/32f685d1-4d07-4b29-82e0-721286d7182a-kube-api-access-phln2\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db2ngmh\" (UID: \"32f685d1-4d07-4b29-82e0-721286d7182a\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db2ngmh"
Jul 09 19:12:02.155239 ip-10-0-139-134 kubenswrapper[2578]: I0709 19:12:02.155195    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/32f685d1-4d07-4b29-82e0-721286d7182a-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db2ngmh\" (UID: \"32f685d1-4d07-4b29-82e0-721286d7182a\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db2ngmh"
Jul 09 19:12:02.155425 ip-10-0-139-134 kubenswrapper[2578]: I0709 19:12:02.155249    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/32f685d1-4d07-4b29-82e0-721286d7182a-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db2ngmh\" (UID: \"32f685d1-4d07-4b29-82e0-721286d7182a\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db2ngmh"
Jul 09 19:12:02.155425 ip-10-0-139-134 kubenswrapper[2578]: I0709 19:12:02.155283    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/32f685d1-4d07-4b29-82e0-721286d7182a-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db2ngmh\" (UID: \"32f685d1-4d07-4b29-82e0-721286d7182a\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db2ngmh"
Jul 09 19:12:02.155425 ip-10-0-139-134 kubenswrapper[2578]: I0709 19:12:02.155316    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/32f685d1-4d07-4b29-82e0-721286d7182a-tmp-dir\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db2ngmh\" (UID: \"32f685d1-4d07-4b29-82e0-721286d7182a\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db2ngmh"
Jul 09 19:12:02.155425 ip-10-0-139-134 kubenswrapper[2578]: I0709 19:12:02.155362    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/32f685d1-4d07-4b29-82e0-721286d7182a-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db2ngmh\" (UID: \"32f685d1-4d07-4b29-82e0-721286d7182a\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db2ngmh"
Jul 09 19:12:02.155425 ip-10-0-139-134 kubenswrapper[2578]: I0709 19:12:02.155392    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-phln2\" (UniqueName: \"kubernetes.io/projected/32f685d1-4d07-4b29-82e0-721286d7182a-kube-api-access-phln2\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db2ngmh\" (UID: \"32f685d1-4d07-4b29-82e0-721286d7182a\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db2ngmh"
Jul 09 19:12:02.155679 ip-10-0-139-134 kubenswrapper[2578]: I0709 19:12:02.155661    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/32f685d1-4d07-4b29-82e0-721286d7182a-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db2ngmh\" (UID: \"32f685d1-4d07-4b29-82e0-721286d7182a\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db2ngmh"
Jul 09 19:12:02.155737 ip-10-0-139-134 kubenswrapper[2578]: I0709 19:12:02.155671    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/32f685d1-4d07-4b29-82e0-721286d7182a-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db2ngmh\" (UID: \"32f685d1-4d07-4b29-82e0-721286d7182a\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db2ngmh"
Jul 09 19:12:02.155793 ip-10-0-139-134 kubenswrapper[2578]: I0709 19:12:02.155730    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/32f685d1-4d07-4b29-82e0-721286d7182a-tmp-dir\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db2ngmh\" (UID: \"32f685d1-4d07-4b29-82e0-721286d7182a\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db2ngmh"
Jul 09 19:12:02.157825 ip-10-0-139-134 kubenswrapper[2578]: I0709 19:12:02.157797    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/32f685d1-4d07-4b29-82e0-721286d7182a-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db2ngmh\" (UID: \"32f685d1-4d07-4b29-82e0-721286d7182a\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db2ngmh"
Jul 09 19:12:02.157946 ip-10-0-139-134 kubenswrapper[2578]: I0709 19:12:02.157928    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/32f685d1-4d07-4b29-82e0-721286d7182a-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db2ngmh\" (UID: \"32f685d1-4d07-4b29-82e0-721286d7182a\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db2ngmh"
Jul 09 19:12:02.164814 ip-10-0-139-134 kubenswrapper[2578]: I0709 19:12:02.164786    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-phln2\" (UniqueName: \"kubernetes.io/projected/32f685d1-4d07-4b29-82e0-721286d7182a-kube-api-access-phln2\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db2ngmh\" (UID: \"32f685d1-4d07-4b29-82e0-721286d7182a\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db2ngmh"
Jul 09 19:12:02.279133 ip-10-0-139-134 kubenswrapper[2578]: I0709 19:12:02.279035    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db2ngmh"
Jul 09 19:12:02.413773 ip-10-0-139-134 kubenswrapper[2578]: I0709 19:12:02.413744    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db2ngmh"]
Jul 09 19:12:02.415843 ip-10-0-139-134 kubenswrapper[2578]: W0709 19:12:02.415811    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod32f685d1_4d07_4b29_82e0_721286d7182a.slice/crio-efc1c39a6cb85f8dc243abadcc148502196e58574e2ac546a3348d849302f8f9 WatchSource:0}: Error finding container efc1c39a6cb85f8dc243abadcc148502196e58574e2ac546a3348d849302f8f9: Status 404 returned error can't find the container with id efc1c39a6cb85f8dc243abadcc148502196e58574e2ac546a3348d849302f8f9
Jul 09 19:12:02.834831 ip-10-0-139-134 kubenswrapper[2578]: I0709 19:12:02.834796    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db2ngmh" event={"ID":"32f685d1-4d07-4b29-82e0-721286d7182a","Type":"ContainerStarted","Data":"2ebe836aaf966d03609304840f1decbeb88a6cb54e20d0dfe62ba851c0558a02"}
Jul 09 19:12:02.835017 ip-10-0-139-134 kubenswrapper[2578]: I0709 19:12:02.834847    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db2ngmh" event={"ID":"32f685d1-4d07-4b29-82e0-721286d7182a","Type":"ContainerStarted","Data":"efc1c39a6cb85f8dc243abadcc148502196e58574e2ac546a3348d849302f8f9"}
Jul 09 19:12:02.856347 ip-10-0-139-134 kubenswrapper[2578]: I0709 19:12:02.856290    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db2ngmh" podStartSLOduration=1.5764908530000001 podStartE2EDuration="1.856272968s" totalImagesPullingTime="279.782115ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 19:12:01 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 19:12:02.855341269 +0000 UTC m=+819.481392626" watchObservedRunningTime="2026-07-09 19:12:02.856272968 +0000 UTC m=+819.482324298"
Jul 09 19:12:12.279783 ip-10-0-139-134 kubenswrapper[2578]: I0709 19:12:12.279745    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db2ngmh"
Jul 09 19:12:12.280228 ip-10-0-139-134 kubenswrapper[2578]: I0709 19:12:12.279806    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db2ngmh"
Jul 09 19:12:12.292570 ip-10-0-139-134 kubenswrapper[2578]: I0709 19:12:12.292542    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db2ngmh"
Jul 09 19:12:12.892891 ip-10-0-139-134 kubenswrapper[2578]: I0709 19:12:12.892861    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db2ngmh"
Jul 09 19:13:23.822812 ip-10-0-139-134 kubenswrapper[2578]: I0709 19:13:23.822702    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-8gqbs_7a15b7a9-7525-426b-a051-3ece178b71bc/ovn-acl-logging/0.log"
Jul 09 19:13:23.823402 ip-10-0-139-134 kubenswrapper[2578]: I0709 19:13:23.823381    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-8gqbs_7a15b7a9-7525-426b-a051-3ece178b71bc/ovn-acl-logging/0.log"
Jul 09 19:18:23.847010 ip-10-0-139-134 kubenswrapper[2578]: I0709 19:18:23.846968    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-8gqbs_7a15b7a9-7525-426b-a051-3ece178b71bc/ovn-acl-logging/0.log"
Jul 09 19:18:23.847552 ip-10-0-139-134 kubenswrapper[2578]: I0709 19:18:23.847329    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-8gqbs_7a15b7a9-7525-426b-a051-3ece178b71bc/ovn-acl-logging/0.log"
Jul 09 19:23:23.868947 ip-10-0-139-134 kubenswrapper[2578]: I0709 19:23:23.868915    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-8gqbs_7a15b7a9-7525-426b-a051-3ece178b71bc/ovn-acl-logging/0.log"
Jul 09 19:23:23.869882 ip-10-0-139-134 kubenswrapper[2578]: I0709 19:23:23.869862    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-8gqbs_7a15b7a9-7525-426b-a051-3ece178b71bc/ovn-acl-logging/0.log"
Jul 09 19:27:03.272434 ip-10-0-139-134 kubenswrapper[2578]: I0709 19:27:03.272401    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-639f19cb-77d6c899f8-8cmps"]
Jul 09 19:27:03.275532 ip-10-0-139-134 kubenswrapper[2578]: I0709 19:27:03.275514    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-639f19cb-77d6c899f8-8cmps"
Jul 09 19:27:03.283316 ip-10-0-139-134 kubenswrapper[2578]: I0709 19:27:03.283281    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-dockercfg-9pdt2\""
Jul 09 19:27:03.283440 ip-10-0-139-134 kubenswrapper[2578]: I0709 19:27:03.283316    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"kube-root-ca.crt\""
Jul 09 19:27:03.283440 ip-10-0-139-134 kubenswrapper[2578]: I0709 19:27:03.283378    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-ait-639f19cb-serving-cert\""
Jul 09 19:27:03.283440 ip-10-0-139-134 kubenswrapper[2578]: I0709 19:27:03.283384    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 09 19:27:03.287289 ip-10-0-139-134 kubenswrapper[2578]: I0709 19:27:03.287269    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-639f19cb-77d6c899f8-8cmps"]
Jul 09 19:27:03.414095 ip-10-0-139-134 kubenswrapper[2578]: I0709 19:27:03.414057    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-94ps8\" (UniqueName: \"kubernetes.io/projected/9d1be8ff-530e-4cdb-bb37-441bf5223df5-kube-api-access-94ps8\") pod \"maas-api-e2e-ait-639f19cb-77d6c899f8-8cmps\" (UID: \"9d1be8ff-530e-4cdb-bb37-441bf5223df5\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-639f19cb-77d6c899f8-8cmps"
Jul 09 19:27:03.414259 ip-10-0-139-134 kubenswrapper[2578]: I0709 19:27:03.414101    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/9d1be8ff-530e-4cdb-bb37-441bf5223df5-openshift-service-ca\") pod \"maas-api-e2e-ait-639f19cb-77d6c899f8-8cmps\" (UID: \"9d1be8ff-530e-4cdb-bb37-441bf5223df5\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-639f19cb-77d6c899f8-8cmps"
Jul 09 19:27:03.414259 ip-10-0-139-134 kubenswrapper[2578]: I0709 19:27:03.414167    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/9d1be8ff-530e-4cdb-bb37-441bf5223df5-maas-api-tls\") pod \"maas-api-e2e-ait-639f19cb-77d6c899f8-8cmps\" (UID: \"9d1be8ff-530e-4cdb-bb37-441bf5223df5\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-639f19cb-77d6c899f8-8cmps"
Jul 09 19:27:03.515530 ip-10-0-139-134 kubenswrapper[2578]: I0709 19:27:03.515496    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-94ps8\" (UniqueName: \"kubernetes.io/projected/9d1be8ff-530e-4cdb-bb37-441bf5223df5-kube-api-access-94ps8\") pod \"maas-api-e2e-ait-639f19cb-77d6c899f8-8cmps\" (UID: \"9d1be8ff-530e-4cdb-bb37-441bf5223df5\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-639f19cb-77d6c899f8-8cmps"
Jul 09 19:27:03.515699 ip-10-0-139-134 kubenswrapper[2578]: I0709 19:27:03.515535    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/9d1be8ff-530e-4cdb-bb37-441bf5223df5-openshift-service-ca\") pod \"maas-api-e2e-ait-639f19cb-77d6c899f8-8cmps\" (UID: \"9d1be8ff-530e-4cdb-bb37-441bf5223df5\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-639f19cb-77d6c899f8-8cmps"
Jul 09 19:27:03.515699 ip-10-0-139-134 kubenswrapper[2578]: I0709 19:27:03.515567    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/9d1be8ff-530e-4cdb-bb37-441bf5223df5-maas-api-tls\") pod \"maas-api-e2e-ait-639f19cb-77d6c899f8-8cmps\" (UID: \"9d1be8ff-530e-4cdb-bb37-441bf5223df5\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-639f19cb-77d6c899f8-8cmps"
Jul 09 19:27:03.515699 ip-10-0-139-134 kubenswrapper[2578]: E0709 19:27:03.515671    2578 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-ait-639f19cb-serving-cert: secret "maas-api-e2e-ait-639f19cb-serving-cert" not found
Jul 09 19:27:03.515825 ip-10-0-139-134 kubenswrapper[2578]: E0709 19:27:03.515740    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9d1be8ff-530e-4cdb-bb37-441bf5223df5-maas-api-tls podName:9d1be8ff-530e-4cdb-bb37-441bf5223df5 nodeName:}" failed. No retries permitted until 2026-07-09 19:27:04.015719227 +0000 UTC m=+1720.641770535 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/9d1be8ff-530e-4cdb-bb37-441bf5223df5-maas-api-tls") pod "maas-api-e2e-ait-639f19cb-77d6c899f8-8cmps" (UID: "9d1be8ff-530e-4cdb-bb37-441bf5223df5") : secret "maas-api-e2e-ait-639f19cb-serving-cert" not found
Jul 09 19:27:03.516267 ip-10-0-139-134 kubenswrapper[2578]: I0709 19:27:03.516247    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/9d1be8ff-530e-4cdb-bb37-441bf5223df5-openshift-service-ca\") pod \"maas-api-e2e-ait-639f19cb-77d6c899f8-8cmps\" (UID: \"9d1be8ff-530e-4cdb-bb37-441bf5223df5\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-639f19cb-77d6c899f8-8cmps"
Jul 09 19:27:03.526124 ip-10-0-139-134 kubenswrapper[2578]: I0709 19:27:03.526066    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-94ps8\" (UniqueName: \"kubernetes.io/projected/9d1be8ff-530e-4cdb-bb37-441bf5223df5-kube-api-access-94ps8\") pod \"maas-api-e2e-ait-639f19cb-77d6c899f8-8cmps\" (UID: \"9d1be8ff-530e-4cdb-bb37-441bf5223df5\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-639f19cb-77d6c899f8-8cmps"
Jul 09 19:27:04.020612 ip-10-0-139-134 kubenswrapper[2578]: I0709 19:27:04.020576    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/9d1be8ff-530e-4cdb-bb37-441bf5223df5-maas-api-tls\") pod \"maas-api-e2e-ait-639f19cb-77d6c899f8-8cmps\" (UID: \"9d1be8ff-530e-4cdb-bb37-441bf5223df5\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-639f19cb-77d6c899f8-8cmps"
Jul 09 19:27:04.023127 ip-10-0-139-134 kubenswrapper[2578]: I0709 19:27:04.023103    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/9d1be8ff-530e-4cdb-bb37-441bf5223df5-maas-api-tls\") pod \"maas-api-e2e-ait-639f19cb-77d6c899f8-8cmps\" (UID: \"9d1be8ff-530e-4cdb-bb37-441bf5223df5\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-639f19cb-77d6c899f8-8cmps"
Jul 09 19:27:04.186118 ip-10-0-139-134 kubenswrapper[2578]: I0709 19:27:04.186087    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-639f19cb-77d6c899f8-8cmps"
Jul 09 19:27:04.322222 ip-10-0-139-134 kubenswrapper[2578]: I0709 19:27:04.322194    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-639f19cb-77d6c899f8-8cmps"]
Jul 09 19:27:04.323933 ip-10-0-139-134 kubenswrapper[2578]: W0709 19:27:04.323908    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9d1be8ff_530e_4cdb_bb37_441bf5223df5.slice/crio-67eeb8f6a6a4199892de3315a0134b29bfdb9cad37f5655584d5b2eff30dc126 WatchSource:0}: Error finding container 67eeb8f6a6a4199892de3315a0134b29bfdb9cad37f5655584d5b2eff30dc126: Status 404 returned error can't find the container with id 67eeb8f6a6a4199892de3315a0134b29bfdb9cad37f5655584d5b2eff30dc126
Jul 09 19:27:04.325276 ip-10-0-139-134 kubenswrapper[2578]: I0709 19:27:04.325258    2578 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 09 19:27:04.586087 ip-10-0-139-134 kubenswrapper[2578]: I0709 19:27:04.585983    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-639f19cb-77d6c899f8-8cmps" event={"ID":"9d1be8ff-530e-4cdb-bb37-441bf5223df5","Type":"ContainerStarted","Data":"67eeb8f6a6a4199892de3315a0134b29bfdb9cad37f5655584d5b2eff30dc126"}
Jul 09 19:27:06.597151 ip-10-0-139-134 kubenswrapper[2578]: I0709 19:27:06.597115    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-639f19cb-77d6c899f8-8cmps" event={"ID":"9d1be8ff-530e-4cdb-bb37-441bf5223df5","Type":"ContainerStarted","Data":"3d2d449576b82f1df928772c5221dec97f1f67e9fa74909249e3d18ed60a2033"}
Jul 09 19:27:06.597538 ip-10-0-139-134 kubenswrapper[2578]: I0709 19:27:06.597267    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-ait-639f19cb-77d6c899f8-8cmps"
Jul 09 19:27:06.616211 ip-10-0-139-134 kubenswrapper[2578]: I0709 19:27:06.616160    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-ait-639f19cb-77d6c899f8-8cmps" podStartSLOduration=1.469153154 podStartE2EDuration="3.616143655s" totalImagesPullingTime="2.146990501s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 19:27:03 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 19:27:06.615768852 +0000 UTC m=+1723.241820181" watchObservedRunningTime="2026-07-09 19:27:06.616143655 +0000 UTC m=+1723.242194985"
Jul 09 19:27:08.525739 ip-10-0-139-134 kubenswrapper[2578]: I0709 19:27:08.525705    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-639f19cb-77d6c899f8-8cmps"]
Jul 09 19:27:08.605845 ip-10-0-139-134 kubenswrapper[2578]: I0709 19:27:08.605807    2578 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-ait-639f19cb-77d6c899f8-8cmps" podUID="9d1be8ff-530e-4cdb-bb37-441bf5223df5" containerName="maas-api" containerID="cri-o://3d2d449576b82f1df928772c5221dec97f1f67e9fa74909249e3d18ed60a2033" gracePeriod=30
Jul 09 19:27:08.848172 ip-10-0-139-134 kubenswrapper[2578]: I0709 19:27:08.848145    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-639f19cb-77d6c899f8-8cmps"
Jul 09 19:27:08.963445 ip-10-0-139-134 kubenswrapper[2578]: I0709 19:27:08.963412    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/9d1be8ff-530e-4cdb-bb37-441bf5223df5-openshift-service-ca\") pod \"9d1be8ff-530e-4cdb-bb37-441bf5223df5\" (UID: \"9d1be8ff-530e-4cdb-bb37-441bf5223df5\") "
Jul 09 19:27:08.963445 ip-10-0-139-134 kubenswrapper[2578]: I0709 19:27:08.963451    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-94ps8\" (UniqueName: \"kubernetes.io/projected/9d1be8ff-530e-4cdb-bb37-441bf5223df5-kube-api-access-94ps8\") pod \"9d1be8ff-530e-4cdb-bb37-441bf5223df5\" (UID: \"9d1be8ff-530e-4cdb-bb37-441bf5223df5\") "
Jul 09 19:27:08.963712 ip-10-0-139-134 kubenswrapper[2578]: I0709 19:27:08.963472    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/9d1be8ff-530e-4cdb-bb37-441bf5223df5-maas-api-tls\") pod \"9d1be8ff-530e-4cdb-bb37-441bf5223df5\" (UID: \"9d1be8ff-530e-4cdb-bb37-441bf5223df5\") "
Jul 09 19:27:08.963850 ip-10-0-139-134 kubenswrapper[2578]: I0709 19:27:08.963821    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9d1be8ff-530e-4cdb-bb37-441bf5223df5-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "9d1be8ff-530e-4cdb-bb37-441bf5223df5" (UID: "9d1be8ff-530e-4cdb-bb37-441bf5223df5"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 09 19:27:08.966493 ip-10-0-139-134 kubenswrapper[2578]: I0709 19:27:08.966466    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9d1be8ff-530e-4cdb-bb37-441bf5223df5-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "9d1be8ff-530e-4cdb-bb37-441bf5223df5" (UID: "9d1be8ff-530e-4cdb-bb37-441bf5223df5"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 09 19:27:08.966493 ip-10-0-139-134 kubenswrapper[2578]: I0709 19:27:08.966482    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9d1be8ff-530e-4cdb-bb37-441bf5223df5-kube-api-access-94ps8" (OuterVolumeSpecName: "kube-api-access-94ps8") pod "9d1be8ff-530e-4cdb-bb37-441bf5223df5" (UID: "9d1be8ff-530e-4cdb-bb37-441bf5223df5"). InnerVolumeSpecName "kube-api-access-94ps8". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 09 19:27:09.064797 ip-10-0-139-134 kubenswrapper[2578]: I0709 19:27:09.064760    2578 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/9d1be8ff-530e-4cdb-bb37-441bf5223df5-openshift-service-ca\") on node \"ip-10-0-139-134.ec2.internal\" DevicePath \"\""
Jul 09 19:27:09.064797 ip-10-0-139-134 kubenswrapper[2578]: I0709 19:27:09.064791    2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-94ps8\" (UniqueName: \"kubernetes.io/projected/9d1be8ff-530e-4cdb-bb37-441bf5223df5-kube-api-access-94ps8\") on node \"ip-10-0-139-134.ec2.internal\" DevicePath \"\""
Jul 09 19:27:09.064797 ip-10-0-139-134 kubenswrapper[2578]: I0709 19:27:09.064801    2578 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/9d1be8ff-530e-4cdb-bb37-441bf5223df5-maas-api-tls\") on node \"ip-10-0-139-134.ec2.internal\" DevicePath \"\""
Jul 09 19:27:09.614789 ip-10-0-139-134 kubenswrapper[2578]: I0709 19:27:09.614751    2578 generic.go:356] "Generic (PLEG): container finished" podID="9d1be8ff-530e-4cdb-bb37-441bf5223df5" containerID="3d2d449576b82f1df928772c5221dec97f1f67e9fa74909249e3d18ed60a2033" exitCode=0
Jul 09 19:27:09.614789 ip-10-0-139-134 kubenswrapper[2578]: I0709 19:27:09.614792    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-639f19cb-77d6c899f8-8cmps" event={"ID":"9d1be8ff-530e-4cdb-bb37-441bf5223df5","Type":"ContainerDied","Data":"3d2d449576b82f1df928772c5221dec97f1f67e9fa74909249e3d18ed60a2033"}
Jul 09 19:27:09.615281 ip-10-0-139-134 kubenswrapper[2578]: I0709 19:27:09.614796    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-639f19cb-77d6c899f8-8cmps"
Jul 09 19:27:09.615281 ip-10-0-139-134 kubenswrapper[2578]: I0709 19:27:09.614855    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-639f19cb-77d6c899f8-8cmps" event={"ID":"9d1be8ff-530e-4cdb-bb37-441bf5223df5","Type":"ContainerDied","Data":"67eeb8f6a6a4199892de3315a0134b29bfdb9cad37f5655584d5b2eff30dc126"}
Jul 09 19:27:09.615281 ip-10-0-139-134 kubenswrapper[2578]: I0709 19:27:09.614877    2578 scope.go:117] "RemoveContainer" containerID="3d2d449576b82f1df928772c5221dec97f1f67e9fa74909249e3d18ed60a2033"
Jul 09 19:27:09.623910 ip-10-0-139-134 kubenswrapper[2578]: I0709 19:27:09.623890    2578 scope.go:117] "RemoveContainer" containerID="3d2d449576b82f1df928772c5221dec97f1f67e9fa74909249e3d18ed60a2033"
Jul 09 19:27:09.624157 ip-10-0-139-134 kubenswrapper[2578]: E0709 19:27:09.624137    2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3d2d449576b82f1df928772c5221dec97f1f67e9fa74909249e3d18ed60a2033\": container with ID starting with 3d2d449576b82f1df928772c5221dec97f1f67e9fa74909249e3d18ed60a2033 not found: ID does not exist" containerID="3d2d449576b82f1df928772c5221dec97f1f67e9fa74909249e3d18ed60a2033"
Jul 09 19:27:09.624226 ip-10-0-139-134 kubenswrapper[2578]: I0709 19:27:09.624168    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3d2d449576b82f1df928772c5221dec97f1f67e9fa74909249e3d18ed60a2033"} err="failed to get container status \"3d2d449576b82f1df928772c5221dec97f1f67e9fa74909249e3d18ed60a2033\": rpc error: code = NotFound desc = could not find container \"3d2d449576b82f1df928772c5221dec97f1f67e9fa74909249e3d18ed60a2033\": container with ID starting with 3d2d449576b82f1df928772c5221dec97f1f67e9fa74909249e3d18ed60a2033 not found: ID does not exist"
Jul 09 19:27:09.644728 ip-10-0-139-134 kubenswrapper[2578]: I0709 19:27:09.644706    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-639f19cb-77d6c899f8-8cmps"]
Jul 09 19:27:09.649808 ip-10-0-139-134 kubenswrapper[2578]: I0709 19:27:09.649788    2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-639f19cb-77d6c899f8-8cmps"]
Jul 09 19:27:09.838980 ip-10-0-139-134 kubenswrapper[2578]: I0709 19:27:09.838950    2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="9d1be8ff-530e-4cdb-bb37-441bf5223df5" path="/var/lib/kubelet/pods/9d1be8ff-530e-4cdb-bb37-441bf5223df5/volumes"
Jul 09 19:27:16.463232 ip-10-0-139-134 kubenswrapper[2578]: I0709 19:27:16.463202    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-8aa344f6-89779ff4-b45r2"]
Jul 09 19:27:16.463574 ip-10-0-139-134 kubenswrapper[2578]: I0709 19:27:16.463496    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9d1be8ff-530e-4cdb-bb37-441bf5223df5" containerName="maas-api"
Jul 09 19:27:16.463574 ip-10-0-139-134 kubenswrapper[2578]: I0709 19:27:16.463506    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="9d1be8ff-530e-4cdb-bb37-441bf5223df5" containerName="maas-api"
Jul 09 19:27:16.463574 ip-10-0-139-134 kubenswrapper[2578]: I0709 19:27:16.463551    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="9d1be8ff-530e-4cdb-bb37-441bf5223df5" containerName="maas-api"
Jul 09 19:27:16.468106 ip-10-0-139-134 kubenswrapper[2578]: I0709 19:27:16.468085    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-8aa344f6-89779ff4-b45r2"
Jul 09 19:27:16.473407 ip-10-0-139-134 kubenswrapper[2578]: I0709 19:27:16.473382    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-ait-8aa344f6-serving-cert\""
Jul 09 19:27:16.473407 ip-10-0-139-134 kubenswrapper[2578]: I0709 19:27:16.473399    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-dockercfg-9pdt2\""
Jul 09 19:27:16.474767 ip-10-0-139-134 kubenswrapper[2578]: I0709 19:27:16.474746    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"kube-root-ca.crt\""
Jul 09 19:27:16.474860 ip-10-0-139-134 kubenswrapper[2578]: I0709 19:27:16.474747    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 09 19:27:16.482756 ip-10-0-139-134 kubenswrapper[2578]: I0709 19:27:16.482734    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-8aa344f6-89779ff4-b45r2"]
Jul 09 19:27:16.527339 ip-10-0-139-134 kubenswrapper[2578]: I0709 19:27:16.527307    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/a355e343-a5da-4346-a01c-cfd080fefe21-openshift-service-ca\") pod \"maas-api-e2e-ait-8aa344f6-89779ff4-b45r2\" (UID: \"a355e343-a5da-4346-a01c-cfd080fefe21\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-8aa344f6-89779ff4-b45r2"
Jul 09 19:27:16.527339 ip-10-0-139-134 kubenswrapper[2578]: I0709 19:27:16.527342    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/a355e343-a5da-4346-a01c-cfd080fefe21-maas-api-tls\") pod \"maas-api-e2e-ait-8aa344f6-89779ff4-b45r2\" (UID: \"a355e343-a5da-4346-a01c-cfd080fefe21\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-8aa344f6-89779ff4-b45r2"
Jul 09 19:27:16.527560 ip-10-0-139-134 kubenswrapper[2578]: I0709 19:27:16.527420    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-p2mj5\" (UniqueName: \"kubernetes.io/projected/a355e343-a5da-4346-a01c-cfd080fefe21-kube-api-access-p2mj5\") pod \"maas-api-e2e-ait-8aa344f6-89779ff4-b45r2\" (UID: \"a355e343-a5da-4346-a01c-cfd080fefe21\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-8aa344f6-89779ff4-b45r2"
Jul 09 19:27:16.628030 ip-10-0-139-134 kubenswrapper[2578]: I0709 19:27:16.627973    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/a355e343-a5da-4346-a01c-cfd080fefe21-openshift-service-ca\") pod \"maas-api-e2e-ait-8aa344f6-89779ff4-b45r2\" (UID: \"a355e343-a5da-4346-a01c-cfd080fefe21\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-8aa344f6-89779ff4-b45r2"
Jul 09 19:27:16.628030 ip-10-0-139-134 kubenswrapper[2578]: I0709 19:27:16.628034    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/a355e343-a5da-4346-a01c-cfd080fefe21-maas-api-tls\") pod \"maas-api-e2e-ait-8aa344f6-89779ff4-b45r2\" (UID: \"a355e343-a5da-4346-a01c-cfd080fefe21\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-8aa344f6-89779ff4-b45r2"
Jul 09 19:27:16.628235 ip-10-0-139-134 kubenswrapper[2578]: I0709 19:27:16.628099    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-p2mj5\" (UniqueName: \"kubernetes.io/projected/a355e343-a5da-4346-a01c-cfd080fefe21-kube-api-access-p2mj5\") pod \"maas-api-e2e-ait-8aa344f6-89779ff4-b45r2\" (UID: \"a355e343-a5da-4346-a01c-cfd080fefe21\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-8aa344f6-89779ff4-b45r2"
Jul 09 19:27:16.628235 ip-10-0-139-134 kubenswrapper[2578]: E0709 19:27:16.628135    2578 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-ait-8aa344f6-serving-cert: secret "maas-api-e2e-ait-8aa344f6-serving-cert" not found
Jul 09 19:27:16.628235 ip-10-0-139-134 kubenswrapper[2578]: E0709 19:27:16.628217    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a355e343-a5da-4346-a01c-cfd080fefe21-maas-api-tls podName:a355e343-a5da-4346-a01c-cfd080fefe21 nodeName:}" failed. No retries permitted until 2026-07-09 19:27:17.128193489 +0000 UTC m=+1733.754244797 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/a355e343-a5da-4346-a01c-cfd080fefe21-maas-api-tls") pod "maas-api-e2e-ait-8aa344f6-89779ff4-b45r2" (UID: "a355e343-a5da-4346-a01c-cfd080fefe21") : secret "maas-api-e2e-ait-8aa344f6-serving-cert" not found
Jul 09 19:27:16.628625 ip-10-0-139-134 kubenswrapper[2578]: I0709 19:27:16.628606    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/a355e343-a5da-4346-a01c-cfd080fefe21-openshift-service-ca\") pod \"maas-api-e2e-ait-8aa344f6-89779ff4-b45r2\" (UID: \"a355e343-a5da-4346-a01c-cfd080fefe21\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-8aa344f6-89779ff4-b45r2"
Jul 09 19:27:16.638779 ip-10-0-139-134 kubenswrapper[2578]: I0709 19:27:16.638751    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-p2mj5\" (UniqueName: \"kubernetes.io/projected/a355e343-a5da-4346-a01c-cfd080fefe21-kube-api-access-p2mj5\") pod \"maas-api-e2e-ait-8aa344f6-89779ff4-b45r2\" (UID: \"a355e343-a5da-4346-a01c-cfd080fefe21\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-8aa344f6-89779ff4-b45r2"
Jul 09 19:27:17.133618 ip-10-0-139-134 kubenswrapper[2578]: I0709 19:27:17.133573    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/a355e343-a5da-4346-a01c-cfd080fefe21-maas-api-tls\") pod \"maas-api-e2e-ait-8aa344f6-89779ff4-b45r2\" (UID: \"a355e343-a5da-4346-a01c-cfd080fefe21\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-8aa344f6-89779ff4-b45r2"
Jul 09 19:27:17.136200 ip-10-0-139-134 kubenswrapper[2578]: I0709 19:27:17.136177    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/a355e343-a5da-4346-a01c-cfd080fefe21-maas-api-tls\") pod \"maas-api-e2e-ait-8aa344f6-89779ff4-b45r2\" (UID: \"a355e343-a5da-4346-a01c-cfd080fefe21\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-8aa344f6-89779ff4-b45r2"
Jul 09 19:27:17.377656 ip-10-0-139-134 kubenswrapper[2578]: I0709 19:27:17.377621    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-8aa344f6-89779ff4-b45r2"
Jul 09 19:27:17.510976 ip-10-0-139-134 kubenswrapper[2578]: I0709 19:27:17.510951    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-8aa344f6-89779ff4-b45r2"]
Jul 09 19:27:17.513442 ip-10-0-139-134 kubenswrapper[2578]: W0709 19:27:17.513410    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda355e343_a5da_4346_a01c_cfd080fefe21.slice/crio-4d2e44739491afa27138d9542d49ea09ccd6e5465cd7bccfd4102e2d3d95fd5e WatchSource:0}: Error finding container 4d2e44739491afa27138d9542d49ea09ccd6e5465cd7bccfd4102e2d3d95fd5e: Status 404 returned error can't find the container with id 4d2e44739491afa27138d9542d49ea09ccd6e5465cd7bccfd4102e2d3d95fd5e
Jul 09 19:27:17.651972 ip-10-0-139-134 kubenswrapper[2578]: I0709 19:27:17.651937    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-8aa344f6-89779ff4-b45r2" event={"ID":"a355e343-a5da-4346-a01c-cfd080fefe21","Type":"ContainerStarted","Data":"4d2e44739491afa27138d9542d49ea09ccd6e5465cd7bccfd4102e2d3d95fd5e"}
Jul 09 19:27:18.658082 ip-10-0-139-134 kubenswrapper[2578]: I0709 19:27:18.658043    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-8aa344f6-89779ff4-b45r2" event={"ID":"a355e343-a5da-4346-a01c-cfd080fefe21","Type":"ContainerStarted","Data":"47efa70c1e7e056f16edb02503975656e5d5a6a0d49c52833736dd93ae00bdb8"}
Jul 09 19:27:18.658476 ip-10-0-139-134 kubenswrapper[2578]: I0709 19:27:18.658190    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-ait-8aa344f6-89779ff4-b45r2"
Jul 09 19:27:18.679363 ip-10-0-139-134 kubenswrapper[2578]: I0709 19:27:18.679311    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-ait-8aa344f6-89779ff4-b45r2" podStartSLOduration=2.163229107 podStartE2EDuration="2.679295004s" totalImagesPullingTime="516.065897ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 19:27:16 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 19:27:18.67784431 +0000 UTC m=+1735.303895670" watchObservedRunningTime="2026-07-09 19:27:18.679295004 +0000 UTC m=+1735.305346333"
Jul 09 19:27:21.818127 ip-10-0-139-134 kubenswrapper[2578]: I0709 19:27:21.818091    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-8aa344f6-89779ff4-b45r2"]
Jul 09 19:27:21.818502 ip-10-0-139-134 kubenswrapper[2578]: I0709 19:27:21.818317    2578 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-ait-8aa344f6-89779ff4-b45r2" podUID="a355e343-a5da-4346-a01c-cfd080fefe21" containerName="maas-api" containerID="cri-o://47efa70c1e7e056f16edb02503975656e5d5a6a0d49c52833736dd93ae00bdb8" gracePeriod=30
Jul 09 19:27:22.059533 ip-10-0-139-134 kubenswrapper[2578]: I0709 19:27:22.059503    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-8aa344f6-89779ff4-b45r2"
Jul 09 19:27:22.073266 ip-10-0-139-134 kubenswrapper[2578]: I0709 19:27:22.073201    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-p2mj5\" (UniqueName: \"kubernetes.io/projected/a355e343-a5da-4346-a01c-cfd080fefe21-kube-api-access-p2mj5\") pod \"a355e343-a5da-4346-a01c-cfd080fefe21\" (UID: \"a355e343-a5da-4346-a01c-cfd080fefe21\") "
Jul 09 19:27:22.073266 ip-10-0-139-134 kubenswrapper[2578]: I0709 19:27:22.073239    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/a355e343-a5da-4346-a01c-cfd080fefe21-maas-api-tls\") pod \"a355e343-a5da-4346-a01c-cfd080fefe21\" (UID: \"a355e343-a5da-4346-a01c-cfd080fefe21\") "
Jul 09 19:27:22.073436 ip-10-0-139-134 kubenswrapper[2578]: I0709 19:27:22.073313    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/a355e343-a5da-4346-a01c-cfd080fefe21-openshift-service-ca\") pod \"a355e343-a5da-4346-a01c-cfd080fefe21\" (UID: \"a355e343-a5da-4346-a01c-cfd080fefe21\") "
Jul 09 19:27:22.073671 ip-10-0-139-134 kubenswrapper[2578]: I0709 19:27:22.073643    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a355e343-a5da-4346-a01c-cfd080fefe21-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "a355e343-a5da-4346-a01c-cfd080fefe21" (UID: "a355e343-a5da-4346-a01c-cfd080fefe21"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 09 19:27:22.075327 ip-10-0-139-134 kubenswrapper[2578]: I0709 19:27:22.075307    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a355e343-a5da-4346-a01c-cfd080fefe21-kube-api-access-p2mj5" (OuterVolumeSpecName: "kube-api-access-p2mj5") pod "a355e343-a5da-4346-a01c-cfd080fefe21" (UID: "a355e343-a5da-4346-a01c-cfd080fefe21"). InnerVolumeSpecName "kube-api-access-p2mj5". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 09 19:27:22.075414 ip-10-0-139-134 kubenswrapper[2578]: I0709 19:27:22.075325    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a355e343-a5da-4346-a01c-cfd080fefe21-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "a355e343-a5da-4346-a01c-cfd080fefe21" (UID: "a355e343-a5da-4346-a01c-cfd080fefe21"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 09 19:27:22.174398 ip-10-0-139-134 kubenswrapper[2578]: I0709 19:27:22.174360    2578 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/a355e343-a5da-4346-a01c-cfd080fefe21-openshift-service-ca\") on node \"ip-10-0-139-134.ec2.internal\" DevicePath \"\""
Jul 09 19:27:22.174398 ip-10-0-139-134 kubenswrapper[2578]: I0709 19:27:22.174389    2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-p2mj5\" (UniqueName: \"kubernetes.io/projected/a355e343-a5da-4346-a01c-cfd080fefe21-kube-api-access-p2mj5\") on node \"ip-10-0-139-134.ec2.internal\" DevicePath \"\""
Jul 09 19:27:22.174398 ip-10-0-139-134 kubenswrapper[2578]: I0709 19:27:22.174398    2578 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/a355e343-a5da-4346-a01c-cfd080fefe21-maas-api-tls\") on node \"ip-10-0-139-134.ec2.internal\" DevicePath \"\""
Jul 09 19:27:22.677124 ip-10-0-139-134 kubenswrapper[2578]: I0709 19:27:22.677090    2578 generic.go:356] "Generic (PLEG): container finished" podID="a355e343-a5da-4346-a01c-cfd080fefe21" containerID="47efa70c1e7e056f16edb02503975656e5d5a6a0d49c52833736dd93ae00bdb8" exitCode=0
Jul 09 19:27:22.677310 ip-10-0-139-134 kubenswrapper[2578]: I0709 19:27:22.677141    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-8aa344f6-89779ff4-b45r2"
Jul 09 19:27:22.677310 ip-10-0-139-134 kubenswrapper[2578]: I0709 19:27:22.677182    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-8aa344f6-89779ff4-b45r2" event={"ID":"a355e343-a5da-4346-a01c-cfd080fefe21","Type":"ContainerDied","Data":"47efa70c1e7e056f16edb02503975656e5d5a6a0d49c52833736dd93ae00bdb8"}
Jul 09 19:27:22.677310 ip-10-0-139-134 kubenswrapper[2578]: I0709 19:27:22.677232    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-8aa344f6-89779ff4-b45r2" event={"ID":"a355e343-a5da-4346-a01c-cfd080fefe21","Type":"ContainerDied","Data":"4d2e44739491afa27138d9542d49ea09ccd6e5465cd7bccfd4102e2d3d95fd5e"}
Jul 09 19:27:22.677310 ip-10-0-139-134 kubenswrapper[2578]: I0709 19:27:22.677254    2578 scope.go:117] "RemoveContainer" containerID="47efa70c1e7e056f16edb02503975656e5d5a6a0d49c52833736dd93ae00bdb8"
Jul 09 19:27:22.686056 ip-10-0-139-134 kubenswrapper[2578]: I0709 19:27:22.686037    2578 scope.go:117] "RemoveContainer" containerID="47efa70c1e7e056f16edb02503975656e5d5a6a0d49c52833736dd93ae00bdb8"
Jul 09 19:27:22.686333 ip-10-0-139-134 kubenswrapper[2578]: E0709 19:27:22.686315    2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"47efa70c1e7e056f16edb02503975656e5d5a6a0d49c52833736dd93ae00bdb8\": container with ID starting with 47efa70c1e7e056f16edb02503975656e5d5a6a0d49c52833736dd93ae00bdb8 not found: ID does not exist" containerID="47efa70c1e7e056f16edb02503975656e5d5a6a0d49c52833736dd93ae00bdb8"
Jul 09 19:27:22.686404 ip-10-0-139-134 kubenswrapper[2578]: I0709 19:27:22.686345    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"47efa70c1e7e056f16edb02503975656e5d5a6a0d49c52833736dd93ae00bdb8"} err="failed to get container status \"47efa70c1e7e056f16edb02503975656e5d5a6a0d49c52833736dd93ae00bdb8\": rpc error: code = NotFound desc = could not find container \"47efa70c1e7e056f16edb02503975656e5d5a6a0d49c52833736dd93ae00bdb8\": container with ID starting with 47efa70c1e7e056f16edb02503975656e5d5a6a0d49c52833736dd93ae00bdb8 not found: ID does not exist"
Jul 09 19:27:22.700370 ip-10-0-139-134 kubenswrapper[2578]: I0709 19:27:22.700345    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-8aa344f6-89779ff4-b45r2"]
Jul 09 19:27:22.704121 ip-10-0-139-134 kubenswrapper[2578]: I0709 19:27:22.704100    2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-8aa344f6-89779ff4-b45r2"]
Jul 09 19:27:23.838622 ip-10-0-139-134 kubenswrapper[2578]: I0709 19:27:23.838585    2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a355e343-a5da-4346-a01c-cfd080fefe21" path="/var/lib/kubelet/pods/a355e343-a5da-4346-a01c-cfd080fefe21/volumes"
Jul 09 19:27:35.165227 ip-10-0-139-134 kubenswrapper[2578]: I0709 19:27:35.165182    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-0153dcdd-8cd447f64-zj959"]
Jul 09 19:27:35.165616 ip-10-0-139-134 kubenswrapper[2578]: I0709 19:27:35.165494    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a355e343-a5da-4346-a01c-cfd080fefe21" containerName="maas-api"
Jul 09 19:27:35.165616 ip-10-0-139-134 kubenswrapper[2578]: I0709 19:27:35.165506    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="a355e343-a5da-4346-a01c-cfd080fefe21" containerName="maas-api"
Jul 09 19:27:35.165616 ip-10-0-139-134 kubenswrapper[2578]: I0709 19:27:35.165568    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="a355e343-a5da-4346-a01c-cfd080fefe21" containerName="maas-api"
Jul 09 19:27:35.168181 ip-10-0-139-134 kubenswrapper[2578]: I0709 19:27:35.168167    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-derive-0153dcdd-8cd447f64-zj959"
Jul 09 19:27:35.171438 ip-10-0-139-134 kubenswrapper[2578]: I0709 19:27:35.171419    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 09 19:27:35.172986 ip-10-0-139-134 kubenswrapper[2578]: I0709 19:27:35.172963    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"kube-root-ca.crt\""
Jul 09 19:27:35.173123 ip-10-0-139-134 kubenswrapper[2578]: I0709 19:27:35.172962    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-derive-0153dcdd-serving-cert\""
Jul 09 19:27:35.173123 ip-10-0-139-134 kubenswrapper[2578]: I0709 19:27:35.173039    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-dockercfg-9pdt2\""
Jul 09 19:27:35.189688 ip-10-0-139-134 kubenswrapper[2578]: I0709 19:27:35.189662    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-0153dcdd-8cd447f64-zj959"]
Jul 09 19:27:35.285178 ip-10-0-139-134 kubenswrapper[2578]: I0709 19:27:35.285142    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/c2941066-c06d-4f33-b9ad-35126198407b-maas-api-tls\") pod \"maas-api-e2e-derive-0153dcdd-8cd447f64-zj959\" (UID: \"c2941066-c06d-4f33-b9ad-35126198407b\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-0153dcdd-8cd447f64-zj959"
Jul 09 19:27:35.285178 ip-10-0-139-134 kubenswrapper[2578]: I0709 19:27:35.285184    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/c2941066-c06d-4f33-b9ad-35126198407b-openshift-service-ca\") pod \"maas-api-e2e-derive-0153dcdd-8cd447f64-zj959\" (UID: \"c2941066-c06d-4f33-b9ad-35126198407b\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-0153dcdd-8cd447f64-zj959"
Jul 09 19:27:35.285396 ip-10-0-139-134 kubenswrapper[2578]: I0709 19:27:35.285213    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6lw9f\" (UniqueName: \"kubernetes.io/projected/c2941066-c06d-4f33-b9ad-35126198407b-kube-api-access-6lw9f\") pod \"maas-api-e2e-derive-0153dcdd-8cd447f64-zj959\" (UID: \"c2941066-c06d-4f33-b9ad-35126198407b\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-0153dcdd-8cd447f64-zj959"
Jul 09 19:27:35.386102 ip-10-0-139-134 kubenswrapper[2578]: I0709 19:27:35.386065    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6lw9f\" (UniqueName: \"kubernetes.io/projected/c2941066-c06d-4f33-b9ad-35126198407b-kube-api-access-6lw9f\") pod \"maas-api-e2e-derive-0153dcdd-8cd447f64-zj959\" (UID: \"c2941066-c06d-4f33-b9ad-35126198407b\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-0153dcdd-8cd447f64-zj959"
Jul 09 19:27:35.386307 ip-10-0-139-134 kubenswrapper[2578]: I0709 19:27:35.386141    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/c2941066-c06d-4f33-b9ad-35126198407b-maas-api-tls\") pod \"maas-api-e2e-derive-0153dcdd-8cd447f64-zj959\" (UID: \"c2941066-c06d-4f33-b9ad-35126198407b\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-0153dcdd-8cd447f64-zj959"
Jul 09 19:27:35.386307 ip-10-0-139-134 kubenswrapper[2578]: I0709 19:27:35.386179    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/c2941066-c06d-4f33-b9ad-35126198407b-openshift-service-ca\") pod \"maas-api-e2e-derive-0153dcdd-8cd447f64-zj959\" (UID: \"c2941066-c06d-4f33-b9ad-35126198407b\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-0153dcdd-8cd447f64-zj959"
Jul 09 19:27:35.386839 ip-10-0-139-134 kubenswrapper[2578]: I0709 19:27:35.386773    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/c2941066-c06d-4f33-b9ad-35126198407b-openshift-service-ca\") pod \"maas-api-e2e-derive-0153dcdd-8cd447f64-zj959\" (UID: \"c2941066-c06d-4f33-b9ad-35126198407b\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-0153dcdd-8cd447f64-zj959"
Jul 09 19:27:35.388680 ip-10-0-139-134 kubenswrapper[2578]: I0709 19:27:35.388658    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/c2941066-c06d-4f33-b9ad-35126198407b-maas-api-tls\") pod \"maas-api-e2e-derive-0153dcdd-8cd447f64-zj959\" (UID: \"c2941066-c06d-4f33-b9ad-35126198407b\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-0153dcdd-8cd447f64-zj959"
Jul 09 19:27:35.395675 ip-10-0-139-134 kubenswrapper[2578]: I0709 19:27:35.395653    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6lw9f\" (UniqueName: \"kubernetes.io/projected/c2941066-c06d-4f33-b9ad-35126198407b-kube-api-access-6lw9f\") pod \"maas-api-e2e-derive-0153dcdd-8cd447f64-zj959\" (UID: \"c2941066-c06d-4f33-b9ad-35126198407b\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-0153dcdd-8cd447f64-zj959"
Jul 09 19:27:35.477878 ip-10-0-139-134 kubenswrapper[2578]: I0709 19:27:35.477785    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-derive-0153dcdd-8cd447f64-zj959"
Jul 09 19:27:35.620170 ip-10-0-139-134 kubenswrapper[2578]: I0709 19:27:35.620144    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-0153dcdd-8cd447f64-zj959"]
Jul 09 19:27:35.622093 ip-10-0-139-134 kubenswrapper[2578]: W0709 19:27:35.622068    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc2941066_c06d_4f33_b9ad_35126198407b.slice/crio-855c43dff1d5de74b603cb1fbc5c5e378b26ef2df932fc1a3425705760c9aaf7 WatchSource:0}: Error finding container 855c43dff1d5de74b603cb1fbc5c5e378b26ef2df932fc1a3425705760c9aaf7: Status 404 returned error can't find the container with id 855c43dff1d5de74b603cb1fbc5c5e378b26ef2df932fc1a3425705760c9aaf7
Jul 09 19:27:35.733599 ip-10-0-139-134 kubenswrapper[2578]: I0709 19:27:35.733517    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-derive-0153dcdd-8cd447f64-zj959" event={"ID":"c2941066-c06d-4f33-b9ad-35126198407b","Type":"ContainerStarted","Data":"855c43dff1d5de74b603cb1fbc5c5e378b26ef2df932fc1a3425705760c9aaf7"}
Jul 09 19:27:36.739486 ip-10-0-139-134 kubenswrapper[2578]: I0709 19:27:36.739449    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-derive-0153dcdd-8cd447f64-zj959" event={"ID":"c2941066-c06d-4f33-b9ad-35126198407b","Type":"ContainerStarted","Data":"2b75601398ddb68f79fdc720ae48bcd12563241034f9c7c4db18226d8cbda374"}
Jul 09 19:27:36.739885 ip-10-0-139-134 kubenswrapper[2578]: I0709 19:27:36.739574    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-derive-0153dcdd-8cd447f64-zj959"
Jul 09 19:27:36.760796 ip-10-0-139-134 kubenswrapper[2578]: I0709 19:27:36.760740    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-derive-0153dcdd-8cd447f64-zj959" podStartSLOduration=1.338696311 podStartE2EDuration="1.760724509s" totalImagesPullingTime="422.028198ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 19:27:35 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 19:27:36.759579054 +0000 UTC m=+1753.385630398" watchObservedRunningTime="2026-07-09 19:27:36.760724509 +0000 UTC m=+1753.386775839"
Jul 09 19:27:39.764690 ip-10-0-139-134 kubenswrapper[2578]: I0709 19:27:39.764662    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-0153dcdd-8cd447f64-zj959"]
Jul 09 19:27:39.765105 ip-10-0-139-134 kubenswrapper[2578]: I0709 19:27:39.764858    2578 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-derive-0153dcdd-8cd447f64-zj959" podUID="c2941066-c06d-4f33-b9ad-35126198407b" containerName="maas-api" containerID="cri-o://2b75601398ddb68f79fdc720ae48bcd12563241034f9c7c4db18226d8cbda374" gracePeriod=30
Jul 09 19:27:40.014073 ip-10-0-139-134 kubenswrapper[2578]: I0709 19:27:40.014046    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-derive-0153dcdd-8cd447f64-zj959"
Jul 09 19:27:40.127557 ip-10-0-139-134 kubenswrapper[2578]: I0709 19:27:40.127470    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/c2941066-c06d-4f33-b9ad-35126198407b-openshift-service-ca\") pod \"c2941066-c06d-4f33-b9ad-35126198407b\" (UID: \"c2941066-c06d-4f33-b9ad-35126198407b\") "
Jul 09 19:27:40.127557 ip-10-0-139-134 kubenswrapper[2578]: I0709 19:27:40.127553    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/c2941066-c06d-4f33-b9ad-35126198407b-maas-api-tls\") pod \"c2941066-c06d-4f33-b9ad-35126198407b\" (UID: \"c2941066-c06d-4f33-b9ad-35126198407b\") "
Jul 09 19:27:40.127769 ip-10-0-139-134 kubenswrapper[2578]: I0709 19:27:40.127650    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-6lw9f\" (UniqueName: \"kubernetes.io/projected/c2941066-c06d-4f33-b9ad-35126198407b-kube-api-access-6lw9f\") pod \"c2941066-c06d-4f33-b9ad-35126198407b\" (UID: \"c2941066-c06d-4f33-b9ad-35126198407b\") "
Jul 09 19:27:40.127872 ip-10-0-139-134 kubenswrapper[2578]: I0709 19:27:40.127849    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c2941066-c06d-4f33-b9ad-35126198407b-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "c2941066-c06d-4f33-b9ad-35126198407b" (UID: "c2941066-c06d-4f33-b9ad-35126198407b"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 09 19:27:40.129671 ip-10-0-139-134 kubenswrapper[2578]: I0709 19:27:40.129650    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c2941066-c06d-4f33-b9ad-35126198407b-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "c2941066-c06d-4f33-b9ad-35126198407b" (UID: "c2941066-c06d-4f33-b9ad-35126198407b"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 09 19:27:40.129754 ip-10-0-139-134 kubenswrapper[2578]: I0709 19:27:40.129713    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c2941066-c06d-4f33-b9ad-35126198407b-kube-api-access-6lw9f" (OuterVolumeSpecName: "kube-api-access-6lw9f") pod "c2941066-c06d-4f33-b9ad-35126198407b" (UID: "c2941066-c06d-4f33-b9ad-35126198407b"). InnerVolumeSpecName "kube-api-access-6lw9f". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 09 19:27:40.228524 ip-10-0-139-134 kubenswrapper[2578]: I0709 19:27:40.228463    2578 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/c2941066-c06d-4f33-b9ad-35126198407b-maas-api-tls\") on node \"ip-10-0-139-134.ec2.internal\" DevicePath \"\""
Jul 09 19:27:40.228524 ip-10-0-139-134 kubenswrapper[2578]: I0709 19:27:40.228515    2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-6lw9f\" (UniqueName: \"kubernetes.io/projected/c2941066-c06d-4f33-b9ad-35126198407b-kube-api-access-6lw9f\") on node \"ip-10-0-139-134.ec2.internal\" DevicePath \"\""
Jul 09 19:27:40.228524 ip-10-0-139-134 kubenswrapper[2578]: I0709 19:27:40.228528    2578 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/c2941066-c06d-4f33-b9ad-35126198407b-openshift-service-ca\") on node \"ip-10-0-139-134.ec2.internal\" DevicePath \"\""
Jul 09 19:27:40.757675 ip-10-0-139-134 kubenswrapper[2578]: I0709 19:27:40.757633    2578 generic.go:356] "Generic (PLEG): container finished" podID="c2941066-c06d-4f33-b9ad-35126198407b" containerID="2b75601398ddb68f79fdc720ae48bcd12563241034f9c7c4db18226d8cbda374" exitCode=0
Jul 09 19:27:40.757675 ip-10-0-139-134 kubenswrapper[2578]: I0709 19:27:40.757679    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-derive-0153dcdd-8cd447f64-zj959"
Jul 09 19:27:40.757949 ip-10-0-139-134 kubenswrapper[2578]: I0709 19:27:40.757731    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-derive-0153dcdd-8cd447f64-zj959" event={"ID":"c2941066-c06d-4f33-b9ad-35126198407b","Type":"ContainerDied","Data":"2b75601398ddb68f79fdc720ae48bcd12563241034f9c7c4db18226d8cbda374"}
Jul 09 19:27:40.757949 ip-10-0-139-134 kubenswrapper[2578]: I0709 19:27:40.757797    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-derive-0153dcdd-8cd447f64-zj959" event={"ID":"c2941066-c06d-4f33-b9ad-35126198407b","Type":"ContainerDied","Data":"855c43dff1d5de74b603cb1fbc5c5e378b26ef2df932fc1a3425705760c9aaf7"}
Jul 09 19:27:40.757949 ip-10-0-139-134 kubenswrapper[2578]: I0709 19:27:40.757831    2578 scope.go:117] "RemoveContainer" containerID="2b75601398ddb68f79fdc720ae48bcd12563241034f9c7c4db18226d8cbda374"
Jul 09 19:27:40.767144 ip-10-0-139-134 kubenswrapper[2578]: I0709 19:27:40.766931    2578 scope.go:117] "RemoveContainer" containerID="2b75601398ddb68f79fdc720ae48bcd12563241034f9c7c4db18226d8cbda374"
Jul 09 19:27:40.767396 ip-10-0-139-134 kubenswrapper[2578]: E0709 19:27:40.767254    2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2b75601398ddb68f79fdc720ae48bcd12563241034f9c7c4db18226d8cbda374\": container with ID starting with 2b75601398ddb68f79fdc720ae48bcd12563241034f9c7c4db18226d8cbda374 not found: ID does not exist" containerID="2b75601398ddb68f79fdc720ae48bcd12563241034f9c7c4db18226d8cbda374"
Jul 09 19:27:40.767396 ip-10-0-139-134 kubenswrapper[2578]: I0709 19:27:40.767281    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2b75601398ddb68f79fdc720ae48bcd12563241034f9c7c4db18226d8cbda374"} err="failed to get container status \"2b75601398ddb68f79fdc720ae48bcd12563241034f9c7c4db18226d8cbda374\": rpc error: code = NotFound desc = could not find container \"2b75601398ddb68f79fdc720ae48bcd12563241034f9c7c4db18226d8cbda374\": container with ID starting with 2b75601398ddb68f79fdc720ae48bcd12563241034f9c7c4db18226d8cbda374 not found: ID does not exist"
Jul 09 19:27:40.782300 ip-10-0-139-134 kubenswrapper[2578]: I0709 19:27:40.782265    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-0153dcdd-8cd447f64-zj959"]
Jul 09 19:27:40.789046 ip-10-0-139-134 kubenswrapper[2578]: I0709 19:27:40.789016    2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-0153dcdd-8cd447f64-zj959"]
Jul 09 19:27:41.837948 ip-10-0-139-134 kubenswrapper[2578]: I0709 19:27:41.837860    2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c2941066-c06d-4f33-b9ad-35126198407b" path="/var/lib/kubelet/pods/c2941066-c06d-4f33-b9ad-35126198407b/volumes"
Jul 09 19:28:23.891668 ip-10-0-139-134 kubenswrapper[2578]: I0709 19:28:23.891635    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-8gqbs_7a15b7a9-7525-426b-a051-3ece178b71bc/ovn-acl-logging/0.log"
Jul 09 19:28:23.893822 ip-10-0-139-134 kubenswrapper[2578]: I0709 19:28:23.893802    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-8gqbs_7a15b7a9-7525-426b-a051-3ece178b71bc/ovn-acl-logging/0.log"
Jul 09 19:29:25.396928 ip-10-0-139-134 kubenswrapper[2578]: I0709 19:29:25.396894    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-5ec314ef-7bc6777c8-bm96b"]
Jul 09 19:29:25.397557 ip-10-0-139-134 kubenswrapper[2578]: I0709 19:29:25.397217    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c2941066-c06d-4f33-b9ad-35126198407b" containerName="maas-api"
Jul 09 19:29:25.397557 ip-10-0-139-134 kubenswrapper[2578]: I0709 19:29:25.397232    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="c2941066-c06d-4f33-b9ad-35126198407b" containerName="maas-api"
Jul 09 19:29:25.397557 ip-10-0-139-134 kubenswrapper[2578]: I0709 19:29:25.397305    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="c2941066-c06d-4f33-b9ad-35126198407b" containerName="maas-api"
Jul 09 19:29:25.399548 ip-10-0-139-134 kubenswrapper[2578]: I0709 19:29:25.399528    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-5ec314ef-7bc6777c8-bm96b"
Jul 09 19:29:25.403192 ip-10-0-139-134 kubenswrapper[2578]: I0709 19:29:25.403168    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-mt-5ec314ef-serving-cert\""
Jul 09 19:29:25.403192 ip-10-0-139-134 kubenswrapper[2578]: I0709 19:29:25.403183    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"kube-root-ca.crt\""
Jul 09 19:29:25.403373 ip-10-0-139-134 kubenswrapper[2578]: I0709 19:29:25.403173    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-dockercfg-9pdt2\""
Jul 09 19:29:25.403373 ip-10-0-139-134 kubenswrapper[2578]: I0709 19:29:25.403225    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 09 19:29:25.410059 ip-10-0-139-134 kubenswrapper[2578]: I0709 19:29:25.410035    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-5ec314ef-7bc6777c8-bm96b"]
Jul 09 19:29:25.536158 ip-10-0-139-134 kubenswrapper[2578]: I0709 19:29:25.536125    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/a7c0450b-fee9-4dd0-baac-14c48f0a3174-openshift-service-ca\") pod \"maas-api-e2e-mt-5ec314ef-7bc6777c8-bm96b\" (UID: \"a7c0450b-fee9-4dd0-baac-14c48f0a3174\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-5ec314ef-7bc6777c8-bm96b"
Jul 09 19:29:25.536333 ip-10-0-139-134 kubenswrapper[2578]: I0709 19:29:25.536167    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-562k6\" (UniqueName: \"kubernetes.io/projected/a7c0450b-fee9-4dd0-baac-14c48f0a3174-kube-api-access-562k6\") pod \"maas-api-e2e-mt-5ec314ef-7bc6777c8-bm96b\" (UID: \"a7c0450b-fee9-4dd0-baac-14c48f0a3174\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-5ec314ef-7bc6777c8-bm96b"
Jul 09 19:29:25.536333 ip-10-0-139-134 kubenswrapper[2578]: I0709 19:29:25.536213    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/a7c0450b-fee9-4dd0-baac-14c48f0a3174-maas-api-tls\") pod \"maas-api-e2e-mt-5ec314ef-7bc6777c8-bm96b\" (UID: \"a7c0450b-fee9-4dd0-baac-14c48f0a3174\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-5ec314ef-7bc6777c8-bm96b"
Jul 09 19:29:25.637618 ip-10-0-139-134 kubenswrapper[2578]: I0709 19:29:25.637576    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/a7c0450b-fee9-4dd0-baac-14c48f0a3174-maas-api-tls\") pod \"maas-api-e2e-mt-5ec314ef-7bc6777c8-bm96b\" (UID: \"a7c0450b-fee9-4dd0-baac-14c48f0a3174\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-5ec314ef-7bc6777c8-bm96b"
Jul 09 19:29:25.637790 ip-10-0-139-134 kubenswrapper[2578]: I0709 19:29:25.637646    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/a7c0450b-fee9-4dd0-baac-14c48f0a3174-openshift-service-ca\") pod \"maas-api-e2e-mt-5ec314ef-7bc6777c8-bm96b\" (UID: \"a7c0450b-fee9-4dd0-baac-14c48f0a3174\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-5ec314ef-7bc6777c8-bm96b"
Jul 09 19:29:25.637790 ip-10-0-139-134 kubenswrapper[2578]: I0709 19:29:25.637670    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-562k6\" (UniqueName: \"kubernetes.io/projected/a7c0450b-fee9-4dd0-baac-14c48f0a3174-kube-api-access-562k6\") pod \"maas-api-e2e-mt-5ec314ef-7bc6777c8-bm96b\" (UID: \"a7c0450b-fee9-4dd0-baac-14c48f0a3174\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-5ec314ef-7bc6777c8-bm96b"
Jul 09 19:29:25.638433 ip-10-0-139-134 kubenswrapper[2578]: I0709 19:29:25.638415    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/a7c0450b-fee9-4dd0-baac-14c48f0a3174-openshift-service-ca\") pod \"maas-api-e2e-mt-5ec314ef-7bc6777c8-bm96b\" (UID: \"a7c0450b-fee9-4dd0-baac-14c48f0a3174\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-5ec314ef-7bc6777c8-bm96b"
Jul 09 19:29:25.640264 ip-10-0-139-134 kubenswrapper[2578]: I0709 19:29:25.640243    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/a7c0450b-fee9-4dd0-baac-14c48f0a3174-maas-api-tls\") pod \"maas-api-e2e-mt-5ec314ef-7bc6777c8-bm96b\" (UID: \"a7c0450b-fee9-4dd0-baac-14c48f0a3174\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-5ec314ef-7bc6777c8-bm96b"
Jul 09 19:29:25.647730 ip-10-0-139-134 kubenswrapper[2578]: I0709 19:29:25.647672    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-562k6\" (UniqueName: \"kubernetes.io/projected/a7c0450b-fee9-4dd0-baac-14c48f0a3174-kube-api-access-562k6\") pod \"maas-api-e2e-mt-5ec314ef-7bc6777c8-bm96b\" (UID: \"a7c0450b-fee9-4dd0-baac-14c48f0a3174\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-5ec314ef-7bc6777c8-bm96b"
Jul 09 19:29:25.711660 ip-10-0-139-134 kubenswrapper[2578]: I0709 19:29:25.711621    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-5ec314ef-7bc6777c8-bm96b"
Jul 09 19:29:25.844606 ip-10-0-139-134 kubenswrapper[2578]: I0709 19:29:25.844580    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-5ec314ef-7bc6777c8-bm96b"]
Jul 09 19:29:25.846774 ip-10-0-139-134 kubenswrapper[2578]: W0709 19:29:25.846742    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda7c0450b_fee9_4dd0_baac_14c48f0a3174.slice/crio-d06787a338837008d71092d8320f86d4548c24fed089ac6cae63734e4cfc1dc8 WatchSource:0}: Error finding container d06787a338837008d71092d8320f86d4548c24fed089ac6cae63734e4cfc1dc8: Status 404 returned error can't find the container with id d06787a338837008d71092d8320f86d4548c24fed089ac6cae63734e4cfc1dc8
Jul 09 19:29:26.191527 ip-10-0-139-134 kubenswrapper[2578]: I0709 19:29:26.191491    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-5ec314ef-7bc6777c8-bm96b" event={"ID":"a7c0450b-fee9-4dd0-baac-14c48f0a3174","Type":"ContainerStarted","Data":"d06787a338837008d71092d8320f86d4548c24fed089ac6cae63734e4cfc1dc8"}
Jul 09 19:29:27.196957 ip-10-0-139-134 kubenswrapper[2578]: I0709 19:29:27.196919    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-5ec314ef-7bc6777c8-bm96b" event={"ID":"a7c0450b-fee9-4dd0-baac-14c48f0a3174","Type":"ContainerStarted","Data":"8c6eb2753ea91de80a0c93109a3715d8bcf28032cdccf4057679e727aa253a81"}
Jul 09 19:29:27.197365 ip-10-0-139-134 kubenswrapper[2578]: I0709 19:29:27.197019    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-mt-5ec314ef-7bc6777c8-bm96b"
Jul 09 19:29:27.221215 ip-10-0-139-134 kubenswrapper[2578]: I0709 19:29:27.221164    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-mt-5ec314ef-7bc6777c8-bm96b" podStartSLOduration=1.764985163 podStartE2EDuration="2.221147615s" totalImagesPullingTime="456.162452ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 19:29:25 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 19:29:27.219284013 +0000 UTC m=+1863.845335385" watchObservedRunningTime="2026-07-09 19:29:27.221147615 +0000 UTC m=+1863.847198944"
Jul 09 19:29:33.206851 ip-10-0-139-134 kubenswrapper[2578]: I0709 19:29:33.206814    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-mt-5ec314ef-7bc6777c8-bm96b"
Jul 09 19:29:37.436818 ip-10-0-139-134 kubenswrapper[2578]: I0709 19:29:37.436781    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-5ec314ef-7bc6777c8-bm96b"]
Jul 09 19:29:37.437261 ip-10-0-139-134 kubenswrapper[2578]: I0709 19:29:37.437034    2578 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-mt-5ec314ef-7bc6777c8-bm96b" podUID="a7c0450b-fee9-4dd0-baac-14c48f0a3174" containerName="maas-api" containerID="cri-o://8c6eb2753ea91de80a0c93109a3715d8bcf28032cdccf4057679e727aa253a81" gracePeriod=30
Jul 09 19:29:37.679072 ip-10-0-139-134 kubenswrapper[2578]: I0709 19:29:37.679045    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-5ec314ef-7bc6777c8-bm96b"
Jul 09 19:29:37.846316 ip-10-0-139-134 kubenswrapper[2578]: I0709 19:29:37.846246    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/a7c0450b-fee9-4dd0-baac-14c48f0a3174-openshift-service-ca\") pod \"a7c0450b-fee9-4dd0-baac-14c48f0a3174\" (UID: \"a7c0450b-fee9-4dd0-baac-14c48f0a3174\") "
Jul 09 19:29:37.846316 ip-10-0-139-134 kubenswrapper[2578]: I0709 19:29:37.846288    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-562k6\" (UniqueName: \"kubernetes.io/projected/a7c0450b-fee9-4dd0-baac-14c48f0a3174-kube-api-access-562k6\") pod \"a7c0450b-fee9-4dd0-baac-14c48f0a3174\" (UID: \"a7c0450b-fee9-4dd0-baac-14c48f0a3174\") "
Jul 09 19:29:37.846523 ip-10-0-139-134 kubenswrapper[2578]: I0709 19:29:37.846339    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/a7c0450b-fee9-4dd0-baac-14c48f0a3174-maas-api-tls\") pod \"a7c0450b-fee9-4dd0-baac-14c48f0a3174\" (UID: \"a7c0450b-fee9-4dd0-baac-14c48f0a3174\") "
Jul 09 19:29:37.846589 ip-10-0-139-134 kubenswrapper[2578]: I0709 19:29:37.846568    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a7c0450b-fee9-4dd0-baac-14c48f0a3174-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "a7c0450b-fee9-4dd0-baac-14c48f0a3174" (UID: "a7c0450b-fee9-4dd0-baac-14c48f0a3174"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 09 19:29:37.848552 ip-10-0-139-134 kubenswrapper[2578]: I0709 19:29:37.848524    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a7c0450b-fee9-4dd0-baac-14c48f0a3174-kube-api-access-562k6" (OuterVolumeSpecName: "kube-api-access-562k6") pod "a7c0450b-fee9-4dd0-baac-14c48f0a3174" (UID: "a7c0450b-fee9-4dd0-baac-14c48f0a3174"). InnerVolumeSpecName "kube-api-access-562k6". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 09 19:29:37.848663 ip-10-0-139-134 kubenswrapper[2578]: I0709 19:29:37.848553    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a7c0450b-fee9-4dd0-baac-14c48f0a3174-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "a7c0450b-fee9-4dd0-baac-14c48f0a3174" (UID: "a7c0450b-fee9-4dd0-baac-14c48f0a3174"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 09 19:29:37.947501 ip-10-0-139-134 kubenswrapper[2578]: I0709 19:29:37.947464    2578 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/a7c0450b-fee9-4dd0-baac-14c48f0a3174-openshift-service-ca\") on node \"ip-10-0-139-134.ec2.internal\" DevicePath \"\""
Jul 09 19:29:37.947501 ip-10-0-139-134 kubenswrapper[2578]: I0709 19:29:37.947494    2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-562k6\" (UniqueName: \"kubernetes.io/projected/a7c0450b-fee9-4dd0-baac-14c48f0a3174-kube-api-access-562k6\") on node \"ip-10-0-139-134.ec2.internal\" DevicePath \"\""
Jul 09 19:29:37.947501 ip-10-0-139-134 kubenswrapper[2578]: I0709 19:29:37.947508    2578 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/a7c0450b-fee9-4dd0-baac-14c48f0a3174-maas-api-tls\") on node \"ip-10-0-139-134.ec2.internal\" DevicePath \"\""
Jul 09 19:29:38.243430 ip-10-0-139-134 kubenswrapper[2578]: I0709 19:29:38.243397    2578 generic.go:356] "Generic (PLEG): container finished" podID="a7c0450b-fee9-4dd0-baac-14c48f0a3174" containerID="8c6eb2753ea91de80a0c93109a3715d8bcf28032cdccf4057679e727aa253a81" exitCode=0
Jul 09 19:29:38.243600 ip-10-0-139-134 kubenswrapper[2578]: I0709 19:29:38.243436    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-5ec314ef-7bc6777c8-bm96b"
Jul 09 19:29:38.243600 ip-10-0-139-134 kubenswrapper[2578]: I0709 19:29:38.243486    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-5ec314ef-7bc6777c8-bm96b" event={"ID":"a7c0450b-fee9-4dd0-baac-14c48f0a3174","Type":"ContainerDied","Data":"8c6eb2753ea91de80a0c93109a3715d8bcf28032cdccf4057679e727aa253a81"}
Jul 09 19:29:38.243600 ip-10-0-139-134 kubenswrapper[2578]: I0709 19:29:38.243538    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-5ec314ef-7bc6777c8-bm96b" event={"ID":"a7c0450b-fee9-4dd0-baac-14c48f0a3174","Type":"ContainerDied","Data":"d06787a338837008d71092d8320f86d4548c24fed089ac6cae63734e4cfc1dc8"}
Jul 09 19:29:38.243600 ip-10-0-139-134 kubenswrapper[2578]: I0709 19:29:38.243561    2578 scope.go:117] "RemoveContainer" containerID="8c6eb2753ea91de80a0c93109a3715d8bcf28032cdccf4057679e727aa253a81"
Jul 09 19:29:38.256436 ip-10-0-139-134 kubenswrapper[2578]: I0709 19:29:38.256417    2578 scope.go:117] "RemoveContainer" containerID="8c6eb2753ea91de80a0c93109a3715d8bcf28032cdccf4057679e727aa253a81"
Jul 09 19:29:38.256693 ip-10-0-139-134 kubenswrapper[2578]: E0709 19:29:38.256674    2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8c6eb2753ea91de80a0c93109a3715d8bcf28032cdccf4057679e727aa253a81\": container with ID starting with 8c6eb2753ea91de80a0c93109a3715d8bcf28032cdccf4057679e727aa253a81 not found: ID does not exist" containerID="8c6eb2753ea91de80a0c93109a3715d8bcf28032cdccf4057679e727aa253a81"
Jul 09 19:29:38.256747 ip-10-0-139-134 kubenswrapper[2578]: I0709 19:29:38.256702    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8c6eb2753ea91de80a0c93109a3715d8bcf28032cdccf4057679e727aa253a81"} err="failed to get container status \"8c6eb2753ea91de80a0c93109a3715d8bcf28032cdccf4057679e727aa253a81\": rpc error: code = NotFound desc = could not find container \"8c6eb2753ea91de80a0c93109a3715d8bcf28032cdccf4057679e727aa253a81\": container with ID starting with 8c6eb2753ea91de80a0c93109a3715d8bcf28032cdccf4057679e727aa253a81 not found: ID does not exist"
Jul 09 19:29:38.270778 ip-10-0-139-134 kubenswrapper[2578]: I0709 19:29:38.270750    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-5ec314ef-7bc6777c8-bm96b"]
Jul 09 19:29:38.274890 ip-10-0-139-134 kubenswrapper[2578]: I0709 19:29:38.274861    2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-5ec314ef-7bc6777c8-bm96b"]
Jul 09 19:29:39.838070 ip-10-0-139-134 kubenswrapper[2578]: I0709 19:29:39.838035    2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a7c0450b-fee9-4dd0-baac-14c48f0a3174" path="/var/lib/kubelet/pods/a7c0450b-fee9-4dd0-baac-14c48f0a3174/volumes"
Jul 09 19:30:09.688933 ip-10-0-139-134 kubenswrapper[2578]: I0709 19:30:09.688864    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-8d9f6bca-686479dc5c-sl4dl"]
Jul 09 19:30:09.689526 ip-10-0-139-134 kubenswrapper[2578]: I0709 19:30:09.689333    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a7c0450b-fee9-4dd0-baac-14c48f0a3174" containerName="maas-api"
Jul 09 19:30:09.689526 ip-10-0-139-134 kubenswrapper[2578]: I0709 19:30:09.689352    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="a7c0450b-fee9-4dd0-baac-14c48f0a3174" containerName="maas-api"
Jul 09 19:30:09.689526 ip-10-0-139-134 kubenswrapper[2578]: I0709 19:30:09.689447    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="a7c0450b-fee9-4dd0-baac-14c48f0a3174" containerName="maas-api"
Jul 09 19:30:09.691639 ip-10-0-139-134 kubenswrapper[2578]: I0709 19:30:09.691618    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-8d9f6bca-686479dc5c-sl4dl"
Jul 09 19:30:09.695552 ip-10-0-139-134 kubenswrapper[2578]: I0709 19:30:09.695353    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-dockercfg-9pdt2\""
Jul 09 19:30:09.695686 ip-10-0-139-134 kubenswrapper[2578]: I0709 19:30:09.695625    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 09 19:30:09.698159 ip-10-0-139-134 kubenswrapper[2578]: I0709 19:30:09.697034    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"kube-root-ca.crt\""
Jul 09 19:30:09.698159 ip-10-0-139-134 kubenswrapper[2578]: I0709 19:30:09.697273    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-mt-8d9f6bca-serving-cert\""
Jul 09 19:30:09.709449 ip-10-0-139-134 kubenswrapper[2578]: I0709 19:30:09.709427    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-8d9f6bca-686479dc5c-sl4dl"]
Jul 09 19:30:09.817133 ip-10-0-139-134 kubenswrapper[2578]: I0709 19:30:09.817093    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-htrqp\" (UniqueName: \"kubernetes.io/projected/350b00e6-f858-4702-9174-cd74479ba3e8-kube-api-access-htrqp\") pod \"maas-api-e2e-mt-8d9f6bca-686479dc5c-sl4dl\" (UID: \"350b00e6-f858-4702-9174-cd74479ba3e8\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-8d9f6bca-686479dc5c-sl4dl"
Jul 09 19:30:09.817133 ip-10-0-139-134 kubenswrapper[2578]: I0709 19:30:09.817138    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/350b00e6-f858-4702-9174-cd74479ba3e8-openshift-service-ca\") pod \"maas-api-e2e-mt-8d9f6bca-686479dc5c-sl4dl\" (UID: \"350b00e6-f858-4702-9174-cd74479ba3e8\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-8d9f6bca-686479dc5c-sl4dl"
Jul 09 19:30:09.817366 ip-10-0-139-134 kubenswrapper[2578]: I0709 19:30:09.817160    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/350b00e6-f858-4702-9174-cd74479ba3e8-maas-api-tls\") pod \"maas-api-e2e-mt-8d9f6bca-686479dc5c-sl4dl\" (UID: \"350b00e6-f858-4702-9174-cd74479ba3e8\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-8d9f6bca-686479dc5c-sl4dl"
Jul 09 19:30:09.918422 ip-10-0-139-134 kubenswrapper[2578]: I0709 19:30:09.918384    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-htrqp\" (UniqueName: \"kubernetes.io/projected/350b00e6-f858-4702-9174-cd74479ba3e8-kube-api-access-htrqp\") pod \"maas-api-e2e-mt-8d9f6bca-686479dc5c-sl4dl\" (UID: \"350b00e6-f858-4702-9174-cd74479ba3e8\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-8d9f6bca-686479dc5c-sl4dl"
Jul 09 19:30:09.918637 ip-10-0-139-134 kubenswrapper[2578]: I0709 19:30:09.918445    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/350b00e6-f858-4702-9174-cd74479ba3e8-openshift-service-ca\") pod \"maas-api-e2e-mt-8d9f6bca-686479dc5c-sl4dl\" (UID: \"350b00e6-f858-4702-9174-cd74479ba3e8\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-8d9f6bca-686479dc5c-sl4dl"
Jul 09 19:30:09.918637 ip-10-0-139-134 kubenswrapper[2578]: I0709 19:30:09.918464    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/350b00e6-f858-4702-9174-cd74479ba3e8-maas-api-tls\") pod \"maas-api-e2e-mt-8d9f6bca-686479dc5c-sl4dl\" (UID: \"350b00e6-f858-4702-9174-cd74479ba3e8\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-8d9f6bca-686479dc5c-sl4dl"
Jul 09 19:30:09.919336 ip-10-0-139-134 kubenswrapper[2578]: I0709 19:30:09.919310    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/350b00e6-f858-4702-9174-cd74479ba3e8-openshift-service-ca\") pod \"maas-api-e2e-mt-8d9f6bca-686479dc5c-sl4dl\" (UID: \"350b00e6-f858-4702-9174-cd74479ba3e8\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-8d9f6bca-686479dc5c-sl4dl"
Jul 09 19:30:09.921224 ip-10-0-139-134 kubenswrapper[2578]: I0709 19:30:09.921202    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/350b00e6-f858-4702-9174-cd74479ba3e8-maas-api-tls\") pod \"maas-api-e2e-mt-8d9f6bca-686479dc5c-sl4dl\" (UID: \"350b00e6-f858-4702-9174-cd74479ba3e8\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-8d9f6bca-686479dc5c-sl4dl"
Jul 09 19:30:09.932102 ip-10-0-139-134 kubenswrapper[2578]: I0709 19:30:09.932075    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-htrqp\" (UniqueName: \"kubernetes.io/projected/350b00e6-f858-4702-9174-cd74479ba3e8-kube-api-access-htrqp\") pod \"maas-api-e2e-mt-8d9f6bca-686479dc5c-sl4dl\" (UID: \"350b00e6-f858-4702-9174-cd74479ba3e8\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-8d9f6bca-686479dc5c-sl4dl"
Jul 09 19:30:10.008034 ip-10-0-139-134 kubenswrapper[2578]: I0709 19:30:10.007920    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-8d9f6bca-686479dc5c-sl4dl"
Jul 09 19:30:10.151548 ip-10-0-139-134 kubenswrapper[2578]: I0709 19:30:10.151524    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-8d9f6bca-686479dc5c-sl4dl"]
Jul 09 19:30:10.153593 ip-10-0-139-134 kubenswrapper[2578]: W0709 19:30:10.153560    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod350b00e6_f858_4702_9174_cd74479ba3e8.slice/crio-88248828b8545f64c3b8419a52ec3045d608a9fc4b7c1445cbb8dd1eda717e41 WatchSource:0}: Error finding container 88248828b8545f64c3b8419a52ec3045d608a9fc4b7c1445cbb8dd1eda717e41: Status 404 returned error can't find the container with id 88248828b8545f64c3b8419a52ec3045d608a9fc4b7c1445cbb8dd1eda717e41
Jul 09 19:30:10.381493 ip-10-0-139-134 kubenswrapper[2578]: I0709 19:30:10.381398    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-8d9f6bca-686479dc5c-sl4dl" event={"ID":"350b00e6-f858-4702-9174-cd74479ba3e8","Type":"ContainerStarted","Data":"88248828b8545f64c3b8419a52ec3045d608a9fc4b7c1445cbb8dd1eda717e41"}
Jul 09 19:30:11.386725 ip-10-0-139-134 kubenswrapper[2578]: I0709 19:30:11.386683    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-8d9f6bca-686479dc5c-sl4dl" event={"ID":"350b00e6-f858-4702-9174-cd74479ba3e8","Type":"ContainerStarted","Data":"45443589bfa29fad6a673180267800b520de4fa0aaaf98240e5529e04db8e0e7"}
Jul 09 19:30:11.387224 ip-10-0-139-134 kubenswrapper[2578]: I0709 19:30:11.386810    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-mt-8d9f6bca-686479dc5c-sl4dl"
Jul 09 19:30:11.406627 ip-10-0-139-134 kubenswrapper[2578]: I0709 19:30:11.406580    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-mt-8d9f6bca-686479dc5c-sl4dl" podStartSLOduration=2.018175176 podStartE2EDuration="2.40656348s" totalImagesPullingTime="388.388304ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 19:30:09 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 19:30:11.406556364 +0000 UTC m=+1908.032607704" watchObservedRunningTime="2026-07-09 19:30:11.40656348 +0000 UTC m=+1908.032614811"
Jul 09 19:30:17.396448 ip-10-0-139-134 kubenswrapper[2578]: I0709 19:30:17.396419    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-mt-8d9f6bca-686479dc5c-sl4dl"
Jul 09 19:30:25.258121 ip-10-0-139-134 kubenswrapper[2578]: I0709 19:30:25.258091    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-mt-8d9f6bca/e2e-lifecycle-model-8d9f6bca-kserve-86b7ffc46c-dsjj7"]
Jul 09 19:30:25.260702 ip-10-0-139-134 kubenswrapper[2578]: I0709 19:30:25.260684    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-mt-8d9f6bca/e2e-lifecycle-model-8d9f6bca-kserve-86b7ffc46c-dsjj7"
Jul 09 19:30:25.263980 ip-10-0-139-134 kubenswrapper[2578]: I0709 19:30:25.263953    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-mt-8d9f6bca\"/\"kube-root-ca.crt\""
Jul 09 19:30:25.263980 ip-10-0-139-134 kubenswrapper[2578]: I0709 19:30:25.263973    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-mt-8d9f6bca\"/\"openshift-service-ca.crt\""
Jul 09 19:30:25.265650 ip-10-0-139-134 kubenswrapper[2578]: I0709 19:30:25.265630    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-mt-8d9f6bca\"/\"e2e-lifecycle-model-8d9f6bca-kserve-self-signed-certs\""
Jul 09 19:30:25.266511 ip-10-0-139-134 kubenswrapper[2578]: I0709 19:30:25.266492    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-mt-8d9f6bca\"/\"default-dockercfg-rxvt6\""
Jul 09 19:30:25.270554 ip-10-0-139-134 kubenswrapper[2578]: I0709 19:30:25.270534    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-mt-8d9f6bca/e2e-lifecycle-model-8d9f6bca-kserve-86b7ffc46c-dsjj7"]
Jul 09 19:30:25.350300 ip-10-0-139-134 kubenswrapper[2578]: I0709 19:30:25.350262    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ddrzc\" (UniqueName: \"kubernetes.io/projected/b149d1dd-cad6-47ed-a75c-71f8f1b1f861-kube-api-access-ddrzc\") pod \"e2e-lifecycle-model-8d9f6bca-kserve-86b7ffc46c-dsjj7\" (UID: \"b149d1dd-cad6-47ed-a75c-71f8f1b1f861\") " pod="ai-tenant-e2e-mt-8d9f6bca/e2e-lifecycle-model-8d9f6bca-kserve-86b7ffc46c-dsjj7"
Jul 09 19:30:25.350300 ip-10-0-139-134 kubenswrapper[2578]: I0709 19:30:25.350302    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/b149d1dd-cad6-47ed-a75c-71f8f1b1f861-model-cache\") pod \"e2e-lifecycle-model-8d9f6bca-kserve-86b7ffc46c-dsjj7\" (UID: \"b149d1dd-cad6-47ed-a75c-71f8f1b1f861\") " pod="ai-tenant-e2e-mt-8d9f6bca/e2e-lifecycle-model-8d9f6bca-kserve-86b7ffc46c-dsjj7"
Jul 09 19:30:25.350538 ip-10-0-139-134 kubenswrapper[2578]: I0709 19:30:25.350335    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/b149d1dd-cad6-47ed-a75c-71f8f1b1f861-tls-certs\") pod \"e2e-lifecycle-model-8d9f6bca-kserve-86b7ffc46c-dsjj7\" (UID: \"b149d1dd-cad6-47ed-a75c-71f8f1b1f861\") " pod="ai-tenant-e2e-mt-8d9f6bca/e2e-lifecycle-model-8d9f6bca-kserve-86b7ffc46c-dsjj7"
Jul 09 19:30:25.350538 ip-10-0-139-134 kubenswrapper[2578]: I0709 19:30:25.350363    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/b149d1dd-cad6-47ed-a75c-71f8f1b1f861-dshm\") pod \"e2e-lifecycle-model-8d9f6bca-kserve-86b7ffc46c-dsjj7\" (UID: \"b149d1dd-cad6-47ed-a75c-71f8f1b1f861\") " pod="ai-tenant-e2e-mt-8d9f6bca/e2e-lifecycle-model-8d9f6bca-kserve-86b7ffc46c-dsjj7"
Jul 09 19:30:25.350538 ip-10-0-139-134 kubenswrapper[2578]: I0709 19:30:25.350485    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/b149d1dd-cad6-47ed-a75c-71f8f1b1f861-home\") pod \"e2e-lifecycle-model-8d9f6bca-kserve-86b7ffc46c-dsjj7\" (UID: \"b149d1dd-cad6-47ed-a75c-71f8f1b1f861\") " pod="ai-tenant-e2e-mt-8d9f6bca/e2e-lifecycle-model-8d9f6bca-kserve-86b7ffc46c-dsjj7"
Jul 09 19:30:25.350538 ip-10-0-139-134 kubenswrapper[2578]: I0709 19:30:25.350521    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b149d1dd-cad6-47ed-a75c-71f8f1b1f861-tmp-dir\") pod \"e2e-lifecycle-model-8d9f6bca-kserve-86b7ffc46c-dsjj7\" (UID: \"b149d1dd-cad6-47ed-a75c-71f8f1b1f861\") " pod="ai-tenant-e2e-mt-8d9f6bca/e2e-lifecycle-model-8d9f6bca-kserve-86b7ffc46c-dsjj7"
Jul 09 19:30:25.451518 ip-10-0-139-134 kubenswrapper[2578]: I0709 19:30:25.451477    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/b149d1dd-cad6-47ed-a75c-71f8f1b1f861-home\") pod \"e2e-lifecycle-model-8d9f6bca-kserve-86b7ffc46c-dsjj7\" (UID: \"b149d1dd-cad6-47ed-a75c-71f8f1b1f861\") " pod="ai-tenant-e2e-mt-8d9f6bca/e2e-lifecycle-model-8d9f6bca-kserve-86b7ffc46c-dsjj7"
Jul 09 19:30:25.451518 ip-10-0-139-134 kubenswrapper[2578]: I0709 19:30:25.451518    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b149d1dd-cad6-47ed-a75c-71f8f1b1f861-tmp-dir\") pod \"e2e-lifecycle-model-8d9f6bca-kserve-86b7ffc46c-dsjj7\" (UID: \"b149d1dd-cad6-47ed-a75c-71f8f1b1f861\") " pod="ai-tenant-e2e-mt-8d9f6bca/e2e-lifecycle-model-8d9f6bca-kserve-86b7ffc46c-dsjj7"
Jul 09 19:30:25.451768 ip-10-0-139-134 kubenswrapper[2578]: I0709 19:30:25.451552    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ddrzc\" (UniqueName: \"kubernetes.io/projected/b149d1dd-cad6-47ed-a75c-71f8f1b1f861-kube-api-access-ddrzc\") pod \"e2e-lifecycle-model-8d9f6bca-kserve-86b7ffc46c-dsjj7\" (UID: \"b149d1dd-cad6-47ed-a75c-71f8f1b1f861\") " pod="ai-tenant-e2e-mt-8d9f6bca/e2e-lifecycle-model-8d9f6bca-kserve-86b7ffc46c-dsjj7"
Jul 09 19:30:25.451768 ip-10-0-139-134 kubenswrapper[2578]: I0709 19:30:25.451577    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/b149d1dd-cad6-47ed-a75c-71f8f1b1f861-model-cache\") pod \"e2e-lifecycle-model-8d9f6bca-kserve-86b7ffc46c-dsjj7\" (UID: \"b149d1dd-cad6-47ed-a75c-71f8f1b1f861\") " pod="ai-tenant-e2e-mt-8d9f6bca/e2e-lifecycle-model-8d9f6bca-kserve-86b7ffc46c-dsjj7"
Jul 09 19:30:25.451768 ip-10-0-139-134 kubenswrapper[2578]: I0709 19:30:25.451596    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/b149d1dd-cad6-47ed-a75c-71f8f1b1f861-tls-certs\") pod \"e2e-lifecycle-model-8d9f6bca-kserve-86b7ffc46c-dsjj7\" (UID: \"b149d1dd-cad6-47ed-a75c-71f8f1b1f861\") " pod="ai-tenant-e2e-mt-8d9f6bca/e2e-lifecycle-model-8d9f6bca-kserve-86b7ffc46c-dsjj7"
Jul 09 19:30:25.451768 ip-10-0-139-134 kubenswrapper[2578]: I0709 19:30:25.451619    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/b149d1dd-cad6-47ed-a75c-71f8f1b1f861-dshm\") pod \"e2e-lifecycle-model-8d9f6bca-kserve-86b7ffc46c-dsjj7\" (UID: \"b149d1dd-cad6-47ed-a75c-71f8f1b1f861\") " pod="ai-tenant-e2e-mt-8d9f6bca/e2e-lifecycle-model-8d9f6bca-kserve-86b7ffc46c-dsjj7"
Jul 09 19:30:25.451984 ip-10-0-139-134 kubenswrapper[2578]: I0709 19:30:25.451959    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/b149d1dd-cad6-47ed-a75c-71f8f1b1f861-home\") pod \"e2e-lifecycle-model-8d9f6bca-kserve-86b7ffc46c-dsjj7\" (UID: \"b149d1dd-cad6-47ed-a75c-71f8f1b1f861\") " pod="ai-tenant-e2e-mt-8d9f6bca/e2e-lifecycle-model-8d9f6bca-kserve-86b7ffc46c-dsjj7"
Jul 09 19:30:25.452075 ip-10-0-139-134 kubenswrapper[2578]: I0709 19:30:25.452029    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b149d1dd-cad6-47ed-a75c-71f8f1b1f861-tmp-dir\") pod \"e2e-lifecycle-model-8d9f6bca-kserve-86b7ffc46c-dsjj7\" (UID: \"b149d1dd-cad6-47ed-a75c-71f8f1b1f861\") " pod="ai-tenant-e2e-mt-8d9f6bca/e2e-lifecycle-model-8d9f6bca-kserve-86b7ffc46c-dsjj7"
Jul 09 19:30:25.452075 ip-10-0-139-134 kubenswrapper[2578]: I0709 19:30:25.452041    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/b149d1dd-cad6-47ed-a75c-71f8f1b1f861-model-cache\") pod \"e2e-lifecycle-model-8d9f6bca-kserve-86b7ffc46c-dsjj7\" (UID: \"b149d1dd-cad6-47ed-a75c-71f8f1b1f861\") " pod="ai-tenant-e2e-mt-8d9f6bca/e2e-lifecycle-model-8d9f6bca-kserve-86b7ffc46c-dsjj7"
Jul 09 19:30:25.454151 ip-10-0-139-134 kubenswrapper[2578]: I0709 19:30:25.454124    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/b149d1dd-cad6-47ed-a75c-71f8f1b1f861-dshm\") pod \"e2e-lifecycle-model-8d9f6bca-kserve-86b7ffc46c-dsjj7\" (UID: \"b149d1dd-cad6-47ed-a75c-71f8f1b1f861\") " pod="ai-tenant-e2e-mt-8d9f6bca/e2e-lifecycle-model-8d9f6bca-kserve-86b7ffc46c-dsjj7"
Jul 09 19:30:25.454324 ip-10-0-139-134 kubenswrapper[2578]: I0709 19:30:25.454307    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/b149d1dd-cad6-47ed-a75c-71f8f1b1f861-tls-certs\") pod \"e2e-lifecycle-model-8d9f6bca-kserve-86b7ffc46c-dsjj7\" (UID: \"b149d1dd-cad6-47ed-a75c-71f8f1b1f861\") " pod="ai-tenant-e2e-mt-8d9f6bca/e2e-lifecycle-model-8d9f6bca-kserve-86b7ffc46c-dsjj7"
Jul 09 19:30:25.461667 ip-10-0-139-134 kubenswrapper[2578]: I0709 19:30:25.461639    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ddrzc\" (UniqueName: \"kubernetes.io/projected/b149d1dd-cad6-47ed-a75c-71f8f1b1f861-kube-api-access-ddrzc\") pod \"e2e-lifecycle-model-8d9f6bca-kserve-86b7ffc46c-dsjj7\" (UID: \"b149d1dd-cad6-47ed-a75c-71f8f1b1f861\") " pod="ai-tenant-e2e-mt-8d9f6bca/e2e-lifecycle-model-8d9f6bca-kserve-86b7ffc46c-dsjj7"
Jul 09 19:30:25.570446 ip-10-0-139-134 kubenswrapper[2578]: I0709 19:30:25.570351    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-mt-8d9f6bca/e2e-lifecycle-model-8d9f6bca-kserve-86b7ffc46c-dsjj7"
Jul 09 19:30:25.708979 ip-10-0-139-134 kubenswrapper[2578]: I0709 19:30:25.708951    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-mt-8d9f6bca/e2e-lifecycle-model-8d9f6bca-kserve-86b7ffc46c-dsjj7"]
Jul 09 19:30:25.710707 ip-10-0-139-134 kubenswrapper[2578]: W0709 19:30:25.710676    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podb149d1dd_cad6_47ed_a75c_71f8f1b1f861.slice/crio-3a73fefc4519c54aa88008e957fd79e82a5029193f2596daddf47372d4ec9656 WatchSource:0}: Error finding container 3a73fefc4519c54aa88008e957fd79e82a5029193f2596daddf47372d4ec9656: Status 404 returned error can't find the container with id 3a73fefc4519c54aa88008e957fd79e82a5029193f2596daddf47372d4ec9656
Jul 09 19:30:26.450634 ip-10-0-139-134 kubenswrapper[2578]: I0709 19:30:26.450597    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-mt-8d9f6bca/e2e-lifecycle-model-8d9f6bca-kserve-86b7ffc46c-dsjj7" event={"ID":"b149d1dd-cad6-47ed-a75c-71f8f1b1f861","Type":"ContainerStarted","Data":"4768003ab5cec46a58ef1373c3c05d7ea1b8adbda5bb098ec97db25a42195775"}
Jul 09 19:30:26.450634 ip-10-0-139-134 kubenswrapper[2578]: I0709 19:30:26.450637    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-mt-8d9f6bca/e2e-lifecycle-model-8d9f6bca-kserve-86b7ffc46c-dsjj7" event={"ID":"b149d1dd-cad6-47ed-a75c-71f8f1b1f861","Type":"ContainerStarted","Data":"3a73fefc4519c54aa88008e957fd79e82a5029193f2596daddf47372d4ec9656"}
Jul 09 19:30:26.468787 ip-10-0-139-134 kubenswrapper[2578]: I0709 19:30:26.468740    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-mt-8d9f6bca/e2e-lifecycle-model-8d9f6bca-kserve-86b7ffc46c-dsjj7" podStartSLOduration=1.468724782 podStartE2EDuration="1.468724782s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 19:30:25 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 19:30:26.467657591 +0000 UTC m=+1923.093708922" watchObservedRunningTime="2026-07-09 19:30:26.468724782 +0000 UTC m=+1923.094776111"
Jul 09 19:30:35.570905 ip-10-0-139-134 kubenswrapper[2578]: I0709 19:30:35.570856    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-mt-8d9f6bca/e2e-lifecycle-model-8d9f6bca-kserve-86b7ffc46c-dsjj7"
Jul 09 19:30:35.570905 ip-10-0-139-134 kubenswrapper[2578]: I0709 19:30:35.570917    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-mt-8d9f6bca/e2e-lifecycle-model-8d9f6bca-kserve-86b7ffc46c-dsjj7"
Jul 09 19:30:35.583538 ip-10-0-139-134 kubenswrapper[2578]: I0709 19:30:35.583511    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-mt-8d9f6bca/e2e-lifecycle-model-8d9f6bca-kserve-86b7ffc46c-dsjj7"
Jul 09 19:30:36.505070 ip-10-0-139-134 kubenswrapper[2578]: I0709 19:30:36.505039    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-mt-8d9f6bca/e2e-lifecycle-model-8d9f6bca-kserve-86b7ffc46c-dsjj7"
Jul 09 19:30:47.142434 ip-10-0-139-134 kubenswrapper[2578]: I0709 19:30:47.142397    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-8d9f6bca-686479dc5c-sl4dl"]
Jul 09 19:30:47.142900 ip-10-0-139-134 kubenswrapper[2578]: I0709 19:30:47.142607    2578 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-mt-8d9f6bca-686479dc5c-sl4dl" podUID="350b00e6-f858-4702-9174-cd74479ba3e8" containerName="maas-api" containerID="cri-o://45443589bfa29fad6a673180267800b520de4fa0aaaf98240e5529e04db8e0e7" gracePeriod=30
Jul 09 19:30:47.381956 ip-10-0-139-134 kubenswrapper[2578]: I0709 19:30:47.381933    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-8d9f6bca-686479dc5c-sl4dl"
Jul 09 19:30:47.429285 ip-10-0-139-134 kubenswrapper[2578]: I0709 19:30:47.429250    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/350b00e6-f858-4702-9174-cd74479ba3e8-maas-api-tls\") pod \"350b00e6-f858-4702-9174-cd74479ba3e8\" (UID: \"350b00e6-f858-4702-9174-cd74479ba3e8\") "
Jul 09 19:30:47.429446 ip-10-0-139-134 kubenswrapper[2578]: I0709 19:30:47.429304    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-htrqp\" (UniqueName: \"kubernetes.io/projected/350b00e6-f858-4702-9174-cd74479ba3e8-kube-api-access-htrqp\") pod \"350b00e6-f858-4702-9174-cd74479ba3e8\" (UID: \"350b00e6-f858-4702-9174-cd74479ba3e8\") "
Jul 09 19:30:47.429446 ip-10-0-139-134 kubenswrapper[2578]: I0709 19:30:47.429325    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/350b00e6-f858-4702-9174-cd74479ba3e8-openshift-service-ca\") pod \"350b00e6-f858-4702-9174-cd74479ba3e8\" (UID: \"350b00e6-f858-4702-9174-cd74479ba3e8\") "
Jul 09 19:30:47.429676 ip-10-0-139-134 kubenswrapper[2578]: I0709 19:30:47.429649    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/350b00e6-f858-4702-9174-cd74479ba3e8-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "350b00e6-f858-4702-9174-cd74479ba3e8" (UID: "350b00e6-f858-4702-9174-cd74479ba3e8"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 09 19:30:47.431457 ip-10-0-139-134 kubenswrapper[2578]: I0709 19:30:47.431433    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/350b00e6-f858-4702-9174-cd74479ba3e8-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "350b00e6-f858-4702-9174-cd74479ba3e8" (UID: "350b00e6-f858-4702-9174-cd74479ba3e8"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 09 19:30:47.431580 ip-10-0-139-134 kubenswrapper[2578]: I0709 19:30:47.431560    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/350b00e6-f858-4702-9174-cd74479ba3e8-kube-api-access-htrqp" (OuterVolumeSpecName: "kube-api-access-htrqp") pod "350b00e6-f858-4702-9174-cd74479ba3e8" (UID: "350b00e6-f858-4702-9174-cd74479ba3e8"). InnerVolumeSpecName "kube-api-access-htrqp". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 09 19:30:47.530235 ip-10-0-139-134 kubenswrapper[2578]: I0709 19:30:47.530195    2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-htrqp\" (UniqueName: \"kubernetes.io/projected/350b00e6-f858-4702-9174-cd74479ba3e8-kube-api-access-htrqp\") on node \"ip-10-0-139-134.ec2.internal\" DevicePath \"\""
Jul 09 19:30:47.530235 ip-10-0-139-134 kubenswrapper[2578]: I0709 19:30:47.530231    2578 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/350b00e6-f858-4702-9174-cd74479ba3e8-openshift-service-ca\") on node \"ip-10-0-139-134.ec2.internal\" DevicePath \"\""
Jul 09 19:30:47.530235 ip-10-0-139-134 kubenswrapper[2578]: I0709 19:30:47.530242    2578 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/350b00e6-f858-4702-9174-cd74479ba3e8-maas-api-tls\") on node \"ip-10-0-139-134.ec2.internal\" DevicePath \"\""
Jul 09 19:30:47.543063 ip-10-0-139-134 kubenswrapper[2578]: I0709 19:30:47.543029    2578 generic.go:356] "Generic (PLEG): container finished" podID="350b00e6-f858-4702-9174-cd74479ba3e8" containerID="45443589bfa29fad6a673180267800b520de4fa0aaaf98240e5529e04db8e0e7" exitCode=0
Jul 09 19:30:47.543247 ip-10-0-139-134 kubenswrapper[2578]: I0709 19:30:47.543083    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-8d9f6bca-686479dc5c-sl4dl"
Jul 09 19:30:47.543247 ip-10-0-139-134 kubenswrapper[2578]: I0709 19:30:47.543121    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-8d9f6bca-686479dc5c-sl4dl" event={"ID":"350b00e6-f858-4702-9174-cd74479ba3e8","Type":"ContainerDied","Data":"45443589bfa29fad6a673180267800b520de4fa0aaaf98240e5529e04db8e0e7"}
Jul 09 19:30:47.543247 ip-10-0-139-134 kubenswrapper[2578]: I0709 19:30:47.543182    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-8d9f6bca-686479dc5c-sl4dl" event={"ID":"350b00e6-f858-4702-9174-cd74479ba3e8","Type":"ContainerDied","Data":"88248828b8545f64c3b8419a52ec3045d608a9fc4b7c1445cbb8dd1eda717e41"}
Jul 09 19:30:47.543247 ip-10-0-139-134 kubenswrapper[2578]: I0709 19:30:47.543211    2578 scope.go:117] "RemoveContainer" containerID="45443589bfa29fad6a673180267800b520de4fa0aaaf98240e5529e04db8e0e7"
Jul 09 19:30:47.551881 ip-10-0-139-134 kubenswrapper[2578]: I0709 19:30:47.551861    2578 scope.go:117] "RemoveContainer" containerID="45443589bfa29fad6a673180267800b520de4fa0aaaf98240e5529e04db8e0e7"
Jul 09 19:30:47.552179 ip-10-0-139-134 kubenswrapper[2578]: E0709 19:30:47.552158    2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"45443589bfa29fad6a673180267800b520de4fa0aaaf98240e5529e04db8e0e7\": container with ID starting with 45443589bfa29fad6a673180267800b520de4fa0aaaf98240e5529e04db8e0e7 not found: ID does not exist" containerID="45443589bfa29fad6a673180267800b520de4fa0aaaf98240e5529e04db8e0e7"
Jul 09 19:30:47.552257 ip-10-0-139-134 kubenswrapper[2578]: I0709 19:30:47.552192    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"45443589bfa29fad6a673180267800b520de4fa0aaaf98240e5529e04db8e0e7"} err="failed to get container status \"45443589bfa29fad6a673180267800b520de4fa0aaaf98240e5529e04db8e0e7\": rpc error: code = NotFound desc = could not find container \"45443589bfa29fad6a673180267800b520de4fa0aaaf98240e5529e04db8e0e7\": container with ID starting with 45443589bfa29fad6a673180267800b520de4fa0aaaf98240e5529e04db8e0e7 not found: ID does not exist"
Jul 09 19:30:47.565215 ip-10-0-139-134 kubenswrapper[2578]: I0709 19:30:47.565188    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-8d9f6bca-686479dc5c-sl4dl"]
Jul 09 19:30:47.569616 ip-10-0-139-134 kubenswrapper[2578]: I0709 19:30:47.569593    2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-8d9f6bca-686479dc5c-sl4dl"]
Jul 09 19:30:47.839379 ip-10-0-139-134 kubenswrapper[2578]: I0709 19:30:47.839296    2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="350b00e6-f858-4702-9174-cd74479ba3e8" path="/var/lib/kubelet/pods/350b00e6-f858-4702-9174-cd74479ba3e8/volumes"
Jul 09 19:30:57.724751 ip-10-0-139-134 kubenswrapper[2578]: I0709 19:30:57.724712    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-mt-8d9f6bca/e2e-lifecycle-model-8d9f6bca-kserve-86b7ffc46c-dsjj7"]
Jul 09 19:31:12.745879 ip-10-0-139-134 kubenswrapper[2578]: I0709 19:31:12.745837    2578 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-mt-8d9f6bca/e2e-lifecycle-model-8d9f6bca-kserve-86b7ffc46c-dsjj7" podUID="b149d1dd-cad6-47ed-a75c-71f8f1b1f861" containerName="main" containerID="cri-o://4768003ab5cec46a58ef1373c3c05d7ea1b8adbda5bb098ec97db25a42195775" gracePeriod=45
Jul 09 19:31:13.003133 ip-10-0-139-134 kubenswrapper[2578]: I0709 19:31:13.003076    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-mt-8d9f6bca/e2e-lifecycle-model-8d9f6bca-kserve-86b7ffc46c-dsjj7"
Jul 09 19:31:13.027041 ip-10-0-139-134 kubenswrapper[2578]: I0709 19:31:13.026988    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b149d1dd-cad6-47ed-a75c-71f8f1b1f861-tmp-dir\") pod \"b149d1dd-cad6-47ed-a75c-71f8f1b1f861\" (UID: \"b149d1dd-cad6-47ed-a75c-71f8f1b1f861\") "
Jul 09 19:31:13.027041 ip-10-0-139-134 kubenswrapper[2578]: I0709 19:31:13.027045    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/b149d1dd-cad6-47ed-a75c-71f8f1b1f861-model-cache\") pod \"b149d1dd-cad6-47ed-a75c-71f8f1b1f861\" (UID: \"b149d1dd-cad6-47ed-a75c-71f8f1b1f861\") "
Jul 09 19:31:13.027268 ip-10-0-139-134 kubenswrapper[2578]: I0709 19:31:13.027080    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-ddrzc\" (UniqueName: \"kubernetes.io/projected/b149d1dd-cad6-47ed-a75c-71f8f1b1f861-kube-api-access-ddrzc\") pod \"b149d1dd-cad6-47ed-a75c-71f8f1b1f861\" (UID: \"b149d1dd-cad6-47ed-a75c-71f8f1b1f861\") "
Jul 09 19:31:13.027268 ip-10-0-139-134 kubenswrapper[2578]: I0709 19:31:13.027098    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/b149d1dd-cad6-47ed-a75c-71f8f1b1f861-dshm\") pod \"b149d1dd-cad6-47ed-a75c-71f8f1b1f861\" (UID: \"b149d1dd-cad6-47ed-a75c-71f8f1b1f861\") "
Jul 09 19:31:13.027268 ip-10-0-139-134 kubenswrapper[2578]: I0709 19:31:13.027164    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/b149d1dd-cad6-47ed-a75c-71f8f1b1f861-tls-certs\") pod \"b149d1dd-cad6-47ed-a75c-71f8f1b1f861\" (UID: \"b149d1dd-cad6-47ed-a75c-71f8f1b1f861\") "
Jul 09 19:31:13.027268 ip-10-0-139-134 kubenswrapper[2578]: I0709 19:31:13.027191    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/b149d1dd-cad6-47ed-a75c-71f8f1b1f861-home\") pod \"b149d1dd-cad6-47ed-a75c-71f8f1b1f861\" (UID: \"b149d1dd-cad6-47ed-a75c-71f8f1b1f861\") "
Jul 09 19:31:13.027268 ip-10-0-139-134 kubenswrapper[2578]: I0709 19:31:13.027224    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b149d1dd-cad6-47ed-a75c-71f8f1b1f861-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "b149d1dd-cad6-47ed-a75c-71f8f1b1f861" (UID: "b149d1dd-cad6-47ed-a75c-71f8f1b1f861"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 09 19:31:13.027470 ip-10-0-139-134 kubenswrapper[2578]: I0709 19:31:13.027330    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b149d1dd-cad6-47ed-a75c-71f8f1b1f861-model-cache" (OuterVolumeSpecName: "model-cache") pod "b149d1dd-cad6-47ed-a75c-71f8f1b1f861" (UID: "b149d1dd-cad6-47ed-a75c-71f8f1b1f861"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 09 19:31:13.027470 ip-10-0-139-134 kubenswrapper[2578]: I0709 19:31:13.027438    2578 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b149d1dd-cad6-47ed-a75c-71f8f1b1f861-tmp-dir\") on node \"ip-10-0-139-134.ec2.internal\" DevicePath \"\""
Jul 09 19:31:13.027470 ip-10-0-139-134 kubenswrapper[2578]: I0709 19:31:13.027458    2578 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/b149d1dd-cad6-47ed-a75c-71f8f1b1f861-model-cache\") on node \"ip-10-0-139-134.ec2.internal\" DevicePath \"\""
Jul 09 19:31:13.027613 ip-10-0-139-134 kubenswrapper[2578]: I0709 19:31:13.027576    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b149d1dd-cad6-47ed-a75c-71f8f1b1f861-home" (OuterVolumeSpecName: "home") pod "b149d1dd-cad6-47ed-a75c-71f8f1b1f861" (UID: "b149d1dd-cad6-47ed-a75c-71f8f1b1f861"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 09 19:31:13.029869 ip-10-0-139-134 kubenswrapper[2578]: I0709 19:31:13.029830    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b149d1dd-cad6-47ed-a75c-71f8f1b1f861-kube-api-access-ddrzc" (OuterVolumeSpecName: "kube-api-access-ddrzc") pod "b149d1dd-cad6-47ed-a75c-71f8f1b1f861" (UID: "b149d1dd-cad6-47ed-a75c-71f8f1b1f861"). InnerVolumeSpecName "kube-api-access-ddrzc". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 09 19:31:13.029869 ip-10-0-139-134 kubenswrapper[2578]: I0709 19:31:13.029850    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b149d1dd-cad6-47ed-a75c-71f8f1b1f861-dshm" (OuterVolumeSpecName: "dshm") pod "b149d1dd-cad6-47ed-a75c-71f8f1b1f861" (UID: "b149d1dd-cad6-47ed-a75c-71f8f1b1f861"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 09 19:31:13.030393 ip-10-0-139-134 kubenswrapper[2578]: I0709 19:31:13.030320    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b149d1dd-cad6-47ed-a75c-71f8f1b1f861-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "b149d1dd-cad6-47ed-a75c-71f8f1b1f861" (UID: "b149d1dd-cad6-47ed-a75c-71f8f1b1f861"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 09 19:31:13.128763 ip-10-0-139-134 kubenswrapper[2578]: I0709 19:31:13.128728    2578 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/b149d1dd-cad6-47ed-a75c-71f8f1b1f861-tls-certs\") on node \"ip-10-0-139-134.ec2.internal\" DevicePath \"\""
Jul 09 19:31:13.128763 ip-10-0-139-134 kubenswrapper[2578]: I0709 19:31:13.128756    2578 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/b149d1dd-cad6-47ed-a75c-71f8f1b1f861-home\") on node \"ip-10-0-139-134.ec2.internal\" DevicePath \"\""
Jul 09 19:31:13.128763 ip-10-0-139-134 kubenswrapper[2578]: I0709 19:31:13.128767    2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-ddrzc\" (UniqueName: \"kubernetes.io/projected/b149d1dd-cad6-47ed-a75c-71f8f1b1f861-kube-api-access-ddrzc\") on node \"ip-10-0-139-134.ec2.internal\" DevicePath \"\""
Jul 09 19:31:13.128982 ip-10-0-139-134 kubenswrapper[2578]: I0709 19:31:13.128775    2578 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/b149d1dd-cad6-47ed-a75c-71f8f1b1f861-dshm\") on node \"ip-10-0-139-134.ec2.internal\" DevicePath \"\""
Jul 09 19:31:13.655885 ip-10-0-139-134 kubenswrapper[2578]: I0709 19:31:13.655844    2578 generic.go:356] "Generic (PLEG): container finished" podID="b149d1dd-cad6-47ed-a75c-71f8f1b1f861" containerID="4768003ab5cec46a58ef1373c3c05d7ea1b8adbda5bb098ec97db25a42195775" exitCode=0
Jul 09 19:31:13.655885 ip-10-0-139-134 kubenswrapper[2578]: I0709 19:31:13.655889    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-mt-8d9f6bca/e2e-lifecycle-model-8d9f6bca-kserve-86b7ffc46c-dsjj7"
Jul 09 19:31:13.656123 ip-10-0-139-134 kubenswrapper[2578]: I0709 19:31:13.655899    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-mt-8d9f6bca/e2e-lifecycle-model-8d9f6bca-kserve-86b7ffc46c-dsjj7" event={"ID":"b149d1dd-cad6-47ed-a75c-71f8f1b1f861","Type":"ContainerDied","Data":"4768003ab5cec46a58ef1373c3c05d7ea1b8adbda5bb098ec97db25a42195775"}
Jul 09 19:31:13.656123 ip-10-0-139-134 kubenswrapper[2578]: I0709 19:31:13.655938    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-mt-8d9f6bca/e2e-lifecycle-model-8d9f6bca-kserve-86b7ffc46c-dsjj7" event={"ID":"b149d1dd-cad6-47ed-a75c-71f8f1b1f861","Type":"ContainerDied","Data":"3a73fefc4519c54aa88008e957fd79e82a5029193f2596daddf47372d4ec9656"}
Jul 09 19:31:13.656123 ip-10-0-139-134 kubenswrapper[2578]: I0709 19:31:13.655961    2578 scope.go:117] "RemoveContainer" containerID="4768003ab5cec46a58ef1373c3c05d7ea1b8adbda5bb098ec97db25a42195775"
Jul 09 19:31:13.664611 ip-10-0-139-134 kubenswrapper[2578]: I0709 19:31:13.664591    2578 scope.go:117] "RemoveContainer" containerID="4768003ab5cec46a58ef1373c3c05d7ea1b8adbda5bb098ec97db25a42195775"
Jul 09 19:31:13.664868 ip-10-0-139-134 kubenswrapper[2578]: E0709 19:31:13.664854    2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4768003ab5cec46a58ef1373c3c05d7ea1b8adbda5bb098ec97db25a42195775\": container with ID starting with 4768003ab5cec46a58ef1373c3c05d7ea1b8adbda5bb098ec97db25a42195775 not found: ID does not exist" containerID="4768003ab5cec46a58ef1373c3c05d7ea1b8adbda5bb098ec97db25a42195775"
Jul 09 19:31:13.664915 ip-10-0-139-134 kubenswrapper[2578]: I0709 19:31:13.664877    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4768003ab5cec46a58ef1373c3c05d7ea1b8adbda5bb098ec97db25a42195775"} err="failed to get container status \"4768003ab5cec46a58ef1373c3c05d7ea1b8adbda5bb098ec97db25a42195775\": rpc error: code = NotFound desc = could not find container \"4768003ab5cec46a58ef1373c3c05d7ea1b8adbda5bb098ec97db25a42195775\": container with ID starting with 4768003ab5cec46a58ef1373c3c05d7ea1b8adbda5bb098ec97db25a42195775 not found: ID does not exist"
Jul 09 19:31:13.677395 ip-10-0-139-134 kubenswrapper[2578]: I0709 19:31:13.677370    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-mt-8d9f6bca/e2e-lifecycle-model-8d9f6bca-kserve-86b7ffc46c-dsjj7"]
Jul 09 19:31:13.681213 ip-10-0-139-134 kubenswrapper[2578]: I0709 19:31:13.681191    2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-mt-8d9f6bca/e2e-lifecycle-model-8d9f6bca-kserve-86b7ffc46c-dsjj7"]
Jul 09 19:31:13.843239 ip-10-0-139-134 kubenswrapper[2578]: I0709 19:31:13.843199    2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b149d1dd-cad6-47ed-a75c-71f8f1b1f861" path="/var/lib/kubelet/pods/b149d1dd-cad6-47ed-a75c-71f8f1b1f861/volumes"
Jul 09 19:32:39.579735 ip-10-0-139-134 kubenswrapper[2578]: I0709 19:32:39.579699    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-a7212d-5d89d479df-xk6vj"]
Jul 09 19:32:39.580152 ip-10-0-139-134 kubenswrapper[2578]: I0709 19:32:39.580084    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="350b00e6-f858-4702-9174-cd74479ba3e8" containerName="maas-api"
Jul 09 19:32:39.580152 ip-10-0-139-134 kubenswrapper[2578]: I0709 19:32:39.580104    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="350b00e6-f858-4702-9174-cd74479ba3e8" containerName="maas-api"
Jul 09 19:32:39.580152 ip-10-0-139-134 kubenswrapper[2578]: I0709 19:32:39.580125    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b149d1dd-cad6-47ed-a75c-71f8f1b1f861" containerName="main"
Jul 09 19:32:39.580152 ip-10-0-139-134 kubenswrapper[2578]: I0709 19:32:39.580131    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="b149d1dd-cad6-47ed-a75c-71f8f1b1f861" containerName="main"
Jul 09 19:32:39.580280 ip-10-0-139-134 kubenswrapper[2578]: I0709 19:32:39.580184    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="350b00e6-f858-4702-9174-cd74479ba3e8" containerName="maas-api"
Jul 09 19:32:39.580280 ip-10-0-139-134 kubenswrapper[2578]: I0709 19:32:39.580193    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="b149d1dd-cad6-47ed-a75c-71f8f1b1f861" containerName="main"
Jul 09 19:32:39.582334 ip-10-0-139-134 kubenswrapper[2578]: I0709 19:32:39.582315    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-a7212d-5d89d479df-xk6vj"
Jul 09 19:32:39.585988 ip-10-0-139-134 kubenswrapper[2578]: I0709 19:32:39.585963    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"kube-root-ca.crt\""
Jul 09 19:32:39.586113 ip-10-0-139-134 kubenswrapper[2578]: I0709 19:32:39.586025    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 09 19:32:39.586432 ip-10-0-139-134 kubenswrapper[2578]: I0709 19:32:39.586415    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-inf-a-a7212d-serving-cert\""
Jul 09 19:32:39.588069 ip-10-0-139-134 kubenswrapper[2578]: I0709 19:32:39.588051    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-dockercfg-9pdt2\""
Jul 09 19:32:39.593442 ip-10-0-139-134 kubenswrapper[2578]: I0709 19:32:39.593421    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-a7212d-5d89d479df-xk6vj"]
Jul 09 19:32:39.776434 ip-10-0-139-134 kubenswrapper[2578]: I0709 19:32:39.776382    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-28vc5\" (UniqueName: \"kubernetes.io/projected/d4836afd-4b27-43de-af61-79ea87801733-kube-api-access-28vc5\") pod \"maas-api-e2e-inf-a-a7212d-5d89d479df-xk6vj\" (UID: \"d4836afd-4b27-43de-af61-79ea87801733\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-a7212d-5d89d479df-xk6vj"
Jul 09 19:32:39.776639 ip-10-0-139-134 kubenswrapper[2578]: I0709 19:32:39.776508    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/d4836afd-4b27-43de-af61-79ea87801733-maas-api-tls\") pod \"maas-api-e2e-inf-a-a7212d-5d89d479df-xk6vj\" (UID: \"d4836afd-4b27-43de-af61-79ea87801733\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-a7212d-5d89d479df-xk6vj"
Jul 09 19:32:39.776639 ip-10-0-139-134 kubenswrapper[2578]: I0709 19:32:39.776580    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/d4836afd-4b27-43de-af61-79ea87801733-openshift-service-ca\") pod \"maas-api-e2e-inf-a-a7212d-5d89d479df-xk6vj\" (UID: \"d4836afd-4b27-43de-af61-79ea87801733\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-a7212d-5d89d479df-xk6vj"
Jul 09 19:32:39.877722 ip-10-0-139-134 kubenswrapper[2578]: I0709 19:32:39.877631    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/d4836afd-4b27-43de-af61-79ea87801733-maas-api-tls\") pod \"maas-api-e2e-inf-a-a7212d-5d89d479df-xk6vj\" (UID: \"d4836afd-4b27-43de-af61-79ea87801733\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-a7212d-5d89d479df-xk6vj"
Jul 09 19:32:39.877722 ip-10-0-139-134 kubenswrapper[2578]: I0709 19:32:39.877680    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/d4836afd-4b27-43de-af61-79ea87801733-openshift-service-ca\") pod \"maas-api-e2e-inf-a-a7212d-5d89d479df-xk6vj\" (UID: \"d4836afd-4b27-43de-af61-79ea87801733\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-a7212d-5d89d479df-xk6vj"
Jul 09 19:32:39.877722 ip-10-0-139-134 kubenswrapper[2578]: I0709 19:32:39.877715    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-28vc5\" (UniqueName: \"kubernetes.io/projected/d4836afd-4b27-43de-af61-79ea87801733-kube-api-access-28vc5\") pod \"maas-api-e2e-inf-a-a7212d-5d89d479df-xk6vj\" (UID: \"d4836afd-4b27-43de-af61-79ea87801733\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-a7212d-5d89d479df-xk6vj"
Jul 09 19:32:39.878103 ip-10-0-139-134 kubenswrapper[2578]: E0709 19:32:39.877792    2578 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-inf-a-a7212d-serving-cert: secret "maas-api-e2e-inf-a-a7212d-serving-cert" not found
Jul 09 19:32:39.878103 ip-10-0-139-134 kubenswrapper[2578]: E0709 19:32:39.877889    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d4836afd-4b27-43de-af61-79ea87801733-maas-api-tls podName:d4836afd-4b27-43de-af61-79ea87801733 nodeName:}" failed. No retries permitted until 2026-07-09 19:32:40.377865863 +0000 UTC m=+2057.003917176 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/d4836afd-4b27-43de-af61-79ea87801733-maas-api-tls") pod "maas-api-e2e-inf-a-a7212d-5d89d479df-xk6vj" (UID: "d4836afd-4b27-43de-af61-79ea87801733") : secret "maas-api-e2e-inf-a-a7212d-serving-cert" not found
Jul 09 19:32:39.878496 ip-10-0-139-134 kubenswrapper[2578]: I0709 19:32:39.878475    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/d4836afd-4b27-43de-af61-79ea87801733-openshift-service-ca\") pod \"maas-api-e2e-inf-a-a7212d-5d89d479df-xk6vj\" (UID: \"d4836afd-4b27-43de-af61-79ea87801733\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-a7212d-5d89d479df-xk6vj"
Jul 09 19:32:39.894795 ip-10-0-139-134 kubenswrapper[2578]: I0709 19:32:39.894758    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-28vc5\" (UniqueName: \"kubernetes.io/projected/d4836afd-4b27-43de-af61-79ea87801733-kube-api-access-28vc5\") pod \"maas-api-e2e-inf-a-a7212d-5d89d479df-xk6vj\" (UID: \"d4836afd-4b27-43de-af61-79ea87801733\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-a7212d-5d89d479df-xk6vj"
Jul 09 19:32:40.382814 ip-10-0-139-134 kubenswrapper[2578]: I0709 19:32:40.382781    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/d4836afd-4b27-43de-af61-79ea87801733-maas-api-tls\") pod \"maas-api-e2e-inf-a-a7212d-5d89d479df-xk6vj\" (UID: \"d4836afd-4b27-43de-af61-79ea87801733\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-a7212d-5d89d479df-xk6vj"
Jul 09 19:32:40.385507 ip-10-0-139-134 kubenswrapper[2578]: I0709 19:32:40.385483    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/d4836afd-4b27-43de-af61-79ea87801733-maas-api-tls\") pod \"maas-api-e2e-inf-a-a7212d-5d89d479df-xk6vj\" (UID: \"d4836afd-4b27-43de-af61-79ea87801733\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-a7212d-5d89d479df-xk6vj"
Jul 09 19:32:40.492505 ip-10-0-139-134 kubenswrapper[2578]: I0709 19:32:40.492468    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-a7212d-5d89d479df-xk6vj"
Jul 09 19:32:40.629082 ip-10-0-139-134 kubenswrapper[2578]: I0709 19:32:40.629010    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-a7212d-5d89d479df-xk6vj"]
Jul 09 19:32:40.631268 ip-10-0-139-134 kubenswrapper[2578]: W0709 19:32:40.631232    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd4836afd_4b27_43de_af61_79ea87801733.slice/crio-f52b093acd5072e3fe04bbb103e212d94ae58cb2347fb21aad4ee06ed5c9a26f WatchSource:0}: Error finding container f52b093acd5072e3fe04bbb103e212d94ae58cb2347fb21aad4ee06ed5c9a26f: Status 404 returned error can't find the container with id f52b093acd5072e3fe04bbb103e212d94ae58cb2347fb21aad4ee06ed5c9a26f
Jul 09 19:32:40.632704 ip-10-0-139-134 kubenswrapper[2578]: I0709 19:32:40.632681    2578 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 09 19:32:41.028167 ip-10-0-139-134 kubenswrapper[2578]: I0709 19:32:41.028134    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-a7212d-5d89d479df-xk6vj" event={"ID":"d4836afd-4b27-43de-af61-79ea87801733","Type":"ContainerStarted","Data":"f52b093acd5072e3fe04bbb103e212d94ae58cb2347fb21aad4ee06ed5c9a26f"}
Jul 09 19:32:42.033648 ip-10-0-139-134 kubenswrapper[2578]: I0709 19:32:42.033615    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-a7212d-5d89d479df-xk6vj" event={"ID":"d4836afd-4b27-43de-af61-79ea87801733","Type":"ContainerStarted","Data":"43423b3c927ff470dba3d4c6847751857dae227deaf0bf6705c86610d336e4c6"}
Jul 09 19:32:42.034149 ip-10-0-139-134 kubenswrapper[2578]: I0709 19:32:42.033741    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-a7212d-5d89d479df-xk6vj"
Jul 09 19:32:42.052877 ip-10-0-139-134 kubenswrapper[2578]: I0709 19:32:42.052819    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-a7212d-5d89d479df-xk6vj" podStartSLOduration=2.560430576 podStartE2EDuration="3.052802264s" totalImagesPullingTime="492.371688ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 19:32:39 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 19:32:42.051273255 +0000 UTC m=+2058.677324585" watchObservedRunningTime="2026-07-09 19:32:42.052802264 +0000 UTC m=+2058.678853593"
Jul 09 19:32:47.733190 ip-10-0-139-134 kubenswrapper[2578]: I0709 19:32:47.733151    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-bc9ef2-5464c697fd-bmdf9"]
Jul 09 19:32:47.736771 ip-10-0-139-134 kubenswrapper[2578]: I0709 19:32:47.736750    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-bc9ef2-5464c697fd-bmdf9"
Jul 09 19:32:47.739845 ip-10-0-139-134 kubenswrapper[2578]: I0709 19:32:47.739825    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-inf-b-bc9ef2-serving-cert\""
Jul 09 19:32:47.749984 ip-10-0-139-134 kubenswrapper[2578]: I0709 19:32:47.749953    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-bc9ef2-5464c697fd-bmdf9"]
Jul 09 19:32:47.833229 ip-10-0-139-134 kubenswrapper[2578]: I0709 19:32:47.833195    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-97mvj\" (UniqueName: \"kubernetes.io/projected/7657f375-df50-40dd-bf06-4956a50849b7-kube-api-access-97mvj\") pod \"maas-api-e2e-inf-b-bc9ef2-5464c697fd-bmdf9\" (UID: \"7657f375-df50-40dd-bf06-4956a50849b7\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-bc9ef2-5464c697fd-bmdf9"
Jul 09 19:32:47.833441 ip-10-0-139-134 kubenswrapper[2578]: I0709 19:32:47.833252    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/7657f375-df50-40dd-bf06-4956a50849b7-openshift-service-ca\") pod \"maas-api-e2e-inf-b-bc9ef2-5464c697fd-bmdf9\" (UID: \"7657f375-df50-40dd-bf06-4956a50849b7\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-bc9ef2-5464c697fd-bmdf9"
Jul 09 19:32:47.833441 ip-10-0-139-134 kubenswrapper[2578]: I0709 19:32:47.833355    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/7657f375-df50-40dd-bf06-4956a50849b7-maas-api-tls\") pod \"maas-api-e2e-inf-b-bc9ef2-5464c697fd-bmdf9\" (UID: \"7657f375-df50-40dd-bf06-4956a50849b7\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-bc9ef2-5464c697fd-bmdf9"
Jul 09 19:32:47.934679 ip-10-0-139-134 kubenswrapper[2578]: I0709 19:32:47.934639    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/7657f375-df50-40dd-bf06-4956a50849b7-maas-api-tls\") pod \"maas-api-e2e-inf-b-bc9ef2-5464c697fd-bmdf9\" (UID: \"7657f375-df50-40dd-bf06-4956a50849b7\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-bc9ef2-5464c697fd-bmdf9"
Jul 09 19:32:47.934871 ip-10-0-139-134 kubenswrapper[2578]: I0709 19:32:47.934688    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-97mvj\" (UniqueName: \"kubernetes.io/projected/7657f375-df50-40dd-bf06-4956a50849b7-kube-api-access-97mvj\") pod \"maas-api-e2e-inf-b-bc9ef2-5464c697fd-bmdf9\" (UID: \"7657f375-df50-40dd-bf06-4956a50849b7\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-bc9ef2-5464c697fd-bmdf9"
Jul 09 19:32:47.934871 ip-10-0-139-134 kubenswrapper[2578]: I0709 19:32:47.934744    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/7657f375-df50-40dd-bf06-4956a50849b7-openshift-service-ca\") pod \"maas-api-e2e-inf-b-bc9ef2-5464c697fd-bmdf9\" (UID: \"7657f375-df50-40dd-bf06-4956a50849b7\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-bc9ef2-5464c697fd-bmdf9"
Jul 09 19:32:47.935546 ip-10-0-139-134 kubenswrapper[2578]: I0709 19:32:47.935517    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/7657f375-df50-40dd-bf06-4956a50849b7-openshift-service-ca\") pod \"maas-api-e2e-inf-b-bc9ef2-5464c697fd-bmdf9\" (UID: \"7657f375-df50-40dd-bf06-4956a50849b7\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-bc9ef2-5464c697fd-bmdf9"
Jul 09 19:32:47.937915 ip-10-0-139-134 kubenswrapper[2578]: I0709 19:32:47.937891    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/7657f375-df50-40dd-bf06-4956a50849b7-maas-api-tls\") pod \"maas-api-e2e-inf-b-bc9ef2-5464c697fd-bmdf9\" (UID: \"7657f375-df50-40dd-bf06-4956a50849b7\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-bc9ef2-5464c697fd-bmdf9"
Jul 09 19:32:47.944118 ip-10-0-139-134 kubenswrapper[2578]: I0709 19:32:47.944099    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-97mvj\" (UniqueName: \"kubernetes.io/projected/7657f375-df50-40dd-bf06-4956a50849b7-kube-api-access-97mvj\") pod \"maas-api-e2e-inf-b-bc9ef2-5464c697fd-bmdf9\" (UID: \"7657f375-df50-40dd-bf06-4956a50849b7\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-bc9ef2-5464c697fd-bmdf9"
Jul 09 19:32:48.044467 ip-10-0-139-134 kubenswrapper[2578]: I0709 19:32:48.044394    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-a7212d-5d89d479df-xk6vj"
Jul 09 19:32:48.046791 ip-10-0-139-134 kubenswrapper[2578]: I0709 19:32:48.046773    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-bc9ef2-5464c697fd-bmdf9"
Jul 09 19:32:48.184522 ip-10-0-139-134 kubenswrapper[2578]: I0709 19:32:48.184498    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-bc9ef2-5464c697fd-bmdf9"]
Jul 09 19:32:48.186427 ip-10-0-139-134 kubenswrapper[2578]: W0709 19:32:48.186395    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7657f375_df50_40dd_bf06_4956a50849b7.slice/crio-db05c313e1a14ba7f36d822d967f36b5c62b9cafecc63a854eef7220b0160960 WatchSource:0}: Error finding container db05c313e1a14ba7f36d822d967f36b5c62b9cafecc63a854eef7220b0160960: Status 404 returned error can't find the container with id db05c313e1a14ba7f36d822d967f36b5c62b9cafecc63a854eef7220b0160960
Jul 09 19:32:49.065319 ip-10-0-139-134 kubenswrapper[2578]: I0709 19:32:49.065282    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-bc9ef2-5464c697fd-bmdf9" event={"ID":"7657f375-df50-40dd-bf06-4956a50849b7","Type":"ContainerStarted","Data":"ecaa190a0b792f9504b1dfe7fefcc5123c0b2bea1f7c14dc255411b181636c83"}
Jul 09 19:32:49.065729 ip-10-0-139-134 kubenswrapper[2578]: I0709 19:32:49.065333    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-bc9ef2-5464c697fd-bmdf9" event={"ID":"7657f375-df50-40dd-bf06-4956a50849b7","Type":"ContainerStarted","Data":"db05c313e1a14ba7f36d822d967f36b5c62b9cafecc63a854eef7220b0160960"}
Jul 09 19:32:49.065729 ip-10-0-139-134 kubenswrapper[2578]: I0709 19:32:49.065416    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-bc9ef2-5464c697fd-bmdf9"
Jul 09 19:32:49.084845 ip-10-0-139-134 kubenswrapper[2578]: I0709 19:32:49.084788    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-bc9ef2-5464c697fd-bmdf9" podStartSLOduration=1.7279577609999999 podStartE2EDuration="2.084769155s" totalImagesPullingTime="356.811394ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 19:32:47 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 19:32:49.084259036 +0000 UTC m=+2065.710310403" watchObservedRunningTime="2026-07-09 19:32:49.084769155 +0000 UTC m=+2065.710820486"
Jul 09 19:32:55.074477 ip-10-0-139-134 kubenswrapper[2578]: I0709 19:32:55.074440    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-bc9ef2-5464c697fd-bmdf9"
Jul 09 19:33:21.860963 ip-10-0-139-134 kubenswrapper[2578]: I0709 19:33:21.860929    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-inf-b-bc9ef2/test-model-bc9ef2-kserve-664d8d9979-kxhk9"]
Jul 09 19:33:21.864075 ip-10-0-139-134 kubenswrapper[2578]: I0709 19:33:21.864055    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-b-bc9ef2/test-model-bc9ef2-kserve-664d8d9979-kxhk9"
Jul 09 19:33:21.868759 ip-10-0-139-134 kubenswrapper[2578]: I0709 19:33:21.868731    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-inf-b-bc9ef2\"/\"openshift-service-ca.crt\""
Jul 09 19:33:21.868863 ip-10-0-139-134 kubenswrapper[2578]: I0709 19:33:21.868800    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-inf-b-bc9ef2\"/\"test-model-bc9ef2-kserve-self-signed-certs\""
Jul 09 19:33:21.868863 ip-10-0-139-134 kubenswrapper[2578]: I0709 19:33:21.868730    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-inf-b-bc9ef2\"/\"kube-root-ca.crt\""
Jul 09 19:33:21.868863 ip-10-0-139-134 kubenswrapper[2578]: I0709 19:33:21.868731    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-inf-b-bc9ef2\"/\"default-dockercfg-zcg82\""
Jul 09 19:33:21.872738 ip-10-0-139-134 kubenswrapper[2578]: I0709 19:33:21.872714    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-inf-b-bc9ef2/test-model-bc9ef2-kserve-664d8d9979-kxhk9"]
Jul 09 19:33:21.918175 ip-10-0-139-134 kubenswrapper[2578]: I0709 19:33:21.918132    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/eeb9b094-9ada-42ee-a4fc-813860c21111-dshm\") pod \"test-model-bc9ef2-kserve-664d8d9979-kxhk9\" (UID: \"eeb9b094-9ada-42ee-a4fc-813860c21111\") " pod="ai-tenant-e2e-inf-b-bc9ef2/test-model-bc9ef2-kserve-664d8d9979-kxhk9"
Jul 09 19:33:21.918175 ip-10-0-139-134 kubenswrapper[2578]: I0709 19:33:21.918173    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/eeb9b094-9ada-42ee-a4fc-813860c21111-tmp-dir\") pod \"test-model-bc9ef2-kserve-664d8d9979-kxhk9\" (UID: \"eeb9b094-9ada-42ee-a4fc-813860c21111\") " pod="ai-tenant-e2e-inf-b-bc9ef2/test-model-bc9ef2-kserve-664d8d9979-kxhk9"
Jul 09 19:33:21.918477 ip-10-0-139-134 kubenswrapper[2578]: I0709 19:33:21.918199    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jk2lk\" (UniqueName: \"kubernetes.io/projected/eeb9b094-9ada-42ee-a4fc-813860c21111-kube-api-access-jk2lk\") pod \"test-model-bc9ef2-kserve-664d8d9979-kxhk9\" (UID: \"eeb9b094-9ada-42ee-a4fc-813860c21111\") " pod="ai-tenant-e2e-inf-b-bc9ef2/test-model-bc9ef2-kserve-664d8d9979-kxhk9"
Jul 09 19:33:21.918477 ip-10-0-139-134 kubenswrapper[2578]: I0709 19:33:21.918277    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/eeb9b094-9ada-42ee-a4fc-813860c21111-home\") pod \"test-model-bc9ef2-kserve-664d8d9979-kxhk9\" (UID: \"eeb9b094-9ada-42ee-a4fc-813860c21111\") " pod="ai-tenant-e2e-inf-b-bc9ef2/test-model-bc9ef2-kserve-664d8d9979-kxhk9"
Jul 09 19:33:21.918477 ip-10-0-139-134 kubenswrapper[2578]: I0709 19:33:21.918339    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/eeb9b094-9ada-42ee-a4fc-813860c21111-model-cache\") pod \"test-model-bc9ef2-kserve-664d8d9979-kxhk9\" (UID: \"eeb9b094-9ada-42ee-a4fc-813860c21111\") " pod="ai-tenant-e2e-inf-b-bc9ef2/test-model-bc9ef2-kserve-664d8d9979-kxhk9"
Jul 09 19:33:21.918477 ip-10-0-139-134 kubenswrapper[2578]: I0709 19:33:21.918364    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/eeb9b094-9ada-42ee-a4fc-813860c21111-tls-certs\") pod \"test-model-bc9ef2-kserve-664d8d9979-kxhk9\" (UID: \"eeb9b094-9ada-42ee-a4fc-813860c21111\") " pod="ai-tenant-e2e-inf-b-bc9ef2/test-model-bc9ef2-kserve-664d8d9979-kxhk9"
Jul 09 19:33:22.019835 ip-10-0-139-134 kubenswrapper[2578]: I0709 19:33:22.019805    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jk2lk\" (UniqueName: \"kubernetes.io/projected/eeb9b094-9ada-42ee-a4fc-813860c21111-kube-api-access-jk2lk\") pod \"test-model-bc9ef2-kserve-664d8d9979-kxhk9\" (UID: \"eeb9b094-9ada-42ee-a4fc-813860c21111\") " pod="ai-tenant-e2e-inf-b-bc9ef2/test-model-bc9ef2-kserve-664d8d9979-kxhk9"
Jul 09 19:33:22.020035 ip-10-0-139-134 kubenswrapper[2578]: I0709 19:33:22.019850    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/eeb9b094-9ada-42ee-a4fc-813860c21111-home\") pod \"test-model-bc9ef2-kserve-664d8d9979-kxhk9\" (UID: \"eeb9b094-9ada-42ee-a4fc-813860c21111\") " pod="ai-tenant-e2e-inf-b-bc9ef2/test-model-bc9ef2-kserve-664d8d9979-kxhk9"
Jul 09 19:33:22.020035 ip-10-0-139-134 kubenswrapper[2578]: I0709 19:33:22.019877    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/eeb9b094-9ada-42ee-a4fc-813860c21111-model-cache\") pod \"test-model-bc9ef2-kserve-664d8d9979-kxhk9\" (UID: \"eeb9b094-9ada-42ee-a4fc-813860c21111\") " pod="ai-tenant-e2e-inf-b-bc9ef2/test-model-bc9ef2-kserve-664d8d9979-kxhk9"
Jul 09 19:33:22.020035 ip-10-0-139-134 kubenswrapper[2578]: I0709 19:33:22.019893    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/eeb9b094-9ada-42ee-a4fc-813860c21111-tls-certs\") pod \"test-model-bc9ef2-kserve-664d8d9979-kxhk9\" (UID: \"eeb9b094-9ada-42ee-a4fc-813860c21111\") " pod="ai-tenant-e2e-inf-b-bc9ef2/test-model-bc9ef2-kserve-664d8d9979-kxhk9"
Jul 09 19:33:22.020035 ip-10-0-139-134 kubenswrapper[2578]: I0709 19:33:22.019959    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/eeb9b094-9ada-42ee-a4fc-813860c21111-dshm\") pod \"test-model-bc9ef2-kserve-664d8d9979-kxhk9\" (UID: \"eeb9b094-9ada-42ee-a4fc-813860c21111\") " pod="ai-tenant-e2e-inf-b-bc9ef2/test-model-bc9ef2-kserve-664d8d9979-kxhk9"
Jul 09 19:33:22.020035 ip-10-0-139-134 kubenswrapper[2578]: I0709 19:33:22.019974    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/eeb9b094-9ada-42ee-a4fc-813860c21111-tmp-dir\") pod \"test-model-bc9ef2-kserve-664d8d9979-kxhk9\" (UID: \"eeb9b094-9ada-42ee-a4fc-813860c21111\") " pod="ai-tenant-e2e-inf-b-bc9ef2/test-model-bc9ef2-kserve-664d8d9979-kxhk9"
Jul 09 19:33:22.020363 ip-10-0-139-134 kubenswrapper[2578]: I0709 19:33:22.020336    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/eeb9b094-9ada-42ee-a4fc-813860c21111-home\") pod \"test-model-bc9ef2-kserve-664d8d9979-kxhk9\" (UID: \"eeb9b094-9ada-42ee-a4fc-813860c21111\") " pod="ai-tenant-e2e-inf-b-bc9ef2/test-model-bc9ef2-kserve-664d8d9979-kxhk9"
Jul 09 19:33:22.020438 ip-10-0-139-134 kubenswrapper[2578]: I0709 19:33:22.020379    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/eeb9b094-9ada-42ee-a4fc-813860c21111-tmp-dir\") pod \"test-model-bc9ef2-kserve-664d8d9979-kxhk9\" (UID: \"eeb9b094-9ada-42ee-a4fc-813860c21111\") " pod="ai-tenant-e2e-inf-b-bc9ef2/test-model-bc9ef2-kserve-664d8d9979-kxhk9"
Jul 09 19:33:22.020438 ip-10-0-139-134 kubenswrapper[2578]: I0709 19:33:22.020421    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/eeb9b094-9ada-42ee-a4fc-813860c21111-model-cache\") pod \"test-model-bc9ef2-kserve-664d8d9979-kxhk9\" (UID: \"eeb9b094-9ada-42ee-a4fc-813860c21111\") " pod="ai-tenant-e2e-inf-b-bc9ef2/test-model-bc9ef2-kserve-664d8d9979-kxhk9"
Jul 09 19:33:22.022571 ip-10-0-139-134 kubenswrapper[2578]: I0709 19:33:22.022539    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/eeb9b094-9ada-42ee-a4fc-813860c21111-dshm\") pod \"test-model-bc9ef2-kserve-664d8d9979-kxhk9\" (UID: \"eeb9b094-9ada-42ee-a4fc-813860c21111\") " pod="ai-tenant-e2e-inf-b-bc9ef2/test-model-bc9ef2-kserve-664d8d9979-kxhk9"
Jul 09 19:33:22.022689 ip-10-0-139-134 kubenswrapper[2578]: I0709 19:33:22.022674    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/eeb9b094-9ada-42ee-a4fc-813860c21111-tls-certs\") pod \"test-model-bc9ef2-kserve-664d8d9979-kxhk9\" (UID: \"eeb9b094-9ada-42ee-a4fc-813860c21111\") " pod="ai-tenant-e2e-inf-b-bc9ef2/test-model-bc9ef2-kserve-664d8d9979-kxhk9"
Jul 09 19:33:22.027857 ip-10-0-139-134 kubenswrapper[2578]: I0709 19:33:22.027829    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jk2lk\" (UniqueName: \"kubernetes.io/projected/eeb9b094-9ada-42ee-a4fc-813860c21111-kube-api-access-jk2lk\") pod \"test-model-bc9ef2-kserve-664d8d9979-kxhk9\" (UID: \"eeb9b094-9ada-42ee-a4fc-813860c21111\") " pod="ai-tenant-e2e-inf-b-bc9ef2/test-model-bc9ef2-kserve-664d8d9979-kxhk9"
Jul 09 19:33:22.174062 ip-10-0-139-134 kubenswrapper[2578]: I0709 19:33:22.174028    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-b-bc9ef2/test-model-bc9ef2-kserve-664d8d9979-kxhk9"
Jul 09 19:33:22.306963 ip-10-0-139-134 kubenswrapper[2578]: I0709 19:33:22.306929    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-inf-b-bc9ef2/test-model-bc9ef2-kserve-664d8d9979-kxhk9"]
Jul 09 19:33:22.308776 ip-10-0-139-134 kubenswrapper[2578]: W0709 19:33:22.308750    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podeeb9b094_9ada_42ee_a4fc_813860c21111.slice/crio-717218465f5e941db4da6b74f2f875f3fde1efca8e32642487f60ed54a2123d6 WatchSource:0}: Error finding container 717218465f5e941db4da6b74f2f875f3fde1efca8e32642487f60ed54a2123d6: Status 404 returned error can't find the container with id 717218465f5e941db4da6b74f2f875f3fde1efca8e32642487f60ed54a2123d6
Jul 09 19:33:23.213311 ip-10-0-139-134 kubenswrapper[2578]: I0709 19:33:23.213269    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-b-bc9ef2/test-model-bc9ef2-kserve-664d8d9979-kxhk9" event={"ID":"eeb9b094-9ada-42ee-a4fc-813860c21111","Type":"ContainerStarted","Data":"f2dba0226fc04ae9a0bbb2a54f8e1e960dff784ffdd75164b77886e794acef88"}
Jul 09 19:33:23.213705 ip-10-0-139-134 kubenswrapper[2578]: I0709 19:33:23.213318    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-b-bc9ef2/test-model-bc9ef2-kserve-664d8d9979-kxhk9" event={"ID":"eeb9b094-9ada-42ee-a4fc-813860c21111","Type":"ContainerStarted","Data":"717218465f5e941db4da6b74f2f875f3fde1efca8e32642487f60ed54a2123d6"}
Jul 09 19:33:23.234020 ip-10-0-139-134 kubenswrapper[2578]: I0709 19:33:23.233935    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-inf-b-bc9ef2/test-model-bc9ef2-kserve-664d8d9979-kxhk9" podStartSLOduration=2.23391922 podStartE2EDuration="2.23391922s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 19:33:21 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 19:33:23.231969214 +0000 UTC m=+2099.858020545" watchObservedRunningTime="2026-07-09 19:33:23.23391922 +0000 UTC m=+2099.859970571"
Jul 09 19:33:23.917412 ip-10-0-139-134 kubenswrapper[2578]: I0709 19:33:23.917381    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-8gqbs_7a15b7a9-7525-426b-a051-3ece178b71bc/ovn-acl-logging/0.log"
Jul 09 19:33:23.919346 ip-10-0-139-134 kubenswrapper[2578]: I0709 19:33:23.919325    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-8gqbs_7a15b7a9-7525-426b-a051-3ece178b71bc/ovn-acl-logging/0.log"
Jul 09 19:33:32.174366 ip-10-0-139-134 kubenswrapper[2578]: I0709 19:33:32.174310    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-inf-b-bc9ef2/test-model-bc9ef2-kserve-664d8d9979-kxhk9"
Jul 09 19:33:32.174366 ip-10-0-139-134 kubenswrapper[2578]: I0709 19:33:32.174380    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-inf-b-bc9ef2/test-model-bc9ef2-kserve-664d8d9979-kxhk9"
Jul 09 19:33:32.186970 ip-10-0-139-134 kubenswrapper[2578]: I0709 19:33:32.186944    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-inf-b-bc9ef2/test-model-bc9ef2-kserve-664d8d9979-kxhk9"
Jul 09 19:33:32.268455 ip-10-0-139-134 kubenswrapper[2578]: I0709 19:33:32.268425    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-inf-b-bc9ef2/test-model-bc9ef2-kserve-664d8d9979-kxhk9"
Jul 09 19:33:46.155262 ip-10-0-139-134 kubenswrapper[2578]: I0709 19:33:46.155231    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-inf-b-bc9ef2/test-model-bc9ef2-kserve-664d8d9979-kxhk9"]
Jul 09 19:33:46.971675 ip-10-0-139-134 kubenswrapper[2578]: I0709 19:33:46.971633    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-a7212d-5d89d479df-xk6vj"]
Jul 09 19:33:46.971988 ip-10-0-139-134 kubenswrapper[2578]: I0709 19:33:46.971931    2578 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-a7212d-5d89d479df-xk6vj" podUID="d4836afd-4b27-43de-af61-79ea87801733" containerName="maas-api" containerID="cri-o://43423b3c927ff470dba3d4c6847751857dae227deaf0bf6705c86610d336e4c6" gracePeriod=30
Jul 09 19:33:47.218829 ip-10-0-139-134 kubenswrapper[2578]: I0709 19:33:47.218804    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-a7212d-5d89d479df-xk6vj"
Jul 09 19:33:47.244815 ip-10-0-139-134 kubenswrapper[2578]: I0709 19:33:47.244746    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/d4836afd-4b27-43de-af61-79ea87801733-maas-api-tls\") pod \"d4836afd-4b27-43de-af61-79ea87801733\" (UID: \"d4836afd-4b27-43de-af61-79ea87801733\") "
Jul 09 19:33:47.244934 ip-10-0-139-134 kubenswrapper[2578]: I0709 19:33:47.244824    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-28vc5\" (UniqueName: \"kubernetes.io/projected/d4836afd-4b27-43de-af61-79ea87801733-kube-api-access-28vc5\") pod \"d4836afd-4b27-43de-af61-79ea87801733\" (UID: \"d4836afd-4b27-43de-af61-79ea87801733\") "
Jul 09 19:33:47.244934 ip-10-0-139-134 kubenswrapper[2578]: I0709 19:33:47.244862    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/d4836afd-4b27-43de-af61-79ea87801733-openshift-service-ca\") pod \"d4836afd-4b27-43de-af61-79ea87801733\" (UID: \"d4836afd-4b27-43de-af61-79ea87801733\") "
Jul 09 19:33:47.245302 ip-10-0-139-134 kubenswrapper[2578]: I0709 19:33:47.245272    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d4836afd-4b27-43de-af61-79ea87801733-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "d4836afd-4b27-43de-af61-79ea87801733" (UID: "d4836afd-4b27-43de-af61-79ea87801733"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 09 19:33:47.246872 ip-10-0-139-134 kubenswrapper[2578]: I0709 19:33:47.246848    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d4836afd-4b27-43de-af61-79ea87801733-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "d4836afd-4b27-43de-af61-79ea87801733" (UID: "d4836afd-4b27-43de-af61-79ea87801733"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 09 19:33:47.247039 ip-10-0-139-134 kubenswrapper[2578]: I0709 19:33:47.247016    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d4836afd-4b27-43de-af61-79ea87801733-kube-api-access-28vc5" (OuterVolumeSpecName: "kube-api-access-28vc5") pod "d4836afd-4b27-43de-af61-79ea87801733" (UID: "d4836afd-4b27-43de-af61-79ea87801733"). InnerVolumeSpecName "kube-api-access-28vc5". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 09 19:33:47.325917 ip-10-0-139-134 kubenswrapper[2578]: I0709 19:33:47.325879    2578 generic.go:356] "Generic (PLEG): container finished" podID="d4836afd-4b27-43de-af61-79ea87801733" containerID="43423b3c927ff470dba3d4c6847751857dae227deaf0bf6705c86610d336e4c6" exitCode=0
Jul 09 19:33:47.326105 ip-10-0-139-134 kubenswrapper[2578]: I0709 19:33:47.325926    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-a7212d-5d89d479df-xk6vj"
Jul 09 19:33:47.326105 ip-10-0-139-134 kubenswrapper[2578]: I0709 19:33:47.325948    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-a7212d-5d89d479df-xk6vj" event={"ID":"d4836afd-4b27-43de-af61-79ea87801733","Type":"ContainerDied","Data":"43423b3c927ff470dba3d4c6847751857dae227deaf0bf6705c86610d336e4c6"}
Jul 09 19:33:47.326105 ip-10-0-139-134 kubenswrapper[2578]: I0709 19:33:47.326024    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-a7212d-5d89d479df-xk6vj" event={"ID":"d4836afd-4b27-43de-af61-79ea87801733","Type":"ContainerDied","Data":"f52b093acd5072e3fe04bbb103e212d94ae58cb2347fb21aad4ee06ed5c9a26f"}
Jul 09 19:33:47.326105 ip-10-0-139-134 kubenswrapper[2578]: I0709 19:33:47.326050    2578 scope.go:117] "RemoveContainer" containerID="43423b3c927ff470dba3d4c6847751857dae227deaf0bf6705c86610d336e4c6"
Jul 09 19:33:47.334826 ip-10-0-139-134 kubenswrapper[2578]: I0709 19:33:47.334810    2578 scope.go:117] "RemoveContainer" containerID="43423b3c927ff470dba3d4c6847751857dae227deaf0bf6705c86610d336e4c6"
Jul 09 19:33:47.335127 ip-10-0-139-134 kubenswrapper[2578]: E0709 19:33:47.335107    2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"43423b3c927ff470dba3d4c6847751857dae227deaf0bf6705c86610d336e4c6\": container with ID starting with 43423b3c927ff470dba3d4c6847751857dae227deaf0bf6705c86610d336e4c6 not found: ID does not exist" containerID="43423b3c927ff470dba3d4c6847751857dae227deaf0bf6705c86610d336e4c6"
Jul 09 19:33:47.335181 ip-10-0-139-134 kubenswrapper[2578]: I0709 19:33:47.335136    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"43423b3c927ff470dba3d4c6847751857dae227deaf0bf6705c86610d336e4c6"} err="failed to get container status \"43423b3c927ff470dba3d4c6847751857dae227deaf0bf6705c86610d336e4c6\": rpc error: code = NotFound desc = could not find container \"43423b3c927ff470dba3d4c6847751857dae227deaf0bf6705c86610d336e4c6\": container with ID starting with 43423b3c927ff470dba3d4c6847751857dae227deaf0bf6705c86610d336e4c6 not found: ID does not exist"
Jul 09 19:33:47.345391 ip-10-0-139-134 kubenswrapper[2578]: I0709 19:33:47.345370    2578 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/d4836afd-4b27-43de-af61-79ea87801733-maas-api-tls\") on node \"ip-10-0-139-134.ec2.internal\" DevicePath \"\""
Jul 09 19:33:47.345391 ip-10-0-139-134 kubenswrapper[2578]: I0709 19:33:47.345390    2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-28vc5\" (UniqueName: \"kubernetes.io/projected/d4836afd-4b27-43de-af61-79ea87801733-kube-api-access-28vc5\") on node \"ip-10-0-139-134.ec2.internal\" DevicePath \"\""
Jul 09 19:33:47.345501 ip-10-0-139-134 kubenswrapper[2578]: I0709 19:33:47.345400    2578 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/d4836afd-4b27-43de-af61-79ea87801733-openshift-service-ca\") on node \"ip-10-0-139-134.ec2.internal\" DevicePath \"\""
Jul 09 19:33:47.348426 ip-10-0-139-134 kubenswrapper[2578]: I0709 19:33:47.348404    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-a7212d-5d89d479df-xk6vj"]
Jul 09 19:33:47.352398 ip-10-0-139-134 kubenswrapper[2578]: I0709 19:33:47.352370    2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-a7212d-5d89d479df-xk6vj"]
Jul 09 19:33:47.838394 ip-10-0-139-134 kubenswrapper[2578]: I0709 19:33:47.838361    2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d4836afd-4b27-43de-af61-79ea87801733" path="/var/lib/kubelet/pods/d4836afd-4b27-43de-af61-79ea87801733/volumes"
Jul 09 19:34:01.176484 ip-10-0-139-134 kubenswrapper[2578]: I0709 19:34:01.176427    2578 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-inf-b-bc9ef2/test-model-bc9ef2-kserve-664d8d9979-kxhk9" podUID="eeb9b094-9ada-42ee-a4fc-813860c21111" containerName="main" containerID="cri-o://f2dba0226fc04ae9a0bbb2a54f8e1e960dff784ffdd75164b77886e794acef88" gracePeriod=45
Jul 09 19:34:01.388799 ip-10-0-139-134 kubenswrapper[2578]: I0709 19:34:01.388761    2578 generic.go:356] "Generic (PLEG): container finished" podID="eeb9b094-9ada-42ee-a4fc-813860c21111" containerID="f2dba0226fc04ae9a0bbb2a54f8e1e960dff784ffdd75164b77886e794acef88" exitCode=0
Jul 09 19:34:01.388951 ip-10-0-139-134 kubenswrapper[2578]: I0709 19:34:01.388830    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-b-bc9ef2/test-model-bc9ef2-kserve-664d8d9979-kxhk9" event={"ID":"eeb9b094-9ada-42ee-a4fc-813860c21111","Type":"ContainerDied","Data":"f2dba0226fc04ae9a0bbb2a54f8e1e960dff784ffdd75164b77886e794acef88"}
Jul 09 19:34:01.425939 ip-10-0-139-134 kubenswrapper[2578]: I0709 19:34:01.425910    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-b-bc9ef2/test-model-bc9ef2-kserve-664d8d9979-kxhk9"
Jul 09 19:34:01.574076 ip-10-0-139-134 kubenswrapper[2578]: I0709 19:34:01.573957    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/eeb9b094-9ada-42ee-a4fc-813860c21111-tmp-dir\") pod \"eeb9b094-9ada-42ee-a4fc-813860c21111\" (UID: \"eeb9b094-9ada-42ee-a4fc-813860c21111\") "
Jul 09 19:34:01.574249 ip-10-0-139-134 kubenswrapper[2578]: I0709 19:34:01.574080    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/eeb9b094-9ada-42ee-a4fc-813860c21111-dshm\") pod \"eeb9b094-9ada-42ee-a4fc-813860c21111\" (UID: \"eeb9b094-9ada-42ee-a4fc-813860c21111\") "
Jul 09 19:34:01.574249 ip-10-0-139-134 kubenswrapper[2578]: I0709 19:34:01.574100    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/eeb9b094-9ada-42ee-a4fc-813860c21111-home\") pod \"eeb9b094-9ada-42ee-a4fc-813860c21111\" (UID: \"eeb9b094-9ada-42ee-a4fc-813860c21111\") "
Jul 09 19:34:01.574249 ip-10-0-139-134 kubenswrapper[2578]: I0709 19:34:01.574132    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/eeb9b094-9ada-42ee-a4fc-813860c21111-model-cache\") pod \"eeb9b094-9ada-42ee-a4fc-813860c21111\" (UID: \"eeb9b094-9ada-42ee-a4fc-813860c21111\") "
Jul 09 19:34:01.574249 ip-10-0-139-134 kubenswrapper[2578]: I0709 19:34:01.574157    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-jk2lk\" (UniqueName: \"kubernetes.io/projected/eeb9b094-9ada-42ee-a4fc-813860c21111-kube-api-access-jk2lk\") pod \"eeb9b094-9ada-42ee-a4fc-813860c21111\" (UID: \"eeb9b094-9ada-42ee-a4fc-813860c21111\") "
Jul 09 19:34:01.574249 ip-10-0-139-134 kubenswrapper[2578]: I0709 19:34:01.574182    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/eeb9b094-9ada-42ee-a4fc-813860c21111-tls-certs\") pod \"eeb9b094-9ada-42ee-a4fc-813860c21111\" (UID: \"eeb9b094-9ada-42ee-a4fc-813860c21111\") "
Jul 09 19:34:01.574501 ip-10-0-139-134 kubenswrapper[2578]: I0709 19:34:01.574248    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/eeb9b094-9ada-42ee-a4fc-813860c21111-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "eeb9b094-9ada-42ee-a4fc-813860c21111" (UID: "eeb9b094-9ada-42ee-a4fc-813860c21111"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 09 19:34:01.574501 ip-10-0-139-134 kubenswrapper[2578]: I0709 19:34:01.574412    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/eeb9b094-9ada-42ee-a4fc-813860c21111-model-cache" (OuterVolumeSpecName: "model-cache") pod "eeb9b094-9ada-42ee-a4fc-813860c21111" (UID: "eeb9b094-9ada-42ee-a4fc-813860c21111"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 09 19:34:01.574501 ip-10-0-139-134 kubenswrapper[2578]: I0709 19:34:01.574421    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/eeb9b094-9ada-42ee-a4fc-813860c21111-home" (OuterVolumeSpecName: "home") pod "eeb9b094-9ada-42ee-a4fc-813860c21111" (UID: "eeb9b094-9ada-42ee-a4fc-813860c21111"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 09 19:34:01.574501 ip-10-0-139-134 kubenswrapper[2578]: I0709 19:34:01.574476    2578 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/eeb9b094-9ada-42ee-a4fc-813860c21111-tmp-dir\") on node \"ip-10-0-139-134.ec2.internal\" DevicePath \"\""
Jul 09 19:34:01.576577 ip-10-0-139-134 kubenswrapper[2578]: I0709 19:34:01.576552    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/eeb9b094-9ada-42ee-a4fc-813860c21111-dshm" (OuterVolumeSpecName: "dshm") pod "eeb9b094-9ada-42ee-a4fc-813860c21111" (UID: "eeb9b094-9ada-42ee-a4fc-813860c21111"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 09 19:34:01.576664 ip-10-0-139-134 kubenswrapper[2578]: I0709 19:34:01.576576    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/eeb9b094-9ada-42ee-a4fc-813860c21111-kube-api-access-jk2lk" (OuterVolumeSpecName: "kube-api-access-jk2lk") pod "eeb9b094-9ada-42ee-a4fc-813860c21111" (UID: "eeb9b094-9ada-42ee-a4fc-813860c21111"). InnerVolumeSpecName "kube-api-access-jk2lk". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 09 19:34:01.576664 ip-10-0-139-134 kubenswrapper[2578]: I0709 19:34:01.576625    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/eeb9b094-9ada-42ee-a4fc-813860c21111-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "eeb9b094-9ada-42ee-a4fc-813860c21111" (UID: "eeb9b094-9ada-42ee-a4fc-813860c21111"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 09 19:34:01.675307 ip-10-0-139-134 kubenswrapper[2578]: I0709 19:34:01.675269    2578 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/eeb9b094-9ada-42ee-a4fc-813860c21111-dshm\") on node \"ip-10-0-139-134.ec2.internal\" DevicePath \"\""
Jul 09 19:34:01.675307 ip-10-0-139-134 kubenswrapper[2578]: I0709 19:34:01.675298    2578 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/eeb9b094-9ada-42ee-a4fc-813860c21111-home\") on node \"ip-10-0-139-134.ec2.internal\" DevicePath \"\""
Jul 09 19:34:01.675307 ip-10-0-139-134 kubenswrapper[2578]: I0709 19:34:01.675306    2578 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/eeb9b094-9ada-42ee-a4fc-813860c21111-model-cache\") on node \"ip-10-0-139-134.ec2.internal\" DevicePath \"\""
Jul 09 19:34:01.675527 ip-10-0-139-134 kubenswrapper[2578]: I0709 19:34:01.675319    2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-jk2lk\" (UniqueName: \"kubernetes.io/projected/eeb9b094-9ada-42ee-a4fc-813860c21111-kube-api-access-jk2lk\") on node \"ip-10-0-139-134.ec2.internal\" DevicePath \"\""
Jul 09 19:34:01.675527 ip-10-0-139-134 kubenswrapper[2578]: I0709 19:34:01.675328    2578 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/eeb9b094-9ada-42ee-a4fc-813860c21111-tls-certs\") on node \"ip-10-0-139-134.ec2.internal\" DevicePath \"\""
Jul 09 19:34:02.393896 ip-10-0-139-134 kubenswrapper[2578]: I0709 19:34:02.393866    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-b-bc9ef2/test-model-bc9ef2-kserve-664d8d9979-kxhk9"
Jul 09 19:34:02.394322 ip-10-0-139-134 kubenswrapper[2578]: I0709 19:34:02.393861    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-b-bc9ef2/test-model-bc9ef2-kserve-664d8d9979-kxhk9" event={"ID":"eeb9b094-9ada-42ee-a4fc-813860c21111","Type":"ContainerDied","Data":"717218465f5e941db4da6b74f2f875f3fde1efca8e32642487f60ed54a2123d6"}
Jul 09 19:34:02.394322 ip-10-0-139-134 kubenswrapper[2578]: I0709 19:34:02.394026    2578 scope.go:117] "RemoveContainer" containerID="f2dba0226fc04ae9a0bbb2a54f8e1e960dff784ffdd75164b77886e794acef88"
Jul 09 19:34:02.410981 ip-10-0-139-134 kubenswrapper[2578]: I0709 19:34:02.410957    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-inf-b-bc9ef2/test-model-bc9ef2-kserve-664d8d9979-kxhk9"]
Jul 09 19:34:02.414959 ip-10-0-139-134 kubenswrapper[2578]: I0709 19:34:02.414935    2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-inf-b-bc9ef2/test-model-bc9ef2-kserve-664d8d9979-kxhk9"]
Jul 09 19:34:03.838265 ip-10-0-139-134 kubenswrapper[2578]: I0709 19:34:03.838232    2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="eeb9b094-9ada-42ee-a4fc-813860c21111" path="/var/lib/kubelet/pods/eeb9b094-9ada-42ee-a4fc-813860c21111/volumes"
Jul 09 19:34:30.140500 ip-10-0-139-134 kubenswrapper[2578]: I0709 19:34:30.140467    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-bc9ef2-5464c697fd-bmdf9"]
Jul 09 19:34:30.140941 ip-10-0-139-134 kubenswrapper[2578]: I0709 19:34:30.140668    2578 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-bc9ef2-5464c697fd-bmdf9" podUID="7657f375-df50-40dd-bf06-4956a50849b7" containerName="maas-api" containerID="cri-o://ecaa190a0b792f9504b1dfe7fefcc5123c0b2bea1f7c14dc255411b181636c83" gracePeriod=30
Jul 09 19:34:30.388576 ip-10-0-139-134 kubenswrapper[2578]: I0709 19:34:30.388554    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-bc9ef2-5464c697fd-bmdf9"
Jul 09 19:34:30.416194 ip-10-0-139-134 kubenswrapper[2578]: I0709 19:34:30.416163    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-97mvj\" (UniqueName: \"kubernetes.io/projected/7657f375-df50-40dd-bf06-4956a50849b7-kube-api-access-97mvj\") pod \"7657f375-df50-40dd-bf06-4956a50849b7\" (UID: \"7657f375-df50-40dd-bf06-4956a50849b7\") "
Jul 09 19:34:30.416352 ip-10-0-139-134 kubenswrapper[2578]: I0709 19:34:30.416213    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/7657f375-df50-40dd-bf06-4956a50849b7-maas-api-tls\") pod \"7657f375-df50-40dd-bf06-4956a50849b7\" (UID: \"7657f375-df50-40dd-bf06-4956a50849b7\") "
Jul 09 19:34:30.416352 ip-10-0-139-134 kubenswrapper[2578]: I0709 19:34:30.416263    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/7657f375-df50-40dd-bf06-4956a50849b7-openshift-service-ca\") pod \"7657f375-df50-40dd-bf06-4956a50849b7\" (UID: \"7657f375-df50-40dd-bf06-4956a50849b7\") "
Jul 09 19:34:30.416683 ip-10-0-139-134 kubenswrapper[2578]: I0709 19:34:30.416658    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/7657f375-df50-40dd-bf06-4956a50849b7-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "7657f375-df50-40dd-bf06-4956a50849b7" (UID: "7657f375-df50-40dd-bf06-4956a50849b7"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 09 19:34:30.418358 ip-10-0-139-134 kubenswrapper[2578]: I0709 19:34:30.418335    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7657f375-df50-40dd-bf06-4956a50849b7-kube-api-access-97mvj" (OuterVolumeSpecName: "kube-api-access-97mvj") pod "7657f375-df50-40dd-bf06-4956a50849b7" (UID: "7657f375-df50-40dd-bf06-4956a50849b7"). InnerVolumeSpecName "kube-api-access-97mvj". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 09 19:34:30.418448 ip-10-0-139-134 kubenswrapper[2578]: I0709 19:34:30.418382    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7657f375-df50-40dd-bf06-4956a50849b7-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "7657f375-df50-40dd-bf06-4956a50849b7" (UID: "7657f375-df50-40dd-bf06-4956a50849b7"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 09 19:34:30.517403 ip-10-0-139-134 kubenswrapper[2578]: I0709 19:34:30.517367    2578 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/7657f375-df50-40dd-bf06-4956a50849b7-openshift-service-ca\") on node \"ip-10-0-139-134.ec2.internal\" DevicePath \"\""
Jul 09 19:34:30.517403 ip-10-0-139-134 kubenswrapper[2578]: I0709 19:34:30.517396    2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-97mvj\" (UniqueName: \"kubernetes.io/projected/7657f375-df50-40dd-bf06-4956a50849b7-kube-api-access-97mvj\") on node \"ip-10-0-139-134.ec2.internal\" DevicePath \"\""
Jul 09 19:34:30.517403 ip-10-0-139-134 kubenswrapper[2578]: I0709 19:34:30.517408    2578 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/7657f375-df50-40dd-bf06-4956a50849b7-maas-api-tls\") on node \"ip-10-0-139-134.ec2.internal\" DevicePath \"\""
Jul 09 19:34:30.526193 ip-10-0-139-134 kubenswrapper[2578]: I0709 19:34:30.526159    2578 generic.go:356] "Generic (PLEG): container finished" podID="7657f375-df50-40dd-bf06-4956a50849b7" containerID="ecaa190a0b792f9504b1dfe7fefcc5123c0b2bea1f7c14dc255411b181636c83" exitCode=0
Jul 09 19:34:30.526357 ip-10-0-139-134 kubenswrapper[2578]: I0709 19:34:30.526210    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-bc9ef2-5464c697fd-bmdf9"
Jul 09 19:34:30.526357 ip-10-0-139-134 kubenswrapper[2578]: I0709 19:34:30.526242    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-bc9ef2-5464c697fd-bmdf9" event={"ID":"7657f375-df50-40dd-bf06-4956a50849b7","Type":"ContainerDied","Data":"ecaa190a0b792f9504b1dfe7fefcc5123c0b2bea1f7c14dc255411b181636c83"}
Jul 09 19:34:30.526357 ip-10-0-139-134 kubenswrapper[2578]: I0709 19:34:30.526294    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-bc9ef2-5464c697fd-bmdf9" event={"ID":"7657f375-df50-40dd-bf06-4956a50849b7","Type":"ContainerDied","Data":"db05c313e1a14ba7f36d822d967f36b5c62b9cafecc63a854eef7220b0160960"}
Jul 09 19:34:30.526357 ip-10-0-139-134 kubenswrapper[2578]: I0709 19:34:30.526317    2578 scope.go:117] "RemoveContainer" containerID="ecaa190a0b792f9504b1dfe7fefcc5123c0b2bea1f7c14dc255411b181636c83"
Jul 09 19:34:30.536927 ip-10-0-139-134 kubenswrapper[2578]: I0709 19:34:30.536884    2578 scope.go:117] "RemoveContainer" containerID="ecaa190a0b792f9504b1dfe7fefcc5123c0b2bea1f7c14dc255411b181636c83"
Jul 09 19:34:30.537350 ip-10-0-139-134 kubenswrapper[2578]: E0709 19:34:30.537327    2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ecaa190a0b792f9504b1dfe7fefcc5123c0b2bea1f7c14dc255411b181636c83\": container with ID starting with ecaa190a0b792f9504b1dfe7fefcc5123c0b2bea1f7c14dc255411b181636c83 not found: ID does not exist" containerID="ecaa190a0b792f9504b1dfe7fefcc5123c0b2bea1f7c14dc255411b181636c83"
Jul 09 19:34:30.537439 ip-10-0-139-134 kubenswrapper[2578]: I0709 19:34:30.537361    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ecaa190a0b792f9504b1dfe7fefcc5123c0b2bea1f7c14dc255411b181636c83"} err="failed to get container status \"ecaa190a0b792f9504b1dfe7fefcc5123c0b2bea1f7c14dc255411b181636c83\": rpc error: code = NotFound desc = could not find container \"ecaa190a0b792f9504b1dfe7fefcc5123c0b2bea1f7c14dc255411b181636c83\": container with ID starting with ecaa190a0b792f9504b1dfe7fefcc5123c0b2bea1f7c14dc255411b181636c83 not found: ID does not exist"
Jul 09 19:34:30.547297 ip-10-0-139-134 kubenswrapper[2578]: I0709 19:34:30.547271    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-bc9ef2-5464c697fd-bmdf9"]
Jul 09 19:34:30.552350 ip-10-0-139-134 kubenswrapper[2578]: I0709 19:34:30.552328    2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-bc9ef2-5464c697fd-bmdf9"]
Jul 09 19:34:31.838373 ip-10-0-139-134 kubenswrapper[2578]: I0709 19:34:31.838341    2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="7657f375-df50-40dd-bf06-4956a50849b7" path="/var/lib/kubelet/pods/7657f375-df50-40dd-bf06-4956a50849b7/volumes"
Jul 09 19:34:40.241107 ip-10-0-139-134 kubenswrapper[2578]: I0709 19:34:40.241067    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-47c272-6cc94d4d88-qwdrr"]
Jul 09 19:34:40.241651 ip-10-0-139-134 kubenswrapper[2578]: I0709 19:34:40.241490    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d4836afd-4b27-43de-af61-79ea87801733" containerName="maas-api"
Jul 09 19:34:40.241651 ip-10-0-139-134 kubenswrapper[2578]: I0709 19:34:40.241508    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="d4836afd-4b27-43de-af61-79ea87801733" containerName="maas-api"
Jul 09 19:34:40.241651 ip-10-0-139-134 kubenswrapper[2578]: I0709 19:34:40.241521    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="eeb9b094-9ada-42ee-a4fc-813860c21111" containerName="main"
Jul 09 19:34:40.241651 ip-10-0-139-134 kubenswrapper[2578]: I0709 19:34:40.241529    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="eeb9b094-9ada-42ee-a4fc-813860c21111" containerName="main"
Jul 09 19:34:40.241651 ip-10-0-139-134 kubenswrapper[2578]: I0709 19:34:40.241545    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7657f375-df50-40dd-bf06-4956a50849b7" containerName="maas-api"
Jul 09 19:34:40.241651 ip-10-0-139-134 kubenswrapper[2578]: I0709 19:34:40.241553    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="7657f375-df50-40dd-bf06-4956a50849b7" containerName="maas-api"
Jul 09 19:34:40.241945 ip-10-0-139-134 kubenswrapper[2578]: I0709 19:34:40.241661    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="7657f375-df50-40dd-bf06-4956a50849b7" containerName="maas-api"
Jul 09 19:34:40.241945 ip-10-0-139-134 kubenswrapper[2578]: I0709 19:34:40.241673    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="eeb9b094-9ada-42ee-a4fc-813860c21111" containerName="main"
Jul 09 19:34:40.241945 ip-10-0-139-134 kubenswrapper[2578]: I0709 19:34:40.241685    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="d4836afd-4b27-43de-af61-79ea87801733" containerName="maas-api"
Jul 09 19:34:40.245299 ip-10-0-139-134 kubenswrapper[2578]: I0709 19:34:40.245275    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-47c272-6cc94d4d88-qwdrr"
Jul 09 19:34:40.248848 ip-10-0-139-134 kubenswrapper[2578]: I0709 19:34:40.248822    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 09 19:34:40.248988 ip-10-0-139-134 kubenswrapper[2578]: I0709 19:34:40.248863    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"kube-root-ca.crt\""
Jul 09 19:34:40.248988 ip-10-0-139-134 kubenswrapper[2578]: I0709 19:34:40.248863    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-dockercfg-9pdt2\""
Jul 09 19:34:40.248988 ip-10-0-139-134 kubenswrapper[2578]: I0709 19:34:40.248903    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-api-a-47c272-serving-cert\""
Jul 09 19:34:40.257226 ip-10-0-139-134 kubenswrapper[2578]: I0709 19:34:40.257202    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-47c272-6cc94d4d88-qwdrr"]
Jul 09 19:34:40.303295 ip-10-0-139-134 kubenswrapper[2578]: I0709 19:34:40.303260    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/cb0e8af6-0e4b-4092-a9b5-8e4621100fce-maas-api-tls\") pod \"maas-api-e2e-api-a-47c272-6cc94d4d88-qwdrr\" (UID: \"cb0e8af6-0e4b-4092-a9b5-8e4621100fce\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-47c272-6cc94d4d88-qwdrr"
Jul 09 19:34:40.303486 ip-10-0-139-134 kubenswrapper[2578]: I0709 19:34:40.303323    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-h5x6k\" (UniqueName: \"kubernetes.io/projected/cb0e8af6-0e4b-4092-a9b5-8e4621100fce-kube-api-access-h5x6k\") pod \"maas-api-e2e-api-a-47c272-6cc94d4d88-qwdrr\" (UID: \"cb0e8af6-0e4b-4092-a9b5-8e4621100fce\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-47c272-6cc94d4d88-qwdrr"
Jul 09 19:34:40.303486 ip-10-0-139-134 kubenswrapper[2578]: I0709 19:34:40.303352    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/cb0e8af6-0e4b-4092-a9b5-8e4621100fce-openshift-service-ca\") pod \"maas-api-e2e-api-a-47c272-6cc94d4d88-qwdrr\" (UID: \"cb0e8af6-0e4b-4092-a9b5-8e4621100fce\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-47c272-6cc94d4d88-qwdrr"
Jul 09 19:34:40.403794 ip-10-0-139-134 kubenswrapper[2578]: I0709 19:34:40.403753    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/cb0e8af6-0e4b-4092-a9b5-8e4621100fce-maas-api-tls\") pod \"maas-api-e2e-api-a-47c272-6cc94d4d88-qwdrr\" (UID: \"cb0e8af6-0e4b-4092-a9b5-8e4621100fce\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-47c272-6cc94d4d88-qwdrr"
Jul 09 19:34:40.403970 ip-10-0-139-134 kubenswrapper[2578]: I0709 19:34:40.403816    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-h5x6k\" (UniqueName: \"kubernetes.io/projected/cb0e8af6-0e4b-4092-a9b5-8e4621100fce-kube-api-access-h5x6k\") pod \"maas-api-e2e-api-a-47c272-6cc94d4d88-qwdrr\" (UID: \"cb0e8af6-0e4b-4092-a9b5-8e4621100fce\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-47c272-6cc94d4d88-qwdrr"
Jul 09 19:34:40.403970 ip-10-0-139-134 kubenswrapper[2578]: I0709 19:34:40.403838    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/cb0e8af6-0e4b-4092-a9b5-8e4621100fce-openshift-service-ca\") pod \"maas-api-e2e-api-a-47c272-6cc94d4d88-qwdrr\" (UID: \"cb0e8af6-0e4b-4092-a9b5-8e4621100fce\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-47c272-6cc94d4d88-qwdrr"
Jul 09 19:34:40.403970 ip-10-0-139-134 kubenswrapper[2578]: E0709 19:34:40.403924    2578 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-api-a-47c272-serving-cert: secret "maas-api-e2e-api-a-47c272-serving-cert" not found
Jul 09 19:34:40.404096 ip-10-0-139-134 kubenswrapper[2578]: E0709 19:34:40.404042    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cb0e8af6-0e4b-4092-a9b5-8e4621100fce-maas-api-tls podName:cb0e8af6-0e4b-4092-a9b5-8e4621100fce nodeName:}" failed. No retries permitted until 2026-07-09 19:34:40.904019598 +0000 UTC m=+2177.530070933 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/cb0e8af6-0e4b-4092-a9b5-8e4621100fce-maas-api-tls") pod "maas-api-e2e-api-a-47c272-6cc94d4d88-qwdrr" (UID: "cb0e8af6-0e4b-4092-a9b5-8e4621100fce") : secret "maas-api-e2e-api-a-47c272-serving-cert" not found
Jul 09 19:34:40.404469 ip-10-0-139-134 kubenswrapper[2578]: I0709 19:34:40.404452    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/cb0e8af6-0e4b-4092-a9b5-8e4621100fce-openshift-service-ca\") pod \"maas-api-e2e-api-a-47c272-6cc94d4d88-qwdrr\" (UID: \"cb0e8af6-0e4b-4092-a9b5-8e4621100fce\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-47c272-6cc94d4d88-qwdrr"
Jul 09 19:34:40.414497 ip-10-0-139-134 kubenswrapper[2578]: I0709 19:34:40.414470    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-h5x6k\" (UniqueName: \"kubernetes.io/projected/cb0e8af6-0e4b-4092-a9b5-8e4621100fce-kube-api-access-h5x6k\") pod \"maas-api-e2e-api-a-47c272-6cc94d4d88-qwdrr\" (UID: \"cb0e8af6-0e4b-4092-a9b5-8e4621100fce\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-47c272-6cc94d4d88-qwdrr"
Jul 09 19:34:40.908094 ip-10-0-139-134 kubenswrapper[2578]: I0709 19:34:40.908053    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/cb0e8af6-0e4b-4092-a9b5-8e4621100fce-maas-api-tls\") pod \"maas-api-e2e-api-a-47c272-6cc94d4d88-qwdrr\" (UID: \"cb0e8af6-0e4b-4092-a9b5-8e4621100fce\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-47c272-6cc94d4d88-qwdrr"
Jul 09 19:34:40.910664 ip-10-0-139-134 kubenswrapper[2578]: I0709 19:34:40.910635    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/cb0e8af6-0e4b-4092-a9b5-8e4621100fce-maas-api-tls\") pod \"maas-api-e2e-api-a-47c272-6cc94d4d88-qwdrr\" (UID: \"cb0e8af6-0e4b-4092-a9b5-8e4621100fce\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-47c272-6cc94d4d88-qwdrr"
Jul 09 19:34:41.157079 ip-10-0-139-134 kubenswrapper[2578]: I0709 19:34:41.157040    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-47c272-6cc94d4d88-qwdrr"
Jul 09 19:34:41.288716 ip-10-0-139-134 kubenswrapper[2578]: I0709 19:34:41.288690    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-47c272-6cc94d4d88-qwdrr"]
Jul 09 19:34:41.290673 ip-10-0-139-134 kubenswrapper[2578]: W0709 19:34:41.290627    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcb0e8af6_0e4b_4092_a9b5_8e4621100fce.slice/crio-0bac8dddeb11f7be9f351a52823d9db57f0602215cde815723f26a0c40a03bd6 WatchSource:0}: Error finding container 0bac8dddeb11f7be9f351a52823d9db57f0602215cde815723f26a0c40a03bd6: Status 404 returned error can't find the container with id 0bac8dddeb11f7be9f351a52823d9db57f0602215cde815723f26a0c40a03bd6
Jul 09 19:34:41.579780 ip-10-0-139-134 kubenswrapper[2578]: I0709 19:34:41.579694    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-47c272-6cc94d4d88-qwdrr" event={"ID":"cb0e8af6-0e4b-4092-a9b5-8e4621100fce","Type":"ContainerStarted","Data":"0bac8dddeb11f7be9f351a52823d9db57f0602215cde815723f26a0c40a03bd6"}
Jul 09 19:34:42.585931 ip-10-0-139-134 kubenswrapper[2578]: I0709 19:34:42.585894    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-47c272-6cc94d4d88-qwdrr" event={"ID":"cb0e8af6-0e4b-4092-a9b5-8e4621100fce","Type":"ContainerStarted","Data":"2e633b6a38d2e38fa5007353f858a120ac1c8a6b017cec6b2e64cb36b52d8747"}
Jul 09 19:34:42.586328 ip-10-0-139-134 kubenswrapper[2578]: I0709 19:34:42.586032    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-47c272-6cc94d4d88-qwdrr"
Jul 09 19:34:42.602972 ip-10-0-139-134 kubenswrapper[2578]: I0709 19:34:42.602910    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-47c272-6cc94d4d88-qwdrr" podStartSLOduration=2.202619885 podStartE2EDuration="2.602892669s" totalImagesPullingTime="400.272784ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 19:34:40 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 19:34:42.602608155 +0000 UTC m=+2179.228659526" watchObservedRunningTime="2026-07-09 19:34:42.602892669 +0000 UTC m=+2179.228944001"
Jul 09 19:34:48.284742 ip-10-0-139-134 kubenswrapper[2578]: I0709 19:34:48.284700    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-a73219-7d9dd64975-jntj7"]
Jul 09 19:34:48.288511 ip-10-0-139-134 kubenswrapper[2578]: I0709 19:34:48.288487    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-a73219-7d9dd64975-jntj7"
Jul 09 19:34:48.291831 ip-10-0-139-134 kubenswrapper[2578]: I0709 19:34:48.291809    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-api-b-a73219-serving-cert\""
Jul 09 19:34:48.300412 ip-10-0-139-134 kubenswrapper[2578]: I0709 19:34:48.300386    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-a73219-7d9dd64975-jntj7"]
Jul 09 19:34:48.373633 ip-10-0-139-134 kubenswrapper[2578]: I0709 19:34:48.373583    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/09ef96f3-e83d-47ba-9b6b-574975643b44-openshift-service-ca\") pod \"maas-api-e2e-api-b-a73219-7d9dd64975-jntj7\" (UID: \"09ef96f3-e83d-47ba-9b6b-574975643b44\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-a73219-7d9dd64975-jntj7"
Jul 09 19:34:48.373837 ip-10-0-139-134 kubenswrapper[2578]: I0709 19:34:48.373653    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/09ef96f3-e83d-47ba-9b6b-574975643b44-maas-api-tls\") pod \"maas-api-e2e-api-b-a73219-7d9dd64975-jntj7\" (UID: \"09ef96f3-e83d-47ba-9b6b-574975643b44\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-a73219-7d9dd64975-jntj7"
Jul 09 19:34:48.373837 ip-10-0-139-134 kubenswrapper[2578]: I0709 19:34:48.373725    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2cgnq\" (UniqueName: \"kubernetes.io/projected/09ef96f3-e83d-47ba-9b6b-574975643b44-kube-api-access-2cgnq\") pod \"maas-api-e2e-api-b-a73219-7d9dd64975-jntj7\" (UID: \"09ef96f3-e83d-47ba-9b6b-574975643b44\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-a73219-7d9dd64975-jntj7"
Jul 09 19:34:48.474935 ip-10-0-139-134 kubenswrapper[2578]: I0709 19:34:48.474895    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2cgnq\" (UniqueName: \"kubernetes.io/projected/09ef96f3-e83d-47ba-9b6b-574975643b44-kube-api-access-2cgnq\") pod \"maas-api-e2e-api-b-a73219-7d9dd64975-jntj7\" (UID: \"09ef96f3-e83d-47ba-9b6b-574975643b44\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-a73219-7d9dd64975-jntj7"
Jul 09 19:34:48.475157 ip-10-0-139-134 kubenswrapper[2578]: I0709 19:34:48.474954    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/09ef96f3-e83d-47ba-9b6b-574975643b44-openshift-service-ca\") pod \"maas-api-e2e-api-b-a73219-7d9dd64975-jntj7\" (UID: \"09ef96f3-e83d-47ba-9b6b-574975643b44\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-a73219-7d9dd64975-jntj7"
Jul 09 19:34:48.475157 ip-10-0-139-134 kubenswrapper[2578]: I0709 19:34:48.474982    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/09ef96f3-e83d-47ba-9b6b-574975643b44-maas-api-tls\") pod \"maas-api-e2e-api-b-a73219-7d9dd64975-jntj7\" (UID: \"09ef96f3-e83d-47ba-9b6b-574975643b44\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-a73219-7d9dd64975-jntj7"
Jul 09 19:34:48.475157 ip-10-0-139-134 kubenswrapper[2578]: E0709 19:34:48.475118    2578 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-api-b-a73219-serving-cert: secret "maas-api-e2e-api-b-a73219-serving-cert" not found
Jul 09 19:34:48.475331 ip-10-0-139-134 kubenswrapper[2578]: E0709 19:34:48.475177    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/09ef96f3-e83d-47ba-9b6b-574975643b44-maas-api-tls podName:09ef96f3-e83d-47ba-9b6b-574975643b44 nodeName:}" failed. No retries permitted until 2026-07-09 19:34:48.975160706 +0000 UTC m=+2185.601212014 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/09ef96f3-e83d-47ba-9b6b-574975643b44-maas-api-tls") pod "maas-api-e2e-api-b-a73219-7d9dd64975-jntj7" (UID: "09ef96f3-e83d-47ba-9b6b-574975643b44") : secret "maas-api-e2e-api-b-a73219-serving-cert" not found
Jul 09 19:34:48.475695 ip-10-0-139-134 kubenswrapper[2578]: I0709 19:34:48.475668    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/09ef96f3-e83d-47ba-9b6b-574975643b44-openshift-service-ca\") pod \"maas-api-e2e-api-b-a73219-7d9dd64975-jntj7\" (UID: \"09ef96f3-e83d-47ba-9b6b-574975643b44\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-a73219-7d9dd64975-jntj7"
Jul 09 19:34:48.488034 ip-10-0-139-134 kubenswrapper[2578]: I0709 19:34:48.488008    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2cgnq\" (UniqueName: \"kubernetes.io/projected/09ef96f3-e83d-47ba-9b6b-574975643b44-kube-api-access-2cgnq\") pod \"maas-api-e2e-api-b-a73219-7d9dd64975-jntj7\" (UID: \"09ef96f3-e83d-47ba-9b6b-574975643b44\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-a73219-7d9dd64975-jntj7"
Jul 09 19:34:48.596531 ip-10-0-139-134 kubenswrapper[2578]: I0709 19:34:48.596447    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-47c272-6cc94d4d88-qwdrr"
Jul 09 19:34:48.978935 ip-10-0-139-134 kubenswrapper[2578]: I0709 19:34:48.978894    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/09ef96f3-e83d-47ba-9b6b-574975643b44-maas-api-tls\") pod \"maas-api-e2e-api-b-a73219-7d9dd64975-jntj7\" (UID: \"09ef96f3-e83d-47ba-9b6b-574975643b44\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-a73219-7d9dd64975-jntj7"
Jul 09 19:34:48.981490 ip-10-0-139-134 kubenswrapper[2578]: I0709 19:34:48.981461    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/09ef96f3-e83d-47ba-9b6b-574975643b44-maas-api-tls\") pod \"maas-api-e2e-api-b-a73219-7d9dd64975-jntj7\" (UID: \"09ef96f3-e83d-47ba-9b6b-574975643b44\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-a73219-7d9dd64975-jntj7"
Jul 09 19:34:49.200467 ip-10-0-139-134 kubenswrapper[2578]: I0709 19:34:49.200417    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-a73219-7d9dd64975-jntj7"
Jul 09 19:34:49.332586 ip-10-0-139-134 kubenswrapper[2578]: I0709 19:34:49.332561    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-a73219-7d9dd64975-jntj7"]
Jul 09 19:34:49.335036 ip-10-0-139-134 kubenswrapper[2578]: W0709 19:34:49.334988    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod09ef96f3_e83d_47ba_9b6b_574975643b44.slice/crio-33a27e6ce4ae2662cd61669c957755e8caa85f26ae4f0e0b0fb13ad4b18925b4 WatchSource:0}: Error finding container 33a27e6ce4ae2662cd61669c957755e8caa85f26ae4f0e0b0fb13ad4b18925b4: Status 404 returned error can't find the container with id 33a27e6ce4ae2662cd61669c957755e8caa85f26ae4f0e0b0fb13ad4b18925b4
Jul 09 19:34:49.623908 ip-10-0-139-134 kubenswrapper[2578]: I0709 19:34:49.623824    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-a73219-7d9dd64975-jntj7" event={"ID":"09ef96f3-e83d-47ba-9b6b-574975643b44","Type":"ContainerStarted","Data":"33a27e6ce4ae2662cd61669c957755e8caa85f26ae4f0e0b0fb13ad4b18925b4"}
Jul 09 19:34:50.629699 ip-10-0-139-134 kubenswrapper[2578]: I0709 19:34:50.629662    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-a73219-7d9dd64975-jntj7" event={"ID":"09ef96f3-e83d-47ba-9b6b-574975643b44","Type":"ContainerStarted","Data":"71b1d279e76c8fa6ba6ff43e0bae568fff1630e0dcaa509a0a12b6b9a2ea8f6f"}
Jul 09 19:34:50.630089 ip-10-0-139-134 kubenswrapper[2578]: I0709 19:34:50.629804    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-a73219-7d9dd64975-jntj7"
Jul 09 19:34:50.649274 ip-10-0-139-134 kubenswrapper[2578]: I0709 19:34:50.649211    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-a73219-7d9dd64975-jntj7" podStartSLOduration=2.098830753 podStartE2EDuration="2.64919369s" totalImagesPullingTime="550.362937ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 19:34:48 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 19:34:50.647887818 +0000 UTC m=+2187.273939164" watchObservedRunningTime="2026-07-09 19:34:50.64919369 +0000 UTC m=+2187.275245019"
Jul 09 19:34:56.640302 ip-10-0-139-134 kubenswrapper[2578]: I0709 19:34:56.640274    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-a73219-7d9dd64975-jntj7"
Jul 09 19:35:01.475905 ip-10-0-139-134 kubenswrapper[2578]: I0709 19:35:01.475869    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-47c272-6cc94d4d88-qwdrr"]
Jul 09 19:35:01.476336 ip-10-0-139-134 kubenswrapper[2578]: I0709 19:35:01.476169    2578 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-47c272-6cc94d4d88-qwdrr" podUID="cb0e8af6-0e4b-4092-a9b5-8e4621100fce" containerName="maas-api" containerID="cri-o://2e633b6a38d2e38fa5007353f858a120ac1c8a6b017cec6b2e64cb36b52d8747" gracePeriod=30
Jul 09 19:35:01.679281 ip-10-0-139-134 kubenswrapper[2578]: I0709 19:35:01.679245    2578 generic.go:356] "Generic (PLEG): container finished" podID="cb0e8af6-0e4b-4092-a9b5-8e4621100fce" containerID="2e633b6a38d2e38fa5007353f858a120ac1c8a6b017cec6b2e64cb36b52d8747" exitCode=0
Jul 09 19:35:01.679461 ip-10-0-139-134 kubenswrapper[2578]: I0709 19:35:01.679320    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-47c272-6cc94d4d88-qwdrr" event={"ID":"cb0e8af6-0e4b-4092-a9b5-8e4621100fce","Type":"ContainerDied","Data":"2e633b6a38d2e38fa5007353f858a120ac1c8a6b017cec6b2e64cb36b52d8747"}
Jul 09 19:35:01.720938 ip-10-0-139-134 kubenswrapper[2578]: I0709 19:35:01.720912    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-47c272-6cc94d4d88-qwdrr"
Jul 09 19:35:01.797394 ip-10-0-139-134 kubenswrapper[2578]: I0709 19:35:01.797288    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/cb0e8af6-0e4b-4092-a9b5-8e4621100fce-openshift-service-ca\") pod \"cb0e8af6-0e4b-4092-a9b5-8e4621100fce\" (UID: \"cb0e8af6-0e4b-4092-a9b5-8e4621100fce\") "
Jul 09 19:35:01.797394 ip-10-0-139-134 kubenswrapper[2578]: I0709 19:35:01.797331    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/cb0e8af6-0e4b-4092-a9b5-8e4621100fce-maas-api-tls\") pod \"cb0e8af6-0e4b-4092-a9b5-8e4621100fce\" (UID: \"cb0e8af6-0e4b-4092-a9b5-8e4621100fce\") "
Jul 09 19:35:01.797394 ip-10-0-139-134 kubenswrapper[2578]: I0709 19:35:01.797375    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-h5x6k\" (UniqueName: \"kubernetes.io/projected/cb0e8af6-0e4b-4092-a9b5-8e4621100fce-kube-api-access-h5x6k\") pod \"cb0e8af6-0e4b-4092-a9b5-8e4621100fce\" (UID: \"cb0e8af6-0e4b-4092-a9b5-8e4621100fce\") "
Jul 09 19:35:01.797756 ip-10-0-139-134 kubenswrapper[2578]: I0709 19:35:01.797731    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/cb0e8af6-0e4b-4092-a9b5-8e4621100fce-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "cb0e8af6-0e4b-4092-a9b5-8e4621100fce" (UID: "cb0e8af6-0e4b-4092-a9b5-8e4621100fce"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 09 19:35:01.799634 ip-10-0-139-134 kubenswrapper[2578]: I0709 19:35:01.799614    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/cb0e8af6-0e4b-4092-a9b5-8e4621100fce-kube-api-access-h5x6k" (OuterVolumeSpecName: "kube-api-access-h5x6k") pod "cb0e8af6-0e4b-4092-a9b5-8e4621100fce" (UID: "cb0e8af6-0e4b-4092-a9b5-8e4621100fce"). InnerVolumeSpecName "kube-api-access-h5x6k". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 09 19:35:01.799713 ip-10-0-139-134 kubenswrapper[2578]: I0709 19:35:01.799698    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/cb0e8af6-0e4b-4092-a9b5-8e4621100fce-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "cb0e8af6-0e4b-4092-a9b5-8e4621100fce" (UID: "cb0e8af6-0e4b-4092-a9b5-8e4621100fce"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 09 19:35:01.898357 ip-10-0-139-134 kubenswrapper[2578]: I0709 19:35:01.898312    2578 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/cb0e8af6-0e4b-4092-a9b5-8e4621100fce-maas-api-tls\") on node \"ip-10-0-139-134.ec2.internal\" DevicePath \"\""
Jul 09 19:35:01.898357 ip-10-0-139-134 kubenswrapper[2578]: I0709 19:35:01.898348    2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-h5x6k\" (UniqueName: \"kubernetes.io/projected/cb0e8af6-0e4b-4092-a9b5-8e4621100fce-kube-api-access-h5x6k\") on node \"ip-10-0-139-134.ec2.internal\" DevicePath \"\""
Jul 09 19:35:01.898357 ip-10-0-139-134 kubenswrapper[2578]: I0709 19:35:01.898360    2578 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/cb0e8af6-0e4b-4092-a9b5-8e4621100fce-openshift-service-ca\") on node \"ip-10-0-139-134.ec2.internal\" DevicePath \"\""
Jul 09 19:35:02.685238 ip-10-0-139-134 kubenswrapper[2578]: I0709 19:35:02.685211    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-47c272-6cc94d4d88-qwdrr"
Jul 09 19:35:02.685651 ip-10-0-139-134 kubenswrapper[2578]: I0709 19:35:02.685211    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-47c272-6cc94d4d88-qwdrr" event={"ID":"cb0e8af6-0e4b-4092-a9b5-8e4621100fce","Type":"ContainerDied","Data":"0bac8dddeb11f7be9f351a52823d9db57f0602215cde815723f26a0c40a03bd6"}
Jul 09 19:35:02.685651 ip-10-0-139-134 kubenswrapper[2578]: I0709 19:35:02.685343    2578 scope.go:117] "RemoveContainer" containerID="2e633b6a38d2e38fa5007353f858a120ac1c8a6b017cec6b2e64cb36b52d8747"
Jul 09 19:35:02.702828 ip-10-0-139-134 kubenswrapper[2578]: I0709 19:35:02.702800    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-47c272-6cc94d4d88-qwdrr"]
Jul 09 19:35:02.706690 ip-10-0-139-134 kubenswrapper[2578]: I0709 19:35:02.706664    2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-47c272-6cc94d4d88-qwdrr"]
Jul 09 19:35:03.838407 ip-10-0-139-134 kubenswrapper[2578]: I0709 19:35:03.838375    2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="cb0e8af6-0e4b-4092-a9b5-8e4621100fce" path="/var/lib/kubelet/pods/cb0e8af6-0e4b-4092-a9b5-8e4621100fce/volumes"
Jul 09 19:35:08.934887 ip-10-0-139-134 kubenswrapper[2578]: I0709 19:35:08.934854    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-a73219-7d9dd64975-jntj7"]
Jul 09 19:35:08.935344 ip-10-0-139-134 kubenswrapper[2578]: I0709 19:35:08.935122    2578 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-a73219-7d9dd64975-jntj7" podUID="09ef96f3-e83d-47ba-9b6b-574975643b44" containerName="maas-api" containerID="cri-o://71b1d279e76c8fa6ba6ff43e0bae568fff1630e0dcaa509a0a12b6b9a2ea8f6f" gracePeriod=30
Jul 09 19:35:09.180457 ip-10-0-139-134 kubenswrapper[2578]: I0709 19:35:09.180429    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-a73219-7d9dd64975-jntj7"
Jul 09 19:35:09.371947 ip-10-0-139-134 kubenswrapper[2578]: I0709 19:35:09.371854    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-2cgnq\" (UniqueName: \"kubernetes.io/projected/09ef96f3-e83d-47ba-9b6b-574975643b44-kube-api-access-2cgnq\") pod \"09ef96f3-e83d-47ba-9b6b-574975643b44\" (UID: \"09ef96f3-e83d-47ba-9b6b-574975643b44\") "
Jul 09 19:35:09.371947 ip-10-0-139-134 kubenswrapper[2578]: I0709 19:35:09.371931    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/09ef96f3-e83d-47ba-9b6b-574975643b44-openshift-service-ca\") pod \"09ef96f3-e83d-47ba-9b6b-574975643b44\" (UID: \"09ef96f3-e83d-47ba-9b6b-574975643b44\") "
Jul 09 19:35:09.372211 ip-10-0-139-134 kubenswrapper[2578]: I0709 19:35:09.371960    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/09ef96f3-e83d-47ba-9b6b-574975643b44-maas-api-tls\") pod \"09ef96f3-e83d-47ba-9b6b-574975643b44\" (UID: \"09ef96f3-e83d-47ba-9b6b-574975643b44\") "
Jul 09 19:35:09.372371 ip-10-0-139-134 kubenswrapper[2578]: I0709 19:35:09.372345    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/09ef96f3-e83d-47ba-9b6b-574975643b44-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "09ef96f3-e83d-47ba-9b6b-574975643b44" (UID: "09ef96f3-e83d-47ba-9b6b-574975643b44"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 09 19:35:09.374306 ip-10-0-139-134 kubenswrapper[2578]: I0709 19:35:09.374276    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/09ef96f3-e83d-47ba-9b6b-574975643b44-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "09ef96f3-e83d-47ba-9b6b-574975643b44" (UID: "09ef96f3-e83d-47ba-9b6b-574975643b44"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 09 19:35:09.374441 ip-10-0-139-134 kubenswrapper[2578]: I0709 19:35:09.374383    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/09ef96f3-e83d-47ba-9b6b-574975643b44-kube-api-access-2cgnq" (OuterVolumeSpecName: "kube-api-access-2cgnq") pod "09ef96f3-e83d-47ba-9b6b-574975643b44" (UID: "09ef96f3-e83d-47ba-9b6b-574975643b44"). InnerVolumeSpecName "kube-api-access-2cgnq". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 09 19:35:09.473183 ip-10-0-139-134 kubenswrapper[2578]: I0709 19:35:09.473141    2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-2cgnq\" (UniqueName: \"kubernetes.io/projected/09ef96f3-e83d-47ba-9b6b-574975643b44-kube-api-access-2cgnq\") on node \"ip-10-0-139-134.ec2.internal\" DevicePath \"\""
Jul 09 19:35:09.473183 ip-10-0-139-134 kubenswrapper[2578]: I0709 19:35:09.473177    2578 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/09ef96f3-e83d-47ba-9b6b-574975643b44-openshift-service-ca\") on node \"ip-10-0-139-134.ec2.internal\" DevicePath \"\""
Jul 09 19:35:09.473183 ip-10-0-139-134 kubenswrapper[2578]: I0709 19:35:09.473190    2578 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/09ef96f3-e83d-47ba-9b6b-574975643b44-maas-api-tls\") on node \"ip-10-0-139-134.ec2.internal\" DevicePath \"\""
Jul 09 19:35:09.719065 ip-10-0-139-134 kubenswrapper[2578]: I0709 19:35:09.719025    2578 generic.go:356] "Generic (PLEG): container finished" podID="09ef96f3-e83d-47ba-9b6b-574975643b44" containerID="71b1d279e76c8fa6ba6ff43e0bae568fff1630e0dcaa509a0a12b6b9a2ea8f6f" exitCode=0
Jul 09 19:35:09.719231 ip-10-0-139-134 kubenswrapper[2578]: I0709 19:35:09.719071    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-a73219-7d9dd64975-jntj7"
Jul 09 19:35:09.719231 ip-10-0-139-134 kubenswrapper[2578]: I0709 19:35:09.719074    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-a73219-7d9dd64975-jntj7" event={"ID":"09ef96f3-e83d-47ba-9b6b-574975643b44","Type":"ContainerDied","Data":"71b1d279e76c8fa6ba6ff43e0bae568fff1630e0dcaa509a0a12b6b9a2ea8f6f"}
Jul 09 19:35:09.719231 ip-10-0-139-134 kubenswrapper[2578]: I0709 19:35:09.719181    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-a73219-7d9dd64975-jntj7" event={"ID":"09ef96f3-e83d-47ba-9b6b-574975643b44","Type":"ContainerDied","Data":"33a27e6ce4ae2662cd61669c957755e8caa85f26ae4f0e0b0fb13ad4b18925b4"}
Jul 09 19:35:09.719231 ip-10-0-139-134 kubenswrapper[2578]: I0709 19:35:09.719204    2578 scope.go:117] "RemoveContainer" containerID="71b1d279e76c8fa6ba6ff43e0bae568fff1630e0dcaa509a0a12b6b9a2ea8f6f"
Jul 09 19:35:09.727885 ip-10-0-139-134 kubenswrapper[2578]: I0709 19:35:09.727867    2578 scope.go:117] "RemoveContainer" containerID="71b1d279e76c8fa6ba6ff43e0bae568fff1630e0dcaa509a0a12b6b9a2ea8f6f"
Jul 09 19:35:09.728137 ip-10-0-139-134 kubenswrapper[2578]: E0709 19:35:09.728117    2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"71b1d279e76c8fa6ba6ff43e0bae568fff1630e0dcaa509a0a12b6b9a2ea8f6f\": container with ID starting with 71b1d279e76c8fa6ba6ff43e0bae568fff1630e0dcaa509a0a12b6b9a2ea8f6f not found: ID does not exist" containerID="71b1d279e76c8fa6ba6ff43e0bae568fff1630e0dcaa509a0a12b6b9a2ea8f6f"
Jul 09 19:35:09.728220 ip-10-0-139-134 kubenswrapper[2578]: I0709 19:35:09.728149    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"71b1d279e76c8fa6ba6ff43e0bae568fff1630e0dcaa509a0a12b6b9a2ea8f6f"} err="failed to get container status \"71b1d279e76c8fa6ba6ff43e0bae568fff1630e0dcaa509a0a12b6b9a2ea8f6f\": rpc error: code = NotFound desc = could not find container \"71b1d279e76c8fa6ba6ff43e0bae568fff1630e0dcaa509a0a12b6b9a2ea8f6f\": container with ID starting with 71b1d279e76c8fa6ba6ff43e0bae568fff1630e0dcaa509a0a12b6b9a2ea8f6f not found: ID does not exist"
Jul 09 19:35:09.742124 ip-10-0-139-134 kubenswrapper[2578]: I0709 19:35:09.742093    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-a73219-7d9dd64975-jntj7"]
Jul 09 19:35:09.748666 ip-10-0-139-134 kubenswrapper[2578]: I0709 19:35:09.748642    2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-a73219-7d9dd64975-jntj7"]
Jul 09 19:35:09.837985 ip-10-0-139-134 kubenswrapper[2578]: I0709 19:35:09.837947    2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="09ef96f3-e83d-47ba-9b6b-574975643b44" path="/var/lib/kubelet/pods/09ef96f3-e83d-47ba-9b6b-574975643b44/volumes"
Jul 09 19:35:18.502546 ip-10-0-139-134 kubenswrapper[2578]: I0709 19:35:18.502511    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-77ffac-78664b6676-x8fdh"]
Jul 09 19:35:18.502920 ip-10-0-139-134 kubenswrapper[2578]: I0709 19:35:18.502845    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="cb0e8af6-0e4b-4092-a9b5-8e4621100fce" containerName="maas-api"
Jul 09 19:35:18.502920 ip-10-0-139-134 kubenswrapper[2578]: I0709 19:35:18.502856    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="cb0e8af6-0e4b-4092-a9b5-8e4621100fce" containerName="maas-api"
Jul 09 19:35:18.502920 ip-10-0-139-134 kubenswrapper[2578]: I0709 19:35:18.502865    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="09ef96f3-e83d-47ba-9b6b-574975643b44" containerName="maas-api"
Jul 09 19:35:18.502920 ip-10-0-139-134 kubenswrapper[2578]: I0709 19:35:18.502871    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="09ef96f3-e83d-47ba-9b6b-574975643b44" containerName="maas-api"
Jul 09 19:35:18.503071 ip-10-0-139-134 kubenswrapper[2578]: I0709 19:35:18.502928    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="09ef96f3-e83d-47ba-9b6b-574975643b44" containerName="maas-api"
Jul 09 19:35:18.503071 ip-10-0-139-134 kubenswrapper[2578]: I0709 19:35:18.502938    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="cb0e8af6-0e4b-4092-a9b5-8e4621100fce" containerName="maas-api"
Jul 09 19:35:18.507169 ip-10-0-139-134 kubenswrapper[2578]: I0709 19:35:18.507147    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-77ffac-78664b6676-x8fdh"
Jul 09 19:35:18.510370 ip-10-0-139-134 kubenswrapper[2578]: I0709 19:35:18.510348    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 09 19:35:18.510572 ip-10-0-139-134 kubenswrapper[2578]: I0709 19:35:18.510554    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"kube-root-ca.crt\""
Jul 09 19:35:18.511916 ip-10-0-139-134 kubenswrapper[2578]: I0709 19:35:18.511893    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-shared-a-77ffac-serving-cert\""
Jul 09 19:35:18.512051 ip-10-0-139-134 kubenswrapper[2578]: I0709 19:35:18.511946    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-dockercfg-9pdt2\""
Jul 09 19:35:18.518596 ip-10-0-139-134 kubenswrapper[2578]: I0709 19:35:18.518574    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-77ffac-78664b6676-x8fdh"]
Jul 09 19:35:18.536152 ip-10-0-139-134 kubenswrapper[2578]: I0709 19:35:18.536125    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/cf71e230-1c79-4a74-8326-31b721995830-maas-api-tls\") pod \"maas-api-e2e-shared-a-77ffac-78664b6676-x8fdh\" (UID: \"cf71e230-1c79-4a74-8326-31b721995830\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-77ffac-78664b6676-x8fdh"
Jul 09 19:35:18.536305 ip-10-0-139-134 kubenswrapper[2578]: I0709 19:35:18.536178    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sgm8w\" (UniqueName: \"kubernetes.io/projected/cf71e230-1c79-4a74-8326-31b721995830-kube-api-access-sgm8w\") pod \"maas-api-e2e-shared-a-77ffac-78664b6676-x8fdh\" (UID: \"cf71e230-1c79-4a74-8326-31b721995830\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-77ffac-78664b6676-x8fdh"
Jul 09 19:35:18.536305 ip-10-0-139-134 kubenswrapper[2578]: I0709 19:35:18.536244    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/cf71e230-1c79-4a74-8326-31b721995830-openshift-service-ca\") pod \"maas-api-e2e-shared-a-77ffac-78664b6676-x8fdh\" (UID: \"cf71e230-1c79-4a74-8326-31b721995830\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-77ffac-78664b6676-x8fdh"
Jul 09 19:35:18.636838 ip-10-0-139-134 kubenswrapper[2578]: I0709 19:35:18.636796    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/cf71e230-1c79-4a74-8326-31b721995830-maas-api-tls\") pod \"maas-api-e2e-shared-a-77ffac-78664b6676-x8fdh\" (UID: \"cf71e230-1c79-4a74-8326-31b721995830\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-77ffac-78664b6676-x8fdh"
Jul 09 19:35:18.636838 ip-10-0-139-134 kubenswrapper[2578]: I0709 19:35:18.636853    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sgm8w\" (UniqueName: \"kubernetes.io/projected/cf71e230-1c79-4a74-8326-31b721995830-kube-api-access-sgm8w\") pod \"maas-api-e2e-shared-a-77ffac-78664b6676-x8fdh\" (UID: \"cf71e230-1c79-4a74-8326-31b721995830\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-77ffac-78664b6676-x8fdh"
Jul 09 19:35:18.637088 ip-10-0-139-134 kubenswrapper[2578]: I0709 19:35:18.636896    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/cf71e230-1c79-4a74-8326-31b721995830-openshift-service-ca\") pod \"maas-api-e2e-shared-a-77ffac-78664b6676-x8fdh\" (UID: \"cf71e230-1c79-4a74-8326-31b721995830\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-77ffac-78664b6676-x8fdh"
Jul 09 19:35:18.637088 ip-10-0-139-134 kubenswrapper[2578]: E0709 19:35:18.636954    2578 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-shared-a-77ffac-serving-cert: secret "maas-api-e2e-shared-a-77ffac-serving-cert" not found
Jul 09 19:35:18.637088 ip-10-0-139-134 kubenswrapper[2578]: E0709 19:35:18.637068    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cf71e230-1c79-4a74-8326-31b721995830-maas-api-tls podName:cf71e230-1c79-4a74-8326-31b721995830 nodeName:}" failed. No retries permitted until 2026-07-09 19:35:19.137043686 +0000 UTC m=+2215.763094994 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/cf71e230-1c79-4a74-8326-31b721995830-maas-api-tls") pod "maas-api-e2e-shared-a-77ffac-78664b6676-x8fdh" (UID: "cf71e230-1c79-4a74-8326-31b721995830") : secret "maas-api-e2e-shared-a-77ffac-serving-cert" not found
Jul 09 19:35:18.637548 ip-10-0-139-134 kubenswrapper[2578]: I0709 19:35:18.637530    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/cf71e230-1c79-4a74-8326-31b721995830-openshift-service-ca\") pod \"maas-api-e2e-shared-a-77ffac-78664b6676-x8fdh\" (UID: \"cf71e230-1c79-4a74-8326-31b721995830\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-77ffac-78664b6676-x8fdh"
Jul 09 19:35:18.650157 ip-10-0-139-134 kubenswrapper[2578]: I0709 19:35:18.650128    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-sgm8w\" (UniqueName: \"kubernetes.io/projected/cf71e230-1c79-4a74-8326-31b721995830-kube-api-access-sgm8w\") pod \"maas-api-e2e-shared-a-77ffac-78664b6676-x8fdh\" (UID: \"cf71e230-1c79-4a74-8326-31b721995830\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-77ffac-78664b6676-x8fdh"
Jul 09 19:35:19.140532 ip-10-0-139-134 kubenswrapper[2578]: I0709 19:35:19.140492    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/cf71e230-1c79-4a74-8326-31b721995830-maas-api-tls\") pod \"maas-api-e2e-shared-a-77ffac-78664b6676-x8fdh\" (UID: \"cf71e230-1c79-4a74-8326-31b721995830\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-77ffac-78664b6676-x8fdh"
Jul 09 19:35:19.143214 ip-10-0-139-134 kubenswrapper[2578]: I0709 19:35:19.143188    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/cf71e230-1c79-4a74-8326-31b721995830-maas-api-tls\") pod \"maas-api-e2e-shared-a-77ffac-78664b6676-x8fdh\" (UID: \"cf71e230-1c79-4a74-8326-31b721995830\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-77ffac-78664b6676-x8fdh"
Jul 09 19:35:19.418442 ip-10-0-139-134 kubenswrapper[2578]: I0709 19:35:19.418399    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-77ffac-78664b6676-x8fdh"
Jul 09 19:35:19.553588 ip-10-0-139-134 kubenswrapper[2578]: I0709 19:35:19.553554    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-77ffac-78664b6676-x8fdh"]
Jul 09 19:35:19.555427 ip-10-0-139-134 kubenswrapper[2578]: W0709 19:35:19.555401    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcf71e230_1c79_4a74_8326_31b721995830.slice/crio-f729a2b6b126ce8860cee0beae22be315bb0feb9cda030a045d9b8dcb1672d6a WatchSource:0}: Error finding container f729a2b6b126ce8860cee0beae22be315bb0feb9cda030a045d9b8dcb1672d6a: Status 404 returned error can't find the container with id f729a2b6b126ce8860cee0beae22be315bb0feb9cda030a045d9b8dcb1672d6a
Jul 09 19:35:19.768241 ip-10-0-139-134 kubenswrapper[2578]: I0709 19:35:19.768157    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-77ffac-78664b6676-x8fdh" event={"ID":"cf71e230-1c79-4a74-8326-31b721995830","Type":"ContainerStarted","Data":"f729a2b6b126ce8860cee0beae22be315bb0feb9cda030a045d9b8dcb1672d6a"}
Jul 09 19:35:20.774102 ip-10-0-139-134 kubenswrapper[2578]: I0709 19:35:20.774064    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-77ffac-78664b6676-x8fdh" event={"ID":"cf71e230-1c79-4a74-8326-31b721995830","Type":"ContainerStarted","Data":"706b2dee40736b4a47f28ddbe553c2267d32f6b3d52adc8c57c29b35628f2052"}
Jul 09 19:35:20.774556 ip-10-0-139-134 kubenswrapper[2578]: I0709 19:35:20.774192    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-77ffac-78664b6676-x8fdh"
Jul 09 19:35:20.793321 ip-10-0-139-134 kubenswrapper[2578]: I0709 19:35:20.793271    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-77ffac-78664b6676-x8fdh" podStartSLOduration=2.448232189 podStartE2EDuration="2.793254717s" totalImagesPullingTime="345.022528ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 19:35:18 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 19:35:20.79226753 +0000 UTC m=+2217.418318881" watchObservedRunningTime="2026-07-09 19:35:20.793254717 +0000 UTC m=+2217.419306046"
Jul 09 19:35:26.588817 ip-10-0-139-134 kubenswrapper[2578]: I0709 19:35:26.588767    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-11fb58-56ffd5df6b-kk96k"]
Jul 09 19:35:26.594656 ip-10-0-139-134 kubenswrapper[2578]: I0709 19:35:26.594628    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-11fb58-56ffd5df6b-kk96k"
Jul 09 19:35:26.598107 ip-10-0-139-134 kubenswrapper[2578]: I0709 19:35:26.598081    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-shared-b-11fb58-serving-cert\""
Jul 09 19:35:26.604804 ip-10-0-139-134 kubenswrapper[2578]: I0709 19:35:26.604774    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-11fb58-56ffd5df6b-kk96k"]
Jul 09 19:35:26.701294 ip-10-0-139-134 kubenswrapper[2578]: I0709 19:35:26.701258    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/fa577694-86a5-4c3e-ac5c-121f3da0a572-openshift-service-ca\") pod \"maas-api-e2e-shared-b-11fb58-56ffd5df6b-kk96k\" (UID: \"fa577694-86a5-4c3e-ac5c-121f3da0a572\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-11fb58-56ffd5df6b-kk96k"
Jul 09 19:35:26.701294 ip-10-0-139-134 kubenswrapper[2578]: I0709 19:35:26.701291    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5qq7h\" (UniqueName: \"kubernetes.io/projected/fa577694-86a5-4c3e-ac5c-121f3da0a572-kube-api-access-5qq7h\") pod \"maas-api-e2e-shared-b-11fb58-56ffd5df6b-kk96k\" (UID: \"fa577694-86a5-4c3e-ac5c-121f3da0a572\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-11fb58-56ffd5df6b-kk96k"
Jul 09 19:35:26.701503 ip-10-0-139-134 kubenswrapper[2578]: I0709 19:35:26.701394    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/fa577694-86a5-4c3e-ac5c-121f3da0a572-maas-api-tls\") pod \"maas-api-e2e-shared-b-11fb58-56ffd5df6b-kk96k\" (UID: \"fa577694-86a5-4c3e-ac5c-121f3da0a572\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-11fb58-56ffd5df6b-kk96k"
Jul 09 19:35:26.785312 ip-10-0-139-134 kubenswrapper[2578]: I0709 19:35:26.785286    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-77ffac-78664b6676-x8fdh"
Jul 09 19:35:26.802273 ip-10-0-139-134 kubenswrapper[2578]: I0709 19:35:26.802245    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/fa577694-86a5-4c3e-ac5c-121f3da0a572-maas-api-tls\") pod \"maas-api-e2e-shared-b-11fb58-56ffd5df6b-kk96k\" (UID: \"fa577694-86a5-4c3e-ac5c-121f3da0a572\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-11fb58-56ffd5df6b-kk96k"
Jul 09 19:35:26.802456 ip-10-0-139-134 kubenswrapper[2578]: I0709 19:35:26.802309    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/fa577694-86a5-4c3e-ac5c-121f3da0a572-openshift-service-ca\") pod \"maas-api-e2e-shared-b-11fb58-56ffd5df6b-kk96k\" (UID: \"fa577694-86a5-4c3e-ac5c-121f3da0a572\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-11fb58-56ffd5df6b-kk96k"
Jul 09 19:35:26.802456 ip-10-0-139-134 kubenswrapper[2578]: I0709 19:35:26.802336    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5qq7h\" (UniqueName: \"kubernetes.io/projected/fa577694-86a5-4c3e-ac5c-121f3da0a572-kube-api-access-5qq7h\") pod \"maas-api-e2e-shared-b-11fb58-56ffd5df6b-kk96k\" (UID: \"fa577694-86a5-4c3e-ac5c-121f3da0a572\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-11fb58-56ffd5df6b-kk96k"
Jul 09 19:35:26.803040 ip-10-0-139-134 kubenswrapper[2578]: I0709 19:35:26.802983    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/fa577694-86a5-4c3e-ac5c-121f3da0a572-openshift-service-ca\") pod \"maas-api-e2e-shared-b-11fb58-56ffd5df6b-kk96k\" (UID: \"fa577694-86a5-4c3e-ac5c-121f3da0a572\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-11fb58-56ffd5df6b-kk96k"
Jul 09 19:35:26.805692 ip-10-0-139-134 kubenswrapper[2578]: I0709 19:35:26.805671    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/fa577694-86a5-4c3e-ac5c-121f3da0a572-maas-api-tls\") pod \"maas-api-e2e-shared-b-11fb58-56ffd5df6b-kk96k\" (UID: \"fa577694-86a5-4c3e-ac5c-121f3da0a572\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-11fb58-56ffd5df6b-kk96k"
Jul 09 19:35:26.815852 ip-10-0-139-134 kubenswrapper[2578]: I0709 19:35:26.815818    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5qq7h\" (UniqueName: \"kubernetes.io/projected/fa577694-86a5-4c3e-ac5c-121f3da0a572-kube-api-access-5qq7h\") pod \"maas-api-e2e-shared-b-11fb58-56ffd5df6b-kk96k\" (UID: \"fa577694-86a5-4c3e-ac5c-121f3da0a572\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-11fb58-56ffd5df6b-kk96k"
Jul 09 19:35:26.908491 ip-10-0-139-134 kubenswrapper[2578]: I0709 19:35:26.908458    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-11fb58-56ffd5df6b-kk96k"
Jul 09 19:35:27.044408 ip-10-0-139-134 kubenswrapper[2578]: I0709 19:35:27.044324    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-11fb58-56ffd5df6b-kk96k"]
Jul 09 19:35:27.046553 ip-10-0-139-134 kubenswrapper[2578]: W0709 19:35:27.046522    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfa577694_86a5_4c3e_ac5c_121f3da0a572.slice/crio-129bdb888a06c93d659cca2456b2d091fea36ac4fb3685cbd74ef00c27546ab0 WatchSource:0}: Error finding container 129bdb888a06c93d659cca2456b2d091fea36ac4fb3685cbd74ef00c27546ab0: Status 404 returned error can't find the container with id 129bdb888a06c93d659cca2456b2d091fea36ac4fb3685cbd74ef00c27546ab0
Jul 09 19:35:27.805235 ip-10-0-139-134 kubenswrapper[2578]: I0709 19:35:27.805154    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-11fb58-56ffd5df6b-kk96k" event={"ID":"fa577694-86a5-4c3e-ac5c-121f3da0a572","Type":"ContainerStarted","Data":"d02e39d1a28e6c26e650959004f466467c289692036389cd82ff9c900cc628ba"}
Jul 09 19:35:27.805235 ip-10-0-139-134 kubenswrapper[2578]: I0709 19:35:27.805209    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-11fb58-56ffd5df6b-kk96k" event={"ID":"fa577694-86a5-4c3e-ac5c-121f3da0a572","Type":"ContainerStarted","Data":"129bdb888a06c93d659cca2456b2d091fea36ac4fb3685cbd74ef00c27546ab0"}
Jul 09 19:35:27.805628 ip-10-0-139-134 kubenswrapper[2578]: I0709 19:35:27.805250    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-11fb58-56ffd5df6b-kk96k"
Jul 09 19:35:27.824562 ip-10-0-139-134 kubenswrapper[2578]: I0709 19:35:27.824510    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-11fb58-56ffd5df6b-kk96k" podStartSLOduration=1.447582556 podStartE2EDuration="1.824493722s" totalImagesPullingTime="376.911166ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 19:35:26 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 19:35:27.823358336 +0000 UTC m=+2224.449409694" watchObservedRunningTime="2026-07-09 19:35:27.824493722 +0000 UTC m=+2224.450545051"
Jul 09 19:35:33.815262 ip-10-0-139-134 kubenswrapper[2578]: I0709 19:35:33.815231    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-11fb58-56ffd5df6b-kk96k"
Jul 09 19:36:22.663623 ip-10-0-139-134 kubenswrapper[2578]: I0709 19:36:22.663582    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-b-11fb58/auth-test-model-11fb58-kserve-dcf9bdbf5-sk22c"]
Jul 09 19:36:22.667471 ip-10-0-139-134 kubenswrapper[2578]: I0709 19:36:22.667453    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-11fb58/auth-test-model-11fb58-kserve-dcf9bdbf5-sk22c"
Jul 09 19:36:22.672626 ip-10-0-139-134 kubenswrapper[2578]: I0709 19:36:22.672603    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-11fb58\"/\"kube-root-ca.crt\""
Jul 09 19:36:22.672626 ip-10-0-139-134 kubenswrapper[2578]: I0709 19:36:22.672612    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-11fb58\"/\"default-dockercfg-rfv8s\""
Jul 09 19:36:22.672803 ip-10-0-139-134 kubenswrapper[2578]: I0709 19:36:22.672624    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-11fb58\"/\"openshift-service-ca.crt\""
Jul 09 19:36:22.672803 ip-10-0-139-134 kubenswrapper[2578]: I0709 19:36:22.672624    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-11fb58\"/\"auth-test-model-11fb58-kserve-self-signed-certs\""
Jul 09 19:36:22.676715 ip-10-0-139-134 kubenswrapper[2578]: I0709 19:36:22.676688    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/626691de-32d6-47ab-b087-1092a9d193b3-home\") pod \"auth-test-model-11fb58-kserve-dcf9bdbf5-sk22c\" (UID: \"626691de-32d6-47ab-b087-1092a9d193b3\") " pod="ai-tenant-e2e-shared-b-11fb58/auth-test-model-11fb58-kserve-dcf9bdbf5-sk22c"
Jul 09 19:36:22.676931 ip-10-0-139-134 kubenswrapper[2578]: I0709 19:36:22.676905    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/626691de-32d6-47ab-b087-1092a9d193b3-dshm\") pod \"auth-test-model-11fb58-kserve-dcf9bdbf5-sk22c\" (UID: \"626691de-32d6-47ab-b087-1092a9d193b3\") " pod="ai-tenant-e2e-shared-b-11fb58/auth-test-model-11fb58-kserve-dcf9bdbf5-sk22c"
Jul 09 19:36:22.677037 ip-10-0-139-134 kubenswrapper[2578]: I0709 19:36:22.676959    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/626691de-32d6-47ab-b087-1092a9d193b3-tmp-dir\") pod \"auth-test-model-11fb58-kserve-dcf9bdbf5-sk22c\" (UID: \"626691de-32d6-47ab-b087-1092a9d193b3\") " pod="ai-tenant-e2e-shared-b-11fb58/auth-test-model-11fb58-kserve-dcf9bdbf5-sk22c"
Jul 09 19:36:22.677103 ip-10-0-139-134 kubenswrapper[2578]: I0709 19:36:22.677033    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sg455\" (UniqueName: \"kubernetes.io/projected/626691de-32d6-47ab-b087-1092a9d193b3-kube-api-access-sg455\") pod \"auth-test-model-11fb58-kserve-dcf9bdbf5-sk22c\" (UID: \"626691de-32d6-47ab-b087-1092a9d193b3\") " pod="ai-tenant-e2e-shared-b-11fb58/auth-test-model-11fb58-kserve-dcf9bdbf5-sk22c"
Jul 09 19:36:22.677103 ip-10-0-139-134 kubenswrapper[2578]: I0709 19:36:22.677076    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/626691de-32d6-47ab-b087-1092a9d193b3-model-cache\") pod \"auth-test-model-11fb58-kserve-dcf9bdbf5-sk22c\" (UID: \"626691de-32d6-47ab-b087-1092a9d193b3\") " pod="ai-tenant-e2e-shared-b-11fb58/auth-test-model-11fb58-kserve-dcf9bdbf5-sk22c"
Jul 09 19:36:22.677239 ip-10-0-139-134 kubenswrapper[2578]: I0709 19:36:22.677165    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/626691de-32d6-47ab-b087-1092a9d193b3-tls-certs\") pod \"auth-test-model-11fb58-kserve-dcf9bdbf5-sk22c\" (UID: \"626691de-32d6-47ab-b087-1092a9d193b3\") " pod="ai-tenant-e2e-shared-b-11fb58/auth-test-model-11fb58-kserve-dcf9bdbf5-sk22c"
Jul 09 19:36:22.677368 ip-10-0-139-134 kubenswrapper[2578]: I0709 19:36:22.677347    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-11fb58/auth-test-model-11fb58-kserve-dcf9bdbf5-sk22c"]
Jul 09 19:36:22.778050 ip-10-0-139-134 kubenswrapper[2578]: I0709 19:36:22.778007    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/626691de-32d6-47ab-b087-1092a9d193b3-home\") pod \"auth-test-model-11fb58-kserve-dcf9bdbf5-sk22c\" (UID: \"626691de-32d6-47ab-b087-1092a9d193b3\") " pod="ai-tenant-e2e-shared-b-11fb58/auth-test-model-11fb58-kserve-dcf9bdbf5-sk22c"
Jul 09 19:36:22.778050 ip-10-0-139-134 kubenswrapper[2578]: I0709 19:36:22.778049    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/626691de-32d6-47ab-b087-1092a9d193b3-dshm\") pod \"auth-test-model-11fb58-kserve-dcf9bdbf5-sk22c\" (UID: \"626691de-32d6-47ab-b087-1092a9d193b3\") " pod="ai-tenant-e2e-shared-b-11fb58/auth-test-model-11fb58-kserve-dcf9bdbf5-sk22c"
Jul 09 19:36:22.778288 ip-10-0-139-134 kubenswrapper[2578]: I0709 19:36:22.778079    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/626691de-32d6-47ab-b087-1092a9d193b3-tmp-dir\") pod \"auth-test-model-11fb58-kserve-dcf9bdbf5-sk22c\" (UID: \"626691de-32d6-47ab-b087-1092a9d193b3\") " pod="ai-tenant-e2e-shared-b-11fb58/auth-test-model-11fb58-kserve-dcf9bdbf5-sk22c"
Jul 09 19:36:22.778288 ip-10-0-139-134 kubenswrapper[2578]: I0709 19:36:22.778113    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sg455\" (UniqueName: \"kubernetes.io/projected/626691de-32d6-47ab-b087-1092a9d193b3-kube-api-access-sg455\") pod \"auth-test-model-11fb58-kserve-dcf9bdbf5-sk22c\" (UID: \"626691de-32d6-47ab-b087-1092a9d193b3\") " pod="ai-tenant-e2e-shared-b-11fb58/auth-test-model-11fb58-kserve-dcf9bdbf5-sk22c"
Jul 09 19:36:22.778288 ip-10-0-139-134 kubenswrapper[2578]: I0709 19:36:22.778149    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/626691de-32d6-47ab-b087-1092a9d193b3-model-cache\") pod \"auth-test-model-11fb58-kserve-dcf9bdbf5-sk22c\" (UID: \"626691de-32d6-47ab-b087-1092a9d193b3\") " pod="ai-tenant-e2e-shared-b-11fb58/auth-test-model-11fb58-kserve-dcf9bdbf5-sk22c"
Jul 09 19:36:22.778447 ip-10-0-139-134 kubenswrapper[2578]: I0709 19:36:22.778300    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/626691de-32d6-47ab-b087-1092a9d193b3-tls-certs\") pod \"auth-test-model-11fb58-kserve-dcf9bdbf5-sk22c\" (UID: \"626691de-32d6-47ab-b087-1092a9d193b3\") " pod="ai-tenant-e2e-shared-b-11fb58/auth-test-model-11fb58-kserve-dcf9bdbf5-sk22c"
Jul 09 19:36:22.778447 ip-10-0-139-134 kubenswrapper[2578]: I0709 19:36:22.778437    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/626691de-32d6-47ab-b087-1092a9d193b3-home\") pod \"auth-test-model-11fb58-kserve-dcf9bdbf5-sk22c\" (UID: \"626691de-32d6-47ab-b087-1092a9d193b3\") " pod="ai-tenant-e2e-shared-b-11fb58/auth-test-model-11fb58-kserve-dcf9bdbf5-sk22c"
Jul 09 19:36:22.778558 ip-10-0-139-134 kubenswrapper[2578]: I0709 19:36:22.778525    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/626691de-32d6-47ab-b087-1092a9d193b3-model-cache\") pod \"auth-test-model-11fb58-kserve-dcf9bdbf5-sk22c\" (UID: \"626691de-32d6-47ab-b087-1092a9d193b3\") " pod="ai-tenant-e2e-shared-b-11fb58/auth-test-model-11fb58-kserve-dcf9bdbf5-sk22c"
Jul 09 19:36:22.778598 ip-10-0-139-134 kubenswrapper[2578]: I0709 19:36:22.778566    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/626691de-32d6-47ab-b087-1092a9d193b3-tmp-dir\") pod \"auth-test-model-11fb58-kserve-dcf9bdbf5-sk22c\" (UID: \"626691de-32d6-47ab-b087-1092a9d193b3\") " pod="ai-tenant-e2e-shared-b-11fb58/auth-test-model-11fb58-kserve-dcf9bdbf5-sk22c"
Jul 09 19:36:22.780675 ip-10-0-139-134 kubenswrapper[2578]: I0709 19:36:22.780651    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/626691de-32d6-47ab-b087-1092a9d193b3-dshm\") pod \"auth-test-model-11fb58-kserve-dcf9bdbf5-sk22c\" (UID: \"626691de-32d6-47ab-b087-1092a9d193b3\") " pod="ai-tenant-e2e-shared-b-11fb58/auth-test-model-11fb58-kserve-dcf9bdbf5-sk22c"
Jul 09 19:36:22.780847 ip-10-0-139-134 kubenswrapper[2578]: I0709 19:36:22.780832    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/626691de-32d6-47ab-b087-1092a9d193b3-tls-certs\") pod \"auth-test-model-11fb58-kserve-dcf9bdbf5-sk22c\" (UID: \"626691de-32d6-47ab-b087-1092a9d193b3\") " pod="ai-tenant-e2e-shared-b-11fb58/auth-test-model-11fb58-kserve-dcf9bdbf5-sk22c"
Jul 09 19:36:22.786489 ip-10-0-139-134 kubenswrapper[2578]: I0709 19:36:22.786464    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-sg455\" (UniqueName: \"kubernetes.io/projected/626691de-32d6-47ab-b087-1092a9d193b3-kube-api-access-sg455\") pod \"auth-test-model-11fb58-kserve-dcf9bdbf5-sk22c\" (UID: \"626691de-32d6-47ab-b087-1092a9d193b3\") " pod="ai-tenant-e2e-shared-b-11fb58/auth-test-model-11fb58-kserve-dcf9bdbf5-sk22c"
Jul 09 19:36:22.979342 ip-10-0-139-134 kubenswrapper[2578]: I0709 19:36:22.979255    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-11fb58/auth-test-model-11fb58-kserve-dcf9bdbf5-sk22c"
Jul 09 19:36:23.111304 ip-10-0-139-134 kubenswrapper[2578]: I0709 19:36:23.111280    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-11fb58/auth-test-model-11fb58-kserve-dcf9bdbf5-sk22c"]
Jul 09 19:36:23.112985 ip-10-0-139-134 kubenswrapper[2578]: W0709 19:36:23.112961    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod626691de_32d6_47ab_b087_1092a9d193b3.slice/crio-d1cccd8c88bf292eff057a71b5baeb55f8f2a6d583f743d0b3a6b46b8e91e52a WatchSource:0}: Error finding container d1cccd8c88bf292eff057a71b5baeb55f8f2a6d583f743d0b3a6b46b8e91e52a: Status 404 returned error can't find the container with id d1cccd8c88bf292eff057a71b5baeb55f8f2a6d583f743d0b3a6b46b8e91e52a
Jul 09 19:36:24.045314 ip-10-0-139-134 kubenswrapper[2578]: I0709 19:36:24.045270    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-11fb58/auth-test-model-11fb58-kserve-dcf9bdbf5-sk22c" event={"ID":"626691de-32d6-47ab-b087-1092a9d193b3","Type":"ContainerStarted","Data":"1d34097bd84882093496da90d1ef51be7b3bf4d7fdad545cedcae6e7b64bb164"}
Jul 09 19:36:24.045314 ip-10-0-139-134 kubenswrapper[2578]: I0709 19:36:24.045317    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-11fb58/auth-test-model-11fb58-kserve-dcf9bdbf5-sk22c" event={"ID":"626691de-32d6-47ab-b087-1092a9d193b3","Type":"ContainerStarted","Data":"d1cccd8c88bf292eff057a71b5baeb55f8f2a6d583f743d0b3a6b46b8e91e52a"}
Jul 09 19:36:24.065191 ip-10-0-139-134 kubenswrapper[2578]: I0709 19:36:24.065127    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-b-11fb58/auth-test-model-11fb58-kserve-dcf9bdbf5-sk22c" podStartSLOduration=2.065106672 podStartE2EDuration="2.065106672s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 19:36:22 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 19:36:24.063101716 +0000 UTC m=+2280.689153047" watchObservedRunningTime="2026-07-09 19:36:24.065106672 +0000 UTC m=+2280.691158004"
Jul 09 19:36:32.980085 ip-10-0-139-134 kubenswrapper[2578]: I0709 19:36:32.980045    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-b-11fb58/auth-test-model-11fb58-kserve-dcf9bdbf5-sk22c"
Jul 09 19:36:32.980085 ip-10-0-139-134 kubenswrapper[2578]: I0709 19:36:32.980092    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-b-11fb58/auth-test-model-11fb58-kserve-dcf9bdbf5-sk22c"
Jul 09 19:36:32.992947 ip-10-0-139-134 kubenswrapper[2578]: I0709 19:36:32.992916    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-b-11fb58/auth-test-model-11fb58-kserve-dcf9bdbf5-sk22c"
Jul 09 19:36:33.104932 ip-10-0-139-134 kubenswrapper[2578]: I0709 19:36:33.104904    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-b-11fb58/auth-test-model-11fb58-kserve-dcf9bdbf5-sk22c"
Jul 09 19:38:23.241784 ip-10-0-139-134 kubenswrapper[2578]: I0709 19:38:23.241747    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-11fb58/auth-test-model-11fb58-kserve-dcf9bdbf5-sk22c"]
Jul 09 19:38:23.942154 ip-10-0-139-134 kubenswrapper[2578]: I0709 19:38:23.942127    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-8gqbs_7a15b7a9-7525-426b-a051-3ece178b71bc/ovn-acl-logging/0.log"
Jul 09 19:38:23.944024 ip-10-0-139-134 kubenswrapper[2578]: I0709 19:38:23.943977    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-8gqbs_7a15b7a9-7525-426b-a051-3ece178b71bc/ovn-acl-logging/0.log"
Jul 09 19:38:30.053536 ip-10-0-139-134 kubenswrapper[2578]: I0709 19:38:30.053500    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-a-77ffac/sub-test-model-77ffac-kserve-68598cbcf-99bvj"]
Jul 09 19:38:30.056701 ip-10-0-139-134 kubenswrapper[2578]: I0709 19:38:30.056682    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-77ffac/sub-test-model-77ffac-kserve-68598cbcf-99bvj"
Jul 09 19:38:30.059975 ip-10-0-139-134 kubenswrapper[2578]: I0709 19:38:30.059948    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-a-77ffac\"/\"openshift-service-ca.crt\""
Jul 09 19:38:30.060106 ip-10-0-139-134 kubenswrapper[2578]: I0709 19:38:30.060065    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-a-77ffac\"/\"default-dockercfg-l2hg6\""
Jul 09 19:38:30.061517 ip-10-0-139-134 kubenswrapper[2578]: I0709 19:38:30.061494    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-a-77ffac\"/\"kube-root-ca.crt\""
Jul 09 19:38:30.061631 ip-10-0-139-134 kubenswrapper[2578]: I0709 19:38:30.061500    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-a-77ffac\"/\"sub-test-model-77ffac-kserve-self-signed-certs\""
Jul 09 19:38:30.066980 ip-10-0-139-134 kubenswrapper[2578]: I0709 19:38:30.066960    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-77ffac/sub-test-model-77ffac-kserve-68598cbcf-99bvj"]
Jul 09 19:38:30.178537 ip-10-0-139-134 kubenswrapper[2578]: I0709 19:38:30.178506    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/ee9f7a87-ba28-40a6-a7ed-c1d8d8a5f11e-home\") pod \"sub-test-model-77ffac-kserve-68598cbcf-99bvj\" (UID: \"ee9f7a87-ba28-40a6-a7ed-c1d8d8a5f11e\") " pod="ai-tenant-e2e-shared-a-77ffac/sub-test-model-77ffac-kserve-68598cbcf-99bvj"
Jul 09 19:38:30.178702 ip-10-0-139-134 kubenswrapper[2578]: I0709 19:38:30.178553    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ee9f7a87-ba28-40a6-a7ed-c1d8d8a5f11e-tmp-dir\") pod \"sub-test-model-77ffac-kserve-68598cbcf-99bvj\" (UID: \"ee9f7a87-ba28-40a6-a7ed-c1d8d8a5f11e\") " pod="ai-tenant-e2e-shared-a-77ffac/sub-test-model-77ffac-kserve-68598cbcf-99bvj"
Jul 09 19:38:30.178702 ip-10-0-139-134 kubenswrapper[2578]: I0709 19:38:30.178641    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/ee9f7a87-ba28-40a6-a7ed-c1d8d8a5f11e-dshm\") pod \"sub-test-model-77ffac-kserve-68598cbcf-99bvj\" (UID: \"ee9f7a87-ba28-40a6-a7ed-c1d8d8a5f11e\") " pod="ai-tenant-e2e-shared-a-77ffac/sub-test-model-77ffac-kserve-68598cbcf-99bvj"
Jul 09 19:38:30.178702 ip-10-0-139-134 kubenswrapper[2578]: I0709 19:38:30.178671    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/ee9f7a87-ba28-40a6-a7ed-c1d8d8a5f11e-model-cache\") pod \"sub-test-model-77ffac-kserve-68598cbcf-99bvj\" (UID: \"ee9f7a87-ba28-40a6-a7ed-c1d8d8a5f11e\") " pod="ai-tenant-e2e-shared-a-77ffac/sub-test-model-77ffac-kserve-68598cbcf-99bvj"
Jul 09 19:38:30.178702 ip-10-0-139-134 kubenswrapper[2578]: I0709 19:38:30.178693    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/ee9f7a87-ba28-40a6-a7ed-c1d8d8a5f11e-tls-certs\") pod \"sub-test-model-77ffac-kserve-68598cbcf-99bvj\" (UID: \"ee9f7a87-ba28-40a6-a7ed-c1d8d8a5f11e\") " pod="ai-tenant-e2e-shared-a-77ffac/sub-test-model-77ffac-kserve-68598cbcf-99bvj"
Jul 09 19:38:30.178853 ip-10-0-139-134 kubenswrapper[2578]: I0709 19:38:30.178748    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-r8kfk\" (UniqueName: \"kubernetes.io/projected/ee9f7a87-ba28-40a6-a7ed-c1d8d8a5f11e-kube-api-access-r8kfk\") pod \"sub-test-model-77ffac-kserve-68598cbcf-99bvj\" (UID: \"ee9f7a87-ba28-40a6-a7ed-c1d8d8a5f11e\") " pod="ai-tenant-e2e-shared-a-77ffac/sub-test-model-77ffac-kserve-68598cbcf-99bvj"
Jul 09 19:38:30.279428 ip-10-0-139-134 kubenswrapper[2578]: I0709 19:38:30.279394    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/ee9f7a87-ba28-40a6-a7ed-c1d8d8a5f11e-dshm\") pod \"sub-test-model-77ffac-kserve-68598cbcf-99bvj\" (UID: \"ee9f7a87-ba28-40a6-a7ed-c1d8d8a5f11e\") " pod="ai-tenant-e2e-shared-a-77ffac/sub-test-model-77ffac-kserve-68598cbcf-99bvj"
Jul 09 19:38:30.279428 ip-10-0-139-134 kubenswrapper[2578]: I0709 19:38:30.279426    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/ee9f7a87-ba28-40a6-a7ed-c1d8d8a5f11e-model-cache\") pod \"sub-test-model-77ffac-kserve-68598cbcf-99bvj\" (UID: \"ee9f7a87-ba28-40a6-a7ed-c1d8d8a5f11e\") " pod="ai-tenant-e2e-shared-a-77ffac/sub-test-model-77ffac-kserve-68598cbcf-99bvj"
Jul 09 19:38:30.279640 ip-10-0-139-134 kubenswrapper[2578]: I0709 19:38:30.279446    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/ee9f7a87-ba28-40a6-a7ed-c1d8d8a5f11e-tls-certs\") pod \"sub-test-model-77ffac-kserve-68598cbcf-99bvj\" (UID: \"ee9f7a87-ba28-40a6-a7ed-c1d8d8a5f11e\") " pod="ai-tenant-e2e-shared-a-77ffac/sub-test-model-77ffac-kserve-68598cbcf-99bvj"
Jul 09 19:38:30.279640 ip-10-0-139-134 kubenswrapper[2578]: I0709 19:38:30.279558    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-r8kfk\" (UniqueName: \"kubernetes.io/projected/ee9f7a87-ba28-40a6-a7ed-c1d8d8a5f11e-kube-api-access-r8kfk\") pod \"sub-test-model-77ffac-kserve-68598cbcf-99bvj\" (UID: \"ee9f7a87-ba28-40a6-a7ed-c1d8d8a5f11e\") " pod="ai-tenant-e2e-shared-a-77ffac/sub-test-model-77ffac-kserve-68598cbcf-99bvj"
Jul 09 19:38:30.279640 ip-10-0-139-134 kubenswrapper[2578]: I0709 19:38:30.279633    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/ee9f7a87-ba28-40a6-a7ed-c1d8d8a5f11e-home\") pod \"sub-test-model-77ffac-kserve-68598cbcf-99bvj\" (UID: \"ee9f7a87-ba28-40a6-a7ed-c1d8d8a5f11e\") " pod="ai-tenant-e2e-shared-a-77ffac/sub-test-model-77ffac-kserve-68598cbcf-99bvj"
Jul 09 19:38:30.279786 ip-10-0-139-134 kubenswrapper[2578]: I0709 19:38:30.279713    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ee9f7a87-ba28-40a6-a7ed-c1d8d8a5f11e-tmp-dir\") pod \"sub-test-model-77ffac-kserve-68598cbcf-99bvj\" (UID: \"ee9f7a87-ba28-40a6-a7ed-c1d8d8a5f11e\") " pod="ai-tenant-e2e-shared-a-77ffac/sub-test-model-77ffac-kserve-68598cbcf-99bvj"
Jul 09 19:38:30.279844 ip-10-0-139-134 kubenswrapper[2578]: I0709 19:38:30.279819    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/ee9f7a87-ba28-40a6-a7ed-c1d8d8a5f11e-model-cache\") pod \"sub-test-model-77ffac-kserve-68598cbcf-99bvj\" (UID: \"ee9f7a87-ba28-40a6-a7ed-c1d8d8a5f11e\") " pod="ai-tenant-e2e-shared-a-77ffac/sub-test-model-77ffac-kserve-68598cbcf-99bvj"
Jul 09 19:38:30.280025 ip-10-0-139-134 kubenswrapper[2578]: I0709 19:38:30.279984    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/ee9f7a87-ba28-40a6-a7ed-c1d8d8a5f11e-home\") pod \"sub-test-model-77ffac-kserve-68598cbcf-99bvj\" (UID: \"ee9f7a87-ba28-40a6-a7ed-c1d8d8a5f11e\") " pod="ai-tenant-e2e-shared-a-77ffac/sub-test-model-77ffac-kserve-68598cbcf-99bvj"
Jul 09 19:38:30.280134 ip-10-0-139-134 kubenswrapper[2578]: I0709 19:38:30.280112    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ee9f7a87-ba28-40a6-a7ed-c1d8d8a5f11e-tmp-dir\") pod \"sub-test-model-77ffac-kserve-68598cbcf-99bvj\" (UID: \"ee9f7a87-ba28-40a6-a7ed-c1d8d8a5f11e\") " pod="ai-tenant-e2e-shared-a-77ffac/sub-test-model-77ffac-kserve-68598cbcf-99bvj"
Jul 09 19:38:30.281897 ip-10-0-139-134 kubenswrapper[2578]: I0709 19:38:30.281874    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/ee9f7a87-ba28-40a6-a7ed-c1d8d8a5f11e-dshm\") pod \"sub-test-model-77ffac-kserve-68598cbcf-99bvj\" (UID: \"ee9f7a87-ba28-40a6-a7ed-c1d8d8a5f11e\") " pod="ai-tenant-e2e-shared-a-77ffac/sub-test-model-77ffac-kserve-68598cbcf-99bvj"
Jul 09 19:38:30.282021 ip-10-0-139-134 kubenswrapper[2578]: I0709 19:38:30.281986    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/ee9f7a87-ba28-40a6-a7ed-c1d8d8a5f11e-tls-certs\") pod \"sub-test-model-77ffac-kserve-68598cbcf-99bvj\" (UID: \"ee9f7a87-ba28-40a6-a7ed-c1d8d8a5f11e\") " pod="ai-tenant-e2e-shared-a-77ffac/sub-test-model-77ffac-kserve-68598cbcf-99bvj"
Jul 09 19:38:30.288511 ip-10-0-139-134 kubenswrapper[2578]: I0709 19:38:30.288489    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-r8kfk\" (UniqueName: \"kubernetes.io/projected/ee9f7a87-ba28-40a6-a7ed-c1d8d8a5f11e-kube-api-access-r8kfk\") pod \"sub-test-model-77ffac-kserve-68598cbcf-99bvj\" (UID: \"ee9f7a87-ba28-40a6-a7ed-c1d8d8a5f11e\") " pod="ai-tenant-e2e-shared-a-77ffac/sub-test-model-77ffac-kserve-68598cbcf-99bvj"
Jul 09 19:38:30.367233 ip-10-0-139-134 kubenswrapper[2578]: I0709 19:38:30.367159    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-77ffac/sub-test-model-77ffac-kserve-68598cbcf-99bvj"
Jul 09 19:38:30.496891 ip-10-0-139-134 kubenswrapper[2578]: I0709 19:38:30.496855    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-77ffac/sub-test-model-77ffac-kserve-68598cbcf-99bvj"]
Jul 09 19:38:30.499784 ip-10-0-139-134 kubenswrapper[2578]: W0709 19:38:30.499751    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podee9f7a87_ba28_40a6_a7ed_c1d8d8a5f11e.slice/crio-883741694d698e742c69a761f2e21bdf620c7438ef9de79776f913a66e48c3c5 WatchSource:0}: Error finding container 883741694d698e742c69a761f2e21bdf620c7438ef9de79776f913a66e48c3c5: Status 404 returned error can't find the container with id 883741694d698e742c69a761f2e21bdf620c7438ef9de79776f913a66e48c3c5
Jul 09 19:38:30.602061 ip-10-0-139-134 kubenswrapper[2578]: I0709 19:38:30.601969    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-77ffac/sub-test-model-77ffac-kserve-68598cbcf-99bvj" event={"ID":"ee9f7a87-ba28-40a6-a7ed-c1d8d8a5f11e","Type":"ContainerStarted","Data":"557fd27c9520323e0e6a768ccc6395cf9643fd3fdf23d06dace8bc129160a6c6"}
Jul 09 19:38:30.602216 ip-10-0-139-134 kubenswrapper[2578]: I0709 19:38:30.602074    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-77ffac/sub-test-model-77ffac-kserve-68598cbcf-99bvj" event={"ID":"ee9f7a87-ba28-40a6-a7ed-c1d8d8a5f11e","Type":"ContainerStarted","Data":"883741694d698e742c69a761f2e21bdf620c7438ef9de79776f913a66e48c3c5"}
Jul 09 19:38:30.621046 ip-10-0-139-134 kubenswrapper[2578]: I0709 19:38:30.620903    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-a-77ffac/sub-test-model-77ffac-kserve-68598cbcf-99bvj" podStartSLOduration=0.620888012 podStartE2EDuration="620.888012ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 19:38:30 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 19:38:30.620065867 +0000 UTC m=+2407.246117202" watchObservedRunningTime="2026-07-09 19:38:30.620888012 +0000 UTC m=+2407.246939342"
Jul 09 19:38:38.262603 ip-10-0-139-134 kubenswrapper[2578]: I0709 19:38:38.262544    2578 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-shared-b-11fb58/auth-test-model-11fb58-kserve-dcf9bdbf5-sk22c" podUID="626691de-32d6-47ab-b087-1092a9d193b3" containerName="main" containerID="cri-o://1d34097bd84882093496da90d1ef51be7b3bf4d7fdad545cedcae6e7b64bb164" gracePeriod=45
Jul 09 19:38:38.502395 ip-10-0-139-134 kubenswrapper[2578]: I0709 19:38:38.502368    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-11fb58/auth-test-model-11fb58-kserve-dcf9bdbf5-sk22c"
Jul 09 19:38:38.638876 ip-10-0-139-134 kubenswrapper[2578]: I0709 19:38:38.638789    2578 generic.go:356] "Generic (PLEG): container finished" podID="626691de-32d6-47ab-b087-1092a9d193b3" containerID="1d34097bd84882093496da90d1ef51be7b3bf4d7fdad545cedcae6e7b64bb164" exitCode=0
Jul 09 19:38:38.638876 ip-10-0-139-134 kubenswrapper[2578]: I0709 19:38:38.638837    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-11fb58/auth-test-model-11fb58-kserve-dcf9bdbf5-sk22c"
Jul 09 19:38:38.639065 ip-10-0-139-134 kubenswrapper[2578]: I0709 19:38:38.638872    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-11fb58/auth-test-model-11fb58-kserve-dcf9bdbf5-sk22c" event={"ID":"626691de-32d6-47ab-b087-1092a9d193b3","Type":"ContainerDied","Data":"1d34097bd84882093496da90d1ef51be7b3bf4d7fdad545cedcae6e7b64bb164"}
Jul 09 19:38:38.639065 ip-10-0-139-134 kubenswrapper[2578]: I0709 19:38:38.638926    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-11fb58/auth-test-model-11fb58-kserve-dcf9bdbf5-sk22c" event={"ID":"626691de-32d6-47ab-b087-1092a9d193b3","Type":"ContainerDied","Data":"d1cccd8c88bf292eff057a71b5baeb55f8f2a6d583f743d0b3a6b46b8e91e52a"}
Jul 09 19:38:38.639065 ip-10-0-139-134 kubenswrapper[2578]: I0709 19:38:38.638947    2578 scope.go:117] "RemoveContainer" containerID="1d34097bd84882093496da90d1ef51be7b3bf4d7fdad545cedcae6e7b64bb164"
Jul 09 19:38:38.647479 ip-10-0-139-134 kubenswrapper[2578]: I0709 19:38:38.647461    2578 scope.go:117] "RemoveContainer" containerID="1d34097bd84882093496da90d1ef51be7b3bf4d7fdad545cedcae6e7b64bb164"
Jul 09 19:38:38.647739 ip-10-0-139-134 kubenswrapper[2578]: E0709 19:38:38.647719    2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1d34097bd84882093496da90d1ef51be7b3bf4d7fdad545cedcae6e7b64bb164\": container with ID starting with 1d34097bd84882093496da90d1ef51be7b3bf4d7fdad545cedcae6e7b64bb164 not found: ID does not exist" containerID="1d34097bd84882093496da90d1ef51be7b3bf4d7fdad545cedcae6e7b64bb164"
Jul 09 19:38:38.647790 ip-10-0-139-134 kubenswrapper[2578]: I0709 19:38:38.647749    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1d34097bd84882093496da90d1ef51be7b3bf4d7fdad545cedcae6e7b64bb164"} err="failed to get container status \"1d34097bd84882093496da90d1ef51be7b3bf4d7fdad545cedcae6e7b64bb164\": rpc error: code = NotFound desc = could not find container \"1d34097bd84882093496da90d1ef51be7b3bf4d7fdad545cedcae6e7b64bb164\": container with ID starting with 1d34097bd84882093496da90d1ef51be7b3bf4d7fdad545cedcae6e7b64bb164 not found: ID does not exist"
Jul 09 19:38:38.650973 ip-10-0-139-134 kubenswrapper[2578]: I0709 19:38:38.650956    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/626691de-32d6-47ab-b087-1092a9d193b3-home\") pod \"626691de-32d6-47ab-b087-1092a9d193b3\" (UID: \"626691de-32d6-47ab-b087-1092a9d193b3\") "
Jul 09 19:38:38.651049 ip-10-0-139-134 kubenswrapper[2578]: I0709 19:38:38.650980    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/626691de-32d6-47ab-b087-1092a9d193b3-dshm\") pod \"626691de-32d6-47ab-b087-1092a9d193b3\" (UID: \"626691de-32d6-47ab-b087-1092a9d193b3\") "
Jul 09 19:38:38.651049 ip-10-0-139-134 kubenswrapper[2578]: I0709 19:38:38.651032    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/626691de-32d6-47ab-b087-1092a9d193b3-tls-certs\") pod \"626691de-32d6-47ab-b087-1092a9d193b3\" (UID: \"626691de-32d6-47ab-b087-1092a9d193b3\") "
Jul 09 19:38:38.651159 ip-10-0-139-134 kubenswrapper[2578]: I0709 19:38:38.651064    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/626691de-32d6-47ab-b087-1092a9d193b3-model-cache\") pod \"626691de-32d6-47ab-b087-1092a9d193b3\" (UID: \"626691de-32d6-47ab-b087-1092a9d193b3\") "
Jul 09 19:38:38.651159 ip-10-0-139-134 kubenswrapper[2578]: I0709 19:38:38.651092    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-sg455\" (UniqueName: \"kubernetes.io/projected/626691de-32d6-47ab-b087-1092a9d193b3-kube-api-access-sg455\") pod \"626691de-32d6-47ab-b087-1092a9d193b3\" (UID: \"626691de-32d6-47ab-b087-1092a9d193b3\") "
Jul 09 19:38:38.651159 ip-10-0-139-134 kubenswrapper[2578]: I0709 19:38:38.651115    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/626691de-32d6-47ab-b087-1092a9d193b3-tmp-dir\") pod \"626691de-32d6-47ab-b087-1092a9d193b3\" (UID: \"626691de-32d6-47ab-b087-1092a9d193b3\") "
Jul 09 19:38:38.651306 ip-10-0-139-134 kubenswrapper[2578]: I0709 19:38:38.651213    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/626691de-32d6-47ab-b087-1092a9d193b3-home" (OuterVolumeSpecName: "home") pod "626691de-32d6-47ab-b087-1092a9d193b3" (UID: "626691de-32d6-47ab-b087-1092a9d193b3"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 09 19:38:38.651365 ip-10-0-139-134 kubenswrapper[2578]: I0709 19:38:38.651340    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/626691de-32d6-47ab-b087-1092a9d193b3-model-cache" (OuterVolumeSpecName: "model-cache") pod "626691de-32d6-47ab-b087-1092a9d193b3" (UID: "626691de-32d6-47ab-b087-1092a9d193b3"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 09 19:38:38.651444 ip-10-0-139-134 kubenswrapper[2578]: I0709 19:38:38.651422    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/626691de-32d6-47ab-b087-1092a9d193b3-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "626691de-32d6-47ab-b087-1092a9d193b3" (UID: "626691de-32d6-47ab-b087-1092a9d193b3"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 09 19:38:38.651511 ip-10-0-139-134 kubenswrapper[2578]: I0709 19:38:38.651453    2578 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/626691de-32d6-47ab-b087-1092a9d193b3-home\") on node \"ip-10-0-139-134.ec2.internal\" DevicePath \"\""
Jul 09 19:38:38.651511 ip-10-0-139-134 kubenswrapper[2578]: I0709 19:38:38.651472    2578 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/626691de-32d6-47ab-b087-1092a9d193b3-model-cache\") on node \"ip-10-0-139-134.ec2.internal\" DevicePath \"\""
Jul 09 19:38:38.653385 ip-10-0-139-134 kubenswrapper[2578]: I0709 19:38:38.653364    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/626691de-32d6-47ab-b087-1092a9d193b3-dshm" (OuterVolumeSpecName: "dshm") pod "626691de-32d6-47ab-b087-1092a9d193b3" (UID: "626691de-32d6-47ab-b087-1092a9d193b3"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 09 19:38:38.653385 ip-10-0-139-134 kubenswrapper[2578]: I0709 19:38:38.653371    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/626691de-32d6-47ab-b087-1092a9d193b3-kube-api-access-sg455" (OuterVolumeSpecName: "kube-api-access-sg455") pod "626691de-32d6-47ab-b087-1092a9d193b3" (UID: "626691de-32d6-47ab-b087-1092a9d193b3"). InnerVolumeSpecName "kube-api-access-sg455". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 09 19:38:38.653514 ip-10-0-139-134 kubenswrapper[2578]: I0709 19:38:38.653406    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/626691de-32d6-47ab-b087-1092a9d193b3-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "626691de-32d6-47ab-b087-1092a9d193b3" (UID: "626691de-32d6-47ab-b087-1092a9d193b3"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 09 19:38:38.754429 ip-10-0-139-134 kubenswrapper[2578]: I0709 19:38:38.754389    2578 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/626691de-32d6-47ab-b087-1092a9d193b3-dshm\") on node \"ip-10-0-139-134.ec2.internal\" DevicePath \"\""
Jul 09 19:38:38.754429 ip-10-0-139-134 kubenswrapper[2578]: I0709 19:38:38.754425    2578 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/626691de-32d6-47ab-b087-1092a9d193b3-tls-certs\") on node \"ip-10-0-139-134.ec2.internal\" DevicePath \"\""
Jul 09 19:38:38.754429 ip-10-0-139-134 kubenswrapper[2578]: I0709 19:38:38.754437    2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-sg455\" (UniqueName: \"kubernetes.io/projected/626691de-32d6-47ab-b087-1092a9d193b3-kube-api-access-sg455\") on node \"ip-10-0-139-134.ec2.internal\" DevicePath \"\""
Jul 09 19:38:38.754684 ip-10-0-139-134 kubenswrapper[2578]: I0709 19:38:38.754446    2578 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/626691de-32d6-47ab-b087-1092a9d193b3-tmp-dir\") on node \"ip-10-0-139-134.ec2.internal\" DevicePath \"\""
Jul 09 19:38:38.961663 ip-10-0-139-134 kubenswrapper[2578]: I0709 19:38:38.961637    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-11fb58/auth-test-model-11fb58-kserve-dcf9bdbf5-sk22c"]
Jul 09 19:38:38.965134 ip-10-0-139-134 kubenswrapper[2578]: I0709 19:38:38.965109    2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-b-11fb58/auth-test-model-11fb58-kserve-dcf9bdbf5-sk22c"]
Jul 09 19:38:39.837866 ip-10-0-139-134 kubenswrapper[2578]: I0709 19:38:39.837833    2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="626691de-32d6-47ab-b087-1092a9d193b3" path="/var/lib/kubelet/pods/626691de-32d6-47ab-b087-1092a9d193b3/volumes"
Jul 09 19:38:40.367643 ip-10-0-139-134 kubenswrapper[2578]: I0709 19:38:40.367610    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-a-77ffac/sub-test-model-77ffac-kserve-68598cbcf-99bvj"
Jul 09 19:38:40.367808 ip-10-0-139-134 kubenswrapper[2578]: I0709 19:38:40.367658    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-a-77ffac/sub-test-model-77ffac-kserve-68598cbcf-99bvj"
Jul 09 19:38:40.379701 ip-10-0-139-134 kubenswrapper[2578]: I0709 19:38:40.379677    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-a-77ffac/sub-test-model-77ffac-kserve-68598cbcf-99bvj"
Jul 09 19:38:40.660234 ip-10-0-139-134 kubenswrapper[2578]: I0709 19:38:40.660205    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-a-77ffac/sub-test-model-77ffac-kserve-68598cbcf-99bvj"
Jul 09 19:39:44.453316 ip-10-0-139-134 kubenswrapper[2578]: I0709 19:39:44.453284    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-77ffac/sub-test-model-77ffac-kserve-68598cbcf-99bvj"]
Jul 09 19:39:59.473799 ip-10-0-139-134 kubenswrapper[2578]: I0709 19:39:59.473758    2578 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-shared-a-77ffac/sub-test-model-77ffac-kserve-68598cbcf-99bvj" podUID="ee9f7a87-ba28-40a6-a7ed-c1d8d8a5f11e" containerName="main" containerID="cri-o://557fd27c9520323e0e6a768ccc6395cf9643fd3fdf23d06dace8bc129160a6c6" gracePeriod=45
Jul 09 19:39:59.726483 ip-10-0-139-134 kubenswrapper[2578]: I0709 19:39:59.726422    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-77ffac/sub-test-model-77ffac-kserve-68598cbcf-99bvj"
Jul 09 19:39:59.850097 ip-10-0-139-134 kubenswrapper[2578]: I0709 19:39:59.850070    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/ee9f7a87-ba28-40a6-a7ed-c1d8d8a5f11e-model-cache\") pod \"ee9f7a87-ba28-40a6-a7ed-c1d8d8a5f11e\" (UID: \"ee9f7a87-ba28-40a6-a7ed-c1d8d8a5f11e\") "
Jul 09 19:39:59.850256 ip-10-0-139-134 kubenswrapper[2578]: I0709 19:39:59.850143    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ee9f7a87-ba28-40a6-a7ed-c1d8d8a5f11e-tmp-dir\") pod \"ee9f7a87-ba28-40a6-a7ed-c1d8d8a5f11e\" (UID: \"ee9f7a87-ba28-40a6-a7ed-c1d8d8a5f11e\") "
Jul 09 19:39:59.850256 ip-10-0-139-134 kubenswrapper[2578]: I0709 19:39:59.850169    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-r8kfk\" (UniqueName: \"kubernetes.io/projected/ee9f7a87-ba28-40a6-a7ed-c1d8d8a5f11e-kube-api-access-r8kfk\") pod \"ee9f7a87-ba28-40a6-a7ed-c1d8d8a5f11e\" (UID: \"ee9f7a87-ba28-40a6-a7ed-c1d8d8a5f11e\") "
Jul 09 19:39:59.850256 ip-10-0-139-134 kubenswrapper[2578]: I0709 19:39:59.850232    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/ee9f7a87-ba28-40a6-a7ed-c1d8d8a5f11e-home\") pod \"ee9f7a87-ba28-40a6-a7ed-c1d8d8a5f11e\" (UID: \"ee9f7a87-ba28-40a6-a7ed-c1d8d8a5f11e\") "
Jul 09 19:39:59.850406 ip-10-0-139-134 kubenswrapper[2578]: I0709 19:39:59.850275    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/ee9f7a87-ba28-40a6-a7ed-c1d8d8a5f11e-dshm\") pod \"ee9f7a87-ba28-40a6-a7ed-c1d8d8a5f11e\" (UID: \"ee9f7a87-ba28-40a6-a7ed-c1d8d8a5f11e\") "
Jul 09 19:39:59.850406 ip-10-0-139-134 kubenswrapper[2578]: I0709 19:39:59.850298    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/ee9f7a87-ba28-40a6-a7ed-c1d8d8a5f11e-tls-certs\") pod \"ee9f7a87-ba28-40a6-a7ed-c1d8d8a5f11e\" (UID: \"ee9f7a87-ba28-40a6-a7ed-c1d8d8a5f11e\") "
Jul 09 19:39:59.850406 ip-10-0-139-134 kubenswrapper[2578]: I0709 19:39:59.850360    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ee9f7a87-ba28-40a6-a7ed-c1d8d8a5f11e-model-cache" (OuterVolumeSpecName: "model-cache") pod "ee9f7a87-ba28-40a6-a7ed-c1d8d8a5f11e" (UID: "ee9f7a87-ba28-40a6-a7ed-c1d8d8a5f11e"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 09 19:39:59.850406 ip-10-0-139-134 kubenswrapper[2578]: I0709 19:39:59.850386    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ee9f7a87-ba28-40a6-a7ed-c1d8d8a5f11e-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "ee9f7a87-ba28-40a6-a7ed-c1d8d8a5f11e" (UID: "ee9f7a87-ba28-40a6-a7ed-c1d8d8a5f11e"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 09 19:39:59.850598 ip-10-0-139-134 kubenswrapper[2578]: I0709 19:39:59.850515    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ee9f7a87-ba28-40a6-a7ed-c1d8d8a5f11e-home" (OuterVolumeSpecName: "home") pod "ee9f7a87-ba28-40a6-a7ed-c1d8d8a5f11e" (UID: "ee9f7a87-ba28-40a6-a7ed-c1d8d8a5f11e"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 09 19:39:59.850598 ip-10-0-139-134 kubenswrapper[2578]: I0709 19:39:59.850530    2578 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/ee9f7a87-ba28-40a6-a7ed-c1d8d8a5f11e-model-cache\") on node \"ip-10-0-139-134.ec2.internal\" DevicePath \"\""
Jul 09 19:39:59.850598 ip-10-0-139-134 kubenswrapper[2578]: I0709 19:39:59.850565    2578 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ee9f7a87-ba28-40a6-a7ed-c1d8d8a5f11e-tmp-dir\") on node \"ip-10-0-139-134.ec2.internal\" DevicePath \"\""
Jul 09 19:39:59.852610 ip-10-0-139-134 kubenswrapper[2578]: I0709 19:39:59.852588    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ee9f7a87-ba28-40a6-a7ed-c1d8d8a5f11e-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "ee9f7a87-ba28-40a6-a7ed-c1d8d8a5f11e" (UID: "ee9f7a87-ba28-40a6-a7ed-c1d8d8a5f11e"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 09 19:39:59.852707 ip-10-0-139-134 kubenswrapper[2578]: I0709 19:39:59.852609    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ee9f7a87-ba28-40a6-a7ed-c1d8d8a5f11e-dshm" (OuterVolumeSpecName: "dshm") pod "ee9f7a87-ba28-40a6-a7ed-c1d8d8a5f11e" (UID: "ee9f7a87-ba28-40a6-a7ed-c1d8d8a5f11e"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 09 19:39:59.852707 ip-10-0-139-134 kubenswrapper[2578]: I0709 19:39:59.852628    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ee9f7a87-ba28-40a6-a7ed-c1d8d8a5f11e-kube-api-access-r8kfk" (OuterVolumeSpecName: "kube-api-access-r8kfk") pod "ee9f7a87-ba28-40a6-a7ed-c1d8d8a5f11e" (UID: "ee9f7a87-ba28-40a6-a7ed-c1d8d8a5f11e"). InnerVolumeSpecName "kube-api-access-r8kfk". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 09 19:39:59.951782 ip-10-0-139-134 kubenswrapper[2578]: I0709 19:39:59.951748    2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-r8kfk\" (UniqueName: \"kubernetes.io/projected/ee9f7a87-ba28-40a6-a7ed-c1d8d8a5f11e-kube-api-access-r8kfk\") on node \"ip-10-0-139-134.ec2.internal\" DevicePath \"\""
Jul 09 19:39:59.951782 ip-10-0-139-134 kubenswrapper[2578]: I0709 19:39:59.951775    2578 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/ee9f7a87-ba28-40a6-a7ed-c1d8d8a5f11e-home\") on node \"ip-10-0-139-134.ec2.internal\" DevicePath \"\""
Jul 09 19:39:59.951782 ip-10-0-139-134 kubenswrapper[2578]: I0709 19:39:59.951785    2578 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/ee9f7a87-ba28-40a6-a7ed-c1d8d8a5f11e-dshm\") on node \"ip-10-0-139-134.ec2.internal\" DevicePath \"\""
Jul 09 19:39:59.952029 ip-10-0-139-134 kubenswrapper[2578]: I0709 19:39:59.951793    2578 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/ee9f7a87-ba28-40a6-a7ed-c1d8d8a5f11e-tls-certs\") on node \"ip-10-0-139-134.ec2.internal\" DevicePath \"\""
Jul 09 19:39:59.989893 ip-10-0-139-134 kubenswrapper[2578]: I0709 19:39:59.989818    2578 generic.go:356] "Generic (PLEG): container finished" podID="ee9f7a87-ba28-40a6-a7ed-c1d8d8a5f11e" containerID="557fd27c9520323e0e6a768ccc6395cf9643fd3fdf23d06dace8bc129160a6c6" exitCode=0
Jul 09 19:39:59.989893 ip-10-0-139-134 kubenswrapper[2578]: I0709 19:39:59.989883    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-77ffac/sub-test-model-77ffac-kserve-68598cbcf-99bvj"
Jul 09 19:39:59.990110 ip-10-0-139-134 kubenswrapper[2578]: I0709 19:39:59.989908    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-77ffac/sub-test-model-77ffac-kserve-68598cbcf-99bvj" event={"ID":"ee9f7a87-ba28-40a6-a7ed-c1d8d8a5f11e","Type":"ContainerDied","Data":"557fd27c9520323e0e6a768ccc6395cf9643fd3fdf23d06dace8bc129160a6c6"}
Jul 09 19:39:59.990110 ip-10-0-139-134 kubenswrapper[2578]: I0709 19:39:59.989950    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-77ffac/sub-test-model-77ffac-kserve-68598cbcf-99bvj" event={"ID":"ee9f7a87-ba28-40a6-a7ed-c1d8d8a5f11e","Type":"ContainerDied","Data":"883741694d698e742c69a761f2e21bdf620c7438ef9de79776f913a66e48c3c5"}
Jul 09 19:39:59.990110 ip-10-0-139-134 kubenswrapper[2578]: I0709 19:39:59.989966    2578 scope.go:117] "RemoveContainer" containerID="557fd27c9520323e0e6a768ccc6395cf9643fd3fdf23d06dace8bc129160a6c6"
Jul 09 19:39:59.998368 ip-10-0-139-134 kubenswrapper[2578]: I0709 19:39:59.998352    2578 scope.go:117] "RemoveContainer" containerID="557fd27c9520323e0e6a768ccc6395cf9643fd3fdf23d06dace8bc129160a6c6"
Jul 09 19:39:59.998611 ip-10-0-139-134 kubenswrapper[2578]: E0709 19:39:59.998593    2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"557fd27c9520323e0e6a768ccc6395cf9643fd3fdf23d06dace8bc129160a6c6\": container with ID starting with 557fd27c9520323e0e6a768ccc6395cf9643fd3fdf23d06dace8bc129160a6c6 not found: ID does not exist" containerID="557fd27c9520323e0e6a768ccc6395cf9643fd3fdf23d06dace8bc129160a6c6"
Jul 09 19:39:59.998674 ip-10-0-139-134 kubenswrapper[2578]: I0709 19:39:59.998624    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"557fd27c9520323e0e6a768ccc6395cf9643fd3fdf23d06dace8bc129160a6c6"} err="failed to get container status \"557fd27c9520323e0e6a768ccc6395cf9643fd3fdf23d06dace8bc129160a6c6\": rpc error: code = NotFound desc = could not find container \"557fd27c9520323e0e6a768ccc6395cf9643fd3fdf23d06dace8bc129160a6c6\": container with ID starting with 557fd27c9520323e0e6a768ccc6395cf9643fd3fdf23d06dace8bc129160a6c6 not found: ID does not exist"
Jul 09 19:40:00.042441 ip-10-0-139-134 kubenswrapper[2578]: I0709 19:40:00.042410    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-77ffac/sub-test-model-77ffac-kserve-68598cbcf-99bvj"]
Jul 09 19:40:00.048777 ip-10-0-139-134 kubenswrapper[2578]: I0709 19:40:00.048753    2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-a-77ffac/sub-test-model-77ffac-kserve-68598cbcf-99bvj"]
Jul 09 19:40:01.838114 ip-10-0-139-134 kubenswrapper[2578]: I0709 19:40:01.838083    2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ee9f7a87-ba28-40a6-a7ed-c1d8d8a5f11e" path="/var/lib/kubelet/pods/ee9f7a87-ba28-40a6-a7ed-c1d8d8a5f11e/volumes"
Jul 09 19:41:48.979515 ip-10-0-139-134 kubenswrapper[2578]: I0709 19:41:48.979476    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-77ffac-78664b6676-x8fdh"]
Jul 09 19:41:48.980016 ip-10-0-139-134 kubenswrapper[2578]: I0709 19:41:48.979663    2578 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-77ffac-78664b6676-x8fdh" podUID="cf71e230-1c79-4a74-8326-31b721995830" containerName="maas-api" containerID="cri-o://706b2dee40736b4a47f28ddbe553c2267d32f6b3d52adc8c57c29b35628f2052" gracePeriod=30
Jul 09 19:41:49.219549 ip-10-0-139-134 kubenswrapper[2578]: I0709 19:41:49.219518    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-77ffac-78664b6676-x8fdh"
Jul 09 19:41:49.358242 ip-10-0-139-134 kubenswrapper[2578]: I0709 19:41:49.358157    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-sgm8w\" (UniqueName: \"kubernetes.io/projected/cf71e230-1c79-4a74-8326-31b721995830-kube-api-access-sgm8w\") pod \"cf71e230-1c79-4a74-8326-31b721995830\" (UID: \"cf71e230-1c79-4a74-8326-31b721995830\") "
Jul 09 19:41:49.358242 ip-10-0-139-134 kubenswrapper[2578]: I0709 19:41:49.358190    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/cf71e230-1c79-4a74-8326-31b721995830-maas-api-tls\") pod \"cf71e230-1c79-4a74-8326-31b721995830\" (UID: \"cf71e230-1c79-4a74-8326-31b721995830\") "
Jul 09 19:41:49.358440 ip-10-0-139-134 kubenswrapper[2578]: I0709 19:41:49.358251    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/cf71e230-1c79-4a74-8326-31b721995830-openshift-service-ca\") pod \"cf71e230-1c79-4a74-8326-31b721995830\" (UID: \"cf71e230-1c79-4a74-8326-31b721995830\") "
Jul 09 19:41:49.358624 ip-10-0-139-134 kubenswrapper[2578]: I0709 19:41:49.358600    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/cf71e230-1c79-4a74-8326-31b721995830-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "cf71e230-1c79-4a74-8326-31b721995830" (UID: "cf71e230-1c79-4a74-8326-31b721995830"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 09 19:41:49.360466 ip-10-0-139-134 kubenswrapper[2578]: I0709 19:41:49.360429    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/cf71e230-1c79-4a74-8326-31b721995830-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "cf71e230-1c79-4a74-8326-31b721995830" (UID: "cf71e230-1c79-4a74-8326-31b721995830"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 09 19:41:49.360680 ip-10-0-139-134 kubenswrapper[2578]: I0709 19:41:49.360631    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/cf71e230-1c79-4a74-8326-31b721995830-kube-api-access-sgm8w" (OuterVolumeSpecName: "kube-api-access-sgm8w") pod "cf71e230-1c79-4a74-8326-31b721995830" (UID: "cf71e230-1c79-4a74-8326-31b721995830"). InnerVolumeSpecName "kube-api-access-sgm8w". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 09 19:41:49.445719 ip-10-0-139-134 kubenswrapper[2578]: I0709 19:41:49.445680    2578 generic.go:356] "Generic (PLEG): container finished" podID="cf71e230-1c79-4a74-8326-31b721995830" containerID="706b2dee40736b4a47f28ddbe553c2267d32f6b3d52adc8c57c29b35628f2052" exitCode=0
Jul 09 19:41:49.445884 ip-10-0-139-134 kubenswrapper[2578]: I0709 19:41:49.445727    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-77ffac-78664b6676-x8fdh"
Jul 09 19:41:49.445884 ip-10-0-139-134 kubenswrapper[2578]: I0709 19:41:49.445762    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-77ffac-78664b6676-x8fdh" event={"ID":"cf71e230-1c79-4a74-8326-31b721995830","Type":"ContainerDied","Data":"706b2dee40736b4a47f28ddbe553c2267d32f6b3d52adc8c57c29b35628f2052"}
Jul 09 19:41:49.445884 ip-10-0-139-134 kubenswrapper[2578]: I0709 19:41:49.445817    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-77ffac-78664b6676-x8fdh" event={"ID":"cf71e230-1c79-4a74-8326-31b721995830","Type":"ContainerDied","Data":"f729a2b6b126ce8860cee0beae22be315bb0feb9cda030a045d9b8dcb1672d6a"}
Jul 09 19:41:49.445884 ip-10-0-139-134 kubenswrapper[2578]: I0709 19:41:49.445839    2578 scope.go:117] "RemoveContainer" containerID="706b2dee40736b4a47f28ddbe553c2267d32f6b3d52adc8c57c29b35628f2052"
Jul 09 19:41:49.454518 ip-10-0-139-134 kubenswrapper[2578]: I0709 19:41:49.454501    2578 scope.go:117] "RemoveContainer" containerID="706b2dee40736b4a47f28ddbe553c2267d32f6b3d52adc8c57c29b35628f2052"
Jul 09 19:41:49.454777 ip-10-0-139-134 kubenswrapper[2578]: E0709 19:41:49.454756    2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"706b2dee40736b4a47f28ddbe553c2267d32f6b3d52adc8c57c29b35628f2052\": container with ID starting with 706b2dee40736b4a47f28ddbe553c2267d32f6b3d52adc8c57c29b35628f2052 not found: ID does not exist" containerID="706b2dee40736b4a47f28ddbe553c2267d32f6b3d52adc8c57c29b35628f2052"
Jul 09 19:41:49.454833 ip-10-0-139-134 kubenswrapper[2578]: I0709 19:41:49.454785    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"706b2dee40736b4a47f28ddbe553c2267d32f6b3d52adc8c57c29b35628f2052"} err="failed to get container status \"706b2dee40736b4a47f28ddbe553c2267d32f6b3d52adc8c57c29b35628f2052\": rpc error: code = NotFound desc = could not find container \"706b2dee40736b4a47f28ddbe553c2267d32f6b3d52adc8c57c29b35628f2052\": container with ID starting with 706b2dee40736b4a47f28ddbe553c2267d32f6b3d52adc8c57c29b35628f2052 not found: ID does not exist"
Jul 09 19:41:49.459326 ip-10-0-139-134 kubenswrapper[2578]: I0709 19:41:49.459308    2578 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/cf71e230-1c79-4a74-8326-31b721995830-openshift-service-ca\") on node \"ip-10-0-139-134.ec2.internal\" DevicePath \"\""
Jul 09 19:41:49.459390 ip-10-0-139-134 kubenswrapper[2578]: I0709 19:41:49.459330    2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-sgm8w\" (UniqueName: \"kubernetes.io/projected/cf71e230-1c79-4a74-8326-31b721995830-kube-api-access-sgm8w\") on node \"ip-10-0-139-134.ec2.internal\" DevicePath \"\""
Jul 09 19:41:49.459390 ip-10-0-139-134 kubenswrapper[2578]: I0709 19:41:49.459340    2578 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/cf71e230-1c79-4a74-8326-31b721995830-maas-api-tls\") on node \"ip-10-0-139-134.ec2.internal\" DevicePath \"\""
Jul 09 19:41:49.466630 ip-10-0-139-134 kubenswrapper[2578]: I0709 19:41:49.466608    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-77ffac-78664b6676-x8fdh"]
Jul 09 19:41:49.470562 ip-10-0-139-134 kubenswrapper[2578]: I0709 19:41:49.470541    2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-77ffac-78664b6676-x8fdh"]
Jul 09 19:41:49.837738 ip-10-0-139-134 kubenswrapper[2578]: I0709 19:41:49.837703    2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="cf71e230-1c79-4a74-8326-31b721995830" path="/var/lib/kubelet/pods/cf71e230-1c79-4a74-8326-31b721995830/volumes"
Jul 09 19:41:56.108199 ip-10-0-139-134 kubenswrapper[2578]: I0709 19:41:56.108164    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-11fb58-56ffd5df6b-kk96k"]
Jul 09 19:41:56.108728 ip-10-0-139-134 kubenswrapper[2578]: I0709 19:41:56.108408    2578 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-11fb58-56ffd5df6b-kk96k" podUID="fa577694-86a5-4c3e-ac5c-121f3da0a572" containerName="maas-api" containerID="cri-o://d02e39d1a28e6c26e650959004f466467c289692036389cd82ff9c900cc628ba" gracePeriod=30
Jul 09 19:41:56.481078 ip-10-0-139-134 kubenswrapper[2578]: I0709 19:41:56.481049    2578 generic.go:356] "Generic (PLEG): container finished" podID="fa577694-86a5-4c3e-ac5c-121f3da0a572" containerID="d02e39d1a28e6c26e650959004f466467c289692036389cd82ff9c900cc628ba" exitCode=0
Jul 09 19:41:56.481203 ip-10-0-139-134 kubenswrapper[2578]: I0709 19:41:56.481127    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-11fb58-56ffd5df6b-kk96k" event={"ID":"fa577694-86a5-4c3e-ac5c-121f3da0a572","Type":"ContainerDied","Data":"d02e39d1a28e6c26e650959004f466467c289692036389cd82ff9c900cc628ba"}
Jul 09 19:41:56.551741 ip-10-0-139-134 kubenswrapper[2578]: I0709 19:41:56.551716    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-11fb58-56ffd5df6b-kk96k"
Jul 09 19:41:56.623302 ip-10-0-139-134 kubenswrapper[2578]: I0709 19:41:56.623271    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/fa577694-86a5-4c3e-ac5c-121f3da0a572-openshift-service-ca\") pod \"fa577694-86a5-4c3e-ac5c-121f3da0a572\" (UID: \"fa577694-86a5-4c3e-ac5c-121f3da0a572\") "
Jul 09 19:41:56.623468 ip-10-0-139-134 kubenswrapper[2578]: I0709 19:41:56.623329    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-5qq7h\" (UniqueName: \"kubernetes.io/projected/fa577694-86a5-4c3e-ac5c-121f3da0a572-kube-api-access-5qq7h\") pod \"fa577694-86a5-4c3e-ac5c-121f3da0a572\" (UID: \"fa577694-86a5-4c3e-ac5c-121f3da0a572\") "
Jul 09 19:41:56.623468 ip-10-0-139-134 kubenswrapper[2578]: I0709 19:41:56.623419    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/fa577694-86a5-4c3e-ac5c-121f3da0a572-maas-api-tls\") pod \"fa577694-86a5-4c3e-ac5c-121f3da0a572\" (UID: \"fa577694-86a5-4c3e-ac5c-121f3da0a572\") "
Jul 09 19:41:56.623700 ip-10-0-139-134 kubenswrapper[2578]: I0709 19:41:56.623682    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/fa577694-86a5-4c3e-ac5c-121f3da0a572-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "fa577694-86a5-4c3e-ac5c-121f3da0a572" (UID: "fa577694-86a5-4c3e-ac5c-121f3da0a572"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 09 19:41:56.625630 ip-10-0-139-134 kubenswrapper[2578]: I0709 19:41:56.625604    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/fa577694-86a5-4c3e-ac5c-121f3da0a572-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "fa577694-86a5-4c3e-ac5c-121f3da0a572" (UID: "fa577694-86a5-4c3e-ac5c-121f3da0a572"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 09 19:41:56.625763 ip-10-0-139-134 kubenswrapper[2578]: I0709 19:41:56.625748    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/fa577694-86a5-4c3e-ac5c-121f3da0a572-kube-api-access-5qq7h" (OuterVolumeSpecName: "kube-api-access-5qq7h") pod "fa577694-86a5-4c3e-ac5c-121f3da0a572" (UID: "fa577694-86a5-4c3e-ac5c-121f3da0a572"). InnerVolumeSpecName "kube-api-access-5qq7h". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 09 19:41:56.724309 ip-10-0-139-134 kubenswrapper[2578]: I0709 19:41:56.724267    2578 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/fa577694-86a5-4c3e-ac5c-121f3da0a572-openshift-service-ca\") on node \"ip-10-0-139-134.ec2.internal\" DevicePath \"\""
Jul 09 19:41:56.724309 ip-10-0-139-134 kubenswrapper[2578]: I0709 19:41:56.724302    2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-5qq7h\" (UniqueName: \"kubernetes.io/projected/fa577694-86a5-4c3e-ac5c-121f3da0a572-kube-api-access-5qq7h\") on node \"ip-10-0-139-134.ec2.internal\" DevicePath \"\""
Jul 09 19:41:56.724309 ip-10-0-139-134 kubenswrapper[2578]: I0709 19:41:56.724314    2578 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/fa577694-86a5-4c3e-ac5c-121f3da0a572-maas-api-tls\") on node \"ip-10-0-139-134.ec2.internal\" DevicePath \"\""
Jul 09 19:41:57.486083 ip-10-0-139-134 kubenswrapper[2578]: I0709 19:41:57.486054    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-11fb58-56ffd5df6b-kk96k"
Jul 09 19:41:57.486083 ip-10-0-139-134 kubenswrapper[2578]: I0709 19:41:57.486058    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-11fb58-56ffd5df6b-kk96k" event={"ID":"fa577694-86a5-4c3e-ac5c-121f3da0a572","Type":"ContainerDied","Data":"129bdb888a06c93d659cca2456b2d091fea36ac4fb3685cbd74ef00c27546ab0"}
Jul 09 19:41:57.486594 ip-10-0-139-134 kubenswrapper[2578]: I0709 19:41:57.486124    2578 scope.go:117] "RemoveContainer" containerID="d02e39d1a28e6c26e650959004f466467c289692036389cd82ff9c900cc628ba"
Jul 09 19:41:57.512060 ip-10-0-139-134 kubenswrapper[2578]: I0709 19:41:57.510986    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-11fb58-56ffd5df6b-kk96k"]
Jul 09 19:41:57.515783 ip-10-0-139-134 kubenswrapper[2578]: I0709 19:41:57.515757    2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-11fb58-56ffd5df6b-kk96k"]
Jul 09 19:41:57.838076 ip-10-0-139-134 kubenswrapper[2578]: I0709 19:41:57.837979    2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="fa577694-86a5-4c3e-ac5c-121f3da0a572" path="/var/lib/kubelet/pods/fa577694-86a5-4c3e-ac5c-121f3da0a572/volumes"
Jul 09 19:42:07.841229 ip-10-0-139-134 kubenswrapper[2578]: I0709 19:42:07.841203    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_model-serving-api-54d89bd5fc-8tnhv_28bc0231-f03b-4fb6-9217-76fb45581312/server/0.log"
Jul 09 19:42:08.173573 ip-10-0-139-134 kubenswrapper[2578]: I0709 19:42:08.173545    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-799d55cdcd-7q6d4_2aaef575-ffa9-44f8-ac52-e2b01a71ae73/copy-manifests/0.log"
Jul 09 19:42:08.185594 ip-10-0-139-134 kubenswrapper[2578]: I0709 19:42:08.185572    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-799d55cdcd-7q6d4_2aaef575-ffa9-44f8-ac52-e2b01a71ae73/manager/0.log"
Jul 09 19:42:11.268878 ip-10-0-139-134 kubenswrapper[2578]: I0709 19:42:11.268851    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-94bb8fbfd-kfdrm_ae0a44de-9c1b-4ceb-b3d7-bd6f5adf64ac/discovery/0.log"
Jul 09 19:42:11.841699 ip-10-0-139-134 kubenswrapper[2578]: I0709 19:42:11.841672    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-58f86c7798-vwmmj_8f0b65ac-44e7-4c22-b204-998168de7c2d/payload-processing/0.log"
Jul 09 19:42:12.381346 ip-10-0-139-134 kubenswrapper[2578]: I0709 19:42:12.381317    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-simulated-kserve-59975d69f9-7wsvs_7f1d16eb-7526-4400-9c2d-613c4a819f18/main/0.log"
Jul 09 19:42:12.588975 ip-10-0-139-134 kubenswrapper[2578]: I0709 19:42:12.588946    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db2ngmh_32f685d1-4d07-4b29-82e0-721286d7182a/main/0.log"
Jul 09 19:42:19.256709 ip-10-0-139-134 kubenswrapper[2578]: I0709 19:42:19.256679    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-kmr4m_4e35097c-426a-4343-aa9d-befa17cabda5/global-pull-secret-syncer/0.log"
Jul 09 19:42:19.408363 ip-10-0-139-134 kubenswrapper[2578]: I0709 19:42:19.408333    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-vnnqd_19c7b09c-711d-472b-95ef-ab437e64985c/konnectivity-agent/0.log"
Jul 09 19:42:19.451495 ip-10-0-139-134 kubenswrapper[2578]: I0709 19:42:19.451451    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-139-134.ec2.internal_6d1a4d271968fb37c56f11e30e3e00f8/haproxy/0.log"
Jul 09 19:42:26.260472 ip-10-0-139-134 kubenswrapper[2578]: I0709 19:42:26.260441    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_metrics-server-b94fdbcb7-mvzzq_fafccd77-fb57-4fbe-8b15-ff8ec7cd9737/metrics-server/0.log"
Jul 09 19:42:26.485310 ip-10-0-139-134 kubenswrapper[2578]: I0709 19:42:26.485282    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-p4k7z_35211644-b8a6-419d-ba70-a479f336e1a6/node-exporter/0.log"
Jul 09 19:42:26.506066 ip-10-0-139-134 kubenswrapper[2578]: I0709 19:42:26.506036    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-p4k7z_35211644-b8a6-419d-ba70-a479f336e1a6/kube-rbac-proxy/0.log"
Jul 09 19:42:26.526745 ip-10-0-139-134 kubenswrapper[2578]: I0709 19:42:26.526665    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-p4k7z_35211644-b8a6-419d-ba70-a479f336e1a6/init-textfile/0.log"
Jul 09 19:42:26.956779 ip-10-0-139-134 kubenswrapper[2578]: I0709 19:42:26.956751    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-admission-webhook-77d98bc786-qnmnx_3368ad15-6140-4fbe-9d0e-dc8604ddfef0/prometheus-operator-admission-webhook/0.log"
Jul 09 19:42:29.782604 ip-10-0-139-134 kubenswrapper[2578]: I0709 19:42:29.782570    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-797qx/perf-node-gather-daemonset-cqmnv"]
Jul 09 19:42:29.783007 ip-10-0-139-134 kubenswrapper[2578]: I0709 19:42:29.782845    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ee9f7a87-ba28-40a6-a7ed-c1d8d8a5f11e" containerName="main"
Jul 09 19:42:29.783007 ip-10-0-139-134 kubenswrapper[2578]: I0709 19:42:29.782857    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="ee9f7a87-ba28-40a6-a7ed-c1d8d8a5f11e" containerName="main"
Jul 09 19:42:29.783007 ip-10-0-139-134 kubenswrapper[2578]: I0709 19:42:29.782872    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="cf71e230-1c79-4a74-8326-31b721995830" containerName="maas-api"
Jul 09 19:42:29.783007 ip-10-0-139-134 kubenswrapper[2578]: I0709 19:42:29.782877    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="cf71e230-1c79-4a74-8326-31b721995830" containerName="maas-api"
Jul 09 19:42:29.783007 ip-10-0-139-134 kubenswrapper[2578]: I0709 19:42:29.782891    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="fa577694-86a5-4c3e-ac5c-121f3da0a572" containerName="maas-api"
Jul 09 19:42:29.783007 ip-10-0-139-134 kubenswrapper[2578]: I0709 19:42:29.782896    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="fa577694-86a5-4c3e-ac5c-121f3da0a572" containerName="maas-api"
Jul 09 19:42:29.783007 ip-10-0-139-134 kubenswrapper[2578]: I0709 19:42:29.782902    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="626691de-32d6-47ab-b087-1092a9d193b3" containerName="main"
Jul 09 19:42:29.783007 ip-10-0-139-134 kubenswrapper[2578]: I0709 19:42:29.782907    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="626691de-32d6-47ab-b087-1092a9d193b3" containerName="main"
Jul 09 19:42:29.783007 ip-10-0-139-134 kubenswrapper[2578]: I0709 19:42:29.782948    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="ee9f7a87-ba28-40a6-a7ed-c1d8d8a5f11e" containerName="main"
Jul 09 19:42:29.783007 ip-10-0-139-134 kubenswrapper[2578]: I0709 19:42:29.782957    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="cf71e230-1c79-4a74-8326-31b721995830" containerName="maas-api"
Jul 09 19:42:29.783007 ip-10-0-139-134 kubenswrapper[2578]: I0709 19:42:29.782962    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="fa577694-86a5-4c3e-ac5c-121f3da0a572" containerName="maas-api"
Jul 09 19:42:29.783007 ip-10-0-139-134 kubenswrapper[2578]: I0709 19:42:29.782968    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="626691de-32d6-47ab-b087-1092a9d193b3" containerName="main"
Jul 09 19:42:29.787654 ip-10-0-139-134 kubenswrapper[2578]: I0709 19:42:29.787627    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-797qx/perf-node-gather-daemonset-cqmnv"
Jul 09 19:42:29.790882 ip-10-0-139-134 kubenswrapper[2578]: I0709 19:42:29.790859    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-797qx\"/\"kube-root-ca.crt\""
Jul 09 19:42:29.792571 ip-10-0-139-134 kubenswrapper[2578]: I0709 19:42:29.792551    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-797qx\"/\"default-dockercfg-7ljkd\""
Jul 09 19:42:29.792790 ip-10-0-139-134 kubenswrapper[2578]: I0709 19:42:29.792558    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-797qx\"/\"openshift-service-ca.crt\""
Jul 09 19:42:29.792878 ip-10-0-139-134 kubenswrapper[2578]: I0709 19:42:29.792851    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/5ac4f849-ad81-4874-82ad-c72c9fda5e30-sys\") pod \"perf-node-gather-daemonset-cqmnv\" (UID: \"5ac4f849-ad81-4874-82ad-c72c9fda5e30\") " pod="openshift-must-gather-797qx/perf-node-gather-daemonset-cqmnv"
Jul 09 19:42:29.792945 ip-10-0-139-134 kubenswrapper[2578]: I0709 19:42:29.792925    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8s4c4\" (UniqueName: \"kubernetes.io/projected/5ac4f849-ad81-4874-82ad-c72c9fda5e30-kube-api-access-8s4c4\") pod \"perf-node-gather-daemonset-cqmnv\" (UID: \"5ac4f849-ad81-4874-82ad-c72c9fda5e30\") " pod="openshift-must-gather-797qx/perf-node-gather-daemonset-cqmnv"
Jul 09 19:42:29.793019 ip-10-0-139-134 kubenswrapper[2578]: I0709 19:42:29.792985    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/5ac4f849-ad81-4874-82ad-c72c9fda5e30-podres\") pod \"perf-node-gather-daemonset-cqmnv\" (UID: \"5ac4f849-ad81-4874-82ad-c72c9fda5e30\") " pod="openshift-must-gather-797qx/perf-node-gather-daemonset-cqmnv"
Jul 09 19:42:29.793076 ip-10-0-139-134 kubenswrapper[2578]: I0709 19:42:29.793053    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/5ac4f849-ad81-4874-82ad-c72c9fda5e30-proc\") pod \"perf-node-gather-daemonset-cqmnv\" (UID: \"5ac4f849-ad81-4874-82ad-c72c9fda5e30\") " pod="openshift-must-gather-797qx/perf-node-gather-daemonset-cqmnv"
Jul 09 19:42:29.793137 ip-10-0-139-134 kubenswrapper[2578]: I0709 19:42:29.793093    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/5ac4f849-ad81-4874-82ad-c72c9fda5e30-lib-modules\") pod \"perf-node-gather-daemonset-cqmnv\" (UID: \"5ac4f849-ad81-4874-82ad-c72c9fda5e30\") " pod="openshift-must-gather-797qx/perf-node-gather-daemonset-cqmnv"
Jul 09 19:42:29.794796 ip-10-0-139-134 kubenswrapper[2578]: I0709 19:42:29.794771    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-797qx/perf-node-gather-daemonset-cqmnv"]
Jul 09 19:42:29.893727 ip-10-0-139-134 kubenswrapper[2578]: I0709 19:42:29.893694    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/5ac4f849-ad81-4874-82ad-c72c9fda5e30-lib-modules\") pod \"perf-node-gather-daemonset-cqmnv\" (UID: \"5ac4f849-ad81-4874-82ad-c72c9fda5e30\") " pod="openshift-must-gather-797qx/perf-node-gather-daemonset-cqmnv"
Jul 09 19:42:29.893928 ip-10-0-139-134 kubenswrapper[2578]: I0709 19:42:29.893750    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/5ac4f849-ad81-4874-82ad-c72c9fda5e30-sys\") pod \"perf-node-gather-daemonset-cqmnv\" (UID: \"5ac4f849-ad81-4874-82ad-c72c9fda5e30\") " pod="openshift-must-gather-797qx/perf-node-gather-daemonset-cqmnv"
Jul 09 19:42:29.893928 ip-10-0-139-134 kubenswrapper[2578]: I0709 19:42:29.893779    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8s4c4\" (UniqueName: \"kubernetes.io/projected/5ac4f849-ad81-4874-82ad-c72c9fda5e30-kube-api-access-8s4c4\") pod \"perf-node-gather-daemonset-cqmnv\" (UID: \"5ac4f849-ad81-4874-82ad-c72c9fda5e30\") " pod="openshift-must-gather-797qx/perf-node-gather-daemonset-cqmnv"
Jul 09 19:42:29.893928 ip-10-0-139-134 kubenswrapper[2578]: I0709 19:42:29.893818    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/5ac4f849-ad81-4874-82ad-c72c9fda5e30-podres\") pod \"perf-node-gather-daemonset-cqmnv\" (UID: \"5ac4f849-ad81-4874-82ad-c72c9fda5e30\") " pod="openshift-must-gather-797qx/perf-node-gather-daemonset-cqmnv"
Jul 09 19:42:29.893928 ip-10-0-139-134 kubenswrapper[2578]: I0709 19:42:29.893851    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/5ac4f849-ad81-4874-82ad-c72c9fda5e30-sys\") pod \"perf-node-gather-daemonset-cqmnv\" (UID: \"5ac4f849-ad81-4874-82ad-c72c9fda5e30\") " pod="openshift-must-gather-797qx/perf-node-gather-daemonset-cqmnv"
Jul 09 19:42:29.893928 ip-10-0-139-134 kubenswrapper[2578]: I0709 19:42:29.893856    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/5ac4f849-ad81-4874-82ad-c72c9fda5e30-proc\") pod \"perf-node-gather-daemonset-cqmnv\" (UID: \"5ac4f849-ad81-4874-82ad-c72c9fda5e30\") " pod="openshift-must-gather-797qx/perf-node-gather-daemonset-cqmnv"
Jul 09 19:42:29.893928 ip-10-0-139-134 kubenswrapper[2578]: I0709 19:42:29.893900    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/5ac4f849-ad81-4874-82ad-c72c9fda5e30-proc\") pod \"perf-node-gather-daemonset-cqmnv\" (UID: \"5ac4f849-ad81-4874-82ad-c72c9fda5e30\") " pod="openshift-must-gather-797qx/perf-node-gather-daemonset-cqmnv"
Jul 09 19:42:29.893928 ip-10-0-139-134 kubenswrapper[2578]: I0709 19:42:29.893895    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/5ac4f849-ad81-4874-82ad-c72c9fda5e30-lib-modules\") pod \"perf-node-gather-daemonset-cqmnv\" (UID: \"5ac4f849-ad81-4874-82ad-c72c9fda5e30\") " pod="openshift-must-gather-797qx/perf-node-gather-daemonset-cqmnv"
Jul 09 19:42:29.894214 ip-10-0-139-134 kubenswrapper[2578]: I0709 19:42:29.893933    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/5ac4f849-ad81-4874-82ad-c72c9fda5e30-podres\") pod \"perf-node-gather-daemonset-cqmnv\" (UID: \"5ac4f849-ad81-4874-82ad-c72c9fda5e30\") " pod="openshift-must-gather-797qx/perf-node-gather-daemonset-cqmnv"
Jul 09 19:42:29.903199 ip-10-0-139-134 kubenswrapper[2578]: I0709 19:42:29.903178    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8s4c4\" (UniqueName: \"kubernetes.io/projected/5ac4f849-ad81-4874-82ad-c72c9fda5e30-kube-api-access-8s4c4\") pod \"perf-node-gather-daemonset-cqmnv\" (UID: \"5ac4f849-ad81-4874-82ad-c72c9fda5e30\") " pod="openshift-must-gather-797qx/perf-node-gather-daemonset-cqmnv"
Jul 09 19:42:30.098889 ip-10-0-139-134 kubenswrapper[2578]: I0709 19:42:30.098779    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-797qx/perf-node-gather-daemonset-cqmnv"
Jul 09 19:42:30.237107 ip-10-0-139-134 kubenswrapper[2578]: I0709 19:42:30.236678    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-797qx/perf-node-gather-daemonset-cqmnv"]
Jul 09 19:42:30.239191 ip-10-0-139-134 kubenswrapper[2578]: W0709 19:42:30.239155    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod5ac4f849_ad81_4874_82ad_c72c9fda5e30.slice/crio-bc81ce1296e35d0e90301e491d93ced33a97a66432c15ba692ffaea1d77e041b WatchSource:0}: Error finding container bc81ce1296e35d0e90301e491d93ced33a97a66432c15ba692ffaea1d77e041b: Status 404 returned error can't find the container with id bc81ce1296e35d0e90301e491d93ced33a97a66432c15ba692ffaea1d77e041b
Jul 09 19:42:30.628782 ip-10-0-139-134 kubenswrapper[2578]: I0709 19:42:30.628694    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-797qx/perf-node-gather-daemonset-cqmnv" event={"ID":"5ac4f849-ad81-4874-82ad-c72c9fda5e30","Type":"ContainerStarted","Data":"8604cc1565a03ef14bf7ddc8fc68c8f4148b8e52d292b08e3f78d05e22547215"}
Jul 09 19:42:30.628782 ip-10-0-139-134 kubenswrapper[2578]: I0709 19:42:30.628745    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-797qx/perf-node-gather-daemonset-cqmnv" event={"ID":"5ac4f849-ad81-4874-82ad-c72c9fda5e30","Type":"ContainerStarted","Data":"bc81ce1296e35d0e90301e491d93ced33a97a66432c15ba692ffaea1d77e041b"}
Jul 09 19:42:30.628971 ip-10-0-139-134 kubenswrapper[2578]: I0709 19:42:30.628833    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-797qx/perf-node-gather-daemonset-cqmnv"
Jul 09 19:42:30.646516 ip-10-0-139-134 kubenswrapper[2578]: I0709 19:42:30.646441    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-797qx/perf-node-gather-daemonset-cqmnv" podStartSLOduration=1.646418514 podStartE2EDuration="1.646418514s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-09 19:42:29 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 19:42:30.646355755 +0000 UTC m=+2647.272407111" watchObservedRunningTime="2026-07-09 19:42:30.646418514 +0000 UTC m=+2647.272469845"
Jul 09 19:42:31.612970 ip-10-0-139-134 kubenswrapper[2578]: I0709 19:42:31.612936    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-pv4p5_c2465fe4-d9fa-4246-b5e6-399f6dbe9259/dns/0.log"
Jul 09 19:42:31.647799 ip-10-0-139-134 kubenswrapper[2578]: I0709 19:42:31.647772    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-pv4p5_c2465fe4-d9fa-4246-b5e6-399f6dbe9259/kube-rbac-proxy/0.log"
Jul 09 19:42:31.684920 ip-10-0-139-134 kubenswrapper[2578]: I0709 19:42:31.684891    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-4ntmk_4b9891d4-d137-4996-ba20-f037de730093/dns-node-resolver/0.log"
Jul 09 19:42:32.405573 ip-10-0-139-134 kubenswrapper[2578]: I0709 19:42:32.405544    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-zwps8_d9cc9b31-8c81-490e-911c-692cc55539c1/node-ca/0.log"
Jul 09 19:42:33.401785 ip-10-0-139-134 kubenswrapper[2578]: I0709 19:42:33.401751    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-94bb8fbfd-kfdrm_ae0a44de-9c1b-4ceb-b3d7-bd6f5adf64ac/discovery/0.log"
Jul 09 19:42:33.592408 ip-10-0-139-134 kubenswrapper[2578]: I0709 19:42:33.592375    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-58f86c7798-vwmmj_8f0b65ac-44e7-4c22-b204-998168de7c2d/payload-processing/0.log"
Jul 09 19:42:34.347966 ip-10-0-139-134 kubenswrapper[2578]: I0709 19:42:34.347938    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-xc6m9_f55f09d8-7f36-4939-bb1c-bb4195e64a93/serve-healthcheck-canary/0.log"
Jul 09 19:42:34.953922 ip-10-0-139-134 kubenswrapper[2578]: I0709 19:42:34.953891    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-c67x7_26f7e025-e3eb-4289-8169-e40c6614d619/kube-rbac-proxy/0.log"
Jul 09 19:42:34.973244 ip-10-0-139-134 kubenswrapper[2578]: I0709 19:42:34.973223    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-c67x7_26f7e025-e3eb-4289-8169-e40c6614d619/exporter/0.log"
Jul 09 19:42:34.993081 ip-10-0-139-134 kubenswrapper[2578]: I0709 19:42:34.993059    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-c67x7_26f7e025-e3eb-4289-8169-e40c6614d619/extractor/0.log"
Jul 09 19:42:36.644154 ip-10-0-139-134 kubenswrapper[2578]: I0709 19:42:36.644126    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-797qx/perf-node-gather-daemonset-cqmnv"
Jul 09 19:42:37.331176 ip-10-0-139-134 kubenswrapper[2578]: I0709 19:42:37.331142    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_model-serving-api-54d89bd5fc-8tnhv_28bc0231-f03b-4fb6-9217-76fb45581312/server/0.log"
Jul 09 19:42:37.543054 ip-10-0-139-134 kubenswrapper[2578]: I0709 19:42:37.543022    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-799d55cdcd-7q6d4_2aaef575-ffa9-44f8-ac52-e2b01a71ae73/manager/0.log"
Jul 09 19:42:37.559551 ip-10-0-139-134 kubenswrapper[2578]: I0709 19:42:37.559525    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-799d55cdcd-7q6d4_2aaef575-ffa9-44f8-ac52-e2b01a71ae73/copy-manifests/0.log"
Jul 09 19:42:38.825130 ip-10-0-139-134 kubenswrapper[2578]: I0709 19:42:38.825100    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_lws-controller-manager-868778c6d9-5nq78_e9492e87-13a9-4746-8b52-bb36503ef496/manager/0.log"
Jul 09 19:42:38.850394 ip-10-0-139-134 kubenswrapper[2578]: I0709 19:42:38.850372    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_openshift-lws-operator-fd8ccff4c-cglkg_dbc789a6-e269-46fd-a8b6-b3e6d8f9d914/openshift-lws-operator/0.log"
Jul 09 19:42:40.150473 ip-10-0-139-134 kubenswrapper[2578]: I0709 19:42:40.150451    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-94bb8fbfd-kfdrm_ae0a44de-9c1b-4ceb-b3d7-bd6f5adf64ac/discovery/0.log"
Jul 09 19:42:40.292183 ip-10-0-139-134 kubenswrapper[2578]: I0709 19:42:40.292158    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-58f86c7798-vwmmj_8f0b65ac-44e7-4c22-b204-998168de7c2d/payload-processing/0.log"
Jul 09 19:42:41.697583 ip-10-0-139-134 kubenswrapper[2578]: I0709 19:42:41.697550    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-94bb8fbfd-kfdrm_ae0a44de-9c1b-4ceb-b3d7-bd6f5adf64ac/discovery/0.log"
Jul 09 19:42:41.841870 ip-10-0-139-134 kubenswrapper[2578]: I0709 19:42:41.841841    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-58f86c7798-vwmmj_8f0b65ac-44e7-4c22-b204-998168de7c2d/payload-processing/0.log"
Jul 09 19:42:45.477255 ip-10-0-139-134 kubenswrapper[2578]: I0709 19:42:45.477213    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-7mdng_c47bacce-dcdf-4fbf-af5f-5c781c502907/kube-multus/0.log"
Jul 09 19:42:45.499868 ip-10-0-139-134 kubenswrapper[2578]: I0709 19:42:45.499841    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-cs7mq_d83b5188-15a8-4450-803c-62524a249f65/kube-multus-additional-cni-plugins/0.log"
Jul 09 19:42:45.523877 ip-10-0-139-134 kubenswrapper[2578]: I0709 19:42:45.523851    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-cs7mq_d83b5188-15a8-4450-803c-62524a249f65/egress-router-binary-copy/0.log"
Jul 09 19:42:45.548156 ip-10-0-139-134 kubenswrapper[2578]: I0709 19:42:45.548136    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-cs7mq_d83b5188-15a8-4450-803c-62524a249f65/cni-plugins/0.log"
Jul 09 19:42:45.571227 ip-10-0-139-134 kubenswrapper[2578]: I0709 19:42:45.571200    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-cs7mq_d83b5188-15a8-4450-803c-62524a249f65/bond-cni-plugin/0.log"
Jul 09 19:42:45.597697 ip-10-0-139-134 kubenswrapper[2578]: I0709 19:42:45.597669    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-cs7mq_d83b5188-15a8-4450-803c-62524a249f65/routeoverride-cni/0.log"
Jul 09 19:42:45.623198 ip-10-0-139-134 kubenswrapper[2578]: I0709 19:42:45.623170    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-cs7mq_d83b5188-15a8-4450-803c-62524a249f65/whereabouts-cni-bincopy/0.log"
Jul 09 19:42:45.648726 ip-10-0-139-134 kubenswrapper[2578]: I0709 19:42:45.648693    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-cs7mq_d83b5188-15a8-4450-803c-62524a249f65/whereabouts-cni/0.log"
Jul 09 19:42:46.024089 ip-10-0-139-134 kubenswrapper[2578]: I0709 19:42:46.024062    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-dztbt_a6f6e738-06b0-41d1-bcc4-3627871fe3d6/network-metrics-daemon/0.log"
Jul 09 19:42:46.052148 ip-10-0-139-134 kubenswrapper[2578]: I0709 19:42:46.052118    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-dztbt_a6f6e738-06b0-41d1-bcc4-3627871fe3d6/kube-rbac-proxy/0.log"
Jul 09 19:42:47.133535 ip-10-0-139-134 kubenswrapper[2578]: I0709 19:42:47.133505    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-8gqbs_7a15b7a9-7525-426b-a051-3ece178b71bc/ovn-controller/0.log"
Jul 09 19:42:47.154531 ip-10-0-139-134 kubenswrapper[2578]: I0709 19:42:47.154501    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-8gqbs_7a15b7a9-7525-426b-a051-3ece178b71bc/ovn-acl-logging/1.log"
Jul 09 19:42:47.154531 ip-10-0-139-134 kubenswrapper[2578]: I0709 19:42:47.154530    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-8gqbs_7a15b7a9-7525-426b-a051-3ece178b71bc/ovn-acl-logging/0.log"
Jul 09 19:42:47.174372 ip-10-0-139-134 kubenswrapper[2578]: I0709 19:42:47.174345    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-8gqbs_7a15b7a9-7525-426b-a051-3ece178b71bc/kube-rbac-proxy-node/0.log"
Jul 09 19:42:47.195497 ip-10-0-139-134 kubenswrapper[2578]: I0709 19:42:47.195470    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-8gqbs_7a15b7a9-7525-426b-a051-3ece178b71bc/kube-rbac-proxy-ovn-metrics/0.log"
Jul 09 19:42:47.213405 ip-10-0-139-134 kubenswrapper[2578]: I0709 19:42:47.213375    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-8gqbs_7a15b7a9-7525-426b-a051-3ece178b71bc/northd/0.log"
Jul 09 19:42:47.233227 ip-10-0-139-134 kubenswrapper[2578]: I0709 19:42:47.233198    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-8gqbs_7a15b7a9-7525-426b-a051-3ece178b71bc/nbdb/0.log"
Jul 09 19:42:47.252893 ip-10-0-139-134 kubenswrapper[2578]: I0709 19:42:47.252868    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-8gqbs_7a15b7a9-7525-426b-a051-3ece178b71bc/sbdb/0.log"
Jul 09 19:42:47.299335 ip-10-0-139-134 kubenswrapper[2578]: I0709 19:42:47.299305    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-8gqbs_7a15b7a9-7525-426b-a051-3ece178b71bc/ovnkube-controller/0.log"