Jul 30 12:57:44.637838 ip-10-0-143-153 systemd[1]: kubelet.service: Failed to load environment files: No such file or directory
Jul 30 12:57:44.637851 ip-10-0-143-153 systemd[1]: kubelet.service: Failed to run 'start-pre' task: No such file or directory
Jul 30 12:57:44.637861 ip-10-0-143-153 systemd[1]: kubelet.service: Failed with result 'resources'.
Jul 30 12:57:44.638198 ip-10-0-143-153 systemd[1]: Failed to start Kubernetes Kubelet.
Jul 30 12:57:54.839263 ip-10-0-143-153 systemd[1]: kubelet.service: Failed to schedule restart job: Unit crio.service not found.
Jul 30 12:57:54.839284 ip-10-0-143-153 systemd[1]: kubelet.service: Failed with result 'resources'.
-- Boot ee49ecf05d7c4a07b4854a7128f9b3eb --
Jul 30 12:59:29.335871 ip-10-0-143-153 systemd[1]: Starting Kubernetes Kubelet...
Jul 30 12:59:29.777944 ip-10-0-143-153 kubenswrapper[2566]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 30 12:59:29.777944 ip-10-0-143-153 kubenswrapper[2566]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version.
Jul 30 12:59:29.777944 ip-10-0-143-153 kubenswrapper[2566]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 30 12:59:29.777944 ip-10-0-143-153 kubenswrapper[2566]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI.
Jul 30 12:59:29.777944 ip-10-0-143-153 kubenswrapper[2566]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 30 12:59:29.780958 ip-10-0-143-153 kubenswrapper[2566]: I0730 12:59:29.780877    2566 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime"
Jul 30 12:59:29.788258 ip-10-0-143-153 kubenswrapper[2566]: W0730 12:59:29.788231    2566 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 30 12:59:29.788258 ip-10-0-143-153 kubenswrapper[2566]: W0730 12:59:29.788252    2566 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 30 12:59:29.788258 ip-10-0-143-153 kubenswrapper[2566]: W0730 12:59:29.788256    2566 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 30 12:59:29.788258 ip-10-0-143-153 kubenswrapper[2566]: W0730 12:59:29.788260    2566 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 30 12:59:29.788258 ip-10-0-143-153 kubenswrapper[2566]: W0730 12:59:29.788264    2566 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 30 12:59:29.788258 ip-10-0-143-153 kubenswrapper[2566]: W0730 12:59:29.788267    2566 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 30 12:59:29.788489 ip-10-0-143-153 kubenswrapper[2566]: W0730 12:59:29.788271    2566 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 30 12:59:29.788489 ip-10-0-143-153 kubenswrapper[2566]: W0730 12:59:29.788274    2566 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 30 12:59:29.788489 ip-10-0-143-153 kubenswrapper[2566]: W0730 12:59:29.788277    2566 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 30 12:59:29.788489 ip-10-0-143-153 kubenswrapper[2566]: W0730 12:59:29.788279    2566 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 30 12:59:29.788489 ip-10-0-143-153 kubenswrapper[2566]: W0730 12:59:29.788282    2566 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 30 12:59:29.788489 ip-10-0-143-153 kubenswrapper[2566]: W0730 12:59:29.788285    2566 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 30 12:59:29.788489 ip-10-0-143-153 kubenswrapper[2566]: W0730 12:59:29.788287    2566 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 30 12:59:29.788489 ip-10-0-143-153 kubenswrapper[2566]: W0730 12:59:29.788290    2566 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 30 12:59:29.788489 ip-10-0-143-153 kubenswrapper[2566]: W0730 12:59:29.788293    2566 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 30 12:59:29.788489 ip-10-0-143-153 kubenswrapper[2566]: W0730 12:59:29.788295    2566 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 30 12:59:29.788489 ip-10-0-143-153 kubenswrapper[2566]: W0730 12:59:29.788298    2566 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 30 12:59:29.788489 ip-10-0-143-153 kubenswrapper[2566]: W0730 12:59:29.788300    2566 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 30 12:59:29.788489 ip-10-0-143-153 kubenswrapper[2566]: W0730 12:59:29.788303    2566 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 30 12:59:29.788489 ip-10-0-143-153 kubenswrapper[2566]: W0730 12:59:29.788306    2566 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 30 12:59:29.788489 ip-10-0-143-153 kubenswrapper[2566]: W0730 12:59:29.788308    2566 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 30 12:59:29.788489 ip-10-0-143-153 kubenswrapper[2566]: W0730 12:59:29.788311    2566 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 30 12:59:29.788489 ip-10-0-143-153 kubenswrapper[2566]: W0730 12:59:29.788314    2566 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 30 12:59:29.788489 ip-10-0-143-153 kubenswrapper[2566]: W0730 12:59:29.788316    2566 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 30 12:59:29.788489 ip-10-0-143-153 kubenswrapper[2566]: W0730 12:59:29.788319    2566 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 30 12:59:29.788489 ip-10-0-143-153 kubenswrapper[2566]: W0730 12:59:29.788321    2566 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 30 12:59:29.789032 ip-10-0-143-153 kubenswrapper[2566]: W0730 12:59:29.788324    2566 feature_gate.go:328] unrecognized feature gate: Example
Jul 30 12:59:29.789032 ip-10-0-143-153 kubenswrapper[2566]: W0730 12:59:29.788327    2566 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 30 12:59:29.789032 ip-10-0-143-153 kubenswrapper[2566]: W0730 12:59:29.788331    2566 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 30 12:59:29.789032 ip-10-0-143-153 kubenswrapper[2566]: W0730 12:59:29.788335    2566 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 30 12:59:29.789032 ip-10-0-143-153 kubenswrapper[2566]: W0730 12:59:29.788338    2566 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 30 12:59:29.789032 ip-10-0-143-153 kubenswrapper[2566]: W0730 12:59:29.788341    2566 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 30 12:59:29.789032 ip-10-0-143-153 kubenswrapper[2566]: W0730 12:59:29.788351    2566 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 30 12:59:29.789032 ip-10-0-143-153 kubenswrapper[2566]: W0730 12:59:29.788354    2566 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 30 12:59:29.789032 ip-10-0-143-153 kubenswrapper[2566]: W0730 12:59:29.788356    2566 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 30 12:59:29.789032 ip-10-0-143-153 kubenswrapper[2566]: W0730 12:59:29.788359    2566 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 30 12:59:29.789032 ip-10-0-143-153 kubenswrapper[2566]: W0730 12:59:29.788361    2566 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 30 12:59:29.789032 ip-10-0-143-153 kubenswrapper[2566]: W0730 12:59:29.788364    2566 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 30 12:59:29.789032 ip-10-0-143-153 kubenswrapper[2566]: W0730 12:59:29.788366    2566 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 30 12:59:29.789032 ip-10-0-143-153 kubenswrapper[2566]: W0730 12:59:29.788370    2566 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 30 12:59:29.789032 ip-10-0-143-153 kubenswrapper[2566]: W0730 12:59:29.788372    2566 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 30 12:59:29.789032 ip-10-0-143-153 kubenswrapper[2566]: W0730 12:59:29.788375    2566 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 30 12:59:29.789032 ip-10-0-143-153 kubenswrapper[2566]: W0730 12:59:29.788377    2566 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 30 12:59:29.789032 ip-10-0-143-153 kubenswrapper[2566]: W0730 12:59:29.788380    2566 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 30 12:59:29.789032 ip-10-0-143-153 kubenswrapper[2566]: W0730 12:59:29.788383    2566 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 30 12:59:29.789505 ip-10-0-143-153 kubenswrapper[2566]: W0730 12:59:29.788385    2566 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 30 12:59:29.789505 ip-10-0-143-153 kubenswrapper[2566]: W0730 12:59:29.788389    2566 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 30 12:59:29.789505 ip-10-0-143-153 kubenswrapper[2566]: W0730 12:59:29.788391    2566 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 30 12:59:29.789505 ip-10-0-143-153 kubenswrapper[2566]: W0730 12:59:29.788393    2566 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 30 12:59:29.789505 ip-10-0-143-153 kubenswrapper[2566]: W0730 12:59:29.788396    2566 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 30 12:59:29.789505 ip-10-0-143-153 kubenswrapper[2566]: W0730 12:59:29.788399    2566 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 30 12:59:29.789505 ip-10-0-143-153 kubenswrapper[2566]: W0730 12:59:29.788402    2566 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 30 12:59:29.789505 ip-10-0-143-153 kubenswrapper[2566]: W0730 12:59:29.788404    2566 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 30 12:59:29.789505 ip-10-0-143-153 kubenswrapper[2566]: W0730 12:59:29.788407    2566 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 30 12:59:29.789505 ip-10-0-143-153 kubenswrapper[2566]: W0730 12:59:29.788410    2566 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 30 12:59:29.789505 ip-10-0-143-153 kubenswrapper[2566]: W0730 12:59:29.788413    2566 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 30 12:59:29.789505 ip-10-0-143-153 kubenswrapper[2566]: W0730 12:59:29.788415    2566 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 30 12:59:29.789505 ip-10-0-143-153 kubenswrapper[2566]: W0730 12:59:29.788419    2566 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 30 12:59:29.789505 ip-10-0-143-153 kubenswrapper[2566]: W0730 12:59:29.788423    2566 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 30 12:59:29.789505 ip-10-0-143-153 kubenswrapper[2566]: W0730 12:59:29.788426    2566 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 30 12:59:29.789505 ip-10-0-143-153 kubenswrapper[2566]: W0730 12:59:29.788429    2566 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 30 12:59:29.789505 ip-10-0-143-153 kubenswrapper[2566]: W0730 12:59:29.788432    2566 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 30 12:59:29.789505 ip-10-0-143-153 kubenswrapper[2566]: W0730 12:59:29.788435    2566 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 30 12:59:29.789505 ip-10-0-143-153 kubenswrapper[2566]: W0730 12:59:29.788438    2566 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 30 12:59:29.789505 ip-10-0-143-153 kubenswrapper[2566]: W0730 12:59:29.788441    2566 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 30 12:59:29.790024 ip-10-0-143-153 kubenswrapper[2566]: W0730 12:59:29.788444    2566 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 30 12:59:29.790024 ip-10-0-143-153 kubenswrapper[2566]: W0730 12:59:29.788446    2566 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 30 12:59:29.790024 ip-10-0-143-153 kubenswrapper[2566]: W0730 12:59:29.788449    2566 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 30 12:59:29.790024 ip-10-0-143-153 kubenswrapper[2566]: W0730 12:59:29.788452    2566 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 30 12:59:29.790024 ip-10-0-143-153 kubenswrapper[2566]: W0730 12:59:29.788454    2566 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 30 12:59:29.790024 ip-10-0-143-153 kubenswrapper[2566]: W0730 12:59:29.788457    2566 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 30 12:59:29.790024 ip-10-0-143-153 kubenswrapper[2566]: W0730 12:59:29.788460    2566 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 30 12:59:29.790024 ip-10-0-143-153 kubenswrapper[2566]: W0730 12:59:29.788464    2566 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 30 12:59:29.790024 ip-10-0-143-153 kubenswrapper[2566]: W0730 12:59:29.788466    2566 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 30 12:59:29.790024 ip-10-0-143-153 kubenswrapper[2566]: W0730 12:59:29.788469    2566 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 30 12:59:29.790024 ip-10-0-143-153 kubenswrapper[2566]: W0730 12:59:29.788472    2566 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 30 12:59:29.790024 ip-10-0-143-153 kubenswrapper[2566]: W0730 12:59:29.788475    2566 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 30 12:59:29.790024 ip-10-0-143-153 kubenswrapper[2566]: W0730 12:59:29.788478    2566 feature_gate.go:328] unrecognized feature gate: Example2
Jul 30 12:59:29.790024 ip-10-0-143-153 kubenswrapper[2566]: W0730 12:59:29.788480    2566 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 30 12:59:29.790024 ip-10-0-143-153 kubenswrapper[2566]: W0730 12:59:29.788483    2566 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 30 12:59:29.790024 ip-10-0-143-153 kubenswrapper[2566]: W0730 12:59:29.788486    2566 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 30 12:59:29.790024 ip-10-0-143-153 kubenswrapper[2566]: W0730 12:59:29.788489    2566 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 30 12:59:29.790024 ip-10-0-143-153 kubenswrapper[2566]: W0730 12:59:29.788491    2566 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 30 12:59:29.790024 ip-10-0-143-153 kubenswrapper[2566]: W0730 12:59:29.788496    2566 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 30 12:59:29.790497 ip-10-0-143-153 kubenswrapper[2566]: W0730 12:59:29.788499    2566 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 30 12:59:29.790497 ip-10-0-143-153 kubenswrapper[2566]: W0730 12:59:29.788502    2566 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 30 12:59:29.790497 ip-10-0-143-153 kubenswrapper[2566]: W0730 12:59:29.788505    2566 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 30 12:59:29.790497 ip-10-0-143-153 kubenswrapper[2566]: W0730 12:59:29.788508    2566 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 30 12:59:29.790497 ip-10-0-143-153 kubenswrapper[2566]: W0730 12:59:29.788511    2566 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 30 12:59:29.790497 ip-10-0-143-153 kubenswrapper[2566]: W0730 12:59:29.788514    2566 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 30 12:59:29.790497 ip-10-0-143-153 kubenswrapper[2566]: W0730 12:59:29.788517    2566 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 30 12:59:29.790497 ip-10-0-143-153 kubenswrapper[2566]: W0730 12:59:29.788519    2566 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 30 12:59:29.790497 ip-10-0-143-153 kubenswrapper[2566]: W0730 12:59:29.788522    2566 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 30 12:59:29.790497 ip-10-0-143-153 kubenswrapper[2566]: W0730 12:59:29.788525    2566 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 30 12:59:29.790497 ip-10-0-143-153 kubenswrapper[2566]: W0730 12:59:29.788527    2566 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 30 12:59:29.790497 ip-10-0-143-153 kubenswrapper[2566]: W0730 12:59:29.788530    2566 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 30 12:59:29.790497 ip-10-0-143-153 kubenswrapper[2566]: W0730 12:59:29.788532    2566 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 30 12:59:29.790497 ip-10-0-143-153 kubenswrapper[2566]: W0730 12:59:29.788535    2566 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 30 12:59:29.790497 ip-10-0-143-153 kubenswrapper[2566]: W0730 12:59:29.788552    2566 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 30 12:59:29.790497 ip-10-0-143-153 kubenswrapper[2566]: W0730 12:59:29.789256    2566 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 30 12:59:29.790497 ip-10-0-143-153 kubenswrapper[2566]: W0730 12:59:29.789262    2566 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 30 12:59:29.790497 ip-10-0-143-153 kubenswrapper[2566]: W0730 12:59:29.789265    2566 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 30 12:59:29.790497 ip-10-0-143-153 kubenswrapper[2566]: W0730 12:59:29.789268    2566 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 30 12:59:29.790497 ip-10-0-143-153 kubenswrapper[2566]: W0730 12:59:29.789272    2566 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 30 12:59:29.791004 ip-10-0-143-153 kubenswrapper[2566]: W0730 12:59:29.789275    2566 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 30 12:59:29.791004 ip-10-0-143-153 kubenswrapper[2566]: W0730 12:59:29.789277    2566 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 30 12:59:29.791004 ip-10-0-143-153 kubenswrapper[2566]: W0730 12:59:29.789280    2566 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 30 12:59:29.791004 ip-10-0-143-153 kubenswrapper[2566]: W0730 12:59:29.789283    2566 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 30 12:59:29.791004 ip-10-0-143-153 kubenswrapper[2566]: W0730 12:59:29.789288    2566 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 30 12:59:29.791004 ip-10-0-143-153 kubenswrapper[2566]: W0730 12:59:29.789292    2566 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 30 12:59:29.791004 ip-10-0-143-153 kubenswrapper[2566]: W0730 12:59:29.789295    2566 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 30 12:59:29.791004 ip-10-0-143-153 kubenswrapper[2566]: W0730 12:59:29.789298    2566 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 30 12:59:29.791004 ip-10-0-143-153 kubenswrapper[2566]: W0730 12:59:29.789301    2566 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 30 12:59:29.791004 ip-10-0-143-153 kubenswrapper[2566]: W0730 12:59:29.789304    2566 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 30 12:59:29.791004 ip-10-0-143-153 kubenswrapper[2566]: W0730 12:59:29.789307    2566 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 30 12:59:29.791004 ip-10-0-143-153 kubenswrapper[2566]: W0730 12:59:29.789310    2566 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 30 12:59:29.791004 ip-10-0-143-153 kubenswrapper[2566]: W0730 12:59:29.789313    2566 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 30 12:59:29.791004 ip-10-0-143-153 kubenswrapper[2566]: W0730 12:59:29.789316    2566 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 30 12:59:29.791004 ip-10-0-143-153 kubenswrapper[2566]: W0730 12:59:29.789319    2566 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 30 12:59:29.791004 ip-10-0-143-153 kubenswrapper[2566]: W0730 12:59:29.789322    2566 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 30 12:59:29.791004 ip-10-0-143-153 kubenswrapper[2566]: W0730 12:59:29.789324    2566 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 30 12:59:29.791004 ip-10-0-143-153 kubenswrapper[2566]: W0730 12:59:29.789327    2566 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 30 12:59:29.791004 ip-10-0-143-153 kubenswrapper[2566]: W0730 12:59:29.789330    2566 feature_gate.go:328] unrecognized feature gate: Example
Jul 30 12:59:29.791515 ip-10-0-143-153 kubenswrapper[2566]: W0730 12:59:29.789333    2566 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 30 12:59:29.791515 ip-10-0-143-153 kubenswrapper[2566]: W0730 12:59:29.789335    2566 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 30 12:59:29.791515 ip-10-0-143-153 kubenswrapper[2566]: W0730 12:59:29.789338    2566 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 30 12:59:29.791515 ip-10-0-143-153 kubenswrapper[2566]: W0730 12:59:29.789341    2566 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 30 12:59:29.791515 ip-10-0-143-153 kubenswrapper[2566]: W0730 12:59:29.789343    2566 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 30 12:59:29.791515 ip-10-0-143-153 kubenswrapper[2566]: W0730 12:59:29.789347    2566 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 30 12:59:29.791515 ip-10-0-143-153 kubenswrapper[2566]: W0730 12:59:29.789351    2566 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 30 12:59:29.791515 ip-10-0-143-153 kubenswrapper[2566]: W0730 12:59:29.789354    2566 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 30 12:59:29.791515 ip-10-0-143-153 kubenswrapper[2566]: W0730 12:59:29.789356    2566 feature_gate.go:328] unrecognized feature gate: Example2
Jul 30 12:59:29.791515 ip-10-0-143-153 kubenswrapper[2566]: W0730 12:59:29.789359    2566 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 30 12:59:29.791515 ip-10-0-143-153 kubenswrapper[2566]: W0730 12:59:29.789362    2566 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 30 12:59:29.791515 ip-10-0-143-153 kubenswrapper[2566]: W0730 12:59:29.789364    2566 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 30 12:59:29.791515 ip-10-0-143-153 kubenswrapper[2566]: W0730 12:59:29.789368    2566 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 30 12:59:29.791515 ip-10-0-143-153 kubenswrapper[2566]: W0730 12:59:29.789371    2566 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 30 12:59:29.791515 ip-10-0-143-153 kubenswrapper[2566]: W0730 12:59:29.789374    2566 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 30 12:59:29.791515 ip-10-0-143-153 kubenswrapper[2566]: W0730 12:59:29.789377    2566 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 30 12:59:29.791515 ip-10-0-143-153 kubenswrapper[2566]: W0730 12:59:29.789379    2566 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 30 12:59:29.791515 ip-10-0-143-153 kubenswrapper[2566]: W0730 12:59:29.789382    2566 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 30 12:59:29.791515 ip-10-0-143-153 kubenswrapper[2566]: W0730 12:59:29.789384    2566 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 30 12:59:29.792009 ip-10-0-143-153 kubenswrapper[2566]: W0730 12:59:29.789386    2566 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 30 12:59:29.792009 ip-10-0-143-153 kubenswrapper[2566]: W0730 12:59:29.789389    2566 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 30 12:59:29.792009 ip-10-0-143-153 kubenswrapper[2566]: W0730 12:59:29.789391    2566 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 30 12:59:29.792009 ip-10-0-143-153 kubenswrapper[2566]: W0730 12:59:29.789394    2566 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 30 12:59:29.792009 ip-10-0-143-153 kubenswrapper[2566]: W0730 12:59:29.789396    2566 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 30 12:59:29.792009 ip-10-0-143-153 kubenswrapper[2566]: W0730 12:59:29.789399    2566 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 30 12:59:29.792009 ip-10-0-143-153 kubenswrapper[2566]: W0730 12:59:29.789402    2566 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 30 12:59:29.792009 ip-10-0-143-153 kubenswrapper[2566]: W0730 12:59:29.789405    2566 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 30 12:59:29.792009 ip-10-0-143-153 kubenswrapper[2566]: W0730 12:59:29.789408    2566 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 30 12:59:29.792009 ip-10-0-143-153 kubenswrapper[2566]: W0730 12:59:29.789410    2566 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 30 12:59:29.792009 ip-10-0-143-153 kubenswrapper[2566]: W0730 12:59:29.789413    2566 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 30 12:59:29.792009 ip-10-0-143-153 kubenswrapper[2566]: W0730 12:59:29.789415    2566 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 30 12:59:29.792009 ip-10-0-143-153 kubenswrapper[2566]: W0730 12:59:29.789418    2566 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 30 12:59:29.792009 ip-10-0-143-153 kubenswrapper[2566]: W0730 12:59:29.789420    2566 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 30 12:59:29.792009 ip-10-0-143-153 kubenswrapper[2566]: W0730 12:59:29.789423    2566 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 30 12:59:29.792009 ip-10-0-143-153 kubenswrapper[2566]: W0730 12:59:29.789426    2566 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 30 12:59:29.792009 ip-10-0-143-153 kubenswrapper[2566]: W0730 12:59:29.789428    2566 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 30 12:59:29.792009 ip-10-0-143-153 kubenswrapper[2566]: W0730 12:59:29.789430    2566 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 30 12:59:29.792009 ip-10-0-143-153 kubenswrapper[2566]: W0730 12:59:29.789433    2566 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 30 12:59:29.792009 ip-10-0-143-153 kubenswrapper[2566]: W0730 12:59:29.789436    2566 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 30 12:59:29.792503 ip-10-0-143-153 kubenswrapper[2566]: W0730 12:59:29.789438    2566 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 30 12:59:29.792503 ip-10-0-143-153 kubenswrapper[2566]: W0730 12:59:29.789441    2566 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 30 12:59:29.792503 ip-10-0-143-153 kubenswrapper[2566]: W0730 12:59:29.789444    2566 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 30 12:59:29.792503 ip-10-0-143-153 kubenswrapper[2566]: W0730 12:59:29.789447    2566 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 30 12:59:29.792503 ip-10-0-143-153 kubenswrapper[2566]: W0730 12:59:29.789450    2566 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 30 12:59:29.792503 ip-10-0-143-153 kubenswrapper[2566]: W0730 12:59:29.789453    2566 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 30 12:59:29.792503 ip-10-0-143-153 kubenswrapper[2566]: W0730 12:59:29.789456    2566 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 30 12:59:29.792503 ip-10-0-143-153 kubenswrapper[2566]: W0730 12:59:29.789458    2566 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 30 12:59:29.792503 ip-10-0-143-153 kubenswrapper[2566]: W0730 12:59:29.789461    2566 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 30 12:59:29.792503 ip-10-0-143-153 kubenswrapper[2566]: W0730 12:59:29.789463    2566 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 30 12:59:29.792503 ip-10-0-143-153 kubenswrapper[2566]: W0730 12:59:29.789466    2566 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 30 12:59:29.792503 ip-10-0-143-153 kubenswrapper[2566]: W0730 12:59:29.789468    2566 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 30 12:59:29.792503 ip-10-0-143-153 kubenswrapper[2566]: W0730 12:59:29.789471    2566 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 30 12:59:29.792503 ip-10-0-143-153 kubenswrapper[2566]: W0730 12:59:29.789473    2566 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 30 12:59:29.792503 ip-10-0-143-153 kubenswrapper[2566]: W0730 12:59:29.789476    2566 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 30 12:59:29.792503 ip-10-0-143-153 kubenswrapper[2566]: W0730 12:59:29.789479    2566 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 30 12:59:29.792503 ip-10-0-143-153 kubenswrapper[2566]: W0730 12:59:29.789481    2566 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 30 12:59:29.792503 ip-10-0-143-153 kubenswrapper[2566]: W0730 12:59:29.789484    2566 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 30 12:59:29.792503 ip-10-0-143-153 kubenswrapper[2566]: W0730 12:59:29.789486    2566 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 30 12:59:29.792503 ip-10-0-143-153 kubenswrapper[2566]: W0730 12:59:29.789489    2566 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 30 12:59:29.793024 ip-10-0-143-153 kubenswrapper[2566]: W0730 12:59:29.789492    2566 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 30 12:59:29.793024 ip-10-0-143-153 kubenswrapper[2566]: W0730 12:59:29.789495    2566 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 30 12:59:29.793024 ip-10-0-143-153 kubenswrapper[2566]: W0730 12:59:29.789498    2566 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 30 12:59:29.793024 ip-10-0-143-153 kubenswrapper[2566]: W0730 12:59:29.789502    2566 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 30 12:59:29.793024 ip-10-0-143-153 kubenswrapper[2566]: W0730 12:59:29.789505    2566 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 30 12:59:29.793024 ip-10-0-143-153 kubenswrapper[2566]: W0730 12:59:29.789507    2566 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 30 12:59:29.793024 ip-10-0-143-153 kubenswrapper[2566]: W0730 12:59:29.789510    2566 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 30 12:59:29.793024 ip-10-0-143-153 kubenswrapper[2566]: W0730 12:59:29.789513    2566 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 30 12:59:29.793024 ip-10-0-143-153 kubenswrapper[2566]: W0730 12:59:29.789515    2566 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 30 12:59:29.793024 ip-10-0-143-153 kubenswrapper[2566]: W0730 12:59:29.789518    2566 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 30 12:59:29.793024 ip-10-0-143-153 kubenswrapper[2566]: W0730 12:59:29.789521    2566 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 30 12:59:29.793024 ip-10-0-143-153 kubenswrapper[2566]: W0730 12:59:29.789523    2566 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 30 12:59:29.793024 ip-10-0-143-153 kubenswrapper[2566]: W0730 12:59:29.789526    2566 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 30 12:59:29.793024 ip-10-0-143-153 kubenswrapper[2566]: W0730 12:59:29.789528    2566 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 30 12:59:29.793024 ip-10-0-143-153 kubenswrapper[2566]: W0730 12:59:29.789531    2566 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 30 12:59:29.793024 ip-10-0-143-153 kubenswrapper[2566]: W0730 12:59:29.789534    2566 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 30 12:59:29.793024 ip-10-0-143-153 kubenswrapper[2566]: W0730 12:59:29.789962    2566 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 30 12:59:29.793024 ip-10-0-143-153 kubenswrapper[2566]: W0730 12:59:29.789968    2566 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 30 12:59:29.793024 ip-10-0-143-153 kubenswrapper[2566]: W0730 12:59:29.789972    2566 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 30 12:59:29.793024 ip-10-0-143-153 kubenswrapper[2566]: W0730 12:59:29.789975    2566 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 30 12:59:29.793506 ip-10-0-143-153 kubenswrapper[2566]: W0730 12:59:29.789978    2566 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 30 12:59:29.793506 ip-10-0-143-153 kubenswrapper[2566]: W0730 12:59:29.789981    2566 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 30 12:59:29.793506 ip-10-0-143-153 kubenswrapper[2566]: W0730 12:59:29.789983    2566 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 30 12:59:29.793506 ip-10-0-143-153 kubenswrapper[2566]: W0730 12:59:29.789986    2566 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 30 12:59:29.793506 ip-10-0-143-153 kubenswrapper[2566]: W0730 12:59:29.789989    2566 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 30 12:59:29.793506 ip-10-0-143-153 kubenswrapper[2566]: W0730 12:59:29.789993    2566 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 30 12:59:29.793506 ip-10-0-143-153 kubenswrapper[2566]: W0730 12:59:29.789996    2566 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 30 12:59:29.793506 ip-10-0-143-153 kubenswrapper[2566]: W0730 12:59:29.790000    2566 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 30 12:59:29.793506 ip-10-0-143-153 kubenswrapper[2566]: W0730 12:59:29.790003    2566 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 30 12:59:29.793506 ip-10-0-143-153 kubenswrapper[2566]: W0730 12:59:29.790006    2566 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 30 12:59:29.793506 ip-10-0-143-153 kubenswrapper[2566]: W0730 12:59:29.790009    2566 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 30 12:59:29.793506 ip-10-0-143-153 kubenswrapper[2566]: W0730 12:59:29.790012    2566 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 30 12:59:29.793506 ip-10-0-143-153 kubenswrapper[2566]: W0730 12:59:29.790015    2566 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 30 12:59:29.793506 ip-10-0-143-153 kubenswrapper[2566]: W0730 12:59:29.790018    2566 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 30 12:59:29.793506 ip-10-0-143-153 kubenswrapper[2566]: W0730 12:59:29.790020    2566 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 30 12:59:29.793506 ip-10-0-143-153 kubenswrapper[2566]: W0730 12:59:29.790024    2566 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 30 12:59:29.793506 ip-10-0-143-153 kubenswrapper[2566]: W0730 12:59:29.790026    2566 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 30 12:59:29.793506 ip-10-0-143-153 kubenswrapper[2566]: W0730 12:59:29.790029    2566 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 30 12:59:29.793506 ip-10-0-143-153 kubenswrapper[2566]: W0730 12:59:29.790033    2566 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 30 12:59:29.793998 ip-10-0-143-153 kubenswrapper[2566]: W0730 12:59:29.790036    2566 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 30 12:59:29.793998 ip-10-0-143-153 kubenswrapper[2566]: W0730 12:59:29.790038    2566 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 30 12:59:29.793998 ip-10-0-143-153 kubenswrapper[2566]: W0730 12:59:29.790041    2566 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 30 12:59:29.793998 ip-10-0-143-153 kubenswrapper[2566]: W0730 12:59:29.790043    2566 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 30 12:59:29.793998 ip-10-0-143-153 kubenswrapper[2566]: W0730 12:59:29.790046    2566 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 30 12:59:29.793998 ip-10-0-143-153 kubenswrapper[2566]: W0730 12:59:29.790049    2566 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 30 12:59:29.793998 ip-10-0-143-153 kubenswrapper[2566]: W0730 12:59:29.790051    2566 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 30 12:59:29.793998 ip-10-0-143-153 kubenswrapper[2566]: W0730 12:59:29.790054    2566 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 30 12:59:29.793998 ip-10-0-143-153 kubenswrapper[2566]: W0730 12:59:29.790056    2566 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 30 12:59:29.793998 ip-10-0-143-153 kubenswrapper[2566]: W0730 12:59:29.790059    2566 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 30 12:59:29.793998 ip-10-0-143-153 kubenswrapper[2566]: W0730 12:59:29.790071    2566 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 30 12:59:29.793998 ip-10-0-143-153 kubenswrapper[2566]: W0730 12:59:29.790074    2566 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 30 12:59:29.793998 ip-10-0-143-153 kubenswrapper[2566]: W0730 12:59:29.790077    2566 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 30 12:59:29.793998 ip-10-0-143-153 kubenswrapper[2566]: W0730 12:59:29.790079    2566 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 30 12:59:29.793998 ip-10-0-143-153 kubenswrapper[2566]: W0730 12:59:29.790082    2566 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 30 12:59:29.793998 ip-10-0-143-153 kubenswrapper[2566]: W0730 12:59:29.790084    2566 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 30 12:59:29.793998 ip-10-0-143-153 kubenswrapper[2566]: W0730 12:59:29.790087    2566 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 30 12:59:29.793998 ip-10-0-143-153 kubenswrapper[2566]: W0730 12:59:29.790089    2566 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 30 12:59:29.793998 ip-10-0-143-153 kubenswrapper[2566]: W0730 12:59:29.790092    2566 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 30 12:59:29.793998 ip-10-0-143-153 kubenswrapper[2566]: W0730 12:59:29.790094    2566 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 30 12:59:29.794487 ip-10-0-143-153 kubenswrapper[2566]: W0730 12:59:29.790097    2566 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 30 12:59:29.794487 ip-10-0-143-153 kubenswrapper[2566]: W0730 12:59:29.790101    2566 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 30 12:59:29.794487 ip-10-0-143-153 kubenswrapper[2566]: W0730 12:59:29.790103    2566 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 30 12:59:29.794487 ip-10-0-143-153 kubenswrapper[2566]: W0730 12:59:29.790106    2566 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 30 12:59:29.794487 ip-10-0-143-153 kubenswrapper[2566]: W0730 12:59:29.790108    2566 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 30 12:59:29.794487 ip-10-0-143-153 kubenswrapper[2566]: W0730 12:59:29.790111    2566 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 30 12:59:29.794487 ip-10-0-143-153 kubenswrapper[2566]: W0730 12:59:29.790114    2566 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 30 12:59:29.794487 ip-10-0-143-153 kubenswrapper[2566]: W0730 12:59:29.790117    2566 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 30 12:59:29.794487 ip-10-0-143-153 kubenswrapper[2566]: W0730 12:59:29.790120    2566 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 30 12:59:29.794487 ip-10-0-143-153 kubenswrapper[2566]: W0730 12:59:29.790122    2566 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 30 12:59:29.794487 ip-10-0-143-153 kubenswrapper[2566]: W0730 12:59:29.790124    2566 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 30 12:59:29.794487 ip-10-0-143-153 kubenswrapper[2566]: W0730 12:59:29.790127    2566 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 30 12:59:29.794487 ip-10-0-143-153 kubenswrapper[2566]: W0730 12:59:29.790129    2566 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 30 12:59:29.794487 ip-10-0-143-153 kubenswrapper[2566]: W0730 12:59:29.790132    2566 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 30 12:59:29.794487 ip-10-0-143-153 kubenswrapper[2566]: W0730 12:59:29.790134    2566 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 30 12:59:29.794487 ip-10-0-143-153 kubenswrapper[2566]: W0730 12:59:29.790137    2566 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 30 12:59:29.794487 ip-10-0-143-153 kubenswrapper[2566]: W0730 12:59:29.790139    2566 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 30 12:59:29.794487 ip-10-0-143-153 kubenswrapper[2566]: W0730 12:59:29.790142    2566 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 30 12:59:29.794487 ip-10-0-143-153 kubenswrapper[2566]: W0730 12:59:29.790144    2566 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 30 12:59:29.794487 ip-10-0-143-153 kubenswrapper[2566]: W0730 12:59:29.790147    2566 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 30 12:59:29.794998 ip-10-0-143-153 kubenswrapper[2566]: W0730 12:59:29.790149    2566 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 30 12:59:29.794998 ip-10-0-143-153 kubenswrapper[2566]: W0730 12:59:29.790152    2566 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 30 12:59:29.794998 ip-10-0-143-153 kubenswrapper[2566]: W0730 12:59:29.790155    2566 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 30 12:59:29.794998 ip-10-0-143-153 kubenswrapper[2566]: W0730 12:59:29.790157    2566 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 30 12:59:29.794998 ip-10-0-143-153 kubenswrapper[2566]: W0730 12:59:29.790160    2566 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 30 12:59:29.794998 ip-10-0-143-153 kubenswrapper[2566]: W0730 12:59:29.790163    2566 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 30 12:59:29.794998 ip-10-0-143-153 kubenswrapper[2566]: W0730 12:59:29.790165    2566 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 30 12:59:29.794998 ip-10-0-143-153 kubenswrapper[2566]: W0730 12:59:29.790168    2566 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 30 12:59:29.794998 ip-10-0-143-153 kubenswrapper[2566]: W0730 12:59:29.790170    2566 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 30 12:59:29.794998 ip-10-0-143-153 kubenswrapper[2566]: W0730 12:59:29.790173    2566 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 30 12:59:29.794998 ip-10-0-143-153 kubenswrapper[2566]: W0730 12:59:29.790175    2566 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 30 12:59:29.794998 ip-10-0-143-153 kubenswrapper[2566]: W0730 12:59:29.790178    2566 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 30 12:59:29.794998 ip-10-0-143-153 kubenswrapper[2566]: W0730 12:59:29.790183    2566 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 30 12:59:29.794998 ip-10-0-143-153 kubenswrapper[2566]: W0730 12:59:29.790186    2566 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 30 12:59:29.794998 ip-10-0-143-153 kubenswrapper[2566]: W0730 12:59:29.790188    2566 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 30 12:59:29.794998 ip-10-0-143-153 kubenswrapper[2566]: W0730 12:59:29.790191    2566 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 30 12:59:29.794998 ip-10-0-143-153 kubenswrapper[2566]: W0730 12:59:29.790193    2566 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 30 12:59:29.794998 ip-10-0-143-153 kubenswrapper[2566]: W0730 12:59:29.790196    2566 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 30 12:59:29.794998 ip-10-0-143-153 kubenswrapper[2566]: W0730 12:59:29.790198    2566 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 30 12:59:29.794998 ip-10-0-143-153 kubenswrapper[2566]: W0730 12:59:29.790201    2566 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 30 12:59:29.795491 ip-10-0-143-153 kubenswrapper[2566]: W0730 12:59:29.790205    2566 feature_gate.go:328] unrecognized feature gate: Example2
Jul 30 12:59:29.795491 ip-10-0-143-153 kubenswrapper[2566]: W0730 12:59:29.790210    2566 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 30 12:59:29.795491 ip-10-0-143-153 kubenswrapper[2566]: W0730 12:59:29.790213    2566 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 30 12:59:29.795491 ip-10-0-143-153 kubenswrapper[2566]: W0730 12:59:29.790217    2566 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 30 12:59:29.795491 ip-10-0-143-153 kubenswrapper[2566]: W0730 12:59:29.790220    2566 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 30 12:59:29.795491 ip-10-0-143-153 kubenswrapper[2566]: W0730 12:59:29.790223    2566 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 30 12:59:29.795491 ip-10-0-143-153 kubenswrapper[2566]: W0730 12:59:29.790225    2566 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 30 12:59:29.795491 ip-10-0-143-153 kubenswrapper[2566]: W0730 12:59:29.790228    2566 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 30 12:59:29.795491 ip-10-0-143-153 kubenswrapper[2566]: W0730 12:59:29.790231    2566 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 30 12:59:29.795491 ip-10-0-143-153 kubenswrapper[2566]: W0730 12:59:29.790233    2566 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 30 12:59:29.795491 ip-10-0-143-153 kubenswrapper[2566]: W0730 12:59:29.790237    2566 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 30 12:59:29.795491 ip-10-0-143-153 kubenswrapper[2566]: W0730 12:59:29.790241    2566 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 30 12:59:29.795491 ip-10-0-143-153 kubenswrapper[2566]: W0730 12:59:29.790244    2566 feature_gate.go:328] unrecognized feature gate: Example
Jul 30 12:59:29.795491 ip-10-0-143-153 kubenswrapper[2566]: W0730 12:59:29.790247    2566 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 30 12:59:29.795491 ip-10-0-143-153 kubenswrapper[2566]: W0730 12:59:29.790250    2566 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 30 12:59:29.795491 ip-10-0-143-153 kubenswrapper[2566]: W0730 12:59:29.790252    2566 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 30 12:59:29.795491 ip-10-0-143-153 kubenswrapper[2566]: I0730 12:59:29.790316    2566 flags.go:64] FLAG: --address="0.0.0.0"
Jul 30 12:59:29.795491 ip-10-0-143-153 kubenswrapper[2566]: I0730 12:59:29.790323    2566 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]"
Jul 30 12:59:29.795491 ip-10-0-143-153 kubenswrapper[2566]: I0730 12:59:29.790330    2566 flags.go:64] FLAG: --anonymous-auth="true"
Jul 30 12:59:29.795964 ip-10-0-143-153 kubenswrapper[2566]: I0730 12:59:29.790334    2566 flags.go:64] FLAG: --application-metrics-count-limit="100"
Jul 30 12:59:29.795964 ip-10-0-143-153 kubenswrapper[2566]: I0730 12:59:29.790338    2566 flags.go:64] FLAG: --authentication-token-webhook="false"
Jul 30 12:59:29.795964 ip-10-0-143-153 kubenswrapper[2566]: I0730 12:59:29.790341    2566 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s"
Jul 30 12:59:29.795964 ip-10-0-143-153 kubenswrapper[2566]: I0730 12:59:29.790345    2566 flags.go:64] FLAG: --authorization-mode="AlwaysAllow"
Jul 30 12:59:29.795964 ip-10-0-143-153 kubenswrapper[2566]: I0730 12:59:29.790349    2566 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s"
Jul 30 12:59:29.795964 ip-10-0-143-153 kubenswrapper[2566]: I0730 12:59:29.790354    2566 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s"
Jul 30 12:59:29.795964 ip-10-0-143-153 kubenswrapper[2566]: I0730 12:59:29.790357    2566 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id"
Jul 30 12:59:29.795964 ip-10-0-143-153 kubenswrapper[2566]: I0730 12:59:29.790360    2566 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig"
Jul 30 12:59:29.795964 ip-10-0-143-153 kubenswrapper[2566]: I0730 12:59:29.790364    2566 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki"
Jul 30 12:59:29.795964 ip-10-0-143-153 kubenswrapper[2566]: I0730 12:59:29.790366    2566 flags.go:64] FLAG: --cgroup-driver="cgroupfs"
Jul 30 12:59:29.795964 ip-10-0-143-153 kubenswrapper[2566]: I0730 12:59:29.790369    2566 flags.go:64] FLAG: --cgroup-root=""
Jul 30 12:59:29.795964 ip-10-0-143-153 kubenswrapper[2566]: I0730 12:59:29.790372    2566 flags.go:64] FLAG: --cgroups-per-qos="true"
Jul 30 12:59:29.795964 ip-10-0-143-153 kubenswrapper[2566]: I0730 12:59:29.790375    2566 flags.go:64] FLAG: --client-ca-file=""
Jul 30 12:59:29.795964 ip-10-0-143-153 kubenswrapper[2566]: I0730 12:59:29.790379    2566 flags.go:64] FLAG: --cloud-provider="external"
Jul 30 12:59:29.795964 ip-10-0-143-153 kubenswrapper[2566]: I0730 12:59:29.790383    2566 flags.go:64] FLAG: --cluster-dns="[]"
Jul 30 12:59:29.795964 ip-10-0-143-153 kubenswrapper[2566]: I0730 12:59:29.790387    2566 flags.go:64] FLAG: --cluster-domain=""
Jul 30 12:59:29.795964 ip-10-0-143-153 kubenswrapper[2566]: I0730 12:59:29.790390    2566 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf"
Jul 30 12:59:29.795964 ip-10-0-143-153 kubenswrapper[2566]: I0730 12:59:29.790393    2566 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d"
Jul 30 12:59:29.795964 ip-10-0-143-153 kubenswrapper[2566]: I0730 12:59:29.790396    2566 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json"
Jul 30 12:59:29.795964 ip-10-0-143-153 kubenswrapper[2566]: I0730 12:59:29.790399    2566 flags.go:64] FLAG: --container-log-max-files="5"
Jul 30 12:59:29.795964 ip-10-0-143-153 kubenswrapper[2566]: I0730 12:59:29.790403    2566 flags.go:64] FLAG: --container-log-max-size="10Mi"
Jul 30 12:59:29.795964 ip-10-0-143-153 kubenswrapper[2566]: I0730 12:59:29.790406    2566 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock"
Jul 30 12:59:29.795964 ip-10-0-143-153 kubenswrapper[2566]: I0730 12:59:29.790409    2566 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock"
Jul 30 12:59:29.796622 ip-10-0-143-153 kubenswrapper[2566]: I0730 12:59:29.790412    2566 flags.go:64] FLAG: --containerd-namespace="k8s.io"
Jul 30 12:59:29.796622 ip-10-0-143-153 kubenswrapper[2566]: I0730 12:59:29.790415    2566 flags.go:64] FLAG: --contention-profiling="false"
Jul 30 12:59:29.796622 ip-10-0-143-153 kubenswrapper[2566]: I0730 12:59:29.790418    2566 flags.go:64] FLAG: --cpu-cfs-quota="true"
Jul 30 12:59:29.796622 ip-10-0-143-153 kubenswrapper[2566]: I0730 12:59:29.790421    2566 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms"
Jul 30 12:59:29.796622 ip-10-0-143-153 kubenswrapper[2566]: I0730 12:59:29.790424    2566 flags.go:64] FLAG: --cpu-manager-policy="none"
Jul 30 12:59:29.796622 ip-10-0-143-153 kubenswrapper[2566]: I0730 12:59:29.790427    2566 flags.go:64] FLAG: --cpu-manager-policy-options=""
Jul 30 12:59:29.796622 ip-10-0-143-153 kubenswrapper[2566]: I0730 12:59:29.790431    2566 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s"
Jul 30 12:59:29.796622 ip-10-0-143-153 kubenswrapper[2566]: I0730 12:59:29.790434    2566 flags.go:64] FLAG: --enable-controller-attach-detach="true"
Jul 30 12:59:29.796622 ip-10-0-143-153 kubenswrapper[2566]: I0730 12:59:29.790437    2566 flags.go:64] FLAG: --enable-debugging-handlers="true"
Jul 30 12:59:29.796622 ip-10-0-143-153 kubenswrapper[2566]: I0730 12:59:29.790440    2566 flags.go:64] FLAG: --enable-load-reader="false"
Jul 30 12:59:29.796622 ip-10-0-143-153 kubenswrapper[2566]: I0730 12:59:29.790443    2566 flags.go:64] FLAG: --enable-server="true"
Jul 30 12:59:29.796622 ip-10-0-143-153 kubenswrapper[2566]: I0730 12:59:29.790446    2566 flags.go:64] FLAG: --enforce-node-allocatable="[pods]"
Jul 30 12:59:29.796622 ip-10-0-143-153 kubenswrapper[2566]: I0730 12:59:29.790450    2566 flags.go:64] FLAG: --event-burst="100"
Jul 30 12:59:29.796622 ip-10-0-143-153 kubenswrapper[2566]: I0730 12:59:29.790453    2566 flags.go:64] FLAG: --event-qps="50"
Jul 30 12:59:29.796622 ip-10-0-143-153 kubenswrapper[2566]: I0730 12:59:29.790457    2566 flags.go:64] FLAG: --event-storage-age-limit="default=0"
Jul 30 12:59:29.796622 ip-10-0-143-153 kubenswrapper[2566]: I0730 12:59:29.790461    2566 flags.go:64] FLAG: --event-storage-event-limit="default=0"
Jul 30 12:59:29.796622 ip-10-0-143-153 kubenswrapper[2566]: I0730 12:59:29.790464    2566 flags.go:64] FLAG: --eviction-hard=""
Jul 30 12:59:29.796622 ip-10-0-143-153 kubenswrapper[2566]: I0730 12:59:29.790468    2566 flags.go:64] FLAG: --eviction-max-pod-grace-period="0"
Jul 30 12:59:29.796622 ip-10-0-143-153 kubenswrapper[2566]: I0730 12:59:29.790470    2566 flags.go:64] FLAG: --eviction-minimum-reclaim=""
Jul 30 12:59:29.796622 ip-10-0-143-153 kubenswrapper[2566]: I0730 12:59:29.790473    2566 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s"
Jul 30 12:59:29.796622 ip-10-0-143-153 kubenswrapper[2566]: I0730 12:59:29.790476    2566 flags.go:64] FLAG: --eviction-soft=""
Jul 30 12:59:29.796622 ip-10-0-143-153 kubenswrapper[2566]: I0730 12:59:29.790479    2566 flags.go:64] FLAG: --eviction-soft-grace-period=""
Jul 30 12:59:29.796622 ip-10-0-143-153 kubenswrapper[2566]: I0730 12:59:29.790482    2566 flags.go:64] FLAG: --exit-on-lock-contention="false"
Jul 30 12:59:29.796622 ip-10-0-143-153 kubenswrapper[2566]: I0730 12:59:29.790487    2566 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false"
Jul 30 12:59:29.796622 ip-10-0-143-153 kubenswrapper[2566]: I0730 12:59:29.790491    2566 flags.go:64] FLAG: --experimental-mounter-path=""
Jul 30 12:59:29.797283 ip-10-0-143-153 kubenswrapper[2566]: I0730 12:59:29.790494    2566 flags.go:64] FLAG: --fail-cgroupv1="false"
Jul 30 12:59:29.797283 ip-10-0-143-153 kubenswrapper[2566]: I0730 12:59:29.790496    2566 flags.go:64] FLAG: --fail-swap-on="true"
Jul 30 12:59:29.797283 ip-10-0-143-153 kubenswrapper[2566]: I0730 12:59:29.790499    2566 flags.go:64] FLAG: --feature-gates=""
Jul 30 12:59:29.797283 ip-10-0-143-153 kubenswrapper[2566]: I0730 12:59:29.790503    2566 flags.go:64] FLAG: --file-check-frequency="20s"
Jul 30 12:59:29.797283 ip-10-0-143-153 kubenswrapper[2566]: I0730 12:59:29.790506    2566 flags.go:64] FLAG: --global-housekeeping-interval="1m0s"
Jul 30 12:59:29.797283 ip-10-0-143-153 kubenswrapper[2566]: I0730 12:59:29.790509    2566 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge"
Jul 30 12:59:29.797283 ip-10-0-143-153 kubenswrapper[2566]: I0730 12:59:29.790512    2566 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1"
Jul 30 12:59:29.797283 ip-10-0-143-153 kubenswrapper[2566]: I0730 12:59:29.790515    2566 flags.go:64] FLAG: --healthz-port="10248"
Jul 30 12:59:29.797283 ip-10-0-143-153 kubenswrapper[2566]: I0730 12:59:29.790518    2566 flags.go:64] FLAG: --help="false"
Jul 30 12:59:29.797283 ip-10-0-143-153 kubenswrapper[2566]: I0730 12:59:29.790521    2566 flags.go:64] FLAG: --hostname-override="ip-10-0-143-153.ec2.internal"
Jul 30 12:59:29.797283 ip-10-0-143-153 kubenswrapper[2566]: I0730 12:59:29.790524    2566 flags.go:64] FLAG: --housekeeping-interval="10s"
Jul 30 12:59:29.797283 ip-10-0-143-153 kubenswrapper[2566]: I0730 12:59:29.790527    2566 flags.go:64] FLAG: --http-check-frequency="20s"
Jul 30 12:59:29.797283 ip-10-0-143-153 kubenswrapper[2566]: I0730 12:59:29.790548    2566 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins"
Jul 30 12:59:29.797283 ip-10-0-143-153 kubenswrapper[2566]: I0730 12:59:29.790552    2566 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml"
Jul 30 12:59:29.797283 ip-10-0-143-153 kubenswrapper[2566]: I0730 12:59:29.790556    2566 flags.go:64] FLAG: --image-gc-high-threshold="85"
Jul 30 12:59:29.797283 ip-10-0-143-153 kubenswrapper[2566]: I0730 12:59:29.790559    2566 flags.go:64] FLAG: --image-gc-low-threshold="80"
Jul 30 12:59:29.797283 ip-10-0-143-153 kubenswrapper[2566]: I0730 12:59:29.790562    2566 flags.go:64] FLAG: --image-service-endpoint=""
Jul 30 12:59:29.797283 ip-10-0-143-153 kubenswrapper[2566]: I0730 12:59:29.790565    2566 flags.go:64] FLAG: --kernel-memcg-notification="false"
Jul 30 12:59:29.797283 ip-10-0-143-153 kubenswrapper[2566]: I0730 12:59:29.790568    2566 flags.go:64] FLAG: --kube-api-burst="100"
Jul 30 12:59:29.797283 ip-10-0-143-153 kubenswrapper[2566]: I0730 12:59:29.790570    2566 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf"
Jul 30 12:59:29.797283 ip-10-0-143-153 kubenswrapper[2566]: I0730 12:59:29.790574    2566 flags.go:64] FLAG: --kube-api-qps="50"
Jul 30 12:59:29.797283 ip-10-0-143-153 kubenswrapper[2566]: I0730 12:59:29.790578    2566 flags.go:64] FLAG: --kube-reserved=""
Jul 30 12:59:29.797283 ip-10-0-143-153 kubenswrapper[2566]: I0730 12:59:29.790581    2566 flags.go:64] FLAG: --kube-reserved-cgroup=""
Jul 30 12:59:29.797283 ip-10-0-143-153 kubenswrapper[2566]: I0730 12:59:29.790583    2566 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig"
Jul 30 12:59:29.798255 ip-10-0-143-153 kubenswrapper[2566]: I0730 12:59:29.790586    2566 flags.go:64] FLAG: --kubelet-cgroups=""
Jul 30 12:59:29.798255 ip-10-0-143-153 kubenswrapper[2566]: I0730 12:59:29.790589    2566 flags.go:64] FLAG: --local-storage-capacity-isolation="true"
Jul 30 12:59:29.798255 ip-10-0-143-153 kubenswrapper[2566]: I0730 12:59:29.790592    2566 flags.go:64] FLAG: --lock-file=""
Jul 30 12:59:29.798255 ip-10-0-143-153 kubenswrapper[2566]: I0730 12:59:29.790595    2566 flags.go:64] FLAG: --log-cadvisor-usage="false"
Jul 30 12:59:29.798255 ip-10-0-143-153 kubenswrapper[2566]: I0730 12:59:29.790597    2566 flags.go:64] FLAG: --log-flush-frequency="5s"
Jul 30 12:59:29.798255 ip-10-0-143-153 kubenswrapper[2566]: I0730 12:59:29.790600    2566 flags.go:64] FLAG: --log-json-info-buffer-size="0"
Jul 30 12:59:29.798255 ip-10-0-143-153 kubenswrapper[2566]: I0730 12:59:29.790607    2566 flags.go:64] FLAG: --log-json-split-stream="false"
Jul 30 12:59:29.798255 ip-10-0-143-153 kubenswrapper[2566]: I0730 12:59:29.790615    2566 flags.go:64] FLAG: --log-text-info-buffer-size="0"
Jul 30 12:59:29.798255 ip-10-0-143-153 kubenswrapper[2566]: I0730 12:59:29.790618    2566 flags.go:64] FLAG: --log-text-split-stream="false"
Jul 30 12:59:29.798255 ip-10-0-143-153 kubenswrapper[2566]: I0730 12:59:29.790621    2566 flags.go:64] FLAG: --logging-format="text"
Jul 30 12:59:29.798255 ip-10-0-143-153 kubenswrapper[2566]: I0730 12:59:29.790624    2566 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id"
Jul 30 12:59:29.798255 ip-10-0-143-153 kubenswrapper[2566]: I0730 12:59:29.790627    2566 flags.go:64] FLAG: --make-iptables-util-chains="true"
Jul 30 12:59:29.798255 ip-10-0-143-153 kubenswrapper[2566]: I0730 12:59:29.790630    2566 flags.go:64] FLAG: --manifest-url=""
Jul 30 12:59:29.798255 ip-10-0-143-153 kubenswrapper[2566]: I0730 12:59:29.790633    2566 flags.go:64] FLAG: --manifest-url-header=""
Jul 30 12:59:29.798255 ip-10-0-143-153 kubenswrapper[2566]: I0730 12:59:29.790637    2566 flags.go:64] FLAG: --max-housekeeping-interval="15s"
Jul 30 12:59:29.798255 ip-10-0-143-153 kubenswrapper[2566]: I0730 12:59:29.790640    2566 flags.go:64] FLAG: --max-open-files="1000000"
Jul 30 12:59:29.798255 ip-10-0-143-153 kubenswrapper[2566]: I0730 12:59:29.790644    2566 flags.go:64] FLAG: --max-pods="110"
Jul 30 12:59:29.798255 ip-10-0-143-153 kubenswrapper[2566]: I0730 12:59:29.790647    2566 flags.go:64] FLAG: --maximum-dead-containers="-1"
Jul 30 12:59:29.798255 ip-10-0-143-153 kubenswrapper[2566]: I0730 12:59:29.790650    2566 flags.go:64] FLAG: --maximum-dead-containers-per-container="1"
Jul 30 12:59:29.798255 ip-10-0-143-153 kubenswrapper[2566]: I0730 12:59:29.790652    2566 flags.go:64] FLAG: --memory-manager-policy="None"
Jul 30 12:59:29.798255 ip-10-0-143-153 kubenswrapper[2566]: I0730 12:59:29.790655    2566 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s"
Jul 30 12:59:29.798255 ip-10-0-143-153 kubenswrapper[2566]: I0730 12:59:29.790658    2566 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s"
Jul 30 12:59:29.798255 ip-10-0-143-153 kubenswrapper[2566]: I0730 12:59:29.790661    2566 flags.go:64] FLAG: --node-ip="0.0.0.0"
Jul 30 12:59:29.798255 ip-10-0-143-153 kubenswrapper[2566]: I0730 12:59:29.790664    2566 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel"
Jul 30 12:59:29.798255 ip-10-0-143-153 kubenswrapper[2566]: I0730 12:59:29.790670    2566 flags.go:64] FLAG: --node-status-max-images="50"
Jul 30 12:59:29.799332 ip-10-0-143-153 kubenswrapper[2566]: I0730 12:59:29.790673    2566 flags.go:64] FLAG: --node-status-update-frequency="10s"
Jul 30 12:59:29.799332 ip-10-0-143-153 kubenswrapper[2566]: I0730 12:59:29.790676    2566 flags.go:64] FLAG: --oom-score-adj="-999"
Jul 30 12:59:29.799332 ip-10-0-143-153 kubenswrapper[2566]: I0730 12:59:29.790679    2566 flags.go:64] FLAG: --pod-cidr=""
Jul 30 12:59:29.799332 ip-10-0-143-153 kubenswrapper[2566]: I0730 12:59:29.790682    2566 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:7505336a406394b8c1c77d14d890a9f628aa4cfff172312179cb9af8c28c30bb"
Jul 30 12:59:29.799332 ip-10-0-143-153 kubenswrapper[2566]: I0730 12:59:29.790689    2566 flags.go:64] FLAG: --pod-manifest-path=""
Jul 30 12:59:29.799332 ip-10-0-143-153 kubenswrapper[2566]: I0730 12:59:29.790692    2566 flags.go:64] FLAG: --pod-max-pids="-1"
Jul 30 12:59:29.799332 ip-10-0-143-153 kubenswrapper[2566]: I0730 12:59:29.790695    2566 flags.go:64] FLAG: --pods-per-core="0"
Jul 30 12:59:29.799332 ip-10-0-143-153 kubenswrapper[2566]: I0730 12:59:29.790698    2566 flags.go:64] FLAG: --port="10250"
Jul 30 12:59:29.799332 ip-10-0-143-153 kubenswrapper[2566]: I0730 12:59:29.790701    2566 flags.go:64] FLAG: --protect-kernel-defaults="false"
Jul 30 12:59:29.799332 ip-10-0-143-153 kubenswrapper[2566]: I0730 12:59:29.790703    2566 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-0620a22eba3df6558"
Jul 30 12:59:29.799332 ip-10-0-143-153 kubenswrapper[2566]: I0730 12:59:29.790706    2566 flags.go:64] FLAG: --qos-reserved=""
Jul 30 12:59:29.799332 ip-10-0-143-153 kubenswrapper[2566]: I0730 12:59:29.790709    2566 flags.go:64] FLAG: --read-only-port="10255"
Jul 30 12:59:29.799332 ip-10-0-143-153 kubenswrapper[2566]: I0730 12:59:29.790712    2566 flags.go:64] FLAG: --register-node="true"
Jul 30 12:59:29.799332 ip-10-0-143-153 kubenswrapper[2566]: I0730 12:59:29.790715    2566 flags.go:64] FLAG: --register-with-taints=""
Jul 30 12:59:29.799332 ip-10-0-143-153 kubenswrapper[2566]: I0730 12:59:29.790719    2566 flags.go:64] FLAG: --registry-burst="10"
Jul 30 12:59:29.799332 ip-10-0-143-153 kubenswrapper[2566]: I0730 12:59:29.790722    2566 flags.go:64] FLAG: --registry-qps="5"
Jul 30 12:59:29.799332 ip-10-0-143-153 kubenswrapper[2566]: I0730 12:59:29.790725    2566 flags.go:64] FLAG: --reserved-cpus=""
Jul 30 12:59:29.799332 ip-10-0-143-153 kubenswrapper[2566]: I0730 12:59:29.790728    2566 flags.go:64] FLAG: --reserved-memory=""
Jul 30 12:59:29.799332 ip-10-0-143-153 kubenswrapper[2566]: I0730 12:59:29.790731    2566 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf"
Jul 30 12:59:29.799332 ip-10-0-143-153 kubenswrapper[2566]: I0730 12:59:29.790734    2566 flags.go:64] FLAG: --root-dir="/var/lib/kubelet"
Jul 30 12:59:29.799332 ip-10-0-143-153 kubenswrapper[2566]: I0730 12:59:29.790737    2566 flags.go:64] FLAG: --rotate-certificates="false"
Jul 30 12:59:29.799332 ip-10-0-143-153 kubenswrapper[2566]: I0730 12:59:29.790740    2566 flags.go:64] FLAG: --rotate-server-certificates="false"
Jul 30 12:59:29.799332 ip-10-0-143-153 kubenswrapper[2566]: I0730 12:59:29.790743    2566 flags.go:64] FLAG: --runonce="false"
Jul 30 12:59:29.799332 ip-10-0-143-153 kubenswrapper[2566]: I0730 12:59:29.790746    2566 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service"
Jul 30 12:59:29.799332 ip-10-0-143-153 kubenswrapper[2566]: I0730 12:59:29.790749    2566 flags.go:64] FLAG: --runtime-request-timeout="2m0s"
Jul 30 12:59:29.800453 ip-10-0-143-153 kubenswrapper[2566]: I0730 12:59:29.790752    2566 flags.go:64] FLAG: --seccomp-default="false"
Jul 30 12:59:29.800453 ip-10-0-143-153 kubenswrapper[2566]: I0730 12:59:29.790754    2566 flags.go:64] FLAG: --serialize-image-pulls="true"
Jul 30 12:59:29.800453 ip-10-0-143-153 kubenswrapper[2566]: I0730 12:59:29.790757    2566 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s"
Jul 30 12:59:29.800453 ip-10-0-143-153 kubenswrapper[2566]: I0730 12:59:29.790760    2566 flags.go:64] FLAG: --storage-driver-db="cadvisor"
Jul 30 12:59:29.800453 ip-10-0-143-153 kubenswrapper[2566]: I0730 12:59:29.790763    2566 flags.go:64] FLAG: --storage-driver-host="localhost:8086"
Jul 30 12:59:29.800453 ip-10-0-143-153 kubenswrapper[2566]: I0730 12:59:29.790766    2566 flags.go:64] FLAG: --storage-driver-password="root"
Jul 30 12:59:29.800453 ip-10-0-143-153 kubenswrapper[2566]: I0730 12:59:29.790769    2566 flags.go:64] FLAG: --storage-driver-secure="false"
Jul 30 12:59:29.800453 ip-10-0-143-153 kubenswrapper[2566]: I0730 12:59:29.790772    2566 flags.go:64] FLAG: --storage-driver-table="stats"
Jul 30 12:59:29.800453 ip-10-0-143-153 kubenswrapper[2566]: I0730 12:59:29.790775    2566 flags.go:64] FLAG: --storage-driver-user="root"
Jul 30 12:59:29.800453 ip-10-0-143-153 kubenswrapper[2566]: I0730 12:59:29.790778    2566 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s"
Jul 30 12:59:29.800453 ip-10-0-143-153 kubenswrapper[2566]: I0730 12:59:29.790781    2566 flags.go:64] FLAG: --sync-frequency="1m0s"
Jul 30 12:59:29.800453 ip-10-0-143-153 kubenswrapper[2566]: I0730 12:59:29.790785    2566 flags.go:64] FLAG: --system-cgroups=""
Jul 30 12:59:29.800453 ip-10-0-143-153 kubenswrapper[2566]: I0730 12:59:29.790788    2566 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi"
Jul 30 12:59:29.800453 ip-10-0-143-153 kubenswrapper[2566]: I0730 12:59:29.790793    2566 flags.go:64] FLAG: --system-reserved-cgroup=""
Jul 30 12:59:29.800453 ip-10-0-143-153 kubenswrapper[2566]: I0730 12:59:29.790795    2566 flags.go:64] FLAG: --tls-cert-file=""
Jul 30 12:59:29.800453 ip-10-0-143-153 kubenswrapper[2566]: I0730 12:59:29.790798    2566 flags.go:64] FLAG: --tls-cipher-suites="[]"
Jul 30 12:59:29.800453 ip-10-0-143-153 kubenswrapper[2566]: I0730 12:59:29.790802    2566 flags.go:64] FLAG: --tls-min-version=""
Jul 30 12:59:29.800453 ip-10-0-143-153 kubenswrapper[2566]: I0730 12:59:29.790804    2566 flags.go:64] FLAG: --tls-private-key-file=""
Jul 30 12:59:29.800453 ip-10-0-143-153 kubenswrapper[2566]: I0730 12:59:29.790807    2566 flags.go:64] FLAG: --topology-manager-policy="none"
Jul 30 12:59:29.800453 ip-10-0-143-153 kubenswrapper[2566]: I0730 12:59:29.790810    2566 flags.go:64] FLAG: --topology-manager-policy-options=""
Jul 30 12:59:29.800453 ip-10-0-143-153 kubenswrapper[2566]: I0730 12:59:29.790814    2566 flags.go:64] FLAG: --topology-manager-scope="container"
Jul 30 12:59:29.800453 ip-10-0-143-153 kubenswrapper[2566]: I0730 12:59:29.790816    2566 flags.go:64] FLAG: --v="2"
Jul 30 12:59:29.800453 ip-10-0-143-153 kubenswrapper[2566]: I0730 12:59:29.790820    2566 flags.go:64] FLAG: --version="false"
Jul 30 12:59:29.800453 ip-10-0-143-153 kubenswrapper[2566]: I0730 12:59:29.790825    2566 flags.go:64] FLAG: --vmodule=""
Jul 30 12:59:29.800453 ip-10-0-143-153 kubenswrapper[2566]: I0730 12:59:29.790829    2566 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec"
Jul 30 12:59:29.801565 ip-10-0-143-153 kubenswrapper[2566]: I0730 12:59:29.790832    2566 flags.go:64] FLAG: --volume-stats-agg-period="1m0s"
Jul 30 12:59:29.801565 ip-10-0-143-153 kubenswrapper[2566]: W0730 12:59:29.790944    2566 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 30 12:59:29.801565 ip-10-0-143-153 kubenswrapper[2566]: W0730 12:59:29.790947    2566 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 30 12:59:29.801565 ip-10-0-143-153 kubenswrapper[2566]: W0730 12:59:29.790950    2566 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 30 12:59:29.801565 ip-10-0-143-153 kubenswrapper[2566]: W0730 12:59:29.790953    2566 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 30 12:59:29.801565 ip-10-0-143-153 kubenswrapper[2566]: W0730 12:59:29.790956    2566 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 30 12:59:29.801565 ip-10-0-143-153 kubenswrapper[2566]: W0730 12:59:29.790959    2566 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 30 12:59:29.801565 ip-10-0-143-153 kubenswrapper[2566]: W0730 12:59:29.790962    2566 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 30 12:59:29.801565 ip-10-0-143-153 kubenswrapper[2566]: W0730 12:59:29.790965    2566 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 30 12:59:29.801565 ip-10-0-143-153 kubenswrapper[2566]: W0730 12:59:29.790967    2566 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 30 12:59:29.801565 ip-10-0-143-153 kubenswrapper[2566]: W0730 12:59:29.790970    2566 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 30 12:59:29.801565 ip-10-0-143-153 kubenswrapper[2566]: W0730 12:59:29.790972    2566 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 30 12:59:29.801565 ip-10-0-143-153 kubenswrapper[2566]: W0730 12:59:29.790975    2566 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 30 12:59:29.801565 ip-10-0-143-153 kubenswrapper[2566]: W0730 12:59:29.790977    2566 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 30 12:59:29.801565 ip-10-0-143-153 kubenswrapper[2566]: W0730 12:59:29.790980    2566 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 30 12:59:29.801565 ip-10-0-143-153 kubenswrapper[2566]: W0730 12:59:29.790982    2566 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 30 12:59:29.801565 ip-10-0-143-153 kubenswrapper[2566]: W0730 12:59:29.790985    2566 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 30 12:59:29.801565 ip-10-0-143-153 kubenswrapper[2566]: W0730 12:59:29.790987    2566 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 30 12:59:29.801565 ip-10-0-143-153 kubenswrapper[2566]: W0730 12:59:29.790991    2566 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 30 12:59:29.801565 ip-10-0-143-153 kubenswrapper[2566]: W0730 12:59:29.790994    2566 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 30 12:59:29.801565 ip-10-0-143-153 kubenswrapper[2566]: W0730 12:59:29.790996    2566 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 30 12:59:29.802188 ip-10-0-143-153 kubenswrapper[2566]: W0730 12:59:29.790999    2566 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 30 12:59:29.802188 ip-10-0-143-153 kubenswrapper[2566]: W0730 12:59:29.791001    2566 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 30 12:59:29.802188 ip-10-0-143-153 kubenswrapper[2566]: W0730 12:59:29.791003    2566 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 30 12:59:29.802188 ip-10-0-143-153 kubenswrapper[2566]: W0730 12:59:29.791006    2566 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 30 12:59:29.802188 ip-10-0-143-153 kubenswrapper[2566]: W0730 12:59:29.791009    2566 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 30 12:59:29.802188 ip-10-0-143-153 kubenswrapper[2566]: W0730 12:59:29.791012    2566 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 30 12:59:29.802188 ip-10-0-143-153 kubenswrapper[2566]: W0730 12:59:29.791017    2566 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 30 12:59:29.802188 ip-10-0-143-153 kubenswrapper[2566]: W0730 12:59:29.791020    2566 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 30 12:59:29.802188 ip-10-0-143-153 kubenswrapper[2566]: W0730 12:59:29.791022    2566 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 30 12:59:29.802188 ip-10-0-143-153 kubenswrapper[2566]: W0730 12:59:29.791025    2566 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 30 12:59:29.802188 ip-10-0-143-153 kubenswrapper[2566]: W0730 12:59:29.791028    2566 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 30 12:59:29.802188 ip-10-0-143-153 kubenswrapper[2566]: W0730 12:59:29.791031    2566 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 30 12:59:29.802188 ip-10-0-143-153 kubenswrapper[2566]: W0730 12:59:29.791033    2566 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 30 12:59:29.802188 ip-10-0-143-153 kubenswrapper[2566]: W0730 12:59:29.791036    2566 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 30 12:59:29.802188 ip-10-0-143-153 kubenswrapper[2566]: W0730 12:59:29.791038    2566 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 30 12:59:29.802188 ip-10-0-143-153 kubenswrapper[2566]: W0730 12:59:29.791041    2566 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 30 12:59:29.802188 ip-10-0-143-153 kubenswrapper[2566]: W0730 12:59:29.791043    2566 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 30 12:59:29.802188 ip-10-0-143-153 kubenswrapper[2566]: W0730 12:59:29.791046    2566 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 30 12:59:29.802188 ip-10-0-143-153 kubenswrapper[2566]: W0730 12:59:29.791048    2566 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 30 12:59:29.803023 ip-10-0-143-153 kubenswrapper[2566]: W0730 12:59:29.791051    2566 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 30 12:59:29.803023 ip-10-0-143-153 kubenswrapper[2566]: W0730 12:59:29.791053    2566 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 30 12:59:29.803023 ip-10-0-143-153 kubenswrapper[2566]: W0730 12:59:29.791056    2566 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 30 12:59:29.803023 ip-10-0-143-153 kubenswrapper[2566]: W0730 12:59:29.791058    2566 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 30 12:59:29.803023 ip-10-0-143-153 kubenswrapper[2566]: W0730 12:59:29.791060    2566 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 30 12:59:29.803023 ip-10-0-143-153 kubenswrapper[2566]: W0730 12:59:29.791063    2566 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 30 12:59:29.803023 ip-10-0-143-153 kubenswrapper[2566]: W0730 12:59:29.791066    2566 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 30 12:59:29.803023 ip-10-0-143-153 kubenswrapper[2566]: W0730 12:59:29.791068    2566 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 30 12:59:29.803023 ip-10-0-143-153 kubenswrapper[2566]: W0730 12:59:29.791070    2566 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 30 12:59:29.803023 ip-10-0-143-153 kubenswrapper[2566]: W0730 12:59:29.791073    2566 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 30 12:59:29.803023 ip-10-0-143-153 kubenswrapper[2566]: W0730 12:59:29.791077    2566 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 30 12:59:29.803023 ip-10-0-143-153 kubenswrapper[2566]: W0730 12:59:29.791080    2566 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 30 12:59:29.803023 ip-10-0-143-153 kubenswrapper[2566]: W0730 12:59:29.791084    2566 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 30 12:59:29.803023 ip-10-0-143-153 kubenswrapper[2566]: W0730 12:59:29.791087    2566 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 30 12:59:29.803023 ip-10-0-143-153 kubenswrapper[2566]: W0730 12:59:29.791090    2566 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 30 12:59:29.803023 ip-10-0-143-153 kubenswrapper[2566]: W0730 12:59:29.791093    2566 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 30 12:59:29.803023 ip-10-0-143-153 kubenswrapper[2566]: W0730 12:59:29.791096    2566 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 30 12:59:29.803023 ip-10-0-143-153 kubenswrapper[2566]: W0730 12:59:29.791098    2566 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 30 12:59:29.803023 ip-10-0-143-153 kubenswrapper[2566]: W0730 12:59:29.791101    2566 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 30 12:59:29.803868 ip-10-0-143-153 kubenswrapper[2566]: W0730 12:59:29.791107    2566 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 30 12:59:29.803868 ip-10-0-143-153 kubenswrapper[2566]: W0730 12:59:29.791109    2566 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 30 12:59:29.803868 ip-10-0-143-153 kubenswrapper[2566]: W0730 12:59:29.791112    2566 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 30 12:59:29.803868 ip-10-0-143-153 kubenswrapper[2566]: W0730 12:59:29.791115    2566 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 30 12:59:29.803868 ip-10-0-143-153 kubenswrapper[2566]: W0730 12:59:29.791117    2566 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 30 12:59:29.803868 ip-10-0-143-153 kubenswrapper[2566]: W0730 12:59:29.791120    2566 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 30 12:59:29.803868 ip-10-0-143-153 kubenswrapper[2566]: W0730 12:59:29.791123    2566 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 30 12:59:29.803868 ip-10-0-143-153 kubenswrapper[2566]: W0730 12:59:29.791126    2566 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 30 12:59:29.803868 ip-10-0-143-153 kubenswrapper[2566]: W0730 12:59:29.791128    2566 feature_gate.go:328] unrecognized feature gate: Example2
Jul 30 12:59:29.803868 ip-10-0-143-153 kubenswrapper[2566]: W0730 12:59:29.791131    2566 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 30 12:59:29.803868 ip-10-0-143-153 kubenswrapper[2566]: W0730 12:59:29.791134    2566 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 30 12:59:29.803868 ip-10-0-143-153 kubenswrapper[2566]: W0730 12:59:29.791136    2566 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 30 12:59:29.803868 ip-10-0-143-153 kubenswrapper[2566]: W0730 12:59:29.791139    2566 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 30 12:59:29.803868 ip-10-0-143-153 kubenswrapper[2566]: W0730 12:59:29.791141    2566 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 30 12:59:29.803868 ip-10-0-143-153 kubenswrapper[2566]: W0730 12:59:29.791144    2566 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 30 12:59:29.803868 ip-10-0-143-153 kubenswrapper[2566]: W0730 12:59:29.791146    2566 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 30 12:59:29.803868 ip-10-0-143-153 kubenswrapper[2566]: W0730 12:59:29.791149    2566 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 30 12:59:29.803868 ip-10-0-143-153 kubenswrapper[2566]: W0730 12:59:29.791151    2566 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 30 12:59:29.803868 ip-10-0-143-153 kubenswrapper[2566]: W0730 12:59:29.791154    2566 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 30 12:59:29.803868 ip-10-0-143-153 kubenswrapper[2566]: W0730 12:59:29.791156    2566 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 30 12:59:29.804440 ip-10-0-143-153 kubenswrapper[2566]: W0730 12:59:29.791159    2566 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 30 12:59:29.804440 ip-10-0-143-153 kubenswrapper[2566]: W0730 12:59:29.791161    2566 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 30 12:59:29.804440 ip-10-0-143-153 kubenswrapper[2566]: W0730 12:59:29.791164    2566 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 30 12:59:29.804440 ip-10-0-143-153 kubenswrapper[2566]: W0730 12:59:29.791167    2566 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 30 12:59:29.804440 ip-10-0-143-153 kubenswrapper[2566]: W0730 12:59:29.791170    2566 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 30 12:59:29.804440 ip-10-0-143-153 kubenswrapper[2566]: W0730 12:59:29.791174    2566 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 30 12:59:29.804440 ip-10-0-143-153 kubenswrapper[2566]: W0730 12:59:29.791177    2566 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 30 12:59:29.804440 ip-10-0-143-153 kubenswrapper[2566]: W0730 12:59:29.791180    2566 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 30 12:59:29.804440 ip-10-0-143-153 kubenswrapper[2566]: W0730 12:59:29.791183    2566 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 30 12:59:29.804440 ip-10-0-143-153 kubenswrapper[2566]: W0730 12:59:29.791186    2566 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 30 12:59:29.804440 ip-10-0-143-153 kubenswrapper[2566]: W0730 12:59:29.791188    2566 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 30 12:59:29.804440 ip-10-0-143-153 kubenswrapper[2566]: W0730 12:59:29.791191    2566 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 30 12:59:29.804440 ip-10-0-143-153 kubenswrapper[2566]: W0730 12:59:29.791195    2566 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 30 12:59:29.804440 ip-10-0-143-153 kubenswrapper[2566]: W0730 12:59:29.791197    2566 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 30 12:59:29.804440 ip-10-0-143-153 kubenswrapper[2566]: W0730 12:59:29.791200    2566 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 30 12:59:29.804440 ip-10-0-143-153 kubenswrapper[2566]: W0730 12:59:29.791203    2566 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 30 12:59:29.804440 ip-10-0-143-153 kubenswrapper[2566]: W0730 12:59:29.791206    2566 feature_gate.go:328] unrecognized feature gate: Example
Jul 30 12:59:29.804440 ip-10-0-143-153 kubenswrapper[2566]: W0730 12:59:29.791208    2566 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 30 12:59:29.804440 ip-10-0-143-153 kubenswrapper[2566]: W0730 12:59:29.791211    2566 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 30 12:59:29.805069 ip-10-0-143-153 kubenswrapper[2566]: W0730 12:59:29.791214    2566 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 30 12:59:29.805069 ip-10-0-143-153 kubenswrapper[2566]: W0730 12:59:29.791216    2566 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 30 12:59:29.805069 ip-10-0-143-153 kubenswrapper[2566]: I0730 12:59:29.792009    2566 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 30 12:59:29.805069 ip-10-0-143-153 kubenswrapper[2566]: I0730 12:59:29.800050    2566 server.go:529] "Kubelet version" kubeletVersion="v1.34.9"
Jul 30 12:59:29.805069 ip-10-0-143-153 kubenswrapper[2566]: I0730 12:59:29.800076    2566 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK=""
Jul 30 12:59:29.805069 ip-10-0-143-153 kubenswrapper[2566]: I0730 12:59:29.800103    2566 watchdog_linux.go:95] "Systemd watchdog is not enabled"
Jul 30 12:59:29.805069 ip-10-0-143-153 kubenswrapper[2566]: I0730 12:59:29.800122    2566 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started."
Jul 30 12:59:29.805069 ip-10-0-143-153 kubenswrapper[2566]: W0730 12:59:29.800216    2566 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 30 12:59:29.805069 ip-10-0-143-153 kubenswrapper[2566]: W0730 12:59:29.800224    2566 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 30 12:59:29.805069 ip-10-0-143-153 kubenswrapper[2566]: W0730 12:59:29.800229    2566 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 30 12:59:29.805069 ip-10-0-143-153 kubenswrapper[2566]: W0730 12:59:29.800235    2566 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 30 12:59:29.805069 ip-10-0-143-153 kubenswrapper[2566]: W0730 12:59:29.800240    2566 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 30 12:59:29.805069 ip-10-0-143-153 kubenswrapper[2566]: W0730 12:59:29.800245    2566 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 30 12:59:29.805069 ip-10-0-143-153 kubenswrapper[2566]: W0730 12:59:29.800250    2566 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 30 12:59:29.805069 ip-10-0-143-153 kubenswrapper[2566]: W0730 12:59:29.800255    2566 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 30 12:59:29.805455 ip-10-0-143-153 kubenswrapper[2566]: W0730 12:59:29.800260    2566 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 30 12:59:29.805455 ip-10-0-143-153 kubenswrapper[2566]: W0730 12:59:29.800265    2566 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 30 12:59:29.805455 ip-10-0-143-153 kubenswrapper[2566]: W0730 12:59:29.800270    2566 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 30 12:59:29.805455 ip-10-0-143-153 kubenswrapper[2566]: W0730 12:59:29.800275    2566 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 30 12:59:29.805455 ip-10-0-143-153 kubenswrapper[2566]: W0730 12:59:29.800279    2566 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 30 12:59:29.805455 ip-10-0-143-153 kubenswrapper[2566]: W0730 12:59:29.800284    2566 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 30 12:59:29.805455 ip-10-0-143-153 kubenswrapper[2566]: W0730 12:59:29.800289    2566 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 30 12:59:29.805455 ip-10-0-143-153 kubenswrapper[2566]: W0730 12:59:29.800293    2566 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 30 12:59:29.805455 ip-10-0-143-153 kubenswrapper[2566]: W0730 12:59:29.800298    2566 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 30 12:59:29.805455 ip-10-0-143-153 kubenswrapper[2566]: W0730 12:59:29.800302    2566 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 30 12:59:29.805455 ip-10-0-143-153 kubenswrapper[2566]: W0730 12:59:29.800307    2566 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 30 12:59:29.805455 ip-10-0-143-153 kubenswrapper[2566]: W0730 12:59:29.800311    2566 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 30 12:59:29.805455 ip-10-0-143-153 kubenswrapper[2566]: W0730 12:59:29.800315    2566 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 30 12:59:29.805455 ip-10-0-143-153 kubenswrapper[2566]: W0730 12:59:29.800319    2566 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 30 12:59:29.805455 ip-10-0-143-153 kubenswrapper[2566]: W0730 12:59:29.800323    2566 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 30 12:59:29.805455 ip-10-0-143-153 kubenswrapper[2566]: W0730 12:59:29.800327    2566 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 30 12:59:29.805455 ip-10-0-143-153 kubenswrapper[2566]: W0730 12:59:29.800332    2566 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 30 12:59:29.805455 ip-10-0-143-153 kubenswrapper[2566]: W0730 12:59:29.800336    2566 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 30 12:59:29.805455 ip-10-0-143-153 kubenswrapper[2566]: W0730 12:59:29.800340    2566 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 30 12:59:29.805988 ip-10-0-143-153 kubenswrapper[2566]: W0730 12:59:29.800344    2566 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 30 12:59:29.805988 ip-10-0-143-153 kubenswrapper[2566]: W0730 12:59:29.800348    2566 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 30 12:59:29.805988 ip-10-0-143-153 kubenswrapper[2566]: W0730 12:59:29.800361    2566 feature_gate.go:328] unrecognized feature gate: Example2
Jul 30 12:59:29.805988 ip-10-0-143-153 kubenswrapper[2566]: W0730 12:59:29.800366    2566 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 30 12:59:29.805988 ip-10-0-143-153 kubenswrapper[2566]: W0730 12:59:29.800370    2566 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 30 12:59:29.805988 ip-10-0-143-153 kubenswrapper[2566]: W0730 12:59:29.800375    2566 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 30 12:59:29.805988 ip-10-0-143-153 kubenswrapper[2566]: W0730 12:59:29.800379    2566 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 30 12:59:29.805988 ip-10-0-143-153 kubenswrapper[2566]: W0730 12:59:29.800384    2566 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 30 12:59:29.805988 ip-10-0-143-153 kubenswrapper[2566]: W0730 12:59:29.800388    2566 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 30 12:59:29.805988 ip-10-0-143-153 kubenswrapper[2566]: W0730 12:59:29.800392    2566 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 30 12:59:29.805988 ip-10-0-143-153 kubenswrapper[2566]: W0730 12:59:29.800396    2566 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 30 12:59:29.805988 ip-10-0-143-153 kubenswrapper[2566]: W0730 12:59:29.800400    2566 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 30 12:59:29.805988 ip-10-0-143-153 kubenswrapper[2566]: W0730 12:59:29.800405    2566 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 30 12:59:29.805988 ip-10-0-143-153 kubenswrapper[2566]: W0730 12:59:29.800409    2566 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 30 12:59:29.805988 ip-10-0-143-153 kubenswrapper[2566]: W0730 12:59:29.800413    2566 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 30 12:59:29.805988 ip-10-0-143-153 kubenswrapper[2566]: W0730 12:59:29.800417    2566 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 30 12:59:29.805988 ip-10-0-143-153 kubenswrapper[2566]: W0730 12:59:29.800421    2566 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 30 12:59:29.805988 ip-10-0-143-153 kubenswrapper[2566]: W0730 12:59:29.800425    2566 feature_gate.go:328] unrecognized feature gate: Example
Jul 30 12:59:29.805988 ip-10-0-143-153 kubenswrapper[2566]: W0730 12:59:29.800430    2566 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 30 12:59:29.805988 ip-10-0-143-153 kubenswrapper[2566]: W0730 12:59:29.800434    2566 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 30 12:59:29.805988 ip-10-0-143-153 kubenswrapper[2566]: W0730 12:59:29.800438    2566 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 30 12:59:29.806527 ip-10-0-143-153 kubenswrapper[2566]: W0730 12:59:29.800442    2566 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 30 12:59:29.806527 ip-10-0-143-153 kubenswrapper[2566]: W0730 12:59:29.800447    2566 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 30 12:59:29.806527 ip-10-0-143-153 kubenswrapper[2566]: W0730 12:59:29.800451    2566 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 30 12:59:29.806527 ip-10-0-143-153 kubenswrapper[2566]: W0730 12:59:29.800455    2566 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 30 12:59:29.806527 ip-10-0-143-153 kubenswrapper[2566]: W0730 12:59:29.800458    2566 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 30 12:59:29.806527 ip-10-0-143-153 kubenswrapper[2566]: W0730 12:59:29.800462    2566 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 30 12:59:29.806527 ip-10-0-143-153 kubenswrapper[2566]: W0730 12:59:29.800466    2566 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 30 12:59:29.806527 ip-10-0-143-153 kubenswrapper[2566]: W0730 12:59:29.800470    2566 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 30 12:59:29.806527 ip-10-0-143-153 kubenswrapper[2566]: W0730 12:59:29.800474    2566 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 30 12:59:29.806527 ip-10-0-143-153 kubenswrapper[2566]: W0730 12:59:29.800477    2566 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 30 12:59:29.806527 ip-10-0-143-153 kubenswrapper[2566]: W0730 12:59:29.800482    2566 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 30 12:59:29.806527 ip-10-0-143-153 kubenswrapper[2566]: W0730 12:59:29.800486    2566 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 30 12:59:29.806527 ip-10-0-143-153 kubenswrapper[2566]: W0730 12:59:29.800490    2566 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 30 12:59:29.806527 ip-10-0-143-153 kubenswrapper[2566]: W0730 12:59:29.800496    2566 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 30 12:59:29.806527 ip-10-0-143-153 kubenswrapper[2566]: W0730 12:59:29.800509    2566 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 30 12:59:29.806527 ip-10-0-143-153 kubenswrapper[2566]: W0730 12:59:29.800513    2566 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 30 12:59:29.806527 ip-10-0-143-153 kubenswrapper[2566]: W0730 12:59:29.800518    2566 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 30 12:59:29.806527 ip-10-0-143-153 kubenswrapper[2566]: W0730 12:59:29.800522    2566 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 30 12:59:29.806527 ip-10-0-143-153 kubenswrapper[2566]: W0730 12:59:29.800526    2566 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 30 12:59:29.807158 ip-10-0-143-153 kubenswrapper[2566]: W0730 12:59:29.800532    2566 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 30 12:59:29.807158 ip-10-0-143-153 kubenswrapper[2566]: W0730 12:59:29.800559    2566 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 30 12:59:29.807158 ip-10-0-143-153 kubenswrapper[2566]: W0730 12:59:29.800564    2566 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 30 12:59:29.807158 ip-10-0-143-153 kubenswrapper[2566]: W0730 12:59:29.800568    2566 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 30 12:59:29.807158 ip-10-0-143-153 kubenswrapper[2566]: W0730 12:59:29.800573    2566 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 30 12:59:29.807158 ip-10-0-143-153 kubenswrapper[2566]: W0730 12:59:29.800577    2566 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 30 12:59:29.807158 ip-10-0-143-153 kubenswrapper[2566]: W0730 12:59:29.800581    2566 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 30 12:59:29.807158 ip-10-0-143-153 kubenswrapper[2566]: W0730 12:59:29.800586    2566 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 30 12:59:29.807158 ip-10-0-143-153 kubenswrapper[2566]: W0730 12:59:29.800590    2566 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 30 12:59:29.807158 ip-10-0-143-153 kubenswrapper[2566]: W0730 12:59:29.800594    2566 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 30 12:59:29.807158 ip-10-0-143-153 kubenswrapper[2566]: W0730 12:59:29.800598    2566 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 30 12:59:29.807158 ip-10-0-143-153 kubenswrapper[2566]: W0730 12:59:29.800604    2566 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 30 12:59:29.807158 ip-10-0-143-153 kubenswrapper[2566]: W0730 12:59:29.800622    2566 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 30 12:59:29.807158 ip-10-0-143-153 kubenswrapper[2566]: W0730 12:59:29.800628    2566 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 30 12:59:29.807158 ip-10-0-143-153 kubenswrapper[2566]: W0730 12:59:29.800633    2566 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 30 12:59:29.807158 ip-10-0-143-153 kubenswrapper[2566]: W0730 12:59:29.800638    2566 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 30 12:59:29.807158 ip-10-0-143-153 kubenswrapper[2566]: W0730 12:59:29.800642    2566 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 30 12:59:29.807158 ip-10-0-143-153 kubenswrapper[2566]: W0730 12:59:29.800647    2566 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 30 12:59:29.807158 ip-10-0-143-153 kubenswrapper[2566]: W0730 12:59:29.800652    2566 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 30 12:59:29.807717 ip-10-0-143-153 kubenswrapper[2566]: W0730 12:59:29.800656    2566 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 30 12:59:29.807717 ip-10-0-143-153 kubenswrapper[2566]: W0730 12:59:29.800660    2566 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 30 12:59:29.807717 ip-10-0-143-153 kubenswrapper[2566]: W0730 12:59:29.800664    2566 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 30 12:59:29.807717 ip-10-0-143-153 kubenswrapper[2566]: W0730 12:59:29.800669    2566 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 30 12:59:29.807717 ip-10-0-143-153 kubenswrapper[2566]: W0730 12:59:29.800673    2566 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 30 12:59:29.807717 ip-10-0-143-153 kubenswrapper[2566]: W0730 12:59:29.800677    2566 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 30 12:59:29.807717 ip-10-0-143-153 kubenswrapper[2566]: W0730 12:59:29.800682    2566 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 30 12:59:29.807717 ip-10-0-143-153 kubenswrapper[2566]: W0730 12:59:29.800687    2566 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 30 12:59:29.807717 ip-10-0-143-153 kubenswrapper[2566]: W0730 12:59:29.800691    2566 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 30 12:59:29.807717 ip-10-0-143-153 kubenswrapper[2566]: W0730 12:59:29.800704    2566 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 30 12:59:29.807717 ip-10-0-143-153 kubenswrapper[2566]: W0730 12:59:29.800709    2566 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 30 12:59:29.807717 ip-10-0-143-153 kubenswrapper[2566]: W0730 12:59:29.800713    2566 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 30 12:59:29.807717 ip-10-0-143-153 kubenswrapper[2566]: W0730 12:59:29.800717    2566 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 30 12:59:29.807717 ip-10-0-143-153 kubenswrapper[2566]: I0730 12:59:29.800725    2566 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 30 12:59:29.807717 ip-10-0-143-153 kubenswrapper[2566]: W0730 12:59:29.800949    2566 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 30 12:59:29.808090 ip-10-0-143-153 kubenswrapper[2566]: W0730 12:59:29.800958    2566 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 30 12:59:29.808090 ip-10-0-143-153 kubenswrapper[2566]: W0730 12:59:29.800963    2566 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 30 12:59:29.808090 ip-10-0-143-153 kubenswrapper[2566]: W0730 12:59:29.800968    2566 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 30 12:59:29.808090 ip-10-0-143-153 kubenswrapper[2566]: W0730 12:59:29.800972    2566 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 30 12:59:29.808090 ip-10-0-143-153 kubenswrapper[2566]: W0730 12:59:29.800976    2566 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 30 12:59:29.808090 ip-10-0-143-153 kubenswrapper[2566]: W0730 12:59:29.800981    2566 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 30 12:59:29.808090 ip-10-0-143-153 kubenswrapper[2566]: W0730 12:59:29.800985    2566 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 30 12:59:29.808090 ip-10-0-143-153 kubenswrapper[2566]: W0730 12:59:29.800989    2566 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 30 12:59:29.808090 ip-10-0-143-153 kubenswrapper[2566]: W0730 12:59:29.800993    2566 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 30 12:59:29.808090 ip-10-0-143-153 kubenswrapper[2566]: W0730 12:59:29.800998    2566 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 30 12:59:29.808090 ip-10-0-143-153 kubenswrapper[2566]: W0730 12:59:29.801002    2566 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 30 12:59:29.808090 ip-10-0-143-153 kubenswrapper[2566]: W0730 12:59:29.801006    2566 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 30 12:59:29.808090 ip-10-0-143-153 kubenswrapper[2566]: W0730 12:59:29.801010    2566 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 30 12:59:29.808090 ip-10-0-143-153 kubenswrapper[2566]: W0730 12:59:29.801015    2566 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 30 12:59:29.808090 ip-10-0-143-153 kubenswrapper[2566]: W0730 12:59:29.801019    2566 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 30 12:59:29.808090 ip-10-0-143-153 kubenswrapper[2566]: W0730 12:59:29.801024    2566 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 30 12:59:29.808090 ip-10-0-143-153 kubenswrapper[2566]: W0730 12:59:29.801029    2566 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 30 12:59:29.808090 ip-10-0-143-153 kubenswrapper[2566]: W0730 12:59:29.801033    2566 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 30 12:59:29.808090 ip-10-0-143-153 kubenswrapper[2566]: W0730 12:59:29.801037    2566 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 30 12:59:29.808614 ip-10-0-143-153 kubenswrapper[2566]: W0730 12:59:29.801041    2566 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 30 12:59:29.808614 ip-10-0-143-153 kubenswrapper[2566]: W0730 12:59:29.801046    2566 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 30 12:59:29.808614 ip-10-0-143-153 kubenswrapper[2566]: W0730 12:59:29.801050    2566 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 30 12:59:29.808614 ip-10-0-143-153 kubenswrapper[2566]: W0730 12:59:29.801054    2566 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 30 12:59:29.808614 ip-10-0-143-153 kubenswrapper[2566]: W0730 12:59:29.801058    2566 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 30 12:59:29.808614 ip-10-0-143-153 kubenswrapper[2566]: W0730 12:59:29.801062    2566 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 30 12:59:29.808614 ip-10-0-143-153 kubenswrapper[2566]: W0730 12:59:29.801067    2566 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 30 12:59:29.808614 ip-10-0-143-153 kubenswrapper[2566]: W0730 12:59:29.801071    2566 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 30 12:59:29.808614 ip-10-0-143-153 kubenswrapper[2566]: W0730 12:59:29.801084    2566 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 30 12:59:29.808614 ip-10-0-143-153 kubenswrapper[2566]: W0730 12:59:29.801091    2566 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 30 12:59:29.808614 ip-10-0-143-153 kubenswrapper[2566]: W0730 12:59:29.801096    2566 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 30 12:59:29.808614 ip-10-0-143-153 kubenswrapper[2566]: W0730 12:59:29.801100    2566 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 30 12:59:29.808614 ip-10-0-143-153 kubenswrapper[2566]: W0730 12:59:29.801105    2566 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 30 12:59:29.808614 ip-10-0-143-153 kubenswrapper[2566]: W0730 12:59:29.801111    2566 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 30 12:59:29.808614 ip-10-0-143-153 kubenswrapper[2566]: W0730 12:59:29.801115    2566 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 30 12:59:29.808614 ip-10-0-143-153 kubenswrapper[2566]: W0730 12:59:29.801120    2566 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 30 12:59:29.808614 ip-10-0-143-153 kubenswrapper[2566]: W0730 12:59:29.801124    2566 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 30 12:59:29.808614 ip-10-0-143-153 kubenswrapper[2566]: W0730 12:59:29.801129    2566 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 30 12:59:29.808614 ip-10-0-143-153 kubenswrapper[2566]: W0730 12:59:29.801133    2566 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 30 12:59:29.809068 ip-10-0-143-153 kubenswrapper[2566]: W0730 12:59:29.801138    2566 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 30 12:59:29.809068 ip-10-0-143-153 kubenswrapper[2566]: W0730 12:59:29.801141    2566 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 30 12:59:29.809068 ip-10-0-143-153 kubenswrapper[2566]: W0730 12:59:29.801146    2566 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 30 12:59:29.809068 ip-10-0-143-153 kubenswrapper[2566]: W0730 12:59:29.801150    2566 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 30 12:59:29.809068 ip-10-0-143-153 kubenswrapper[2566]: W0730 12:59:29.801154    2566 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 30 12:59:29.809068 ip-10-0-143-153 kubenswrapper[2566]: W0730 12:59:29.801159    2566 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 30 12:59:29.809068 ip-10-0-143-153 kubenswrapper[2566]: W0730 12:59:29.801163    2566 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 30 12:59:29.809068 ip-10-0-143-153 kubenswrapper[2566]: W0730 12:59:29.801167    2566 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 30 12:59:29.809068 ip-10-0-143-153 kubenswrapper[2566]: W0730 12:59:29.801171    2566 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 30 12:59:29.809068 ip-10-0-143-153 kubenswrapper[2566]: W0730 12:59:29.801175    2566 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 30 12:59:29.809068 ip-10-0-143-153 kubenswrapper[2566]: W0730 12:59:29.801179    2566 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 30 12:59:29.809068 ip-10-0-143-153 kubenswrapper[2566]: W0730 12:59:29.801183    2566 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 30 12:59:29.809068 ip-10-0-143-153 kubenswrapper[2566]: W0730 12:59:29.801188    2566 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 30 12:59:29.809068 ip-10-0-143-153 kubenswrapper[2566]: W0730 12:59:29.801192    2566 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 30 12:59:29.809068 ip-10-0-143-153 kubenswrapper[2566]: W0730 12:59:29.801196    2566 feature_gate.go:328] unrecognized feature gate: Example
Jul 30 12:59:29.809068 ip-10-0-143-153 kubenswrapper[2566]: W0730 12:59:29.801200    2566 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 30 12:59:29.809068 ip-10-0-143-153 kubenswrapper[2566]: W0730 12:59:29.801205    2566 feature_gate.go:328] unrecognized feature gate: Example2
Jul 30 12:59:29.809068 ip-10-0-143-153 kubenswrapper[2566]: W0730 12:59:29.801209    2566 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 30 12:59:29.809068 ip-10-0-143-153 kubenswrapper[2566]: W0730 12:59:29.801213    2566 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 30 12:59:29.809068 ip-10-0-143-153 kubenswrapper[2566]: W0730 12:59:29.801218    2566 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 30 12:59:29.809867 ip-10-0-143-153 kubenswrapper[2566]: W0730 12:59:29.801222    2566 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 30 12:59:29.809867 ip-10-0-143-153 kubenswrapper[2566]: W0730 12:59:29.801226    2566 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 30 12:59:29.809867 ip-10-0-143-153 kubenswrapper[2566]: W0730 12:59:29.801238    2566 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 30 12:59:29.809867 ip-10-0-143-153 kubenswrapper[2566]: W0730 12:59:29.801243    2566 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 30 12:59:29.809867 ip-10-0-143-153 kubenswrapper[2566]: W0730 12:59:29.801247    2566 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 30 12:59:29.809867 ip-10-0-143-153 kubenswrapper[2566]: W0730 12:59:29.801251    2566 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 30 12:59:29.809867 ip-10-0-143-153 kubenswrapper[2566]: W0730 12:59:29.801256    2566 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 30 12:59:29.809867 ip-10-0-143-153 kubenswrapper[2566]: W0730 12:59:29.801260    2566 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 30 12:59:29.809867 ip-10-0-143-153 kubenswrapper[2566]: W0730 12:59:29.801264    2566 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 30 12:59:29.809867 ip-10-0-143-153 kubenswrapper[2566]: W0730 12:59:29.801268    2566 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 30 12:59:29.809867 ip-10-0-143-153 kubenswrapper[2566]: W0730 12:59:29.801272    2566 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 30 12:59:29.809867 ip-10-0-143-153 kubenswrapper[2566]: W0730 12:59:29.801276    2566 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 30 12:59:29.809867 ip-10-0-143-153 kubenswrapper[2566]: W0730 12:59:29.801280    2566 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 30 12:59:29.809867 ip-10-0-143-153 kubenswrapper[2566]: W0730 12:59:29.801284    2566 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 30 12:59:29.809867 ip-10-0-143-153 kubenswrapper[2566]: W0730 12:59:29.801289    2566 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 30 12:59:29.809867 ip-10-0-143-153 kubenswrapper[2566]: W0730 12:59:29.801293    2566 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 30 12:59:29.809867 ip-10-0-143-153 kubenswrapper[2566]: W0730 12:59:29.801297    2566 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 30 12:59:29.809867 ip-10-0-143-153 kubenswrapper[2566]: W0730 12:59:29.801301    2566 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 30 12:59:29.809867 ip-10-0-143-153 kubenswrapper[2566]: W0730 12:59:29.801305    2566 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 30 12:59:29.809867 ip-10-0-143-153 kubenswrapper[2566]: W0730 12:59:29.801309    2566 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 30 12:59:29.809867 ip-10-0-143-153 kubenswrapper[2566]: W0730 12:59:29.801313    2566 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 30 12:59:29.810425 ip-10-0-143-153 kubenswrapper[2566]: W0730 12:59:29.801318    2566 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 30 12:59:29.810425 ip-10-0-143-153 kubenswrapper[2566]: W0730 12:59:29.801322    2566 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 30 12:59:29.810425 ip-10-0-143-153 kubenswrapper[2566]: W0730 12:59:29.801326    2566 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 30 12:59:29.810425 ip-10-0-143-153 kubenswrapper[2566]: W0730 12:59:29.801330    2566 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 30 12:59:29.810425 ip-10-0-143-153 kubenswrapper[2566]: W0730 12:59:29.801334    2566 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 30 12:59:29.810425 ip-10-0-143-153 kubenswrapper[2566]: W0730 12:59:29.801338    2566 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 30 12:59:29.810425 ip-10-0-143-153 kubenswrapper[2566]: W0730 12:59:29.801342    2566 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 30 12:59:29.810425 ip-10-0-143-153 kubenswrapper[2566]: W0730 12:59:29.801346    2566 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 30 12:59:29.810425 ip-10-0-143-153 kubenswrapper[2566]: W0730 12:59:29.801350    2566 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 30 12:59:29.810425 ip-10-0-143-153 kubenswrapper[2566]: W0730 12:59:29.801356    2566 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 30 12:59:29.810425 ip-10-0-143-153 kubenswrapper[2566]: W0730 12:59:29.801361    2566 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 30 12:59:29.810425 ip-10-0-143-153 kubenswrapper[2566]: W0730 12:59:29.801365    2566 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 30 12:59:29.810425 ip-10-0-143-153 kubenswrapper[2566]: W0730 12:59:29.801369    2566 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 30 12:59:29.810425 ip-10-0-143-153 kubenswrapper[2566]: W0730 12:59:29.801373    2566 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 30 12:59:29.810425 ip-10-0-143-153 kubenswrapper[2566]: W0730 12:59:29.801389    2566 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 30 12:59:29.810425 ip-10-0-143-153 kubenswrapper[2566]: W0730 12:59:29.801395    2566 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 30 12:59:29.810425 ip-10-0-143-153 kubenswrapper[2566]: W0730 12:59:29.801400    2566 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 30 12:59:29.810425 ip-10-0-143-153 kubenswrapper[2566]: W0730 12:59:29.801405    2566 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 30 12:59:29.810425 ip-10-0-143-153 kubenswrapper[2566]: W0730 12:59:29.801410    2566 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 30 12:59:29.811064 ip-10-0-143-153 kubenswrapper[2566]: I0730 12:59:29.801418    2566 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 30 12:59:29.811064 ip-10-0-143-153 kubenswrapper[2566]: I0730 12:59:29.801618    2566 server.go:962] "Client rotation is on, will bootstrap in background"
Jul 30 12:59:29.811064 ip-10-0-143-153 kubenswrapper[2566]: I0730 12:59:29.804815    2566 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir"
Jul 30 12:59:29.811064 ip-10-0-143-153 kubenswrapper[2566]: I0730 12:59:29.806645    2566 server.go:1019] "Starting client certificate rotation"
Jul 30 12:59:29.811064 ip-10-0-143-153 kubenswrapper[2566]: I0730 12:59:29.806761    2566 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet"
Jul 30 12:59:29.811064 ip-10-0-143-153 kubenswrapper[2566]: I0730 12:59:29.806795    2566 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet"
Jul 30 12:59:29.811319 ip-10-0-143-153 kubenswrapper[2566]: I0730 12:59:29.811194    2566 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Jul 30 12:59:29.813372 ip-10-0-143-153 kubenswrapper[2566]: I0730 12:59:29.813353    2566 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Jul 30 12:59:29.825073 ip-10-0-143-153 kubenswrapper[2566]: I0730 12:59:29.825056    2566 log.go:25] "Validated CRI v1 runtime API"
Jul 30 12:59:29.827512 ip-10-0-143-153 kubenswrapper[2566]: I0730 12:59:29.827500    2566 log.go:25] "Validated CRI v1 image API"
Jul 30 12:59:29.831656 ip-10-0-143-153 kubenswrapper[2566]: I0730 12:59:29.831631    2566 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd"
Jul 30 12:59:29.835914 ip-10-0-143-153 kubenswrapper[2566]: I0730 12:59:29.835893    2566 fs.go:135] Filesystem UUIDs: map[7B77-95E7:/dev/nvme0n1p2 bcd757c5-2d0f-4e56-8deb-86302569d4d2:/dev/nvme0n1p4 bfc75bb9-7db6-4d4c-bc4b-2bfcaf3c519e:/dev/nvme0n1p3]
Jul 30 12:59:29.836004 ip-10-0-143-153 kubenswrapper[2566]: I0730 12:59:29.835913    2566 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}]
Jul 30 12:59:29.842035 ip-10-0-143-153 kubenswrapper[2566]: I0730 12:59:29.841920    2566 manager.go:216] Machine: {Timestamp:2026-07-30 12:59:29.840487078 +0000 UTC m=+0.378712709 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3101817 MemoryCapacity:33164492800 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec20d162fc59305fd37a42858e95eba6 SystemUUID:ec20d162-fc59-305f-d37a-42858e95eba6 BootID:ee49ecf0-5d7c-4a07-b485-4a7128f9b3eb Filesystems:[{Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582246400 Type:vfs Inodes:4048400 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632898560 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6111232 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582246400 Type:vfs Inodes:1048576 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:90:ae:a5:75:73 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:90:ae:a5:75:73 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:e2:bf:08:6d:3c:f3 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164492800 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None}
Jul 30 12:59:29.842035 ip-10-0-143-153 kubenswrapper[2566]: I0730 12:59:29.842028    2566 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available.
Jul 30 12:59:29.842225 ip-10-0-143-153 kubenswrapper[2566]: I0730 12:59:29.842140    2566 manager.go:232] Version: {KernelVersion:5.14.0-570.129.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260717-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:}
Jul 30 12:59:29.845664 ip-10-0-143-153 kubenswrapper[2566]: I0730 12:59:29.845637    2566 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[]
Jul 30 12:59:29.845805 ip-10-0-143-153 kubenswrapper[2566]: I0730 12:59:29.845666    2566 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-143-153.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2}
Jul 30 12:59:29.846505 ip-10-0-143-153 kubenswrapper[2566]: I0730 12:59:29.846494    2566 topology_manager.go:138] "Creating topology manager with none policy"
Jul 30 12:59:29.846558 ip-10-0-143-153 kubenswrapper[2566]: I0730 12:59:29.846506    2566 container_manager_linux.go:309] "Creating device plugin manager"
Jul 30 12:59:29.846558 ip-10-0-143-153 kubenswrapper[2566]: I0730 12:59:29.846518    2566 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock"
Jul 30 12:59:29.846558 ip-10-0-143-153 kubenswrapper[2566]: I0730 12:59:29.846532    2566 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock"
Jul 30 12:59:29.847808 ip-10-0-143-153 kubenswrapper[2566]: I0730 12:59:29.847797    2566 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager"
Jul 30 12:59:29.850655 ip-10-0-143-153 kubenswrapper[2566]: I0730 12:59:29.850634    2566 state_mem.go:36] "Initialized new in-memory state store"
Jul 30 12:59:29.850773 ip-10-0-143-153 kubenswrapper[2566]: I0730 12:59:29.850764    2566 server.go:1240] "Using root directory" path="/var/lib/kubelet"
Jul 30 12:59:29.850817 ip-10-0-143-153 kubenswrapper[2566]: I0730 12:59:29.850793    2566 kubelet.go:486] "Attempting to sync node with API server"
Jul 30 12:59:29.850817 ip-10-0-143-153 kubenswrapper[2566]: I0730 12:59:29.850804    2566 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests"
Jul 30 12:59:29.850881 ip-10-0-143-153 kubenswrapper[2566]: I0730 12:59:29.850817    2566 file.go:69] "Watching path" path="/etc/kubernetes/manifests"
Jul 30 12:59:29.850881 ip-10-0-143-153 kubenswrapper[2566]: I0730 12:59:29.850826    2566 kubelet.go:398] "Adding apiserver pod source"
Jul 30 12:59:29.850881 ip-10-0-143-153 kubenswrapper[2566]: I0730 12:59:29.850835    2566 apiserver.go:42] "Waiting for node sync before watching apiserver pods"
Jul 30 12:59:29.851224 ip-10-0-143-153 kubenswrapper[2566]: I0730 12:59:29.851213    2566 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Jul 30 12:59:29.851261 ip-10-0-143-153 kubenswrapper[2566]: I0730 12:59:29.851231    2566 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Jul 30 12:59:29.854108 ip-10-0-143-153 kubenswrapper[2566]: I0730 12:59:29.854088    2566 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Jul 30 12:59:29.855295 ip-10-0-143-153 kubenswrapper[2566]: I0730 12:59:29.854956    2566 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.10-2.rhaos4.21.git83ee25b.el9" apiVersion="v1"
Jul 30 12:59:29.857912 ip-10-0-143-153 kubenswrapper[2566]: I0730 12:59:29.857895    2566 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled"
Jul 30 12:59:29.857993 ip-10-0-143-153 kubenswrapper[2566]: I0730 12:59:29.857926    2566 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled"
Jul 30 12:59:29.860021 ip-10-0-143-153 kubenswrapper[2566]: I0730 12:59:29.860009    2566 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume"
Jul 30 12:59:29.860069 ip-10-0-143-153 kubenswrapper[2566]: I0730 12:59:29.860025    2566 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir"
Jul 30 12:59:29.860069 ip-10-0-143-153 kubenswrapper[2566]: I0730 12:59:29.860032    2566 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo"
Jul 30 12:59:29.860069 ip-10-0-143-153 kubenswrapper[2566]: I0730 12:59:29.860037    2566 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path"
Jul 30 12:59:29.860069 ip-10-0-143-153 kubenswrapper[2566]: I0730 12:59:29.860046    2566 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs"
Jul 30 12:59:29.860069 ip-10-0-143-153 kubenswrapper[2566]: I0730 12:59:29.860051    2566 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret"
Jul 30 12:59:29.860069 ip-10-0-143-153 kubenswrapper[2566]: I0730 12:59:29.860059    2566 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi"
Jul 30 12:59:29.860069 ip-10-0-143-153 kubenswrapper[2566]: I0730 12:59:29.860065    2566 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api"
Jul 30 12:59:29.860069 ip-10-0-143-153 kubenswrapper[2566]: I0730 12:59:29.860071    2566 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc"
Jul 30 12:59:29.860325 ip-10-0-143-153 kubenswrapper[2566]: I0730 12:59:29.860077    2566 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap"
Jul 30 12:59:29.860325 ip-10-0-143-153 kubenswrapper[2566]: I0730 12:59:29.860085    2566 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected"
Jul 30 12:59:29.860325 ip-10-0-143-153 kubenswrapper[2566]: I0730 12:59:29.860091    2566 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume"
Jul 30 12:59:29.860325 ip-10-0-143-153 kubenswrapper[2566]: I0730 12:59:29.860109    2566 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi"
Jul 30 12:59:29.860325 ip-10-0-143-153 kubenswrapper[2566]: I0730 12:59:29.860114    2566 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image"
Jul 30 12:59:29.863280 ip-10-0-143-153 kubenswrapper[2566]: I0730 12:59:29.863266    2566 server.go:1268] "Started kubelet"
Jul 30 12:59:29.863377 ip-10-0-143-153 kubenswrapper[2566]: I0730 12:59:29.863352    2566 server.go:180] "Starting to listen" address="0.0.0.0" port=10250
Jul 30 12:59:29.863438 ip-10-0-143-153 kubenswrapper[2566]: I0730 12:59:29.863343    2566 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10
Jul 30 12:59:29.863438 ip-10-0-143-153 kubenswrapper[2566]: I0730 12:59:29.863411    2566 server_v1.go:49] "podresources" method="list" useActivePods=true
Jul 30 12:59:29.863822 ip-10-0-143-153 kubenswrapper[2566]: I0730 12:59:29.863802    2566 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-143-153.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope
Jul 30 12:59:29.863931 ip-10-0-143-153 kubenswrapper[2566]: E0730 12:59:29.863821    2566 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-143-153.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node"
Jul 30 12:59:29.863931 ip-10-0-143-153 kubenswrapper[2566]: E0730 12:59:29.863817    2566 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service"
Jul 30 12:59:29.864072 ip-10-0-143-153 systemd[1]: Started Kubernetes Kubelet.
Jul 30 12:59:29.865481 ip-10-0-143-153 kubenswrapper[2566]: I0730 12:59:29.865468    2566 server.go:310] "Adding debug handlers to kubelet server"
Jul 30 12:59:29.865686 ip-10-0-143-153 kubenswrapper[2566]: I0730 12:59:29.865583    2566 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock"
Jul 30 12:59:29.870470 ip-10-0-143-153 kubenswrapper[2566]: E0730 12:59:29.870444    2566 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache"
Jul 30 12:59:29.873234 ip-10-0-143-153 kubenswrapper[2566]: E0730 12:59:29.872083    2566 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-143-153.ec2.internal.18c712ba95db3ccf  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-143-153.ec2.internal,UID:ip-10-0-143-153.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-143-153.ec2.internal,},FirstTimestamp:2026-07-30 12:59:29.863081167 +0000 UTC m=+0.401306798,LastTimestamp:2026-07-30 12:59:29.863081167 +0000 UTC m=+0.401306798,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-143-153.ec2.internal,}"
Jul 30 12:59:29.875067 ip-10-0-143-153 kubenswrapper[2566]: I0730 12:59:29.875044    2566 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving"
Jul 30 12:59:29.875106 ip-10-0-143-153 kubenswrapper[2566]: I0730 12:59:29.875052    2566 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer"
Jul 30 12:59:29.875340 ip-10-0-143-153 kubenswrapper[2566]: E0730 12:59:29.875158    2566 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-143-153.ec2.internal\" not found"
Jul 30 12:59:29.876275 ip-10-0-143-153 kubenswrapper[2566]: I0730 12:59:29.876260    2566 desired_state_of_world_populator.go:146] "Desired state populator starts to run"
Jul 30 12:59:29.876275 ip-10-0-143-153 kubenswrapper[2566]: I0730 12:59:29.876259    2566 volume_manager.go:311] "The desired_state_of_world populator starts"
Jul 30 12:59:29.876407 ip-10-0-143-153 kubenswrapper[2566]: I0730 12:59:29.876286    2566 volume_manager.go:313] "Starting Kubelet Volume Manager"
Jul 30 12:59:29.876407 ip-10-0-143-153 kubenswrapper[2566]: I0730 12:59:29.876396    2566 reconstruct.go:97] "Volume reconstruction finished"
Jul 30 12:59:29.876407 ip-10-0-143-153 kubenswrapper[2566]: I0730 12:59:29.876406    2566 reconciler.go:29] "Reconciler: start to sync state"
Jul 30 12:59:29.876833 ip-10-0-143-153 kubenswrapper[2566]: I0730 12:59:29.876815    2566 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory
Jul 30 12:59:29.876910 ip-10-0-143-153 kubenswrapper[2566]: I0730 12:59:29.876835    2566 factory.go:55] Registering systemd factory
Jul 30 12:59:29.876910 ip-10-0-143-153 kubenswrapper[2566]: I0730 12:59:29.876846    2566 factory.go:223] Registration of the systemd container factory successfully
Jul 30 12:59:29.877086 ip-10-0-143-153 kubenswrapper[2566]: I0730 12:59:29.877072    2566 factory.go:153] Registering CRI-O factory
Jul 30 12:59:29.877151 ip-10-0-143-153 kubenswrapper[2566]: I0730 12:59:29.877088    2566 factory.go:223] Registration of the crio container factory successfully
Jul 30 12:59:29.877151 ip-10-0-143-153 kubenswrapper[2566]: I0730 12:59:29.877109    2566 factory.go:103] Registering Raw factory
Jul 30 12:59:29.877151 ip-10-0-143-153 kubenswrapper[2566]: I0730 12:59:29.877126    2566 manager.go:1196] Started watching for new ooms in manager
Jul 30 12:59:29.877615 ip-10-0-143-153 kubenswrapper[2566]: I0730 12:59:29.877599    2566 manager.go:349] Starting recovery of all containers
Jul 30 12:59:29.881507 ip-10-0-143-153 kubenswrapper[2566]: E0730 12:59:29.881478    2566 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver"
Jul 30 12:59:29.886190 ip-10-0-143-153 kubenswrapper[2566]: E0730 12:59:29.886129    2566 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-143-153.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms"
Jul 30 12:59:29.891079 ip-10-0-143-153 kubenswrapper[2566]: I0730 12:59:29.891062    2566 manager.go:354] Recovery completed
Jul 30 12:59:29.896307 ip-10-0-143-153 kubenswrapper[2566]: I0730 12:59:29.896293    2566 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 30 12:59:29.898788 ip-10-0-143-153 kubenswrapper[2566]: I0730 12:59:29.898180    2566 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-153.ec2.internal" event="NodeHasSufficientMemory"
Jul 30 12:59:29.898788 ip-10-0-143-153 kubenswrapper[2566]: I0730 12:59:29.898215    2566 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-153.ec2.internal" event="NodeHasNoDiskPressure"
Jul 30 12:59:29.898788 ip-10-0-143-153 kubenswrapper[2566]: I0730 12:59:29.898230    2566 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-153.ec2.internal" event="NodeHasSufficientPID"
Jul 30 12:59:29.898788 ip-10-0-143-153 kubenswrapper[2566]: I0730 12:59:29.898769    2566 cpu_manager.go:222] "Starting CPU manager" policy="none"
Jul 30 12:59:29.898788 ip-10-0-143-153 kubenswrapper[2566]: I0730 12:59:29.898778    2566 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s"
Jul 30 12:59:29.898788 ip-10-0-143-153 kubenswrapper[2566]: I0730 12:59:29.898792    2566 state_mem.go:36] "Initialized new in-memory state store"
Jul 30 12:59:29.899081 ip-10-0-143-153 kubenswrapper[2566]: I0730 12:59:29.898861    2566 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 30 12:59:29.899836 ip-10-0-143-153 kubenswrapper[2566]: I0730 12:59:29.899821    2566 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-153.ec2.internal" event="NodeHasSufficientMemory"
Jul 30 12:59:29.899924 ip-10-0-143-153 kubenswrapper[2566]: I0730 12:59:29.899845    2566 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-153.ec2.internal" event="NodeHasNoDiskPressure"
Jul 30 12:59:29.899924 ip-10-0-143-153 kubenswrapper[2566]: I0730 12:59:29.899860    2566 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-153.ec2.internal" event="NodeHasSufficientPID"
Jul 30 12:59:29.901651 ip-10-0-143-153 kubenswrapper[2566]: E0730 12:59:29.901471    2566 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-143-153.ec2.internal.18c712ba97f31bd5  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-143-153.ec2.internal,UID:ip-10-0-143-153.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-143-153.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-143-153.ec2.internal,},FirstTimestamp:2026-07-30 12:59:29.898200021 +0000 UTC m=+0.436425659,LastTimestamp:2026-07-30 12:59:29.898200021 +0000 UTC m=+0.436425659,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-143-153.ec2.internal,}"
Jul 30 12:59:29.901735 ip-10-0-143-153 kubenswrapper[2566]: I0730 12:59:29.901662    2566 policy_none.go:49] "None policy: Start"
Jul 30 12:59:29.901735 ip-10-0-143-153 kubenswrapper[2566]: I0730 12:59:29.901674    2566 memory_manager.go:187] "Starting memorymanager" policy="None"
Jul 30 12:59:29.901735 ip-10-0-143-153 kubenswrapper[2566]: I0730 12:59:29.901684    2566 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint"
Jul 30 12:59:29.903693 ip-10-0-143-153 kubenswrapper[2566]: I0730 12:59:29.903681    2566 policy_none.go:47] "Start"
Jul 30 12:59:29.913744 ip-10-0-143-153 kubenswrapper[2566]: E0730 12:59:29.913672    2566 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-143-153.ec2.internal.18c712ba97f37153  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-143-153.ec2.internal,UID:ip-10-0-143-153.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasNoDiskPressure,Message:Node ip-10-0-143-153.ec2.internal status is now: NodeHasNoDiskPressure,Source:EventSource{Component:kubelet,Host:ip-10-0-143-153.ec2.internal,},FirstTimestamp:2026-07-30 12:59:29.898221907 +0000 UTC m=+0.436447544,LastTimestamp:2026-07-30 12:59:29.898221907 +0000 UTC m=+0.436447544,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-143-153.ec2.internal,}"
Jul 30 12:59:29.920727 ip-10-0-143-153 kubenswrapper[2566]: E0730 12:59:29.920669    2566 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-143-153.ec2.internal.18c712ba97f3a430  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-143-153.ec2.internal,UID:ip-10-0-143-153.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientPID,Message:Node ip-10-0-143-153.ec2.internal status is now: NodeHasSufficientPID,Source:EventSource{Component:kubelet,Host:ip-10-0-143-153.ec2.internal,},FirstTimestamp:2026-07-30 12:59:29.898234928 +0000 UTC m=+0.436460561,LastTimestamp:2026-07-30 12:59:29.898234928 +0000 UTC m=+0.436460561,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-143-153.ec2.internal,}"
Jul 30 12:59:29.930656 ip-10-0-143-153 kubenswrapper[2566]: E0730 12:59:29.930573    2566 event.go:359] "Server rejected event (will not retry!)" err="events \"ip-10-0-143-153.ec2.internal.18c712ba97f31bd5\" is forbidden: User \"system:anonymous\" cannot patch resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-143-153.ec2.internal.18c712ba97f31bd5  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-143-153.ec2.internal,UID:ip-10-0-143-153.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-143-153.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-143-153.ec2.internal,},FirstTimestamp:2026-07-30 12:59:29.898200021 +0000 UTC m=+0.436425659,LastTimestamp:2026-07-30 12:59:29.89983407 +0000 UTC m=+0.438059703,Count:2,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-143-153.ec2.internal,}"
Jul 30 12:59:29.956375 ip-10-0-143-153 kubenswrapper[2566]: E0730 12:59:29.936532    2566 event.go:359] "Server rejected event (will not retry!)" err="events \"ip-10-0-143-153.ec2.internal.18c712ba97f37153\" is forbidden: User \"system:anonymous\" cannot patch resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-143-153.ec2.internal.18c712ba97f37153  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-143-153.ec2.internal,UID:ip-10-0-143-153.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasNoDiskPressure,Message:Node ip-10-0-143-153.ec2.internal status is now: NodeHasNoDiskPressure,Source:EventSource{Component:kubelet,Host:ip-10-0-143-153.ec2.internal,},FirstTimestamp:2026-07-30 12:59:29.898221907 +0000 UTC m=+0.436447544,LastTimestamp:2026-07-30 12:59:29.899852522 +0000 UTC m=+0.438078155,Count:2,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-143-153.ec2.internal,}"
Jul 30 12:59:29.956375 ip-10-0-143-153 kubenswrapper[2566]: E0730 12:59:29.939795    2566 event.go:359] "Server rejected event (will not retry!)" err="events \"ip-10-0-143-153.ec2.internal.18c712ba97f3a430\" is forbidden: User \"system:anonymous\" cannot patch resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-143-153.ec2.internal.18c712ba97f3a430  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-143-153.ec2.internal,UID:ip-10-0-143-153.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientPID,Message:Node ip-10-0-143-153.ec2.internal status is now: NodeHasSufficientPID,Source:EventSource{Component:kubelet,Host:ip-10-0-143-153.ec2.internal,},FirstTimestamp:2026-07-30 12:59:29.898234928 +0000 UTC m=+0.436460561,LastTimestamp:2026-07-30 12:59:29.899865906 +0000 UTC m=+0.438091542,Count:2,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-143-153.ec2.internal,}"
Jul 30 12:59:29.956375 ip-10-0-143-153 kubenswrapper[2566]: I0730 12:59:29.945107    2566 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-8vwwm"
Jul 30 12:59:29.956375 ip-10-0-143-153 kubenswrapper[2566]: I0730 12:59:29.956274    2566 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-8vwwm"
Jul 30 12:59:29.976011 ip-10-0-143-153 kubenswrapper[2566]: E0730 12:59:29.975988    2566 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-143-153.ec2.internal\" not found"
Jul 30 12:59:30.009704 ip-10-0-143-153 kubenswrapper[2566]: I0730 12:59:30.009669    2566 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4"
Jul 30 12:59:30.011011 ip-10-0-143-153 kubenswrapper[2566]: I0730 12:59:30.010992    2566 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6"
Jul 30 12:59:30.011074 ip-10-0-143-153 kubenswrapper[2566]: I0730 12:59:30.011030    2566 status_manager.go:244] "Starting to sync pod status with apiserver"
Jul 30 12:59:30.011118 ip-10-0-143-153 kubenswrapper[2566]: I0730 12:59:30.011082    2566 kubelet.go:2448] "Starting kubelet main sync loop"
Jul 30 12:59:30.011167 ip-10-0-143-153 kubenswrapper[2566]: E0730 12:59:30.011119    2566 kubelet.go:2472] "Skipping pod synchronization" err="[container runtime status check may not have completed yet, PLEG is not healthy: pleg has yet to be successful]"
Jul 30 12:59:30.013607 ip-10-0-143-153 kubenswrapper[2566]: E0730 12:59:30.013575    2566 reflector.go:205] "Failed to watch" err="failed to list *v1.RuntimeClass: runtimeclasses.node.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"runtimeclasses\" in API group \"node.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass"
Jul 30 12:59:30.076586 ip-10-0-143-153 kubenswrapper[2566]: E0730 12:59:30.076440    2566 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-143-153.ec2.internal\" not found"
Jul 30 12:59:30.086595 ip-10-0-143-153 kubenswrapper[2566]: I0730 12:59:30.086578    2566 manager.go:337] "Starting Device Plugin manager"
Jul 30 12:59:30.086693 ip-10-0-143-153 kubenswrapper[2566]: E0730 12:59:30.086665    2566 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint"
Jul 30 12:59:30.086693 ip-10-0-143-153 kubenswrapper[2566]: I0730 12:59:30.086679    2566 server.go:87] "Starting device plugin registration server"
Jul 30 12:59:30.086935 ip-10-0-143-153 kubenswrapper[2566]: I0730 12:59:30.086921    2566 eviction_manager.go:189] "Eviction manager: starting control loop"
Jul 30 12:59:30.087037 ip-10-0-143-153 kubenswrapper[2566]: I0730 12:59:30.086934    2566 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s"
Jul 30 12:59:30.087037 ip-10-0-143-153 kubenswrapper[2566]: I0730 12:59:30.087023    2566 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry"
Jul 30 12:59:30.087128 ip-10-0-143-153 kubenswrapper[2566]: I0730 12:59:30.087093    2566 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts"
Jul 30 12:59:30.087128 ip-10-0-143-153 kubenswrapper[2566]: I0730 12:59:30.087099    2566 plugin_manager.go:118] "Starting Kubelet Plugin Manager"
Jul 30 12:59:30.087713 ip-10-0-143-153 kubenswrapper[2566]: E0730 12:59:30.087674    2566 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\""
Jul 30 12:59:30.087784 ip-10-0-143-153 kubenswrapper[2566]: E0730 12:59:30.087721    2566 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-143-153.ec2.internal\" not found"
Jul 30 12:59:30.100743 ip-10-0-143-153 kubenswrapper[2566]: E0730 12:59:30.100725    2566 nodelease.go:49] "Failed to get node when trying to set owner ref to the node lease" err="nodes \"ip-10-0-143-153.ec2.internal\" not found" node="ip-10-0-143-153.ec2.internal"
Jul 30 12:59:30.111676 ip-10-0-143-153 kubenswrapper[2566]: I0730 12:59:30.111659    2566 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-153.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-143-153.ec2.internal"]
Jul 30 12:59:30.111748 ip-10-0-143-153 kubenswrapper[2566]: I0730 12:59:30.111713    2566 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 30 12:59:30.113013 ip-10-0-143-153 kubenswrapper[2566]: I0730 12:59:30.112993    2566 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-153.ec2.internal" event="NodeHasSufficientMemory"
Jul 30 12:59:30.113097 ip-10-0-143-153 kubenswrapper[2566]: I0730 12:59:30.113026    2566 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-153.ec2.internal" event="NodeHasNoDiskPressure"
Jul 30 12:59:30.113097 ip-10-0-143-153 kubenswrapper[2566]: I0730 12:59:30.113037    2566 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-153.ec2.internal" event="NodeHasSufficientPID"
Jul 30 12:59:30.115296 ip-10-0-143-153 kubenswrapper[2566]: I0730 12:59:30.115284    2566 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 30 12:59:30.115435 ip-10-0-143-153 kubenswrapper[2566]: I0730 12:59:30.115421    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-153.ec2.internal"
Jul 30 12:59:30.115474 ip-10-0-143-153 kubenswrapper[2566]: I0730 12:59:30.115450    2566 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 30 12:59:30.115994 ip-10-0-143-153 kubenswrapper[2566]: I0730 12:59:30.115979    2566 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-153.ec2.internal" event="NodeHasSufficientMemory"
Jul 30 12:59:30.116079 ip-10-0-143-153 kubenswrapper[2566]: I0730 12:59:30.115998    2566 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-153.ec2.internal" event="NodeHasSufficientMemory"
Jul 30 12:59:30.116079 ip-10-0-143-153 kubenswrapper[2566]: I0730 12:59:30.116009    2566 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-153.ec2.internal" event="NodeHasNoDiskPressure"
Jul 30 12:59:30.116079 ip-10-0-143-153 kubenswrapper[2566]: I0730 12:59:30.116015    2566 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-153.ec2.internal" event="NodeHasNoDiskPressure"
Jul 30 12:59:30.116079 ip-10-0-143-153 kubenswrapper[2566]: I0730 12:59:30.116024    2566 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-153.ec2.internal" event="NodeHasSufficientPID"
Jul 30 12:59:30.116079 ip-10-0-143-153 kubenswrapper[2566]: I0730 12:59:30.116024    2566 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-153.ec2.internal" event="NodeHasSufficientPID"
Jul 30 12:59:30.118251 ip-10-0-143-153 kubenswrapper[2566]: I0730 12:59:30.118236    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-143-153.ec2.internal"
Jul 30 12:59:30.118337 ip-10-0-143-153 kubenswrapper[2566]: I0730 12:59:30.118263    2566 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 30 12:59:30.118861 ip-10-0-143-153 kubenswrapper[2566]: I0730 12:59:30.118848    2566 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-153.ec2.internal" event="NodeHasSufficientMemory"
Jul 30 12:59:30.118934 ip-10-0-143-153 kubenswrapper[2566]: I0730 12:59:30.118872    2566 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-153.ec2.internal" event="NodeHasNoDiskPressure"
Jul 30 12:59:30.118934 ip-10-0-143-153 kubenswrapper[2566]: I0730 12:59:30.118885    2566 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-153.ec2.internal" event="NodeHasSufficientPID"
Jul 30 12:59:30.140095 ip-10-0-143-153 kubenswrapper[2566]: E0730 12:59:30.140077    2566 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-143-153.ec2.internal\" not found" node="ip-10-0-143-153.ec2.internal"
Jul 30 12:59:30.144348 ip-10-0-143-153 kubenswrapper[2566]: E0730 12:59:30.144335    2566 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-143-153.ec2.internal\" not found" node="ip-10-0-143-153.ec2.internal"
Jul 30 12:59:30.177818 ip-10-0-143-153 kubenswrapper[2566]: I0730 12:59:30.177795    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/a8e6a8f600eea6e545d463bd99143fa2-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-143-153.ec2.internal\" (UID: \"a8e6a8f600eea6e545d463bd99143fa2\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-153.ec2.internal"
Jul 30 12:59:30.177889 ip-10-0-143-153 kubenswrapper[2566]: I0730 12:59:30.177823    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/a8e6a8f600eea6e545d463bd99143fa2-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-143-153.ec2.internal\" (UID: \"a8e6a8f600eea6e545d463bd99143fa2\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-153.ec2.internal"
Jul 30 12:59:30.177889 ip-10-0-143-153 kubenswrapper[2566]: I0730 12:59:30.177843    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/3327a5e598b8ce026a5b536fdb99458b-config\") pod \"kube-apiserver-proxy-ip-10-0-143-153.ec2.internal\" (UID: \"3327a5e598b8ce026a5b536fdb99458b\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-143-153.ec2.internal"
Jul 30 12:59:30.187393 ip-10-0-143-153 kubenswrapper[2566]: I0730 12:59:30.187377    2566 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 30 12:59:30.188242 ip-10-0-143-153 kubenswrapper[2566]: I0730 12:59:30.188227    2566 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-153.ec2.internal" event="NodeHasSufficientMemory"
Jul 30 12:59:30.188302 ip-10-0-143-153 kubenswrapper[2566]: I0730 12:59:30.188254    2566 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-153.ec2.internal" event="NodeHasNoDiskPressure"
Jul 30 12:59:30.188302 ip-10-0-143-153 kubenswrapper[2566]: I0730 12:59:30.188264    2566 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-153.ec2.internal" event="NodeHasSufficientPID"
Jul 30 12:59:30.188302 ip-10-0-143-153 kubenswrapper[2566]: I0730 12:59:30.188298    2566 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-143-153.ec2.internal"
Jul 30 12:59:30.196830 ip-10-0-143-153 kubenswrapper[2566]: I0730 12:59:30.196812    2566 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-143-153.ec2.internal"
Jul 30 12:59:30.196878 ip-10-0-143-153 kubenswrapper[2566]: E0730 12:59:30.196838    2566 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-143-153.ec2.internal\": node \"ip-10-0-143-153.ec2.internal\" not found"
Jul 30 12:59:30.215719 ip-10-0-143-153 kubenswrapper[2566]: E0730 12:59:30.215694    2566 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-143-153.ec2.internal\" not found"
Jul 30 12:59:30.278861 ip-10-0-143-153 kubenswrapper[2566]: I0730 12:59:30.278829    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/a8e6a8f600eea6e545d463bd99143fa2-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-143-153.ec2.internal\" (UID: \"a8e6a8f600eea6e545d463bd99143fa2\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-153.ec2.internal"
Jul 30 12:59:30.279012 ip-10-0-143-153 kubenswrapper[2566]: I0730 12:59:30.278865    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/3327a5e598b8ce026a5b536fdb99458b-config\") pod \"kube-apiserver-proxy-ip-10-0-143-153.ec2.internal\" (UID: \"3327a5e598b8ce026a5b536fdb99458b\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-143-153.ec2.internal"
Jul 30 12:59:30.279012 ip-10-0-143-153 kubenswrapper[2566]: I0730 12:59:30.278888    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/a8e6a8f600eea6e545d463bd99143fa2-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-143-153.ec2.internal\" (UID: \"a8e6a8f600eea6e545d463bd99143fa2\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-153.ec2.internal"
Jul 30 12:59:30.279012 ip-10-0-143-153 kubenswrapper[2566]: I0730 12:59:30.278931    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/a8e6a8f600eea6e545d463bd99143fa2-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-143-153.ec2.internal\" (UID: \"a8e6a8f600eea6e545d463bd99143fa2\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-153.ec2.internal"
Jul 30 12:59:30.279012 ip-10-0-143-153 kubenswrapper[2566]: I0730 12:59:30.278937    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/a8e6a8f600eea6e545d463bd99143fa2-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-143-153.ec2.internal\" (UID: \"a8e6a8f600eea6e545d463bd99143fa2\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-153.ec2.internal"
Jul 30 12:59:30.279012 ip-10-0-143-153 kubenswrapper[2566]: I0730 12:59:30.278944    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/3327a5e598b8ce026a5b536fdb99458b-config\") pod \"kube-apiserver-proxy-ip-10-0-143-153.ec2.internal\" (UID: \"3327a5e598b8ce026a5b536fdb99458b\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-143-153.ec2.internal"
Jul 30 12:59:30.316125 ip-10-0-143-153 kubenswrapper[2566]: E0730 12:59:30.316067    2566 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-143-153.ec2.internal\" not found"
Jul 30 12:59:30.416796 ip-10-0-143-153 kubenswrapper[2566]: E0730 12:59:30.416755    2566 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-143-153.ec2.internal\" not found"
Jul 30 12:59:30.442947 ip-10-0-143-153 kubenswrapper[2566]: I0730 12:59:30.442923    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-153.ec2.internal"
Jul 30 12:59:30.448512 ip-10-0-143-153 kubenswrapper[2566]: I0730 12:59:30.447746    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-143-153.ec2.internal"
Jul 30 12:59:32.126850 ip-10-0-143-153 kubenswrapper[2566]: E0730 12:59:32.126827    2566 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-143-153.ec2.internal\" not found"
Jul 30 12:59:32.227453 ip-10-0-143-153 kubenswrapper[2566]: E0730 12:59:32.227383    2566 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-143-153.ec2.internal\" not found"
Jul 30 12:59:32.327951 ip-10-0-143-153 kubenswrapper[2566]: E0730 12:59:32.327908    2566 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-143-153.ec2.internal\" not found"
Jul 30 12:59:32.360685 ip-10-0-143-153 kubenswrapper[2566]: I0730 12:59:32.360653    2566 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 30 12:59:32.385168 ip-10-0-143-153 kubenswrapper[2566]: I0730 12:59:32.385143    2566 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-153.ec2.internal"
Jul 30 12:59:32.396818 ip-10-0-143-153 kubenswrapper[2566]: I0730 12:59:32.396792    2566 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Jul 30 12:59:32.398358 ip-10-0-143-153 kubenswrapper[2566]: I0730 12:59:32.398344    2566 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-143-153.ec2.internal"
Jul 30 12:59:32.408907 ip-10-0-143-153 kubenswrapper[2566]: I0730 12:59:32.408894    2566 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Jul 30 12:59:32.415045 ip-10-0-143-153 kubenswrapper[2566]: I0730 12:59:32.415028    2566 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials"
Jul 30 12:59:32.415169 ip-10-0-143-153 kubenswrapper[2566]: I0730 12:59:32.415153    2566 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
Jul 30 12:59:32.461539 ip-10-0-143-153 kubenswrapper[2566]: I0730 12:59:32.461520    2566 apiserver.go:52] "Watching apiserver"
Jul 30 12:59:32.473930 ip-10-0-143-153 kubenswrapper[2566]: I0730 12:59:32.473906    2566 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66"
Jul 30 12:59:32.474314 ip-10-0-143-153 kubenswrapper[2566]: I0730 12:59:32.474292    2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-diagnostics/network-check-target-bjnvm","openshift-network-operator/iptables-alerter-m8zwx","kube-system/kube-apiserver-proxy-ip-10-0-143-153.ec2.internal","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4fdfw","openshift-dns/node-resolver-4tzjz","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-153.ec2.internal","openshift-multus/multus-gppm2","openshift-multus/network-metrics-daemon-kb44p","openshift-ovn-kubernetes/ovnkube-node-f6br6","kube-system/global-pull-secret-syncer-9bp7v","kube-system/konnectivity-agent-qt2mr","openshift-cluster-node-tuning-operator/tuned-pvtx9","openshift-image-registry/node-ca-9lmmp","openshift-multus/multus-additional-cni-plugins-8br4n"]
Jul 30 12:59:32.476678 ip-10-0-143-153 kubenswrapper[2566]: I0730 12:59:32.476659    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-gppm2"
Jul 30 12:59:32.478227 ip-10-0-143-153 kubenswrapper[2566]: I0730 12:59:32.478186    2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\""
Jul 30 12:59:32.478321 ip-10-0-143-153 kubenswrapper[2566]: I0730 12:59:32.478283    2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\""
Jul 30 12:59:32.478321 ip-10-0-143-153 kubenswrapper[2566]: I0730 12:59:32.478302    2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\""
Jul 30 12:59:32.478403 ip-10-0-143-153 kubenswrapper[2566]: I0730 12:59:32.478304    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-gw6dk\""
Jul 30 12:59:32.478590 ip-10-0-143-153 kubenswrapper[2566]: I0730 12:59:32.478575    2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\""
Jul 30 12:59:32.479512 ip-10-0-143-153 kubenswrapper[2566]: I0730 12:59:32.479496    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-9lmmp"
Jul 30 12:59:32.480859 ip-10-0-143-153 kubenswrapper[2566]: I0730 12:59:32.480843    2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\""
Jul 30 12:59:32.481088 ip-10-0-143-153 kubenswrapper[2566]: I0730 12:59:32.481058    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-f5b9b\""
Jul 30 12:59:32.481130 ip-10-0-143-153 kubenswrapper[2566]: I0730 12:59:32.481107    2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\""
Jul 30 12:59:32.481168 ip-10-0-143-153 kubenswrapper[2566]: I0730 12:59:32.481151    2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\""
Jul 30 12:59:32.481880 ip-10-0-143-153 kubenswrapper[2566]: I0730 12:59:32.481864    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-8br4n"
Jul 30 12:59:32.483345 ip-10-0-143-153 kubenswrapper[2566]: I0730 12:59:32.483329    2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\""
Jul 30 12:59:32.483436 ip-10-0-143-153 kubenswrapper[2566]: I0730 12:59:32.483425    2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\""
Jul 30 12:59:32.483494 ip-10-0-143-153 kubenswrapper[2566]: I0730 12:59:32.483481    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-mzt7l\""
Jul 30 12:59:32.484096 ip-10-0-143-153 kubenswrapper[2566]: I0730 12:59:32.484068    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4fdfw"
Jul 30 12:59:32.485715 ip-10-0-143-153 kubenswrapper[2566]: I0730 12:59:32.485700    2566 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving"
Jul 30 12:59:32.485972 ip-10-0-143-153 kubenswrapper[2566]: I0730 12:59:32.485935    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\""
Jul 30 12:59:32.486101 ip-10-0-143-153 kubenswrapper[2566]: I0730 12:59:32.485980    2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\""
Jul 30 12:59:32.486101 ip-10-0-143-153 kubenswrapper[2566]: I0730 12:59:32.486020    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-72zcs\""
Jul 30 12:59:32.486101 ip-10-0-143-153 kubenswrapper[2566]: I0730 12:59:32.485947    2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\""
Jul 30 12:59:32.486327 ip-10-0-143-153 kubenswrapper[2566]: I0730 12:59:32.486313    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-4tzjz"
Jul 30 12:59:32.487782 ip-10-0-143-153 kubenswrapper[2566]: I0730 12:59:32.487767    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-ssztn\""
Jul 30 12:59:32.488213 ip-10-0-143-153 kubenswrapper[2566]: I0730 12:59:32.488198    2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\""
Jul 30 12:59:32.488356 ip-10-0-143-153 kubenswrapper[2566]: I0730 12:59:32.488345    2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\""
Jul 30 12:59:32.488741 ip-10-0-143-153 kubenswrapper[2566]: I0730 12:59:32.488728    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-kb44p"
Jul 30 12:59:32.488797 ip-10-0-143-153 kubenswrapper[2566]: E0730 12:59:32.488779    2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-kb44p" podUID="995cd086-39a7-4097-971a-1c4e6c08576b"
Jul 30 12:59:32.491807 ip-10-0-143-153 kubenswrapper[2566]: I0730 12:59:32.491785    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/0e113987-a362-4c64-825a-1f883ab76ec9-cni-binary-copy\") pod \"multus-additional-cni-plugins-8br4n\" (UID: \"0e113987-a362-4c64-825a-1f883ab76ec9\") " pod="openshift-multus/multus-additional-cni-plugins-8br4n"
Jul 30 12:59:32.491880 ip-10-0-143-153 kubenswrapper[2566]: I0730 12:59:32.491831    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/0e113987-a362-4c64-825a-1f883ab76ec9-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-8br4n\" (UID: \"0e113987-a362-4c64-825a-1f883ab76ec9\") " pod="openshift-multus/multus-additional-cni-plugins-8br4n"
Jul 30 12:59:32.491880 ip-10-0-143-153 kubenswrapper[2566]: I0730 12:59:32.491848    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/d1644e14-73e0-40a9-a205-7bdd0eefe290-host-var-lib-cni-multus\") pod \"multus-gppm2\" (UID: \"d1644e14-73e0-40a9-a205-7bdd0eefe290\") " pod="openshift-multus/multus-gppm2"
Jul 30 12:59:32.491880 ip-10-0-143-153 kubenswrapper[2566]: I0730 12:59:32.491868    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/d1644e14-73e0-40a9-a205-7bdd0eefe290-system-cni-dir\") pod \"multus-gppm2\" (UID: \"d1644e14-73e0-40a9-a205-7bdd0eefe290\") " pod="openshift-multus/multus-gppm2"
Jul 30 12:59:32.492055 ip-10-0-143-153 kubenswrapper[2566]: I0730 12:59:32.491891    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/d1644e14-73e0-40a9-a205-7bdd0eefe290-multus-cni-dir\") pod \"multus-gppm2\" (UID: \"d1644e14-73e0-40a9-a205-7bdd0eefe290\") " pod="openshift-multus/multus-gppm2"
Jul 30 12:59:32.492055 ip-10-0-143-153 kubenswrapper[2566]: I0730 12:59:32.491915    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/abe34634-20e4-4e0b-9d22-565c35543229-socket-dir\") pod \"aws-ebs-csi-driver-node-4fdfw\" (UID: \"abe34634-20e4-4e0b-9d22-565c35543229\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4fdfw"
Jul 30 12:59:32.492055 ip-10-0-143-153 kubenswrapper[2566]: I0730 12:59:32.491937    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/abe34634-20e4-4e0b-9d22-565c35543229-sys-fs\") pod \"aws-ebs-csi-driver-node-4fdfw\" (UID: \"abe34634-20e4-4e0b-9d22-565c35543229\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4fdfw"
Jul 30 12:59:32.492055 ip-10-0-143-153 kubenswrapper[2566]: I0730 12:59:32.491962    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/95057af8-5515-4bb3-9147-613240e101bb-hosts-file\") pod \"node-resolver-4tzjz\" (UID: \"95057af8-5515-4bb3-9147-613240e101bb\") " pod="openshift-dns/node-resolver-4tzjz"
Jul 30 12:59:32.492055 ip-10-0-143-153 kubenswrapper[2566]: I0730 12:59:32.492002    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-f6br6"
Jul 30 12:59:32.492055 ip-10-0-143-153 kubenswrapper[2566]: I0730 12:59:32.492006    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/d1644e14-73e0-40a9-a205-7bdd0eefe290-host-run-k8s-cni-cncf-io\") pod \"multus-gppm2\" (UID: \"d1644e14-73e0-40a9-a205-7bdd0eefe290\") " pod="openshift-multus/multus-gppm2"
Jul 30 12:59:32.492055 ip-10-0-143-153 kubenswrapper[2566]: I0730 12:59:32.492034    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/b6cb9164-228a-4fff-b909-8be034a2b11a-host\") pod \"node-ca-9lmmp\" (UID: \"b6cb9164-228a-4fff-b909-8be034a2b11a\") " pod="openshift-image-registry/node-ca-9lmmp"
Jul 30 12:59:32.492390 ip-10-0-143-153 kubenswrapper[2566]: I0730 12:59:32.492071    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/b6cb9164-228a-4fff-b909-8be034a2b11a-serviceca\") pod \"node-ca-9lmmp\" (UID: \"b6cb9164-228a-4fff-b909-8be034a2b11a\") " pod="openshift-image-registry/node-ca-9lmmp"
Jul 30 12:59:32.492390 ip-10-0-143-153 kubenswrapper[2566]: I0730 12:59:32.492127    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/0e113987-a362-4c64-825a-1f883ab76ec9-cnibin\") pod \"multus-additional-cni-plugins-8br4n\" (UID: \"0e113987-a362-4c64-825a-1f883ab76ec9\") " pod="openshift-multus/multus-additional-cni-plugins-8br4n"
Jul 30 12:59:32.492390 ip-10-0-143-153 kubenswrapper[2566]: I0730 12:59:32.492164    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/0e113987-a362-4c64-825a-1f883ab76ec9-os-release\") pod \"multus-additional-cni-plugins-8br4n\" (UID: \"0e113987-a362-4c64-825a-1f883ab76ec9\") " pod="openshift-multus/multus-additional-cni-plugins-8br4n"
Jul 30 12:59:32.492390 ip-10-0-143-153 kubenswrapper[2566]: I0730 12:59:32.492201    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tk52b\" (UniqueName: \"kubernetes.io/projected/0e113987-a362-4c64-825a-1f883ab76ec9-kube-api-access-tk52b\") pod \"multus-additional-cni-plugins-8br4n\" (UID: \"0e113987-a362-4c64-825a-1f883ab76ec9\") " pod="openshift-multus/multus-additional-cni-plugins-8br4n"
Jul 30 12:59:32.492390 ip-10-0-143-153 kubenswrapper[2566]: I0730 12:59:32.492227    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ndmqt\" (UniqueName: \"kubernetes.io/projected/95057af8-5515-4bb3-9147-613240e101bb-kube-api-access-ndmqt\") pod \"node-resolver-4tzjz\" (UID: \"95057af8-5515-4bb3-9147-613240e101bb\") " pod="openshift-dns/node-resolver-4tzjz"
Jul 30 12:59:32.492390 ip-10-0-143-153 kubenswrapper[2566]: I0730 12:59:32.492306    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/d1644e14-73e0-40a9-a205-7bdd0eefe290-cni-binary-copy\") pod \"multus-gppm2\" (UID: \"d1644e14-73e0-40a9-a205-7bdd0eefe290\") " pod="openshift-multus/multus-gppm2"
Jul 30 12:59:32.492390 ip-10-0-143-153 kubenswrapper[2566]: I0730 12:59:32.492337    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/d1644e14-73e0-40a9-a205-7bdd0eefe290-host-var-lib-cni-bin\") pod \"multus-gppm2\" (UID: \"d1644e14-73e0-40a9-a205-7bdd0eefe290\") " pod="openshift-multus/multus-gppm2"
Jul 30 12:59:32.492390 ip-10-0-143-153 kubenswrapper[2566]: I0730 12:59:32.492369    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/0e113987-a362-4c64-825a-1f883ab76ec9-tuning-conf-dir\") pod \"multus-additional-cni-plugins-8br4n\" (UID: \"0e113987-a362-4c64-825a-1f883ab76ec9\") " pod="openshift-multus/multus-additional-cni-plugins-8br4n"
Jul 30 12:59:32.492747 ip-10-0-143-153 kubenswrapper[2566]: I0730 12:59:32.492419    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/d1644e14-73e0-40a9-a205-7bdd0eefe290-multus-conf-dir\") pod \"multus-gppm2\" (UID: \"d1644e14-73e0-40a9-a205-7bdd0eefe290\") " pod="openshift-multus/multus-gppm2"
Jul 30 12:59:32.492747 ip-10-0-143-153 kubenswrapper[2566]: I0730 12:59:32.492450    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/abe34634-20e4-4e0b-9d22-565c35543229-device-dir\") pod \"aws-ebs-csi-driver-node-4fdfw\" (UID: \"abe34634-20e4-4e0b-9d22-565c35543229\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4fdfw"
Jul 30 12:59:32.492747 ip-10-0-143-153 kubenswrapper[2566]: I0730 12:59:32.492469    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/abe34634-20e4-4e0b-9d22-565c35543229-etc-selinux\") pod \"aws-ebs-csi-driver-node-4fdfw\" (UID: \"abe34634-20e4-4e0b-9d22-565c35543229\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4fdfw"
Jul 30 12:59:32.492747 ip-10-0-143-153 kubenswrapper[2566]: I0730 12:59:32.492484    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-plcsn\" (UniqueName: \"kubernetes.io/projected/abe34634-20e4-4e0b-9d22-565c35543229-kube-api-access-plcsn\") pod \"aws-ebs-csi-driver-node-4fdfw\" (UID: \"abe34634-20e4-4e0b-9d22-565c35543229\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4fdfw"
Jul 30 12:59:32.492747 ip-10-0-143-153 kubenswrapper[2566]: I0730 12:59:32.492504    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/d1644e14-73e0-40a9-a205-7bdd0eefe290-cnibin\") pod \"multus-gppm2\" (UID: \"d1644e14-73e0-40a9-a205-7bdd0eefe290\") " pod="openshift-multus/multus-gppm2"
Jul 30 12:59:32.492747 ip-10-0-143-153 kubenswrapper[2566]: I0730 12:59:32.492526    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/abe34634-20e4-4e0b-9d22-565c35543229-kubelet-dir\") pod \"aws-ebs-csi-driver-node-4fdfw\" (UID: \"abe34634-20e4-4e0b-9d22-565c35543229\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4fdfw"
Jul 30 12:59:32.492747 ip-10-0-143-153 kubenswrapper[2566]: I0730 12:59:32.492549    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/abe34634-20e4-4e0b-9d22-565c35543229-registration-dir\") pod \"aws-ebs-csi-driver-node-4fdfw\" (UID: \"abe34634-20e4-4e0b-9d22-565c35543229\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4fdfw"
Jul 30 12:59:32.492747 ip-10-0-143-153 kubenswrapper[2566]: I0730 12:59:32.492580    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/d1644e14-73e0-40a9-a205-7bdd0eefe290-os-release\") pod \"multus-gppm2\" (UID: \"d1644e14-73e0-40a9-a205-7bdd0eefe290\") " pod="openshift-multus/multus-gppm2"
Jul 30 12:59:32.492747 ip-10-0-143-153 kubenswrapper[2566]: I0730 12:59:32.492608    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/d1644e14-73e0-40a9-a205-7bdd0eefe290-etc-kubernetes\") pod \"multus-gppm2\" (UID: \"d1644e14-73e0-40a9-a205-7bdd0eefe290\") " pod="openshift-multus/multus-gppm2"
Jul 30 12:59:32.492747 ip-10-0-143-153 kubenswrapper[2566]: I0730 12:59:32.492631    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-f97hw\" (UniqueName: \"kubernetes.io/projected/b6cb9164-228a-4fff-b909-8be034a2b11a-kube-api-access-f97hw\") pod \"node-ca-9lmmp\" (UID: \"b6cb9164-228a-4fff-b909-8be034a2b11a\") " pod="openshift-image-registry/node-ca-9lmmp"
Jul 30 12:59:32.492747 ip-10-0-143-153 kubenswrapper[2566]: I0730 12:59:32.492646    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/95057af8-5515-4bb3-9147-613240e101bb-tmp-dir\") pod \"node-resolver-4tzjz\" (UID: \"95057af8-5515-4bb3-9147-613240e101bb\") " pod="openshift-dns/node-resolver-4tzjz"
Jul 30 12:59:32.492747 ip-10-0-143-153 kubenswrapper[2566]: I0730 12:59:32.492660    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/d1644e14-73e0-40a9-a205-7bdd0eefe290-host-var-lib-kubelet\") pod \"multus-gppm2\" (UID: \"d1644e14-73e0-40a9-a205-7bdd0eefe290\") " pod="openshift-multus/multus-gppm2"
Jul 30 12:59:32.492747 ip-10-0-143-153 kubenswrapper[2566]: I0730 12:59:32.492679    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/0e113987-a362-4c64-825a-1f883ab76ec9-system-cni-dir\") pod \"multus-additional-cni-plugins-8br4n\" (UID: \"0e113987-a362-4c64-825a-1f883ab76ec9\") " pod="openshift-multus/multus-additional-cni-plugins-8br4n"
Jul 30 12:59:32.492747 ip-10-0-143-153 kubenswrapper[2566]: I0730 12:59:32.492693    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/0e113987-a362-4c64-825a-1f883ab76ec9-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-8br4n\" (UID: \"0e113987-a362-4c64-825a-1f883ab76ec9\") " pod="openshift-multus/multus-additional-cni-plugins-8br4n"
Jul 30 12:59:32.492747 ip-10-0-143-153 kubenswrapper[2566]: I0730 12:59:32.492707    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/d1644e14-73e0-40a9-a205-7bdd0eefe290-multus-socket-dir-parent\") pod \"multus-gppm2\" (UID: \"d1644e14-73e0-40a9-a205-7bdd0eefe290\") " pod="openshift-multus/multus-gppm2"
Jul 30 12:59:32.492747 ip-10-0-143-153 kubenswrapper[2566]: I0730 12:59:32.492722    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/d1644e14-73e0-40a9-a205-7bdd0eefe290-host-run-netns\") pod \"multus-gppm2\" (UID: \"d1644e14-73e0-40a9-a205-7bdd0eefe290\") " pod="openshift-multus/multus-gppm2"
Jul 30 12:59:32.493490 ip-10-0-143-153 kubenswrapper[2566]: I0730 12:59:32.492736    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/d1644e14-73e0-40a9-a205-7bdd0eefe290-hostroot\") pod \"multus-gppm2\" (UID: \"d1644e14-73e0-40a9-a205-7bdd0eefe290\") " pod="openshift-multus/multus-gppm2"
Jul 30 12:59:32.493490 ip-10-0-143-153 kubenswrapper[2566]: I0730 12:59:32.492768    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/d1644e14-73e0-40a9-a205-7bdd0eefe290-multus-daemon-config\") pod \"multus-gppm2\" (UID: \"d1644e14-73e0-40a9-a205-7bdd0eefe290\") " pod="openshift-multus/multus-gppm2"
Jul 30 12:59:32.493490 ip-10-0-143-153 kubenswrapper[2566]: I0730 12:59:32.492802    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/d1644e14-73e0-40a9-a205-7bdd0eefe290-host-run-multus-certs\") pod \"multus-gppm2\" (UID: \"d1644e14-73e0-40a9-a205-7bdd0eefe290\") " pod="openshift-multus/multus-gppm2"
Jul 30 12:59:32.493490 ip-10-0-143-153 kubenswrapper[2566]: I0730 12:59:32.492827    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rd6r7\" (UniqueName: \"kubernetes.io/projected/d1644e14-73e0-40a9-a205-7bdd0eefe290-kube-api-access-rd6r7\") pod \"multus-gppm2\" (UID: \"d1644e14-73e0-40a9-a205-7bdd0eefe290\") " pod="openshift-multus/multus-gppm2"
Jul 30 12:59:32.494010 ip-10-0-143-153 kubenswrapper[2566]: I0730 12:59:32.493993    2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\""
Jul 30 12:59:32.494105 ip-10-0-143-153 kubenswrapper[2566]: I0730 12:59:32.494011    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-bsvnp\""
Jul 30 12:59:32.494105 ip-10-0-143-153 kubenswrapper[2566]: I0730 12:59:32.494087    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\""
Jul 30 12:59:32.494244 ip-10-0-143-153 kubenswrapper[2566]: I0730 12:59:32.494192    2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\""
Jul 30 12:59:32.494526 ip-10-0-143-153 kubenswrapper[2566]: I0730 12:59:32.494509    2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\""
Jul 30 12:59:32.494595 ip-10-0-143-153 kubenswrapper[2566]: I0730 12:59:32.494583    2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\""
Jul 30 12:59:32.495154 ip-10-0-143-153 kubenswrapper[2566]: I0730 12:59:32.495139    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-bjnvm"
Jul 30 12:59:32.495217 ip-10-0-143-153 kubenswrapper[2566]: E0730 12:59:32.495200    2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-bjnvm" podUID="be740ef9-ac84-4ef4-ad66-7f61253c6c28"
Jul 30 12:59:32.496279 ip-10-0-143-153 kubenswrapper[2566]: I0730 12:59:32.496261    2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\""
Jul 30 12:59:32.497788 ip-10-0-143-153 kubenswrapper[2566]: I0730 12:59:32.497772    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-m8zwx"
Jul 30 12:59:32.499403 ip-10-0-143-153 kubenswrapper[2566]: I0730 12:59:32.499384    2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\""
Jul 30 12:59:32.499502 ip-10-0-143-153 kubenswrapper[2566]: I0730 12:59:32.499468    2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\""
Jul 30 12:59:32.499594 ip-10-0-143-153 kubenswrapper[2566]: I0730 12:59:32.499578    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-gfj8m\""
Jul 30 12:59:32.499679 ip-10-0-143-153 kubenswrapper[2566]: I0730 12:59:32.499664    2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\""
Jul 30 12:59:32.500453 ip-10-0-143-153 kubenswrapper[2566]: I0730 12:59:32.500438    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-9bp7v"
Jul 30 12:59:32.500514 ip-10-0-143-153 kubenswrapper[2566]: E0730 12:59:32.500497    2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-9bp7v" podUID="c2428457-ecf0-45c5-b008-7a51403785c9"
Jul 30 12:59:32.500744 ip-10-0-143-153 kubenswrapper[2566]: I0730 12:59:32.500731    2566 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Jul 30 12:59:32.503139 ip-10-0-143-153 kubenswrapper[2566]: I0730 12:59:32.503123    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-qt2mr"
Jul 30 12:59:32.504862 ip-10-0-143-153 kubenswrapper[2566]: I0730 12:59:32.504846    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\""
Jul 30 12:59:32.505115 ip-10-0-143-153 kubenswrapper[2566]: I0730 12:59:32.505098    2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\""
Jul 30 12:59:32.505192 ip-10-0-143-153 kubenswrapper[2566]: I0730 12:59:32.505123    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-f5n7z\""
Jul 30 12:59:32.505873 ip-10-0-143-153 kubenswrapper[2566]: I0730 12:59:32.505858    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-pvtx9"
Jul 30 12:59:32.509046 ip-10-0-143-153 kubenswrapper[2566]: I0730 12:59:32.509029    2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\""
Jul 30 12:59:32.509153 ip-10-0-143-153 kubenswrapper[2566]: I0730 12:59:32.509139    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-cvrlb\""
Jul 30 12:59:32.509332 ip-10-0-143-153 kubenswrapper[2566]: I0730 12:59:32.509318    2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\""
Jul 30 12:59:32.523863 ip-10-0-143-153 kubenswrapper[2566]: I0730 12:59:32.523847    2566 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-gzx79"
Jul 30 12:59:32.539472 ip-10-0-143-153 kubenswrapper[2566]: I0730 12:59:32.539454    2566 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-gzx79"
Jul 30 12:59:32.572508 ip-10-0-143-153 kubenswrapper[2566]: I0730 12:59:32.572015    2566 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-07-29 12:54:31 +0000 UTC" deadline="2028-03-21 10:33:40.682446343 +0000 UTC"
Jul 30 12:59:32.572508 ip-10-0-143-153 kubenswrapper[2566]: I0730 12:59:32.572064    2566 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="14397h34m8.110385166s"
Jul 30 12:59:32.587226 ip-10-0-143-153 kubenswrapper[2566]: I0730 12:59:32.587199    2566 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world"
Jul 30 12:59:32.593292 ip-10-0-143-153 kubenswrapper[2566]: I0730 12:59:32.593269    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/0e113987-a362-4c64-825a-1f883ab76ec9-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-8br4n\" (UID: \"0e113987-a362-4c64-825a-1f883ab76ec9\") " pod="openshift-multus/multus-additional-cni-plugins-8br4n"
Jul 30 12:59:32.593406 ip-10-0-143-153 kubenswrapper[2566]: I0730 12:59:32.593300    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/389ae0b4-e97d-4637-8836-5d349b4b2182-sys\") pod \"tuned-pvtx9\" (UID: \"389ae0b4-e97d-4637-8836-5d349b4b2182\") " pod="openshift-cluster-node-tuning-operator/tuned-pvtx9"
Jul 30 12:59:32.593406 ip-10-0-143-153 kubenswrapper[2566]: I0730 12:59:32.593317    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/3ebbc209-4373-44d8-a22e-d2d2aa4cbfa6-node-log\") pod \"ovnkube-node-f6br6\" (UID: \"3ebbc209-4373-44d8-a22e-d2d2aa4cbfa6\") " pod="openshift-ovn-kubernetes/ovnkube-node-f6br6"
Jul 30 12:59:32.593406 ip-10-0-143-153 kubenswrapper[2566]: I0730 12:59:32.593331    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/3ebbc209-4373-44d8-a22e-d2d2aa4cbfa6-host-cni-netd\") pod \"ovnkube-node-f6br6\" (UID: \"3ebbc209-4373-44d8-a22e-d2d2aa4cbfa6\") " pod="openshift-ovn-kubernetes/ovnkube-node-f6br6"
Jul 30 12:59:32.593406 ip-10-0-143-153 kubenswrapper[2566]: I0730 12:59:32.593346    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gqc9f\" (UniqueName: \"kubernetes.io/projected/5eedd146-086a-4a5d-a331-5c1dc35f8e9e-kube-api-access-gqc9f\") pod \"iptables-alerter-m8zwx\" (UID: \"5eedd146-086a-4a5d-a331-5c1dc35f8e9e\") " pod="openshift-network-operator/iptables-alerter-m8zwx"
Jul 30 12:59:32.593406 ip-10-0-143-153 kubenswrapper[2566]: I0730 12:59:32.593364    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/d1644e14-73e0-40a9-a205-7bdd0eefe290-multus-socket-dir-parent\") pod \"multus-gppm2\" (UID: \"d1644e14-73e0-40a9-a205-7bdd0eefe290\") " pod="openshift-multus/multus-gppm2"
Jul 30 12:59:32.593649 ip-10-0-143-153 kubenswrapper[2566]: I0730 12:59:32.593408    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/d1644e14-73e0-40a9-a205-7bdd0eefe290-hostroot\") pod \"multus-gppm2\" (UID: \"d1644e14-73e0-40a9-a205-7bdd0eefe290\") " pod="openshift-multus/multus-gppm2"
Jul 30 12:59:32.593649 ip-10-0-143-153 kubenswrapper[2566]: I0730 12:59:32.593445    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/d1644e14-73e0-40a9-a205-7bdd0eefe290-host-run-multus-certs\") pod \"multus-gppm2\" (UID: \"d1644e14-73e0-40a9-a205-7bdd0eefe290\") " pod="openshift-multus/multus-gppm2"
Jul 30 12:59:32.593649 ip-10-0-143-153 kubenswrapper[2566]: I0730 12:59:32.593472    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/0e113987-a362-4c64-825a-1f883ab76ec9-cni-binary-copy\") pod \"multus-additional-cni-plugins-8br4n\" (UID: \"0e113987-a362-4c64-825a-1f883ab76ec9\") " pod="openshift-multus/multus-additional-cni-plugins-8br4n"
Jul 30 12:59:32.593649 ip-10-0-143-153 kubenswrapper[2566]: I0730 12:59:32.593496    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/0e113987-a362-4c64-825a-1f883ab76ec9-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-8br4n\" (UID: \"0e113987-a362-4c64-825a-1f883ab76ec9\") " pod="openshift-multus/multus-additional-cni-plugins-8br4n"
Jul 30 12:59:32.593649 ip-10-0-143-153 kubenswrapper[2566]: I0730 12:59:32.593523    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/abe34634-20e4-4e0b-9d22-565c35543229-sys-fs\") pod \"aws-ebs-csi-driver-node-4fdfw\" (UID: \"abe34634-20e4-4e0b-9d22-565c35543229\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4fdfw"
Jul 30 12:59:32.593649 ip-10-0-143-153 kubenswrapper[2566]: I0730 12:59:32.593544    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/95057af8-5515-4bb3-9147-613240e101bb-hosts-file\") pod \"node-resolver-4tzjz\" (UID: \"95057af8-5515-4bb3-9147-613240e101bb\") " pod="openshift-dns/node-resolver-4tzjz"
Jul 30 12:59:32.593649 ip-10-0-143-153 kubenswrapper[2566]: I0730 12:59:32.593554    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/d1644e14-73e0-40a9-a205-7bdd0eefe290-multus-socket-dir-parent\") pod \"multus-gppm2\" (UID: \"d1644e14-73e0-40a9-a205-7bdd0eefe290\") " pod="openshift-multus/multus-gppm2"
Jul 30 12:59:32.593649 ip-10-0-143-153 kubenswrapper[2566]: I0730 12:59:32.593569    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/3ebbc209-4373-44d8-a22e-d2d2aa4cbfa6-var-lib-openvswitch\") pod \"ovnkube-node-f6br6\" (UID: \"3ebbc209-4373-44d8-a22e-d2d2aa4cbfa6\") " pod="openshift-ovn-kubernetes/ovnkube-node-f6br6"
Jul 30 12:59:32.593649 ip-10-0-143-153 kubenswrapper[2566]: I0730 12:59:32.593594    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/d1644e14-73e0-40a9-a205-7bdd0eefe290-host-var-lib-cni-multus\") pod \"multus-gppm2\" (UID: \"d1644e14-73e0-40a9-a205-7bdd0eefe290\") " pod="openshift-multus/multus-gppm2"
Jul 30 12:59:32.593649 ip-10-0-143-153 kubenswrapper[2566]: I0730 12:59:32.593617    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/d1644e14-73e0-40a9-a205-7bdd0eefe290-system-cni-dir\") pod \"multus-gppm2\" (UID: \"d1644e14-73e0-40a9-a205-7bdd0eefe290\") " pod="openshift-multus/multus-gppm2"
Jul 30 12:59:32.593649 ip-10-0-143-153 kubenswrapper[2566]: I0730 12:59:32.593639    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/d1644e14-73e0-40a9-a205-7bdd0eefe290-multus-cni-dir\") pod \"multus-gppm2\" (UID: \"d1644e14-73e0-40a9-a205-7bdd0eefe290\") " pod="openshift-multus/multus-gppm2"
Jul 30 12:59:32.594165 ip-10-0-143-153 kubenswrapper[2566]: I0730 12:59:32.593661    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/389ae0b4-e97d-4637-8836-5d349b4b2182-etc-kubernetes\") pod \"tuned-pvtx9\" (UID: \"389ae0b4-e97d-4637-8836-5d349b4b2182\") " pod="openshift-cluster-node-tuning-operator/tuned-pvtx9"
Jul 30 12:59:32.594165 ip-10-0-143-153 kubenswrapper[2566]: I0730 12:59:32.593683    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/3ebbc209-4373-44d8-a22e-d2d2aa4cbfa6-host-slash\") pod \"ovnkube-node-f6br6\" (UID: \"3ebbc209-4373-44d8-a22e-d2d2aa4cbfa6\") " pod="openshift-ovn-kubernetes/ovnkube-node-f6br6"
Jul 30 12:59:32.594165 ip-10-0-143-153 kubenswrapper[2566]: I0730 12:59:32.593735    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/d1644e14-73e0-40a9-a205-7bdd0eefe290-host-var-lib-cni-multus\") pod \"multus-gppm2\" (UID: \"d1644e14-73e0-40a9-a205-7bdd0eefe290\") " pod="openshift-multus/multus-gppm2"
Jul 30 12:59:32.594165 ip-10-0-143-153 kubenswrapper[2566]: I0730 12:59:32.593758    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/d1644e14-73e0-40a9-a205-7bdd0eefe290-system-cni-dir\") pod \"multus-gppm2\" (UID: \"d1644e14-73e0-40a9-a205-7bdd0eefe290\") " pod="openshift-multus/multus-gppm2"
Jul 30 12:59:32.594165 ip-10-0-143-153 kubenswrapper[2566]: I0730 12:59:32.593782    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/3ebbc209-4373-44d8-a22e-d2d2aa4cbfa6-run-systemd\") pod \"ovnkube-node-f6br6\" (UID: \"3ebbc209-4373-44d8-a22e-d2d2aa4cbfa6\") " pod="openshift-ovn-kubernetes/ovnkube-node-f6br6"
Jul 30 12:59:32.594165 ip-10-0-143-153 kubenswrapper[2566]: I0730 12:59:32.593809    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/3ebbc209-4373-44d8-a22e-d2d2aa4cbfa6-log-socket\") pod \"ovnkube-node-f6br6\" (UID: \"3ebbc209-4373-44d8-a22e-d2d2aa4cbfa6\") " pod="openshift-ovn-kubernetes/ovnkube-node-f6br6"
Jul 30 12:59:32.594165 ip-10-0-143-153 kubenswrapper[2566]: I0730 12:59:32.593837    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/b6cb9164-228a-4fff-b909-8be034a2b11a-serviceca\") pod \"node-ca-9lmmp\" (UID: \"b6cb9164-228a-4fff-b909-8be034a2b11a\") " pod="openshift-image-registry/node-ca-9lmmp"
Jul 30 12:59:32.594165 ip-10-0-143-153 kubenswrapper[2566]: I0730 12:59:32.593862    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/0e113987-a362-4c64-825a-1f883ab76ec9-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-8br4n\" (UID: \"0e113987-a362-4c64-825a-1f883ab76ec9\") " pod="openshift-multus/multus-additional-cni-plugins-8br4n"
Jul 30 12:59:32.594165 ip-10-0-143-153 kubenswrapper[2566]: I0730 12:59:32.593878    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/d1644e14-73e0-40a9-a205-7bdd0eefe290-multus-cni-dir\") pod \"multus-gppm2\" (UID: \"d1644e14-73e0-40a9-a205-7bdd0eefe290\") " pod="openshift-multus/multus-gppm2"
Jul 30 12:59:32.594165 ip-10-0-143-153 kubenswrapper[2566]: I0730 12:59:32.593864    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/0e113987-a362-4c64-825a-1f883ab76ec9-cnibin\") pod \"multus-additional-cni-plugins-8br4n\" (UID: \"0e113987-a362-4c64-825a-1f883ab76ec9\") " pod="openshift-multus/multus-additional-cni-plugins-8br4n"
Jul 30 12:59:32.594165 ip-10-0-143-153 kubenswrapper[2566]: I0730 12:59:32.593897    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/0e113987-a362-4c64-825a-1f883ab76ec9-cnibin\") pod \"multus-additional-cni-plugins-8br4n\" (UID: \"0e113987-a362-4c64-825a-1f883ab76ec9\") " pod="openshift-multus/multus-additional-cni-plugins-8br4n"
Jul 30 12:59:32.594165 ip-10-0-143-153 kubenswrapper[2566]: I0730 12:59:32.593927    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/d1644e14-73e0-40a9-a205-7bdd0eefe290-host-run-multus-certs\") pod \"multus-gppm2\" (UID: \"d1644e14-73e0-40a9-a205-7bdd0eefe290\") " pod="openshift-multus/multus-gppm2"
Jul 30 12:59:32.594165 ip-10-0-143-153 kubenswrapper[2566]: I0730 12:59:32.593938    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/0e113987-a362-4c64-825a-1f883ab76ec9-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-8br4n\" (UID: \"0e113987-a362-4c64-825a-1f883ab76ec9\") " pod="openshift-multus/multus-additional-cni-plugins-8br4n"
Jul 30 12:59:32.594165 ip-10-0-143-153 kubenswrapper[2566]: I0730 12:59:32.593955    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/95057af8-5515-4bb3-9147-613240e101bb-hosts-file\") pod \"node-resolver-4tzjz\" (UID: \"95057af8-5515-4bb3-9147-613240e101bb\") " pod="openshift-dns/node-resolver-4tzjz"
Jul 30 12:59:32.594165 ip-10-0-143-153 kubenswrapper[2566]: I0730 12:59:32.593964    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/d1644e14-73e0-40a9-a205-7bdd0eefe290-hostroot\") pod \"multus-gppm2\" (UID: \"d1644e14-73e0-40a9-a205-7bdd0eefe290\") " pod="openshift-multus/multus-gppm2"
Jul 30 12:59:32.594165 ip-10-0-143-153 kubenswrapper[2566]: I0730 12:59:32.593965    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tk52b\" (UniqueName: \"kubernetes.io/projected/0e113987-a362-4c64-825a-1f883ab76ec9-kube-api-access-tk52b\") pod \"multus-additional-cni-plugins-8br4n\" (UID: \"0e113987-a362-4c64-825a-1f883ab76ec9\") " pod="openshift-multus/multus-additional-cni-plugins-8br4n"
Jul 30 12:59:32.594165 ip-10-0-143-153 kubenswrapper[2566]: I0730 12:59:32.593943    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/abe34634-20e4-4e0b-9d22-565c35543229-sys-fs\") pod \"aws-ebs-csi-driver-node-4fdfw\" (UID: \"abe34634-20e4-4e0b-9d22-565c35543229\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4fdfw"
Jul 30 12:59:32.595026 ip-10-0-143-153 kubenswrapper[2566]: I0730 12:59:32.594012    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ndmqt\" (UniqueName: \"kubernetes.io/projected/95057af8-5515-4bb3-9147-613240e101bb-kube-api-access-ndmqt\") pod \"node-resolver-4tzjz\" (UID: \"95057af8-5515-4bb3-9147-613240e101bb\") " pod="openshift-dns/node-resolver-4tzjz"
Jul 30 12:59:32.595026 ip-10-0-143-153 kubenswrapper[2566]: I0730 12:59:32.594041    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/3ebbc209-4373-44d8-a22e-d2d2aa4cbfa6-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-f6br6\" (UID: \"3ebbc209-4373-44d8-a22e-d2d2aa4cbfa6\") " pod="openshift-ovn-kubernetes/ovnkube-node-f6br6"
Jul 30 12:59:32.595026 ip-10-0-143-153 kubenswrapper[2566]: I0730 12:59:32.594097    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/3ebbc209-4373-44d8-a22e-d2d2aa4cbfa6-ovnkube-config\") pod \"ovnkube-node-f6br6\" (UID: \"3ebbc209-4373-44d8-a22e-d2d2aa4cbfa6\") " pod="openshift-ovn-kubernetes/ovnkube-node-f6br6"
Jul 30 12:59:32.595026 ip-10-0-143-153 kubenswrapper[2566]: I0730 12:59:32.594215    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/995cd086-39a7-4097-971a-1c4e6c08576b-metrics-certs\") pod \"network-metrics-daemon-kb44p\" (UID: \"995cd086-39a7-4097-971a-1c4e6c08576b\") " pod="openshift-multus/network-metrics-daemon-kb44p"
Jul 30 12:59:32.595026 ip-10-0-143-153 kubenswrapper[2566]: I0730 12:59:32.594275    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/3ebbc209-4373-44d8-a22e-d2d2aa4cbfa6-host-kubelet\") pod \"ovnkube-node-f6br6\" (UID: \"3ebbc209-4373-44d8-a22e-d2d2aa4cbfa6\") " pod="openshift-ovn-kubernetes/ovnkube-node-f6br6"
Jul 30 12:59:32.595026 ip-10-0-143-153 kubenswrapper[2566]: I0730 12:59:32.594313    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/d1644e14-73e0-40a9-a205-7bdd0eefe290-multus-conf-dir\") pod \"multus-gppm2\" (UID: \"d1644e14-73e0-40a9-a205-7bdd0eefe290\") " pod="openshift-multus/multus-gppm2"
Jul 30 12:59:32.595026 ip-10-0-143-153 kubenswrapper[2566]: I0730 12:59:32.594348    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/abe34634-20e4-4e0b-9d22-565c35543229-device-dir\") pod \"aws-ebs-csi-driver-node-4fdfw\" (UID: \"abe34634-20e4-4e0b-9d22-565c35543229\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4fdfw"
Jul 30 12:59:32.595026 ip-10-0-143-153 kubenswrapper[2566]: I0730 12:59:32.594353    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/d1644e14-73e0-40a9-a205-7bdd0eefe290-multus-conf-dir\") pod \"multus-gppm2\" (UID: \"d1644e14-73e0-40a9-a205-7bdd0eefe290\") " pod="openshift-multus/multus-gppm2"
Jul 30 12:59:32.595026 ip-10-0-143-153 kubenswrapper[2566]: I0730 12:59:32.594358    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/0e113987-a362-4c64-825a-1f883ab76ec9-cni-binary-copy\") pod \"multus-additional-cni-plugins-8br4n\" (UID: \"0e113987-a362-4c64-825a-1f883ab76ec9\") " pod="openshift-multus/multus-additional-cni-plugins-8br4n"
Jul 30 12:59:32.595026 ip-10-0-143-153 kubenswrapper[2566]: I0730 12:59:32.594387    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/abe34634-20e4-4e0b-9d22-565c35543229-etc-selinux\") pod \"aws-ebs-csi-driver-node-4fdfw\" (UID: \"abe34634-20e4-4e0b-9d22-565c35543229\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4fdfw"
Jul 30 12:59:32.595026 ip-10-0-143-153 kubenswrapper[2566]: I0730 12:59:32.594397    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/abe34634-20e4-4e0b-9d22-565c35543229-device-dir\") pod \"aws-ebs-csi-driver-node-4fdfw\" (UID: \"abe34634-20e4-4e0b-9d22-565c35543229\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4fdfw"
Jul 30 12:59:32.595026 ip-10-0-143-153 kubenswrapper[2566]: I0730 12:59:32.594402    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/b6cb9164-228a-4fff-b909-8be034a2b11a-serviceca\") pod \"node-ca-9lmmp\" (UID: \"b6cb9164-228a-4fff-b909-8be034a2b11a\") " pod="openshift-image-registry/node-ca-9lmmp"
Jul 30 12:59:32.595026 ip-10-0-143-153 kubenswrapper[2566]: I0730 12:59:32.594416    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-plcsn\" (UniqueName: \"kubernetes.io/projected/abe34634-20e4-4e0b-9d22-565c35543229-kube-api-access-plcsn\") pod \"aws-ebs-csi-driver-node-4fdfw\" (UID: \"abe34634-20e4-4e0b-9d22-565c35543229\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4fdfw"
Jul 30 12:59:32.595026 ip-10-0-143-153 kubenswrapper[2566]: I0730 12:59:32.594442    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/abe34634-20e4-4e0b-9d22-565c35543229-kubelet-dir\") pod \"aws-ebs-csi-driver-node-4fdfw\" (UID: \"abe34634-20e4-4e0b-9d22-565c35543229\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4fdfw"
Jul 30 12:59:32.595026 ip-10-0-143-153 kubenswrapper[2566]: I0730 12:59:32.594467    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/abe34634-20e4-4e0b-9d22-565c35543229-registration-dir\") pod \"aws-ebs-csi-driver-node-4fdfw\" (UID: \"abe34634-20e4-4e0b-9d22-565c35543229\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4fdfw"
Jul 30 12:59:32.595026 ip-10-0-143-153 kubenswrapper[2566]: I0730 12:59:32.594480    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/abe34634-20e4-4e0b-9d22-565c35543229-etc-selinux\") pod \"aws-ebs-csi-driver-node-4fdfw\" (UID: \"abe34634-20e4-4e0b-9d22-565c35543229\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4fdfw"
Jul 30 12:59:32.595026 ip-10-0-143-153 kubenswrapper[2566]: I0730 12:59:32.594492    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/389ae0b4-e97d-4637-8836-5d349b4b2182-run\") pod \"tuned-pvtx9\" (UID: \"389ae0b4-e97d-4637-8836-5d349b4b2182\") " pod="openshift-cluster-node-tuning-operator/tuned-pvtx9"
Jul 30 12:59:32.595803 ip-10-0-143-153 kubenswrapper[2566]: I0730 12:59:32.594505    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/abe34634-20e4-4e0b-9d22-565c35543229-kubelet-dir\") pod \"aws-ebs-csi-driver-node-4fdfw\" (UID: \"abe34634-20e4-4e0b-9d22-565c35543229\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4fdfw"
Jul 30 12:59:32.595803 ip-10-0-143-153 kubenswrapper[2566]: I0730 12:59:32.594516    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/389ae0b4-e97d-4637-8836-5d349b4b2182-host\") pod \"tuned-pvtx9\" (UID: \"389ae0b4-e97d-4637-8836-5d349b4b2182\") " pod="openshift-cluster-node-tuning-operator/tuned-pvtx9"
Jul 30 12:59:32.595803 ip-10-0-143-153 kubenswrapper[2566]: I0730 12:59:32.594543    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/abe34634-20e4-4e0b-9d22-565c35543229-registration-dir\") pod \"aws-ebs-csi-driver-node-4fdfw\" (UID: \"abe34634-20e4-4e0b-9d22-565c35543229\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4fdfw"
Jul 30 12:59:32.595803 ip-10-0-143-153 kubenswrapper[2566]: I0730 12:59:32.594557    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/d1644e14-73e0-40a9-a205-7bdd0eefe290-os-release\") pod \"multus-gppm2\" (UID: \"d1644e14-73e0-40a9-a205-7bdd0eefe290\") " pod="openshift-multus/multus-gppm2"
Jul 30 12:59:32.595803 ip-10-0-143-153 kubenswrapper[2566]: I0730 12:59:32.594580    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/95057af8-5515-4bb3-9147-613240e101bb-tmp-dir\") pod \"node-resolver-4tzjz\" (UID: \"95057af8-5515-4bb3-9147-613240e101bb\") " pod="openshift-dns/node-resolver-4tzjz"
Jul 30 12:59:32.595803 ip-10-0-143-153 kubenswrapper[2566]: I0730 12:59:32.594605    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/9c33f673-8361-433b-847f-081d6d4b2753-agent-certs\") pod \"konnectivity-agent-qt2mr\" (UID: \"9c33f673-8361-433b-847f-081d6d4b2753\") " pod="kube-system/konnectivity-agent-qt2mr"
Jul 30 12:59:32.595803 ip-10-0-143-153 kubenswrapper[2566]: I0730 12:59:32.594613    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/d1644e14-73e0-40a9-a205-7bdd0eefe290-os-release\") pod \"multus-gppm2\" (UID: \"d1644e14-73e0-40a9-a205-7bdd0eefe290\") " pod="openshift-multus/multus-gppm2"
Jul 30 12:59:32.595803 ip-10-0-143-153 kubenswrapper[2566]: I0730 12:59:32.594629    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/9c33f673-8361-433b-847f-081d6d4b2753-konnectivity-ca\") pod \"konnectivity-agent-qt2mr\" (UID: \"9c33f673-8361-433b-847f-081d6d4b2753\") " pod="kube-system/konnectivity-agent-qt2mr"
Jul 30 12:59:32.595803 ip-10-0-143-153 kubenswrapper[2566]: I0730 12:59:32.594653    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/389ae0b4-e97d-4637-8836-5d349b4b2182-lib-modules\") pod \"tuned-pvtx9\" (UID: \"389ae0b4-e97d-4637-8836-5d349b4b2182\") " pod="openshift-cluster-node-tuning-operator/tuned-pvtx9"
Jul 30 12:59:32.595803 ip-10-0-143-153 kubenswrapper[2566]: I0730 12:59:32.594682    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/389ae0b4-e97d-4637-8836-5d349b4b2182-tmp\") pod \"tuned-pvtx9\" (UID: \"389ae0b4-e97d-4637-8836-5d349b4b2182\") " pod="openshift-cluster-node-tuning-operator/tuned-pvtx9"
Jul 30 12:59:32.595803 ip-10-0-143-153 kubenswrapper[2566]: I0730 12:59:32.594726    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/3ebbc209-4373-44d8-a22e-d2d2aa4cbfa6-host-run-ovn-kubernetes\") pod \"ovnkube-node-f6br6\" (UID: \"3ebbc209-4373-44d8-a22e-d2d2aa4cbfa6\") " pod="openshift-ovn-kubernetes/ovnkube-node-f6br6"
Jul 30 12:59:32.595803 ip-10-0-143-153 kubenswrapper[2566]: I0730 12:59:32.594749    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/3ebbc209-4373-44d8-a22e-d2d2aa4cbfa6-host-cni-bin\") pod \"ovnkube-node-f6br6\" (UID: \"3ebbc209-4373-44d8-a22e-d2d2aa4cbfa6\") " pod="openshift-ovn-kubernetes/ovnkube-node-f6br6"
Jul 30 12:59:32.595803 ip-10-0-143-153 kubenswrapper[2566]: I0730 12:59:32.594774    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/d1644e14-73e0-40a9-a205-7bdd0eefe290-host-var-lib-kubelet\") pod \"multus-gppm2\" (UID: \"d1644e14-73e0-40a9-a205-7bdd0eefe290\") " pod="openshift-multus/multus-gppm2"
Jul 30 12:59:32.595803 ip-10-0-143-153 kubenswrapper[2566]: I0730 12:59:32.594820    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/0e113987-a362-4c64-825a-1f883ab76ec9-system-cni-dir\") pod \"multus-additional-cni-plugins-8br4n\" (UID: \"0e113987-a362-4c64-825a-1f883ab76ec9\") " pod="openshift-multus/multus-additional-cni-plugins-8br4n"
Jul 30 12:59:32.595803 ip-10-0-143-153 kubenswrapper[2566]: I0730 12:59:32.594830    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/d1644e14-73e0-40a9-a205-7bdd0eefe290-host-var-lib-kubelet\") pod \"multus-gppm2\" (UID: \"d1644e14-73e0-40a9-a205-7bdd0eefe290\") " pod="openshift-multus/multus-gppm2"
Jul 30 12:59:32.595803 ip-10-0-143-153 kubenswrapper[2566]: I0730 12:59:32.594845    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/c2428457-ecf0-45c5-b008-7a51403785c9-kubelet-config\") pod \"global-pull-secret-syncer-9bp7v\" (UID: \"c2428457-ecf0-45c5-b008-7a51403785c9\") " pod="kube-system/global-pull-secret-syncer-9bp7v"
Jul 30 12:59:32.595803 ip-10-0-143-153 kubenswrapper[2566]: I0730 12:59:32.594835    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/95057af8-5515-4bb3-9147-613240e101bb-tmp-dir\") pod \"node-resolver-4tzjz\" (UID: \"95057af8-5515-4bb3-9147-613240e101bb\") " pod="openshift-dns/node-resolver-4tzjz"
Jul 30 12:59:32.596356 ip-10-0-143-153 kubenswrapper[2566]: I0730 12:59:32.594870    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/0e113987-a362-4c64-825a-1f883ab76ec9-system-cni-dir\") pod \"multus-additional-cni-plugins-8br4n\" (UID: \"0e113987-a362-4c64-825a-1f883ab76ec9\") " pod="openshift-multus/multus-additional-cni-plugins-8br4n"
Jul 30 12:59:32.596356 ip-10-0-143-153 kubenswrapper[2566]: I0730 12:59:32.594871    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/c2428457-ecf0-45c5-b008-7a51403785c9-original-pull-secret\") pod \"global-pull-secret-syncer-9bp7v\" (UID: \"c2428457-ecf0-45c5-b008-7a51403785c9\") " pod="kube-system/global-pull-secret-syncer-9bp7v"
Jul 30 12:59:32.596356 ip-10-0-143-153 kubenswrapper[2566]: I0730 12:59:32.594912    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/389ae0b4-e97d-4637-8836-5d349b4b2182-etc-sysctl-d\") pod \"tuned-pvtx9\" (UID: \"389ae0b4-e97d-4637-8836-5d349b4b2182\") " pod="openshift-cluster-node-tuning-operator/tuned-pvtx9"
Jul 30 12:59:32.596356 ip-10-0-143-153 kubenswrapper[2566]: I0730 12:59:32.594936    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/3ebbc209-4373-44d8-a22e-d2d2aa4cbfa6-systemd-units\") pod \"ovnkube-node-f6br6\" (UID: \"3ebbc209-4373-44d8-a22e-d2d2aa4cbfa6\") " pod="openshift-ovn-kubernetes/ovnkube-node-f6br6"
Jul 30 12:59:32.596356 ip-10-0-143-153 kubenswrapper[2566]: I0730 12:59:32.594961    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/5eedd146-086a-4a5d-a331-5c1dc35f8e9e-iptables-alerter-script\") pod \"iptables-alerter-m8zwx\" (UID: \"5eedd146-086a-4a5d-a331-5c1dc35f8e9e\") " pod="openshift-network-operator/iptables-alerter-m8zwx"
Jul 30 12:59:32.596356 ip-10-0-143-153 kubenswrapper[2566]: I0730 12:59:32.594986    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/d1644e14-73e0-40a9-a205-7bdd0eefe290-host-run-netns\") pod \"multus-gppm2\" (UID: \"d1644e14-73e0-40a9-a205-7bdd0eefe290\") " pod="openshift-multus/multus-gppm2"
Jul 30 12:59:32.596356 ip-10-0-143-153 kubenswrapper[2566]: I0730 12:59:32.595020    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/d1644e14-73e0-40a9-a205-7bdd0eefe290-multus-daemon-config\") pod \"multus-gppm2\" (UID: \"d1644e14-73e0-40a9-a205-7bdd0eefe290\") " pod="openshift-multus/multus-gppm2"
Jul 30 12:59:32.596356 ip-10-0-143-153 kubenswrapper[2566]: I0730 12:59:32.595064    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rd6r7\" (UniqueName: \"kubernetes.io/projected/d1644e14-73e0-40a9-a205-7bdd0eefe290-kube-api-access-rd6r7\") pod \"multus-gppm2\" (UID: \"d1644e14-73e0-40a9-a205-7bdd0eefe290\") " pod="openshift-multus/multus-gppm2"
Jul 30 12:59:32.596356 ip-10-0-143-153 kubenswrapper[2566]: I0730 12:59:32.595105    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/389ae0b4-e97d-4637-8836-5d349b4b2182-etc-sysconfig\") pod \"tuned-pvtx9\" (UID: \"389ae0b4-e97d-4637-8836-5d349b4b2182\") " pod="openshift-cluster-node-tuning-operator/tuned-pvtx9"
Jul 30 12:59:32.596356 ip-10-0-143-153 kubenswrapper[2566]: I0730 12:59:32.595104    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/d1644e14-73e0-40a9-a205-7bdd0eefe290-host-run-netns\") pod \"multus-gppm2\" (UID: \"d1644e14-73e0-40a9-a205-7bdd0eefe290\") " pod="openshift-multus/multus-gppm2"
Jul 30 12:59:32.596356 ip-10-0-143-153 kubenswrapper[2566]: I0730 12:59:32.595130    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/3ebbc209-4373-44d8-a22e-d2d2aa4cbfa6-ovn-node-metrics-cert\") pod \"ovnkube-node-f6br6\" (UID: \"3ebbc209-4373-44d8-a22e-d2d2aa4cbfa6\") " pod="openshift-ovn-kubernetes/ovnkube-node-f6br6"
Jul 30 12:59:32.596356 ip-10-0-143-153 kubenswrapper[2566]: I0730 12:59:32.595156    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/abe34634-20e4-4e0b-9d22-565c35543229-socket-dir\") pod \"aws-ebs-csi-driver-node-4fdfw\" (UID: \"abe34634-20e4-4e0b-9d22-565c35543229\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4fdfw"
Jul 30 12:59:32.596356 ip-10-0-143-153 kubenswrapper[2566]: I0730 12:59:32.595178    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/389ae0b4-e97d-4637-8836-5d349b4b2182-etc-tuned\") pod \"tuned-pvtx9\" (UID: \"389ae0b4-e97d-4637-8836-5d349b4b2182\") " pod="openshift-cluster-node-tuning-operator/tuned-pvtx9"
Jul 30 12:59:32.596356 ip-10-0-143-153 kubenswrapper[2566]: I0730 12:59:32.595203    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wvdt7\" (UniqueName: \"kubernetes.io/projected/be740ef9-ac84-4ef4-ad66-7f61253c6c28-kube-api-access-wvdt7\") pod \"network-check-target-bjnvm\" (UID: \"be740ef9-ac84-4ef4-ad66-7f61253c6c28\") " pod="openshift-network-diagnostics/network-check-target-bjnvm"
Jul 30 12:59:32.596356 ip-10-0-143-153 kubenswrapper[2566]: I0730 12:59:32.595226    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wtcj7\" (UniqueName: \"kubernetes.io/projected/3ebbc209-4373-44d8-a22e-d2d2aa4cbfa6-kube-api-access-wtcj7\") pod \"ovnkube-node-f6br6\" (UID: \"3ebbc209-4373-44d8-a22e-d2d2aa4cbfa6\") " pod="openshift-ovn-kubernetes/ovnkube-node-f6br6"
Jul 30 12:59:32.596356 ip-10-0-143-153 kubenswrapper[2566]: I0730 12:59:32.595251    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/d1644e14-73e0-40a9-a205-7bdd0eefe290-host-run-k8s-cni-cncf-io\") pod \"multus-gppm2\" (UID: \"d1644e14-73e0-40a9-a205-7bdd0eefe290\") " pod="openshift-multus/multus-gppm2"
Jul 30 12:59:32.596356 ip-10-0-143-153 kubenswrapper[2566]: I0730 12:59:32.595263    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/abe34634-20e4-4e0b-9d22-565c35543229-socket-dir\") pod \"aws-ebs-csi-driver-node-4fdfw\" (UID: \"abe34634-20e4-4e0b-9d22-565c35543229\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4fdfw"
Jul 30 12:59:32.596858 ip-10-0-143-153 kubenswrapper[2566]: I0730 12:59:32.595297    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/b6cb9164-228a-4fff-b909-8be034a2b11a-host\") pod \"node-ca-9lmmp\" (UID: \"b6cb9164-228a-4fff-b909-8be034a2b11a\") " pod="openshift-image-registry/node-ca-9lmmp"
Jul 30 12:59:32.596858 ip-10-0-143-153 kubenswrapper[2566]: I0730 12:59:32.595307    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/d1644e14-73e0-40a9-a205-7bdd0eefe290-host-run-k8s-cni-cncf-io\") pod \"multus-gppm2\" (UID: \"d1644e14-73e0-40a9-a205-7bdd0eefe290\") " pod="openshift-multus/multus-gppm2"
Jul 30 12:59:32.596858 ip-10-0-143-153 kubenswrapper[2566]: I0730 12:59:32.595322    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/0e113987-a362-4c64-825a-1f883ab76ec9-os-release\") pod \"multus-additional-cni-plugins-8br4n\" (UID: \"0e113987-a362-4c64-825a-1f883ab76ec9\") " pod="openshift-multus/multus-additional-cni-plugins-8br4n"
Jul 30 12:59:32.596858 ip-10-0-143-153 kubenswrapper[2566]: I0730 12:59:32.595331    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/b6cb9164-228a-4fff-b909-8be034a2b11a-host\") pod \"node-ca-9lmmp\" (UID: \"b6cb9164-228a-4fff-b909-8be034a2b11a\") " pod="openshift-image-registry/node-ca-9lmmp"
Jul 30 12:59:32.596858 ip-10-0-143-153 kubenswrapper[2566]: I0730 12:59:32.595362    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/3ebbc209-4373-44d8-a22e-d2d2aa4cbfa6-etc-openvswitch\") pod \"ovnkube-node-f6br6\" (UID: \"3ebbc209-4373-44d8-a22e-d2d2aa4cbfa6\") " pod="openshift-ovn-kubernetes/ovnkube-node-f6br6"
Jul 30 12:59:32.596858 ip-10-0-143-153 kubenswrapper[2566]: I0730 12:59:32.595378    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/3ebbc209-4373-44d8-a22e-d2d2aa4cbfa6-ovnkube-script-lib\") pod \"ovnkube-node-f6br6\" (UID: \"3ebbc209-4373-44d8-a22e-d2d2aa4cbfa6\") " pod="openshift-ovn-kubernetes/ovnkube-node-f6br6"
Jul 30 12:59:32.596858 ip-10-0-143-153 kubenswrapper[2566]: I0730 12:59:32.595396    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/5eedd146-086a-4a5d-a331-5c1dc35f8e9e-host-slash\") pod \"iptables-alerter-m8zwx\" (UID: \"5eedd146-086a-4a5d-a331-5c1dc35f8e9e\") " pod="openshift-network-operator/iptables-alerter-m8zwx"
Jul 30 12:59:32.596858 ip-10-0-143-153 kubenswrapper[2566]: I0730 12:59:32.595407    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/0e113987-a362-4c64-825a-1f883ab76ec9-os-release\") pod \"multus-additional-cni-plugins-8br4n\" (UID: \"0e113987-a362-4c64-825a-1f883ab76ec9\") " pod="openshift-multus/multus-additional-cni-plugins-8br4n"
Jul 30 12:59:32.596858 ip-10-0-143-153 kubenswrapper[2566]: I0730 12:59:32.595426    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/d1644e14-73e0-40a9-a205-7bdd0eefe290-cni-binary-copy\") pod \"multus-gppm2\" (UID: \"d1644e14-73e0-40a9-a205-7bdd0eefe290\") " pod="openshift-multus/multus-gppm2"
Jul 30 12:59:32.596858 ip-10-0-143-153 kubenswrapper[2566]: I0730 12:59:32.595443    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/d1644e14-73e0-40a9-a205-7bdd0eefe290-host-var-lib-cni-bin\") pod \"multus-gppm2\" (UID: \"d1644e14-73e0-40a9-a205-7bdd0eefe290\") " pod="openshift-multus/multus-gppm2"
Jul 30 12:59:32.596858 ip-10-0-143-153 kubenswrapper[2566]: I0730 12:59:32.595458    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/0e113987-a362-4c64-825a-1f883ab76ec9-tuning-conf-dir\") pod \"multus-additional-cni-plugins-8br4n\" (UID: \"0e113987-a362-4c64-825a-1f883ab76ec9\") " pod="openshift-multus/multus-additional-cni-plugins-8br4n"
Jul 30 12:59:32.596858 ip-10-0-143-153 kubenswrapper[2566]: I0730 12:59:32.595475    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/c2428457-ecf0-45c5-b008-7a51403785c9-dbus\") pod \"global-pull-secret-syncer-9bp7v\" (UID: \"c2428457-ecf0-45c5-b008-7a51403785c9\") " pod="kube-system/global-pull-secret-syncer-9bp7v"
Jul 30 12:59:32.596858 ip-10-0-143-153 kubenswrapper[2566]: I0730 12:59:32.595483    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/d1644e14-73e0-40a9-a205-7bdd0eefe290-host-var-lib-cni-bin\") pod \"multus-gppm2\" (UID: \"d1644e14-73e0-40a9-a205-7bdd0eefe290\") " pod="openshift-multus/multus-gppm2"
Jul 30 12:59:32.596858 ip-10-0-143-153 kubenswrapper[2566]: I0730 12:59:32.595571    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/3ebbc209-4373-44d8-a22e-d2d2aa4cbfa6-env-overrides\") pod \"ovnkube-node-f6br6\" (UID: \"3ebbc209-4373-44d8-a22e-d2d2aa4cbfa6\") " pod="openshift-ovn-kubernetes/ovnkube-node-f6br6"
Jul 30 12:59:32.596858 ip-10-0-143-153 kubenswrapper[2566]: I0730 12:59:32.595585    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/0e113987-a362-4c64-825a-1f883ab76ec9-tuning-conf-dir\") pod \"multus-additional-cni-plugins-8br4n\" (UID: \"0e113987-a362-4c64-825a-1f883ab76ec9\") " pod="openshift-multus/multus-additional-cni-plugins-8br4n"
Jul 30 12:59:32.596858 ip-10-0-143-153 kubenswrapper[2566]: I0730 12:59:32.595609    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/389ae0b4-e97d-4637-8836-5d349b4b2182-etc-sysctl-conf\") pod \"tuned-pvtx9\" (UID: \"389ae0b4-e97d-4637-8836-5d349b4b2182\") " pod="openshift-cluster-node-tuning-operator/tuned-pvtx9"
Jul 30 12:59:32.596858 ip-10-0-143-153 kubenswrapper[2566]: I0730 12:59:32.595626    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/389ae0b4-e97d-4637-8836-5d349b4b2182-var-lib-kubelet\") pod \"tuned-pvtx9\" (UID: \"389ae0b4-e97d-4637-8836-5d349b4b2182\") " pod="openshift-cluster-node-tuning-operator/tuned-pvtx9"
Jul 30 12:59:32.597410 ip-10-0-143-153 kubenswrapper[2566]: I0730 12:59:32.595641    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jw4nl\" (UniqueName: \"kubernetes.io/projected/389ae0b4-e97d-4637-8836-5d349b4b2182-kube-api-access-jw4nl\") pod \"tuned-pvtx9\" (UID: \"389ae0b4-e97d-4637-8836-5d349b4b2182\") " pod="openshift-cluster-node-tuning-operator/tuned-pvtx9"
Jul 30 12:59:32.597410 ip-10-0-143-153 kubenswrapper[2566]: I0730 12:59:32.595655    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/3ebbc209-4373-44d8-a22e-d2d2aa4cbfa6-host-run-netns\") pod \"ovnkube-node-f6br6\" (UID: \"3ebbc209-4373-44d8-a22e-d2d2aa4cbfa6\") " pod="openshift-ovn-kubernetes/ovnkube-node-f6br6"
Jul 30 12:59:32.597410 ip-10-0-143-153 kubenswrapper[2566]: I0730 12:59:32.595677    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/3ebbc209-4373-44d8-a22e-d2d2aa4cbfa6-run-ovn\") pod \"ovnkube-node-f6br6\" (UID: \"3ebbc209-4373-44d8-a22e-d2d2aa4cbfa6\") " pod="openshift-ovn-kubernetes/ovnkube-node-f6br6"
Jul 30 12:59:32.597410 ip-10-0-143-153 kubenswrapper[2566]: I0730 12:59:32.595704    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/d1644e14-73e0-40a9-a205-7bdd0eefe290-cnibin\") pod \"multus-gppm2\" (UID: \"d1644e14-73e0-40a9-a205-7bdd0eefe290\") " pod="openshift-multus/multus-gppm2"
Jul 30 12:59:32.597410 ip-10-0-143-153 kubenswrapper[2566]: I0730 12:59:32.595725    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/389ae0b4-e97d-4637-8836-5d349b4b2182-etc-modprobe-d\") pod \"tuned-pvtx9\" (UID: \"389ae0b4-e97d-4637-8836-5d349b4b2182\") " pod="openshift-cluster-node-tuning-operator/tuned-pvtx9"
Jul 30 12:59:32.597410 ip-10-0-143-153 kubenswrapper[2566]: I0730 12:59:32.595742    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/d1644e14-73e0-40a9-a205-7bdd0eefe290-etc-kubernetes\") pod \"multus-gppm2\" (UID: \"d1644e14-73e0-40a9-a205-7bdd0eefe290\") " pod="openshift-multus/multus-gppm2"
Jul 30 12:59:32.597410 ip-10-0-143-153 kubenswrapper[2566]: I0730 12:59:32.595773    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-f97hw\" (UniqueName: \"kubernetes.io/projected/b6cb9164-228a-4fff-b909-8be034a2b11a-kube-api-access-f97hw\") pod \"node-ca-9lmmp\" (UID: \"b6cb9164-228a-4fff-b909-8be034a2b11a\") " pod="openshift-image-registry/node-ca-9lmmp"
Jul 30 12:59:32.597410 ip-10-0-143-153 kubenswrapper[2566]: I0730 12:59:32.595774    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/d1644e14-73e0-40a9-a205-7bdd0eefe290-etc-kubernetes\") pod \"multus-gppm2\" (UID: \"d1644e14-73e0-40a9-a205-7bdd0eefe290\") " pod="openshift-multus/multus-gppm2"
Jul 30 12:59:32.597410 ip-10-0-143-153 kubenswrapper[2566]: I0730 12:59:32.595796    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/d1644e14-73e0-40a9-a205-7bdd0eefe290-cnibin\") pod \"multus-gppm2\" (UID: \"d1644e14-73e0-40a9-a205-7bdd0eefe290\") " pod="openshift-multus/multus-gppm2"
Jul 30 12:59:32.597410 ip-10-0-143-153 kubenswrapper[2566]: I0730 12:59:32.595813    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/389ae0b4-e97d-4637-8836-5d349b4b2182-etc-systemd\") pod \"tuned-pvtx9\" (UID: \"389ae0b4-e97d-4637-8836-5d349b4b2182\") " pod="openshift-cluster-node-tuning-operator/tuned-pvtx9"
Jul 30 12:59:32.597410 ip-10-0-143-153 kubenswrapper[2566]: I0730 12:59:32.595837    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7g7bn\" (UniqueName: \"kubernetes.io/projected/995cd086-39a7-4097-971a-1c4e6c08576b-kube-api-access-7g7bn\") pod \"network-metrics-daemon-kb44p\" (UID: \"995cd086-39a7-4097-971a-1c4e6c08576b\") " pod="openshift-multus/network-metrics-daemon-kb44p"
Jul 30 12:59:32.597410 ip-10-0-143-153 kubenswrapper[2566]: I0730 12:59:32.595861    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/3ebbc209-4373-44d8-a22e-d2d2aa4cbfa6-run-openvswitch\") pod \"ovnkube-node-f6br6\" (UID: \"3ebbc209-4373-44d8-a22e-d2d2aa4cbfa6\") " pod="openshift-ovn-kubernetes/ovnkube-node-f6br6"
Jul 30 12:59:32.597410 ip-10-0-143-153 kubenswrapper[2566]: I0730 12:59:32.595905    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/d1644e14-73e0-40a9-a205-7bdd0eefe290-cni-binary-copy\") pod \"multus-gppm2\" (UID: \"d1644e14-73e0-40a9-a205-7bdd0eefe290\") " pod="openshift-multus/multus-gppm2"
Jul 30 12:59:32.597410 ip-10-0-143-153 kubenswrapper[2566]: I0730 12:59:32.596020    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/d1644e14-73e0-40a9-a205-7bdd0eefe290-multus-daemon-config\") pod \"multus-gppm2\" (UID: \"d1644e14-73e0-40a9-a205-7bdd0eefe290\") " pod="openshift-multus/multus-gppm2"
Jul 30 12:59:32.599410 ip-10-0-143-153 kubenswrapper[2566]: I0730 12:59:32.599374    2566 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory"
Jul 30 12:59:32.602914 ip-10-0-143-153 kubenswrapper[2566]: I0730 12:59:32.602892    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ndmqt\" (UniqueName: \"kubernetes.io/projected/95057af8-5515-4bb3-9147-613240e101bb-kube-api-access-ndmqt\") pod \"node-resolver-4tzjz\" (UID: \"95057af8-5515-4bb3-9147-613240e101bb\") " pod="openshift-dns/node-resolver-4tzjz"
Jul 30 12:59:32.603017 ip-10-0-143-153 kubenswrapper[2566]: I0730 12:59:32.602894    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tk52b\" (UniqueName: \"kubernetes.io/projected/0e113987-a362-4c64-825a-1f883ab76ec9-kube-api-access-tk52b\") pod \"multus-additional-cni-plugins-8br4n\" (UID: \"0e113987-a362-4c64-825a-1f883ab76ec9\") " pod="openshift-multus/multus-additional-cni-plugins-8br4n"
Jul 30 12:59:32.603017 ip-10-0-143-153 kubenswrapper[2566]: I0730 12:59:32.602957    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-plcsn\" (UniqueName: \"kubernetes.io/projected/abe34634-20e4-4e0b-9d22-565c35543229-kube-api-access-plcsn\") pod \"aws-ebs-csi-driver-node-4fdfw\" (UID: \"abe34634-20e4-4e0b-9d22-565c35543229\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4fdfw"
Jul 30 12:59:32.603017 ip-10-0-143-153 kubenswrapper[2566]: I0730 12:59:32.602950    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rd6r7\" (UniqueName: \"kubernetes.io/projected/d1644e14-73e0-40a9-a205-7bdd0eefe290-kube-api-access-rd6r7\") pod \"multus-gppm2\" (UID: \"d1644e14-73e0-40a9-a205-7bdd0eefe290\") " pod="openshift-multus/multus-gppm2"
Jul 30 12:59:32.603354 ip-10-0-143-153 kubenswrapper[2566]: I0730 12:59:32.603331    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-f97hw\" (UniqueName: \"kubernetes.io/projected/b6cb9164-228a-4fff-b909-8be034a2b11a-kube-api-access-f97hw\") pod \"node-ca-9lmmp\" (UID: \"b6cb9164-228a-4fff-b909-8be034a2b11a\") " pod="openshift-image-registry/node-ca-9lmmp"
Jul 30 12:59:32.676060 ip-10-0-143-153 kubenswrapper[2566]: W0730 12:59:32.676029    2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda8e6a8f600eea6e545d463bd99143fa2.slice/crio-d37d2605e14f76e75c5f8ae7fc72385741640904862b497252d40afaa5f411b9 WatchSource:0}: Error finding container d37d2605e14f76e75c5f8ae7fc72385741640904862b497252d40afaa5f411b9: Status 404 returned error can't find the container with id d37d2605e14f76e75c5f8ae7fc72385741640904862b497252d40afaa5f411b9
Jul 30 12:59:32.678209 ip-10-0-143-153 kubenswrapper[2566]: W0730 12:59:32.678184    2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3327a5e598b8ce026a5b536fdb99458b.slice/crio-0c93e3669ee27f2a6080731290993213547bb6258d9b4d9d058435ee2c4713a4 WatchSource:0}: Error finding container 0c93e3669ee27f2a6080731290993213547bb6258d9b4d9d058435ee2c4713a4: Status 404 returned error can't find the container with id 0c93e3669ee27f2a6080731290993213547bb6258d9b4d9d058435ee2c4713a4
Jul 30 12:59:32.682224 ip-10-0-143-153 kubenswrapper[2566]: I0730 12:59:32.682208    2566 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 30 12:59:32.696427 ip-10-0-143-153 kubenswrapper[2566]: I0730 12:59:32.696408    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wtcj7\" (UniqueName: \"kubernetes.io/projected/3ebbc209-4373-44d8-a22e-d2d2aa4cbfa6-kube-api-access-wtcj7\") pod \"ovnkube-node-f6br6\" (UID: \"3ebbc209-4373-44d8-a22e-d2d2aa4cbfa6\") " pod="openshift-ovn-kubernetes/ovnkube-node-f6br6"
Jul 30 12:59:32.696532 ip-10-0-143-153 kubenswrapper[2566]: I0730 12:59:32.696436    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/3ebbc209-4373-44d8-a22e-d2d2aa4cbfa6-etc-openvswitch\") pod \"ovnkube-node-f6br6\" (UID: \"3ebbc209-4373-44d8-a22e-d2d2aa4cbfa6\") " pod="openshift-ovn-kubernetes/ovnkube-node-f6br6"
Jul 30 12:59:32.696532 ip-10-0-143-153 kubenswrapper[2566]: I0730 12:59:32.696451    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/3ebbc209-4373-44d8-a22e-d2d2aa4cbfa6-ovnkube-script-lib\") pod \"ovnkube-node-f6br6\" (UID: \"3ebbc209-4373-44d8-a22e-d2d2aa4cbfa6\") " pod="openshift-ovn-kubernetes/ovnkube-node-f6br6"
Jul 30 12:59:32.696532 ip-10-0-143-153 kubenswrapper[2566]: I0730 12:59:32.696466    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/5eedd146-086a-4a5d-a331-5c1dc35f8e9e-host-slash\") pod \"iptables-alerter-m8zwx\" (UID: \"5eedd146-086a-4a5d-a331-5c1dc35f8e9e\") " pod="openshift-network-operator/iptables-alerter-m8zwx"
Jul 30 12:59:32.696532 ip-10-0-143-153 kubenswrapper[2566]: I0730 12:59:32.696488    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/c2428457-ecf0-45c5-b008-7a51403785c9-dbus\") pod \"global-pull-secret-syncer-9bp7v\" (UID: \"c2428457-ecf0-45c5-b008-7a51403785c9\") " pod="kube-system/global-pull-secret-syncer-9bp7v"
Jul 30 12:59:32.696532 ip-10-0-143-153 kubenswrapper[2566]: I0730 12:59:32.696518    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/3ebbc209-4373-44d8-a22e-d2d2aa4cbfa6-etc-openvswitch\") pod \"ovnkube-node-f6br6\" (UID: \"3ebbc209-4373-44d8-a22e-d2d2aa4cbfa6\") " pod="openshift-ovn-kubernetes/ovnkube-node-f6br6"
Jul 30 12:59:32.696708 ip-10-0-143-153 kubenswrapper[2566]: I0730 12:59:32.696545    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/5eedd146-086a-4a5d-a331-5c1dc35f8e9e-host-slash\") pod \"iptables-alerter-m8zwx\" (UID: \"5eedd146-086a-4a5d-a331-5c1dc35f8e9e\") " pod="openshift-network-operator/iptables-alerter-m8zwx"
Jul 30 12:59:32.696708 ip-10-0-143-153 kubenswrapper[2566]: I0730 12:59:32.696557    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/c2428457-ecf0-45c5-b008-7a51403785c9-dbus\") pod \"global-pull-secret-syncer-9bp7v\" (UID: \"c2428457-ecf0-45c5-b008-7a51403785c9\") " pod="kube-system/global-pull-secret-syncer-9bp7v"
Jul 30 12:59:32.696708 ip-10-0-143-153 kubenswrapper[2566]: I0730 12:59:32.696573    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/3ebbc209-4373-44d8-a22e-d2d2aa4cbfa6-env-overrides\") pod \"ovnkube-node-f6br6\" (UID: \"3ebbc209-4373-44d8-a22e-d2d2aa4cbfa6\") " pod="openshift-ovn-kubernetes/ovnkube-node-f6br6"
Jul 30 12:59:32.696708 ip-10-0-143-153 kubenswrapper[2566]: I0730 12:59:32.696597    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/389ae0b4-e97d-4637-8836-5d349b4b2182-etc-sysctl-conf\") pod \"tuned-pvtx9\" (UID: \"389ae0b4-e97d-4637-8836-5d349b4b2182\") " pod="openshift-cluster-node-tuning-operator/tuned-pvtx9"
Jul 30 12:59:32.696708 ip-10-0-143-153 kubenswrapper[2566]: I0730 12:59:32.696614    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/389ae0b4-e97d-4637-8836-5d349b4b2182-var-lib-kubelet\") pod \"tuned-pvtx9\" (UID: \"389ae0b4-e97d-4637-8836-5d349b4b2182\") " pod="openshift-cluster-node-tuning-operator/tuned-pvtx9"
Jul 30 12:59:32.696708 ip-10-0-143-153 kubenswrapper[2566]: I0730 12:59:32.696633    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jw4nl\" (UniqueName: \"kubernetes.io/projected/389ae0b4-e97d-4637-8836-5d349b4b2182-kube-api-access-jw4nl\") pod \"tuned-pvtx9\" (UID: \"389ae0b4-e97d-4637-8836-5d349b4b2182\") " pod="openshift-cluster-node-tuning-operator/tuned-pvtx9"
Jul 30 12:59:32.696708 ip-10-0-143-153 kubenswrapper[2566]: I0730 12:59:32.696655    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/3ebbc209-4373-44d8-a22e-d2d2aa4cbfa6-host-run-netns\") pod \"ovnkube-node-f6br6\" (UID: \"3ebbc209-4373-44d8-a22e-d2d2aa4cbfa6\") " pod="openshift-ovn-kubernetes/ovnkube-node-f6br6"
Jul 30 12:59:32.696708 ip-10-0-143-153 kubenswrapper[2566]: I0730 12:59:32.696674    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/3ebbc209-4373-44d8-a22e-d2d2aa4cbfa6-run-ovn\") pod \"ovnkube-node-f6br6\" (UID: \"3ebbc209-4373-44d8-a22e-d2d2aa4cbfa6\") " pod="openshift-ovn-kubernetes/ovnkube-node-f6br6"
Jul 30 12:59:32.696708 ip-10-0-143-153 kubenswrapper[2566]: I0730 12:59:32.696677    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/389ae0b4-e97d-4637-8836-5d349b4b2182-var-lib-kubelet\") pod \"tuned-pvtx9\" (UID: \"389ae0b4-e97d-4637-8836-5d349b4b2182\") " pod="openshift-cluster-node-tuning-operator/tuned-pvtx9"
Jul 30 12:59:32.696708 ip-10-0-143-153 kubenswrapper[2566]: I0730 12:59:32.696694    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/389ae0b4-e97d-4637-8836-5d349b4b2182-etc-modprobe-d\") pod \"tuned-pvtx9\" (UID: \"389ae0b4-e97d-4637-8836-5d349b4b2182\") " pod="openshift-cluster-node-tuning-operator/tuned-pvtx9"
Jul 30 12:59:32.697199 ip-10-0-143-153 kubenswrapper[2566]: I0730 12:59:32.696721    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/389ae0b4-e97d-4637-8836-5d349b4b2182-etc-systemd\") pod \"tuned-pvtx9\" (UID: \"389ae0b4-e97d-4637-8836-5d349b4b2182\") " pod="openshift-cluster-node-tuning-operator/tuned-pvtx9"
Jul 30 12:59:32.697199 ip-10-0-143-153 kubenswrapper[2566]: I0730 12:59:32.696741    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/389ae0b4-e97d-4637-8836-5d349b4b2182-etc-sysctl-conf\") pod \"tuned-pvtx9\" (UID: \"389ae0b4-e97d-4637-8836-5d349b4b2182\") " pod="openshift-cluster-node-tuning-operator/tuned-pvtx9"
Jul 30 12:59:32.697199 ip-10-0-143-153 kubenswrapper[2566]: I0730 12:59:32.696744    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/3ebbc209-4373-44d8-a22e-d2d2aa4cbfa6-host-run-netns\") pod \"ovnkube-node-f6br6\" (UID: \"3ebbc209-4373-44d8-a22e-d2d2aa4cbfa6\") " pod="openshift-ovn-kubernetes/ovnkube-node-f6br6"
Jul 30 12:59:32.697199 ip-10-0-143-153 kubenswrapper[2566]: I0730 12:59:32.696759    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7g7bn\" (UniqueName: \"kubernetes.io/projected/995cd086-39a7-4097-971a-1c4e6c08576b-kube-api-access-7g7bn\") pod \"network-metrics-daemon-kb44p\" (UID: \"995cd086-39a7-4097-971a-1c4e6c08576b\") " pod="openshift-multus/network-metrics-daemon-kb44p"
Jul 30 12:59:32.697199 ip-10-0-143-153 kubenswrapper[2566]: I0730 12:59:32.696787    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/3ebbc209-4373-44d8-a22e-d2d2aa4cbfa6-run-openvswitch\") pod \"ovnkube-node-f6br6\" (UID: \"3ebbc209-4373-44d8-a22e-d2d2aa4cbfa6\") " pod="openshift-ovn-kubernetes/ovnkube-node-f6br6"
Jul 30 12:59:32.697199 ip-10-0-143-153 kubenswrapper[2566]: I0730 12:59:32.696791    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/389ae0b4-e97d-4637-8836-5d349b4b2182-etc-systemd\") pod \"tuned-pvtx9\" (UID: \"389ae0b4-e97d-4637-8836-5d349b4b2182\") " pod="openshift-cluster-node-tuning-operator/tuned-pvtx9"
Jul 30 12:59:32.697199 ip-10-0-143-153 kubenswrapper[2566]: I0730 12:59:32.696760    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/3ebbc209-4373-44d8-a22e-d2d2aa4cbfa6-run-ovn\") pod \"ovnkube-node-f6br6\" (UID: \"3ebbc209-4373-44d8-a22e-d2d2aa4cbfa6\") " pod="openshift-ovn-kubernetes/ovnkube-node-f6br6"
Jul 30 12:59:32.697199 ip-10-0-143-153 kubenswrapper[2566]: I0730 12:59:32.696812    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/389ae0b4-e97d-4637-8836-5d349b4b2182-sys\") pod \"tuned-pvtx9\" (UID: \"389ae0b4-e97d-4637-8836-5d349b4b2182\") " pod="openshift-cluster-node-tuning-operator/tuned-pvtx9"
Jul 30 12:59:32.697199 ip-10-0-143-153 kubenswrapper[2566]: I0730 12:59:32.696835    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/3ebbc209-4373-44d8-a22e-d2d2aa4cbfa6-node-log\") pod \"ovnkube-node-f6br6\" (UID: \"3ebbc209-4373-44d8-a22e-d2d2aa4cbfa6\") " pod="openshift-ovn-kubernetes/ovnkube-node-f6br6"
Jul 30 12:59:32.697199 ip-10-0-143-153 kubenswrapper[2566]: I0730 12:59:32.696838    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/389ae0b4-e97d-4637-8836-5d349b4b2182-etc-modprobe-d\") pod \"tuned-pvtx9\" (UID: \"389ae0b4-e97d-4637-8836-5d349b4b2182\") " pod="openshift-cluster-node-tuning-operator/tuned-pvtx9"
Jul 30 12:59:32.697199 ip-10-0-143-153 kubenswrapper[2566]: I0730 12:59:32.696837    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/3ebbc209-4373-44d8-a22e-d2d2aa4cbfa6-run-openvswitch\") pod \"ovnkube-node-f6br6\" (UID: \"3ebbc209-4373-44d8-a22e-d2d2aa4cbfa6\") " pod="openshift-ovn-kubernetes/ovnkube-node-f6br6"
Jul 30 12:59:32.697199 ip-10-0-143-153 kubenswrapper[2566]: I0730 12:59:32.696860    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/3ebbc209-4373-44d8-a22e-d2d2aa4cbfa6-host-cni-netd\") pod \"ovnkube-node-f6br6\" (UID: \"3ebbc209-4373-44d8-a22e-d2d2aa4cbfa6\") " pod="openshift-ovn-kubernetes/ovnkube-node-f6br6"
Jul 30 12:59:32.697199 ip-10-0-143-153 kubenswrapper[2566]: I0730 12:59:32.696866    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/3ebbc209-4373-44d8-a22e-d2d2aa4cbfa6-node-log\") pod \"ovnkube-node-f6br6\" (UID: \"3ebbc209-4373-44d8-a22e-d2d2aa4cbfa6\") " pod="openshift-ovn-kubernetes/ovnkube-node-f6br6"
Jul 30 12:59:32.697199 ip-10-0-143-153 kubenswrapper[2566]: I0730 12:59:32.696870    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/389ae0b4-e97d-4637-8836-5d349b4b2182-sys\") pod \"tuned-pvtx9\" (UID: \"389ae0b4-e97d-4637-8836-5d349b4b2182\") " pod="openshift-cluster-node-tuning-operator/tuned-pvtx9"
Jul 30 12:59:32.697199 ip-10-0-143-153 kubenswrapper[2566]: I0730 12:59:32.696890    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gqc9f\" (UniqueName: \"kubernetes.io/projected/5eedd146-086a-4a5d-a331-5c1dc35f8e9e-kube-api-access-gqc9f\") pod \"iptables-alerter-m8zwx\" (UID: \"5eedd146-086a-4a5d-a331-5c1dc35f8e9e\") " pod="openshift-network-operator/iptables-alerter-m8zwx"
Jul 30 12:59:32.697199 ip-10-0-143-153 kubenswrapper[2566]: I0730 12:59:32.696893    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/3ebbc209-4373-44d8-a22e-d2d2aa4cbfa6-host-cni-netd\") pod \"ovnkube-node-f6br6\" (UID: \"3ebbc209-4373-44d8-a22e-d2d2aa4cbfa6\") " pod="openshift-ovn-kubernetes/ovnkube-node-f6br6"
Jul 30 12:59:32.697199 ip-10-0-143-153 kubenswrapper[2566]: I0730 12:59:32.696913    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/3ebbc209-4373-44d8-a22e-d2d2aa4cbfa6-var-lib-openvswitch\") pod \"ovnkube-node-f6br6\" (UID: \"3ebbc209-4373-44d8-a22e-d2d2aa4cbfa6\") " pod="openshift-ovn-kubernetes/ovnkube-node-f6br6"
Jul 30 12:59:32.697199 ip-10-0-143-153 kubenswrapper[2566]: I0730 12:59:32.696933    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/389ae0b4-e97d-4637-8836-5d349b4b2182-etc-kubernetes\") pod \"tuned-pvtx9\" (UID: \"389ae0b4-e97d-4637-8836-5d349b4b2182\") " pod="openshift-cluster-node-tuning-operator/tuned-pvtx9"
Jul 30 12:59:32.699055 ip-10-0-143-153 kubenswrapper[2566]: I0730 12:59:32.696949    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/3ebbc209-4373-44d8-a22e-d2d2aa4cbfa6-host-slash\") pod \"ovnkube-node-f6br6\" (UID: \"3ebbc209-4373-44d8-a22e-d2d2aa4cbfa6\") " pod="openshift-ovn-kubernetes/ovnkube-node-f6br6"
Jul 30 12:59:32.699055 ip-10-0-143-153 kubenswrapper[2566]: I0730 12:59:32.696986    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/3ebbc209-4373-44d8-a22e-d2d2aa4cbfa6-run-systemd\") pod \"ovnkube-node-f6br6\" (UID: \"3ebbc209-4373-44d8-a22e-d2d2aa4cbfa6\") " pod="openshift-ovn-kubernetes/ovnkube-node-f6br6"
Jul 30 12:59:32.699055 ip-10-0-143-153 kubenswrapper[2566]: I0730 12:59:32.697009    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/3ebbc209-4373-44d8-a22e-d2d2aa4cbfa6-log-socket\") pod \"ovnkube-node-f6br6\" (UID: \"3ebbc209-4373-44d8-a22e-d2d2aa4cbfa6\") " pod="openshift-ovn-kubernetes/ovnkube-node-f6br6"
Jul 30 12:59:32.699055 ip-10-0-143-153 kubenswrapper[2566]: I0730 12:59:32.697011    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/3ebbc209-4373-44d8-a22e-d2d2aa4cbfa6-host-slash\") pod \"ovnkube-node-f6br6\" (UID: \"3ebbc209-4373-44d8-a22e-d2d2aa4cbfa6\") " pod="openshift-ovn-kubernetes/ovnkube-node-f6br6"
Jul 30 12:59:32.699055 ip-10-0-143-153 kubenswrapper[2566]: I0730 12:59:32.697014    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/389ae0b4-e97d-4637-8836-5d349b4b2182-etc-kubernetes\") pod \"tuned-pvtx9\" (UID: \"389ae0b4-e97d-4637-8836-5d349b4b2182\") " pod="openshift-cluster-node-tuning-operator/tuned-pvtx9"
Jul 30 12:59:32.699055 ip-10-0-143-153 kubenswrapper[2566]: I0730 12:59:32.697039    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/3ebbc209-4373-44d8-a22e-d2d2aa4cbfa6-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-f6br6\" (UID: \"3ebbc209-4373-44d8-a22e-d2d2aa4cbfa6\") " pod="openshift-ovn-kubernetes/ovnkube-node-f6br6"
Jul 30 12:59:32.699055 ip-10-0-143-153 kubenswrapper[2566]: I0730 12:59:32.697064    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/3ebbc209-4373-44d8-a22e-d2d2aa4cbfa6-var-lib-openvswitch\") pod \"ovnkube-node-f6br6\" (UID: \"3ebbc209-4373-44d8-a22e-d2d2aa4cbfa6\") " pod="openshift-ovn-kubernetes/ovnkube-node-f6br6"
Jul 30 12:59:32.699055 ip-10-0-143-153 kubenswrapper[2566]: I0730 12:59:32.697067    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/3ebbc209-4373-44d8-a22e-d2d2aa4cbfa6-ovnkube-config\") pod \"ovnkube-node-f6br6\" (UID: \"3ebbc209-4373-44d8-a22e-d2d2aa4cbfa6\") " pod="openshift-ovn-kubernetes/ovnkube-node-f6br6"
Jul 30 12:59:32.699055 ip-10-0-143-153 kubenswrapper[2566]: I0730 12:59:32.697108    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/3ebbc209-4373-44d8-a22e-d2d2aa4cbfa6-run-systemd\") pod \"ovnkube-node-f6br6\" (UID: \"3ebbc209-4373-44d8-a22e-d2d2aa4cbfa6\") " pod="openshift-ovn-kubernetes/ovnkube-node-f6br6"
Jul 30 12:59:32.699055 ip-10-0-143-153 kubenswrapper[2566]: I0730 12:59:32.697110    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/3ebbc209-4373-44d8-a22e-d2d2aa4cbfa6-log-socket\") pod \"ovnkube-node-f6br6\" (UID: \"3ebbc209-4373-44d8-a22e-d2d2aa4cbfa6\") " pod="openshift-ovn-kubernetes/ovnkube-node-f6br6"
Jul 30 12:59:32.699055 ip-10-0-143-153 kubenswrapper[2566]: I0730 12:59:32.697127    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/995cd086-39a7-4097-971a-1c4e6c08576b-metrics-certs\") pod \"network-metrics-daemon-kb44p\" (UID: \"995cd086-39a7-4097-971a-1c4e6c08576b\") " pod="openshift-multus/network-metrics-daemon-kb44p"
Jul 30 12:59:32.699055 ip-10-0-143-153 kubenswrapper[2566]: I0730 12:59:32.697155    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/3ebbc209-4373-44d8-a22e-d2d2aa4cbfa6-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-f6br6\" (UID: \"3ebbc209-4373-44d8-a22e-d2d2aa4cbfa6\") " pod="openshift-ovn-kubernetes/ovnkube-node-f6br6"
Jul 30 12:59:32.699055 ip-10-0-143-153 kubenswrapper[2566]: I0730 12:59:32.697166    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/3ebbc209-4373-44d8-a22e-d2d2aa4cbfa6-host-kubelet\") pod \"ovnkube-node-f6br6\" (UID: \"3ebbc209-4373-44d8-a22e-d2d2aa4cbfa6\") " pod="openshift-ovn-kubernetes/ovnkube-node-f6br6"
Jul 30 12:59:32.699055 ip-10-0-143-153 kubenswrapper[2566]: I0730 12:59:32.697202    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/389ae0b4-e97d-4637-8836-5d349b4b2182-run\") pod \"tuned-pvtx9\" (UID: \"389ae0b4-e97d-4637-8836-5d349b4b2182\") " pod="openshift-cluster-node-tuning-operator/tuned-pvtx9"
Jul 30 12:59:32.699055 ip-10-0-143-153 kubenswrapper[2566]: I0730 12:59:32.697219    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/389ae0b4-e97d-4637-8836-5d349b4b2182-host\") pod \"tuned-pvtx9\" (UID: \"389ae0b4-e97d-4637-8836-5d349b4b2182\") " pod="openshift-cluster-node-tuning-operator/tuned-pvtx9"
Jul 30 12:59:32.699055 ip-10-0-143-153 kubenswrapper[2566]: I0730 12:59:32.697234    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/9c33f673-8361-433b-847f-081d6d4b2753-agent-certs\") pod \"konnectivity-agent-qt2mr\" (UID: \"9c33f673-8361-433b-847f-081d6d4b2753\") " pod="kube-system/konnectivity-agent-qt2mr"
Jul 30 12:59:32.699055 ip-10-0-143-153 kubenswrapper[2566]: I0730 12:59:32.697254    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/9c33f673-8361-433b-847f-081d6d4b2753-konnectivity-ca\") pod \"konnectivity-agent-qt2mr\" (UID: \"9c33f673-8361-433b-847f-081d6d4b2753\") " pod="kube-system/konnectivity-agent-qt2mr"
Jul 30 12:59:32.699671 ip-10-0-143-153 kubenswrapper[2566]: I0730 12:59:32.697278    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/389ae0b4-e97d-4637-8836-5d349b4b2182-lib-modules\") pod \"tuned-pvtx9\" (UID: \"389ae0b4-e97d-4637-8836-5d349b4b2182\") " pod="openshift-cluster-node-tuning-operator/tuned-pvtx9"
Jul 30 12:59:32.699671 ip-10-0-143-153 kubenswrapper[2566]: I0730 12:59:32.697267    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/389ae0b4-e97d-4637-8836-5d349b4b2182-run\") pod \"tuned-pvtx9\" (UID: \"389ae0b4-e97d-4637-8836-5d349b4b2182\") " pod="openshift-cluster-node-tuning-operator/tuned-pvtx9"
Jul 30 12:59:32.699671 ip-10-0-143-153 kubenswrapper[2566]: I0730 12:59:32.697301    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/389ae0b4-e97d-4637-8836-5d349b4b2182-tmp\") pod \"tuned-pvtx9\" (UID: \"389ae0b4-e97d-4637-8836-5d349b4b2182\") " pod="openshift-cluster-node-tuning-operator/tuned-pvtx9"
Jul 30 12:59:32.699671 ip-10-0-143-153 kubenswrapper[2566]: I0730 12:59:32.697337    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/3ebbc209-4373-44d8-a22e-d2d2aa4cbfa6-host-run-ovn-kubernetes\") pod \"ovnkube-node-f6br6\" (UID: \"3ebbc209-4373-44d8-a22e-d2d2aa4cbfa6\") " pod="openshift-ovn-kubernetes/ovnkube-node-f6br6"
Jul 30 12:59:32.699671 ip-10-0-143-153 kubenswrapper[2566]: I0730 12:59:32.697373    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/3ebbc209-4373-44d8-a22e-d2d2aa4cbfa6-host-cni-bin\") pod \"ovnkube-node-f6br6\" (UID: \"3ebbc209-4373-44d8-a22e-d2d2aa4cbfa6\") " pod="openshift-ovn-kubernetes/ovnkube-node-f6br6"
Jul 30 12:59:32.699671 ip-10-0-143-153 kubenswrapper[2566]: I0730 12:59:32.697404    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/c2428457-ecf0-45c5-b008-7a51403785c9-kubelet-config\") pod \"global-pull-secret-syncer-9bp7v\" (UID: \"c2428457-ecf0-45c5-b008-7a51403785c9\") " pod="kube-system/global-pull-secret-syncer-9bp7v"
Jul 30 12:59:32.699671 ip-10-0-143-153 kubenswrapper[2566]: I0730 12:59:32.697444    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/c2428457-ecf0-45c5-b008-7a51403785c9-original-pull-secret\") pod \"global-pull-secret-syncer-9bp7v\" (UID: \"c2428457-ecf0-45c5-b008-7a51403785c9\") " pod="kube-system/global-pull-secret-syncer-9bp7v"
Jul 30 12:59:32.699671 ip-10-0-143-153 kubenswrapper[2566]: I0730 12:59:32.697468    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/389ae0b4-e97d-4637-8836-5d349b4b2182-etc-sysctl-d\") pod \"tuned-pvtx9\" (UID: \"389ae0b4-e97d-4637-8836-5d349b4b2182\") " pod="openshift-cluster-node-tuning-operator/tuned-pvtx9"
Jul 30 12:59:32.699671 ip-10-0-143-153 kubenswrapper[2566]: I0730 12:59:32.697497    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/3ebbc209-4373-44d8-a22e-d2d2aa4cbfa6-systemd-units\") pod \"ovnkube-node-f6br6\" (UID: \"3ebbc209-4373-44d8-a22e-d2d2aa4cbfa6\") " pod="openshift-ovn-kubernetes/ovnkube-node-f6br6"
Jul 30 12:59:32.699671 ip-10-0-143-153 kubenswrapper[2566]: I0730 12:59:32.697522    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/5eedd146-086a-4a5d-a331-5c1dc35f8e9e-iptables-alerter-script\") pod \"iptables-alerter-m8zwx\" (UID: \"5eedd146-086a-4a5d-a331-5c1dc35f8e9e\") " pod="openshift-network-operator/iptables-alerter-m8zwx"
Jul 30 12:59:32.699671 ip-10-0-143-153 kubenswrapper[2566]: I0730 12:59:32.697575    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/389ae0b4-e97d-4637-8836-5d349b4b2182-etc-sysconfig\") pod \"tuned-pvtx9\" (UID: \"389ae0b4-e97d-4637-8836-5d349b4b2182\") " pod="openshift-cluster-node-tuning-operator/tuned-pvtx9"
Jul 30 12:59:32.699671 ip-10-0-143-153 kubenswrapper[2566]: I0730 12:59:32.697606    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/3ebbc209-4373-44d8-a22e-d2d2aa4cbfa6-ovn-node-metrics-cert\") pod \"ovnkube-node-f6br6\" (UID: \"3ebbc209-4373-44d8-a22e-d2d2aa4cbfa6\") " pod="openshift-ovn-kubernetes/ovnkube-node-f6br6"
Jul 30 12:59:32.699671 ip-10-0-143-153 kubenswrapper[2566]: I0730 12:59:32.697607    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/3ebbc209-4373-44d8-a22e-d2d2aa4cbfa6-env-overrides\") pod \"ovnkube-node-f6br6\" (UID: \"3ebbc209-4373-44d8-a22e-d2d2aa4cbfa6\") " pod="openshift-ovn-kubernetes/ovnkube-node-f6br6"
Jul 30 12:59:32.699671 ip-10-0-143-153 kubenswrapper[2566]: I0730 12:59:32.697645    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/3ebbc209-4373-44d8-a22e-d2d2aa4cbfa6-ovnkube-config\") pod \"ovnkube-node-f6br6\" (UID: \"3ebbc209-4373-44d8-a22e-d2d2aa4cbfa6\") " pod="openshift-ovn-kubernetes/ovnkube-node-f6br6"
Jul 30 12:59:32.699671 ip-10-0-143-153 kubenswrapper[2566]: I0730 12:59:32.697671    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/3ebbc209-4373-44d8-a22e-d2d2aa4cbfa6-host-kubelet\") pod \"ovnkube-node-f6br6\" (UID: \"3ebbc209-4373-44d8-a22e-d2d2aa4cbfa6\") " pod="openshift-ovn-kubernetes/ovnkube-node-f6br6"
Jul 30 12:59:32.699671 ip-10-0-143-153 kubenswrapper[2566]: I0730 12:59:32.697675    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/3ebbc209-4373-44d8-a22e-d2d2aa4cbfa6-ovnkube-script-lib\") pod \"ovnkube-node-f6br6\" (UID: \"3ebbc209-4373-44d8-a22e-d2d2aa4cbfa6\") " pod="openshift-ovn-kubernetes/ovnkube-node-f6br6"
Jul 30 12:59:32.699671 ip-10-0-143-153 kubenswrapper[2566]: I0730 12:59:32.697718    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/389ae0b4-e97d-4637-8836-5d349b4b2182-host\") pod \"tuned-pvtx9\" (UID: \"389ae0b4-e97d-4637-8836-5d349b4b2182\") " pod="openshift-cluster-node-tuning-operator/tuned-pvtx9"
Jul 30 12:59:32.700358 ip-10-0-143-153 kubenswrapper[2566]: I0730 12:59:32.697725    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/3ebbc209-4373-44d8-a22e-d2d2aa4cbfa6-host-run-ovn-kubernetes\") pod \"ovnkube-node-f6br6\" (UID: \"3ebbc209-4373-44d8-a22e-d2d2aa4cbfa6\") " pod="openshift-ovn-kubernetes/ovnkube-node-f6br6"
Jul 30 12:59:32.700358 ip-10-0-143-153 kubenswrapper[2566]: I0730 12:59:32.697772    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/3ebbc209-4373-44d8-a22e-d2d2aa4cbfa6-host-cni-bin\") pod \"ovnkube-node-f6br6\" (UID: \"3ebbc209-4373-44d8-a22e-d2d2aa4cbfa6\") " pod="openshift-ovn-kubernetes/ovnkube-node-f6br6"
Jul 30 12:59:32.700358 ip-10-0-143-153 kubenswrapper[2566]: I0730 12:59:32.697773    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/3ebbc209-4373-44d8-a22e-d2d2aa4cbfa6-systemd-units\") pod \"ovnkube-node-f6br6\" (UID: \"3ebbc209-4373-44d8-a22e-d2d2aa4cbfa6\") " pod="openshift-ovn-kubernetes/ovnkube-node-f6br6"
Jul 30 12:59:32.700358 ip-10-0-143-153 kubenswrapper[2566]: I0730 12:59:32.697821    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/c2428457-ecf0-45c5-b008-7a51403785c9-kubelet-config\") pod \"global-pull-secret-syncer-9bp7v\" (UID: \"c2428457-ecf0-45c5-b008-7a51403785c9\") " pod="kube-system/global-pull-secret-syncer-9bp7v"
Jul 30 12:59:32.700358 ip-10-0-143-153 kubenswrapper[2566]: I0730 12:59:32.697849    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/389ae0b4-e97d-4637-8836-5d349b4b2182-etc-sysctl-d\") pod \"tuned-pvtx9\" (UID: \"389ae0b4-e97d-4637-8836-5d349b4b2182\") " pod="openshift-cluster-node-tuning-operator/tuned-pvtx9"
Jul 30 12:59:32.700358 ip-10-0-143-153 kubenswrapper[2566]: I0730 12:59:32.697910    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/389ae0b4-e97d-4637-8836-5d349b4b2182-lib-modules\") pod \"tuned-pvtx9\" (UID: \"389ae0b4-e97d-4637-8836-5d349b4b2182\") " pod="openshift-cluster-node-tuning-operator/tuned-pvtx9"
Jul 30 12:59:32.700358 ip-10-0-143-153 kubenswrapper[2566]: E0730 12:59:32.697234    2566 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 30 12:59:32.700358 ip-10-0-143-153 kubenswrapper[2566]: I0730 12:59:32.697926    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/389ae0b4-e97d-4637-8836-5d349b4b2182-etc-sysconfig\") pod \"tuned-pvtx9\" (UID: \"389ae0b4-e97d-4637-8836-5d349b4b2182\") " pod="openshift-cluster-node-tuning-operator/tuned-pvtx9"
Jul 30 12:59:32.700358 ip-10-0-143-153 kubenswrapper[2566]: E0730 12:59:32.698001    2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/995cd086-39a7-4097-971a-1c4e6c08576b-metrics-certs podName:995cd086-39a7-4097-971a-1c4e6c08576b nodeName:}" failed. No retries permitted until 2026-07-30 12:59:33.197961342 +0000 UTC m=+2.126649588 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/995cd086-39a7-4097-971a-1c4e6c08576b-metrics-certs") pod "network-metrics-daemon-kb44p" (UID: "995cd086-39a7-4097-971a-1c4e6c08576b") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 30 12:59:32.700358 ip-10-0-143-153 kubenswrapper[2566]: I0730 12:59:32.698144    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/9c33f673-8361-433b-847f-081d6d4b2753-konnectivity-ca\") pod \"konnectivity-agent-qt2mr\" (UID: \"9c33f673-8361-433b-847f-081d6d4b2753\") " pod="kube-system/konnectivity-agent-qt2mr"
Jul 30 12:59:32.700358 ip-10-0-143-153 kubenswrapper[2566]: I0730 12:59:32.698182    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/389ae0b4-e97d-4637-8836-5d349b4b2182-etc-tuned\") pod \"tuned-pvtx9\" (UID: \"389ae0b4-e97d-4637-8836-5d349b4b2182\") " pod="openshift-cluster-node-tuning-operator/tuned-pvtx9"
Jul 30 12:59:32.700358 ip-10-0-143-153 kubenswrapper[2566]: I0730 12:59:32.698249    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wvdt7\" (UniqueName: \"kubernetes.io/projected/be740ef9-ac84-4ef4-ad66-7f61253c6c28-kube-api-access-wvdt7\") pod \"network-check-target-bjnvm\" (UID: \"be740ef9-ac84-4ef4-ad66-7f61253c6c28\") " pod="openshift-network-diagnostics/network-check-target-bjnvm"
Jul 30 12:59:32.700358 ip-10-0-143-153 kubenswrapper[2566]: E0730 12:59:32.697871    2566 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 30 12:59:32.700358 ip-10-0-143-153 kubenswrapper[2566]: I0730 12:59:32.698441    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/5eedd146-086a-4a5d-a331-5c1dc35f8e9e-iptables-alerter-script\") pod \"iptables-alerter-m8zwx\" (UID: \"5eedd146-086a-4a5d-a331-5c1dc35f8e9e\") " pod="openshift-network-operator/iptables-alerter-m8zwx"
Jul 30 12:59:32.700358 ip-10-0-143-153 kubenswrapper[2566]: E0730 12:59:32.698466    2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c2428457-ecf0-45c5-b008-7a51403785c9-original-pull-secret podName:c2428457-ecf0-45c5-b008-7a51403785c9 nodeName:}" failed. No retries permitted until 2026-07-30 12:59:33.198448766 +0000 UTC m=+2.127137017 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/c2428457-ecf0-45c5-b008-7a51403785c9-original-pull-secret") pod "global-pull-secret-syncer-9bp7v" (UID: "c2428457-ecf0-45c5-b008-7a51403785c9") : object "kube-system"/"original-pull-secret" not registered
Jul 30 12:59:32.700358 ip-10-0-143-153 kubenswrapper[2566]: I0730 12:59:32.700000    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/389ae0b4-e97d-4637-8836-5d349b4b2182-tmp\") pod \"tuned-pvtx9\" (UID: \"389ae0b4-e97d-4637-8836-5d349b4b2182\") " pod="openshift-cluster-node-tuning-operator/tuned-pvtx9"
Jul 30 12:59:32.700358 ip-10-0-143-153 kubenswrapper[2566]: I0730 12:59:32.700160    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/9c33f673-8361-433b-847f-081d6d4b2753-agent-certs\") pod \"konnectivity-agent-qt2mr\" (UID: \"9c33f673-8361-433b-847f-081d6d4b2753\") " pod="kube-system/konnectivity-agent-qt2mr"
Jul 30 12:59:32.700857 ip-10-0-143-153 kubenswrapper[2566]: I0730 12:59:32.700198    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/389ae0b4-e97d-4637-8836-5d349b4b2182-etc-tuned\") pod \"tuned-pvtx9\" (UID: \"389ae0b4-e97d-4637-8836-5d349b4b2182\") " pod="openshift-cluster-node-tuning-operator/tuned-pvtx9"
Jul 30 12:59:32.700857 ip-10-0-143-153 kubenswrapper[2566]: I0730 12:59:32.700315    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/3ebbc209-4373-44d8-a22e-d2d2aa4cbfa6-ovn-node-metrics-cert\") pod \"ovnkube-node-f6br6\" (UID: \"3ebbc209-4373-44d8-a22e-d2d2aa4cbfa6\") " pod="openshift-ovn-kubernetes/ovnkube-node-f6br6"
Jul 30 12:59:32.705145 ip-10-0-143-153 kubenswrapper[2566]: E0730 12:59:32.705124    2566 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 30 12:59:32.705145 ip-10-0-143-153 kubenswrapper[2566]: E0730 12:59:32.705148    2566 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 30 12:59:32.705298 ip-10-0-143-153 kubenswrapper[2566]: E0730 12:59:32.705162    2566 projected.go:196] Error preparing data for projected volume kube-api-access-wvdt7 for pod openshift-network-diagnostics/network-check-target-bjnvm: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 30 12:59:32.705298 ip-10-0-143-153 kubenswrapper[2566]: E0730 12:59:32.705284    2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/be740ef9-ac84-4ef4-ad66-7f61253c6c28-kube-api-access-wvdt7 podName:be740ef9-ac84-4ef4-ad66-7f61253c6c28 nodeName:}" failed. No retries permitted until 2026-07-30 12:59:33.205262932 +0000 UTC m=+2.133951176 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-wvdt7" (UniqueName: "kubernetes.io/projected/be740ef9-ac84-4ef4-ad66-7f61253c6c28-kube-api-access-wvdt7") pod "network-check-target-bjnvm" (UID: "be740ef9-ac84-4ef4-ad66-7f61253c6c28") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 30 12:59:32.706817 ip-10-0-143-153 kubenswrapper[2566]: I0730 12:59:32.706540    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7g7bn\" (UniqueName: \"kubernetes.io/projected/995cd086-39a7-4097-971a-1c4e6c08576b-kube-api-access-7g7bn\") pod \"network-metrics-daemon-kb44p\" (UID: \"995cd086-39a7-4097-971a-1c4e6c08576b\") " pod="openshift-multus/network-metrics-daemon-kb44p"
Jul 30 12:59:32.706935 ip-10-0-143-153 kubenswrapper[2566]: I0730 12:59:32.706915    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wtcj7\" (UniqueName: \"kubernetes.io/projected/3ebbc209-4373-44d8-a22e-d2d2aa4cbfa6-kube-api-access-wtcj7\") pod \"ovnkube-node-f6br6\" (UID: \"3ebbc209-4373-44d8-a22e-d2d2aa4cbfa6\") " pod="openshift-ovn-kubernetes/ovnkube-node-f6br6"
Jul 30 12:59:32.707324 ip-10-0-143-153 kubenswrapper[2566]: I0730 12:59:32.707304    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gqc9f\" (UniqueName: \"kubernetes.io/projected/5eedd146-086a-4a5d-a331-5c1dc35f8e9e-kube-api-access-gqc9f\") pod \"iptables-alerter-m8zwx\" (UID: \"5eedd146-086a-4a5d-a331-5c1dc35f8e9e\") " pod="openshift-network-operator/iptables-alerter-m8zwx"
Jul 30 12:59:32.707324 ip-10-0-143-153 kubenswrapper[2566]: I0730 12:59:32.707298    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jw4nl\" (UniqueName: \"kubernetes.io/projected/389ae0b4-e97d-4637-8836-5d349b4b2182-kube-api-access-jw4nl\") pod \"tuned-pvtx9\" (UID: \"389ae0b4-e97d-4637-8836-5d349b4b2182\") " pod="openshift-cluster-node-tuning-operator/tuned-pvtx9"
Jul 30 12:59:32.759095 ip-10-0-143-153 kubenswrapper[2566]: I0730 12:59:32.758997    2566 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 30 12:59:32.802019 ip-10-0-143-153 kubenswrapper[2566]: I0730 12:59:32.801987    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-gppm2"
Jul 30 12:59:32.811751 ip-10-0-143-153 kubenswrapper[2566]: W0730 12:59:32.811727    2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd1644e14_73e0_40a9_a205_7bdd0eefe290.slice/crio-0a04fa0d3c2244385e9236f4cdec3cf64c480a8ae86752448bd14ca28fe2fede WatchSource:0}: Error finding container 0a04fa0d3c2244385e9236f4cdec3cf64c480a8ae86752448bd14ca28fe2fede: Status 404 returned error can't find the container with id 0a04fa0d3c2244385e9236f4cdec3cf64c480a8ae86752448bd14ca28fe2fede
Jul 30 12:59:32.826311 ip-10-0-143-153 kubenswrapper[2566]: I0730 12:59:32.826290    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-9lmmp"
Jul 30 12:59:32.834231 ip-10-0-143-153 kubenswrapper[2566]: I0730 12:59:32.834169    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-8br4n"
Jul 30 12:59:32.834332 ip-10-0-143-153 kubenswrapper[2566]: W0730 12:59:32.834299    2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb6cb9164_228a_4fff_b909_8be034a2b11a.slice/crio-d18b1d7e7d4d5a06c8f8086d600059d826c3e2d8e5b3dae2274175f64167b504 WatchSource:0}: Error finding container d18b1d7e7d4d5a06c8f8086d600059d826c3e2d8e5b3dae2274175f64167b504: Status 404 returned error can't find the container with id d18b1d7e7d4d5a06c8f8086d600059d826c3e2d8e5b3dae2274175f64167b504
Jul 30 12:59:32.842310 ip-10-0-143-153 kubenswrapper[2566]: W0730 12:59:32.842289    2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0e113987_a362_4c64_825a_1f883ab76ec9.slice/crio-5934dc83d5094daa4b0379e5819e2d3059f7ec9534b3e4d92c0b737e9e9ca416 WatchSource:0}: Error finding container 5934dc83d5094daa4b0379e5819e2d3059f7ec9534b3e4d92c0b737e9e9ca416: Status 404 returned error can't find the container with id 5934dc83d5094daa4b0379e5819e2d3059f7ec9534b3e4d92c0b737e9e9ca416
Jul 30 12:59:32.848116 ip-10-0-143-153 kubenswrapper[2566]: I0730 12:59:32.848098    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4fdfw"
Jul 30 12:59:32.855573 ip-10-0-143-153 kubenswrapper[2566]: W0730 12:59:32.855551    2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podabe34634_20e4_4e0b_9d22_565c35543229.slice/crio-4dc865eda450594e4c951abfdc8f609e89af0435928bbbbbc24729fa53619248 WatchSource:0}: Error finding container 4dc865eda450594e4c951abfdc8f609e89af0435928bbbbbc24729fa53619248: Status 404 returned error can't find the container with id 4dc865eda450594e4c951abfdc8f609e89af0435928bbbbbc24729fa53619248
Jul 30 12:59:32.867473 ip-10-0-143-153 kubenswrapper[2566]: I0730 12:59:32.867452    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-4tzjz"
Jul 30 12:59:32.875011 ip-10-0-143-153 kubenswrapper[2566]: W0730 12:59:32.874988    2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod95057af8_5515_4bb3_9147_613240e101bb.slice/crio-d92292b09aff69af6208e81a62c7a1cfddc7bd92ef9fa2a07d80520de1bf0625 WatchSource:0}: Error finding container d92292b09aff69af6208e81a62c7a1cfddc7bd92ef9fa2a07d80520de1bf0625: Status 404 returned error can't find the container with id d92292b09aff69af6208e81a62c7a1cfddc7bd92ef9fa2a07d80520de1bf0625
Jul 30 12:59:32.887761 ip-10-0-143-153 kubenswrapper[2566]: I0730 12:59:32.887741    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-f6br6"
Jul 30 12:59:32.895573 ip-10-0-143-153 kubenswrapper[2566]: W0730 12:59:32.895542    2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3ebbc209_4373_44d8_a22e_d2d2aa4cbfa6.slice/crio-ddc244cdf2ad52148d7f02db826f73e61ee38aacb47c301e066d946dd263d374 WatchSource:0}: Error finding container ddc244cdf2ad52148d7f02db826f73e61ee38aacb47c301e066d946dd263d374: Status 404 returned error can't find the container with id ddc244cdf2ad52148d7f02db826f73e61ee38aacb47c301e066d946dd263d374
Jul 30 12:59:32.900565 ip-10-0-143-153 kubenswrapper[2566]: I0730 12:59:32.900548    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-m8zwx"
Jul 30 12:59:32.909870 ip-10-0-143-153 kubenswrapper[2566]: W0730 12:59:32.909851    2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5eedd146_086a_4a5d_a331_5c1dc35f8e9e.slice/crio-3716e6d0c112a6a49db257fbbe7a2d38976cc7de0aa0ade11b1055140a186906 WatchSource:0}: Error finding container 3716e6d0c112a6a49db257fbbe7a2d38976cc7de0aa0ade11b1055140a186906: Status 404 returned error can't find the container with id 3716e6d0c112a6a49db257fbbe7a2d38976cc7de0aa0ade11b1055140a186906
Jul 30 12:59:32.912677 ip-10-0-143-153 kubenswrapper[2566]: I0730 12:59:32.912660    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-qt2mr"
Jul 30 12:59:32.916314 ip-10-0-143-153 kubenswrapper[2566]: I0730 12:59:32.916294    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-pvtx9"
Jul 30 12:59:32.920487 ip-10-0-143-153 kubenswrapper[2566]: I0730 12:59:32.920469    2566 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 30 12:59:32.922529 ip-10-0-143-153 kubenswrapper[2566]: W0730 12:59:32.922503    2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9c33f673_8361_433b_847f_081d6d4b2753.slice/crio-20189f64cdf9ec3cf1c93e71816b9c57a8c65e55bafacc5a7514f61d096e30cd WatchSource:0}: Error finding container 20189f64cdf9ec3cf1c93e71816b9c57a8c65e55bafacc5a7514f61d096e30cd: Status 404 returned error can't find the container with id 20189f64cdf9ec3cf1c93e71816b9c57a8c65e55bafacc5a7514f61d096e30cd
Jul 30 12:59:32.924929 ip-10-0-143-153 kubenswrapper[2566]: W0730 12:59:32.924909    2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod389ae0b4_e97d_4637_8836_5d349b4b2182.slice/crio-0db2f25ca3ec71846a3e8457da4f144333ad520539ce72ce43ef38e555da55ed WatchSource:0}: Error finding container 0db2f25ca3ec71846a3e8457da4f144333ad520539ce72ce43ef38e555da55ed: Status 404 returned error can't find the container with id 0db2f25ca3ec71846a3e8457da4f144333ad520539ce72ce43ef38e555da55ed
Jul 30 12:59:33.025014 ip-10-0-143-153 kubenswrapper[2566]: I0730 12:59:33.024942    2566 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 30 12:59:33.201397 ip-10-0-143-153 kubenswrapper[2566]: I0730 12:59:33.201357    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/995cd086-39a7-4097-971a-1c4e6c08576b-metrics-certs\") pod \"network-metrics-daemon-kb44p\" (UID: \"995cd086-39a7-4097-971a-1c4e6c08576b\") " pod="openshift-multus/network-metrics-daemon-kb44p"
Jul 30 12:59:33.201560 ip-10-0-143-153 kubenswrapper[2566]: I0730 12:59:33.201417    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/c2428457-ecf0-45c5-b008-7a51403785c9-original-pull-secret\") pod \"global-pull-secret-syncer-9bp7v\" (UID: \"c2428457-ecf0-45c5-b008-7a51403785c9\") " pod="kube-system/global-pull-secret-syncer-9bp7v"
Jul 30 12:59:33.201560 ip-10-0-143-153 kubenswrapper[2566]: E0730 12:59:33.201522    2566 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 30 12:59:33.201560 ip-10-0-143-153 kubenswrapper[2566]: E0730 12:59:33.201548    2566 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 30 12:59:33.201699 ip-10-0-143-153 kubenswrapper[2566]: E0730 12:59:33.201602    2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/995cd086-39a7-4097-971a-1c4e6c08576b-metrics-certs podName:995cd086-39a7-4097-971a-1c4e6c08576b nodeName:}" failed. No retries permitted until 2026-07-30 12:59:34.201582021 +0000 UTC m=+3.130270265 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/995cd086-39a7-4097-971a-1c4e6c08576b-metrics-certs") pod "network-metrics-daemon-kb44p" (UID: "995cd086-39a7-4097-971a-1c4e6c08576b") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 30 12:59:33.201699 ip-10-0-143-153 kubenswrapper[2566]: E0730 12:59:33.201624    2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c2428457-ecf0-45c5-b008-7a51403785c9-original-pull-secret podName:c2428457-ecf0-45c5-b008-7a51403785c9 nodeName:}" failed. No retries permitted until 2026-07-30 12:59:34.201614255 +0000 UTC m=+3.130302498 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/c2428457-ecf0-45c5-b008-7a51403785c9-original-pull-secret") pod "global-pull-secret-syncer-9bp7v" (UID: "c2428457-ecf0-45c5-b008-7a51403785c9") : object "kube-system"/"original-pull-secret" not registered
Jul 30 12:59:33.303425 ip-10-0-143-153 kubenswrapper[2566]: I0730 12:59:33.302729    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wvdt7\" (UniqueName: \"kubernetes.io/projected/be740ef9-ac84-4ef4-ad66-7f61253c6c28-kube-api-access-wvdt7\") pod \"network-check-target-bjnvm\" (UID: \"be740ef9-ac84-4ef4-ad66-7f61253c6c28\") " pod="openshift-network-diagnostics/network-check-target-bjnvm"
Jul 30 12:59:33.303425 ip-10-0-143-153 kubenswrapper[2566]: E0730 12:59:33.302909    2566 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 30 12:59:33.303425 ip-10-0-143-153 kubenswrapper[2566]: E0730 12:59:33.302930    2566 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 30 12:59:33.303425 ip-10-0-143-153 kubenswrapper[2566]: E0730 12:59:33.302974    2566 projected.go:196] Error preparing data for projected volume kube-api-access-wvdt7 for pod openshift-network-diagnostics/network-check-target-bjnvm: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 30 12:59:33.303425 ip-10-0-143-153 kubenswrapper[2566]: E0730 12:59:33.303116    2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/be740ef9-ac84-4ef4-ad66-7f61253c6c28-kube-api-access-wvdt7 podName:be740ef9-ac84-4ef4-ad66-7f61253c6c28 nodeName:}" failed. No retries permitted until 2026-07-30 12:59:34.303095306 +0000 UTC m=+3.231783551 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-wvdt7" (UniqueName: "kubernetes.io/projected/be740ef9-ac84-4ef4-ad66-7f61253c6c28-kube-api-access-wvdt7") pod "network-check-target-bjnvm" (UID: "be740ef9-ac84-4ef4-ad66-7f61253c6c28") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 30 12:59:33.542346 ip-10-0-143-153 kubenswrapper[2566]: I0730 12:59:33.542186    2566 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-29 12:54:32 +0000 UTC" deadline="2028-03-03 00:52:50.363917096 +0000 UTC"
Jul 30 12:59:33.542346 ip-10-0-143-153 kubenswrapper[2566]: I0730 12:59:33.542246    2566 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="13955h53m16.821675557s"
Jul 30 12:59:33.635666 ip-10-0-143-153 kubenswrapper[2566]: I0730 12:59:33.635553    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-8br4n" event={"ID":"0e113987-a362-4c64-825a-1f883ab76ec9","Type":"ContainerStarted","Data":"5934dc83d5094daa4b0379e5819e2d3059f7ec9534b3e4d92c0b737e9e9ca416"}
Jul 30 12:59:33.652985 ip-10-0-143-153 kubenswrapper[2566]: I0730 12:59:33.652948    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-gppm2" event={"ID":"d1644e14-73e0-40a9-a205-7bdd0eefe290","Type":"ContainerStarted","Data":"0a04fa0d3c2244385e9236f4cdec3cf64c480a8ae86752448bd14ca28fe2fede"}
Jul 30 12:59:33.680564 ip-10-0-143-153 kubenswrapper[2566]: I0730 12:59:33.666986    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-153.ec2.internal" event={"ID":"a8e6a8f600eea6e545d463bd99143fa2","Type":"ContainerStarted","Data":"d37d2605e14f76e75c5f8ae7fc72385741640904862b497252d40afaa5f411b9"}
Jul 30 12:59:33.682007 ip-10-0-143-153 kubenswrapper[2566]: I0730 12:59:33.681977    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-qt2mr" event={"ID":"9c33f673-8361-433b-847f-081d6d4b2753","Type":"ContainerStarted","Data":"20189f64cdf9ec3cf1c93e71816b9c57a8c65e55bafacc5a7514f61d096e30cd"}
Jul 30 12:59:33.696127 ip-10-0-143-153 kubenswrapper[2566]: I0730 12:59:33.692122    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-9lmmp" event={"ID":"b6cb9164-228a-4fff-b909-8be034a2b11a","Type":"ContainerStarted","Data":"d18b1d7e7d4d5a06c8f8086d600059d826c3e2d8e5b3dae2274175f64167b504"}
Jul 30 12:59:33.708466 ip-10-0-143-153 kubenswrapper[2566]: I0730 12:59:33.708377    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-143-153.ec2.internal" event={"ID":"3327a5e598b8ce026a5b536fdb99458b","Type":"ContainerStarted","Data":"0c93e3669ee27f2a6080731290993213547bb6258d9b4d9d058435ee2c4713a4"}
Jul 30 12:59:33.723477 ip-10-0-143-153 kubenswrapper[2566]: I0730 12:59:33.723437    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-pvtx9" event={"ID":"389ae0b4-e97d-4637-8836-5d349b4b2182","Type":"ContainerStarted","Data":"0db2f25ca3ec71846a3e8457da4f144333ad520539ce72ce43ef38e555da55ed"}
Jul 30 12:59:33.739327 ip-10-0-143-153 kubenswrapper[2566]: I0730 12:59:33.739288    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-m8zwx" event={"ID":"5eedd146-086a-4a5d-a331-5c1dc35f8e9e","Type":"ContainerStarted","Data":"3716e6d0c112a6a49db257fbbe7a2d38976cc7de0aa0ade11b1055140a186906"}
Jul 30 12:59:33.766939 ip-10-0-143-153 kubenswrapper[2566]: I0730 12:59:33.766899    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-f6br6" event={"ID":"3ebbc209-4373-44d8-a22e-d2d2aa4cbfa6","Type":"ContainerStarted","Data":"ddc244cdf2ad52148d7f02db826f73e61ee38aacb47c301e066d946dd263d374"}
Jul 30 12:59:33.778762 ip-10-0-143-153 kubenswrapper[2566]: I0730 12:59:33.778728    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-4tzjz" event={"ID":"95057af8-5515-4bb3-9147-613240e101bb","Type":"ContainerStarted","Data":"d92292b09aff69af6208e81a62c7a1cfddc7bd92ef9fa2a07d80520de1bf0625"}
Jul 30 12:59:33.790037 ip-10-0-143-153 kubenswrapper[2566]: I0730 12:59:33.790003    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4fdfw" event={"ID":"abe34634-20e4-4e0b-9d22-565c35543229","Type":"ContainerStarted","Data":"4dc865eda450594e4c951abfdc8f609e89af0435928bbbbbc24729fa53619248"}
Jul 30 12:59:34.208605 ip-10-0-143-153 kubenswrapper[2566]: I0730 12:59:34.208567    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/995cd086-39a7-4097-971a-1c4e6c08576b-metrics-certs\") pod \"network-metrics-daemon-kb44p\" (UID: \"995cd086-39a7-4097-971a-1c4e6c08576b\") " pod="openshift-multus/network-metrics-daemon-kb44p"
Jul 30 12:59:34.208784 ip-10-0-143-153 kubenswrapper[2566]: I0730 12:59:34.208633    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/c2428457-ecf0-45c5-b008-7a51403785c9-original-pull-secret\") pod \"global-pull-secret-syncer-9bp7v\" (UID: \"c2428457-ecf0-45c5-b008-7a51403785c9\") " pod="kube-system/global-pull-secret-syncer-9bp7v"
Jul 30 12:59:34.208784 ip-10-0-143-153 kubenswrapper[2566]: E0730 12:59:34.208776    2566 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 30 12:59:34.208909 ip-10-0-143-153 kubenswrapper[2566]: E0730 12:59:34.208838    2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c2428457-ecf0-45c5-b008-7a51403785c9-original-pull-secret podName:c2428457-ecf0-45c5-b008-7a51403785c9 nodeName:}" failed. No retries permitted until 2026-07-30 12:59:36.20882135 +0000 UTC m=+5.137509590 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/c2428457-ecf0-45c5-b008-7a51403785c9-original-pull-secret") pod "global-pull-secret-syncer-9bp7v" (UID: "c2428457-ecf0-45c5-b008-7a51403785c9") : object "kube-system"/"original-pull-secret" not registered
Jul 30 12:59:34.209440 ip-10-0-143-153 kubenswrapper[2566]: E0730 12:59:34.209259    2566 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 30 12:59:34.209440 ip-10-0-143-153 kubenswrapper[2566]: E0730 12:59:34.209312    2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/995cd086-39a7-4097-971a-1c4e6c08576b-metrics-certs podName:995cd086-39a7-4097-971a-1c4e6c08576b nodeName:}" failed. No retries permitted until 2026-07-30 12:59:36.209297643 +0000 UTC m=+5.137985887 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/995cd086-39a7-4097-971a-1c4e6c08576b-metrics-certs") pod "network-metrics-daemon-kb44p" (UID: "995cd086-39a7-4097-971a-1c4e6c08576b") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 30 12:59:34.309381 ip-10-0-143-153 kubenswrapper[2566]: I0730 12:59:34.309335    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wvdt7\" (UniqueName: \"kubernetes.io/projected/be740ef9-ac84-4ef4-ad66-7f61253c6c28-kube-api-access-wvdt7\") pod \"network-check-target-bjnvm\" (UID: \"be740ef9-ac84-4ef4-ad66-7f61253c6c28\") " pod="openshift-network-diagnostics/network-check-target-bjnvm"
Jul 30 12:59:34.309598 ip-10-0-143-153 kubenswrapper[2566]: E0730 12:59:34.309556    2566 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 30 12:59:34.309598 ip-10-0-143-153 kubenswrapper[2566]: E0730 12:59:34.309580    2566 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 30 12:59:34.309598 ip-10-0-143-153 kubenswrapper[2566]: E0730 12:59:34.309593    2566 projected.go:196] Error preparing data for projected volume kube-api-access-wvdt7 for pod openshift-network-diagnostics/network-check-target-bjnvm: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 30 12:59:34.309790 ip-10-0-143-153 kubenswrapper[2566]: E0730 12:59:34.309652    2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/be740ef9-ac84-4ef4-ad66-7f61253c6c28-kube-api-access-wvdt7 podName:be740ef9-ac84-4ef4-ad66-7f61253c6c28 nodeName:}" failed. No retries permitted until 2026-07-30 12:59:36.309633627 +0000 UTC m=+5.238321872 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-wvdt7" (UniqueName: "kubernetes.io/projected/be740ef9-ac84-4ef4-ad66-7f61253c6c28-kube-api-access-wvdt7") pod "network-check-target-bjnvm" (UID: "be740ef9-ac84-4ef4-ad66-7f61253c6c28") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 30 12:59:34.420597 ip-10-0-143-153 kubenswrapper[2566]: I0730 12:59:34.420569    2566 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 30 12:59:34.543513 ip-10-0-143-153 kubenswrapper[2566]: I0730 12:59:34.543352    2566 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-29 12:54:32 +0000 UTC" deadline="2027-12-29 23:01:28.873699384 +0000 UTC"
Jul 30 12:59:34.543513 ip-10-0-143-153 kubenswrapper[2566]: I0730 12:59:34.543394    2566 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="12418h1m54.330309625s"
Jul 30 12:59:34.621901 ip-10-0-143-153 kubenswrapper[2566]: I0730 12:59:34.621872    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-bjnvm"
Jul 30 12:59:34.622121 ip-10-0-143-153 kubenswrapper[2566]: E0730 12:59:34.622013    2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-bjnvm" podUID="be740ef9-ac84-4ef4-ad66-7f61253c6c28"
Jul 30 12:59:34.622460 ip-10-0-143-153 kubenswrapper[2566]: I0730 12:59:34.622443    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-9bp7v"
Jul 30 12:59:34.622605 ip-10-0-143-153 kubenswrapper[2566]: E0730 12:59:34.622539    2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-9bp7v" podUID="c2428457-ecf0-45c5-b008-7a51403785c9"
Jul 30 12:59:34.622672 ip-10-0-143-153 kubenswrapper[2566]: I0730 12:59:34.622616    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-kb44p"
Jul 30 12:59:34.622725 ip-10-0-143-153 kubenswrapper[2566]: E0730 12:59:34.622697    2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-kb44p" podUID="995cd086-39a7-4097-971a-1c4e6c08576b"
Jul 30 12:59:36.228524 ip-10-0-143-153 kubenswrapper[2566]: I0730 12:59:36.227678    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/995cd086-39a7-4097-971a-1c4e6c08576b-metrics-certs\") pod \"network-metrics-daemon-kb44p\" (UID: \"995cd086-39a7-4097-971a-1c4e6c08576b\") " pod="openshift-multus/network-metrics-daemon-kb44p"
Jul 30 12:59:36.228524 ip-10-0-143-153 kubenswrapper[2566]: I0730 12:59:36.227743    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/c2428457-ecf0-45c5-b008-7a51403785c9-original-pull-secret\") pod \"global-pull-secret-syncer-9bp7v\" (UID: \"c2428457-ecf0-45c5-b008-7a51403785c9\") " pod="kube-system/global-pull-secret-syncer-9bp7v"
Jul 30 12:59:36.228524 ip-10-0-143-153 kubenswrapper[2566]: E0730 12:59:36.227905    2566 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 30 12:59:36.228524 ip-10-0-143-153 kubenswrapper[2566]: E0730 12:59:36.227967    2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c2428457-ecf0-45c5-b008-7a51403785c9-original-pull-secret podName:c2428457-ecf0-45c5-b008-7a51403785c9 nodeName:}" failed. No retries permitted until 2026-07-30 12:59:40.227947669 +0000 UTC m=+9.156635909 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/c2428457-ecf0-45c5-b008-7a51403785c9-original-pull-secret") pod "global-pull-secret-syncer-9bp7v" (UID: "c2428457-ecf0-45c5-b008-7a51403785c9") : object "kube-system"/"original-pull-secret" not registered
Jul 30 12:59:36.228524 ip-10-0-143-153 kubenswrapper[2566]: E0730 12:59:36.228401    2566 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 30 12:59:36.228524 ip-10-0-143-153 kubenswrapper[2566]: E0730 12:59:36.228451    2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/995cd086-39a7-4097-971a-1c4e6c08576b-metrics-certs podName:995cd086-39a7-4097-971a-1c4e6c08576b nodeName:}" failed. No retries permitted until 2026-07-30 12:59:40.228435144 +0000 UTC m=+9.157123389 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/995cd086-39a7-4097-971a-1c4e6c08576b-metrics-certs") pod "network-metrics-daemon-kb44p" (UID: "995cd086-39a7-4097-971a-1c4e6c08576b") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 30 12:59:36.328510 ip-10-0-143-153 kubenswrapper[2566]: I0730 12:59:36.328452    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wvdt7\" (UniqueName: \"kubernetes.io/projected/be740ef9-ac84-4ef4-ad66-7f61253c6c28-kube-api-access-wvdt7\") pod \"network-check-target-bjnvm\" (UID: \"be740ef9-ac84-4ef4-ad66-7f61253c6c28\") " pod="openshift-network-diagnostics/network-check-target-bjnvm"
Jul 30 12:59:36.328692 ip-10-0-143-153 kubenswrapper[2566]: E0730 12:59:36.328642    2566 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 30 12:59:36.328692 ip-10-0-143-153 kubenswrapper[2566]: E0730 12:59:36.328671    2566 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 30 12:59:36.328692 ip-10-0-143-153 kubenswrapper[2566]: E0730 12:59:36.328685    2566 projected.go:196] Error preparing data for projected volume kube-api-access-wvdt7 for pod openshift-network-diagnostics/network-check-target-bjnvm: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 30 12:59:36.328842 ip-10-0-143-153 kubenswrapper[2566]: E0730 12:59:36.328749    2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/be740ef9-ac84-4ef4-ad66-7f61253c6c28-kube-api-access-wvdt7 podName:be740ef9-ac84-4ef4-ad66-7f61253c6c28 nodeName:}" failed. No retries permitted until 2026-07-30 12:59:40.328731548 +0000 UTC m=+9.257419803 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-wvdt7" (UniqueName: "kubernetes.io/projected/be740ef9-ac84-4ef4-ad66-7f61253c6c28-kube-api-access-wvdt7") pod "network-check-target-bjnvm" (UID: "be740ef9-ac84-4ef4-ad66-7f61253c6c28") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 30 12:59:36.621527 ip-10-0-143-153 kubenswrapper[2566]: I0730 12:59:36.621443    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-9bp7v"
Jul 30 12:59:36.621768 ip-10-0-143-153 kubenswrapper[2566]: E0730 12:59:36.621575    2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-9bp7v" podUID="c2428457-ecf0-45c5-b008-7a51403785c9"
Jul 30 12:59:36.621768 ip-10-0-143-153 kubenswrapper[2566]: I0730 12:59:36.621651    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-kb44p"
Jul 30 12:59:36.621768 ip-10-0-143-153 kubenswrapper[2566]: E0730 12:59:36.621740    2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-kb44p" podUID="995cd086-39a7-4097-971a-1c4e6c08576b"
Jul 30 12:59:36.621971 ip-10-0-143-153 kubenswrapper[2566]: I0730 12:59:36.621796    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-bjnvm"
Jul 30 12:59:36.621971 ip-10-0-143-153 kubenswrapper[2566]: E0730 12:59:36.621857    2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-bjnvm" podUID="be740ef9-ac84-4ef4-ad66-7f61253c6c28"
Jul 30 12:59:38.621031 ip-10-0-143-153 kubenswrapper[2566]: I0730 12:59:38.620995    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-bjnvm"
Jul 30 12:59:38.621490 ip-10-0-143-153 kubenswrapper[2566]: I0730 12:59:38.621044    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-9bp7v"
Jul 30 12:59:38.621490 ip-10-0-143-153 kubenswrapper[2566]: I0730 12:59:38.621128    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-kb44p"
Jul 30 12:59:38.621490 ip-10-0-143-153 kubenswrapper[2566]: E0730 12:59:38.621134    2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-bjnvm" podUID="be740ef9-ac84-4ef4-ad66-7f61253c6c28"
Jul 30 12:59:38.621490 ip-10-0-143-153 kubenswrapper[2566]: E0730 12:59:38.621205    2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-9bp7v" podUID="c2428457-ecf0-45c5-b008-7a51403785c9"
Jul 30 12:59:38.621490 ip-10-0-143-153 kubenswrapper[2566]: E0730 12:59:38.621341    2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-kb44p" podUID="995cd086-39a7-4097-971a-1c4e6c08576b"
Jul 30 12:59:40.261863 ip-10-0-143-153 kubenswrapper[2566]: I0730 12:59:40.261823    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/995cd086-39a7-4097-971a-1c4e6c08576b-metrics-certs\") pod \"network-metrics-daemon-kb44p\" (UID: \"995cd086-39a7-4097-971a-1c4e6c08576b\") " pod="openshift-multus/network-metrics-daemon-kb44p"
Jul 30 12:59:40.262402 ip-10-0-143-153 kubenswrapper[2566]: I0730 12:59:40.261891    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/c2428457-ecf0-45c5-b008-7a51403785c9-original-pull-secret\") pod \"global-pull-secret-syncer-9bp7v\" (UID: \"c2428457-ecf0-45c5-b008-7a51403785c9\") " pod="kube-system/global-pull-secret-syncer-9bp7v"
Jul 30 12:59:40.262402 ip-10-0-143-153 kubenswrapper[2566]: E0730 12:59:40.261997    2566 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 30 12:59:40.262402 ip-10-0-143-153 kubenswrapper[2566]: E0730 12:59:40.262000    2566 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 30 12:59:40.262402 ip-10-0-143-153 kubenswrapper[2566]: E0730 12:59:40.262063    2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c2428457-ecf0-45c5-b008-7a51403785c9-original-pull-secret podName:c2428457-ecf0-45c5-b008-7a51403785c9 nodeName:}" failed. No retries permitted until 2026-07-30 12:59:48.262039727 +0000 UTC m=+17.190727975 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/c2428457-ecf0-45c5-b008-7a51403785c9-original-pull-secret") pod "global-pull-secret-syncer-9bp7v" (UID: "c2428457-ecf0-45c5-b008-7a51403785c9") : object "kube-system"/"original-pull-secret" not registered
Jul 30 12:59:40.262402 ip-10-0-143-153 kubenswrapper[2566]: E0730 12:59:40.262142    2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/995cd086-39a7-4097-971a-1c4e6c08576b-metrics-certs podName:995cd086-39a7-4097-971a-1c4e6c08576b nodeName:}" failed. No retries permitted until 2026-07-30 12:59:48.262119319 +0000 UTC m=+17.190807569 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/995cd086-39a7-4097-971a-1c4e6c08576b-metrics-certs") pod "network-metrics-daemon-kb44p" (UID: "995cd086-39a7-4097-971a-1c4e6c08576b") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 30 12:59:40.362805 ip-10-0-143-153 kubenswrapper[2566]: I0730 12:59:40.362758    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wvdt7\" (UniqueName: \"kubernetes.io/projected/be740ef9-ac84-4ef4-ad66-7f61253c6c28-kube-api-access-wvdt7\") pod \"network-check-target-bjnvm\" (UID: \"be740ef9-ac84-4ef4-ad66-7f61253c6c28\") " pod="openshift-network-diagnostics/network-check-target-bjnvm"
Jul 30 12:59:40.362976 ip-10-0-143-153 kubenswrapper[2566]: E0730 12:59:40.362940    2566 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 30 12:59:40.362976 ip-10-0-143-153 kubenswrapper[2566]: E0730 12:59:40.362962    2566 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 30 12:59:40.362976 ip-10-0-143-153 kubenswrapper[2566]: E0730 12:59:40.362974    2566 projected.go:196] Error preparing data for projected volume kube-api-access-wvdt7 for pod openshift-network-diagnostics/network-check-target-bjnvm: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 30 12:59:40.363173 ip-10-0-143-153 kubenswrapper[2566]: E0730 12:59:40.363028    2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/be740ef9-ac84-4ef4-ad66-7f61253c6c28-kube-api-access-wvdt7 podName:be740ef9-ac84-4ef4-ad66-7f61253c6c28 nodeName:}" failed. No retries permitted until 2026-07-30 12:59:48.363010526 +0000 UTC m=+17.291698775 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-wvdt7" (UniqueName: "kubernetes.io/projected/be740ef9-ac84-4ef4-ad66-7f61253c6c28-kube-api-access-wvdt7") pod "network-check-target-bjnvm" (UID: "be740ef9-ac84-4ef4-ad66-7f61253c6c28") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 30 12:59:40.621326 ip-10-0-143-153 kubenswrapper[2566]: I0730 12:59:40.621229    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-9bp7v"
Jul 30 12:59:40.621489 ip-10-0-143-153 kubenswrapper[2566]: E0730 12:59:40.621370    2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-9bp7v" podUID="c2428457-ecf0-45c5-b008-7a51403785c9"
Jul 30 12:59:40.621852 ip-10-0-143-153 kubenswrapper[2566]: I0730 12:59:40.621823    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-kb44p"
Jul 30 12:59:40.622007 ip-10-0-143-153 kubenswrapper[2566]: E0730 12:59:40.621985    2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-kb44p" podUID="995cd086-39a7-4097-971a-1c4e6c08576b"
Jul 30 12:59:40.622102 ip-10-0-143-153 kubenswrapper[2566]: I0730 12:59:40.622055    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-bjnvm"
Jul 30 12:59:40.622213 ip-10-0-143-153 kubenswrapper[2566]: E0730 12:59:40.622192    2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-bjnvm" podUID="be740ef9-ac84-4ef4-ad66-7f61253c6c28"
Jul 30 12:59:42.620900 ip-10-0-143-153 kubenswrapper[2566]: I0730 12:59:42.620868    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-bjnvm"
Jul 30 12:59:42.621413 ip-10-0-143-153 kubenswrapper[2566]: E0730 12:59:42.620994    2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-bjnvm" podUID="be740ef9-ac84-4ef4-ad66-7f61253c6c28"
Jul 30 12:59:42.621413 ip-10-0-143-153 kubenswrapper[2566]: I0730 12:59:42.620868    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-9bp7v"
Jul 30 12:59:42.621413 ip-10-0-143-153 kubenswrapper[2566]: E0730 12:59:42.621111    2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-9bp7v" podUID="c2428457-ecf0-45c5-b008-7a51403785c9"
Jul 30 12:59:42.621413 ip-10-0-143-153 kubenswrapper[2566]: I0730 12:59:42.620868    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-kb44p"
Jul 30 12:59:42.621413 ip-10-0-143-153 kubenswrapper[2566]: E0730 12:59:42.621199    2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-kb44p" podUID="995cd086-39a7-4097-971a-1c4e6c08576b"
Jul 30 12:59:44.621659 ip-10-0-143-153 kubenswrapper[2566]: I0730 12:59:44.621575    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-kb44p"
Jul 30 12:59:44.622117 ip-10-0-143-153 kubenswrapper[2566]: I0730 12:59:44.621584    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-bjnvm"
Jul 30 12:59:44.622117 ip-10-0-143-153 kubenswrapper[2566]: E0730 12:59:44.621716    2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-kb44p" podUID="995cd086-39a7-4097-971a-1c4e6c08576b"
Jul 30 12:59:44.622117 ip-10-0-143-153 kubenswrapper[2566]: I0730 12:59:44.621771    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-9bp7v"
Jul 30 12:59:44.622117 ip-10-0-143-153 kubenswrapper[2566]: E0730 12:59:44.621862    2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-bjnvm" podUID="be740ef9-ac84-4ef4-ad66-7f61253c6c28"
Jul 30 12:59:44.622117 ip-10-0-143-153 kubenswrapper[2566]: E0730 12:59:44.621938    2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-9bp7v" podUID="c2428457-ecf0-45c5-b008-7a51403785c9"
Jul 30 12:59:46.621831 ip-10-0-143-153 kubenswrapper[2566]: I0730 12:59:46.621791    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-9bp7v"
Jul 30 12:59:46.621831 ip-10-0-143-153 kubenswrapper[2566]: I0730 12:59:46.621827    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-bjnvm"
Jul 30 12:59:46.622315 ip-10-0-143-153 kubenswrapper[2566]: E0730 12:59:46.621937    2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-9bp7v" podUID="c2428457-ecf0-45c5-b008-7a51403785c9"
Jul 30 12:59:46.622315 ip-10-0-143-153 kubenswrapper[2566]: E0730 12:59:46.621946    2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-bjnvm" podUID="be740ef9-ac84-4ef4-ad66-7f61253c6c28"
Jul 30 12:59:46.622315 ip-10-0-143-153 kubenswrapper[2566]: I0730 12:59:46.621980    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-kb44p"
Jul 30 12:59:46.622315 ip-10-0-143-153 kubenswrapper[2566]: E0730 12:59:46.622044    2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-kb44p" podUID="995cd086-39a7-4097-971a-1c4e6c08576b"
Jul 30 12:59:48.318638 ip-10-0-143-153 kubenswrapper[2566]: I0730 12:59:48.318602    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/c2428457-ecf0-45c5-b008-7a51403785c9-original-pull-secret\") pod \"global-pull-secret-syncer-9bp7v\" (UID: \"c2428457-ecf0-45c5-b008-7a51403785c9\") " pod="kube-system/global-pull-secret-syncer-9bp7v"
Jul 30 12:59:48.319107 ip-10-0-143-153 kubenswrapper[2566]: I0730 12:59:48.318682    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/995cd086-39a7-4097-971a-1c4e6c08576b-metrics-certs\") pod \"network-metrics-daemon-kb44p\" (UID: \"995cd086-39a7-4097-971a-1c4e6c08576b\") " pod="openshift-multus/network-metrics-daemon-kb44p"
Jul 30 12:59:48.319107 ip-10-0-143-153 kubenswrapper[2566]: E0730 12:59:48.318767    2566 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 30 12:59:48.319107 ip-10-0-143-153 kubenswrapper[2566]: E0730 12:59:48.318820    2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/995cd086-39a7-4097-971a-1c4e6c08576b-metrics-certs podName:995cd086-39a7-4097-971a-1c4e6c08576b nodeName:}" failed. No retries permitted until 2026-07-30 13:00:04.318804794 +0000 UTC m=+33.247493055 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/995cd086-39a7-4097-971a-1c4e6c08576b-metrics-certs") pod "network-metrics-daemon-kb44p" (UID: "995cd086-39a7-4097-971a-1c4e6c08576b") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 30 12:59:48.319107 ip-10-0-143-153 kubenswrapper[2566]: E0730 12:59:48.318766    2566 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 30 12:59:48.319107 ip-10-0-143-153 kubenswrapper[2566]: E0730 12:59:48.318915    2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c2428457-ecf0-45c5-b008-7a51403785c9-original-pull-secret podName:c2428457-ecf0-45c5-b008-7a51403785c9 nodeName:}" failed. No retries permitted until 2026-07-30 13:00:04.31889542 +0000 UTC m=+33.247583664 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/c2428457-ecf0-45c5-b008-7a51403785c9-original-pull-secret") pod "global-pull-secret-syncer-9bp7v" (UID: "c2428457-ecf0-45c5-b008-7a51403785c9") : object "kube-system"/"original-pull-secret" not registered
Jul 30 12:59:48.419350 ip-10-0-143-153 kubenswrapper[2566]: I0730 12:59:48.419293    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wvdt7\" (UniqueName: \"kubernetes.io/projected/be740ef9-ac84-4ef4-ad66-7f61253c6c28-kube-api-access-wvdt7\") pod \"network-check-target-bjnvm\" (UID: \"be740ef9-ac84-4ef4-ad66-7f61253c6c28\") " pod="openshift-network-diagnostics/network-check-target-bjnvm"
Jul 30 12:59:48.419538 ip-10-0-143-153 kubenswrapper[2566]: E0730 12:59:48.419484    2566 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 30 12:59:48.419538 ip-10-0-143-153 kubenswrapper[2566]: E0730 12:59:48.419512    2566 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 30 12:59:48.419538 ip-10-0-143-153 kubenswrapper[2566]: E0730 12:59:48.419525    2566 projected.go:196] Error preparing data for projected volume kube-api-access-wvdt7 for pod openshift-network-diagnostics/network-check-target-bjnvm: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 30 12:59:48.419662 ip-10-0-143-153 kubenswrapper[2566]: E0730 12:59:48.419590    2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/be740ef9-ac84-4ef4-ad66-7f61253c6c28-kube-api-access-wvdt7 podName:be740ef9-ac84-4ef4-ad66-7f61253c6c28 nodeName:}" failed. No retries permitted until 2026-07-30 13:00:04.419571656 +0000 UTC m=+33.348259898 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-wvdt7" (UniqueName: "kubernetes.io/projected/be740ef9-ac84-4ef4-ad66-7f61253c6c28-kube-api-access-wvdt7") pod "network-check-target-bjnvm" (UID: "be740ef9-ac84-4ef4-ad66-7f61253c6c28") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 30 12:59:48.620927 ip-10-0-143-153 kubenswrapper[2566]: I0730 12:59:48.620848    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-9bp7v"
Jul 30 12:59:48.620927 ip-10-0-143-153 kubenswrapper[2566]: I0730 12:59:48.620885    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-bjnvm"
Jul 30 12:59:48.620927 ip-10-0-143-153 kubenswrapper[2566]: I0730 12:59:48.620887    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-kb44p"
Jul 30 12:59:48.621222 ip-10-0-143-153 kubenswrapper[2566]: E0730 12:59:48.620986    2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-9bp7v" podUID="c2428457-ecf0-45c5-b008-7a51403785c9"
Jul 30 12:59:48.621222 ip-10-0-143-153 kubenswrapper[2566]: E0730 12:59:48.621112    2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-bjnvm" podUID="be740ef9-ac84-4ef4-ad66-7f61253c6c28"
Jul 30 12:59:48.621299 ip-10-0-143-153 kubenswrapper[2566]: E0730 12:59:48.621225    2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-kb44p" podUID="995cd086-39a7-4097-971a-1c4e6c08576b"
Jul 30 12:59:50.621906 ip-10-0-143-153 kubenswrapper[2566]: I0730 12:59:50.621686    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-9bp7v"
Jul 30 12:59:50.622389 ip-10-0-143-153 kubenswrapper[2566]: I0730 12:59:50.621740    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-bjnvm"
Jul 30 12:59:50.622389 ip-10-0-143-153 kubenswrapper[2566]: E0730 12:59:50.621998    2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-9bp7v" podUID="c2428457-ecf0-45c5-b008-7a51403785c9"
Jul 30 12:59:50.622389 ip-10-0-143-153 kubenswrapper[2566]: I0730 12:59:50.621744    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-kb44p"
Jul 30 12:59:50.622389 ip-10-0-143-153 kubenswrapper[2566]: E0730 12:59:50.622070    2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-bjnvm" podUID="be740ef9-ac84-4ef4-ad66-7f61253c6c28"
Jul 30 12:59:50.622389 ip-10-0-143-153 kubenswrapper[2566]: E0730 12:59:50.622184    2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-kb44p" podUID="995cd086-39a7-4097-971a-1c4e6c08576b"
Jul 30 12:59:52.621735 ip-10-0-143-153 kubenswrapper[2566]: I0730 12:59:52.621701    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-9bp7v"
Jul 30 12:59:52.621735 ip-10-0-143-153 kubenswrapper[2566]: I0730 12:59:52.621736    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-kb44p"
Jul 30 12:59:52.622270 ip-10-0-143-153 kubenswrapper[2566]: I0730 12:59:52.621715    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-bjnvm"
Jul 30 12:59:52.622270 ip-10-0-143-153 kubenswrapper[2566]: E0730 12:59:52.621832    2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-9bp7v" podUID="c2428457-ecf0-45c5-b008-7a51403785c9"
Jul 30 12:59:52.622270 ip-10-0-143-153 kubenswrapper[2566]: E0730 12:59:52.621923    2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-kb44p" podUID="995cd086-39a7-4097-971a-1c4e6c08576b"
Jul 30 12:59:52.622270 ip-10-0-143-153 kubenswrapper[2566]: E0730 12:59:52.621960    2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-bjnvm" podUID="be740ef9-ac84-4ef4-ad66-7f61253c6c28"
Jul 30 12:59:53.840389 ip-10-0-143-153 kubenswrapper[2566]: I0730 12:59:53.840200    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-f6br6_3ebbc209-4373-44d8-a22e-d2d2aa4cbfa6/ovn-acl-logging/0.log"
Jul 30 12:59:53.841164 ip-10-0-143-153 kubenswrapper[2566]: I0730 12:59:53.840762    2566 generic.go:356] "Generic (PLEG): container finished" podID="3ebbc209-4373-44d8-a22e-d2d2aa4cbfa6" containerID="af713d58c7f85f3482172a2a4fb2989c6d4616b9bf971f0d8aaa664c73c23def" exitCode=1
Jul 30 12:59:53.841164 ip-10-0-143-153 kubenswrapper[2566]: I0730 12:59:53.840823    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-f6br6" event={"ID":"3ebbc209-4373-44d8-a22e-d2d2aa4cbfa6","Type":"ContainerStarted","Data":"ee78b2ba75fcc48aff7e1d08928215fca40fc3aa0063cce938bdd82ee0c4cbc2"}
Jul 30 12:59:53.841164 ip-10-0-143-153 kubenswrapper[2566]: I0730 12:59:53.840897    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-f6br6" event={"ID":"3ebbc209-4373-44d8-a22e-d2d2aa4cbfa6","Type":"ContainerStarted","Data":"9bee5ce33466524ecea24fbc8b66600975004447941ae0d7697be89ff8824465"}
Jul 30 12:59:53.841164 ip-10-0-143-153 kubenswrapper[2566]: I0730 12:59:53.840931    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-f6br6" event={"ID":"3ebbc209-4373-44d8-a22e-d2d2aa4cbfa6","Type":"ContainerStarted","Data":"169c59ecd1b737dd108e7eae4b5d3a560fcafe2fa1d4f32c693591f38d328cf8"}
Jul 30 12:59:53.841164 ip-10-0-143-153 kubenswrapper[2566]: I0730 12:59:53.840969    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-f6br6" event={"ID":"3ebbc209-4373-44d8-a22e-d2d2aa4cbfa6","Type":"ContainerStarted","Data":"af8df2fd10ebfadedd40563c0e82765afaa60c176f3c0340ff2305cf0c2e46ea"}
Jul 30 12:59:53.841164 ip-10-0-143-153 kubenswrapper[2566]: I0730 12:59:53.841005    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-f6br6" event={"ID":"3ebbc209-4373-44d8-a22e-d2d2aa4cbfa6","Type":"ContainerDied","Data":"af713d58c7f85f3482172a2a4fb2989c6d4616b9bf971f0d8aaa664c73c23def"}
Jul 30 12:59:53.841164 ip-10-0-143-153 kubenswrapper[2566]: I0730 12:59:53.841045    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-f6br6" event={"ID":"3ebbc209-4373-44d8-a22e-d2d2aa4cbfa6","Type":"ContainerStarted","Data":"4db6d26e01e7d56b37e9f7972dd4378672a5dd6cc270ee48059d4cc721359b35"}
Jul 30 12:59:53.842396 ip-10-0-143-153 kubenswrapper[2566]: I0730 12:59:53.842370    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-4tzjz" event={"ID":"95057af8-5515-4bb3-9147-613240e101bb","Type":"ContainerStarted","Data":"de9ad75cc94f1c8381a328a950f6d2030159ec5b77dd883f5b2e93b9a08e8435"}
Jul 30 12:59:53.843736 ip-10-0-143-153 kubenswrapper[2566]: I0730 12:59:53.843716    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4fdfw" event={"ID":"abe34634-20e4-4e0b-9d22-565c35543229","Type":"ContainerStarted","Data":"0a2ba80a4668b348ab6c7242b8dfb70d7c2e4ef27a4be9230705b06c5fa85c03"}
Jul 30 12:59:53.845108 ip-10-0-143-153 kubenswrapper[2566]: I0730 12:59:53.845067    2566 generic.go:356] "Generic (PLEG): container finished" podID="0e113987-a362-4c64-825a-1f883ab76ec9" containerID="84068e7b35f23ad5313a0dd2c7ef27505faba7c9cb0d4c577daba5b057f21c00" exitCode=0
Jul 30 12:59:53.845196 ip-10-0-143-153 kubenswrapper[2566]: I0730 12:59:53.845101    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-8br4n" event={"ID":"0e113987-a362-4c64-825a-1f883ab76ec9","Type":"ContainerDied","Data":"84068e7b35f23ad5313a0dd2c7ef27505faba7c9cb0d4c577daba5b057f21c00"}
Jul 30 12:59:53.846626 ip-10-0-143-153 kubenswrapper[2566]: I0730 12:59:53.846606    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-gppm2" event={"ID":"d1644e14-73e0-40a9-a205-7bdd0eefe290","Type":"ContainerStarted","Data":"aa18adbf9e334080741f6b1c3298adefbaca7591fbb62fc0663414a107eed1bc"}
Jul 30 12:59:53.848275 ip-10-0-143-153 kubenswrapper[2566]: I0730 12:59:53.848248    2566 generic.go:356] "Generic (PLEG): container finished" podID="a8e6a8f600eea6e545d463bd99143fa2" containerID="79b777ddb1f4206448959161f4683c9ea274d082dab46fb184bcac02a73de819" exitCode=0
Jul 30 12:59:53.848365 ip-10-0-143-153 kubenswrapper[2566]: I0730 12:59:53.848336    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-153.ec2.internal" event={"ID":"a8e6a8f600eea6e545d463bd99143fa2","Type":"ContainerDied","Data":"79b777ddb1f4206448959161f4683c9ea274d082dab46fb184bcac02a73de819"}
Jul 30 12:59:53.849858 ip-10-0-143-153 kubenswrapper[2566]: I0730 12:59:53.849835    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-qt2mr" event={"ID":"9c33f673-8361-433b-847f-081d6d4b2753","Type":"ContainerStarted","Data":"c7df716c1e8572af5a3e397d998b7e6f636adfaf0e997c8f8a4dac5ba48b5cd6"}
Jul 30 12:59:53.851311 ip-10-0-143-153 kubenswrapper[2566]: I0730 12:59:53.851286    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-9lmmp" event={"ID":"b6cb9164-228a-4fff-b909-8be034a2b11a","Type":"ContainerStarted","Data":"5ea5986ea6f2ac06f6798645e1a0edcc3aa7f0f3aa1561cfebb3a4ff170af49f"}
Jul 30 12:59:53.853143 ip-10-0-143-153 kubenswrapper[2566]: I0730 12:59:53.853122    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-143-153.ec2.internal" event={"ID":"3327a5e598b8ce026a5b536fdb99458b","Type":"ContainerStarted","Data":"5c30386fe6853d5fe3e35c0c91226d0cb561d8068ff976443bd642b624226cab"}
Jul 30 12:59:53.854513 ip-10-0-143-153 kubenswrapper[2566]: I0730 12:59:53.854491    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-pvtx9" event={"ID":"389ae0b4-e97d-4637-8836-5d349b4b2182","Type":"ContainerStarted","Data":"431377a695e2dabe6ba2c2deaeac7fb40462c8a6c36711c08362a68937c7d873"}
Jul 30 12:59:53.858252 ip-10-0-143-153 kubenswrapper[2566]: I0730 12:59:53.858210    2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-4tzjz" podStartSLOduration=2.754477092 podStartE2EDuration="22.858198779s" totalImagesPullingTime="20.103721687s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-30 12:59:31 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 12:59:53.858159541 +0000 UTC m=+22.786847806" watchObservedRunningTime="2026-07-30 12:59:53.858198779 +0000 UTC m=+22.786887041"
Jul 30 12:59:53.888756 ip-10-0-143-153 kubenswrapper[2566]: I0730 12:59:53.888705    2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-143-153.ec2.internal" podStartSLOduration=21.888687003 podStartE2EDuration="21.888687003s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-30 12:59:32 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 12:59:53.888432444 +0000 UTC m=+22.817120706" watchObservedRunningTime="2026-07-30 12:59:53.888687003 +0000 UTC m=+22.817375267"
Jul 30 12:59:53.906663 ip-10-0-143-153 kubenswrapper[2566]: I0730 12:59:53.906614    2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-gppm2" podStartSLOduration=2.307195251 podStartE2EDuration="22.906597342s" totalImagesPullingTime="20.599402091s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-30 12:59:31 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 12:59:53.906371418 +0000 UTC m=+22.835059680" watchObservedRunningTime="2026-07-30 12:59:53.906597342 +0000 UTC m=+22.835285608"
Jul 30 12:59:53.946712 ip-10-0-143-153 kubenswrapper[2566]: I0730 12:59:53.946673    2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-qt2mr" podStartSLOduration=2.917734662 podStartE2EDuration="22.946659596s" totalImagesPullingTime="20.028924934s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-30 12:59:31 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 12:59:53.946127414 +0000 UTC m=+22.874815676" watchObservedRunningTime="2026-07-30 12:59:53.946659596 +0000 UTC m=+22.875347859"
Jul 30 12:59:53.962696 ip-10-0-143-153 kubenswrapper[2566]: I0730 12:59:53.961978    2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-9lmmp" podStartSLOduration=6.992310217 podStartE2EDuration="22.961958067s" totalImagesPullingTime="15.96964785s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-30 12:59:31 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 12:59:53.961122338 +0000 UTC m=+22.889810579" watchObservedRunningTime="2026-07-30 12:59:53.961958067 +0000 UTC m=+22.890646335"
Jul 30 12:59:53.979404 ip-10-0-143-153 kubenswrapper[2566]: I0730 12:59:53.979357    2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-pvtx9" podStartSLOduration=2.912276005 podStartE2EDuration="22.979344013s" totalImagesPullingTime="20.067068008s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-30 12:59:31 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 12:59:53.978908168 +0000 UTC m=+22.907596431" watchObservedRunningTime="2026-07-30 12:59:53.979344013 +0000 UTC m=+22.908032274"
Jul 30 12:59:54.621590 ip-10-0-143-153 kubenswrapper[2566]: I0730 12:59:54.621516    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-9bp7v"
Jul 30 12:59:54.621782 ip-10-0-143-153 kubenswrapper[2566]: I0730 12:59:54.621613    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-kb44p"
Jul 30 12:59:54.621782 ip-10-0-143-153 kubenswrapper[2566]: E0730 12:59:54.621622    2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-9bp7v" podUID="c2428457-ecf0-45c5-b008-7a51403785c9"
Jul 30 12:59:54.621782 ip-10-0-143-153 kubenswrapper[2566]: I0730 12:59:54.621646    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-bjnvm"
Jul 30 12:59:54.621782 ip-10-0-143-153 kubenswrapper[2566]: E0730 12:59:54.621726    2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-kb44p" podUID="995cd086-39a7-4097-971a-1c4e6c08576b"
Jul 30 12:59:54.621996 ip-10-0-143-153 kubenswrapper[2566]: E0730 12:59:54.621783    2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-bjnvm" podUID="be740ef9-ac84-4ef4-ad66-7f61253c6c28"
Jul 30 12:59:54.859545 ip-10-0-143-153 kubenswrapper[2566]: I0730 12:59:54.859506    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-153.ec2.internal" event={"ID":"a8e6a8f600eea6e545d463bd99143fa2","Type":"ContainerStarted","Data":"456fdebe6bd5ba85b236ca687f0466a4050ab084ba3fcec10f85e28062ff03d3"}
Jul 30 12:59:54.861450 ip-10-0-143-153 kubenswrapper[2566]: I0730 12:59:54.861416    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-m8zwx" event={"ID":"5eedd146-086a-4a5d-a331-5c1dc35f8e9e","Type":"ContainerStarted","Data":"02648c6db2f81f26dfd8702593346c67546612154f89956ad98edf133200daf1"}
Jul 30 12:59:54.873763 ip-10-0-143-153 kubenswrapper[2566]: I0730 12:59:54.873673    2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-153.ec2.internal" podStartSLOduration=22.873657829 podStartE2EDuration="22.873657829s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-30 12:59:32 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 12:59:54.873217787 +0000 UTC m=+23.801906054" watchObservedRunningTime="2026-07-30 12:59:54.873657829 +0000 UTC m=+23.802346092"
Jul 30 12:59:54.886452 ip-10-0-143-153 kubenswrapper[2566]: I0730 12:59:54.886409    2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-m8zwx" podStartSLOduration=3.798279031 podStartE2EDuration="23.886395067s" totalImagesPullingTime="20.088116036s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-30 12:59:31 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 12:59:54.885764924 +0000 UTC m=+23.814453190" watchObservedRunningTime="2026-07-30 12:59:54.886395067 +0000 UTC m=+23.815083363"
Jul 30 12:59:54.991690 ip-10-0-143-153 kubenswrapper[2566]: I0730 12:59:54.991657    2566 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-qt2mr"
Jul 30 12:59:54.992384 ip-10-0-143-153 kubenswrapper[2566]: I0730 12:59:54.992358    2566 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-qt2mr"
Jul 30 12:59:55.399872 ip-10-0-143-153 kubenswrapper[2566]: I0730 12:59:55.399773    2566 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock"
Jul 30 12:59:55.715423 ip-10-0-143-153 kubenswrapper[2566]: I0730 12:59:55.715279    2566 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-07-30T12:59:55.399788538Z","UUID":"31a92be0-2f88-487a-91bf-acc2f3da7897","Handler":null,"Name":"","Endpoint":""}
Jul 30 12:59:55.717195 ip-10-0-143-153 kubenswrapper[2566]: I0730 12:59:55.717170    2566 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0
Jul 30 12:59:55.717320 ip-10-0-143-153 kubenswrapper[2566]: I0730 12:59:55.717216    2566 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock
Jul 30 12:59:55.865662 ip-10-0-143-153 kubenswrapper[2566]: I0730 12:59:55.865632    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4fdfw" event={"ID":"abe34634-20e4-4e0b-9d22-565c35543229","Type":"ContainerStarted","Data":"3e1dccd94fdd6b1a4611d56d715a91b320f6738bae5c2b7cd94956f6a3ad22cc"}
Jul 30 12:59:55.866110 ip-10-0-143-153 kubenswrapper[2566]: I0730 12:59:55.865898    2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-qt2mr"
Jul 30 12:59:55.866449 ip-10-0-143-153 kubenswrapper[2566]: I0730 12:59:55.866428    2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-qt2mr"
Jul 30 12:59:56.620938 ip-10-0-143-153 kubenswrapper[2566]: I0730 12:59:56.620910    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-9bp7v"
Jul 30 12:59:56.620938 ip-10-0-143-153 kubenswrapper[2566]: I0730 12:59:56.620941    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-kb44p"
Jul 30 12:59:56.621226 ip-10-0-143-153 kubenswrapper[2566]: E0730 12:59:56.621024    2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-9bp7v" podUID="c2428457-ecf0-45c5-b008-7a51403785c9"
Jul 30 12:59:56.621226 ip-10-0-143-153 kubenswrapper[2566]: I0730 12:59:56.621089    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-bjnvm"
Jul 30 12:59:56.621226 ip-10-0-143-153 kubenswrapper[2566]: E0730 12:59:56.621179    2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-kb44p" podUID="995cd086-39a7-4097-971a-1c4e6c08576b"
Jul 30 12:59:56.621342 ip-10-0-143-153 kubenswrapper[2566]: E0730 12:59:56.621234    2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-bjnvm" podUID="be740ef9-ac84-4ef4-ad66-7f61253c6c28"
Jul 30 12:59:56.871973 ip-10-0-143-153 kubenswrapper[2566]: I0730 12:59:56.871904    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-f6br6_3ebbc209-4373-44d8-a22e-d2d2aa4cbfa6/ovn-acl-logging/0.log"
Jul 30 12:59:56.872484 ip-10-0-143-153 kubenswrapper[2566]: I0730 12:59:56.872356    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-f6br6" event={"ID":"3ebbc209-4373-44d8-a22e-d2d2aa4cbfa6","Type":"ContainerStarted","Data":"6c92262801fb2e2161be1366a115ec38d11f717c257f6762ee7225f3455bc01c"}
Jul 30 12:59:58.621357 ip-10-0-143-153 kubenswrapper[2566]: I0730 12:59:58.621187    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-kb44p"
Jul 30 12:59:58.621962 ip-10-0-143-153 kubenswrapper[2566]: I0730 12:59:58.621187    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-bjnvm"
Jul 30 12:59:58.621962 ip-10-0-143-153 kubenswrapper[2566]: E0730 12:59:58.621442    2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-kb44p" podUID="995cd086-39a7-4097-971a-1c4e6c08576b"
Jul 30 12:59:58.621962 ip-10-0-143-153 kubenswrapper[2566]: I0730 12:59:58.621187    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-9bp7v"
Jul 30 12:59:58.621962 ip-10-0-143-153 kubenswrapper[2566]: E0730 12:59:58.621501    2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-bjnvm" podUID="be740ef9-ac84-4ef4-ad66-7f61253c6c28"
Jul 30 12:59:58.621962 ip-10-0-143-153 kubenswrapper[2566]: E0730 12:59:58.621621    2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-9bp7v" podUID="c2428457-ecf0-45c5-b008-7a51403785c9"
Jul 30 12:59:58.879135 ip-10-0-143-153 kubenswrapper[2566]: I0730 12:59:58.879044    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4fdfw" event={"ID":"abe34634-20e4-4e0b-9d22-565c35543229","Type":"ContainerStarted","Data":"e15dcea10e092999e5be1ccc921e1ea34b385bb52ea72120e75d15ec5f0b4fa6"}
Jul 30 12:59:58.880841 ip-10-0-143-153 kubenswrapper[2566]: I0730 12:59:58.880806    2566 generic.go:356] "Generic (PLEG): container finished" podID="0e113987-a362-4c64-825a-1f883ab76ec9" containerID="1f0ce6c48db53f6c2ed74fcf41c8c1d91d89ae1a40ab50f1d91e2317317cb601" exitCode=0
Jul 30 12:59:58.880970 ip-10-0-143-153 kubenswrapper[2566]: I0730 12:59:58.880892    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-8br4n" event={"ID":"0e113987-a362-4c64-825a-1f883ab76ec9","Type":"ContainerDied","Data":"1f0ce6c48db53f6c2ed74fcf41c8c1d91d89ae1a40ab50f1d91e2317317cb601"}
Jul 30 12:59:58.884464 ip-10-0-143-153 kubenswrapper[2566]: I0730 12:59:58.884445    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-f6br6_3ebbc209-4373-44d8-a22e-d2d2aa4cbfa6/ovn-acl-logging/0.log"
Jul 30 12:59:58.884824 ip-10-0-143-153 kubenswrapper[2566]: I0730 12:59:58.884808    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-f6br6" event={"ID":"3ebbc209-4373-44d8-a22e-d2d2aa4cbfa6","Type":"ContainerStarted","Data":"9075065be420b2720f2a3a5d27833af7dd3bec582d6908fbf497c897d8cb0067"}
Jul 30 12:59:58.885061 ip-10-0-143-153 kubenswrapper[2566]: I0730 12:59:58.885047    2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-f6br6"
Jul 30 12:59:58.885140 ip-10-0-143-153 kubenswrapper[2566]: I0730 12:59:58.885127    2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-f6br6"
Jul 30 12:59:58.885201 ip-10-0-143-153 kubenswrapper[2566]: I0730 12:59:58.885187    2566 scope.go:117] "RemoveContainer" containerID="af713d58c7f85f3482172a2a4fb2989c6d4616b9bf971f0d8aaa664c73c23def"
Jul 30 12:59:58.894975 ip-10-0-143-153 kubenswrapper[2566]: I0730 12:59:58.894925    2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4fdfw" podStartSLOduration=3.321778305 podStartE2EDuration="27.894906186s" totalImagesPullingTime="24.573127881s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-30 12:59:31 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 12:59:58.894062657 +0000 UTC m=+27.822750945" watchObservedRunningTime="2026-07-30 12:59:58.894906186 +0000 UTC m=+27.823594451"
Jul 30 12:59:58.900992 ip-10-0-143-153 kubenswrapper[2566]: I0730 12:59:58.900975    2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-f6br6"
Jul 30 12:59:59.891377 ip-10-0-143-153 kubenswrapper[2566]: I0730 12:59:59.891352    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-f6br6_3ebbc209-4373-44d8-a22e-d2d2aa4cbfa6/ovn-acl-logging/0.log"
Jul 30 12:59:59.891995 ip-10-0-143-153 kubenswrapper[2566]: I0730 12:59:59.891816    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-f6br6" event={"ID":"3ebbc209-4373-44d8-a22e-d2d2aa4cbfa6","Type":"ContainerStarted","Data":"ead6d66a03e6483f2a032d415ddd00d7279991173f8d2fcb06b3feb1c069240c"}
Jul 30 12:59:59.892060 ip-10-0-143-153 kubenswrapper[2566]: I0730 12:59:59.892033    2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-f6br6"
Jul 30 12:59:59.906703 ip-10-0-143-153 kubenswrapper[2566]: I0730 12:59:59.906680    2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-f6br6"
Jul 30 12:59:59.921758 ip-10-0-143-153 kubenswrapper[2566]: I0730 12:59:59.921715    2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-f6br6" podStartSLOduration=8.808295346 podStartE2EDuration="28.921698963s" totalImagesPullingTime="20.113403617s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-30 12:59:31 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 12:59:59.921164825 +0000 UTC m=+28.849853089" watchObservedRunningTime="2026-07-30 12:59:59.921698963 +0000 UTC m=+28.850387223"
Jul 30 13:00:00.605751 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:00:00.605547    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-kb44p"]
Jul 30 13:00:00.605991 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:00:00.605909    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-kb44p"
Jul 30 13:00:00.606061 ip-10-0-143-153 kubenswrapper[2566]: E0730 13:00:00.606032    2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-kb44p" podUID="995cd086-39a7-4097-971a-1c4e6c08576b"
Jul 30 13:00:00.608941 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:00:00.608912    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-9bp7v"]
Jul 30 13:00:00.609095 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:00:00.609026    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-9bp7v"
Jul 30 13:00:00.609161 ip-10-0-143-153 kubenswrapper[2566]: E0730 13:00:00.609141    2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-9bp7v" podUID="c2428457-ecf0-45c5-b008-7a51403785c9"
Jul 30 13:00:00.609662 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:00:00.609607    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-bjnvm"]
Jul 30 13:00:00.609791 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:00:00.609715    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-bjnvm"
Jul 30 13:00:00.609859 ip-10-0-143-153 kubenswrapper[2566]: E0730 13:00:00.609801    2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-bjnvm" podUID="be740ef9-ac84-4ef4-ad66-7f61253c6c28"
Jul 30 13:00:00.895881 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:00:00.895806    2566 generic.go:356] "Generic (PLEG): container finished" podID="0e113987-a362-4c64-825a-1f883ab76ec9" containerID="f741742028f68690ee32f3bff3e6f527285a89b06ea40519c8b2ce4dee62b192" exitCode=0
Jul 30 13:00:00.896268 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:00:00.895889    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-8br4n" event={"ID":"0e113987-a362-4c64-825a-1f883ab76ec9","Type":"ContainerDied","Data":"f741742028f68690ee32f3bff3e6f527285a89b06ea40519c8b2ce4dee62b192"}
Jul 30 13:00:02.621373 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:00:02.621191    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-9bp7v"
Jul 30 13:00:02.621373 ip-10-0-143-153 kubenswrapper[2566]: E0730 13:00:02.621292    2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-9bp7v" podUID="c2428457-ecf0-45c5-b008-7a51403785c9"
Jul 30 13:00:02.621373 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:00:02.621319    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-bjnvm"
Jul 30 13:00:02.621911 ip-10-0-143-153 kubenswrapper[2566]: E0730 13:00:02.621420    2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-bjnvm" podUID="be740ef9-ac84-4ef4-ad66-7f61253c6c28"
Jul 30 13:00:02.621911 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:00:02.621451    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-kb44p"
Jul 30 13:00:02.621911 ip-10-0-143-153 kubenswrapper[2566]: E0730 13:00:02.621531    2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-kb44p" podUID="995cd086-39a7-4097-971a-1c4e6c08576b"
Jul 30 13:00:02.902401 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:00:02.902366    2566 generic.go:356] "Generic (PLEG): container finished" podID="0e113987-a362-4c64-825a-1f883ab76ec9" containerID="5fcffb2b739ee5c80a9f0f670f63f09981cd7d37095629d7cdfe23c32891b0a1" exitCode=0
Jul 30 13:00:02.902585 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:00:02.902425    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-8br4n" event={"ID":"0e113987-a362-4c64-825a-1f883ab76ec9","Type":"ContainerDied","Data":"5fcffb2b739ee5c80a9f0f670f63f09981cd7d37095629d7cdfe23c32891b0a1"}
Jul 30 13:00:04.332727 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:00:04.332687    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/c2428457-ecf0-45c5-b008-7a51403785c9-original-pull-secret\") pod \"global-pull-secret-syncer-9bp7v\" (UID: \"c2428457-ecf0-45c5-b008-7a51403785c9\") " pod="kube-system/global-pull-secret-syncer-9bp7v"
Jul 30 13:00:04.333160 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:00:04.332789    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/995cd086-39a7-4097-971a-1c4e6c08576b-metrics-certs\") pod \"network-metrics-daemon-kb44p\" (UID: \"995cd086-39a7-4097-971a-1c4e6c08576b\") " pod="openshift-multus/network-metrics-daemon-kb44p"
Jul 30 13:00:04.333160 ip-10-0-143-153 kubenswrapper[2566]: E0730 13:00:04.332883    2566 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 30 13:00:04.333160 ip-10-0-143-153 kubenswrapper[2566]: E0730 13:00:04.332966    2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c2428457-ecf0-45c5-b008-7a51403785c9-original-pull-secret podName:c2428457-ecf0-45c5-b008-7a51403785c9 nodeName:}" failed. No retries permitted until 2026-07-30 13:00:36.332947568 +0000 UTC m=+65.261635808 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/c2428457-ecf0-45c5-b008-7a51403785c9-original-pull-secret") pod "global-pull-secret-syncer-9bp7v" (UID: "c2428457-ecf0-45c5-b008-7a51403785c9") : object "kube-system"/"original-pull-secret" not registered
Jul 30 13:00:04.333160 ip-10-0-143-153 kubenswrapper[2566]: E0730 13:00:04.332897    2566 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 30 13:00:04.333160 ip-10-0-143-153 kubenswrapper[2566]: E0730 13:00:04.333047    2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/995cd086-39a7-4097-971a-1c4e6c08576b-metrics-certs podName:995cd086-39a7-4097-971a-1c4e6c08576b nodeName:}" failed. No retries permitted until 2026-07-30 13:00:36.333030048 +0000 UTC m=+65.261718295 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/995cd086-39a7-4097-971a-1c4e6c08576b-metrics-certs") pod "network-metrics-daemon-kb44p" (UID: "995cd086-39a7-4097-971a-1c4e6c08576b") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 30 13:00:04.434119 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:00:04.434068    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wvdt7\" (UniqueName: \"kubernetes.io/projected/be740ef9-ac84-4ef4-ad66-7f61253c6c28-kube-api-access-wvdt7\") pod \"network-check-target-bjnvm\" (UID: \"be740ef9-ac84-4ef4-ad66-7f61253c6c28\") " pod="openshift-network-diagnostics/network-check-target-bjnvm"
Jul 30 13:00:04.434288 ip-10-0-143-153 kubenswrapper[2566]: E0730 13:00:04.434215    2566 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 30 13:00:04.434288 ip-10-0-143-153 kubenswrapper[2566]: E0730 13:00:04.434241    2566 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 30 13:00:04.434288 ip-10-0-143-153 kubenswrapper[2566]: E0730 13:00:04.434258    2566 projected.go:196] Error preparing data for projected volume kube-api-access-wvdt7 for pod openshift-network-diagnostics/network-check-target-bjnvm: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 30 13:00:04.434460 ip-10-0-143-153 kubenswrapper[2566]: E0730 13:00:04.434322    2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/be740ef9-ac84-4ef4-ad66-7f61253c6c28-kube-api-access-wvdt7 podName:be740ef9-ac84-4ef4-ad66-7f61253c6c28 nodeName:}" failed. No retries permitted until 2026-07-30 13:00:36.434303031 +0000 UTC m=+65.362991285 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-wvdt7" (UniqueName: "kubernetes.io/projected/be740ef9-ac84-4ef4-ad66-7f61253c6c28-kube-api-access-wvdt7") pod "network-check-target-bjnvm" (UID: "be740ef9-ac84-4ef4-ad66-7f61253c6c28") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 30 13:00:04.621390 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:00:04.621312    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-9bp7v"
Jul 30 13:00:04.621390 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:00:04.621346    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-bjnvm"
Jul 30 13:00:04.621588 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:00:04.621326    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-kb44p"
Jul 30 13:00:04.621588 ip-10-0-143-153 kubenswrapper[2566]: E0730 13:00:04.621440    2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-9bp7v" podUID="c2428457-ecf0-45c5-b008-7a51403785c9"
Jul 30 13:00:04.621588 ip-10-0-143-153 kubenswrapper[2566]: E0730 13:00:04.621504    2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-kb44p" podUID="995cd086-39a7-4097-971a-1c4e6c08576b"
Jul 30 13:00:04.621723 ip-10-0-143-153 kubenswrapper[2566]: E0730 13:00:04.621591    2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-bjnvm" podUID="be740ef9-ac84-4ef4-ad66-7f61253c6c28"
Jul 30 13:00:06.364212 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:00:06.364177    2566 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-153.ec2.internal" event="NodeReady"
Jul 30 13:00:06.364642 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:00:06.364339    2566 kubelet_node_status.go:489] "Fast updating node status as it just became ready"
Jul 30 13:00:06.415342 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:00:06.415306    2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-f9822"]
Jul 30 13:00:06.419947 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:00:06.419925    2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-mlzcq"]
Jul 30 13:00:06.420105 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:00:06.420060    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-f9822"
Jul 30 13:00:06.421848 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:00:06.421825    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\""
Jul 30 13:00:06.422191 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:00:06.422174    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-lv78x\""
Jul 30 13:00:06.422272 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:00:06.422259    2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\""
Jul 30 13:00:06.423310 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:00:06.423291    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-mlzcq"
Jul 30 13:00:06.425257 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:00:06.425220    2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\""
Jul 30 13:00:06.425366 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:00:06.425308    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\""
Jul 30 13:00:06.425447 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:00:06.425428    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-r52zx\""
Jul 30 13:00:06.425495 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:00:06.425432    2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\""
Jul 30 13:00:06.427565 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:00:06.427538    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-mlzcq"]
Jul 30 13:00:06.430951 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:00:06.430890    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-f9822"]
Jul 30 13:00:06.549387 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:00:06.549352    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/1a31bbf5-b584-424a-8866-8789661dc09a-config-volume\") pod \"dns-default-f9822\" (UID: \"1a31bbf5-b584-424a-8866-8789661dc09a\") " pod="openshift-dns/dns-default-f9822"
Jul 30 13:00:06.549583 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:00:06.549412    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/1a31bbf5-b584-424a-8866-8789661dc09a-metrics-tls\") pod \"dns-default-f9822\" (UID: \"1a31bbf5-b584-424a-8866-8789661dc09a\") " pod="openshift-dns/dns-default-f9822"
Jul 30 13:00:06.549583 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:00:06.549439    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rdz82\" (UniqueName: \"kubernetes.io/projected/44aa0a10-5c3a-4b62-bb19-92c5b8223440-kube-api-access-rdz82\") pod \"ingress-canary-mlzcq\" (UID: \"44aa0a10-5c3a-4b62-bb19-92c5b8223440\") " pod="openshift-ingress-canary/ingress-canary-mlzcq"
Jul 30 13:00:06.549583 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:00:06.549515    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jp8m9\" (UniqueName: \"kubernetes.io/projected/1a31bbf5-b584-424a-8866-8789661dc09a-kube-api-access-jp8m9\") pod \"dns-default-f9822\" (UID: \"1a31bbf5-b584-424a-8866-8789661dc09a\") " pod="openshift-dns/dns-default-f9822"
Jul 30 13:00:06.549759 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:00:06.549591    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/44aa0a10-5c3a-4b62-bb19-92c5b8223440-cert\") pod \"ingress-canary-mlzcq\" (UID: \"44aa0a10-5c3a-4b62-bb19-92c5b8223440\") " pod="openshift-ingress-canary/ingress-canary-mlzcq"
Jul 30 13:00:06.549759 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:00:06.549692    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/1a31bbf5-b584-424a-8866-8789661dc09a-tmp-dir\") pod \"dns-default-f9822\" (UID: \"1a31bbf5-b584-424a-8866-8789661dc09a\") " pod="openshift-dns/dns-default-f9822"
Jul 30 13:00:06.621350 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:00:06.621273    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-bjnvm"
Jul 30 13:00:06.621519 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:00:06.621273    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-kb44p"
Jul 30 13:00:06.621519 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:00:06.621403    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-9bp7v"
Jul 30 13:00:06.623932 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:00:06.623648    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Jul 30 13:00:06.623932 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:00:06.623689    2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Jul 30 13:00:06.623932 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:00:06.623786    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Jul 30 13:00:06.623932 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:00:06.623789    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-v4mfl\""
Jul 30 13:00:06.624231 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:00:06.624019    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-cq62z\""
Jul 30 13:00:06.624231 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:00:06.624061    2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Jul 30 13:00:06.650247 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:00:06.650223    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/44aa0a10-5c3a-4b62-bb19-92c5b8223440-cert\") pod \"ingress-canary-mlzcq\" (UID: \"44aa0a10-5c3a-4b62-bb19-92c5b8223440\") " pod="openshift-ingress-canary/ingress-canary-mlzcq"
Jul 30 13:00:06.650360 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:00:06.650266    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/1a31bbf5-b584-424a-8866-8789661dc09a-tmp-dir\") pod \"dns-default-f9822\" (UID: \"1a31bbf5-b584-424a-8866-8789661dc09a\") " pod="openshift-dns/dns-default-f9822"
Jul 30 13:00:06.650360 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:00:06.650288    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/1a31bbf5-b584-424a-8866-8789661dc09a-config-volume\") pod \"dns-default-f9822\" (UID: \"1a31bbf5-b584-424a-8866-8789661dc09a\") " pod="openshift-dns/dns-default-f9822"
Jul 30 13:00:06.650360 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:00:06.650336    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/1a31bbf5-b584-424a-8866-8789661dc09a-metrics-tls\") pod \"dns-default-f9822\" (UID: \"1a31bbf5-b584-424a-8866-8789661dc09a\") " pod="openshift-dns/dns-default-f9822"
Jul 30 13:00:06.650512 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:00:06.650359    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rdz82\" (UniqueName: \"kubernetes.io/projected/44aa0a10-5c3a-4b62-bb19-92c5b8223440-kube-api-access-rdz82\") pod \"ingress-canary-mlzcq\" (UID: \"44aa0a10-5c3a-4b62-bb19-92c5b8223440\") " pod="openshift-ingress-canary/ingress-canary-mlzcq"
Jul 30 13:00:06.650512 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:00:06.650391    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jp8m9\" (UniqueName: \"kubernetes.io/projected/1a31bbf5-b584-424a-8866-8789661dc09a-kube-api-access-jp8m9\") pod \"dns-default-f9822\" (UID: \"1a31bbf5-b584-424a-8866-8789661dc09a\") " pod="openshift-dns/dns-default-f9822"
Jul 30 13:00:06.650512 ip-10-0-143-153 kubenswrapper[2566]: E0730 13:00:06.650479    2566 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 30 13:00:06.650638 ip-10-0-143-153 kubenswrapper[2566]: E0730 13:00:06.650555    2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1a31bbf5-b584-424a-8866-8789661dc09a-metrics-tls podName:1a31bbf5-b584-424a-8866-8789661dc09a nodeName:}" failed. No retries permitted until 2026-07-30 13:00:07.150532456 +0000 UTC m=+36.079220710 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/1a31bbf5-b584-424a-8866-8789661dc09a-metrics-tls") pod "dns-default-f9822" (UID: "1a31bbf5-b584-424a-8866-8789661dc09a") : secret "dns-default-metrics-tls" not found
Jul 30 13:00:06.650638 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:00:06.650603    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/1a31bbf5-b584-424a-8866-8789661dc09a-tmp-dir\") pod \"dns-default-f9822\" (UID: \"1a31bbf5-b584-424a-8866-8789661dc09a\") " pod="openshift-dns/dns-default-f9822"
Jul 30 13:00:06.650874 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:00:06.650854    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/1a31bbf5-b584-424a-8866-8789661dc09a-config-volume\") pod \"dns-default-f9822\" (UID: \"1a31bbf5-b584-424a-8866-8789661dc09a\") " pod="openshift-dns/dns-default-f9822"
Jul 30 13:00:06.654988 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:00:06.654970    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/44aa0a10-5c3a-4b62-bb19-92c5b8223440-cert\") pod \"ingress-canary-mlzcq\" (UID: \"44aa0a10-5c3a-4b62-bb19-92c5b8223440\") " pod="openshift-ingress-canary/ingress-canary-mlzcq"
Jul 30 13:00:06.658568 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:00:06.658441    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jp8m9\" (UniqueName: \"kubernetes.io/projected/1a31bbf5-b584-424a-8866-8789661dc09a-kube-api-access-jp8m9\") pod \"dns-default-f9822\" (UID: \"1a31bbf5-b584-424a-8866-8789661dc09a\") " pod="openshift-dns/dns-default-f9822"
Jul 30 13:00:06.658709 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:00:06.658681    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rdz82\" (UniqueName: \"kubernetes.io/projected/44aa0a10-5c3a-4b62-bb19-92c5b8223440-kube-api-access-rdz82\") pod \"ingress-canary-mlzcq\" (UID: \"44aa0a10-5c3a-4b62-bb19-92c5b8223440\") " pod="openshift-ingress-canary/ingress-canary-mlzcq"
Jul 30 13:00:06.738692 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:00:06.738656    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-mlzcq"
Jul 30 13:00:07.154503 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:00:07.154463    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/1a31bbf5-b584-424a-8866-8789661dc09a-metrics-tls\") pod \"dns-default-f9822\" (UID: \"1a31bbf5-b584-424a-8866-8789661dc09a\") " pod="openshift-dns/dns-default-f9822"
Jul 30 13:00:07.154671 ip-10-0-143-153 kubenswrapper[2566]: E0730 13:00:07.154614    2566 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 30 13:00:07.154729 ip-10-0-143-153 kubenswrapper[2566]: E0730 13:00:07.154690    2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1a31bbf5-b584-424a-8866-8789661dc09a-metrics-tls podName:1a31bbf5-b584-424a-8866-8789661dc09a nodeName:}" failed. No retries permitted until 2026-07-30 13:00:08.154669295 +0000 UTC m=+37.083357536 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/1a31bbf5-b584-424a-8866-8789661dc09a-metrics-tls") pod "dns-default-f9822" (UID: "1a31bbf5-b584-424a-8866-8789661dc09a") : secret "dns-default-metrics-tls" not found
Jul 30 13:00:07.352780 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:00:07.352555    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-mlzcq"]
Jul 30 13:00:07.357334 ip-10-0-143-153 kubenswrapper[2566]: W0730 13:00:07.357295    2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod44aa0a10_5c3a_4b62_bb19_92c5b8223440.slice/crio-9927b537af11c938dc25e8838885ec3411f71ba4215cf5a15297a49fe4555d3e WatchSource:0}: Error finding container 9927b537af11c938dc25e8838885ec3411f71ba4215cf5a15297a49fe4555d3e: Status 404 returned error can't find the container with id 9927b537af11c938dc25e8838885ec3411f71ba4215cf5a15297a49fe4555d3e
Jul 30 13:00:07.919562 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:00:07.919339    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-mlzcq" event={"ID":"44aa0a10-5c3a-4b62-bb19-92c5b8223440","Type":"ContainerStarted","Data":"9927b537af11c938dc25e8838885ec3411f71ba4215cf5a15297a49fe4555d3e"}
Jul 30 13:00:07.922467 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:00:07.922437    2566 generic.go:356] "Generic (PLEG): container finished" podID="0e113987-a362-4c64-825a-1f883ab76ec9" containerID="63289a9836ef4e686dd476507c2d6af6371056b3c7544f0468901fd64e0e70c2" exitCode=0
Jul 30 13:00:07.922607 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:00:07.922480    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-8br4n" event={"ID":"0e113987-a362-4c64-825a-1f883ab76ec9","Type":"ContainerDied","Data":"63289a9836ef4e686dd476507c2d6af6371056b3c7544f0468901fd64e0e70c2"}
Jul 30 13:00:08.161437 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:00:08.161401    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/1a31bbf5-b584-424a-8866-8789661dc09a-metrics-tls\") pod \"dns-default-f9822\" (UID: \"1a31bbf5-b584-424a-8866-8789661dc09a\") " pod="openshift-dns/dns-default-f9822"
Jul 30 13:00:08.161599 ip-10-0-143-153 kubenswrapper[2566]: E0730 13:00:08.161522    2566 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 30 13:00:08.161599 ip-10-0-143-153 kubenswrapper[2566]: E0730 13:00:08.161576    2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1a31bbf5-b584-424a-8866-8789661dc09a-metrics-tls podName:1a31bbf5-b584-424a-8866-8789661dc09a nodeName:}" failed. No retries permitted until 2026-07-30 13:00:10.161561153 +0000 UTC m=+39.090249394 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/1a31bbf5-b584-424a-8866-8789661dc09a-metrics-tls") pod "dns-default-f9822" (UID: "1a31bbf5-b584-424a-8866-8789661dc09a") : secret "dns-default-metrics-tls" not found
Jul 30 13:00:08.930096 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:00:08.930045    2566 generic.go:356] "Generic (PLEG): container finished" podID="0e113987-a362-4c64-825a-1f883ab76ec9" containerID="a2858df600c3847a64f56ac478784707437aa489af4af5e7b0a46cb777c7fae4" exitCode=0
Jul 30 13:00:08.930552 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:00:08.930114    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-8br4n" event={"ID":"0e113987-a362-4c64-825a-1f883ab76ec9","Type":"ContainerDied","Data":"a2858df600c3847a64f56ac478784707437aa489af4af5e7b0a46cb777c7fae4"}
Jul 30 13:00:09.936058 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:00:09.936028    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-8br4n" event={"ID":"0e113987-a362-4c64-825a-1f883ab76ec9","Type":"ContainerStarted","Data":"380721d1a3461cf11bae8c38166fcd747b691cbef8319b0bf57fec64b70214ee"}
Jul 30 13:00:09.937466 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:00:09.937438    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-mlzcq" event={"ID":"44aa0a10-5c3a-4b62-bb19-92c5b8223440","Type":"ContainerStarted","Data":"331c50e0f603828b539b602814de7792f50565ad7ff05bd57b076ab3747bd7cc"}
Jul 30 13:00:09.957823 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:00:09.957779    2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-8br4n" podStartSLOduration=7.244173325 podStartE2EDuration="38.957764906s" totalImagesPullingTime="31.713591581s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-30 12:59:31 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 13:00:09.956769347 +0000 UTC m=+38.885457604" watchObservedRunningTime="2026-07-30 13:00:09.957764906 +0000 UTC m=+38.886453168"
Jul 30 13:00:09.972844 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:00:09.972803    2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-mlzcq" podStartSLOduration=1.7189193120000001 podStartE2EDuration="3.972790124s" totalImagesPullingTime="2.253870812s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-30 13:00:06 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 13:00:09.972327965 +0000 UTC m=+38.901016228" watchObservedRunningTime="2026-07-30 13:00:09.972790124 +0000 UTC m=+38.901478388"
Jul 30 13:00:10.176755 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:00:10.176716    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/1a31bbf5-b584-424a-8866-8789661dc09a-metrics-tls\") pod \"dns-default-f9822\" (UID: \"1a31bbf5-b584-424a-8866-8789661dc09a\") " pod="openshift-dns/dns-default-f9822"
Jul 30 13:00:10.176951 ip-10-0-143-153 kubenswrapper[2566]: E0730 13:00:10.176886    2566 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 30 13:00:10.177013 ip-10-0-143-153 kubenswrapper[2566]: E0730 13:00:10.176965    2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1a31bbf5-b584-424a-8866-8789661dc09a-metrics-tls podName:1a31bbf5-b584-424a-8866-8789661dc09a nodeName:}" failed. No retries permitted until 2026-07-30 13:00:14.176942781 +0000 UTC m=+43.105631041 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/1a31bbf5-b584-424a-8866-8789661dc09a-metrics-tls") pod "dns-default-f9822" (UID: "1a31bbf5-b584-424a-8866-8789661dc09a") : secret "dns-default-metrics-tls" not found
Jul 30 13:00:14.204323 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:00:14.204278    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/1a31bbf5-b584-424a-8866-8789661dc09a-metrics-tls\") pod \"dns-default-f9822\" (UID: \"1a31bbf5-b584-424a-8866-8789661dc09a\") " pod="openshift-dns/dns-default-f9822"
Jul 30 13:00:14.204692 ip-10-0-143-153 kubenswrapper[2566]: E0730 13:00:14.204438    2566 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 30 13:00:14.204692 ip-10-0-143-153 kubenswrapper[2566]: E0730 13:00:14.204500    2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1a31bbf5-b584-424a-8866-8789661dc09a-metrics-tls podName:1a31bbf5-b584-424a-8866-8789661dc09a nodeName:}" failed. No retries permitted until 2026-07-30 13:00:22.204483849 +0000 UTC m=+51.133172101 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/1a31bbf5-b584-424a-8866-8789661dc09a-metrics-tls") pod "dns-default-f9822" (UID: "1a31bbf5-b584-424a-8866-8789661dc09a") : secret "dns-default-metrics-tls" not found
Jul 30 13:00:22.259030 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:00:22.258989    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/1a31bbf5-b584-424a-8866-8789661dc09a-metrics-tls\") pod \"dns-default-f9822\" (UID: \"1a31bbf5-b584-424a-8866-8789661dc09a\") " pod="openshift-dns/dns-default-f9822"
Jul 30 13:00:22.259544 ip-10-0-143-153 kubenswrapper[2566]: E0730 13:00:22.259163    2566 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 30 13:00:22.259544 ip-10-0-143-153 kubenswrapper[2566]: E0730 13:00:22.259230    2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1a31bbf5-b584-424a-8866-8789661dc09a-metrics-tls podName:1a31bbf5-b584-424a-8866-8789661dc09a nodeName:}" failed. No retries permitted until 2026-07-30 13:00:38.259214216 +0000 UTC m=+67.187902457 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/1a31bbf5-b584-424a-8866-8789661dc09a-metrics-tls") pod "dns-default-f9822" (UID: "1a31bbf5-b584-424a-8866-8789661dc09a") : secret "dns-default-metrics-tls" not found
Jul 30 13:00:31.915890 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:00:31.915859    2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-f6br6"
Jul 30 13:00:36.358705 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:00:36.358655    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/995cd086-39a7-4097-971a-1c4e6c08576b-metrics-certs\") pod \"network-metrics-daemon-kb44p\" (UID: \"995cd086-39a7-4097-971a-1c4e6c08576b\") " pod="openshift-multus/network-metrics-daemon-kb44p"
Jul 30 13:00:36.358705 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:00:36.358711    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/c2428457-ecf0-45c5-b008-7a51403785c9-original-pull-secret\") pod \"global-pull-secret-syncer-9bp7v\" (UID: \"c2428457-ecf0-45c5-b008-7a51403785c9\") " pod="kube-system/global-pull-secret-syncer-9bp7v"
Jul 30 13:00:36.361160 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:00:36.361136    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Jul 30 13:00:36.361160 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:00:36.361153    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Jul 30 13:00:36.369223 ip-10-0-143-153 kubenswrapper[2566]: E0730 13:00:36.369210    2566 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found
Jul 30 13:00:36.369273 ip-10-0-143-153 kubenswrapper[2566]: E0730 13:00:36.369259    2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/995cd086-39a7-4097-971a-1c4e6c08576b-metrics-certs podName:995cd086-39a7-4097-971a-1c4e6c08576b nodeName:}" failed. No retries permitted until 2026-07-30 13:01:40.369245158 +0000 UTC m=+129.297933399 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/995cd086-39a7-4097-971a-1c4e6c08576b-metrics-certs") pod "network-metrics-daemon-kb44p" (UID: "995cd086-39a7-4097-971a-1c4e6c08576b") : secret "metrics-daemon-secret" not found
Jul 30 13:00:36.372648 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:00:36.372630    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/c2428457-ecf0-45c5-b008-7a51403785c9-original-pull-secret\") pod \"global-pull-secret-syncer-9bp7v\" (UID: \"c2428457-ecf0-45c5-b008-7a51403785c9\") " pod="kube-system/global-pull-secret-syncer-9bp7v"
Jul 30 13:00:36.459431 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:00:36.459401    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wvdt7\" (UniqueName: \"kubernetes.io/projected/be740ef9-ac84-4ef4-ad66-7f61253c6c28-kube-api-access-wvdt7\") pod \"network-check-target-bjnvm\" (UID: \"be740ef9-ac84-4ef4-ad66-7f61253c6c28\") " pod="openshift-network-diagnostics/network-check-target-bjnvm"
Jul 30 13:00:36.461866 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:00:36.461849    2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Jul 30 13:00:36.472462 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:00:36.472442    2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Jul 30 13:00:36.483187 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:00:36.483162    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wvdt7\" (UniqueName: \"kubernetes.io/projected/be740ef9-ac84-4ef4-ad66-7f61253c6c28-kube-api-access-wvdt7\") pod \"network-check-target-bjnvm\" (UID: \"be740ef9-ac84-4ef4-ad66-7f61253c6c28\") " pod="openshift-network-diagnostics/network-check-target-bjnvm"
Jul 30 13:00:36.634503 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:00:36.634481    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-cq62z\""
Jul 30 13:00:36.642379 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:00:36.642363    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-bjnvm"
Jul 30 13:00:36.644524 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:00:36.644505    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-9bp7v"
Jul 30 13:00:36.783001 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:00:36.782962    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-9bp7v"]
Jul 30 13:00:36.800791 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:00:36.800763    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-bjnvm"]
Jul 30 13:00:36.803852 ip-10-0-143-153 kubenswrapper[2566]: W0730 13:00:36.803828    2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbe740ef9_ac84_4ef4_ad66_7f61253c6c28.slice/crio-ec2ab392c7e88d79c16be76edcf0ef3eef472d9234f16ed7569b2687c56c41a8 WatchSource:0}: Error finding container ec2ab392c7e88d79c16be76edcf0ef3eef472d9234f16ed7569b2687c56c41a8: Status 404 returned error can't find the container with id ec2ab392c7e88d79c16be76edcf0ef3eef472d9234f16ed7569b2687c56c41a8
Jul 30 13:00:37.000252 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:00:37.000173    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-9bp7v" event={"ID":"c2428457-ecf0-45c5-b008-7a51403785c9","Type":"ContainerStarted","Data":"12807f810043a84e52f7bcd6411c63981324b4b6a654e3fac922378d95bd6f0b"}
Jul 30 13:00:37.001257 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:00:37.001222    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-bjnvm" event={"ID":"be740ef9-ac84-4ef4-ad66-7f61253c6c28","Type":"ContainerStarted","Data":"ec2ab392c7e88d79c16be76edcf0ef3eef472d9234f16ed7569b2687c56c41a8"}
Jul 30 13:00:38.272344 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:00:38.272256    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/1a31bbf5-b584-424a-8866-8789661dc09a-metrics-tls\") pod \"dns-default-f9822\" (UID: \"1a31bbf5-b584-424a-8866-8789661dc09a\") " pod="openshift-dns/dns-default-f9822"
Jul 30 13:00:38.272801 ip-10-0-143-153 kubenswrapper[2566]: E0730 13:00:38.272419    2566 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 30 13:00:38.272801 ip-10-0-143-153 kubenswrapper[2566]: E0730 13:00:38.272501    2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1a31bbf5-b584-424a-8866-8789661dc09a-metrics-tls podName:1a31bbf5-b584-424a-8866-8789661dc09a nodeName:}" failed. No retries permitted until 2026-07-30 13:01:10.27247596 +0000 UTC m=+99.201164205 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/1a31bbf5-b584-424a-8866-8789661dc09a-metrics-tls") pod "dns-default-f9822" (UID: "1a31bbf5-b584-424a-8866-8789661dc09a") : secret "dns-default-metrics-tls" not found
Jul 30 13:00:40.989248 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:00:40.989212    2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-service-ca-operator/service-ca-operator-5d6c75f84f-psdw9"]
Jul 30 13:00:41.006285 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:00:41.006257    2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console-operator/console-operator-584dcb6b54-bzl6w"]
Jul 30 13:00:41.006447 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:00:41.006423    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-5d6c75f84f-psdw9"
Jul 30 13:00:41.010286 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:00:41.010257    2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-config\""
Jul 30 13:00:41.010431 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:00:41.010345    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-dockercfg-9pth6\""
Jul 30 13:00:41.010655 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:00:41.010638    2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"openshift-service-ca.crt\""
Jul 30 13:00:41.010756 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:00:41.010644    2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"kube-root-ca.crt\""
Jul 30 13:00:41.010756 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:00:41.010703    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"serving-cert\""
Jul 30 13:00:41.020024 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:00:41.018885    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-5d6c75f84f-psdw9"]
Jul 30 13:00:41.020024 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:00:41.019013    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-584dcb6b54-bzl6w"]
Jul 30 13:00:41.020024 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:00:41.019035    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-584dcb6b54-bzl6w"
Jul 30 13:00:41.035628 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:00:41.035597    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"serving-cert\""
Jul 30 13:00:41.035920 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:00:41.035902    2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"kube-root-ca.crt\""
Jul 30 13:00:41.036199 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:00:41.036180    2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"openshift-service-ca.crt\""
Jul 30 13:00:41.036415 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:00:41.036400    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"console-operator-dockercfg-tmdqw\""
Jul 30 13:00:41.036650 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:00:41.036635    2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"console-operator-config\""
Jul 30 13:00:41.043545 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:00:41.043521    2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"trusted-ca\""
Jul 30 13:00:41.072336 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:00:41.072301    2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-548b489cb8-v6zgd"]
Jul 30 13:00:41.093591 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:00:41.093556    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/51cdacbf-3a14-47c0-8fd4-69b0b2be0e64-trusted-ca\") pod \"console-operator-584dcb6b54-bzl6w\" (UID: \"51cdacbf-3a14-47c0-8fd4-69b0b2be0e64\") " pod="openshift-console-operator/console-operator-584dcb6b54-bzl6w"
Jul 30 13:00:41.093591 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:00:41.093594    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/0a469596-ff7b-45e1-9fc7-a6f4753ff16a-config\") pod \"service-ca-operator-5d6c75f84f-psdw9\" (UID: \"0a469596-ff7b-45e1-9fc7-a6f4753ff16a\") " pod="openshift-service-ca-operator/service-ca-operator-5d6c75f84f-psdw9"
Jul 30 13:00:41.093803 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:00:41.093619    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mm74v\" (UniqueName: \"kubernetes.io/projected/51cdacbf-3a14-47c0-8fd4-69b0b2be0e64-kube-api-access-mm74v\") pod \"console-operator-584dcb6b54-bzl6w\" (UID: \"51cdacbf-3a14-47c0-8fd4-69b0b2be0e64\") " pod="openshift-console-operator/console-operator-584dcb6b54-bzl6w"
Jul 30 13:00:41.093803 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:00:41.093656    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/51cdacbf-3a14-47c0-8fd4-69b0b2be0e64-serving-cert\") pod \"console-operator-584dcb6b54-bzl6w\" (UID: \"51cdacbf-3a14-47c0-8fd4-69b0b2be0e64\") " pod="openshift-console-operator/console-operator-584dcb6b54-bzl6w"
Jul 30 13:00:41.093803 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:00:41.093706    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zjbmr\" (UniqueName: \"kubernetes.io/projected/0a469596-ff7b-45e1-9fc7-a6f4753ff16a-kube-api-access-zjbmr\") pod \"service-ca-operator-5d6c75f84f-psdw9\" (UID: \"0a469596-ff7b-45e1-9fc7-a6f4753ff16a\") " pod="openshift-service-ca-operator/service-ca-operator-5d6c75f84f-psdw9"
Jul 30 13:00:41.093803 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:00:41.093735    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/51cdacbf-3a14-47c0-8fd4-69b0b2be0e64-config\") pod \"console-operator-584dcb6b54-bzl6w\" (UID: \"51cdacbf-3a14-47c0-8fd4-69b0b2be0e64\") " pod="openshift-console-operator/console-operator-584dcb6b54-bzl6w"
Jul 30 13:00:41.093803 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:00:41.093778    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/0a469596-ff7b-45e1-9fc7-a6f4753ff16a-serving-cert\") pod \"service-ca-operator-5d6c75f84f-psdw9\" (UID: \"0a469596-ff7b-45e1-9fc7-a6f4753ff16a\") " pod="openshift-service-ca-operator/service-ca-operator-5d6c75f84f-psdw9"
Jul 30 13:00:41.094716 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:00:41.094692    2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-diagnostics/network-check-source-7d88cb55d8-52sx8"]
Jul 30 13:00:41.094840 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:00:41.094824    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-548b489cb8-v6zgd"
Jul 30 13:00:41.097345 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:00:41.097326    2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\""
Jul 30 13:00:41.097470 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:00:41.097453    2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\""
Jul 30 13:00:41.097708 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:00:41.097686    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-tls\""
Jul 30 13:00:41.097708 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:00:41.097701    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-dockercfg-hvx9n\""
Jul 30 13:00:41.097867 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:00:41.097857    2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemetry-config\""
Jul 30 13:00:41.118938 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:00:41.118912    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-548b489cb8-v6zgd"]
Jul 30 13:00:41.119048 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:00:41.118954    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-7d88cb55d8-52sx8"]
Jul 30 13:00:41.119136 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:00:41.119047    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-7d88cb55d8-52sx8"
Jul 30 13:00:41.121090 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:00:41.121033    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"network-diagnostics-dockercfg-t6vh6\""
Jul 30 13:00:41.176372 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:00:41.176342    2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6f4d6fb6bc-thklp"]
Jul 30 13:00:41.192870 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:00:41.192844    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6f4d6fb6bc-thklp"
Jul 30 13:00:41.193262 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:00:41.193235    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6f4d6fb6bc-thklp"]
Jul 30 13:00:41.194701 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:00:41.194674    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zjbmr\" (UniqueName: \"kubernetes.io/projected/0a469596-ff7b-45e1-9fc7-a6f4753ff16a-kube-api-access-zjbmr\") pod \"service-ca-operator-5d6c75f84f-psdw9\" (UID: \"0a469596-ff7b-45e1-9fc7-a6f4753ff16a\") " pod="openshift-service-ca-operator/service-ca-operator-5d6c75f84f-psdw9"
Jul 30 13:00:41.194826 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:00:41.194715    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/51cdacbf-3a14-47c0-8fd4-69b0b2be0e64-config\") pod \"console-operator-584dcb6b54-bzl6w\" (UID: \"51cdacbf-3a14-47c0-8fd4-69b0b2be0e64\") " pod="openshift-console-operator/console-operator-584dcb6b54-bzl6w"
Jul 30 13:00:41.194826 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:00:41.194747    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zlp8n\" (UniqueName: \"kubernetes.io/projected/a9cdd07c-66cd-4d85-bc84-b2a318f1b705-kube-api-access-zlp8n\") pod \"cluster-monitoring-operator-548b489cb8-v6zgd\" (UID: \"a9cdd07c-66cd-4d85-bc84-b2a318f1b705\") " pod="openshift-monitoring/cluster-monitoring-operator-548b489cb8-v6zgd"
Jul 30 13:00:41.194911 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:00:41.194891    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/0a469596-ff7b-45e1-9fc7-a6f4753ff16a-serving-cert\") pod \"service-ca-operator-5d6c75f84f-psdw9\" (UID: \"0a469596-ff7b-45e1-9fc7-a6f4753ff16a\") " pod="openshift-service-ca-operator/service-ca-operator-5d6c75f84f-psdw9"
Jul 30 13:00:41.194978 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:00:41.194962    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/51cdacbf-3a14-47c0-8fd4-69b0b2be0e64-trusted-ca\") pod \"console-operator-584dcb6b54-bzl6w\" (UID: \"51cdacbf-3a14-47c0-8fd4-69b0b2be0e64\") " pod="openshift-console-operator/console-operator-584dcb6b54-bzl6w"
Jul 30 13:00:41.195015 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:00:41.194996    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/a9cdd07c-66cd-4d85-bc84-b2a318f1b705-telemetry-config\") pod \"cluster-monitoring-operator-548b489cb8-v6zgd\" (UID: \"a9cdd07c-66cd-4d85-bc84-b2a318f1b705\") " pod="openshift-monitoring/cluster-monitoring-operator-548b489cb8-v6zgd"
Jul 30 13:00:41.195062 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:00:41.195028    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/0a469596-ff7b-45e1-9fc7-a6f4753ff16a-config\") pod \"service-ca-operator-5d6c75f84f-psdw9\" (UID: \"0a469596-ff7b-45e1-9fc7-a6f4753ff16a\") " pod="openshift-service-ca-operator/service-ca-operator-5d6c75f84f-psdw9"
Jul 30 13:00:41.195062 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:00:41.195053    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mm74v\" (UniqueName: \"kubernetes.io/projected/51cdacbf-3a14-47c0-8fd4-69b0b2be0e64-kube-api-access-mm74v\") pod \"console-operator-584dcb6b54-bzl6w\" (UID: \"51cdacbf-3a14-47c0-8fd4-69b0b2be0e64\") " pod="openshift-console-operator/console-operator-584dcb6b54-bzl6w"
Jul 30 13:00:41.195168 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:00:41.195099    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4rjs2\" (UniqueName: \"kubernetes.io/projected/694c86c8-35ba-4966-9c5c-251894af19b4-kube-api-access-4rjs2\") pod \"network-check-source-7d88cb55d8-52sx8\" (UID: \"694c86c8-35ba-4966-9c5c-251894af19b4\") " pod="openshift-network-diagnostics/network-check-source-7d88cb55d8-52sx8"
Jul 30 13:00:41.195168 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:00:41.195143    2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"config\""
Jul 30 13:00:41.195280 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:00:41.195130    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/51cdacbf-3a14-47c0-8fd4-69b0b2be0e64-serving-cert\") pod \"console-operator-584dcb6b54-bzl6w\" (UID: \"51cdacbf-3a14-47c0-8fd4-69b0b2be0e64\") " pod="openshift-console-operator/console-operator-584dcb6b54-bzl6w"
Jul 30 13:00:41.195336 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:00:41.195322    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/a9cdd07c-66cd-4d85-bc84-b2a318f1b705-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-548b489cb8-v6zgd\" (UID: \"a9cdd07c-66cd-4d85-bc84-b2a318f1b705\") " pod="openshift-monitoring/cluster-monitoring-operator-548b489cb8-v6zgd"
Jul 30 13:00:41.195494 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:00:41.195476    2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"openshift-service-ca.crt\""
Jul 30 13:00:41.195494 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:00:41.195487    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/51cdacbf-3a14-47c0-8fd4-69b0b2be0e64-config\") pod \"console-operator-584dcb6b54-bzl6w\" (UID: \"51cdacbf-3a14-47c0-8fd4-69b0b2be0e64\") " pod="openshift-console-operator/console-operator-584dcb6b54-bzl6w"
Jul 30 13:00:41.195709 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:00:41.195692    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"serving-cert\""
Jul 30 13:00:41.195774 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:00:41.195733    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-storage-version-migrator-operator-dockercfg-ccf2r\""
Jul 30 13:00:41.196620 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:00:41.195935    2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-root-ca.crt\""
Jul 30 13:00:41.196620 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:00:41.196114    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/51cdacbf-3a14-47c0-8fd4-69b0b2be0e64-trusted-ca\") pod \"console-operator-584dcb6b54-bzl6w\" (UID: \"51cdacbf-3a14-47c0-8fd4-69b0b2be0e64\") " pod="openshift-console-operator/console-operator-584dcb6b54-bzl6w"
Jul 30 13:00:41.196620 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:00:41.196574    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/0a469596-ff7b-45e1-9fc7-a6f4753ff16a-config\") pod \"service-ca-operator-5d6c75f84f-psdw9\" (UID: \"0a469596-ff7b-45e1-9fc7-a6f4753ff16a\") " pod="openshift-service-ca-operator/service-ca-operator-5d6c75f84f-psdw9"
Jul 30 13:00:41.198008 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:00:41.197984    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/51cdacbf-3a14-47c0-8fd4-69b0b2be0e64-serving-cert\") pod \"console-operator-584dcb6b54-bzl6w\" (UID: \"51cdacbf-3a14-47c0-8fd4-69b0b2be0e64\") " pod="openshift-console-operator/console-operator-584dcb6b54-bzl6w"
Jul 30 13:00:41.198512 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:00:41.198494    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/0a469596-ff7b-45e1-9fc7-a6f4753ff16a-serving-cert\") pod \"service-ca-operator-5d6c75f84f-psdw9\" (UID: \"0a469596-ff7b-45e1-9fc7-a6f4753ff16a\") " pod="openshift-service-ca-operator/service-ca-operator-5d6c75f84f-psdw9"
Jul 30 13:00:41.207175 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:00:41.207148    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zjbmr\" (UniqueName: \"kubernetes.io/projected/0a469596-ff7b-45e1-9fc7-a6f4753ff16a-kube-api-access-zjbmr\") pod \"service-ca-operator-5d6c75f84f-psdw9\" (UID: \"0a469596-ff7b-45e1-9fc7-a6f4753ff16a\") " pod="openshift-service-ca-operator/service-ca-operator-5d6c75f84f-psdw9"
Jul 30 13:00:41.208246 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:00:41.208224    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mm74v\" (UniqueName: \"kubernetes.io/projected/51cdacbf-3a14-47c0-8fd4-69b0b2be0e64-kube-api-access-mm74v\") pod \"console-operator-584dcb6b54-bzl6w\" (UID: \"51cdacbf-3a14-47c0-8fd4-69b0b2be0e64\") " pod="openshift-console-operator/console-operator-584dcb6b54-bzl6w"
Jul 30 13:00:41.296251 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:00:41.296158    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/a9cdd07c-66cd-4d85-bc84-b2a318f1b705-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-548b489cb8-v6zgd\" (UID: \"a9cdd07c-66cd-4d85-bc84-b2a318f1b705\") " pod="openshift-monitoring/cluster-monitoring-operator-548b489cb8-v6zgd"
Jul 30 13:00:41.296251 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:00:41.296209    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zlp8n\" (UniqueName: \"kubernetes.io/projected/a9cdd07c-66cd-4d85-bc84-b2a318f1b705-kube-api-access-zlp8n\") pod \"cluster-monitoring-operator-548b489cb8-v6zgd\" (UID: \"a9cdd07c-66cd-4d85-bc84-b2a318f1b705\") " pod="openshift-monitoring/cluster-monitoring-operator-548b489cb8-v6zgd"
Jul 30 13:00:41.296488 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:00:41.296284    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/a9cdd07c-66cd-4d85-bc84-b2a318f1b705-telemetry-config\") pod \"cluster-monitoring-operator-548b489cb8-v6zgd\" (UID: \"a9cdd07c-66cd-4d85-bc84-b2a318f1b705\") " pod="openshift-monitoring/cluster-monitoring-operator-548b489cb8-v6zgd"
Jul 30 13:00:41.296488 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:00:41.296312    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4rjs2\" (UniqueName: \"kubernetes.io/projected/694c86c8-35ba-4966-9c5c-251894af19b4-kube-api-access-4rjs2\") pod \"network-check-source-7d88cb55d8-52sx8\" (UID: \"694c86c8-35ba-4966-9c5c-251894af19b4\") " pod="openshift-network-diagnostics/network-check-source-7d88cb55d8-52sx8"
Jul 30 13:00:41.296488 ip-10-0-143-153 kubenswrapper[2566]: E0730 13:00:41.296331    2566 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Jul 30 13:00:41.296488 ip-10-0-143-153 kubenswrapper[2566]: E0730 13:00:41.296409    2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a9cdd07c-66cd-4d85-bc84-b2a318f1b705-cluster-monitoring-operator-tls podName:a9cdd07c-66cd-4d85-bc84-b2a318f1b705 nodeName:}" failed. No retries permitted until 2026-07-30 13:00:41.796387542 +0000 UTC m=+70.725075784 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/a9cdd07c-66cd-4d85-bc84-b2a318f1b705-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-548b489cb8-v6zgd" (UID: "a9cdd07c-66cd-4d85-bc84-b2a318f1b705") : secret "cluster-monitoring-operator-tls" not found
Jul 30 13:00:41.296488 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:00:41.296338    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bgfzz\" (UniqueName: \"kubernetes.io/projected/c566cf8d-48ce-43ae-9427-e5e43d8f2e2f-kube-api-access-bgfzz\") pod \"kube-storage-version-migrator-operator-6f4d6fb6bc-thklp\" (UID: \"c566cf8d-48ce-43ae-9427-e5e43d8f2e2f\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6f4d6fb6bc-thklp"
Jul 30 13:00:41.296488 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:00:41.296476    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/c566cf8d-48ce-43ae-9427-e5e43d8f2e2f-serving-cert\") pod \"kube-storage-version-migrator-operator-6f4d6fb6bc-thklp\" (UID: \"c566cf8d-48ce-43ae-9427-e5e43d8f2e2f\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6f4d6fb6bc-thklp"
Jul 30 13:00:41.296776 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:00:41.296520    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/c566cf8d-48ce-43ae-9427-e5e43d8f2e2f-config\") pod \"kube-storage-version-migrator-operator-6f4d6fb6bc-thklp\" (UID: \"c566cf8d-48ce-43ae-9427-e5e43d8f2e2f\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6f4d6fb6bc-thklp"
Jul 30 13:00:41.297125 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:00:41.297093    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/a9cdd07c-66cd-4d85-bc84-b2a318f1b705-telemetry-config\") pod \"cluster-monitoring-operator-548b489cb8-v6zgd\" (UID: \"a9cdd07c-66cd-4d85-bc84-b2a318f1b705\") " pod="openshift-monitoring/cluster-monitoring-operator-548b489cb8-v6zgd"
Jul 30 13:00:41.305186 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:00:41.305161    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zlp8n\" (UniqueName: \"kubernetes.io/projected/a9cdd07c-66cd-4d85-bc84-b2a318f1b705-kube-api-access-zlp8n\") pod \"cluster-monitoring-operator-548b489cb8-v6zgd\" (UID: \"a9cdd07c-66cd-4d85-bc84-b2a318f1b705\") " pod="openshift-monitoring/cluster-monitoring-operator-548b489cb8-v6zgd"
Jul 30 13:00:41.305305 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:00:41.305170    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4rjs2\" (UniqueName: \"kubernetes.io/projected/694c86c8-35ba-4966-9c5c-251894af19b4-kube-api-access-4rjs2\") pod \"network-check-source-7d88cb55d8-52sx8\" (UID: \"694c86c8-35ba-4966-9c5c-251894af19b4\") " pod="openshift-network-diagnostics/network-check-source-7d88cb55d8-52sx8"
Jul 30 13:00:41.322825 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:00:41.322803    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-5d6c75f84f-psdw9"
Jul 30 13:00:41.333567 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:00:41.333540    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-584dcb6b54-bzl6w"
Jul 30 13:00:41.397881 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:00:41.397837    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bgfzz\" (UniqueName: \"kubernetes.io/projected/c566cf8d-48ce-43ae-9427-e5e43d8f2e2f-kube-api-access-bgfzz\") pod \"kube-storage-version-migrator-operator-6f4d6fb6bc-thklp\" (UID: \"c566cf8d-48ce-43ae-9427-e5e43d8f2e2f\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6f4d6fb6bc-thklp"
Jul 30 13:00:41.397881 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:00:41.397886    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/c566cf8d-48ce-43ae-9427-e5e43d8f2e2f-serving-cert\") pod \"kube-storage-version-migrator-operator-6f4d6fb6bc-thklp\" (UID: \"c566cf8d-48ce-43ae-9427-e5e43d8f2e2f\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6f4d6fb6bc-thklp"
Jul 30 13:00:41.398133 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:00:41.397917    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/c566cf8d-48ce-43ae-9427-e5e43d8f2e2f-config\") pod \"kube-storage-version-migrator-operator-6f4d6fb6bc-thklp\" (UID: \"c566cf8d-48ce-43ae-9427-e5e43d8f2e2f\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6f4d6fb6bc-thklp"
Jul 30 13:00:41.398500 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:00:41.398473    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/c566cf8d-48ce-43ae-9427-e5e43d8f2e2f-config\") pod \"kube-storage-version-migrator-operator-6f4d6fb6bc-thklp\" (UID: \"c566cf8d-48ce-43ae-9427-e5e43d8f2e2f\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6f4d6fb6bc-thklp"
Jul 30 13:00:41.400635 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:00:41.400606    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/c566cf8d-48ce-43ae-9427-e5e43d8f2e2f-serving-cert\") pod \"kube-storage-version-migrator-operator-6f4d6fb6bc-thklp\" (UID: \"c566cf8d-48ce-43ae-9427-e5e43d8f2e2f\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6f4d6fb6bc-thklp"
Jul 30 13:00:41.409599 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:00:41.409577    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bgfzz\" (UniqueName: \"kubernetes.io/projected/c566cf8d-48ce-43ae-9427-e5e43d8f2e2f-kube-api-access-bgfzz\") pod \"kube-storage-version-migrator-operator-6f4d6fb6bc-thklp\" (UID: \"c566cf8d-48ce-43ae-9427-e5e43d8f2e2f\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6f4d6fb6bc-thklp"
Jul 30 13:00:41.429712 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:00:41.429689    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-7d88cb55d8-52sx8"
Jul 30 13:00:41.519324 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:00:41.519291    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6f4d6fb6bc-thklp"
Jul 30 13:00:41.800114 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:00:41.800068    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/a9cdd07c-66cd-4d85-bc84-b2a318f1b705-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-548b489cb8-v6zgd\" (UID: \"a9cdd07c-66cd-4d85-bc84-b2a318f1b705\") " pod="openshift-monitoring/cluster-monitoring-operator-548b489cb8-v6zgd"
Jul 30 13:00:41.800296 ip-10-0-143-153 kubenswrapper[2566]: E0730 13:00:41.800178    2566 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Jul 30 13:00:41.800296 ip-10-0-143-153 kubenswrapper[2566]: E0730 13:00:41.800240    2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a9cdd07c-66cd-4d85-bc84-b2a318f1b705-cluster-monitoring-operator-tls podName:a9cdd07c-66cd-4d85-bc84-b2a318f1b705 nodeName:}" failed. No retries permitted until 2026-07-30 13:00:42.80022511 +0000 UTC m=+71.728913350 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/a9cdd07c-66cd-4d85-bc84-b2a318f1b705-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-548b489cb8-v6zgd" (UID: "a9cdd07c-66cd-4d85-bc84-b2a318f1b705") : secret "cluster-monitoring-operator-tls" not found
Jul 30 13:00:42.153934 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:00:42.153832    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-5d6c75f84f-psdw9"]
Jul 30 13:00:42.159148 ip-10-0-143-153 kubenswrapper[2566]: W0730 13:00:42.159119    2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0a469596_ff7b_45e1_9fc7_a6f4753ff16a.slice/crio-0021b4a4d5041a01ff16d2902666e610a00ed9a0520cc1b805c4d5957bdaf42c WatchSource:0}: Error finding container 0021b4a4d5041a01ff16d2902666e610a00ed9a0520cc1b805c4d5957bdaf42c: Status 404 returned error can't find the container with id 0021b4a4d5041a01ff16d2902666e610a00ed9a0520cc1b805c4d5957bdaf42c
Jul 30 13:00:42.376760 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:00:42.376684    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-7d88cb55d8-52sx8"]
Jul 30 13:00:42.380435 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:00:42.379982    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-584dcb6b54-bzl6w"]
Jul 30 13:00:42.380435 ip-10-0-143-153 kubenswrapper[2566]: W0730 13:00:42.380351    2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod694c86c8_35ba_4966_9c5c_251894af19b4.slice/crio-5e7f17b936ec656ce36b1a885f8fb7d562ea3c66da534971a4760da54b770fea WatchSource:0}: Error finding container 5e7f17b936ec656ce36b1a885f8fb7d562ea3c66da534971a4760da54b770fea: Status 404 returned error can't find the container with id 5e7f17b936ec656ce36b1a885f8fb7d562ea3c66da534971a4760da54b770fea
Jul 30 13:00:42.381041 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:00:42.381016    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6f4d6fb6bc-thklp"]
Jul 30 13:00:42.383410 ip-10-0-143-153 kubenswrapper[2566]: W0730 13:00:42.383372    2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod51cdacbf_3a14_47c0_8fd4_69b0b2be0e64.slice/crio-129b8948cb04b406a606a32b29d9603d190fd25bf829ff324504738197060fcb WatchSource:0}: Error finding container 129b8948cb04b406a606a32b29d9603d190fd25bf829ff324504738197060fcb: Status 404 returned error can't find the container with id 129b8948cb04b406a606a32b29d9603d190fd25bf829ff324504738197060fcb
Jul 30 13:00:42.385639 ip-10-0-143-153 kubenswrapper[2566]: W0730 13:00:42.385570    2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc566cf8d_48ce_43ae_9427_e5e43d8f2e2f.slice/crio-a4a130831d9b7538defcbb2a4e65b5bed8126a69cfeb844cb5a50e1831cbdd9f WatchSource:0}: Error finding container a4a130831d9b7538defcbb2a4e65b5bed8126a69cfeb844cb5a50e1831cbdd9f: Status 404 returned error can't find the container with id a4a130831d9b7538defcbb2a4e65b5bed8126a69cfeb844cb5a50e1831cbdd9f
Jul 30 13:00:42.807367 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:00:42.807328    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/a9cdd07c-66cd-4d85-bc84-b2a318f1b705-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-548b489cb8-v6zgd\" (UID: \"a9cdd07c-66cd-4d85-bc84-b2a318f1b705\") " pod="openshift-monitoring/cluster-monitoring-operator-548b489cb8-v6zgd"
Jul 30 13:00:42.807641 ip-10-0-143-153 kubenswrapper[2566]: E0730 13:00:42.807469    2566 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Jul 30 13:00:42.807641 ip-10-0-143-153 kubenswrapper[2566]: E0730 13:00:42.807537    2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a9cdd07c-66cd-4d85-bc84-b2a318f1b705-cluster-monitoring-operator-tls podName:a9cdd07c-66cd-4d85-bc84-b2a318f1b705 nodeName:}" failed. No retries permitted until 2026-07-30 13:00:44.80751883 +0000 UTC m=+73.736207076 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/a9cdd07c-66cd-4d85-bc84-b2a318f1b705-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-548b489cb8-v6zgd" (UID: "a9cdd07c-66cd-4d85-bc84-b2a318f1b705") : secret "cluster-monitoring-operator-tls" not found
Jul 30 13:00:43.021906 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:00:43.021481    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-9bp7v" event={"ID":"c2428457-ecf0-45c5-b008-7a51403785c9","Type":"ContainerStarted","Data":"bc5ac8f1d1a86894500bb2ce5e38a5de5530f9bf6b85cb2d5d256d7025db4ca6"}
Jul 30 13:00:43.023141 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:00:43.023113    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-bjnvm" event={"ID":"be740ef9-ac84-4ef4-ad66-7f61253c6c28","Type":"ContainerStarted","Data":"be5d76306020ffe090a9438765f52b4ab4fea233b8429cf781b5cf3b70342a5b"}
Jul 30 13:00:43.023273 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:00:43.023221    2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-bjnvm"
Jul 30 13:00:43.024534 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:00:43.024512    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-584dcb6b54-bzl6w" event={"ID":"51cdacbf-3a14-47c0-8fd4-69b0b2be0e64","Type":"ContainerStarted","Data":"129b8948cb04b406a606a32b29d9603d190fd25bf829ff324504738197060fcb"}
Jul 30 13:00:43.025705 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:00:43.025677    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-5d6c75f84f-psdw9" event={"ID":"0a469596-ff7b-45e1-9fc7-a6f4753ff16a","Type":"ContainerStarted","Data":"0021b4a4d5041a01ff16d2902666e610a00ed9a0520cc1b805c4d5957bdaf42c"}
Jul 30 13:00:43.027320 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:00:43.027297    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-7d88cb55d8-52sx8" event={"ID":"694c86c8-35ba-4966-9c5c-251894af19b4","Type":"ContainerStarted","Data":"07b072214e9cb11afb5780fcc33a162cf9d7a2da7142da4e0ff705e008a92221"}
Jul 30 13:00:43.027416 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:00:43.027338    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-7d88cb55d8-52sx8" event={"ID":"694c86c8-35ba-4966-9c5c-251894af19b4","Type":"ContainerStarted","Data":"5e7f17b936ec656ce36b1a885f8fb7d562ea3c66da534971a4760da54b770fea"}
Jul 30 13:00:43.028590 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:00:43.028569    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6f4d6fb6bc-thklp" event={"ID":"c566cf8d-48ce-43ae-9427-e5e43d8f2e2f","Type":"ContainerStarted","Data":"a4a130831d9b7538defcbb2a4e65b5bed8126a69cfeb844cb5a50e1831cbdd9f"}
Jul 30 13:00:43.036992 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:00:43.036943    2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-9bp7v" podStartSLOduration=66.8287374 podStartE2EDuration="1m12.036926222s" totalImagesPullingTime="5.208188822s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-30 12:59:31 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 13:00:43.036215955 +0000 UTC m=+71.964904219" watchObservedRunningTime="2026-07-30 13:00:43.036926222 +0000 UTC m=+71.965614466"
Jul 30 13:00:43.051525 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:00:43.051484    2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-source-7d88cb55d8-52sx8" podStartSLOduration=2.05147125 podStartE2EDuration="2.05147125s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-30 13:00:41 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 13:00:43.050300245 +0000 UTC m=+71.978988510" watchObservedRunningTime="2026-07-30 13:00:43.05147125 +0000 UTC m=+71.980159561"
Jul 30 13:00:43.066997 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:00:43.066916    2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-bjnvm" podStartSLOduration=66.881450187 podStartE2EDuration="1m12.066897794s" totalImagesPullingTime="5.185447607s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-30 12:59:31 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 13:00:43.06552135 +0000 UTC m=+71.994209613" watchObservedRunningTime="2026-07-30 13:00:43.066897794 +0000 UTC m=+71.995586058"
Jul 30 13:00:44.824616 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:00:44.824582    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/a9cdd07c-66cd-4d85-bc84-b2a318f1b705-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-548b489cb8-v6zgd\" (UID: \"a9cdd07c-66cd-4d85-bc84-b2a318f1b705\") " pod="openshift-monitoring/cluster-monitoring-operator-548b489cb8-v6zgd"
Jul 30 13:00:44.824976 ip-10-0-143-153 kubenswrapper[2566]: E0730 13:00:44.824738    2566 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Jul 30 13:00:44.824976 ip-10-0-143-153 kubenswrapper[2566]: E0730 13:00:44.824808    2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a9cdd07c-66cd-4d85-bc84-b2a318f1b705-cluster-monitoring-operator-tls podName:a9cdd07c-66cd-4d85-bc84-b2a318f1b705 nodeName:}" failed. No retries permitted until 2026-07-30 13:00:48.824786784 +0000 UTC m=+77.753475042 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/a9cdd07c-66cd-4d85-bc84-b2a318f1b705-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-548b489cb8-v6zgd" (UID: "a9cdd07c-66cd-4d85-bc84-b2a318f1b705") : secret "cluster-monitoring-operator-tls" not found
Jul 30 13:00:45.037546 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:00:45.037035    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6f4d6fb6bc-thklp" event={"ID":"c566cf8d-48ce-43ae-9427-e5e43d8f2e2f","Type":"ContainerStarted","Data":"334025f4745269314fcef4265647b9ceaf72156b23b63de99cbe6e01a387d3a9"}
Jul 30 13:00:45.038546 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:00:45.038525    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-5d6c75f84f-psdw9" event={"ID":"0a469596-ff7b-45e1-9fc7-a6f4753ff16a","Type":"ContainerStarted","Data":"2766d8918e2607b49142c417229af7cc08dbb48313e3b1da3c42b5964e76b7a6"}
Jul 30 13:00:45.054137 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:00:45.054069    2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6f4d6fb6bc-thklp" podStartSLOduration=1.6673906459999999 podStartE2EDuration="4.054048815s" totalImagesPullingTime="2.386658169s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-30 13:00:41 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 13:00:45.053427707 +0000 UTC m=+73.982115981" watchObservedRunningTime="2026-07-30 13:00:45.054048815 +0000 UTC m=+73.982737059"
Jul 30 13:00:45.069275 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:00:45.069230    2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-service-ca-operator/service-ca-operator-5d6c75f84f-psdw9" podStartSLOduration=2.458556829 podStartE2EDuration="5.069214163s" totalImagesPullingTime="2.610657334s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-30 13:00:40 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 13:00:45.068315387 +0000 UTC m=+73.997003650" watchObservedRunningTime="2026-07-30 13:00:45.069214163 +0000 UTC m=+73.997902427"
Jul 30 13:00:45.417622 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:00:45.417589    2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-44fp6"]
Jul 30 13:00:45.420874 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:00:45.420858    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-44fp6"
Jul 30 13:00:45.423229 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:00:45.423201    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\""
Jul 30 13:00:45.423367 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:00:45.423265    2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\""
Jul 30 13:00:45.423367 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:00:45.423276    2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\""
Jul 30 13:00:45.423367 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:00:45.423289    2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\""
Jul 30 13:00:45.423367 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:00:45.423309    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-nzhhh\""
Jul 30 13:00:45.432835 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:00:45.432815    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-44fp6"]
Jul 30 13:00:45.530108 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:00:45.530054    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/4d829197-e96c-4e01-9d4c-6008b6d40c84-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-44fp6\" (UID: \"4d829197-e96c-4e01-9d4c-6008b6d40c84\") " pod="openshift-insights/insights-runtime-extractor-44fp6"
Jul 30 13:00:45.530297 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:00:45.530114    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kq7rn\" (UniqueName: \"kubernetes.io/projected/4d829197-e96c-4e01-9d4c-6008b6d40c84-kube-api-access-kq7rn\") pod \"insights-runtime-extractor-44fp6\" (UID: \"4d829197-e96c-4e01-9d4c-6008b6d40c84\") " pod="openshift-insights/insights-runtime-extractor-44fp6"
Jul 30 13:00:45.530297 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:00:45.530253    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/4d829197-e96c-4e01-9d4c-6008b6d40c84-crio-socket\") pod \"insights-runtime-extractor-44fp6\" (UID: \"4d829197-e96c-4e01-9d4c-6008b6d40c84\") " pod="openshift-insights/insights-runtime-extractor-44fp6"
Jul 30 13:00:45.530297 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:00:45.530285    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/4d829197-e96c-4e01-9d4c-6008b6d40c84-data-volume\") pod \"insights-runtime-extractor-44fp6\" (UID: \"4d829197-e96c-4e01-9d4c-6008b6d40c84\") " pod="openshift-insights/insights-runtime-extractor-44fp6"
Jul 30 13:00:45.530430 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:00:45.530312    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/4d829197-e96c-4e01-9d4c-6008b6d40c84-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-44fp6\" (UID: \"4d829197-e96c-4e01-9d4c-6008b6d40c84\") " pod="openshift-insights/insights-runtime-extractor-44fp6"
Jul 30 13:00:45.630693 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:00:45.630662    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/4d829197-e96c-4e01-9d4c-6008b6d40c84-crio-socket\") pod \"insights-runtime-extractor-44fp6\" (UID: \"4d829197-e96c-4e01-9d4c-6008b6d40c84\") " pod="openshift-insights/insights-runtime-extractor-44fp6"
Jul 30 13:00:45.630840 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:00:45.630699    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/4d829197-e96c-4e01-9d4c-6008b6d40c84-data-volume\") pod \"insights-runtime-extractor-44fp6\" (UID: \"4d829197-e96c-4e01-9d4c-6008b6d40c84\") " pod="openshift-insights/insights-runtime-extractor-44fp6"
Jul 30 13:00:45.630840 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:00:45.630717    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/4d829197-e96c-4e01-9d4c-6008b6d40c84-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-44fp6\" (UID: \"4d829197-e96c-4e01-9d4c-6008b6d40c84\") " pod="openshift-insights/insights-runtime-extractor-44fp6"
Jul 30 13:00:45.630840 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:00:45.630781    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/4d829197-e96c-4e01-9d4c-6008b6d40c84-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-44fp6\" (UID: \"4d829197-e96c-4e01-9d4c-6008b6d40c84\") " pod="openshift-insights/insights-runtime-extractor-44fp6"
Jul 30 13:00:45.630840 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:00:45.630793    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/4d829197-e96c-4e01-9d4c-6008b6d40c84-crio-socket\") pod \"insights-runtime-extractor-44fp6\" (UID: \"4d829197-e96c-4e01-9d4c-6008b6d40c84\") " pod="openshift-insights/insights-runtime-extractor-44fp6"
Jul 30 13:00:45.630840 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:00:45.630807    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kq7rn\" (UniqueName: \"kubernetes.io/projected/4d829197-e96c-4e01-9d4c-6008b6d40c84-kube-api-access-kq7rn\") pod \"insights-runtime-extractor-44fp6\" (UID: \"4d829197-e96c-4e01-9d4c-6008b6d40c84\") " pod="openshift-insights/insights-runtime-extractor-44fp6"
Jul 30 13:00:45.631231 ip-10-0-143-153 kubenswrapper[2566]: E0730 13:00:45.630895    2566 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 30 13:00:45.631231 ip-10-0-143-153 kubenswrapper[2566]: E0730 13:00:45.630986    2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/4d829197-e96c-4e01-9d4c-6008b6d40c84-kube-rbac-proxy-cm podName:4d829197-e96c-4e01-9d4c-6008b6d40c84 nodeName:}" failed. No retries permitted until 2026-07-30 13:00:46.13096017 +0000 UTC m=+75.059648427 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/4d829197-e96c-4e01-9d4c-6008b6d40c84-kube-rbac-proxy-cm") pod "insights-runtime-extractor-44fp6" (UID: "4d829197-e96c-4e01-9d4c-6008b6d40c84") : configmap "kube-rbac-proxy" not found
Jul 30 13:00:45.631231 ip-10-0-143-153 kubenswrapper[2566]: E0730 13:00:45.630901    2566 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 30 13:00:45.631231 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:00:45.631034    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/4d829197-e96c-4e01-9d4c-6008b6d40c84-data-volume\") pod \"insights-runtime-extractor-44fp6\" (UID: \"4d829197-e96c-4e01-9d4c-6008b6d40c84\") " pod="openshift-insights/insights-runtime-extractor-44fp6"
Jul 30 13:00:45.631231 ip-10-0-143-153 kubenswrapper[2566]: E0730 13:00:45.631052    2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4d829197-e96c-4e01-9d4c-6008b6d40c84-insights-runtime-extractor-tls podName:4d829197-e96c-4e01-9d4c-6008b6d40c84 nodeName:}" failed. No retries permitted until 2026-07-30 13:00:46.13103355 +0000 UTC m=+75.059721795 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/4d829197-e96c-4e01-9d4c-6008b6d40c84-insights-runtime-extractor-tls") pod "insights-runtime-extractor-44fp6" (UID: "4d829197-e96c-4e01-9d4c-6008b6d40c84") : secret "insights-runtime-extractor-tls" not found
Jul 30 13:00:45.639466 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:00:45.639437    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kq7rn\" (UniqueName: \"kubernetes.io/projected/4d829197-e96c-4e01-9d4c-6008b6d40c84-kube-api-access-kq7rn\") pod \"insights-runtime-extractor-44fp6\" (UID: \"4d829197-e96c-4e01-9d4c-6008b6d40c84\") " pod="openshift-insights/insights-runtime-extractor-44fp6"
Jul 30 13:00:46.133818 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:00:46.133781    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/4d829197-e96c-4e01-9d4c-6008b6d40c84-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-44fp6\" (UID: \"4d829197-e96c-4e01-9d4c-6008b6d40c84\") " pod="openshift-insights/insights-runtime-extractor-44fp6"
Jul 30 13:00:46.134285 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:00:46.133868    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/4d829197-e96c-4e01-9d4c-6008b6d40c84-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-44fp6\" (UID: \"4d829197-e96c-4e01-9d4c-6008b6d40c84\") " pod="openshift-insights/insights-runtime-extractor-44fp6"
Jul 30 13:00:46.134285 ip-10-0-143-153 kubenswrapper[2566]: E0730 13:00:46.133939    2566 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 30 13:00:46.134285 ip-10-0-143-153 kubenswrapper[2566]: E0730 13:00:46.133999    2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/4d829197-e96c-4e01-9d4c-6008b6d40c84-kube-rbac-proxy-cm podName:4d829197-e96c-4e01-9d4c-6008b6d40c84 nodeName:}" failed. No retries permitted until 2026-07-30 13:00:47.133981464 +0000 UTC m=+76.062669706 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/4d829197-e96c-4e01-9d4c-6008b6d40c84-kube-rbac-proxy-cm") pod "insights-runtime-extractor-44fp6" (UID: "4d829197-e96c-4e01-9d4c-6008b6d40c84") : configmap "kube-rbac-proxy" not found
Jul 30 13:00:46.134285 ip-10-0-143-153 kubenswrapper[2566]: E0730 13:00:46.134056    2566 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 30 13:00:46.134285 ip-10-0-143-153 kubenswrapper[2566]: E0730 13:00:46.134115    2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4d829197-e96c-4e01-9d4c-6008b6d40c84-insights-runtime-extractor-tls podName:4d829197-e96c-4e01-9d4c-6008b6d40c84 nodeName:}" failed. No retries permitted until 2026-07-30 13:00:47.134102277 +0000 UTC m=+76.062790526 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/4d829197-e96c-4e01-9d4c-6008b6d40c84-insights-runtime-extractor-tls") pod "insights-runtime-extractor-44fp6" (UID: "4d829197-e96c-4e01-9d4c-6008b6d40c84") : secret "insights-runtime-extractor-tls" not found
Jul 30 13:00:47.143133 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:00:47.143098    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/4d829197-e96c-4e01-9d4c-6008b6d40c84-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-44fp6\" (UID: \"4d829197-e96c-4e01-9d4c-6008b6d40c84\") " pod="openshift-insights/insights-runtime-extractor-44fp6"
Jul 30 13:00:47.143569 ip-10-0-143-153 kubenswrapper[2566]: E0730 13:00:47.143257    2566 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 30 13:00:47.143569 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:00:47.143282    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/4d829197-e96c-4e01-9d4c-6008b6d40c84-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-44fp6\" (UID: \"4d829197-e96c-4e01-9d4c-6008b6d40c84\") " pod="openshift-insights/insights-runtime-extractor-44fp6"
Jul 30 13:00:47.143569 ip-10-0-143-153 kubenswrapper[2566]: E0730 13:00:47.143324    2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4d829197-e96c-4e01-9d4c-6008b6d40c84-insights-runtime-extractor-tls podName:4d829197-e96c-4e01-9d4c-6008b6d40c84 nodeName:}" failed. No retries permitted until 2026-07-30 13:00:49.143309289 +0000 UTC m=+78.071997530 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/4d829197-e96c-4e01-9d4c-6008b6d40c84-insights-runtime-extractor-tls") pod "insights-runtime-extractor-44fp6" (UID: "4d829197-e96c-4e01-9d4c-6008b6d40c84") : secret "insights-runtime-extractor-tls" not found
Jul 30 13:00:47.143569 ip-10-0-143-153 kubenswrapper[2566]: E0730 13:00:47.143361    2566 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 30 13:00:47.143569 ip-10-0-143-153 kubenswrapper[2566]: E0730 13:00:47.143426    2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/4d829197-e96c-4e01-9d4c-6008b6d40c84-kube-rbac-proxy-cm podName:4d829197-e96c-4e01-9d4c-6008b6d40c84 nodeName:}" failed. No retries permitted until 2026-07-30 13:00:49.14340467 +0000 UTC m=+78.072092926 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/4d829197-e96c-4e01-9d4c-6008b6d40c84-kube-rbac-proxy-cm") pod "insights-runtime-extractor-44fp6" (UID: "4d829197-e96c-4e01-9d4c-6008b6d40c84") : configmap "kube-rbac-proxy" not found
Jul 30 13:00:47.181117 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:00:47.181088    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-4tzjz_95057af8-5515-4bb3-9147-613240e101bb/dns-node-resolver/0.log"
Jul 30 13:00:48.581464 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:00:48.581438    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-9lmmp_b6cb9164-228a-4fff-b909-8be034a2b11a/node-ca/0.log"
Jul 30 13:00:48.857176 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:00:48.857060    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/a9cdd07c-66cd-4d85-bc84-b2a318f1b705-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-548b489cb8-v6zgd\" (UID: \"a9cdd07c-66cd-4d85-bc84-b2a318f1b705\") " pod="openshift-monitoring/cluster-monitoring-operator-548b489cb8-v6zgd"
Jul 30 13:00:48.857339 ip-10-0-143-153 kubenswrapper[2566]: E0730 13:00:48.857219    2566 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Jul 30 13:00:48.857339 ip-10-0-143-153 kubenswrapper[2566]: E0730 13:00:48.857290    2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a9cdd07c-66cd-4d85-bc84-b2a318f1b705-cluster-monitoring-operator-tls podName:a9cdd07c-66cd-4d85-bc84-b2a318f1b705 nodeName:}" failed. No retries permitted until 2026-07-30 13:00:56.857273996 +0000 UTC m=+85.785962236 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/a9cdd07c-66cd-4d85-bc84-b2a318f1b705-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-548b489cb8-v6zgd" (UID: "a9cdd07c-66cd-4d85-bc84-b2a318f1b705") : secret "cluster-monitoring-operator-tls" not found
Jul 30 13:00:49.054807 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:00:49.054778    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-bzl6w_51cdacbf-3a14-47c0-8fd4-69b0b2be0e64/console-operator/0.log"
Jul 30 13:00:49.054980 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:00:49.054818    2566 generic.go:356] "Generic (PLEG): container finished" podID="51cdacbf-3a14-47c0-8fd4-69b0b2be0e64" containerID="a914823810f38367d4e5f519642bdf709b7de6a64c7b836634506ea45f134cbd" exitCode=255
Jul 30 13:00:49.054980 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:00:49.054879    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-584dcb6b54-bzl6w" event={"ID":"51cdacbf-3a14-47c0-8fd4-69b0b2be0e64","Type":"ContainerDied","Data":"a914823810f38367d4e5f519642bdf709b7de6a64c7b836634506ea45f134cbd"}
Jul 30 13:00:49.055117 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:00:49.055102    2566 scope.go:117] "RemoveContainer" containerID="a914823810f38367d4e5f519642bdf709b7de6a64c7b836634506ea45f134cbd"
Jul 30 13:00:49.159067 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:00:49.159036    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/4d829197-e96c-4e01-9d4c-6008b6d40c84-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-44fp6\" (UID: \"4d829197-e96c-4e01-9d4c-6008b6d40c84\") " pod="openshift-insights/insights-runtime-extractor-44fp6"
Jul 30 13:00:49.159266 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:00:49.159158    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/4d829197-e96c-4e01-9d4c-6008b6d40c84-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-44fp6\" (UID: \"4d829197-e96c-4e01-9d4c-6008b6d40c84\") " pod="openshift-insights/insights-runtime-extractor-44fp6"
Jul 30 13:00:49.159266 ip-10-0-143-153 kubenswrapper[2566]: E0730 13:00:49.159260    2566 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 30 13:00:49.159371 ip-10-0-143-153 kubenswrapper[2566]: E0730 13:00:49.159319    2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4d829197-e96c-4e01-9d4c-6008b6d40c84-insights-runtime-extractor-tls podName:4d829197-e96c-4e01-9d4c-6008b6d40c84 nodeName:}" failed. No retries permitted until 2026-07-30 13:00:53.159302275 +0000 UTC m=+82.087990533 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/4d829197-e96c-4e01-9d4c-6008b6d40c84-insights-runtime-extractor-tls") pod "insights-runtime-extractor-44fp6" (UID: "4d829197-e96c-4e01-9d4c-6008b6d40c84") : secret "insights-runtime-extractor-tls" not found
Jul 30 13:00:49.159371 ip-10-0-143-153 kubenswrapper[2566]: E0730 13:00:49.159334    2566 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 30 13:00:49.159516 ip-10-0-143-153 kubenswrapper[2566]: E0730 13:00:49.159403    2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/4d829197-e96c-4e01-9d4c-6008b6d40c84-kube-rbac-proxy-cm podName:4d829197-e96c-4e01-9d4c-6008b6d40c84 nodeName:}" failed. No retries permitted until 2026-07-30 13:00:53.159383183 +0000 UTC m=+82.088071438 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/4d829197-e96c-4e01-9d4c-6008b6d40c84-kube-rbac-proxy-cm") pod "insights-runtime-extractor-44fp6" (UID: "4d829197-e96c-4e01-9d4c-6008b6d40c84") : configmap "kube-rbac-proxy" not found
Jul 30 13:00:49.161291 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:00:49.161270    2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-service-ca/service-ca-658d7b7c78-s2c6r"]
Jul 30 13:00:49.164125 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:00:49.164105    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-658d7b7c78-s2c6r"
Jul 30 13:00:49.166101 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:00:49.165896    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"signing-key\""
Jul 30 13:00:49.166101 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:00:49.165948    2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"openshift-service-ca.crt\""
Jul 30 13:00:49.166101 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:00:49.165956    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"service-ca-dockercfg-fmvl9\""
Jul 30 13:00:49.166101 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:00:49.165948    2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"kube-root-ca.crt\""
Jul 30 13:00:49.166325 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:00:49.166117    2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"signing-cabundle\""
Jul 30 13:00:49.171609 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:00:49.171589    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-658d7b7c78-s2c6r"]
Jul 30 13:00:49.181871 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:00:49.181853    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-mlzcq_44aa0a10-5c3a-4b62-bb19-92c5b8223440/serve-healthcheck-canary/0.log"
Jul 30 13:00:49.260246 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:00:49.260215    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/815edb15-80b2-4b05-840c-aa7cf86182dd-signing-key\") pod \"service-ca-658d7b7c78-s2c6r\" (UID: \"815edb15-80b2-4b05-840c-aa7cf86182dd\") " pod="openshift-service-ca/service-ca-658d7b7c78-s2c6r"
Jul 30 13:00:49.260418 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:00:49.260325    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7gvvq\" (UniqueName: \"kubernetes.io/projected/815edb15-80b2-4b05-840c-aa7cf86182dd-kube-api-access-7gvvq\") pod \"service-ca-658d7b7c78-s2c6r\" (UID: \"815edb15-80b2-4b05-840c-aa7cf86182dd\") " pod="openshift-service-ca/service-ca-658d7b7c78-s2c6r"
Jul 30 13:00:49.260418 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:00:49.260391    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/815edb15-80b2-4b05-840c-aa7cf86182dd-signing-cabundle\") pod \"service-ca-658d7b7c78-s2c6r\" (UID: \"815edb15-80b2-4b05-840c-aa7cf86182dd\") " pod="openshift-service-ca/service-ca-658d7b7c78-s2c6r"
Jul 30 13:00:49.361380 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:00:49.361271    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/815edb15-80b2-4b05-840c-aa7cf86182dd-signing-cabundle\") pod \"service-ca-658d7b7c78-s2c6r\" (UID: \"815edb15-80b2-4b05-840c-aa7cf86182dd\") " pod="openshift-service-ca/service-ca-658d7b7c78-s2c6r"
Jul 30 13:00:49.361380 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:00:49.361338    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/815edb15-80b2-4b05-840c-aa7cf86182dd-signing-key\") pod \"service-ca-658d7b7c78-s2c6r\" (UID: \"815edb15-80b2-4b05-840c-aa7cf86182dd\") " pod="openshift-service-ca/service-ca-658d7b7c78-s2c6r"
Jul 30 13:00:49.361617 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:00:49.361429    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7gvvq\" (UniqueName: \"kubernetes.io/projected/815edb15-80b2-4b05-840c-aa7cf86182dd-kube-api-access-7gvvq\") pod \"service-ca-658d7b7c78-s2c6r\" (UID: \"815edb15-80b2-4b05-840c-aa7cf86182dd\") " pod="openshift-service-ca/service-ca-658d7b7c78-s2c6r"
Jul 30 13:00:49.361973 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:00:49.361953    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/815edb15-80b2-4b05-840c-aa7cf86182dd-signing-cabundle\") pod \"service-ca-658d7b7c78-s2c6r\" (UID: \"815edb15-80b2-4b05-840c-aa7cf86182dd\") " pod="openshift-service-ca/service-ca-658d7b7c78-s2c6r"
Jul 30 13:00:49.363606 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:00:49.363588    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/815edb15-80b2-4b05-840c-aa7cf86182dd-signing-key\") pod \"service-ca-658d7b7c78-s2c6r\" (UID: \"815edb15-80b2-4b05-840c-aa7cf86182dd\") " pod="openshift-service-ca/service-ca-658d7b7c78-s2c6r"
Jul 30 13:00:49.369496 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:00:49.369476    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7gvvq\" (UniqueName: \"kubernetes.io/projected/815edb15-80b2-4b05-840c-aa7cf86182dd-kube-api-access-7gvvq\") pod \"service-ca-658d7b7c78-s2c6r\" (UID: \"815edb15-80b2-4b05-840c-aa7cf86182dd\") " pod="openshift-service-ca/service-ca-658d7b7c78-s2c6r"
Jul 30 13:00:49.515952 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:00:49.515920    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-658d7b7c78-s2c6r"
Jul 30 13:00:49.643208 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:00:49.643180    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-658d7b7c78-s2c6r"]
Jul 30 13:00:49.646294 ip-10-0-143-153 kubenswrapper[2566]: W0730 13:00:49.646269    2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod815edb15_80b2_4b05_840c_aa7cf86182dd.slice/crio-d278b0739794c8583f163db984962915b5afbdda3edf3727ddf47e92c471b578 WatchSource:0}: Error finding container d278b0739794c8583f163db984962915b5afbdda3edf3727ddf47e92c471b578: Status 404 returned error can't find the container with id d278b0739794c8583f163db984962915b5afbdda3edf3727ddf47e92c471b578
Jul 30 13:00:50.059893 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:00:50.059804    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-658d7b7c78-s2c6r" event={"ID":"815edb15-80b2-4b05-840c-aa7cf86182dd","Type":"ContainerStarted","Data":"0613fe650500161b1b48d881943db1485dd67cdadd7210e7a165636e3e43bdc8"}
Jul 30 13:00:50.059893 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:00:50.059853    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-658d7b7c78-s2c6r" event={"ID":"815edb15-80b2-4b05-840c-aa7cf86182dd","Type":"ContainerStarted","Data":"d278b0739794c8583f163db984962915b5afbdda3edf3727ddf47e92c471b578"}
Jul 30 13:00:50.061427 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:00:50.061405    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-bzl6w_51cdacbf-3a14-47c0-8fd4-69b0b2be0e64/console-operator/1.log"
Jul 30 13:00:50.061816 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:00:50.061802    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-bzl6w_51cdacbf-3a14-47c0-8fd4-69b0b2be0e64/console-operator/0.log"
Jul 30 13:00:50.061888 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:00:50.061837    2566 generic.go:356] "Generic (PLEG): container finished" podID="51cdacbf-3a14-47c0-8fd4-69b0b2be0e64" containerID="237a6d4b693a698bf5623d6ec17ebf4dfbcc3d3faccd9079c75adcb136cd79d9" exitCode=255
Jul 30 13:00:50.061888 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:00:50.061864    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-584dcb6b54-bzl6w" event={"ID":"51cdacbf-3a14-47c0-8fd4-69b0b2be0e64","Type":"ContainerDied","Data":"237a6d4b693a698bf5623d6ec17ebf4dfbcc3d3faccd9079c75adcb136cd79d9"}
Jul 30 13:00:50.061996 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:00:50.061919    2566 scope.go:117] "RemoveContainer" containerID="a914823810f38367d4e5f519642bdf709b7de6a64c7b836634506ea45f134cbd"
Jul 30 13:00:50.062162 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:00:50.062144    2566 scope.go:117] "RemoveContainer" containerID="237a6d4b693a698bf5623d6ec17ebf4dfbcc3d3faccd9079c75adcb136cd79d9"
Jul 30 13:00:50.062329 ip-10-0-143-153 kubenswrapper[2566]: E0730 13:00:50.062313    2566 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-584dcb6b54-bzl6w_openshift-console-operator(51cdacbf-3a14-47c0-8fd4-69b0b2be0e64)\"" pod="openshift-console-operator/console-operator-584dcb6b54-bzl6w" podUID="51cdacbf-3a14-47c0-8fd4-69b0b2be0e64"
Jul 30 13:00:50.076679 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:00:50.076635    2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-service-ca/service-ca-658d7b7c78-s2c6r" podStartSLOduration=1.076620117 podStartE2EDuration="1.076620117s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-30 13:00:49 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 13:00:50.076048319 +0000 UTC m=+79.004736602" watchObservedRunningTime="2026-07-30 13:00:50.076620117 +0000 UTC m=+79.005308380"
Jul 30 13:00:51.068219 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:00:51.068187    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-bzl6w_51cdacbf-3a14-47c0-8fd4-69b0b2be0e64/console-operator/1.log"
Jul 30 13:00:51.068960 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:00:51.068938    2566 scope.go:117] "RemoveContainer" containerID="237a6d4b693a698bf5623d6ec17ebf4dfbcc3d3faccd9079c75adcb136cd79d9"
Jul 30 13:00:51.069130 ip-10-0-143-153 kubenswrapper[2566]: E0730 13:00:51.069106    2566 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-584dcb6b54-bzl6w_openshift-console-operator(51cdacbf-3a14-47c0-8fd4-69b0b2be0e64)\"" pod="openshift-console-operator/console-operator-584dcb6b54-bzl6w" podUID="51cdacbf-3a14-47c0-8fd4-69b0b2be0e64"
Jul 30 13:00:51.334474 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:00:51.334373    2566 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="openshift-console-operator/console-operator-584dcb6b54-bzl6w"
Jul 30 13:00:51.334474 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:00:51.334466    2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-584dcb6b54-bzl6w"
Jul 30 13:00:52.072164 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:00:52.072138    2566 scope.go:117] "RemoveContainer" containerID="237a6d4b693a698bf5623d6ec17ebf4dfbcc3d3faccd9079c75adcb136cd79d9"
Jul 30 13:00:52.072554 ip-10-0-143-153 kubenswrapper[2566]: E0730 13:00:52.072282    2566 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-584dcb6b54-bzl6w_openshift-console-operator(51cdacbf-3a14-47c0-8fd4-69b0b2be0e64)\"" pod="openshift-console-operator/console-operator-584dcb6b54-bzl6w" podUID="51cdacbf-3a14-47c0-8fd4-69b0b2be0e64"
Jul 30 13:00:53.194370 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:00:53.194331    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/4d829197-e96c-4e01-9d4c-6008b6d40c84-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-44fp6\" (UID: \"4d829197-e96c-4e01-9d4c-6008b6d40c84\") " pod="openshift-insights/insights-runtime-extractor-44fp6"
Jul 30 13:00:53.194745 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:00:53.194386    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/4d829197-e96c-4e01-9d4c-6008b6d40c84-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-44fp6\" (UID: \"4d829197-e96c-4e01-9d4c-6008b6d40c84\") " pod="openshift-insights/insights-runtime-extractor-44fp6"
Jul 30 13:00:53.194745 ip-10-0-143-153 kubenswrapper[2566]: E0730 13:00:53.194490    2566 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 30 13:00:53.194745 ip-10-0-143-153 kubenswrapper[2566]: E0730 13:00:53.194523    2566 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 30 13:00:53.194745 ip-10-0-143-153 kubenswrapper[2566]: E0730 13:00:53.194558    2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4d829197-e96c-4e01-9d4c-6008b6d40c84-insights-runtime-extractor-tls podName:4d829197-e96c-4e01-9d4c-6008b6d40c84 nodeName:}" failed. No retries permitted until 2026-07-30 13:01:01.194542671 +0000 UTC m=+90.123230912 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/4d829197-e96c-4e01-9d4c-6008b6d40c84-insights-runtime-extractor-tls") pod "insights-runtime-extractor-44fp6" (UID: "4d829197-e96c-4e01-9d4c-6008b6d40c84") : secret "insights-runtime-extractor-tls" not found
Jul 30 13:00:53.194745 ip-10-0-143-153 kubenswrapper[2566]: E0730 13:00:53.194579    2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/4d829197-e96c-4e01-9d4c-6008b6d40c84-kube-rbac-proxy-cm podName:4d829197-e96c-4e01-9d4c-6008b6d40c84 nodeName:}" failed. No retries permitted until 2026-07-30 13:01:01.194565602 +0000 UTC m=+90.123253842 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/4d829197-e96c-4e01-9d4c-6008b6d40c84-kube-rbac-proxy-cm") pod "insights-runtime-extractor-44fp6" (UID: "4d829197-e96c-4e01-9d4c-6008b6d40c84") : configmap "kube-rbac-proxy" not found
Jul 30 13:00:56.926893 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:00:56.926778    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/a9cdd07c-66cd-4d85-bc84-b2a318f1b705-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-548b489cb8-v6zgd\" (UID: \"a9cdd07c-66cd-4d85-bc84-b2a318f1b705\") " pod="openshift-monitoring/cluster-monitoring-operator-548b489cb8-v6zgd"
Jul 30 13:00:56.927262 ip-10-0-143-153 kubenswrapper[2566]: E0730 13:00:56.926897    2566 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Jul 30 13:00:56.927262 ip-10-0-143-153 kubenswrapper[2566]: E0730 13:00:56.926970    2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a9cdd07c-66cd-4d85-bc84-b2a318f1b705-cluster-monitoring-operator-tls podName:a9cdd07c-66cd-4d85-bc84-b2a318f1b705 nodeName:}" failed. No retries permitted until 2026-07-30 13:01:12.926952347 +0000 UTC m=+101.855640595 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/a9cdd07c-66cd-4d85-bc84-b2a318f1b705-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-548b489cb8-v6zgd" (UID: "a9cdd07c-66cd-4d85-bc84-b2a318f1b705") : secret "cluster-monitoring-operator-tls" not found
Jul 30 13:01:01.264518 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:01:01.264481    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/4d829197-e96c-4e01-9d4c-6008b6d40c84-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-44fp6\" (UID: \"4d829197-e96c-4e01-9d4c-6008b6d40c84\") " pod="openshift-insights/insights-runtime-extractor-44fp6"
Jul 30 13:01:01.264518 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:01:01.264524    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/4d829197-e96c-4e01-9d4c-6008b6d40c84-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-44fp6\" (UID: \"4d829197-e96c-4e01-9d4c-6008b6d40c84\") " pod="openshift-insights/insights-runtime-extractor-44fp6"
Jul 30 13:01:01.265106 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:01:01.265061    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/4d829197-e96c-4e01-9d4c-6008b6d40c84-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-44fp6\" (UID: \"4d829197-e96c-4e01-9d4c-6008b6d40c84\") " pod="openshift-insights/insights-runtime-extractor-44fp6"
Jul 30 13:01:01.266882 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:01:01.266857    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/4d829197-e96c-4e01-9d4c-6008b6d40c84-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-44fp6\" (UID: \"4d829197-e96c-4e01-9d4c-6008b6d40c84\") " pod="openshift-insights/insights-runtime-extractor-44fp6"
Jul 30 13:01:01.331105 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:01:01.331032    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-44fp6"
Jul 30 13:01:01.463783 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:01:01.463746    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-44fp6"]
Jul 30 13:01:01.467193 ip-10-0-143-153 kubenswrapper[2566]: W0730 13:01:01.467164    2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4d829197_e96c_4e01_9d4c_6008b6d40c84.slice/crio-28c32076e3fc7cf072c0d3a4969c6a139469d6d20a7507f65f92dfbe6fb3b5d8 WatchSource:0}: Error finding container 28c32076e3fc7cf072c0d3a4969c6a139469d6d20a7507f65f92dfbe6fb3b5d8: Status 404 returned error can't find the container with id 28c32076e3fc7cf072c0d3a4969c6a139469d6d20a7507f65f92dfbe6fb3b5d8
Jul 30 13:01:02.109968 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:01:02.109930    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-44fp6" event={"ID":"4d829197-e96c-4e01-9d4c-6008b6d40c84","Type":"ContainerStarted","Data":"28c32076e3fc7cf072c0d3a4969c6a139469d6d20a7507f65f92dfbe6fb3b5d8"}
Jul 30 13:01:05.622243 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:01:05.622209    2566 scope.go:117] "RemoveContainer" containerID="237a6d4b693a698bf5623d6ec17ebf4dfbcc3d3faccd9079c75adcb136cd79d9"
Jul 30 13:01:07.128837 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:01:07.128809    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-bzl6w_51cdacbf-3a14-47c0-8fd4-69b0b2be0e64/console-operator/1.log"
Jul 30 13:01:07.129290 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:01:07.128891    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-584dcb6b54-bzl6w" event={"ID":"51cdacbf-3a14-47c0-8fd4-69b0b2be0e64","Type":"ContainerStarted","Data":"78ba93715356a956719e0138f3b07a20fa22b75bcd3c30279174a1c37cdf7866"}
Jul 30 13:01:07.129354 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:01:07.129330    2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-584dcb6b54-bzl6w"
Jul 30 13:01:07.130540 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:01:07.130509    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-44fp6" event={"ID":"4d829197-e96c-4e01-9d4c-6008b6d40c84","Type":"ContainerStarted","Data":"e734e21d43889569b4bb53857bab29fdf6276f515b4d0cede91a2a1b651e33b0"}
Jul 30 13:01:07.146411 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:01:07.146358    2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console-operator/console-operator-584dcb6b54-bzl6w" podStartSLOduration=21.447436956 podStartE2EDuration="27.146343266s" totalImagesPullingTime="5.69890631s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-30 13:00:40 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 13:01:07.145400051 +0000 UTC m=+96.074088315" watchObservedRunningTime="2026-07-30 13:01:07.146343266 +0000 UTC m=+96.075031529"
Jul 30 13:01:07.173388 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:01:07.173358    2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console-operator/console-operator-584dcb6b54-bzl6w"
Jul 30 13:01:10.339315 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:01:10.339244    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/1a31bbf5-b584-424a-8866-8789661dc09a-metrics-tls\") pod \"dns-default-f9822\" (UID: \"1a31bbf5-b584-424a-8866-8789661dc09a\") " pod="openshift-dns/dns-default-f9822"
Jul 30 13:01:10.341424 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:01:10.341401    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/1a31bbf5-b584-424a-8866-8789661dc09a-metrics-tls\") pod \"dns-default-f9822\" (UID: \"1a31bbf5-b584-424a-8866-8789661dc09a\") " pod="openshift-dns/dns-default-f9822"
Jul 30 13:01:10.636829 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:01:10.636803    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-lv78x\""
Jul 30 13:01:10.645749 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:01:10.645540    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-f9822"
Jul 30 13:01:10.949517 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:01:10.949444    2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-7965cd4d49-6w24f"]
Jul 30 13:01:10.953116 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:01:10.953067    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7965cd4d49-6w24f"
Jul 30 13:01:10.953266 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:01:10.953137    2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-77c9c5bb54-cz4zd"]
Jul 30 13:01:10.955612 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:01:10.955587    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"open-cluster-management-image-pull-credentials\""
Jul 30 13:01:10.955730 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:01:10.955652    2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"kube-root-ca.crt\""
Jul 30 13:01:10.955921 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:01:10.955904    2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"openshift-service-ca.crt\""
Jul 30 13:01:10.955973 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:01:10.955906    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"work-manager-hub-kubeconfig\""
Jul 30 13:01:10.956304 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:01:10.956286    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-77c9c5bb54-cz4zd"
Jul 30 13:01:10.958317 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:01:10.958257    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-service-proxy-server-certificates\""
Jul 30 13:01:10.958317 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:01:10.958295    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-ca\""
Jul 30 13:01:10.958476 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:01:10.958352    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-open-cluster-management.io-proxy-agent-signer-client-cert\""
Jul 30 13:01:10.958476 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:01:10.958294    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-hub-kubeconfig\""
Jul 30 13:01:10.969771 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:01:10.969728    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-7965cd4d49-6w24f"]
Jul 30 13:01:10.972189 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:01:10.972157    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-77c9c5bb54-cz4zd"]
Jul 30 13:01:11.043707 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:01:11.043674    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-w9vrx\" (UniqueName: \"kubernetes.io/projected/767d7777-cf05-4efd-9e57-adea4e69118e-kube-api-access-w9vrx\") pod \"cluster-proxy-proxy-agent-77c9c5bb54-cz4zd\" (UID: \"767d7777-cf05-4efd-9e57-adea4e69118e\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-77c9c5bb54-cz4zd"
Jul 30 13:01:11.043843 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:01:11.043722    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/767d7777-cf05-4efd-9e57-adea4e69118e-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-77c9c5bb54-cz4zd\" (UID: \"767d7777-cf05-4efd-9e57-adea4e69118e\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-77c9c5bb54-cz4zd"
Jul 30 13:01:11.043843 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:01:11.043776    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/8155317c-b7df-4116-838a-66f1c23cfecd-klusterlet-config\") pod \"klusterlet-addon-workmgr-7965cd4d49-6w24f\" (UID: \"8155317c-b7df-4116-838a-66f1c23cfecd\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7965cd4d49-6w24f"
Jul 30 13:01:11.043843 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:01:11.043803    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/8155317c-b7df-4116-838a-66f1c23cfecd-tmp\") pod \"klusterlet-addon-workmgr-7965cd4d49-6w24f\" (UID: \"8155317c-b7df-4116-838a-66f1c23cfecd\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7965cd4d49-6w24f"
Jul 30 13:01:11.043843 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:01:11.043822    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub\" (UniqueName: \"kubernetes.io/secret/767d7777-cf05-4efd-9e57-adea4e69118e-hub\") pod \"cluster-proxy-proxy-agent-77c9c5bb54-cz4zd\" (UID: \"767d7777-cf05-4efd-9e57-adea4e69118e\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-77c9c5bb54-cz4zd"
Jul 30 13:01:11.043843 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:01:11.043836    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/767d7777-cf05-4efd-9e57-adea4e69118e-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-77c9c5bb54-cz4zd\" (UID: \"767d7777-cf05-4efd-9e57-adea4e69118e\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-77c9c5bb54-cz4zd"
Jul 30 13:01:11.044227 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:01:11.043939    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca\" (UniqueName: \"kubernetes.io/secret/767d7777-cf05-4efd-9e57-adea4e69118e-ca\") pod \"cluster-proxy-proxy-agent-77c9c5bb54-cz4zd\" (UID: \"767d7777-cf05-4efd-9e57-adea4e69118e\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-77c9c5bb54-cz4zd"
Jul 30 13:01:11.044227 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:01:11.043974    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-967zp\" (UniqueName: \"kubernetes.io/projected/8155317c-b7df-4116-838a-66f1c23cfecd-kube-api-access-967zp\") pod \"klusterlet-addon-workmgr-7965cd4d49-6w24f\" (UID: \"8155317c-b7df-4116-838a-66f1c23cfecd\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7965cd4d49-6w24f"
Jul 30 13:01:11.044227 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:01:11.044012    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/767d7777-cf05-4efd-9e57-adea4e69118e-additional-service-ca\") pod \"cluster-proxy-proxy-agent-77c9c5bb54-cz4zd\" (UID: \"767d7777-cf05-4efd-9e57-adea4e69118e\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-77c9c5bb54-cz4zd"
Jul 30 13:01:11.113418 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:01:11.113391    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-f9822"]
Jul 30 13:01:11.117424 ip-10-0-143-153 kubenswrapper[2566]: W0730 13:01:11.117397    2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1a31bbf5_b584_424a_8866_8789661dc09a.slice/crio-b3cc66882ed1885ac8cee9fc14e1eec8d399f5ab926d503d76d79009b77005f8 WatchSource:0}: Error finding container b3cc66882ed1885ac8cee9fc14e1eec8d399f5ab926d503d76d79009b77005f8: Status 404 returned error can't find the container with id b3cc66882ed1885ac8cee9fc14e1eec8d399f5ab926d503d76d79009b77005f8
Jul 30 13:01:11.144366 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:01:11.144339    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-w9vrx\" (UniqueName: \"kubernetes.io/projected/767d7777-cf05-4efd-9e57-adea4e69118e-kube-api-access-w9vrx\") pod \"cluster-proxy-proxy-agent-77c9c5bb54-cz4zd\" (UID: \"767d7777-cf05-4efd-9e57-adea4e69118e\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-77c9c5bb54-cz4zd"
Jul 30 13:01:11.144366 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:01:11.144376    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/767d7777-cf05-4efd-9e57-adea4e69118e-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-77c9c5bb54-cz4zd\" (UID: \"767d7777-cf05-4efd-9e57-adea4e69118e\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-77c9c5bb54-cz4zd"
Jul 30 13:01:11.144615 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:01:11.144422    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/8155317c-b7df-4116-838a-66f1c23cfecd-klusterlet-config\") pod \"klusterlet-addon-workmgr-7965cd4d49-6w24f\" (UID: \"8155317c-b7df-4116-838a-66f1c23cfecd\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7965cd4d49-6w24f"
Jul 30 13:01:11.144615 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:01:11.144445    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/8155317c-b7df-4116-838a-66f1c23cfecd-tmp\") pod \"klusterlet-addon-workmgr-7965cd4d49-6w24f\" (UID: \"8155317c-b7df-4116-838a-66f1c23cfecd\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7965cd4d49-6w24f"
Jul 30 13:01:11.144615 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:01:11.144469    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub\" (UniqueName: \"kubernetes.io/secret/767d7777-cf05-4efd-9e57-adea4e69118e-hub\") pod \"cluster-proxy-proxy-agent-77c9c5bb54-cz4zd\" (UID: \"767d7777-cf05-4efd-9e57-adea4e69118e\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-77c9c5bb54-cz4zd"
Jul 30 13:01:11.144615 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:01:11.144494    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/767d7777-cf05-4efd-9e57-adea4e69118e-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-77c9c5bb54-cz4zd\" (UID: \"767d7777-cf05-4efd-9e57-adea4e69118e\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-77c9c5bb54-cz4zd"
Jul 30 13:01:11.144615 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:01:11.144549    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca\" (UniqueName: \"kubernetes.io/secret/767d7777-cf05-4efd-9e57-adea4e69118e-ca\") pod \"cluster-proxy-proxy-agent-77c9c5bb54-cz4zd\" (UID: \"767d7777-cf05-4efd-9e57-adea4e69118e\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-77c9c5bb54-cz4zd"
Jul 30 13:01:11.145095 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:01:11.144845    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-967zp\" (UniqueName: \"kubernetes.io/projected/8155317c-b7df-4116-838a-66f1c23cfecd-kube-api-access-967zp\") pod \"klusterlet-addon-workmgr-7965cd4d49-6w24f\" (UID: \"8155317c-b7df-4116-838a-66f1c23cfecd\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7965cd4d49-6w24f"
Jul 30 13:01:11.145095 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:01:11.145072    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/767d7777-cf05-4efd-9e57-adea4e69118e-additional-service-ca\") pod \"cluster-proxy-proxy-agent-77c9c5bb54-cz4zd\" (UID: \"767d7777-cf05-4efd-9e57-adea4e69118e\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-77c9c5bb54-cz4zd"
Jul 30 13:01:11.145506 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:01:11.144937    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/8155317c-b7df-4116-838a-66f1c23cfecd-tmp\") pod \"klusterlet-addon-workmgr-7965cd4d49-6w24f\" (UID: \"8155317c-b7df-4116-838a-66f1c23cfecd\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7965cd4d49-6w24f"
Jul 30 13:01:11.146055 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:01:11.146023    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-44fp6" event={"ID":"4d829197-e96c-4e01-9d4c-6008b6d40c84","Type":"ContainerStarted","Data":"02f142641489e5d5c121b14ec2c034f453abb8d1a0ce2452928e16ffd7fcda1a"}
Jul 30 13:01:11.146179 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:01:11.146045    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/767d7777-cf05-4efd-9e57-adea4e69118e-additional-service-ca\") pod \"cluster-proxy-proxy-agent-77c9c5bb54-cz4zd\" (UID: \"767d7777-cf05-4efd-9e57-adea4e69118e\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-77c9c5bb54-cz4zd"
Jul 30 13:01:11.147471 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:01:11.147436    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-f9822" event={"ID":"1a31bbf5-b584-424a-8866-8789661dc09a","Type":"ContainerStarted","Data":"b3cc66882ed1885ac8cee9fc14e1eec8d399f5ab926d503d76d79009b77005f8"}
Jul 30 13:01:11.147657 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:01:11.147636    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/767d7777-cf05-4efd-9e57-adea4e69118e-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-77c9c5bb54-cz4zd\" (UID: \"767d7777-cf05-4efd-9e57-adea4e69118e\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-77c9c5bb54-cz4zd"
Jul 30 13:01:11.147920 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:01:11.147659    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca\" (UniqueName: \"kubernetes.io/secret/767d7777-cf05-4efd-9e57-adea4e69118e-ca\") pod \"cluster-proxy-proxy-agent-77c9c5bb54-cz4zd\" (UID: \"767d7777-cf05-4efd-9e57-adea4e69118e\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-77c9c5bb54-cz4zd"
Jul 30 13:01:11.147999 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:01:11.147769    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/767d7777-cf05-4efd-9e57-adea4e69118e-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-77c9c5bb54-cz4zd\" (UID: \"767d7777-cf05-4efd-9e57-adea4e69118e\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-77c9c5bb54-cz4zd"
Jul 30 13:01:11.148049 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:01:11.147983    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/8155317c-b7df-4116-838a-66f1c23cfecd-klusterlet-config\") pod \"klusterlet-addon-workmgr-7965cd4d49-6w24f\" (UID: \"8155317c-b7df-4116-838a-66f1c23cfecd\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7965cd4d49-6w24f"
Jul 30 13:01:11.148185 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:01:11.148164    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hub\" (UniqueName: \"kubernetes.io/secret/767d7777-cf05-4efd-9e57-adea4e69118e-hub\") pod \"cluster-proxy-proxy-agent-77c9c5bb54-cz4zd\" (UID: \"767d7777-cf05-4efd-9e57-adea4e69118e\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-77c9c5bb54-cz4zd"
Jul 30 13:01:11.154021 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:01:11.154002    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-967zp\" (UniqueName: \"kubernetes.io/projected/8155317c-b7df-4116-838a-66f1c23cfecd-kube-api-access-967zp\") pod \"klusterlet-addon-workmgr-7965cd4d49-6w24f\" (UID: \"8155317c-b7df-4116-838a-66f1c23cfecd\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7965cd4d49-6w24f"
Jul 30 13:01:11.154119 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:01:11.154093    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-w9vrx\" (UniqueName: \"kubernetes.io/projected/767d7777-cf05-4efd-9e57-adea4e69118e-kube-api-access-w9vrx\") pod \"cluster-proxy-proxy-agent-77c9c5bb54-cz4zd\" (UID: \"767d7777-cf05-4efd-9e57-adea4e69118e\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-77c9c5bb54-cz4zd"
Jul 30 13:01:11.266229 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:01:11.266155    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7965cd4d49-6w24f"
Jul 30 13:01:11.278452 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:01:11.278431    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-77c9c5bb54-cz4zd"
Jul 30 13:01:11.407134 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:01:11.407103    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-7965cd4d49-6w24f"]
Jul 30 13:01:11.411138 ip-10-0-143-153 kubenswrapper[2566]: W0730 13:01:11.411109    2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8155317c_b7df_4116_838a_66f1c23cfecd.slice/crio-e63f511b6606debab5b0b1ed9ffde12977fa14ddd47bedf2f234cd13f7b9ec2b WatchSource:0}: Error finding container e63f511b6606debab5b0b1ed9ffde12977fa14ddd47bedf2f234cd13f7b9ec2b: Status 404 returned error can't find the container with id e63f511b6606debab5b0b1ed9ffde12977fa14ddd47bedf2f234cd13f7b9ec2b
Jul 30 13:01:11.430216 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:01:11.430184    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-77c9c5bb54-cz4zd"]
Jul 30 13:01:11.433316 ip-10-0-143-153 kubenswrapper[2566]: W0730 13:01:11.433293    2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod767d7777_cf05_4efd_9e57_adea4e69118e.slice/crio-7c5a5534f05589e928d24f6de5cf1127deba704f500136499c94e8422d0a4e47 WatchSource:0}: Error finding container 7c5a5534f05589e928d24f6de5cf1127deba704f500136499c94e8422d0a4e47: Status 404 returned error can't find the container with id 7c5a5534f05589e928d24f6de5cf1127deba704f500136499c94e8422d0a4e47
Jul 30 13:01:12.155526 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:01:12.155468    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-77c9c5bb54-cz4zd" event={"ID":"767d7777-cf05-4efd-9e57-adea4e69118e","Type":"ContainerStarted","Data":"7c5a5534f05589e928d24f6de5cf1127deba704f500136499c94e8422d0a4e47"}
Jul 30 13:01:12.157588 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:01:12.157561    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7965cd4d49-6w24f" event={"ID":"8155317c-b7df-4116-838a-66f1c23cfecd","Type":"ContainerStarted","Data":"e63f511b6606debab5b0b1ed9ffde12977fa14ddd47bedf2f234cd13f7b9ec2b"}
Jul 30 13:01:12.962641 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:01:12.962089    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/a9cdd07c-66cd-4d85-bc84-b2a318f1b705-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-548b489cb8-v6zgd\" (UID: \"a9cdd07c-66cd-4d85-bc84-b2a318f1b705\") " pod="openshift-monitoring/cluster-monitoring-operator-548b489cb8-v6zgd"
Jul 30 13:01:12.979424 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:01:12.978873    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/a9cdd07c-66cd-4d85-bc84-b2a318f1b705-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-548b489cb8-v6zgd\" (UID: \"a9cdd07c-66cd-4d85-bc84-b2a318f1b705\") " pod="openshift-monitoring/cluster-monitoring-operator-548b489cb8-v6zgd"
Jul 30 13:01:13.205726 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:01:13.205689    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-548b489cb8-v6zgd"
Jul 30 13:01:14.037106 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:01:14.036521    2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-bjnvm"
Jul 30 13:01:20.401138 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:01:20.400815    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-548b489cb8-v6zgd"]
Jul 30 13:01:20.403635 ip-10-0-143-153 kubenswrapper[2566]: W0730 13:01:20.403607    2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda9cdd07c_66cd_4d85_bc84_b2a318f1b705.slice/crio-313e3ee45e684ad2fb2f817a19e99ed2b069f49ea7ebe74f2c93bb0a14d19a5d WatchSource:0}: Error finding container 313e3ee45e684ad2fb2f817a19e99ed2b069f49ea7ebe74f2c93bb0a14d19a5d: Status 404 returned error can't find the container with id 313e3ee45e684ad2fb2f817a19e99ed2b069f49ea7ebe74f2c93bb0a14d19a5d
Jul 30 13:01:21.195867 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:01:21.195826    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-44fp6" event={"ID":"4d829197-e96c-4e01-9d4c-6008b6d40c84","Type":"ContainerStarted","Data":"adbe54361b812f09d8bfcaf29c4ed86a01d2a02e9a465a21d765e6e87670c0ba"}
Jul 30 13:01:21.197521 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:01:21.197493    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-f9822" event={"ID":"1a31bbf5-b584-424a-8866-8789661dc09a","Type":"ContainerStarted","Data":"65482fb9fa6dd57ba4bd89c96ddb380bc3745413ba9bb1afd8143a6cbbe55a0c"}
Jul 30 13:01:21.197661 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:01:21.197552    2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-f9822"
Jul 30 13:01:21.197661 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:01:21.197579    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-f9822" event={"ID":"1a31bbf5-b584-424a-8866-8789661dc09a","Type":"ContainerStarted","Data":"42855532a284cffa7f529849ab2fd1cde49e1e733282cfafced8a8acc0cf16e9"}
Jul 30 13:01:21.199424 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:01:21.199402    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-77c9c5bb54-cz4zd" event={"ID":"767d7777-cf05-4efd-9e57-adea4e69118e","Type":"ContainerStarted","Data":"04f2bb422ae556baf884f1aa2e2d2025cd8db751de5fa36c6b91ce7de8c57a8f"}
Jul 30 13:01:21.199537 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:01:21.199434    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-77c9c5bb54-cz4zd" event={"ID":"767d7777-cf05-4efd-9e57-adea4e69118e","Type":"ContainerStarted","Data":"00328fdb8c035e1c0be82578c51ce7d671e4e4a5602e94eaf87d8bd99427dc4e"}
Jul 30 13:01:21.199537 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:01:21.199451    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-77c9c5bb54-cz4zd" event={"ID":"767d7777-cf05-4efd-9e57-adea4e69118e","Type":"ContainerStarted","Data":"a159c1af22876fb4228ea1b9cc4259661b7ee40eccd98fad566c5568f0eaccab"}
Jul 30 13:01:21.200771 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:01:21.200751    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7965cd4d49-6w24f" event={"ID":"8155317c-b7df-4116-838a-66f1c23cfecd","Type":"ContainerStarted","Data":"4faadda6b132513639d758898485a1369a707432018163054ec26be31d56ada3"}
Jul 30 13:01:21.200871 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:01:21.200806    2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7965cd4d49-6w24f"
Jul 30 13:01:21.201838 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:01:21.201814    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-548b489cb8-v6zgd" event={"ID":"a9cdd07c-66cd-4d85-bc84-b2a318f1b705","Type":"ContainerStarted","Data":"313e3ee45e684ad2fb2f817a19e99ed2b069f49ea7ebe74f2c93bb0a14d19a5d"}
Jul 30 13:01:21.202618 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:01:21.202602    2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7965cd4d49-6w24f"
Jul 30 13:01:21.220657 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:01:21.220609    2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-44fp6" podStartSLOduration=17.536034893 podStartE2EDuration="36.220592577s" totalImagesPullingTime="18.684557684s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-30 13:00:45 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 13:01:21.220467312 +0000 UTC m=+110.149155593" watchObservedRunningTime="2026-07-30 13:01:21.220592577 +0000 UTC m=+110.149280839"
Jul 30 13:01:21.243225 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:01:21.243168    2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-77c9c5bb54-cz4zd" podStartSLOduration=2.393839749 podStartE2EDuration="11.2431515s" totalImagesPullingTime="8.849311751s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-30 13:01:10 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 13:01:21.242559796 +0000 UTC m=+110.171248058" watchObservedRunningTime="2026-07-30 13:01:21.2431515 +0000 UTC m=+110.171839768"
Jul 30 13:01:21.264696 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:01:21.264652    2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-f9822" podStartSLOduration=66.145169651 podStartE2EDuration="1m15.264638146s" totalImagesPullingTime="9.119468495s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-30 13:00:06 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 13:01:21.264243251 +0000 UTC m=+110.192931515" watchObservedRunningTime="2026-07-30 13:01:21.264638146 +0000 UTC m=+110.193326400"
Jul 30 13:01:21.288650 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:01:21.288610    2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7965cd4d49-6w24f" podStartSLOduration=2.377432294 podStartE2EDuration="11.288596796s" totalImagesPullingTime="8.911164502s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-30 13:01:10 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 13:01:21.288541679 +0000 UTC m=+110.217229956" watchObservedRunningTime="2026-07-30 13:01:21.288596796 +0000 UTC m=+110.217285058"
Jul 30 13:01:23.212460 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:01:23.212418    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-548b489cb8-v6zgd" event={"ID":"a9cdd07c-66cd-4d85-bc84-b2a318f1b705","Type":"ContainerStarted","Data":"6bc45ddc018785a70d9a6ca4ff543c59150147452b750b3d7c84d15b1720f1c4"}
Jul 30 13:01:31.207736 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:01:31.207702    2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-f9822"
Jul 30 13:01:31.242162 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:01:31.242109    2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/cluster-monitoring-operator-548b489cb8-v6zgd" podStartSLOduration=47.58375777 podStartE2EDuration="50.242073042s" totalImagesPullingTime="2.658315272s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-30 13:00:41 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 13:01:23.227974787 +0000 UTC m=+112.156663051" watchObservedRunningTime="2026-07-30 13:01:31.242073042 +0000 UTC m=+120.170761304"
Jul 30 13:01:40.114223 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:01:40.114187    2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-sj92n"]
Jul 30 13:01:40.127505 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:01:40.127479    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-sj92n"
Jul 30 13:01:40.129743 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:01:40.129683    2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\""
Jul 30 13:01:40.129743 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:01:40.129696    2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\""
Jul 30 13:01:40.129743 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:01:40.129733    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\""
Jul 30 13:01:40.129743 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:01:40.129742    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-2xgst\""
Jul 30 13:01:40.130134 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:01:40.130116    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\""
Jul 30 13:01:40.188150 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:01:40.188116    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/de54e463-261a-4ad2-9c3b-fcd6b8ae9d8f-root\") pod \"node-exporter-sj92n\" (UID: \"de54e463-261a-4ad2-9c3b-fcd6b8ae9d8f\") " pod="openshift-monitoring/node-exporter-sj92n"
Jul 30 13:01:40.188150 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:01:40.188148    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/de54e463-261a-4ad2-9c3b-fcd6b8ae9d8f-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-sj92n\" (UID: \"de54e463-261a-4ad2-9c3b-fcd6b8ae9d8f\") " pod="openshift-monitoring/node-exporter-sj92n"
Jul 30 13:01:40.188400 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:01:40.188170    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/de54e463-261a-4ad2-9c3b-fcd6b8ae9d8f-node-exporter-accelerators-collector-config\") pod \"node-exporter-sj92n\" (UID: \"de54e463-261a-4ad2-9c3b-fcd6b8ae9d8f\") " pod="openshift-monitoring/node-exporter-sj92n"
Jul 30 13:01:40.188400 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:01:40.188200    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/de54e463-261a-4ad2-9c3b-fcd6b8ae9d8f-node-exporter-wtmp\") pod \"node-exporter-sj92n\" (UID: \"de54e463-261a-4ad2-9c3b-fcd6b8ae9d8f\") " pod="openshift-monitoring/node-exporter-sj92n"
Jul 30 13:01:40.188400 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:01:40.188245    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/de54e463-261a-4ad2-9c3b-fcd6b8ae9d8f-sys\") pod \"node-exporter-sj92n\" (UID: \"de54e463-261a-4ad2-9c3b-fcd6b8ae9d8f\") " pod="openshift-monitoring/node-exporter-sj92n"
Jul 30 13:01:40.188400 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:01:40.188273    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/de54e463-261a-4ad2-9c3b-fcd6b8ae9d8f-node-exporter-textfile\") pod \"node-exporter-sj92n\" (UID: \"de54e463-261a-4ad2-9c3b-fcd6b8ae9d8f\") " pod="openshift-monitoring/node-exporter-sj92n"
Jul 30 13:01:40.188400 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:01:40.188301    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/de54e463-261a-4ad2-9c3b-fcd6b8ae9d8f-metrics-client-ca\") pod \"node-exporter-sj92n\" (UID: \"de54e463-261a-4ad2-9c3b-fcd6b8ae9d8f\") " pod="openshift-monitoring/node-exporter-sj92n"
Jul 30 13:01:40.188400 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:01:40.188347    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/de54e463-261a-4ad2-9c3b-fcd6b8ae9d8f-node-exporter-tls\") pod \"node-exporter-sj92n\" (UID: \"de54e463-261a-4ad2-9c3b-fcd6b8ae9d8f\") " pod="openshift-monitoring/node-exporter-sj92n"
Jul 30 13:01:40.188400 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:01:40.188365    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vz7zl\" (UniqueName: \"kubernetes.io/projected/de54e463-261a-4ad2-9c3b-fcd6b8ae9d8f-kube-api-access-vz7zl\") pod \"node-exporter-sj92n\" (UID: \"de54e463-261a-4ad2-9c3b-fcd6b8ae9d8f\") " pod="openshift-monitoring/node-exporter-sj92n"
Jul 30 13:01:40.289271 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:01:40.289232    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/de54e463-261a-4ad2-9c3b-fcd6b8ae9d8f-sys\") pod \"node-exporter-sj92n\" (UID: \"de54e463-261a-4ad2-9c3b-fcd6b8ae9d8f\") " pod="openshift-monitoring/node-exporter-sj92n"
Jul 30 13:01:40.289462 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:01:40.289290    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/de54e463-261a-4ad2-9c3b-fcd6b8ae9d8f-node-exporter-textfile\") pod \"node-exporter-sj92n\" (UID: \"de54e463-261a-4ad2-9c3b-fcd6b8ae9d8f\") " pod="openshift-monitoring/node-exporter-sj92n"
Jul 30 13:01:40.289462 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:01:40.289322    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/de54e463-261a-4ad2-9c3b-fcd6b8ae9d8f-metrics-client-ca\") pod \"node-exporter-sj92n\" (UID: \"de54e463-261a-4ad2-9c3b-fcd6b8ae9d8f\") " pod="openshift-monitoring/node-exporter-sj92n"
Jul 30 13:01:40.289462 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:01:40.289360    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/de54e463-261a-4ad2-9c3b-fcd6b8ae9d8f-sys\") pod \"node-exporter-sj92n\" (UID: \"de54e463-261a-4ad2-9c3b-fcd6b8ae9d8f\") " pod="openshift-monitoring/node-exporter-sj92n"
Jul 30 13:01:40.289462 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:01:40.289381    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/de54e463-261a-4ad2-9c3b-fcd6b8ae9d8f-node-exporter-tls\") pod \"node-exporter-sj92n\" (UID: \"de54e463-261a-4ad2-9c3b-fcd6b8ae9d8f\") " pod="openshift-monitoring/node-exporter-sj92n"
Jul 30 13:01:40.289462 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:01:40.289411    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vz7zl\" (UniqueName: \"kubernetes.io/projected/de54e463-261a-4ad2-9c3b-fcd6b8ae9d8f-kube-api-access-vz7zl\") pod \"node-exporter-sj92n\" (UID: \"de54e463-261a-4ad2-9c3b-fcd6b8ae9d8f\") " pod="openshift-monitoring/node-exporter-sj92n"
Jul 30 13:01:40.289718 ip-10-0-143-153 kubenswrapper[2566]: E0730 13:01:40.289491    2566 secret.go:189] Couldn't get secret openshift-monitoring/node-exporter-tls: secret "node-exporter-tls" not found
Jul 30 13:01:40.289718 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:01:40.289562    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/de54e463-261a-4ad2-9c3b-fcd6b8ae9d8f-root\") pod \"node-exporter-sj92n\" (UID: \"de54e463-261a-4ad2-9c3b-fcd6b8ae9d8f\") " pod="openshift-monitoring/node-exporter-sj92n"
Jul 30 13:01:40.289718 ip-10-0-143-153 kubenswrapper[2566]: E0730 13:01:40.289572    2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/de54e463-261a-4ad2-9c3b-fcd6b8ae9d8f-node-exporter-tls podName:de54e463-261a-4ad2-9c3b-fcd6b8ae9d8f nodeName:}" failed. No retries permitted until 2026-07-30 13:01:40.789549997 +0000 UTC m=+129.718238260 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "node-exporter-tls" (UniqueName: "kubernetes.io/secret/de54e463-261a-4ad2-9c3b-fcd6b8ae9d8f-node-exporter-tls") pod "node-exporter-sj92n" (UID: "de54e463-261a-4ad2-9c3b-fcd6b8ae9d8f") : secret "node-exporter-tls" not found
Jul 30 13:01:40.289718 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:01:40.289596    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/de54e463-261a-4ad2-9c3b-fcd6b8ae9d8f-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-sj92n\" (UID: \"de54e463-261a-4ad2-9c3b-fcd6b8ae9d8f\") " pod="openshift-monitoring/node-exporter-sj92n"
Jul 30 13:01:40.289718 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:01:40.289629    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/de54e463-261a-4ad2-9c3b-fcd6b8ae9d8f-node-exporter-accelerators-collector-config\") pod \"node-exporter-sj92n\" (UID: \"de54e463-261a-4ad2-9c3b-fcd6b8ae9d8f\") " pod="openshift-monitoring/node-exporter-sj92n"
Jul 30 13:01:40.289718 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:01:40.289650    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/de54e463-261a-4ad2-9c3b-fcd6b8ae9d8f-root\") pod \"node-exporter-sj92n\" (UID: \"de54e463-261a-4ad2-9c3b-fcd6b8ae9d8f\") " pod="openshift-monitoring/node-exporter-sj92n"
Jul 30 13:01:40.289718 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:01:40.289660    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/de54e463-261a-4ad2-9c3b-fcd6b8ae9d8f-node-exporter-wtmp\") pod \"node-exporter-sj92n\" (UID: \"de54e463-261a-4ad2-9c3b-fcd6b8ae9d8f\") " pod="openshift-monitoring/node-exporter-sj92n"
Jul 30 13:01:40.289718 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:01:40.289697    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/de54e463-261a-4ad2-9c3b-fcd6b8ae9d8f-node-exporter-textfile\") pod \"node-exporter-sj92n\" (UID: \"de54e463-261a-4ad2-9c3b-fcd6b8ae9d8f\") " pod="openshift-monitoring/node-exporter-sj92n"
Jul 30 13:01:40.290134 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:01:40.289823    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/de54e463-261a-4ad2-9c3b-fcd6b8ae9d8f-node-exporter-wtmp\") pod \"node-exporter-sj92n\" (UID: \"de54e463-261a-4ad2-9c3b-fcd6b8ae9d8f\") " pod="openshift-monitoring/node-exporter-sj92n"
Jul 30 13:01:40.290268 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:01:40.290249    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/de54e463-261a-4ad2-9c3b-fcd6b8ae9d8f-metrics-client-ca\") pod \"node-exporter-sj92n\" (UID: \"de54e463-261a-4ad2-9c3b-fcd6b8ae9d8f\") " pod="openshift-monitoring/node-exporter-sj92n"
Jul 30 13:01:40.290325 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:01:40.290268    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/de54e463-261a-4ad2-9c3b-fcd6b8ae9d8f-node-exporter-accelerators-collector-config\") pod \"node-exporter-sj92n\" (UID: \"de54e463-261a-4ad2-9c3b-fcd6b8ae9d8f\") " pod="openshift-monitoring/node-exporter-sj92n"
Jul 30 13:01:40.291886 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:01:40.291867    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/de54e463-261a-4ad2-9c3b-fcd6b8ae9d8f-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-sj92n\" (UID: \"de54e463-261a-4ad2-9c3b-fcd6b8ae9d8f\") " pod="openshift-monitoring/node-exporter-sj92n"
Jul 30 13:01:40.297689 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:01:40.297667    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vz7zl\" (UniqueName: \"kubernetes.io/projected/de54e463-261a-4ad2-9c3b-fcd6b8ae9d8f-kube-api-access-vz7zl\") pod \"node-exporter-sj92n\" (UID: \"de54e463-261a-4ad2-9c3b-fcd6b8ae9d8f\") " pod="openshift-monitoring/node-exporter-sj92n"
Jul 30 13:01:40.390618 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:01:40.390572    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/995cd086-39a7-4097-971a-1c4e6c08576b-metrics-certs\") pod \"network-metrics-daemon-kb44p\" (UID: \"995cd086-39a7-4097-971a-1c4e6c08576b\") " pod="openshift-multus/network-metrics-daemon-kb44p"
Jul 30 13:01:40.393893 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:01:40.393854    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/995cd086-39a7-4097-971a-1c4e6c08576b-metrics-certs\") pod \"network-metrics-daemon-kb44p\" (UID: \"995cd086-39a7-4097-971a-1c4e6c08576b\") " pod="openshift-multus/network-metrics-daemon-kb44p"
Jul 30 13:01:40.541496 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:01:40.541462    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-v4mfl\""
Jul 30 13:01:40.549933 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:01:40.549913    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-kb44p"
Jul 30 13:01:40.793916 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:01:40.793885    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/de54e463-261a-4ad2-9c3b-fcd6b8ae9d8f-node-exporter-tls\") pod \"node-exporter-sj92n\" (UID: \"de54e463-261a-4ad2-9c3b-fcd6b8ae9d8f\") " pod="openshift-monitoring/node-exporter-sj92n"
Jul 30 13:01:40.796238 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:01:40.796211    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/de54e463-261a-4ad2-9c3b-fcd6b8ae9d8f-node-exporter-tls\") pod \"node-exporter-sj92n\" (UID: \"de54e463-261a-4ad2-9c3b-fcd6b8ae9d8f\") " pod="openshift-monitoring/node-exporter-sj92n"
Jul 30 13:01:40.807159 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:01:40.807132    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-kb44p"]
Jul 30 13:01:40.809639 ip-10-0-143-153 kubenswrapper[2566]: W0730 13:01:40.809615    2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod995cd086_39a7_4097_971a_1c4e6c08576b.slice/crio-0c8b2213036c802d065bb8c3b32706133dc33d64cae3879da390753216f89d8b WatchSource:0}: Error finding container 0c8b2213036c802d065bb8c3b32706133dc33d64cae3879da390753216f89d8b: Status 404 returned error can't find the container with id 0c8b2213036c802d065bb8c3b32706133dc33d64cae3879da390753216f89d8b
Jul 30 13:01:41.038676 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:01:41.038597    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-sj92n"
Jul 30 13:01:41.085400 ip-10-0-143-153 kubenswrapper[2566]: W0730 13:01:41.085370    2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podde54e463_261a_4ad2_9c3b_fcd6b8ae9d8f.slice/crio-0c8dc47beec3545bf391869e2d76098ee57fd95a38e9daf831f7844301bb0319 WatchSource:0}: Error finding container 0c8dc47beec3545bf391869e2d76098ee57fd95a38e9daf831f7844301bb0319: Status 404 returned error can't find the container with id 0c8dc47beec3545bf391869e2d76098ee57fd95a38e9daf831f7844301bb0319
Jul 30 13:01:41.278464 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:01:41.278423    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-kb44p" event={"ID":"995cd086-39a7-4097-971a-1c4e6c08576b","Type":"ContainerStarted","Data":"0c8b2213036c802d065bb8c3b32706133dc33d64cae3879da390753216f89d8b"}
Jul 30 13:01:41.279789 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:01:41.279761    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-sj92n" event={"ID":"de54e463-261a-4ad2-9c3b-fcd6b8ae9d8f","Type":"ContainerStarted","Data":"0c8dc47beec3545bf391869e2d76098ee57fd95a38e9daf831f7844301bb0319"}
Jul 30 13:01:43.289555 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:01:43.289513    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-kb44p" event={"ID":"995cd086-39a7-4097-971a-1c4e6c08576b","Type":"ContainerStarted","Data":"271e9357c2a88d26226158d0232d3cbeee76add45ef89e9e089a20964f8fbb12"}
Jul 30 13:01:43.290099 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:01:43.289581    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-kb44p" event={"ID":"995cd086-39a7-4097-971a-1c4e6c08576b","Type":"ContainerStarted","Data":"5db61a2b841ace09031de42ed253598491ded4da97841f26a000c521e7b8491e"}
Jul 30 13:01:43.291249 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:01:43.291222    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-sj92n" event={"ID":"de54e463-261a-4ad2-9c3b-fcd6b8ae9d8f","Type":"ContainerStarted","Data":"afe7ab38374c3474820ced634860a980c9be81e1f548dc50b0d94bd71a91e735"}
Jul 30 13:01:43.306419 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:01:43.306362    2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-kb44p" podStartSLOduration=130.921124681 podStartE2EDuration="2m12.306340996s" totalImagesPullingTime="1.385216315s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-30 12:59:31 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 13:01:43.305618977 +0000 UTC m=+132.234307251" watchObservedRunningTime="2026-07-30 13:01:43.306340996 +0000 UTC m=+132.235029260"
Jul 30 13:01:44.296337 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:01:44.296295    2566 generic.go:356] "Generic (PLEG): container finished" podID="de54e463-261a-4ad2-9c3b-fcd6b8ae9d8f" containerID="afe7ab38374c3474820ced634860a980c9be81e1f548dc50b0d94bd71a91e735" exitCode=0
Jul 30 13:01:44.296791 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:01:44.296378    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-sj92n" event={"ID":"de54e463-261a-4ad2-9c3b-fcd6b8ae9d8f","Type":"ContainerDied","Data":"afe7ab38374c3474820ced634860a980c9be81e1f548dc50b0d94bd71a91e735"}
Jul 30 13:01:45.301493 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:01:45.301460    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-sj92n" event={"ID":"de54e463-261a-4ad2-9c3b-fcd6b8ae9d8f","Type":"ContainerStarted","Data":"2339ae70d4f5662bcd5be7ebc1e5f80a5a1d3d4e7d692e6e35f8c0fd480304ce"}
Jul 30 13:01:45.302104 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:01:45.301513    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-sj92n" event={"ID":"de54e463-261a-4ad2-9c3b-fcd6b8ae9d8f","Type":"ContainerStarted","Data":"f6e169bbb0333f17035162d39ab8864a9b9f6d1fa8432047c28b14378819bf1b"}
Jul 30 13:01:45.321544 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:01:45.321480    2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-sj92n" podStartSLOduration=3.207210801 podStartE2EDuration="5.321460248s" totalImagesPullingTime="2.005744209s" totalInitContainerRuntime="108.505238ms" isStatefulPod=true podCreationTimestamp="2026-07-30 13:01:40 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 13:01:45.320071151 +0000 UTC m=+134.248759414" watchObservedRunningTime="2026-07-30 13:01:45.321460248 +0000 UTC m=+134.250148511"
Jul 30 13:02:01.358756 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:02:01.358724    2566 generic.go:356] "Generic (PLEG): container finished" podID="0a469596-ff7b-45e1-9fc7-a6f4753ff16a" containerID="2766d8918e2607b49142c417229af7cc08dbb48313e3b1da3c42b5964e76b7a6" exitCode=0
Jul 30 13:02:01.359132 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:02:01.358794    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-5d6c75f84f-psdw9" event={"ID":"0a469596-ff7b-45e1-9fc7-a6f4753ff16a","Type":"ContainerDied","Data":"2766d8918e2607b49142c417229af7cc08dbb48313e3b1da3c42b5964e76b7a6"}
Jul 30 13:02:01.359227 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:02:01.359143    2566 scope.go:117] "RemoveContainer" containerID="2766d8918e2607b49142c417229af7cc08dbb48313e3b1da3c42b5964e76b7a6"
Jul 30 13:02:02.364295 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:02:02.364257    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-5d6c75f84f-psdw9" event={"ID":"0a469596-ff7b-45e1-9fc7-a6f4753ff16a","Type":"ContainerStarted","Data":"38e5881261c380e5ca4df1914feb8a47e0b6be1d96837a8f216c586b97b93aaa"}
Jul 30 13:02:11.393856 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:02:11.393817    2566 generic.go:356] "Generic (PLEG): container finished" podID="c566cf8d-48ce-43ae-9427-e5e43d8f2e2f" containerID="334025f4745269314fcef4265647b9ceaf72156b23b63de99cbe6e01a387d3a9" exitCode=0
Jul 30 13:02:11.394276 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:02:11.393892    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6f4d6fb6bc-thklp" event={"ID":"c566cf8d-48ce-43ae-9427-e5e43d8f2e2f","Type":"ContainerDied","Data":"334025f4745269314fcef4265647b9ceaf72156b23b63de99cbe6e01a387d3a9"}
Jul 30 13:02:11.394276 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:02:11.394266    2566 scope.go:117] "RemoveContainer" containerID="334025f4745269314fcef4265647b9ceaf72156b23b63de99cbe6e01a387d3a9"
Jul 30 13:02:12.398913 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:02:12.398879    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6f4d6fb6bc-thklp" event={"ID":"c566cf8d-48ce-43ae-9427-e5e43d8f2e2f","Type":"ContainerStarted","Data":"88cabaaa68c8cdd53e780902dc43ebee4b1130bbf4e86480d45ec0541a38adc0"}
Jul 30 13:04:31.495236 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:04:31.495207    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-bzl6w_51cdacbf-3a14-47c0-8fd4-69b0b2be0e64/console-operator/1.log"
Jul 30 13:04:31.500866 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:04:31.500838    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-f6br6_3ebbc209-4373-44d8-a22e-d2d2aa4cbfa6/ovn-acl-logging/0.log"
Jul 30 13:04:31.501801 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:04:31.501781    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-bzl6w_51cdacbf-3a14-47c0-8fd4-69b0b2be0e64/console-operator/1.log"
Jul 30 13:04:31.506903 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:04:31.506883    2566 kubelet.go:1648] "Image garbage collection succeeded"
Jul 30 13:04:31.507231 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:04:31.507213    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-f6br6_3ebbc209-4373-44d8-a22e-d2d2aa4cbfa6/ovn-acl-logging/0.log"
Jul 30 13:04:44.541303 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:04:44.541264    2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-9pscf"]
Jul 30 13:04:44.544615 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:04:44.544595    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-9pscf"
Jul 30 13:04:44.546500 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:04:44.546478    2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"kube-root-ca.crt\""
Jul 30 13:04:44.546724 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:04:44.546709    2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"openshift-service-ca.crt\""
Jul 30 13:04:44.546791 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:04:44.546711    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"openshift-lws-operator-dockercfg-xg8lq\""
Jul 30 13:04:44.553786 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:04:44.553764    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-9pscf"]
Jul 30 13:04:44.647010 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:04:44.646980    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/d5ca8fa5-a694-4b65-936a-2f8ba5628c55-tmp\") pod \"openshift-lws-operator-fd8ccff4c-9pscf\" (UID: \"d5ca8fa5-a694-4b65-936a-2f8ba5628c55\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-9pscf"
Jul 30 13:04:44.647207 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:04:44.647037    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gjpwp\" (UniqueName: \"kubernetes.io/projected/d5ca8fa5-a694-4b65-936a-2f8ba5628c55-kube-api-access-gjpwp\") pod \"openshift-lws-operator-fd8ccff4c-9pscf\" (UID: \"d5ca8fa5-a694-4b65-936a-2f8ba5628c55\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-9pscf"
Jul 30 13:04:44.747725 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:04:44.747698    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/d5ca8fa5-a694-4b65-936a-2f8ba5628c55-tmp\") pod \"openshift-lws-operator-fd8ccff4c-9pscf\" (UID: \"d5ca8fa5-a694-4b65-936a-2f8ba5628c55\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-9pscf"
Jul 30 13:04:44.747864 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:04:44.747743    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gjpwp\" (UniqueName: \"kubernetes.io/projected/d5ca8fa5-a694-4b65-936a-2f8ba5628c55-kube-api-access-gjpwp\") pod \"openshift-lws-operator-fd8ccff4c-9pscf\" (UID: \"d5ca8fa5-a694-4b65-936a-2f8ba5628c55\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-9pscf"
Jul 30 13:04:44.748117 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:04:44.748067    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/d5ca8fa5-a694-4b65-936a-2f8ba5628c55-tmp\") pod \"openshift-lws-operator-fd8ccff4c-9pscf\" (UID: \"d5ca8fa5-a694-4b65-936a-2f8ba5628c55\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-9pscf"
Jul 30 13:04:44.761182 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:04:44.761156    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gjpwp\" (UniqueName: \"kubernetes.io/projected/d5ca8fa5-a694-4b65-936a-2f8ba5628c55-kube-api-access-gjpwp\") pod \"openshift-lws-operator-fd8ccff4c-9pscf\" (UID: \"d5ca8fa5-a694-4b65-936a-2f8ba5628c55\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-9pscf"
Jul 30 13:04:44.853112 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:04:44.853013    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-9pscf"
Jul 30 13:04:44.979901 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:04:44.979871    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-9pscf"]
Jul 30 13:04:44.983022 ip-10-0-143-153 kubenswrapper[2566]: W0730 13:04:44.982997    2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podd5ca8fa5_a694_4b65_936a_2f8ba5628c55.slice/crio-fe716220037d9487921a0ead147a3769489e9d3728d4d3825fb9589976739c41 WatchSource:0}: Error finding container fe716220037d9487921a0ead147a3769489e9d3728d4d3825fb9589976739c41: Status 404 returned error can't find the container with id fe716220037d9487921a0ead147a3769489e9d3728d4d3825fb9589976739c41
Jul 30 13:04:44.984494 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:04:44.984476    2566 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 30 13:04:45.923716 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:04:45.923679    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-9pscf" event={"ID":"d5ca8fa5-a694-4b65-936a-2f8ba5628c55","Type":"ContainerStarted","Data":"fe716220037d9487921a0ead147a3769489e9d3728d4d3825fb9589976739c41"}
Jul 30 13:04:47.932352 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:04:47.932316    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-9pscf" event={"ID":"d5ca8fa5-a694-4b65-936a-2f8ba5628c55","Type":"ContainerStarted","Data":"bc6e14434beb14d3d9076cc7befd54ada43e3df4efe7d6f9f518b6a1d6dbc656"}
Jul 30 13:04:47.956269 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:04:47.956211    2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-9pscf" podStartSLOduration=1.177075603 podStartE2EDuration="3.956188719s" totalImagesPullingTime="2.779113116s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-30 13:04:44 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 13:04:47.95481468 +0000 UTC m=+316.883502955" watchObservedRunningTime="2026-07-30 13:04:47.956188719 +0000 UTC m=+316.884876984"
Jul 30 13:05:03.647499 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:05:03.647461    2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-6bd55cb6f4-fwjfw"]
Jul 30 13:05:03.654071 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:05:03.654051    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-6bd55cb6f4-fwjfw"
Jul 30 13:05:03.656731 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:05:03.656704    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\""
Jul 30 13:05:03.656731 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:05:03.656705    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-cwt6z\""
Jul 30 13:05:03.657184 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:05:03.657162    2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\""
Jul 30 13:05:03.657424 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:05:03.657404    2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\""
Jul 30 13:05:03.657676 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:05:03.657658    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\""
Jul 30 13:05:03.665281 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:05:03.665259    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-6bd55cb6f4-fwjfw"]
Jul 30 13:05:03.793704 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:05:03.793664    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/d42add9d-4212-4ebe-a243-558fa6293154-apiservice-cert\") pod \"opendatahub-operator-controller-manager-6bd55cb6f4-fwjfw\" (UID: \"d42add9d-4212-4ebe-a243-558fa6293154\") " pod="opendatahub/opendatahub-operator-controller-manager-6bd55cb6f4-fwjfw"
Jul 30 13:05:03.793704 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:05:03.793707    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/d42add9d-4212-4ebe-a243-558fa6293154-manifests\") pod \"opendatahub-operator-controller-manager-6bd55cb6f4-fwjfw\" (UID: \"d42add9d-4212-4ebe-a243-558fa6293154\") " pod="opendatahub/opendatahub-operator-controller-manager-6bd55cb6f4-fwjfw"
Jul 30 13:05:03.793915 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:05:03.793740    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/d42add9d-4212-4ebe-a243-558fa6293154-tmp\") pod \"opendatahub-operator-controller-manager-6bd55cb6f4-fwjfw\" (UID: \"d42add9d-4212-4ebe-a243-558fa6293154\") " pod="opendatahub/opendatahub-operator-controller-manager-6bd55cb6f4-fwjfw"
Jul 30 13:05:03.793915 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:05:03.793807    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6w84j\" (UniqueName: \"kubernetes.io/projected/d42add9d-4212-4ebe-a243-558fa6293154-kube-api-access-6w84j\") pod \"opendatahub-operator-controller-manager-6bd55cb6f4-fwjfw\" (UID: \"d42add9d-4212-4ebe-a243-558fa6293154\") " pod="opendatahub/opendatahub-operator-controller-manager-6bd55cb6f4-fwjfw"
Jul 30 13:05:03.793915 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:05:03.793855    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/d42add9d-4212-4ebe-a243-558fa6293154-webhook-cert\") pod \"opendatahub-operator-controller-manager-6bd55cb6f4-fwjfw\" (UID: \"d42add9d-4212-4ebe-a243-558fa6293154\") " pod="opendatahub/opendatahub-operator-controller-manager-6bd55cb6f4-fwjfw"
Jul 30 13:05:03.895048 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:05:03.895011    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/d42add9d-4212-4ebe-a243-558fa6293154-apiservice-cert\") pod \"opendatahub-operator-controller-manager-6bd55cb6f4-fwjfw\" (UID: \"d42add9d-4212-4ebe-a243-558fa6293154\") " pod="opendatahub/opendatahub-operator-controller-manager-6bd55cb6f4-fwjfw"
Jul 30 13:05:03.895048 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:05:03.895051    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/d42add9d-4212-4ebe-a243-558fa6293154-manifests\") pod \"opendatahub-operator-controller-manager-6bd55cb6f4-fwjfw\" (UID: \"d42add9d-4212-4ebe-a243-558fa6293154\") " pod="opendatahub/opendatahub-operator-controller-manager-6bd55cb6f4-fwjfw"
Jul 30 13:05:03.895270 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:05:03.895073    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/d42add9d-4212-4ebe-a243-558fa6293154-tmp\") pod \"opendatahub-operator-controller-manager-6bd55cb6f4-fwjfw\" (UID: \"d42add9d-4212-4ebe-a243-558fa6293154\") " pod="opendatahub/opendatahub-operator-controller-manager-6bd55cb6f4-fwjfw"
Jul 30 13:05:03.895270 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:05:03.895235    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6w84j\" (UniqueName: \"kubernetes.io/projected/d42add9d-4212-4ebe-a243-558fa6293154-kube-api-access-6w84j\") pod \"opendatahub-operator-controller-manager-6bd55cb6f4-fwjfw\" (UID: \"d42add9d-4212-4ebe-a243-558fa6293154\") " pod="opendatahub/opendatahub-operator-controller-manager-6bd55cb6f4-fwjfw"
Jul 30 13:05:03.895367 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:05:03.895292    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/d42add9d-4212-4ebe-a243-558fa6293154-webhook-cert\") pod \"opendatahub-operator-controller-manager-6bd55cb6f4-fwjfw\" (UID: \"d42add9d-4212-4ebe-a243-558fa6293154\") " pod="opendatahub/opendatahub-operator-controller-manager-6bd55cb6f4-fwjfw"
Jul 30 13:05:03.895568 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:05:03.895543    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/d42add9d-4212-4ebe-a243-558fa6293154-manifests\") pod \"opendatahub-operator-controller-manager-6bd55cb6f4-fwjfw\" (UID: \"d42add9d-4212-4ebe-a243-558fa6293154\") " pod="opendatahub/opendatahub-operator-controller-manager-6bd55cb6f4-fwjfw"
Jul 30 13:05:03.897603 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:05:03.897545    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/d42add9d-4212-4ebe-a243-558fa6293154-tmp\") pod \"opendatahub-operator-controller-manager-6bd55cb6f4-fwjfw\" (UID: \"d42add9d-4212-4ebe-a243-558fa6293154\") " pod="opendatahub/opendatahub-operator-controller-manager-6bd55cb6f4-fwjfw"
Jul 30 13:05:03.897703 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:05:03.897609    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/d42add9d-4212-4ebe-a243-558fa6293154-webhook-cert\") pod \"opendatahub-operator-controller-manager-6bd55cb6f4-fwjfw\" (UID: \"d42add9d-4212-4ebe-a243-558fa6293154\") " pod="opendatahub/opendatahub-operator-controller-manager-6bd55cb6f4-fwjfw"
Jul 30 13:05:03.897703 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:05:03.897681    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/d42add9d-4212-4ebe-a243-558fa6293154-apiservice-cert\") pod \"opendatahub-operator-controller-manager-6bd55cb6f4-fwjfw\" (UID: \"d42add9d-4212-4ebe-a243-558fa6293154\") " pod="opendatahub/opendatahub-operator-controller-manager-6bd55cb6f4-fwjfw"
Jul 30 13:05:03.902810 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:05:03.902790    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6w84j\" (UniqueName: \"kubernetes.io/projected/d42add9d-4212-4ebe-a243-558fa6293154-kube-api-access-6w84j\") pod \"opendatahub-operator-controller-manager-6bd55cb6f4-fwjfw\" (UID: \"d42add9d-4212-4ebe-a243-558fa6293154\") " pod="opendatahub/opendatahub-operator-controller-manager-6bd55cb6f4-fwjfw"
Jul 30 13:05:03.963903 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:05:03.963870    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-6bd55cb6f4-fwjfw"
Jul 30 13:05:04.110779 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:05:04.110684    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-6bd55cb6f4-fwjfw"]
Jul 30 13:05:04.113170 ip-10-0-143-153 kubenswrapper[2566]: W0730 13:05:04.113135    2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd42add9d_4212_4ebe_a243_558fa6293154.slice/crio-0c1824175202bde6b8a24751c491563bcbe4f43f534a0a098039eb140a86907d WatchSource:0}: Error finding container 0c1824175202bde6b8a24751c491563bcbe4f43f534a0a098039eb140a86907d: Status 404 returned error can't find the container with id 0c1824175202bde6b8a24751c491563bcbe4f43f534a0a098039eb140a86907d
Jul 30 13:05:04.994693 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:05:04.994660    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-6bd55cb6f4-fwjfw" event={"ID":"d42add9d-4212-4ebe-a243-558fa6293154","Type":"ContainerStarted","Data":"0c1824175202bde6b8a24751c491563bcbe4f43f534a0a098039eb140a86907d"}
Jul 30 13:05:10.014262 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:05:10.014221    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-6bd55cb6f4-fwjfw" event={"ID":"d42add9d-4212-4ebe-a243-558fa6293154","Type":"ContainerStarted","Data":"f5042fabd5d40b9a0a5e8742c2041d41dc12c64431b4e8285ae5be61f20044ca"}
Jul 30 13:05:11.019589 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:05:11.019551    2566 generic.go:356] "Generic (PLEG): container finished" podID="d42add9d-4212-4ebe-a243-558fa6293154" containerID="f5042fabd5d40b9a0a5e8742c2041d41dc12c64431b4e8285ae5be61f20044ca" exitCode=0
Jul 30 13:05:11.019985 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:05:11.019603    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-6bd55cb6f4-fwjfw" event={"ID":"d42add9d-4212-4ebe-a243-558fa6293154","Type":"ContainerDied","Data":"f5042fabd5d40b9a0a5e8742c2041d41dc12c64431b4e8285ae5be61f20044ca"}
Jul 30 13:05:12.025207 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:05:12.025174    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-6bd55cb6f4-fwjfw" event={"ID":"d42add9d-4212-4ebe-a243-558fa6293154","Type":"ContainerStarted","Data":"984a8c1565341dceee3d278a7448b86cfd6871d4cf3e08aa6a4af5163a28b7db"}
Jul 30 13:05:12.025557 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:05:12.025301    2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-6bd55cb6f4-fwjfw"
Jul 30 13:05:12.044879 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:05:12.044718    2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-6bd55cb6f4-fwjfw" podStartSLOduration=2.588025341 podStartE2EDuration="9.044700919s" totalImagesPullingTime="5.379663715s" totalInitContainerRuntime="1.077011863s" isStatefulPod=false podCreationTimestamp="2026-07-30 13:05:03 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 13:05:12.044107066 +0000 UTC m=+340.972795330" watchObservedRunningTime="2026-07-30 13:05:12.044700919 +0000 UTC m=+340.973389183"
Jul 30 13:05:23.030539 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:05:23.030505    2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-6bd55cb6f4-fwjfw"
Jul 30 13:05:25.346609 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:05:25.346532    2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/kube-auth-proxy-54d6c599cc-7s9mh"]
Jul 30 13:05:25.349864 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:05:25.349847    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-54d6c599cc-7s9mh"
Jul 30 13:05:25.352865 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:05:25.352843    2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\""
Jul 30 13:05:25.353161 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:05:25.353135    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-dockercfg-tfg9p\""
Jul 30 13:05:25.353161 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:05:25.353160    2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\""
Jul 30 13:05:25.353314 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:05:25.353220    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-creds\""
Jul 30 13:05:25.353314 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:05:25.353148    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-tls\""
Jul 30 13:05:25.364712 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:05:25.364690    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-54d6c599cc-7s9mh"]
Jul 30 13:05:25.472352 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:05:25.472316    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/0238e0f1-c28e-45cc-a028-aa78c8a3e130-tmp\") pod \"kube-auth-proxy-54d6c599cc-7s9mh\" (UID: \"0238e0f1-c28e-45cc-a028-aa78c8a3e130\") " pod="openshift-ingress/kube-auth-proxy-54d6c599cc-7s9mh"
Jul 30 13:05:25.472535 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:05:25.472371    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/0238e0f1-c28e-45cc-a028-aa78c8a3e130-tls-certs\") pod \"kube-auth-proxy-54d6c599cc-7s9mh\" (UID: \"0238e0f1-c28e-45cc-a028-aa78c8a3e130\") " pod="openshift-ingress/kube-auth-proxy-54d6c599cc-7s9mh"
Jul 30 13:05:25.472535 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:05:25.472468    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zgq6w\" (UniqueName: \"kubernetes.io/projected/0238e0f1-c28e-45cc-a028-aa78c8a3e130-kube-api-access-zgq6w\") pod \"kube-auth-proxy-54d6c599cc-7s9mh\" (UID: \"0238e0f1-c28e-45cc-a028-aa78c8a3e130\") " pod="openshift-ingress/kube-auth-proxy-54d6c599cc-7s9mh"
Jul 30 13:05:25.499633 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:05:25.499595    2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/odh-model-controller-7998c67dc4-44z8n"]
Jul 30 13:05:25.502829 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:05:25.502813    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/odh-model-controller-7998c67dc4-44z8n"
Jul 30 13:05:25.505476 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:05:25.505451    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"odh-model-controller-webhook-cert\""
Jul 30 13:05:25.505592 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:05:25.505545    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"odh-model-controller-dockercfg-4glj4\""
Jul 30 13:05:25.522370 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:05:25.522344    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/odh-model-controller-7998c67dc4-44z8n"]
Jul 30 13:05:25.573471 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:05:25.573438    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/0238e0f1-c28e-45cc-a028-aa78c8a3e130-tls-certs\") pod \"kube-auth-proxy-54d6c599cc-7s9mh\" (UID: \"0238e0f1-c28e-45cc-a028-aa78c8a3e130\") " pod="openshift-ingress/kube-auth-proxy-54d6c599cc-7s9mh"
Jul 30 13:05:25.573635 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:05:25.573501    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zgq6w\" (UniqueName: \"kubernetes.io/projected/0238e0f1-c28e-45cc-a028-aa78c8a3e130-kube-api-access-zgq6w\") pod \"kube-auth-proxy-54d6c599cc-7s9mh\" (UID: \"0238e0f1-c28e-45cc-a028-aa78c8a3e130\") " pod="openshift-ingress/kube-auth-proxy-54d6c599cc-7s9mh"
Jul 30 13:05:25.573635 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:05:25.573546    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/0238e0f1-c28e-45cc-a028-aa78c8a3e130-tmp\") pod \"kube-auth-proxy-54d6c599cc-7s9mh\" (UID: \"0238e0f1-c28e-45cc-a028-aa78c8a3e130\") " pod="openshift-ingress/kube-auth-proxy-54d6c599cc-7s9mh"
Jul 30 13:05:25.573635 ip-10-0-143-153 kubenswrapper[2566]: E0730 13:05:25.573601    2566 secret.go:189] Couldn't get secret openshift-ingress/kube-auth-proxy-tls: secret "kube-auth-proxy-tls" not found
Jul 30 13:05:25.573759 ip-10-0-143-153 kubenswrapper[2566]: E0730 13:05:25.573674    2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0238e0f1-c28e-45cc-a028-aa78c8a3e130-tls-certs podName:0238e0f1-c28e-45cc-a028-aa78c8a3e130 nodeName:}" failed. No retries permitted until 2026-07-30 13:05:26.073650537 +0000 UTC m=+355.002338792 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "tls-certs" (UniqueName: "kubernetes.io/secret/0238e0f1-c28e-45cc-a028-aa78c8a3e130-tls-certs") pod "kube-auth-proxy-54d6c599cc-7s9mh" (UID: "0238e0f1-c28e-45cc-a028-aa78c8a3e130") : secret "kube-auth-proxy-tls" not found
Jul 30 13:05:25.575826 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:05:25.575800    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/0238e0f1-c28e-45cc-a028-aa78c8a3e130-tmp\") pod \"kube-auth-proxy-54d6c599cc-7s9mh\" (UID: \"0238e0f1-c28e-45cc-a028-aa78c8a3e130\") " pod="openshift-ingress/kube-auth-proxy-54d6c599cc-7s9mh"
Jul 30 13:05:25.587938 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:05:25.587909    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zgq6w\" (UniqueName: \"kubernetes.io/projected/0238e0f1-c28e-45cc-a028-aa78c8a3e130-kube-api-access-zgq6w\") pod \"kube-auth-proxy-54d6c599cc-7s9mh\" (UID: \"0238e0f1-c28e-45cc-a028-aa78c8a3e130\") " pod="openshift-ingress/kube-auth-proxy-54d6c599cc-7s9mh"
Jul 30 13:05:25.674056 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:05:25.674025    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/4ab61f41-6eff-4806-968d-98a6d5573f4e-cert\") pod \"odh-model-controller-7998c67dc4-44z8n\" (UID: \"4ab61f41-6eff-4806-968d-98a6d5573f4e\") " pod="opendatahub/odh-model-controller-7998c67dc4-44z8n"
Jul 30 13:05:25.674235 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:05:25.674068    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-s8c8g\" (UniqueName: \"kubernetes.io/projected/4ab61f41-6eff-4806-968d-98a6d5573f4e-kube-api-access-s8c8g\") pod \"odh-model-controller-7998c67dc4-44z8n\" (UID: \"4ab61f41-6eff-4806-968d-98a6d5573f4e\") " pod="opendatahub/odh-model-controller-7998c67dc4-44z8n"
Jul 30 13:05:25.774721 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:05:25.774686    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/4ab61f41-6eff-4806-968d-98a6d5573f4e-cert\") pod \"odh-model-controller-7998c67dc4-44z8n\" (UID: \"4ab61f41-6eff-4806-968d-98a6d5573f4e\") " pod="opendatahub/odh-model-controller-7998c67dc4-44z8n"
Jul 30 13:05:25.774882 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:05:25.774729    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-s8c8g\" (UniqueName: \"kubernetes.io/projected/4ab61f41-6eff-4806-968d-98a6d5573f4e-kube-api-access-s8c8g\") pod \"odh-model-controller-7998c67dc4-44z8n\" (UID: \"4ab61f41-6eff-4806-968d-98a6d5573f4e\") " pod="opendatahub/odh-model-controller-7998c67dc4-44z8n"
Jul 30 13:05:25.777149 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:05:25.777117    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/4ab61f41-6eff-4806-968d-98a6d5573f4e-cert\") pod \"odh-model-controller-7998c67dc4-44z8n\" (UID: \"4ab61f41-6eff-4806-968d-98a6d5573f4e\") " pod="opendatahub/odh-model-controller-7998c67dc4-44z8n"
Jul 30 13:05:25.781636 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:05:25.781616    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-s8c8g\" (UniqueName: \"kubernetes.io/projected/4ab61f41-6eff-4806-968d-98a6d5573f4e-kube-api-access-s8c8g\") pod \"odh-model-controller-7998c67dc4-44z8n\" (UID: \"4ab61f41-6eff-4806-968d-98a6d5573f4e\") " pod="opendatahub/odh-model-controller-7998c67dc4-44z8n"
Jul 30 13:05:25.814565 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:05:25.814541    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/odh-model-controller-7998c67dc4-44z8n"
Jul 30 13:05:25.975367 ip-10-0-143-153 kubenswrapper[2566]: W0730 13:05:25.975328    2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4ab61f41_6eff_4806_968d_98a6d5573f4e.slice/crio-288e4ba051a78986091997a9f278be1f65f68230df0d4ece03fda9122542d4d3 WatchSource:0}: Error finding container 288e4ba051a78986091997a9f278be1f65f68230df0d4ece03fda9122542d4d3: Status 404 returned error can't find the container with id 288e4ba051a78986091997a9f278be1f65f68230df0d4ece03fda9122542d4d3
Jul 30 13:05:25.996508 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:05:25.996484    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/odh-model-controller-7998c67dc4-44z8n"]
Jul 30 13:05:26.076275 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:05:26.076242    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/odh-model-controller-7998c67dc4-44z8n" event={"ID":"4ab61f41-6eff-4806-968d-98a6d5573f4e","Type":"ContainerStarted","Data":"288e4ba051a78986091997a9f278be1f65f68230df0d4ece03fda9122542d4d3"}
Jul 30 13:05:26.076560 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:05:26.076547    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/0238e0f1-c28e-45cc-a028-aa78c8a3e130-tls-certs\") pod \"kube-auth-proxy-54d6c599cc-7s9mh\" (UID: \"0238e0f1-c28e-45cc-a028-aa78c8a3e130\") " pod="openshift-ingress/kube-auth-proxy-54d6c599cc-7s9mh"
Jul 30 13:05:26.078868 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:05:26.078848    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/0238e0f1-c28e-45cc-a028-aa78c8a3e130-tls-certs\") pod \"kube-auth-proxy-54d6c599cc-7s9mh\" (UID: \"0238e0f1-c28e-45cc-a028-aa78c8a3e130\") " pod="openshift-ingress/kube-auth-proxy-54d6c599cc-7s9mh"
Jul 30 13:05:26.259513 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:05:26.259430    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-54d6c599cc-7s9mh"
Jul 30 13:05:26.263823 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:05:26.263797    2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/model-serving-api-54d89bd5fc-szgjq"]
Jul 30 13:05:26.267008 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:05:26.266992    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/model-serving-api-54d89bd5fc-szgjq"
Jul 30 13:05:26.273326 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:05:26.273297    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"model-serving-api-tls\""
Jul 30 13:05:26.289412 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:05:26.286321    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/model-serving-api-54d89bd5fc-szgjq"]
Jul 30 13:05:26.379660 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:05:26.379618    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/bb3f0039-55d7-4311-957d-5c9932ea9e65-tls-certs\") pod \"model-serving-api-54d89bd5fc-szgjq\" (UID: \"bb3f0039-55d7-4311-957d-5c9932ea9e65\") " pod="opendatahub/model-serving-api-54d89bd5fc-szgjq"
Jul 30 13:05:26.380034 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:05:26.379733    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-47k2l\" (UniqueName: \"kubernetes.io/projected/bb3f0039-55d7-4311-957d-5c9932ea9e65-kube-api-access-47k2l\") pod \"model-serving-api-54d89bd5fc-szgjq\" (UID: \"bb3f0039-55d7-4311-957d-5c9932ea9e65\") " pod="opendatahub/model-serving-api-54d89bd5fc-szgjq"
Jul 30 13:05:26.408737 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:05:26.408703    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-54d6c599cc-7s9mh"]
Jul 30 13:05:26.411693 ip-10-0-143-153 kubenswrapper[2566]: W0730 13:05:26.411664    2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0238e0f1_c28e_45cc_a028_aa78c8a3e130.slice/crio-034645bf48953da3e0737976ea34e6ad64d41e15d2949385d8025f104ac55b9b WatchSource:0}: Error finding container 034645bf48953da3e0737976ea34e6ad64d41e15d2949385d8025f104ac55b9b: Status 404 returned error can't find the container with id 034645bf48953da3e0737976ea34e6ad64d41e15d2949385d8025f104ac55b9b
Jul 30 13:05:26.480886 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:05:26.480846    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-47k2l\" (UniqueName: \"kubernetes.io/projected/bb3f0039-55d7-4311-957d-5c9932ea9e65-kube-api-access-47k2l\") pod \"model-serving-api-54d89bd5fc-szgjq\" (UID: \"bb3f0039-55d7-4311-957d-5c9932ea9e65\") " pod="opendatahub/model-serving-api-54d89bd5fc-szgjq"
Jul 30 13:05:26.481046 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:05:26.480925    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/bb3f0039-55d7-4311-957d-5c9932ea9e65-tls-certs\") pod \"model-serving-api-54d89bd5fc-szgjq\" (UID: \"bb3f0039-55d7-4311-957d-5c9932ea9e65\") " pod="opendatahub/model-serving-api-54d89bd5fc-szgjq"
Jul 30 13:05:26.481126 ip-10-0-143-153 kubenswrapper[2566]: E0730 13:05:26.481105    2566 secret.go:189] Couldn't get secret opendatahub/model-serving-api-tls: secret "model-serving-api-tls" not found
Jul 30 13:05:26.481194 ip-10-0-143-153 kubenswrapper[2566]: E0730 13:05:26.481183    2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/bb3f0039-55d7-4311-957d-5c9932ea9e65-tls-certs podName:bb3f0039-55d7-4311-957d-5c9932ea9e65 nodeName:}" failed. No retries permitted until 2026-07-30 13:05:26.981168391 +0000 UTC m=+355.909856633 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "tls-certs" (UniqueName: "kubernetes.io/secret/bb3f0039-55d7-4311-957d-5c9932ea9e65-tls-certs") pod "model-serving-api-54d89bd5fc-szgjq" (UID: "bb3f0039-55d7-4311-957d-5c9932ea9e65") : secret "model-serving-api-tls" not found
Jul 30 13:05:26.494817 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:05:26.494793    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-47k2l\" (UniqueName: \"kubernetes.io/projected/bb3f0039-55d7-4311-957d-5c9932ea9e65-kube-api-access-47k2l\") pod \"model-serving-api-54d89bd5fc-szgjq\" (UID: \"bb3f0039-55d7-4311-957d-5c9932ea9e65\") " pod="opendatahub/model-serving-api-54d89bd5fc-szgjq"
Jul 30 13:05:26.903266 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:05:26.903234    2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7b7995d5cd-t58rw"]
Jul 30 13:05:26.906675 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:05:26.906628    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-t58rw"
Jul 30 13:05:26.908482 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:05:26.908394    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istio-kubeconfig\""
Jul 30 13:05:26.908482 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:05:26.908426    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"cacerts\""
Jul 30 13:05:26.908482 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:05:26.908428    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-tls\""
Jul 30 13:05:26.908734 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:05:26.908485    2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\""
Jul 30 13:05:26.908802 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:05:26.908779    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-openshift-gateway-dockercfg-f2lrp\""
Jul 30 13:05:26.920582 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:05:26.920562    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7b7995d5cd-t58rw"]
Jul 30 13:05:26.986582 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:05:26.986539    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/5728cf87-4fde-4edb-bf8a-56b2f90b553b-local-certs\") pod \"istiod-openshift-gateway-7b7995d5cd-t58rw\" (UID: \"5728cf87-4fde-4edb-bf8a-56b2f90b553b\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-t58rw"
Jul 30 13:05:26.986582 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:05:26.986580    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/5728cf87-4fde-4edb-bf8a-56b2f90b553b-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-7b7995d5cd-t58rw\" (UID: \"5728cf87-4fde-4edb-bf8a-56b2f90b553b\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-t58rw"
Jul 30 13:05:26.986830 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:05:26.986662    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/5728cf87-4fde-4edb-bf8a-56b2f90b553b-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-7b7995d5cd-t58rw\" (UID: \"5728cf87-4fde-4edb-bf8a-56b2f90b553b\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-t58rw"
Jul 30 13:05:26.986830 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:05:26.986688    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/5728cf87-4fde-4edb-bf8a-56b2f90b553b-istio-kubeconfig\") pod \"istiod-openshift-gateway-7b7995d5cd-t58rw\" (UID: \"5728cf87-4fde-4edb-bf8a-56b2f90b553b\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-t58rw"
Jul 30 13:05:26.986830 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:05:26.986724    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/bb3f0039-55d7-4311-957d-5c9932ea9e65-tls-certs\") pod \"model-serving-api-54d89bd5fc-szgjq\" (UID: \"bb3f0039-55d7-4311-957d-5c9932ea9e65\") " pod="opendatahub/model-serving-api-54d89bd5fc-szgjq"
Jul 30 13:05:26.986830 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:05:26.986809    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/5728cf87-4fde-4edb-bf8a-56b2f90b553b-istio-token\") pod \"istiod-openshift-gateway-7b7995d5cd-t58rw\" (UID: \"5728cf87-4fde-4edb-bf8a-56b2f90b553b\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-t58rw"
Jul 30 13:05:26.987027 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:05:26.986868    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4h4xx\" (UniqueName: \"kubernetes.io/projected/5728cf87-4fde-4edb-bf8a-56b2f90b553b-kube-api-access-4h4xx\") pod \"istiod-openshift-gateway-7b7995d5cd-t58rw\" (UID: \"5728cf87-4fde-4edb-bf8a-56b2f90b553b\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-t58rw"
Jul 30 13:05:26.987027 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:05:26.986946    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/5728cf87-4fde-4edb-bf8a-56b2f90b553b-cacerts\") pod \"istiod-openshift-gateway-7b7995d5cd-t58rw\" (UID: \"5728cf87-4fde-4edb-bf8a-56b2f90b553b\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-t58rw"
Jul 30 13:05:26.990186 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:05:26.990135    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/bb3f0039-55d7-4311-957d-5c9932ea9e65-tls-certs\") pod \"model-serving-api-54d89bd5fc-szgjq\" (UID: \"bb3f0039-55d7-4311-957d-5c9932ea9e65\") " pod="opendatahub/model-serving-api-54d89bd5fc-szgjq"
Jul 30 13:05:27.082429 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:05:27.082390    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-54d6c599cc-7s9mh" event={"ID":"0238e0f1-c28e-45cc-a028-aa78c8a3e130","Type":"ContainerStarted","Data":"034645bf48953da3e0737976ea34e6ad64d41e15d2949385d8025f104ac55b9b"}
Jul 30 13:05:27.087855 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:05:27.087823    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/5728cf87-4fde-4edb-bf8a-56b2f90b553b-cacerts\") pod \"istiod-openshift-gateway-7b7995d5cd-t58rw\" (UID: \"5728cf87-4fde-4edb-bf8a-56b2f90b553b\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-t58rw"
Jul 30 13:05:27.088009 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:05:27.087869    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/5728cf87-4fde-4edb-bf8a-56b2f90b553b-local-certs\") pod \"istiod-openshift-gateway-7b7995d5cd-t58rw\" (UID: \"5728cf87-4fde-4edb-bf8a-56b2f90b553b\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-t58rw"
Jul 30 13:05:27.088009 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:05:27.087994    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/5728cf87-4fde-4edb-bf8a-56b2f90b553b-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-7b7995d5cd-t58rw\" (UID: \"5728cf87-4fde-4edb-bf8a-56b2f90b553b\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-t58rw"
Jul 30 13:05:27.088162 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:05:27.088092    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/5728cf87-4fde-4edb-bf8a-56b2f90b553b-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-7b7995d5cd-t58rw\" (UID: \"5728cf87-4fde-4edb-bf8a-56b2f90b553b\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-t58rw"
Jul 30 13:05:27.088162 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:05:27.088123    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/5728cf87-4fde-4edb-bf8a-56b2f90b553b-istio-kubeconfig\") pod \"istiod-openshift-gateway-7b7995d5cd-t58rw\" (UID: \"5728cf87-4fde-4edb-bf8a-56b2f90b553b\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-t58rw"
Jul 30 13:05:27.088274 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:05:27.088174    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/5728cf87-4fde-4edb-bf8a-56b2f90b553b-istio-token\") pod \"istiod-openshift-gateway-7b7995d5cd-t58rw\" (UID: \"5728cf87-4fde-4edb-bf8a-56b2f90b553b\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-t58rw"
Jul 30 13:05:27.088274 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:05:27.088208    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4h4xx\" (UniqueName: \"kubernetes.io/projected/5728cf87-4fde-4edb-bf8a-56b2f90b553b-kube-api-access-4h4xx\") pod \"istiod-openshift-gateway-7b7995d5cd-t58rw\" (UID: \"5728cf87-4fde-4edb-bf8a-56b2f90b553b\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-t58rw"
Jul 30 13:05:27.089189 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:05:27.089136    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/5728cf87-4fde-4edb-bf8a-56b2f90b553b-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-7b7995d5cd-t58rw\" (UID: \"5728cf87-4fde-4edb-bf8a-56b2f90b553b\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-t58rw"
Jul 30 13:05:27.090821 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:05:27.090799    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/5728cf87-4fde-4edb-bf8a-56b2f90b553b-local-certs\") pod \"istiod-openshift-gateway-7b7995d5cd-t58rw\" (UID: \"5728cf87-4fde-4edb-bf8a-56b2f90b553b\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-t58rw"
Jul 30 13:05:27.090943 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:05:27.090831    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/5728cf87-4fde-4edb-bf8a-56b2f90b553b-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-7b7995d5cd-t58rw\" (UID: \"5728cf87-4fde-4edb-bf8a-56b2f90b553b\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-t58rw"
Jul 30 13:05:27.091005 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:05:27.090974    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/5728cf87-4fde-4edb-bf8a-56b2f90b553b-cacerts\") pod \"istiod-openshift-gateway-7b7995d5cd-t58rw\" (UID: \"5728cf87-4fde-4edb-bf8a-56b2f90b553b\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-t58rw"
Jul 30 13:05:27.091330 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:05:27.091309    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/5728cf87-4fde-4edb-bf8a-56b2f90b553b-istio-kubeconfig\") pod \"istiod-openshift-gateway-7b7995d5cd-t58rw\" (UID: \"5728cf87-4fde-4edb-bf8a-56b2f90b553b\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-t58rw"
Jul 30 13:05:27.096538 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:05:27.096515    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4h4xx\" (UniqueName: \"kubernetes.io/projected/5728cf87-4fde-4edb-bf8a-56b2f90b553b-kube-api-access-4h4xx\") pod \"istiod-openshift-gateway-7b7995d5cd-t58rw\" (UID: \"5728cf87-4fde-4edb-bf8a-56b2f90b553b\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-t58rw"
Jul 30 13:05:27.097191 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:05:27.097170    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/5728cf87-4fde-4edb-bf8a-56b2f90b553b-istio-token\") pod \"istiod-openshift-gateway-7b7995d5cd-t58rw\" (UID: \"5728cf87-4fde-4edb-bf8a-56b2f90b553b\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-t58rw"
Jul 30 13:05:27.177873 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:05:27.177602    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/model-serving-api-54d89bd5fc-szgjq"
Jul 30 13:05:27.218698 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:05:27.218427    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-t58rw"
Jul 30 13:05:27.351304 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:05:27.351234    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/model-serving-api-54d89bd5fc-szgjq"]
Jul 30 13:05:27.355722 ip-10-0-143-153 kubenswrapper[2566]: W0730 13:05:27.355688    2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbb3f0039_55d7_4311_957d_5c9932ea9e65.slice/crio-eee81863161377721a629e8403d14f4222eae3c17eec803243ec56b0fffed0dc WatchSource:0}: Error finding container eee81863161377721a629e8403d14f4222eae3c17eec803243ec56b0fffed0dc: Status 404 returned error can't find the container with id eee81863161377721a629e8403d14f4222eae3c17eec803243ec56b0fffed0dc
Jul 30 13:05:27.385136 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:05:27.385000    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7b7995d5cd-t58rw"]
Jul 30 13:05:27.387660 ip-10-0-143-153 kubenswrapper[2566]: W0730 13:05:27.387618    2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5728cf87_4fde_4edb_bf8a_56b2f90b553b.slice/crio-6d6720ef256df2bdc1af23b7c3ede41aa2cd66e6f9a718b2d35d01e201347819 WatchSource:0}: Error finding container 6d6720ef256df2bdc1af23b7c3ede41aa2cd66e6f9a718b2d35d01e201347819: Status 404 returned error can't find the container with id 6d6720ef256df2bdc1af23b7c3ede41aa2cd66e6f9a718b2d35d01e201347819
Jul 30 13:05:28.089100 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:05:28.089051    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/model-serving-api-54d89bd5fc-szgjq" event={"ID":"bb3f0039-55d7-4311-957d-5c9932ea9e65","Type":"ContainerStarted","Data":"eee81863161377721a629e8403d14f4222eae3c17eec803243ec56b0fffed0dc"}
Jul 30 13:05:28.090913 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:05:28.090873    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-t58rw" event={"ID":"5728cf87-4fde-4edb-bf8a-56b2f90b553b","Type":"ContainerStarted","Data":"6d6720ef256df2bdc1af23b7c3ede41aa2cd66e6f9a718b2d35d01e201347819"}
Jul 30 13:05:31.105832 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:05:31.105791    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-54d6c599cc-7s9mh" event={"ID":"0238e0f1-c28e-45cc-a028-aa78c8a3e130","Type":"ContainerStarted","Data":"07e427eb84aa2d8c881d815d737503b6a46b0062ff4c2c02c3b7496c2cd48873"}
Jul 30 13:05:31.123227 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:05:31.123178    2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/kube-auth-proxy-54d6c599cc-7s9mh" podStartSLOduration=2.847823156 podStartE2EDuration="6.123161103s" totalImagesPullingTime="3.275337947s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-30 13:05:25 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 13:05:31.121036599 +0000 UTC m=+360.049724863" watchObservedRunningTime="2026-07-30 13:05:31.123161103 +0000 UTC m=+360.051849389"
Jul 30 13:05:31.233718 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:05:31.233684    2566 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 30 13:05:31.233796 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:05:31.233749    2566 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 30 13:05:32.111982 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:05:32.111931    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/model-serving-api-54d89bd5fc-szgjq" event={"ID":"bb3f0039-55d7-4311-957d-5c9932ea9e65","Type":"ContainerStarted","Data":"784c0d9569ab6ac385375a2381974a4b711e44f81267d7eaa88aba93ecba3edb"}
Jul 30 13:05:32.112478 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:05:32.112014    2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/model-serving-api-54d89bd5fc-szgjq"
Jul 30 13:05:32.113679 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:05:32.113649    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/odh-model-controller-7998c67dc4-44z8n" event={"ID":"4ab61f41-6eff-4806-968d-98a6d5573f4e","Type":"ContainerStarted","Data":"efb324ec22e021ba5c2e6c2a70ae5e62bb6220b069439182b7302953780c15cc"}
Jul 30 13:05:32.113818 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:05:32.113738    2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/odh-model-controller-7998c67dc4-44z8n"
Jul 30 13:05:32.115781 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:05:32.115755    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-t58rw" event={"ID":"5728cf87-4fde-4edb-bf8a-56b2f90b553b","Type":"ContainerStarted","Data":"080d09fa260e8d8f426d3b5d090c7be4053b4ad67c2538042e9776bb05513d39"}
Jul 30 13:05:32.132467 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:05:32.132411    2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/model-serving-api-54d89bd5fc-szgjq" podStartSLOduration=2.313362293 podStartE2EDuration="6.132396227s" totalImagesPullingTime="3.819033934s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-30 13:05:26 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 13:05:32.130816221 +0000 UTC m=+361.059504486" watchObservedRunningTime="2026-07-30 13:05:32.132396227 +0000 UTC m=+361.061084490"
Jul 30 13:05:32.150765 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:05:32.150709    2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/odh-model-controller-7998c67dc4-44z8n" podStartSLOduration=3.437974039 podStartE2EDuration="7.150693043s" totalImagesPullingTime="3.712719004s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-30 13:05:25 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 13:05:32.148885504 +0000 UTC m=+361.077573810" watchObservedRunningTime="2026-07-30 13:05:32.150693043 +0000 UTC m=+361.079381341"
Jul 30 13:05:32.172168 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:05:32.172122    2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-t58rw" podStartSLOduration=2.328675354 podStartE2EDuration="6.172106233s" totalImagesPullingTime="3.843430879s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-30 13:05:26 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 13:05:32.170867 +0000 UTC m=+361.099555263" watchObservedRunningTime="2026-07-30 13:05:32.172106233 +0000 UTC m=+361.100794496"
Jul 30 13:05:33.120390 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:05:33.120349    2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-t58rw"
Jul 30 13:05:33.121827 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:05:33.121804    2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-t58rw"
Jul 30 13:05:36.071472 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:05:36.071433    2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/kserve-controller-manager-d6f4b65b8-v6nkv"]
Jul 30 13:05:36.076424 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:05:36.076405    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/kserve-controller-manager-d6f4b65b8-v6nkv"
Jul 30 13:05:36.078638 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:05:36.078622    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"kserve-webhook-server-cert\""
Jul 30 13:05:36.079198 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:05:36.079184    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"kserve-controller-manager-dockercfg-44vqp\""
Jul 30 13:05:36.090091 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:05:36.090053    2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/llmisvc-controller-manager-777c6bd7d5-7hl55"]
Jul 30 13:05:36.093146 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:05:36.093131    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-7hl55"
Jul 30 13:05:36.095014 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:05:36.094992    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"llmisvc-webhook-server-cert\""
Jul 30 13:05:36.095184 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:05:36.095152    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"llmisvc-controller-manager-dockercfg-4dpbn\""
Jul 30 13:05:36.096834 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:05:36.096814    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/kserve-controller-manager-d6f4b65b8-v6nkv"]
Jul 30 13:05:36.113733 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:05:36.113711    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/llmisvc-controller-manager-777c6bd7d5-7hl55"]
Jul 30 13:05:36.172803 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:05:36.172763    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hhpf7\" (UniqueName: \"kubernetes.io/projected/9a4345c8-f997-4e6e-a9d0-af2faaac547f-kube-api-access-hhpf7\") pod \"kserve-controller-manager-d6f4b65b8-v6nkv\" (UID: \"9a4345c8-f997-4e6e-a9d0-af2faaac547f\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-v6nkv"
Jul 30 13:05:36.172995 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:05:36.172829    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/9a4345c8-f997-4e6e-a9d0-af2faaac547f-cert\") pod \"kserve-controller-manager-d6f4b65b8-v6nkv\" (UID: \"9a4345c8-f997-4e6e-a9d0-af2faaac547f\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-v6nkv"
Jul 30 13:05:36.273828 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:05:36.273793    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hhpf7\" (UniqueName: \"kubernetes.io/projected/9a4345c8-f997-4e6e-a9d0-af2faaac547f-kube-api-access-hhpf7\") pod \"kserve-controller-manager-d6f4b65b8-v6nkv\" (UID: \"9a4345c8-f997-4e6e-a9d0-af2faaac547f\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-v6nkv"
Jul 30 13:05:36.273992 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:05:36.273838    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/323af4a0-6392-43b7-9b27-1454e4505327-cert\") pod \"llmisvc-controller-manager-777c6bd7d5-7hl55\" (UID: \"323af4a0-6392-43b7-9b27-1454e4505327\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-7hl55"
Jul 30 13:05:36.273992 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:05:36.273963    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hdckg\" (UniqueName: \"kubernetes.io/projected/323af4a0-6392-43b7-9b27-1454e4505327-kube-api-access-hdckg\") pod \"llmisvc-controller-manager-777c6bd7d5-7hl55\" (UID: \"323af4a0-6392-43b7-9b27-1454e4505327\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-7hl55"
Jul 30 13:05:36.274062 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:05:36.274027    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/9a4345c8-f997-4e6e-a9d0-af2faaac547f-cert\") pod \"kserve-controller-manager-d6f4b65b8-v6nkv\" (UID: \"9a4345c8-f997-4e6e-a9d0-af2faaac547f\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-v6nkv"
Jul 30 13:05:36.274171 ip-10-0-143-153 kubenswrapper[2566]: E0730 13:05:36.274156    2566 secret.go:189] Couldn't get secret opendatahub/kserve-webhook-server-cert: secret "kserve-webhook-server-cert" not found
Jul 30 13:05:36.274230 ip-10-0-143-153 kubenswrapper[2566]: E0730 13:05:36.274220    2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9a4345c8-f997-4e6e-a9d0-af2faaac547f-cert podName:9a4345c8-f997-4e6e-a9d0-af2faaac547f nodeName:}" failed. No retries permitted until 2026-07-30 13:05:36.774200069 +0000 UTC m=+365.702888316 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/9a4345c8-f997-4e6e-a9d0-af2faaac547f-cert") pod "kserve-controller-manager-d6f4b65b8-v6nkv" (UID: "9a4345c8-f997-4e6e-a9d0-af2faaac547f") : secret "kserve-webhook-server-cert" not found
Jul 30 13:05:36.308625 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:05:36.308589    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hhpf7\" (UniqueName: \"kubernetes.io/projected/9a4345c8-f997-4e6e-a9d0-af2faaac547f-kube-api-access-hhpf7\") pod \"kserve-controller-manager-d6f4b65b8-v6nkv\" (UID: \"9a4345c8-f997-4e6e-a9d0-af2faaac547f\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-v6nkv"
Jul 30 13:05:36.375046 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:05:36.374970    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/323af4a0-6392-43b7-9b27-1454e4505327-cert\") pod \"llmisvc-controller-manager-777c6bd7d5-7hl55\" (UID: \"323af4a0-6392-43b7-9b27-1454e4505327\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-7hl55"
Jul 30 13:05:36.375046 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:05:36.375008    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hdckg\" (UniqueName: \"kubernetes.io/projected/323af4a0-6392-43b7-9b27-1454e4505327-kube-api-access-hdckg\") pod \"llmisvc-controller-manager-777c6bd7d5-7hl55\" (UID: \"323af4a0-6392-43b7-9b27-1454e4505327\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-7hl55"
Jul 30 13:05:36.377599 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:05:36.377576    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/323af4a0-6392-43b7-9b27-1454e4505327-cert\") pod \"llmisvc-controller-manager-777c6bd7d5-7hl55\" (UID: \"323af4a0-6392-43b7-9b27-1454e4505327\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-7hl55"
Jul 30 13:05:36.391388 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:05:36.391355    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hdckg\" (UniqueName: \"kubernetes.io/projected/323af4a0-6392-43b7-9b27-1454e4505327-kube-api-access-hdckg\") pod \"llmisvc-controller-manager-777c6bd7d5-7hl55\" (UID: \"323af4a0-6392-43b7-9b27-1454e4505327\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-7hl55"
Jul 30 13:05:36.404303 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:05:36.404279    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-7hl55"
Jul 30 13:05:36.537422 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:05:36.537388    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/llmisvc-controller-manager-777c6bd7d5-7hl55"]
Jul 30 13:05:36.540789 ip-10-0-143-153 kubenswrapper[2566]: W0730 13:05:36.540763    2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod323af4a0_6392_43b7_9b27_1454e4505327.slice/crio-ad2d6ea01801be89459a381fec45ccc7b298bf489ab2f26c79961de3f45dbd55 WatchSource:0}: Error finding container ad2d6ea01801be89459a381fec45ccc7b298bf489ab2f26c79961de3f45dbd55: Status 404 returned error can't find the container with id ad2d6ea01801be89459a381fec45ccc7b298bf489ab2f26c79961de3f45dbd55
Jul 30 13:05:36.778339 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:05:36.778293    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/9a4345c8-f997-4e6e-a9d0-af2faaac547f-cert\") pod \"kserve-controller-manager-d6f4b65b8-v6nkv\" (UID: \"9a4345c8-f997-4e6e-a9d0-af2faaac547f\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-v6nkv"
Jul 30 13:05:36.780747 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:05:36.780729    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/9a4345c8-f997-4e6e-a9d0-af2faaac547f-cert\") pod \"kserve-controller-manager-d6f4b65b8-v6nkv\" (UID: \"9a4345c8-f997-4e6e-a9d0-af2faaac547f\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-v6nkv"
Jul 30 13:05:36.988316 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:05:36.988275    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/kserve-controller-manager-d6f4b65b8-v6nkv"
Jul 30 13:05:37.122645 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:05:37.122616    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/kserve-controller-manager-d6f4b65b8-v6nkv"]
Jul 30 13:05:37.125165 ip-10-0-143-153 kubenswrapper[2566]: W0730 13:05:37.125139    2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9a4345c8_f997_4e6e_a9d0_af2faaac547f.slice/crio-aaa74be555f02676089c520acfd56cf7ad7f9b20e05483517bede5c059d6759d WatchSource:0}: Error finding container aaa74be555f02676089c520acfd56cf7ad7f9b20e05483517bede5c059d6759d: Status 404 returned error can't find the container with id aaa74be555f02676089c520acfd56cf7ad7f9b20e05483517bede5c059d6759d
Jul 30 13:05:37.136485 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:05:37.136461    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-7hl55" event={"ID":"323af4a0-6392-43b7-9b27-1454e4505327","Type":"ContainerStarted","Data":"ad2d6ea01801be89459a381fec45ccc7b298bf489ab2f26c79961de3f45dbd55"}
Jul 30 13:05:37.137486 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:05:37.137466    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/kserve-controller-manager-d6f4b65b8-v6nkv" event={"ID":"9a4345c8-f997-4e6e-a9d0-af2faaac547f","Type":"ContainerStarted","Data":"aaa74be555f02676089c520acfd56cf7ad7f9b20e05483517bede5c059d6759d"}
Jul 30 13:05:41.159162 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:05:41.159119    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-7hl55" event={"ID":"323af4a0-6392-43b7-9b27-1454e4505327","Type":"ContainerStarted","Data":"9d0e91f20606a49f21ccd7291aeec60891141f3287d36ee0d15ec48678366353"}
Jul 30 13:05:41.159609 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:05:41.159303    2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-7hl55"
Jul 30 13:05:41.160571 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:05:41.160544    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/kserve-controller-manager-d6f4b65b8-v6nkv" event={"ID":"9a4345c8-f997-4e6e-a9d0-af2faaac547f","Type":"ContainerStarted","Data":"cf07f6e2d56bd62e7da9f1348e39207cafb3f32949b8b8f61080ae98fdb62775"}
Jul 30 13:05:41.160697 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:05:41.160681    2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/kserve-controller-manager-d6f4b65b8-v6nkv"
Jul 30 13:05:41.176606 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:05:41.176565    2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-7hl55" podStartSLOduration=1.140109606 podStartE2EDuration="5.176551781s" totalImagesPullingTime="4.036442175s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-30 13:05:36 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 13:05:41.174953405 +0000 UTC m=+370.103641679" watchObservedRunningTime="2026-07-30 13:05:41.176551781 +0000 UTC m=+370.105240044"
Jul 30 13:05:41.193289 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:05:41.193245    2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/kserve-controller-manager-d6f4b65b8-v6nkv" podStartSLOduration=1.744950284 podStartE2EDuration="5.193231076s" totalImagesPullingTime="3.448280792s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-30 13:05:36 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 13:05:41.191134787 +0000 UTC m=+370.119823046" watchObservedRunningTime="2026-07-30 13:05:41.193231076 +0000 UTC m=+370.121919339"
Jul 30 13:05:43.122450 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:05:43.122412    2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/odh-model-controller-7998c67dc4-44z8n"
Jul 30 13:05:43.124549 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:05:43.124528    2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/model-serving-api-54d89bd5fc-szgjq"
Jul 30 13:05:46.574602 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:05:46.574566    2566 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7b7995d5cd-t58rw"]
Jul 30 13:05:46.575171 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:05:46.574750    2566 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-t58rw" podUID="5728cf87-4fde-4edb-bf8a-56b2f90b553b" containerName="discovery" containerID="cri-o://080d09fa260e8d8f426d3b5d090c7be4053b4ad67c2538042e9776bb05513d39" gracePeriod=30
Jul 30 13:05:46.818827 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:05:46.818803    2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-t58rw"
Jul 30 13:05:46.865525 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:05:46.865446    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/5728cf87-4fde-4edb-bf8a-56b2f90b553b-istio-csr-ca-configmap\") pod \"5728cf87-4fde-4edb-bf8a-56b2f90b553b\" (UID: \"5728cf87-4fde-4edb-bf8a-56b2f90b553b\") "
Jul 30 13:05:46.865525 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:05:46.865516    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-4h4xx\" (UniqueName: \"kubernetes.io/projected/5728cf87-4fde-4edb-bf8a-56b2f90b553b-kube-api-access-4h4xx\") pod \"5728cf87-4fde-4edb-bf8a-56b2f90b553b\" (UID: \"5728cf87-4fde-4edb-bf8a-56b2f90b553b\") "
Jul 30 13:05:46.865748 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:05:46.865558    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/5728cf87-4fde-4edb-bf8a-56b2f90b553b-istio-csr-dns-cert\") pod \"5728cf87-4fde-4edb-bf8a-56b2f90b553b\" (UID: \"5728cf87-4fde-4edb-bf8a-56b2f90b553b\") "
Jul 30 13:05:46.865748 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:05:46.865594    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/5728cf87-4fde-4edb-bf8a-56b2f90b553b-istio-token\") pod \"5728cf87-4fde-4edb-bf8a-56b2f90b553b\" (UID: \"5728cf87-4fde-4edb-bf8a-56b2f90b553b\") "
Jul 30 13:05:46.865748 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:05:46.865656    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/5728cf87-4fde-4edb-bf8a-56b2f90b553b-istio-kubeconfig\") pod \"5728cf87-4fde-4edb-bf8a-56b2f90b553b\" (UID: \"5728cf87-4fde-4edb-bf8a-56b2f90b553b\") "
Jul 30 13:05:46.865748 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:05:46.865744    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/5728cf87-4fde-4edb-bf8a-56b2f90b553b-local-certs\") pod \"5728cf87-4fde-4edb-bf8a-56b2f90b553b\" (UID: \"5728cf87-4fde-4edb-bf8a-56b2f90b553b\") "
Jul 30 13:05:46.865949 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:05:46.865770    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/5728cf87-4fde-4edb-bf8a-56b2f90b553b-cacerts\") pod \"5728cf87-4fde-4edb-bf8a-56b2f90b553b\" (UID: \"5728cf87-4fde-4edb-bf8a-56b2f90b553b\") "
Jul 30 13:05:46.865949 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:05:46.865891    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5728cf87-4fde-4edb-bf8a-56b2f90b553b-istio-csr-ca-configmap" (OuterVolumeSpecName: "istio-csr-ca-configmap") pod "5728cf87-4fde-4edb-bf8a-56b2f90b553b" (UID: "5728cf87-4fde-4edb-bf8a-56b2f90b553b"). InnerVolumeSpecName "istio-csr-ca-configmap". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 30 13:05:46.866128 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:05:46.866094    2566 reconciler_common.go:299] "Volume detached for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/5728cf87-4fde-4edb-bf8a-56b2f90b553b-istio-csr-ca-configmap\") on node \"ip-10-0-143-153.ec2.internal\" DevicePath \"\""
Jul 30 13:05:46.868195 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:05:46.868164    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5728cf87-4fde-4edb-bf8a-56b2f90b553b-istio-kubeconfig" (OuterVolumeSpecName: "istio-kubeconfig") pod "5728cf87-4fde-4edb-bf8a-56b2f90b553b" (UID: "5728cf87-4fde-4edb-bf8a-56b2f90b553b"). InnerVolumeSpecName "istio-kubeconfig". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 30 13:05:46.868384 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:05:46.868358    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5728cf87-4fde-4edb-bf8a-56b2f90b553b-cacerts" (OuterVolumeSpecName: "cacerts") pod "5728cf87-4fde-4edb-bf8a-56b2f90b553b" (UID: "5728cf87-4fde-4edb-bf8a-56b2f90b553b"). InnerVolumeSpecName "cacerts". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 30 13:05:46.868463 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:05:46.868387    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5728cf87-4fde-4edb-bf8a-56b2f90b553b-istio-token" (OuterVolumeSpecName: "istio-token") pod "5728cf87-4fde-4edb-bf8a-56b2f90b553b" (UID: "5728cf87-4fde-4edb-bf8a-56b2f90b553b"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 30 13:05:46.868463 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:05:46.868431    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5728cf87-4fde-4edb-bf8a-56b2f90b553b-kube-api-access-4h4xx" (OuterVolumeSpecName: "kube-api-access-4h4xx") pod "5728cf87-4fde-4edb-bf8a-56b2f90b553b" (UID: "5728cf87-4fde-4edb-bf8a-56b2f90b553b"). InnerVolumeSpecName "kube-api-access-4h4xx". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 30 13:05:46.868566 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:05:46.868496    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5728cf87-4fde-4edb-bf8a-56b2f90b553b-local-certs" (OuterVolumeSpecName: "local-certs") pod "5728cf87-4fde-4edb-bf8a-56b2f90b553b" (UID: "5728cf87-4fde-4edb-bf8a-56b2f90b553b"). InnerVolumeSpecName "local-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 30 13:05:46.868620 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:05:46.868594    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5728cf87-4fde-4edb-bf8a-56b2f90b553b-istio-csr-dns-cert" (OuterVolumeSpecName: "istio-csr-dns-cert") pod "5728cf87-4fde-4edb-bf8a-56b2f90b553b" (UID: "5728cf87-4fde-4edb-bf8a-56b2f90b553b"). InnerVolumeSpecName "istio-csr-dns-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 30 13:05:46.967392 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:05:46.967358    2566 reconciler_common.go:299] "Volume detached for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/5728cf87-4fde-4edb-bf8a-56b2f90b553b-istio-csr-dns-cert\") on node \"ip-10-0-143-153.ec2.internal\" DevicePath \"\""
Jul 30 13:05:46.967392 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:05:46.967387    2566 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/5728cf87-4fde-4edb-bf8a-56b2f90b553b-istio-token\") on node \"ip-10-0-143-153.ec2.internal\" DevicePath \"\""
Jul 30 13:05:46.967392 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:05:46.967396    2566 reconciler_common.go:299] "Volume detached for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/5728cf87-4fde-4edb-bf8a-56b2f90b553b-istio-kubeconfig\") on node \"ip-10-0-143-153.ec2.internal\" DevicePath \"\""
Jul 30 13:05:46.967615 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:05:46.967403    2566 reconciler_common.go:299] "Volume detached for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/5728cf87-4fde-4edb-bf8a-56b2f90b553b-local-certs\") on node \"ip-10-0-143-153.ec2.internal\" DevicePath \"\""
Jul 30 13:05:46.967615 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:05:46.967411    2566 reconciler_common.go:299] "Volume detached for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/5728cf87-4fde-4edb-bf8a-56b2f90b553b-cacerts\") on node \"ip-10-0-143-153.ec2.internal\" DevicePath \"\""
Jul 30 13:05:46.967615 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:05:46.967419    2566 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-4h4xx\" (UniqueName: \"kubernetes.io/projected/5728cf87-4fde-4edb-bf8a-56b2f90b553b-kube-api-access-4h4xx\") on node \"ip-10-0-143-153.ec2.internal\" DevicePath \"\""
Jul 30 13:05:47.194155 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:05:47.194119    2566 generic.go:356] "Generic (PLEG): container finished" podID="5728cf87-4fde-4edb-bf8a-56b2f90b553b" containerID="080d09fa260e8d8f426d3b5d090c7be4053b4ad67c2538042e9776bb05513d39" exitCode=0
Jul 30 13:05:47.194323 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:05:47.194174    2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-t58rw"
Jul 30 13:05:47.194323 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:05:47.194210    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-t58rw" event={"ID":"5728cf87-4fde-4edb-bf8a-56b2f90b553b","Type":"ContainerDied","Data":"080d09fa260e8d8f426d3b5d090c7be4053b4ad67c2538042e9776bb05513d39"}
Jul 30 13:05:47.194323 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:05:47.194263    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-t58rw" event={"ID":"5728cf87-4fde-4edb-bf8a-56b2f90b553b","Type":"ContainerDied","Data":"6d6720ef256df2bdc1af23b7c3ede41aa2cd66e6f9a718b2d35d01e201347819"}
Jul 30 13:05:47.194323 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:05:47.194283    2566 scope.go:117] "RemoveContainer" containerID="080d09fa260e8d8f426d3b5d090c7be4053b4ad67c2538042e9776bb05513d39"
Jul 30 13:05:47.203297 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:05:47.203280    2566 scope.go:117] "RemoveContainer" containerID="080d09fa260e8d8f426d3b5d090c7be4053b4ad67c2538042e9776bb05513d39"
Jul 30 13:05:47.203559 ip-10-0-143-153 kubenswrapper[2566]: E0730 13:05:47.203534    2566 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"080d09fa260e8d8f426d3b5d090c7be4053b4ad67c2538042e9776bb05513d39\": container with ID starting with 080d09fa260e8d8f426d3b5d090c7be4053b4ad67c2538042e9776bb05513d39 not found: ID does not exist" containerID="080d09fa260e8d8f426d3b5d090c7be4053b4ad67c2538042e9776bb05513d39"
Jul 30 13:05:47.203637 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:05:47.203566    2566 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"080d09fa260e8d8f426d3b5d090c7be4053b4ad67c2538042e9776bb05513d39"} err="failed to get container status \"080d09fa260e8d8f426d3b5d090c7be4053b4ad67c2538042e9776bb05513d39\": rpc error: code = NotFound desc = could not find container \"080d09fa260e8d8f426d3b5d090c7be4053b4ad67c2538042e9776bb05513d39\": container with ID starting with 080d09fa260e8d8f426d3b5d090c7be4053b4ad67c2538042e9776bb05513d39 not found: ID does not exist"
Jul 30 13:05:47.216761 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:05:47.216728    2566 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7b7995d5cd-t58rw"]
Jul 30 13:05:47.220313 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:05:47.220289    2566 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7b7995d5cd-t58rw"]
Jul 30 13:05:47.626423 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:05:47.626348    2566 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="5728cf87-4fde-4edb-bf8a-56b2f90b553b" path="/var/lib/kubelet/pods/5728cf87-4fde-4edb-bf8a-56b2f90b553b/volumes"
Jul 30 13:06:12.167657 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:06:12.167613    2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-7hl55"
Jul 30 13:06:12.170608 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:06:12.170584    2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/kserve-controller-manager-d6f4b65b8-v6nkv"
Jul 30 13:06:26.559487 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:06:26.559454    2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-8k9zv"]
Jul 30 13:06:26.560577 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:06:26.560552    2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5728cf87-4fde-4edb-bf8a-56b2f90b553b" containerName="discovery"
Jul 30 13:06:26.560577 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:06:26.560579    2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="5728cf87-4fde-4edb-bf8a-56b2f90b553b" containerName="discovery"
Jul 30 13:06:26.560756 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:06:26.560654    2566 memory_manager.go:368] "RemoveStaleState removing state" podUID="5728cf87-4fde-4edb-bf8a-56b2f90b553b" containerName="discovery"
Jul 30 13:06:26.563543 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:06:26.563522    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-8k9zv"
Jul 30 13:06:26.565717 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:06:26.565694    2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\""
Jul 30 13:06:26.565852 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:06:26.565786    2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\""
Jul 30 13:06:26.566182 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:06:26.566159    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-catalog-dockercfg-l9shf\""
Jul 30 13:06:26.574393 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:06:26.574371    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-8k9zv"]
Jul 30 13:06:26.689499 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:06:26.689465    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7f84k\" (UniqueName: \"kubernetes.io/projected/0106ea1b-3259-4971-90c9-f6e553235f9d-kube-api-access-7f84k\") pod \"kuadrant-operator-catalog-8k9zv\" (UID: \"0106ea1b-3259-4971-90c9-f6e553235f9d\") " pod="kuadrant-system/kuadrant-operator-catalog-8k9zv"
Jul 30 13:06:26.752973 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:06:26.752937    2566 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-8k9zv"]
Jul 30 13:06:26.753223 ip-10-0-143-153 kubenswrapper[2566]: E0730 13:06:26.753202    2566 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[kube-api-access-7f84k], unattached volumes=[], failed to process volumes=[]: context canceled" pod="kuadrant-system/kuadrant-operator-catalog-8k9zv" podUID="0106ea1b-3259-4971-90c9-f6e553235f9d"
Jul 30 13:06:26.790345 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:06:26.790309    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7f84k\" (UniqueName: \"kubernetes.io/projected/0106ea1b-3259-4971-90c9-f6e553235f9d-kube-api-access-7f84k\") pod \"kuadrant-operator-catalog-8k9zv\" (UID: \"0106ea1b-3259-4971-90c9-f6e553235f9d\") " pod="kuadrant-system/kuadrant-operator-catalog-8k9zv"
Jul 30 13:06:26.798809 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:06:26.798787    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7f84k\" (UniqueName: \"kubernetes.io/projected/0106ea1b-3259-4971-90c9-f6e553235f9d-kube-api-access-7f84k\") pod \"kuadrant-operator-catalog-8k9zv\" (UID: \"0106ea1b-3259-4971-90c9-f6e553235f9d\") " pod="kuadrant-system/kuadrant-operator-catalog-8k9zv"
Jul 30 13:06:26.964656 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:06:26.964621    2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-hwrmt"]
Jul 30 13:06:26.986561 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:06:26.986533    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-hwrmt"]
Jul 30 13:06:26.986723 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:06:26.986645    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-hwrmt"
Jul 30 13:06:27.092733 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:06:27.092699    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rmwqm\" (UniqueName: \"kubernetes.io/projected/9211d01a-c930-4bf8-8156-e83be9705acb-kube-api-access-rmwqm\") pod \"kuadrant-operator-catalog-hwrmt\" (UID: \"9211d01a-c930-4bf8-8156-e83be9705acb\") " pod="kuadrant-system/kuadrant-operator-catalog-hwrmt"
Jul 30 13:06:27.193753 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:06:27.193719    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rmwqm\" (UniqueName: \"kubernetes.io/projected/9211d01a-c930-4bf8-8156-e83be9705acb-kube-api-access-rmwqm\") pod \"kuadrant-operator-catalog-hwrmt\" (UID: \"9211d01a-c930-4bf8-8156-e83be9705acb\") " pod="kuadrant-system/kuadrant-operator-catalog-hwrmt"
Jul 30 13:06:27.201750 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:06:27.201718    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rmwqm\" (UniqueName: \"kubernetes.io/projected/9211d01a-c930-4bf8-8156-e83be9705acb-kube-api-access-rmwqm\") pod \"kuadrant-operator-catalog-hwrmt\" (UID: \"9211d01a-c930-4bf8-8156-e83be9705acb\") " pod="kuadrant-system/kuadrant-operator-catalog-hwrmt"
Jul 30 13:06:27.297555 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:06:27.297479    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-hwrmt"
Jul 30 13:06:27.364609 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:06:27.364575    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-8k9zv"
Jul 30 13:06:27.372796 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:06:27.372772    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-8k9zv"
Jul 30 13:06:27.430877 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:06:27.430851    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-hwrmt"]
Jul 30 13:06:27.433844 ip-10-0-143-153 kubenswrapper[2566]: W0730 13:06:27.433815    2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9211d01a_c930_4bf8_8156_e83be9705acb.slice/crio-7c9d23143a961ba248df4852fc2230dc9562f95116ebe518cc92115cfd1eae91 WatchSource:0}: Error finding container 7c9d23143a961ba248df4852fc2230dc9562f95116ebe518cc92115cfd1eae91: Status 404 returned error can't find the container with id 7c9d23143a961ba248df4852fc2230dc9562f95116ebe518cc92115cfd1eae91
Jul 30 13:06:27.496132 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:06:27.496104    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-7f84k\" (UniqueName: \"kubernetes.io/projected/0106ea1b-3259-4971-90c9-f6e553235f9d-kube-api-access-7f84k\") pod \"0106ea1b-3259-4971-90c9-f6e553235f9d\" (UID: \"0106ea1b-3259-4971-90c9-f6e553235f9d\") "
Jul 30 13:06:27.498195 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:06:27.498173    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0106ea1b-3259-4971-90c9-f6e553235f9d-kube-api-access-7f84k" (OuterVolumeSpecName: "kube-api-access-7f84k") pod "0106ea1b-3259-4971-90c9-f6e553235f9d" (UID: "0106ea1b-3259-4971-90c9-f6e553235f9d"). InnerVolumeSpecName "kube-api-access-7f84k". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 30 13:06:27.597396 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:06:27.597322    2566 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-7f84k\" (UniqueName: \"kubernetes.io/projected/0106ea1b-3259-4971-90c9-f6e553235f9d-kube-api-access-7f84k\") on node \"ip-10-0-143-153.ec2.internal\" DevicePath \"\""
Jul 30 13:06:28.370267 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:06:28.370231    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-hwrmt" event={"ID":"9211d01a-c930-4bf8-8156-e83be9705acb","Type":"ContainerStarted","Data":"7c9d23143a961ba248df4852fc2230dc9562f95116ebe518cc92115cfd1eae91"}
Jul 30 13:06:28.370267 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:06:28.370261    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-8k9zv"
Jul 30 13:06:28.405234 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:06:28.405202    2566 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-8k9zv"]
Jul 30 13:06:28.412017 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:06:28.411991    2566 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-8k9zv"]
Jul 30 13:06:29.626735 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:06:29.626706    2566 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="0106ea1b-3259-4971-90c9-f6e553235f9d" path="/var/lib/kubelet/pods/0106ea1b-3259-4971-90c9-f6e553235f9d/volumes"
Jul 30 13:06:30.381952 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:06:30.381920    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-hwrmt" event={"ID":"9211d01a-c930-4bf8-8156-e83be9705acb","Type":"ContainerStarted","Data":"ea33250aaffaacc67c2a4ec19a9491ad2fe542a5a1e21f8f74a83817b24d8645"}
Jul 30 13:06:30.399189 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:06:30.399145    2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-catalog-hwrmt" podStartSLOduration=1.6413867020000001 podStartE2EDuration="4.399127146s" totalImagesPullingTime="2.757740444s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-30 13:06:26 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 13:06:30.397912245 +0000 UTC m=+419.326600510" watchObservedRunningTime="2026-07-30 13:06:30.399127146 +0000 UTC m=+419.327815408"
Jul 30 13:06:37.297719 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:06:37.297681    2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-catalog-hwrmt"
Jul 30 13:06:37.298295 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:06:37.297761    2566 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kuadrant-system/kuadrant-operator-catalog-hwrmt"
Jul 30 13:06:37.319772 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:06:37.319747    2566 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kuadrant-system/kuadrant-operator-catalog-hwrmt"
Jul 30 13:06:37.431650 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:06:37.431609    2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-catalog-hwrmt"
Jul 30 13:06:57.747271 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:06:57.747173    2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/dns-operator-controller-manager-864dd78c4c-tv5wd"]
Jul 30 13:06:57.750567 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:06:57.750543    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-tv5wd"
Jul 30 13:06:57.752427 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:06:57.752402    2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"dns-operator-controller-env\""
Jul 30 13:06:57.752534 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:06:57.752485    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"dns-operator-controller-manager-dockercfg-wftdz\""
Jul 30 13:06:57.760133 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:06:57.760111    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/dns-operator-controller-manager-864dd78c4c-tv5wd"]
Jul 30 13:06:57.827464 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:06:57.827426    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-q5j6n\" (UniqueName: \"kubernetes.io/projected/e7173845-0385-4dc6-9db0-5e68633c88a7-kube-api-access-q5j6n\") pod \"dns-operator-controller-manager-864dd78c4c-tv5wd\" (UID: \"e7173845-0385-4dc6-9db0-5e68633c88a7\") " pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-tv5wd"
Jul 30 13:06:57.928871 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:06:57.928830    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-q5j6n\" (UniqueName: \"kubernetes.io/projected/e7173845-0385-4dc6-9db0-5e68633c88a7-kube-api-access-q5j6n\") pod \"dns-operator-controller-manager-864dd78c4c-tv5wd\" (UID: \"e7173845-0385-4dc6-9db0-5e68633c88a7\") " pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-tv5wd"
Jul 30 13:06:57.947072 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:06:57.947043    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-q5j6n\" (UniqueName: \"kubernetes.io/projected/e7173845-0385-4dc6-9db0-5e68633c88a7-kube-api-access-q5j6n\") pod \"dns-operator-controller-manager-864dd78c4c-tv5wd\" (UID: \"e7173845-0385-4dc6-9db0-5e68633c88a7\") " pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-tv5wd"
Jul 30 13:06:58.061039 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:06:58.060955    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-tv5wd"
Jul 30 13:06:58.193658 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:06:58.193626    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/dns-operator-controller-manager-864dd78c4c-tv5wd"]
Jul 30 13:06:58.196800 ip-10-0-143-153 kubenswrapper[2566]: W0730 13:06:58.196773    2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode7173845_0385_4dc6_9db0_5e68633c88a7.slice/crio-ecae58d3a455900ebc239bf0573f76692d8cb4b9567d70497a9e754d64e578b5 WatchSource:0}: Error finding container ecae58d3a455900ebc239bf0573f76692d8cb4b9567d70497a9e754d64e578b5: Status 404 returned error can't find the container with id ecae58d3a455900ebc239bf0573f76692d8cb4b9567d70497a9e754d64e578b5
Jul 30 13:06:58.497415 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:06:58.497380    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-tv5wd" event={"ID":"e7173845-0385-4dc6-9db0-5e68633c88a7","Type":"ContainerStarted","Data":"ecae58d3a455900ebc239bf0573f76692d8cb4b9567d70497a9e754d64e578b5"}
Jul 30 13:07:00.508714 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:07:00.508616    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-tv5wd" event={"ID":"e7173845-0385-4dc6-9db0-5e68633c88a7","Type":"ContainerStarted","Data":"b2ed155d8f7d02c0e14c218a00bf102b1b2b4dc6b2bdfac1c938144c4f05a822"}
Jul 30 13:07:00.508714 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:07:00.508684    2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-tv5wd"
Jul 30 13:07:00.523558 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:07:00.523474    2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-tv5wd" podStartSLOduration=1.546598578 podStartE2EDuration="3.523455354s" totalImagesPullingTime="1.976856776s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-30 13:06:57 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 13:07:00.523052919 +0000 UTC m=+449.451741182" watchObservedRunningTime="2026-07-30 13:07:00.523455354 +0000 UTC m=+449.452143617"
Jul 30 13:07:03.714928 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:07:03.714897    2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-t4msf"]
Jul 30 13:07:03.722642 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:07:03.722623    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-t4msf"
Jul 30 13:07:03.727929 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:07:03.727899    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-hxg6w\""
Jul 30 13:07:03.739755 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:07:03.739732    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-t4msf"]
Jul 30 13:07:03.781419 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:07:03.781384    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/6a881a07-3cd2-4e8f-9414-2bcdda40b84d-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-t4msf\" (UID: \"6a881a07-3cd2-4e8f-9414-2bcdda40b84d\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-t4msf"
Jul 30 13:07:03.781577 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:07:03.781435    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lb42f\" (UniqueName: \"kubernetes.io/projected/6a881a07-3cd2-4e8f-9414-2bcdda40b84d-kube-api-access-lb42f\") pod \"kuadrant-operator-controller-manager-8684c9ff49-t4msf\" (UID: \"6a881a07-3cd2-4e8f-9414-2bcdda40b84d\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-t4msf"
Jul 30 13:07:03.882066 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:07:03.882028    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lb42f\" (UniqueName: \"kubernetes.io/projected/6a881a07-3cd2-4e8f-9414-2bcdda40b84d-kube-api-access-lb42f\") pod \"kuadrant-operator-controller-manager-8684c9ff49-t4msf\" (UID: \"6a881a07-3cd2-4e8f-9414-2bcdda40b84d\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-t4msf"
Jul 30 13:07:03.882270 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:07:03.882139    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/6a881a07-3cd2-4e8f-9414-2bcdda40b84d-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-t4msf\" (UID: \"6a881a07-3cd2-4e8f-9414-2bcdda40b84d\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-t4msf"
Jul 30 13:07:03.882500 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:07:03.882483    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/6a881a07-3cd2-4e8f-9414-2bcdda40b84d-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-t4msf\" (UID: \"6a881a07-3cd2-4e8f-9414-2bcdda40b84d\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-t4msf"
Jul 30 13:07:03.891166 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:07:03.891140    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lb42f\" (UniqueName: \"kubernetes.io/projected/6a881a07-3cd2-4e8f-9414-2bcdda40b84d-kube-api-access-lb42f\") pod \"kuadrant-operator-controller-manager-8684c9ff49-t4msf\" (UID: \"6a881a07-3cd2-4e8f-9414-2bcdda40b84d\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-t4msf"
Jul 30 13:07:04.032552 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:07:04.032465    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-t4msf"
Jul 30 13:07:04.185852 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:07:04.185738    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-t4msf"]
Jul 30 13:07:04.188678 ip-10-0-143-153 kubenswrapper[2566]: W0730 13:07:04.188636    2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6a881a07_3cd2_4e8f_9414_2bcdda40b84d.slice/crio-d5b1f51d4e4fc92c721c6f744636f150bab84a2c67475f598515332b2006a284 WatchSource:0}: Error finding container d5b1f51d4e4fc92c721c6f744636f150bab84a2c67475f598515332b2006a284: Status 404 returned error can't find the container with id d5b1f51d4e4fc92c721c6f744636f150bab84a2c67475f598515332b2006a284
Jul 30 13:07:04.525580 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:07:04.525544    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-t4msf" event={"ID":"6a881a07-3cd2-4e8f-9414-2bcdda40b84d","Type":"ContainerStarted","Data":"d5b1f51d4e4fc92c721c6f744636f150bab84a2c67475f598515332b2006a284"}
Jul 30 13:07:06.073771 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:07:06.073731    2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-247ch"]
Jul 30 13:07:06.077845 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:07:06.077819    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-247ch"
Jul 30 13:07:06.079764 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:07:06.079739    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"limitador-operator-controller-manager-dockercfg-vhwgm\""
Jul 30 13:07:06.087978 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:07:06.087952    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-247ch"]
Jul 30 13:07:06.203065 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:07:06.203024    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-znrfr\" (UniqueName: \"kubernetes.io/projected/c05d6004-48a7-4743-a7f2-fb6bcc881916-kube-api-access-znrfr\") pod \"limitador-operator-controller-manager-859d7b78bd-247ch\" (UID: \"c05d6004-48a7-4743-a7f2-fb6bcc881916\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-247ch"
Jul 30 13:07:06.304549 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:07:06.304516    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-znrfr\" (UniqueName: \"kubernetes.io/projected/c05d6004-48a7-4743-a7f2-fb6bcc881916-kube-api-access-znrfr\") pod \"limitador-operator-controller-manager-859d7b78bd-247ch\" (UID: \"c05d6004-48a7-4743-a7f2-fb6bcc881916\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-247ch"
Jul 30 13:07:06.316249 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:07:06.316219    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-znrfr\" (UniqueName: \"kubernetes.io/projected/c05d6004-48a7-4743-a7f2-fb6bcc881916-kube-api-access-znrfr\") pod \"limitador-operator-controller-manager-859d7b78bd-247ch\" (UID: \"c05d6004-48a7-4743-a7f2-fb6bcc881916\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-247ch"
Jul 30 13:07:06.390825 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:07:06.390786    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-247ch"
Jul 30 13:07:06.542628 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:07:06.542554    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-247ch"]
Jul 30 13:07:06.546927 ip-10-0-143-153 kubenswrapper[2566]: W0730 13:07:06.546900    2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc05d6004_48a7_4743_a7f2_fb6bcc881916.slice/crio-ccfc513ba6b69281db11c88d6459057768420a4b7b79b78a555a241179a56997 WatchSource:0}: Error finding container ccfc513ba6b69281db11c88d6459057768420a4b7b79b78a555a241179a56997: Status 404 returned error can't find the container with id ccfc513ba6b69281db11c88d6459057768420a4b7b79b78a555a241179a56997
Jul 30 13:07:07.542395 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:07:07.542360    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-247ch" event={"ID":"c05d6004-48a7-4743-a7f2-fb6bcc881916","Type":"ContainerStarted","Data":"ccfc513ba6b69281db11c88d6459057768420a4b7b79b78a555a241179a56997"}
Jul 30 13:07:09.297361 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:07:09.297286    2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-operator-75cc8d5cb7-v2zhh"]
Jul 30 13:07:09.300797 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:07:09.300777    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-operator-75cc8d5cb7-v2zhh"
Jul 30 13:07:09.302706 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:07:09.302687    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-operator-dockercfg-8wsmd\""
Jul 30 13:07:09.312431 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:07:09.312406    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-operator-75cc8d5cb7-v2zhh"]
Jul 30 13:07:09.432448 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:07:09.432410    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vjm8g\" (UniqueName: \"kubernetes.io/projected/a7a7c0f0-7a79-4b07-b1fa-0d3aabe682b7-kube-api-access-vjm8g\") pod \"authorino-operator-75cc8d5cb7-v2zhh\" (UID: \"a7a7c0f0-7a79-4b07-b1fa-0d3aabe682b7\") " pod="kuadrant-system/authorino-operator-75cc8d5cb7-v2zhh"
Jul 30 13:07:09.533420 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:07:09.533378    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vjm8g\" (UniqueName: \"kubernetes.io/projected/a7a7c0f0-7a79-4b07-b1fa-0d3aabe682b7-kube-api-access-vjm8g\") pod \"authorino-operator-75cc8d5cb7-v2zhh\" (UID: \"a7a7c0f0-7a79-4b07-b1fa-0d3aabe682b7\") " pod="kuadrant-system/authorino-operator-75cc8d5cb7-v2zhh"
Jul 30 13:07:09.543512 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:07:09.543476    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vjm8g\" (UniqueName: \"kubernetes.io/projected/a7a7c0f0-7a79-4b07-b1fa-0d3aabe682b7-kube-api-access-vjm8g\") pod \"authorino-operator-75cc8d5cb7-v2zhh\" (UID: \"a7a7c0f0-7a79-4b07-b1fa-0d3aabe682b7\") " pod="kuadrant-system/authorino-operator-75cc8d5cb7-v2zhh"
Jul 30 13:07:09.555675 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:07:09.555590    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-t4msf" event={"ID":"6a881a07-3cd2-4e8f-9414-2bcdda40b84d","Type":"ContainerStarted","Data":"ae0c4b81262bf5e4b4f4580f3fd76ed4870085419304f0ed2cc8395d778a4886"}
Jul 30 13:07:09.555675 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:07:09.555659    2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-t4msf"
Jul 30 13:07:09.557210 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:07:09.557180    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-247ch" event={"ID":"c05d6004-48a7-4743-a7f2-fb6bcc881916","Type":"ContainerStarted","Data":"10c38b31147e79b7b9cd93cd524524371bc119b09923b80ea32f812eb8c4ad94"}
Jul 30 13:07:09.557321 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:07:09.557237    2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-247ch"
Jul 30 13:07:09.579629 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:07:09.579576    2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-t4msf" podStartSLOduration=1.8261163470000001 podStartE2EDuration="6.579561251s" totalImagesPullingTime="4.753444904s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-30 13:07:03 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 13:07:09.578209164 +0000 UTC m=+458.506897426" watchObservedRunningTime="2026-07-30 13:07:09.579561251 +0000 UTC m=+458.508249513"
Jul 30 13:07:09.597504 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:07:09.597462    2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-247ch" podStartSLOduration=1.1988718600000001 podStartE2EDuration="3.597447755s" totalImagesPullingTime="2.398575895s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-30 13:07:06 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 13:07:09.595781041 +0000 UTC m=+458.524469303" watchObservedRunningTime="2026-07-30 13:07:09.597447755 +0000 UTC m=+458.526136018"
Jul 30 13:07:09.610535 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:07:09.610507    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-operator-75cc8d5cb7-v2zhh"
Jul 30 13:07:09.755121 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:07:09.755096    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-operator-75cc8d5cb7-v2zhh"]
Jul 30 13:07:09.757831 ip-10-0-143-153 kubenswrapper[2566]: W0730 13:07:09.757807    2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda7a7c0f0_7a79_4b07_b1fa_0d3aabe682b7.slice/crio-f7f992c3a5e5b3a81dc406bc62cfb940ea2bf21be576ab38632aa27e047d5dc3 WatchSource:0}: Error finding container f7f992c3a5e5b3a81dc406bc62cfb940ea2bf21be576ab38632aa27e047d5dc3: Status 404 returned error can't find the container with id f7f992c3a5e5b3a81dc406bc62cfb940ea2bf21be576ab38632aa27e047d5dc3
Jul 30 13:07:10.565136 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:07:10.565046    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-operator-75cc8d5cb7-v2zhh" event={"ID":"a7a7c0f0-7a79-4b07-b1fa-0d3aabe682b7","Type":"ContainerStarted","Data":"f7f992c3a5e5b3a81dc406bc62cfb940ea2bf21be576ab38632aa27e047d5dc3"}
Jul 30 13:07:11.515235 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:07:11.515205    2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-tv5wd"
Jul 30 13:07:12.579163 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:07:12.579129    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-operator-75cc8d5cb7-v2zhh" event={"ID":"a7a7c0f0-7a79-4b07-b1fa-0d3aabe682b7","Type":"ContainerStarted","Data":"563c52ba34378c170ba641674efbba5ff98eaf6289d46116fa50fc0dcd6396c5"}
Jul 30 13:07:12.579563 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:07:12.579254    2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/authorino-operator-75cc8d5cb7-v2zhh"
Jul 30 13:07:12.594319 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:07:12.594275    2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-operator-75cc8d5cb7-v2zhh" podStartSLOduration=1.270580176 podStartE2EDuration="3.594257234s" totalImagesPullingTime="2.323677058s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-30 13:07:09 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 13:07:12.594006011 +0000 UTC m=+461.522694274" watchObservedRunningTime="2026-07-30 13:07:12.594257234 +0000 UTC m=+461.522945497"
Jul 30 13:07:20.567006 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:07:20.566973    2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-t4msf"
Jul 30 13:07:20.567497 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:07:20.567042    2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-247ch"
Jul 30 13:07:22.493337 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:07:22.493303    2566 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-t4msf"]
Jul 30 13:07:22.493739 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:07:22.493482    2566 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-t4msf" podUID="6a881a07-3cd2-4e8f-9414-2bcdda40b84d" containerName="manager" containerID="cri-o://ae0c4b81262bf5e4b4f4580f3fd76ed4870085419304f0ed2cc8395d778a4886" gracePeriod=2
Jul 30 13:07:22.497358 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:07:22.497328    2566 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-t4msf"]
Jul 30 13:07:22.497502 ip-10-0-143-153 kubenswrapper[2566]: E0730 13:07:22.497459    2566 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-t4msf\" is forbidden: User \"system:node:ip-10-0-143-153.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-143-153.ec2.internal' and this object" podUID="6a881a07-3cd2-4e8f-9414-2bcdda40b84d" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-t4msf"
Jul 30 13:07:22.511027 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:07:22.510991    2566 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-247ch"]
Jul 30 13:07:22.511236 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:07:22.511210    2566 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-247ch" podUID="c05d6004-48a7-4743-a7f2-fb6bcc881916" containerName="manager" containerID="cri-o://10c38b31147e79b7b9cd93cd524524371bc119b09923b80ea32f812eb8c4ad94" gracePeriod=2
Jul 30 13:07:22.516568 ip-10-0-143-153 kubenswrapper[2566]: E0730 13:07:22.516530    2566 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-t4msf\" is forbidden: User \"system:node:ip-10-0-143-153.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-143-153.ec2.internal' and this object" podUID="6a881a07-3cd2-4e8f-9414-2bcdda40b84d" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-t4msf"
Jul 30 13:07:22.518175 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:07:22.518153    2566 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-247ch"]
Jul 30 13:07:22.529425 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:07:22.529395    2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-prcvv"]
Jul 30 13:07:22.530187 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:07:22.530164    2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6a881a07-3cd2-4e8f-9414-2bcdda40b84d" containerName="manager"
Jul 30 13:07:22.530187 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:07:22.530187    2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="6a881a07-3cd2-4e8f-9414-2bcdda40b84d" containerName="manager"
Jul 30 13:07:22.530349 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:07:22.530224    2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c05d6004-48a7-4743-a7f2-fb6bcc881916" containerName="manager"
Jul 30 13:07:22.530349 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:07:22.530232    2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="c05d6004-48a7-4743-a7f2-fb6bcc881916" containerName="manager"
Jul 30 13:07:22.530349 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:07:22.530308    2566 memory_manager.go:368] "RemoveStaleState removing state" podUID="c05d6004-48a7-4743-a7f2-fb6bcc881916" containerName="manager"
Jul 30 13:07:22.530349 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:07:22.530320    2566 memory_manager.go:368] "RemoveStaleState removing state" podUID="6a881a07-3cd2-4e8f-9414-2bcdda40b84d" containerName="manager"
Jul 30 13:07:22.533526 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:07:22.533509    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-prcvv"
Jul 30 13:07:22.535477 ip-10-0-143-153 kubenswrapper[2566]: E0730 13:07:22.535454    2566 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-247ch\" is forbidden: User \"system:node:ip-10-0-143-153.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-143-153.ec2.internal' and this object" podUID="c05d6004-48a7-4743-a7f2-fb6bcc881916" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-247ch"
Jul 30 13:07:22.540776 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:07:22.540750    2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-psl2b"]
Jul 30 13:07:22.544053 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:07:22.543931    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-psl2b"
Jul 30 13:07:22.545941 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:07:22.545918    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-prcvv"]
Jul 30 13:07:22.564588 ip-10-0-143-153 kubenswrapper[2566]: E0730 13:07:22.564548    2566 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-t4msf\" is forbidden: User \"system:node:ip-10-0-143-153.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-143-153.ec2.internal' and this object" podUID="6a881a07-3cd2-4e8f-9414-2bcdda40b84d" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-t4msf"
Jul 30 13:07:22.568182 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:07:22.568157    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-psl2b"]
Jul 30 13:07:22.586508 ip-10-0-143-153 kubenswrapper[2566]: E0730 13:07:22.586471    2566 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-247ch\" is forbidden: User \"system:node:ip-10-0-143-153.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-143-153.ec2.internal' and this object" podUID="c05d6004-48a7-4743-a7f2-fb6bcc881916" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-247ch"
Jul 30 13:07:22.588000 ip-10-0-143-153 kubenswrapper[2566]: E0730 13:07:22.587978    2566 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-t4msf\" is forbidden: User \"system:node:ip-10-0-143-153.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-143-153.ec2.internal' and this object" podUID="6a881a07-3cd2-4e8f-9414-2bcdda40b84d" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-t4msf"
Jul 30 13:07:22.626785 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:07:22.626758    2566 generic.go:356] "Generic (PLEG): container finished" podID="6a881a07-3cd2-4e8f-9414-2bcdda40b84d" containerID="ae0c4b81262bf5e4b4f4580f3fd76ed4870085419304f0ed2cc8395d778a4886" exitCode=0
Jul 30 13:07:22.628779 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:07:22.628753    2566 generic.go:356] "Generic (PLEG): container finished" podID="c05d6004-48a7-4743-a7f2-fb6bcc881916" containerID="10c38b31147e79b7b9cd93cd524524371bc119b09923b80ea32f812eb8c4ad94" exitCode=0
Jul 30 13:07:22.645542 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:07:22.645516    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/6c1b3e8e-1cb7-4348-ac0b-d72a0a98598a-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-prcvv\" (UID: \"6c1b3e8e-1cb7-4348-ac0b-d72a0a98598a\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-prcvv"
Jul 30 13:07:22.645729 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:07:22.645569    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-r9gq5\" (UniqueName: \"kubernetes.io/projected/6c1b3e8e-1cb7-4348-ac0b-d72a0a98598a-kube-api-access-r9gq5\") pod \"kuadrant-operator-controller-manager-8684c9ff49-prcvv\" (UID: \"6c1b3e8e-1cb7-4348-ac0b-d72a0a98598a\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-prcvv"
Jul 30 13:07:22.645729 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:07:22.645634    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tk5rx\" (UniqueName: \"kubernetes.io/projected/ccc93ea0-2545-4f0e-ac89-3b2a356522eb-kube-api-access-tk5rx\") pod \"limitador-operator-controller-manager-859d7b78bd-psl2b\" (UID: \"ccc93ea0-2545-4f0e-ac89-3b2a356522eb\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-psl2b"
Jul 30 13:07:22.746235 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:07:22.746174    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/6c1b3e8e-1cb7-4348-ac0b-d72a0a98598a-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-prcvv\" (UID: \"6c1b3e8e-1cb7-4348-ac0b-d72a0a98598a\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-prcvv"
Jul 30 13:07:22.746235 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:07:22.746220    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-r9gq5\" (UniqueName: \"kubernetes.io/projected/6c1b3e8e-1cb7-4348-ac0b-d72a0a98598a-kube-api-access-r9gq5\") pod \"kuadrant-operator-controller-manager-8684c9ff49-prcvv\" (UID: \"6c1b3e8e-1cb7-4348-ac0b-d72a0a98598a\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-prcvv"
Jul 30 13:07:22.746376 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:07:22.746253    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tk5rx\" (UniqueName: \"kubernetes.io/projected/ccc93ea0-2545-4f0e-ac89-3b2a356522eb-kube-api-access-tk5rx\") pod \"limitador-operator-controller-manager-859d7b78bd-psl2b\" (UID: \"ccc93ea0-2545-4f0e-ac89-3b2a356522eb\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-psl2b"
Jul 30 13:07:22.746584 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:07:22.746559    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/6c1b3e8e-1cb7-4348-ac0b-d72a0a98598a-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-prcvv\" (UID: \"6c1b3e8e-1cb7-4348-ac0b-d72a0a98598a\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-prcvv"
Jul 30 13:07:22.751473 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:07:22.751454    2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-t4msf"
Jul 30 13:07:22.752789 ip-10-0-143-153 kubenswrapper[2566]: E0730 13:07:22.752766    2566 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-247ch\" is forbidden: User \"system:node:ip-10-0-143-153.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-143-153.ec2.internal' and this object" podUID="c05d6004-48a7-4743-a7f2-fb6bcc881916" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-247ch"
Jul 30 13:07:22.753507 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:07:22.753493    2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-247ch"
Jul 30 13:07:22.753798 ip-10-0-143-153 kubenswrapper[2566]: E0730 13:07:22.753779    2566 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-t4msf\" is forbidden: User \"system:node:ip-10-0-143-153.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-143-153.ec2.internal' and this object" podUID="6a881a07-3cd2-4e8f-9414-2bcdda40b84d" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-t4msf"
Jul 30 13:07:22.754310 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:07:22.754294    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tk5rx\" (UniqueName: \"kubernetes.io/projected/ccc93ea0-2545-4f0e-ac89-3b2a356522eb-kube-api-access-tk5rx\") pod \"limitador-operator-controller-manager-859d7b78bd-psl2b\" (UID: \"ccc93ea0-2545-4f0e-ac89-3b2a356522eb\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-psl2b"
Jul 30 13:07:22.754462 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:07:22.754444    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-r9gq5\" (UniqueName: \"kubernetes.io/projected/6c1b3e8e-1cb7-4348-ac0b-d72a0a98598a-kube-api-access-r9gq5\") pod \"kuadrant-operator-controller-manager-8684c9ff49-prcvv\" (UID: \"6c1b3e8e-1cb7-4348-ac0b-d72a0a98598a\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-prcvv"
Jul 30 13:07:22.754980 ip-10-0-143-153 kubenswrapper[2566]: E0730 13:07:22.754955    2566 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-247ch\" is forbidden: User \"system:node:ip-10-0-143-153.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-143-153.ec2.internal' and this object" podUID="c05d6004-48a7-4743-a7f2-fb6bcc881916" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-247ch"
Jul 30 13:07:22.756026 ip-10-0-143-153 kubenswrapper[2566]: E0730 13:07:22.756001    2566 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-t4msf\" is forbidden: User \"system:node:ip-10-0-143-153.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-143-153.ec2.internal' and this object" podUID="6a881a07-3cd2-4e8f-9414-2bcdda40b84d" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-t4msf"
Jul 30 13:07:22.846769 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:07:22.846738    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/6a881a07-3cd2-4e8f-9414-2bcdda40b84d-extensions-socket-volume\") pod \"6a881a07-3cd2-4e8f-9414-2bcdda40b84d\" (UID: \"6a881a07-3cd2-4e8f-9414-2bcdda40b84d\") "
Jul 30 13:07:22.846932 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:07:22.846787    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-lb42f\" (UniqueName: \"kubernetes.io/projected/6a881a07-3cd2-4e8f-9414-2bcdda40b84d-kube-api-access-lb42f\") pod \"6a881a07-3cd2-4e8f-9414-2bcdda40b84d\" (UID: \"6a881a07-3cd2-4e8f-9414-2bcdda40b84d\") "
Jul 30 13:07:22.846932 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:07:22.846820    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-znrfr\" (UniqueName: \"kubernetes.io/projected/c05d6004-48a7-4743-a7f2-fb6bcc881916-kube-api-access-znrfr\") pod \"c05d6004-48a7-4743-a7f2-fb6bcc881916\" (UID: \"c05d6004-48a7-4743-a7f2-fb6bcc881916\") "
Jul 30 13:07:22.847306 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:07:22.847278    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6a881a07-3cd2-4e8f-9414-2bcdda40b84d-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "6a881a07-3cd2-4e8f-9414-2bcdda40b84d" (UID: "6a881a07-3cd2-4e8f-9414-2bcdda40b84d"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 30 13:07:22.848959 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:07:22.848938    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c05d6004-48a7-4743-a7f2-fb6bcc881916-kube-api-access-znrfr" (OuterVolumeSpecName: "kube-api-access-znrfr") pod "c05d6004-48a7-4743-a7f2-fb6bcc881916" (UID: "c05d6004-48a7-4743-a7f2-fb6bcc881916"). InnerVolumeSpecName "kube-api-access-znrfr". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 30 13:07:22.849039 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:07:22.849019    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6a881a07-3cd2-4e8f-9414-2bcdda40b84d-kube-api-access-lb42f" (OuterVolumeSpecName: "kube-api-access-lb42f") pod "6a881a07-3cd2-4e8f-9414-2bcdda40b84d" (UID: "6a881a07-3cd2-4e8f-9414-2bcdda40b84d"). InnerVolumeSpecName "kube-api-access-lb42f". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 30 13:07:22.948307 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:07:22.948266    2566 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/6a881a07-3cd2-4e8f-9414-2bcdda40b84d-extensions-socket-volume\") on node \"ip-10-0-143-153.ec2.internal\" DevicePath \"\""
Jul 30 13:07:22.948307 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:07:22.948299    2566 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-lb42f\" (UniqueName: \"kubernetes.io/projected/6a881a07-3cd2-4e8f-9414-2bcdda40b84d-kube-api-access-lb42f\") on node \"ip-10-0-143-153.ec2.internal\" DevicePath \"\""
Jul 30 13:07:22.948307 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:07:22.948311    2566 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-znrfr\" (UniqueName: \"kubernetes.io/projected/c05d6004-48a7-4743-a7f2-fb6bcc881916-kube-api-access-znrfr\") on node \"ip-10-0-143-153.ec2.internal\" DevicePath \"\""
Jul 30 13:07:22.951230 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:07:22.951194    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-prcvv"
Jul 30 13:07:22.958302 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:07:22.958278    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-psl2b"
Jul 30 13:07:23.141454 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:07:23.141419    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-prcvv"]
Jul 30 13:07:23.159706 ip-10-0-143-153 kubenswrapper[2566]: W0730 13:07:23.159679    2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6c1b3e8e_1cb7_4348_ac0b_d72a0a98598a.slice/crio-0f2a245797c6422779dca5bd58afd2a124d815d4434d12895f8c4c0152f11b7e WatchSource:0}: Error finding container 0f2a245797c6422779dca5bd58afd2a124d815d4434d12895f8c4c0152f11b7e: Status 404 returned error can't find the container with id 0f2a245797c6422779dca5bd58afd2a124d815d4434d12895f8c4c0152f11b7e
Jul 30 13:07:23.177684 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:07:23.177658    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-psl2b"]
Jul 30 13:07:23.180711 ip-10-0-143-153 kubenswrapper[2566]: W0730 13:07:23.180682    2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podccc93ea0_2545_4f0e_ac89_3b2a356522eb.slice/crio-1ee7e2ba38a6b8c37ff004623baa836bb3409dab1866a94c91febe50971e2f26 WatchSource:0}: Error finding container 1ee7e2ba38a6b8c37ff004623baa836bb3409dab1866a94c91febe50971e2f26: Status 404 returned error can't find the container with id 1ee7e2ba38a6b8c37ff004623baa836bb3409dab1866a94c91febe50971e2f26
Jul 30 13:07:23.566250 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:07:23.566216    2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-kpc2j"]
Jul 30 13:07:23.569628 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:07:23.569606    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-kpc2j"
Jul 30 13:07:23.572011 ip-10-0-143-153 kubenswrapper[2566]: E0730 13:07:23.571984    2566 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-247ch\" is forbidden: User \"system:node:ip-10-0-143-153.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-143-153.ec2.internal' and this object" podUID="c05d6004-48a7-4743-a7f2-fb6bcc881916" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-247ch"
Jul 30 13:07:23.573257 ip-10-0-143-153 kubenswrapper[2566]: E0730 13:07:23.573235    2566 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-t4msf\" is forbidden: User \"system:node:ip-10-0-143-153.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-143-153.ec2.internal' and this object" podUID="6a881a07-3cd2-4e8f-9414-2bcdda40b84d" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-t4msf"
Jul 30 13:07:23.584391 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:07:23.584365    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-kpc2j"]
Jul 30 13:07:23.586147 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:07:23.586122    2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/authorino-operator-75cc8d5cb7-v2zhh"
Jul 30 13:07:23.612485 ip-10-0-143-153 kubenswrapper[2566]: E0730 13:07:23.612452    2566 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-t4msf\" is forbidden: User \"system:node:ip-10-0-143-153.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-143-153.ec2.internal' and this object" podUID="6a881a07-3cd2-4e8f-9414-2bcdda40b84d" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-t4msf"
Jul 30 13:07:23.631737 ip-10-0-143-153 kubenswrapper[2566]: E0730 13:07:23.631701    2566 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-247ch\" is forbidden: User \"system:node:ip-10-0-143-153.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-143-153.ec2.internal' and this object" podUID="c05d6004-48a7-4743-a7f2-fb6bcc881916" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-247ch"
Jul 30 13:07:23.632853 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:07:23.632826    2566 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="6a881a07-3cd2-4e8f-9414-2bcdda40b84d" path="/var/lib/kubelet/pods/6a881a07-3cd2-4e8f-9414-2bcdda40b84d/volumes"
Jul 30 13:07:23.633335 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:07:23.633295    2566 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c05d6004-48a7-4743-a7f2-fb6bcc881916" path="/var/lib/kubelet/pods/c05d6004-48a7-4743-a7f2-fb6bcc881916/volumes"
Jul 30 13:07:23.636181 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:07:23.636156    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-psl2b" event={"ID":"ccc93ea0-2545-4f0e-ac89-3b2a356522eb","Type":"ContainerStarted","Data":"6c90b64973c12686271853b233cdb86b4ccfc8cd0c32295adff5baa2eec29d30"}
Jul 30 13:07:23.636294 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:07:23.636201    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-psl2b" event={"ID":"ccc93ea0-2545-4f0e-ac89-3b2a356522eb","Type":"ContainerStarted","Data":"1ee7e2ba38a6b8c37ff004623baa836bb3409dab1866a94c91febe50971e2f26"}
Jul 30 13:07:23.636294 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:07:23.636272    2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-psl2b"
Jul 30 13:07:23.637513 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:07:23.637496    2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-t4msf"
Jul 30 13:07:23.637606 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:07:23.637497    2566 scope.go:117] "RemoveContainer" containerID="ae0c4b81262bf5e4b4f4580f3fd76ed4870085419304f0ed2cc8395d778a4886"
Jul 30 13:07:23.640255 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:07:23.640201    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-prcvv" event={"ID":"6c1b3e8e-1cb7-4348-ac0b-d72a0a98598a","Type":"ContainerStarted","Data":"740214148fb5b227745c7de72af80a210477ee9f32e7697db49c8d7f6001097d"}
Jul 30 13:07:23.640367 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:07:23.640272    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-prcvv" event={"ID":"6c1b3e8e-1cb7-4348-ac0b-d72a0a98598a","Type":"ContainerStarted","Data":"0f2a245797c6422779dca5bd58afd2a124d815d4434d12895f8c4c0152f11b7e"}
Jul 30 13:07:23.640899 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:07:23.640841    2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-prcvv"
Jul 30 13:07:23.642609 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:07:23.642592    2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-247ch"
Jul 30 13:07:23.649937 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:07:23.649920    2566 scope.go:117] "RemoveContainer" containerID="10c38b31147e79b7b9cd93cd524524371bc119b09923b80ea32f812eb8c4ad94"
Jul 30 13:07:23.653542 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:07:23.652938    2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-psl2b" podStartSLOduration=1.652919898 podStartE2EDuration="1.652919898s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-30 13:07:22 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 13:07:23.6515449 +0000 UTC m=+472.580233184" watchObservedRunningTime="2026-07-30 13:07:23.652919898 +0000 UTC m=+472.581608139"
Jul 30 13:07:23.655272 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:07:23.655249    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/bbf37c61-e530-4d55-aacd-cbf6dc2da7ca-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-kpc2j\" (UID: \"bbf37c61-e530-4d55-aacd-cbf6dc2da7ca\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-kpc2j"
Jul 30 13:07:23.655364 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:07:23.655279    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zjkk5\" (UniqueName: \"kubernetes.io/projected/bbf37c61-e530-4d55-aacd-cbf6dc2da7ca-kube-api-access-zjkk5\") pod \"kuadrant-operator-controller-manager-86878c769f-kpc2j\" (UID: \"bbf37c61-e530-4d55-aacd-cbf6dc2da7ca\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-kpc2j"
Jul 30 13:07:23.671277 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:07:23.671229    2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-prcvv" podStartSLOduration=1.6712091770000002 podStartE2EDuration="1.671209177s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-30 13:07:22 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 13:07:23.670300613 +0000 UTC m=+472.598988890" watchObservedRunningTime="2026-07-30 13:07:23.671209177 +0000 UTC m=+472.599897443"
Jul 30 13:07:23.755836 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:07:23.755787    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/bbf37c61-e530-4d55-aacd-cbf6dc2da7ca-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-kpc2j\" (UID: \"bbf37c61-e530-4d55-aacd-cbf6dc2da7ca\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-kpc2j"
Jul 30 13:07:23.755836 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:07:23.755839    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zjkk5\" (UniqueName: \"kubernetes.io/projected/bbf37c61-e530-4d55-aacd-cbf6dc2da7ca-kube-api-access-zjkk5\") pod \"kuadrant-operator-controller-manager-86878c769f-kpc2j\" (UID: \"bbf37c61-e530-4d55-aacd-cbf6dc2da7ca\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-kpc2j"
Jul 30 13:07:23.756293 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:07:23.756269    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/bbf37c61-e530-4d55-aacd-cbf6dc2da7ca-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-kpc2j\" (UID: \"bbf37c61-e530-4d55-aacd-cbf6dc2da7ca\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-kpc2j"
Jul 30 13:07:23.768194 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:07:23.768125    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zjkk5\" (UniqueName: \"kubernetes.io/projected/bbf37c61-e530-4d55-aacd-cbf6dc2da7ca-kube-api-access-zjkk5\") pod \"kuadrant-operator-controller-manager-86878c769f-kpc2j\" (UID: \"bbf37c61-e530-4d55-aacd-cbf6dc2da7ca\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-kpc2j"
Jul 30 13:07:23.880689 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:07:23.880660    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-kpc2j"
Jul 30 13:07:24.025455 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:07:24.025378    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-kpc2j"]
Jul 30 13:07:24.029261 ip-10-0-143-153 kubenswrapper[2566]: W0730 13:07:24.029229    2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbbf37c61_e530_4d55_aacd_cbf6dc2da7ca.slice/crio-b0f8f19c99606871a3782e8a2b58a2217c06273eaee3e231ead6937964379c2e WatchSource:0}: Error finding container b0f8f19c99606871a3782e8a2b58a2217c06273eaee3e231ead6937964379c2e: Status 404 returned error can't find the container with id b0f8f19c99606871a3782e8a2b58a2217c06273eaee3e231ead6937964379c2e
Jul 30 13:07:24.649489 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:07:24.649455    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-kpc2j" event={"ID":"bbf37c61-e530-4d55-aacd-cbf6dc2da7ca","Type":"ContainerStarted","Data":"61ae3d3a6de7b32a90780bbbd731b3046061e6baf7b5959ba64b4e7c7ac92df6"}
Jul 30 13:07:24.649897 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:07:24.649510    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-kpc2j" event={"ID":"bbf37c61-e530-4d55-aacd-cbf6dc2da7ca","Type":"ContainerStarted","Data":"b0f8f19c99606871a3782e8a2b58a2217c06273eaee3e231ead6937964379c2e"}
Jul 30 13:07:24.649897 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:07:24.649537    2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-kpc2j"
Jul 30 13:07:24.687387 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:07:24.687336    2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-kpc2j" podStartSLOduration=1.687319702 podStartE2EDuration="1.687319702s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-30 13:07:23 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 13:07:24.686870305 +0000 UTC m=+473.615558569" watchObservedRunningTime="2026-07-30 13:07:24.687319702 +0000 UTC m=+473.616007965"
Jul 30 13:07:34.653922 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:07:34.653889    2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-psl2b"
Jul 30 13:07:35.658559 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:07:35.658528    2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-kpc2j"
Jul 30 13:07:35.659123 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:07:35.658606    2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-prcvv"
Jul 30 13:07:35.740504 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:07:35.740476    2566 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-prcvv"]
Jul 30 13:07:35.740679 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:07:35.740639    2566 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-prcvv" podUID="6c1b3e8e-1cb7-4348-ac0b-d72a0a98598a" containerName="manager" containerID="cri-o://740214148fb5b227745c7de72af80a210477ee9f32e7697db49c8d7f6001097d" gracePeriod=10
Jul 30 13:07:35.992001 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:07:35.991981    2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-prcvv"
Jul 30 13:07:36.065700 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:07:36.065669    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/6c1b3e8e-1cb7-4348-ac0b-d72a0a98598a-extensions-socket-volume\") pod \"6c1b3e8e-1cb7-4348-ac0b-d72a0a98598a\" (UID: \"6c1b3e8e-1cb7-4348-ac0b-d72a0a98598a\") "
Jul 30 13:07:36.065859 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:07:36.065739    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-r9gq5\" (UniqueName: \"kubernetes.io/projected/6c1b3e8e-1cb7-4348-ac0b-d72a0a98598a-kube-api-access-r9gq5\") pod \"6c1b3e8e-1cb7-4348-ac0b-d72a0a98598a\" (UID: \"6c1b3e8e-1cb7-4348-ac0b-d72a0a98598a\") "
Jul 30 13:07:36.066017 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:07:36.065994    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6c1b3e8e-1cb7-4348-ac0b-d72a0a98598a-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "6c1b3e8e-1cb7-4348-ac0b-d72a0a98598a" (UID: "6c1b3e8e-1cb7-4348-ac0b-d72a0a98598a"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 30 13:07:36.067601 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:07:36.067579    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6c1b3e8e-1cb7-4348-ac0b-d72a0a98598a-kube-api-access-r9gq5" (OuterVolumeSpecName: "kube-api-access-r9gq5") pod "6c1b3e8e-1cb7-4348-ac0b-d72a0a98598a" (UID: "6c1b3e8e-1cb7-4348-ac0b-d72a0a98598a"). InnerVolumeSpecName "kube-api-access-r9gq5". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 30 13:07:36.167267 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:07:36.167185    2566 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/6c1b3e8e-1cb7-4348-ac0b-d72a0a98598a-extensions-socket-volume\") on node \"ip-10-0-143-153.ec2.internal\" DevicePath \"\""
Jul 30 13:07:36.167267 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:07:36.167214    2566 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-r9gq5\" (UniqueName: \"kubernetes.io/projected/6c1b3e8e-1cb7-4348-ac0b-d72a0a98598a-kube-api-access-r9gq5\") on node \"ip-10-0-143-153.ec2.internal\" DevicePath \"\""
Jul 30 13:07:36.709982 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:07:36.709945    2566 generic.go:356] "Generic (PLEG): container finished" podID="6c1b3e8e-1cb7-4348-ac0b-d72a0a98598a" containerID="740214148fb5b227745c7de72af80a210477ee9f32e7697db49c8d7f6001097d" exitCode=0
Jul 30 13:07:36.710476 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:07:36.709994    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-prcvv" event={"ID":"6c1b3e8e-1cb7-4348-ac0b-d72a0a98598a","Type":"ContainerDied","Data":"740214148fb5b227745c7de72af80a210477ee9f32e7697db49c8d7f6001097d"}
Jul 30 13:07:36.710476 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:07:36.709997    2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-prcvv"
Jul 30 13:07:36.710476 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:07:36.710037    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-prcvv" event={"ID":"6c1b3e8e-1cb7-4348-ac0b-d72a0a98598a","Type":"ContainerDied","Data":"0f2a245797c6422779dca5bd58afd2a124d815d4434d12895f8c4c0152f11b7e"}
Jul 30 13:07:36.710476 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:07:36.710057    2566 scope.go:117] "RemoveContainer" containerID="740214148fb5b227745c7de72af80a210477ee9f32e7697db49c8d7f6001097d"
Jul 30 13:07:36.718493 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:07:36.718476    2566 scope.go:117] "RemoveContainer" containerID="740214148fb5b227745c7de72af80a210477ee9f32e7697db49c8d7f6001097d"
Jul 30 13:07:36.718763 ip-10-0-143-153 kubenswrapper[2566]: E0730 13:07:36.718744    2566 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"740214148fb5b227745c7de72af80a210477ee9f32e7697db49c8d7f6001097d\": container with ID starting with 740214148fb5b227745c7de72af80a210477ee9f32e7697db49c8d7f6001097d not found: ID does not exist" containerID="740214148fb5b227745c7de72af80a210477ee9f32e7697db49c8d7f6001097d"
Jul 30 13:07:36.718823 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:07:36.718772    2566 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"740214148fb5b227745c7de72af80a210477ee9f32e7697db49c8d7f6001097d"} err="failed to get container status \"740214148fb5b227745c7de72af80a210477ee9f32e7697db49c8d7f6001097d\": rpc error: code = NotFound desc = could not find container \"740214148fb5b227745c7de72af80a210477ee9f32e7697db49c8d7f6001097d\": container with ID starting with 740214148fb5b227745c7de72af80a210477ee9f32e7697db49c8d7f6001097d not found: ID does not exist"
Jul 30 13:07:36.729818 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:07:36.729793    2566 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-prcvv"]
Jul 30 13:07:36.736770 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:07:36.736748    2566 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-prcvv"]
Jul 30 13:07:37.629225 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:07:37.627725    2566 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="6c1b3e8e-1cb7-4348-ac0b-d72a0a98598a" path="/var/lib/kubelet/pods/6c1b3e8e-1cb7-4348-ac0b-d72a0a98598a/volumes"
Jul 30 13:07:54.282928 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:07:54.282892    2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-v7tqk"]
Jul 30 13:07:54.283583 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:07:54.283241    2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6c1b3e8e-1cb7-4348-ac0b-d72a0a98598a" containerName="manager"
Jul 30 13:07:54.283583 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:07:54.283253    2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="6c1b3e8e-1cb7-4348-ac0b-d72a0a98598a" containerName="manager"
Jul 30 13:07:54.283583 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:07:54.283306    2566 memory_manager.go:368] "RemoveStaleState removing state" podUID="6c1b3e8e-1cb7-4348-ac0b-d72a0a98598a" containerName="manager"
Jul 30 13:07:54.289805 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:07:54.289784    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-v7tqk"
Jul 30 13:07:54.292854 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:07:54.292830    2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"limitador-limits-config-limitador\""
Jul 30 13:07:54.292979 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:07:54.292964    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-q85h5\""
Jul 30 13:07:54.298109 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:07:54.298070    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-v7tqk"]
Jul 30 13:07:54.382672 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:07:54.382637    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-v7tqk"]
Jul 30 13:07:54.425201 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:07:54.425167    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-v8kkx\" (UniqueName: \"kubernetes.io/projected/56cde200-1377-4216-9eed-19b0bd78ce7a-kube-api-access-v8kkx\") pod \"limitador-limitador-64c94fd64f-v7tqk\" (UID: \"56cde200-1377-4216-9eed-19b0bd78ce7a\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-v7tqk"
Jul 30 13:07:54.425350 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:07:54.425235    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/56cde200-1377-4216-9eed-19b0bd78ce7a-config-file\") pod \"limitador-limitador-64c94fd64f-v7tqk\" (UID: \"56cde200-1377-4216-9eed-19b0bd78ce7a\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-v7tqk"
Jul 30 13:07:54.525848 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:07:54.525816    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-v8kkx\" (UniqueName: \"kubernetes.io/projected/56cde200-1377-4216-9eed-19b0bd78ce7a-kube-api-access-v8kkx\") pod \"limitador-limitador-64c94fd64f-v7tqk\" (UID: \"56cde200-1377-4216-9eed-19b0bd78ce7a\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-v7tqk"
Jul 30 13:07:54.526011 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:07:54.525877    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/56cde200-1377-4216-9eed-19b0bd78ce7a-config-file\") pod \"limitador-limitador-64c94fd64f-v7tqk\" (UID: \"56cde200-1377-4216-9eed-19b0bd78ce7a\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-v7tqk"
Jul 30 13:07:54.526550 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:07:54.526529    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/56cde200-1377-4216-9eed-19b0bd78ce7a-config-file\") pod \"limitador-limitador-64c94fd64f-v7tqk\" (UID: \"56cde200-1377-4216-9eed-19b0bd78ce7a\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-v7tqk"
Jul 30 13:07:54.534112 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:07:54.534034    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-v8kkx\" (UniqueName: \"kubernetes.io/projected/56cde200-1377-4216-9eed-19b0bd78ce7a-kube-api-access-v8kkx\") pod \"limitador-limitador-64c94fd64f-v7tqk\" (UID: \"56cde200-1377-4216-9eed-19b0bd78ce7a\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-v7tqk"
Jul 30 13:07:54.599878 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:07:54.599845    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-v7tqk"
Jul 30 13:07:54.739603 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:07:54.739565    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-v7tqk"]
Jul 30 13:07:54.742711 ip-10-0-143-153 kubenswrapper[2566]: W0730 13:07:54.742683    2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod56cde200_1377_4216_9eed_19b0bd78ce7a.slice/crio-03156d269b126508fa1ef14d6f43d62edd4b8743c2186f288da216c6201eaa0f WatchSource:0}: Error finding container 03156d269b126508fa1ef14d6f43d62edd4b8743c2186f288da216c6201eaa0f: Status 404 returned error can't find the container with id 03156d269b126508fa1ef14d6f43d62edd4b8743c2186f288da216c6201eaa0f
Jul 30 13:07:54.793528 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:07:54.793452    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-v7tqk" event={"ID":"56cde200-1377-4216-9eed-19b0bd78ce7a","Type":"ContainerStarted","Data":"03156d269b126508fa1ef14d6f43d62edd4b8743c2186f288da216c6201eaa0f"}
Jul 30 13:07:55.115560 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:07:55.115485    2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-58cd955675-4nm9w"]
Jul 30 13:07:55.120004 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:07:55.119979    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-4nm9w"
Jul 30 13:07:55.121749 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:07:55.121727    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-authorino-dockercfg-r2f7n\""
Jul 30 13:07:55.125266 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:07:55.125244    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-58cd955675-4nm9w"]
Jul 30 13:07:55.232443 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:07:55.232409    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xrwgh\" (UniqueName: \"kubernetes.io/projected/2e855582-95c3-418d-8f80-9ca3a686bc48-kube-api-access-xrwgh\") pod \"authorino-58cd955675-4nm9w\" (UID: \"2e855582-95c3-418d-8f80-9ca3a686bc48\") " pod="kuadrant-system/authorino-58cd955675-4nm9w"
Jul 30 13:07:55.322676 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:07:55.322638    2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-75d556bd77-zvtzk"]
Jul 30 13:07:55.326170 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:07:55.326148    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-zvtzk"
Jul 30 13:07:55.329622 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:07:55.329596    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-75d556bd77-zvtzk"]
Jul 30 13:07:55.332862 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:07:55.332835    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xrwgh\" (UniqueName: \"kubernetes.io/projected/2e855582-95c3-418d-8f80-9ca3a686bc48-kube-api-access-xrwgh\") pod \"authorino-58cd955675-4nm9w\" (UID: \"2e855582-95c3-418d-8f80-9ca3a686bc48\") " pod="kuadrant-system/authorino-58cd955675-4nm9w"
Jul 30 13:07:55.347559 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:07:55.347538    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xrwgh\" (UniqueName: \"kubernetes.io/projected/2e855582-95c3-418d-8f80-9ca3a686bc48-kube-api-access-xrwgh\") pod \"authorino-58cd955675-4nm9w\" (UID: \"2e855582-95c3-418d-8f80-9ca3a686bc48\") " pod="kuadrant-system/authorino-58cd955675-4nm9w"
Jul 30 13:07:55.430943 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:07:55.430911    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-4nm9w"
Jul 30 13:07:55.434195 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:07:55.434166    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mr9gw\" (UniqueName: \"kubernetes.io/projected/4aaa6528-1368-4a95-9034-6b92aff6f5a3-kube-api-access-mr9gw\") pod \"authorino-75d556bd77-zvtzk\" (UID: \"4aaa6528-1368-4a95-9034-6b92aff6f5a3\") " pod="kuadrant-system/authorino-75d556bd77-zvtzk"
Jul 30 13:07:55.534837 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:07:55.534660    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mr9gw\" (UniqueName: \"kubernetes.io/projected/4aaa6528-1368-4a95-9034-6b92aff6f5a3-kube-api-access-mr9gw\") pod \"authorino-75d556bd77-zvtzk\" (UID: \"4aaa6528-1368-4a95-9034-6b92aff6f5a3\") " pod="kuadrant-system/authorino-75d556bd77-zvtzk"
Jul 30 13:07:55.544736 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:07:55.544683    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mr9gw\" (UniqueName: \"kubernetes.io/projected/4aaa6528-1368-4a95-9034-6b92aff6f5a3-kube-api-access-mr9gw\") pod \"authorino-75d556bd77-zvtzk\" (UID: \"4aaa6528-1368-4a95-9034-6b92aff6f5a3\") " pod="kuadrant-system/authorino-75d556bd77-zvtzk"
Jul 30 13:07:55.585390 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:07:55.585358    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-58cd955675-4nm9w"]
Jul 30 13:07:55.588613 ip-10-0-143-153 kubenswrapper[2566]: W0730 13:07:55.588581    2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod2e855582_95c3_418d_8f80_9ca3a686bc48.slice/crio-1e5f55cfbae706eb6bdf0dca68fd4bbe397b837fff2ac6b9b9e10af686ec8e75 WatchSource:0}: Error finding container 1e5f55cfbae706eb6bdf0dca68fd4bbe397b837fff2ac6b9b9e10af686ec8e75: Status 404 returned error can't find the container with id 1e5f55cfbae706eb6bdf0dca68fd4bbe397b837fff2ac6b9b9e10af686ec8e75
Jul 30 13:07:55.636727 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:07:55.636488    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-zvtzk"
Jul 30 13:07:55.805511 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:07:55.805439    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-4nm9w" event={"ID":"2e855582-95c3-418d-8f80-9ca3a686bc48","Type":"ContainerStarted","Data":"1e5f55cfbae706eb6bdf0dca68fd4bbe397b837fff2ac6b9b9e10af686ec8e75"}
Jul 30 13:07:55.829587 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:07:55.829395    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-75d556bd77-zvtzk"]
Jul 30 13:07:55.832930 ip-10-0-143-153 kubenswrapper[2566]: W0730 13:07:55.832864    2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod4aaa6528_1368_4a95_9034_6b92aff6f5a3.slice/crio-c03bb48039cde05b83623637ff2d977fde5b6c9245df341b93ef4baef2c9565d WatchSource:0}: Error finding container c03bb48039cde05b83623637ff2d977fde5b6c9245df341b93ef4baef2c9565d: Status 404 returned error can't find the container with id c03bb48039cde05b83623637ff2d977fde5b6c9245df341b93ef4baef2c9565d
Jul 30 13:07:56.817049 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:07:56.816978    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-zvtzk" event={"ID":"4aaa6528-1368-4a95-9034-6b92aff6f5a3","Type":"ContainerStarted","Data":"c03bb48039cde05b83623637ff2d977fde5b6c9245df341b93ef4baef2c9565d"}
Jul 30 13:08:00.839651 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:08:00.839608    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-4nm9w" event={"ID":"2e855582-95c3-418d-8f80-9ca3a686bc48","Type":"ContainerStarted","Data":"c71ed4b97d26df91a3aff35ad6f0de2340c69a95ca2503d31a38849e1b48dd2a"}
Jul 30 13:08:00.841210 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:08:00.841187    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-zvtzk" event={"ID":"4aaa6528-1368-4a95-9034-6b92aff6f5a3","Type":"ContainerStarted","Data":"7741ac0bde197e0707c285ba586fd057f6edc5672cf11bfd2afc26a6646812a3"}
Jul 30 13:08:00.842764 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:08:00.842740    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-v7tqk" event={"ID":"56cde200-1377-4216-9eed-19b0bd78ce7a","Type":"ContainerStarted","Data":"8273a97915d9f978532c64ac3c3a274179e215fd05ae6cc6b96a375bc6dec039"}
Jul 30 13:08:00.842894 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:08:00.842879    2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-limitador-64c94fd64f-v7tqk"
Jul 30 13:08:00.854428 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:08:00.854377    2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-58cd955675-4nm9w" podStartSLOduration=1.3948732 podStartE2EDuration="5.854356271s" totalImagesPullingTime="4.459483071s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-30 13:07:55 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 13:08:00.853771712 +0000 UTC m=+509.782459972" watchObservedRunningTime="2026-07-30 13:08:00.854356271 +0000 UTC m=+509.783044536"
Jul 30 13:08:00.867913 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:08:00.867868    2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-75d556bd77-zvtzk" podStartSLOduration=1.684402756 podStartE2EDuration="5.867850374s" totalImagesPullingTime="4.183447618s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-30 13:07:55 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 13:08:00.866763623 +0000 UTC m=+509.795451886" watchObservedRunningTime="2026-07-30 13:08:00.867850374 +0000 UTC m=+509.796538636"
Jul 30 13:08:00.888355 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:08:00.888294    2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-limitador-64c94fd64f-v7tqk" podStartSLOduration=1.5737904459999998 podStartE2EDuration="6.888273583s" totalImagesPullingTime="5.314483137s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-30 13:07:54 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 13:08:00.887428979 +0000 UTC m=+509.816117245" watchObservedRunningTime="2026-07-30 13:08:00.888273583 +0000 UTC m=+509.816961846"
Jul 30 13:08:00.899971 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:08:00.899943    2566 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-58cd955675-4nm9w"]
Jul 30 13:08:02.852441 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:08:02.852403    2566 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/authorino-58cd955675-4nm9w" podUID="2e855582-95c3-418d-8f80-9ca3a686bc48" containerName="authorino" containerID="cri-o://c71ed4b97d26df91a3aff35ad6f0de2340c69a95ca2503d31a38849e1b48dd2a" gracePeriod=30
Jul 30 13:08:03.102780 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:08:03.102725    2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-4nm9w"
Jul 30 13:08:03.202413 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:08:03.202381    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-xrwgh\" (UniqueName: \"kubernetes.io/projected/2e855582-95c3-418d-8f80-9ca3a686bc48-kube-api-access-xrwgh\") pod \"2e855582-95c3-418d-8f80-9ca3a686bc48\" (UID: \"2e855582-95c3-418d-8f80-9ca3a686bc48\") "
Jul 30 13:08:03.204466 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:08:03.204437    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2e855582-95c3-418d-8f80-9ca3a686bc48-kube-api-access-xrwgh" (OuterVolumeSpecName: "kube-api-access-xrwgh") pod "2e855582-95c3-418d-8f80-9ca3a686bc48" (UID: "2e855582-95c3-418d-8f80-9ca3a686bc48"). InnerVolumeSpecName "kube-api-access-xrwgh". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 30 13:08:03.302958 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:08:03.302918    2566 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-xrwgh\" (UniqueName: \"kubernetes.io/projected/2e855582-95c3-418d-8f80-9ca3a686bc48-kube-api-access-xrwgh\") on node \"ip-10-0-143-153.ec2.internal\" DevicePath \"\""
Jul 30 13:08:03.858537 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:08:03.858498    2566 generic.go:356] "Generic (PLEG): container finished" podID="2e855582-95c3-418d-8f80-9ca3a686bc48" containerID="c71ed4b97d26df91a3aff35ad6f0de2340c69a95ca2503d31a38849e1b48dd2a" exitCode=0
Jul 30 13:08:03.858910 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:08:03.858543    2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-4nm9w"
Jul 30 13:08:03.858910 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:08:03.858581    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-4nm9w" event={"ID":"2e855582-95c3-418d-8f80-9ca3a686bc48","Type":"ContainerDied","Data":"c71ed4b97d26df91a3aff35ad6f0de2340c69a95ca2503d31a38849e1b48dd2a"}
Jul 30 13:08:03.858910 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:08:03.858621    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-4nm9w" event={"ID":"2e855582-95c3-418d-8f80-9ca3a686bc48","Type":"ContainerDied","Data":"1e5f55cfbae706eb6bdf0dca68fd4bbe397b837fff2ac6b9b9e10af686ec8e75"}
Jul 30 13:08:03.858910 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:08:03.858638    2566 scope.go:117] "RemoveContainer" containerID="c71ed4b97d26df91a3aff35ad6f0de2340c69a95ca2503d31a38849e1b48dd2a"
Jul 30 13:08:03.867222 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:08:03.867196    2566 scope.go:117] "RemoveContainer" containerID="c71ed4b97d26df91a3aff35ad6f0de2340c69a95ca2503d31a38849e1b48dd2a"
Jul 30 13:08:03.867457 ip-10-0-143-153 kubenswrapper[2566]: E0730 13:08:03.867440    2566 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c71ed4b97d26df91a3aff35ad6f0de2340c69a95ca2503d31a38849e1b48dd2a\": container with ID starting with c71ed4b97d26df91a3aff35ad6f0de2340c69a95ca2503d31a38849e1b48dd2a not found: ID does not exist" containerID="c71ed4b97d26df91a3aff35ad6f0de2340c69a95ca2503d31a38849e1b48dd2a"
Jul 30 13:08:03.867502 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:08:03.867466    2566 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c71ed4b97d26df91a3aff35ad6f0de2340c69a95ca2503d31a38849e1b48dd2a"} err="failed to get container status \"c71ed4b97d26df91a3aff35ad6f0de2340c69a95ca2503d31a38849e1b48dd2a\": rpc error: code = NotFound desc = could not find container \"c71ed4b97d26df91a3aff35ad6f0de2340c69a95ca2503d31a38849e1b48dd2a\": container with ID starting with c71ed4b97d26df91a3aff35ad6f0de2340c69a95ca2503d31a38849e1b48dd2a not found: ID does not exist"
Jul 30 13:08:03.876348 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:08:03.876326    2566 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-58cd955675-4nm9w"]
Jul 30 13:08:03.879924 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:08:03.879906    2566 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-58cd955675-4nm9w"]
Jul 30 13:08:05.626852 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:08:05.626815    2566 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="2e855582-95c3-418d-8f80-9ca3a686bc48" path="/var/lib/kubelet/pods/2e855582-95c3-418d-8f80-9ca3a686bc48/volumes"
Jul 30 13:08:11.355170 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:08:11.355127    2566 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-v7tqk"]
Jul 30 13:08:11.355954 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:08:11.355898    2566 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/limitador-limitador-64c94fd64f-v7tqk" podUID="56cde200-1377-4216-9eed-19b0bd78ce7a" containerName="limitador" containerID="cri-o://8273a97915d9f978532c64ac3c3a274179e215fd05ae6cc6b96a375bc6dec039" gracePeriod=30
Jul 30 13:08:11.358206 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:08:11.358187    2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-limitador-64c94fd64f-v7tqk"
Jul 30 13:08:11.904071 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:08:11.904043    2566 generic.go:356] "Generic (PLEG): container finished" podID="56cde200-1377-4216-9eed-19b0bd78ce7a" containerID="8273a97915d9f978532c64ac3c3a274179e215fd05ae6cc6b96a375bc6dec039" exitCode=0
Jul 30 13:08:11.904195 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:08:11.904104    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-v7tqk" event={"ID":"56cde200-1377-4216-9eed-19b0bd78ce7a","Type":"ContainerDied","Data":"8273a97915d9f978532c64ac3c3a274179e215fd05ae6cc6b96a375bc6dec039"}
Jul 30 13:08:11.914821 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:08:11.914800    2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-v7tqk"
Jul 30 13:08:12.078899 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:08:12.078811    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/56cde200-1377-4216-9eed-19b0bd78ce7a-config-file\") pod \"56cde200-1377-4216-9eed-19b0bd78ce7a\" (UID: \"56cde200-1377-4216-9eed-19b0bd78ce7a\") "
Jul 30 13:08:12.079097 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:08:12.078902    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-v8kkx\" (UniqueName: \"kubernetes.io/projected/56cde200-1377-4216-9eed-19b0bd78ce7a-kube-api-access-v8kkx\") pod \"56cde200-1377-4216-9eed-19b0bd78ce7a\" (UID: \"56cde200-1377-4216-9eed-19b0bd78ce7a\") "
Jul 30 13:08:12.079270 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:08:12.079244    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/56cde200-1377-4216-9eed-19b0bd78ce7a-config-file" (OuterVolumeSpecName: "config-file") pod "56cde200-1377-4216-9eed-19b0bd78ce7a" (UID: "56cde200-1377-4216-9eed-19b0bd78ce7a"). InnerVolumeSpecName "config-file". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 30 13:08:12.081005 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:08:12.080977    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/56cde200-1377-4216-9eed-19b0bd78ce7a-kube-api-access-v8kkx" (OuterVolumeSpecName: "kube-api-access-v8kkx") pod "56cde200-1377-4216-9eed-19b0bd78ce7a" (UID: "56cde200-1377-4216-9eed-19b0bd78ce7a"). InnerVolumeSpecName "kube-api-access-v8kkx". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 30 13:08:12.180320 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:08:12.180288    2566 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-v8kkx\" (UniqueName: \"kubernetes.io/projected/56cde200-1377-4216-9eed-19b0bd78ce7a-kube-api-access-v8kkx\") on node \"ip-10-0-143-153.ec2.internal\" DevicePath \"\""
Jul 30 13:08:12.180320 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:08:12.180317    2566 reconciler_common.go:299] "Volume detached for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/56cde200-1377-4216-9eed-19b0bd78ce7a-config-file\") on node \"ip-10-0-143-153.ec2.internal\" DevicePath \"\""
Jul 30 13:08:12.909991 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:08:12.909961    2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-v7tqk"
Jul 30 13:08:12.909991 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:08:12.909990    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-v7tqk" event={"ID":"56cde200-1377-4216-9eed-19b0bd78ce7a","Type":"ContainerDied","Data":"03156d269b126508fa1ef14d6f43d62edd4b8743c2186f288da216c6201eaa0f"}
Jul 30 13:08:12.910597 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:08:12.910040    2566 scope.go:117] "RemoveContainer" containerID="8273a97915d9f978532c64ac3c3a274179e215fd05ae6cc6b96a375bc6dec039"
Jul 30 13:08:12.929416 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:08:12.929385    2566 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-v7tqk"]
Jul 30 13:08:12.935532 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:08:12.935508    2566 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-v7tqk"]
Jul 30 13:08:13.626851 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:08:13.626819    2566 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="56cde200-1377-4216-9eed-19b0bd78ce7a" path="/var/lib/kubelet/pods/56cde200-1377-4216-9eed-19b0bd78ce7a/volumes"
Jul 30 13:08:16.080421 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:08:16.080386    2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/postgres-69fb4594cf-zthfp"]
Jul 30 13:08:16.080920 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:08:16.080898    2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="56cde200-1377-4216-9eed-19b0bd78ce7a" containerName="limitador"
Jul 30 13:08:16.080995 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:08:16.080923    2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="56cde200-1377-4216-9eed-19b0bd78ce7a" containerName="limitador"
Jul 30 13:08:16.080995 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:08:16.080941    2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2e855582-95c3-418d-8f80-9ca3a686bc48" containerName="authorino"
Jul 30 13:08:16.080995 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:08:16.080950    2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="2e855582-95c3-418d-8f80-9ca3a686bc48" containerName="authorino"
Jul 30 13:08:16.081167 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:08:16.081047    2566 memory_manager.go:368] "RemoveStaleState removing state" podUID="56cde200-1377-4216-9eed-19b0bd78ce7a" containerName="limitador"
Jul 30 13:08:16.081167 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:08:16.081065    2566 memory_manager.go:368] "RemoveStaleState removing state" podUID="2e855582-95c3-418d-8f80-9ca3a686bc48" containerName="authorino"
Jul 30 13:08:16.085246 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:08:16.085223    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/postgres-69fb4594cf-zthfp"
Jul 30 13:08:16.087159 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:08:16.087134    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"postgres-creds\""
Jul 30 13:08:16.087280 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:08:16.087176    2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 30 13:08:16.087618 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:08:16.087602    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"default-dockercfg-r89qc\""
Jul 30 13:08:16.087735 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:08:16.087623    2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"kube-root-ca.crt\""
Jul 30 13:08:16.091628 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:08:16.091607    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/postgres-69fb4594cf-zthfp"]
Jul 30 13:08:16.215500 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:08:16.215468    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/767dfad6-34a4-4af3-9603-f776a18fae0e-data\") pod \"postgres-69fb4594cf-zthfp\" (UID: \"767dfad6-34a4-4af3-9603-f776a18fae0e\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-zthfp"
Jul 30 13:08:16.215500 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:08:16.215503    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5cx6m\" (UniqueName: \"kubernetes.io/projected/767dfad6-34a4-4af3-9603-f776a18fae0e-kube-api-access-5cx6m\") pod \"postgres-69fb4594cf-zthfp\" (UID: \"767dfad6-34a4-4af3-9603-f776a18fae0e\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-zthfp"
Jul 30 13:08:16.316868 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:08:16.316832    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/767dfad6-34a4-4af3-9603-f776a18fae0e-data\") pod \"postgres-69fb4594cf-zthfp\" (UID: \"767dfad6-34a4-4af3-9603-f776a18fae0e\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-zthfp"
Jul 30 13:08:16.317136 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:08:16.316874    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5cx6m\" (UniqueName: \"kubernetes.io/projected/767dfad6-34a4-4af3-9603-f776a18fae0e-kube-api-access-5cx6m\") pod \"postgres-69fb4594cf-zthfp\" (UID: \"767dfad6-34a4-4af3-9603-f776a18fae0e\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-zthfp"
Jul 30 13:08:16.317248 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:08:16.317226    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/767dfad6-34a4-4af3-9603-f776a18fae0e-data\") pod \"postgres-69fb4594cf-zthfp\" (UID: \"767dfad6-34a4-4af3-9603-f776a18fae0e\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-zthfp"
Jul 30 13:08:16.324188 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:08:16.324161    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5cx6m\" (UniqueName: \"kubernetes.io/projected/767dfad6-34a4-4af3-9603-f776a18fae0e-kube-api-access-5cx6m\") pod \"postgres-69fb4594cf-zthfp\" (UID: \"767dfad6-34a4-4af3-9603-f776a18fae0e\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-zthfp"
Jul 30 13:08:16.396180 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:08:16.396150    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/postgres-69fb4594cf-zthfp"
Jul 30 13:08:16.531327 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:08:16.531303    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/postgres-69fb4594cf-zthfp"]
Jul 30 13:08:16.533881 ip-10-0-143-153 kubenswrapper[2566]: W0730 13:08:16.533853    2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod767dfad6_34a4_4af3_9603_f776a18fae0e.slice/crio-57e6423280f970c26b2a620100d4bcd79ebf781f07baee445c0d39b03c32bbd2 WatchSource:0}: Error finding container 57e6423280f970c26b2a620100d4bcd79ebf781f07baee445c0d39b03c32bbd2: Status 404 returned error can't find the container with id 57e6423280f970c26b2a620100d4bcd79ebf781f07baee445c0d39b03c32bbd2
Jul 30 13:08:16.929658 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:08:16.929627    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/postgres-69fb4594cf-zthfp" event={"ID":"767dfad6-34a4-4af3-9603-f776a18fae0e","Type":"ContainerStarted","Data":"57e6423280f970c26b2a620100d4bcd79ebf781f07baee445c0d39b03c32bbd2"}
Jul 30 13:08:21.958033 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:08:21.957931    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/postgres-69fb4594cf-zthfp" event={"ID":"767dfad6-34a4-4af3-9603-f776a18fae0e","Type":"ContainerStarted","Data":"61e802f57722acf7b8dc03063caa8bef3b230c511900704867b031a8ce49392c"}
Jul 30 13:08:21.958033 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:08:21.957998    2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/postgres-69fb4594cf-zthfp"
Jul 30 13:08:21.976617 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:08:21.976572    2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/postgres-69fb4594cf-zthfp" podStartSLOduration=0.855644736 podStartE2EDuration="5.976557417s" totalImagesPullingTime="5.120912681s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-30 13:08:16 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 13:08:21.975741861 +0000 UTC m=+530.904430175" watchObservedRunningTime="2026-07-30 13:08:21.976557417 +0000 UTC m=+530.905245680"
Jul 30 13:08:27.991667 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:08:27.991587    2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/postgres-69fb4594cf-zthfp"
Jul 30 13:08:28.557636 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:08:28.557601    2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-5d4b67c446-rx5db"]
Jul 30 13:08:28.561089 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:08:28.561058    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-rx5db"
Jul 30 13:08:28.567857 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:08:28.567833    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-rx5db"]
Jul 30 13:08:28.617948 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:08:28.617908    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5jq5s\" (UniqueName: \"kubernetes.io/projected/c85cc1d5-f842-4632-8541-aaa180fcb005-kube-api-access-5jq5s\") pod \"authorino-5d4b67c446-rx5db\" (UID: \"c85cc1d5-f842-4632-8541-aaa180fcb005\") " pod="kuadrant-system/authorino-5d4b67c446-rx5db"
Jul 30 13:08:28.719314 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:08:28.719277    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5jq5s\" (UniqueName: \"kubernetes.io/projected/c85cc1d5-f842-4632-8541-aaa180fcb005-kube-api-access-5jq5s\") pod \"authorino-5d4b67c446-rx5db\" (UID: \"c85cc1d5-f842-4632-8541-aaa180fcb005\") " pod="kuadrant-system/authorino-5d4b67c446-rx5db"
Jul 30 13:08:28.728504 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:08:28.728475    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5jq5s\" (UniqueName: \"kubernetes.io/projected/c85cc1d5-f842-4632-8541-aaa180fcb005-kube-api-access-5jq5s\") pod \"authorino-5d4b67c446-rx5db\" (UID: \"c85cc1d5-f842-4632-8541-aaa180fcb005\") " pod="kuadrant-system/authorino-5d4b67c446-rx5db"
Jul 30 13:08:28.809767 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:08:28.809675    2566 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-rx5db"]
Jul 30 13:08:28.809982 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:08:28.809964    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-rx5db"
Jul 30 13:08:28.836123 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:08:28.836090    2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-64dbf947f9-q6rfr"]
Jul 30 13:08:28.839639 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:08:28.839621    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-64dbf947f9-q6rfr"
Jul 30 13:08:28.846436 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:08:28.846409    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-64dbf947f9-q6rfr"]
Jul 30 13:08:28.913983 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:08:28.913944    2566 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-64dbf947f9-q6rfr"]
Jul 30 13:08:28.914264 ip-10-0-143-153 kubenswrapper[2566]: E0730 13:08:28.914242    2566 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[kube-api-access-j8fxp], unattached volumes=[], failed to process volumes=[kube-api-access-j8fxp]: context canceled" pod="kuadrant-system/authorino-64dbf947f9-q6rfr" podUID="0b55fbee-7f98-43df-a2c2-667f4eb1eab5"
Jul 30 13:08:28.921383 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:08:28.921353    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-j8fxp\" (UniqueName: \"kubernetes.io/projected/0b55fbee-7f98-43df-a2c2-667f4eb1eab5-kube-api-access-j8fxp\") pod \"authorino-64dbf947f9-q6rfr\" (UID: \"0b55fbee-7f98-43df-a2c2-667f4eb1eab5\") " pod="kuadrant-system/authorino-64dbf947f9-q6rfr"
Jul 30 13:08:28.946068 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:08:28.946038    2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-75b89cbd95-cpwkw"]
Jul 30 13:08:28.949424 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:08:28.949400    2566 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-rx5db"]
Jul 30 13:08:28.949531 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:08:28.949499    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75b89cbd95-cpwkw"
Jul 30 13:08:28.951311 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:08:28.951290    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-server-cert\""
Jul 30 13:08:28.952716 ip-10-0-143-153 kubenswrapper[2566]: W0730 13:08:28.952694    2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podc85cc1d5_f842_4632_8541_aaa180fcb005.slice/crio-563a6a0dbae0130548b2f4332f6b14d6f01f1dbf7bbfd9507d129004bd32e37c WatchSource:0}: Error finding container 563a6a0dbae0130548b2f4332f6b14d6f01f1dbf7bbfd9507d129004bd32e37c: Status 404 returned error can't find the container with id 563a6a0dbae0130548b2f4332f6b14d6f01f1dbf7bbfd9507d129004bd32e37c
Jul 30 13:08:28.956429 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:08:28.956410    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-75b89cbd95-cpwkw"]
Jul 30 13:08:28.992172 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:08:28.992150    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-64dbf947f9-q6rfr"
Jul 30 13:08:28.992469 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:08:28.992144    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5d4b67c446-rx5db" event={"ID":"c85cc1d5-f842-4632-8541-aaa180fcb005","Type":"ContainerStarted","Data":"563a6a0dbae0130548b2f4332f6b14d6f01f1dbf7bbfd9507d129004bd32e37c"}
Jul 30 13:08:28.998662 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:08:28.998636    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-64dbf947f9-q6rfr"
Jul 30 13:08:29.022482 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:08:29.022451    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fh5b2\" (UniqueName: \"kubernetes.io/projected/c426d46b-6492-4761-bc70-d4383f3df3f5-kube-api-access-fh5b2\") pod \"authorino-75b89cbd95-cpwkw\" (UID: \"c426d46b-6492-4761-bc70-d4383f3df3f5\") " pod="kuadrant-system/authorino-75b89cbd95-cpwkw"
Jul 30 13:08:29.022619 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:08:29.022500    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/c426d46b-6492-4761-bc70-d4383f3df3f5-tls-cert\") pod \"authorino-75b89cbd95-cpwkw\" (UID: \"c426d46b-6492-4761-bc70-d4383f3df3f5\") " pod="kuadrant-system/authorino-75b89cbd95-cpwkw"
Jul 30 13:08:29.022619 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:08:29.022536    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-j8fxp\" (UniqueName: \"kubernetes.io/projected/0b55fbee-7f98-43df-a2c2-667f4eb1eab5-kube-api-access-j8fxp\") pod \"authorino-64dbf947f9-q6rfr\" (UID: \"0b55fbee-7f98-43df-a2c2-667f4eb1eab5\") " pod="kuadrant-system/authorino-64dbf947f9-q6rfr"
Jul 30 13:08:29.030501 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:08:29.030477    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-j8fxp\" (UniqueName: \"kubernetes.io/projected/0b55fbee-7f98-43df-a2c2-667f4eb1eab5-kube-api-access-j8fxp\") pod \"authorino-64dbf947f9-q6rfr\" (UID: \"0b55fbee-7f98-43df-a2c2-667f4eb1eab5\") " pod="kuadrant-system/authorino-64dbf947f9-q6rfr"
Jul 30 13:08:29.123590 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:08:29.123512    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-j8fxp\" (UniqueName: \"kubernetes.io/projected/0b55fbee-7f98-43df-a2c2-667f4eb1eab5-kube-api-access-j8fxp\") pod \"0b55fbee-7f98-43df-a2c2-667f4eb1eab5\" (UID: \"0b55fbee-7f98-43df-a2c2-667f4eb1eab5\") "
Jul 30 13:08:29.123776 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:08:29.123677    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fh5b2\" (UniqueName: \"kubernetes.io/projected/c426d46b-6492-4761-bc70-d4383f3df3f5-kube-api-access-fh5b2\") pod \"authorino-75b89cbd95-cpwkw\" (UID: \"c426d46b-6492-4761-bc70-d4383f3df3f5\") " pod="kuadrant-system/authorino-75b89cbd95-cpwkw"
Jul 30 13:08:29.123776 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:08:29.123709    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/c426d46b-6492-4761-bc70-d4383f3df3f5-tls-cert\") pod \"authorino-75b89cbd95-cpwkw\" (UID: \"c426d46b-6492-4761-bc70-d4383f3df3f5\") " pod="kuadrant-system/authorino-75b89cbd95-cpwkw"
Jul 30 13:08:29.125606 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:08:29.125573    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0b55fbee-7f98-43df-a2c2-667f4eb1eab5-kube-api-access-j8fxp" (OuterVolumeSpecName: "kube-api-access-j8fxp") pod "0b55fbee-7f98-43df-a2c2-667f4eb1eab5" (UID: "0b55fbee-7f98-43df-a2c2-667f4eb1eab5"). InnerVolumeSpecName "kube-api-access-j8fxp". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 30 13:08:29.125907 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:08:29.125890    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/c426d46b-6492-4761-bc70-d4383f3df3f5-tls-cert\") pod \"authorino-75b89cbd95-cpwkw\" (UID: \"c426d46b-6492-4761-bc70-d4383f3df3f5\") " pod="kuadrant-system/authorino-75b89cbd95-cpwkw"
Jul 30 13:08:29.131358 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:08:29.131335    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fh5b2\" (UniqueName: \"kubernetes.io/projected/c426d46b-6492-4761-bc70-d4383f3df3f5-kube-api-access-fh5b2\") pod \"authorino-75b89cbd95-cpwkw\" (UID: \"c426d46b-6492-4761-bc70-d4383f3df3f5\") " pod="kuadrant-system/authorino-75b89cbd95-cpwkw"
Jul 30 13:08:29.224668 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:08:29.224636    2566 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-j8fxp\" (UniqueName: \"kubernetes.io/projected/0b55fbee-7f98-43df-a2c2-667f4eb1eab5-kube-api-access-j8fxp\") on node \"ip-10-0-143-153.ec2.internal\" DevicePath \"\""
Jul 30 13:08:29.266947 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:08:29.266909    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75b89cbd95-cpwkw"
Jul 30 13:08:29.423243 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:08:29.423212    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-75b89cbd95-cpwkw"]
Jul 30 13:08:29.427197 ip-10-0-143-153 kubenswrapper[2566]: W0730 13:08:29.427159    2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podc426d46b_6492_4761_bc70_d4383f3df3f5.slice/crio-f5815a9929dcd64f44c1c6a2911e7fa32e114324452f5ef8d76dc8a1ae5b7776 WatchSource:0}: Error finding container f5815a9929dcd64f44c1c6a2911e7fa32e114324452f5ef8d76dc8a1ae5b7776: Status 404 returned error can't find the container with id f5815a9929dcd64f44c1c6a2911e7fa32e114324452f5ef8d76dc8a1ae5b7776
Jul 30 13:08:29.998488 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:08:29.998457    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75b89cbd95-cpwkw" event={"ID":"c426d46b-6492-4761-bc70-d4383f3df3f5","Type":"ContainerStarted","Data":"f5815a9929dcd64f44c1c6a2911e7fa32e114324452f5ef8d76dc8a1ae5b7776"}
Jul 30 13:08:30.000061 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:08:30.000041    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-64dbf947f9-q6rfr"
Jul 30 13:08:30.000184 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:08:30.000069    2566 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/authorino-5d4b67c446-rx5db" podUID="c85cc1d5-f842-4632-8541-aaa180fcb005" containerName="authorino" containerID="cri-o://a8d831aa7db35ed680fd3de614d9bb0f509bd21366db4859671c8b6b8f01efa0" gracePeriod=30
Jul 30 13:08:30.000184 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:08:30.000034    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5d4b67c446-rx5db" event={"ID":"c85cc1d5-f842-4632-8541-aaa180fcb005","Type":"ContainerStarted","Data":"a8d831aa7db35ed680fd3de614d9bb0f509bd21366db4859671c8b6b8f01efa0"}
Jul 30 13:08:30.015129 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:08:30.015066    2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-5d4b67c446-rx5db" podStartSLOduration=1.6835620470000001 podStartE2EDuration="2.015049828s" totalImagesPullingTime="331.487781ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-30 13:08:28 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 13:08:30.014692919 +0000 UTC m=+538.943381179" watchObservedRunningTime="2026-07-30 13:08:30.015049828 +0000 UTC m=+538.943738091"
Jul 30 13:08:30.041641 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:08:30.041617    2566 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-64dbf947f9-q6rfr"]
Jul 30 13:08:30.043290 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:08:30.043268    2566 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-64dbf947f9-q6rfr"]
Jul 30 13:08:30.294238 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:08:30.294211    2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-rx5db"
Jul 30 13:08:30.334070 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:08:30.334038    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-5jq5s\" (UniqueName: \"kubernetes.io/projected/c85cc1d5-f842-4632-8541-aaa180fcb005-kube-api-access-5jq5s\") pod \"c85cc1d5-f842-4632-8541-aaa180fcb005\" (UID: \"c85cc1d5-f842-4632-8541-aaa180fcb005\") "
Jul 30 13:08:30.336213 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:08:30.336187    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c85cc1d5-f842-4632-8541-aaa180fcb005-kube-api-access-5jq5s" (OuterVolumeSpecName: "kube-api-access-5jq5s") pod "c85cc1d5-f842-4632-8541-aaa180fcb005" (UID: "c85cc1d5-f842-4632-8541-aaa180fcb005"). InnerVolumeSpecName "kube-api-access-5jq5s". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 30 13:08:30.435126 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:08:30.435072    2566 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-5jq5s\" (UniqueName: \"kubernetes.io/projected/c85cc1d5-f842-4632-8541-aaa180fcb005-kube-api-access-5jq5s\") on node \"ip-10-0-143-153.ec2.internal\" DevicePath \"\""
Jul 30 13:08:31.006539 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:08:31.006449    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75b89cbd95-cpwkw" event={"ID":"c426d46b-6492-4761-bc70-d4383f3df3f5","Type":"ContainerStarted","Data":"b036b4aea5dfef37604f10bb9735137345eaad02c08fa729f52cfe1f49988f32"}
Jul 30 13:08:31.007622 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:08:31.007601    2566 generic.go:356] "Generic (PLEG): container finished" podID="c85cc1d5-f842-4632-8541-aaa180fcb005" containerID="a8d831aa7db35ed680fd3de614d9bb0f509bd21366db4859671c8b6b8f01efa0" exitCode=0
Jul 30 13:08:31.007713 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:08:31.007632    2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-rx5db"
Jul 30 13:08:31.007713 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:08:31.007691    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5d4b67c446-rx5db" event={"ID":"c85cc1d5-f842-4632-8541-aaa180fcb005","Type":"ContainerDied","Data":"a8d831aa7db35ed680fd3de614d9bb0f509bd21366db4859671c8b6b8f01efa0"}
Jul 30 13:08:31.007792 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:08:31.007730    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5d4b67c446-rx5db" event={"ID":"c85cc1d5-f842-4632-8541-aaa180fcb005","Type":"ContainerDied","Data":"563a6a0dbae0130548b2f4332f6b14d6f01f1dbf7bbfd9507d129004bd32e37c"}
Jul 30 13:08:31.007792 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:08:31.007747    2566 scope.go:117] "RemoveContainer" containerID="a8d831aa7db35ed680fd3de614d9bb0f509bd21366db4859671c8b6b8f01efa0"
Jul 30 13:08:31.035187 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:08:31.032443    2566 scope.go:117] "RemoveContainer" containerID="a8d831aa7db35ed680fd3de614d9bb0f509bd21366db4859671c8b6b8f01efa0"
Jul 30 13:08:31.035187 ip-10-0-143-153 kubenswrapper[2566]: E0730 13:08:31.033427    2566 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a8d831aa7db35ed680fd3de614d9bb0f509bd21366db4859671c8b6b8f01efa0\": container with ID starting with a8d831aa7db35ed680fd3de614d9bb0f509bd21366db4859671c8b6b8f01efa0 not found: ID does not exist" containerID="a8d831aa7db35ed680fd3de614d9bb0f509bd21366db4859671c8b6b8f01efa0"
Jul 30 13:08:31.035187 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:08:31.033466    2566 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a8d831aa7db35ed680fd3de614d9bb0f509bd21366db4859671c8b6b8f01efa0"} err="failed to get container status \"a8d831aa7db35ed680fd3de614d9bb0f509bd21366db4859671c8b6b8f01efa0\": rpc error: code = NotFound desc = could not find container \"a8d831aa7db35ed680fd3de614d9bb0f509bd21366db4859671c8b6b8f01efa0\": container with ID starting with a8d831aa7db35ed680fd3de614d9bb0f509bd21366db4859671c8b6b8f01efa0 not found: ID does not exist"
Jul 30 13:08:31.035187 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:08:31.034663    2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-75b89cbd95-cpwkw" podStartSLOduration=2.480024756 podStartE2EDuration="3.034645224s" totalImagesPullingTime="554.620468ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-30 13:08:28 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 13:08:31.032502672 +0000 UTC m=+539.961190934" watchObservedRunningTime="2026-07-30 13:08:31.034645224 +0000 UTC m=+539.963333488"
Jul 30 13:08:31.048401 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:08:31.048374    2566 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-75d556bd77-zvtzk"]
Jul 30 13:08:31.048589 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:08:31.048564    2566 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/authorino-75d556bd77-zvtzk" podUID="4aaa6528-1368-4a95-9034-6b92aff6f5a3" containerName="authorino" containerID="cri-o://7741ac0bde197e0707c285ba586fd057f6edc5672cf11bfd2afc26a6646812a3" gracePeriod=30
Jul 30 13:08:31.052378 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:08:31.052347    2566 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-rx5db"]
Jul 30 13:08:31.054461 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:08:31.054440    2566 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-rx5db"]
Jul 30 13:08:31.353048 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:08:31.353010    2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-zvtzk"
Jul 30 13:08:31.442910 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:08:31.442880    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-mr9gw\" (UniqueName: \"kubernetes.io/projected/4aaa6528-1368-4a95-9034-6b92aff6f5a3-kube-api-access-mr9gw\") pod \"4aaa6528-1368-4a95-9034-6b92aff6f5a3\" (UID: \"4aaa6528-1368-4a95-9034-6b92aff6f5a3\") "
Jul 30 13:08:31.444983 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:08:31.444961    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4aaa6528-1368-4a95-9034-6b92aff6f5a3-kube-api-access-mr9gw" (OuterVolumeSpecName: "kube-api-access-mr9gw") pod "4aaa6528-1368-4a95-9034-6b92aff6f5a3" (UID: "4aaa6528-1368-4a95-9034-6b92aff6f5a3"). InnerVolumeSpecName "kube-api-access-mr9gw". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 30 13:08:31.543523 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:08:31.543504    2566 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-mr9gw\" (UniqueName: \"kubernetes.io/projected/4aaa6528-1368-4a95-9034-6b92aff6f5a3-kube-api-access-mr9gw\") on node \"ip-10-0-143-153.ec2.internal\" DevicePath \"\""
Jul 30 13:08:31.626921 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:08:31.626852    2566 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="0b55fbee-7f98-43df-a2c2-667f4eb1eab5" path="/var/lib/kubelet/pods/0b55fbee-7f98-43df-a2c2-667f4eb1eab5/volumes"
Jul 30 13:08:31.627102 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:08:31.627059    2566 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c85cc1d5-f842-4632-8541-aaa180fcb005" path="/var/lib/kubelet/pods/c85cc1d5-f842-4632-8541-aaa180fcb005/volumes"
Jul 30 13:08:32.013344 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:08:32.013312    2566 generic.go:356] "Generic (PLEG): container finished" podID="4aaa6528-1368-4a95-9034-6b92aff6f5a3" containerID="7741ac0bde197e0707c285ba586fd057f6edc5672cf11bfd2afc26a6646812a3" exitCode=0
Jul 30 13:08:32.013795 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:08:32.013359    2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-zvtzk"
Jul 30 13:08:32.013795 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:08:32.013399    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-zvtzk" event={"ID":"4aaa6528-1368-4a95-9034-6b92aff6f5a3","Type":"ContainerDied","Data":"7741ac0bde197e0707c285ba586fd057f6edc5672cf11bfd2afc26a6646812a3"}
Jul 30 13:08:32.013795 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:08:32.013451    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-zvtzk" event={"ID":"4aaa6528-1368-4a95-9034-6b92aff6f5a3","Type":"ContainerDied","Data":"c03bb48039cde05b83623637ff2d977fde5b6c9245df341b93ef4baef2c9565d"}
Jul 30 13:08:32.013795 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:08:32.013483    2566 scope.go:117] "RemoveContainer" containerID="7741ac0bde197e0707c285ba586fd057f6edc5672cf11bfd2afc26a6646812a3"
Jul 30 13:08:32.021568 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:08:32.021556    2566 scope.go:117] "RemoveContainer" containerID="7741ac0bde197e0707c285ba586fd057f6edc5672cf11bfd2afc26a6646812a3"
Jul 30 13:08:32.021842 ip-10-0-143-153 kubenswrapper[2566]: E0730 13:08:32.021821    2566 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7741ac0bde197e0707c285ba586fd057f6edc5672cf11bfd2afc26a6646812a3\": container with ID starting with 7741ac0bde197e0707c285ba586fd057f6edc5672cf11bfd2afc26a6646812a3 not found: ID does not exist" containerID="7741ac0bde197e0707c285ba586fd057f6edc5672cf11bfd2afc26a6646812a3"
Jul 30 13:08:32.021907 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:08:32.021850    2566 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7741ac0bde197e0707c285ba586fd057f6edc5672cf11bfd2afc26a6646812a3"} err="failed to get container status \"7741ac0bde197e0707c285ba586fd057f6edc5672cf11bfd2afc26a6646812a3\": rpc error: code = NotFound desc = could not find container \"7741ac0bde197e0707c285ba586fd057f6edc5672cf11bfd2afc26a6646812a3\": container with ID starting with 7741ac0bde197e0707c285ba586fd057f6edc5672cf11bfd2afc26a6646812a3 not found: ID does not exist"
Jul 30 13:08:32.027543 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:08:32.027522    2566 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-75d556bd77-zvtzk"]
Jul 30 13:08:32.031670 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:08:32.031638    2566 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-75d556bd77-zvtzk"]
Jul 30 13:08:33.628476 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:08:33.628430    2566 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="4aaa6528-1368-4a95-9034-6b92aff6f5a3" path="/var/lib/kubelet/pods/4aaa6528-1368-4a95-9034-6b92aff6f5a3/volumes"
Jul 30 13:08:35.923449 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:08:35.923418    2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-976567c8c-t8r6b"]
Jul 30 13:08:35.923935 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:08:35.923913    2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c85cc1d5-f842-4632-8541-aaa180fcb005" containerName="authorino"
Jul 30 13:08:35.923935 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:08:35.923934    2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="c85cc1d5-f842-4632-8541-aaa180fcb005" containerName="authorino"
Jul 30 13:08:35.924057 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:08:35.923958    2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4aaa6528-1368-4a95-9034-6b92aff6f5a3" containerName="authorino"
Jul 30 13:08:35.924057 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:08:35.923968    2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="4aaa6528-1368-4a95-9034-6b92aff6f5a3" containerName="authorino"
Jul 30 13:08:35.924181 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:08:35.924063    2566 memory_manager.go:368] "RemoveStaleState removing state" podUID="c85cc1d5-f842-4632-8541-aaa180fcb005" containerName="authorino"
Jul 30 13:08:35.924181 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:08:35.924111    2566 memory_manager.go:368] "RemoveStaleState removing state" podUID="4aaa6528-1368-4a95-9034-6b92aff6f5a3" containerName="authorino"
Jul 30 13:08:35.935966 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:08:35.935944    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-976567c8c-t8r6b"
Jul 30 13:08:35.939274 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:08:35.939251    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-c66mt\""
Jul 30 13:08:35.939424 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:08:35.939298    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-webhook-cert\""
Jul 30 13:08:35.939424 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:08:35.939320    2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\""
Jul 30 13:08:35.946772 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:08:35.946749    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-976567c8c-t8r6b"]
Jul 30 13:08:35.978759 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:08:35.978729    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/ffbc58cb-21cc-4943-bcf8-15d2cdb77e18-webhook-cert\") pod \"maas-controller-976567c8c-t8r6b\" (UID: \"ffbc58cb-21cc-4943-bcf8-15d2cdb77e18\") " pod="opendatahub/maas-controller-976567c8c-t8r6b"
Jul 30 13:08:35.978885 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:08:35.978764    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-24ff2\" (UniqueName: \"kubernetes.io/projected/ffbc58cb-21cc-4943-bcf8-15d2cdb77e18-kube-api-access-24ff2\") pod \"maas-controller-976567c8c-t8r6b\" (UID: \"ffbc58cb-21cc-4943-bcf8-15d2cdb77e18\") " pod="opendatahub/maas-controller-976567c8c-t8r6b"
Jul 30 13:08:36.080026 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:08:36.079997    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/ffbc58cb-21cc-4943-bcf8-15d2cdb77e18-webhook-cert\") pod \"maas-controller-976567c8c-t8r6b\" (UID: \"ffbc58cb-21cc-4943-bcf8-15d2cdb77e18\") " pod="opendatahub/maas-controller-976567c8c-t8r6b"
Jul 30 13:08:36.080228 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:08:36.080047    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-24ff2\" (UniqueName: \"kubernetes.io/projected/ffbc58cb-21cc-4943-bcf8-15d2cdb77e18-kube-api-access-24ff2\") pod \"maas-controller-976567c8c-t8r6b\" (UID: \"ffbc58cb-21cc-4943-bcf8-15d2cdb77e18\") " pod="opendatahub/maas-controller-976567c8c-t8r6b"
Jul 30 13:08:36.082494 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:08:36.082469    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/ffbc58cb-21cc-4943-bcf8-15d2cdb77e18-webhook-cert\") pod \"maas-controller-976567c8c-t8r6b\" (UID: \"ffbc58cb-21cc-4943-bcf8-15d2cdb77e18\") " pod="opendatahub/maas-controller-976567c8c-t8r6b"
Jul 30 13:08:36.091675 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:08:36.091650    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-24ff2\" (UniqueName: \"kubernetes.io/projected/ffbc58cb-21cc-4943-bcf8-15d2cdb77e18-kube-api-access-24ff2\") pod \"maas-controller-976567c8c-t8r6b\" (UID: \"ffbc58cb-21cc-4943-bcf8-15d2cdb77e18\") " pod="opendatahub/maas-controller-976567c8c-t8r6b"
Jul 30 13:08:36.137034 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:08:36.137001    2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-b8b49f4d5-srpzm"]
Jul 30 13:08:36.140676 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:08:36.140655    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-b8b49f4d5-srpzm"
Jul 30 13:08:36.149314 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:08:36.149290    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-b8b49f4d5-srpzm"]
Jul 30 13:08:36.180692 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:08:36.180614    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/78a48b48-ee53-43fc-9c46-95464a056597-webhook-cert\") pod \"maas-controller-b8b49f4d5-srpzm\" (UID: \"78a48b48-ee53-43fc-9c46-95464a056597\") " pod="opendatahub/maas-controller-b8b49f4d5-srpzm"
Jul 30 13:08:36.180692 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:08:36.180661    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kjpb6\" (UniqueName: \"kubernetes.io/projected/78a48b48-ee53-43fc-9c46-95464a056597-kube-api-access-kjpb6\") pod \"maas-controller-b8b49f4d5-srpzm\" (UID: \"78a48b48-ee53-43fc-9c46-95464a056597\") " pod="opendatahub/maas-controller-b8b49f4d5-srpzm"
Jul 30 13:08:36.247795 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:08:36.247756    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-976567c8c-t8r6b"
Jul 30 13:08:36.281293 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:08:36.281258    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/78a48b48-ee53-43fc-9c46-95464a056597-webhook-cert\") pod \"maas-controller-b8b49f4d5-srpzm\" (UID: \"78a48b48-ee53-43fc-9c46-95464a056597\") " pod="opendatahub/maas-controller-b8b49f4d5-srpzm"
Jul 30 13:08:36.281424 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:08:36.281340    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kjpb6\" (UniqueName: \"kubernetes.io/projected/78a48b48-ee53-43fc-9c46-95464a056597-kube-api-access-kjpb6\") pod \"maas-controller-b8b49f4d5-srpzm\" (UID: \"78a48b48-ee53-43fc-9c46-95464a056597\") " pod="opendatahub/maas-controller-b8b49f4d5-srpzm"
Jul 30 13:08:36.283808 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:08:36.283779    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/78a48b48-ee53-43fc-9c46-95464a056597-webhook-cert\") pod \"maas-controller-b8b49f4d5-srpzm\" (UID: \"78a48b48-ee53-43fc-9c46-95464a056597\") " pod="opendatahub/maas-controller-b8b49f4d5-srpzm"
Jul 30 13:08:36.290461 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:08:36.290418    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kjpb6\" (UniqueName: \"kubernetes.io/projected/78a48b48-ee53-43fc-9c46-95464a056597-kube-api-access-kjpb6\") pod \"maas-controller-b8b49f4d5-srpzm\" (UID: \"78a48b48-ee53-43fc-9c46-95464a056597\") " pod="opendatahub/maas-controller-b8b49f4d5-srpzm"
Jul 30 13:08:36.378661 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:08:36.378626    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-976567c8c-t8r6b"]
Jul 30 13:08:36.382674 ip-10-0-143-153 kubenswrapper[2566]: W0730 13:08:36.382646    2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podffbc58cb_21cc_4943_bcf8_15d2cdb77e18.slice/crio-b27c680f45513e8399ce683ac37c75251d91703a2e33dff0c7431ed03751db14 WatchSource:0}: Error finding container b27c680f45513e8399ce683ac37c75251d91703a2e33dff0c7431ed03751db14: Status 404 returned error can't find the container with id b27c680f45513e8399ce683ac37c75251d91703a2e33dff0c7431ed03751db14
Jul 30 13:08:36.452362 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:08:36.452285    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-b8b49f4d5-srpzm"
Jul 30 13:08:36.584930 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:08:36.584904    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-b8b49f4d5-srpzm"]
Jul 30 13:08:36.587410 ip-10-0-143-153 kubenswrapper[2566]: W0730 13:08:36.587384    2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod78a48b48_ee53_43fc_9c46_95464a056597.slice/crio-b3a3791776438a65ab46ae63acd21208ce65c348761c0548ff811423a0f684f9 WatchSource:0}: Error finding container b3a3791776438a65ab46ae63acd21208ce65c348761c0548ff811423a0f684f9: Status 404 returned error can't find the container with id b3a3791776438a65ab46ae63acd21208ce65c348761c0548ff811423a0f684f9
Jul 30 13:08:37.041436 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:08:37.041343    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-b8b49f4d5-srpzm" event={"ID":"78a48b48-ee53-43fc-9c46-95464a056597","Type":"ContainerStarted","Data":"b3a3791776438a65ab46ae63acd21208ce65c348761c0548ff811423a0f684f9"}
Jul 30 13:08:37.043130 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:08:37.043051    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-976567c8c-t8r6b" event={"ID":"ffbc58cb-21cc-4943-bcf8-15d2cdb77e18","Type":"ContainerStarted","Data":"b27c680f45513e8399ce683ac37c75251d91703a2e33dff0c7431ed03751db14"}
Jul 30 13:08:39.056408 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:08:39.056351    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-b8b49f4d5-srpzm" event={"ID":"78a48b48-ee53-43fc-9c46-95464a056597","Type":"ContainerStarted","Data":"a6a6e39c1a49e131ae81ab40962e1be7817c79a7da6efacaa516a9b6522d5130"}
Jul 30 13:08:39.056972 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:08:39.056428    2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-b8b49f4d5-srpzm"
Jul 30 13:08:39.058741 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:08:39.058708    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-976567c8c-t8r6b" event={"ID":"ffbc58cb-21cc-4943-bcf8-15d2cdb77e18","Type":"ContainerStarted","Data":"2ba92313385ea51284658ffc238a886cc324af22c2f96d7d063d3219c226e479"}
Jul 30 13:08:39.058894 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:08:39.058811    2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-976567c8c-t8r6b"
Jul 30 13:08:39.077922 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:08:39.077878    2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-b8b49f4d5-srpzm" podStartSLOduration=0.760471111 podStartE2EDuration="3.07786226s" totalImagesPullingTime="2.317391149s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-30 13:08:36 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 13:08:39.075708435 +0000 UTC m=+548.004396722" watchObservedRunningTime="2026-07-30 13:08:39.07786226 +0000 UTC m=+548.006550560"
Jul 30 13:08:39.104031 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:08:39.103943    2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-976567c8c-t8r6b" podStartSLOduration=1.5887689109999998 podStartE2EDuration="4.103924878s" totalImagesPullingTime="2.515155967s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-30 13:08:35 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 13:08:39.103727173 +0000 UTC m=+548.032415433" watchObservedRunningTime="2026-07-30 13:08:39.103924878 +0000 UTC m=+548.032613141"
Jul 30 13:08:50.066393 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:08:50.066363    2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-b8b49f4d5-srpzm"
Jul 30 13:08:50.066776 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:08:50.066436    2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-976567c8c-t8r6b"
Jul 30 13:08:50.123635 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:08:50.123600    2566 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-976567c8c-t8r6b"]
Jul 30 13:08:50.124059 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:08:50.124015    2566 kuberuntime_container.go:873] "Killing container with a grace period" pod="opendatahub/maas-controller-976567c8c-t8r6b" podUID="ffbc58cb-21cc-4943-bcf8-15d2cdb77e18" containerName="manager" containerID="cri-o://2ba92313385ea51284658ffc238a886cc324af22c2f96d7d063d3219c226e479" gracePeriod=30
Jul 30 13:08:50.374300 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:08:50.374277    2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-976567c8c-t8r6b"
Jul 30 13:08:50.506858 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:08:50.506817    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-24ff2\" (UniqueName: \"kubernetes.io/projected/ffbc58cb-21cc-4943-bcf8-15d2cdb77e18-kube-api-access-24ff2\") pod \"ffbc58cb-21cc-4943-bcf8-15d2cdb77e18\" (UID: \"ffbc58cb-21cc-4943-bcf8-15d2cdb77e18\") "
Jul 30 13:08:50.507036 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:08:50.506889    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/ffbc58cb-21cc-4943-bcf8-15d2cdb77e18-webhook-cert\") pod \"ffbc58cb-21cc-4943-bcf8-15d2cdb77e18\" (UID: \"ffbc58cb-21cc-4943-bcf8-15d2cdb77e18\") "
Jul 30 13:08:50.509093 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:08:50.509054    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ffbc58cb-21cc-4943-bcf8-15d2cdb77e18-webhook-cert" (OuterVolumeSpecName: "webhook-cert") pod "ffbc58cb-21cc-4943-bcf8-15d2cdb77e18" (UID: "ffbc58cb-21cc-4943-bcf8-15d2cdb77e18"). InnerVolumeSpecName "webhook-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 30 13:08:50.509194 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:08:50.509112    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ffbc58cb-21cc-4943-bcf8-15d2cdb77e18-kube-api-access-24ff2" (OuterVolumeSpecName: "kube-api-access-24ff2") pod "ffbc58cb-21cc-4943-bcf8-15d2cdb77e18" (UID: "ffbc58cb-21cc-4943-bcf8-15d2cdb77e18"). InnerVolumeSpecName "kube-api-access-24ff2". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 30 13:08:50.607517 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:08:50.607435    2566 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-24ff2\" (UniqueName: \"kubernetes.io/projected/ffbc58cb-21cc-4943-bcf8-15d2cdb77e18-kube-api-access-24ff2\") on node \"ip-10-0-143-153.ec2.internal\" DevicePath \"\""
Jul 30 13:08:50.607517 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:08:50.607465    2566 reconciler_common.go:299] "Volume detached for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/ffbc58cb-21cc-4943-bcf8-15d2cdb77e18-webhook-cert\") on node \"ip-10-0-143-153.ec2.internal\" DevicePath \"\""
Jul 30 13:08:51.116903 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:08:51.116867    2566 generic.go:356] "Generic (PLEG): container finished" podID="ffbc58cb-21cc-4943-bcf8-15d2cdb77e18" containerID="2ba92313385ea51284658ffc238a886cc324af22c2f96d7d063d3219c226e479" exitCode=0
Jul 30 13:08:51.117349 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:08:51.116916    2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-976567c8c-t8r6b"
Jul 30 13:08:51.117349 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:08:51.116928    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-976567c8c-t8r6b" event={"ID":"ffbc58cb-21cc-4943-bcf8-15d2cdb77e18","Type":"ContainerDied","Data":"2ba92313385ea51284658ffc238a886cc324af22c2f96d7d063d3219c226e479"}
Jul 30 13:08:51.117349 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:08:51.116982    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-976567c8c-t8r6b" event={"ID":"ffbc58cb-21cc-4943-bcf8-15d2cdb77e18","Type":"ContainerDied","Data":"b27c680f45513e8399ce683ac37c75251d91703a2e33dff0c7431ed03751db14"}
Jul 30 13:08:51.117349 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:08:51.117014    2566 scope.go:117] "RemoveContainer" containerID="2ba92313385ea51284658ffc238a886cc324af22c2f96d7d063d3219c226e479"
Jul 30 13:08:51.126016 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:08:51.125863    2566 scope.go:117] "RemoveContainer" containerID="2ba92313385ea51284658ffc238a886cc324af22c2f96d7d063d3219c226e479"
Jul 30 13:08:51.126145 ip-10-0-143-153 kubenswrapper[2566]: E0730 13:08:51.126126    2566 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2ba92313385ea51284658ffc238a886cc324af22c2f96d7d063d3219c226e479\": container with ID starting with 2ba92313385ea51284658ffc238a886cc324af22c2f96d7d063d3219c226e479 not found: ID does not exist" containerID="2ba92313385ea51284658ffc238a886cc324af22c2f96d7d063d3219c226e479"
Jul 30 13:08:51.126204 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:08:51.126150    2566 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2ba92313385ea51284658ffc238a886cc324af22c2f96d7d063d3219c226e479"} err="failed to get container status \"2ba92313385ea51284658ffc238a886cc324af22c2f96d7d063d3219c226e479\": rpc error: code = NotFound desc = could not find container \"2ba92313385ea51284658ffc238a886cc324af22c2f96d7d063d3219c226e479\": container with ID starting with 2ba92313385ea51284658ffc238a886cc324af22c2f96d7d063d3219c226e479 not found: ID does not exist"
Jul 30 13:08:51.137486 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:08:51.137457    2566 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-976567c8c-t8r6b"]
Jul 30 13:08:51.142210 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:08:51.142187    2566 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-controller-976567c8c-t8r6b"]
Jul 30 13:08:51.626770 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:08:51.626737    2566 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ffbc58cb-21cc-4943-bcf8-15d2cdb77e18" path="/var/lib/kubelet/pods/ffbc58cb-21cc-4943-bcf8-15d2cdb77e18/volumes"
Jul 30 13:09:12.409373 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:09:12.409342    2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-574cd7886f-ffjb8"]
Jul 30 13:09:12.409799 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:09:12.409683    2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ffbc58cb-21cc-4943-bcf8-15d2cdb77e18" containerName="manager"
Jul 30 13:09:12.409799 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:09:12.409694    2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="ffbc58cb-21cc-4943-bcf8-15d2cdb77e18" containerName="manager"
Jul 30 13:09:12.409799 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:09:12.409753    2566 memory_manager.go:368] "RemoveStaleState removing state" podUID="ffbc58cb-21cc-4943-bcf8-15d2cdb77e18" containerName="manager"
Jul 30 13:09:12.418001 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:09:12.417980    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-574cd7886f-ffjb8"
Jul 30 13:09:12.420093 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:09:12.420054    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-serving-cert\""
Jul 30 13:09:12.420225 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:09:12.420172    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-dockercfg-dnpqq\""
Jul 30 13:09:12.425168 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:09:12.425139    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-574cd7886f-ffjb8"]
Jul 30 13:09:12.597856 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:09:12.597814    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/beb7f60a-f9d7-4885-ad1d-83fa9440a514-maas-api-tls\") pod \"maas-api-574cd7886f-ffjb8\" (UID: \"beb7f60a-f9d7-4885-ad1d-83fa9440a514\") " pod="odh-ai-gateway-infra/maas-api-574cd7886f-ffjb8"
Jul 30 13:09:12.597856 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:09:12.597862    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/beb7f60a-f9d7-4885-ad1d-83fa9440a514-openshift-service-ca\") pod \"maas-api-574cd7886f-ffjb8\" (UID: \"beb7f60a-f9d7-4885-ad1d-83fa9440a514\") " pod="odh-ai-gateway-infra/maas-api-574cd7886f-ffjb8"
Jul 30 13:09:12.598073 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:09:12.597887    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ljgb2\" (UniqueName: \"kubernetes.io/projected/beb7f60a-f9d7-4885-ad1d-83fa9440a514-kube-api-access-ljgb2\") pod \"maas-api-574cd7886f-ffjb8\" (UID: \"beb7f60a-f9d7-4885-ad1d-83fa9440a514\") " pod="odh-ai-gateway-infra/maas-api-574cd7886f-ffjb8"
Jul 30 13:09:12.698931 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:09:12.698845    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/beb7f60a-f9d7-4885-ad1d-83fa9440a514-maas-api-tls\") pod \"maas-api-574cd7886f-ffjb8\" (UID: \"beb7f60a-f9d7-4885-ad1d-83fa9440a514\") " pod="odh-ai-gateway-infra/maas-api-574cd7886f-ffjb8"
Jul 30 13:09:12.698931 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:09:12.698884    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/beb7f60a-f9d7-4885-ad1d-83fa9440a514-openshift-service-ca\") pod \"maas-api-574cd7886f-ffjb8\" (UID: \"beb7f60a-f9d7-4885-ad1d-83fa9440a514\") " pod="odh-ai-gateway-infra/maas-api-574cd7886f-ffjb8"
Jul 30 13:09:12.698931 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:09:12.698905    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ljgb2\" (UniqueName: \"kubernetes.io/projected/beb7f60a-f9d7-4885-ad1d-83fa9440a514-kube-api-access-ljgb2\") pod \"maas-api-574cd7886f-ffjb8\" (UID: \"beb7f60a-f9d7-4885-ad1d-83fa9440a514\") " pod="odh-ai-gateway-infra/maas-api-574cd7886f-ffjb8"
Jul 30 13:09:12.699552 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:09:12.699522    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/beb7f60a-f9d7-4885-ad1d-83fa9440a514-openshift-service-ca\") pod \"maas-api-574cd7886f-ffjb8\" (UID: \"beb7f60a-f9d7-4885-ad1d-83fa9440a514\") " pod="odh-ai-gateway-infra/maas-api-574cd7886f-ffjb8"
Jul 30 13:09:12.701423 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:09:12.701400    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/beb7f60a-f9d7-4885-ad1d-83fa9440a514-maas-api-tls\") pod \"maas-api-574cd7886f-ffjb8\" (UID: \"beb7f60a-f9d7-4885-ad1d-83fa9440a514\") " pod="odh-ai-gateway-infra/maas-api-574cd7886f-ffjb8"
Jul 30 13:09:12.711392 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:09:12.711368    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ljgb2\" (UniqueName: \"kubernetes.io/projected/beb7f60a-f9d7-4885-ad1d-83fa9440a514-kube-api-access-ljgb2\") pod \"maas-api-574cd7886f-ffjb8\" (UID: \"beb7f60a-f9d7-4885-ad1d-83fa9440a514\") " pod="odh-ai-gateway-infra/maas-api-574cd7886f-ffjb8"
Jul 30 13:09:12.730383 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:09:12.730354    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-574cd7886f-ffjb8"
Jul 30 13:09:12.876262 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:09:12.876222    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-574cd7886f-ffjb8"]
Jul 30 13:09:12.880736 ip-10-0-143-153 kubenswrapper[2566]: W0730 13:09:12.880705    2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbeb7f60a_f9d7_4885_ad1d_83fa9440a514.slice/crio-ee945e88b6bcb36ad43da84605b2c17b31924b16d1d4f1e51c78b63e398930f7 WatchSource:0}: Error finding container ee945e88b6bcb36ad43da84605b2c17b31924b16d1d4f1e51c78b63e398930f7: Status 404 returned error can't find the container with id ee945e88b6bcb36ad43da84605b2c17b31924b16d1d4f1e51c78b63e398930f7
Jul 30 13:09:12.989853 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:09:12.989776    2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-5cc6cd444b-5tgls"]
Jul 30 13:09:12.995355 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:09:12.995326    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-5cc6cd444b-5tgls"
Jul 30 13:09:12.997524 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:09:12.997498    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-dockercfg-g9q9q\""
Jul 30 13:09:12.997664 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:09:12.997508    2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins\""
Jul 30 13:09:13.001820 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:09:13.001745    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-5cc6cd444b-5tgls"]
Jul 30 13:09:13.027294 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:09:13.027259    2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-687dbb6cf6-6pdbs"]
Jul 30 13:09:13.031208 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:09:13.031184    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-687dbb6cf6-6pdbs"
Jul 30 13:09:13.041229 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:09:13.041195    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-687dbb6cf6-6pdbs"]
Jul 30 13:09:13.103412 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:09:13.103370    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zv7g9\" (UniqueName: \"kubernetes.io/projected/9d35b27b-86d0-47b9-b35b-03725cef3b51-kube-api-access-zv7g9\") pod \"payload-processing-5cc6cd444b-5tgls\" (UID: \"9d35b27b-86d0-47b9-b35b-03725cef3b51\") " pod="openshift-ingress/payload-processing-5cc6cd444b-5tgls"
Jul 30 13:09:13.103603 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:09:13.103471    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/9d35b27b-86d0-47b9-b35b-03725cef3b51-plugins-config-volume\") pod \"payload-processing-5cc6cd444b-5tgls\" (UID: \"9d35b27b-86d0-47b9-b35b-03725cef3b51\") " pod="openshift-ingress/payload-processing-5cc6cd444b-5tgls"
Jul 30 13:09:13.204392 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:09:13.204352    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9dqd4\" (UniqueName: \"kubernetes.io/projected/a01576a6-192f-4614-b37f-3e14c28cdfb1-kube-api-access-9dqd4\") pod \"payload-pre-processing-687dbb6cf6-6pdbs\" (UID: \"a01576a6-192f-4614-b37f-3e14c28cdfb1\") " pod="openshift-ingress/payload-pre-processing-687dbb6cf6-6pdbs"
Jul 30 13:09:13.204561 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:09:13.204410    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/a01576a6-192f-4614-b37f-3e14c28cdfb1-plugins-config-volume\") pod \"payload-pre-processing-687dbb6cf6-6pdbs\" (UID: \"a01576a6-192f-4614-b37f-3e14c28cdfb1\") " pod="openshift-ingress/payload-pre-processing-687dbb6cf6-6pdbs"
Jul 30 13:09:13.204561 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:09:13.204447    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zv7g9\" (UniqueName: \"kubernetes.io/projected/9d35b27b-86d0-47b9-b35b-03725cef3b51-kube-api-access-zv7g9\") pod \"payload-processing-5cc6cd444b-5tgls\" (UID: \"9d35b27b-86d0-47b9-b35b-03725cef3b51\") " pod="openshift-ingress/payload-processing-5cc6cd444b-5tgls"
Jul 30 13:09:13.204561 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:09:13.204476    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/9d35b27b-86d0-47b9-b35b-03725cef3b51-plugins-config-volume\") pod \"payload-processing-5cc6cd444b-5tgls\" (UID: \"9d35b27b-86d0-47b9-b35b-03725cef3b51\") " pod="openshift-ingress/payload-processing-5cc6cd444b-5tgls"
Jul 30 13:09:13.205150 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:09:13.205128    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/9d35b27b-86d0-47b9-b35b-03725cef3b51-plugins-config-volume\") pod \"payload-processing-5cc6cd444b-5tgls\" (UID: \"9d35b27b-86d0-47b9-b35b-03725cef3b51\") " pod="openshift-ingress/payload-processing-5cc6cd444b-5tgls"
Jul 30 13:09:13.212801 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:09:13.212774    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zv7g9\" (UniqueName: \"kubernetes.io/projected/9d35b27b-86d0-47b9-b35b-03725cef3b51-kube-api-access-zv7g9\") pod \"payload-processing-5cc6cd444b-5tgls\" (UID: \"9d35b27b-86d0-47b9-b35b-03725cef3b51\") " pod="openshift-ingress/payload-processing-5cc6cd444b-5tgls"
Jul 30 13:09:13.224685 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:09:13.224653    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-574cd7886f-ffjb8" event={"ID":"beb7f60a-f9d7-4885-ad1d-83fa9440a514","Type":"ContainerStarted","Data":"ee945e88b6bcb36ad43da84605b2c17b31924b16d1d4f1e51c78b63e398930f7"}
Jul 30 13:09:13.305929 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:09:13.305839    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9dqd4\" (UniqueName: \"kubernetes.io/projected/a01576a6-192f-4614-b37f-3e14c28cdfb1-kube-api-access-9dqd4\") pod \"payload-pre-processing-687dbb6cf6-6pdbs\" (UID: \"a01576a6-192f-4614-b37f-3e14c28cdfb1\") " pod="openshift-ingress/payload-pre-processing-687dbb6cf6-6pdbs"
Jul 30 13:09:13.305929 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:09:13.305889    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/a01576a6-192f-4614-b37f-3e14c28cdfb1-plugins-config-volume\") pod \"payload-pre-processing-687dbb6cf6-6pdbs\" (UID: \"a01576a6-192f-4614-b37f-3e14c28cdfb1\") " pod="openshift-ingress/payload-pre-processing-687dbb6cf6-6pdbs"
Jul 30 13:09:13.306668 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:09:13.306648    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/a01576a6-192f-4614-b37f-3e14c28cdfb1-plugins-config-volume\") pod \"payload-pre-processing-687dbb6cf6-6pdbs\" (UID: \"a01576a6-192f-4614-b37f-3e14c28cdfb1\") " pod="openshift-ingress/payload-pre-processing-687dbb6cf6-6pdbs"
Jul 30 13:09:13.308750 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:09:13.308731    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-5cc6cd444b-5tgls"
Jul 30 13:09:13.314357 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:09:13.314331    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9dqd4\" (UniqueName: \"kubernetes.io/projected/a01576a6-192f-4614-b37f-3e14c28cdfb1-kube-api-access-9dqd4\") pod \"payload-pre-processing-687dbb6cf6-6pdbs\" (UID: \"a01576a6-192f-4614-b37f-3e14c28cdfb1\") " pod="openshift-ingress/payload-pre-processing-687dbb6cf6-6pdbs"
Jul 30 13:09:13.343270 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:09:13.343237    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-687dbb6cf6-6pdbs"
Jul 30 13:09:13.467548 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:09:13.467514    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-5cc6cd444b-5tgls"]
Jul 30 13:09:13.518127 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:09:13.518044    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-687dbb6cf6-6pdbs"]
Jul 30 13:09:13.518267 ip-10-0-143-153 kubenswrapper[2566]: W0730 13:09:13.518234    2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda01576a6_192f_4614_b37f_3e14c28cdfb1.slice/crio-c3adbee1bf5e29e9b039fe771457db045f369b566eb356dfd9f524daa05477d0 WatchSource:0}: Error finding container c3adbee1bf5e29e9b039fe771457db045f369b566eb356dfd9f524daa05477d0: Status 404 returned error can't find the container with id c3adbee1bf5e29e9b039fe771457db045f369b566eb356dfd9f524daa05477d0
Jul 30 13:09:14.235742 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:09:14.235607    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-687dbb6cf6-6pdbs" event={"ID":"a01576a6-192f-4614-b37f-3e14c28cdfb1","Type":"ContainerStarted","Data":"c3adbee1bf5e29e9b039fe771457db045f369b566eb356dfd9f524daa05477d0"}
Jul 30 13:09:14.239274 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:09:14.239239    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-5cc6cd444b-5tgls" event={"ID":"9d35b27b-86d0-47b9-b35b-03725cef3b51","Type":"ContainerStarted","Data":"98e552dd397c2eec7243dca3d6db4cb89ff910998b003bea975df343b1c50078"}
Jul 30 13:09:15.248432 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:09:15.248385    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-574cd7886f-ffjb8" event={"ID":"beb7f60a-f9d7-4885-ad1d-83fa9440a514","Type":"ContainerStarted","Data":"6ee5ecb7654246b677eeee1f7cb8cd546aa57db336cbb851ecdacffeb669d702"}
Jul 30 13:09:15.248971 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:09:15.248486    2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-574cd7886f-ffjb8"
Jul 30 13:09:15.267072 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:09:15.267012    2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-574cd7886f-ffjb8" podStartSLOduration=1.498462486 podStartE2EDuration="3.266993588s" totalImagesPullingTime="1.768531102s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-30 13:09:12 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 13:09:15.264531385 +0000 UTC m=+584.193219649" watchObservedRunningTime="2026-07-30 13:09:15.266993588 +0000 UTC m=+584.195681850"
Jul 30 13:09:16.255297 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:09:16.255203    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-687dbb6cf6-6pdbs" event={"ID":"a01576a6-192f-4614-b37f-3e14c28cdfb1","Type":"ContainerStarted","Data":"6533ff79dcc6060fbe31e866990d0861d8fd344042968eef782e1c4cb7851b00"}
Jul 30 13:09:16.255722 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:09:16.255387    2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-687dbb6cf6-6pdbs"
Jul 30 13:09:16.256785 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:09:16.256761    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-5cc6cd444b-5tgls" event={"ID":"9d35b27b-86d0-47b9-b35b-03725cef3b51","Type":"ContainerStarted","Data":"45f39fd59d02a0080425e8fd11a51d4f95dbe80539bd581ab36e91d40a039c40"}
Jul 30 13:09:16.256953 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:09:16.256938    2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-5cc6cd444b-5tgls"
Jul 30 13:09:16.270099 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:09:16.269867    2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-687dbb6cf6-6pdbs" podStartSLOduration=0.770467023 podStartE2EDuration="3.269848501s" totalImagesPullingTime="2.499381478s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-30 13:09:13 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 13:09:16.269182608 +0000 UTC m=+585.197870872" watchObservedRunningTime="2026-07-30 13:09:16.269848501 +0000 UTC m=+585.198536764"
Jul 30 13:09:16.285536 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:09:16.285007    2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-5cc6cd444b-5tgls" podStartSLOduration=1.7431534530000001 podStartE2EDuration="4.28498625s" totalImagesPullingTime="2.541832797s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-30 13:09:12 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 13:09:16.284499772 +0000 UTC m=+585.213188036" watchObservedRunningTime="2026-07-30 13:09:16.28498625 +0000 UTC m=+585.213674514"
Jul 30 13:09:21.262872 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:09:21.262842    2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-574cd7886f-ffjb8"
Jul 30 13:09:27.264777 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:09:27.264744    2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-5cc6cd444b-5tgls"
Jul 30 13:09:27.265266 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:09:27.264961    2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-687dbb6cf6-6pdbs"
Jul 30 13:09:31.444430 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:09:31.444392    2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-q2n28"]
Jul 30 13:09:31.448510 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:09:31.448489    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-q2n28"
Jul 30 13:09:31.451034 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:09:31.451006    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-6m8gs\""
Jul 30 13:09:31.451034 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:09:31.451023    2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\""
Jul 30 13:09:31.451245 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:09:31.451110    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-distinct-2-simulated-kserve-self-signed-certs\""
Jul 30 13:09:31.451245 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:09:31.451158    2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\""
Jul 30 13:09:31.452130 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:09:31.452107    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/6e3da121-3497-4ac9-8b9e-f29aec4ea5bc-home\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-q2n28\" (UID: \"6e3da121-3497-4ac9-8b9e-f29aec4ea5bc\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-q2n28"
Jul 30 13:09:31.452257 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:09:31.452159    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/6e3da121-3497-4ac9-8b9e-f29aec4ea5bc-tmp-dir\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-q2n28\" (UID: \"6e3da121-3497-4ac9-8b9e-f29aec4ea5bc\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-q2n28"
Jul 30 13:09:31.452257 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:09:31.452186    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-76v77\" (UniqueName: \"kubernetes.io/projected/6e3da121-3497-4ac9-8b9e-f29aec4ea5bc-kube-api-access-76v77\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-q2n28\" (UID: \"6e3da121-3497-4ac9-8b9e-f29aec4ea5bc\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-q2n28"
Jul 30 13:09:31.452257 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:09:31.452217    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/6e3da121-3497-4ac9-8b9e-f29aec4ea5bc-dshm\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-q2n28\" (UID: \"6e3da121-3497-4ac9-8b9e-f29aec4ea5bc\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-q2n28"
Jul 30 13:09:31.452257 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:09:31.452246    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/6e3da121-3497-4ac9-8b9e-f29aec4ea5bc-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-q2n28\" (UID: \"6e3da121-3497-4ac9-8b9e-f29aec4ea5bc\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-q2n28"
Jul 30 13:09:31.452481 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:09:31.452294    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/6e3da121-3497-4ac9-8b9e-f29aec4ea5bc-model-cache\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-q2n28\" (UID: \"6e3da121-3497-4ac9-8b9e-f29aec4ea5bc\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-q2n28"
Jul 30 13:09:31.457774 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:09:31.457748    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-q2n28"]
Jul 30 13:09:31.527360 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:09:31.527333    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-bzl6w_51cdacbf-3a14-47c0-8fd4-69b0b2be0e64/console-operator/1.log"
Jul 30 13:09:31.529621 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:09:31.529599    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-bzl6w_51cdacbf-3a14-47c0-8fd4-69b0b2be0e64/console-operator/1.log"
Jul 30 13:09:31.532694 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:09:31.532668    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-f6br6_3ebbc209-4373-44d8-a22e-d2d2aa4cbfa6/ovn-acl-logging/0.log"
Jul 30 13:09:31.534927 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:09:31.534913    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-f6br6_3ebbc209-4373-44d8-a22e-d2d2aa4cbfa6/ovn-acl-logging/0.log"
Jul 30 13:09:31.552872 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:09:31.552853    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/6e3da121-3497-4ac9-8b9e-f29aec4ea5bc-tmp-dir\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-q2n28\" (UID: \"6e3da121-3497-4ac9-8b9e-f29aec4ea5bc\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-q2n28"
Jul 30 13:09:31.552979 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:09:31.552878    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-76v77\" (UniqueName: \"kubernetes.io/projected/6e3da121-3497-4ac9-8b9e-f29aec4ea5bc-kube-api-access-76v77\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-q2n28\" (UID: \"6e3da121-3497-4ac9-8b9e-f29aec4ea5bc\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-q2n28"
Jul 30 13:09:31.552979 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:09:31.552898    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/6e3da121-3497-4ac9-8b9e-f29aec4ea5bc-dshm\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-q2n28\" (UID: \"6e3da121-3497-4ac9-8b9e-f29aec4ea5bc\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-q2n28"
Jul 30 13:09:31.552979 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:09:31.552916    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/6e3da121-3497-4ac9-8b9e-f29aec4ea5bc-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-q2n28\" (UID: \"6e3da121-3497-4ac9-8b9e-f29aec4ea5bc\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-q2n28"
Jul 30 13:09:31.553160 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:09:31.553016    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/6e3da121-3497-4ac9-8b9e-f29aec4ea5bc-model-cache\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-q2n28\" (UID: \"6e3da121-3497-4ac9-8b9e-f29aec4ea5bc\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-q2n28"
Jul 30 13:09:31.553160 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:09:31.553107    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/6e3da121-3497-4ac9-8b9e-f29aec4ea5bc-home\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-q2n28\" (UID: \"6e3da121-3497-4ac9-8b9e-f29aec4ea5bc\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-q2n28"
Jul 30 13:09:31.553272 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:09:31.553241    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/6e3da121-3497-4ac9-8b9e-f29aec4ea5bc-tmp-dir\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-q2n28\" (UID: \"6e3da121-3497-4ac9-8b9e-f29aec4ea5bc\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-q2n28"
Jul 30 13:09:31.553419 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:09:31.553395    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/6e3da121-3497-4ac9-8b9e-f29aec4ea5bc-model-cache\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-q2n28\" (UID: \"6e3da121-3497-4ac9-8b9e-f29aec4ea5bc\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-q2n28"
Jul 30 13:09:31.553419 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:09:31.553415    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/6e3da121-3497-4ac9-8b9e-f29aec4ea5bc-home\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-q2n28\" (UID: \"6e3da121-3497-4ac9-8b9e-f29aec4ea5bc\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-q2n28"
Jul 30 13:09:31.554719 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:09:31.554702    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-distinct-2-simulated-kserve-self-signed-certs\""
Jul 30 13:09:31.555122 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:09:31.555102    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/6e3da121-3497-4ac9-8b9e-f29aec4ea5bc-dshm\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-q2n28\" (UID: \"6e3da121-3497-4ac9-8b9e-f29aec4ea5bc\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-q2n28"
Jul 30 13:09:31.559458 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:09:31.559433    2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\""
Jul 30 13:09:31.566239 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:09:31.566218    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/6e3da121-3497-4ac9-8b9e-f29aec4ea5bc-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-q2n28\" (UID: \"6e3da121-3497-4ac9-8b9e-f29aec4ea5bc\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-q2n28"
Jul 30 13:09:31.571049 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:09:31.571034    2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\""
Jul 30 13:09:31.581713 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:09:31.581692    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-76v77\" (UniqueName: \"kubernetes.io/projected/6e3da121-3497-4ac9-8b9e-f29aec4ea5bc-kube-api-access-76v77\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-q2n28\" (UID: \"6e3da121-3497-4ac9-8b9e-f29aec4ea5bc\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-q2n28"
Jul 30 13:09:31.763681 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:09:31.763610    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-6m8gs\""
Jul 30 13:09:31.772096 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:09:31.772063    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-q2n28"
Jul 30 13:09:31.915291 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:09:31.915266    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-q2n28"]
Jul 30 13:09:31.917811 ip-10-0-143-153 kubenswrapper[2566]: W0730 13:09:31.917783    2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6e3da121_3497_4ac9_8b9e_f29aec4ea5bc.slice/crio-e6f8dc83b0313d4284ad90790a67b5f92933e21f6d9e02c4339f4d9bc7eede58 WatchSource:0}: Error finding container e6f8dc83b0313d4284ad90790a67b5f92933e21f6d9e02c4339f4d9bc7eede58: Status 404 returned error can't find the container with id e6f8dc83b0313d4284ad90790a67b5f92933e21f6d9e02c4339f4d9bc7eede58
Jul 30 13:09:32.340518 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:09:32.340476    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-q2n28" event={"ID":"6e3da121-3497-4ac9-8b9e-f29aec4ea5bc","Type":"ContainerStarted","Data":"e6f8dc83b0313d4284ad90790a67b5f92933e21f6d9e02c4339f4d9bc7eede58"}
Jul 30 13:09:33.347140 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:09:33.347033    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-q2n28" event={"ID":"6e3da121-3497-4ac9-8b9e-f29aec4ea5bc","Type":"ContainerStarted","Data":"d27d2fbd19f0e1f1513841592f670ad190098bebb7fa598b6828b8a67b14a053"}
Jul 30 13:09:33.365476 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:09:33.365424    2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-q2n28" podStartSLOduration=1.2586891279999999 podStartE2EDuration="2.365408927s" totalImagesPullingTime="1.106719799s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-30 13:09:31 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 13:09:33.364219541 +0000 UTC m=+602.292907805" watchObservedRunningTime="2026-07-30 13:09:33.365408927 +0000 UTC m=+602.294097190"
Jul 30 13:09:41.772844 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:09:41.772805    2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-q2n28"
Jul 30 13:09:41.773370 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:09:41.772890    2566 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-q2n28"
Jul 30 13:09:41.785740 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:09:41.785715    2566 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-q2n28"
Jul 30 13:09:42.404462 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:09:42.404435    2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-q2n28"
Jul 30 13:09:59.828944 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:09:59.828847    2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-598466548d-dw9sg"]
Jul 30 13:09:59.832975 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:09:59.832952    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-dw9sg"
Jul 30 13:09:59.834866 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:09:59.834843    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-trlp-test-simulated-kserve-self-signed-certs\""
Jul 30 13:09:59.842420 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:09:59.842397    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-598466548d-dw9sg"]
Jul 30 13:09:59.891338 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:09:59.891291    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/29d044c4-90f4-452e-a379-7af25f225621-dshm\") pod \"e2e-trlp-test-simulated-kserve-598466548d-dw9sg\" (UID: \"29d044c4-90f4-452e-a379-7af25f225621\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-dw9sg"
Jul 30 13:09:59.891338 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:09:59.891330    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/29d044c4-90f4-452e-a379-7af25f225621-model-cache\") pod \"e2e-trlp-test-simulated-kserve-598466548d-dw9sg\" (UID: \"29d044c4-90f4-452e-a379-7af25f225621\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-dw9sg"
Jul 30 13:09:59.891579 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:09:59.891359    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/29d044c4-90f4-452e-a379-7af25f225621-home\") pod \"e2e-trlp-test-simulated-kserve-598466548d-dw9sg\" (UID: \"29d044c4-90f4-452e-a379-7af25f225621\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-dw9sg"
Jul 30 13:09:59.891579 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:09:59.891403    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/29d044c4-90f4-452e-a379-7af25f225621-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-598466548d-dw9sg\" (UID: \"29d044c4-90f4-452e-a379-7af25f225621\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-dw9sg"
Jul 30 13:09:59.891579 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:09:59.891430    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sts7l\" (UniqueName: \"kubernetes.io/projected/29d044c4-90f4-452e-a379-7af25f225621-kube-api-access-sts7l\") pod \"e2e-trlp-test-simulated-kserve-598466548d-dw9sg\" (UID: \"29d044c4-90f4-452e-a379-7af25f225621\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-dw9sg"
Jul 30 13:09:59.891579 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:09:59.891456    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/29d044c4-90f4-452e-a379-7af25f225621-tmp-dir\") pod \"e2e-trlp-test-simulated-kserve-598466548d-dw9sg\" (UID: \"29d044c4-90f4-452e-a379-7af25f225621\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-dw9sg"
Jul 30 13:09:59.991910 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:09:59.991868    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/29d044c4-90f4-452e-a379-7af25f225621-home\") pod \"e2e-trlp-test-simulated-kserve-598466548d-dw9sg\" (UID: \"29d044c4-90f4-452e-a379-7af25f225621\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-dw9sg"
Jul 30 13:09:59.991910 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:09:59.991913    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/29d044c4-90f4-452e-a379-7af25f225621-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-598466548d-dw9sg\" (UID: \"29d044c4-90f4-452e-a379-7af25f225621\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-dw9sg"
Jul 30 13:09:59.992195 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:09:59.991950    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sts7l\" (UniqueName: \"kubernetes.io/projected/29d044c4-90f4-452e-a379-7af25f225621-kube-api-access-sts7l\") pod \"e2e-trlp-test-simulated-kserve-598466548d-dw9sg\" (UID: \"29d044c4-90f4-452e-a379-7af25f225621\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-dw9sg"
Jul 30 13:09:59.992195 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:09:59.991971    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/29d044c4-90f4-452e-a379-7af25f225621-tmp-dir\") pod \"e2e-trlp-test-simulated-kserve-598466548d-dw9sg\" (UID: \"29d044c4-90f4-452e-a379-7af25f225621\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-dw9sg"
Jul 30 13:09:59.992195 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:09:59.992051    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/29d044c4-90f4-452e-a379-7af25f225621-dshm\") pod \"e2e-trlp-test-simulated-kserve-598466548d-dw9sg\" (UID: \"29d044c4-90f4-452e-a379-7af25f225621\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-dw9sg"
Jul 30 13:09:59.992195 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:09:59.992073    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/29d044c4-90f4-452e-a379-7af25f225621-model-cache\") pod \"e2e-trlp-test-simulated-kserve-598466548d-dw9sg\" (UID: \"29d044c4-90f4-452e-a379-7af25f225621\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-dw9sg"
Jul 30 13:09:59.992422 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:09:59.992323    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/29d044c4-90f4-452e-a379-7af25f225621-home\") pod \"e2e-trlp-test-simulated-kserve-598466548d-dw9sg\" (UID: \"29d044c4-90f4-452e-a379-7af25f225621\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-dw9sg"
Jul 30 13:09:59.992484 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:09:59.992416    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/29d044c4-90f4-452e-a379-7af25f225621-tmp-dir\") pod \"e2e-trlp-test-simulated-kserve-598466548d-dw9sg\" (UID: \"29d044c4-90f4-452e-a379-7af25f225621\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-dw9sg"
Jul 30 13:09:59.992522 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:09:59.992489    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/29d044c4-90f4-452e-a379-7af25f225621-model-cache\") pod \"e2e-trlp-test-simulated-kserve-598466548d-dw9sg\" (UID: \"29d044c4-90f4-452e-a379-7af25f225621\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-dw9sg"
Jul 30 13:09:59.994226 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:09:59.994205    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/29d044c4-90f4-452e-a379-7af25f225621-dshm\") pod \"e2e-trlp-test-simulated-kserve-598466548d-dw9sg\" (UID: \"29d044c4-90f4-452e-a379-7af25f225621\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-dw9sg"
Jul 30 13:09:59.994605 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:09:59.994584    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/29d044c4-90f4-452e-a379-7af25f225621-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-598466548d-dw9sg\" (UID: \"29d044c4-90f4-452e-a379-7af25f225621\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-dw9sg"
Jul 30 13:09:59.999714 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:09:59.999696    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-sts7l\" (UniqueName: \"kubernetes.io/projected/29d044c4-90f4-452e-a379-7af25f225621-kube-api-access-sts7l\") pod \"e2e-trlp-test-simulated-kserve-598466548d-dw9sg\" (UID: \"29d044c4-90f4-452e-a379-7af25f225621\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-dw9sg"
Jul 30 13:10:00.145559 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:10:00.145524    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-dw9sg"
Jul 30 13:10:00.293448 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:10:00.293419    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-598466548d-dw9sg"]
Jul 30 13:10:00.296145 ip-10-0-143-153 kubenswrapper[2566]: W0730 13:10:00.296118    2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod29d044c4_90f4_452e_a379_7af25f225621.slice/crio-c7bba427a4ddae880e0881ab3860184a242a2208898362b03f066879694ae198 WatchSource:0}: Error finding container c7bba427a4ddae880e0881ab3860184a242a2208898362b03f066879694ae198: Status 404 returned error can't find the container with id c7bba427a4ddae880e0881ab3860184a242a2208898362b03f066879694ae198
Jul 30 13:10:00.297876 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:10:00.297854    2566 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 30 13:10:00.479319 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:10:00.479231    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-dw9sg" event={"ID":"29d044c4-90f4-452e-a379-7af25f225621","Type":"ContainerStarted","Data":"c7bba427a4ddae880e0881ab3860184a242a2208898362b03f066879694ae198"}
Jul 30 13:10:01.486920 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:10:01.486888    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-dw9sg" event={"ID":"29d044c4-90f4-452e-a379-7af25f225621","Type":"ContainerStarted","Data":"1bdb61dc15914fee610b65fd95a5c0e754edc9759e0eebe27ffc74d5d8ada931"}
Jul 30 13:10:01.521256 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:10:01.521183    2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-dw9sg" podStartSLOduration=2.28611855 podStartE2EDuration="2.521157296s" totalImagesPullingTime="235.038746ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-30 13:09:59 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 13:10:01.519721825 +0000 UTC m=+630.448410089" watchObservedRunningTime="2026-07-30 13:10:01.521157296 +0000 UTC m=+630.449845560"
Jul 30 13:10:10.145685 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:10:10.145642    2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-dw9sg"
Jul 30 13:10:10.146177 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:10:10.145707    2566 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-dw9sg"
Jul 30 13:10:10.158169 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:10:10.158143    2566 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-dw9sg"
Jul 30 13:10:10.543332 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:10:10.543299    2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-dw9sg"
Jul 30 13:10:18.536958 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:10:18.536925    2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-57fc66f697-8lqd6"]
Jul 30 13:10:18.542092 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:10:18.542052    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-8lqd6"
Jul 30 13:10:18.544807 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:10:18.544783    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"premium-simulated-simulated-premium-kserve-self-signed-certs\""
Jul 30 13:10:18.553277 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:10:18.553248    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-57fc66f697-8lqd6"]
Jul 30 13:10:18.663256 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:10:18.663215    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/50382248-94a7-4fe8-95a3-458bd04a921a-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-8lqd6\" (UID: \"50382248-94a7-4fe8-95a3-458bd04a921a\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-8lqd6"
Jul 30 13:10:18.663459 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:10:18.663263    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-h8bq2\" (UniqueName: \"kubernetes.io/projected/50382248-94a7-4fe8-95a3-458bd04a921a-kube-api-access-h8bq2\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-8lqd6\" (UID: \"50382248-94a7-4fe8-95a3-458bd04a921a\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-8lqd6"
Jul 30 13:10:18.663459 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:10:18.663305    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/50382248-94a7-4fe8-95a3-458bd04a921a-model-cache\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-8lqd6\" (UID: \"50382248-94a7-4fe8-95a3-458bd04a921a\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-8lqd6"
Jul 30 13:10:18.663459 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:10:18.663387    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/50382248-94a7-4fe8-95a3-458bd04a921a-tmp-dir\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-8lqd6\" (UID: \"50382248-94a7-4fe8-95a3-458bd04a921a\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-8lqd6"
Jul 30 13:10:18.663459 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:10:18.663448    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/50382248-94a7-4fe8-95a3-458bd04a921a-home\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-8lqd6\" (UID: \"50382248-94a7-4fe8-95a3-458bd04a921a\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-8lqd6"
Jul 30 13:10:18.663688 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:10:18.663477    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/50382248-94a7-4fe8-95a3-458bd04a921a-dshm\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-8lqd6\" (UID: \"50382248-94a7-4fe8-95a3-458bd04a921a\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-8lqd6"
Jul 30 13:10:18.764262 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:10:18.764218    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/50382248-94a7-4fe8-95a3-458bd04a921a-tmp-dir\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-8lqd6\" (UID: \"50382248-94a7-4fe8-95a3-458bd04a921a\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-8lqd6"
Jul 30 13:10:18.764262 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:10:18.764269    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/50382248-94a7-4fe8-95a3-458bd04a921a-home\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-8lqd6\" (UID: \"50382248-94a7-4fe8-95a3-458bd04a921a\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-8lqd6"
Jul 30 13:10:18.764554 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:10:18.764288    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/50382248-94a7-4fe8-95a3-458bd04a921a-dshm\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-8lqd6\" (UID: \"50382248-94a7-4fe8-95a3-458bd04a921a\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-8lqd6"
Jul 30 13:10:18.764554 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:10:18.764361    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/50382248-94a7-4fe8-95a3-458bd04a921a-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-8lqd6\" (UID: \"50382248-94a7-4fe8-95a3-458bd04a921a\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-8lqd6"
Jul 30 13:10:18.764554 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:10:18.764384    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-h8bq2\" (UniqueName: \"kubernetes.io/projected/50382248-94a7-4fe8-95a3-458bd04a921a-kube-api-access-h8bq2\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-8lqd6\" (UID: \"50382248-94a7-4fe8-95a3-458bd04a921a\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-8lqd6"
Jul 30 13:10:18.764554 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:10:18.764419    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/50382248-94a7-4fe8-95a3-458bd04a921a-model-cache\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-8lqd6\" (UID: \"50382248-94a7-4fe8-95a3-458bd04a921a\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-8lqd6"
Jul 30 13:10:18.764770 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:10:18.764694    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/50382248-94a7-4fe8-95a3-458bd04a921a-tmp-dir\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-8lqd6\" (UID: \"50382248-94a7-4fe8-95a3-458bd04a921a\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-8lqd6"
Jul 30 13:10:18.764901 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:10:18.764875    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/50382248-94a7-4fe8-95a3-458bd04a921a-home\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-8lqd6\" (UID: \"50382248-94a7-4fe8-95a3-458bd04a921a\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-8lqd6"
Jul 30 13:10:18.764971 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:10:18.764942    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/50382248-94a7-4fe8-95a3-458bd04a921a-model-cache\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-8lqd6\" (UID: \"50382248-94a7-4fe8-95a3-458bd04a921a\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-8lqd6"
Jul 30 13:10:18.766972 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:10:18.766945    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/50382248-94a7-4fe8-95a3-458bd04a921a-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-8lqd6\" (UID: \"50382248-94a7-4fe8-95a3-458bd04a921a\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-8lqd6"
Jul 30 13:10:18.767155 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:10:18.767136    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/50382248-94a7-4fe8-95a3-458bd04a921a-dshm\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-8lqd6\" (UID: \"50382248-94a7-4fe8-95a3-458bd04a921a\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-8lqd6"
Jul 30 13:10:18.775310 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:10:18.775246    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-h8bq2\" (UniqueName: \"kubernetes.io/projected/50382248-94a7-4fe8-95a3-458bd04a921a-kube-api-access-h8bq2\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-8lqd6\" (UID: \"50382248-94a7-4fe8-95a3-458bd04a921a\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-8lqd6"
Jul 30 13:10:18.854892 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:10:18.854800    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-8lqd6"
Jul 30 13:10:19.001134 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:10:19.001038    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-57fc66f697-8lqd6"]
Jul 30 13:10:19.577620 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:10:19.577526    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-8lqd6" event={"ID":"50382248-94a7-4fe8-95a3-458bd04a921a","Type":"ContainerStarted","Data":"2db23344467620477501c555f1b204663096011f401857ff0cb27816419bd5da"}
Jul 30 13:10:19.577620 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:10:19.577575    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-8lqd6" event={"ID":"50382248-94a7-4fe8-95a3-458bd04a921a","Type":"ContainerStarted","Data":"5b79ed136ac4cee24a8dccc0e63f34ffea2af372fda980b4ff43770140e97355"}
Jul 30 13:10:19.617959 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:10:19.617906    2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-8lqd6" podStartSLOduration=1.341108308 podStartE2EDuration="1.617891717s" totalImagesPullingTime="276.783409ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-30 13:10:18 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 13:10:19.617426998 +0000 UTC m=+648.546115274" watchObservedRunningTime="2026-07-30 13:10:19.617891717 +0000 UTC m=+648.546579980"
Jul 30 13:10:28.855879 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:10:28.855844    2566 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-8lqd6"
Jul 30 13:10:28.856491 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:10:28.855904    2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-8lqd6"
Jul 30 13:10:28.868443 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:10:28.868411    2566 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-8lqd6"
Jul 30 13:10:29.638875 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:10:29.638845    2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-8lqd6"
Jul 30 13:11:44.940233 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:11:44.940150    2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-6b7977fdcd-9g7f4"]
Jul 30 13:11:44.943356 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:11:44.943337    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-6b7977fdcd-9g7f4"
Jul 30 13:11:44.967854 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:11:44.967823    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-6b7977fdcd-9g7f4"]
Jul 30 13:11:45.016253 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:11:45.016215    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8pmtt\" (UniqueName: \"kubernetes.io/projected/5b888ffe-b963-42a4-85f4-2b1080a78371-kube-api-access-8pmtt\") pod \"authorino-6b7977fdcd-9g7f4\" (UID: \"5b888ffe-b963-42a4-85f4-2b1080a78371\") " pod="kuadrant-system/authorino-6b7977fdcd-9g7f4"
Jul 30 13:11:45.016253 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:11:45.016254    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/5b888ffe-b963-42a4-85f4-2b1080a78371-tls-cert\") pod \"authorino-6b7977fdcd-9g7f4\" (UID: \"5b888ffe-b963-42a4-85f4-2b1080a78371\") " pod="kuadrant-system/authorino-6b7977fdcd-9g7f4"
Jul 30 13:11:45.117769 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:11:45.117726    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8pmtt\" (UniqueName: \"kubernetes.io/projected/5b888ffe-b963-42a4-85f4-2b1080a78371-kube-api-access-8pmtt\") pod \"authorino-6b7977fdcd-9g7f4\" (UID: \"5b888ffe-b963-42a4-85f4-2b1080a78371\") " pod="kuadrant-system/authorino-6b7977fdcd-9g7f4"
Jul 30 13:11:45.117769 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:11:45.117777    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/5b888ffe-b963-42a4-85f4-2b1080a78371-tls-cert\") pod \"authorino-6b7977fdcd-9g7f4\" (UID: \"5b888ffe-b963-42a4-85f4-2b1080a78371\") " pod="kuadrant-system/authorino-6b7977fdcd-9g7f4"
Jul 30 13:11:45.120458 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:11:45.120428    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/5b888ffe-b963-42a4-85f4-2b1080a78371-tls-cert\") pod \"authorino-6b7977fdcd-9g7f4\" (UID: \"5b888ffe-b963-42a4-85f4-2b1080a78371\") " pod="kuadrant-system/authorino-6b7977fdcd-9g7f4"
Jul 30 13:11:45.126669 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:11:45.126633    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8pmtt\" (UniqueName: \"kubernetes.io/projected/5b888ffe-b963-42a4-85f4-2b1080a78371-kube-api-access-8pmtt\") pod \"authorino-6b7977fdcd-9g7f4\" (UID: \"5b888ffe-b963-42a4-85f4-2b1080a78371\") " pod="kuadrant-system/authorino-6b7977fdcd-9g7f4"
Jul 30 13:11:45.252299 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:11:45.252215    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-6b7977fdcd-9g7f4"
Jul 30 13:11:45.405767 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:11:45.405655    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-6b7977fdcd-9g7f4"]
Jul 30 13:11:45.408953 ip-10-0-143-153 kubenswrapper[2566]: W0730 13:11:45.408923    2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod5b888ffe_b963_42a4_85f4_2b1080a78371.slice/crio-b0bf7ff80450895f979f5c6007cbde504290508d76c75f66f2491c17ae57ecfc WatchSource:0}: Error finding container b0bf7ff80450895f979f5c6007cbde504290508d76c75f66f2491c17ae57ecfc: Status 404 returned error can't find the container with id b0bf7ff80450895f979f5c6007cbde504290508d76c75f66f2491c17ae57ecfc
Jul 30 13:11:45.998939 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:11:45.998899    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-6b7977fdcd-9g7f4" event={"ID":"5b888ffe-b963-42a4-85f4-2b1080a78371","Type":"ContainerStarted","Data":"b0bf7ff80450895f979f5c6007cbde504290508d76c75f66f2491c17ae57ecfc"}
Jul 30 13:11:47.005849 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:11:47.005814    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-6b7977fdcd-9g7f4" event={"ID":"5b888ffe-b963-42a4-85f4-2b1080a78371","Type":"ContainerStarted","Data":"c559d028712711600e132630fdca6d063561532e3cb80d6f9dc9203ba58edfcc"}
Jul 30 13:11:47.028900 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:11:47.028842    2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-6b7977fdcd-9g7f4" podStartSLOduration=2.357083742 podStartE2EDuration="3.028825566s" totalImagesPullingTime="671.741824ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-30 13:11:44 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 13:11:47.026370259 +0000 UTC m=+735.955058524" watchObservedRunningTime="2026-07-30 13:11:47.028825566 +0000 UTC m=+735.957513867"
Jul 30 13:11:47.072661 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:11:47.072620    2566 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-75b89cbd95-cpwkw"]
Jul 30 13:11:47.072848 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:11:47.072790    2566 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/authorino-75b89cbd95-cpwkw" podUID="c426d46b-6492-4761-bc70-d4383f3df3f5" containerName="authorino" containerID="cri-o://b036b4aea5dfef37604f10bb9735137345eaad02c08fa729f52cfe1f49988f32" gracePeriod=30
Jul 30 13:11:47.344265 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:11:47.344238    2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75b89cbd95-cpwkw"
Jul 30 13:11:47.437577 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:11:47.437547    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-fh5b2\" (UniqueName: \"kubernetes.io/projected/c426d46b-6492-4761-bc70-d4383f3df3f5-kube-api-access-fh5b2\") pod \"c426d46b-6492-4761-bc70-d4383f3df3f5\" (UID: \"c426d46b-6492-4761-bc70-d4383f3df3f5\") "
Jul 30 13:11:47.437762 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:11:47.437623    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/c426d46b-6492-4761-bc70-d4383f3df3f5-tls-cert\") pod \"c426d46b-6492-4761-bc70-d4383f3df3f5\" (UID: \"c426d46b-6492-4761-bc70-d4383f3df3f5\") "
Jul 30 13:11:47.439744 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:11:47.439695    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c426d46b-6492-4761-bc70-d4383f3df3f5-kube-api-access-fh5b2" (OuterVolumeSpecName: "kube-api-access-fh5b2") pod "c426d46b-6492-4761-bc70-d4383f3df3f5" (UID: "c426d46b-6492-4761-bc70-d4383f3df3f5"). InnerVolumeSpecName "kube-api-access-fh5b2". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 30 13:11:47.449771 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:11:47.449735    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c426d46b-6492-4761-bc70-d4383f3df3f5-tls-cert" (OuterVolumeSpecName: "tls-cert") pod "c426d46b-6492-4761-bc70-d4383f3df3f5" (UID: "c426d46b-6492-4761-bc70-d4383f3df3f5"). InnerVolumeSpecName "tls-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 30 13:11:47.538524 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:11:47.538469    2566 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-fh5b2\" (UniqueName: \"kubernetes.io/projected/c426d46b-6492-4761-bc70-d4383f3df3f5-kube-api-access-fh5b2\") on node \"ip-10-0-143-153.ec2.internal\" DevicePath \"\""
Jul 30 13:11:47.538524 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:11:47.538500    2566 reconciler_common.go:299] "Volume detached for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/c426d46b-6492-4761-bc70-d4383f3df3f5-tls-cert\") on node \"ip-10-0-143-153.ec2.internal\" DevicePath \"\""
Jul 30 13:11:48.012586 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:11:48.012499    2566 generic.go:356] "Generic (PLEG): container finished" podID="c426d46b-6492-4761-bc70-d4383f3df3f5" containerID="b036b4aea5dfef37604f10bb9735137345eaad02c08fa729f52cfe1f49988f32" exitCode=0
Jul 30 13:11:48.012586 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:11:48.012540    2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75b89cbd95-cpwkw"
Jul 30 13:11:48.013100 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:11:48.012582    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75b89cbd95-cpwkw" event={"ID":"c426d46b-6492-4761-bc70-d4383f3df3f5","Type":"ContainerDied","Data":"b036b4aea5dfef37604f10bb9735137345eaad02c08fa729f52cfe1f49988f32"}
Jul 30 13:11:48.013100 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:11:48.012628    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75b89cbd95-cpwkw" event={"ID":"c426d46b-6492-4761-bc70-d4383f3df3f5","Type":"ContainerDied","Data":"f5815a9929dcd64f44c1c6a2911e7fa32e114324452f5ef8d76dc8a1ae5b7776"}
Jul 30 13:11:48.013100 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:11:48.012650    2566 scope.go:117] "RemoveContainer" containerID="b036b4aea5dfef37604f10bb9735137345eaad02c08fa729f52cfe1f49988f32"
Jul 30 13:11:48.025849 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:11:48.025823    2566 scope.go:117] "RemoveContainer" containerID="b036b4aea5dfef37604f10bb9735137345eaad02c08fa729f52cfe1f49988f32"
Jul 30 13:11:48.026304 ip-10-0-143-153 kubenswrapper[2566]: E0730 13:11:48.026260    2566 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b036b4aea5dfef37604f10bb9735137345eaad02c08fa729f52cfe1f49988f32\": container with ID starting with b036b4aea5dfef37604f10bb9735137345eaad02c08fa729f52cfe1f49988f32 not found: ID does not exist" containerID="b036b4aea5dfef37604f10bb9735137345eaad02c08fa729f52cfe1f49988f32"
Jul 30 13:11:48.026458 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:11:48.026302    2566 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b036b4aea5dfef37604f10bb9735137345eaad02c08fa729f52cfe1f49988f32"} err="failed to get container status \"b036b4aea5dfef37604f10bb9735137345eaad02c08fa729f52cfe1f49988f32\": rpc error: code = NotFound desc = could not find container \"b036b4aea5dfef37604f10bb9735137345eaad02c08fa729f52cfe1f49988f32\": container with ID starting with b036b4aea5dfef37604f10bb9735137345eaad02c08fa729f52cfe1f49988f32 not found: ID does not exist"
Jul 30 13:11:48.033644 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:11:48.033615    2566 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-75b89cbd95-cpwkw"]
Jul 30 13:11:48.036606 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:11:48.036579    2566 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-75b89cbd95-cpwkw"]
Jul 30 13:11:49.627236 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:11:49.627202    2566 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c426d46b-6492-4761-bc70-d4383f3df3f5" path="/var/lib/kubelet/pods/c426d46b-6492-4761-bc70-d4383f3df3f5/volumes"
Jul 30 13:12:33.392977 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:12:33.392935    2566 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-b8b49f4d5-srpzm"]
Jul 30 13:12:33.393482 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:12:33.393165    2566 kuberuntime_container.go:873] "Killing container with a grace period" pod="opendatahub/maas-controller-b8b49f4d5-srpzm" podUID="78a48b48-ee53-43fc-9c46-95464a056597" containerName="manager" containerID="cri-o://a6a6e39c1a49e131ae81ab40962e1be7817c79a7da6efacaa516a9b6522d5130" gracePeriod=30
Jul 30 13:12:33.647283 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:12:33.647224    2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-b8b49f4d5-srpzm"
Jul 30 13:12:33.748159 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:12:33.748106    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-kjpb6\" (UniqueName: \"kubernetes.io/projected/78a48b48-ee53-43fc-9c46-95464a056597-kube-api-access-kjpb6\") pod \"78a48b48-ee53-43fc-9c46-95464a056597\" (UID: \"78a48b48-ee53-43fc-9c46-95464a056597\") "
Jul 30 13:12:33.748159 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:12:33.748155    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/78a48b48-ee53-43fc-9c46-95464a056597-webhook-cert\") pod \"78a48b48-ee53-43fc-9c46-95464a056597\" (UID: \"78a48b48-ee53-43fc-9c46-95464a056597\") "
Jul 30 13:12:33.750369 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:12:33.750337    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/78a48b48-ee53-43fc-9c46-95464a056597-kube-api-access-kjpb6" (OuterVolumeSpecName: "kube-api-access-kjpb6") pod "78a48b48-ee53-43fc-9c46-95464a056597" (UID: "78a48b48-ee53-43fc-9c46-95464a056597"). InnerVolumeSpecName "kube-api-access-kjpb6". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 30 13:12:33.750474 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:12:33.750427    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/78a48b48-ee53-43fc-9c46-95464a056597-webhook-cert" (OuterVolumeSpecName: "webhook-cert") pod "78a48b48-ee53-43fc-9c46-95464a056597" (UID: "78a48b48-ee53-43fc-9c46-95464a056597"). InnerVolumeSpecName "webhook-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 30 13:12:33.848715 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:12:33.848680    2566 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-kjpb6\" (UniqueName: \"kubernetes.io/projected/78a48b48-ee53-43fc-9c46-95464a056597-kube-api-access-kjpb6\") on node \"ip-10-0-143-153.ec2.internal\" DevicePath \"\""
Jul 30 13:12:33.848715 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:12:33.848709    2566 reconciler_common.go:299] "Volume detached for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/78a48b48-ee53-43fc-9c46-95464a056597-webhook-cert\") on node \"ip-10-0-143-153.ec2.internal\" DevicePath \"\""
Jul 30 13:12:34.257565 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:12:34.257520    2566 generic.go:356] "Generic (PLEG): container finished" podID="78a48b48-ee53-43fc-9c46-95464a056597" containerID="a6a6e39c1a49e131ae81ab40962e1be7817c79a7da6efacaa516a9b6522d5130" exitCode=0
Jul 30 13:12:34.257737 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:12:34.257596    2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-b8b49f4d5-srpzm"
Jul 30 13:12:34.257737 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:12:34.257596    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-b8b49f4d5-srpzm" event={"ID":"78a48b48-ee53-43fc-9c46-95464a056597","Type":"ContainerDied","Data":"a6a6e39c1a49e131ae81ab40962e1be7817c79a7da6efacaa516a9b6522d5130"}
Jul 30 13:12:34.257737 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:12:34.257672    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-b8b49f4d5-srpzm" event={"ID":"78a48b48-ee53-43fc-9c46-95464a056597","Type":"ContainerDied","Data":"b3a3791776438a65ab46ae63acd21208ce65c348761c0548ff811423a0f684f9"}
Jul 30 13:12:34.257737 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:12:34.257695    2566 scope.go:117] "RemoveContainer" containerID="a6a6e39c1a49e131ae81ab40962e1be7817c79a7da6efacaa516a9b6522d5130"
Jul 30 13:12:34.266807 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:12:34.266788    2566 scope.go:117] "RemoveContainer" containerID="a6a6e39c1a49e131ae81ab40962e1be7817c79a7da6efacaa516a9b6522d5130"
Jul 30 13:12:34.267068 ip-10-0-143-153 kubenswrapper[2566]: E0730 13:12:34.267047    2566 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a6a6e39c1a49e131ae81ab40962e1be7817c79a7da6efacaa516a9b6522d5130\": container with ID starting with a6a6e39c1a49e131ae81ab40962e1be7817c79a7da6efacaa516a9b6522d5130 not found: ID does not exist" containerID="a6a6e39c1a49e131ae81ab40962e1be7817c79a7da6efacaa516a9b6522d5130"
Jul 30 13:12:34.267141 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:12:34.267098    2566 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a6a6e39c1a49e131ae81ab40962e1be7817c79a7da6efacaa516a9b6522d5130"} err="failed to get container status \"a6a6e39c1a49e131ae81ab40962e1be7817c79a7da6efacaa516a9b6522d5130\": rpc error: code = NotFound desc = could not find container \"a6a6e39c1a49e131ae81ab40962e1be7817c79a7da6efacaa516a9b6522d5130\": container with ID starting with a6a6e39c1a49e131ae81ab40962e1be7817c79a7da6efacaa516a9b6522d5130 not found: ID does not exist"
Jul 30 13:12:34.280160 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:12:34.280132    2566 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-b8b49f4d5-srpzm"]
Jul 30 13:12:34.284664 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:12:34.284640    2566 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-controller-b8b49f4d5-srpzm"]
Jul 30 13:12:35.627493 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:12:35.627460    2566 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="78a48b48-ee53-43fc-9c46-95464a056597" path="/var/lib/kubelet/pods/78a48b48-ee53-43fc-9c46-95464a056597/volumes"
Jul 30 13:13:35.151098 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:13:35.148671    2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-b8b49f4d5-fqx4t"]
Jul 30 13:13:35.151098 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:13:35.149582    2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="78a48b48-ee53-43fc-9c46-95464a056597" containerName="manager"
Jul 30 13:13:35.151098 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:13:35.149603    2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="78a48b48-ee53-43fc-9c46-95464a056597" containerName="manager"
Jul 30 13:13:35.151098 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:13:35.149635    2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c426d46b-6492-4761-bc70-d4383f3df3f5" containerName="authorino"
Jul 30 13:13:35.151098 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:13:35.149645    2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="c426d46b-6492-4761-bc70-d4383f3df3f5" containerName="authorino"
Jul 30 13:13:35.151098 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:13:35.149864    2566 memory_manager.go:368] "RemoveStaleState removing state" podUID="c426d46b-6492-4761-bc70-d4383f3df3f5" containerName="authorino"
Jul 30 13:13:35.151098 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:13:35.149887    2566 memory_manager.go:368] "RemoveStaleState removing state" podUID="78a48b48-ee53-43fc-9c46-95464a056597" containerName="manager"
Jul 30 13:13:35.155110 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:13:35.155060    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-b8b49f4d5-fqx4t"
Jul 30 13:13:35.157693 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:13:35.157661    2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\""
Jul 30 13:13:35.157814 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:13:35.157700    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-c66mt\""
Jul 30 13:13:35.157814 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:13:35.157661    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-webhook-cert\""
Jul 30 13:13:35.161941 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:13:35.161918    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-b8b49f4d5-fqx4t"]
Jul 30 13:13:35.181800 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:13:35.181766    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/4050b572-9996-4353-b332-e47bd70aee75-webhook-cert\") pod \"maas-controller-b8b49f4d5-fqx4t\" (UID: \"4050b572-9996-4353-b332-e47bd70aee75\") " pod="opendatahub/maas-controller-b8b49f4d5-fqx4t"
Jul 30 13:13:35.181978 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:13:35.181847    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kw5kv\" (UniqueName: \"kubernetes.io/projected/4050b572-9996-4353-b332-e47bd70aee75-kube-api-access-kw5kv\") pod \"maas-controller-b8b49f4d5-fqx4t\" (UID: \"4050b572-9996-4353-b332-e47bd70aee75\") " pod="opendatahub/maas-controller-b8b49f4d5-fqx4t"
Jul 30 13:13:35.282779 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:13:35.282748    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kw5kv\" (UniqueName: \"kubernetes.io/projected/4050b572-9996-4353-b332-e47bd70aee75-kube-api-access-kw5kv\") pod \"maas-controller-b8b49f4d5-fqx4t\" (UID: \"4050b572-9996-4353-b332-e47bd70aee75\") " pod="opendatahub/maas-controller-b8b49f4d5-fqx4t"
Jul 30 13:13:35.282945 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:13:35.282819    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/4050b572-9996-4353-b332-e47bd70aee75-webhook-cert\") pod \"maas-controller-b8b49f4d5-fqx4t\" (UID: \"4050b572-9996-4353-b332-e47bd70aee75\") " pod="opendatahub/maas-controller-b8b49f4d5-fqx4t"
Jul 30 13:13:35.285267 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:13:35.285238    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/4050b572-9996-4353-b332-e47bd70aee75-webhook-cert\") pod \"maas-controller-b8b49f4d5-fqx4t\" (UID: \"4050b572-9996-4353-b332-e47bd70aee75\") " pod="opendatahub/maas-controller-b8b49f4d5-fqx4t"
Jul 30 13:13:35.290894 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:13:35.290871    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kw5kv\" (UniqueName: \"kubernetes.io/projected/4050b572-9996-4353-b332-e47bd70aee75-kube-api-access-kw5kv\") pod \"maas-controller-b8b49f4d5-fqx4t\" (UID: \"4050b572-9996-4353-b332-e47bd70aee75\") " pod="opendatahub/maas-controller-b8b49f4d5-fqx4t"
Jul 30 13:13:35.467912 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:13:35.467833    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-b8b49f4d5-fqx4t"
Jul 30 13:13:35.616560 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:13:35.616398    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-b8b49f4d5-fqx4t"]
Jul 30 13:13:35.619410 ip-10-0-143-153 kubenswrapper[2566]: W0730 13:13:35.619379    2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4050b572_9996_4353_b332_e47bd70aee75.slice/crio-842058e43bd8ce29e79b86de0b7d9ea391cf2aaa33584fe46c344696b689aa3d WatchSource:0}: Error finding container 842058e43bd8ce29e79b86de0b7d9ea391cf2aaa33584fe46c344696b689aa3d: Status 404 returned error can't find the container with id 842058e43bd8ce29e79b86de0b7d9ea391cf2aaa33584fe46c344696b689aa3d
Jul 30 13:13:36.564382 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:13:36.564343    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-b8b49f4d5-fqx4t" event={"ID":"4050b572-9996-4353-b332-e47bd70aee75","Type":"ContainerStarted","Data":"804e727c453053474e800dd1439cbbbd4100b8533c7f5371d2653c56594b3de5"}
Jul 30 13:13:36.564746 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:13:36.564411    2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-b8b49f4d5-fqx4t"
Jul 30 13:13:36.564746 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:13:36.564437    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-b8b49f4d5-fqx4t" event={"ID":"4050b572-9996-4353-b332-e47bd70aee75","Type":"ContainerStarted","Data":"842058e43bd8ce29e79b86de0b7d9ea391cf2aaa33584fe46c344696b689aa3d"}
Jul 30 13:13:36.581449 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:13:36.581387    2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-b8b49f4d5-fqx4t" podStartSLOduration=0.859577147 podStartE2EDuration="1.581363156s" totalImagesPullingTime="721.786009ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-30 13:13:35 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 13:13:36.579569255 +0000 UTC m=+845.508257516" watchObservedRunningTime="2026-07-30 13:13:36.581363156 +0000 UTC m=+845.510051420"
Jul 30 13:13:47.571482 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:13:47.571446    2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-b8b49f4d5-fqx4t"
Jul 30 13:13:52.240862 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:13:52.240825    2566 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-b8b49f4d5-fqx4t"]
Jul 30 13:13:52.241305 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:13:52.241020    2566 kuberuntime_container.go:873] "Killing container with a grace period" pod="opendatahub/maas-controller-b8b49f4d5-fqx4t" podUID="4050b572-9996-4353-b332-e47bd70aee75" containerName="manager" containerID="cri-o://804e727c453053474e800dd1439cbbbd4100b8533c7f5371d2653c56594b3de5" gracePeriod=30
Jul 30 13:13:52.494998 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:13:52.494925    2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-b8b49f4d5-fqx4t"
Jul 30 13:13:52.534871 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:13:52.534827    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/4050b572-9996-4353-b332-e47bd70aee75-webhook-cert\") pod \"4050b572-9996-4353-b332-e47bd70aee75\" (UID: \"4050b572-9996-4353-b332-e47bd70aee75\") "
Jul 30 13:13:52.535065 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:13:52.534891    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-kw5kv\" (UniqueName: \"kubernetes.io/projected/4050b572-9996-4353-b332-e47bd70aee75-kube-api-access-kw5kv\") pod \"4050b572-9996-4353-b332-e47bd70aee75\" (UID: \"4050b572-9996-4353-b332-e47bd70aee75\") "
Jul 30 13:13:52.537245 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:13:52.537211    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4050b572-9996-4353-b332-e47bd70aee75-kube-api-access-kw5kv" (OuterVolumeSpecName: "kube-api-access-kw5kv") pod "4050b572-9996-4353-b332-e47bd70aee75" (UID: "4050b572-9996-4353-b332-e47bd70aee75"). InnerVolumeSpecName "kube-api-access-kw5kv". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 30 13:13:52.537354 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:13:52.537260    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4050b572-9996-4353-b332-e47bd70aee75-webhook-cert" (OuterVolumeSpecName: "webhook-cert") pod "4050b572-9996-4353-b332-e47bd70aee75" (UID: "4050b572-9996-4353-b332-e47bd70aee75"). InnerVolumeSpecName "webhook-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 30 13:13:52.636430 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:13:52.636395    2566 reconciler_common.go:299] "Volume detached for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/4050b572-9996-4353-b332-e47bd70aee75-webhook-cert\") on node \"ip-10-0-143-153.ec2.internal\" DevicePath \"\""
Jul 30 13:13:52.636430 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:13:52.636425    2566 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-kw5kv\" (UniqueName: \"kubernetes.io/projected/4050b572-9996-4353-b332-e47bd70aee75-kube-api-access-kw5kv\") on node \"ip-10-0-143-153.ec2.internal\" DevicePath \"\""
Jul 30 13:13:52.646631 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:13:52.646603    2566 generic.go:356] "Generic (PLEG): container finished" podID="4050b572-9996-4353-b332-e47bd70aee75" containerID="804e727c453053474e800dd1439cbbbd4100b8533c7f5371d2653c56594b3de5" exitCode=0
Jul 30 13:13:52.646773 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:13:52.646650    2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-b8b49f4d5-fqx4t"
Jul 30 13:13:52.646773 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:13:52.646669    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-b8b49f4d5-fqx4t" event={"ID":"4050b572-9996-4353-b332-e47bd70aee75","Type":"ContainerDied","Data":"804e727c453053474e800dd1439cbbbd4100b8533c7f5371d2653c56594b3de5"}
Jul 30 13:13:52.646773 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:13:52.646710    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-b8b49f4d5-fqx4t" event={"ID":"4050b572-9996-4353-b332-e47bd70aee75","Type":"ContainerDied","Data":"842058e43bd8ce29e79b86de0b7d9ea391cf2aaa33584fe46c344696b689aa3d"}
Jul 30 13:13:52.646773 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:13:52.646731    2566 scope.go:117] "RemoveContainer" containerID="804e727c453053474e800dd1439cbbbd4100b8533c7f5371d2653c56594b3de5"
Jul 30 13:13:52.655820 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:13:52.655801    2566 scope.go:117] "RemoveContainer" containerID="804e727c453053474e800dd1439cbbbd4100b8533c7f5371d2653c56594b3de5"
Jul 30 13:13:52.656103 ip-10-0-143-153 kubenswrapper[2566]: E0730 13:13:52.656067    2566 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"804e727c453053474e800dd1439cbbbd4100b8533c7f5371d2653c56594b3de5\": container with ID starting with 804e727c453053474e800dd1439cbbbd4100b8533c7f5371d2653c56594b3de5 not found: ID does not exist" containerID="804e727c453053474e800dd1439cbbbd4100b8533c7f5371d2653c56594b3de5"
Jul 30 13:13:52.656162 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:13:52.656113    2566 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"804e727c453053474e800dd1439cbbbd4100b8533c7f5371d2653c56594b3de5"} err="failed to get container status \"804e727c453053474e800dd1439cbbbd4100b8533c7f5371d2653c56594b3de5\": rpc error: code = NotFound desc = could not find container \"804e727c453053474e800dd1439cbbbd4100b8533c7f5371d2653c56594b3de5\": container with ID starting with 804e727c453053474e800dd1439cbbbd4100b8533c7f5371d2653c56594b3de5 not found: ID does not exist"
Jul 30 13:13:52.674490 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:13:52.674460    2566 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-b8b49f4d5-fqx4t"]
Jul 30 13:13:52.680188 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:13:52.680160    2566 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-controller-b8b49f4d5-fqx4t"]
Jul 30 13:13:53.627243 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:13:53.627210    2566 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="4050b572-9996-4353-b332-e47bd70aee75" path="/var/lib/kubelet/pods/4050b572-9996-4353-b332-e47bd70aee75/volumes"
Jul 30 13:14:31.558374 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:14:31.558301    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-bzl6w_51cdacbf-3a14-47c0-8fd4-69b0b2be0e64/console-operator/1.log"
Jul 30 13:14:31.558914 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:14:31.558616    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-bzl6w_51cdacbf-3a14-47c0-8fd4-69b0b2be0e64/console-operator/1.log"
Jul 30 13:14:31.563866 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:14:31.563847    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-f6br6_3ebbc209-4373-44d8-a22e-d2d2aa4cbfa6/ovn-acl-logging/0.log"
Jul 30 13:14:31.564056 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:14:31.564029    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-f6br6_3ebbc209-4373-44d8-a22e-d2d2aa4cbfa6/ovn-acl-logging/0.log"
Jul 30 13:19:31.589383 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:19:31.589356    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-bzl6w_51cdacbf-3a14-47c0-8fd4-69b0b2be0e64/console-operator/1.log"
Jul 30 13:19:31.595164 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:19:31.595137    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-bzl6w_51cdacbf-3a14-47c0-8fd4-69b0b2be0e64/console-operator/1.log"
Jul 30 13:19:31.597884 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:19:31.597863    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-f6br6_3ebbc209-4373-44d8-a22e-d2d2aa4cbfa6/ovn-acl-logging/0.log"
Jul 30 13:19:31.600260 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:19:31.600242    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-f6br6_3ebbc209-4373-44d8-a22e-d2d2aa4cbfa6/ovn-acl-logging/0.log"
Jul 30 13:21:23.830385 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:21:23.830342    2566 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-kpc2j"]
Jul 30 13:21:23.832970 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:21:23.830623    2566 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-kpc2j" podUID="bbf37c61-e530-4d55-aacd-cbf6dc2da7ca" containerName="manager" containerID="cri-o://61ae3d3a6de7b32a90780bbbd731b3046061e6baf7b5959ba64b4e7c7ac92df6" gracePeriod=10
Jul 30 13:21:24.088551 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:21:24.088493    2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-kpc2j"
Jul 30 13:21:24.115279 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:21:24.115249    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-zjkk5\" (UniqueName: \"kubernetes.io/projected/bbf37c61-e530-4d55-aacd-cbf6dc2da7ca-kube-api-access-zjkk5\") pod \"bbf37c61-e530-4d55-aacd-cbf6dc2da7ca\" (UID: \"bbf37c61-e530-4d55-aacd-cbf6dc2da7ca\") "
Jul 30 13:21:24.115444 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:21:24.115291    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/bbf37c61-e530-4d55-aacd-cbf6dc2da7ca-extensions-socket-volume\") pod \"bbf37c61-e530-4d55-aacd-cbf6dc2da7ca\" (UID: \"bbf37c61-e530-4d55-aacd-cbf6dc2da7ca\") "
Jul 30 13:21:24.115728 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:21:24.115706    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/bbf37c61-e530-4d55-aacd-cbf6dc2da7ca-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "bbf37c61-e530-4d55-aacd-cbf6dc2da7ca" (UID: "bbf37c61-e530-4d55-aacd-cbf6dc2da7ca"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 30 13:21:24.117476 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:21:24.117452    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/bbf37c61-e530-4d55-aacd-cbf6dc2da7ca-kube-api-access-zjkk5" (OuterVolumeSpecName: "kube-api-access-zjkk5") pod "bbf37c61-e530-4d55-aacd-cbf6dc2da7ca" (UID: "bbf37c61-e530-4d55-aacd-cbf6dc2da7ca"). InnerVolumeSpecName "kube-api-access-zjkk5". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 30 13:21:24.215940 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:21:24.215901    2566 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-zjkk5\" (UniqueName: \"kubernetes.io/projected/bbf37c61-e530-4d55-aacd-cbf6dc2da7ca-kube-api-access-zjkk5\") on node \"ip-10-0-143-153.ec2.internal\" DevicePath \"\""
Jul 30 13:21:24.215940 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:21:24.215933    2566 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/bbf37c61-e530-4d55-aacd-cbf6dc2da7ca-extensions-socket-volume\") on node \"ip-10-0-143-153.ec2.internal\" DevicePath \"\""
Jul 30 13:21:24.899467 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:21:24.899428    2566 generic.go:356] "Generic (PLEG): container finished" podID="bbf37c61-e530-4d55-aacd-cbf6dc2da7ca" containerID="61ae3d3a6de7b32a90780bbbd731b3046061e6baf7b5959ba64b4e7c7ac92df6" exitCode=0
Jul 30 13:21:24.899901 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:21:24.899482    2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-kpc2j"
Jul 30 13:21:24.899901 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:21:24.899515    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-kpc2j" event={"ID":"bbf37c61-e530-4d55-aacd-cbf6dc2da7ca","Type":"ContainerDied","Data":"61ae3d3a6de7b32a90780bbbd731b3046061e6baf7b5959ba64b4e7c7ac92df6"}
Jul 30 13:21:24.899901 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:21:24.899589    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-kpc2j" event={"ID":"bbf37c61-e530-4d55-aacd-cbf6dc2da7ca","Type":"ContainerDied","Data":"b0f8f19c99606871a3782e8a2b58a2217c06273eaee3e231ead6937964379c2e"}
Jul 30 13:21:24.899901 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:21:24.899612    2566 scope.go:117] "RemoveContainer" containerID="61ae3d3a6de7b32a90780bbbd731b3046061e6baf7b5959ba64b4e7c7ac92df6"
Jul 30 13:21:24.910350 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:21:24.910328    2566 scope.go:117] "RemoveContainer" containerID="61ae3d3a6de7b32a90780bbbd731b3046061e6baf7b5959ba64b4e7c7ac92df6"
Jul 30 13:21:24.910605 ip-10-0-143-153 kubenswrapper[2566]: E0730 13:21:24.910585    2566 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"61ae3d3a6de7b32a90780bbbd731b3046061e6baf7b5959ba64b4e7c7ac92df6\": container with ID starting with 61ae3d3a6de7b32a90780bbbd731b3046061e6baf7b5959ba64b4e7c7ac92df6 not found: ID does not exist" containerID="61ae3d3a6de7b32a90780bbbd731b3046061e6baf7b5959ba64b4e7c7ac92df6"
Jul 30 13:21:24.910679 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:21:24.910612    2566 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"61ae3d3a6de7b32a90780bbbd731b3046061e6baf7b5959ba64b4e7c7ac92df6"} err="failed to get container status \"61ae3d3a6de7b32a90780bbbd731b3046061e6baf7b5959ba64b4e7c7ac92df6\": rpc error: code = NotFound desc = could not find container \"61ae3d3a6de7b32a90780bbbd731b3046061e6baf7b5959ba64b4e7c7ac92df6\": container with ID starting with 61ae3d3a6de7b32a90780bbbd731b3046061e6baf7b5959ba64b4e7c7ac92df6 not found: ID does not exist"
Jul 30 13:21:24.919788 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:21:24.919762    2566 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-kpc2j"]
Jul 30 13:21:24.923628 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:21:24.923594    2566 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-kpc2j"]
Jul 30 13:21:25.628939 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:21:25.628907    2566 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="bbf37c61-e530-4d55-aacd-cbf6dc2da7ca" path="/var/lib/kubelet/pods/bbf37c61-e530-4d55-aacd-cbf6dc2da7ca/volumes"
Jul 30 13:22:24.568808 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:22:24.568772    2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-2mqt2"]
Jul 30 13:22:24.569317 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:22:24.569155    2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="bbf37c61-e530-4d55-aacd-cbf6dc2da7ca" containerName="manager"
Jul 30 13:22:24.569317 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:22:24.569166    2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="bbf37c61-e530-4d55-aacd-cbf6dc2da7ca" containerName="manager"
Jul 30 13:22:24.569317 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:22:24.569174    2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4050b572-9996-4353-b332-e47bd70aee75" containerName="manager"
Jul 30 13:22:24.569317 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:22:24.569179    2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="4050b572-9996-4353-b332-e47bd70aee75" containerName="manager"
Jul 30 13:22:24.569317 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:22:24.569234    2566 memory_manager.go:368] "RemoveStaleState removing state" podUID="bbf37c61-e530-4d55-aacd-cbf6dc2da7ca" containerName="manager"
Jul 30 13:22:24.569317 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:22:24.569245    2566 memory_manager.go:368] "RemoveStaleState removing state" podUID="4050b572-9996-4353-b332-e47bd70aee75" containerName="manager"
Jul 30 13:22:24.572218 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:22:24.572201    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-2mqt2"
Jul 30 13:22:24.574297 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:22:24.574279    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-hxg6w\""
Jul 30 13:22:24.583286 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:22:24.583260    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-2mqt2"]
Jul 30 13:22:24.648042 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:22:24.648004    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/3601c772-17aa-4747-93ec-63d72243a5c9-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-2mqt2\" (UID: \"3601c772-17aa-4747-93ec-63d72243a5c9\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-2mqt2"
Jul 30 13:22:24.648216 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:22:24.648054    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jd7hr\" (UniqueName: \"kubernetes.io/projected/3601c772-17aa-4747-93ec-63d72243a5c9-kube-api-access-jd7hr\") pod \"kuadrant-operator-controller-manager-86878c769f-2mqt2\" (UID: \"3601c772-17aa-4747-93ec-63d72243a5c9\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-2mqt2"
Jul 30 13:22:24.749379 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:22:24.749345    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/3601c772-17aa-4747-93ec-63d72243a5c9-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-2mqt2\" (UID: \"3601c772-17aa-4747-93ec-63d72243a5c9\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-2mqt2"
Jul 30 13:22:24.749379 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:22:24.749392    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jd7hr\" (UniqueName: \"kubernetes.io/projected/3601c772-17aa-4747-93ec-63d72243a5c9-kube-api-access-jd7hr\") pod \"kuadrant-operator-controller-manager-86878c769f-2mqt2\" (UID: \"3601c772-17aa-4747-93ec-63d72243a5c9\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-2mqt2"
Jul 30 13:22:24.749735 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:22:24.749714    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/3601c772-17aa-4747-93ec-63d72243a5c9-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-2mqt2\" (UID: \"3601c772-17aa-4747-93ec-63d72243a5c9\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-2mqt2"
Jul 30 13:22:24.762298 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:22:24.762265    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jd7hr\" (UniqueName: \"kubernetes.io/projected/3601c772-17aa-4747-93ec-63d72243a5c9-kube-api-access-jd7hr\") pod \"kuadrant-operator-controller-manager-86878c769f-2mqt2\" (UID: \"3601c772-17aa-4747-93ec-63d72243a5c9\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-2mqt2"
Jul 30 13:22:24.882212 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:22:24.882183    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-2mqt2"
Jul 30 13:22:25.045445 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:22:25.045420    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-2mqt2"]
Jul 30 13:22:25.047939 ip-10-0-143-153 kubenswrapper[2566]: W0730 13:22:25.047913    2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3601c772_17aa_4747_93ec_63d72243a5c9.slice/crio-1c46d29f883ed61341a7cba251e9179b517f73830f2235ff7ef6e339206f8506 WatchSource:0}: Error finding container 1c46d29f883ed61341a7cba251e9179b517f73830f2235ff7ef6e339206f8506: Status 404 returned error can't find the container with id 1c46d29f883ed61341a7cba251e9179b517f73830f2235ff7ef6e339206f8506
Jul 30 13:22:25.192510 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:22:25.192421    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-2mqt2" event={"ID":"3601c772-17aa-4747-93ec-63d72243a5c9","Type":"ContainerStarted","Data":"c15caf267d4e9daad70c3906ae3f890a389e7330d2d408cdf24c1ab83c2624f6"}
Jul 30 13:22:25.192510 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:22:25.192481    2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-2mqt2"
Jul 30 13:22:25.192510 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:22:25.192500    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-2mqt2" event={"ID":"3601c772-17aa-4747-93ec-63d72243a5c9","Type":"ContainerStarted","Data":"1c46d29f883ed61341a7cba251e9179b517f73830f2235ff7ef6e339206f8506"}
Jul 30 13:22:25.232332 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:22:25.232282    2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-2mqt2" podStartSLOduration=1.232267016 podStartE2EDuration="1.232267016s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-30 13:22:24 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 13:22:25.230553892 +0000 UTC m=+1374.159242155" watchObservedRunningTime="2026-07-30 13:22:25.232267016 +0000 UTC m=+1374.160955310"
Jul 30 13:22:36.199301 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:22:36.199270    2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-2mqt2"
Jul 30 13:24:31.639356 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:24:31.639320    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-bzl6w_51cdacbf-3a14-47c0-8fd4-69b0b2be0e64/console-operator/1.log"
Jul 30 13:24:31.640865 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:24:31.640841    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-bzl6w_51cdacbf-3a14-47c0-8fd4-69b0b2be0e64/console-operator/1.log"
Jul 30 13:24:31.645145 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:24:31.645105    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-f6br6_3ebbc209-4373-44d8-a22e-d2d2aa4cbfa6/ovn-acl-logging/0.log"
Jul 30 13:24:31.647794 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:24:31.647777    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-f6br6_3ebbc209-4373-44d8-a22e-d2d2aa4cbfa6/ovn-acl-logging/0.log"
Jul 30 13:25:39.951814 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:25:39.951779    2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-same-id-b-378c6e33-kserve-bc456579f-g2cw4"]
Jul 30 13:25:39.955521 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:25:39.955502    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-same-id-b-378c6e33-kserve-bc456579f-g2cw4"
Jul 30 13:25:39.957887 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:25:39.957857    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-same-id-b-378c6e33-kserve-self-signed-certs\""
Jul 30 13:25:39.965452 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:25:39.965425    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-same-id-b-378c6e33-kserve-bc456579f-g2cw4"]
Jul 30 13:25:39.984217 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:25:39.984160    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/6e6258e8-2d6e-4d46-855b-847568a2b16e-home\") pod \"e2e-same-id-b-378c6e33-kserve-bc456579f-g2cw4\" (UID: \"6e6258e8-2d6e-4d46-855b-847568a2b16e\") " pod="llm/e2e-same-id-b-378c6e33-kserve-bc456579f-g2cw4"
Jul 30 13:25:39.984217 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:25:39.984210    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-k7sn8\" (UniqueName: \"kubernetes.io/projected/6e6258e8-2d6e-4d46-855b-847568a2b16e-kube-api-access-k7sn8\") pod \"e2e-same-id-b-378c6e33-kserve-bc456579f-g2cw4\" (UID: \"6e6258e8-2d6e-4d46-855b-847568a2b16e\") " pod="llm/e2e-same-id-b-378c6e33-kserve-bc456579f-g2cw4"
Jul 30 13:25:39.984457 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:25:39.984258    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/6e6258e8-2d6e-4d46-855b-847568a2b16e-tls-certs\") pod \"e2e-same-id-b-378c6e33-kserve-bc456579f-g2cw4\" (UID: \"6e6258e8-2d6e-4d46-855b-847568a2b16e\") " pod="llm/e2e-same-id-b-378c6e33-kserve-bc456579f-g2cw4"
Jul 30 13:25:39.984457 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:25:39.984341    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/6e6258e8-2d6e-4d46-855b-847568a2b16e-dshm\") pod \"e2e-same-id-b-378c6e33-kserve-bc456579f-g2cw4\" (UID: \"6e6258e8-2d6e-4d46-855b-847568a2b16e\") " pod="llm/e2e-same-id-b-378c6e33-kserve-bc456579f-g2cw4"
Jul 30 13:25:39.984457 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:25:39.984384    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/6e6258e8-2d6e-4d46-855b-847568a2b16e-tmp-dir\") pod \"e2e-same-id-b-378c6e33-kserve-bc456579f-g2cw4\" (UID: \"6e6258e8-2d6e-4d46-855b-847568a2b16e\") " pod="llm/e2e-same-id-b-378c6e33-kserve-bc456579f-g2cw4"
Jul 30 13:25:39.984564 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:25:39.984518    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/6e6258e8-2d6e-4d46-855b-847568a2b16e-model-cache\") pod \"e2e-same-id-b-378c6e33-kserve-bc456579f-g2cw4\" (UID: \"6e6258e8-2d6e-4d46-855b-847568a2b16e\") " pod="llm/e2e-same-id-b-378c6e33-kserve-bc456579f-g2cw4"
Jul 30 13:25:40.085522 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:25:40.085489    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/6e6258e8-2d6e-4d46-855b-847568a2b16e-home\") pod \"e2e-same-id-b-378c6e33-kserve-bc456579f-g2cw4\" (UID: \"6e6258e8-2d6e-4d46-855b-847568a2b16e\") " pod="llm/e2e-same-id-b-378c6e33-kserve-bc456579f-g2cw4"
Jul 30 13:25:40.085522 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:25:40.085527    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-k7sn8\" (UniqueName: \"kubernetes.io/projected/6e6258e8-2d6e-4d46-855b-847568a2b16e-kube-api-access-k7sn8\") pod \"e2e-same-id-b-378c6e33-kserve-bc456579f-g2cw4\" (UID: \"6e6258e8-2d6e-4d46-855b-847568a2b16e\") " pod="llm/e2e-same-id-b-378c6e33-kserve-bc456579f-g2cw4"
Jul 30 13:25:40.085789 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:25:40.085551    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/6e6258e8-2d6e-4d46-855b-847568a2b16e-tls-certs\") pod \"e2e-same-id-b-378c6e33-kserve-bc456579f-g2cw4\" (UID: \"6e6258e8-2d6e-4d46-855b-847568a2b16e\") " pod="llm/e2e-same-id-b-378c6e33-kserve-bc456579f-g2cw4"
Jul 30 13:25:40.085789 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:25:40.085579    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/6e6258e8-2d6e-4d46-855b-847568a2b16e-dshm\") pod \"e2e-same-id-b-378c6e33-kserve-bc456579f-g2cw4\" (UID: \"6e6258e8-2d6e-4d46-855b-847568a2b16e\") " pod="llm/e2e-same-id-b-378c6e33-kserve-bc456579f-g2cw4"
Jul 30 13:25:40.085789 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:25:40.085594    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/6e6258e8-2d6e-4d46-855b-847568a2b16e-tmp-dir\") pod \"e2e-same-id-b-378c6e33-kserve-bc456579f-g2cw4\" (UID: \"6e6258e8-2d6e-4d46-855b-847568a2b16e\") " pod="llm/e2e-same-id-b-378c6e33-kserve-bc456579f-g2cw4"
Jul 30 13:25:40.085789 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:25:40.085642    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/6e6258e8-2d6e-4d46-855b-847568a2b16e-model-cache\") pod \"e2e-same-id-b-378c6e33-kserve-bc456579f-g2cw4\" (UID: \"6e6258e8-2d6e-4d46-855b-847568a2b16e\") " pod="llm/e2e-same-id-b-378c6e33-kserve-bc456579f-g2cw4"
Jul 30 13:25:40.086178 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:25:40.086151    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/6e6258e8-2d6e-4d46-855b-847568a2b16e-tmp-dir\") pod \"e2e-same-id-b-378c6e33-kserve-bc456579f-g2cw4\" (UID: \"6e6258e8-2d6e-4d46-855b-847568a2b16e\") " pod="llm/e2e-same-id-b-378c6e33-kserve-bc456579f-g2cw4"
Jul 30 13:25:40.086178 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:25:40.086165    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/6e6258e8-2d6e-4d46-855b-847568a2b16e-model-cache\") pod \"e2e-same-id-b-378c6e33-kserve-bc456579f-g2cw4\" (UID: \"6e6258e8-2d6e-4d46-855b-847568a2b16e\") " pod="llm/e2e-same-id-b-378c6e33-kserve-bc456579f-g2cw4"
Jul 30 13:25:40.086374 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:25:40.086220    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/6e6258e8-2d6e-4d46-855b-847568a2b16e-home\") pod \"e2e-same-id-b-378c6e33-kserve-bc456579f-g2cw4\" (UID: \"6e6258e8-2d6e-4d46-855b-847568a2b16e\") " pod="llm/e2e-same-id-b-378c6e33-kserve-bc456579f-g2cw4"
Jul 30 13:25:40.087874 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:25:40.087847    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/6e6258e8-2d6e-4d46-855b-847568a2b16e-dshm\") pod \"e2e-same-id-b-378c6e33-kserve-bc456579f-g2cw4\" (UID: \"6e6258e8-2d6e-4d46-855b-847568a2b16e\") " pod="llm/e2e-same-id-b-378c6e33-kserve-bc456579f-g2cw4"
Jul 30 13:25:40.088179 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:25:40.088160    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/6e6258e8-2d6e-4d46-855b-847568a2b16e-tls-certs\") pod \"e2e-same-id-b-378c6e33-kserve-bc456579f-g2cw4\" (UID: \"6e6258e8-2d6e-4d46-855b-847568a2b16e\") " pod="llm/e2e-same-id-b-378c6e33-kserve-bc456579f-g2cw4"
Jul 30 13:25:40.095544 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:25:40.095517    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-k7sn8\" (UniqueName: \"kubernetes.io/projected/6e6258e8-2d6e-4d46-855b-847568a2b16e-kube-api-access-k7sn8\") pod \"e2e-same-id-b-378c6e33-kserve-bc456579f-g2cw4\" (UID: \"6e6258e8-2d6e-4d46-855b-847568a2b16e\") " pod="llm/e2e-same-id-b-378c6e33-kserve-bc456579f-g2cw4"
Jul 30 13:25:40.267105 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:25:40.266990    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-same-id-b-378c6e33-kserve-bc456579f-g2cw4"
Jul 30 13:25:40.411704 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:25:40.411637    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-same-id-b-378c6e33-kserve-bc456579f-g2cw4"]
Jul 30 13:25:40.414586 ip-10-0-143-153 kubenswrapper[2566]: W0730 13:25:40.414560    2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod6e6258e8_2d6e_4d46_855b_847568a2b16e.slice/crio-cc177e2c54693e8feba93d1a201dfe6682ac9331b08b311a4121c51cad2df910 WatchSource:0}: Error finding container cc177e2c54693e8feba93d1a201dfe6682ac9331b08b311a4121c51cad2df910: Status 404 returned error can't find the container with id cc177e2c54693e8feba93d1a201dfe6682ac9331b08b311a4121c51cad2df910
Jul 30 13:25:41.174912 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:25:41.174874    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-same-id-b-378c6e33-kserve-bc456579f-g2cw4" event={"ID":"6e6258e8-2d6e-4d46-855b-847568a2b16e","Type":"ContainerStarted","Data":"4676003de2761c2d6197cecfc17688c12550c538e2ab058db03af8d83fe5be5d"}
Jul 30 13:25:41.174912 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:25:41.174919    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-same-id-b-378c6e33-kserve-bc456579f-g2cw4" event={"ID":"6e6258e8-2d6e-4d46-855b-847568a2b16e","Type":"ContainerStarted","Data":"cc177e2c54693e8feba93d1a201dfe6682ac9331b08b311a4121c51cad2df910"}
Jul 30 13:25:41.193160 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:25:41.193114    2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-same-id-b-378c6e33-kserve-bc456579f-g2cw4" podStartSLOduration=2.193096624 podStartE2EDuration="2.193096624s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-30 13:25:39 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 13:25:41.192956107 +0000 UTC m=+1570.121644371" watchObservedRunningTime="2026-07-30 13:25:41.193096624 +0000 UTC m=+1570.121784881"
Jul 30 13:25:50.267202 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:25:50.267168    2566 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-same-id-b-378c6e33-kserve-bc456579f-g2cw4"
Jul 30 13:25:50.267635 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:25:50.267221    2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-same-id-b-378c6e33-kserve-bc456579f-g2cw4"
Jul 30 13:25:50.279842 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:25:50.279814    2566 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-same-id-b-378c6e33-kserve-bc456579f-g2cw4"
Jul 30 13:25:51.238706 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:25:51.238674    2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-same-id-b-378c6e33-kserve-bc456579f-g2cw4"
Jul 30 13:26:12.531610 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:26:12.531566    2566 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["llm/e2e-same-id-b-378c6e33-kserve-bc456579f-g2cw4"]
Jul 30 13:26:27.551406 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:26:27.551343    2566 kuberuntime_container.go:873] "Killing container with a grace period" pod="llm/e2e-same-id-b-378c6e33-kserve-bc456579f-g2cw4" podUID="6e6258e8-2d6e-4d46-855b-847568a2b16e" containerName="main" containerID="cri-o://4676003de2761c2d6197cecfc17688c12550c538e2ab058db03af8d83fe5be5d" gracePeriod=45
Jul 30 13:26:27.811800 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:26:27.811741    2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="llm/e2e-same-id-b-378c6e33-kserve-bc456579f-g2cw4"
Jul 30 13:26:27.912588 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:26:27.912557    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/6e6258e8-2d6e-4d46-855b-847568a2b16e-tls-certs\") pod \"6e6258e8-2d6e-4d46-855b-847568a2b16e\" (UID: \"6e6258e8-2d6e-4d46-855b-847568a2b16e\") "
Jul 30 13:26:27.912765 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:26:27.912602    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/6e6258e8-2d6e-4d46-855b-847568a2b16e-model-cache\") pod \"6e6258e8-2d6e-4d46-855b-847568a2b16e\" (UID: \"6e6258e8-2d6e-4d46-855b-847568a2b16e\") "
Jul 30 13:26:27.912765 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:26:27.912630    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-k7sn8\" (UniqueName: \"kubernetes.io/projected/6e6258e8-2d6e-4d46-855b-847568a2b16e-kube-api-access-k7sn8\") pod \"6e6258e8-2d6e-4d46-855b-847568a2b16e\" (UID: \"6e6258e8-2d6e-4d46-855b-847568a2b16e\") "
Jul 30 13:26:27.912765 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:26:27.912661    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/6e6258e8-2d6e-4d46-855b-847568a2b16e-dshm\") pod \"6e6258e8-2d6e-4d46-855b-847568a2b16e\" (UID: \"6e6258e8-2d6e-4d46-855b-847568a2b16e\") "
Jul 30 13:26:27.912765 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:26:27.912694    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/6e6258e8-2d6e-4d46-855b-847568a2b16e-tmp-dir\") pod \"6e6258e8-2d6e-4d46-855b-847568a2b16e\" (UID: \"6e6258e8-2d6e-4d46-855b-847568a2b16e\") "
Jul 30 13:26:27.912985 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:26:27.912896    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6e6258e8-2d6e-4d46-855b-847568a2b16e-model-cache" (OuterVolumeSpecName: "model-cache") pod "6e6258e8-2d6e-4d46-855b-847568a2b16e" (UID: "6e6258e8-2d6e-4d46-855b-847568a2b16e"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 30 13:26:27.913050 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:26:27.913026    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6e6258e8-2d6e-4d46-855b-847568a2b16e-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "6e6258e8-2d6e-4d46-855b-847568a2b16e" (UID: "6e6258e8-2d6e-4d46-855b-847568a2b16e"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 30 13:26:27.914909 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:26:27.914888    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6e6258e8-2d6e-4d46-855b-847568a2b16e-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "6e6258e8-2d6e-4d46-855b-847568a2b16e" (UID: "6e6258e8-2d6e-4d46-855b-847568a2b16e"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 30 13:26:27.914978 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:26:27.914941    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6e6258e8-2d6e-4d46-855b-847568a2b16e-dshm" (OuterVolumeSpecName: "dshm") pod "6e6258e8-2d6e-4d46-855b-847568a2b16e" (UID: "6e6258e8-2d6e-4d46-855b-847568a2b16e"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 30 13:26:27.915048 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:26:27.915024    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6e6258e8-2d6e-4d46-855b-847568a2b16e-kube-api-access-k7sn8" (OuterVolumeSpecName: "kube-api-access-k7sn8") pod "6e6258e8-2d6e-4d46-855b-847568a2b16e" (UID: "6e6258e8-2d6e-4d46-855b-847568a2b16e"). InnerVolumeSpecName "kube-api-access-k7sn8". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 30 13:26:28.013463 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:26:28.013434    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/6e6258e8-2d6e-4d46-855b-847568a2b16e-home\") pod \"6e6258e8-2d6e-4d46-855b-847568a2b16e\" (UID: \"6e6258e8-2d6e-4d46-855b-847568a2b16e\") "
Jul 30 13:26:28.013711 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:26:28.013689    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6e6258e8-2d6e-4d46-855b-847568a2b16e-home" (OuterVolumeSpecName: "home") pod "6e6258e8-2d6e-4d46-855b-847568a2b16e" (UID: "6e6258e8-2d6e-4d46-855b-847568a2b16e"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 30 13:26:28.013788 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:26:28.013771    2566 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/6e6258e8-2d6e-4d46-855b-847568a2b16e-tmp-dir\") on node \"ip-10-0-143-153.ec2.internal\" DevicePath \"\""
Jul 30 13:26:28.013827 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:26:28.013791    2566 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/6e6258e8-2d6e-4d46-855b-847568a2b16e-home\") on node \"ip-10-0-143-153.ec2.internal\" DevicePath \"\""
Jul 30 13:26:28.013827 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:26:28.013800    2566 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/6e6258e8-2d6e-4d46-855b-847568a2b16e-tls-certs\") on node \"ip-10-0-143-153.ec2.internal\" DevicePath \"\""
Jul 30 13:26:28.013827 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:26:28.013808    2566 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/6e6258e8-2d6e-4d46-855b-847568a2b16e-model-cache\") on node \"ip-10-0-143-153.ec2.internal\" DevicePath \"\""
Jul 30 13:26:28.013827 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:26:28.013816    2566 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-k7sn8\" (UniqueName: \"kubernetes.io/projected/6e6258e8-2d6e-4d46-855b-847568a2b16e-kube-api-access-k7sn8\") on node \"ip-10-0-143-153.ec2.internal\" DevicePath \"\""
Jul 30 13:26:28.013827 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:26:28.013825    2566 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/6e6258e8-2d6e-4d46-855b-847568a2b16e-dshm\") on node \"ip-10-0-143-153.ec2.internal\" DevicePath \"\""
Jul 30 13:26:28.421783 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:26:28.421748    2566 generic.go:356] "Generic (PLEG): container finished" podID="6e6258e8-2d6e-4d46-855b-847568a2b16e" containerID="4676003de2761c2d6197cecfc17688c12550c538e2ab058db03af8d83fe5be5d" exitCode=0
Jul 30 13:26:28.421955 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:26:28.421792    2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="llm/e2e-same-id-b-378c6e33-kserve-bc456579f-g2cw4"
Jul 30 13:26:28.421955 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:26:28.421835    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-same-id-b-378c6e33-kserve-bc456579f-g2cw4" event={"ID":"6e6258e8-2d6e-4d46-855b-847568a2b16e","Type":"ContainerDied","Data":"4676003de2761c2d6197cecfc17688c12550c538e2ab058db03af8d83fe5be5d"}
Jul 30 13:26:28.421955 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:26:28.421877    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-same-id-b-378c6e33-kserve-bc456579f-g2cw4" event={"ID":"6e6258e8-2d6e-4d46-855b-847568a2b16e","Type":"ContainerDied","Data":"cc177e2c54693e8feba93d1a201dfe6682ac9331b08b311a4121c51cad2df910"}
Jul 30 13:26:28.421955 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:26:28.421901    2566 scope.go:117] "RemoveContainer" containerID="4676003de2761c2d6197cecfc17688c12550c538e2ab058db03af8d83fe5be5d"
Jul 30 13:26:28.431283 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:26:28.431266    2566 scope.go:117] "RemoveContainer" containerID="4676003de2761c2d6197cecfc17688c12550c538e2ab058db03af8d83fe5be5d"
Jul 30 13:26:28.431516 ip-10-0-143-153 kubenswrapper[2566]: E0730 13:26:28.431500    2566 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4676003de2761c2d6197cecfc17688c12550c538e2ab058db03af8d83fe5be5d\": container with ID starting with 4676003de2761c2d6197cecfc17688c12550c538e2ab058db03af8d83fe5be5d not found: ID does not exist" containerID="4676003de2761c2d6197cecfc17688c12550c538e2ab058db03af8d83fe5be5d"
Jul 30 13:26:28.431568 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:26:28.431524    2566 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4676003de2761c2d6197cecfc17688c12550c538e2ab058db03af8d83fe5be5d"} err="failed to get container status \"4676003de2761c2d6197cecfc17688c12550c538e2ab058db03af8d83fe5be5d\": rpc error: code = NotFound desc = could not find container \"4676003de2761c2d6197cecfc17688c12550c538e2ab058db03af8d83fe5be5d\": container with ID starting with 4676003de2761c2d6197cecfc17688c12550c538e2ab058db03af8d83fe5be5d not found: ID does not exist"
Jul 30 13:26:28.441636 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:26:28.441613    2566 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["llm/e2e-same-id-b-378c6e33-kserve-bc456579f-g2cw4"]
Jul 30 13:26:28.445229 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:26:28.445209    2566 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["llm/e2e-same-id-b-378c6e33-kserve-bc456579f-g2cw4"]
Jul 30 13:26:29.630179 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:26:29.630146    2566 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="6e6258e8-2d6e-4d46-855b-847568a2b16e" path="/var/lib/kubelet/pods/6e6258e8-2d6e-4d46-855b-847568a2b16e/volumes"
Jul 30 13:29:31.670582 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:29:31.670553    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-bzl6w_51cdacbf-3a14-47c0-8fd4-69b0b2be0e64/console-operator/1.log"
Jul 30 13:29:31.673930 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:29:31.673905    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-bzl6w_51cdacbf-3a14-47c0-8fd4-69b0b2be0e64/console-operator/1.log"
Jul 30 13:29:31.675957 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:29:31.675934    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-f6br6_3ebbc209-4373-44d8-a22e-d2d2aa4cbfa6/ovn-acl-logging/0.log"
Jul 30 13:29:31.678986 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:29:31.678967    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-f6br6_3ebbc209-4373-44d8-a22e-d2d2aa4cbfa6/ovn-acl-logging/0.log"
Jul 30 13:31:10.951291 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:31:10.951259    2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-a593ec13-7598667cbd-r7ffr"]
Jul 30 13:31:10.951772 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:31:10.951628    2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6e6258e8-2d6e-4d46-855b-847568a2b16e" containerName="main"
Jul 30 13:31:10.951772 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:31:10.951648    2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="6e6258e8-2d6e-4d46-855b-847568a2b16e" containerName="main"
Jul 30 13:31:10.951772 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:31:10.951724    2566 memory_manager.go:368] "RemoveStaleState removing state" podUID="6e6258e8-2d6e-4d46-855b-847568a2b16e" containerName="main"
Jul 30 13:31:10.954887 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:31:10.954866    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-a593ec13-7598667cbd-r7ffr"
Jul 30 13:31:10.959332 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:31:10.959311    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-ait-a593ec13-serving-cert\""
Jul 30 13:31:10.975203 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:31:10.975174    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-a593ec13-7598667cbd-r7ffr"]
Jul 30 13:31:11.124260 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:31:11.124223    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/b5ef29a1-915c-4510-b62f-88c055cc169a-openshift-service-ca\") pod \"maas-api-e2e-ait-a593ec13-7598667cbd-r7ffr\" (UID: \"b5ef29a1-915c-4510-b62f-88c055cc169a\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-a593ec13-7598667cbd-r7ffr"
Jul 30 13:31:11.124440 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:31:11.124274    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4h8j2\" (UniqueName: \"kubernetes.io/projected/b5ef29a1-915c-4510-b62f-88c055cc169a-kube-api-access-4h8j2\") pod \"maas-api-e2e-ait-a593ec13-7598667cbd-r7ffr\" (UID: \"b5ef29a1-915c-4510-b62f-88c055cc169a\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-a593ec13-7598667cbd-r7ffr"
Jul 30 13:31:11.124440 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:31:11.124350    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/b5ef29a1-915c-4510-b62f-88c055cc169a-maas-api-tls\") pod \"maas-api-e2e-ait-a593ec13-7598667cbd-r7ffr\" (UID: \"b5ef29a1-915c-4510-b62f-88c055cc169a\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-a593ec13-7598667cbd-r7ffr"
Jul 30 13:31:11.225277 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:31:11.225190    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/b5ef29a1-915c-4510-b62f-88c055cc169a-openshift-service-ca\") pod \"maas-api-e2e-ait-a593ec13-7598667cbd-r7ffr\" (UID: \"b5ef29a1-915c-4510-b62f-88c055cc169a\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-a593ec13-7598667cbd-r7ffr"
Jul 30 13:31:11.225277 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:31:11.225240    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4h8j2\" (UniqueName: \"kubernetes.io/projected/b5ef29a1-915c-4510-b62f-88c055cc169a-kube-api-access-4h8j2\") pod \"maas-api-e2e-ait-a593ec13-7598667cbd-r7ffr\" (UID: \"b5ef29a1-915c-4510-b62f-88c055cc169a\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-a593ec13-7598667cbd-r7ffr"
Jul 30 13:31:11.225467 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:31:11.225303    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/b5ef29a1-915c-4510-b62f-88c055cc169a-maas-api-tls\") pod \"maas-api-e2e-ait-a593ec13-7598667cbd-r7ffr\" (UID: \"b5ef29a1-915c-4510-b62f-88c055cc169a\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-a593ec13-7598667cbd-r7ffr"
Jul 30 13:31:11.225467 ip-10-0-143-153 kubenswrapper[2566]: E0730 13:31:11.225419    2566 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-ait-a593ec13-serving-cert: secret "maas-api-e2e-ait-a593ec13-serving-cert" not found
Jul 30 13:31:11.225534 ip-10-0-143-153 kubenswrapper[2566]: E0730 13:31:11.225485    2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b5ef29a1-915c-4510-b62f-88c055cc169a-maas-api-tls podName:b5ef29a1-915c-4510-b62f-88c055cc169a nodeName:}" failed. No retries permitted until 2026-07-30 13:31:11.72546446 +0000 UTC m=+1900.654152701 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/b5ef29a1-915c-4510-b62f-88c055cc169a-maas-api-tls") pod "maas-api-e2e-ait-a593ec13-7598667cbd-r7ffr" (UID: "b5ef29a1-915c-4510-b62f-88c055cc169a") : secret "maas-api-e2e-ait-a593ec13-serving-cert" not found
Jul 30 13:31:11.225856 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:31:11.225837    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/b5ef29a1-915c-4510-b62f-88c055cc169a-openshift-service-ca\") pod \"maas-api-e2e-ait-a593ec13-7598667cbd-r7ffr\" (UID: \"b5ef29a1-915c-4510-b62f-88c055cc169a\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-a593ec13-7598667cbd-r7ffr"
Jul 30 13:31:11.233794 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:31:11.233768    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4h8j2\" (UniqueName: \"kubernetes.io/projected/b5ef29a1-915c-4510-b62f-88c055cc169a-kube-api-access-4h8j2\") pod \"maas-api-e2e-ait-a593ec13-7598667cbd-r7ffr\" (UID: \"b5ef29a1-915c-4510-b62f-88c055cc169a\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-a593ec13-7598667cbd-r7ffr"
Jul 30 13:31:11.609033 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:31:11.608953    2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-a593ec13-57d4d49fd8-mmvh9"]
Jul 30 13:31:11.612554 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:31:11.612535    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ait-a593ec13-57d4d49fd8-mmvh9"
Jul 30 13:31:11.616613 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:31:11.616578    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-ait-a593ec13-dockercfg-2t95n\""
Jul 30 13:31:11.616975 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:31:11.616957    2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-ait-a593ec13\""
Jul 30 13:31:11.631437 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:31:11.631410    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-a593ec13-57d4d49fd8-mmvh9"]
Jul 30 13:31:11.651217 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:31:11.651191    2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-a593ec13-7b695b9bcb-9gp65"]
Jul 30 13:31:11.654588 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:31:11.654572    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ait-a593ec13-7b695b9bcb-9gp65"
Jul 30 13:31:11.665884 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:31:11.665861    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-a593ec13-7b695b9bcb-9gp65"]
Jul 30 13:31:11.730396 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:31:11.730362    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/b5ef29a1-915c-4510-b62f-88c055cc169a-maas-api-tls\") pod \"maas-api-e2e-ait-a593ec13-7598667cbd-r7ffr\" (UID: \"b5ef29a1-915c-4510-b62f-88c055cc169a\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-a593ec13-7598667cbd-r7ffr"
Jul 30 13:31:11.730554 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:31:11.730528    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/ff101a0c-85e5-4249-93b1-1fbc99b25f73-plugins-config-volume\") pod \"payload-pre-processing-e2e-ait-a593ec13-57d4d49fd8-mmvh9\" (UID: \"ff101a0c-85e5-4249-93b1-1fbc99b25f73\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-a593ec13-57d4d49fd8-mmvh9"
Jul 30 13:31:11.730597 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:31:11.730557    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9pxn4\" (UniqueName: \"kubernetes.io/projected/ff101a0c-85e5-4249-93b1-1fbc99b25f73-kube-api-access-9pxn4\") pod \"payload-pre-processing-e2e-ait-a593ec13-57d4d49fd8-mmvh9\" (UID: \"ff101a0c-85e5-4249-93b1-1fbc99b25f73\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-a593ec13-57d4d49fd8-mmvh9"
Jul 30 13:31:11.732849 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:31:11.732827    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/b5ef29a1-915c-4510-b62f-88c055cc169a-maas-api-tls\") pod \"maas-api-e2e-ait-a593ec13-7598667cbd-r7ffr\" (UID: \"b5ef29a1-915c-4510-b62f-88c055cc169a\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-a593ec13-7598667cbd-r7ffr"
Jul 30 13:31:11.831061 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:31:11.831023    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/d6ca3f66-181c-4e2a-8960-f283687d88f4-plugins-config-volume\") pod \"payload-processing-e2e-ait-a593ec13-7b695b9bcb-9gp65\" (UID: \"d6ca3f66-181c-4e2a-8960-f283687d88f4\") " pod="openshift-ingress/payload-processing-e2e-ait-a593ec13-7b695b9bcb-9gp65"
Jul 30 13:31:11.831297 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:31:11.831158    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/ff101a0c-85e5-4249-93b1-1fbc99b25f73-plugins-config-volume\") pod \"payload-pre-processing-e2e-ait-a593ec13-57d4d49fd8-mmvh9\" (UID: \"ff101a0c-85e5-4249-93b1-1fbc99b25f73\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-a593ec13-57d4d49fd8-mmvh9"
Jul 30 13:31:11.831297 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:31:11.831200    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9pxn4\" (UniqueName: \"kubernetes.io/projected/ff101a0c-85e5-4249-93b1-1fbc99b25f73-kube-api-access-9pxn4\") pod \"payload-pre-processing-e2e-ait-a593ec13-57d4d49fd8-mmvh9\" (UID: \"ff101a0c-85e5-4249-93b1-1fbc99b25f73\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-a593ec13-57d4d49fd8-mmvh9"
Jul 30 13:31:11.831297 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:31:11.831269    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fq4dm\" (UniqueName: \"kubernetes.io/projected/d6ca3f66-181c-4e2a-8960-f283687d88f4-kube-api-access-fq4dm\") pod \"payload-processing-e2e-ait-a593ec13-7b695b9bcb-9gp65\" (UID: \"d6ca3f66-181c-4e2a-8960-f283687d88f4\") " pod="openshift-ingress/payload-processing-e2e-ait-a593ec13-7b695b9bcb-9gp65"
Jul 30 13:31:11.831895 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:31:11.831875    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/ff101a0c-85e5-4249-93b1-1fbc99b25f73-plugins-config-volume\") pod \"payload-pre-processing-e2e-ait-a593ec13-57d4d49fd8-mmvh9\" (UID: \"ff101a0c-85e5-4249-93b1-1fbc99b25f73\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-a593ec13-57d4d49fd8-mmvh9"
Jul 30 13:31:11.838949 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:31:11.838923    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9pxn4\" (UniqueName: \"kubernetes.io/projected/ff101a0c-85e5-4249-93b1-1fbc99b25f73-kube-api-access-9pxn4\") pod \"payload-pre-processing-e2e-ait-a593ec13-57d4d49fd8-mmvh9\" (UID: \"ff101a0c-85e5-4249-93b1-1fbc99b25f73\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-a593ec13-57d4d49fd8-mmvh9"
Jul 30 13:31:11.864996 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:31:11.864912    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-a593ec13-7598667cbd-r7ffr"
Jul 30 13:31:11.923392 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:31:11.923361    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ait-a593ec13-57d4d49fd8-mmvh9"
Jul 30 13:31:11.932876 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:31:11.932840    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/d6ca3f66-181c-4e2a-8960-f283687d88f4-plugins-config-volume\") pod \"payload-processing-e2e-ait-a593ec13-7b695b9bcb-9gp65\" (UID: \"d6ca3f66-181c-4e2a-8960-f283687d88f4\") " pod="openshift-ingress/payload-processing-e2e-ait-a593ec13-7b695b9bcb-9gp65"
Jul 30 13:31:11.933007 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:31:11.932974    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fq4dm\" (UniqueName: \"kubernetes.io/projected/d6ca3f66-181c-4e2a-8960-f283687d88f4-kube-api-access-fq4dm\") pod \"payload-processing-e2e-ait-a593ec13-7b695b9bcb-9gp65\" (UID: \"d6ca3f66-181c-4e2a-8960-f283687d88f4\") " pod="openshift-ingress/payload-processing-e2e-ait-a593ec13-7b695b9bcb-9gp65"
Jul 30 13:31:11.933680 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:31:11.933652    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/d6ca3f66-181c-4e2a-8960-f283687d88f4-plugins-config-volume\") pod \"payload-processing-e2e-ait-a593ec13-7b695b9bcb-9gp65\" (UID: \"d6ca3f66-181c-4e2a-8960-f283687d88f4\") " pod="openshift-ingress/payload-processing-e2e-ait-a593ec13-7b695b9bcb-9gp65"
Jul 30 13:31:11.942354 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:31:11.942329    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fq4dm\" (UniqueName: \"kubernetes.io/projected/d6ca3f66-181c-4e2a-8960-f283687d88f4-kube-api-access-fq4dm\") pod \"payload-processing-e2e-ait-a593ec13-7b695b9bcb-9gp65\" (UID: \"d6ca3f66-181c-4e2a-8960-f283687d88f4\") " pod="openshift-ingress/payload-processing-e2e-ait-a593ec13-7b695b9bcb-9gp65"
Jul 30 13:31:11.965332 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:31:11.965296    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ait-a593ec13-7b695b9bcb-9gp65"
Jul 30 13:31:12.030104 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:31:12.030056    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-a593ec13-7598667cbd-r7ffr"]
Jul 30 13:31:12.035999 ip-10-0-143-153 kubenswrapper[2566]: W0730 13:31:12.035722    2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb5ef29a1_915c_4510_b62f_88c055cc169a.slice/crio-86ad1b29a37bc646deee3ae3076de321e7f9ccbf92d2aaa7b2c7e0f53de1f8fc WatchSource:0}: Error finding container 86ad1b29a37bc646deee3ae3076de321e7f9ccbf92d2aaa7b2c7e0f53de1f8fc: Status 404 returned error can't find the container with id 86ad1b29a37bc646deee3ae3076de321e7f9ccbf92d2aaa7b2c7e0f53de1f8fc
Jul 30 13:31:12.038639 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:31:12.037461    2566 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 30 13:31:12.089150 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:31:12.089004    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-a593ec13-57d4d49fd8-mmvh9"]
Jul 30 13:31:12.094613 ip-10-0-143-153 kubenswrapper[2566]: W0730 13:31:12.094582    2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podff101a0c_85e5_4249_93b1_1fbc99b25f73.slice/crio-4300a664e6b57833c154a55a67686697617723de5717b1e631f48ddcc47cfa88 WatchSource:0}: Error finding container 4300a664e6b57833c154a55a67686697617723de5717b1e631f48ddcc47cfa88: Status 404 returned error can't find the container with id 4300a664e6b57833c154a55a67686697617723de5717b1e631f48ddcc47cfa88
Jul 30 13:31:12.344236 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:31:12.344143    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-a593ec13-7b695b9bcb-9gp65"]
Jul 30 13:31:12.347054 ip-10-0-143-153 kubenswrapper[2566]: W0730 13:31:12.347018    2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd6ca3f66_181c_4e2a_8960_f283687d88f4.slice/crio-a46eaca9d391e9177e8fbe3775d7709173abd0a73a176b4eda6a29c851ba781d WatchSource:0}: Error finding container a46eaca9d391e9177e8fbe3775d7709173abd0a73a176b4eda6a29c851ba781d: Status 404 returned error can't find the container with id a46eaca9d391e9177e8fbe3775d7709173abd0a73a176b4eda6a29c851ba781d
Jul 30 13:31:12.825550 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:31:12.825506    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-a593ec13-7598667cbd-r7ffr" event={"ID":"b5ef29a1-915c-4510-b62f-88c055cc169a","Type":"ContainerStarted","Data":"b109fae97765a7d84d34e9f3c96da5a131378942f6a246679ce1851822c72be8"}
Jul 30 13:31:12.825744 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:31:12.825564    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-a593ec13-7598667cbd-r7ffr" event={"ID":"b5ef29a1-915c-4510-b62f-88c055cc169a","Type":"ContainerStarted","Data":"86ad1b29a37bc646deee3ae3076de321e7f9ccbf92d2aaa7b2c7e0f53de1f8fc"}
Jul 30 13:31:12.825744 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:31:12.825673    2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-ait-a593ec13-7598667cbd-r7ffr"
Jul 30 13:31:12.827060 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:31:12.827037    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ait-a593ec13-7b695b9bcb-9gp65" event={"ID":"d6ca3f66-181c-4e2a-8960-f283687d88f4","Type":"ContainerStarted","Data":"23d06cdbdcb145bacc78e25ae3a5794687817083c0742bb44b870df9cb6553b5"}
Jul 30 13:31:12.827195 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:31:12.827095    2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-ait-a593ec13-7b695b9bcb-9gp65"
Jul 30 13:31:12.827195 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:31:12.827114    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ait-a593ec13-7b695b9bcb-9gp65" event={"ID":"d6ca3f66-181c-4e2a-8960-f283687d88f4","Type":"ContainerStarted","Data":"a46eaca9d391e9177e8fbe3775d7709173abd0a73a176b4eda6a29c851ba781d"}
Jul 30 13:31:12.828421 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:31:12.828395    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ait-a593ec13-57d4d49fd8-mmvh9" event={"ID":"ff101a0c-85e5-4249-93b1-1fbc99b25f73","Type":"ContainerStarted","Data":"071a20bfb0bbfeee7265fe3268bf29c3ebb25a0961d719634fb0ed0d704f7f73"}
Jul 30 13:31:12.828525 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:31:12.828441    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ait-a593ec13-57d4d49fd8-mmvh9" event={"ID":"ff101a0c-85e5-4249-93b1-1fbc99b25f73","Type":"ContainerStarted","Data":"4300a664e6b57833c154a55a67686697617723de5717b1e631f48ddcc47cfa88"}
Jul 30 13:31:12.828583 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:31:12.828523    2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-ait-a593ec13-57d4d49fd8-mmvh9"
Jul 30 13:31:12.844263 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:31:12.844220    2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-ait-a593ec13-7598667cbd-r7ffr" podStartSLOduration=2.240928913 podStartE2EDuration="2.844206495s" totalImagesPullingTime="603.277582ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-30 13:31:10 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 13:31:12.843442577 +0000 UTC m=+1901.772130841" watchObservedRunningTime="2026-07-30 13:31:12.844206495 +0000 UTC m=+1901.772894754"
Jul 30 13:31:12.862414 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:31:12.862374    2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-ait-a593ec13-7b695b9bcb-9gp65" podStartSLOduration=1.862361774 podStartE2EDuration="1.862361774s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-30 13:31:11 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 13:31:12.859782214 +0000 UTC m=+1901.788470475" watchObservedRunningTime="2026-07-30 13:31:12.862361774 +0000 UTC m=+1901.791050054"
Jul 30 13:31:12.878474 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:31:12.878418    2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-ait-a593ec13-57d4d49fd8-mmvh9" podStartSLOduration=1.878400519 podStartE2EDuration="1.878400519s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-30 13:31:11 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 13:31:12.876786181 +0000 UTC m=+1901.805474444" watchObservedRunningTime="2026-07-30 13:31:12.878400519 +0000 UTC m=+1901.807088784"
Jul 30 13:31:18.838674 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:31:18.838644    2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-ait-a593ec13-7598667cbd-r7ffr"
Jul 30 13:31:23.835934 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:31:23.835883    2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-ait-a593ec13-57d4d49fd8-mmvh9"
Jul 30 13:31:23.836658 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:31:23.836230    2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-ait-a593ec13-7b695b9bcb-9gp65"
Jul 30 13:31:41.582827 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:31:41.582760    2566 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-a593ec13-7598667cbd-r7ffr"]
Jul 30 13:31:41.585886 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:31:41.583044    2566 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-ait-a593ec13-7598667cbd-r7ffr" podUID="b5ef29a1-915c-4510-b62f-88c055cc169a" containerName="maas-api" containerID="cri-o://b109fae97765a7d84d34e9f3c96da5a131378942f6a246679ce1851822c72be8" gracePeriod=30
Jul 30 13:31:41.643759 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:31:41.643730    2566 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-a593ec13-7b695b9bcb-9gp65"]
Jul 30 13:31:41.643939 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:31:41.643914    2566 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-ait-a593ec13-7b695b9bcb-9gp65" podUID="d6ca3f66-181c-4e2a-8960-f283687d88f4" containerName="payload-processing" containerID="cri-o://23d06cdbdcb145bacc78e25ae3a5794687817083c0742bb44b870df9cb6553b5" gracePeriod=30
Jul 30 13:31:41.657664 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:31:41.657636    2566 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-a593ec13-57d4d49fd8-mmvh9"]
Jul 30 13:31:41.657853 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:31:41.657819    2566 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-ait-a593ec13-57d4d49fd8-mmvh9" podUID="ff101a0c-85e5-4249-93b1-1fbc99b25f73" containerName="payload-pre-processing" containerID="cri-o://071a20bfb0bbfeee7265fe3268bf29c3ebb25a0961d719634fb0ed0d704f7f73" gracePeriod=30
Jul 30 13:31:41.945060 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:31:41.945033    2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ait-a593ec13-7b695b9bcb-9gp65"
Jul 30 13:31:41.947989 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:31:41.947968    2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-a593ec13-7598667cbd-r7ffr"
Jul 30 13:31:41.974408 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:31:41.974371    2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ait-a593ec13-57d4d49fd8-mmvh9"
Jul 30 13:31:41.977396 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:31:41.977353    2566 generic.go:356] "Generic (PLEG): container finished" podID="ff101a0c-85e5-4249-93b1-1fbc99b25f73" containerID="071a20bfb0bbfeee7265fe3268bf29c3ebb25a0961d719634fb0ed0d704f7f73" exitCode=0
Jul 30 13:31:41.977625 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:31:41.977424    2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ait-a593ec13-57d4d49fd8-mmvh9"
Jul 30 13:31:41.977625 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:31:41.977467    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ait-a593ec13-57d4d49fd8-mmvh9" event={"ID":"ff101a0c-85e5-4249-93b1-1fbc99b25f73","Type":"ContainerDied","Data":"071a20bfb0bbfeee7265fe3268bf29c3ebb25a0961d719634fb0ed0d704f7f73"}
Jul 30 13:31:41.977625 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:31:41.977518    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ait-a593ec13-57d4d49fd8-mmvh9" event={"ID":"ff101a0c-85e5-4249-93b1-1fbc99b25f73","Type":"ContainerDied","Data":"4300a664e6b57833c154a55a67686697617723de5717b1e631f48ddcc47cfa88"}
Jul 30 13:31:41.977625 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:31:41.977553    2566 scope.go:117] "RemoveContainer" containerID="071a20bfb0bbfeee7265fe3268bf29c3ebb25a0961d719634fb0ed0d704f7f73"
Jul 30 13:31:41.979561 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:31:41.979517    2566 generic.go:356] "Generic (PLEG): container finished" podID="b5ef29a1-915c-4510-b62f-88c055cc169a" containerID="b109fae97765a7d84d34e9f3c96da5a131378942f6a246679ce1851822c72be8" exitCode=0
Jul 30 13:31:41.979688 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:31:41.979581    2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-a593ec13-7598667cbd-r7ffr"
Jul 30 13:31:41.979688 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:31:41.979644    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-a593ec13-7598667cbd-r7ffr" event={"ID":"b5ef29a1-915c-4510-b62f-88c055cc169a","Type":"ContainerDied","Data":"b109fae97765a7d84d34e9f3c96da5a131378942f6a246679ce1851822c72be8"}
Jul 30 13:31:41.979688 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:31:41.979682    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-a593ec13-7598667cbd-r7ffr" event={"ID":"b5ef29a1-915c-4510-b62f-88c055cc169a","Type":"ContainerDied","Data":"86ad1b29a37bc646deee3ae3076de321e7f9ccbf92d2aaa7b2c7e0f53de1f8fc"}
Jul 30 13:31:41.981402 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:31:41.981383    2566 generic.go:356] "Generic (PLEG): container finished" podID="d6ca3f66-181c-4e2a-8960-f283687d88f4" containerID="23d06cdbdcb145bacc78e25ae3a5794687817083c0742bb44b870df9cb6553b5" exitCode=0
Jul 30 13:31:41.981703 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:31:41.981448    2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ait-a593ec13-7b695b9bcb-9gp65"
Jul 30 13:31:41.982125 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:31:41.981490    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ait-a593ec13-7b695b9bcb-9gp65" event={"ID":"d6ca3f66-181c-4e2a-8960-f283687d88f4","Type":"ContainerDied","Data":"23d06cdbdcb145bacc78e25ae3a5794687817083c0742bb44b870df9cb6553b5"}
Jul 30 13:31:41.982125 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:31:41.982014    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ait-a593ec13-7b695b9bcb-9gp65" event={"ID":"d6ca3f66-181c-4e2a-8960-f283687d88f4","Type":"ContainerDied","Data":"a46eaca9d391e9177e8fbe3775d7709173abd0a73a176b4eda6a29c851ba781d"}
Jul 30 13:31:41.988250 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:31:41.988224    2566 scope.go:117] "RemoveContainer" containerID="071a20bfb0bbfeee7265fe3268bf29c3ebb25a0961d719634fb0ed0d704f7f73"
Jul 30 13:31:41.988513 ip-10-0-143-153 kubenswrapper[2566]: E0730 13:31:41.988495    2566 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"071a20bfb0bbfeee7265fe3268bf29c3ebb25a0961d719634fb0ed0d704f7f73\": container with ID starting with 071a20bfb0bbfeee7265fe3268bf29c3ebb25a0961d719634fb0ed0d704f7f73 not found: ID does not exist" containerID="071a20bfb0bbfeee7265fe3268bf29c3ebb25a0961d719634fb0ed0d704f7f73"
Jul 30 13:31:41.988587 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:31:41.988525    2566 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"071a20bfb0bbfeee7265fe3268bf29c3ebb25a0961d719634fb0ed0d704f7f73"} err="failed to get container status \"071a20bfb0bbfeee7265fe3268bf29c3ebb25a0961d719634fb0ed0d704f7f73\": rpc error: code = NotFound desc = could not find container \"071a20bfb0bbfeee7265fe3268bf29c3ebb25a0961d719634fb0ed0d704f7f73\": container with ID starting with 071a20bfb0bbfeee7265fe3268bf29c3ebb25a0961d719634fb0ed0d704f7f73 not found: ID does not exist"
Jul 30 13:31:41.988587 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:31:41.988551    2566 scope.go:117] "RemoveContainer" containerID="b109fae97765a7d84d34e9f3c96da5a131378942f6a246679ce1851822c72be8"
Jul 30 13:31:41.998215 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:31:41.998195    2566 scope.go:117] "RemoveContainer" containerID="b109fae97765a7d84d34e9f3c96da5a131378942f6a246679ce1851822c72be8"
Jul 30 13:31:41.998486 ip-10-0-143-153 kubenswrapper[2566]: E0730 13:31:41.998468    2566 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b109fae97765a7d84d34e9f3c96da5a131378942f6a246679ce1851822c72be8\": container with ID starting with b109fae97765a7d84d34e9f3c96da5a131378942f6a246679ce1851822c72be8 not found: ID does not exist" containerID="b109fae97765a7d84d34e9f3c96da5a131378942f6a246679ce1851822c72be8"
Jul 30 13:31:41.998553 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:31:41.998496    2566 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b109fae97765a7d84d34e9f3c96da5a131378942f6a246679ce1851822c72be8"} err="failed to get container status \"b109fae97765a7d84d34e9f3c96da5a131378942f6a246679ce1851822c72be8\": rpc error: code = NotFound desc = could not find container \"b109fae97765a7d84d34e9f3c96da5a131378942f6a246679ce1851822c72be8\": container with ID starting with b109fae97765a7d84d34e9f3c96da5a131378942f6a246679ce1851822c72be8 not found: ID does not exist"
Jul 30 13:31:41.998553 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:31:41.998518    2566 scope.go:117] "RemoveContainer" containerID="23d06cdbdcb145bacc78e25ae3a5794687817083c0742bb44b870df9cb6553b5"
Jul 30 13:31:42.009902 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:31:42.009883    2566 scope.go:117] "RemoveContainer" containerID="23d06cdbdcb145bacc78e25ae3a5794687817083c0742bb44b870df9cb6553b5"
Jul 30 13:31:42.010268 ip-10-0-143-153 kubenswrapper[2566]: E0730 13:31:42.010240    2566 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"23d06cdbdcb145bacc78e25ae3a5794687817083c0742bb44b870df9cb6553b5\": container with ID starting with 23d06cdbdcb145bacc78e25ae3a5794687817083c0742bb44b870df9cb6553b5 not found: ID does not exist" containerID="23d06cdbdcb145bacc78e25ae3a5794687817083c0742bb44b870df9cb6553b5"
Jul 30 13:31:42.010398 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:31:42.010279    2566 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"23d06cdbdcb145bacc78e25ae3a5794687817083c0742bb44b870df9cb6553b5"} err="failed to get container status \"23d06cdbdcb145bacc78e25ae3a5794687817083c0742bb44b870df9cb6553b5\": rpc error: code = NotFound desc = could not find container \"23d06cdbdcb145bacc78e25ae3a5794687817083c0742bb44b870df9cb6553b5\": container with ID starting with 23d06cdbdcb145bacc78e25ae3a5794687817083c0742bb44b870df9cb6553b5 not found: ID does not exist"
Jul 30 13:31:42.098580 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:31:42.098551    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-4h8j2\" (UniqueName: \"kubernetes.io/projected/b5ef29a1-915c-4510-b62f-88c055cc169a-kube-api-access-4h8j2\") pod \"b5ef29a1-915c-4510-b62f-88c055cc169a\" (UID: \"b5ef29a1-915c-4510-b62f-88c055cc169a\") "
Jul 30 13:31:42.098759 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:31:42.098633    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/b5ef29a1-915c-4510-b62f-88c055cc169a-maas-api-tls\") pod \"b5ef29a1-915c-4510-b62f-88c055cc169a\" (UID: \"b5ef29a1-915c-4510-b62f-88c055cc169a\") "
Jul 30 13:31:42.098759 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:31:42.098722    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/b5ef29a1-915c-4510-b62f-88c055cc169a-openshift-service-ca\") pod \"b5ef29a1-915c-4510-b62f-88c055cc169a\" (UID: \"b5ef29a1-915c-4510-b62f-88c055cc169a\") "
Jul 30 13:31:42.098848 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:31:42.098768    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-fq4dm\" (UniqueName: \"kubernetes.io/projected/d6ca3f66-181c-4e2a-8960-f283687d88f4-kube-api-access-fq4dm\") pod \"d6ca3f66-181c-4e2a-8960-f283687d88f4\" (UID: \"d6ca3f66-181c-4e2a-8960-f283687d88f4\") "
Jul 30 13:31:42.098848 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:31:42.098820    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/ff101a0c-85e5-4249-93b1-1fbc99b25f73-plugins-config-volume\") pod \"ff101a0c-85e5-4249-93b1-1fbc99b25f73\" (UID: \"ff101a0c-85e5-4249-93b1-1fbc99b25f73\") "
Jul 30 13:31:42.098944 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:31:42.098843    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/d6ca3f66-181c-4e2a-8960-f283687d88f4-plugins-config-volume\") pod \"d6ca3f66-181c-4e2a-8960-f283687d88f4\" (UID: \"d6ca3f66-181c-4e2a-8960-f283687d88f4\") "
Jul 30 13:31:42.098944 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:31:42.098897    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-9pxn4\" (UniqueName: \"kubernetes.io/projected/ff101a0c-85e5-4249-93b1-1fbc99b25f73-kube-api-access-9pxn4\") pod \"ff101a0c-85e5-4249-93b1-1fbc99b25f73\" (UID: \"ff101a0c-85e5-4249-93b1-1fbc99b25f73\") "
Jul 30 13:31:42.099343 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:31:42.099165    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b5ef29a1-915c-4510-b62f-88c055cc169a-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "b5ef29a1-915c-4510-b62f-88c055cc169a" (UID: "b5ef29a1-915c-4510-b62f-88c055cc169a"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 30 13:31:42.099343 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:31:42.099242    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d6ca3f66-181c-4e2a-8960-f283687d88f4-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "d6ca3f66-181c-4e2a-8960-f283687d88f4" (UID: "d6ca3f66-181c-4e2a-8960-f283687d88f4"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 30 13:31:42.099343 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:31:42.099285    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ff101a0c-85e5-4249-93b1-1fbc99b25f73-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "ff101a0c-85e5-4249-93b1-1fbc99b25f73" (UID: "ff101a0c-85e5-4249-93b1-1fbc99b25f73"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 30 13:31:42.100917 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:31:42.100891    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b5ef29a1-915c-4510-b62f-88c055cc169a-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "b5ef29a1-915c-4510-b62f-88c055cc169a" (UID: "b5ef29a1-915c-4510-b62f-88c055cc169a"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 30 13:31:42.101009 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:31:42.100949    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ff101a0c-85e5-4249-93b1-1fbc99b25f73-kube-api-access-9pxn4" (OuterVolumeSpecName: "kube-api-access-9pxn4") pod "ff101a0c-85e5-4249-93b1-1fbc99b25f73" (UID: "ff101a0c-85e5-4249-93b1-1fbc99b25f73"). InnerVolumeSpecName "kube-api-access-9pxn4". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 30 13:31:42.101250 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:31:42.101227    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b5ef29a1-915c-4510-b62f-88c055cc169a-kube-api-access-4h8j2" (OuterVolumeSpecName: "kube-api-access-4h8j2") pod "b5ef29a1-915c-4510-b62f-88c055cc169a" (UID: "b5ef29a1-915c-4510-b62f-88c055cc169a"). InnerVolumeSpecName "kube-api-access-4h8j2". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 30 13:31:42.101318 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:31:42.101231    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d6ca3f66-181c-4e2a-8960-f283687d88f4-kube-api-access-fq4dm" (OuterVolumeSpecName: "kube-api-access-fq4dm") pod "d6ca3f66-181c-4e2a-8960-f283687d88f4" (UID: "d6ca3f66-181c-4e2a-8960-f283687d88f4"). InnerVolumeSpecName "kube-api-access-fq4dm". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 30 13:31:42.200098 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:31:42.200048    2566 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/b5ef29a1-915c-4510-b62f-88c055cc169a-openshift-service-ca\") on node \"ip-10-0-143-153.ec2.internal\" DevicePath \"\""
Jul 30 13:31:42.200098 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:31:42.200089    2566 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-fq4dm\" (UniqueName: \"kubernetes.io/projected/d6ca3f66-181c-4e2a-8960-f283687d88f4-kube-api-access-fq4dm\") on node \"ip-10-0-143-153.ec2.internal\" DevicePath \"\""
Jul 30 13:31:42.200098 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:31:42.200100    2566 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/ff101a0c-85e5-4249-93b1-1fbc99b25f73-plugins-config-volume\") on node \"ip-10-0-143-153.ec2.internal\" DevicePath \"\""
Jul 30 13:31:42.200347 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:31:42.200115    2566 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/d6ca3f66-181c-4e2a-8960-f283687d88f4-plugins-config-volume\") on node \"ip-10-0-143-153.ec2.internal\" DevicePath \"\""
Jul 30 13:31:42.200347 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:31:42.200126    2566 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-9pxn4\" (UniqueName: \"kubernetes.io/projected/ff101a0c-85e5-4249-93b1-1fbc99b25f73-kube-api-access-9pxn4\") on node \"ip-10-0-143-153.ec2.internal\" DevicePath \"\""
Jul 30 13:31:42.200347 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:31:42.200134    2566 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-4h8j2\" (UniqueName: \"kubernetes.io/projected/b5ef29a1-915c-4510-b62f-88c055cc169a-kube-api-access-4h8j2\") on node \"ip-10-0-143-153.ec2.internal\" DevicePath \"\""
Jul 30 13:31:42.200347 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:31:42.200143    2566 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/b5ef29a1-915c-4510-b62f-88c055cc169a-maas-api-tls\") on node \"ip-10-0-143-153.ec2.internal\" DevicePath \"\""
Jul 30 13:31:42.309599 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:31:42.309571    2566 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-a593ec13-57d4d49fd8-mmvh9"]
Jul 30 13:31:42.319819 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:31:42.319791    2566 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-a593ec13-57d4d49fd8-mmvh9"]
Jul 30 13:31:42.334399 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:31:42.334361    2566 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-a593ec13-7598667cbd-r7ffr"]
Jul 30 13:31:42.337591 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:31:42.337566    2566 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-a593ec13-7598667cbd-r7ffr"]
Jul 30 13:31:42.349640 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:31:42.349614    2566 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-a593ec13-7b695b9bcb-9gp65"]
Jul 30 13:31:42.358402 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:31:42.358368    2566 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-a593ec13-7b695b9bcb-9gp65"]
Jul 30 13:31:43.628529 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:31:43.628495    2566 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b5ef29a1-915c-4510-b62f-88c055cc169a" path="/var/lib/kubelet/pods/b5ef29a1-915c-4510-b62f-88c055cc169a/volumes"
Jul 30 13:31:43.628908 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:31:43.628835    2566 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d6ca3f66-181c-4e2a-8960-f283687d88f4" path="/var/lib/kubelet/pods/d6ca3f66-181c-4e2a-8960-f283687d88f4/volumes"
Jul 30 13:31:43.629157 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:31:43.629144    2566 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ff101a0c-85e5-4249-93b1-1fbc99b25f73" path="/var/lib/kubelet/pods/ff101a0c-85e5-4249-93b1-1fbc99b25f73/volumes"
Jul 30 13:31:46.233250 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:31:46.233214    2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-migrate-c5e6a00f-cfc4d94f7-qc8gl"]
Jul 30 13:31:46.233808 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:31:46.233573    2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ff101a0c-85e5-4249-93b1-1fbc99b25f73" containerName="payload-pre-processing"
Jul 30 13:31:46.233808 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:31:46.233585    2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="ff101a0c-85e5-4249-93b1-1fbc99b25f73" containerName="payload-pre-processing"
Jul 30 13:31:46.233808 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:31:46.233596    2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b5ef29a1-915c-4510-b62f-88c055cc169a" containerName="maas-api"
Jul 30 13:31:46.233808 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:31:46.233601    2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="b5ef29a1-915c-4510-b62f-88c055cc169a" containerName="maas-api"
Jul 30 13:31:46.233808 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:31:46.233616    2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d6ca3f66-181c-4e2a-8960-f283687d88f4" containerName="payload-processing"
Jul 30 13:31:46.233808 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:31:46.233621    2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="d6ca3f66-181c-4e2a-8960-f283687d88f4" containerName="payload-processing"
Jul 30 13:31:46.233808 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:31:46.233688    2566 memory_manager.go:368] "RemoveStaleState removing state" podUID="ff101a0c-85e5-4249-93b1-1fbc99b25f73" containerName="payload-pre-processing"
Jul 30 13:31:46.233808 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:31:46.233695    2566 memory_manager.go:368] "RemoveStaleState removing state" podUID="b5ef29a1-915c-4510-b62f-88c055cc169a" containerName="maas-api"
Jul 30 13:31:46.233808 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:31:46.233702    2566 memory_manager.go:368] "RemoveStaleState removing state" podUID="d6ca3f66-181c-4e2a-8960-f283687d88f4" containerName="payload-processing"
Jul 30 13:31:46.238661 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:31:46.238643    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-c5e6a00f-cfc4d94f7-qc8gl"
Jul 30 13:31:46.241239 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:31:46.241219    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-migrate-c5e6a00f-serving-cert\""
Jul 30 13:31:46.249671 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:31:46.249647    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-migrate-c5e6a00f-cfc4d94f7-qc8gl"]
Jul 30 13:31:46.338449 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:31:46.338413    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/9b1cef13-b474-42ff-9d7e-0b7b9c69b7d9-maas-api-tls\") pod \"maas-api-e2e-migrate-c5e6a00f-cfc4d94f7-qc8gl\" (UID: \"9b1cef13-b474-42ff-9d7e-0b7b9c69b7d9\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-c5e6a00f-cfc4d94f7-qc8gl"
Jul 30 13:31:46.338449 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:31:46.338453    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/9b1cef13-b474-42ff-9d7e-0b7b9c69b7d9-openshift-service-ca\") pod \"maas-api-e2e-migrate-c5e6a00f-cfc4d94f7-qc8gl\" (UID: \"9b1cef13-b474-42ff-9d7e-0b7b9c69b7d9\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-c5e6a00f-cfc4d94f7-qc8gl"
Jul 30 13:31:46.338751 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:31:46.338489    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vv55z\" (UniqueName: \"kubernetes.io/projected/9b1cef13-b474-42ff-9d7e-0b7b9c69b7d9-kube-api-access-vv55z\") pod \"maas-api-e2e-migrate-c5e6a00f-cfc4d94f7-qc8gl\" (UID: \"9b1cef13-b474-42ff-9d7e-0b7b9c69b7d9\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-c5e6a00f-cfc4d94f7-qc8gl"
Jul 30 13:31:46.439862 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:31:46.439828    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vv55z\" (UniqueName: \"kubernetes.io/projected/9b1cef13-b474-42ff-9d7e-0b7b9c69b7d9-kube-api-access-vv55z\") pod \"maas-api-e2e-migrate-c5e6a00f-cfc4d94f7-qc8gl\" (UID: \"9b1cef13-b474-42ff-9d7e-0b7b9c69b7d9\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-c5e6a00f-cfc4d94f7-qc8gl"
Jul 30 13:31:46.440050 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:31:46.439917    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/9b1cef13-b474-42ff-9d7e-0b7b9c69b7d9-maas-api-tls\") pod \"maas-api-e2e-migrate-c5e6a00f-cfc4d94f7-qc8gl\" (UID: \"9b1cef13-b474-42ff-9d7e-0b7b9c69b7d9\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-c5e6a00f-cfc4d94f7-qc8gl"
Jul 30 13:31:46.440050 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:31:46.439937    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/9b1cef13-b474-42ff-9d7e-0b7b9c69b7d9-openshift-service-ca\") pod \"maas-api-e2e-migrate-c5e6a00f-cfc4d94f7-qc8gl\" (UID: \"9b1cef13-b474-42ff-9d7e-0b7b9c69b7d9\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-c5e6a00f-cfc4d94f7-qc8gl"
Jul 30 13:31:46.440201 ip-10-0-143-153 kubenswrapper[2566]: E0730 13:31:46.440052    2566 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-migrate-c5e6a00f-serving-cert: secret "maas-api-e2e-migrate-c5e6a00f-serving-cert" not found
Jul 30 13:31:46.440201 ip-10-0-143-153 kubenswrapper[2566]: E0730 13:31:46.440158    2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9b1cef13-b474-42ff-9d7e-0b7b9c69b7d9-maas-api-tls podName:9b1cef13-b474-42ff-9d7e-0b7b9c69b7d9 nodeName:}" failed. No retries permitted until 2026-07-30 13:31:46.940138223 +0000 UTC m=+1935.868826480 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/9b1cef13-b474-42ff-9d7e-0b7b9c69b7d9-maas-api-tls") pod "maas-api-e2e-migrate-c5e6a00f-cfc4d94f7-qc8gl" (UID: "9b1cef13-b474-42ff-9d7e-0b7b9c69b7d9") : secret "maas-api-e2e-migrate-c5e6a00f-serving-cert" not found
Jul 30 13:31:46.440580 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:31:46.440563    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/9b1cef13-b474-42ff-9d7e-0b7b9c69b7d9-openshift-service-ca\") pod \"maas-api-e2e-migrate-c5e6a00f-cfc4d94f7-qc8gl\" (UID: \"9b1cef13-b474-42ff-9d7e-0b7b9c69b7d9\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-c5e6a00f-cfc4d94f7-qc8gl"
Jul 30 13:31:46.454685 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:31:46.454655    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vv55z\" (UniqueName: \"kubernetes.io/projected/9b1cef13-b474-42ff-9d7e-0b7b9c69b7d9-kube-api-access-vv55z\") pod \"maas-api-e2e-migrate-c5e6a00f-cfc4d94f7-qc8gl\" (UID: \"9b1cef13-b474-42ff-9d7e-0b7b9c69b7d9\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-c5e6a00f-cfc4d94f7-qc8gl"
Jul 30 13:31:46.944596 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:31:46.944556    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/9b1cef13-b474-42ff-9d7e-0b7b9c69b7d9-maas-api-tls\") pod \"maas-api-e2e-migrate-c5e6a00f-cfc4d94f7-qc8gl\" (UID: \"9b1cef13-b474-42ff-9d7e-0b7b9c69b7d9\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-c5e6a00f-cfc4d94f7-qc8gl"
Jul 30 13:31:46.946951 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:31:46.946927    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/9b1cef13-b474-42ff-9d7e-0b7b9c69b7d9-maas-api-tls\") pod \"maas-api-e2e-migrate-c5e6a00f-cfc4d94f7-qc8gl\" (UID: \"9b1cef13-b474-42ff-9d7e-0b7b9c69b7d9\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-c5e6a00f-cfc4d94f7-qc8gl"
Jul 30 13:31:47.064253 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:31:47.064223    2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-migrate-c5e6a00f-585d5c5896-q92bh"]
Jul 30 13:31:47.067490 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:31:47.067473    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-migrate-c5e6a00f-585d5c5896-q92bh"
Jul 30 13:31:47.076962 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:31:47.076938    2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-migrate-c5e6a00f\""
Jul 30 13:31:47.077126 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:31:47.077107    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-migrate-c5e6a00f-dockercfg-54tjv\""
Jul 30 13:31:47.091809 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:31:47.091786    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-migrate-c5e6a00f-585d5c5896-q92bh"]
Jul 30 13:31:47.142115 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:31:47.140128    2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-migrate-c5e6a00f-6cfc78dc85-xk4jb"]
Jul 30 13:31:47.145620 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:31:47.145590    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-migrate-c5e6a00f-6cfc78dc85-xk4jb"
Jul 30 13:31:47.145875 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:31:47.145854    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ps9tc\" (UniqueName: \"kubernetes.io/projected/2c7fe4f3-7096-4f2c-ad82-cf9ddc372fa0-kube-api-access-ps9tc\") pod \"payload-pre-processing-e2e-migrate-c5e6a00f-585d5c5896-q92bh\" (UID: \"2c7fe4f3-7096-4f2c-ad82-cf9ddc372fa0\") " pod="openshift-ingress/payload-pre-processing-e2e-migrate-c5e6a00f-585d5c5896-q92bh"
Jul 30 13:31:47.145961 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:31:47.145899    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/2c7fe4f3-7096-4f2c-ad82-cf9ddc372fa0-plugins-config-volume\") pod \"payload-pre-processing-e2e-migrate-c5e6a00f-585d5c5896-q92bh\" (UID: \"2c7fe4f3-7096-4f2c-ad82-cf9ddc372fa0\") " pod="openshift-ingress/payload-pre-processing-e2e-migrate-c5e6a00f-585d5c5896-q92bh"
Jul 30 13:31:47.149631 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:31:47.149610    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-c5e6a00f-cfc4d94f7-qc8gl"
Jul 30 13:31:47.164831 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:31:47.164811    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-migrate-c5e6a00f-6cfc78dc85-xk4jb"]
Jul 30 13:31:47.246819 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:31:47.246743    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8k4qw\" (UniqueName: \"kubernetes.io/projected/ccd99c50-92de-480e-a03a-2ff8a553e932-kube-api-access-8k4qw\") pod \"payload-processing-e2e-migrate-c5e6a00f-6cfc78dc85-xk4jb\" (UID: \"ccd99c50-92de-480e-a03a-2ff8a553e932\") " pod="openshift-ingress/payload-processing-e2e-migrate-c5e6a00f-6cfc78dc85-xk4jb"
Jul 30 13:31:47.247230 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:31:47.246838    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/ccd99c50-92de-480e-a03a-2ff8a553e932-plugins-config-volume\") pod \"payload-processing-e2e-migrate-c5e6a00f-6cfc78dc85-xk4jb\" (UID: \"ccd99c50-92de-480e-a03a-2ff8a553e932\") " pod="openshift-ingress/payload-processing-e2e-migrate-c5e6a00f-6cfc78dc85-xk4jb"
Jul 30 13:31:47.247230 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:31:47.246895    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ps9tc\" (UniqueName: \"kubernetes.io/projected/2c7fe4f3-7096-4f2c-ad82-cf9ddc372fa0-kube-api-access-ps9tc\") pod \"payload-pre-processing-e2e-migrate-c5e6a00f-585d5c5896-q92bh\" (UID: \"2c7fe4f3-7096-4f2c-ad82-cf9ddc372fa0\") " pod="openshift-ingress/payload-pre-processing-e2e-migrate-c5e6a00f-585d5c5896-q92bh"
Jul 30 13:31:47.247230 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:31:47.246987    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/2c7fe4f3-7096-4f2c-ad82-cf9ddc372fa0-plugins-config-volume\") pod \"payload-pre-processing-e2e-migrate-c5e6a00f-585d5c5896-q92bh\" (UID: \"2c7fe4f3-7096-4f2c-ad82-cf9ddc372fa0\") " pod="openshift-ingress/payload-pre-processing-e2e-migrate-c5e6a00f-585d5c5896-q92bh"
Jul 30 13:31:47.247904 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:31:47.247884    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/2c7fe4f3-7096-4f2c-ad82-cf9ddc372fa0-plugins-config-volume\") pod \"payload-pre-processing-e2e-migrate-c5e6a00f-585d5c5896-q92bh\" (UID: \"2c7fe4f3-7096-4f2c-ad82-cf9ddc372fa0\") " pod="openshift-ingress/payload-pre-processing-e2e-migrate-c5e6a00f-585d5c5896-q92bh"
Jul 30 13:31:47.260162 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:31:47.260138    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ps9tc\" (UniqueName: \"kubernetes.io/projected/2c7fe4f3-7096-4f2c-ad82-cf9ddc372fa0-kube-api-access-ps9tc\") pod \"payload-pre-processing-e2e-migrate-c5e6a00f-585d5c5896-q92bh\" (UID: \"2c7fe4f3-7096-4f2c-ad82-cf9ddc372fa0\") " pod="openshift-ingress/payload-pre-processing-e2e-migrate-c5e6a00f-585d5c5896-q92bh"
Jul 30 13:31:47.313958 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:31:47.313928    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-migrate-c5e6a00f-cfc4d94f7-qc8gl"]
Jul 30 13:31:47.317207 ip-10-0-143-153 kubenswrapper[2566]: W0730 13:31:47.317176    2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9b1cef13_b474_42ff_9d7e_0b7b9c69b7d9.slice/crio-21d1b8e3007776446c12b89b4c86253b2db7d5a0b67a7bc239f7058fff82df52 WatchSource:0}: Error finding container 21d1b8e3007776446c12b89b4c86253b2db7d5a0b67a7bc239f7058fff82df52: Status 404 returned error can't find the container with id 21d1b8e3007776446c12b89b4c86253b2db7d5a0b67a7bc239f7058fff82df52
Jul 30 13:31:47.347549 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:31:47.347523    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8k4qw\" (UniqueName: \"kubernetes.io/projected/ccd99c50-92de-480e-a03a-2ff8a553e932-kube-api-access-8k4qw\") pod \"payload-processing-e2e-migrate-c5e6a00f-6cfc78dc85-xk4jb\" (UID: \"ccd99c50-92de-480e-a03a-2ff8a553e932\") " pod="openshift-ingress/payload-processing-e2e-migrate-c5e6a00f-6cfc78dc85-xk4jb"
Jul 30 13:31:47.347666 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:31:47.347568    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/ccd99c50-92de-480e-a03a-2ff8a553e932-plugins-config-volume\") pod \"payload-processing-e2e-migrate-c5e6a00f-6cfc78dc85-xk4jb\" (UID: \"ccd99c50-92de-480e-a03a-2ff8a553e932\") " pod="openshift-ingress/payload-processing-e2e-migrate-c5e6a00f-6cfc78dc85-xk4jb"
Jul 30 13:31:47.348249 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:31:47.348227    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/ccd99c50-92de-480e-a03a-2ff8a553e932-plugins-config-volume\") pod \"payload-processing-e2e-migrate-c5e6a00f-6cfc78dc85-xk4jb\" (UID: \"ccd99c50-92de-480e-a03a-2ff8a553e932\") " pod="openshift-ingress/payload-processing-e2e-migrate-c5e6a00f-6cfc78dc85-xk4jb"
Jul 30 13:31:47.360165 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:31:47.360140    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8k4qw\" (UniqueName: \"kubernetes.io/projected/ccd99c50-92de-480e-a03a-2ff8a553e932-kube-api-access-8k4qw\") pod \"payload-processing-e2e-migrate-c5e6a00f-6cfc78dc85-xk4jb\" (UID: \"ccd99c50-92de-480e-a03a-2ff8a553e932\") " pod="openshift-ingress/payload-processing-e2e-migrate-c5e6a00f-6cfc78dc85-xk4jb"
Jul 30 13:31:47.379262 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:31:47.379030    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-migrate-c5e6a00f-585d5c5896-q92bh"
Jul 30 13:31:47.457160 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:31:47.457127    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-migrate-c5e6a00f-6cfc78dc85-xk4jb"
Jul 30 13:31:47.606519 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:31:47.606487    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-migrate-c5e6a00f-585d5c5896-q92bh"]
Jul 30 13:31:47.610781 ip-10-0-143-153 kubenswrapper[2566]: W0730 13:31:47.610750    2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2c7fe4f3_7096_4f2c_ad82_cf9ddc372fa0.slice/crio-8f1b7eba92551072383b93bb4d9715ae8df6a287da869237fc4d659fc9a08e76 WatchSource:0}: Error finding container 8f1b7eba92551072383b93bb4d9715ae8df6a287da869237fc4d659fc9a08e76: Status 404 returned error can't find the container with id 8f1b7eba92551072383b93bb4d9715ae8df6a287da869237fc4d659fc9a08e76
Jul 30 13:31:47.665865 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:31:47.665843    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-migrate-c5e6a00f-6cfc78dc85-xk4jb"]
Jul 30 13:31:47.668385 ip-10-0-143-153 kubenswrapper[2566]: W0730 13:31:47.668357    2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podccd99c50_92de_480e_a03a_2ff8a553e932.slice/crio-e52c322f7a63a9e1fc34063f5804547e3dd260872bfa802f170fc24492f4e628 WatchSource:0}: Error finding container e52c322f7a63a9e1fc34063f5804547e3dd260872bfa802f170fc24492f4e628: Status 404 returned error can't find the container with id e52c322f7a63a9e1fc34063f5804547e3dd260872bfa802f170fc24492f4e628
Jul 30 13:31:48.022354 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:31:48.022261    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-c5e6a00f-cfc4d94f7-qc8gl" event={"ID":"9b1cef13-b474-42ff-9d7e-0b7b9c69b7d9","Type":"ContainerStarted","Data":"8411a0a84e8a44787c215260459bbd72edad2c9fa5504c47ff7698dcf31671c8"}
Jul 30 13:31:48.022354 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:31:48.022321    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-c5e6a00f-cfc4d94f7-qc8gl" event={"ID":"9b1cef13-b474-42ff-9d7e-0b7b9c69b7d9","Type":"ContainerStarted","Data":"21d1b8e3007776446c12b89b4c86253b2db7d5a0b67a7bc239f7058fff82df52"}
Jul 30 13:31:48.022703 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:31:48.022429    2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-c5e6a00f-cfc4d94f7-qc8gl"
Jul 30 13:31:48.023822 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:31:48.023800    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-migrate-c5e6a00f-6cfc78dc85-xk4jb" event={"ID":"ccd99c50-92de-480e-a03a-2ff8a553e932","Type":"ContainerStarted","Data":"12fb21577a68bc99e49a18ccf50d236f5855021c608280db776eb9d5fead7e3e"}
Jul 30 13:31:48.023959 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:31:48.023839    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-migrate-c5e6a00f-6cfc78dc85-xk4jb" event={"ID":"ccd99c50-92de-480e-a03a-2ff8a553e932","Type":"ContainerStarted","Data":"e52c322f7a63a9e1fc34063f5804547e3dd260872bfa802f170fc24492f4e628"}
Jul 30 13:31:48.023959 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:31:48.023892    2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-migrate-c5e6a00f-6cfc78dc85-xk4jb"
Jul 30 13:31:48.025277 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:31:48.025253    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-migrate-c5e6a00f-585d5c5896-q92bh" event={"ID":"2c7fe4f3-7096-4f2c-ad82-cf9ddc372fa0","Type":"ContainerStarted","Data":"466de9254c82f38596ea03ec5f4e73f0f7312ec80b50fa76d1d07151ac2bdbe4"}
Jul 30 13:31:48.025398 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:31:48.025290    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-migrate-c5e6a00f-585d5c5896-q92bh" event={"ID":"2c7fe4f3-7096-4f2c-ad82-cf9ddc372fa0","Type":"ContainerStarted","Data":"8f1b7eba92551072383b93bb4d9715ae8df6a287da869237fc4d659fc9a08e76"}
Jul 30 13:31:48.025398 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:31:48.025366    2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-migrate-c5e6a00f-585d5c5896-q92bh"
Jul 30 13:31:48.065062 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:31:48.065008    2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-c5e6a00f-cfc4d94f7-qc8gl" podStartSLOduration=1.5298155850000001 podStartE2EDuration="2.064992575s" totalImagesPullingTime="535.17699ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-30 13:31:46 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 13:31:48.060254114 +0000 UTC m=+1936.988942377" watchObservedRunningTime="2026-07-30 13:31:48.064992575 +0000 UTC m=+1936.993680890"
Jul 30 13:31:48.106593 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:31:48.106525    2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-migrate-c5e6a00f-6cfc78dc85-xk4jb" podStartSLOduration=1.106502048 podStartE2EDuration="1.106502048s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-30 13:31:47 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 13:31:48.105008431 +0000 UTC m=+1937.033696692" watchObservedRunningTime="2026-07-30 13:31:48.106502048 +0000 UTC m=+1937.035190312"
Jul 30 13:31:48.153447 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:31:48.153395    2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-migrate-c5e6a00f-585d5c5896-q92bh" podStartSLOduration=1.153376558 podStartE2EDuration="1.153376558s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-30 13:31:47 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 13:31:48.150990819 +0000 UTC m=+1937.079679101" watchObservedRunningTime="2026-07-30 13:31:48.153376558 +0000 UTC m=+1937.082064821"
Jul 30 13:31:54.036120 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:31:54.036088    2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-c5e6a00f-cfc4d94f7-qc8gl"
Jul 30 13:31:59.032765 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:31:59.032692    2566 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/payload-pre-processing-e2e-migrate-c5e6a00f-585d5c5896-q92bh" podUID="2c7fe4f3-7096-4f2c-ad82-cf9ddc372fa0" containerName="payload-pre-processing" probeResult="failure" output="dial tcp 10.133.0.57:9004: connect: connection refused"
Jul 30 13:31:59.033257 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:31:59.032890    2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-migrate-c5e6a00f-6cfc78dc85-xk4jb"
Jul 30 13:32:09.031967 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:32:09.031932    2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-migrate-c5e6a00f-585d5c5896-q92bh"
Jul 30 13:32:16.925714 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:32:16.925653    2566 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-migrate-c5e6a00f-cfc4d94f7-qc8gl"]
Jul 30 13:32:16.926196 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:32:16.925927    2566 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-c5e6a00f-cfc4d94f7-qc8gl" podUID="9b1cef13-b474-42ff-9d7e-0b7b9c69b7d9" containerName="maas-api" containerID="cri-o://8411a0a84e8a44787c215260459bbd72edad2c9fa5504c47ff7698dcf31671c8" gracePeriod=30
Jul 30 13:32:16.984720 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:32:16.983855    2566 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-migrate-c5e6a00f-6cfc78dc85-xk4jb"]
Jul 30 13:32:16.984898 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:32:16.984700    2566 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-migrate-c5e6a00f-6cfc78dc85-xk4jb" podUID="ccd99c50-92de-480e-a03a-2ff8a553e932" containerName="payload-processing" containerID="cri-o://12fb21577a68bc99e49a18ccf50d236f5855021c608280db776eb9d5fead7e3e" gracePeriod=30
Jul 30 13:32:16.994652 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:32:16.993513    2566 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-migrate-c5e6a00f-585d5c5896-q92bh"]
Jul 30 13:32:16.994652 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:32:16.993727    2566 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-migrate-c5e6a00f-585d5c5896-q92bh" podUID="2c7fe4f3-7096-4f2c-ad82-cf9ddc372fa0" containerName="payload-pre-processing" containerID="cri-o://466de9254c82f38596ea03ec5f4e73f0f7312ec80b50fa76d1d07151ac2bdbe4" gracePeriod=30
Jul 30 13:32:17.191670 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:32:17.191568    2566 generic.go:356] "Generic (PLEG): container finished" podID="ccd99c50-92de-480e-a03a-2ff8a553e932" containerID="12fb21577a68bc99e49a18ccf50d236f5855021c608280db776eb9d5fead7e3e" exitCode=0
Jul 30 13:32:17.191895 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:32:17.191639    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-migrate-c5e6a00f-6cfc78dc85-xk4jb" event={"ID":"ccd99c50-92de-480e-a03a-2ff8a553e932","Type":"ContainerDied","Data":"12fb21577a68bc99e49a18ccf50d236f5855021c608280db776eb9d5fead7e3e"}
Jul 30 13:32:17.194384 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:32:17.194357    2566 generic.go:356] "Generic (PLEG): container finished" podID="2c7fe4f3-7096-4f2c-ad82-cf9ddc372fa0" containerID="466de9254c82f38596ea03ec5f4e73f0f7312ec80b50fa76d1d07151ac2bdbe4" exitCode=0
Jul 30 13:32:17.194509 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:32:17.194424    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-migrate-c5e6a00f-585d5c5896-q92bh" event={"ID":"2c7fe4f3-7096-4f2c-ad82-cf9ddc372fa0","Type":"ContainerDied","Data":"466de9254c82f38596ea03ec5f4e73f0f7312ec80b50fa76d1d07151ac2bdbe4"}
Jul 30 13:32:17.196308 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:32:17.196286    2566 generic.go:356] "Generic (PLEG): container finished" podID="9b1cef13-b474-42ff-9d7e-0b7b9c69b7d9" containerID="8411a0a84e8a44787c215260459bbd72edad2c9fa5504c47ff7698dcf31671c8" exitCode=0
Jul 30 13:32:17.196399 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:32:17.196323    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-c5e6a00f-cfc4d94f7-qc8gl" event={"ID":"9b1cef13-b474-42ff-9d7e-0b7b9c69b7d9","Type":"ContainerDied","Data":"8411a0a84e8a44787c215260459bbd72edad2c9fa5504c47ff7698dcf31671c8"}
Jul 30 13:32:17.262311 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:32:17.262283    2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-c5e6a00f-cfc4d94f7-qc8gl"
Jul 30 13:32:17.296577 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:32:17.296547    2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-migrate-c5e6a00f-6cfc78dc85-xk4jb"
Jul 30 13:32:17.303931 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:32:17.303908    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/9b1cef13-b474-42ff-9d7e-0b7b9c69b7d9-maas-api-tls\") pod \"9b1cef13-b474-42ff-9d7e-0b7b9c69b7d9\" (UID: \"9b1cef13-b474-42ff-9d7e-0b7b9c69b7d9\") "
Jul 30 13:32:17.304094 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:32:17.303954    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-vv55z\" (UniqueName: \"kubernetes.io/projected/9b1cef13-b474-42ff-9d7e-0b7b9c69b7d9-kube-api-access-vv55z\") pod \"9b1cef13-b474-42ff-9d7e-0b7b9c69b7d9\" (UID: \"9b1cef13-b474-42ff-9d7e-0b7b9c69b7d9\") "
Jul 30 13:32:17.304094 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:32:17.303978    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/9b1cef13-b474-42ff-9d7e-0b7b9c69b7d9-openshift-service-ca\") pod \"9b1cef13-b474-42ff-9d7e-0b7b9c69b7d9\" (UID: \"9b1cef13-b474-42ff-9d7e-0b7b9c69b7d9\") "
Jul 30 13:32:17.304471 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:32:17.304440    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9b1cef13-b474-42ff-9d7e-0b7b9c69b7d9-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "9b1cef13-b474-42ff-9d7e-0b7b9c69b7d9" (UID: "9b1cef13-b474-42ff-9d7e-0b7b9c69b7d9"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 30 13:32:17.306135 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:32:17.306107    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9b1cef13-b474-42ff-9d7e-0b7b9c69b7d9-kube-api-access-vv55z" (OuterVolumeSpecName: "kube-api-access-vv55z") pod "9b1cef13-b474-42ff-9d7e-0b7b9c69b7d9" (UID: "9b1cef13-b474-42ff-9d7e-0b7b9c69b7d9"). InnerVolumeSpecName "kube-api-access-vv55z". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 30 13:32:17.306484 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:32:17.306456    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9b1cef13-b474-42ff-9d7e-0b7b9c69b7d9-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "9b1cef13-b474-42ff-9d7e-0b7b9c69b7d9" (UID: "9b1cef13-b474-42ff-9d7e-0b7b9c69b7d9"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 30 13:32:17.309645 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:32:17.309625    2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-migrate-c5e6a00f-585d5c5896-q92bh"
Jul 30 13:32:17.404918 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:32:17.404885    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/2c7fe4f3-7096-4f2c-ad82-cf9ddc372fa0-plugins-config-volume\") pod \"2c7fe4f3-7096-4f2c-ad82-cf9ddc372fa0\" (UID: \"2c7fe4f3-7096-4f2c-ad82-cf9ddc372fa0\") "
Jul 30 13:32:17.405128 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:32:17.404932    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-ps9tc\" (UniqueName: \"kubernetes.io/projected/2c7fe4f3-7096-4f2c-ad82-cf9ddc372fa0-kube-api-access-ps9tc\") pod \"2c7fe4f3-7096-4f2c-ad82-cf9ddc372fa0\" (UID: \"2c7fe4f3-7096-4f2c-ad82-cf9ddc372fa0\") "
Jul 30 13:32:17.405128 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:32:17.405024    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/ccd99c50-92de-480e-a03a-2ff8a553e932-plugins-config-volume\") pod \"ccd99c50-92de-480e-a03a-2ff8a553e932\" (UID: \"ccd99c50-92de-480e-a03a-2ff8a553e932\") "
Jul 30 13:32:17.405128 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:32:17.405120    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-8k4qw\" (UniqueName: \"kubernetes.io/projected/ccd99c50-92de-480e-a03a-2ff8a553e932-kube-api-access-8k4qw\") pod \"ccd99c50-92de-480e-a03a-2ff8a553e932\" (UID: \"ccd99c50-92de-480e-a03a-2ff8a553e932\") "
Jul 30 13:32:17.405345 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:32:17.405328    2566 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/9b1cef13-b474-42ff-9d7e-0b7b9c69b7d9-maas-api-tls\") on node \"ip-10-0-143-153.ec2.internal\" DevicePath \"\""
Jul 30 13:32:17.405425 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:32:17.405348    2566 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-vv55z\" (UniqueName: \"kubernetes.io/projected/9b1cef13-b474-42ff-9d7e-0b7b9c69b7d9-kube-api-access-vv55z\") on node \"ip-10-0-143-153.ec2.internal\" DevicePath \"\""
Jul 30 13:32:17.405425 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:32:17.405362    2566 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/9b1cef13-b474-42ff-9d7e-0b7b9c69b7d9-openshift-service-ca\") on node \"ip-10-0-143-153.ec2.internal\" DevicePath \"\""
Jul 30 13:32:17.405698 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:32:17.405632    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ccd99c50-92de-480e-a03a-2ff8a553e932-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "ccd99c50-92de-480e-a03a-2ff8a553e932" (UID: "ccd99c50-92de-480e-a03a-2ff8a553e932"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 30 13:32:17.405698 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:32:17.405648    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2c7fe4f3-7096-4f2c-ad82-cf9ddc372fa0-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "2c7fe4f3-7096-4f2c-ad82-cf9ddc372fa0" (UID: "2c7fe4f3-7096-4f2c-ad82-cf9ddc372fa0"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 30 13:32:17.408518 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:32:17.408489    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ccd99c50-92de-480e-a03a-2ff8a553e932-kube-api-access-8k4qw" (OuterVolumeSpecName: "kube-api-access-8k4qw") pod "ccd99c50-92de-480e-a03a-2ff8a553e932" (UID: "ccd99c50-92de-480e-a03a-2ff8a553e932"). InnerVolumeSpecName "kube-api-access-8k4qw". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 30 13:32:17.408644 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:32:17.408552    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2c7fe4f3-7096-4f2c-ad82-cf9ddc372fa0-kube-api-access-ps9tc" (OuterVolumeSpecName: "kube-api-access-ps9tc") pod "2c7fe4f3-7096-4f2c-ad82-cf9ddc372fa0" (UID: "2c7fe4f3-7096-4f2c-ad82-cf9ddc372fa0"). InnerVolumeSpecName "kube-api-access-ps9tc". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 30 13:32:17.506040 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:32:17.505953    2566 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/ccd99c50-92de-480e-a03a-2ff8a553e932-plugins-config-volume\") on node \"ip-10-0-143-153.ec2.internal\" DevicePath \"\""
Jul 30 13:32:17.506040 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:32:17.505985    2566 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-8k4qw\" (UniqueName: \"kubernetes.io/projected/ccd99c50-92de-480e-a03a-2ff8a553e932-kube-api-access-8k4qw\") on node \"ip-10-0-143-153.ec2.internal\" DevicePath \"\""
Jul 30 13:32:17.506040 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:32:17.505995    2566 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/2c7fe4f3-7096-4f2c-ad82-cf9ddc372fa0-plugins-config-volume\") on node \"ip-10-0-143-153.ec2.internal\" DevicePath \"\""
Jul 30 13:32:17.506040 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:32:17.506004    2566 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-ps9tc\" (UniqueName: \"kubernetes.io/projected/2c7fe4f3-7096-4f2c-ad82-cf9ddc372fa0-kube-api-access-ps9tc\") on node \"ip-10-0-143-153.ec2.internal\" DevicePath \"\""
Jul 30 13:32:18.204180 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:32:18.204100    2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-c5e6a00f-cfc4d94f7-qc8gl"
Jul 30 13:32:18.204180 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:32:18.204136    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-c5e6a00f-cfc4d94f7-qc8gl" event={"ID":"9b1cef13-b474-42ff-9d7e-0b7b9c69b7d9","Type":"ContainerDied","Data":"21d1b8e3007776446c12b89b4c86253b2db7d5a0b67a7bc239f7058fff82df52"}
Jul 30 13:32:18.204713 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:32:18.204197    2566 scope.go:117] "RemoveContainer" containerID="8411a0a84e8a44787c215260459bbd72edad2c9fa5504c47ff7698dcf31671c8"
Jul 30 13:32:18.205758 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:32:18.205730    2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-migrate-c5e6a00f-6cfc78dc85-xk4jb"
Jul 30 13:32:18.205851 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:32:18.205783    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-migrate-c5e6a00f-6cfc78dc85-xk4jb" event={"ID":"ccd99c50-92de-480e-a03a-2ff8a553e932","Type":"ContainerDied","Data":"e52c322f7a63a9e1fc34063f5804547e3dd260872bfa802f170fc24492f4e628"}
Jul 30 13:32:18.208347 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:32:18.208238    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-migrate-c5e6a00f-585d5c5896-q92bh" event={"ID":"2c7fe4f3-7096-4f2c-ad82-cf9ddc372fa0","Type":"ContainerDied","Data":"8f1b7eba92551072383b93bb4d9715ae8df6a287da869237fc4d659fc9a08e76"}
Jul 30 13:32:18.208453 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:32:18.208308    2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-migrate-c5e6a00f-585d5c5896-q92bh"
Jul 30 13:32:18.216770 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:32:18.216746    2566 scope.go:117] "RemoveContainer" containerID="12fb21577a68bc99e49a18ccf50d236f5855021c608280db776eb9d5fead7e3e"
Jul 30 13:32:18.226020 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:32:18.225988    2566 scope.go:117] "RemoveContainer" containerID="466de9254c82f38596ea03ec5f4e73f0f7312ec80b50fa76d1d07151ac2bdbe4"
Jul 30 13:32:18.246404 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:32:18.246378    2566 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-migrate-c5e6a00f-cfc4d94f7-qc8gl"]
Jul 30 13:32:18.264834 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:32:18.264809    2566 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-migrate-c5e6a00f-cfc4d94f7-qc8gl"]
Jul 30 13:32:18.294749 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:32:18.294715    2566 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-migrate-c5e6a00f-6cfc78dc85-xk4jb"]
Jul 30 13:32:18.316320 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:32:18.316294    2566 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-migrate-c5e6a00f-6cfc78dc85-xk4jb"]
Jul 30 13:32:18.348108 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:32:18.348070    2566 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-migrate-c5e6a00f-585d5c5896-q92bh"]
Jul 30 13:32:18.365220 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:32:18.365190    2566 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-migrate-c5e6a00f-585d5c5896-q92bh"]
Jul 30 13:32:19.627131 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:32:19.627101    2566 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="2c7fe4f3-7096-4f2c-ad82-cf9ddc372fa0" path="/var/lib/kubelet/pods/2c7fe4f3-7096-4f2c-ad82-cf9ddc372fa0/volumes"
Jul 30 13:32:19.627504 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:32:19.627496    2566 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="9b1cef13-b474-42ff-9d7e-0b7b9c69b7d9" path="/var/lib/kubelet/pods/9b1cef13-b474-42ff-9d7e-0b7b9c69b7d9/volumes"
Jul 30 13:32:19.627829 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:32:19.627816    2566 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ccd99c50-92de-480e-a03a-2ff8a553e932" path="/var/lib/kubelet/pods/ccd99c50-92de-480e-a03a-2ff8a553e932/volumes"
Jul 30 13:32:22.155306 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:32:22.155268    2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-c625014c-7bc985d84d-bc7mn"]
Jul 30 13:32:22.155879 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:32:22.155860    2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9b1cef13-b474-42ff-9d7e-0b7b9c69b7d9" containerName="maas-api"
Jul 30 13:32:22.155879 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:32:22.155879    2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="9b1cef13-b474-42ff-9d7e-0b7b9c69b7d9" containerName="maas-api"
Jul 30 13:32:22.156050 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:32:22.155894    2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2c7fe4f3-7096-4f2c-ad82-cf9ddc372fa0" containerName="payload-pre-processing"
Jul 30 13:32:22.156050 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:32:22.155903    2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="2c7fe4f3-7096-4f2c-ad82-cf9ddc372fa0" containerName="payload-pre-processing"
Jul 30 13:32:22.156050 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:32:22.155917    2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ccd99c50-92de-480e-a03a-2ff8a553e932" containerName="payload-processing"
Jul 30 13:32:22.156050 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:32:22.155927    2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="ccd99c50-92de-480e-a03a-2ff8a553e932" containerName="payload-processing"
Jul 30 13:32:22.156050 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:32:22.156018    2566 memory_manager.go:368] "RemoveStaleState removing state" podUID="2c7fe4f3-7096-4f2c-ad82-cf9ddc372fa0" containerName="payload-pre-processing"
Jul 30 13:32:22.156050 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:32:22.156030    2566 memory_manager.go:368] "RemoveStaleState removing state" podUID="ccd99c50-92de-480e-a03a-2ff8a553e932" containerName="payload-processing"
Jul 30 13:32:22.156050 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:32:22.156044    2566 memory_manager.go:368] "RemoveStaleState removing state" podUID="9b1cef13-b474-42ff-9d7e-0b7b9c69b7d9" containerName="maas-api"
Jul 30 13:32:22.161115 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:32:22.161096    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-c625014c-7bc985d84d-bc7mn"
Jul 30 13:32:22.163439 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:32:22.163417    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-ait-c625014c-serving-cert\""
Jul 30 13:32:22.173887 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:32:22.173864    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-c625014c-7bc985d84d-bc7mn"]
Jul 30 13:32:22.245256 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:32:22.245224    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2wtb5\" (UniqueName: \"kubernetes.io/projected/53fc328a-526e-42a0-95a0-02ee02459fe1-kube-api-access-2wtb5\") pod \"maas-api-e2e-ait-c625014c-7bc985d84d-bc7mn\" (UID: \"53fc328a-526e-42a0-95a0-02ee02459fe1\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-c625014c-7bc985d84d-bc7mn"
Jul 30 13:32:22.245454 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:32:22.245276    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/53fc328a-526e-42a0-95a0-02ee02459fe1-maas-api-tls\") pod \"maas-api-e2e-ait-c625014c-7bc985d84d-bc7mn\" (UID: \"53fc328a-526e-42a0-95a0-02ee02459fe1\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-c625014c-7bc985d84d-bc7mn"
Jul 30 13:32:22.245454 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:32:22.245297    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/53fc328a-526e-42a0-95a0-02ee02459fe1-openshift-service-ca\") pod \"maas-api-e2e-ait-c625014c-7bc985d84d-bc7mn\" (UID: \"53fc328a-526e-42a0-95a0-02ee02459fe1\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-c625014c-7bc985d84d-bc7mn"
Jul 30 13:32:22.346764 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:32:22.346728    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/53fc328a-526e-42a0-95a0-02ee02459fe1-maas-api-tls\") pod \"maas-api-e2e-ait-c625014c-7bc985d84d-bc7mn\" (UID: \"53fc328a-526e-42a0-95a0-02ee02459fe1\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-c625014c-7bc985d84d-bc7mn"
Jul 30 13:32:22.346764 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:32:22.346774    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/53fc328a-526e-42a0-95a0-02ee02459fe1-openshift-service-ca\") pod \"maas-api-e2e-ait-c625014c-7bc985d84d-bc7mn\" (UID: \"53fc328a-526e-42a0-95a0-02ee02459fe1\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-c625014c-7bc985d84d-bc7mn"
Jul 30 13:32:22.346990 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:32:22.346868    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2wtb5\" (UniqueName: \"kubernetes.io/projected/53fc328a-526e-42a0-95a0-02ee02459fe1-kube-api-access-2wtb5\") pod \"maas-api-e2e-ait-c625014c-7bc985d84d-bc7mn\" (UID: \"53fc328a-526e-42a0-95a0-02ee02459fe1\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-c625014c-7bc985d84d-bc7mn"
Jul 30 13:32:22.346990 ip-10-0-143-153 kubenswrapper[2566]: E0730 13:32:22.346892    2566 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-ait-c625014c-serving-cert: secret "maas-api-e2e-ait-c625014c-serving-cert" not found
Jul 30 13:32:22.346990 ip-10-0-143-153 kubenswrapper[2566]: E0730 13:32:22.346969    2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/53fc328a-526e-42a0-95a0-02ee02459fe1-maas-api-tls podName:53fc328a-526e-42a0-95a0-02ee02459fe1 nodeName:}" failed. No retries permitted until 2026-07-30 13:32:22.846951738 +0000 UTC m=+1971.775639982 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/53fc328a-526e-42a0-95a0-02ee02459fe1-maas-api-tls") pod "maas-api-e2e-ait-c625014c-7bc985d84d-bc7mn" (UID: "53fc328a-526e-42a0-95a0-02ee02459fe1") : secret "maas-api-e2e-ait-c625014c-serving-cert" not found
Jul 30 13:32:22.347502 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:32:22.347484    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/53fc328a-526e-42a0-95a0-02ee02459fe1-openshift-service-ca\") pod \"maas-api-e2e-ait-c625014c-7bc985d84d-bc7mn\" (UID: \"53fc328a-526e-42a0-95a0-02ee02459fe1\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-c625014c-7bc985d84d-bc7mn"
Jul 30 13:32:22.355826 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:32:22.355798    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2wtb5\" (UniqueName: \"kubernetes.io/projected/53fc328a-526e-42a0-95a0-02ee02459fe1-kube-api-access-2wtb5\") pod \"maas-api-e2e-ait-c625014c-7bc985d84d-bc7mn\" (UID: \"53fc328a-526e-42a0-95a0-02ee02459fe1\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-c625014c-7bc985d84d-bc7mn"
Jul 30 13:32:22.853192 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:32:22.853158    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/53fc328a-526e-42a0-95a0-02ee02459fe1-maas-api-tls\") pod \"maas-api-e2e-ait-c625014c-7bc985d84d-bc7mn\" (UID: \"53fc328a-526e-42a0-95a0-02ee02459fe1\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-c625014c-7bc985d84d-bc7mn"
Jul 30 13:32:22.855704 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:32:22.855678    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/53fc328a-526e-42a0-95a0-02ee02459fe1-maas-api-tls\") pod \"maas-api-e2e-ait-c625014c-7bc985d84d-bc7mn\" (UID: \"53fc328a-526e-42a0-95a0-02ee02459fe1\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-c625014c-7bc985d84d-bc7mn"
Jul 30 13:32:22.937368 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:32:22.937324    2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-c625014c-586d58784d-m82lv"]
Jul 30 13:32:22.941143 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:32:22.941122    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ait-c625014c-586d58784d-m82lv"
Jul 30 13:32:22.943540 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:32:22.943520    2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-ait-c625014c\""
Jul 30 13:32:22.943673 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:32:22.943562    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-ait-c625014c-dockercfg-tw6q7\""
Jul 30 13:32:22.949630 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:32:22.949601    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-c625014c-586d58784d-m82lv"]
Jul 30 13:32:23.010004 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:32:23.009971    2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-c625014c-786dbf8b88-djt24"]
Jul 30 13:32:23.013573 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:32:23.013554    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ait-c625014c-786dbf8b88-djt24"
Jul 30 13:32:23.022628 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:32:23.022599    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-c625014c-786dbf8b88-djt24"]
Jul 30 13:32:23.054981 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:32:23.054949    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/4e6dcc03-ae0d-4f23-a567-4d1dd75808ba-plugins-config-volume\") pod \"payload-pre-processing-e2e-ait-c625014c-586d58784d-m82lv\" (UID: \"4e6dcc03-ae0d-4f23-a567-4d1dd75808ba\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-c625014c-586d58784d-m82lv"
Jul 30 13:32:23.055181 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:32:23.054992    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/1114a58a-8b3b-4905-b1b0-a65594da51cd-plugins-config-volume\") pod \"payload-processing-e2e-ait-c625014c-786dbf8b88-djt24\" (UID: \"1114a58a-8b3b-4905-b1b0-a65594da51cd\") " pod="openshift-ingress/payload-processing-e2e-ait-c625014c-786dbf8b88-djt24"
Jul 30 13:32:23.055181 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:32:23.055012    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-826fh\" (UniqueName: \"kubernetes.io/projected/1114a58a-8b3b-4905-b1b0-a65594da51cd-kube-api-access-826fh\") pod \"payload-processing-e2e-ait-c625014c-786dbf8b88-djt24\" (UID: \"1114a58a-8b3b-4905-b1b0-a65594da51cd\") " pod="openshift-ingress/payload-processing-e2e-ait-c625014c-786dbf8b88-djt24"
Jul 30 13:32:23.055181 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:32:23.055114    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ts6f5\" (UniqueName: \"kubernetes.io/projected/4e6dcc03-ae0d-4f23-a567-4d1dd75808ba-kube-api-access-ts6f5\") pod \"payload-pre-processing-e2e-ait-c625014c-586d58784d-m82lv\" (UID: \"4e6dcc03-ae0d-4f23-a567-4d1dd75808ba\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-c625014c-586d58784d-m82lv"
Jul 30 13:32:23.072883 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:32:23.072860    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-c625014c-7bc985d84d-bc7mn"
Jul 30 13:32:23.156530 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:32:23.156501    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/1114a58a-8b3b-4905-b1b0-a65594da51cd-plugins-config-volume\") pod \"payload-processing-e2e-ait-c625014c-786dbf8b88-djt24\" (UID: \"1114a58a-8b3b-4905-b1b0-a65594da51cd\") " pod="openshift-ingress/payload-processing-e2e-ait-c625014c-786dbf8b88-djt24"
Jul 30 13:32:23.156940 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:32:23.156537    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-826fh\" (UniqueName: \"kubernetes.io/projected/1114a58a-8b3b-4905-b1b0-a65594da51cd-kube-api-access-826fh\") pod \"payload-processing-e2e-ait-c625014c-786dbf8b88-djt24\" (UID: \"1114a58a-8b3b-4905-b1b0-a65594da51cd\") " pod="openshift-ingress/payload-processing-e2e-ait-c625014c-786dbf8b88-djt24"
Jul 30 13:32:23.156940 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:32:23.156584    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ts6f5\" (UniqueName: \"kubernetes.io/projected/4e6dcc03-ae0d-4f23-a567-4d1dd75808ba-kube-api-access-ts6f5\") pod \"payload-pre-processing-e2e-ait-c625014c-586d58784d-m82lv\" (UID: \"4e6dcc03-ae0d-4f23-a567-4d1dd75808ba\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-c625014c-586d58784d-m82lv"
Jul 30 13:32:23.156940 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:32:23.156640    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/4e6dcc03-ae0d-4f23-a567-4d1dd75808ba-plugins-config-volume\") pod \"payload-pre-processing-e2e-ait-c625014c-586d58784d-m82lv\" (UID: \"4e6dcc03-ae0d-4f23-a567-4d1dd75808ba\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-c625014c-586d58784d-m82lv"
Jul 30 13:32:23.157327 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:32:23.157307    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/1114a58a-8b3b-4905-b1b0-a65594da51cd-plugins-config-volume\") pod \"payload-processing-e2e-ait-c625014c-786dbf8b88-djt24\" (UID: \"1114a58a-8b3b-4905-b1b0-a65594da51cd\") " pod="openshift-ingress/payload-processing-e2e-ait-c625014c-786dbf8b88-djt24"
Jul 30 13:32:23.157372 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:32:23.157332    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/4e6dcc03-ae0d-4f23-a567-4d1dd75808ba-plugins-config-volume\") pod \"payload-pre-processing-e2e-ait-c625014c-586d58784d-m82lv\" (UID: \"4e6dcc03-ae0d-4f23-a567-4d1dd75808ba\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-c625014c-586d58784d-m82lv"
Jul 30 13:32:23.165105 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:32:23.165057    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-826fh\" (UniqueName: \"kubernetes.io/projected/1114a58a-8b3b-4905-b1b0-a65594da51cd-kube-api-access-826fh\") pod \"payload-processing-e2e-ait-c625014c-786dbf8b88-djt24\" (UID: \"1114a58a-8b3b-4905-b1b0-a65594da51cd\") " pod="openshift-ingress/payload-processing-e2e-ait-c625014c-786dbf8b88-djt24"
Jul 30 13:32:23.165756 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:32:23.165734    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ts6f5\" (UniqueName: \"kubernetes.io/projected/4e6dcc03-ae0d-4f23-a567-4d1dd75808ba-kube-api-access-ts6f5\") pod \"payload-pre-processing-e2e-ait-c625014c-586d58784d-m82lv\" (UID: \"4e6dcc03-ae0d-4f23-a567-4d1dd75808ba\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-c625014c-586d58784d-m82lv"
Jul 30 13:32:23.218913 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:32:23.218883    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-c625014c-7bc985d84d-bc7mn"]
Jul 30 13:32:23.221527 ip-10-0-143-153 kubenswrapper[2566]: W0730 13:32:23.221499    2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod53fc328a_526e_42a0_95a0_02ee02459fe1.slice/crio-dffa8ee72ec8fdf6325a82b923a43404b033953265f974cbd277e86030abdf74 WatchSource:0}: Error finding container dffa8ee72ec8fdf6325a82b923a43404b033953265f974cbd277e86030abdf74: Status 404 returned error can't find the container with id dffa8ee72ec8fdf6325a82b923a43404b033953265f974cbd277e86030abdf74
Jul 30 13:32:23.239976 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:32:23.239941    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-c625014c-7bc985d84d-bc7mn" event={"ID":"53fc328a-526e-42a0-95a0-02ee02459fe1","Type":"ContainerStarted","Data":"dffa8ee72ec8fdf6325a82b923a43404b033953265f974cbd277e86030abdf74"}
Jul 30 13:32:23.253283 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:32:23.253246    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ait-c625014c-586d58784d-m82lv"
Jul 30 13:32:23.325525 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:32:23.325495    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ait-c625014c-786dbf8b88-djt24"
Jul 30 13:32:23.399464 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:32:23.399436    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-c625014c-586d58784d-m82lv"]
Jul 30 13:32:23.402750 ip-10-0-143-153 kubenswrapper[2566]: W0730 13:32:23.402715    2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4e6dcc03_ae0d_4f23_a567_4d1dd75808ba.slice/crio-1cba3418bdac19379f28a41e8a96e1b266fa98339f78317ce678c8d5461a38cf WatchSource:0}: Error finding container 1cba3418bdac19379f28a41e8a96e1b266fa98339f78317ce678c8d5461a38cf: Status 404 returned error can't find the container with id 1cba3418bdac19379f28a41e8a96e1b266fa98339f78317ce678c8d5461a38cf
Jul 30 13:32:23.484458 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:32:23.484415    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-c625014c-786dbf8b88-djt24"]
Jul 30 13:32:23.488028 ip-10-0-143-153 kubenswrapper[2566]: W0730 13:32:23.487993    2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1114a58a_8b3b_4905_b1b0_a65594da51cd.slice/crio-074103f9078e62a91f64f23ab6dfdd86422b6c5422d659fa54dbcc3837b2e0ed WatchSource:0}: Error finding container 074103f9078e62a91f64f23ab6dfdd86422b6c5422d659fa54dbcc3837b2e0ed: Status 404 returned error can't find the container with id 074103f9078e62a91f64f23ab6dfdd86422b6c5422d659fa54dbcc3837b2e0ed
Jul 30 13:32:24.246245 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:32:24.246207    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-c625014c-7bc985d84d-bc7mn" event={"ID":"53fc328a-526e-42a0-95a0-02ee02459fe1","Type":"ContainerStarted","Data":"727bbf93bdd4edc6701d66b36a82b12df0491b61f4cdfc0e22baaa8db00cdb0b"}
Jul 30 13:32:24.246713 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:32:24.246273    2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-ait-c625014c-7bc985d84d-bc7mn"
Jul 30 13:32:24.247800 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:32:24.247776    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ait-c625014c-586d58784d-m82lv" event={"ID":"4e6dcc03-ae0d-4f23-a567-4d1dd75808ba","Type":"ContainerStarted","Data":"42eb46b0e0bd85c6113af9af14d539a494cea98228f6a592f56f9121eaee3f77"}
Jul 30 13:32:24.247918 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:32:24.247819    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ait-c625014c-586d58784d-m82lv" event={"ID":"4e6dcc03-ae0d-4f23-a567-4d1dd75808ba","Type":"ContainerStarted","Data":"1cba3418bdac19379f28a41e8a96e1b266fa98339f78317ce678c8d5461a38cf"}
Jul 30 13:32:24.247918 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:32:24.247869    2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-ait-c625014c-586d58784d-m82lv"
Jul 30 13:32:24.249344 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:32:24.249317    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ait-c625014c-786dbf8b88-djt24" event={"ID":"1114a58a-8b3b-4905-b1b0-a65594da51cd","Type":"ContainerStarted","Data":"049e9538f9049cdfaf20fe2afcc8fd677658ab1478114172bf9c5024b45e5b12"}
Jul 30 13:32:24.249424 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:32:24.249363    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ait-c625014c-786dbf8b88-djt24" event={"ID":"1114a58a-8b3b-4905-b1b0-a65594da51cd","Type":"ContainerStarted","Data":"074103f9078e62a91f64f23ab6dfdd86422b6c5422d659fa54dbcc3837b2e0ed"}
Jul 30 13:32:24.249498 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:32:24.249430    2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-ait-c625014c-786dbf8b88-djt24"
Jul 30 13:32:24.265508 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:32:24.265464    2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-ait-c625014c-7bc985d84d-bc7mn" podStartSLOduration=1.725612146 podStartE2EDuration="2.265449092s" totalImagesPullingTime="539.836946ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-30 13:32:22 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 13:32:24.264592156 +0000 UTC m=+1973.193280418" watchObservedRunningTime="2026-07-30 13:32:24.265449092 +0000 UTC m=+1973.194137356"
Jul 30 13:32:24.284156 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:32:24.284109    2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-ait-c625014c-586d58784d-m82lv" podStartSLOduration=2.2840648310000002 podStartE2EDuration="2.284064831s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-30 13:32:22 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 13:32:24.2818766 +0000 UTC m=+1973.210564862" watchObservedRunningTime="2026-07-30 13:32:24.284064831 +0000 UTC m=+1973.212753114"
Jul 30 13:32:24.300732 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:32:24.300690    2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-ait-c625014c-786dbf8b88-djt24" podStartSLOduration=2.300675723 podStartE2EDuration="2.300675723s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-30 13:32:22 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 13:32:24.298229027 +0000 UTC m=+1973.226917309" watchObservedRunningTime="2026-07-30 13:32:24.300675723 +0000 UTC m=+1973.229363986"
Jul 30 13:32:30.261001 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:32:30.260974    2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-ait-c625014c-7bc985d84d-bc7mn"
Jul 30 13:32:35.257435 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:32:35.257401    2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-ait-c625014c-586d58784d-m82lv"
Jul 30 13:32:35.257894 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:32:35.257477    2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-ait-c625014c-786dbf8b88-djt24"
Jul 30 13:32:52.734558 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:32:52.734522    2566 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-c625014c-7bc985d84d-bc7mn"]
Jul 30 13:32:52.735050 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:32:52.734750    2566 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-ait-c625014c-7bc985d84d-bc7mn" podUID="53fc328a-526e-42a0-95a0-02ee02459fe1" containerName="maas-api" containerID="cri-o://727bbf93bdd4edc6701d66b36a82b12df0491b61f4cdfc0e22baaa8db00cdb0b" gracePeriod=30
Jul 30 13:32:52.801435 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:32:52.801399    2566 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-c625014c-786dbf8b88-djt24"]
Jul 30 13:32:52.801677 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:32:52.801637    2566 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-ait-c625014c-786dbf8b88-djt24" podUID="1114a58a-8b3b-4905-b1b0-a65594da51cd" containerName="payload-processing" containerID="cri-o://049e9538f9049cdfaf20fe2afcc8fd677658ab1478114172bf9c5024b45e5b12" gracePeriod=30
Jul 30 13:32:52.814060 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:32:52.814021    2566 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-c625014c-586d58784d-m82lv"]
Jul 30 13:32:52.814325 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:32:52.814291    2566 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-ait-c625014c-586d58784d-m82lv" podUID="4e6dcc03-ae0d-4f23-a567-4d1dd75808ba" containerName="payload-pre-processing" containerID="cri-o://42eb46b0e0bd85c6113af9af14d539a494cea98228f6a592f56f9121eaee3f77" gracePeriod=30
Jul 30 13:32:53.088131 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:32:53.088103    2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ait-c625014c-786dbf8b88-djt24"
Jul 30 13:32:53.101315 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:32:53.101293    2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-c625014c-7bc985d84d-bc7mn"
Jul 30 13:32:53.119847 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:32:53.119825    2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ait-c625014c-586d58784d-m82lv"
Jul 30 13:32:53.218397 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:32:53.218362    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/53fc328a-526e-42a0-95a0-02ee02459fe1-maas-api-tls\") pod \"53fc328a-526e-42a0-95a0-02ee02459fe1\" (UID: \"53fc328a-526e-42a0-95a0-02ee02459fe1\") "
Jul 30 13:32:53.218587 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:32:53.218418    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/1114a58a-8b3b-4905-b1b0-a65594da51cd-plugins-config-volume\") pod \"1114a58a-8b3b-4905-b1b0-a65594da51cd\" (UID: \"1114a58a-8b3b-4905-b1b0-a65594da51cd\") "
Jul 30 13:32:53.218587 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:32:53.218451    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/4e6dcc03-ae0d-4f23-a567-4d1dd75808ba-plugins-config-volume\") pod \"4e6dcc03-ae0d-4f23-a567-4d1dd75808ba\" (UID: \"4e6dcc03-ae0d-4f23-a567-4d1dd75808ba\") "
Jul 30 13:32:53.218587 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:32:53.218488    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-2wtb5\" (UniqueName: \"kubernetes.io/projected/53fc328a-526e-42a0-95a0-02ee02459fe1-kube-api-access-2wtb5\") pod \"53fc328a-526e-42a0-95a0-02ee02459fe1\" (UID: \"53fc328a-526e-42a0-95a0-02ee02459fe1\") "
Jul 30 13:32:53.218587 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:32:53.218525    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/53fc328a-526e-42a0-95a0-02ee02459fe1-openshift-service-ca\") pod \"53fc328a-526e-42a0-95a0-02ee02459fe1\" (UID: \"53fc328a-526e-42a0-95a0-02ee02459fe1\") "
Jul 30 13:32:53.218587 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:32:53.218548    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-826fh\" (UniqueName: \"kubernetes.io/projected/1114a58a-8b3b-4905-b1b0-a65594da51cd-kube-api-access-826fh\") pod \"1114a58a-8b3b-4905-b1b0-a65594da51cd\" (UID: \"1114a58a-8b3b-4905-b1b0-a65594da51cd\") "
Jul 30 13:32:53.218587 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:32:53.218574    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-ts6f5\" (UniqueName: \"kubernetes.io/projected/4e6dcc03-ae0d-4f23-a567-4d1dd75808ba-kube-api-access-ts6f5\") pod \"4e6dcc03-ae0d-4f23-a567-4d1dd75808ba\" (UID: \"4e6dcc03-ae0d-4f23-a567-4d1dd75808ba\") "
Jul 30 13:32:53.218978 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:32:53.218902    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1114a58a-8b3b-4905-b1b0-a65594da51cd-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "1114a58a-8b3b-4905-b1b0-a65594da51cd" (UID: "1114a58a-8b3b-4905-b1b0-a65594da51cd"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 30 13:32:53.219280 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:32:53.219249    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/53fc328a-526e-42a0-95a0-02ee02459fe1-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "53fc328a-526e-42a0-95a0-02ee02459fe1" (UID: "53fc328a-526e-42a0-95a0-02ee02459fe1"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 30 13:32:53.219384 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:32:53.219260    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4e6dcc03-ae0d-4f23-a567-4d1dd75808ba-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "4e6dcc03-ae0d-4f23-a567-4d1dd75808ba" (UID: "4e6dcc03-ae0d-4f23-a567-4d1dd75808ba"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 30 13:32:53.220757 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:32:53.220733    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/53fc328a-526e-42a0-95a0-02ee02459fe1-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "53fc328a-526e-42a0-95a0-02ee02459fe1" (UID: "53fc328a-526e-42a0-95a0-02ee02459fe1"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 30 13:32:53.220933 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:32:53.220907    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4e6dcc03-ae0d-4f23-a567-4d1dd75808ba-kube-api-access-ts6f5" (OuterVolumeSpecName: "kube-api-access-ts6f5") pod "4e6dcc03-ae0d-4f23-a567-4d1dd75808ba" (UID: "4e6dcc03-ae0d-4f23-a567-4d1dd75808ba"). InnerVolumeSpecName "kube-api-access-ts6f5". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 30 13:32:53.220933 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:32:53.220901    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1114a58a-8b3b-4905-b1b0-a65594da51cd-kube-api-access-826fh" (OuterVolumeSpecName: "kube-api-access-826fh") pod "1114a58a-8b3b-4905-b1b0-a65594da51cd" (UID: "1114a58a-8b3b-4905-b1b0-a65594da51cd"). InnerVolumeSpecName "kube-api-access-826fh". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 30 13:32:53.221093 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:32:53.220978    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/53fc328a-526e-42a0-95a0-02ee02459fe1-kube-api-access-2wtb5" (OuterVolumeSpecName: "kube-api-access-2wtb5") pod "53fc328a-526e-42a0-95a0-02ee02459fe1" (UID: "53fc328a-526e-42a0-95a0-02ee02459fe1"). InnerVolumeSpecName "kube-api-access-2wtb5". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 30 13:32:53.319998 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:32:53.319900    2566 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-2wtb5\" (UniqueName: \"kubernetes.io/projected/53fc328a-526e-42a0-95a0-02ee02459fe1-kube-api-access-2wtb5\") on node \"ip-10-0-143-153.ec2.internal\" DevicePath \"\""
Jul 30 13:32:53.319998 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:32:53.319937    2566 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/53fc328a-526e-42a0-95a0-02ee02459fe1-openshift-service-ca\") on node \"ip-10-0-143-153.ec2.internal\" DevicePath \"\""
Jul 30 13:32:53.319998 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:32:53.319949    2566 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-826fh\" (UniqueName: \"kubernetes.io/projected/1114a58a-8b3b-4905-b1b0-a65594da51cd-kube-api-access-826fh\") on node \"ip-10-0-143-153.ec2.internal\" DevicePath \"\""
Jul 30 13:32:53.319998 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:32:53.319958    2566 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-ts6f5\" (UniqueName: \"kubernetes.io/projected/4e6dcc03-ae0d-4f23-a567-4d1dd75808ba-kube-api-access-ts6f5\") on node \"ip-10-0-143-153.ec2.internal\" DevicePath \"\""
Jul 30 13:32:53.319998 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:32:53.319968    2566 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/53fc328a-526e-42a0-95a0-02ee02459fe1-maas-api-tls\") on node \"ip-10-0-143-153.ec2.internal\" DevicePath \"\""
Jul 30 13:32:53.319998 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:32:53.319976    2566 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/1114a58a-8b3b-4905-b1b0-a65594da51cd-plugins-config-volume\") on node \"ip-10-0-143-153.ec2.internal\" DevicePath \"\""
Jul 30 13:32:53.319998 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:32:53.319986    2566 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/4e6dcc03-ae0d-4f23-a567-4d1dd75808ba-plugins-config-volume\") on node \"ip-10-0-143-153.ec2.internal\" DevicePath \"\""
Jul 30 13:32:53.405313 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:32:53.405276    2566 generic.go:356] "Generic (PLEG): container finished" podID="1114a58a-8b3b-4905-b1b0-a65594da51cd" containerID="049e9538f9049cdfaf20fe2afcc8fd677658ab1478114172bf9c5024b45e5b12" exitCode=0
Jul 30 13:32:53.405482 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:32:53.405318    2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ait-c625014c-786dbf8b88-djt24"
Jul 30 13:32:53.405482 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:32:53.405362    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ait-c625014c-786dbf8b88-djt24" event={"ID":"1114a58a-8b3b-4905-b1b0-a65594da51cd","Type":"ContainerDied","Data":"049e9538f9049cdfaf20fe2afcc8fd677658ab1478114172bf9c5024b45e5b12"}
Jul 30 13:32:53.405482 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:32:53.405424    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ait-c625014c-786dbf8b88-djt24" event={"ID":"1114a58a-8b3b-4905-b1b0-a65594da51cd","Type":"ContainerDied","Data":"074103f9078e62a91f64f23ab6dfdd86422b6c5422d659fa54dbcc3837b2e0ed"}
Jul 30 13:32:53.405482 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:32:53.405458    2566 scope.go:117] "RemoveContainer" containerID="049e9538f9049cdfaf20fe2afcc8fd677658ab1478114172bf9c5024b45e5b12"
Jul 30 13:32:53.406704 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:32:53.406683    2566 generic.go:356] "Generic (PLEG): container finished" podID="53fc328a-526e-42a0-95a0-02ee02459fe1" containerID="727bbf93bdd4edc6701d66b36a82b12df0491b61f4cdfc0e22baaa8db00cdb0b" exitCode=0
Jul 30 13:32:53.406776 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:32:53.406711    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-c625014c-7bc985d84d-bc7mn" event={"ID":"53fc328a-526e-42a0-95a0-02ee02459fe1","Type":"ContainerDied","Data":"727bbf93bdd4edc6701d66b36a82b12df0491b61f4cdfc0e22baaa8db00cdb0b"}
Jul 30 13:32:53.406776 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:32:53.406764    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-c625014c-7bc985d84d-bc7mn" event={"ID":"53fc328a-526e-42a0-95a0-02ee02459fe1","Type":"ContainerDied","Data":"dffa8ee72ec8fdf6325a82b923a43404b033953265f974cbd277e86030abdf74"}
Jul 30 13:32:53.406875 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:32:53.406724    2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-c625014c-7bc985d84d-bc7mn"
Jul 30 13:32:53.408034 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:32:53.408011    2566 generic.go:356] "Generic (PLEG): container finished" podID="4e6dcc03-ae0d-4f23-a567-4d1dd75808ba" containerID="42eb46b0e0bd85c6113af9af14d539a494cea98228f6a592f56f9121eaee3f77" exitCode=0
Jul 30 13:32:53.408175 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:32:53.408061    2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ait-c625014c-586d58784d-m82lv"
Jul 30 13:32:53.408175 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:32:53.408111    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ait-c625014c-586d58784d-m82lv" event={"ID":"4e6dcc03-ae0d-4f23-a567-4d1dd75808ba","Type":"ContainerDied","Data":"42eb46b0e0bd85c6113af9af14d539a494cea98228f6a592f56f9121eaee3f77"}
Jul 30 13:32:53.408175 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:32:53.408164    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ait-c625014c-586d58784d-m82lv" event={"ID":"4e6dcc03-ae0d-4f23-a567-4d1dd75808ba","Type":"ContainerDied","Data":"1cba3418bdac19379f28a41e8a96e1b266fa98339f78317ce678c8d5461a38cf"}
Jul 30 13:32:53.415138 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:32:53.415118    2566 scope.go:117] "RemoveContainer" containerID="049e9538f9049cdfaf20fe2afcc8fd677658ab1478114172bf9c5024b45e5b12"
Jul 30 13:32:53.415447 ip-10-0-143-153 kubenswrapper[2566]: E0730 13:32:53.415422    2566 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"049e9538f9049cdfaf20fe2afcc8fd677658ab1478114172bf9c5024b45e5b12\": container with ID starting with 049e9538f9049cdfaf20fe2afcc8fd677658ab1478114172bf9c5024b45e5b12 not found: ID does not exist" containerID="049e9538f9049cdfaf20fe2afcc8fd677658ab1478114172bf9c5024b45e5b12"
Jul 30 13:32:53.415534 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:32:53.415458    2566 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"049e9538f9049cdfaf20fe2afcc8fd677658ab1478114172bf9c5024b45e5b12"} err="failed to get container status \"049e9538f9049cdfaf20fe2afcc8fd677658ab1478114172bf9c5024b45e5b12\": rpc error: code = NotFound desc = could not find container \"049e9538f9049cdfaf20fe2afcc8fd677658ab1478114172bf9c5024b45e5b12\": container with ID starting with 049e9538f9049cdfaf20fe2afcc8fd677658ab1478114172bf9c5024b45e5b12 not found: ID does not exist"
Jul 30 13:32:53.415534 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:32:53.415486    2566 scope.go:117] "RemoveContainer" containerID="727bbf93bdd4edc6701d66b36a82b12df0491b61f4cdfc0e22baaa8db00cdb0b"
Jul 30 13:32:53.424590 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:32:53.424570    2566 scope.go:117] "RemoveContainer" containerID="727bbf93bdd4edc6701d66b36a82b12df0491b61f4cdfc0e22baaa8db00cdb0b"
Jul 30 13:32:53.424847 ip-10-0-143-153 kubenswrapper[2566]: E0730 13:32:53.424829    2566 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"727bbf93bdd4edc6701d66b36a82b12df0491b61f4cdfc0e22baaa8db00cdb0b\": container with ID starting with 727bbf93bdd4edc6701d66b36a82b12df0491b61f4cdfc0e22baaa8db00cdb0b not found: ID does not exist" containerID="727bbf93bdd4edc6701d66b36a82b12df0491b61f4cdfc0e22baaa8db00cdb0b"
Jul 30 13:32:53.424891 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:32:53.424857    2566 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"727bbf93bdd4edc6701d66b36a82b12df0491b61f4cdfc0e22baaa8db00cdb0b"} err="failed to get container status \"727bbf93bdd4edc6701d66b36a82b12df0491b61f4cdfc0e22baaa8db00cdb0b\": rpc error: code = NotFound desc = could not find container \"727bbf93bdd4edc6701d66b36a82b12df0491b61f4cdfc0e22baaa8db00cdb0b\": container with ID starting with 727bbf93bdd4edc6701d66b36a82b12df0491b61f4cdfc0e22baaa8db00cdb0b not found: ID does not exist"
Jul 30 13:32:53.424891 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:32:53.424874    2566 scope.go:117] "RemoveContainer" containerID="42eb46b0e0bd85c6113af9af14d539a494cea98228f6a592f56f9121eaee3f77"
Jul 30 13:32:53.433205 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:32:53.433147    2566 scope.go:117] "RemoveContainer" containerID="42eb46b0e0bd85c6113af9af14d539a494cea98228f6a592f56f9121eaee3f77"
Jul 30 13:32:53.433484 ip-10-0-143-153 kubenswrapper[2566]: E0730 13:32:53.433463    2566 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"42eb46b0e0bd85c6113af9af14d539a494cea98228f6a592f56f9121eaee3f77\": container with ID starting with 42eb46b0e0bd85c6113af9af14d539a494cea98228f6a592f56f9121eaee3f77 not found: ID does not exist" containerID="42eb46b0e0bd85c6113af9af14d539a494cea98228f6a592f56f9121eaee3f77"
Jul 30 13:32:53.433548 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:32:53.433495    2566 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"42eb46b0e0bd85c6113af9af14d539a494cea98228f6a592f56f9121eaee3f77"} err="failed to get container status \"42eb46b0e0bd85c6113af9af14d539a494cea98228f6a592f56f9121eaee3f77\": rpc error: code = NotFound desc = could not find container \"42eb46b0e0bd85c6113af9af14d539a494cea98228f6a592f56f9121eaee3f77\": container with ID starting with 42eb46b0e0bd85c6113af9af14d539a494cea98228f6a592f56f9121eaee3f77 not found: ID does not exist"
Jul 30 13:32:53.434549 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:32:53.434530    2566 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-c625014c-786dbf8b88-djt24"]
Jul 30 13:32:53.440708 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:32:53.440688    2566 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-c625014c-786dbf8b88-djt24"]
Jul 30 13:32:53.453461 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:32:53.453436    2566 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-c625014c-586d58784d-m82lv"]
Jul 30 13:32:53.456100 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:32:53.456062    2566 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-c625014c-586d58784d-m82lv"]
Jul 30 13:32:53.472896 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:32:53.472874    2566 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-c625014c-7bc985d84d-bc7mn"]
Jul 30 13:32:53.478406 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:32:53.478360    2566 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-c625014c-7bc985d84d-bc7mn"]
Jul 30 13:32:53.627516 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:32:53.627437    2566 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="1114a58a-8b3b-4905-b1b0-a65594da51cd" path="/var/lib/kubelet/pods/1114a58a-8b3b-4905-b1b0-a65594da51cd/volumes"
Jul 30 13:32:53.627801 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:32:53.627787    2566 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="4e6dcc03-ae0d-4f23-a567-4d1dd75808ba" path="/var/lib/kubelet/pods/4e6dcc03-ae0d-4f23-a567-4d1dd75808ba/volumes"
Jul 30 13:32:53.628184 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:32:53.628171    2566 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="53fc328a-526e-42a0-95a0-02ee02459fe1" path="/var/lib/kubelet/pods/53fc328a-526e-42a0-95a0-02ee02459fe1/volumes"
Jul 30 13:32:58.533497 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:32:58.533460    2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-f10a044c-6867bdb8d8-q8vkk"]
Jul 30 13:32:58.533947 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:32:58.533847    2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4e6dcc03-ae0d-4f23-a567-4d1dd75808ba" containerName="payload-pre-processing"
Jul 30 13:32:58.533947 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:32:58.533859    2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="4e6dcc03-ae0d-4f23-a567-4d1dd75808ba" containerName="payload-pre-processing"
Jul 30 13:32:58.533947 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:32:58.533889    2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1114a58a-8b3b-4905-b1b0-a65594da51cd" containerName="payload-processing"
Jul 30 13:32:58.533947 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:32:58.533895    2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="1114a58a-8b3b-4905-b1b0-a65594da51cd" containerName="payload-processing"
Jul 30 13:32:58.533947 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:32:58.533901    2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="53fc328a-526e-42a0-95a0-02ee02459fe1" containerName="maas-api"
Jul 30 13:32:58.533947 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:32:58.533907    2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="53fc328a-526e-42a0-95a0-02ee02459fe1" containerName="maas-api"
Jul 30 13:32:58.534309 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:32:58.533966    2566 memory_manager.go:368] "RemoveStaleState removing state" podUID="53fc328a-526e-42a0-95a0-02ee02459fe1" containerName="maas-api"
Jul 30 13:32:58.534309 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:32:58.533978    2566 memory_manager.go:368] "RemoveStaleState removing state" podUID="4e6dcc03-ae0d-4f23-a567-4d1dd75808ba" containerName="payload-pre-processing"
Jul 30 13:32:58.534309 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:32:58.533986    2566 memory_manager.go:368] "RemoveStaleState removing state" podUID="1114a58a-8b3b-4905-b1b0-a65594da51cd" containerName="payload-processing"
Jul 30 13:32:58.538614 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:32:58.538593    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-derive-f10a044c-6867bdb8d8-q8vkk"
Jul 30 13:32:58.540600 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:32:58.540578    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-derive-f10a044c-serving-cert\""
Jul 30 13:32:58.546254 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:32:58.546230    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-f10a044c-6867bdb8d8-q8vkk"]
Jul 30 13:32:58.667851 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:32:58.667808    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jl8qx\" (UniqueName: \"kubernetes.io/projected/18492d3b-3c91-4d94-b219-ba24a9a6ad2f-kube-api-access-jl8qx\") pod \"maas-api-e2e-derive-f10a044c-6867bdb8d8-q8vkk\" (UID: \"18492d3b-3c91-4d94-b219-ba24a9a6ad2f\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-f10a044c-6867bdb8d8-q8vkk"
Jul 30 13:32:58.668111 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:32:58.667873    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/18492d3b-3c91-4d94-b219-ba24a9a6ad2f-openshift-service-ca\") pod \"maas-api-e2e-derive-f10a044c-6867bdb8d8-q8vkk\" (UID: \"18492d3b-3c91-4d94-b219-ba24a9a6ad2f\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-f10a044c-6867bdb8d8-q8vkk"
Jul 30 13:32:58.668111 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:32:58.667929    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/18492d3b-3c91-4d94-b219-ba24a9a6ad2f-maas-api-tls\") pod \"maas-api-e2e-derive-f10a044c-6867bdb8d8-q8vkk\" (UID: \"18492d3b-3c91-4d94-b219-ba24a9a6ad2f\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-f10a044c-6867bdb8d8-q8vkk"
Jul 30 13:32:58.768890 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:32:58.768850    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/18492d3b-3c91-4d94-b219-ba24a9a6ad2f-maas-api-tls\") pod \"maas-api-e2e-derive-f10a044c-6867bdb8d8-q8vkk\" (UID: \"18492d3b-3c91-4d94-b219-ba24a9a6ad2f\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-f10a044c-6867bdb8d8-q8vkk"
Jul 30 13:32:58.769151 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:32:58.768929    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jl8qx\" (UniqueName: \"kubernetes.io/projected/18492d3b-3c91-4d94-b219-ba24a9a6ad2f-kube-api-access-jl8qx\") pod \"maas-api-e2e-derive-f10a044c-6867bdb8d8-q8vkk\" (UID: \"18492d3b-3c91-4d94-b219-ba24a9a6ad2f\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-f10a044c-6867bdb8d8-q8vkk"
Jul 30 13:32:58.769151 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:32:58.768981    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/18492d3b-3c91-4d94-b219-ba24a9a6ad2f-openshift-service-ca\") pod \"maas-api-e2e-derive-f10a044c-6867bdb8d8-q8vkk\" (UID: \"18492d3b-3c91-4d94-b219-ba24a9a6ad2f\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-f10a044c-6867bdb8d8-q8vkk"
Jul 30 13:32:58.769151 ip-10-0-143-153 kubenswrapper[2566]: E0730 13:32:58.769010    2566 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-derive-f10a044c-serving-cert: secret "maas-api-e2e-derive-f10a044c-serving-cert" not found
Jul 30 13:32:58.769151 ip-10-0-143-153 kubenswrapper[2566]: E0730 13:32:58.769101    2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/18492d3b-3c91-4d94-b219-ba24a9a6ad2f-maas-api-tls podName:18492d3b-3c91-4d94-b219-ba24a9a6ad2f nodeName:}" failed. No retries permitted until 2026-07-30 13:32:59.269057774 +0000 UTC m=+2008.197746014 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/18492d3b-3c91-4d94-b219-ba24a9a6ad2f-maas-api-tls") pod "maas-api-e2e-derive-f10a044c-6867bdb8d8-q8vkk" (UID: "18492d3b-3c91-4d94-b219-ba24a9a6ad2f") : secret "maas-api-e2e-derive-f10a044c-serving-cert" not found
Jul 30 13:32:58.769697 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:32:58.769674    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/18492d3b-3c91-4d94-b219-ba24a9a6ad2f-openshift-service-ca\") pod \"maas-api-e2e-derive-f10a044c-6867bdb8d8-q8vkk\" (UID: \"18492d3b-3c91-4d94-b219-ba24a9a6ad2f\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-f10a044c-6867bdb8d8-q8vkk"
Jul 30 13:32:58.782014 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:32:58.781990    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jl8qx\" (UniqueName: \"kubernetes.io/projected/18492d3b-3c91-4d94-b219-ba24a9a6ad2f-kube-api-access-jl8qx\") pod \"maas-api-e2e-derive-f10a044c-6867bdb8d8-q8vkk\" (UID: \"18492d3b-3c91-4d94-b219-ba24a9a6ad2f\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-f10a044c-6867bdb8d8-q8vkk"
Jul 30 13:32:59.143731 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:32:59.143694    2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-derive-f10a044c-6875cd98db-qtzr8"]
Jul 30 13:32:59.147385 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:32:59.147365    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-derive-f10a044c-6875cd98db-qtzr8"
Jul 30 13:32:59.149794 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:32:59.149768    2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-derive-f10a044c\""
Jul 30 13:32:59.158980 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:32:59.158939    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-derive-f10a044c-6875cd98db-qtzr8"]
Jul 30 13:32:59.161362 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:32:59.161341    2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-derive-f10a044c-64f5cd6bdd-72kcs"]
Jul 30 13:32:59.164792 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:32:59.164769    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-derive-f10a044c-64f5cd6bdd-72kcs"
Jul 30 13:32:59.167034 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:32:59.167015    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-derive-f10a044c-dockercfg-2f2rl\""
Jul 30 13:32:59.180633 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:32:59.180606    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-derive-f10a044c-64f5cd6bdd-72kcs"]
Jul 30 13:32:59.273160 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:32:59.273124    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/c4e66bc1-81c1-407c-9d40-a9e6ead76774-plugins-config-volume\") pod \"payload-processing-e2e-derive-f10a044c-6875cd98db-qtzr8\" (UID: \"c4e66bc1-81c1-407c-9d40-a9e6ead76774\") " pod="openshift-ingress/payload-processing-e2e-derive-f10a044c-6875cd98db-qtzr8"
Jul 30 13:32:59.273322 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:32:59.273229    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kldzs\" (UniqueName: \"kubernetes.io/projected/42ead5f7-8619-44e9-ba3b-4457d5113752-kube-api-access-kldzs\") pod \"payload-pre-processing-e2e-derive-f10a044c-64f5cd6bdd-72kcs\" (UID: \"42ead5f7-8619-44e9-ba3b-4457d5113752\") " pod="openshift-ingress/payload-pre-processing-e2e-derive-f10a044c-64f5cd6bdd-72kcs"
Jul 30 13:32:59.273322 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:32:59.273251    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rg6z9\" (UniqueName: \"kubernetes.io/projected/c4e66bc1-81c1-407c-9d40-a9e6ead76774-kube-api-access-rg6z9\") pod \"payload-processing-e2e-derive-f10a044c-6875cd98db-qtzr8\" (UID: \"c4e66bc1-81c1-407c-9d40-a9e6ead76774\") " pod="openshift-ingress/payload-processing-e2e-derive-f10a044c-6875cd98db-qtzr8"
Jul 30 13:32:59.273322 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:32:59.273282    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/42ead5f7-8619-44e9-ba3b-4457d5113752-plugins-config-volume\") pod \"payload-pre-processing-e2e-derive-f10a044c-64f5cd6bdd-72kcs\" (UID: \"42ead5f7-8619-44e9-ba3b-4457d5113752\") " pod="openshift-ingress/payload-pre-processing-e2e-derive-f10a044c-64f5cd6bdd-72kcs"
Jul 30 13:32:59.273322 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:32:59.273315    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/18492d3b-3c91-4d94-b219-ba24a9a6ad2f-maas-api-tls\") pod \"maas-api-e2e-derive-f10a044c-6867bdb8d8-q8vkk\" (UID: \"18492d3b-3c91-4d94-b219-ba24a9a6ad2f\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-f10a044c-6867bdb8d8-q8vkk"
Jul 30 13:32:59.275851 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:32:59.275822    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/18492d3b-3c91-4d94-b219-ba24a9a6ad2f-maas-api-tls\") pod \"maas-api-e2e-derive-f10a044c-6867bdb8d8-q8vkk\" (UID: \"18492d3b-3c91-4d94-b219-ba24a9a6ad2f\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-f10a044c-6867bdb8d8-q8vkk"
Jul 30 13:32:59.374818 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:32:59.374785    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/c4e66bc1-81c1-407c-9d40-a9e6ead76774-plugins-config-volume\") pod \"payload-processing-e2e-derive-f10a044c-6875cd98db-qtzr8\" (UID: \"c4e66bc1-81c1-407c-9d40-a9e6ead76774\") " pod="openshift-ingress/payload-processing-e2e-derive-f10a044c-6875cd98db-qtzr8"
Jul 30 13:32:59.374996 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:32:59.374868    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kldzs\" (UniqueName: \"kubernetes.io/projected/42ead5f7-8619-44e9-ba3b-4457d5113752-kube-api-access-kldzs\") pod \"payload-pre-processing-e2e-derive-f10a044c-64f5cd6bdd-72kcs\" (UID: \"42ead5f7-8619-44e9-ba3b-4457d5113752\") " pod="openshift-ingress/payload-pre-processing-e2e-derive-f10a044c-64f5cd6bdd-72kcs"
Jul 30 13:32:59.374996 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:32:59.374947    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rg6z9\" (UniqueName: \"kubernetes.io/projected/c4e66bc1-81c1-407c-9d40-a9e6ead76774-kube-api-access-rg6z9\") pod \"payload-processing-e2e-derive-f10a044c-6875cd98db-qtzr8\" (UID: \"c4e66bc1-81c1-407c-9d40-a9e6ead76774\") " pod="openshift-ingress/payload-processing-e2e-derive-f10a044c-6875cd98db-qtzr8"
Jul 30 13:32:59.374996 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:32:59.374982    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/42ead5f7-8619-44e9-ba3b-4457d5113752-plugins-config-volume\") pod \"payload-pre-processing-e2e-derive-f10a044c-64f5cd6bdd-72kcs\" (UID: \"42ead5f7-8619-44e9-ba3b-4457d5113752\") " pod="openshift-ingress/payload-pre-processing-e2e-derive-f10a044c-64f5cd6bdd-72kcs"
Jul 30 13:32:59.375689 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:32:59.375654    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/c4e66bc1-81c1-407c-9d40-a9e6ead76774-plugins-config-volume\") pod \"payload-processing-e2e-derive-f10a044c-6875cd98db-qtzr8\" (UID: \"c4e66bc1-81c1-407c-9d40-a9e6ead76774\") " pod="openshift-ingress/payload-processing-e2e-derive-f10a044c-6875cd98db-qtzr8"
Jul 30 13:32:59.375689 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:32:59.375682    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/42ead5f7-8619-44e9-ba3b-4457d5113752-plugins-config-volume\") pod \"payload-pre-processing-e2e-derive-f10a044c-64f5cd6bdd-72kcs\" (UID: \"42ead5f7-8619-44e9-ba3b-4457d5113752\") " pod="openshift-ingress/payload-pre-processing-e2e-derive-f10a044c-64f5cd6bdd-72kcs"
Jul 30 13:32:59.382984 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:32:59.382949    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kldzs\" (UniqueName: \"kubernetes.io/projected/42ead5f7-8619-44e9-ba3b-4457d5113752-kube-api-access-kldzs\") pod \"payload-pre-processing-e2e-derive-f10a044c-64f5cd6bdd-72kcs\" (UID: \"42ead5f7-8619-44e9-ba3b-4457d5113752\") " pod="openshift-ingress/payload-pre-processing-e2e-derive-f10a044c-64f5cd6bdd-72kcs"
Jul 30 13:32:59.383135 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:32:59.382956    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rg6z9\" (UniqueName: \"kubernetes.io/projected/c4e66bc1-81c1-407c-9d40-a9e6ead76774-kube-api-access-rg6z9\") pod \"payload-processing-e2e-derive-f10a044c-6875cd98db-qtzr8\" (UID: \"c4e66bc1-81c1-407c-9d40-a9e6ead76774\") " pod="openshift-ingress/payload-processing-e2e-derive-f10a044c-6875cd98db-qtzr8"
Jul 30 13:32:59.451488 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:32:59.451407    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-derive-f10a044c-6867bdb8d8-q8vkk"
Jul 30 13:32:59.458413 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:32:59.458390    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-derive-f10a044c-6875cd98db-qtzr8"
Jul 30 13:32:59.474401 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:32:59.474376    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-derive-f10a044c-64f5cd6bdd-72kcs"
Jul 30 13:32:59.842375 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:32:59.842314    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-f10a044c-6867bdb8d8-q8vkk"]
Jul 30 13:32:59.844758 ip-10-0-143-153 kubenswrapper[2566]: W0730 13:32:59.844732    2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod18492d3b_3c91_4d94_b219_ba24a9a6ad2f.slice/crio-48e45f30465c54cd9f3a27e1c11622f607547e9755a7b96553acddf2080edb51 WatchSource:0}: Error finding container 48e45f30465c54cd9f3a27e1c11622f607547e9755a7b96553acddf2080edb51: Status 404 returned error can't find the container with id 48e45f30465c54cd9f3a27e1c11622f607547e9755a7b96553acddf2080edb51
Jul 30 13:32:59.866321 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:32:59.866300    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-derive-f10a044c-6875cd98db-qtzr8"]
Jul 30 13:32:59.868465 ip-10-0-143-153 kubenswrapper[2566]: W0730 13:32:59.868441    2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc4e66bc1_81c1_407c_9d40_a9e6ead76774.slice/crio-093e5ba4db2f61b9e5c14578a6229f79990870abc6c7a38ad64f978c0acbcbe4 WatchSource:0}: Error finding container 093e5ba4db2f61b9e5c14578a6229f79990870abc6c7a38ad64f978c0acbcbe4: Status 404 returned error can't find the container with id 093e5ba4db2f61b9e5c14578a6229f79990870abc6c7a38ad64f978c0acbcbe4
Jul 30 13:32:59.895595 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:32:59.895567    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-derive-f10a044c-64f5cd6bdd-72kcs"]
Jul 30 13:32:59.901420 ip-10-0-143-153 kubenswrapper[2566]: W0730 13:32:59.901391    2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod42ead5f7_8619_44e9_ba3b_4457d5113752.slice/crio-28f6a05c65ade8653be2e3b450c05f7dc4662b56d025e95e3c5ff55d9380ee2f WatchSource:0}: Error finding container 28f6a05c65ade8653be2e3b450c05f7dc4662b56d025e95e3c5ff55d9380ee2f: Status 404 returned error can't find the container with id 28f6a05c65ade8653be2e3b450c05f7dc4662b56d025e95e3c5ff55d9380ee2f
Jul 30 13:33:00.446284 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:33:00.446250    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-derive-f10a044c-64f5cd6bdd-72kcs" event={"ID":"42ead5f7-8619-44e9-ba3b-4457d5113752","Type":"ContainerStarted","Data":"d308d69b999d097c77776934f88793c21e7fbf5fb669d12ac72112cb6c1a791e"}
Jul 30 13:33:00.446436 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:33:00.446311    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-derive-f10a044c-64f5cd6bdd-72kcs" event={"ID":"42ead5f7-8619-44e9-ba3b-4457d5113752","Type":"ContainerStarted","Data":"28f6a05c65ade8653be2e3b450c05f7dc4662b56d025e95e3c5ff55d9380ee2f"}
Jul 30 13:33:00.446436 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:33:00.446338    2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-derive-f10a044c-64f5cd6bdd-72kcs"
Jul 30 13:33:00.447774 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:33:00.447750    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-derive-f10a044c-6875cd98db-qtzr8" event={"ID":"c4e66bc1-81c1-407c-9d40-a9e6ead76774","Type":"ContainerStarted","Data":"1bd6f5d0ad831399f0bc042c89c1999e8086268d1f09cc8f0cb3e6ee09ffbdbc"}
Jul 30 13:33:00.447891 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:33:00.447793    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-derive-f10a044c-6875cd98db-qtzr8" event={"ID":"c4e66bc1-81c1-407c-9d40-a9e6ead76774","Type":"ContainerStarted","Data":"093e5ba4db2f61b9e5c14578a6229f79990870abc6c7a38ad64f978c0acbcbe4"}
Jul 30 13:33:00.447891 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:33:00.447832    2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-derive-f10a044c-6875cd98db-qtzr8"
Jul 30 13:33:00.449156 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:33:00.449135    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-derive-f10a044c-6867bdb8d8-q8vkk" event={"ID":"18492d3b-3c91-4d94-b219-ba24a9a6ad2f","Type":"ContainerStarted","Data":"c9ff302ee08bb48016417304211b8789112afc924671e003d28502f257abea94"}
Jul 30 13:33:00.449252 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:33:00.449167    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-derive-f10a044c-6867bdb8d8-q8vkk" event={"ID":"18492d3b-3c91-4d94-b219-ba24a9a6ad2f","Type":"ContainerStarted","Data":"48e45f30465c54cd9f3a27e1c11622f607547e9755a7b96553acddf2080edb51"}
Jul 30 13:33:00.449252 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:33:00.449198    2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-derive-f10a044c-6867bdb8d8-q8vkk"
Jul 30 13:33:00.466887 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:33:00.466834    2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-derive-f10a044c-64f5cd6bdd-72kcs" podStartSLOduration=1.466814713 podStartE2EDuration="1.466814713s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-30 13:32:59 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 13:33:00.466521927 +0000 UTC m=+2009.395210185" watchObservedRunningTime="2026-07-30 13:33:00.466814713 +0000 UTC m=+2009.395502973"
Jul 30 13:33:00.492172 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:33:00.492113    2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-derive-f10a044c-6867bdb8d8-q8vkk" podStartSLOduration=1.9735947600000001 podStartE2EDuration="2.492071431s" totalImagesPullingTime="518.476671ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-30 13:32:58 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 13:33:00.489309846 +0000 UTC m=+2009.417998123" watchObservedRunningTime="2026-07-30 13:33:00.492071431 +0000 UTC m=+2009.420759698"
Jul 30 13:33:00.509435 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:33:00.509383    2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-derive-f10a044c-6875cd98db-qtzr8" podStartSLOduration=1.5093655400000001 podStartE2EDuration="1.50936554s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-30 13:32:59 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 13:33:00.507462876 +0000 UTC m=+2009.436151139" watchObservedRunningTime="2026-07-30 13:33:00.50936554 +0000 UTC m=+2009.438053802"
Jul 30 13:33:06.459841 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:33:06.459810    2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-derive-f10a044c-6867bdb8d8-q8vkk"
Jul 30 13:33:11.455732 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:33:11.455697    2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-derive-f10a044c-64f5cd6bdd-72kcs"
Jul 30 13:33:11.456211 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:33:11.456013    2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-derive-f10a044c-6875cd98db-qtzr8"
Jul 30 13:33:28.790795 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:33:28.790758    2566 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-f10a044c-6867bdb8d8-q8vkk"]
Jul 30 13:33:28.791429 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:33:28.791098    2566 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-derive-f10a044c-6867bdb8d8-q8vkk" podUID="18492d3b-3c91-4d94-b219-ba24a9a6ad2f" containerName="maas-api" containerID="cri-o://c9ff302ee08bb48016417304211b8789112afc924671e003d28502f257abea94" gracePeriod=30
Jul 30 13:33:28.848670 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:33:28.848635    2566 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-derive-f10a044c-6875cd98db-qtzr8"]
Jul 30 13:33:28.848910 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:33:28.848885    2566 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-derive-f10a044c-6875cd98db-qtzr8" podUID="c4e66bc1-81c1-407c-9d40-a9e6ead76774" containerName="payload-processing" containerID="cri-o://1bd6f5d0ad831399f0bc042c89c1999e8086268d1f09cc8f0cb3e6ee09ffbdbc" gracePeriod=30
Jul 30 13:33:28.856680 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:33:28.856644    2566 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-derive-f10a044c-64f5cd6bdd-72kcs"]
Jul 30 13:33:28.856913 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:33:28.856860    2566 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-derive-f10a044c-64f5cd6bdd-72kcs" podUID="42ead5f7-8619-44e9-ba3b-4457d5113752" containerName="payload-pre-processing" containerID="cri-o://d308d69b999d097c77776934f88793c21e7fbf5fb669d12ac72112cb6c1a791e" gracePeriod=30
Jul 30 13:33:29.131710 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:33:29.131683    2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-derive-f10a044c-6867bdb8d8-q8vkk"
Jul 30 13:33:29.144203 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:33:29.144180    2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-derive-f10a044c-64f5cd6bdd-72kcs"
Jul 30 13:33:29.171065 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:33:29.171043    2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-derive-f10a044c-6875cd98db-qtzr8"
Jul 30 13:33:29.239972 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:33:29.239939    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/18492d3b-3c91-4d94-b219-ba24a9a6ad2f-maas-api-tls\") pod \"18492d3b-3c91-4d94-b219-ba24a9a6ad2f\" (UID: \"18492d3b-3c91-4d94-b219-ba24a9a6ad2f\") "
Jul 30 13:33:29.239972 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:33:29.239977    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-jl8qx\" (UniqueName: \"kubernetes.io/projected/18492d3b-3c91-4d94-b219-ba24a9a6ad2f-kube-api-access-jl8qx\") pod \"18492d3b-3c91-4d94-b219-ba24a9a6ad2f\" (UID: \"18492d3b-3c91-4d94-b219-ba24a9a6ad2f\") "
Jul 30 13:33:29.240269 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:33:29.239997    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/18492d3b-3c91-4d94-b219-ba24a9a6ad2f-openshift-service-ca\") pod \"18492d3b-3c91-4d94-b219-ba24a9a6ad2f\" (UID: \"18492d3b-3c91-4d94-b219-ba24a9a6ad2f\") "
Jul 30 13:33:29.240269 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:33:29.240029    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-rg6z9\" (UniqueName: \"kubernetes.io/projected/c4e66bc1-81c1-407c-9d40-a9e6ead76774-kube-api-access-rg6z9\") pod \"c4e66bc1-81c1-407c-9d40-a9e6ead76774\" (UID: \"c4e66bc1-81c1-407c-9d40-a9e6ead76774\") "
Jul 30 13:33:29.240269 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:33:29.240068    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/c4e66bc1-81c1-407c-9d40-a9e6ead76774-plugins-config-volume\") pod \"c4e66bc1-81c1-407c-9d40-a9e6ead76774\" (UID: \"c4e66bc1-81c1-407c-9d40-a9e6ead76774\") "
Jul 30 13:33:29.240269 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:33:29.240110    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/42ead5f7-8619-44e9-ba3b-4457d5113752-plugins-config-volume\") pod \"42ead5f7-8619-44e9-ba3b-4457d5113752\" (UID: \"42ead5f7-8619-44e9-ba3b-4457d5113752\") "
Jul 30 13:33:29.240269 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:33:29.240187    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-kldzs\" (UniqueName: \"kubernetes.io/projected/42ead5f7-8619-44e9-ba3b-4457d5113752-kube-api-access-kldzs\") pod \"42ead5f7-8619-44e9-ba3b-4457d5113752\" (UID: \"42ead5f7-8619-44e9-ba3b-4457d5113752\") "
Jul 30 13:33:29.240530 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:33:29.240480    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/18492d3b-3c91-4d94-b219-ba24a9a6ad2f-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "18492d3b-3c91-4d94-b219-ba24a9a6ad2f" (UID: "18492d3b-3c91-4d94-b219-ba24a9a6ad2f"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 30 13:33:29.240639 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:33:29.240609    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/42ead5f7-8619-44e9-ba3b-4457d5113752-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "42ead5f7-8619-44e9-ba3b-4457d5113752" (UID: "42ead5f7-8619-44e9-ba3b-4457d5113752"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 30 13:33:29.240707 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:33:29.240686    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c4e66bc1-81c1-407c-9d40-a9e6ead76774-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "c4e66bc1-81c1-407c-9d40-a9e6ead76774" (UID: "c4e66bc1-81c1-407c-9d40-a9e6ead76774"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 30 13:33:29.242311 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:33:29.242279    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/18492d3b-3c91-4d94-b219-ba24a9a6ad2f-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "18492d3b-3c91-4d94-b219-ba24a9a6ad2f" (UID: "18492d3b-3c91-4d94-b219-ba24a9a6ad2f"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 30 13:33:29.242311 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:33:29.242281    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c4e66bc1-81c1-407c-9d40-a9e6ead76774-kube-api-access-rg6z9" (OuterVolumeSpecName: "kube-api-access-rg6z9") pod "c4e66bc1-81c1-407c-9d40-a9e6ead76774" (UID: "c4e66bc1-81c1-407c-9d40-a9e6ead76774"). InnerVolumeSpecName "kube-api-access-rg6z9". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 30 13:33:29.242456 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:33:29.242361    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/18492d3b-3c91-4d94-b219-ba24a9a6ad2f-kube-api-access-jl8qx" (OuterVolumeSpecName: "kube-api-access-jl8qx") pod "18492d3b-3c91-4d94-b219-ba24a9a6ad2f" (UID: "18492d3b-3c91-4d94-b219-ba24a9a6ad2f"). InnerVolumeSpecName "kube-api-access-jl8qx". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 30 13:33:29.242456 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:33:29.242393    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/42ead5f7-8619-44e9-ba3b-4457d5113752-kube-api-access-kldzs" (OuterVolumeSpecName: "kube-api-access-kldzs") pod "42ead5f7-8619-44e9-ba3b-4457d5113752" (UID: "42ead5f7-8619-44e9-ba3b-4457d5113752"). InnerVolumeSpecName "kube-api-access-kldzs". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 30 13:33:29.341570 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:33:29.341482    2566 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/18492d3b-3c91-4d94-b219-ba24a9a6ad2f-maas-api-tls\") on node \"ip-10-0-143-153.ec2.internal\" DevicePath \"\""
Jul 30 13:33:29.341570 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:33:29.341514    2566 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-jl8qx\" (UniqueName: \"kubernetes.io/projected/18492d3b-3c91-4d94-b219-ba24a9a6ad2f-kube-api-access-jl8qx\") on node \"ip-10-0-143-153.ec2.internal\" DevicePath \"\""
Jul 30 13:33:29.341570 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:33:29.341527    2566 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/18492d3b-3c91-4d94-b219-ba24a9a6ad2f-openshift-service-ca\") on node \"ip-10-0-143-153.ec2.internal\" DevicePath \"\""
Jul 30 13:33:29.341570 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:33:29.341539    2566 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-rg6z9\" (UniqueName: \"kubernetes.io/projected/c4e66bc1-81c1-407c-9d40-a9e6ead76774-kube-api-access-rg6z9\") on node \"ip-10-0-143-153.ec2.internal\" DevicePath \"\""
Jul 30 13:33:29.341570 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:33:29.341550    2566 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/c4e66bc1-81c1-407c-9d40-a9e6ead76774-plugins-config-volume\") on node \"ip-10-0-143-153.ec2.internal\" DevicePath \"\""
Jul 30 13:33:29.341570 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:33:29.341562    2566 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/42ead5f7-8619-44e9-ba3b-4457d5113752-plugins-config-volume\") on node \"ip-10-0-143-153.ec2.internal\" DevicePath \"\""
Jul 30 13:33:29.341876 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:33:29.341574    2566 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-kldzs\" (UniqueName: \"kubernetes.io/projected/42ead5f7-8619-44e9-ba3b-4457d5113752-kube-api-access-kldzs\") on node \"ip-10-0-143-153.ec2.internal\" DevicePath \"\""
Jul 30 13:33:29.607244 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:33:29.607156    2566 generic.go:356] "Generic (PLEG): container finished" podID="c4e66bc1-81c1-407c-9d40-a9e6ead76774" containerID="1bd6f5d0ad831399f0bc042c89c1999e8086268d1f09cc8f0cb3e6ee09ffbdbc" exitCode=0
Jul 30 13:33:29.607244 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:33:29.607203    2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-derive-f10a044c-6875cd98db-qtzr8"
Jul 30 13:33:29.607485 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:33:29.607234    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-derive-f10a044c-6875cd98db-qtzr8" event={"ID":"c4e66bc1-81c1-407c-9d40-a9e6ead76774","Type":"ContainerDied","Data":"1bd6f5d0ad831399f0bc042c89c1999e8086268d1f09cc8f0cb3e6ee09ffbdbc"}
Jul 30 13:33:29.607485 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:33:29.607287    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-derive-f10a044c-6875cd98db-qtzr8" event={"ID":"c4e66bc1-81c1-407c-9d40-a9e6ead76774","Type":"ContainerDied","Data":"093e5ba4db2f61b9e5c14578a6229f79990870abc6c7a38ad64f978c0acbcbe4"}
Jul 30 13:33:29.607485 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:33:29.607315    2566 scope.go:117] "RemoveContainer" containerID="1bd6f5d0ad831399f0bc042c89c1999e8086268d1f09cc8f0cb3e6ee09ffbdbc"
Jul 30 13:33:29.608637 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:33:29.608612    2566 generic.go:356] "Generic (PLEG): container finished" podID="18492d3b-3c91-4d94-b219-ba24a9a6ad2f" containerID="c9ff302ee08bb48016417304211b8789112afc924671e003d28502f257abea94" exitCode=0
Jul 30 13:33:29.608727 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:33:29.608652    2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-derive-f10a044c-6867bdb8d8-q8vkk"
Jul 30 13:33:29.608727 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:33:29.608701    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-derive-f10a044c-6867bdb8d8-q8vkk" event={"ID":"18492d3b-3c91-4d94-b219-ba24a9a6ad2f","Type":"ContainerDied","Data":"c9ff302ee08bb48016417304211b8789112afc924671e003d28502f257abea94"}
Jul 30 13:33:29.608814 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:33:29.608749    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-derive-f10a044c-6867bdb8d8-q8vkk" event={"ID":"18492d3b-3c91-4d94-b219-ba24a9a6ad2f","Type":"ContainerDied","Data":"48e45f30465c54cd9f3a27e1c11622f607547e9755a7b96553acddf2080edb51"}
Jul 30 13:33:29.610254 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:33:29.610155    2566 generic.go:356] "Generic (PLEG): container finished" podID="42ead5f7-8619-44e9-ba3b-4457d5113752" containerID="d308d69b999d097c77776934f88793c21e7fbf5fb669d12ac72112cb6c1a791e" exitCode=0
Jul 30 13:33:29.610254 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:33:29.610194    2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-derive-f10a044c-64f5cd6bdd-72kcs"
Jul 30 13:33:29.610254 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:33:29.610190    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-derive-f10a044c-64f5cd6bdd-72kcs" event={"ID":"42ead5f7-8619-44e9-ba3b-4457d5113752","Type":"ContainerDied","Data":"d308d69b999d097c77776934f88793c21e7fbf5fb669d12ac72112cb6c1a791e"}
Jul 30 13:33:29.610486 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:33:29.610271    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-derive-f10a044c-64f5cd6bdd-72kcs" event={"ID":"42ead5f7-8619-44e9-ba3b-4457d5113752","Type":"ContainerDied","Data":"28f6a05c65ade8653be2e3b450c05f7dc4662b56d025e95e3c5ff55d9380ee2f"}
Jul 30 13:33:29.618348 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:33:29.618328    2566 scope.go:117] "RemoveContainer" containerID="1bd6f5d0ad831399f0bc042c89c1999e8086268d1f09cc8f0cb3e6ee09ffbdbc"
Jul 30 13:33:29.618693 ip-10-0-143-153 kubenswrapper[2566]: E0730 13:33:29.618665    2566 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1bd6f5d0ad831399f0bc042c89c1999e8086268d1f09cc8f0cb3e6ee09ffbdbc\": container with ID starting with 1bd6f5d0ad831399f0bc042c89c1999e8086268d1f09cc8f0cb3e6ee09ffbdbc not found: ID does not exist" containerID="1bd6f5d0ad831399f0bc042c89c1999e8086268d1f09cc8f0cb3e6ee09ffbdbc"
Jul 30 13:33:29.618775 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:33:29.618703    2566 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1bd6f5d0ad831399f0bc042c89c1999e8086268d1f09cc8f0cb3e6ee09ffbdbc"} err="failed to get container status \"1bd6f5d0ad831399f0bc042c89c1999e8086268d1f09cc8f0cb3e6ee09ffbdbc\": rpc error: code = NotFound desc = could not find container \"1bd6f5d0ad831399f0bc042c89c1999e8086268d1f09cc8f0cb3e6ee09ffbdbc\": container with ID starting with 1bd6f5d0ad831399f0bc042c89c1999e8086268d1f09cc8f0cb3e6ee09ffbdbc not found: ID does not exist"
Jul 30 13:33:29.618775 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:33:29.618726    2566 scope.go:117] "RemoveContainer" containerID="c9ff302ee08bb48016417304211b8789112afc924671e003d28502f257abea94"
Jul 30 13:33:29.631501 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:33:29.631481    2566 scope.go:117] "RemoveContainer" containerID="c9ff302ee08bb48016417304211b8789112afc924671e003d28502f257abea94"
Jul 30 13:33:29.631610 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:33:29.631591    2566 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-derive-f10a044c-6875cd98db-qtzr8"]
Jul 30 13:33:29.631917 ip-10-0-143-153 kubenswrapper[2566]: E0730 13:33:29.631864    2566 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c9ff302ee08bb48016417304211b8789112afc924671e003d28502f257abea94\": container with ID starting with c9ff302ee08bb48016417304211b8789112afc924671e003d28502f257abea94 not found: ID does not exist" containerID="c9ff302ee08bb48016417304211b8789112afc924671e003d28502f257abea94"
Jul 30 13:33:29.631917 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:33:29.631894    2566 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c9ff302ee08bb48016417304211b8789112afc924671e003d28502f257abea94"} err="failed to get container status \"c9ff302ee08bb48016417304211b8789112afc924671e003d28502f257abea94\": rpc error: code = NotFound desc = could not find container \"c9ff302ee08bb48016417304211b8789112afc924671e003d28502f257abea94\": container with ID starting with c9ff302ee08bb48016417304211b8789112afc924671e003d28502f257abea94 not found: ID does not exist"
Jul 30 13:33:29.632109 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:33:29.631918    2566 scope.go:117] "RemoveContainer" containerID="d308d69b999d097c77776934f88793c21e7fbf5fb669d12ac72112cb6c1a791e"
Jul 30 13:33:29.634326 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:33:29.634303    2566 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-derive-f10a044c-6875cd98db-qtzr8"]
Jul 30 13:33:29.641665 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:33:29.641399    2566 scope.go:117] "RemoveContainer" containerID="d308d69b999d097c77776934f88793c21e7fbf5fb669d12ac72112cb6c1a791e"
Jul 30 13:33:29.641843 ip-10-0-143-153 kubenswrapper[2566]: E0730 13:33:29.641819    2566 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d308d69b999d097c77776934f88793c21e7fbf5fb669d12ac72112cb6c1a791e\": container with ID starting with d308d69b999d097c77776934f88793c21e7fbf5fb669d12ac72112cb6c1a791e not found: ID does not exist" containerID="d308d69b999d097c77776934f88793c21e7fbf5fb669d12ac72112cb6c1a791e"
Jul 30 13:33:29.641906 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:33:29.641853    2566 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d308d69b999d097c77776934f88793c21e7fbf5fb669d12ac72112cb6c1a791e"} err="failed to get container status \"d308d69b999d097c77776934f88793c21e7fbf5fb669d12ac72112cb6c1a791e\": rpc error: code = NotFound desc = could not find container \"d308d69b999d097c77776934f88793c21e7fbf5fb669d12ac72112cb6c1a791e\": container with ID starting with d308d69b999d097c77776934f88793c21e7fbf5fb669d12ac72112cb6c1a791e not found: ID does not exist"
Jul 30 13:33:29.643443 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:33:29.643424    2566 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-f10a044c-6867bdb8d8-q8vkk"]
Jul 30 13:33:29.650591 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:33:29.650569    2566 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-f10a044c-6867bdb8d8-q8vkk"]
Jul 30 13:33:29.661912 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:33:29.661892    2566 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-derive-f10a044c-64f5cd6bdd-72kcs"]
Jul 30 13:33:29.669483 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:33:29.669464    2566 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-derive-f10a044c-64f5cd6bdd-72kcs"]
Jul 30 13:33:31.627297 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:33:31.627265    2566 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="18492d3b-3c91-4d94-b219-ba24a9a6ad2f" path="/var/lib/kubelet/pods/18492d3b-3c91-4d94-b219-ba24a9a6ad2f/volumes"
Jul 30 13:33:31.627676 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:33:31.627646    2566 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="42ead5f7-8619-44e9-ba3b-4457d5113752" path="/var/lib/kubelet/pods/42ead5f7-8619-44e9-ba3b-4457d5113752/volumes"
Jul 30 13:33:31.627978 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:33:31.627965    2566 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c4e66bc1-81c1-407c-9d40-a9e6ead76774" path="/var/lib/kubelet/pods/c4e66bc1-81c1-407c-9d40-a9e6ead76774/volumes"
Jul 30 13:34:31.702040 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:34:31.702012    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-bzl6w_51cdacbf-3a14-47c0-8fd4-69b0b2be0e64/console-operator/1.log"
Jul 30 13:34:31.707671 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:34:31.707638    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-bzl6w_51cdacbf-3a14-47c0-8fd4-69b0b2be0e64/console-operator/1.log"
Jul 30 13:34:31.707928 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:34:31.707909    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-f6br6_3ebbc209-4373-44d8-a22e-d2d2aa4cbfa6/ovn-acl-logging/0.log"
Jul 30 13:34:31.716500 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:34:31.716479    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-f6br6_3ebbc209-4373-44d8-a22e-d2d2aa4cbfa6/ovn-acl-logging/0.log"
Jul 30 13:35:44.936159 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:35:44.936055    2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-06db6c7f-787bd8c6f5-cx8ht"]
Jul 30 13:35:44.936741 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:35:44.936456    2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c4e66bc1-81c1-407c-9d40-a9e6ead76774" containerName="payload-processing"
Jul 30 13:35:44.936741 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:35:44.936469    2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="c4e66bc1-81c1-407c-9d40-a9e6ead76774" containerName="payload-processing"
Jul 30 13:35:44.936741 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:35:44.936479    2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="42ead5f7-8619-44e9-ba3b-4457d5113752" containerName="payload-pre-processing"
Jul 30 13:35:44.936741 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:35:44.936486    2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="42ead5f7-8619-44e9-ba3b-4457d5113752" containerName="payload-pre-processing"
Jul 30 13:35:44.936741 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:35:44.936498    2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="18492d3b-3c91-4d94-b219-ba24a9a6ad2f" containerName="maas-api"
Jul 30 13:35:44.936741 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:35:44.936504    2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="18492d3b-3c91-4d94-b219-ba24a9a6ad2f" containerName="maas-api"
Jul 30 13:35:44.936741 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:35:44.936564    2566 memory_manager.go:368] "RemoveStaleState removing state" podUID="42ead5f7-8619-44e9-ba3b-4457d5113752" containerName="payload-pre-processing"
Jul 30 13:35:44.936741 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:35:44.936573    2566 memory_manager.go:368] "RemoveStaleState removing state" podUID="c4e66bc1-81c1-407c-9d40-a9e6ead76774" containerName="payload-processing"
Jul 30 13:35:44.936741 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:35:44.936581    2566 memory_manager.go:368] "RemoveStaleState removing state" podUID="18492d3b-3c91-4d94-b219-ba24a9a6ad2f" containerName="maas-api"
Jul 30 13:35:44.940233 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:35:44.940205    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-06db6c7f-787bd8c6f5-cx8ht"
Jul 30 13:35:44.942110 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:35:44.942062    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-mt-06db6c7f-serving-cert\""
Jul 30 13:35:44.952349 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:35:44.952325    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-06db6c7f-787bd8c6f5-cx8ht"]
Jul 30 13:35:45.017329 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:35:45.017275    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/26002646-0da5-452a-ae2d-9d638cf10333-maas-api-tls\") pod \"maas-api-e2e-mt-06db6c7f-787bd8c6f5-cx8ht\" (UID: \"26002646-0da5-452a-ae2d-9d638cf10333\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-06db6c7f-787bd8c6f5-cx8ht"
Jul 30 13:35:45.017541 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:35:45.017364    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/26002646-0da5-452a-ae2d-9d638cf10333-openshift-service-ca\") pod \"maas-api-e2e-mt-06db6c7f-787bd8c6f5-cx8ht\" (UID: \"26002646-0da5-452a-ae2d-9d638cf10333\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-06db6c7f-787bd8c6f5-cx8ht"
Jul 30 13:35:45.017541 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:35:45.017405    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gfpbj\" (UniqueName: \"kubernetes.io/projected/26002646-0da5-452a-ae2d-9d638cf10333-kube-api-access-gfpbj\") pod \"maas-api-e2e-mt-06db6c7f-787bd8c6f5-cx8ht\" (UID: \"26002646-0da5-452a-ae2d-9d638cf10333\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-06db6c7f-787bd8c6f5-cx8ht"
Jul 30 13:35:45.118754 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:35:45.118719    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/26002646-0da5-452a-ae2d-9d638cf10333-maas-api-tls\") pod \"maas-api-e2e-mt-06db6c7f-787bd8c6f5-cx8ht\" (UID: \"26002646-0da5-452a-ae2d-9d638cf10333\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-06db6c7f-787bd8c6f5-cx8ht"
Jul 30 13:35:45.118926 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:35:45.118775    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/26002646-0da5-452a-ae2d-9d638cf10333-openshift-service-ca\") pod \"maas-api-e2e-mt-06db6c7f-787bd8c6f5-cx8ht\" (UID: \"26002646-0da5-452a-ae2d-9d638cf10333\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-06db6c7f-787bd8c6f5-cx8ht"
Jul 30 13:35:45.118926 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:35:45.118802    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gfpbj\" (UniqueName: \"kubernetes.io/projected/26002646-0da5-452a-ae2d-9d638cf10333-kube-api-access-gfpbj\") pod \"maas-api-e2e-mt-06db6c7f-787bd8c6f5-cx8ht\" (UID: \"26002646-0da5-452a-ae2d-9d638cf10333\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-06db6c7f-787bd8c6f5-cx8ht"
Jul 30 13:35:45.118926 ip-10-0-143-153 kubenswrapper[2566]: E0730 13:35:45.118891    2566 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-mt-06db6c7f-serving-cert: secret "maas-api-e2e-mt-06db6c7f-serving-cert" not found
Jul 30 13:35:45.119048 ip-10-0-143-153 kubenswrapper[2566]: E0730 13:35:45.118974    2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/26002646-0da5-452a-ae2d-9d638cf10333-maas-api-tls podName:26002646-0da5-452a-ae2d-9d638cf10333 nodeName:}" failed. No retries permitted until 2026-07-30 13:35:45.618951075 +0000 UTC m=+2174.547639317 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/26002646-0da5-452a-ae2d-9d638cf10333-maas-api-tls") pod "maas-api-e2e-mt-06db6c7f-787bd8c6f5-cx8ht" (UID: "26002646-0da5-452a-ae2d-9d638cf10333") : secret "maas-api-e2e-mt-06db6c7f-serving-cert" not found
Jul 30 13:35:45.119492 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:35:45.119457    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/26002646-0da5-452a-ae2d-9d638cf10333-openshift-service-ca\") pod \"maas-api-e2e-mt-06db6c7f-787bd8c6f5-cx8ht\" (UID: \"26002646-0da5-452a-ae2d-9d638cf10333\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-06db6c7f-787bd8c6f5-cx8ht"
Jul 30 13:35:45.128752 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:35:45.128726    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gfpbj\" (UniqueName: \"kubernetes.io/projected/26002646-0da5-452a-ae2d-9d638cf10333-kube-api-access-gfpbj\") pod \"maas-api-e2e-mt-06db6c7f-787bd8c6f5-cx8ht\" (UID: \"26002646-0da5-452a-ae2d-9d638cf10333\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-06db6c7f-787bd8c6f5-cx8ht"
Jul 30 13:35:45.623906 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:35:45.623874    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/26002646-0da5-452a-ae2d-9d638cf10333-maas-api-tls\") pod \"maas-api-e2e-mt-06db6c7f-787bd8c6f5-cx8ht\" (UID: \"26002646-0da5-452a-ae2d-9d638cf10333\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-06db6c7f-787bd8c6f5-cx8ht"
Jul 30 13:35:45.626835 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:35:45.626804    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/26002646-0da5-452a-ae2d-9d638cf10333-maas-api-tls\") pod \"maas-api-e2e-mt-06db6c7f-787bd8c6f5-cx8ht\" (UID: \"26002646-0da5-452a-ae2d-9d638cf10333\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-06db6c7f-787bd8c6f5-cx8ht"
Jul 30 13:35:45.808518 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:35:45.808481    2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-06db6c7f-69dcd44bc6-srmw2"]
Jul 30 13:35:45.812382 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:35:45.812363    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-mt-06db6c7f-69dcd44bc6-srmw2"
Jul 30 13:35:45.814332 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:35:45.814312    2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-mt-06db6c7f\""
Jul 30 13:35:45.814456 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:35:45.814313    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-mt-06db6c7f-dockercfg-v99lw\""
Jul 30 13:35:45.820418 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:35:45.820394    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-06db6c7f-69dcd44bc6-srmw2"]
Jul 30 13:35:45.853675 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:35:45.853648    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-06db6c7f-787bd8c6f5-cx8ht"
Jul 30 13:35:45.886690 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:35:45.886657    2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-mt-06db6c7f-9d55ddbb6-qb4n8"]
Jul 30 13:35:45.890968 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:35:45.890944    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-mt-06db6c7f-9d55ddbb6-qb4n8"
Jul 30 13:35:45.901715 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:35:45.901689    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-mt-06db6c7f-9d55ddbb6-qb4n8"]
Jul 30 13:35:45.926696 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:35:45.926665    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6xvb6\" (UniqueName: \"kubernetes.io/projected/02d0975f-119f-4366-b695-f88f232877cf-kube-api-access-6xvb6\") pod \"payload-pre-processing-e2e-mt-06db6c7f-69dcd44bc6-srmw2\" (UID: \"02d0975f-119f-4366-b695-f88f232877cf\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-06db6c7f-69dcd44bc6-srmw2"
Jul 30 13:35:45.926859 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:35:45.926723    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/02d0975f-119f-4366-b695-f88f232877cf-plugins-config-volume\") pod \"payload-pre-processing-e2e-mt-06db6c7f-69dcd44bc6-srmw2\" (UID: \"02d0975f-119f-4366-b695-f88f232877cf\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-06db6c7f-69dcd44bc6-srmw2"
Jul 30 13:35:46.027449 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:35:46.027406    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/e6e6c195-64f0-44d6-8855-21564780202e-plugins-config-volume\") pod \"payload-processing-e2e-mt-06db6c7f-9d55ddbb6-qb4n8\" (UID: \"e6e6c195-64f0-44d6-8855-21564780202e\") " pod="openshift-ingress/payload-processing-e2e-mt-06db6c7f-9d55ddbb6-qb4n8"
Jul 30 13:35:46.027859 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:35:46.027467    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/02d0975f-119f-4366-b695-f88f232877cf-plugins-config-volume\") pod \"payload-pre-processing-e2e-mt-06db6c7f-69dcd44bc6-srmw2\" (UID: \"02d0975f-119f-4366-b695-f88f232877cf\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-06db6c7f-69dcd44bc6-srmw2"
Jul 30 13:35:46.027859 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:35:46.027557    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9dcx5\" (UniqueName: \"kubernetes.io/projected/e6e6c195-64f0-44d6-8855-21564780202e-kube-api-access-9dcx5\") pod \"payload-processing-e2e-mt-06db6c7f-9d55ddbb6-qb4n8\" (UID: \"e6e6c195-64f0-44d6-8855-21564780202e\") " pod="openshift-ingress/payload-processing-e2e-mt-06db6c7f-9d55ddbb6-qb4n8"
Jul 30 13:35:46.027859 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:35:46.027640    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6xvb6\" (UniqueName: \"kubernetes.io/projected/02d0975f-119f-4366-b695-f88f232877cf-kube-api-access-6xvb6\") pod \"payload-pre-processing-e2e-mt-06db6c7f-69dcd44bc6-srmw2\" (UID: \"02d0975f-119f-4366-b695-f88f232877cf\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-06db6c7f-69dcd44bc6-srmw2"
Jul 30 13:35:46.028177 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:35:46.028161    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/02d0975f-119f-4366-b695-f88f232877cf-plugins-config-volume\") pod \"payload-pre-processing-e2e-mt-06db6c7f-69dcd44bc6-srmw2\" (UID: \"02d0975f-119f-4366-b695-f88f232877cf\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-06db6c7f-69dcd44bc6-srmw2"
Jul 30 13:35:46.037446 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:35:46.037422    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6xvb6\" (UniqueName: \"kubernetes.io/projected/02d0975f-119f-4366-b695-f88f232877cf-kube-api-access-6xvb6\") pod \"payload-pre-processing-e2e-mt-06db6c7f-69dcd44bc6-srmw2\" (UID: \"02d0975f-119f-4366-b695-f88f232877cf\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-06db6c7f-69dcd44bc6-srmw2"
Jul 30 13:35:46.126731 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:35:46.126686    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-mt-06db6c7f-69dcd44bc6-srmw2"
Jul 30 13:35:46.128046 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:35:46.128022    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/e6e6c195-64f0-44d6-8855-21564780202e-plugins-config-volume\") pod \"payload-processing-e2e-mt-06db6c7f-9d55ddbb6-qb4n8\" (UID: \"e6e6c195-64f0-44d6-8855-21564780202e\") " pod="openshift-ingress/payload-processing-e2e-mt-06db6c7f-9d55ddbb6-qb4n8"
Jul 30 13:35:46.128224 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:35:46.128203    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9dcx5\" (UniqueName: \"kubernetes.io/projected/e6e6c195-64f0-44d6-8855-21564780202e-kube-api-access-9dcx5\") pod \"payload-processing-e2e-mt-06db6c7f-9d55ddbb6-qb4n8\" (UID: \"e6e6c195-64f0-44d6-8855-21564780202e\") " pod="openshift-ingress/payload-processing-e2e-mt-06db6c7f-9d55ddbb6-qb4n8"
Jul 30 13:35:46.128664 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:35:46.128647    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/e6e6c195-64f0-44d6-8855-21564780202e-plugins-config-volume\") pod \"payload-processing-e2e-mt-06db6c7f-9d55ddbb6-qb4n8\" (UID: \"e6e6c195-64f0-44d6-8855-21564780202e\") " pod="openshift-ingress/payload-processing-e2e-mt-06db6c7f-9d55ddbb6-qb4n8"
Jul 30 13:35:46.154219 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:35:46.154193    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9dcx5\" (UniqueName: \"kubernetes.io/projected/e6e6c195-64f0-44d6-8855-21564780202e-kube-api-access-9dcx5\") pod \"payload-processing-e2e-mt-06db6c7f-9d55ddbb6-qb4n8\" (UID: \"e6e6c195-64f0-44d6-8855-21564780202e\") " pod="openshift-ingress/payload-processing-e2e-mt-06db6c7f-9d55ddbb6-qb4n8"
Jul 30 13:35:46.205588 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:35:46.205557    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-mt-06db6c7f-9d55ddbb6-qb4n8"
Jul 30 13:35:46.212941 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:35:46.212912    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-06db6c7f-787bd8c6f5-cx8ht"]
Jul 30 13:35:46.220442 ip-10-0-143-153 kubenswrapper[2566]: W0730 13:35:46.220411    2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod26002646_0da5_452a_ae2d_9d638cf10333.slice/crio-bcdd5da342429c22127b1ca89f8790f4843a49ac7f112bfccec863e8a2f1af8d WatchSource:0}: Error finding container bcdd5da342429c22127b1ca89f8790f4843a49ac7f112bfccec863e8a2f1af8d: Status 404 returned error can't find the container with id bcdd5da342429c22127b1ca89f8790f4843a49ac7f112bfccec863e8a2f1af8d
Jul 30 13:35:46.269091 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:35:46.269047    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-06db6c7f-69dcd44bc6-srmw2"]
Jul 30 13:35:46.273115 ip-10-0-143-153 kubenswrapper[2566]: W0730 13:35:46.273061    2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod02d0975f_119f_4366_b695_f88f232877cf.slice/crio-57bda52ab06949c5737f9e11a824ab5eedaeb343ec56a6919de0c9f5f085d7c1 WatchSource:0}: Error finding container 57bda52ab06949c5737f9e11a824ab5eedaeb343ec56a6919de0c9f5f085d7c1: Status 404 returned error can't find the container with id 57bda52ab06949c5737f9e11a824ab5eedaeb343ec56a6919de0c9f5f085d7c1
Jul 30 13:35:46.304284 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:35:46.304255    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-mt-06db6c7f-69dcd44bc6-srmw2" event={"ID":"02d0975f-119f-4366-b695-f88f232877cf","Type":"ContainerStarted","Data":"57bda52ab06949c5737f9e11a824ab5eedaeb343ec56a6919de0c9f5f085d7c1"}
Jul 30 13:35:46.305409 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:35:46.305382    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-06db6c7f-787bd8c6f5-cx8ht" event={"ID":"26002646-0da5-452a-ae2d-9d638cf10333","Type":"ContainerStarted","Data":"bcdd5da342429c22127b1ca89f8790f4843a49ac7f112bfccec863e8a2f1af8d"}
Jul 30 13:35:46.365989 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:35:46.365964    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-mt-06db6c7f-9d55ddbb6-qb4n8"]
Jul 30 13:35:46.369438 ip-10-0-143-153 kubenswrapper[2566]: W0730 13:35:46.369416    2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode6e6c195_64f0_44d6_8855_21564780202e.slice/crio-d169040832dc5ec2277b29fed76e7ceb0bf1b9de1646aa889b1da63253f804c9 WatchSource:0}: Error finding container d169040832dc5ec2277b29fed76e7ceb0bf1b9de1646aa889b1da63253f804c9: Status 404 returned error can't find the container with id d169040832dc5ec2277b29fed76e7ceb0bf1b9de1646aa889b1da63253f804c9
Jul 30 13:35:47.313164 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:35:47.313122    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-mt-06db6c7f-69dcd44bc6-srmw2" event={"ID":"02d0975f-119f-4366-b695-f88f232877cf","Type":"ContainerStarted","Data":"da3119021ecde0e4856782f93787a24cc55a59932ce4d32bab278389e2d63f41"}
Jul 30 13:35:47.313637 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:35:47.313230    2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-mt-06db6c7f-69dcd44bc6-srmw2"
Jul 30 13:35:47.314887 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:35:47.314861    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-mt-06db6c7f-9d55ddbb6-qb4n8" event={"ID":"e6e6c195-64f0-44d6-8855-21564780202e","Type":"ContainerStarted","Data":"12e40846fd6cf783c8df3e270561a236933205255c50c393f426292a1ff48eb4"}
Jul 30 13:35:47.315033 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:35:47.314912    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-mt-06db6c7f-9d55ddbb6-qb4n8" event={"ID":"e6e6c195-64f0-44d6-8855-21564780202e","Type":"ContainerStarted","Data":"d169040832dc5ec2277b29fed76e7ceb0bf1b9de1646aa889b1da63253f804c9"}
Jul 30 13:35:47.315033 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:35:47.314941    2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-mt-06db6c7f-9d55ddbb6-qb4n8"
Jul 30 13:35:47.330010 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:35:47.329965    2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-mt-06db6c7f-69dcd44bc6-srmw2" podStartSLOduration=2.329951448 podStartE2EDuration="2.329951448s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-30 13:35:45 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 13:35:47.328685366 +0000 UTC m=+2176.257373630" watchObservedRunningTime="2026-07-30 13:35:47.329951448 +0000 UTC m=+2176.258639758"
Jul 30 13:35:48.322887 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:35:48.322848    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-06db6c7f-787bd8c6f5-cx8ht" event={"ID":"26002646-0da5-452a-ae2d-9d638cf10333","Type":"ContainerStarted","Data":"4c0d6793caf53fc6cf7718bc1a2e20569710e2fe5a2fd3693bf5f791af538c78"}
Jul 30 13:35:48.340905 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:35:48.340853    2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-mt-06db6c7f-787bd8c6f5-cx8ht" podStartSLOduration=3.173004837 podStartE2EDuration="4.340836922s" totalImagesPullingTime="1.167832085s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-30 13:35:44 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 13:35:48.338494444 +0000 UTC m=+2177.267182709" watchObservedRunningTime="2026-07-30 13:35:48.340836922 +0000 UTC m=+2177.269525184"
Jul 30 13:35:48.341117 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:35:48.340954    2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-mt-06db6c7f-9d55ddbb6-qb4n8" podStartSLOduration=3.340947973 podStartE2EDuration="3.340947973s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-30 13:35:45 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 13:35:47.353485674 +0000 UTC m=+2176.282174070" watchObservedRunningTime="2026-07-30 13:35:48.340947973 +0000 UTC m=+2177.269636235"
Jul 30 13:35:49.328577 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:35:49.328534    2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-mt-06db6c7f-787bd8c6f5-cx8ht"
Jul 30 13:35:55.338873 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:35:55.338838    2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-mt-06db6c7f-787bd8c6f5-cx8ht"
Jul 30 13:35:58.324763 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:35:58.324723    2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-mt-06db6c7f-9d55ddbb6-qb4n8"
Jul 30 13:35:58.325195 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:35:58.324977    2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-mt-06db6c7f-69dcd44bc6-srmw2"
Jul 30 13:36:26.424956 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:36:26.424803    2566 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-06db6c7f-787bd8c6f5-cx8ht"]
Jul 30 13:36:26.425630 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:36:26.425109    2566 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-mt-06db6c7f-787bd8c6f5-cx8ht" podUID="26002646-0da5-452a-ae2d-9d638cf10333" containerName="maas-api" containerID="cri-o://4c0d6793caf53fc6cf7718bc1a2e20569710e2fe5a2fd3693bf5f791af538c78" gracePeriod=30
Jul 30 13:36:26.499302 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:36:26.499266    2566 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-mt-06db6c7f-9d55ddbb6-qb4n8"]
Jul 30 13:36:26.499553 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:36:26.499527    2566 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-mt-06db6c7f-9d55ddbb6-qb4n8" podUID="e6e6c195-64f0-44d6-8855-21564780202e" containerName="payload-processing" containerID="cri-o://12e40846fd6cf783c8df3e270561a236933205255c50c393f426292a1ff48eb4" gracePeriod=30
Jul 30 13:36:26.509854 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:36:26.509819    2566 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-06db6c7f-69dcd44bc6-srmw2"]
Jul 30 13:36:26.510102 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:36:26.510055    2566 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-mt-06db6c7f-69dcd44bc6-srmw2" podUID="02d0975f-119f-4366-b695-f88f232877cf" containerName="payload-pre-processing" containerID="cri-o://da3119021ecde0e4856782f93787a24cc55a59932ce4d32bab278389e2d63f41" gracePeriod=30
Jul 30 13:36:26.802275 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:36:26.802245    2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-mt-06db6c7f-69dcd44bc6-srmw2"
Jul 30 13:36:26.805184 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:36:26.805163    2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-06db6c7f-787bd8c6f5-cx8ht"
Jul 30 13:36:26.819567 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:36:26.819540    2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-mt-06db6c7f-9d55ddbb6-qb4n8"
Jul 30 13:36:26.907737 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:36:26.907694    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/26002646-0da5-452a-ae2d-9d638cf10333-openshift-service-ca\") pod \"26002646-0da5-452a-ae2d-9d638cf10333\" (UID: \"26002646-0da5-452a-ae2d-9d638cf10333\") "
Jul 30 13:36:26.907938 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:36:26.907756    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/26002646-0da5-452a-ae2d-9d638cf10333-maas-api-tls\") pod \"26002646-0da5-452a-ae2d-9d638cf10333\" (UID: \"26002646-0da5-452a-ae2d-9d638cf10333\") "
Jul 30 13:36:26.907938 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:36:26.907827    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-6xvb6\" (UniqueName: \"kubernetes.io/projected/02d0975f-119f-4366-b695-f88f232877cf-kube-api-access-6xvb6\") pod \"02d0975f-119f-4366-b695-f88f232877cf\" (UID: \"02d0975f-119f-4366-b695-f88f232877cf\") "
Jul 30 13:36:26.907938 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:36:26.907894    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/02d0975f-119f-4366-b695-f88f232877cf-plugins-config-volume\") pod \"02d0975f-119f-4366-b695-f88f232877cf\" (UID: \"02d0975f-119f-4366-b695-f88f232877cf\") "
Jul 30 13:36:26.907938 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:36:26.907925    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-gfpbj\" (UniqueName: \"kubernetes.io/projected/26002646-0da5-452a-ae2d-9d638cf10333-kube-api-access-gfpbj\") pod \"26002646-0da5-452a-ae2d-9d638cf10333\" (UID: \"26002646-0da5-452a-ae2d-9d638cf10333\") "
Jul 30 13:36:26.908200 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:36:26.907946    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/e6e6c195-64f0-44d6-8855-21564780202e-plugins-config-volume\") pod \"e6e6c195-64f0-44d6-8855-21564780202e\" (UID: \"e6e6c195-64f0-44d6-8855-21564780202e\") "
Jul 30 13:36:26.908200 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:36:26.908012    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-9dcx5\" (UniqueName: \"kubernetes.io/projected/e6e6c195-64f0-44d6-8855-21564780202e-kube-api-access-9dcx5\") pod \"e6e6c195-64f0-44d6-8855-21564780202e\" (UID: \"e6e6c195-64f0-44d6-8855-21564780202e\") "
Jul 30 13:36:26.908699 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:36:26.908654    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/02d0975f-119f-4366-b695-f88f232877cf-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "02d0975f-119f-4366-b695-f88f232877cf" (UID: "02d0975f-119f-4366-b695-f88f232877cf"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 30 13:36:26.908850 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:36:26.908825    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/26002646-0da5-452a-ae2d-9d638cf10333-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "26002646-0da5-452a-ae2d-9d638cf10333" (UID: "26002646-0da5-452a-ae2d-9d638cf10333"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 30 13:36:26.909014 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:36:26.908951    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e6e6c195-64f0-44d6-8855-21564780202e-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "e6e6c195-64f0-44d6-8855-21564780202e" (UID: "e6e6c195-64f0-44d6-8855-21564780202e"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 30 13:36:26.909299 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:36:26.909272    2566 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/26002646-0da5-452a-ae2d-9d638cf10333-openshift-service-ca\") on node \"ip-10-0-143-153.ec2.internal\" DevicePath \"\""
Jul 30 13:36:26.909416 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:36:26.909304    2566 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/02d0975f-119f-4366-b695-f88f232877cf-plugins-config-volume\") on node \"ip-10-0-143-153.ec2.internal\" DevicePath \"\""
Jul 30 13:36:26.909416 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:36:26.909321    2566 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/e6e6c195-64f0-44d6-8855-21564780202e-plugins-config-volume\") on node \"ip-10-0-143-153.ec2.internal\" DevicePath \"\""
Jul 30 13:36:26.912955 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:36:26.911256    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/02d0975f-119f-4366-b695-f88f232877cf-kube-api-access-6xvb6" (OuterVolumeSpecName: "kube-api-access-6xvb6") pod "02d0975f-119f-4366-b695-f88f232877cf" (UID: "02d0975f-119f-4366-b695-f88f232877cf"). InnerVolumeSpecName "kube-api-access-6xvb6". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 30 13:36:26.912955 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:36:26.911295    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/26002646-0da5-452a-ae2d-9d638cf10333-kube-api-access-gfpbj" (OuterVolumeSpecName: "kube-api-access-gfpbj") pod "26002646-0da5-452a-ae2d-9d638cf10333" (UID: "26002646-0da5-452a-ae2d-9d638cf10333"). InnerVolumeSpecName "kube-api-access-gfpbj". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 30 13:36:26.912955 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:36:26.911543    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e6e6c195-64f0-44d6-8855-21564780202e-kube-api-access-9dcx5" (OuterVolumeSpecName: "kube-api-access-9dcx5") pod "e6e6c195-64f0-44d6-8855-21564780202e" (UID: "e6e6c195-64f0-44d6-8855-21564780202e"). InnerVolumeSpecName "kube-api-access-9dcx5". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 30 13:36:26.916452 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:36:26.916425    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/26002646-0da5-452a-ae2d-9d638cf10333-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "26002646-0da5-452a-ae2d-9d638cf10333" (UID: "26002646-0da5-452a-ae2d-9d638cf10333"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 30 13:36:27.010649 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:36:27.010568    2566 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/26002646-0da5-452a-ae2d-9d638cf10333-maas-api-tls\") on node \"ip-10-0-143-153.ec2.internal\" DevicePath \"\""
Jul 30 13:36:27.010649 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:36:27.010602    2566 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-6xvb6\" (UniqueName: \"kubernetes.io/projected/02d0975f-119f-4366-b695-f88f232877cf-kube-api-access-6xvb6\") on node \"ip-10-0-143-153.ec2.internal\" DevicePath \"\""
Jul 30 13:36:27.010649 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:36:27.010614    2566 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-gfpbj\" (UniqueName: \"kubernetes.io/projected/26002646-0da5-452a-ae2d-9d638cf10333-kube-api-access-gfpbj\") on node \"ip-10-0-143-153.ec2.internal\" DevicePath \"\""
Jul 30 13:36:27.010649 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:36:27.010624    2566 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-9dcx5\" (UniqueName: \"kubernetes.io/projected/e6e6c195-64f0-44d6-8855-21564780202e-kube-api-access-9dcx5\") on node \"ip-10-0-143-153.ec2.internal\" DevicePath \"\""
Jul 30 13:36:27.521877 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:36:27.521839    2566 generic.go:356] "Generic (PLEG): container finished" podID="02d0975f-119f-4366-b695-f88f232877cf" containerID="da3119021ecde0e4856782f93787a24cc55a59932ce4d32bab278389e2d63f41" exitCode=0
Jul 30 13:36:27.522350 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:36:27.521880    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-mt-06db6c7f-69dcd44bc6-srmw2" event={"ID":"02d0975f-119f-4366-b695-f88f232877cf","Type":"ContainerDied","Data":"da3119021ecde0e4856782f93787a24cc55a59932ce4d32bab278389e2d63f41"}
Jul 30 13:36:27.522350 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:36:27.521937    2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-mt-06db6c7f-69dcd44bc6-srmw2"
Jul 30 13:36:27.522350 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:36:27.521995    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-mt-06db6c7f-69dcd44bc6-srmw2" event={"ID":"02d0975f-119f-4366-b695-f88f232877cf","Type":"ContainerDied","Data":"57bda52ab06949c5737f9e11a824ab5eedaeb343ec56a6919de0c9f5f085d7c1"}
Jul 30 13:36:27.522350 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:36:27.522034    2566 scope.go:117] "RemoveContainer" containerID="da3119021ecde0e4856782f93787a24cc55a59932ce4d32bab278389e2d63f41"
Jul 30 13:36:27.523631 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:36:27.523602    2566 generic.go:356] "Generic (PLEG): container finished" podID="26002646-0da5-452a-ae2d-9d638cf10333" containerID="4c0d6793caf53fc6cf7718bc1a2e20569710e2fe5a2fd3693bf5f791af538c78" exitCode=0
Jul 30 13:36:27.523733 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:36:27.523661    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-06db6c7f-787bd8c6f5-cx8ht" event={"ID":"26002646-0da5-452a-ae2d-9d638cf10333","Type":"ContainerDied","Data":"4c0d6793caf53fc6cf7718bc1a2e20569710e2fe5a2fd3693bf5f791af538c78"}
Jul 30 13:36:27.523733 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:36:27.523707    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-06db6c7f-787bd8c6f5-cx8ht" event={"ID":"26002646-0da5-452a-ae2d-9d638cf10333","Type":"ContainerDied","Data":"bcdd5da342429c22127b1ca89f8790f4843a49ac7f112bfccec863e8a2f1af8d"}
Jul 30 13:36:27.523733 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:36:27.523724    2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-06db6c7f-787bd8c6f5-cx8ht"
Jul 30 13:36:27.525282 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:36:27.525256    2566 generic.go:356] "Generic (PLEG): container finished" podID="e6e6c195-64f0-44d6-8855-21564780202e" containerID="12e40846fd6cf783c8df3e270561a236933205255c50c393f426292a1ff48eb4" exitCode=0
Jul 30 13:36:27.525407 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:36:27.525294    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-mt-06db6c7f-9d55ddbb6-qb4n8" event={"ID":"e6e6c195-64f0-44d6-8855-21564780202e","Type":"ContainerDied","Data":"12e40846fd6cf783c8df3e270561a236933205255c50c393f426292a1ff48eb4"}
Jul 30 13:36:27.525407 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:36:27.525336    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-mt-06db6c7f-9d55ddbb6-qb4n8" event={"ID":"e6e6c195-64f0-44d6-8855-21564780202e","Type":"ContainerDied","Data":"d169040832dc5ec2277b29fed76e7ceb0bf1b9de1646aa889b1da63253f804c9"}
Jul 30 13:36:27.525531 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:36:27.525416    2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-mt-06db6c7f-9d55ddbb6-qb4n8"
Jul 30 13:36:27.533516 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:36:27.533438    2566 scope.go:117] "RemoveContainer" containerID="da3119021ecde0e4856782f93787a24cc55a59932ce4d32bab278389e2d63f41"
Jul 30 13:36:27.533796 ip-10-0-143-153 kubenswrapper[2566]: E0730 13:36:27.533766    2566 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"da3119021ecde0e4856782f93787a24cc55a59932ce4d32bab278389e2d63f41\": container with ID starting with da3119021ecde0e4856782f93787a24cc55a59932ce4d32bab278389e2d63f41 not found: ID does not exist" containerID="da3119021ecde0e4856782f93787a24cc55a59932ce4d32bab278389e2d63f41"
Jul 30 13:36:27.533883 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:36:27.533807    2566 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"da3119021ecde0e4856782f93787a24cc55a59932ce4d32bab278389e2d63f41"} err="failed to get container status \"da3119021ecde0e4856782f93787a24cc55a59932ce4d32bab278389e2d63f41\": rpc error: code = NotFound desc = could not find container \"da3119021ecde0e4856782f93787a24cc55a59932ce4d32bab278389e2d63f41\": container with ID starting with da3119021ecde0e4856782f93787a24cc55a59932ce4d32bab278389e2d63f41 not found: ID does not exist"
Jul 30 13:36:27.533883 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:36:27.533829    2566 scope.go:117] "RemoveContainer" containerID="4c0d6793caf53fc6cf7718bc1a2e20569710e2fe5a2fd3693bf5f791af538c78"
Jul 30 13:36:27.543021 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:36:27.543004    2566 scope.go:117] "RemoveContainer" containerID="4c0d6793caf53fc6cf7718bc1a2e20569710e2fe5a2fd3693bf5f791af538c78"
Jul 30 13:36:27.543344 ip-10-0-143-153 kubenswrapper[2566]: E0730 13:36:27.543323    2566 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4c0d6793caf53fc6cf7718bc1a2e20569710e2fe5a2fd3693bf5f791af538c78\": container with ID starting with 4c0d6793caf53fc6cf7718bc1a2e20569710e2fe5a2fd3693bf5f791af538c78 not found: ID does not exist" containerID="4c0d6793caf53fc6cf7718bc1a2e20569710e2fe5a2fd3693bf5f791af538c78"
Jul 30 13:36:27.543429 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:36:27.543351    2566 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4c0d6793caf53fc6cf7718bc1a2e20569710e2fe5a2fd3693bf5f791af538c78"} err="failed to get container status \"4c0d6793caf53fc6cf7718bc1a2e20569710e2fe5a2fd3693bf5f791af538c78\": rpc error: code = NotFound desc = could not find container \"4c0d6793caf53fc6cf7718bc1a2e20569710e2fe5a2fd3693bf5f791af538c78\": container with ID starting with 4c0d6793caf53fc6cf7718bc1a2e20569710e2fe5a2fd3693bf5f791af538c78 not found: ID does not exist"
Jul 30 13:36:27.543429 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:36:27.543368    2566 scope.go:117] "RemoveContainer" containerID="12e40846fd6cf783c8df3e270561a236933205255c50c393f426292a1ff48eb4"
Jul 30 13:36:27.550799 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:36:27.550774    2566 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-06db6c7f-69dcd44bc6-srmw2"]
Jul 30 13:36:27.552486 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:36:27.552465    2566 scope.go:117] "RemoveContainer" containerID="12e40846fd6cf783c8df3e270561a236933205255c50c393f426292a1ff48eb4"
Jul 30 13:36:27.552764 ip-10-0-143-153 kubenswrapper[2566]: E0730 13:36:27.552744    2566 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"12e40846fd6cf783c8df3e270561a236933205255c50c393f426292a1ff48eb4\": container with ID starting with 12e40846fd6cf783c8df3e270561a236933205255c50c393f426292a1ff48eb4 not found: ID does not exist" containerID="12e40846fd6cf783c8df3e270561a236933205255c50c393f426292a1ff48eb4"
Jul 30 13:36:27.552824 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:36:27.552771    2566 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"12e40846fd6cf783c8df3e270561a236933205255c50c393f426292a1ff48eb4"} err="failed to get container status \"12e40846fd6cf783c8df3e270561a236933205255c50c393f426292a1ff48eb4\": rpc error: code = NotFound desc = could not find container \"12e40846fd6cf783c8df3e270561a236933205255c50c393f426292a1ff48eb4\": container with ID starting with 12e40846fd6cf783c8df3e270561a236933205255c50c393f426292a1ff48eb4 not found: ID does not exist"
Jul 30 13:36:27.552874 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:36:27.552845    2566 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-06db6c7f-69dcd44bc6-srmw2"]
Jul 30 13:36:27.562423 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:36:27.562400    2566 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-06db6c7f-787bd8c6f5-cx8ht"]
Jul 30 13:36:27.566545 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:36:27.566526    2566 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-06db6c7f-787bd8c6f5-cx8ht"]
Jul 30 13:36:27.576291 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:36:27.576269    2566 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-mt-06db6c7f-9d55ddbb6-qb4n8"]
Jul 30 13:36:27.580063 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:36:27.580044    2566 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-mt-06db6c7f-9d55ddbb6-qb4n8"]
Jul 30 13:36:27.628598 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:36:27.628562    2566 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="02d0975f-119f-4366-b695-f88f232877cf" path="/var/lib/kubelet/pods/02d0975f-119f-4366-b695-f88f232877cf/volumes"
Jul 30 13:36:27.628950 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:36:27.628937    2566 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="26002646-0da5-452a-ae2d-9d638cf10333" path="/var/lib/kubelet/pods/26002646-0da5-452a-ae2d-9d638cf10333/volumes"
Jul 30 13:36:27.629291 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:36:27.629280    2566 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e6e6c195-64f0-44d6-8855-21564780202e" path="/var/lib/kubelet/pods/e6e6c195-64f0-44d6-8855-21564780202e/volumes"
Jul 30 13:37:14.990556 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:37:14.990512    2566 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-2mqt2"]
Jul 30 13:37:14.991200 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:37:14.990747    2566 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-2mqt2" podUID="3601c772-17aa-4747-93ec-63d72243a5c9" containerName="manager" containerID="cri-o://c15caf267d4e9daad70c3906ae3f890a389e7330d2d408cdf24c1ab83c2624f6" gracePeriod=10
Jul 30 13:37:16.252281 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:37:16.252254    2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-2mqt2"
Jul 30 13:37:16.357260 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:37:16.357169    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/3601c772-17aa-4747-93ec-63d72243a5c9-extensions-socket-volume\") pod \"3601c772-17aa-4747-93ec-63d72243a5c9\" (UID: \"3601c772-17aa-4747-93ec-63d72243a5c9\") "
Jul 30 13:37:16.357260 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:37:16.357210    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-jd7hr\" (UniqueName: \"kubernetes.io/projected/3601c772-17aa-4747-93ec-63d72243a5c9-kube-api-access-jd7hr\") pod \"3601c772-17aa-4747-93ec-63d72243a5c9\" (UID: \"3601c772-17aa-4747-93ec-63d72243a5c9\") "
Jul 30 13:37:16.357667 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:37:16.357639    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3601c772-17aa-4747-93ec-63d72243a5c9-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "3601c772-17aa-4747-93ec-63d72243a5c9" (UID: "3601c772-17aa-4747-93ec-63d72243a5c9"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 30 13:37:16.359354 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:37:16.359331    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3601c772-17aa-4747-93ec-63d72243a5c9-kube-api-access-jd7hr" (OuterVolumeSpecName: "kube-api-access-jd7hr") pod "3601c772-17aa-4747-93ec-63d72243a5c9" (UID: "3601c772-17aa-4747-93ec-63d72243a5c9"). InnerVolumeSpecName "kube-api-access-jd7hr". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 30 13:37:16.457758 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:37:16.457721    2566 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/3601c772-17aa-4747-93ec-63d72243a5c9-extensions-socket-volume\") on node \"ip-10-0-143-153.ec2.internal\" DevicePath \"\""
Jul 30 13:37:16.457758 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:37:16.457747    2566 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-jd7hr\" (UniqueName: \"kubernetes.io/projected/3601c772-17aa-4747-93ec-63d72243a5c9-kube-api-access-jd7hr\") on node \"ip-10-0-143-153.ec2.internal\" DevicePath \"\""
Jul 30 13:37:16.770287 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:37:16.770248    2566 generic.go:356] "Generic (PLEG): container finished" podID="3601c772-17aa-4747-93ec-63d72243a5c9" containerID="c15caf267d4e9daad70c3906ae3f890a389e7330d2d408cdf24c1ab83c2624f6" exitCode=0
Jul 30 13:37:16.770287 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:37:16.770292    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-2mqt2" event={"ID":"3601c772-17aa-4747-93ec-63d72243a5c9","Type":"ContainerDied","Data":"c15caf267d4e9daad70c3906ae3f890a389e7330d2d408cdf24c1ab83c2624f6"}
Jul 30 13:37:16.770551 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:37:16.770297    2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-2mqt2"
Jul 30 13:37:16.770551 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:37:16.770344    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-2mqt2" event={"ID":"3601c772-17aa-4747-93ec-63d72243a5c9","Type":"ContainerDied","Data":"1c46d29f883ed61341a7cba251e9179b517f73830f2235ff7ef6e339206f8506"}
Jul 30 13:37:16.770551 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:37:16.770370    2566 scope.go:117] "RemoveContainer" containerID="c15caf267d4e9daad70c3906ae3f890a389e7330d2d408cdf24c1ab83c2624f6"
Jul 30 13:37:16.781171 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:37:16.781148    2566 scope.go:117] "RemoveContainer" containerID="c15caf267d4e9daad70c3906ae3f890a389e7330d2d408cdf24c1ab83c2624f6"
Jul 30 13:37:16.781472 ip-10-0-143-153 kubenswrapper[2566]: E0730 13:37:16.781449    2566 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c15caf267d4e9daad70c3906ae3f890a389e7330d2d408cdf24c1ab83c2624f6\": container with ID starting with c15caf267d4e9daad70c3906ae3f890a389e7330d2d408cdf24c1ab83c2624f6 not found: ID does not exist" containerID="c15caf267d4e9daad70c3906ae3f890a389e7330d2d408cdf24c1ab83c2624f6"
Jul 30 13:37:16.781553 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:37:16.781479    2566 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c15caf267d4e9daad70c3906ae3f890a389e7330d2d408cdf24c1ab83c2624f6"} err="failed to get container status \"c15caf267d4e9daad70c3906ae3f890a389e7330d2d408cdf24c1ab83c2624f6\": rpc error: code = NotFound desc = could not find container \"c15caf267d4e9daad70c3906ae3f890a389e7330d2d408cdf24c1ab83c2624f6\": container with ID starting with c15caf267d4e9daad70c3906ae3f890a389e7330d2d408cdf24c1ab83c2624f6 not found: ID does not exist"
Jul 30 13:37:16.791729 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:37:16.791703    2566 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-2mqt2"]
Jul 30 13:37:16.798500 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:37:16.798478    2566 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-2mqt2"]
Jul 30 13:37:17.198125 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:37:17.198069    2566 prober.go:120] "Probe failed" probeType="Readiness" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-2mqt2" podUID="3601c772-17aa-4747-93ec-63d72243a5c9" containerName="manager" probeResult="failure" output="Get \"http://10.133.0.51:8081/readyz\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Jul 30 13:37:17.627798 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:37:17.627715    2566 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="3601c772-17aa-4747-93ec-63d72243a5c9" path="/var/lib/kubelet/pods/3601c772-17aa-4747-93ec-63d72243a5c9/volumes"
Jul 30 13:38:30.633619 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:38:30.633534    2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-hpvp8"]
Jul 30 13:38:30.634177 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:38:30.633914    2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="26002646-0da5-452a-ae2d-9d638cf10333" containerName="maas-api"
Jul 30 13:38:30.634177 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:38:30.633925    2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="26002646-0da5-452a-ae2d-9d638cf10333" containerName="maas-api"
Jul 30 13:38:30.634177 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:38:30.633946    2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3601c772-17aa-4747-93ec-63d72243a5c9" containerName="manager"
Jul 30 13:38:30.634177 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:38:30.633951    2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="3601c772-17aa-4747-93ec-63d72243a5c9" containerName="manager"
Jul 30 13:38:30.634177 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:38:30.633957    2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="02d0975f-119f-4366-b695-f88f232877cf" containerName="payload-pre-processing"
Jul 30 13:38:30.634177 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:38:30.633963    2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="02d0975f-119f-4366-b695-f88f232877cf" containerName="payload-pre-processing"
Jul 30 13:38:30.634177 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:38:30.633969    2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e6e6c195-64f0-44d6-8855-21564780202e" containerName="payload-processing"
Jul 30 13:38:30.634177 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:38:30.633974    2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="e6e6c195-64f0-44d6-8855-21564780202e" containerName="payload-processing"
Jul 30 13:38:30.634177 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:38:30.634024    2566 memory_manager.go:368] "RemoveStaleState removing state" podUID="3601c772-17aa-4747-93ec-63d72243a5c9" containerName="manager"
Jul 30 13:38:30.634177 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:38:30.634034    2566 memory_manager.go:368] "RemoveStaleState removing state" podUID="e6e6c195-64f0-44d6-8855-21564780202e" containerName="payload-processing"
Jul 30 13:38:30.634177 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:38:30.634043    2566 memory_manager.go:368] "RemoveStaleState removing state" podUID="02d0975f-119f-4366-b695-f88f232877cf" containerName="payload-pre-processing"
Jul 30 13:38:30.634177 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:38:30.634051    2566 memory_manager.go:368] "RemoveStaleState removing state" podUID="26002646-0da5-452a-ae2d-9d638cf10333" containerName="maas-api"
Jul 30 13:38:30.637181 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:38:30.637164    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-hpvp8"
Jul 30 13:38:30.639109 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:38:30.639090    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-hxg6w\""
Jul 30 13:38:30.648618 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:38:30.648594    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-hpvp8"]
Jul 30 13:38:30.699262 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:38:30.699227    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/12228031-211e-4518-bad3-3fe90cde4177-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-hpvp8\" (UID: \"12228031-211e-4518-bad3-3fe90cde4177\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-hpvp8"
Jul 30 13:38:30.699459 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:38:30.699297    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-z9t9z\" (UniqueName: \"kubernetes.io/projected/12228031-211e-4518-bad3-3fe90cde4177-kube-api-access-z9t9z\") pod \"kuadrant-operator-controller-manager-86878c769f-hpvp8\" (UID: \"12228031-211e-4518-bad3-3fe90cde4177\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-hpvp8"
Jul 30 13:38:30.799983 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:38:30.799943    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/12228031-211e-4518-bad3-3fe90cde4177-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-hpvp8\" (UID: \"12228031-211e-4518-bad3-3fe90cde4177\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-hpvp8"
Jul 30 13:38:30.800205 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:38:30.800017    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-z9t9z\" (UniqueName: \"kubernetes.io/projected/12228031-211e-4518-bad3-3fe90cde4177-kube-api-access-z9t9z\") pod \"kuadrant-operator-controller-manager-86878c769f-hpvp8\" (UID: \"12228031-211e-4518-bad3-3fe90cde4177\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-hpvp8"
Jul 30 13:38:30.800377 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:38:30.800346    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/12228031-211e-4518-bad3-3fe90cde4177-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-hpvp8\" (UID: \"12228031-211e-4518-bad3-3fe90cde4177\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-hpvp8"
Jul 30 13:38:30.808718 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:38:30.808696    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-z9t9z\" (UniqueName: \"kubernetes.io/projected/12228031-211e-4518-bad3-3fe90cde4177-kube-api-access-z9t9z\") pod \"kuadrant-operator-controller-manager-86878c769f-hpvp8\" (UID: \"12228031-211e-4518-bad3-3fe90cde4177\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-hpvp8"
Jul 30 13:38:30.947750 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:38:30.947656    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-hpvp8"
Jul 30 13:38:31.091313 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:38:31.091285    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-hpvp8"]
Jul 30 13:38:31.093579 ip-10-0-143-153 kubenswrapper[2566]: W0730 13:38:31.093551    2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod12228031_211e_4518_bad3_3fe90cde4177.slice/crio-1955de679da774eee097defd0b80012c463ab98955a029182e0fc5f88c06224d WatchSource:0}: Error finding container 1955de679da774eee097defd0b80012c463ab98955a029182e0fc5f88c06224d: Status 404 returned error can't find the container with id 1955de679da774eee097defd0b80012c463ab98955a029182e0fc5f88c06224d
Jul 30 13:38:31.127702 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:38:31.127674    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-hpvp8" event={"ID":"12228031-211e-4518-bad3-3fe90cde4177","Type":"ContainerStarted","Data":"1955de679da774eee097defd0b80012c463ab98955a029182e0fc5f88c06224d"}
Jul 30 13:38:32.134365 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:38:32.134330    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-hpvp8" event={"ID":"12228031-211e-4518-bad3-3fe90cde4177","Type":"ContainerStarted","Data":"c44a8d4bd585fd7ae1723d84106a66e49c21a0fb2ec295ef9a87050e4ab06d24"}
Jul 30 13:38:32.134749 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:38:32.134465    2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-hpvp8"
Jul 30 13:38:32.153386 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:38:32.153338    2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-hpvp8" podStartSLOduration=2.153322954 podStartE2EDuration="2.153322954s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-30 13:38:30 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 13:38:32.150914754 +0000 UTC m=+2341.079603031" watchObservedRunningTime="2026-07-30 13:38:32.153322954 +0000 UTC m=+2341.082011216"
Jul 30 13:38:43.141199 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:38:43.141165    2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-hpvp8"
Jul 30 13:38:53.667288 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:38:53.667256    2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-85370406-65fbcdc5b6-59t9d"]
Jul 30 13:38:53.670929 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:38:53.670908    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-85370406-65fbcdc5b6-59t9d"
Jul 30 13:38:53.674605 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:38:53.674580    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-mt-85370406-serving-cert\""
Jul 30 13:38:53.682699 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:38:53.682673    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-85370406-65fbcdc5b6-59t9d"]
Jul 30 13:38:53.802613 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:38:53.802577    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5k4bf\" (UniqueName: \"kubernetes.io/projected/37f11109-b630-409b-9844-171e5963d392-kube-api-access-5k4bf\") pod \"maas-api-e2e-mt-85370406-65fbcdc5b6-59t9d\" (UID: \"37f11109-b630-409b-9844-171e5963d392\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-85370406-65fbcdc5b6-59t9d"
Jul 30 13:38:53.802781 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:38:53.802625    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/37f11109-b630-409b-9844-171e5963d392-maas-api-tls\") pod \"maas-api-e2e-mt-85370406-65fbcdc5b6-59t9d\" (UID: \"37f11109-b630-409b-9844-171e5963d392\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-85370406-65fbcdc5b6-59t9d"
Jul 30 13:38:53.802781 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:38:53.802642    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/37f11109-b630-409b-9844-171e5963d392-openshift-service-ca\") pod \"maas-api-e2e-mt-85370406-65fbcdc5b6-59t9d\" (UID: \"37f11109-b630-409b-9844-171e5963d392\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-85370406-65fbcdc5b6-59t9d"
Jul 30 13:38:53.903947 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:38:53.903910    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/37f11109-b630-409b-9844-171e5963d392-maas-api-tls\") pod \"maas-api-e2e-mt-85370406-65fbcdc5b6-59t9d\" (UID: \"37f11109-b630-409b-9844-171e5963d392\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-85370406-65fbcdc5b6-59t9d"
Jul 30 13:38:53.904161 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:38:53.903950    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/37f11109-b630-409b-9844-171e5963d392-openshift-service-ca\") pod \"maas-api-e2e-mt-85370406-65fbcdc5b6-59t9d\" (UID: \"37f11109-b630-409b-9844-171e5963d392\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-85370406-65fbcdc5b6-59t9d"
Jul 30 13:38:53.904161 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:38:53.904070    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5k4bf\" (UniqueName: \"kubernetes.io/projected/37f11109-b630-409b-9844-171e5963d392-kube-api-access-5k4bf\") pod \"maas-api-e2e-mt-85370406-65fbcdc5b6-59t9d\" (UID: \"37f11109-b630-409b-9844-171e5963d392\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-85370406-65fbcdc5b6-59t9d"
Jul 30 13:38:53.904743 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:38:53.904722    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/37f11109-b630-409b-9844-171e5963d392-openshift-service-ca\") pod \"maas-api-e2e-mt-85370406-65fbcdc5b6-59t9d\" (UID: \"37f11109-b630-409b-9844-171e5963d392\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-85370406-65fbcdc5b6-59t9d"
Jul 30 13:38:53.906669 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:38:53.906640    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/37f11109-b630-409b-9844-171e5963d392-maas-api-tls\") pod \"maas-api-e2e-mt-85370406-65fbcdc5b6-59t9d\" (UID: \"37f11109-b630-409b-9844-171e5963d392\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-85370406-65fbcdc5b6-59t9d"
Jul 30 13:38:53.914267 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:38:53.914243    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5k4bf\" (UniqueName: \"kubernetes.io/projected/37f11109-b630-409b-9844-171e5963d392-kube-api-access-5k4bf\") pod \"maas-api-e2e-mt-85370406-65fbcdc5b6-59t9d\" (UID: \"37f11109-b630-409b-9844-171e5963d392\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-85370406-65fbcdc5b6-59t9d"
Jul 30 13:38:53.983295 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:38:53.983207    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-85370406-65fbcdc5b6-59t9d"
Jul 30 13:38:54.146275 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:38:54.146237    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-85370406-65fbcdc5b6-59t9d"]
Jul 30 13:38:54.150310 ip-10-0-143-153 kubenswrapper[2566]: W0730 13:38:54.150284    2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod37f11109_b630_409b_9844_171e5963d392.slice/crio-2e9fcd4228e85cbd7456c8c09ddc8b2a4e4aae2413f14db9ee0078c38dc69bb2 WatchSource:0}: Error finding container 2e9fcd4228e85cbd7456c8c09ddc8b2a4e4aae2413f14db9ee0078c38dc69bb2: Status 404 returned error can't find the container with id 2e9fcd4228e85cbd7456c8c09ddc8b2a4e4aae2413f14db9ee0078c38dc69bb2
Jul 30 13:38:54.151922 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:38:54.151901    2566 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 30 13:38:54.263113 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:38:54.262978    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-85370406-65fbcdc5b6-59t9d" event={"ID":"37f11109-b630-409b-9844-171e5963d392","Type":"ContainerStarted","Data":"2e9fcd4228e85cbd7456c8c09ddc8b2a4e4aae2413f14db9ee0078c38dc69bb2"}
Jul 30 13:38:54.574957 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:38:54.574867    2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-85370406-74c56c6f5b-xjp85"]
Jul 30 13:38:54.579510 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:38:54.579486    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-mt-85370406-74c56c6f5b-xjp85"
Jul 30 13:38:54.581737 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:38:54.581708    2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-mt-85370406\""
Jul 30 13:38:54.589963 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:38:54.589934    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-85370406-74c56c6f5b-xjp85"]
Jul 30 13:38:54.621349 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:38:54.621311    2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-mt-85370406-995875f66-554l2"]
Jul 30 13:38:54.625296 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:38:54.625274    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-mt-85370406-995875f66-554l2"
Jul 30 13:38:54.627288 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:38:54.627266    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-mt-85370406-dockercfg-9p29h\""
Jul 30 13:38:54.636319 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:38:54.636290    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-mt-85370406-995875f66-554l2"]
Jul 30 13:38:54.711922 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:38:54.711888    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/b6e7a82c-1483-4cb5-a544-acf674e994c8-plugins-config-volume\") pod \"payload-pre-processing-e2e-mt-85370406-74c56c6f5b-xjp85\" (UID: \"b6e7a82c-1483-4cb5-a544-acf674e994c8\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-85370406-74c56c6f5b-xjp85"
Jul 30 13:38:54.711922 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:38:54.711935    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-h2w4h\" (UniqueName: \"kubernetes.io/projected/ee08e42f-8d96-4dc8-b274-de06bf4ea0e5-kube-api-access-h2w4h\") pod \"payload-processing-e2e-mt-85370406-995875f66-554l2\" (UID: \"ee08e42f-8d96-4dc8-b274-de06bf4ea0e5\") " pod="openshift-ingress/payload-processing-e2e-mt-85370406-995875f66-554l2"
Jul 30 13:38:54.712481 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:38:54.712023    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6kfz2\" (UniqueName: \"kubernetes.io/projected/b6e7a82c-1483-4cb5-a544-acf674e994c8-kube-api-access-6kfz2\") pod \"payload-pre-processing-e2e-mt-85370406-74c56c6f5b-xjp85\" (UID: \"b6e7a82c-1483-4cb5-a544-acf674e994c8\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-85370406-74c56c6f5b-xjp85"
Jul 30 13:38:54.712481 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:38:54.712057    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/ee08e42f-8d96-4dc8-b274-de06bf4ea0e5-plugins-config-volume\") pod \"payload-processing-e2e-mt-85370406-995875f66-554l2\" (UID: \"ee08e42f-8d96-4dc8-b274-de06bf4ea0e5\") " pod="openshift-ingress/payload-processing-e2e-mt-85370406-995875f66-554l2"
Jul 30 13:38:54.813023 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:38:54.812986    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/b6e7a82c-1483-4cb5-a544-acf674e994c8-plugins-config-volume\") pod \"payload-pre-processing-e2e-mt-85370406-74c56c6f5b-xjp85\" (UID: \"b6e7a82c-1483-4cb5-a544-acf674e994c8\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-85370406-74c56c6f5b-xjp85"
Jul 30 13:38:54.813257 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:38:54.813039    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-h2w4h\" (UniqueName: \"kubernetes.io/projected/ee08e42f-8d96-4dc8-b274-de06bf4ea0e5-kube-api-access-h2w4h\") pod \"payload-processing-e2e-mt-85370406-995875f66-554l2\" (UID: \"ee08e42f-8d96-4dc8-b274-de06bf4ea0e5\") " pod="openshift-ingress/payload-processing-e2e-mt-85370406-995875f66-554l2"
Jul 30 13:38:54.813257 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:38:54.813104    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6kfz2\" (UniqueName: \"kubernetes.io/projected/b6e7a82c-1483-4cb5-a544-acf674e994c8-kube-api-access-6kfz2\") pod \"payload-pre-processing-e2e-mt-85370406-74c56c6f5b-xjp85\" (UID: \"b6e7a82c-1483-4cb5-a544-acf674e994c8\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-85370406-74c56c6f5b-xjp85"
Jul 30 13:38:54.813257 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:38:54.813130    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/ee08e42f-8d96-4dc8-b274-de06bf4ea0e5-plugins-config-volume\") pod \"payload-processing-e2e-mt-85370406-995875f66-554l2\" (UID: \"ee08e42f-8d96-4dc8-b274-de06bf4ea0e5\") " pod="openshift-ingress/payload-processing-e2e-mt-85370406-995875f66-554l2"
Jul 30 13:38:54.813835 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:38:54.813808    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/ee08e42f-8d96-4dc8-b274-de06bf4ea0e5-plugins-config-volume\") pod \"payload-processing-e2e-mt-85370406-995875f66-554l2\" (UID: \"ee08e42f-8d96-4dc8-b274-de06bf4ea0e5\") " pod="openshift-ingress/payload-processing-e2e-mt-85370406-995875f66-554l2"
Jul 30 13:38:54.813951 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:38:54.813932    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/b6e7a82c-1483-4cb5-a544-acf674e994c8-plugins-config-volume\") pod \"payload-pre-processing-e2e-mt-85370406-74c56c6f5b-xjp85\" (UID: \"b6e7a82c-1483-4cb5-a544-acf674e994c8\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-85370406-74c56c6f5b-xjp85"
Jul 30 13:38:54.821464 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:38:54.821435    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6kfz2\" (UniqueName: \"kubernetes.io/projected/b6e7a82c-1483-4cb5-a544-acf674e994c8-kube-api-access-6kfz2\") pod \"payload-pre-processing-e2e-mt-85370406-74c56c6f5b-xjp85\" (UID: \"b6e7a82c-1483-4cb5-a544-acf674e994c8\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-85370406-74c56c6f5b-xjp85"
Jul 30 13:38:54.821464 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:38:54.821457    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-h2w4h\" (UniqueName: \"kubernetes.io/projected/ee08e42f-8d96-4dc8-b274-de06bf4ea0e5-kube-api-access-h2w4h\") pod \"payload-processing-e2e-mt-85370406-995875f66-554l2\" (UID: \"ee08e42f-8d96-4dc8-b274-de06bf4ea0e5\") " pod="openshift-ingress/payload-processing-e2e-mt-85370406-995875f66-554l2"
Jul 30 13:38:54.893482 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:38:54.893449    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-mt-85370406-74c56c6f5b-xjp85"
Jul 30 13:38:54.936319 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:38:54.936287    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-mt-85370406-995875f66-554l2"
Jul 30 13:38:55.097102 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:38:55.095881    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-85370406-74c56c6f5b-xjp85"]
Jul 30 13:38:55.118434 ip-10-0-143-153 kubenswrapper[2566]: W0730 13:38:55.118390    2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb6e7a82c_1483_4cb5_a544_acf674e994c8.slice/crio-a780269e7386cdf5e4f8994d7c56ca9b928cd5b654ae78acbb028c86bd241a0e WatchSource:0}: Error finding container a780269e7386cdf5e4f8994d7c56ca9b928cd5b654ae78acbb028c86bd241a0e: Status 404 returned error can't find the container with id a780269e7386cdf5e4f8994d7c56ca9b928cd5b654ae78acbb028c86bd241a0e
Jul 30 13:38:55.269499 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:38:55.269463    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-85370406-65fbcdc5b6-59t9d" event={"ID":"37f11109-b630-409b-9844-171e5963d392","Type":"ContainerStarted","Data":"cb1365c4ca3a46a18cda99768e4864de173405a47c69f5a27641833b1329b324"}
Jul 30 13:38:55.269679 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:38:55.269581    2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-mt-85370406-65fbcdc5b6-59t9d"
Jul 30 13:38:55.271102 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:38:55.271053    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-mt-85370406-74c56c6f5b-xjp85" event={"ID":"b6e7a82c-1483-4cb5-a544-acf674e994c8","Type":"ContainerStarted","Data":"388ddfcc36e18f5a61b55bab301187137299c5aeed14406fee91592537ff5aeb"}
Jul 30 13:38:55.271238 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:38:55.271115    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-mt-85370406-74c56c6f5b-xjp85" event={"ID":"b6e7a82c-1483-4cb5-a544-acf674e994c8","Type":"ContainerStarted","Data":"a780269e7386cdf5e4f8994d7c56ca9b928cd5b654ae78acbb028c86bd241a0e"}
Jul 30 13:38:55.271238 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:38:55.271206    2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-mt-85370406-74c56c6f5b-xjp85"
Jul 30 13:38:55.291660 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:38:55.291600    2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-mt-85370406-65fbcdc5b6-59t9d" podStartSLOduration=1.5151985 podStartE2EDuration="2.291582964s" totalImagesPullingTime="776.384464ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-30 13:38:53 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 13:38:55.289749881 +0000 UTC m=+2364.218438147" watchObservedRunningTime="2026-07-30 13:38:55.291582964 +0000 UTC m=+2364.220271229"
Jul 30 13:38:55.351879 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:38:55.351816    2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-mt-85370406-74c56c6f5b-xjp85" podStartSLOduration=1.351794415 podStartE2EDuration="1.351794415s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-30 13:38:54 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 13:38:55.309364869 +0000 UTC m=+2364.238053132" watchObservedRunningTime="2026-07-30 13:38:55.351794415 +0000 UTC m=+2364.280482680"
Jul 30 13:38:55.353739 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:38:55.353679    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-mt-85370406-995875f66-554l2"]
Jul 30 13:38:55.356637 ip-10-0-143-153 kubenswrapper[2566]: W0730 13:38:55.356611    2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podee08e42f_8d96_4dc8_b274_de06bf4ea0e5.slice/crio-af8a7a35d149f7617c670730a99c298a5c4dd607e43a9b44bb6fae1931dc19e5 WatchSource:0}: Error finding container af8a7a35d149f7617c670730a99c298a5c4dd607e43a9b44bb6fae1931dc19e5: Status 404 returned error can't find the container with id af8a7a35d149f7617c670730a99c298a5c4dd607e43a9b44bb6fae1931dc19e5
Jul 30 13:38:56.277362 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:38:56.277321    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-mt-85370406-995875f66-554l2" event={"ID":"ee08e42f-8d96-4dc8-b274-de06bf4ea0e5","Type":"ContainerStarted","Data":"016c3bd18d8aebcbbf8eaac30c25895ea2dbe545ed8711a00869607973ed8997"}
Jul 30 13:38:56.277850 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:38:56.277387    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-mt-85370406-995875f66-554l2" event={"ID":"ee08e42f-8d96-4dc8-b274-de06bf4ea0e5","Type":"ContainerStarted","Data":"af8a7a35d149f7617c670730a99c298a5c4dd607e43a9b44bb6fae1931dc19e5"}
Jul 30 13:38:56.277850 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:38:56.277529    2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-mt-85370406-995875f66-554l2"
Jul 30 13:38:56.294424 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:38:56.294375    2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-mt-85370406-995875f66-554l2" podStartSLOduration=2.294360367 podStartE2EDuration="2.294360367s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-30 13:38:54 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 13:38:56.292275659 +0000 UTC m=+2365.220963922" watchObservedRunningTime="2026-07-30 13:38:56.294360367 +0000 UTC m=+2365.223048629"
Jul 30 13:39:01.284053 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:39:01.284021    2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-mt-85370406-65fbcdc5b6-59t9d"
Jul 30 13:39:06.279561 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:39:06.279506    2566 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/payload-pre-processing-e2e-mt-85370406-74c56c6f5b-xjp85" podUID="b6e7a82c-1483-4cb5-a544-acf674e994c8" containerName="payload-pre-processing" probeResult="failure" output="dial tcp 10.133.0.70:9004: connect: connection refused"
Jul 30 13:39:07.286252 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:39:07.286220    2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-mt-85370406-995875f66-554l2"
Jul 30 13:39:16.278814 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:39:16.278782    2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-mt-85370406-74c56c6f5b-xjp85"
Jul 30 13:39:31.741131 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:39:31.741104    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-bzl6w_51cdacbf-3a14-47c0-8fd4-69b0b2be0e64/console-operator/1.log"
Jul 30 13:39:31.745878 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:39:31.745857    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-bzl6w_51cdacbf-3a14-47c0-8fd4-69b0b2be0e64/console-operator/1.log"
Jul 30 13:39:31.746010 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:39:31.745909    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-f6br6_3ebbc209-4373-44d8-a22e-d2d2aa4cbfa6/ovn-acl-logging/0.log"
Jul 30 13:39:31.750627 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:39:31.750609    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-f6br6_3ebbc209-4373-44d8-a22e-d2d2aa4cbfa6/ovn-acl-logging/0.log"
Jul 30 13:40:17.976191 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:40:17.976153    2566 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-85370406-65fbcdc5b6-59t9d"]
Jul 30 13:40:17.976729 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:40:17.976414    2566 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-mt-85370406-65fbcdc5b6-59t9d" podUID="37f11109-b630-409b-9844-171e5963d392" containerName="maas-api" containerID="cri-o://cb1365c4ca3a46a18cda99768e4864de173405a47c69f5a27641833b1329b324" gracePeriod=30
Jul 30 13:40:18.127751 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:40:18.127715    2566 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-mt-85370406-995875f66-554l2"]
Jul 30 13:40:18.127988 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:40:18.127964    2566 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-mt-85370406-995875f66-554l2" podUID="ee08e42f-8d96-4dc8-b274-de06bf4ea0e5" containerName="payload-processing" containerID="cri-o://016c3bd18d8aebcbbf8eaac30c25895ea2dbe545ed8711a00869607973ed8997" gracePeriod=30
Jul 30 13:40:18.144915 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:40:18.144883    2566 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-85370406-74c56c6f5b-xjp85"]
Jul 30 13:40:18.145186 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:40:18.145158    2566 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-mt-85370406-74c56c6f5b-xjp85" podUID="b6e7a82c-1483-4cb5-a544-acf674e994c8" containerName="payload-pre-processing" containerID="cri-o://388ddfcc36e18f5a61b55bab301187137299c5aeed14406fee91592537ff5aeb" gracePeriod=30
Jul 30 13:40:18.271399 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:40:18.271374    2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-85370406-65fbcdc5b6-59t9d"
Jul 30 13:40:18.360007 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:40:18.359980    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/37f11109-b630-409b-9844-171e5963d392-maas-api-tls\") pod \"37f11109-b630-409b-9844-171e5963d392\" (UID: \"37f11109-b630-409b-9844-171e5963d392\") "
Jul 30 13:40:18.360203 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:40:18.360040    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-5k4bf\" (UniqueName: \"kubernetes.io/projected/37f11109-b630-409b-9844-171e5963d392-kube-api-access-5k4bf\") pod \"37f11109-b630-409b-9844-171e5963d392\" (UID: \"37f11109-b630-409b-9844-171e5963d392\") "
Jul 30 13:40:18.360203 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:40:18.360114    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/37f11109-b630-409b-9844-171e5963d392-openshift-service-ca\") pod \"37f11109-b630-409b-9844-171e5963d392\" (UID: \"37f11109-b630-409b-9844-171e5963d392\") "
Jul 30 13:40:18.360749 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:40:18.360719    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/37f11109-b630-409b-9844-171e5963d392-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "37f11109-b630-409b-9844-171e5963d392" (UID: "37f11109-b630-409b-9844-171e5963d392"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 30 13:40:18.362358 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:40:18.362326    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/37f11109-b630-409b-9844-171e5963d392-kube-api-access-5k4bf" (OuterVolumeSpecName: "kube-api-access-5k4bf") pod "37f11109-b630-409b-9844-171e5963d392" (UID: "37f11109-b630-409b-9844-171e5963d392"). InnerVolumeSpecName "kube-api-access-5k4bf". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 30 13:40:18.362811 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:40:18.362789    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/37f11109-b630-409b-9844-171e5963d392-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "37f11109-b630-409b-9844-171e5963d392" (UID: "37f11109-b630-409b-9844-171e5963d392"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 30 13:40:18.409147 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:40:18.409120    2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-mt-85370406-995875f66-554l2"
Jul 30 13:40:18.418061 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:40:18.418035    2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-mt-85370406-74c56c6f5b-xjp85"
Jul 30 13:40:18.461414 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:40:18.461380    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-h2w4h\" (UniqueName: \"kubernetes.io/projected/ee08e42f-8d96-4dc8-b274-de06bf4ea0e5-kube-api-access-h2w4h\") pod \"ee08e42f-8d96-4dc8-b274-de06bf4ea0e5\" (UID: \"ee08e42f-8d96-4dc8-b274-de06bf4ea0e5\") "
Jul 30 13:40:18.461414 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:40:18.461425    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/ee08e42f-8d96-4dc8-b274-de06bf4ea0e5-plugins-config-volume\") pod \"ee08e42f-8d96-4dc8-b274-de06bf4ea0e5\" (UID: \"ee08e42f-8d96-4dc8-b274-de06bf4ea0e5\") "
Jul 30 13:40:18.461716 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:40:18.461446    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-6kfz2\" (UniqueName: \"kubernetes.io/projected/b6e7a82c-1483-4cb5-a544-acf674e994c8-kube-api-access-6kfz2\") pod \"b6e7a82c-1483-4cb5-a544-acf674e994c8\" (UID: \"b6e7a82c-1483-4cb5-a544-acf674e994c8\") "
Jul 30 13:40:18.461716 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:40:18.461506    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/b6e7a82c-1483-4cb5-a544-acf674e994c8-plugins-config-volume\") pod \"b6e7a82c-1483-4cb5-a544-acf674e994c8\" (UID: \"b6e7a82c-1483-4cb5-a544-acf674e994c8\") "
Jul 30 13:40:18.461835 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:40:18.461764    2566 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/37f11109-b630-409b-9844-171e5963d392-maas-api-tls\") on node \"ip-10-0-143-153.ec2.internal\" DevicePath \"\""
Jul 30 13:40:18.461835 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:40:18.461778    2566 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-5k4bf\" (UniqueName: \"kubernetes.io/projected/37f11109-b630-409b-9844-171e5963d392-kube-api-access-5k4bf\") on node \"ip-10-0-143-153.ec2.internal\" DevicePath \"\""
Jul 30 13:40:18.461835 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:40:18.461789    2566 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/37f11109-b630-409b-9844-171e5963d392-openshift-service-ca\") on node \"ip-10-0-143-153.ec2.internal\" DevicePath \"\""
Jul 30 13:40:18.461998 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:40:18.461948    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ee08e42f-8d96-4dc8-b274-de06bf4ea0e5-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "ee08e42f-8d96-4dc8-b274-de06bf4ea0e5" (UID: "ee08e42f-8d96-4dc8-b274-de06bf4ea0e5"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 30 13:40:18.462051 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:40:18.462001    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b6e7a82c-1483-4cb5-a544-acf674e994c8-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "b6e7a82c-1483-4cb5-a544-acf674e994c8" (UID: "b6e7a82c-1483-4cb5-a544-acf674e994c8"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 30 13:40:18.464070 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:40:18.464043    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b6e7a82c-1483-4cb5-a544-acf674e994c8-kube-api-access-6kfz2" (OuterVolumeSpecName: "kube-api-access-6kfz2") pod "b6e7a82c-1483-4cb5-a544-acf674e994c8" (UID: "b6e7a82c-1483-4cb5-a544-acf674e994c8"). InnerVolumeSpecName "kube-api-access-6kfz2". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 30 13:40:18.464202 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:40:18.464088    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ee08e42f-8d96-4dc8-b274-de06bf4ea0e5-kube-api-access-h2w4h" (OuterVolumeSpecName: "kube-api-access-h2w4h") pod "ee08e42f-8d96-4dc8-b274-de06bf4ea0e5" (UID: "ee08e42f-8d96-4dc8-b274-de06bf4ea0e5"). InnerVolumeSpecName "kube-api-access-h2w4h". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 30 13:40:18.562451 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:40:18.562361    2566 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-h2w4h\" (UniqueName: \"kubernetes.io/projected/ee08e42f-8d96-4dc8-b274-de06bf4ea0e5-kube-api-access-h2w4h\") on node \"ip-10-0-143-153.ec2.internal\" DevicePath \"\""
Jul 30 13:40:18.562451 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:40:18.562392    2566 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/ee08e42f-8d96-4dc8-b274-de06bf4ea0e5-plugins-config-volume\") on node \"ip-10-0-143-153.ec2.internal\" DevicePath \"\""
Jul 30 13:40:18.562451 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:40:18.562402    2566 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-6kfz2\" (UniqueName: \"kubernetes.io/projected/b6e7a82c-1483-4cb5-a544-acf674e994c8-kube-api-access-6kfz2\") on node \"ip-10-0-143-153.ec2.internal\" DevicePath \"\""
Jul 30 13:40:18.562451 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:40:18.562410    2566 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/b6e7a82c-1483-4cb5-a544-acf674e994c8-plugins-config-volume\") on node \"ip-10-0-143-153.ec2.internal\" DevicePath \"\""
Jul 30 13:40:18.707089 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:40:18.707042    2566 generic.go:356] "Generic (PLEG): container finished" podID="37f11109-b630-409b-9844-171e5963d392" containerID="cb1365c4ca3a46a18cda99768e4864de173405a47c69f5a27641833b1329b324" exitCode=0
Jul 30 13:40:18.707296 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:40:18.707106    2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-85370406-65fbcdc5b6-59t9d"
Jul 30 13:40:18.707296 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:40:18.707142    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-85370406-65fbcdc5b6-59t9d" event={"ID":"37f11109-b630-409b-9844-171e5963d392","Type":"ContainerDied","Data":"cb1365c4ca3a46a18cda99768e4864de173405a47c69f5a27641833b1329b324"}
Jul 30 13:40:18.707296 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:40:18.707204    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-85370406-65fbcdc5b6-59t9d" event={"ID":"37f11109-b630-409b-9844-171e5963d392","Type":"ContainerDied","Data":"2e9fcd4228e85cbd7456c8c09ddc8b2a4e4aae2413f14db9ee0078c38dc69bb2"}
Jul 30 13:40:18.707296 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:40:18.707235    2566 scope.go:117] "RemoveContainer" containerID="cb1365c4ca3a46a18cda99768e4864de173405a47c69f5a27641833b1329b324"
Jul 30 13:40:18.708646 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:40:18.708618    2566 generic.go:356] "Generic (PLEG): container finished" podID="b6e7a82c-1483-4cb5-a544-acf674e994c8" containerID="388ddfcc36e18f5a61b55bab301187137299c5aeed14406fee91592537ff5aeb" exitCode=0
Jul 30 13:40:18.708782 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:40:18.708655    2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-mt-85370406-74c56c6f5b-xjp85"
Jul 30 13:40:18.708782 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:40:18.708681    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-mt-85370406-74c56c6f5b-xjp85" event={"ID":"b6e7a82c-1483-4cb5-a544-acf674e994c8","Type":"ContainerDied","Data":"388ddfcc36e18f5a61b55bab301187137299c5aeed14406fee91592537ff5aeb"}
Jul 30 13:40:18.708782 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:40:18.708735    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-mt-85370406-74c56c6f5b-xjp85" event={"ID":"b6e7a82c-1483-4cb5-a544-acf674e994c8","Type":"ContainerDied","Data":"a780269e7386cdf5e4f8994d7c56ca9b928cd5b654ae78acbb028c86bd241a0e"}
Jul 30 13:40:18.710301 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:40:18.710232    2566 generic.go:356] "Generic (PLEG): container finished" podID="ee08e42f-8d96-4dc8-b274-de06bf4ea0e5" containerID="016c3bd18d8aebcbbf8eaac30c25895ea2dbe545ed8711a00869607973ed8997" exitCode=0
Jul 30 13:40:18.710301 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:40:18.710264    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-mt-85370406-995875f66-554l2" event={"ID":"ee08e42f-8d96-4dc8-b274-de06bf4ea0e5","Type":"ContainerDied","Data":"016c3bd18d8aebcbbf8eaac30c25895ea2dbe545ed8711a00869607973ed8997"}
Jul 30 13:40:18.710301 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:40:18.710271    2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-mt-85370406-995875f66-554l2"
Jul 30 13:40:18.710301 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:40:18.710303    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-mt-85370406-995875f66-554l2" event={"ID":"ee08e42f-8d96-4dc8-b274-de06bf4ea0e5","Type":"ContainerDied","Data":"af8a7a35d149f7617c670730a99c298a5c4dd607e43a9b44bb6fae1931dc19e5"}
Jul 30 13:40:18.717849 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:40:18.717826    2566 scope.go:117] "RemoveContainer" containerID="cb1365c4ca3a46a18cda99768e4864de173405a47c69f5a27641833b1329b324"
Jul 30 13:40:18.718260 ip-10-0-143-153 kubenswrapper[2566]: E0730 13:40:18.718229    2566 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"cb1365c4ca3a46a18cda99768e4864de173405a47c69f5a27641833b1329b324\": container with ID starting with cb1365c4ca3a46a18cda99768e4864de173405a47c69f5a27641833b1329b324 not found: ID does not exist" containerID="cb1365c4ca3a46a18cda99768e4864de173405a47c69f5a27641833b1329b324"
Jul 30 13:40:18.718408 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:40:18.718273    2566 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"cb1365c4ca3a46a18cda99768e4864de173405a47c69f5a27641833b1329b324"} err="failed to get container status \"cb1365c4ca3a46a18cda99768e4864de173405a47c69f5a27641833b1329b324\": rpc error: code = NotFound desc = could not find container \"cb1365c4ca3a46a18cda99768e4864de173405a47c69f5a27641833b1329b324\": container with ID starting with cb1365c4ca3a46a18cda99768e4864de173405a47c69f5a27641833b1329b324 not found: ID does not exist"
Jul 30 13:40:18.718408 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:40:18.718296    2566 scope.go:117] "RemoveContainer" containerID="388ddfcc36e18f5a61b55bab301187137299c5aeed14406fee91592537ff5aeb"
Jul 30 13:40:18.727345 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:40:18.727324    2566 scope.go:117] "RemoveContainer" containerID="388ddfcc36e18f5a61b55bab301187137299c5aeed14406fee91592537ff5aeb"
Jul 30 13:40:18.727636 ip-10-0-143-153 kubenswrapper[2566]: E0730 13:40:18.727616    2566 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"388ddfcc36e18f5a61b55bab301187137299c5aeed14406fee91592537ff5aeb\": container with ID starting with 388ddfcc36e18f5a61b55bab301187137299c5aeed14406fee91592537ff5aeb not found: ID does not exist" containerID="388ddfcc36e18f5a61b55bab301187137299c5aeed14406fee91592537ff5aeb"
Jul 30 13:40:18.727716 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:40:18.727644    2566 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"388ddfcc36e18f5a61b55bab301187137299c5aeed14406fee91592537ff5aeb"} err="failed to get container status \"388ddfcc36e18f5a61b55bab301187137299c5aeed14406fee91592537ff5aeb\": rpc error: code = NotFound desc = could not find container \"388ddfcc36e18f5a61b55bab301187137299c5aeed14406fee91592537ff5aeb\": container with ID starting with 388ddfcc36e18f5a61b55bab301187137299c5aeed14406fee91592537ff5aeb not found: ID does not exist"
Jul 30 13:40:18.727716 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:40:18.727661    2566 scope.go:117] "RemoveContainer" containerID="016c3bd18d8aebcbbf8eaac30c25895ea2dbe545ed8711a00869607973ed8997"
Jul 30 13:40:18.735067 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:40:18.735050    2566 scope.go:117] "RemoveContainer" containerID="016c3bd18d8aebcbbf8eaac30c25895ea2dbe545ed8711a00869607973ed8997"
Jul 30 13:40:18.735331 ip-10-0-143-153 kubenswrapper[2566]: E0730 13:40:18.735313    2566 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"016c3bd18d8aebcbbf8eaac30c25895ea2dbe545ed8711a00869607973ed8997\": container with ID starting with 016c3bd18d8aebcbbf8eaac30c25895ea2dbe545ed8711a00869607973ed8997 not found: ID does not exist" containerID="016c3bd18d8aebcbbf8eaac30c25895ea2dbe545ed8711a00869607973ed8997"
Jul 30 13:40:18.735387 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:40:18.735338    2566 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"016c3bd18d8aebcbbf8eaac30c25895ea2dbe545ed8711a00869607973ed8997"} err="failed to get container status \"016c3bd18d8aebcbbf8eaac30c25895ea2dbe545ed8711a00869607973ed8997\": rpc error: code = NotFound desc = could not find container \"016c3bd18d8aebcbbf8eaac30c25895ea2dbe545ed8711a00869607973ed8997\": container with ID starting with 016c3bd18d8aebcbbf8eaac30c25895ea2dbe545ed8711a00869607973ed8997 not found: ID does not exist"
Jul 30 13:40:18.738021 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:40:18.738000    2566 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-85370406-65fbcdc5b6-59t9d"]
Jul 30 13:40:18.745132 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:40:18.745110    2566 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-85370406-65fbcdc5b6-59t9d"]
Jul 30 13:40:18.759353 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:40:18.759327    2566 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-85370406-74c56c6f5b-xjp85"]
Jul 30 13:40:18.764857 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:40:18.764834    2566 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-85370406-74c56c6f5b-xjp85"]
Jul 30 13:40:18.775296 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:40:18.775266    2566 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-mt-85370406-995875f66-554l2"]
Jul 30 13:40:18.778566 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:40:18.778546    2566 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-mt-85370406-995875f66-554l2"]
Jul 30 13:40:19.634409 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:40:19.628414    2566 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="37f11109-b630-409b-9844-171e5963d392" path="/var/lib/kubelet/pods/37f11109-b630-409b-9844-171e5963d392/volumes"
Jul 30 13:40:19.634409 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:40:19.629166    2566 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b6e7a82c-1483-4cb5-a544-acf674e994c8" path="/var/lib/kubelet/pods/b6e7a82c-1483-4cb5-a544-acf674e994c8/volumes"
Jul 30 13:40:19.634409 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:40:19.629707    2566 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ee08e42f-8d96-4dc8-b274-de06bf4ea0e5" path="/var/lib/kubelet/pods/ee08e42f-8d96-4dc8-b274-de06bf4ea0e5/volumes"
Jul 30 13:42:29.616887 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:42:29.616855    2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-628283-7ff6c69cb4-ng5rt"]
Jul 30 13:42:29.619455 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:42:29.617428    2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="37f11109-b630-409b-9844-171e5963d392" containerName="maas-api"
Jul 30 13:42:29.619455 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:42:29.617445    2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="37f11109-b630-409b-9844-171e5963d392" containerName="maas-api"
Jul 30 13:42:29.619455 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:42:29.617457    2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b6e7a82c-1483-4cb5-a544-acf674e994c8" containerName="payload-pre-processing"
Jul 30 13:42:29.619455 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:42:29.617463    2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="b6e7a82c-1483-4cb5-a544-acf674e994c8" containerName="payload-pre-processing"
Jul 30 13:42:29.619455 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:42:29.617470    2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ee08e42f-8d96-4dc8-b274-de06bf4ea0e5" containerName="payload-processing"
Jul 30 13:42:29.619455 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:42:29.617475    2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="ee08e42f-8d96-4dc8-b274-de06bf4ea0e5" containerName="payload-processing"
Jul 30 13:42:29.619455 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:42:29.617530    2566 memory_manager.go:368] "RemoveStaleState removing state" podUID="37f11109-b630-409b-9844-171e5963d392" containerName="maas-api"
Jul 30 13:42:29.619455 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:42:29.617539    2566 memory_manager.go:368] "RemoveStaleState removing state" podUID="b6e7a82c-1483-4cb5-a544-acf674e994c8" containerName="payload-pre-processing"
Jul 30 13:42:29.619455 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:42:29.617549    2566 memory_manager.go:368] "RemoveStaleState removing state" podUID="ee08e42f-8d96-4dc8-b274-de06bf4ea0e5" containerName="payload-processing"
Jul 30 13:42:29.620416 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:42:29.620397    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-628283-7ff6c69cb4-ng5rt"
Jul 30 13:42:29.622199 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:42:29.622178    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-inf-a-628283-serving-cert\""
Jul 30 13:42:29.630298 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:42:29.630277    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-628283-7ff6c69cb4-ng5rt"]
Jul 30 13:42:29.639757 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:42:29.639730    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/f7cb1c77-72b7-460b-bffb-7e6b782e15c7-openshift-service-ca\") pod \"maas-api-e2e-inf-a-628283-7ff6c69cb4-ng5rt\" (UID: \"f7cb1c77-72b7-460b-bffb-7e6b782e15c7\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-628283-7ff6c69cb4-ng5rt"
Jul 30 13:42:29.639880 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:42:29.639834    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/f7cb1c77-72b7-460b-bffb-7e6b782e15c7-maas-api-tls\") pod \"maas-api-e2e-inf-a-628283-7ff6c69cb4-ng5rt\" (UID: \"f7cb1c77-72b7-460b-bffb-7e6b782e15c7\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-628283-7ff6c69cb4-ng5rt"
Jul 30 13:42:29.639969 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:42:29.639940    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8hc4l\" (UniqueName: \"kubernetes.io/projected/f7cb1c77-72b7-460b-bffb-7e6b782e15c7-kube-api-access-8hc4l\") pod \"maas-api-e2e-inf-a-628283-7ff6c69cb4-ng5rt\" (UID: \"f7cb1c77-72b7-460b-bffb-7e6b782e15c7\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-628283-7ff6c69cb4-ng5rt"
Jul 30 13:42:29.740595 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:42:29.740558    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/f7cb1c77-72b7-460b-bffb-7e6b782e15c7-openshift-service-ca\") pod \"maas-api-e2e-inf-a-628283-7ff6c69cb4-ng5rt\" (UID: \"f7cb1c77-72b7-460b-bffb-7e6b782e15c7\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-628283-7ff6c69cb4-ng5rt"
Jul 30 13:42:29.740783 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:42:29.740616    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/f7cb1c77-72b7-460b-bffb-7e6b782e15c7-maas-api-tls\") pod \"maas-api-e2e-inf-a-628283-7ff6c69cb4-ng5rt\" (UID: \"f7cb1c77-72b7-460b-bffb-7e6b782e15c7\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-628283-7ff6c69cb4-ng5rt"
Jul 30 13:42:29.740783 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:42:29.740640    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8hc4l\" (UniqueName: \"kubernetes.io/projected/f7cb1c77-72b7-460b-bffb-7e6b782e15c7-kube-api-access-8hc4l\") pod \"maas-api-e2e-inf-a-628283-7ff6c69cb4-ng5rt\" (UID: \"f7cb1c77-72b7-460b-bffb-7e6b782e15c7\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-628283-7ff6c69cb4-ng5rt"
Jul 30 13:42:29.740906 ip-10-0-143-153 kubenswrapper[2566]: E0730 13:42:29.740783    2566 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-inf-a-628283-serving-cert: secret "maas-api-e2e-inf-a-628283-serving-cert" not found
Jul 30 13:42:29.740906 ip-10-0-143-153 kubenswrapper[2566]: E0730 13:42:29.740857    2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f7cb1c77-72b7-460b-bffb-7e6b782e15c7-maas-api-tls podName:f7cb1c77-72b7-460b-bffb-7e6b782e15c7 nodeName:}" failed. No retries permitted until 2026-07-30 13:42:30.240835769 +0000 UTC m=+2579.169524030 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/f7cb1c77-72b7-460b-bffb-7e6b782e15c7-maas-api-tls") pod "maas-api-e2e-inf-a-628283-7ff6c69cb4-ng5rt" (UID: "f7cb1c77-72b7-460b-bffb-7e6b782e15c7") : secret "maas-api-e2e-inf-a-628283-serving-cert" not found
Jul 30 13:42:29.741196 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:42:29.741176    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/f7cb1c77-72b7-460b-bffb-7e6b782e15c7-openshift-service-ca\") pod \"maas-api-e2e-inf-a-628283-7ff6c69cb4-ng5rt\" (UID: \"f7cb1c77-72b7-460b-bffb-7e6b782e15c7\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-628283-7ff6c69cb4-ng5rt"
Jul 30 13:42:29.749659 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:42:29.749635    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8hc4l\" (UniqueName: \"kubernetes.io/projected/f7cb1c77-72b7-460b-bffb-7e6b782e15c7-kube-api-access-8hc4l\") pod \"maas-api-e2e-inf-a-628283-7ff6c69cb4-ng5rt\" (UID: \"f7cb1c77-72b7-460b-bffb-7e6b782e15c7\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-628283-7ff6c69cb4-ng5rt"
Jul 30 13:42:30.245448 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:42:30.245415    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/f7cb1c77-72b7-460b-bffb-7e6b782e15c7-maas-api-tls\") pod \"maas-api-e2e-inf-a-628283-7ff6c69cb4-ng5rt\" (UID: \"f7cb1c77-72b7-460b-bffb-7e6b782e15c7\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-628283-7ff6c69cb4-ng5rt"
Jul 30 13:42:30.247826 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:42:30.247806    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/f7cb1c77-72b7-460b-bffb-7e6b782e15c7-maas-api-tls\") pod \"maas-api-e2e-inf-a-628283-7ff6c69cb4-ng5rt\" (UID: \"f7cb1c77-72b7-460b-bffb-7e6b782e15c7\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-628283-7ff6c69cb4-ng5rt"
Jul 30 13:42:30.267713 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:42:30.267680    2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-inf-a-628283-7cc5c58b4d-6vnvh"]
Jul 30 13:42:30.271234 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:42:30.271214    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-628283-7cc5c58b4d-6vnvh"
Jul 30 13:42:30.274337 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:42:30.274320    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-inf-a-628283-dockercfg-k6v5t\""
Jul 30 13:42:30.274678 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:42:30.274663    2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-inf-a-628283\""
Jul 30 13:42:30.293705 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:42:30.293681    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-inf-a-628283-7cc5c58b4d-6vnvh"]
Jul 30 13:42:30.296378 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:42:30.296356    2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-inf-a-628283-6d7bf888bd-hbhfq"]
Jul 30 13:42:30.299780 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:42:30.299762    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-inf-a-628283-6d7bf888bd-hbhfq"
Jul 30 13:42:30.313597 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:42:30.313572    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-inf-a-628283-6d7bf888bd-hbhfq"]
Jul 30 13:42:30.352927 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:42:30.346822    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/1ba55f4b-747b-473c-88a4-592d8bc184ce-plugins-config-volume\") pod \"payload-pre-processing-e2e-inf-a-628283-7cc5c58b4d-6vnvh\" (UID: \"1ba55f4b-747b-473c-88a4-592d8bc184ce\") " pod="openshift-ingress/payload-pre-processing-e2e-inf-a-628283-7cc5c58b4d-6vnvh"
Jul 30 13:42:30.352927 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:42:30.346930    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kfntf\" (UniqueName: \"kubernetes.io/projected/1ba55f4b-747b-473c-88a4-592d8bc184ce-kube-api-access-kfntf\") pod \"payload-pre-processing-e2e-inf-a-628283-7cc5c58b4d-6vnvh\" (UID: \"1ba55f4b-747b-473c-88a4-592d8bc184ce\") " pod="openshift-ingress/payload-pre-processing-e2e-inf-a-628283-7cc5c58b4d-6vnvh"
Jul 30 13:42:30.352927 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:42:30.346971    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/fa56f5f8-762c-4eaf-bab1-76e6f008b6f8-plugins-config-volume\") pod \"payload-processing-e2e-inf-a-628283-6d7bf888bd-hbhfq\" (UID: \"fa56f5f8-762c-4eaf-bab1-76e6f008b6f8\") " pod="openshift-ingress/payload-processing-e2e-inf-a-628283-6d7bf888bd-hbhfq"
Jul 30 13:42:30.352927 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:42:30.347026    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5frbm\" (UniqueName: \"kubernetes.io/projected/fa56f5f8-762c-4eaf-bab1-76e6f008b6f8-kube-api-access-5frbm\") pod \"payload-processing-e2e-inf-a-628283-6d7bf888bd-hbhfq\" (UID: \"fa56f5f8-762c-4eaf-bab1-76e6f008b6f8\") " pod="openshift-ingress/payload-processing-e2e-inf-a-628283-6d7bf888bd-hbhfq"
Jul 30 13:42:30.448348 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:42:30.448305    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/1ba55f4b-747b-473c-88a4-592d8bc184ce-plugins-config-volume\") pod \"payload-pre-processing-e2e-inf-a-628283-7cc5c58b4d-6vnvh\" (UID: \"1ba55f4b-747b-473c-88a4-592d8bc184ce\") " pod="openshift-ingress/payload-pre-processing-e2e-inf-a-628283-7cc5c58b4d-6vnvh"
Jul 30 13:42:30.448548 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:42:30.448362    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kfntf\" (UniqueName: \"kubernetes.io/projected/1ba55f4b-747b-473c-88a4-592d8bc184ce-kube-api-access-kfntf\") pod \"payload-pre-processing-e2e-inf-a-628283-7cc5c58b4d-6vnvh\" (UID: \"1ba55f4b-747b-473c-88a4-592d8bc184ce\") " pod="openshift-ingress/payload-pre-processing-e2e-inf-a-628283-7cc5c58b4d-6vnvh"
Jul 30 13:42:30.448548 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:42:30.448386    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/fa56f5f8-762c-4eaf-bab1-76e6f008b6f8-plugins-config-volume\") pod \"payload-processing-e2e-inf-a-628283-6d7bf888bd-hbhfq\" (UID: \"fa56f5f8-762c-4eaf-bab1-76e6f008b6f8\") " pod="openshift-ingress/payload-processing-e2e-inf-a-628283-6d7bf888bd-hbhfq"
Jul 30 13:42:30.448548 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:42:30.448410    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5frbm\" (UniqueName: \"kubernetes.io/projected/fa56f5f8-762c-4eaf-bab1-76e6f008b6f8-kube-api-access-5frbm\") pod \"payload-processing-e2e-inf-a-628283-6d7bf888bd-hbhfq\" (UID: \"fa56f5f8-762c-4eaf-bab1-76e6f008b6f8\") " pod="openshift-ingress/payload-processing-e2e-inf-a-628283-6d7bf888bd-hbhfq"
Jul 30 13:42:30.449166 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:42:30.449141    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/fa56f5f8-762c-4eaf-bab1-76e6f008b6f8-plugins-config-volume\") pod \"payload-processing-e2e-inf-a-628283-6d7bf888bd-hbhfq\" (UID: \"fa56f5f8-762c-4eaf-bab1-76e6f008b6f8\") " pod="openshift-ingress/payload-processing-e2e-inf-a-628283-6d7bf888bd-hbhfq"
Jul 30 13:42:30.449275 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:42:30.449169    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/1ba55f4b-747b-473c-88a4-592d8bc184ce-plugins-config-volume\") pod \"payload-pre-processing-e2e-inf-a-628283-7cc5c58b4d-6vnvh\" (UID: \"1ba55f4b-747b-473c-88a4-592d8bc184ce\") " pod="openshift-ingress/payload-pre-processing-e2e-inf-a-628283-7cc5c58b4d-6vnvh"
Jul 30 13:42:30.456360 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:42:30.456338    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kfntf\" (UniqueName: \"kubernetes.io/projected/1ba55f4b-747b-473c-88a4-592d8bc184ce-kube-api-access-kfntf\") pod \"payload-pre-processing-e2e-inf-a-628283-7cc5c58b4d-6vnvh\" (UID: \"1ba55f4b-747b-473c-88a4-592d8bc184ce\") " pod="openshift-ingress/payload-pre-processing-e2e-inf-a-628283-7cc5c58b4d-6vnvh"
Jul 30 13:42:30.456454 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:42:30.456401    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5frbm\" (UniqueName: \"kubernetes.io/projected/fa56f5f8-762c-4eaf-bab1-76e6f008b6f8-kube-api-access-5frbm\") pod \"payload-processing-e2e-inf-a-628283-6d7bf888bd-hbhfq\" (UID: \"fa56f5f8-762c-4eaf-bab1-76e6f008b6f8\") " pod="openshift-ingress/payload-processing-e2e-inf-a-628283-6d7bf888bd-hbhfq"
Jul 30 13:42:30.533832 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:42:30.533753    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-628283-7ff6c69cb4-ng5rt"
Jul 30 13:42:30.582851 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:42:30.582792    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-628283-7cc5c58b4d-6vnvh"
Jul 30 13:42:30.610753 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:42:30.610654    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-inf-a-628283-6d7bf888bd-hbhfq"
Jul 30 13:42:30.687377 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:42:30.687192    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-628283-7ff6c69cb4-ng5rt"]
Jul 30 13:42:30.750408 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:42:30.750370    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-inf-a-628283-7cc5c58b4d-6vnvh"]
Jul 30 13:42:30.752164 ip-10-0-143-153 kubenswrapper[2566]: W0730 13:42:30.751881    2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1ba55f4b_747b_473c_88a4_592d8bc184ce.slice/crio-cee7d3654e4edab4337e6577738795f9200c46b052bfc38f2bce16b9d855c4e0 WatchSource:0}: Error finding container cee7d3654e4edab4337e6577738795f9200c46b052bfc38f2bce16b9d855c4e0: Status 404 returned error can't find the container with id cee7d3654e4edab4337e6577738795f9200c46b052bfc38f2bce16b9d855c4e0
Jul 30 13:42:30.985839 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:42:30.985810    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-inf-a-628283-6d7bf888bd-hbhfq"]
Jul 30 13:42:30.987829 ip-10-0-143-153 kubenswrapper[2566]: W0730 13:42:30.987792    2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfa56f5f8_762c_4eaf_bab1_76e6f008b6f8.slice/crio-efab44026f313bcb5411aa54ec54b9e7b34fd3310a4029e584c0b028221dc0ca WatchSource:0}: Error finding container efab44026f313bcb5411aa54ec54b9e7b34fd3310a4029e584c0b028221dc0ca: Status 404 returned error can't find the container with id efab44026f313bcb5411aa54ec54b9e7b34fd3310a4029e584c0b028221dc0ca
Jul 30 13:42:31.363759 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:42:31.363722    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-inf-a-628283-6d7bf888bd-hbhfq" event={"ID":"fa56f5f8-762c-4eaf-bab1-76e6f008b6f8","Type":"ContainerStarted","Data":"1c228b466160a6f53241c0262b34ef33538f708426b44f92418e11b2fb6d7fc4"}
Jul 30 13:42:31.363951 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:42:31.363796    2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-inf-a-628283-6d7bf888bd-hbhfq"
Jul 30 13:42:31.363951 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:42:31.363822    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-inf-a-628283-6d7bf888bd-hbhfq" event={"ID":"fa56f5f8-762c-4eaf-bab1-76e6f008b6f8","Type":"ContainerStarted","Data":"efab44026f313bcb5411aa54ec54b9e7b34fd3310a4029e584c0b028221dc0ca"}
Jul 30 13:42:31.365252 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:42:31.365221    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-628283-7ff6c69cb4-ng5rt" event={"ID":"f7cb1c77-72b7-460b-bffb-7e6b782e15c7","Type":"ContainerStarted","Data":"f48f082e2c0c9f0801f739b5642ff723f72320c8831648b4aececbfb3c251968"}
Jul 30 13:42:31.365394 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:42:31.365278    2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-628283-7ff6c69cb4-ng5rt"
Jul 30 13:42:31.365394 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:42:31.365303    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-628283-7ff6c69cb4-ng5rt" event={"ID":"f7cb1c77-72b7-460b-bffb-7e6b782e15c7","Type":"ContainerStarted","Data":"70ba446ede98fa135ac316f330d2fc60b039c5e544ab5ea7cf984488ed833cc8"}
Jul 30 13:42:31.366598 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:42:31.366575    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-628283-7cc5c58b4d-6vnvh" event={"ID":"1ba55f4b-747b-473c-88a4-592d8bc184ce","Type":"ContainerStarted","Data":"fcc4787c1165682e9d70bc40bfa65287aa24627039d1220e0564a06972ffc898"}
Jul 30 13:42:31.366705 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:42:31.366619    2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-628283-7cc5c58b4d-6vnvh"
Jul 30 13:42:31.366705 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:42:31.366638    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-628283-7cc5c58b4d-6vnvh" event={"ID":"1ba55f4b-747b-473c-88a4-592d8bc184ce","Type":"ContainerStarted","Data":"cee7d3654e4edab4337e6577738795f9200c46b052bfc38f2bce16b9d855c4e0"}
Jul 30 13:42:31.379062 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:42:31.379002    2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-inf-a-628283-6d7bf888bd-hbhfq" podStartSLOduration=1.378983273 podStartE2EDuration="1.378983273s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-30 13:42:30 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 13:42:31.376865107 +0000 UTC m=+2580.305553381" watchObservedRunningTime="2026-07-30 13:42:31.378983273 +0000 UTC m=+2580.307671542"
Jul 30 13:42:31.401398 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:42:31.401349    2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-628283-7ff6c69cb4-ng5rt" podStartSLOduration=1.870985372 podStartE2EDuration="2.401333829s" totalImagesPullingTime="530.348457ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-30 13:42:29 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 13:42:31.3955466 +0000 UTC m=+2580.324234854" watchObservedRunningTime="2026-07-30 13:42:31.401333829 +0000 UTC m=+2580.330022092"
Jul 30 13:42:31.424038 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:42:31.423987    2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-628283-7cc5c58b4d-6vnvh" podStartSLOduration=1.423970821 podStartE2EDuration="1.423970821s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-30 13:42:30 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 13:42:31.423252148 +0000 UTC m=+2580.351940414" watchObservedRunningTime="2026-07-30 13:42:31.423970821 +0000 UTC m=+2580.352659084"
Jul 30 13:42:37.376592 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:42:37.376563    2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-628283-7ff6c69cb4-ng5rt"
Jul 30 13:42:42.373497 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:42:42.373456    2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-628283-7cc5c58b4d-6vnvh"
Jul 30 13:42:42.373948 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:42:42.373525    2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-inf-a-628283-6d7bf888bd-hbhfq"
Jul 30 13:42:59.374759 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:42:59.374676    2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-inf-b-bdee41-564f47487b-5kb7b"]
Jul 30 13:42:59.390444 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:42:59.390415    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-inf-b-bdee41-564f47487b-5kb7b"
Jul 30 13:42:59.391226 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:42:59.391175    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-inf-b-bdee41-564f47487b-5kb7b"]
Jul 30 13:42:59.392774 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:42:59.392741    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-inf-b-bdee41-dockercfg-vh86g\""
Jul 30 13:42:59.392931 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:42:59.392753    2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-inf-b-bdee41\""
Jul 30 13:42:59.403589 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:42:59.403555    2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-inf-b-bdee41-6fb44bfbb-x4bvj"]
Jul 30 13:42:59.407821 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:42:59.407801    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-inf-b-bdee41-6fb44bfbb-x4bvj"
Jul 30 13:42:59.414052 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:42:59.414030    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-inf-b-bdee41-6fb44bfbb-x4bvj"]
Jul 30 13:42:59.510982 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:42:59.510942    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bt2pt\" (UniqueName: \"kubernetes.io/projected/bcc74110-b23b-436e-aa51-e4239530587c-kube-api-access-bt2pt\") pod \"payload-pre-processing-e2e-inf-b-bdee41-564f47487b-5kb7b\" (UID: \"bcc74110-b23b-436e-aa51-e4239530587c\") " pod="openshift-ingress/payload-pre-processing-e2e-inf-b-bdee41-564f47487b-5kb7b"
Jul 30 13:42:59.511201 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:42:59.510993    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/32812613-d312-4a9e-8102-a782ad68677e-plugins-config-volume\") pod \"payload-processing-e2e-inf-b-bdee41-6fb44bfbb-x4bvj\" (UID: \"32812613-d312-4a9e-8102-a782ad68677e\") " pod="openshift-ingress/payload-processing-e2e-inf-b-bdee41-6fb44bfbb-x4bvj"
Jul 30 13:42:59.511201 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:42:59.511030    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6k2rb\" (UniqueName: \"kubernetes.io/projected/32812613-d312-4a9e-8102-a782ad68677e-kube-api-access-6k2rb\") pod \"payload-processing-e2e-inf-b-bdee41-6fb44bfbb-x4bvj\" (UID: \"32812613-d312-4a9e-8102-a782ad68677e\") " pod="openshift-ingress/payload-processing-e2e-inf-b-bdee41-6fb44bfbb-x4bvj"
Jul 30 13:42:59.511201 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:42:59.511063    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/bcc74110-b23b-436e-aa51-e4239530587c-plugins-config-volume\") pod \"payload-pre-processing-e2e-inf-b-bdee41-564f47487b-5kb7b\" (UID: \"bcc74110-b23b-436e-aa51-e4239530587c\") " pod="openshift-ingress/payload-pre-processing-e2e-inf-b-bdee41-564f47487b-5kb7b"
Jul 30 13:42:59.612408 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:42:59.612369    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bt2pt\" (UniqueName: \"kubernetes.io/projected/bcc74110-b23b-436e-aa51-e4239530587c-kube-api-access-bt2pt\") pod \"payload-pre-processing-e2e-inf-b-bdee41-564f47487b-5kb7b\" (UID: \"bcc74110-b23b-436e-aa51-e4239530587c\") " pod="openshift-ingress/payload-pre-processing-e2e-inf-b-bdee41-564f47487b-5kb7b"
Jul 30 13:42:59.612408 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:42:59.612409    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/32812613-d312-4a9e-8102-a782ad68677e-plugins-config-volume\") pod \"payload-processing-e2e-inf-b-bdee41-6fb44bfbb-x4bvj\" (UID: \"32812613-d312-4a9e-8102-a782ad68677e\") " pod="openshift-ingress/payload-processing-e2e-inf-b-bdee41-6fb44bfbb-x4bvj"
Jul 30 13:42:59.612693 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:42:59.612430    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6k2rb\" (UniqueName: \"kubernetes.io/projected/32812613-d312-4a9e-8102-a782ad68677e-kube-api-access-6k2rb\") pod \"payload-processing-e2e-inf-b-bdee41-6fb44bfbb-x4bvj\" (UID: \"32812613-d312-4a9e-8102-a782ad68677e\") " pod="openshift-ingress/payload-processing-e2e-inf-b-bdee41-6fb44bfbb-x4bvj"
Jul 30 13:42:59.612693 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:42:59.612464    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/bcc74110-b23b-436e-aa51-e4239530587c-plugins-config-volume\") pod \"payload-pre-processing-e2e-inf-b-bdee41-564f47487b-5kb7b\" (UID: \"bcc74110-b23b-436e-aa51-e4239530587c\") " pod="openshift-ingress/payload-pre-processing-e2e-inf-b-bdee41-564f47487b-5kb7b"
Jul 30 13:42:59.613188 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:42:59.613168    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/32812613-d312-4a9e-8102-a782ad68677e-plugins-config-volume\") pod \"payload-processing-e2e-inf-b-bdee41-6fb44bfbb-x4bvj\" (UID: \"32812613-d312-4a9e-8102-a782ad68677e\") " pod="openshift-ingress/payload-processing-e2e-inf-b-bdee41-6fb44bfbb-x4bvj"
Jul 30 13:42:59.613261 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:42:59.613199    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/bcc74110-b23b-436e-aa51-e4239530587c-plugins-config-volume\") pod \"payload-pre-processing-e2e-inf-b-bdee41-564f47487b-5kb7b\" (UID: \"bcc74110-b23b-436e-aa51-e4239530587c\") " pod="openshift-ingress/payload-pre-processing-e2e-inf-b-bdee41-564f47487b-5kb7b"
Jul 30 13:42:59.622769 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:42:59.622736    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bt2pt\" (UniqueName: \"kubernetes.io/projected/bcc74110-b23b-436e-aa51-e4239530587c-kube-api-access-bt2pt\") pod \"payload-pre-processing-e2e-inf-b-bdee41-564f47487b-5kb7b\" (UID: \"bcc74110-b23b-436e-aa51-e4239530587c\") " pod="openshift-ingress/payload-pre-processing-e2e-inf-b-bdee41-564f47487b-5kb7b"
Jul 30 13:42:59.622897 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:42:59.622822    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6k2rb\" (UniqueName: \"kubernetes.io/projected/32812613-d312-4a9e-8102-a782ad68677e-kube-api-access-6k2rb\") pod \"payload-processing-e2e-inf-b-bdee41-6fb44bfbb-x4bvj\" (UID: \"32812613-d312-4a9e-8102-a782ad68677e\") " pod="openshift-ingress/payload-processing-e2e-inf-b-bdee41-6fb44bfbb-x4bvj"
Jul 30 13:42:59.703978 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:42:59.703940    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-inf-b-bdee41-564f47487b-5kb7b"
Jul 30 13:42:59.718929 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:42:59.718901    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-inf-b-bdee41-6fb44bfbb-x4bvj"
Jul 30 13:42:59.889505 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:42:59.889471    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-inf-b-bdee41-6fb44bfbb-x4bvj"]
Jul 30 13:42:59.892202 ip-10-0-143-153 kubenswrapper[2566]: W0730 13:42:59.892173    2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod32812613_d312_4a9e_8102_a782ad68677e.slice/crio-469ad54217d7d097f0dcce22f6a80638ce553d14c31475b9af0e205331ab7bf8 WatchSource:0}: Error finding container 469ad54217d7d097f0dcce22f6a80638ce553d14c31475b9af0e205331ab7bf8: Status 404 returned error can't find the container with id 469ad54217d7d097f0dcce22f6a80638ce553d14c31475b9af0e205331ab7bf8
Jul 30 13:43:00.062493 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:43:00.062466    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-inf-b-bdee41-564f47487b-5kb7b"]
Jul 30 13:43:00.064958 ip-10-0-143-153 kubenswrapper[2566]: W0730 13:43:00.064932    2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbcc74110_b23b_436e_aa51_e4239530587c.slice/crio-4ab327c1ce689a5a87e209e618ad673f9e1ad6a9acf6fd6b5664d46f75eb9f80 WatchSource:0}: Error finding container 4ab327c1ce689a5a87e209e618ad673f9e1ad6a9acf6fd6b5664d46f75eb9f80: Status 404 returned error can't find the container with id 4ab327c1ce689a5a87e209e618ad673f9e1ad6a9acf6fd6b5664d46f75eb9f80
Jul 30 13:43:00.515635 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:43:00.515598    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-inf-b-bdee41-6fb44bfbb-x4bvj" event={"ID":"32812613-d312-4a9e-8102-a782ad68677e","Type":"ContainerStarted","Data":"78aa40f724f61172bcab728ceb702f543d2720db491c94ab99e222384a5a091c"}
Jul 30 13:43:00.516095 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:43:00.515661    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-inf-b-bdee41-6fb44bfbb-x4bvj" event={"ID":"32812613-d312-4a9e-8102-a782ad68677e","Type":"ContainerStarted","Data":"469ad54217d7d097f0dcce22f6a80638ce553d14c31475b9af0e205331ab7bf8"}
Jul 30 13:43:00.516095 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:43:00.515689    2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-inf-b-bdee41-6fb44bfbb-x4bvj"
Jul 30 13:43:00.517301 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:43:00.517279    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-inf-b-bdee41-564f47487b-5kb7b" event={"ID":"bcc74110-b23b-436e-aa51-e4239530587c","Type":"ContainerStarted","Data":"6a9df3e8f83a124f7bea89d3521602cf58c5b87e398849061567e10a58d3f50c"}
Jul 30 13:43:00.517377 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:43:00.517320    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-inf-b-bdee41-564f47487b-5kb7b" event={"ID":"bcc74110-b23b-436e-aa51-e4239530587c","Type":"ContainerStarted","Data":"4ab327c1ce689a5a87e209e618ad673f9e1ad6a9acf6fd6b5664d46f75eb9f80"}
Jul 30 13:43:00.517377 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:43:00.517341    2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-inf-b-bdee41-564f47487b-5kb7b"
Jul 30 13:43:00.530060 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:43:00.530013    2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-inf-b-bdee41-6fb44bfbb-x4bvj" podStartSLOduration=1.5299991400000001 podStartE2EDuration="1.52999914s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-30 13:42:59 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 13:43:00.52977837 +0000 UTC m=+2609.458466634" watchObservedRunningTime="2026-07-30 13:43:00.52999914 +0000 UTC m=+2609.458687416"
Jul 30 13:43:00.546412 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:43:00.546367    2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-inf-b-bdee41-564f47487b-5kb7b" podStartSLOduration=1.5463528279999998 podStartE2EDuration="1.546352828s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-30 13:42:59 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 13:43:00.544387672 +0000 UTC m=+2609.473075934" watchObservedRunningTime="2026-07-30 13:43:00.546352828 +0000 UTC m=+2609.475041145"
Jul 30 13:43:11.525820 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:43:11.525789    2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-inf-b-bdee41-564f47487b-5kb7b"
Jul 30 13:43:11.526352 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:43:11.526132    2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-inf-b-bdee41-6fb44bfbb-x4bvj"
Jul 30 13:44:31.771248 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:44:31.771170    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-bzl6w_51cdacbf-3a14-47c0-8fd4-69b0b2be0e64/console-operator/1.log"
Jul 30 13:44:31.776869 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:44:31.776848    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-bzl6w_51cdacbf-3a14-47c0-8fd4-69b0b2be0e64/console-operator/1.log"
Jul 30 13:44:31.777096 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:44:31.777061    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-f6br6_3ebbc209-4373-44d8-a22e-d2d2aa4cbfa6/ovn-acl-logging/0.log"
Jul 30 13:44:31.782207 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:44:31.782188    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-f6br6_3ebbc209-4373-44d8-a22e-d2d2aa4cbfa6/ovn-acl-logging/0.log"
Jul 30 13:44:54.124303 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:44:54.124269    2566 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-628283-7ff6c69cb4-ng5rt"]
Jul 30 13:44:54.124777 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:44:54.124560    2566 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-628283-7ff6c69cb4-ng5rt" podUID="f7cb1c77-72b7-460b-bffb-7e6b782e15c7" containerName="maas-api" containerID="cri-o://f48f082e2c0c9f0801f739b5642ff723f72320c8831648b4aececbfb3c251968" gracePeriod=30
Jul 30 13:44:54.177331 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:44:54.177295    2566 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-inf-a-628283-6d7bf888bd-hbhfq"]
Jul 30 13:44:54.177774 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:44:54.177744    2566 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-inf-a-628283-6d7bf888bd-hbhfq" podUID="fa56f5f8-762c-4eaf-bab1-76e6f008b6f8" containerName="payload-processing" containerID="cri-o://1c228b466160a6f53241c0262b34ef33538f708426b44f92418e11b2fb6d7fc4" gracePeriod=30
Jul 30 13:44:54.186917 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:44:54.186824    2566 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-inf-a-628283-7cc5c58b4d-6vnvh"]
Jul 30 13:44:54.187714 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:44:54.187543    2566 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-628283-7cc5c58b4d-6vnvh" podUID="1ba55f4b-747b-473c-88a4-592d8bc184ce" containerName="payload-pre-processing" containerID="cri-o://fcc4787c1165682e9d70bc40bfa65287aa24627039d1220e0564a06972ffc898" gracePeriod=30
Jul 30 13:44:54.455686 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:44:54.455657    2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-628283-7ff6c69cb4-ng5rt"
Jul 30 13:44:54.507226 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:44:54.507198    2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-inf-a-628283-6d7bf888bd-hbhfq"
Jul 30 13:44:54.510045 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:44:54.510016    2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-628283-7cc5c58b4d-6vnvh"
Jul 30 13:44:54.566731 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:44:54.566694    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/1ba55f4b-747b-473c-88a4-592d8bc184ce-plugins-config-volume\") pod \"1ba55f4b-747b-473c-88a4-592d8bc184ce\" (UID: \"1ba55f4b-747b-473c-88a4-592d8bc184ce\") "
Jul 30 13:44:54.566915 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:44:54.566748    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/f7cb1c77-72b7-460b-bffb-7e6b782e15c7-openshift-service-ca\") pod \"f7cb1c77-72b7-460b-bffb-7e6b782e15c7\" (UID: \"f7cb1c77-72b7-460b-bffb-7e6b782e15c7\") "
Jul 30 13:44:54.566915 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:44:54.566772    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-5frbm\" (UniqueName: \"kubernetes.io/projected/fa56f5f8-762c-4eaf-bab1-76e6f008b6f8-kube-api-access-5frbm\") pod \"fa56f5f8-762c-4eaf-bab1-76e6f008b6f8\" (UID: \"fa56f5f8-762c-4eaf-bab1-76e6f008b6f8\") "
Jul 30 13:44:54.566915 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:44:54.566805    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/fa56f5f8-762c-4eaf-bab1-76e6f008b6f8-plugins-config-volume\") pod \"fa56f5f8-762c-4eaf-bab1-76e6f008b6f8\" (UID: \"fa56f5f8-762c-4eaf-bab1-76e6f008b6f8\") "
Jul 30 13:44:54.566915 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:44:54.566835    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/f7cb1c77-72b7-460b-bffb-7e6b782e15c7-maas-api-tls\") pod \"f7cb1c77-72b7-460b-bffb-7e6b782e15c7\" (UID: \"f7cb1c77-72b7-460b-bffb-7e6b782e15c7\") "
Jul 30 13:44:54.566915 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:44:54.566862    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-8hc4l\" (UniqueName: \"kubernetes.io/projected/f7cb1c77-72b7-460b-bffb-7e6b782e15c7-kube-api-access-8hc4l\") pod \"f7cb1c77-72b7-460b-bffb-7e6b782e15c7\" (UID: \"f7cb1c77-72b7-460b-bffb-7e6b782e15c7\") "
Jul 30 13:44:54.566915 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:44:54.566903    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-kfntf\" (UniqueName: \"kubernetes.io/projected/1ba55f4b-747b-473c-88a4-592d8bc184ce-kube-api-access-kfntf\") pod \"1ba55f4b-747b-473c-88a4-592d8bc184ce\" (UID: \"1ba55f4b-747b-473c-88a4-592d8bc184ce\") "
Jul 30 13:44:54.567255 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:44:54.567210    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1ba55f4b-747b-473c-88a4-592d8bc184ce-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "1ba55f4b-747b-473c-88a4-592d8bc184ce" (UID: "1ba55f4b-747b-473c-88a4-592d8bc184ce"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 30 13:44:54.567255 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:44:54.567218    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f7cb1c77-72b7-460b-bffb-7e6b782e15c7-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "f7cb1c77-72b7-460b-bffb-7e6b782e15c7" (UID: "f7cb1c77-72b7-460b-bffb-7e6b782e15c7"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 30 13:44:54.567255 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:44:54.567231    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/fa56f5f8-762c-4eaf-bab1-76e6f008b6f8-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "fa56f5f8-762c-4eaf-bab1-76e6f008b6f8" (UID: "fa56f5f8-762c-4eaf-bab1-76e6f008b6f8"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 30 13:44:54.567594 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:44:54.567520    2566 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/f7cb1c77-72b7-460b-bffb-7e6b782e15c7-openshift-service-ca\") on node \"ip-10-0-143-153.ec2.internal\" DevicePath \"\""
Jul 30 13:44:54.567594 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:44:54.567542    2566 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/fa56f5f8-762c-4eaf-bab1-76e6f008b6f8-plugins-config-volume\") on node \"ip-10-0-143-153.ec2.internal\" DevicePath \"\""
Jul 30 13:44:54.567594 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:44:54.567555    2566 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/1ba55f4b-747b-473c-88a4-592d8bc184ce-plugins-config-volume\") on node \"ip-10-0-143-153.ec2.internal\" DevicePath \"\""
Jul 30 13:44:54.569288 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:44:54.569255    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f7cb1c77-72b7-460b-bffb-7e6b782e15c7-kube-api-access-8hc4l" (OuterVolumeSpecName: "kube-api-access-8hc4l") pod "f7cb1c77-72b7-460b-bffb-7e6b782e15c7" (UID: "f7cb1c77-72b7-460b-bffb-7e6b782e15c7"). InnerVolumeSpecName "kube-api-access-8hc4l". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 30 13:44:54.569424 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:44:54.569405    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1ba55f4b-747b-473c-88a4-592d8bc184ce-kube-api-access-kfntf" (OuterVolumeSpecName: "kube-api-access-kfntf") pod "1ba55f4b-747b-473c-88a4-592d8bc184ce" (UID: "1ba55f4b-747b-473c-88a4-592d8bc184ce"). InnerVolumeSpecName "kube-api-access-kfntf". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 30 13:44:54.569477 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:44:54.569447    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f7cb1c77-72b7-460b-bffb-7e6b782e15c7-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "f7cb1c77-72b7-460b-bffb-7e6b782e15c7" (UID: "f7cb1c77-72b7-460b-bffb-7e6b782e15c7"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 30 13:44:54.569543 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:44:54.569524    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/fa56f5f8-762c-4eaf-bab1-76e6f008b6f8-kube-api-access-5frbm" (OuterVolumeSpecName: "kube-api-access-5frbm") pod "fa56f5f8-762c-4eaf-bab1-76e6f008b6f8" (UID: "fa56f5f8-762c-4eaf-bab1-76e6f008b6f8"). InnerVolumeSpecName "kube-api-access-5frbm". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 30 13:44:54.668244 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:44:54.668166    2566 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-5frbm\" (UniqueName: \"kubernetes.io/projected/fa56f5f8-762c-4eaf-bab1-76e6f008b6f8-kube-api-access-5frbm\") on node \"ip-10-0-143-153.ec2.internal\" DevicePath \"\""
Jul 30 13:44:54.668244 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:44:54.668193    2566 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/f7cb1c77-72b7-460b-bffb-7e6b782e15c7-maas-api-tls\") on node \"ip-10-0-143-153.ec2.internal\" DevicePath \"\""
Jul 30 13:44:54.668244 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:44:54.668203    2566 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-8hc4l\" (UniqueName: \"kubernetes.io/projected/f7cb1c77-72b7-460b-bffb-7e6b782e15c7-kube-api-access-8hc4l\") on node \"ip-10-0-143-153.ec2.internal\" DevicePath \"\""
Jul 30 13:44:54.668244 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:44:54.668211    2566 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-kfntf\" (UniqueName: \"kubernetes.io/projected/1ba55f4b-747b-473c-88a4-592d8bc184ce-kube-api-access-kfntf\") on node \"ip-10-0-143-153.ec2.internal\" DevicePath \"\""
Jul 30 13:44:55.120846 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:44:55.120750    2566 generic.go:356] "Generic (PLEG): container finished" podID="fa56f5f8-762c-4eaf-bab1-76e6f008b6f8" containerID="1c228b466160a6f53241c0262b34ef33538f708426b44f92418e11b2fb6d7fc4" exitCode=0
Jul 30 13:44:55.120846 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:44:55.120803    2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-inf-a-628283-6d7bf888bd-hbhfq"
Jul 30 13:44:55.121106 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:44:55.120838    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-inf-a-628283-6d7bf888bd-hbhfq" event={"ID":"fa56f5f8-762c-4eaf-bab1-76e6f008b6f8","Type":"ContainerDied","Data":"1c228b466160a6f53241c0262b34ef33538f708426b44f92418e11b2fb6d7fc4"}
Jul 30 13:44:55.121106 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:44:55.120907    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-inf-a-628283-6d7bf888bd-hbhfq" event={"ID":"fa56f5f8-762c-4eaf-bab1-76e6f008b6f8","Type":"ContainerDied","Data":"efab44026f313bcb5411aa54ec54b9e7b34fd3310a4029e584c0b028221dc0ca"}
Jul 30 13:44:55.121106 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:44:55.120941    2566 scope.go:117] "RemoveContainer" containerID="1c228b466160a6f53241c0262b34ef33538f708426b44f92418e11b2fb6d7fc4"
Jul 30 13:44:55.122254 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:44:55.122225    2566 generic.go:356] "Generic (PLEG): container finished" podID="f7cb1c77-72b7-460b-bffb-7e6b782e15c7" containerID="f48f082e2c0c9f0801f739b5642ff723f72320c8831648b4aececbfb3c251968" exitCode=0
Jul 30 13:44:55.122385 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:44:55.122279    2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-628283-7ff6c69cb4-ng5rt"
Jul 30 13:44:55.122385 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:44:55.122280    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-628283-7ff6c69cb4-ng5rt" event={"ID":"f7cb1c77-72b7-460b-bffb-7e6b782e15c7","Type":"ContainerDied","Data":"f48f082e2c0c9f0801f739b5642ff723f72320c8831648b4aececbfb3c251968"}
Jul 30 13:44:55.122385 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:44:55.122325    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-628283-7ff6c69cb4-ng5rt" event={"ID":"f7cb1c77-72b7-460b-bffb-7e6b782e15c7","Type":"ContainerDied","Data":"70ba446ede98fa135ac316f330d2fc60b039c5e544ab5ea7cf984488ed833cc8"}
Jul 30 13:44:55.123886 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:44:55.123861    2566 generic.go:356] "Generic (PLEG): container finished" podID="1ba55f4b-747b-473c-88a4-592d8bc184ce" containerID="fcc4787c1165682e9d70bc40bfa65287aa24627039d1220e0564a06972ffc898" exitCode=0
Jul 30 13:44:55.124025 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:44:55.123920    2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-628283-7cc5c58b4d-6vnvh"
Jul 30 13:44:55.124025 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:44:55.123974    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-628283-7cc5c58b4d-6vnvh" event={"ID":"1ba55f4b-747b-473c-88a4-592d8bc184ce","Type":"ContainerDied","Data":"fcc4787c1165682e9d70bc40bfa65287aa24627039d1220e0564a06972ffc898"}
Jul 30 13:44:55.124025 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:44:55.124011    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-628283-7cc5c58b4d-6vnvh" event={"ID":"1ba55f4b-747b-473c-88a4-592d8bc184ce","Type":"ContainerDied","Data":"cee7d3654e4edab4337e6577738795f9200c46b052bfc38f2bce16b9d855c4e0"}
Jul 30 13:44:55.130654 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:44:55.130461    2566 scope.go:117] "RemoveContainer" containerID="1c228b466160a6f53241c0262b34ef33538f708426b44f92418e11b2fb6d7fc4"
Jul 30 13:44:55.130947 ip-10-0-143-153 kubenswrapper[2566]: E0730 13:44:55.130843    2566 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1c228b466160a6f53241c0262b34ef33538f708426b44f92418e11b2fb6d7fc4\": container with ID starting with 1c228b466160a6f53241c0262b34ef33538f708426b44f92418e11b2fb6d7fc4 not found: ID does not exist" containerID="1c228b466160a6f53241c0262b34ef33538f708426b44f92418e11b2fb6d7fc4"
Jul 30 13:44:55.130947 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:44:55.130880    2566 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1c228b466160a6f53241c0262b34ef33538f708426b44f92418e11b2fb6d7fc4"} err="failed to get container status \"1c228b466160a6f53241c0262b34ef33538f708426b44f92418e11b2fb6d7fc4\": rpc error: code = NotFound desc = could not find container \"1c228b466160a6f53241c0262b34ef33538f708426b44f92418e11b2fb6d7fc4\": container with ID starting with 1c228b466160a6f53241c0262b34ef33538f708426b44f92418e11b2fb6d7fc4 not found: ID does not exist"
Jul 30 13:44:55.130947 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:44:55.130905    2566 scope.go:117] "RemoveContainer" containerID="f48f082e2c0c9f0801f739b5642ff723f72320c8831648b4aececbfb3c251968"
Jul 30 13:44:55.150024 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:44:55.149993    2566 scope.go:117] "RemoveContainer" containerID="f48f082e2c0c9f0801f739b5642ff723f72320c8831648b4aececbfb3c251968"
Jul 30 13:44:55.150330 ip-10-0-143-153 kubenswrapper[2566]: E0730 13:44:55.150311    2566 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f48f082e2c0c9f0801f739b5642ff723f72320c8831648b4aececbfb3c251968\": container with ID starting with f48f082e2c0c9f0801f739b5642ff723f72320c8831648b4aececbfb3c251968 not found: ID does not exist" containerID="f48f082e2c0c9f0801f739b5642ff723f72320c8831648b4aececbfb3c251968"
Jul 30 13:44:55.150414 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:44:55.150342    2566 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f48f082e2c0c9f0801f739b5642ff723f72320c8831648b4aececbfb3c251968"} err="failed to get container status \"f48f082e2c0c9f0801f739b5642ff723f72320c8831648b4aececbfb3c251968\": rpc error: code = NotFound desc = could not find container \"f48f082e2c0c9f0801f739b5642ff723f72320c8831648b4aececbfb3c251968\": container with ID starting with f48f082e2c0c9f0801f739b5642ff723f72320c8831648b4aececbfb3c251968 not found: ID does not exist"
Jul 30 13:44:55.150414 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:44:55.150364    2566 scope.go:117] "RemoveContainer" containerID="fcc4787c1165682e9d70bc40bfa65287aa24627039d1220e0564a06972ffc898"
Jul 30 13:44:55.158487 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:44:55.158465    2566 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-inf-a-628283-6d7bf888bd-hbhfq"]
Jul 30 13:44:55.159390 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:44:55.159375    2566 scope.go:117] "RemoveContainer" containerID="fcc4787c1165682e9d70bc40bfa65287aa24627039d1220e0564a06972ffc898"
Jul 30 13:44:55.159639 ip-10-0-143-153 kubenswrapper[2566]: E0730 13:44:55.159621    2566 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"fcc4787c1165682e9d70bc40bfa65287aa24627039d1220e0564a06972ffc898\": container with ID starting with fcc4787c1165682e9d70bc40bfa65287aa24627039d1220e0564a06972ffc898 not found: ID does not exist" containerID="fcc4787c1165682e9d70bc40bfa65287aa24627039d1220e0564a06972ffc898"
Jul 30 13:44:55.159735 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:44:55.159643    2566 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"fcc4787c1165682e9d70bc40bfa65287aa24627039d1220e0564a06972ffc898"} err="failed to get container status \"fcc4787c1165682e9d70bc40bfa65287aa24627039d1220e0564a06972ffc898\": rpc error: code = NotFound desc = could not find container \"fcc4787c1165682e9d70bc40bfa65287aa24627039d1220e0564a06972ffc898\": container with ID starting with fcc4787c1165682e9d70bc40bfa65287aa24627039d1220e0564a06972ffc898 not found: ID does not exist"
Jul 30 13:44:55.162185 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:44:55.162165    2566 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-inf-a-628283-6d7bf888bd-hbhfq"]
Jul 30 13:44:55.170557 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:44:55.170538    2566 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-628283-7ff6c69cb4-ng5rt"]
Jul 30 13:44:55.174898 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:44:55.174867    2566 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-628283-7ff6c69cb4-ng5rt"]
Jul 30 13:44:55.184013 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:44:55.183989    2566 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-inf-a-628283-7cc5c58b4d-6vnvh"]
Jul 30 13:44:55.188052 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:44:55.188030    2566 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-inf-a-628283-7cc5c58b4d-6vnvh"]
Jul 30 13:44:55.629061 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:44:55.629027    2566 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="1ba55f4b-747b-473c-88a4-592d8bc184ce" path="/var/lib/kubelet/pods/1ba55f4b-747b-473c-88a4-592d8bc184ce/volumes"
Jul 30 13:44:55.629461 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:44:55.629447    2566 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f7cb1c77-72b7-460b-bffb-7e6b782e15c7" path="/var/lib/kubelet/pods/f7cb1c77-72b7-460b-bffb-7e6b782e15c7/volumes"
Jul 30 13:44:55.629756 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:44:55.629745    2566 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="fa56f5f8-762c-4eaf-bab1-76e6f008b6f8" path="/var/lib/kubelet/pods/fa56f5f8-762c-4eaf-bab1-76e6f008b6f8/volumes"
Jul 30 13:45:12.403304 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:45:12.403259    2566 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-inf-b-bdee41-6fb44bfbb-x4bvj"]
Jul 30 13:45:12.403784 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:45:12.403493    2566 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-inf-b-bdee41-6fb44bfbb-x4bvj" podUID="32812613-d312-4a9e-8102-a782ad68677e" containerName="payload-processing" containerID="cri-o://78aa40f724f61172bcab728ceb702f543d2720db491c94ab99e222384a5a091c" gracePeriod=30
Jul 30 13:45:12.413323 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:45:12.412215    2566 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-inf-b-bdee41-564f47487b-5kb7b"]
Jul 30 13:45:12.413323 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:45:12.412439    2566 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-inf-b-bdee41-564f47487b-5kb7b" podUID="bcc74110-b23b-436e-aa51-e4239530587c" containerName="payload-pre-processing" containerID="cri-o://6a9df3e8f83a124f7bea89d3521602cf58c5b87e398849061567e10a58d3f50c" gracePeriod=30
Jul 30 13:45:12.663464 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:45:12.663400    2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-inf-b-bdee41-6fb44bfbb-x4bvj"
Jul 30 13:45:12.690962 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:45:12.690940    2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-inf-b-bdee41-564f47487b-5kb7b"
Jul 30 13:45:12.844309 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:45:12.844276    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/32812613-d312-4a9e-8102-a782ad68677e-plugins-config-volume\") pod \"32812613-d312-4a9e-8102-a782ad68677e\" (UID: \"32812613-d312-4a9e-8102-a782ad68677e\") "
Jul 30 13:45:12.844515 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:45:12.844340    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-bt2pt\" (UniqueName: \"kubernetes.io/projected/bcc74110-b23b-436e-aa51-e4239530587c-kube-api-access-bt2pt\") pod \"bcc74110-b23b-436e-aa51-e4239530587c\" (UID: \"bcc74110-b23b-436e-aa51-e4239530587c\") "
Jul 30 13:45:12.844515 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:45:12.844382    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/bcc74110-b23b-436e-aa51-e4239530587c-plugins-config-volume\") pod \"bcc74110-b23b-436e-aa51-e4239530587c\" (UID: \"bcc74110-b23b-436e-aa51-e4239530587c\") "
Jul 30 13:45:12.844515 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:45:12.844407    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-6k2rb\" (UniqueName: \"kubernetes.io/projected/32812613-d312-4a9e-8102-a782ad68677e-kube-api-access-6k2rb\") pod \"32812613-d312-4a9e-8102-a782ad68677e\" (UID: \"32812613-d312-4a9e-8102-a782ad68677e\") "
Jul 30 13:45:12.844772 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:45:12.844745    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/32812613-d312-4a9e-8102-a782ad68677e-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "32812613-d312-4a9e-8102-a782ad68677e" (UID: "32812613-d312-4a9e-8102-a782ad68677e"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 30 13:45:12.844772 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:45:12.844763    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/bcc74110-b23b-436e-aa51-e4239530587c-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "bcc74110-b23b-436e-aa51-e4239530587c" (UID: "bcc74110-b23b-436e-aa51-e4239530587c"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 30 13:45:12.846559 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:45:12.846536    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/32812613-d312-4a9e-8102-a782ad68677e-kube-api-access-6k2rb" (OuterVolumeSpecName: "kube-api-access-6k2rb") pod "32812613-d312-4a9e-8102-a782ad68677e" (UID: "32812613-d312-4a9e-8102-a782ad68677e"). InnerVolumeSpecName "kube-api-access-6k2rb". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 30 13:45:12.846624 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:45:12.846575    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/bcc74110-b23b-436e-aa51-e4239530587c-kube-api-access-bt2pt" (OuterVolumeSpecName: "kube-api-access-bt2pt") pod "bcc74110-b23b-436e-aa51-e4239530587c" (UID: "bcc74110-b23b-436e-aa51-e4239530587c"). InnerVolumeSpecName "kube-api-access-bt2pt". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 30 13:45:12.946026 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:45:12.945933    2566 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/bcc74110-b23b-436e-aa51-e4239530587c-plugins-config-volume\") on node \"ip-10-0-143-153.ec2.internal\" DevicePath \"\""
Jul 30 13:45:12.946026 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:45:12.945966    2566 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-6k2rb\" (UniqueName: \"kubernetes.io/projected/32812613-d312-4a9e-8102-a782ad68677e-kube-api-access-6k2rb\") on node \"ip-10-0-143-153.ec2.internal\" DevicePath \"\""
Jul 30 13:45:12.946026 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:45:12.945980    2566 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/32812613-d312-4a9e-8102-a782ad68677e-plugins-config-volume\") on node \"ip-10-0-143-153.ec2.internal\" DevicePath \"\""
Jul 30 13:45:12.946026 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:45:12.945992    2566 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-bt2pt\" (UniqueName: \"kubernetes.io/projected/bcc74110-b23b-436e-aa51-e4239530587c-kube-api-access-bt2pt\") on node \"ip-10-0-143-153.ec2.internal\" DevicePath \"\""
Jul 30 13:45:13.220696 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:45:13.220606    2566 generic.go:356] "Generic (PLEG): container finished" podID="32812613-d312-4a9e-8102-a782ad68677e" containerID="78aa40f724f61172bcab728ceb702f543d2720db491c94ab99e222384a5a091c" exitCode=0
Jul 30 13:45:13.220696 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:45:13.220661    2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-inf-b-bdee41-6fb44bfbb-x4bvj"
Jul 30 13:45:13.220925 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:45:13.220688    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-inf-b-bdee41-6fb44bfbb-x4bvj" event={"ID":"32812613-d312-4a9e-8102-a782ad68677e","Type":"ContainerDied","Data":"78aa40f724f61172bcab728ceb702f543d2720db491c94ab99e222384a5a091c"}
Jul 30 13:45:13.220925 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:45:13.220747    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-inf-b-bdee41-6fb44bfbb-x4bvj" event={"ID":"32812613-d312-4a9e-8102-a782ad68677e","Type":"ContainerDied","Data":"469ad54217d7d097f0dcce22f6a80638ce553d14c31475b9af0e205331ab7bf8"}
Jul 30 13:45:13.220925 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:45:13.220779    2566 scope.go:117] "RemoveContainer" containerID="78aa40f724f61172bcab728ceb702f543d2720db491c94ab99e222384a5a091c"
Jul 30 13:45:13.222090 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:45:13.222055    2566 generic.go:356] "Generic (PLEG): container finished" podID="bcc74110-b23b-436e-aa51-e4239530587c" containerID="6a9df3e8f83a124f7bea89d3521602cf58c5b87e398849061567e10a58d3f50c" exitCode=0
Jul 30 13:45:13.222181 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:45:13.222110    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-inf-b-bdee41-564f47487b-5kb7b" event={"ID":"bcc74110-b23b-436e-aa51-e4239530587c","Type":"ContainerDied","Data":"6a9df3e8f83a124f7bea89d3521602cf58c5b87e398849061567e10a58d3f50c"}
Jul 30 13:45:13.222181 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:45:13.222125    2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-inf-b-bdee41-564f47487b-5kb7b"
Jul 30 13:45:13.222181 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:45:13.222155    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-inf-b-bdee41-564f47487b-5kb7b" event={"ID":"bcc74110-b23b-436e-aa51-e4239530587c","Type":"ContainerDied","Data":"4ab327c1ce689a5a87e209e618ad673f9e1ad6a9acf6fd6b5664d46f75eb9f80"}
Jul 30 13:45:13.233254 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:45:13.233037    2566 scope.go:117] "RemoveContainer" containerID="78aa40f724f61172bcab728ceb702f543d2720db491c94ab99e222384a5a091c"
Jul 30 13:45:13.233413 ip-10-0-143-153 kubenswrapper[2566]: E0730 13:45:13.233393    2566 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"78aa40f724f61172bcab728ceb702f543d2720db491c94ab99e222384a5a091c\": container with ID starting with 78aa40f724f61172bcab728ceb702f543d2720db491c94ab99e222384a5a091c not found: ID does not exist" containerID="78aa40f724f61172bcab728ceb702f543d2720db491c94ab99e222384a5a091c"
Jul 30 13:45:13.233485 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:45:13.233421    2566 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"78aa40f724f61172bcab728ceb702f543d2720db491c94ab99e222384a5a091c"} err="failed to get container status \"78aa40f724f61172bcab728ceb702f543d2720db491c94ab99e222384a5a091c\": rpc error: code = NotFound desc = could not find container \"78aa40f724f61172bcab728ceb702f543d2720db491c94ab99e222384a5a091c\": container with ID starting with 78aa40f724f61172bcab728ceb702f543d2720db491c94ab99e222384a5a091c not found: ID does not exist"
Jul 30 13:45:13.233485 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:45:13.233443    2566 scope.go:117] "RemoveContainer" containerID="6a9df3e8f83a124f7bea89d3521602cf58c5b87e398849061567e10a58d3f50c"
Jul 30 13:45:13.241953 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:45:13.241937    2566 scope.go:117] "RemoveContainer" containerID="6a9df3e8f83a124f7bea89d3521602cf58c5b87e398849061567e10a58d3f50c"
Jul 30 13:45:13.242225 ip-10-0-143-153 kubenswrapper[2566]: E0730 13:45:13.242208    2566 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6a9df3e8f83a124f7bea89d3521602cf58c5b87e398849061567e10a58d3f50c\": container with ID starting with 6a9df3e8f83a124f7bea89d3521602cf58c5b87e398849061567e10a58d3f50c not found: ID does not exist" containerID="6a9df3e8f83a124f7bea89d3521602cf58c5b87e398849061567e10a58d3f50c"
Jul 30 13:45:13.242287 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:45:13.242230    2566 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6a9df3e8f83a124f7bea89d3521602cf58c5b87e398849061567e10a58d3f50c"} err="failed to get container status \"6a9df3e8f83a124f7bea89d3521602cf58c5b87e398849061567e10a58d3f50c\": rpc error: code = NotFound desc = could not find container \"6a9df3e8f83a124f7bea89d3521602cf58c5b87e398849061567e10a58d3f50c\": container with ID starting with 6a9df3e8f83a124f7bea89d3521602cf58c5b87e398849061567e10a58d3f50c not found: ID does not exist"
Jul 30 13:45:13.247746 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:45:13.247723    2566 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-inf-b-bdee41-564f47487b-5kb7b"]
Jul 30 13:45:13.251763 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:45:13.251739    2566 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-inf-b-bdee41-564f47487b-5kb7b"]
Jul 30 13:45:13.262088 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:45:13.262052    2566 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-inf-b-bdee41-6fb44bfbb-x4bvj"]
Jul 30 13:45:13.266575 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:45:13.266553    2566 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-inf-b-bdee41-6fb44bfbb-x4bvj"]
Jul 30 13:45:13.627629 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:45:13.627539    2566 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="32812613-d312-4a9e-8102-a782ad68677e" path="/var/lib/kubelet/pods/32812613-d312-4a9e-8102-a782ad68677e/volumes"
Jul 30 13:45:13.627983 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:45:13.627914    2566 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="bcc74110-b23b-436e-aa51-e4239530587c" path="/var/lib/kubelet/pods/bcc74110-b23b-436e-aa51-e4239530587c/volumes"
Jul 30 13:45:24.234804 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:45:24.234762    2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-api-a-45e018-5bf8c48f7d-jkz74"]
Jul 30 13:45:24.235297 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:45:24.235280    2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1ba55f4b-747b-473c-88a4-592d8bc184ce" containerName="payload-pre-processing"
Jul 30 13:45:24.235297 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:45:24.235299    2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="1ba55f4b-747b-473c-88a4-592d8bc184ce" containerName="payload-pre-processing"
Jul 30 13:45:24.235386 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:45:24.235314    2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="bcc74110-b23b-436e-aa51-e4239530587c" containerName="payload-pre-processing"
Jul 30 13:45:24.235386 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:45:24.235319    2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="bcc74110-b23b-436e-aa51-e4239530587c" containerName="payload-pre-processing"
Jul 30 13:45:24.235386 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:45:24.235332    2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="fa56f5f8-762c-4eaf-bab1-76e6f008b6f8" containerName="payload-processing"
Jul 30 13:45:24.235386 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:45:24.235338    2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="fa56f5f8-762c-4eaf-bab1-76e6f008b6f8" containerName="payload-processing"
Jul 30 13:45:24.235386 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:45:24.235349    2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f7cb1c77-72b7-460b-bffb-7e6b782e15c7" containerName="maas-api"
Jul 30 13:45:24.235386 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:45:24.235354    2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="f7cb1c77-72b7-460b-bffb-7e6b782e15c7" containerName="maas-api"
Jul 30 13:45:24.235386 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:45:24.235361    2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="32812613-d312-4a9e-8102-a782ad68677e" containerName="payload-processing"
Jul 30 13:45:24.235386 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:45:24.235366    2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="32812613-d312-4a9e-8102-a782ad68677e" containerName="payload-processing"
Jul 30 13:45:24.235660 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:45:24.235424    2566 memory_manager.go:368] "RemoveStaleState removing state" podUID="1ba55f4b-747b-473c-88a4-592d8bc184ce" containerName="payload-pre-processing"
Jul 30 13:45:24.235660 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:45:24.235435    2566 memory_manager.go:368] "RemoveStaleState removing state" podUID="fa56f5f8-762c-4eaf-bab1-76e6f008b6f8" containerName="payload-processing"
Jul 30 13:45:24.235660 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:45:24.235441    2566 memory_manager.go:368] "RemoveStaleState removing state" podUID="bcc74110-b23b-436e-aa51-e4239530587c" containerName="payload-pre-processing"
Jul 30 13:45:24.235660 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:45:24.235448    2566 memory_manager.go:368] "RemoveStaleState removing state" podUID="f7cb1c77-72b7-460b-bffb-7e6b782e15c7" containerName="maas-api"
Jul 30 13:45:24.235660 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:45:24.235455    2566 memory_manager.go:368] "RemoveStaleState removing state" podUID="32812613-d312-4a9e-8102-a782ad68677e" containerName="payload-processing"
Jul 30 13:45:24.239996 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:45:24.239980    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-api-a-45e018-5bf8c48f7d-jkz74"
Jul 30 13:45:24.241911 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:45:24.241889    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-api-a-45e018-dockercfg-6bwbv\""
Jul 30 13:45:24.242031 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:45:24.241955    2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-api-a-45e018\""
Jul 30 13:45:24.252245 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:45:24.252216    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-api-a-45e018-5bf8c48f7d-jkz74"]
Jul 30 13:45:24.288617 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:45:24.288589    2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-a-45e018-58f9889788-swlqj"]
Jul 30 13:45:24.292006 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:45:24.291988    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-api-a-45e018-58f9889788-swlqj"
Jul 30 13:45:24.306419 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:45:24.306395    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-a-45e018-58f9889788-swlqj"]
Jul 30 13:45:24.335982 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:45:24.335950    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/ea1bfbcb-ed94-4d28-8f21-76b45aed54a2-plugins-config-volume\") pod \"payload-pre-processing-e2e-api-a-45e018-58f9889788-swlqj\" (UID: \"ea1bfbcb-ed94-4d28-8f21-76b45aed54a2\") " pod="openshift-ingress/payload-pre-processing-e2e-api-a-45e018-58f9889788-swlqj"
Jul 30 13:45:24.336154 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:45:24.336000    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/9a8bd78a-13c3-47fd-981e-470b96aa1b21-plugins-config-volume\") pod \"payload-processing-e2e-api-a-45e018-5bf8c48f7d-jkz74\" (UID: \"9a8bd78a-13c3-47fd-981e-470b96aa1b21\") " pod="openshift-ingress/payload-processing-e2e-api-a-45e018-5bf8c48f7d-jkz74"
Jul 30 13:45:24.336154 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:45:24.336031    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8z2xk\" (UniqueName: \"kubernetes.io/projected/ea1bfbcb-ed94-4d28-8f21-76b45aed54a2-kube-api-access-8z2xk\") pod \"payload-pre-processing-e2e-api-a-45e018-58f9889788-swlqj\" (UID: \"ea1bfbcb-ed94-4d28-8f21-76b45aed54a2\") " pod="openshift-ingress/payload-pre-processing-e2e-api-a-45e018-58f9889788-swlqj"
Jul 30 13:45:24.336154 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:45:24.336085    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-df5sl\" (UniqueName: \"kubernetes.io/projected/9a8bd78a-13c3-47fd-981e-470b96aa1b21-kube-api-access-df5sl\") pod \"payload-processing-e2e-api-a-45e018-5bf8c48f7d-jkz74\" (UID: \"9a8bd78a-13c3-47fd-981e-470b96aa1b21\") " pod="openshift-ingress/payload-processing-e2e-api-a-45e018-5bf8c48f7d-jkz74"
Jul 30 13:45:24.437514 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:45:24.437472    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/9a8bd78a-13c3-47fd-981e-470b96aa1b21-plugins-config-volume\") pod \"payload-processing-e2e-api-a-45e018-5bf8c48f7d-jkz74\" (UID: \"9a8bd78a-13c3-47fd-981e-470b96aa1b21\") " pod="openshift-ingress/payload-processing-e2e-api-a-45e018-5bf8c48f7d-jkz74"
Jul 30 13:45:24.437514 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:45:24.437522    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8z2xk\" (UniqueName: \"kubernetes.io/projected/ea1bfbcb-ed94-4d28-8f21-76b45aed54a2-kube-api-access-8z2xk\") pod \"payload-pre-processing-e2e-api-a-45e018-58f9889788-swlqj\" (UID: \"ea1bfbcb-ed94-4d28-8f21-76b45aed54a2\") " pod="openshift-ingress/payload-pre-processing-e2e-api-a-45e018-58f9889788-swlqj"
Jul 30 13:45:24.437738 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:45:24.437575    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-df5sl\" (UniqueName: \"kubernetes.io/projected/9a8bd78a-13c3-47fd-981e-470b96aa1b21-kube-api-access-df5sl\") pod \"payload-processing-e2e-api-a-45e018-5bf8c48f7d-jkz74\" (UID: \"9a8bd78a-13c3-47fd-981e-470b96aa1b21\") " pod="openshift-ingress/payload-processing-e2e-api-a-45e018-5bf8c48f7d-jkz74"
Jul 30 13:45:24.437738 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:45:24.437614    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/ea1bfbcb-ed94-4d28-8f21-76b45aed54a2-plugins-config-volume\") pod \"payload-pre-processing-e2e-api-a-45e018-58f9889788-swlqj\" (UID: \"ea1bfbcb-ed94-4d28-8f21-76b45aed54a2\") " pod="openshift-ingress/payload-pre-processing-e2e-api-a-45e018-58f9889788-swlqj"
Jul 30 13:45:24.438327 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:45:24.438303    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/9a8bd78a-13c3-47fd-981e-470b96aa1b21-plugins-config-volume\") pod \"payload-processing-e2e-api-a-45e018-5bf8c48f7d-jkz74\" (UID: \"9a8bd78a-13c3-47fd-981e-470b96aa1b21\") " pod="openshift-ingress/payload-processing-e2e-api-a-45e018-5bf8c48f7d-jkz74"
Jul 30 13:45:24.438431 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:45:24.438366    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/ea1bfbcb-ed94-4d28-8f21-76b45aed54a2-plugins-config-volume\") pod \"payload-pre-processing-e2e-api-a-45e018-58f9889788-swlqj\" (UID: \"ea1bfbcb-ed94-4d28-8f21-76b45aed54a2\") " pod="openshift-ingress/payload-pre-processing-e2e-api-a-45e018-58f9889788-swlqj"
Jul 30 13:45:24.445395 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:45:24.445372    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8z2xk\" (UniqueName: \"kubernetes.io/projected/ea1bfbcb-ed94-4d28-8f21-76b45aed54a2-kube-api-access-8z2xk\") pod \"payload-pre-processing-e2e-api-a-45e018-58f9889788-swlqj\" (UID: \"ea1bfbcb-ed94-4d28-8f21-76b45aed54a2\") " pod="openshift-ingress/payload-pre-processing-e2e-api-a-45e018-58f9889788-swlqj"
Jul 30 13:45:24.445507 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:45:24.445452    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-df5sl\" (UniqueName: \"kubernetes.io/projected/9a8bd78a-13c3-47fd-981e-470b96aa1b21-kube-api-access-df5sl\") pod \"payload-processing-e2e-api-a-45e018-5bf8c48f7d-jkz74\" (UID: \"9a8bd78a-13c3-47fd-981e-470b96aa1b21\") " pod="openshift-ingress/payload-processing-e2e-api-a-45e018-5bf8c48f7d-jkz74"
Jul 30 13:45:24.550649 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:45:24.550554    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-api-a-45e018-5bf8c48f7d-jkz74"
Jul 30 13:45:24.602592 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:45:24.602493    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-api-a-45e018-58f9889788-swlqj"
Jul 30 13:45:24.710062 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:45:24.710031    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-api-a-45e018-5bf8c48f7d-jkz74"]
Jul 30 13:45:24.712103 ip-10-0-143-153 kubenswrapper[2566]: W0730 13:45:24.712050    2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9a8bd78a_13c3_47fd_981e_470b96aa1b21.slice/crio-a56500054a12652de9c5fa6daea6fa736ff5598ce15b1314534679cd26a0039f WatchSource:0}: Error finding container a56500054a12652de9c5fa6daea6fa736ff5598ce15b1314534679cd26a0039f: Status 404 returned error can't find the container with id a56500054a12652de9c5fa6daea6fa736ff5598ce15b1314534679cd26a0039f
Jul 30 13:45:24.755681 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:45:24.755656    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-a-45e018-58f9889788-swlqj"]
Jul 30 13:45:24.758403 ip-10-0-143-153 kubenswrapper[2566]: W0730 13:45:24.758367    2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podea1bfbcb_ed94_4d28_8f21_76b45aed54a2.slice/crio-00e5b63e0e8d6325307477391c52995bc018ac627d26ca4fea55b602cc6647bd WatchSource:0}: Error finding container 00e5b63e0e8d6325307477391c52995bc018ac627d26ca4fea55b602cc6647bd: Status 404 returned error can't find the container with id 00e5b63e0e8d6325307477391c52995bc018ac627d26ca4fea55b602cc6647bd
Jul 30 13:45:25.291495 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:45:25.291462    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-api-a-45e018-58f9889788-swlqj" event={"ID":"ea1bfbcb-ed94-4d28-8f21-76b45aed54a2","Type":"ContainerStarted","Data":"73f149fe96b558df9962f4bd146fdf016c3c5dacb24befffacf0956c026bdee5"}
Jul 30 13:45:25.291914 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:45:25.291524    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-api-a-45e018-58f9889788-swlqj" event={"ID":"ea1bfbcb-ed94-4d28-8f21-76b45aed54a2","Type":"ContainerStarted","Data":"00e5b63e0e8d6325307477391c52995bc018ac627d26ca4fea55b602cc6647bd"}
Jul 30 13:45:25.291914 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:45:25.291603    2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-api-a-45e018-58f9889788-swlqj"
Jul 30 13:45:25.293611 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:45:25.293586    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-api-a-45e018-5bf8c48f7d-jkz74" event={"ID":"9a8bd78a-13c3-47fd-981e-470b96aa1b21","Type":"ContainerStarted","Data":"0bbc4424984ec7fa767e2287c02ebe5aa0a3ac9227e27520409e5d881afba83e"}
Jul 30 13:45:25.293745 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:45:25.293623    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-api-a-45e018-5bf8c48f7d-jkz74" event={"ID":"9a8bd78a-13c3-47fd-981e-470b96aa1b21","Type":"ContainerStarted","Data":"a56500054a12652de9c5fa6daea6fa736ff5598ce15b1314534679cd26a0039f"}
Jul 30 13:45:25.293745 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:45:25.293656    2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-api-a-45e018-5bf8c48f7d-jkz74"
Jul 30 13:45:25.313728 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:45:25.313684    2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-api-a-45e018-58f9889788-swlqj" podStartSLOduration=1.313672694 podStartE2EDuration="1.313672694s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-30 13:45:24 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 13:45:25.312481609 +0000 UTC m=+2754.241169874" watchObservedRunningTime="2026-07-30 13:45:25.313672694 +0000 UTC m=+2754.242360956"
Jul 30 13:45:25.337324 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:45:25.337279    2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-api-a-45e018-5bf8c48f7d-jkz74" podStartSLOduration=1.337264128 podStartE2EDuration="1.337264128s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-30 13:45:24 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 13:45:25.336281114 +0000 UTC m=+2754.264969391" watchObservedRunningTime="2026-07-30 13:45:25.337264128 +0000 UTC m=+2754.265952390"
Jul 30 13:45:36.300628 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:45:36.300596    2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-api-a-45e018-58f9889788-swlqj"
Jul 30 13:45:36.301154 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:45:36.300682    2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-api-a-45e018-5bf8c48f7d-jkz74"
Jul 30 13:45:52.641950 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:45:52.641913    2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-5fdbfb-59fc8d8684-9zzg9"]
Jul 30 13:45:52.646284 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:45:52.646259    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-5fdbfb-59fc8d8684-9zzg9"
Jul 30 13:45:52.648003 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:45:52.647979    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-api-b-5fdbfb-serving-cert\""
Jul 30 13:45:52.655300 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:45:52.655162    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-5fdbfb-59fc8d8684-9zzg9"]
Jul 30 13:45:52.803522 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:45:52.803474    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-svzck\" (UniqueName: \"kubernetes.io/projected/db5acccc-1218-4879-ac88-0e0499e50be9-kube-api-access-svzck\") pod \"maas-api-e2e-api-b-5fdbfb-59fc8d8684-9zzg9\" (UID: \"db5acccc-1218-4879-ac88-0e0499e50be9\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-5fdbfb-59fc8d8684-9zzg9"
Jul 30 13:45:52.803707 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:45:52.803537    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/db5acccc-1218-4879-ac88-0e0499e50be9-openshift-service-ca\") pod \"maas-api-e2e-api-b-5fdbfb-59fc8d8684-9zzg9\" (UID: \"db5acccc-1218-4879-ac88-0e0499e50be9\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-5fdbfb-59fc8d8684-9zzg9"
Jul 30 13:45:52.803755 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:45:52.803703    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/db5acccc-1218-4879-ac88-0e0499e50be9-maas-api-tls\") pod \"maas-api-e2e-api-b-5fdbfb-59fc8d8684-9zzg9\" (UID: \"db5acccc-1218-4879-ac88-0e0499e50be9\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-5fdbfb-59fc8d8684-9zzg9"
Jul 30 13:45:52.904731 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:45:52.904636    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/db5acccc-1218-4879-ac88-0e0499e50be9-maas-api-tls\") pod \"maas-api-e2e-api-b-5fdbfb-59fc8d8684-9zzg9\" (UID: \"db5acccc-1218-4879-ac88-0e0499e50be9\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-5fdbfb-59fc8d8684-9zzg9"
Jul 30 13:45:52.904731 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:45:52.904695    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-svzck\" (UniqueName: \"kubernetes.io/projected/db5acccc-1218-4879-ac88-0e0499e50be9-kube-api-access-svzck\") pod \"maas-api-e2e-api-b-5fdbfb-59fc8d8684-9zzg9\" (UID: \"db5acccc-1218-4879-ac88-0e0499e50be9\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-5fdbfb-59fc8d8684-9zzg9"
Jul 30 13:45:52.904731 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:45:52.904724    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/db5acccc-1218-4879-ac88-0e0499e50be9-openshift-service-ca\") pod \"maas-api-e2e-api-b-5fdbfb-59fc8d8684-9zzg9\" (UID: \"db5acccc-1218-4879-ac88-0e0499e50be9\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-5fdbfb-59fc8d8684-9zzg9"
Jul 30 13:45:52.905035 ip-10-0-143-153 kubenswrapper[2566]: E0730 13:45:52.904819    2566 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-api-b-5fdbfb-serving-cert: secret "maas-api-e2e-api-b-5fdbfb-serving-cert" not found
Jul 30 13:45:52.905035 ip-10-0-143-153 kubenswrapper[2566]: E0730 13:45:52.904905    2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/db5acccc-1218-4879-ac88-0e0499e50be9-maas-api-tls podName:db5acccc-1218-4879-ac88-0e0499e50be9 nodeName:}" failed. No retries permitted until 2026-07-30 13:45:53.40488105 +0000 UTC m=+2782.333569292 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/db5acccc-1218-4879-ac88-0e0499e50be9-maas-api-tls") pod "maas-api-e2e-api-b-5fdbfb-59fc8d8684-9zzg9" (UID: "db5acccc-1218-4879-ac88-0e0499e50be9") : secret "maas-api-e2e-api-b-5fdbfb-serving-cert" not found
Jul 30 13:45:52.905370 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:45:52.905353    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/db5acccc-1218-4879-ac88-0e0499e50be9-openshift-service-ca\") pod \"maas-api-e2e-api-b-5fdbfb-59fc8d8684-9zzg9\" (UID: \"db5acccc-1218-4879-ac88-0e0499e50be9\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-5fdbfb-59fc8d8684-9zzg9"
Jul 30 13:45:52.913521 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:45:52.913497    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-svzck\" (UniqueName: \"kubernetes.io/projected/db5acccc-1218-4879-ac88-0e0499e50be9-kube-api-access-svzck\") pod \"maas-api-e2e-api-b-5fdbfb-59fc8d8684-9zzg9\" (UID: \"db5acccc-1218-4879-ac88-0e0499e50be9\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-5fdbfb-59fc8d8684-9zzg9"
Jul 30 13:45:53.311732 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:45:53.311651    2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-b-5fdbfb-8695cdd44-kljb2"]
Jul 30 13:45:53.315297 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:45:53.315279    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-api-b-5fdbfb-8695cdd44-kljb2"
Jul 30 13:45:53.318145 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:45:53.318124    2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-api-b-5fdbfb\""
Jul 30 13:45:53.322728 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:45:53.322703    2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-api-b-5fdbfb-59876545fb-h8g2l"]
Jul 30 13:45:53.326298 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:45:53.326278    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-api-b-5fdbfb-59876545fb-h8g2l"
Jul 30 13:45:53.345895 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:45:53.345862    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-b-5fdbfb-8695cdd44-kljb2"]
Jul 30 13:45:53.348029 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:45:53.348001    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-api-b-5fdbfb-59876545fb-h8g2l"]
Jul 30 13:45:53.409449 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:45:53.409417    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/33a6785b-efc9-4f22-9bff-21d64f5ab3b2-plugins-config-volume\") pod \"payload-processing-e2e-api-b-5fdbfb-59876545fb-h8g2l\" (UID: \"33a6785b-efc9-4f22-9bff-21d64f5ab3b2\") " pod="openshift-ingress/payload-processing-e2e-api-b-5fdbfb-59876545fb-h8g2l"
Jul 30 13:45:53.409654 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:45:53.409470    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/db5acccc-1218-4879-ac88-0e0499e50be9-maas-api-tls\") pod \"maas-api-e2e-api-b-5fdbfb-59fc8d8684-9zzg9\" (UID: \"db5acccc-1218-4879-ac88-0e0499e50be9\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-5fdbfb-59fc8d8684-9zzg9"
Jul 30 13:45:53.409654 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:45:53.409528    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-czm7n\" (UniqueName: \"kubernetes.io/projected/8658b0ed-79dd-43a6-8553-78443421aa58-kube-api-access-czm7n\") pod \"payload-pre-processing-e2e-api-b-5fdbfb-8695cdd44-kljb2\" (UID: \"8658b0ed-79dd-43a6-8553-78443421aa58\") " pod="openshift-ingress/payload-pre-processing-e2e-api-b-5fdbfb-8695cdd44-kljb2"
Jul 30 13:45:53.409654 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:45:53.409569    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/8658b0ed-79dd-43a6-8553-78443421aa58-plugins-config-volume\") pod \"payload-pre-processing-e2e-api-b-5fdbfb-8695cdd44-kljb2\" (UID: \"8658b0ed-79dd-43a6-8553-78443421aa58\") " pod="openshift-ingress/payload-pre-processing-e2e-api-b-5fdbfb-8695cdd44-kljb2"
Jul 30 13:45:53.409654 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:45:53.409599    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qzqnn\" (UniqueName: \"kubernetes.io/projected/33a6785b-efc9-4f22-9bff-21d64f5ab3b2-kube-api-access-qzqnn\") pod \"payload-processing-e2e-api-b-5fdbfb-59876545fb-h8g2l\" (UID: \"33a6785b-efc9-4f22-9bff-21d64f5ab3b2\") " pod="openshift-ingress/payload-processing-e2e-api-b-5fdbfb-59876545fb-h8g2l"
Jul 30 13:45:53.411999 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:45:53.411975    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/db5acccc-1218-4879-ac88-0e0499e50be9-maas-api-tls\") pod \"maas-api-e2e-api-b-5fdbfb-59fc8d8684-9zzg9\" (UID: \"db5acccc-1218-4879-ac88-0e0499e50be9\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-5fdbfb-59fc8d8684-9zzg9"
Jul 30 13:45:53.510807 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:45:53.510766    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/33a6785b-efc9-4f22-9bff-21d64f5ab3b2-plugins-config-volume\") pod \"payload-processing-e2e-api-b-5fdbfb-59876545fb-h8g2l\" (UID: \"33a6785b-efc9-4f22-9bff-21d64f5ab3b2\") " pod="openshift-ingress/payload-processing-e2e-api-b-5fdbfb-59876545fb-h8g2l"
Jul 30 13:45:53.511014 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:45:53.510831    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-czm7n\" (UniqueName: \"kubernetes.io/projected/8658b0ed-79dd-43a6-8553-78443421aa58-kube-api-access-czm7n\") pod \"payload-pre-processing-e2e-api-b-5fdbfb-8695cdd44-kljb2\" (UID: \"8658b0ed-79dd-43a6-8553-78443421aa58\") " pod="openshift-ingress/payload-pre-processing-e2e-api-b-5fdbfb-8695cdd44-kljb2"
Jul 30 13:45:53.511014 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:45:53.510863    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/8658b0ed-79dd-43a6-8553-78443421aa58-plugins-config-volume\") pod \"payload-pre-processing-e2e-api-b-5fdbfb-8695cdd44-kljb2\" (UID: \"8658b0ed-79dd-43a6-8553-78443421aa58\") " pod="openshift-ingress/payload-pre-processing-e2e-api-b-5fdbfb-8695cdd44-kljb2"
Jul 30 13:45:53.511014 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:45:53.510883    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qzqnn\" (UniqueName: \"kubernetes.io/projected/33a6785b-efc9-4f22-9bff-21d64f5ab3b2-kube-api-access-qzqnn\") pod \"payload-processing-e2e-api-b-5fdbfb-59876545fb-h8g2l\" (UID: \"33a6785b-efc9-4f22-9bff-21d64f5ab3b2\") " pod="openshift-ingress/payload-processing-e2e-api-b-5fdbfb-59876545fb-h8g2l"
Jul 30 13:45:53.511530 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:45:53.511509    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/33a6785b-efc9-4f22-9bff-21d64f5ab3b2-plugins-config-volume\") pod \"payload-processing-e2e-api-b-5fdbfb-59876545fb-h8g2l\" (UID: \"33a6785b-efc9-4f22-9bff-21d64f5ab3b2\") " pod="openshift-ingress/payload-processing-e2e-api-b-5fdbfb-59876545fb-h8g2l"
Jul 30 13:45:53.511586 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:45:53.511529    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/8658b0ed-79dd-43a6-8553-78443421aa58-plugins-config-volume\") pod \"payload-pre-processing-e2e-api-b-5fdbfb-8695cdd44-kljb2\" (UID: \"8658b0ed-79dd-43a6-8553-78443421aa58\") " pod="openshift-ingress/payload-pre-processing-e2e-api-b-5fdbfb-8695cdd44-kljb2"
Jul 30 13:45:53.518316 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:45:53.518295    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-czm7n\" (UniqueName: \"kubernetes.io/projected/8658b0ed-79dd-43a6-8553-78443421aa58-kube-api-access-czm7n\") pod \"payload-pre-processing-e2e-api-b-5fdbfb-8695cdd44-kljb2\" (UID: \"8658b0ed-79dd-43a6-8553-78443421aa58\") " pod="openshift-ingress/payload-pre-processing-e2e-api-b-5fdbfb-8695cdd44-kljb2"
Jul 30 13:45:53.518396 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:45:53.518331    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qzqnn\" (UniqueName: \"kubernetes.io/projected/33a6785b-efc9-4f22-9bff-21d64f5ab3b2-kube-api-access-qzqnn\") pod \"payload-processing-e2e-api-b-5fdbfb-59876545fb-h8g2l\" (UID: \"33a6785b-efc9-4f22-9bff-21d64f5ab3b2\") " pod="openshift-ingress/payload-processing-e2e-api-b-5fdbfb-59876545fb-h8g2l"
Jul 30 13:45:53.569041 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:45:53.568935    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-5fdbfb-59fc8d8684-9zzg9"
Jul 30 13:45:53.626465 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:45:53.626435    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-api-b-5fdbfb-8695cdd44-kljb2"
Jul 30 13:45:53.635728 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:45:53.635657    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-api-b-5fdbfb-59876545fb-h8g2l"
Jul 30 13:45:53.733654 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:45:53.733629    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-5fdbfb-59fc8d8684-9zzg9"]
Jul 30 13:45:53.735257 ip-10-0-143-153 kubenswrapper[2566]: W0730 13:45:53.735229    2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddb5acccc_1218_4879_ac88_0e0499e50be9.slice/crio-8412322f5f0c356338f5934bb46b8168138fac7e275a3e030149edaaabb080fe WatchSource:0}: Error finding container 8412322f5f0c356338f5934bb46b8168138fac7e275a3e030149edaaabb080fe: Status 404 returned error can't find the container with id 8412322f5f0c356338f5934bb46b8168138fac7e275a3e030149edaaabb080fe
Jul 30 13:45:53.736726 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:45:53.736702    2566 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 30 13:45:53.805358 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:45:53.805331    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-api-b-5fdbfb-59876545fb-h8g2l"]
Jul 30 13:45:53.807089 ip-10-0-143-153 kubenswrapper[2566]: W0730 13:45:53.807049    2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod33a6785b_efc9_4f22_9bff_21d64f5ab3b2.slice/crio-744073fb5512b50148fca390696ee8fe5ec127bfacf8612292dc2bbab7d94e89 WatchSource:0}: Error finding container 744073fb5512b50148fca390696ee8fe5ec127bfacf8612292dc2bbab7d94e89: Status 404 returned error can't find the container with id 744073fb5512b50148fca390696ee8fe5ec127bfacf8612292dc2bbab7d94e89
Jul 30 13:45:54.030038 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:45:54.029919    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-b-5fdbfb-8695cdd44-kljb2"]
Jul 30 13:45:54.032273 ip-10-0-143-153 kubenswrapper[2566]: W0730 13:45:54.032247    2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8658b0ed_79dd_43a6_8553_78443421aa58.slice/crio-e127f93dbb25053db5cf13110ca6208e222f4329410d1ed52e9952d5b1b878c6 WatchSource:0}: Error finding container e127f93dbb25053db5cf13110ca6208e222f4329410d1ed52e9952d5b1b878c6: Status 404 returned error can't find the container with id e127f93dbb25053db5cf13110ca6208e222f4329410d1ed52e9952d5b1b878c6
Jul 30 13:45:54.458731 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:45:54.458695    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-api-b-5fdbfb-59876545fb-h8g2l" event={"ID":"33a6785b-efc9-4f22-9bff-21d64f5ab3b2","Type":"ContainerStarted","Data":"836c36579329444d90435062b7c0b1f23ee58d092ce16814c00c7aa5107af92d"}
Jul 30 13:45:54.458972 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:45:54.458752    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-api-b-5fdbfb-59876545fb-h8g2l" event={"ID":"33a6785b-efc9-4f22-9bff-21d64f5ab3b2","Type":"ContainerStarted","Data":"744073fb5512b50148fca390696ee8fe5ec127bfacf8612292dc2bbab7d94e89"}
Jul 30 13:45:54.458972 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:45:54.458809    2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-api-b-5fdbfb-59876545fb-h8g2l"
Jul 30 13:45:54.460364 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:45:54.460334    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-api-b-5fdbfb-8695cdd44-kljb2" event={"ID":"8658b0ed-79dd-43a6-8553-78443421aa58","Type":"ContainerStarted","Data":"2805ed818356d646b0a1023e796d63db997b20db04c07a841e87b2918e6bed4f"}
Jul 30 13:45:54.460487 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:45:54.460387    2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-api-b-5fdbfb-8695cdd44-kljb2"
Jul 30 13:45:54.460487 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:45:54.460411    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-api-b-5fdbfb-8695cdd44-kljb2" event={"ID":"8658b0ed-79dd-43a6-8553-78443421aa58","Type":"ContainerStarted","Data":"e127f93dbb25053db5cf13110ca6208e222f4329410d1ed52e9952d5b1b878c6"}
Jul 30 13:45:54.461698 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:45:54.461676    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-5fdbfb-59fc8d8684-9zzg9" event={"ID":"db5acccc-1218-4879-ac88-0e0499e50be9","Type":"ContainerStarted","Data":"af09625edd871ecf6d5b278f63c734258dc5c534abf653250fe2a3efd569a699"}
Jul 30 13:45:54.461777 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:45:54.461717    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-5fdbfb-59fc8d8684-9zzg9" event={"ID":"db5acccc-1218-4879-ac88-0e0499e50be9","Type":"ContainerStarted","Data":"8412322f5f0c356338f5934bb46b8168138fac7e275a3e030149edaaabb080fe"}
Jul 30 13:45:54.461777 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:45:54.461737    2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-5fdbfb-59fc8d8684-9zzg9"
Jul 30 13:45:54.475211 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:45:54.475151    2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-api-b-5fdbfb-59876545fb-h8g2l" podStartSLOduration=1.4751328209999999 podStartE2EDuration="1.475132821s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-30 13:45:53 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 13:45:54.474296777 +0000 UTC m=+2783.402985055" watchObservedRunningTime="2026-07-30 13:45:54.475132821 +0000 UTC m=+2783.403821085"
Jul 30 13:45:54.489609 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:45:54.489553    2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-api-b-5fdbfb-8695cdd44-kljb2" podStartSLOduration=1.489537285 podStartE2EDuration="1.489537285s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-30 13:45:53 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 13:45:54.488557213 +0000 UTC m=+2783.417245475" watchObservedRunningTime="2026-07-30 13:45:54.489537285 +0000 UTC m=+2783.418225549"
Jul 30 13:45:54.504827 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:45:54.504779    2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-5fdbfb-59fc8d8684-9zzg9" podStartSLOduration=2.092854591 podStartE2EDuration="2.504761971s" totalImagesPullingTime="411.90738ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-30 13:45:52 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 13:45:54.50299835 +0000 UTC m=+2783.431686616" watchObservedRunningTime="2026-07-30 13:45:54.504761971 +0000 UTC m=+2783.433450233"
Jul 30 13:46:00.474209 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:46:00.474169    2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-5fdbfb-59fc8d8684-9zzg9"
Jul 30 13:46:05.470480 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:46:05.470441    2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-api-b-5fdbfb-59876545fb-h8g2l"
Jul 30 13:46:05.470926 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:46:05.470603    2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-api-b-5fdbfb-8695cdd44-kljb2"
Jul 30 13:46:35.070237 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:46:35.070199    2566 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-api-a-45e018-5bf8c48f7d-jkz74"]
Jul 30 13:46:35.070788 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:46:35.070450    2566 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-api-a-45e018-5bf8c48f7d-jkz74" podUID="9a8bd78a-13c3-47fd-981e-470b96aa1b21" containerName="payload-processing" containerID="cri-o://0bbc4424984ec7fa767e2287c02ebe5aa0a3ac9227e27520409e5d881afba83e" gracePeriod=30
Jul 30 13:46:35.084615 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:46:35.084584    2566 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-a-45e018-58f9889788-swlqj"]
Jul 30 13:46:35.084861 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:46:35.084815    2566 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-api-a-45e018-58f9889788-swlqj" podUID="ea1bfbcb-ed94-4d28-8f21-76b45aed54a2" containerName="payload-pre-processing" containerID="cri-o://73f149fe96b558df9962f4bd146fdf016c3c5dacb24befffacf0956c026bdee5" gracePeriod=30
Jul 30 13:46:35.371940 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:46:35.371907    2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-api-a-45e018-5bf8c48f7d-jkz74"
Jul 30 13:46:35.375141 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:46:35.375117    2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-api-a-45e018-58f9889788-swlqj"
Jul 30 13:46:35.491910 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:46:35.491875    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/9a8bd78a-13c3-47fd-981e-470b96aa1b21-plugins-config-volume\") pod \"9a8bd78a-13c3-47fd-981e-470b96aa1b21\" (UID: \"9a8bd78a-13c3-47fd-981e-470b96aa1b21\") "
Jul 30 13:46:35.491910 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:46:35.491911    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-df5sl\" (UniqueName: \"kubernetes.io/projected/9a8bd78a-13c3-47fd-981e-470b96aa1b21-kube-api-access-df5sl\") pod \"9a8bd78a-13c3-47fd-981e-470b96aa1b21\" (UID: \"9a8bd78a-13c3-47fd-981e-470b96aa1b21\") "
Jul 30 13:46:35.492198 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:46:35.491929    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/ea1bfbcb-ed94-4d28-8f21-76b45aed54a2-plugins-config-volume\") pod \"ea1bfbcb-ed94-4d28-8f21-76b45aed54a2\" (UID: \"ea1bfbcb-ed94-4d28-8f21-76b45aed54a2\") "
Jul 30 13:46:35.492198 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:46:35.491988    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-8z2xk\" (UniqueName: \"kubernetes.io/projected/ea1bfbcb-ed94-4d28-8f21-76b45aed54a2-kube-api-access-8z2xk\") pod \"ea1bfbcb-ed94-4d28-8f21-76b45aed54a2\" (UID: \"ea1bfbcb-ed94-4d28-8f21-76b45aed54a2\") "
Jul 30 13:46:35.492371 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:46:35.492345    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ea1bfbcb-ed94-4d28-8f21-76b45aed54a2-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "ea1bfbcb-ed94-4d28-8f21-76b45aed54a2" (UID: "ea1bfbcb-ed94-4d28-8f21-76b45aed54a2"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 30 13:46:35.492371 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:46:35.492358    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9a8bd78a-13c3-47fd-981e-470b96aa1b21-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "9a8bd78a-13c3-47fd-981e-470b96aa1b21" (UID: "9a8bd78a-13c3-47fd-981e-470b96aa1b21"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 30 13:46:35.494108 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:46:35.494069    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9a8bd78a-13c3-47fd-981e-470b96aa1b21-kube-api-access-df5sl" (OuterVolumeSpecName: "kube-api-access-df5sl") pod "9a8bd78a-13c3-47fd-981e-470b96aa1b21" (UID: "9a8bd78a-13c3-47fd-981e-470b96aa1b21"). InnerVolumeSpecName "kube-api-access-df5sl". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 30 13:46:35.494223 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:46:35.494134    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ea1bfbcb-ed94-4d28-8f21-76b45aed54a2-kube-api-access-8z2xk" (OuterVolumeSpecName: "kube-api-access-8z2xk") pod "ea1bfbcb-ed94-4d28-8f21-76b45aed54a2" (UID: "ea1bfbcb-ed94-4d28-8f21-76b45aed54a2"). InnerVolumeSpecName "kube-api-access-8z2xk". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 30 13:46:35.593190 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:46:35.593108    2566 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/9a8bd78a-13c3-47fd-981e-470b96aa1b21-plugins-config-volume\") on node \"ip-10-0-143-153.ec2.internal\" DevicePath \"\""
Jul 30 13:46:35.593190 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:46:35.593139    2566 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-df5sl\" (UniqueName: \"kubernetes.io/projected/9a8bd78a-13c3-47fd-981e-470b96aa1b21-kube-api-access-df5sl\") on node \"ip-10-0-143-153.ec2.internal\" DevicePath \"\""
Jul 30 13:46:35.593190 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:46:35.593149    2566 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/ea1bfbcb-ed94-4d28-8f21-76b45aed54a2-plugins-config-volume\") on node \"ip-10-0-143-153.ec2.internal\" DevicePath \"\""
Jul 30 13:46:35.593190 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:46:35.593157    2566 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-8z2xk\" (UniqueName: \"kubernetes.io/projected/ea1bfbcb-ed94-4d28-8f21-76b45aed54a2-kube-api-access-8z2xk\") on node \"ip-10-0-143-153.ec2.internal\" DevicePath \"\""
Jul 30 13:46:35.683596 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:46:35.683562    2566 generic.go:356] "Generic (PLEG): container finished" podID="9a8bd78a-13c3-47fd-981e-470b96aa1b21" containerID="0bbc4424984ec7fa767e2287c02ebe5aa0a3ac9227e27520409e5d881afba83e" exitCode=0
Jul 30 13:46:35.683781 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:46:35.683615    2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-api-a-45e018-5bf8c48f7d-jkz74"
Jul 30 13:46:35.683781 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:46:35.683654    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-api-a-45e018-5bf8c48f7d-jkz74" event={"ID":"9a8bd78a-13c3-47fd-981e-470b96aa1b21","Type":"ContainerDied","Data":"0bbc4424984ec7fa767e2287c02ebe5aa0a3ac9227e27520409e5d881afba83e"}
Jul 30 13:46:35.683781 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:46:35.683714    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-api-a-45e018-5bf8c48f7d-jkz74" event={"ID":"9a8bd78a-13c3-47fd-981e-470b96aa1b21","Type":"ContainerDied","Data":"a56500054a12652de9c5fa6daea6fa736ff5598ce15b1314534679cd26a0039f"}
Jul 30 13:46:35.683781 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:46:35.683747    2566 scope.go:117] "RemoveContainer" containerID="0bbc4424984ec7fa767e2287c02ebe5aa0a3ac9227e27520409e5d881afba83e"
Jul 30 13:46:35.685221 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:46:35.685194    2566 generic.go:356] "Generic (PLEG): container finished" podID="ea1bfbcb-ed94-4d28-8f21-76b45aed54a2" containerID="73f149fe96b558df9962f4bd146fdf016c3c5dacb24befffacf0956c026bdee5" exitCode=0
Jul 30 13:46:35.685338 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:46:35.685229    2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-api-a-45e018-58f9889788-swlqj"
Jul 30 13:46:35.685338 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:46:35.685234    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-api-a-45e018-58f9889788-swlqj" event={"ID":"ea1bfbcb-ed94-4d28-8f21-76b45aed54a2","Type":"ContainerDied","Data":"73f149fe96b558df9962f4bd146fdf016c3c5dacb24befffacf0956c026bdee5"}
Jul 30 13:46:35.685338 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:46:35.685272    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-api-a-45e018-58f9889788-swlqj" event={"ID":"ea1bfbcb-ed94-4d28-8f21-76b45aed54a2","Type":"ContainerDied","Data":"00e5b63e0e8d6325307477391c52995bc018ac627d26ca4fea55b602cc6647bd"}
Jul 30 13:46:35.694823 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:46:35.694803    2566 scope.go:117] "RemoveContainer" containerID="0bbc4424984ec7fa767e2287c02ebe5aa0a3ac9227e27520409e5d881afba83e"
Jul 30 13:46:35.695119 ip-10-0-143-153 kubenswrapper[2566]: E0730 13:46:35.695098    2566 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0bbc4424984ec7fa767e2287c02ebe5aa0a3ac9227e27520409e5d881afba83e\": container with ID starting with 0bbc4424984ec7fa767e2287c02ebe5aa0a3ac9227e27520409e5d881afba83e not found: ID does not exist" containerID="0bbc4424984ec7fa767e2287c02ebe5aa0a3ac9227e27520409e5d881afba83e"
Jul 30 13:46:35.695181 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:46:35.695127    2566 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0bbc4424984ec7fa767e2287c02ebe5aa0a3ac9227e27520409e5d881afba83e"} err="failed to get container status \"0bbc4424984ec7fa767e2287c02ebe5aa0a3ac9227e27520409e5d881afba83e\": rpc error: code = NotFound desc = could not find container \"0bbc4424984ec7fa767e2287c02ebe5aa0a3ac9227e27520409e5d881afba83e\": container with ID starting with 0bbc4424984ec7fa767e2287c02ebe5aa0a3ac9227e27520409e5d881afba83e not found: ID does not exist"
Jul 30 13:46:35.695181 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:46:35.695145    2566 scope.go:117] "RemoveContainer" containerID="73f149fe96b558df9962f4bd146fdf016c3c5dacb24befffacf0956c026bdee5"
Jul 30 13:46:35.701807 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:46:35.701785    2566 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-a-45e018-58f9889788-swlqj"]
Jul 30 13:46:35.703583 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:46:35.703564    2566 scope.go:117] "RemoveContainer" containerID="73f149fe96b558df9962f4bd146fdf016c3c5dacb24befffacf0956c026bdee5"
Jul 30 13:46:35.704168 ip-10-0-143-153 kubenswrapper[2566]: E0730 13:46:35.703952    2566 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"73f149fe96b558df9962f4bd146fdf016c3c5dacb24befffacf0956c026bdee5\": container with ID starting with 73f149fe96b558df9962f4bd146fdf016c3c5dacb24befffacf0956c026bdee5 not found: ID does not exist" containerID="73f149fe96b558df9962f4bd146fdf016c3c5dacb24befffacf0956c026bdee5"
Jul 30 13:46:35.704168 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:46:35.703993    2566 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"73f149fe96b558df9962f4bd146fdf016c3c5dacb24befffacf0956c026bdee5"} err="failed to get container status \"73f149fe96b558df9962f4bd146fdf016c3c5dacb24befffacf0956c026bdee5\": rpc error: code = NotFound desc = could not find container \"73f149fe96b558df9962f4bd146fdf016c3c5dacb24befffacf0956c026bdee5\": container with ID starting with 73f149fe96b558df9962f4bd146fdf016c3c5dacb24befffacf0956c026bdee5 not found: ID does not exist"
Jul 30 13:46:35.705987 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:46:35.705968    2566 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-a-45e018-58f9889788-swlqj"]
Jul 30 13:46:35.714919 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:46:35.714898    2566 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-api-a-45e018-5bf8c48f7d-jkz74"]
Jul 30 13:46:35.719204 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:46:35.719184    2566 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-api-a-45e018-5bf8c48f7d-jkz74"]
Jul 30 13:46:37.627982 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:46:37.627950    2566 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="9a8bd78a-13c3-47fd-981e-470b96aa1b21" path="/var/lib/kubelet/pods/9a8bd78a-13c3-47fd-981e-470b96aa1b21/volumes"
Jul 30 13:46:37.628378 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:46:37.628330    2566 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ea1bfbcb-ed94-4d28-8f21-76b45aed54a2" path="/var/lib/kubelet/pods/ea1bfbcb-ed94-4d28-8f21-76b45aed54a2/volumes"
Jul 30 13:46:57.566902 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:46:57.566864    2566 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-5fdbfb-59fc8d8684-9zzg9"]
Jul 30 13:46:57.567493 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:46:57.567124    2566 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-5fdbfb-59fc8d8684-9zzg9" podUID="db5acccc-1218-4879-ac88-0e0499e50be9" containerName="maas-api" containerID="cri-o://af09625edd871ecf6d5b278f63c734258dc5c534abf653250fe2a3efd569a699" gracePeriod=30
Jul 30 13:46:57.634065 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:46:57.634035    2566 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-api-b-5fdbfb-59876545fb-h8g2l"]
Jul 30 13:46:57.634325 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:46:57.634295    2566 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-api-b-5fdbfb-59876545fb-h8g2l" podUID="33a6785b-efc9-4f22-9bff-21d64f5ab3b2" containerName="payload-processing" containerID="cri-o://836c36579329444d90435062b7c0b1f23ee58d092ce16814c00c7aa5107af92d" gracePeriod=30
Jul 30 13:46:57.642973 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:46:57.642944    2566 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-b-5fdbfb-8695cdd44-kljb2"]
Jul 30 13:46:57.643193 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:46:57.643156    2566 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-api-b-5fdbfb-8695cdd44-kljb2" podUID="8658b0ed-79dd-43a6-8553-78443421aa58" containerName="payload-pre-processing" containerID="cri-o://2805ed818356d646b0a1023e796d63db997b20db04c07a841e87b2918e6bed4f" gracePeriod=30
Jul 30 13:46:57.807356 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:46:57.807276    2566 generic.go:356] "Generic (PLEG): container finished" podID="33a6785b-efc9-4f22-9bff-21d64f5ab3b2" containerID="836c36579329444d90435062b7c0b1f23ee58d092ce16814c00c7aa5107af92d" exitCode=0
Jul 30 13:46:57.807517 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:46:57.807359    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-api-b-5fdbfb-59876545fb-h8g2l" event={"ID":"33a6785b-efc9-4f22-9bff-21d64f5ab3b2","Type":"ContainerDied","Data":"836c36579329444d90435062b7c0b1f23ee58d092ce16814c00c7aa5107af92d"}
Jul 30 13:46:57.809098 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:46:57.808993    2566 generic.go:356] "Generic (PLEG): container finished" podID="8658b0ed-79dd-43a6-8553-78443421aa58" containerID="2805ed818356d646b0a1023e796d63db997b20db04c07a841e87b2918e6bed4f" exitCode=0
Jul 30 13:46:57.809098 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:46:57.809021    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-api-b-5fdbfb-8695cdd44-kljb2" event={"ID":"8658b0ed-79dd-43a6-8553-78443421aa58","Type":"ContainerDied","Data":"2805ed818356d646b0a1023e796d63db997b20db04c07a841e87b2918e6bed4f"}
Jul 30 13:46:57.810712 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:46:57.810692    2566 generic.go:356] "Generic (PLEG): container finished" podID="db5acccc-1218-4879-ac88-0e0499e50be9" containerID="af09625edd871ecf6d5b278f63c734258dc5c534abf653250fe2a3efd569a699" exitCode=0
Jul 30 13:46:57.810811 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:46:57.810759    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-5fdbfb-59fc8d8684-9zzg9" event={"ID":"db5acccc-1218-4879-ac88-0e0499e50be9","Type":"ContainerDied","Data":"af09625edd871ecf6d5b278f63c734258dc5c534abf653250fe2a3efd569a699"}
Jul 30 13:46:57.920142 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:46:57.920117    2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-5fdbfb-59fc8d8684-9zzg9"
Jul 30 13:46:57.924225 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:46:57.924199    2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-api-b-5fdbfb-59876545fb-h8g2l"
Jul 30 13:46:57.947273 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:46:57.947248    2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-api-b-5fdbfb-8695cdd44-kljb2"
Jul 30 13:46:57.998871 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:46:57.998843    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/db5acccc-1218-4879-ac88-0e0499e50be9-maas-api-tls\") pod \"db5acccc-1218-4879-ac88-0e0499e50be9\" (UID: \"db5acccc-1218-4879-ac88-0e0499e50be9\") "
Jul 30 13:46:57.998871 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:46:57.998874    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/33a6785b-efc9-4f22-9bff-21d64f5ab3b2-plugins-config-volume\") pod \"33a6785b-efc9-4f22-9bff-21d64f5ab3b2\" (UID: \"33a6785b-efc9-4f22-9bff-21d64f5ab3b2\") "
Jul 30 13:46:57.999163 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:46:57.998929    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/8658b0ed-79dd-43a6-8553-78443421aa58-plugins-config-volume\") pod \"8658b0ed-79dd-43a6-8553-78443421aa58\" (UID: \"8658b0ed-79dd-43a6-8553-78443421aa58\") "
Jul 30 13:46:57.999163 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:46:57.998960    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/db5acccc-1218-4879-ac88-0e0499e50be9-openshift-service-ca\") pod \"db5acccc-1218-4879-ac88-0e0499e50be9\" (UID: \"db5acccc-1218-4879-ac88-0e0499e50be9\") "
Jul 30 13:46:57.999163 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:46:57.999000    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-czm7n\" (UniqueName: \"kubernetes.io/projected/8658b0ed-79dd-43a6-8553-78443421aa58-kube-api-access-czm7n\") pod \"8658b0ed-79dd-43a6-8553-78443421aa58\" (UID: \"8658b0ed-79dd-43a6-8553-78443421aa58\") "
Jul 30 13:46:57.999163 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:46:57.999025    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-qzqnn\" (UniqueName: \"kubernetes.io/projected/33a6785b-efc9-4f22-9bff-21d64f5ab3b2-kube-api-access-qzqnn\") pod \"33a6785b-efc9-4f22-9bff-21d64f5ab3b2\" (UID: \"33a6785b-efc9-4f22-9bff-21d64f5ab3b2\") "
Jul 30 13:46:57.999392 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:46:57.999363    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/db5acccc-1218-4879-ac88-0e0499e50be9-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "db5acccc-1218-4879-ac88-0e0499e50be9" (UID: "db5acccc-1218-4879-ac88-0e0499e50be9"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 30 13:46:57.999392 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:46:57.999377    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8658b0ed-79dd-43a6-8553-78443421aa58-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "8658b0ed-79dd-43a6-8553-78443421aa58" (UID: "8658b0ed-79dd-43a6-8553-78443421aa58"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 30 13:46:57.999509 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:46:57.999387    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/33a6785b-efc9-4f22-9bff-21d64f5ab3b2-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "33a6785b-efc9-4f22-9bff-21d64f5ab3b2" (UID: "33a6785b-efc9-4f22-9bff-21d64f5ab3b2"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 30 13:46:57.999509 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:46:57.999424    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-svzck\" (UniqueName: \"kubernetes.io/projected/db5acccc-1218-4879-ac88-0e0499e50be9-kube-api-access-svzck\") pod \"db5acccc-1218-4879-ac88-0e0499e50be9\" (UID: \"db5acccc-1218-4879-ac88-0e0499e50be9\") "
Jul 30 13:46:57.999727 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:46:57.999707    2566 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/8658b0ed-79dd-43a6-8553-78443421aa58-plugins-config-volume\") on node \"ip-10-0-143-153.ec2.internal\" DevicePath \"\""
Jul 30 13:46:57.999727 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:46:57.999728    2566 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/db5acccc-1218-4879-ac88-0e0499e50be9-openshift-service-ca\") on node \"ip-10-0-143-153.ec2.internal\" DevicePath \"\""
Jul 30 13:46:57.999921 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:46:57.999739    2566 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/33a6785b-efc9-4f22-9bff-21d64f5ab3b2-plugins-config-volume\") on node \"ip-10-0-143-153.ec2.internal\" DevicePath \"\""
Jul 30 13:46:58.001270 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:46:58.001237    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/33a6785b-efc9-4f22-9bff-21d64f5ab3b2-kube-api-access-qzqnn" (OuterVolumeSpecName: "kube-api-access-qzqnn") pod "33a6785b-efc9-4f22-9bff-21d64f5ab3b2" (UID: "33a6785b-efc9-4f22-9bff-21d64f5ab3b2"). InnerVolumeSpecName "kube-api-access-qzqnn". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 30 13:46:58.001487 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:46:58.001465    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/db5acccc-1218-4879-ac88-0e0499e50be9-kube-api-access-svzck" (OuterVolumeSpecName: "kube-api-access-svzck") pod "db5acccc-1218-4879-ac88-0e0499e50be9" (UID: "db5acccc-1218-4879-ac88-0e0499e50be9"). InnerVolumeSpecName "kube-api-access-svzck". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 30 13:46:58.001682 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:46:58.001661    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/db5acccc-1218-4879-ac88-0e0499e50be9-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "db5acccc-1218-4879-ac88-0e0499e50be9" (UID: "db5acccc-1218-4879-ac88-0e0499e50be9"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 30 13:46:58.001741 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:46:58.001663    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8658b0ed-79dd-43a6-8553-78443421aa58-kube-api-access-czm7n" (OuterVolumeSpecName: "kube-api-access-czm7n") pod "8658b0ed-79dd-43a6-8553-78443421aa58" (UID: "8658b0ed-79dd-43a6-8553-78443421aa58"). InnerVolumeSpecName "kube-api-access-czm7n". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 30 13:46:58.101040 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:46:58.100963    2566 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/db5acccc-1218-4879-ac88-0e0499e50be9-maas-api-tls\") on node \"ip-10-0-143-153.ec2.internal\" DevicePath \"\""
Jul 30 13:46:58.101040 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:46:58.100992    2566 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-czm7n\" (UniqueName: \"kubernetes.io/projected/8658b0ed-79dd-43a6-8553-78443421aa58-kube-api-access-czm7n\") on node \"ip-10-0-143-153.ec2.internal\" DevicePath \"\""
Jul 30 13:46:58.101040 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:46:58.101002    2566 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-qzqnn\" (UniqueName: \"kubernetes.io/projected/33a6785b-efc9-4f22-9bff-21d64f5ab3b2-kube-api-access-qzqnn\") on node \"ip-10-0-143-153.ec2.internal\" DevicePath \"\""
Jul 30 13:46:58.101040 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:46:58.101012    2566 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-svzck\" (UniqueName: \"kubernetes.io/projected/db5acccc-1218-4879-ac88-0e0499e50be9-kube-api-access-svzck\") on node \"ip-10-0-143-153.ec2.internal\" DevicePath \"\""
Jul 30 13:46:58.816380 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:46:58.816344    2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-api-b-5fdbfb-8695cdd44-kljb2"
Jul 30 13:46:58.816798 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:46:58.816343    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-api-b-5fdbfb-8695cdd44-kljb2" event={"ID":"8658b0ed-79dd-43a6-8553-78443421aa58","Type":"ContainerDied","Data":"e127f93dbb25053db5cf13110ca6208e222f4329410d1ed52e9952d5b1b878c6"}
Jul 30 13:46:58.816798 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:46:58.816515    2566 scope.go:117] "RemoveContainer" containerID="2805ed818356d646b0a1023e796d63db997b20db04c07a841e87b2918e6bed4f"
Jul 30 13:46:58.817977 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:46:58.817953    2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-5fdbfb-59fc8d8684-9zzg9"
Jul 30 13:46:58.817977 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:46:58.817968    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-5fdbfb-59fc8d8684-9zzg9" event={"ID":"db5acccc-1218-4879-ac88-0e0499e50be9","Type":"ContainerDied","Data":"8412322f5f0c356338f5934bb46b8168138fac7e275a3e030149edaaabb080fe"}
Jul 30 13:46:58.819472 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:46:58.819445    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-api-b-5fdbfb-59876545fb-h8g2l" event={"ID":"33a6785b-efc9-4f22-9bff-21d64f5ab3b2","Type":"ContainerDied","Data":"744073fb5512b50148fca390696ee8fe5ec127bfacf8612292dc2bbab7d94e89"}
Jul 30 13:46:58.819602 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:46:58.819506    2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-api-b-5fdbfb-59876545fb-h8g2l"
Jul 30 13:46:58.827570 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:46:58.827541    2566 scope.go:117] "RemoveContainer" containerID="af09625edd871ecf6d5b278f63c734258dc5c534abf653250fe2a3efd569a699"
Jul 30 13:46:58.836555 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:46:58.836535    2566 scope.go:117] "RemoveContainer" containerID="836c36579329444d90435062b7c0b1f23ee58d092ce16814c00c7aa5107af92d"
Jul 30 13:46:58.842371 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:46:58.842346    2566 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-b-5fdbfb-8695cdd44-kljb2"]
Jul 30 13:46:58.848568 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:46:58.848547    2566 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-b-5fdbfb-8695cdd44-kljb2"]
Jul 30 13:46:58.858399 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:46:58.858377    2566 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-5fdbfb-59fc8d8684-9zzg9"]
Jul 30 13:46:58.862436 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:46:58.862415    2566 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-5fdbfb-59fc8d8684-9zzg9"]
Jul 30 13:46:58.872215 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:46:58.872194    2566 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-api-b-5fdbfb-59876545fb-h8g2l"]
Jul 30 13:46:58.877043 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:46:58.877022    2566 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-api-b-5fdbfb-59876545fb-h8g2l"]
Jul 30 13:46:59.629578 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:46:59.629545    2566 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="33a6785b-efc9-4f22-9bff-21d64f5ab3b2" path="/var/lib/kubelet/pods/33a6785b-efc9-4f22-9bff-21d64f5ab3b2/volumes"
Jul 30 13:46:59.630027 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:46:59.630007    2566 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="8658b0ed-79dd-43a6-8553-78443421aa58" path="/var/lib/kubelet/pods/8658b0ed-79dd-43a6-8553-78443421aa58/volumes"
Jul 30 13:46:59.630448 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:46:59.630424    2566 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="db5acccc-1218-4879-ac88-0e0499e50be9" path="/var/lib/kubelet/pods/db5acccc-1218-4879-ac88-0e0499e50be9/volumes"
Jul 30 13:47:09.747467 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:47:09.747433    2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-a-f4dc0a-7c5b8c59bd-2cszm"]
Jul 30 13:47:09.747899 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:47:09.747806    2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="db5acccc-1218-4879-ac88-0e0499e50be9" containerName="maas-api"
Jul 30 13:47:09.747899 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:47:09.747817    2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="db5acccc-1218-4879-ac88-0e0499e50be9" containerName="maas-api"
Jul 30 13:47:09.747899 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:47:09.747834    2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8658b0ed-79dd-43a6-8553-78443421aa58" containerName="payload-pre-processing"
Jul 30 13:47:09.747899 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:47:09.747842    2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="8658b0ed-79dd-43a6-8553-78443421aa58" containerName="payload-pre-processing"
Jul 30 13:47:09.747899 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:47:09.747851    2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9a8bd78a-13c3-47fd-981e-470b96aa1b21" containerName="payload-processing"
Jul 30 13:47:09.747899 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:47:09.747857    2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="9a8bd78a-13c3-47fd-981e-470b96aa1b21" containerName="payload-processing"
Jul 30 13:47:09.747899 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:47:09.747870    2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ea1bfbcb-ed94-4d28-8f21-76b45aed54a2" containerName="payload-pre-processing"
Jul 30 13:47:09.747899 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:47:09.747876    2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="ea1bfbcb-ed94-4d28-8f21-76b45aed54a2" containerName="payload-pre-processing"
Jul 30 13:47:09.747899 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:47:09.747882    2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="33a6785b-efc9-4f22-9bff-21d64f5ab3b2" containerName="payload-processing"
Jul 30 13:47:09.747899 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:47:09.747887    2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="33a6785b-efc9-4f22-9bff-21d64f5ab3b2" containerName="payload-processing"
Jul 30 13:47:09.748344 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:47:09.747942    2566 memory_manager.go:368] "RemoveStaleState removing state" podUID="9a8bd78a-13c3-47fd-981e-470b96aa1b21" containerName="payload-processing"
Jul 30 13:47:09.748344 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:47:09.747950    2566 memory_manager.go:368] "RemoveStaleState removing state" podUID="33a6785b-efc9-4f22-9bff-21d64f5ab3b2" containerName="payload-processing"
Jul 30 13:47:09.748344 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:47:09.747957    2566 memory_manager.go:368] "RemoveStaleState removing state" podUID="ea1bfbcb-ed94-4d28-8f21-76b45aed54a2" containerName="payload-pre-processing"
Jul 30 13:47:09.748344 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:47:09.747965    2566 memory_manager.go:368] "RemoveStaleState removing state" podUID="db5acccc-1218-4879-ac88-0e0499e50be9" containerName="maas-api"
Jul 30 13:47:09.748344 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:47:09.747972    2566 memory_manager.go:368] "RemoveStaleState removing state" podUID="8658b0ed-79dd-43a6-8553-78443421aa58" containerName="payload-pre-processing"
Jul 30 13:47:09.752662 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:47:09.752645    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-f4dc0a-7c5b8c59bd-2cszm"
Jul 30 13:47:09.754704 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:47:09.754686    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-shared-a-f4dc0a-dockercfg-tvzgv\""
Jul 30 13:47:09.754809 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:47:09.754688    2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-shared-a-f4dc0a\""
Jul 30 13:47:09.759997 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:47:09.759974    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-a-f4dc0a-7c5b8c59bd-2cszm"]
Jul 30 13:47:09.781243 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:47:09.781210    2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-a-f4dc0a-7cbc4cb99d-s6xr6"]
Jul 30 13:47:09.785752 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:47:09.785715    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-a-f4dc0a-7cbc4cb99d-s6xr6"
Jul 30 13:47:09.798302 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:47:09.798275    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-a-f4dc0a-7cbc4cb99d-s6xr6"]
Jul 30 13:47:09.912776 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:47:09.912742    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/881c595b-3957-45ae-9da4-f6655fd4c779-plugins-config-volume\") pod \"payload-pre-processing-e2e-shared-a-f4dc0a-7c5b8c59bd-2cszm\" (UID: \"881c595b-3957-45ae-9da4-f6655fd4c779\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-a-f4dc0a-7c5b8c59bd-2cszm"
Jul 30 13:47:09.912940 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:47:09.912797    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-psrdj\" (UniqueName: \"kubernetes.io/projected/881c595b-3957-45ae-9da4-f6655fd4c779-kube-api-access-psrdj\") pod \"payload-pre-processing-e2e-shared-a-f4dc0a-7c5b8c59bd-2cszm\" (UID: \"881c595b-3957-45ae-9da4-f6655fd4c779\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-a-f4dc0a-7c5b8c59bd-2cszm"
Jul 30 13:47:09.912940 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:47:09.912839    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dm866\" (UniqueName: \"kubernetes.io/projected/e7b30cc1-c765-49b7-80ca-bbe7755911df-kube-api-access-dm866\") pod \"payload-processing-e2e-shared-a-f4dc0a-7cbc4cb99d-s6xr6\" (UID: \"e7b30cc1-c765-49b7-80ca-bbe7755911df\") " pod="openshift-ingress/payload-processing-e2e-shared-a-f4dc0a-7cbc4cb99d-s6xr6"
Jul 30 13:47:09.912940 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:47:09.912870    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/e7b30cc1-c765-49b7-80ca-bbe7755911df-plugins-config-volume\") pod \"payload-processing-e2e-shared-a-f4dc0a-7cbc4cb99d-s6xr6\" (UID: \"e7b30cc1-c765-49b7-80ca-bbe7755911df\") " pod="openshift-ingress/payload-processing-e2e-shared-a-f4dc0a-7cbc4cb99d-s6xr6"
Jul 30 13:47:10.013471 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:47:10.013386    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/881c595b-3957-45ae-9da4-f6655fd4c779-plugins-config-volume\") pod \"payload-pre-processing-e2e-shared-a-f4dc0a-7c5b8c59bd-2cszm\" (UID: \"881c595b-3957-45ae-9da4-f6655fd4c779\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-a-f4dc0a-7c5b8c59bd-2cszm"
Jul 30 13:47:10.013471 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:47:10.013441    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-psrdj\" (UniqueName: \"kubernetes.io/projected/881c595b-3957-45ae-9da4-f6655fd4c779-kube-api-access-psrdj\") pod \"payload-pre-processing-e2e-shared-a-f4dc0a-7c5b8c59bd-2cszm\" (UID: \"881c595b-3957-45ae-9da4-f6655fd4c779\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-a-f4dc0a-7c5b8c59bd-2cszm"
Jul 30 13:47:10.013471 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:47:10.013461    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dm866\" (UniqueName: \"kubernetes.io/projected/e7b30cc1-c765-49b7-80ca-bbe7755911df-kube-api-access-dm866\") pod \"payload-processing-e2e-shared-a-f4dc0a-7cbc4cb99d-s6xr6\" (UID: \"e7b30cc1-c765-49b7-80ca-bbe7755911df\") " pod="openshift-ingress/payload-processing-e2e-shared-a-f4dc0a-7cbc4cb99d-s6xr6"
Jul 30 13:47:10.013706 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:47:10.013480    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/e7b30cc1-c765-49b7-80ca-bbe7755911df-plugins-config-volume\") pod \"payload-processing-e2e-shared-a-f4dc0a-7cbc4cb99d-s6xr6\" (UID: \"e7b30cc1-c765-49b7-80ca-bbe7755911df\") " pod="openshift-ingress/payload-processing-e2e-shared-a-f4dc0a-7cbc4cb99d-s6xr6"
Jul 30 13:47:10.014156 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:47:10.014139    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/e7b30cc1-c765-49b7-80ca-bbe7755911df-plugins-config-volume\") pod \"payload-processing-e2e-shared-a-f4dc0a-7cbc4cb99d-s6xr6\" (UID: \"e7b30cc1-c765-49b7-80ca-bbe7755911df\") " pod="openshift-ingress/payload-processing-e2e-shared-a-f4dc0a-7cbc4cb99d-s6xr6"
Jul 30 13:47:10.014231 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:47:10.014203    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/881c595b-3957-45ae-9da4-f6655fd4c779-plugins-config-volume\") pod \"payload-pre-processing-e2e-shared-a-f4dc0a-7c5b8c59bd-2cszm\" (UID: \"881c595b-3957-45ae-9da4-f6655fd4c779\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-a-f4dc0a-7c5b8c59bd-2cszm"
Jul 30 13:47:10.022045 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:47:10.022024    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-psrdj\" (UniqueName: \"kubernetes.io/projected/881c595b-3957-45ae-9da4-f6655fd4c779-kube-api-access-psrdj\") pod \"payload-pre-processing-e2e-shared-a-f4dc0a-7c5b8c59bd-2cszm\" (UID: \"881c595b-3957-45ae-9da4-f6655fd4c779\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-a-f4dc0a-7c5b8c59bd-2cszm"
Jul 30 13:47:10.022180 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:47:10.022134    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dm866\" (UniqueName: \"kubernetes.io/projected/e7b30cc1-c765-49b7-80ca-bbe7755911df-kube-api-access-dm866\") pod \"payload-processing-e2e-shared-a-f4dc0a-7cbc4cb99d-s6xr6\" (UID: \"e7b30cc1-c765-49b7-80ca-bbe7755911df\") " pod="openshift-ingress/payload-processing-e2e-shared-a-f4dc0a-7cbc4cb99d-s6xr6"
Jul 30 13:47:10.064729 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:47:10.064700    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-f4dc0a-7c5b8c59bd-2cszm"
Jul 30 13:47:10.097870 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:47:10.097836    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-a-f4dc0a-7cbc4cb99d-s6xr6"
Jul 30 13:47:10.256449 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:47:10.256422    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-a-f4dc0a-7cbc4cb99d-s6xr6"]
Jul 30 13:47:10.259230 ip-10-0-143-153 kubenswrapper[2566]: W0730 13:47:10.259194    2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode7b30cc1_c765_49b7_80ca_bbe7755911df.slice/crio-b7d3d0a8bf0449d397e96a9352b82e06136378f43b19c7b9e52bc5292dbd2a8d WatchSource:0}: Error finding container b7d3d0a8bf0449d397e96a9352b82e06136378f43b19c7b9e52bc5292dbd2a8d: Status 404 returned error can't find the container with id b7d3d0a8bf0449d397e96a9352b82e06136378f43b19c7b9e52bc5292dbd2a8d
Jul 30 13:47:10.427355 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:47:10.427323    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-a-f4dc0a-7c5b8c59bd-2cszm"]
Jul 30 13:47:10.430955 ip-10-0-143-153 kubenswrapper[2566]: W0730 13:47:10.430926    2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod881c595b_3957_45ae_9da4_f6655fd4c779.slice/crio-b37a0d26c35e302f95f7796ba4bf13c072975d3f69a130fc07cc12cf9630a884 WatchSource:0}: Error finding container b37a0d26c35e302f95f7796ba4bf13c072975d3f69a130fc07cc12cf9630a884: Status 404 returned error can't find the container with id b37a0d26c35e302f95f7796ba4bf13c072975d3f69a130fc07cc12cf9630a884
Jul 30 13:47:10.886281 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:47:10.886238    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-a-f4dc0a-7cbc4cb99d-s6xr6" event={"ID":"e7b30cc1-c765-49b7-80ca-bbe7755911df","Type":"ContainerStarted","Data":"e72b6744f48ee8d83c1c75ede4641e16b072702385ab620d107465fdf2e3def1"}
Jul 30 13:47:10.886788 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:47:10.886315    2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-shared-a-f4dc0a-7cbc4cb99d-s6xr6"
Jul 30 13:47:10.886788 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:47:10.886339    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-a-f4dc0a-7cbc4cb99d-s6xr6" event={"ID":"e7b30cc1-c765-49b7-80ca-bbe7755911df","Type":"ContainerStarted","Data":"b7d3d0a8bf0449d397e96a9352b82e06136378f43b19c7b9e52bc5292dbd2a8d"}
Jul 30 13:47:10.887989 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:47:10.887965    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-f4dc0a-7c5b8c59bd-2cszm" event={"ID":"881c595b-3957-45ae-9da4-f6655fd4c779","Type":"ContainerStarted","Data":"bc5e1a90a429abd2bfa0c0acedb22048d59e8cf52fc926704deb52071d3d75c7"}
Jul 30 13:47:10.888139 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:47:10.888006    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-f4dc0a-7c5b8c59bd-2cszm" event={"ID":"881c595b-3957-45ae-9da4-f6655fd4c779","Type":"ContainerStarted","Data":"b37a0d26c35e302f95f7796ba4bf13c072975d3f69a130fc07cc12cf9630a884"}
Jul 30 13:47:10.888139 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:47:10.888121    2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-f4dc0a-7c5b8c59bd-2cszm"
Jul 30 13:47:10.903270 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:47:10.903211    2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-shared-a-f4dc0a-7cbc4cb99d-s6xr6" podStartSLOduration=1.90319271 podStartE2EDuration="1.90319271s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-30 13:47:09 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 13:47:10.901889193 +0000 UTC m=+2859.830577468" watchObservedRunningTime="2026-07-30 13:47:10.90319271 +0000 UTC m=+2859.831880975"
Jul 30 13:47:10.917593 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:47:10.917546    2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-f4dc0a-7c5b8c59bd-2cszm" podStartSLOduration=1.917529091 podStartE2EDuration="1.917529091s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-30 13:47:09 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 13:47:10.91654672 +0000 UTC m=+2859.845234982" watchObservedRunningTime="2026-07-30 13:47:10.917529091 +0000 UTC m=+2859.846217354"
Jul 30 13:47:21.894616 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:47:21.894584    2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-shared-a-f4dc0a-7cbc4cb99d-s6xr6"
Jul 30 13:47:21.895006 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:47:21.894658    2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-f4dc0a-7c5b8c59bd-2cszm"
Jul 30 13:47:37.250997 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:47:37.250962    2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-e945a1-7dd46465c9-ck9fr"]
Jul 30 13:47:37.258958 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:47:37.258929    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-e945a1-7dd46465c9-ck9fr"
Jul 30 13:47:37.262482 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:47:37.262455    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-e945a1-7dd46465c9-ck9fr"]
Jul 30 13:47:37.263476 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:47:37.263369    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-shared-b-e945a1-serving-cert\""
Jul 30 13:47:37.352407 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:47:37.352364    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gwp85\" (UniqueName: \"kubernetes.io/projected/b767dcfe-a268-4dd8-94cb-9ae86d281bfd-kube-api-access-gwp85\") pod \"maas-api-e2e-shared-b-e945a1-7dd46465c9-ck9fr\" (UID: \"b767dcfe-a268-4dd8-94cb-9ae86d281bfd\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-e945a1-7dd46465c9-ck9fr"
Jul 30 13:47:37.352575 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:47:37.352463    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/b767dcfe-a268-4dd8-94cb-9ae86d281bfd-maas-api-tls\") pod \"maas-api-e2e-shared-b-e945a1-7dd46465c9-ck9fr\" (UID: \"b767dcfe-a268-4dd8-94cb-9ae86d281bfd\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-e945a1-7dd46465c9-ck9fr"
Jul 30 13:47:37.352575 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:47:37.352546    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/b767dcfe-a268-4dd8-94cb-9ae86d281bfd-openshift-service-ca\") pod \"maas-api-e2e-shared-b-e945a1-7dd46465c9-ck9fr\" (UID: \"b767dcfe-a268-4dd8-94cb-9ae86d281bfd\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-e945a1-7dd46465c9-ck9fr"
Jul 30 13:47:37.453269 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:47:37.453236    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/b767dcfe-a268-4dd8-94cb-9ae86d281bfd-openshift-service-ca\") pod \"maas-api-e2e-shared-b-e945a1-7dd46465c9-ck9fr\" (UID: \"b767dcfe-a268-4dd8-94cb-9ae86d281bfd\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-e945a1-7dd46465c9-ck9fr"
Jul 30 13:47:37.453442 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:47:37.453316    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gwp85\" (UniqueName: \"kubernetes.io/projected/b767dcfe-a268-4dd8-94cb-9ae86d281bfd-kube-api-access-gwp85\") pod \"maas-api-e2e-shared-b-e945a1-7dd46465c9-ck9fr\" (UID: \"b767dcfe-a268-4dd8-94cb-9ae86d281bfd\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-e945a1-7dd46465c9-ck9fr"
Jul 30 13:47:37.453442 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:47:37.453380    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/b767dcfe-a268-4dd8-94cb-9ae86d281bfd-maas-api-tls\") pod \"maas-api-e2e-shared-b-e945a1-7dd46465c9-ck9fr\" (UID: \"b767dcfe-a268-4dd8-94cb-9ae86d281bfd\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-e945a1-7dd46465c9-ck9fr"
Jul 30 13:47:37.453584 ip-10-0-143-153 kubenswrapper[2566]: E0730 13:47:37.453515    2566 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-shared-b-e945a1-serving-cert: secret "maas-api-e2e-shared-b-e945a1-serving-cert" not found
Jul 30 13:47:37.453644 ip-10-0-143-153 kubenswrapper[2566]: E0730 13:47:37.453590    2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b767dcfe-a268-4dd8-94cb-9ae86d281bfd-maas-api-tls podName:b767dcfe-a268-4dd8-94cb-9ae86d281bfd nodeName:}" failed. No retries permitted until 2026-07-30 13:47:37.953567782 +0000 UTC m=+2886.882256041 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/b767dcfe-a268-4dd8-94cb-9ae86d281bfd-maas-api-tls") pod "maas-api-e2e-shared-b-e945a1-7dd46465c9-ck9fr" (UID: "b767dcfe-a268-4dd8-94cb-9ae86d281bfd") : secret "maas-api-e2e-shared-b-e945a1-serving-cert" not found
Jul 30 13:47:37.453944 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:47:37.453920    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/b767dcfe-a268-4dd8-94cb-9ae86d281bfd-openshift-service-ca\") pod \"maas-api-e2e-shared-b-e945a1-7dd46465c9-ck9fr\" (UID: \"b767dcfe-a268-4dd8-94cb-9ae86d281bfd\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-e945a1-7dd46465c9-ck9fr"
Jul 30 13:47:37.464619 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:47:37.464589    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gwp85\" (UniqueName: \"kubernetes.io/projected/b767dcfe-a268-4dd8-94cb-9ae86d281bfd-kube-api-access-gwp85\") pod \"maas-api-e2e-shared-b-e945a1-7dd46465c9-ck9fr\" (UID: \"b767dcfe-a268-4dd8-94cb-9ae86d281bfd\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-e945a1-7dd46465c9-ck9fr"
Jul 30 13:47:37.889308 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:47:37.889267    2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-b-e945a1-6c4d84789b-tbk85"]
Jul 30 13:47:37.893061 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:47:37.893044    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-e945a1-6c4d84789b-tbk85"
Jul 30 13:47:37.896257 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:47:37.896229    2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-shared-b-e945a1\""
Jul 30 13:47:37.896452 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:47:37.896438    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-shared-b-e945a1-dockercfg-ds6tn\""
Jul 30 13:47:37.902444 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:47:37.902416    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-b-e945a1-6c4d84789b-tbk85"]
Jul 30 13:47:37.916878 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:47:37.916836    2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-b-e945a1-5c9b5b596b-bzzsl"]
Jul 30 13:47:37.921134 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:47:37.921112    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-b-e945a1-5c9b5b596b-bzzsl"
Jul 30 13:47:37.926775 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:47:37.926752    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-b-e945a1-5c9b5b596b-bzzsl"]
Jul 30 13:47:37.957877 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:47:37.957850    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fvknm\" (UniqueName: \"kubernetes.io/projected/dbc3def8-0b66-446b-bac2-241bdc436dd4-kube-api-access-fvknm\") pod \"payload-processing-e2e-shared-b-e945a1-5c9b5b596b-bzzsl\" (UID: \"dbc3def8-0b66-446b-bac2-241bdc436dd4\") " pod="openshift-ingress/payload-processing-e2e-shared-b-e945a1-5c9b5b596b-bzzsl"
Jul 30 13:47:37.958036 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:47:37.957968    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/b767dcfe-a268-4dd8-94cb-9ae86d281bfd-maas-api-tls\") pod \"maas-api-e2e-shared-b-e945a1-7dd46465c9-ck9fr\" (UID: \"b767dcfe-a268-4dd8-94cb-9ae86d281bfd\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-e945a1-7dd46465c9-ck9fr"
Jul 30 13:47:37.958036 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:47:37.958005    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vpwk8\" (UniqueName: \"kubernetes.io/projected/c8762a24-6b2f-4202-a17a-b5c8fdfc09e9-kube-api-access-vpwk8\") pod \"payload-pre-processing-e2e-shared-b-e945a1-6c4d84789b-tbk85\" (UID: \"c8762a24-6b2f-4202-a17a-b5c8fdfc09e9\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-b-e945a1-6c4d84789b-tbk85"
Jul 30 13:47:37.958036 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:47:37.958026    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/dbc3def8-0b66-446b-bac2-241bdc436dd4-plugins-config-volume\") pod \"payload-processing-e2e-shared-b-e945a1-5c9b5b596b-bzzsl\" (UID: \"dbc3def8-0b66-446b-bac2-241bdc436dd4\") " pod="openshift-ingress/payload-processing-e2e-shared-b-e945a1-5c9b5b596b-bzzsl"
Jul 30 13:47:37.958169 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:47:37.958045    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/c8762a24-6b2f-4202-a17a-b5c8fdfc09e9-plugins-config-volume\") pod \"payload-pre-processing-e2e-shared-b-e945a1-6c4d84789b-tbk85\" (UID: \"c8762a24-6b2f-4202-a17a-b5c8fdfc09e9\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-b-e945a1-6c4d84789b-tbk85"
Jul 30 13:47:37.960326 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:47:37.960308    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/b767dcfe-a268-4dd8-94cb-9ae86d281bfd-maas-api-tls\") pod \"maas-api-e2e-shared-b-e945a1-7dd46465c9-ck9fr\" (UID: \"b767dcfe-a268-4dd8-94cb-9ae86d281bfd\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-e945a1-7dd46465c9-ck9fr"
Jul 30 13:47:38.059006 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:47:38.058975    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vpwk8\" (UniqueName: \"kubernetes.io/projected/c8762a24-6b2f-4202-a17a-b5c8fdfc09e9-kube-api-access-vpwk8\") pod \"payload-pre-processing-e2e-shared-b-e945a1-6c4d84789b-tbk85\" (UID: \"c8762a24-6b2f-4202-a17a-b5c8fdfc09e9\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-b-e945a1-6c4d84789b-tbk85"
Jul 30 13:47:38.059006 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:47:38.059008    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/dbc3def8-0b66-446b-bac2-241bdc436dd4-plugins-config-volume\") pod \"payload-processing-e2e-shared-b-e945a1-5c9b5b596b-bzzsl\" (UID: \"dbc3def8-0b66-446b-bac2-241bdc436dd4\") " pod="openshift-ingress/payload-processing-e2e-shared-b-e945a1-5c9b5b596b-bzzsl"
Jul 30 13:47:38.059310 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:47:38.059031    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/c8762a24-6b2f-4202-a17a-b5c8fdfc09e9-plugins-config-volume\") pod \"payload-pre-processing-e2e-shared-b-e945a1-6c4d84789b-tbk85\" (UID: \"c8762a24-6b2f-4202-a17a-b5c8fdfc09e9\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-b-e945a1-6c4d84789b-tbk85"
Jul 30 13:47:38.059310 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:47:38.059068    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fvknm\" (UniqueName: \"kubernetes.io/projected/dbc3def8-0b66-446b-bac2-241bdc436dd4-kube-api-access-fvknm\") pod \"payload-processing-e2e-shared-b-e945a1-5c9b5b596b-bzzsl\" (UID: \"dbc3def8-0b66-446b-bac2-241bdc436dd4\") " pod="openshift-ingress/payload-processing-e2e-shared-b-e945a1-5c9b5b596b-bzzsl"
Jul 30 13:47:38.059765 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:47:38.059742    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/dbc3def8-0b66-446b-bac2-241bdc436dd4-plugins-config-volume\") pod \"payload-processing-e2e-shared-b-e945a1-5c9b5b596b-bzzsl\" (UID: \"dbc3def8-0b66-446b-bac2-241bdc436dd4\") " pod="openshift-ingress/payload-processing-e2e-shared-b-e945a1-5c9b5b596b-bzzsl"
Jul 30 13:47:38.059855 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:47:38.059836    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/c8762a24-6b2f-4202-a17a-b5c8fdfc09e9-plugins-config-volume\") pod \"payload-pre-processing-e2e-shared-b-e945a1-6c4d84789b-tbk85\" (UID: \"c8762a24-6b2f-4202-a17a-b5c8fdfc09e9\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-b-e945a1-6c4d84789b-tbk85"
Jul 30 13:47:38.067604 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:47:38.067580    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vpwk8\" (UniqueName: \"kubernetes.io/projected/c8762a24-6b2f-4202-a17a-b5c8fdfc09e9-kube-api-access-vpwk8\") pod \"payload-pre-processing-e2e-shared-b-e945a1-6c4d84789b-tbk85\" (UID: \"c8762a24-6b2f-4202-a17a-b5c8fdfc09e9\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-b-e945a1-6c4d84789b-tbk85"
Jul 30 13:47:38.067738 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:47:38.067630    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fvknm\" (UniqueName: \"kubernetes.io/projected/dbc3def8-0b66-446b-bac2-241bdc436dd4-kube-api-access-fvknm\") pod \"payload-processing-e2e-shared-b-e945a1-5c9b5b596b-bzzsl\" (UID: \"dbc3def8-0b66-446b-bac2-241bdc436dd4\") " pod="openshift-ingress/payload-processing-e2e-shared-b-e945a1-5c9b5b596b-bzzsl"
Jul 30 13:47:38.173845 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:47:38.173757    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-e945a1-7dd46465c9-ck9fr"
Jul 30 13:47:38.205037 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:47:38.205004    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-e945a1-6c4d84789b-tbk85"
Jul 30 13:47:38.233626 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:47:38.233593    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-b-e945a1-5c9b5b596b-bzzsl"
Jul 30 13:47:38.558683 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:47:38.553000    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-e945a1-7dd46465c9-ck9fr"]
Jul 30 13:47:38.587680 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:47:38.587498    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-b-e945a1-6c4d84789b-tbk85"]
Jul 30 13:47:38.589911 ip-10-0-143-153 kubenswrapper[2566]: W0730 13:47:38.589874    2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc8762a24_6b2f_4202_a17a_b5c8fdfc09e9.slice/crio-17f3015f019c62cd394c2e198546df1adf690ee3167a95ab7e0edaf6f0410202 WatchSource:0}: Error finding container 17f3015f019c62cd394c2e198546df1adf690ee3167a95ab7e0edaf6f0410202: Status 404 returned error can't find the container with id 17f3015f019c62cd394c2e198546df1adf690ee3167a95ab7e0edaf6f0410202
Jul 30 13:47:38.623478 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:47:38.623454    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-b-e945a1-5c9b5b596b-bzzsl"]
Jul 30 13:47:38.633373 ip-10-0-143-153 kubenswrapper[2566]: W0730 13:47:38.633337    2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddbc3def8_0b66_446b_bac2_241bdc436dd4.slice/crio-d0958a5672eb7db1baee4586fbb06ce6916344f7c0b9d232d250ea291901f4b1 WatchSource:0}: Error finding container d0958a5672eb7db1baee4586fbb06ce6916344f7c0b9d232d250ea291901f4b1: Status 404 returned error can't find the container with id d0958a5672eb7db1baee4586fbb06ce6916344f7c0b9d232d250ea291901f4b1
Jul 30 13:47:39.029298 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:47:39.029257    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-e945a1-7dd46465c9-ck9fr" event={"ID":"b767dcfe-a268-4dd8-94cb-9ae86d281bfd","Type":"ContainerStarted","Data":"0c49ed4f642bbdff29549e622d11bf6aabbe5cd2a06c184a7f4e69ed347c0a13"}
Jul 30 13:47:39.030710 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:47:39.030680    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-b-e945a1-5c9b5b596b-bzzsl" event={"ID":"dbc3def8-0b66-446b-bac2-241bdc436dd4","Type":"ContainerStarted","Data":"92b461f180bb9f185afc3671b6cc2c1cbc21ab850a44b3ba5be6760f21da3df1"}
Jul 30 13:47:39.030846 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:47:39.030732    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-b-e945a1-5c9b5b596b-bzzsl" event={"ID":"dbc3def8-0b66-446b-bac2-241bdc436dd4","Type":"ContainerStarted","Data":"d0958a5672eb7db1baee4586fbb06ce6916344f7c0b9d232d250ea291901f4b1"}
Jul 30 13:47:39.030846 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:47:39.030796    2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-shared-b-e945a1-5c9b5b596b-bzzsl"
Jul 30 13:47:39.032190 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:47:39.032170    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-e945a1-6c4d84789b-tbk85" event={"ID":"c8762a24-6b2f-4202-a17a-b5c8fdfc09e9","Type":"ContainerStarted","Data":"ac9fd261380598372e6c8cc27193609b07c80c1dfdcc7d56630f5cb4a16360d3"}
Jul 30 13:47:39.032275 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:47:39.032204    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-e945a1-6c4d84789b-tbk85" event={"ID":"c8762a24-6b2f-4202-a17a-b5c8fdfc09e9","Type":"ContainerStarted","Data":"17f3015f019c62cd394c2e198546df1adf690ee3167a95ab7e0edaf6f0410202"}
Jul 30 13:47:39.032275 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:47:39.032254    2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-e945a1-6c4d84789b-tbk85"
Jul 30 13:47:39.045623 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:47:39.045584    2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-shared-b-e945a1-5c9b5b596b-bzzsl" podStartSLOduration=2.045570278 podStartE2EDuration="2.045570278s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-30 13:47:37 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 13:47:39.044335894 +0000 UTC m=+2887.973024158" watchObservedRunningTime="2026-07-30 13:47:39.045570278 +0000 UTC m=+2887.974258541"
Jul 30 13:47:39.058803 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:47:39.058761    2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-e945a1-6c4d84789b-tbk85" podStartSLOduration=2.0587450880000002 podStartE2EDuration="2.058745088s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-30 13:47:37 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 13:47:39.058040142 +0000 UTC m=+2887.986728406" watchObservedRunningTime="2026-07-30 13:47:39.058745088 +0000 UTC m=+2887.987433353"
Jul 30 13:47:40.042503 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:47:40.042438    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-e945a1-7dd46465c9-ck9fr" event={"ID":"b767dcfe-a268-4dd8-94cb-9ae86d281bfd","Type":"ContainerStarted","Data":"bf59014cd59a73e36756f773c1149206ef92841a2cd5acbeabbfa8016afb2d67"}
Jul 30 13:47:40.042980 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:47:40.042781    2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-e945a1-7dd46465c9-ck9fr"
Jul 30 13:47:40.058532 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:47:40.058481    2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-e945a1-7dd46465c9-ck9fr" podStartSLOduration=2.242136332 podStartE2EDuration="3.058459419s" totalImagesPullingTime="816.323087ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-30 13:47:37 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 13:47:40.058378708 +0000 UTC m=+2888.987066968" watchObservedRunningTime="2026-07-30 13:47:40.058459419 +0000 UTC m=+2888.987147684"
Jul 30 13:47:46.054599 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:47:46.054568    2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-e945a1-7dd46465c9-ck9fr"
Jul 30 13:47:50.044541 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:47:50.044509    2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-shared-b-e945a1-5c9b5b596b-bzzsl"
Jul 30 13:47:50.044931 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:47:50.044678    2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-e945a1-6c4d84789b-tbk85"
Jul 30 13:49:31.803849 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:49:31.803817    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-bzl6w_51cdacbf-3a14-47c0-8fd4-69b0b2be0e64/console-operator/1.log"
Jul 30 13:49:31.808902 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:49:31.808875    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-f6br6_3ebbc209-4373-44d8-a22e-d2d2aa4cbfa6/ovn-acl-logging/0.log"
Jul 30 13:49:31.809764 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:49:31.809745    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-bzl6w_51cdacbf-3a14-47c0-8fd4-69b0b2be0e64/console-operator/1.log"
Jul 30 13:49:31.814734 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:49:31.814716    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-f6br6_3ebbc209-4373-44d8-a22e-d2d2aa4cbfa6/ovn-acl-logging/0.log"
Jul 30 13:54:31.834541 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:54:31.834505    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-bzl6w_51cdacbf-3a14-47c0-8fd4-69b0b2be0e64/console-operator/1.log"
Jul 30 13:54:31.839521 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:54:31.839495    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-f6br6_3ebbc209-4373-44d8-a22e-d2d2aa4cbfa6/ovn-acl-logging/0.log"
Jul 30 13:54:31.840624 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:54:31.840601    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-bzl6w_51cdacbf-3a14-47c0-8fd4-69b0b2be0e64/console-operator/1.log"
Jul 30 13:54:31.845172 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:54:31.845156    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-f6br6_3ebbc209-4373-44d8-a22e-d2d2aa4cbfa6/ovn-acl-logging/0.log"
Jul 30 13:58:52.078979 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:58:52.078947    2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-a-cd11f9-5488cbd6d-t7pww"]
Jul 30 13:58:52.082653 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:58:52.082634    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-cd11f9-5488cbd6d-t7pww"
Jul 30 13:58:52.084634 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:58:52.084606    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-ipp-a-cd11f9-dockercfg-kzftz\""
Jul 30 13:58:52.084776 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:58:52.084668    2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-ipp-a-cd11f9\""
Jul 30 13:58:52.091546 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:58:52.091523    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-a-cd11f9-5488cbd6d-t7pww"]
Jul 30 13:58:52.113960 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:58:52.113923    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/2abd4aca-be43-475e-83b4-0901962e1c51-plugins-config-volume\") pod \"payload-pre-processing-e2e-ipp-a-cd11f9-5488cbd6d-t7pww\" (UID: \"2abd4aca-be43-475e-83b4-0901962e1c51\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-cd11f9-5488cbd6d-t7pww"
Jul 30 13:58:52.114121 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:58:52.114067    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sq689\" (UniqueName: \"kubernetes.io/projected/2abd4aca-be43-475e-83b4-0901962e1c51-kube-api-access-sq689\") pod \"payload-pre-processing-e2e-ipp-a-cd11f9-5488cbd6d-t7pww\" (UID: \"2abd4aca-be43-475e-83b4-0901962e1c51\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-cd11f9-5488cbd6d-t7pww"
Jul 30 13:58:52.122846 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:58:52.122822    2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-a-cd11f9-6dddf984cd-7rtgl"]
Jul 30 13:58:52.126264 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:58:52.126246    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-a-cd11f9-6dddf984cd-7rtgl"
Jul 30 13:58:52.134629 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:58:52.134605    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-a-cd11f9-6dddf984cd-7rtgl"]
Jul 30 13:58:52.214796 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:58:52.214761    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/d07273f6-e306-4c3d-b36f-0606b9634a53-plugins-config-volume\") pod \"payload-processing-e2e-ipp-a-cd11f9-6dddf984cd-7rtgl\" (UID: \"d07273f6-e306-4c3d-b36f-0606b9634a53\") " pod="openshift-ingress/payload-processing-e2e-ipp-a-cd11f9-6dddf984cd-7rtgl"
Jul 30 13:58:52.215001 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:58:52.214826    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sq689\" (UniqueName: \"kubernetes.io/projected/2abd4aca-be43-475e-83b4-0901962e1c51-kube-api-access-sq689\") pod \"payload-pre-processing-e2e-ipp-a-cd11f9-5488cbd6d-t7pww\" (UID: \"2abd4aca-be43-475e-83b4-0901962e1c51\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-cd11f9-5488cbd6d-t7pww"
Jul 30 13:58:52.215001 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:58:52.214882    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-d9b8m\" (UniqueName: \"kubernetes.io/projected/d07273f6-e306-4c3d-b36f-0606b9634a53-kube-api-access-d9b8m\") pod \"payload-processing-e2e-ipp-a-cd11f9-6dddf984cd-7rtgl\" (UID: \"d07273f6-e306-4c3d-b36f-0606b9634a53\") " pod="openshift-ingress/payload-processing-e2e-ipp-a-cd11f9-6dddf984cd-7rtgl"
Jul 30 13:58:52.215001 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:58:52.214959    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/2abd4aca-be43-475e-83b4-0901962e1c51-plugins-config-volume\") pod \"payload-pre-processing-e2e-ipp-a-cd11f9-5488cbd6d-t7pww\" (UID: \"2abd4aca-be43-475e-83b4-0901962e1c51\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-cd11f9-5488cbd6d-t7pww"
Jul 30 13:58:52.215700 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:58:52.215682    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/2abd4aca-be43-475e-83b4-0901962e1c51-plugins-config-volume\") pod \"payload-pre-processing-e2e-ipp-a-cd11f9-5488cbd6d-t7pww\" (UID: \"2abd4aca-be43-475e-83b4-0901962e1c51\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-cd11f9-5488cbd6d-t7pww"
Jul 30 13:58:52.222539 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:58:52.222518    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-sq689\" (UniqueName: \"kubernetes.io/projected/2abd4aca-be43-475e-83b4-0901962e1c51-kube-api-access-sq689\") pod \"payload-pre-processing-e2e-ipp-a-cd11f9-5488cbd6d-t7pww\" (UID: \"2abd4aca-be43-475e-83b4-0901962e1c51\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-cd11f9-5488cbd6d-t7pww"
Jul 30 13:58:52.315634 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:58:52.315596    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/d07273f6-e306-4c3d-b36f-0606b9634a53-plugins-config-volume\") pod \"payload-processing-e2e-ipp-a-cd11f9-6dddf984cd-7rtgl\" (UID: \"d07273f6-e306-4c3d-b36f-0606b9634a53\") " pod="openshift-ingress/payload-processing-e2e-ipp-a-cd11f9-6dddf984cd-7rtgl"
Jul 30 13:58:52.315837 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:58:52.315657    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-d9b8m\" (UniqueName: \"kubernetes.io/projected/d07273f6-e306-4c3d-b36f-0606b9634a53-kube-api-access-d9b8m\") pod \"payload-processing-e2e-ipp-a-cd11f9-6dddf984cd-7rtgl\" (UID: \"d07273f6-e306-4c3d-b36f-0606b9634a53\") " pod="openshift-ingress/payload-processing-e2e-ipp-a-cd11f9-6dddf984cd-7rtgl"
Jul 30 13:58:52.316419 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:58:52.316390    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/d07273f6-e306-4c3d-b36f-0606b9634a53-plugins-config-volume\") pod \"payload-processing-e2e-ipp-a-cd11f9-6dddf984cd-7rtgl\" (UID: \"d07273f6-e306-4c3d-b36f-0606b9634a53\") " pod="openshift-ingress/payload-processing-e2e-ipp-a-cd11f9-6dddf984cd-7rtgl"
Jul 30 13:58:52.322730 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:58:52.322704    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-d9b8m\" (UniqueName: \"kubernetes.io/projected/d07273f6-e306-4c3d-b36f-0606b9634a53-kube-api-access-d9b8m\") pod \"payload-processing-e2e-ipp-a-cd11f9-6dddf984cd-7rtgl\" (UID: \"d07273f6-e306-4c3d-b36f-0606b9634a53\") " pod="openshift-ingress/payload-processing-e2e-ipp-a-cd11f9-6dddf984cd-7rtgl"
Jul 30 13:58:52.393825 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:58:52.393792    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-cd11f9-5488cbd6d-t7pww"
Jul 30 13:58:52.438480 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:58:52.438444    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-a-cd11f9-6dddf984cd-7rtgl"
Jul 30 13:58:52.549575 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:58:52.549547    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-a-cd11f9-5488cbd6d-t7pww"]
Jul 30 13:58:52.551839 ip-10-0-143-153 kubenswrapper[2566]: W0730 13:58:52.551793    2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2abd4aca_be43_475e_83b4_0901962e1c51.slice/crio-99307be3c7387be041db0fa68bae9aa5f228a08b8d926e6314f7da5bf5ad407c WatchSource:0}: Error finding container 99307be3c7387be041db0fa68bae9aa5f228a08b8d926e6314f7da5bf5ad407c: Status 404 returned error can't find the container with id 99307be3c7387be041db0fa68bae9aa5f228a08b8d926e6314f7da5bf5ad407c
Jul 30 13:58:52.804447 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:58:52.804398    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-a-cd11f9-6dddf984cd-7rtgl"]
Jul 30 13:58:52.806710 ip-10-0-143-153 kubenswrapper[2566]: W0730 13:58:52.806685    2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd07273f6_e306_4c3d_b36f_0606b9634a53.slice/crio-8fb11137c710f486fbf28c98d44ac50b6d9e5c20662ca76862764df084ae6a0f WatchSource:0}: Error finding container 8fb11137c710f486fbf28c98d44ac50b6d9e5c20662ca76862764df084ae6a0f: Status 404 returned error can't find the container with id 8fb11137c710f486fbf28c98d44ac50b6d9e5c20662ca76862764df084ae6a0f
Jul 30 13:58:53.560531 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:58:53.560494    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-a-cd11f9-6dddf984cd-7rtgl" event={"ID":"d07273f6-e306-4c3d-b36f-0606b9634a53","Type":"ContainerStarted","Data":"5ceebd0ee27a3b7826ff31ca1804a3f166df036f8a0e79a56fb43ff1d8d7144a"}
Jul 30 13:58:53.560956 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:58:53.560590    2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-ipp-a-cd11f9-6dddf984cd-7rtgl"
Jul 30 13:58:53.560956 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:58:53.560617    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-a-cd11f9-6dddf984cd-7rtgl" event={"ID":"d07273f6-e306-4c3d-b36f-0606b9634a53","Type":"ContainerStarted","Data":"8fb11137c710f486fbf28c98d44ac50b6d9e5c20662ca76862764df084ae6a0f"}
Jul 30 13:58:53.562035 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:58:53.562010    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-cd11f9-5488cbd6d-t7pww" event={"ID":"2abd4aca-be43-475e-83b4-0901962e1c51","Type":"ContainerStarted","Data":"205076b55eab3c0bc572f588bd5c0f4d39cb94bc427e418c5250f99367bdd90a"}
Jul 30 13:58:53.562141 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:58:53.562056    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-cd11f9-5488cbd6d-t7pww" event={"ID":"2abd4aca-be43-475e-83b4-0901962e1c51","Type":"ContainerStarted","Data":"99307be3c7387be041db0fa68bae9aa5f228a08b8d926e6314f7da5bf5ad407c"}
Jul 30 13:58:53.562141 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:58:53.562119    2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-cd11f9-5488cbd6d-t7pww"
Jul 30 13:58:53.578064 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:58:53.578006    2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-ipp-a-cd11f9-6dddf984cd-7rtgl" podStartSLOduration=1.5779867300000001 podStartE2EDuration="1.57798673s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-30 13:58:52 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 13:58:53.575998168 +0000 UTC m=+3562.504686413" watchObservedRunningTime="2026-07-30 13:58:53.57798673 +0000 UTC m=+3562.506674994"
Jul 30 13:58:53.591958 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:58:53.591907    2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-cd11f9-5488cbd6d-t7pww" podStartSLOduration=1.591888285 podStartE2EDuration="1.591888285s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-30 13:58:52 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 13:58:53.589742998 +0000 UTC m=+3562.518431260" watchObservedRunningTime="2026-07-30 13:58:53.591888285 +0000 UTC m=+3562.520576549"
Jul 30 13:59:04.570057 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:59:04.570025    2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-cd11f9-5488cbd6d-t7pww"
Jul 30 13:59:04.570534 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:59:04.570207    2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-ipp-a-cd11f9-6dddf984cd-7rtgl"
Jul 30 13:59:21.232680 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:59:21.232644    2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-b-2a5bef-64bdf857bd-9sqd2"]
Jul 30 13:59:21.236313 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:59:21.236296    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-2a5bef-64bdf857bd-9sqd2"
Jul 30 13:59:21.240602 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:59:21.240576    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-ipp-b-2a5bef-dockercfg-scvpl\""
Jul 30 13:59:21.240723 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:59:21.240613    2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-ipp-b-2a5bef\""
Jul 30 13:59:21.245501 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:59:21.245480    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-b-2a5bef-64bdf857bd-9sqd2"]
Jul 30 13:59:21.265802 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:59:21.265772    2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-b-2a5bef-7d6c89ff8-97bjm"]
Jul 30 13:59:21.269519 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:59:21.269501    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-b-2a5bef-7d6c89ff8-97bjm"
Jul 30 13:59:21.282753 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:59:21.282032    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-b-2a5bef-7d6c89ff8-97bjm"]
Jul 30 13:59:21.389561 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:59:21.389527    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/abcfa942-4318-457b-a9a5-7593cdb437f1-plugins-config-volume\") pod \"payload-pre-processing-e2e-ipp-b-2a5bef-64bdf857bd-9sqd2\" (UID: \"abcfa942-4318-457b-a9a5-7593cdb437f1\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-2a5bef-64bdf857bd-9sqd2"
Jul 30 13:59:21.389722 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:59:21.389589    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hfqs8\" (UniqueName: \"kubernetes.io/projected/abcfa942-4318-457b-a9a5-7593cdb437f1-kube-api-access-hfqs8\") pod \"payload-pre-processing-e2e-ipp-b-2a5bef-64bdf857bd-9sqd2\" (UID: \"abcfa942-4318-457b-a9a5-7593cdb437f1\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-2a5bef-64bdf857bd-9sqd2"
Jul 30 13:59:21.389722 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:59:21.389666    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-79dvn\" (UniqueName: \"kubernetes.io/projected/0d250aef-7d08-4ea4-9bc6-7aa90acd9a88-kube-api-access-79dvn\") pod \"payload-processing-e2e-ipp-b-2a5bef-7d6c89ff8-97bjm\" (UID: \"0d250aef-7d08-4ea4-9bc6-7aa90acd9a88\") " pod="openshift-ingress/payload-processing-e2e-ipp-b-2a5bef-7d6c89ff8-97bjm"
Jul 30 13:59:21.389722 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:59:21.389707    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/0d250aef-7d08-4ea4-9bc6-7aa90acd9a88-plugins-config-volume\") pod \"payload-processing-e2e-ipp-b-2a5bef-7d6c89ff8-97bjm\" (UID: \"0d250aef-7d08-4ea4-9bc6-7aa90acd9a88\") " pod="openshift-ingress/payload-processing-e2e-ipp-b-2a5bef-7d6c89ff8-97bjm"
Jul 30 13:59:21.491192 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:59:21.491107    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/abcfa942-4318-457b-a9a5-7593cdb437f1-plugins-config-volume\") pod \"payload-pre-processing-e2e-ipp-b-2a5bef-64bdf857bd-9sqd2\" (UID: \"abcfa942-4318-457b-a9a5-7593cdb437f1\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-2a5bef-64bdf857bd-9sqd2"
Jul 30 13:59:21.491192 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:59:21.491184    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hfqs8\" (UniqueName: \"kubernetes.io/projected/abcfa942-4318-457b-a9a5-7593cdb437f1-kube-api-access-hfqs8\") pod \"payload-pre-processing-e2e-ipp-b-2a5bef-64bdf857bd-9sqd2\" (UID: \"abcfa942-4318-457b-a9a5-7593cdb437f1\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-2a5bef-64bdf857bd-9sqd2"
Jul 30 13:59:21.491390 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:59:21.491218    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-79dvn\" (UniqueName: \"kubernetes.io/projected/0d250aef-7d08-4ea4-9bc6-7aa90acd9a88-kube-api-access-79dvn\") pod \"payload-processing-e2e-ipp-b-2a5bef-7d6c89ff8-97bjm\" (UID: \"0d250aef-7d08-4ea4-9bc6-7aa90acd9a88\") " pod="openshift-ingress/payload-processing-e2e-ipp-b-2a5bef-7d6c89ff8-97bjm"
Jul 30 13:59:21.491390 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:59:21.491245    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/0d250aef-7d08-4ea4-9bc6-7aa90acd9a88-plugins-config-volume\") pod \"payload-processing-e2e-ipp-b-2a5bef-7d6c89ff8-97bjm\" (UID: \"0d250aef-7d08-4ea4-9bc6-7aa90acd9a88\") " pod="openshift-ingress/payload-processing-e2e-ipp-b-2a5bef-7d6c89ff8-97bjm"
Jul 30 13:59:21.491909 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:59:21.491890    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/0d250aef-7d08-4ea4-9bc6-7aa90acd9a88-plugins-config-volume\") pod \"payload-processing-e2e-ipp-b-2a5bef-7d6c89ff8-97bjm\" (UID: \"0d250aef-7d08-4ea4-9bc6-7aa90acd9a88\") " pod="openshift-ingress/payload-processing-e2e-ipp-b-2a5bef-7d6c89ff8-97bjm"
Jul 30 13:59:21.491954 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:59:21.491909    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/abcfa942-4318-457b-a9a5-7593cdb437f1-plugins-config-volume\") pod \"payload-pre-processing-e2e-ipp-b-2a5bef-64bdf857bd-9sqd2\" (UID: \"abcfa942-4318-457b-a9a5-7593cdb437f1\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-2a5bef-64bdf857bd-9sqd2"
Jul 30 13:59:21.498629 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:59:21.498605    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hfqs8\" (UniqueName: \"kubernetes.io/projected/abcfa942-4318-457b-a9a5-7593cdb437f1-kube-api-access-hfqs8\") pod \"payload-pre-processing-e2e-ipp-b-2a5bef-64bdf857bd-9sqd2\" (UID: \"abcfa942-4318-457b-a9a5-7593cdb437f1\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-2a5bef-64bdf857bd-9sqd2"
Jul 30 13:59:21.498747 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:59:21.498636    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-79dvn\" (UniqueName: \"kubernetes.io/projected/0d250aef-7d08-4ea4-9bc6-7aa90acd9a88-kube-api-access-79dvn\") pod \"payload-processing-e2e-ipp-b-2a5bef-7d6c89ff8-97bjm\" (UID: \"0d250aef-7d08-4ea4-9bc6-7aa90acd9a88\") " pod="openshift-ingress/payload-processing-e2e-ipp-b-2a5bef-7d6c89ff8-97bjm"
Jul 30 13:59:21.549407 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:59:21.549380    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-2a5bef-64bdf857bd-9sqd2"
Jul 30 13:59:21.584650 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:59:21.584615    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-b-2a5bef-7d6c89ff8-97bjm"
Jul 30 13:59:21.923386 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:59:21.923350    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-b-2a5bef-64bdf857bd-9sqd2"]
Jul 30 13:59:21.927114 ip-10-0-143-153 kubenswrapper[2566]: W0730 13:59:21.927087    2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podabcfa942_4318_457b_a9a5_7593cdb437f1.slice/crio-4c42fabb86429743e71cf2691c26bc94ef4d980fd58199eaa8c46cfcdbbff9b5 WatchSource:0}: Error finding container 4c42fabb86429743e71cf2691c26bc94ef4d980fd58199eaa8c46cfcdbbff9b5: Status 404 returned error can't find the container with id 4c42fabb86429743e71cf2691c26bc94ef4d980fd58199eaa8c46cfcdbbff9b5
Jul 30 13:59:21.952298 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:59:21.952276    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-b-2a5bef-7d6c89ff8-97bjm"]
Jul 30 13:59:21.968350 ip-10-0-143-153 kubenswrapper[2566]: W0730 13:59:21.968323    2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0d250aef_7d08_4ea4_9bc6_7aa90acd9a88.slice/crio-019e726453dc40b0db6a923cb4b169141d3ff44ef92411aecfdf9186e755c5cd WatchSource:0}: Error finding container 019e726453dc40b0db6a923cb4b169141d3ff44ef92411aecfdf9186e755c5cd: Status 404 returned error can't find the container with id 019e726453dc40b0db6a923cb4b169141d3ff44ef92411aecfdf9186e755c5cd
Jul 30 13:59:22.721143 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:59:22.721108    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-b-2a5bef-7d6c89ff8-97bjm" event={"ID":"0d250aef-7d08-4ea4-9bc6-7aa90acd9a88","Type":"ContainerStarted","Data":"14c072a026cc6c6667ee6a3d015e5da15d54bdbe6b6854ebc241a741efa2086a"}
Jul 30 13:59:22.721599 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:59:22.721172    2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-ipp-b-2a5bef-7d6c89ff8-97bjm"
Jul 30 13:59:22.721599 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:59:22.721194    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-b-2a5bef-7d6c89ff8-97bjm" event={"ID":"0d250aef-7d08-4ea4-9bc6-7aa90acd9a88","Type":"ContainerStarted","Data":"019e726453dc40b0db6a923cb4b169141d3ff44ef92411aecfdf9186e755c5cd"}
Jul 30 13:59:22.722705 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:59:22.722673    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-2a5bef-64bdf857bd-9sqd2" event={"ID":"abcfa942-4318-457b-a9a5-7593cdb437f1","Type":"ContainerStarted","Data":"1c1e241ec26e45cd2d2fd75e8962417905b6da60c47a138ee262306d1ff797a7"}
Jul 30 13:59:22.722825 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:59:22.722724    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-2a5bef-64bdf857bd-9sqd2" event={"ID":"abcfa942-4318-457b-a9a5-7593cdb437f1","Type":"ContainerStarted","Data":"4c42fabb86429743e71cf2691c26bc94ef4d980fd58199eaa8c46cfcdbbff9b5"}
Jul 30 13:59:22.722825 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:59:22.722751    2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-2a5bef-64bdf857bd-9sqd2"
Jul 30 13:59:22.736991 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:59:22.736935    2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-ipp-b-2a5bef-7d6c89ff8-97bjm" podStartSLOduration=1.736917605 podStartE2EDuration="1.736917605s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-30 13:59:21 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 13:59:22.736649496 +0000 UTC m=+3591.665337760" watchObservedRunningTime="2026-07-30 13:59:22.736917605 +0000 UTC m=+3591.665605849"
Jul 30 13:59:22.755133 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:59:22.755067    2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-2a5bef-64bdf857bd-9sqd2" podStartSLOduration=1.755047512 podStartE2EDuration="1.755047512s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-30 13:59:21 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 13:59:22.75258828 +0000 UTC m=+3591.681276546" watchObservedRunningTime="2026-07-30 13:59:22.755047512 +0000 UTC m=+3591.683735777"
Jul 30 13:59:31.865295 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:59:31.865263    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-bzl6w_51cdacbf-3a14-47c0-8fd4-69b0b2be0e64/console-operator/1.log"
Jul 30 13:59:31.870017 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:59:31.869995    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-f6br6_3ebbc209-4373-44d8-a22e-d2d2aa4cbfa6/ovn-acl-logging/0.log"
Jul 30 13:59:31.872568 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:59:31.872548    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-bzl6w_51cdacbf-3a14-47c0-8fd4-69b0b2be0e64/console-operator/1.log"
Jul 30 13:59:31.885664 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:59:31.885638    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-f6br6_3ebbc209-4373-44d8-a22e-d2d2aa4cbfa6/ovn-acl-logging/0.log"
Jul 30 13:59:33.730374 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:59:33.730347    2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-ipp-b-2a5bef-7d6c89ff8-97bjm"
Jul 30 13:59:33.730771 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:59:33.730424    2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-2a5bef-64bdf857bd-9sqd2"
Jul 30 13:59:41.322583 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:59:41.322555    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-5cc6cd444b-5tgls_9d35b27b-86d0-47b9-b35b-03725cef3b51/payload-processing/0.log"
Jul 30 13:59:41.439353 ip-10-0-143-153 kubenswrapper[2566]: I0730 13:59:41.439325    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-e2e-ipp-b-2a5bef-7d6c89ff8-97bjm_0d250aef-7d08-4ea4-9bc6-7aa90acd9a88/payload-processing/0.log"
Jul 30 14:00:38.558278 ip-10-0-143-153 kubenswrapper[2566]: I0730 14:00:38.558243    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-e2e-ipp-a-cd11f9-6dddf984cd-7rtgl_d07273f6-e306-4c3d-b36f-0606b9634a53/payload-processing/0.log"
Jul 30 14:00:38.689687 ip-10-0-143-153 kubenswrapper[2566]: I0730 14:00:38.689652    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-5cc6cd444b-5tgls_9d35b27b-86d0-47b9-b35b-03725cef3b51/payload-processing/0.log"
Jul 30 14:00:38.807102 ip-10-0-143-153 kubenswrapper[2566]: I0730 14:00:38.807052    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-e2e-ipp-b-2a5bef-7d6c89ff8-97bjm_0d250aef-7d08-4ea4-9bc6-7aa90acd9a88/payload-processing/0.log"
Jul 30 14:00:44.071067 ip-10-0-143-153 kubenswrapper[2566]: I0730 14:00:44.071027    2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-0e458a-68f94844d4-bk6kb"]
Jul 30 14:00:44.074717 ip-10-0-143-153 kubenswrapper[2566]: I0730 14:00:44.074700    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-0e458a-68f94844d4-bk6kb"
Jul 30 14:00:44.077269 ip-10-0-143-153 kubenswrapper[2566]: I0730 14:00:44.077245    2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-ipp-cleanup-0e458a\""
Jul 30 14:00:44.084748 ip-10-0-143-153 kubenswrapper[2566]: I0730 14:00:44.084714    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-0e458a-68f94844d4-bk6kb"]
Jul 30 14:00:44.112004 ip-10-0-143-153 kubenswrapper[2566]: I0730 14:00:44.111965    2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-cleanup-0e458a-689cbdcd46-nhkjx"]
Jul 30 14:00:44.116420 ip-10-0-143-153 kubenswrapper[2566]: I0730 14:00:44.116398    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-0e458a-689cbdcd46-nhkjx"
Jul 30 14:00:44.119132 ip-10-0-143-153 kubenswrapper[2566]: I0730 14:00:44.119062    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-ipp-cleanup-0e458a-dockercfg-smczs\""
Jul 30 14:00:44.131124 ip-10-0-143-153 kubenswrapper[2566]: I0730 14:00:44.131102    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-cleanup-0e458a-689cbdcd46-nhkjx"]
Jul 30 14:00:44.184674 ip-10-0-143-153 kubenswrapper[2566]: I0730 14:00:44.184637    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/5951831b-2a96-46fc-bedd-65ceaf7f8a66-plugins-config-volume\") pod \"payload-pre-processing-e2e-ipp-cleanup-0e458a-68f94844d4-bk6kb\" (UID: \"5951831b-2a96-46fc-bedd-65ceaf7f8a66\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-0e458a-68f94844d4-bk6kb"
Jul 30 14:00:44.184855 ip-10-0-143-153 kubenswrapper[2566]: I0730 14:00:44.184779    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-n8f6f\" (UniqueName: \"kubernetes.io/projected/5951831b-2a96-46fc-bedd-65ceaf7f8a66-kube-api-access-n8f6f\") pod \"payload-pre-processing-e2e-ipp-cleanup-0e458a-68f94844d4-bk6kb\" (UID: \"5951831b-2a96-46fc-bedd-65ceaf7f8a66\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-0e458a-68f94844d4-bk6kb"
Jul 30 14:00:44.286143 ip-10-0-143-153 kubenswrapper[2566]: I0730 14:00:44.286064    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sqw5h\" (UniqueName: \"kubernetes.io/projected/fa61b3e5-e315-4b83-8252-f76b5987c5c3-kube-api-access-sqw5h\") pod \"payload-processing-e2e-ipp-cleanup-0e458a-689cbdcd46-nhkjx\" (UID: \"fa61b3e5-e315-4b83-8252-f76b5987c5c3\") " pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-0e458a-689cbdcd46-nhkjx"
Jul 30 14:00:44.286319 ip-10-0-143-153 kubenswrapper[2566]: I0730 14:00:44.286198    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-n8f6f\" (UniqueName: \"kubernetes.io/projected/5951831b-2a96-46fc-bedd-65ceaf7f8a66-kube-api-access-n8f6f\") pod \"payload-pre-processing-e2e-ipp-cleanup-0e458a-68f94844d4-bk6kb\" (UID: \"5951831b-2a96-46fc-bedd-65ceaf7f8a66\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-0e458a-68f94844d4-bk6kb"
Jul 30 14:00:44.286319 ip-10-0-143-153 kubenswrapper[2566]: I0730 14:00:44.286285    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/fa61b3e5-e315-4b83-8252-f76b5987c5c3-plugins-config-volume\") pod \"payload-processing-e2e-ipp-cleanup-0e458a-689cbdcd46-nhkjx\" (UID: \"fa61b3e5-e315-4b83-8252-f76b5987c5c3\") " pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-0e458a-689cbdcd46-nhkjx"
Jul 30 14:00:44.286403 ip-10-0-143-153 kubenswrapper[2566]: I0730 14:00:44.286328    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/5951831b-2a96-46fc-bedd-65ceaf7f8a66-plugins-config-volume\") pod \"payload-pre-processing-e2e-ipp-cleanup-0e458a-68f94844d4-bk6kb\" (UID: \"5951831b-2a96-46fc-bedd-65ceaf7f8a66\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-0e458a-68f94844d4-bk6kb"
Jul 30 14:00:44.287038 ip-10-0-143-153 kubenswrapper[2566]: I0730 14:00:44.287018    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/5951831b-2a96-46fc-bedd-65ceaf7f8a66-plugins-config-volume\") pod \"payload-pre-processing-e2e-ipp-cleanup-0e458a-68f94844d4-bk6kb\" (UID: \"5951831b-2a96-46fc-bedd-65ceaf7f8a66\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-0e458a-68f94844d4-bk6kb"
Jul 30 14:00:44.294791 ip-10-0-143-153 kubenswrapper[2566]: I0730 14:00:44.294764    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-n8f6f\" (UniqueName: \"kubernetes.io/projected/5951831b-2a96-46fc-bedd-65ceaf7f8a66-kube-api-access-n8f6f\") pod \"payload-pre-processing-e2e-ipp-cleanup-0e458a-68f94844d4-bk6kb\" (UID: \"5951831b-2a96-46fc-bedd-65ceaf7f8a66\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-0e458a-68f94844d4-bk6kb"
Jul 30 14:00:44.386777 ip-10-0-143-153 kubenswrapper[2566]: I0730 14:00:44.386743    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/fa61b3e5-e315-4b83-8252-f76b5987c5c3-plugins-config-volume\") pod \"payload-processing-e2e-ipp-cleanup-0e458a-689cbdcd46-nhkjx\" (UID: \"fa61b3e5-e315-4b83-8252-f76b5987c5c3\") " pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-0e458a-689cbdcd46-nhkjx"
Jul 30 14:00:44.386965 ip-10-0-143-153 kubenswrapper[2566]: I0730 14:00:44.386807    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sqw5h\" (UniqueName: \"kubernetes.io/projected/fa61b3e5-e315-4b83-8252-f76b5987c5c3-kube-api-access-sqw5h\") pod \"payload-processing-e2e-ipp-cleanup-0e458a-689cbdcd46-nhkjx\" (UID: \"fa61b3e5-e315-4b83-8252-f76b5987c5c3\") " pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-0e458a-689cbdcd46-nhkjx"
Jul 30 14:00:44.387486 ip-10-0-143-153 kubenswrapper[2566]: I0730 14:00:44.387461    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/fa61b3e5-e315-4b83-8252-f76b5987c5c3-plugins-config-volume\") pod \"payload-processing-e2e-ipp-cleanup-0e458a-689cbdcd46-nhkjx\" (UID: \"fa61b3e5-e315-4b83-8252-f76b5987c5c3\") " pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-0e458a-689cbdcd46-nhkjx"
Jul 30 14:00:44.387594 ip-10-0-143-153 kubenswrapper[2566]: I0730 14:00:44.387573    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-0e458a-68f94844d4-bk6kb"
Jul 30 14:00:44.395095 ip-10-0-143-153 kubenswrapper[2566]: I0730 14:00:44.395052    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-sqw5h\" (UniqueName: \"kubernetes.io/projected/fa61b3e5-e315-4b83-8252-f76b5987c5c3-kube-api-access-sqw5h\") pod \"payload-processing-e2e-ipp-cleanup-0e458a-689cbdcd46-nhkjx\" (UID: \"fa61b3e5-e315-4b83-8252-f76b5987c5c3\") " pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-0e458a-689cbdcd46-nhkjx"
Jul 30 14:00:44.430007 ip-10-0-143-153 kubenswrapper[2566]: I0730 14:00:44.429973    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-0e458a-689cbdcd46-nhkjx"
Jul 30 14:00:44.764828 ip-10-0-143-153 kubenswrapper[2566]: I0730 14:00:44.764800    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-0e458a-68f94844d4-bk6kb"]
Jul 30 14:00:44.803674 ip-10-0-143-153 kubenswrapper[2566]: I0730 14:00:44.803550    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-cleanup-0e458a-689cbdcd46-nhkjx"]
Jul 30 14:00:44.806540 ip-10-0-143-153 kubenswrapper[2566]: W0730 14:00:44.806517    2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfa61b3e5_e315_4b83_8252_f76b5987c5c3.slice/crio-61f9172f7eaba44be584f32af9d1be70637e5ad294ad11bf49604940750fa5a9 WatchSource:0}: Error finding container 61f9172f7eaba44be584f32af9d1be70637e5ad294ad11bf49604940750fa5a9: Status 404 returned error can't find the container with id 61f9172f7eaba44be584f32af9d1be70637e5ad294ad11bf49604940750fa5a9
Jul 30 14:00:45.171312 ip-10-0-143-153 kubenswrapper[2566]: I0730 14:00:45.171270    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-0e458a-68f94844d4-bk6kb" event={"ID":"5951831b-2a96-46fc-bedd-65ceaf7f8a66","Type":"ContainerStarted","Data":"1007ce32bc7e77d7ee55b84cf10b67ac8b9cf017c3b457423d63206e60ae5517"}
Jul 30 14:00:45.171900 ip-10-0-143-153 kubenswrapper[2566]: I0730 14:00:45.171343    2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-0e458a-68f94844d4-bk6kb"
Jul 30 14:00:45.171900 ip-10-0-143-153 kubenswrapper[2566]: I0730 14:00:45.171368    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-0e458a-68f94844d4-bk6kb" event={"ID":"5951831b-2a96-46fc-bedd-65ceaf7f8a66","Type":"ContainerStarted","Data":"f6e96695150255e18627ee80e9f4520346783fbcecfe64d8e0a688db08343710"}
Jul 30 14:00:45.172800 ip-10-0-143-153 kubenswrapper[2566]: I0730 14:00:45.172777    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-0e458a-689cbdcd46-nhkjx" event={"ID":"fa61b3e5-e315-4b83-8252-f76b5987c5c3","Type":"ContainerStarted","Data":"c090cf50696ee80b9e46f12ed57d7b9a34388d935b72438ffb5ddb2a28276e44"}
Jul 30 14:00:45.172896 ip-10-0-143-153 kubenswrapper[2566]: I0730 14:00:45.172816    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-0e458a-689cbdcd46-nhkjx" event={"ID":"fa61b3e5-e315-4b83-8252-f76b5987c5c3","Type":"ContainerStarted","Data":"61f9172f7eaba44be584f32af9d1be70637e5ad294ad11bf49604940750fa5a9"}
Jul 30 14:00:45.172896 ip-10-0-143-153 kubenswrapper[2566]: I0730 14:00:45.172837    2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-0e458a-689cbdcd46-nhkjx"
Jul 30 14:00:45.191913 ip-10-0-143-153 kubenswrapper[2566]: I0730 14:00:45.191850    2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-0e458a-68f94844d4-bk6kb" podStartSLOduration=1.191828178 podStartE2EDuration="1.191828178s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-30 14:00:44 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 14:00:45.190865256 +0000 UTC m=+3674.119553532" watchObservedRunningTime="2026-07-30 14:00:45.191828178 +0000 UTC m=+3674.120516443"
Jul 30 14:00:45.212658 ip-10-0-143-153 kubenswrapper[2566]: I0730 14:00:45.212607    2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-0e458a-689cbdcd46-nhkjx" podStartSLOduration=1.212589486 podStartE2EDuration="1.212589486s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-30 14:00:44 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 14:00:45.212065846 +0000 UTC m=+3674.140754109" watchObservedRunningTime="2026-07-30 14:00:45.212589486 +0000 UTC m=+3674.141277751"
Jul 30 14:00:56.186319 ip-10-0-143-153 kubenswrapper[2566]: I0730 14:00:56.186240    2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-0e458a-68f94844d4-bk6kb"
Jul 30 14:00:56.186319 ip-10-0-143-153 kubenswrapper[2566]: I0730 14:00:56.186316    2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-0e458a-689cbdcd46-nhkjx"
Jul 30 14:01:03.013486 ip-10-0-143-153 kubenswrapper[2566]: I0730 14:01:03.013447    2566 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-cleanup-0e458a-689cbdcd46-nhkjx"]
Jul 30 14:01:03.013977 ip-10-0-143-153 kubenswrapper[2566]: I0730 14:01:03.013764    2566 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-0e458a-689cbdcd46-nhkjx" podUID="fa61b3e5-e315-4b83-8252-f76b5987c5c3" containerName="payload-processing" containerID="cri-o://c090cf50696ee80b9e46f12ed57d7b9a34388d935b72438ffb5ddb2a28276e44" gracePeriod=30
Jul 30 14:01:03.024969 ip-10-0-143-153 kubenswrapper[2566]: I0730 14:01:03.024924    2566 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-0e458a-68f94844d4-bk6kb"]
Jul 30 14:01:03.025350 ip-10-0-143-153 kubenswrapper[2566]: I0730 14:01:03.025292    2566 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-0e458a-68f94844d4-bk6kb" podUID="5951831b-2a96-46fc-bedd-65ceaf7f8a66" containerName="payload-pre-processing" containerID="cri-o://1007ce32bc7e77d7ee55b84cf10b67ac8b9cf017c3b457423d63206e60ae5517" gracePeriod=30
Jul 30 14:01:03.278268 ip-10-0-143-153 kubenswrapper[2566]: I0730 14:01:03.278169    2566 generic.go:356] "Generic (PLEG): container finished" podID="fa61b3e5-e315-4b83-8252-f76b5987c5c3" containerID="c090cf50696ee80b9e46f12ed57d7b9a34388d935b72438ffb5ddb2a28276e44" exitCode=0
Jul 30 14:01:03.278446 ip-10-0-143-153 kubenswrapper[2566]: I0730 14:01:03.278336    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-0e458a-689cbdcd46-nhkjx" event={"ID":"fa61b3e5-e315-4b83-8252-f76b5987c5c3","Type":"ContainerDied","Data":"c090cf50696ee80b9e46f12ed57d7b9a34388d935b72438ffb5ddb2a28276e44"}
Jul 30 14:01:03.280819 ip-10-0-143-153 kubenswrapper[2566]: I0730 14:01:03.280785    2566 generic.go:356] "Generic (PLEG): container finished" podID="5951831b-2a96-46fc-bedd-65ceaf7f8a66" containerID="1007ce32bc7e77d7ee55b84cf10b67ac8b9cf017c3b457423d63206e60ae5517" exitCode=0
Jul 30 14:01:03.280963 ip-10-0-143-153 kubenswrapper[2566]: I0730 14:01:03.280937    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-0e458a-68f94844d4-bk6kb" event={"ID":"5951831b-2a96-46fc-bedd-65ceaf7f8a66","Type":"ContainerDied","Data":"1007ce32bc7e77d7ee55b84cf10b67ac8b9cf017c3b457423d63206e60ae5517"}
Jul 30 14:01:03.311252 ip-10-0-143-153 kubenswrapper[2566]: I0730 14:01:03.311221    2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-0e458a-689cbdcd46-nhkjx"
Jul 30 14:01:03.341524 ip-10-0-143-153 kubenswrapper[2566]: I0730 14:01:03.341494    2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-0e458a-68f94844d4-bk6kb"
Jul 30 14:01:03.359180 ip-10-0-143-153 kubenswrapper[2566]: I0730 14:01:03.359149    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-sqw5h\" (UniqueName: \"kubernetes.io/projected/fa61b3e5-e315-4b83-8252-f76b5987c5c3-kube-api-access-sqw5h\") pod \"fa61b3e5-e315-4b83-8252-f76b5987c5c3\" (UID: \"fa61b3e5-e315-4b83-8252-f76b5987c5c3\") "
Jul 30 14:01:03.359380 ip-10-0-143-153 kubenswrapper[2566]: I0730 14:01:03.359203    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/fa61b3e5-e315-4b83-8252-f76b5987c5c3-plugins-config-volume\") pod \"fa61b3e5-e315-4b83-8252-f76b5987c5c3\" (UID: \"fa61b3e5-e315-4b83-8252-f76b5987c5c3\") "
Jul 30 14:01:03.359796 ip-10-0-143-153 kubenswrapper[2566]: I0730 14:01:03.359758    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/fa61b3e5-e315-4b83-8252-f76b5987c5c3-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "fa61b3e5-e315-4b83-8252-f76b5987c5c3" (UID: "fa61b3e5-e315-4b83-8252-f76b5987c5c3"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 30 14:01:03.361490 ip-10-0-143-153 kubenswrapper[2566]: I0730 14:01:03.361459    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/fa61b3e5-e315-4b83-8252-f76b5987c5c3-kube-api-access-sqw5h" (OuterVolumeSpecName: "kube-api-access-sqw5h") pod "fa61b3e5-e315-4b83-8252-f76b5987c5c3" (UID: "fa61b3e5-e315-4b83-8252-f76b5987c5c3"). InnerVolumeSpecName "kube-api-access-sqw5h". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 30 14:01:03.460195 ip-10-0-143-153 kubenswrapper[2566]: I0730 14:01:03.460154    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/5951831b-2a96-46fc-bedd-65ceaf7f8a66-plugins-config-volume\") pod \"5951831b-2a96-46fc-bedd-65ceaf7f8a66\" (UID: \"5951831b-2a96-46fc-bedd-65ceaf7f8a66\") "
Jul 30 14:01:03.460387 ip-10-0-143-153 kubenswrapper[2566]: I0730 14:01:03.460291    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-n8f6f\" (UniqueName: \"kubernetes.io/projected/5951831b-2a96-46fc-bedd-65ceaf7f8a66-kube-api-access-n8f6f\") pod \"5951831b-2a96-46fc-bedd-65ceaf7f8a66\" (UID: \"5951831b-2a96-46fc-bedd-65ceaf7f8a66\") "
Jul 30 14:01:03.460527 ip-10-0-143-153 kubenswrapper[2566]: I0730 14:01:03.460501    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5951831b-2a96-46fc-bedd-65ceaf7f8a66-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "5951831b-2a96-46fc-bedd-65ceaf7f8a66" (UID: "5951831b-2a96-46fc-bedd-65ceaf7f8a66"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 30 14:01:03.460573 ip-10-0-143-153 kubenswrapper[2566]: I0730 14:01:03.460509    2566 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-sqw5h\" (UniqueName: \"kubernetes.io/projected/fa61b3e5-e315-4b83-8252-f76b5987c5c3-kube-api-access-sqw5h\") on node \"ip-10-0-143-153.ec2.internal\" DevicePath \"\""
Jul 30 14:01:03.460573 ip-10-0-143-153 kubenswrapper[2566]: I0730 14:01:03.460557    2566 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/fa61b3e5-e315-4b83-8252-f76b5987c5c3-plugins-config-volume\") on node \"ip-10-0-143-153.ec2.internal\" DevicePath \"\""
Jul 30 14:01:03.462389 ip-10-0-143-153 kubenswrapper[2566]: I0730 14:01:03.462365    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5951831b-2a96-46fc-bedd-65ceaf7f8a66-kube-api-access-n8f6f" (OuterVolumeSpecName: "kube-api-access-n8f6f") pod "5951831b-2a96-46fc-bedd-65ceaf7f8a66" (UID: "5951831b-2a96-46fc-bedd-65ceaf7f8a66"). InnerVolumeSpecName "kube-api-access-n8f6f". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 30 14:01:03.561452 ip-10-0-143-153 kubenswrapper[2566]: I0730 14:01:03.561357    2566 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-n8f6f\" (UniqueName: \"kubernetes.io/projected/5951831b-2a96-46fc-bedd-65ceaf7f8a66-kube-api-access-n8f6f\") on node \"ip-10-0-143-153.ec2.internal\" DevicePath \"\""
Jul 30 14:01:03.561452 ip-10-0-143-153 kubenswrapper[2566]: I0730 14:01:03.561388    2566 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/5951831b-2a96-46fc-bedd-65ceaf7f8a66-plugins-config-volume\") on node \"ip-10-0-143-153.ec2.internal\" DevicePath \"\""
Jul 30 14:01:04.288780 ip-10-0-143-153 kubenswrapper[2566]: I0730 14:01:04.288677    2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-0e458a-689cbdcd46-nhkjx"
Jul 30 14:01:04.288780 ip-10-0-143-153 kubenswrapper[2566]: I0730 14:01:04.288698    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-0e458a-689cbdcd46-nhkjx" event={"ID":"fa61b3e5-e315-4b83-8252-f76b5987c5c3","Type":"ContainerDied","Data":"61f9172f7eaba44be584f32af9d1be70637e5ad294ad11bf49604940750fa5a9"}
Jul 30 14:01:04.288780 ip-10-0-143-153 kubenswrapper[2566]: I0730 14:01:04.288764    2566 scope.go:117] "RemoveContainer" containerID="c090cf50696ee80b9e46f12ed57d7b9a34388d935b72438ffb5ddb2a28276e44"
Jul 30 14:01:04.290241 ip-10-0-143-153 kubenswrapper[2566]: I0730 14:01:04.290213    2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-0e458a-68f94844d4-bk6kb"
Jul 30 14:01:04.290241 ip-10-0-143-153 kubenswrapper[2566]: I0730 14:01:04.290216    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-0e458a-68f94844d4-bk6kb" event={"ID":"5951831b-2a96-46fc-bedd-65ceaf7f8a66","Type":"ContainerDied","Data":"f6e96695150255e18627ee80e9f4520346783fbcecfe64d8e0a688db08343710"}
Jul 30 14:01:04.299113 ip-10-0-143-153 kubenswrapper[2566]: I0730 14:01:04.299064    2566 scope.go:117] "RemoveContainer" containerID="1007ce32bc7e77d7ee55b84cf10b67ac8b9cf017c3b457423d63206e60ae5517"
Jul 30 14:01:04.306802 ip-10-0-143-153 kubenswrapper[2566]: I0730 14:01:04.306774    2566 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-0e458a-68f94844d4-bk6kb"]
Jul 30 14:01:04.312187 ip-10-0-143-153 kubenswrapper[2566]: I0730 14:01:04.312164    2566 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-0e458a-68f94844d4-bk6kb"]
Jul 30 14:01:04.322471 ip-10-0-143-153 kubenswrapper[2566]: I0730 14:01:04.322437    2566 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-cleanup-0e458a-689cbdcd46-nhkjx"]
Jul 30 14:01:04.325913 ip-10-0-143-153 kubenswrapper[2566]: I0730 14:01:04.325889    2566 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-cleanup-0e458a-689cbdcd46-nhkjx"]
Jul 30 14:01:05.628015 ip-10-0-143-153 kubenswrapper[2566]: I0730 14:01:05.627980    2566 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="5951831b-2a96-46fc-bedd-65ceaf7f8a66" path="/var/lib/kubelet/pods/5951831b-2a96-46fc-bedd-65ceaf7f8a66/volumes"
Jul 30 14:01:05.628403 ip-10-0-143-153 kubenswrapper[2566]: I0730 14:01:05.628367    2566 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="fa61b3e5-e315-4b83-8252-f76b5987c5c3" path="/var/lib/kubelet/pods/fa61b3e5-e315-4b83-8252-f76b5987c5c3/volumes"
Jul 30 14:01:25.398352 ip-10-0-143-153 kubenswrapper[2566]: I0730 14:01:25.398315    2566 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-a-cd11f9-6dddf984cd-7rtgl"]
Jul 30 14:01:25.398950 ip-10-0-143-153 kubenswrapper[2566]: I0730 14:01:25.398619    2566 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-ipp-a-cd11f9-6dddf984cd-7rtgl" podUID="d07273f6-e306-4c3d-b36f-0606b9634a53" containerName="payload-processing" containerID="cri-o://5ceebd0ee27a3b7826ff31ca1804a3f166df036f8a0e79a56fb43ff1d8d7144a" gracePeriod=30
Jul 30 14:01:25.406823 ip-10-0-143-153 kubenswrapper[2566]: I0730 14:01:25.406646    2566 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-a-cd11f9-5488cbd6d-t7pww"]
Jul 30 14:01:25.407397 ip-10-0-143-153 kubenswrapper[2566]: I0730 14:01:25.406908    2566 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-cd11f9-5488cbd6d-t7pww" podUID="2abd4aca-be43-475e-83b4-0901962e1c51" containerName="payload-pre-processing" containerID="cri-o://205076b55eab3c0bc572f588bd5c0f4d39cb94bc427e418c5250f99367bdd90a" gracePeriod=30
Jul 30 14:01:25.668706 ip-10-0-143-153 kubenswrapper[2566]: I0730 14:01:25.668682    2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-a-cd11f9-6dddf984cd-7rtgl"
Jul 30 14:01:25.706550 ip-10-0-143-153 kubenswrapper[2566]: I0730 14:01:25.706517    2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-cd11f9-5488cbd6d-t7pww"
Jul 30 14:01:25.763941 ip-10-0-143-153 kubenswrapper[2566]: I0730 14:01:25.763905    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-d9b8m\" (UniqueName: \"kubernetes.io/projected/d07273f6-e306-4c3d-b36f-0606b9634a53-kube-api-access-d9b8m\") pod \"d07273f6-e306-4c3d-b36f-0606b9634a53\" (UID: \"d07273f6-e306-4c3d-b36f-0606b9634a53\") "
Jul 30 14:01:25.764149 ip-10-0-143-153 kubenswrapper[2566]: I0730 14:01:25.763957    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/d07273f6-e306-4c3d-b36f-0606b9634a53-plugins-config-volume\") pod \"d07273f6-e306-4c3d-b36f-0606b9634a53\" (UID: \"d07273f6-e306-4c3d-b36f-0606b9634a53\") "
Jul 30 14:01:25.764420 ip-10-0-143-153 kubenswrapper[2566]: I0730 14:01:25.764393    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d07273f6-e306-4c3d-b36f-0606b9634a53-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "d07273f6-e306-4c3d-b36f-0606b9634a53" (UID: "d07273f6-e306-4c3d-b36f-0606b9634a53"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 30 14:01:25.766171 ip-10-0-143-153 kubenswrapper[2566]: I0730 14:01:25.766148    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d07273f6-e306-4c3d-b36f-0606b9634a53-kube-api-access-d9b8m" (OuterVolumeSpecName: "kube-api-access-d9b8m") pod "d07273f6-e306-4c3d-b36f-0606b9634a53" (UID: "d07273f6-e306-4c3d-b36f-0606b9634a53"). InnerVolumeSpecName "kube-api-access-d9b8m". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 30 14:01:25.865145 ip-10-0-143-153 kubenswrapper[2566]: I0730 14:01:25.865111    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-sq689\" (UniqueName: \"kubernetes.io/projected/2abd4aca-be43-475e-83b4-0901962e1c51-kube-api-access-sq689\") pod \"2abd4aca-be43-475e-83b4-0901962e1c51\" (UID: \"2abd4aca-be43-475e-83b4-0901962e1c51\") "
Jul 30 14:01:25.865331 ip-10-0-143-153 kubenswrapper[2566]: I0730 14:01:25.865184    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/2abd4aca-be43-475e-83b4-0901962e1c51-plugins-config-volume\") pod \"2abd4aca-be43-475e-83b4-0901962e1c51\" (UID: \"2abd4aca-be43-475e-83b4-0901962e1c51\") "
Jul 30 14:01:25.865384 ip-10-0-143-153 kubenswrapper[2566]: I0730 14:01:25.865373    2566 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-d9b8m\" (UniqueName: \"kubernetes.io/projected/d07273f6-e306-4c3d-b36f-0606b9634a53-kube-api-access-d9b8m\") on node \"ip-10-0-143-153.ec2.internal\" DevicePath \"\""
Jul 30 14:01:25.865421 ip-10-0-143-153 kubenswrapper[2566]: I0730 14:01:25.865387    2566 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/d07273f6-e306-4c3d-b36f-0606b9634a53-plugins-config-volume\") on node \"ip-10-0-143-153.ec2.internal\" DevicePath \"\""
Jul 30 14:01:25.865604 ip-10-0-143-153 kubenswrapper[2566]: I0730 14:01:25.865575    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2abd4aca-be43-475e-83b4-0901962e1c51-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "2abd4aca-be43-475e-83b4-0901962e1c51" (UID: "2abd4aca-be43-475e-83b4-0901962e1c51"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 30 14:01:25.867383 ip-10-0-143-153 kubenswrapper[2566]: I0730 14:01:25.867358    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2abd4aca-be43-475e-83b4-0901962e1c51-kube-api-access-sq689" (OuterVolumeSpecName: "kube-api-access-sq689") pod "2abd4aca-be43-475e-83b4-0901962e1c51" (UID: "2abd4aca-be43-475e-83b4-0901962e1c51"). InnerVolumeSpecName "kube-api-access-sq689". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 30 14:01:25.966478 ip-10-0-143-153 kubenswrapper[2566]: I0730 14:01:25.966387    2566 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-sq689\" (UniqueName: \"kubernetes.io/projected/2abd4aca-be43-475e-83b4-0901962e1c51-kube-api-access-sq689\") on node \"ip-10-0-143-153.ec2.internal\" DevicePath \"\""
Jul 30 14:01:25.966478 ip-10-0-143-153 kubenswrapper[2566]: I0730 14:01:25.966418    2566 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/2abd4aca-be43-475e-83b4-0901962e1c51-plugins-config-volume\") on node \"ip-10-0-143-153.ec2.internal\" DevicePath \"\""
Jul 30 14:01:26.422212 ip-10-0-143-153 kubenswrapper[2566]: I0730 14:01:26.422183    2566 generic.go:356] "Generic (PLEG): container finished" podID="2abd4aca-be43-475e-83b4-0901962e1c51" containerID="205076b55eab3c0bc572f588bd5c0f4d39cb94bc427e418c5250f99367bdd90a" exitCode=0
Jul 30 14:01:26.422610 ip-10-0-143-153 kubenswrapper[2566]: I0730 14:01:26.422230    2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-cd11f9-5488cbd6d-t7pww"
Jul 30 14:01:26.422610 ip-10-0-143-153 kubenswrapper[2566]: I0730 14:01:26.422265    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-cd11f9-5488cbd6d-t7pww" event={"ID":"2abd4aca-be43-475e-83b4-0901962e1c51","Type":"ContainerDied","Data":"205076b55eab3c0bc572f588bd5c0f4d39cb94bc427e418c5250f99367bdd90a"}
Jul 30 14:01:26.422610 ip-10-0-143-153 kubenswrapper[2566]: I0730 14:01:26.422315    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-cd11f9-5488cbd6d-t7pww" event={"ID":"2abd4aca-be43-475e-83b4-0901962e1c51","Type":"ContainerDied","Data":"99307be3c7387be041db0fa68bae9aa5f228a08b8d926e6314f7da5bf5ad407c"}
Jul 30 14:01:26.422610 ip-10-0-143-153 kubenswrapper[2566]: I0730 14:01:26.422346    2566 scope.go:117] "RemoveContainer" containerID="205076b55eab3c0bc572f588bd5c0f4d39cb94bc427e418c5250f99367bdd90a"
Jul 30 14:01:26.423788 ip-10-0-143-153 kubenswrapper[2566]: I0730 14:01:26.423766    2566 generic.go:356] "Generic (PLEG): container finished" podID="d07273f6-e306-4c3d-b36f-0606b9634a53" containerID="5ceebd0ee27a3b7826ff31ca1804a3f166df036f8a0e79a56fb43ff1d8d7144a" exitCode=0
Jul 30 14:01:26.423893 ip-10-0-143-153 kubenswrapper[2566]: I0730 14:01:26.423802    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-a-cd11f9-6dddf984cd-7rtgl" event={"ID":"d07273f6-e306-4c3d-b36f-0606b9634a53","Type":"ContainerDied","Data":"5ceebd0ee27a3b7826ff31ca1804a3f166df036f8a0e79a56fb43ff1d8d7144a"}
Jul 30 14:01:26.423893 ip-10-0-143-153 kubenswrapper[2566]: I0730 14:01:26.423817    2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-a-cd11f9-6dddf984cd-7rtgl"
Jul 30 14:01:26.423893 ip-10-0-143-153 kubenswrapper[2566]: I0730 14:01:26.423844    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-a-cd11f9-6dddf984cd-7rtgl" event={"ID":"d07273f6-e306-4c3d-b36f-0606b9634a53","Type":"ContainerDied","Data":"8fb11137c710f486fbf28c98d44ac50b6d9e5c20662ca76862764df084ae6a0f"}
Jul 30 14:01:26.432996 ip-10-0-143-153 kubenswrapper[2566]: I0730 14:01:26.432973    2566 scope.go:117] "RemoveContainer" containerID="205076b55eab3c0bc572f588bd5c0f4d39cb94bc427e418c5250f99367bdd90a"
Jul 30 14:01:26.433346 ip-10-0-143-153 kubenswrapper[2566]: E0730 14:01:26.433321    2566 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"205076b55eab3c0bc572f588bd5c0f4d39cb94bc427e418c5250f99367bdd90a\": container with ID starting with 205076b55eab3c0bc572f588bd5c0f4d39cb94bc427e418c5250f99367bdd90a not found: ID does not exist" containerID="205076b55eab3c0bc572f588bd5c0f4d39cb94bc427e418c5250f99367bdd90a"
Jul 30 14:01:26.433449 ip-10-0-143-153 kubenswrapper[2566]: I0730 14:01:26.433354    2566 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"205076b55eab3c0bc572f588bd5c0f4d39cb94bc427e418c5250f99367bdd90a"} err="failed to get container status \"205076b55eab3c0bc572f588bd5c0f4d39cb94bc427e418c5250f99367bdd90a\": rpc error: code = NotFound desc = could not find container \"205076b55eab3c0bc572f588bd5c0f4d39cb94bc427e418c5250f99367bdd90a\": container with ID starting with 205076b55eab3c0bc572f588bd5c0f4d39cb94bc427e418c5250f99367bdd90a not found: ID does not exist"
Jul 30 14:01:26.433449 ip-10-0-143-153 kubenswrapper[2566]: I0730 14:01:26.433370    2566 scope.go:117] "RemoveContainer" containerID="5ceebd0ee27a3b7826ff31ca1804a3f166df036f8a0e79a56fb43ff1d8d7144a"
Jul 30 14:01:26.442907 ip-10-0-143-153 kubenswrapper[2566]: I0730 14:01:26.442864    2566 scope.go:117] "RemoveContainer" containerID="5ceebd0ee27a3b7826ff31ca1804a3f166df036f8a0e79a56fb43ff1d8d7144a"
Jul 30 14:01:26.443224 ip-10-0-143-153 kubenswrapper[2566]: E0730 14:01:26.443198    2566 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5ceebd0ee27a3b7826ff31ca1804a3f166df036f8a0e79a56fb43ff1d8d7144a\": container with ID starting with 5ceebd0ee27a3b7826ff31ca1804a3f166df036f8a0e79a56fb43ff1d8d7144a not found: ID does not exist" containerID="5ceebd0ee27a3b7826ff31ca1804a3f166df036f8a0e79a56fb43ff1d8d7144a"
Jul 30 14:01:26.443343 ip-10-0-143-153 kubenswrapper[2566]: I0730 14:01:26.443232    2566 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5ceebd0ee27a3b7826ff31ca1804a3f166df036f8a0e79a56fb43ff1d8d7144a"} err="failed to get container status \"5ceebd0ee27a3b7826ff31ca1804a3f166df036f8a0e79a56fb43ff1d8d7144a\": rpc error: code = NotFound desc = could not find container \"5ceebd0ee27a3b7826ff31ca1804a3f166df036f8a0e79a56fb43ff1d8d7144a\": container with ID starting with 5ceebd0ee27a3b7826ff31ca1804a3f166df036f8a0e79a56fb43ff1d8d7144a not found: ID does not exist"
Jul 30 14:01:26.445736 ip-10-0-143-153 kubenswrapper[2566]: I0730 14:01:26.445714    2566 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-a-cd11f9-5488cbd6d-t7pww"]
Jul 30 14:01:26.451196 ip-10-0-143-153 kubenswrapper[2566]: I0730 14:01:26.451175    2566 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-a-cd11f9-5488cbd6d-t7pww"]
Jul 30 14:01:26.460272 ip-10-0-143-153 kubenswrapper[2566]: I0730 14:01:26.460252    2566 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-a-cd11f9-6dddf984cd-7rtgl"]
Jul 30 14:01:26.471583 ip-10-0-143-153 kubenswrapper[2566]: I0730 14:01:26.469088    2566 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-a-cd11f9-6dddf984cd-7rtgl"]
Jul 30 14:01:27.628752 ip-10-0-143-153 kubenswrapper[2566]: I0730 14:01:27.628715    2566 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="2abd4aca-be43-475e-83b4-0901962e1c51" path="/var/lib/kubelet/pods/2abd4aca-be43-475e-83b4-0901962e1c51/volumes"
Jul 30 14:01:27.629137 ip-10-0-143-153 kubenswrapper[2566]: I0730 14:01:27.629104    2566 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d07273f6-e306-4c3d-b36f-0606b9634a53" path="/var/lib/kubelet/pods/d07273f6-e306-4c3d-b36f-0606b9634a53/volumes"
Jul 30 14:02:20.183146 ip-10-0-143-153 kubenswrapper[2566]: I0730 14:02:20.183110    2566 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-b-2a5bef-7d6c89ff8-97bjm"]
Jul 30 14:02:20.183790 ip-10-0-143-153 kubenswrapper[2566]: I0730 14:02:20.183328    2566 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-ipp-b-2a5bef-7d6c89ff8-97bjm" podUID="0d250aef-7d08-4ea4-9bc6-7aa90acd9a88" containerName="payload-processing" containerID="cri-o://14c072a026cc6c6667ee6a3d015e5da15d54bdbe6b6854ebc241a741efa2086a" gracePeriod=30
Jul 30 14:02:20.190470 ip-10-0-143-153 kubenswrapper[2566]: I0730 14:02:20.190442    2566 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-b-2a5bef-64bdf857bd-9sqd2"]
Jul 30 14:02:20.190659 ip-10-0-143-153 kubenswrapper[2566]: I0730 14:02:20.190637    2566 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-2a5bef-64bdf857bd-9sqd2" podUID="abcfa942-4318-457b-a9a5-7593cdb437f1" containerName="payload-pre-processing" containerID="cri-o://1c1e241ec26e45cd2d2fd75e8962417905b6da60c47a138ee262306d1ff797a7" gracePeriod=30
Jul 30 14:02:20.453927 ip-10-0-143-153 kubenswrapper[2566]: I0730 14:02:20.453895    2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-b-2a5bef-7d6c89ff8-97bjm"
Jul 30 14:02:20.499012 ip-10-0-143-153 kubenswrapper[2566]: I0730 14:02:20.498980    2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-2a5bef-64bdf857bd-9sqd2"
Jul 30 14:02:20.585602 ip-10-0-143-153 kubenswrapper[2566]: I0730 14:02:20.585557    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-79dvn\" (UniqueName: \"kubernetes.io/projected/0d250aef-7d08-4ea4-9bc6-7aa90acd9a88-kube-api-access-79dvn\") pod \"0d250aef-7d08-4ea4-9bc6-7aa90acd9a88\" (UID: \"0d250aef-7d08-4ea4-9bc6-7aa90acd9a88\") "
Jul 30 14:02:20.585807 ip-10-0-143-153 kubenswrapper[2566]: I0730 14:02:20.585622    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/abcfa942-4318-457b-a9a5-7593cdb437f1-plugins-config-volume\") pod \"abcfa942-4318-457b-a9a5-7593cdb437f1\" (UID: \"abcfa942-4318-457b-a9a5-7593cdb437f1\") "
Jul 30 14:02:20.585807 ip-10-0-143-153 kubenswrapper[2566]: I0730 14:02:20.585695    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-hfqs8\" (UniqueName: \"kubernetes.io/projected/abcfa942-4318-457b-a9a5-7593cdb437f1-kube-api-access-hfqs8\") pod \"abcfa942-4318-457b-a9a5-7593cdb437f1\" (UID: \"abcfa942-4318-457b-a9a5-7593cdb437f1\") "
Jul 30 14:02:20.585949 ip-10-0-143-153 kubenswrapper[2566]: I0730 14:02:20.585734    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/0d250aef-7d08-4ea4-9bc6-7aa90acd9a88-plugins-config-volume\") pod \"0d250aef-7d08-4ea4-9bc6-7aa90acd9a88\" (UID: \"0d250aef-7d08-4ea4-9bc6-7aa90acd9a88\") "
Jul 30 14:02:20.586628 ip-10-0-143-153 kubenswrapper[2566]: I0730 14:02:20.586589    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0d250aef-7d08-4ea4-9bc6-7aa90acd9a88-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "0d250aef-7d08-4ea4-9bc6-7aa90acd9a88" (UID: "0d250aef-7d08-4ea4-9bc6-7aa90acd9a88"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 30 14:02:20.586772 ip-10-0-143-153 kubenswrapper[2566]: I0730 14:02:20.586692    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/abcfa942-4318-457b-a9a5-7593cdb437f1-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "abcfa942-4318-457b-a9a5-7593cdb437f1" (UID: "abcfa942-4318-457b-a9a5-7593cdb437f1"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 30 14:02:20.588660 ip-10-0-143-153 kubenswrapper[2566]: I0730 14:02:20.588629    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/abcfa942-4318-457b-a9a5-7593cdb437f1-kube-api-access-hfqs8" (OuterVolumeSpecName: "kube-api-access-hfqs8") pod "abcfa942-4318-457b-a9a5-7593cdb437f1" (UID: "abcfa942-4318-457b-a9a5-7593cdb437f1"). InnerVolumeSpecName "kube-api-access-hfqs8". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 30 14:02:20.588963 ip-10-0-143-153 kubenswrapper[2566]: I0730 14:02:20.588941    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0d250aef-7d08-4ea4-9bc6-7aa90acd9a88-kube-api-access-79dvn" (OuterVolumeSpecName: "kube-api-access-79dvn") pod "0d250aef-7d08-4ea4-9bc6-7aa90acd9a88" (UID: "0d250aef-7d08-4ea4-9bc6-7aa90acd9a88"). InnerVolumeSpecName "kube-api-access-79dvn". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 30 14:02:20.687516 ip-10-0-143-153 kubenswrapper[2566]: I0730 14:02:20.687432    2566 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-79dvn\" (UniqueName: \"kubernetes.io/projected/0d250aef-7d08-4ea4-9bc6-7aa90acd9a88-kube-api-access-79dvn\") on node \"ip-10-0-143-153.ec2.internal\" DevicePath \"\""
Jul 30 14:02:20.687516 ip-10-0-143-153 kubenswrapper[2566]: I0730 14:02:20.687463    2566 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/abcfa942-4318-457b-a9a5-7593cdb437f1-plugins-config-volume\") on node \"ip-10-0-143-153.ec2.internal\" DevicePath \"\""
Jul 30 14:02:20.687516 ip-10-0-143-153 kubenswrapper[2566]: I0730 14:02:20.687472    2566 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-hfqs8\" (UniqueName: \"kubernetes.io/projected/abcfa942-4318-457b-a9a5-7593cdb437f1-kube-api-access-hfqs8\") on node \"ip-10-0-143-153.ec2.internal\" DevicePath \"\""
Jul 30 14:02:20.687516 ip-10-0-143-153 kubenswrapper[2566]: I0730 14:02:20.687481    2566 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/0d250aef-7d08-4ea4-9bc6-7aa90acd9a88-plugins-config-volume\") on node \"ip-10-0-143-153.ec2.internal\" DevicePath \"\""
Jul 30 14:02:20.708937 ip-10-0-143-153 kubenswrapper[2566]: I0730 14:02:20.708899    2566 generic.go:356] "Generic (PLEG): container finished" podID="0d250aef-7d08-4ea4-9bc6-7aa90acd9a88" containerID="14c072a026cc6c6667ee6a3d015e5da15d54bdbe6b6854ebc241a741efa2086a" exitCode=0
Jul 30 14:02:20.709180 ip-10-0-143-153 kubenswrapper[2566]: I0730 14:02:20.708976    2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-b-2a5bef-7d6c89ff8-97bjm"
Jul 30 14:02:20.709180 ip-10-0-143-153 kubenswrapper[2566]: I0730 14:02:20.708993    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-b-2a5bef-7d6c89ff8-97bjm" event={"ID":"0d250aef-7d08-4ea4-9bc6-7aa90acd9a88","Type":"ContainerDied","Data":"14c072a026cc6c6667ee6a3d015e5da15d54bdbe6b6854ebc241a741efa2086a"}
Jul 30 14:02:20.709180 ip-10-0-143-153 kubenswrapper[2566]: I0730 14:02:20.709050    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-b-2a5bef-7d6c89ff8-97bjm" event={"ID":"0d250aef-7d08-4ea4-9bc6-7aa90acd9a88","Type":"ContainerDied","Data":"019e726453dc40b0db6a923cb4b169141d3ff44ef92411aecfdf9186e755c5cd"}
Jul 30 14:02:20.709180 ip-10-0-143-153 kubenswrapper[2566]: I0730 14:02:20.709107    2566 scope.go:117] "RemoveContainer" containerID="14c072a026cc6c6667ee6a3d015e5da15d54bdbe6b6854ebc241a741efa2086a"
Jul 30 14:02:20.710982 ip-10-0-143-153 kubenswrapper[2566]: I0730 14:02:20.710555    2566 generic.go:356] "Generic (PLEG): container finished" podID="abcfa942-4318-457b-a9a5-7593cdb437f1" containerID="1c1e241ec26e45cd2d2fd75e8962417905b6da60c47a138ee262306d1ff797a7" exitCode=0
Jul 30 14:02:20.710982 ip-10-0-143-153 kubenswrapper[2566]: I0730 14:02:20.710601    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-2a5bef-64bdf857bd-9sqd2" event={"ID":"abcfa942-4318-457b-a9a5-7593cdb437f1","Type":"ContainerDied","Data":"1c1e241ec26e45cd2d2fd75e8962417905b6da60c47a138ee262306d1ff797a7"}
Jul 30 14:02:20.710982 ip-10-0-143-153 kubenswrapper[2566]: I0730 14:02:20.710632    2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-2a5bef-64bdf857bd-9sqd2"
Jul 30 14:02:20.710982 ip-10-0-143-153 kubenswrapper[2566]: I0730 14:02:20.710666    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-2a5bef-64bdf857bd-9sqd2" event={"ID":"abcfa942-4318-457b-a9a5-7593cdb437f1","Type":"ContainerDied","Data":"4c42fabb86429743e71cf2691c26bc94ef4d980fd58199eaa8c46cfcdbbff9b5"}
Jul 30 14:02:20.720640 ip-10-0-143-153 kubenswrapper[2566]: I0730 14:02:20.720619    2566 scope.go:117] "RemoveContainer" containerID="14c072a026cc6c6667ee6a3d015e5da15d54bdbe6b6854ebc241a741efa2086a"
Jul 30 14:02:20.720919 ip-10-0-143-153 kubenswrapper[2566]: E0730 14:02:20.720897    2566 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"14c072a026cc6c6667ee6a3d015e5da15d54bdbe6b6854ebc241a741efa2086a\": container with ID starting with 14c072a026cc6c6667ee6a3d015e5da15d54bdbe6b6854ebc241a741efa2086a not found: ID does not exist" containerID="14c072a026cc6c6667ee6a3d015e5da15d54bdbe6b6854ebc241a741efa2086a"
Jul 30 14:02:20.721013 ip-10-0-143-153 kubenswrapper[2566]: I0730 14:02:20.720927    2566 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"14c072a026cc6c6667ee6a3d015e5da15d54bdbe6b6854ebc241a741efa2086a"} err="failed to get container status \"14c072a026cc6c6667ee6a3d015e5da15d54bdbe6b6854ebc241a741efa2086a\": rpc error: code = NotFound desc = could not find container \"14c072a026cc6c6667ee6a3d015e5da15d54bdbe6b6854ebc241a741efa2086a\": container with ID starting with 14c072a026cc6c6667ee6a3d015e5da15d54bdbe6b6854ebc241a741efa2086a not found: ID does not exist"
Jul 30 14:02:20.721013 ip-10-0-143-153 kubenswrapper[2566]: I0730 14:02:20.720945    2566 scope.go:117] "RemoveContainer" containerID="1c1e241ec26e45cd2d2fd75e8962417905b6da60c47a138ee262306d1ff797a7"
Jul 30 14:02:20.730602 ip-10-0-143-153 kubenswrapper[2566]: I0730 14:02:20.730584    2566 scope.go:117] "RemoveContainer" containerID="1c1e241ec26e45cd2d2fd75e8962417905b6da60c47a138ee262306d1ff797a7"
Jul 30 14:02:20.730852 ip-10-0-143-153 kubenswrapper[2566]: E0730 14:02:20.730833    2566 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1c1e241ec26e45cd2d2fd75e8962417905b6da60c47a138ee262306d1ff797a7\": container with ID starting with 1c1e241ec26e45cd2d2fd75e8962417905b6da60c47a138ee262306d1ff797a7 not found: ID does not exist" containerID="1c1e241ec26e45cd2d2fd75e8962417905b6da60c47a138ee262306d1ff797a7"
Jul 30 14:02:20.730916 ip-10-0-143-153 kubenswrapper[2566]: I0730 14:02:20.730861    2566 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1c1e241ec26e45cd2d2fd75e8962417905b6da60c47a138ee262306d1ff797a7"} err="failed to get container status \"1c1e241ec26e45cd2d2fd75e8962417905b6da60c47a138ee262306d1ff797a7\": rpc error: code = NotFound desc = could not find container \"1c1e241ec26e45cd2d2fd75e8962417905b6da60c47a138ee262306d1ff797a7\": container with ID starting with 1c1e241ec26e45cd2d2fd75e8962417905b6da60c47a138ee262306d1ff797a7 not found: ID does not exist"
Jul 30 14:02:20.736855 ip-10-0-143-153 kubenswrapper[2566]: I0730 14:02:20.736832    2566 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-b-2a5bef-64bdf857bd-9sqd2"]
Jul 30 14:02:20.740663 ip-10-0-143-153 kubenswrapper[2566]: I0730 14:02:20.740642    2566 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-b-2a5bef-64bdf857bd-9sqd2"]
Jul 30 14:02:20.749747 ip-10-0-143-153 kubenswrapper[2566]: I0730 14:02:20.749723    2566 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-b-2a5bef-7d6c89ff8-97bjm"]
Jul 30 14:02:20.752365 ip-10-0-143-153 kubenswrapper[2566]: I0730 14:02:20.752342    2566 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-b-2a5bef-7d6c89ff8-97bjm"]
Jul 30 14:02:21.628065 ip-10-0-143-153 kubenswrapper[2566]: I0730 14:02:21.627985    2566 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="0d250aef-7d08-4ea4-9bc6-7aa90acd9a88" path="/var/lib/kubelet/pods/0d250aef-7d08-4ea4-9bc6-7aa90acd9a88/volumes"
Jul 30 14:02:21.628461 ip-10-0-143-153 kubenswrapper[2566]: I0730 14:02:21.628372    2566 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="abcfa942-4318-457b-a9a5-7593cdb437f1" path="/var/lib/kubelet/pods/abcfa942-4318-457b-a9a5-7593cdb437f1/volumes"
Jul 30 14:02:33.488110 ip-10-0-143-153 kubenswrapper[2566]: I0730 14:02:33.488055    2566 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-a-f4dc0a-7cbc4cb99d-s6xr6"]
Jul 30 14:02:33.488606 ip-10-0-143-153 kubenswrapper[2566]: I0730 14:02:33.488356    2566 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-shared-a-f4dc0a-7cbc4cb99d-s6xr6" podUID="e7b30cc1-c765-49b7-80ca-bbe7755911df" containerName="payload-processing" containerID="cri-o://e72b6744f48ee8d83c1c75ede4641e16b072702385ab620d107465fdf2e3def1" gracePeriod=30
Jul 30 14:02:33.496872 ip-10-0-143-153 kubenswrapper[2566]: I0730 14:02:33.493721    2566 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-a-f4dc0a-7c5b8c59bd-2cszm"]
Jul 30 14:02:33.496872 ip-10-0-143-153 kubenswrapper[2566]: I0730 14:02:33.494322    2566 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-f4dc0a-7c5b8c59bd-2cszm" podUID="881c595b-3957-45ae-9da4-f6655fd4c779" containerName="payload-pre-processing" containerID="cri-o://bc5e1a90a429abd2bfa0c0acedb22048d59e8cf52fc926704deb52071d3d75c7" gracePeriod=30
Jul 30 14:02:33.785809 ip-10-0-143-153 kubenswrapper[2566]: I0730 14:02:33.785774    2566 generic.go:356] "Generic (PLEG): container finished" podID="e7b30cc1-c765-49b7-80ca-bbe7755911df" containerID="e72b6744f48ee8d83c1c75ede4641e16b072702385ab620d107465fdf2e3def1" exitCode=0
Jul 30 14:02:33.785940 ip-10-0-143-153 kubenswrapper[2566]: I0730 14:02:33.785825    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-a-f4dc0a-7cbc4cb99d-s6xr6" event={"ID":"e7b30cc1-c765-49b7-80ca-bbe7755911df","Type":"ContainerDied","Data":"e72b6744f48ee8d83c1c75ede4641e16b072702385ab620d107465fdf2e3def1"}
Jul 30 14:02:33.785940 ip-10-0-143-153 kubenswrapper[2566]: I0730 14:02:33.785893    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-a-f4dc0a-7cbc4cb99d-s6xr6" event={"ID":"e7b30cc1-c765-49b7-80ca-bbe7755911df","Type":"ContainerDied","Data":"b7d3d0a8bf0449d397e96a9352b82e06136378f43b19c7b9e52bc5292dbd2a8d"}
Jul 30 14:02:33.785940 ip-10-0-143-153 kubenswrapper[2566]: I0730 14:02:33.785922    2566 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="b7d3d0a8bf0449d397e96a9352b82e06136378f43b19c7b9e52bc5292dbd2a8d"
Jul 30 14:02:33.787431 ip-10-0-143-153 kubenswrapper[2566]: I0730 14:02:33.787411    2566 generic.go:356] "Generic (PLEG): container finished" podID="881c595b-3957-45ae-9da4-f6655fd4c779" containerID="bc5e1a90a429abd2bfa0c0acedb22048d59e8cf52fc926704deb52071d3d75c7" exitCode=0
Jul 30 14:02:33.787539 ip-10-0-143-153 kubenswrapper[2566]: I0730 14:02:33.787452    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-f4dc0a-7c5b8c59bd-2cszm" event={"ID":"881c595b-3957-45ae-9da4-f6655fd4c779","Type":"ContainerDied","Data":"bc5e1a90a429abd2bfa0c0acedb22048d59e8cf52fc926704deb52071d3d75c7"}
Jul 30 14:02:33.787539 ip-10-0-143-153 kubenswrapper[2566]: I0730 14:02:33.787483    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-f4dc0a-7c5b8c59bd-2cszm" event={"ID":"881c595b-3957-45ae-9da4-f6655fd4c779","Type":"ContainerDied","Data":"b37a0d26c35e302f95f7796ba4bf13c072975d3f69a130fc07cc12cf9630a884"}
Jul 30 14:02:33.787539 ip-10-0-143-153 kubenswrapper[2566]: I0730 14:02:33.787500    2566 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="b37a0d26c35e302f95f7796ba4bf13c072975d3f69a130fc07cc12cf9630a884"
Jul 30 14:02:33.795769 ip-10-0-143-153 kubenswrapper[2566]: I0730 14:02:33.795748    2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-a-f4dc0a-7cbc4cb99d-s6xr6"
Jul 30 14:02:33.798839 ip-10-0-143-153 kubenswrapper[2566]: I0730 14:02:33.798822    2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-f4dc0a-7c5b8c59bd-2cszm"
Jul 30 14:02:33.916748 ip-10-0-143-153 kubenswrapper[2566]: I0730 14:02:33.916679    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/881c595b-3957-45ae-9da4-f6655fd4c779-plugins-config-volume\") pod \"881c595b-3957-45ae-9da4-f6655fd4c779\" (UID: \"881c595b-3957-45ae-9da4-f6655fd4c779\") "
Jul 30 14:02:33.916748 ip-10-0-143-153 kubenswrapper[2566]: I0730 14:02:33.916727    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-psrdj\" (UniqueName: \"kubernetes.io/projected/881c595b-3957-45ae-9da4-f6655fd4c779-kube-api-access-psrdj\") pod \"881c595b-3957-45ae-9da4-f6655fd4c779\" (UID: \"881c595b-3957-45ae-9da4-f6655fd4c779\") "
Jul 30 14:02:33.916748 ip-10-0-143-153 kubenswrapper[2566]: I0730 14:02:33.916744    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/e7b30cc1-c765-49b7-80ca-bbe7755911df-plugins-config-volume\") pod \"e7b30cc1-c765-49b7-80ca-bbe7755911df\" (UID: \"e7b30cc1-c765-49b7-80ca-bbe7755911df\") "
Jul 30 14:02:33.917065 ip-10-0-143-153 kubenswrapper[2566]: I0730 14:02:33.916774    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-dm866\" (UniqueName: \"kubernetes.io/projected/e7b30cc1-c765-49b7-80ca-bbe7755911df-kube-api-access-dm866\") pod \"e7b30cc1-c765-49b7-80ca-bbe7755911df\" (UID: \"e7b30cc1-c765-49b7-80ca-bbe7755911df\") "
Jul 30 14:02:33.917167 ip-10-0-143-153 kubenswrapper[2566]: I0730 14:02:33.917114    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/881c595b-3957-45ae-9da4-f6655fd4c779-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "881c595b-3957-45ae-9da4-f6655fd4c779" (UID: "881c595b-3957-45ae-9da4-f6655fd4c779"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 30 14:02:33.917167 ip-10-0-143-153 kubenswrapper[2566]: I0730 14:02:33.917129    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e7b30cc1-c765-49b7-80ca-bbe7755911df-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "e7b30cc1-c765-49b7-80ca-bbe7755911df" (UID: "e7b30cc1-c765-49b7-80ca-bbe7755911df"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 30 14:02:33.918867 ip-10-0-143-153 kubenswrapper[2566]: I0730 14:02:33.918840    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/881c595b-3957-45ae-9da4-f6655fd4c779-kube-api-access-psrdj" (OuterVolumeSpecName: "kube-api-access-psrdj") pod "881c595b-3957-45ae-9da4-f6655fd4c779" (UID: "881c595b-3957-45ae-9da4-f6655fd4c779"). InnerVolumeSpecName "kube-api-access-psrdj". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 30 14:02:33.918984 ip-10-0-143-153 kubenswrapper[2566]: I0730 14:02:33.918837    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e7b30cc1-c765-49b7-80ca-bbe7755911df-kube-api-access-dm866" (OuterVolumeSpecName: "kube-api-access-dm866") pod "e7b30cc1-c765-49b7-80ca-bbe7755911df" (UID: "e7b30cc1-c765-49b7-80ca-bbe7755911df"). InnerVolumeSpecName "kube-api-access-dm866". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 30 14:02:34.017854 ip-10-0-143-153 kubenswrapper[2566]: I0730 14:02:34.017782    2566 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/881c595b-3957-45ae-9da4-f6655fd4c779-plugins-config-volume\") on node \"ip-10-0-143-153.ec2.internal\" DevicePath \"\""
Jul 30 14:02:34.017854 ip-10-0-143-153 kubenswrapper[2566]: I0730 14:02:34.017809    2566 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-psrdj\" (UniqueName: \"kubernetes.io/projected/881c595b-3957-45ae-9da4-f6655fd4c779-kube-api-access-psrdj\") on node \"ip-10-0-143-153.ec2.internal\" DevicePath \"\""
Jul 30 14:02:34.017854 ip-10-0-143-153 kubenswrapper[2566]: I0730 14:02:34.017820    2566 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/e7b30cc1-c765-49b7-80ca-bbe7755911df-plugins-config-volume\") on node \"ip-10-0-143-153.ec2.internal\" DevicePath \"\""
Jul 30 14:02:34.017854 ip-10-0-143-153 kubenswrapper[2566]: I0730 14:02:34.017828    2566 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-dm866\" (UniqueName: \"kubernetes.io/projected/e7b30cc1-c765-49b7-80ca-bbe7755911df-kube-api-access-dm866\") on node \"ip-10-0-143-153.ec2.internal\" DevicePath \"\""
Jul 30 14:02:34.793058 ip-10-0-143-153 kubenswrapper[2566]: I0730 14:02:34.792975    2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-f4dc0a-7c5b8c59bd-2cszm"
Jul 30 14:02:34.793439 ip-10-0-143-153 kubenswrapper[2566]: I0730 14:02:34.792976    2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-a-f4dc0a-7cbc4cb99d-s6xr6"
Jul 30 14:02:34.823876 ip-10-0-143-153 kubenswrapper[2566]: I0730 14:02:34.823846    2566 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-a-f4dc0a-7cbc4cb99d-s6xr6"]
Jul 30 14:02:34.831918 ip-10-0-143-153 kubenswrapper[2566]: I0730 14:02:34.831890    2566 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-a-f4dc0a-7cbc4cb99d-s6xr6"]
Jul 30 14:02:34.848300 ip-10-0-143-153 kubenswrapper[2566]: I0730 14:02:34.848276    2566 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-a-f4dc0a-7c5b8c59bd-2cszm"]
Jul 30 14:02:34.853120 ip-10-0-143-153 kubenswrapper[2566]: I0730 14:02:34.853098    2566 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-a-f4dc0a-7c5b8c59bd-2cszm"]
Jul 30 14:02:35.627669 ip-10-0-143-153 kubenswrapper[2566]: I0730 14:02:35.627630    2566 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="881c595b-3957-45ae-9da4-f6655fd4c779" path="/var/lib/kubelet/pods/881c595b-3957-45ae-9da4-f6655fd4c779/volumes"
Jul 30 14:02:35.628071 ip-10-0-143-153 kubenswrapper[2566]: I0730 14:02:35.628051    2566 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e7b30cc1-c765-49b7-80ca-bbe7755911df" path="/var/lib/kubelet/pods/e7b30cc1-c765-49b7-80ca-bbe7755911df/volumes"
Jul 30 14:02:50.913271 ip-10-0-143-153 kubenswrapper[2566]: I0730 14:02:50.913233    2566 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-e945a1-7dd46465c9-ck9fr"]
Jul 30 14:02:50.913794 ip-10-0-143-153 kubenswrapper[2566]: I0730 14:02:50.913438    2566 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-e945a1-7dd46465c9-ck9fr" podUID="b767dcfe-a268-4dd8-94cb-9ae86d281bfd" containerName="maas-api" containerID="cri-o://bf59014cd59a73e36756f773c1149206ef92841a2cd5acbeabbfa8016afb2d67" gracePeriod=30
Jul 30 14:02:50.970636 ip-10-0-143-153 kubenswrapper[2566]: I0730 14:02:50.970599    2566 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-b-e945a1-5c9b5b596b-bzzsl"]
Jul 30 14:02:50.970903 ip-10-0-143-153 kubenswrapper[2566]: I0730 14:02:50.970855    2566 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-shared-b-e945a1-5c9b5b596b-bzzsl" podUID="dbc3def8-0b66-446b-bac2-241bdc436dd4" containerName="payload-processing" containerID="cri-o://92b461f180bb9f185afc3671b6cc2c1cbc21ab850a44b3ba5be6760f21da3df1" gracePeriod=30
Jul 30 14:02:50.985507 ip-10-0-143-153 kubenswrapper[2566]: I0730 14:02:50.985470    2566 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-b-e945a1-6c4d84789b-tbk85"]
Jul 30 14:02:50.985683 ip-10-0-143-153 kubenswrapper[2566]: I0730 14:02:50.985662    2566 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-e945a1-6c4d84789b-tbk85" podUID="c8762a24-6b2f-4202-a17a-b5c8fdfc09e9" containerName="payload-pre-processing" containerID="cri-o://ac9fd261380598372e6c8cc27193609b07c80c1dfdcc7d56630f5cb4a16360d3" gracePeriod=30
Jul 30 14:02:51.049032 ip-10-0-143-153 kubenswrapper[2566]: I0730 14:02:51.048991    2566 prober.go:120] "Probe failed" probeType="Readiness" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-e945a1-7dd46465c9-ck9fr" podUID="b767dcfe-a268-4dd8-94cb-9ae86d281bfd" containerName="maas-api" probeResult="failure" output="Get \"https://10.133.0.84:8443/health\": dial tcp 10.133.0.84:8443: connect: connection refused"
Jul 30 14:02:51.258598 ip-10-0-143-153 kubenswrapper[2566]: I0730 14:02:51.258574    2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-e945a1-7dd46465c9-ck9fr"
Jul 30 14:02:51.261681 ip-10-0-143-153 kubenswrapper[2566]: I0730 14:02:51.261656    2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-b-e945a1-5c9b5b596b-bzzsl"
Jul 30 14:02:51.298414 ip-10-0-143-153 kubenswrapper[2566]: I0730 14:02:51.298386    2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-e945a1-6c4d84789b-tbk85"
Jul 30 14:02:51.371930 ip-10-0-143-153 kubenswrapper[2566]: I0730 14:02:51.371898    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/b767dcfe-a268-4dd8-94cb-9ae86d281bfd-openshift-service-ca\") pod \"b767dcfe-a268-4dd8-94cb-9ae86d281bfd\" (UID: \"b767dcfe-a268-4dd8-94cb-9ae86d281bfd\") "
Jul 30 14:02:51.372117 ip-10-0-143-153 kubenswrapper[2566]: I0730 14:02:51.371944    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/dbc3def8-0b66-446b-bac2-241bdc436dd4-plugins-config-volume\") pod \"dbc3def8-0b66-446b-bac2-241bdc436dd4\" (UID: \"dbc3def8-0b66-446b-bac2-241bdc436dd4\") "
Jul 30 14:02:51.372117 ip-10-0-143-153 kubenswrapper[2566]: I0730 14:02:51.371965    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-gwp85\" (UniqueName: \"kubernetes.io/projected/b767dcfe-a268-4dd8-94cb-9ae86d281bfd-kube-api-access-gwp85\") pod \"b767dcfe-a268-4dd8-94cb-9ae86d281bfd\" (UID: \"b767dcfe-a268-4dd8-94cb-9ae86d281bfd\") "
Jul 30 14:02:51.372117 ip-10-0-143-153 kubenswrapper[2566]: I0730 14:02:51.371996    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/b767dcfe-a268-4dd8-94cb-9ae86d281bfd-maas-api-tls\") pod \"b767dcfe-a268-4dd8-94cb-9ae86d281bfd\" (UID: \"b767dcfe-a268-4dd8-94cb-9ae86d281bfd\") "
Jul 30 14:02:51.372117 ip-10-0-143-153 kubenswrapper[2566]: I0730 14:02:51.372055    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-vpwk8\" (UniqueName: \"kubernetes.io/projected/c8762a24-6b2f-4202-a17a-b5c8fdfc09e9-kube-api-access-vpwk8\") pod \"c8762a24-6b2f-4202-a17a-b5c8fdfc09e9\" (UID: \"c8762a24-6b2f-4202-a17a-b5c8fdfc09e9\") "
Jul 30 14:02:51.372117 ip-10-0-143-153 kubenswrapper[2566]: I0730 14:02:51.372097    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/c8762a24-6b2f-4202-a17a-b5c8fdfc09e9-plugins-config-volume\") pod \"c8762a24-6b2f-4202-a17a-b5c8fdfc09e9\" (UID: \"c8762a24-6b2f-4202-a17a-b5c8fdfc09e9\") "
Jul 30 14:02:51.372531 ip-10-0-143-153 kubenswrapper[2566]: I0730 14:02:51.372130    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-fvknm\" (UniqueName: \"kubernetes.io/projected/dbc3def8-0b66-446b-bac2-241bdc436dd4-kube-api-access-fvknm\") pod \"dbc3def8-0b66-446b-bac2-241bdc436dd4\" (UID: \"dbc3def8-0b66-446b-bac2-241bdc436dd4\") "
Jul 30 14:02:51.372531 ip-10-0-143-153 kubenswrapper[2566]: I0730 14:02:51.372321    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b767dcfe-a268-4dd8-94cb-9ae86d281bfd-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "b767dcfe-a268-4dd8-94cb-9ae86d281bfd" (UID: "b767dcfe-a268-4dd8-94cb-9ae86d281bfd"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 30 14:02:51.372531 ip-10-0-143-153 kubenswrapper[2566]: I0730 14:02:51.372395    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/dbc3def8-0b66-446b-bac2-241bdc436dd4-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "dbc3def8-0b66-446b-bac2-241bdc436dd4" (UID: "dbc3def8-0b66-446b-bac2-241bdc436dd4"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 30 14:02:51.372662 ip-10-0-143-153 kubenswrapper[2566]: I0730 14:02:51.372524    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c8762a24-6b2f-4202-a17a-b5c8fdfc09e9-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "c8762a24-6b2f-4202-a17a-b5c8fdfc09e9" (UID: "c8762a24-6b2f-4202-a17a-b5c8fdfc09e9"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 30 14:02:51.374650 ip-10-0-143-153 kubenswrapper[2566]: I0730 14:02:51.374625    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c8762a24-6b2f-4202-a17a-b5c8fdfc09e9-kube-api-access-vpwk8" (OuterVolumeSpecName: "kube-api-access-vpwk8") pod "c8762a24-6b2f-4202-a17a-b5c8fdfc09e9" (UID: "c8762a24-6b2f-4202-a17a-b5c8fdfc09e9"). InnerVolumeSpecName "kube-api-access-vpwk8". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 30 14:02:51.374650 ip-10-0-143-153 kubenswrapper[2566]: I0730 14:02:51.374637    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/dbc3def8-0b66-446b-bac2-241bdc436dd4-kube-api-access-fvknm" (OuterVolumeSpecName: "kube-api-access-fvknm") pod "dbc3def8-0b66-446b-bac2-241bdc436dd4" (UID: "dbc3def8-0b66-446b-bac2-241bdc436dd4"). InnerVolumeSpecName "kube-api-access-fvknm". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 30 14:02:51.374782 ip-10-0-143-153 kubenswrapper[2566]: I0730 14:02:51.374741    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b767dcfe-a268-4dd8-94cb-9ae86d281bfd-kube-api-access-gwp85" (OuterVolumeSpecName: "kube-api-access-gwp85") pod "b767dcfe-a268-4dd8-94cb-9ae86d281bfd" (UID: "b767dcfe-a268-4dd8-94cb-9ae86d281bfd"). InnerVolumeSpecName "kube-api-access-gwp85". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 30 14:02:51.374782 ip-10-0-143-153 kubenswrapper[2566]: I0730 14:02:51.374748    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b767dcfe-a268-4dd8-94cb-9ae86d281bfd-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "b767dcfe-a268-4dd8-94cb-9ae86d281bfd" (UID: "b767dcfe-a268-4dd8-94cb-9ae86d281bfd"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 30 14:02:51.473041 ip-10-0-143-153 kubenswrapper[2566]: I0730 14:02:51.472942    2566 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-vpwk8\" (UniqueName: \"kubernetes.io/projected/c8762a24-6b2f-4202-a17a-b5c8fdfc09e9-kube-api-access-vpwk8\") on node \"ip-10-0-143-153.ec2.internal\" DevicePath \"\""
Jul 30 14:02:51.473041 ip-10-0-143-153 kubenswrapper[2566]: I0730 14:02:51.472982    2566 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/c8762a24-6b2f-4202-a17a-b5c8fdfc09e9-plugins-config-volume\") on node \"ip-10-0-143-153.ec2.internal\" DevicePath \"\""
Jul 30 14:02:51.473041 ip-10-0-143-153 kubenswrapper[2566]: I0730 14:02:51.472992    2566 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-fvknm\" (UniqueName: \"kubernetes.io/projected/dbc3def8-0b66-446b-bac2-241bdc436dd4-kube-api-access-fvknm\") on node \"ip-10-0-143-153.ec2.internal\" DevicePath \"\""
Jul 30 14:02:51.473041 ip-10-0-143-153 kubenswrapper[2566]: I0730 14:02:51.473000    2566 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/b767dcfe-a268-4dd8-94cb-9ae86d281bfd-openshift-service-ca\") on node \"ip-10-0-143-153.ec2.internal\" DevicePath \"\""
Jul 30 14:02:51.473041 ip-10-0-143-153 kubenswrapper[2566]: I0730 14:02:51.473009    2566 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/dbc3def8-0b66-446b-bac2-241bdc436dd4-plugins-config-volume\") on node \"ip-10-0-143-153.ec2.internal\" DevicePath \"\""
Jul 30 14:02:51.473041 ip-10-0-143-153 kubenswrapper[2566]: I0730 14:02:51.473017    2566 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-gwp85\" (UniqueName: \"kubernetes.io/projected/b767dcfe-a268-4dd8-94cb-9ae86d281bfd-kube-api-access-gwp85\") on node \"ip-10-0-143-153.ec2.internal\" DevicePath \"\""
Jul 30 14:02:51.473041 ip-10-0-143-153 kubenswrapper[2566]: I0730 14:02:51.473025    2566 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/b767dcfe-a268-4dd8-94cb-9ae86d281bfd-maas-api-tls\") on node \"ip-10-0-143-153.ec2.internal\" DevicePath \"\""
Jul 30 14:02:51.888234 ip-10-0-143-153 kubenswrapper[2566]: I0730 14:02:51.888204    2566 generic.go:356] "Generic (PLEG): container finished" podID="dbc3def8-0b66-446b-bac2-241bdc436dd4" containerID="92b461f180bb9f185afc3671b6cc2c1cbc21ab850a44b3ba5be6760f21da3df1" exitCode=0
Jul 30 14:02:51.888414 ip-10-0-143-153 kubenswrapper[2566]: I0730 14:02:51.888278    2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-b-e945a1-5c9b5b596b-bzzsl"
Jul 30 14:02:51.888414 ip-10-0-143-153 kubenswrapper[2566]: I0730 14:02:51.888279    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-b-e945a1-5c9b5b596b-bzzsl" event={"ID":"dbc3def8-0b66-446b-bac2-241bdc436dd4","Type":"ContainerDied","Data":"92b461f180bb9f185afc3671b6cc2c1cbc21ab850a44b3ba5be6760f21da3df1"}
Jul 30 14:02:51.888414 ip-10-0-143-153 kubenswrapper[2566]: I0730 14:02:51.888404    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-b-e945a1-5c9b5b596b-bzzsl" event={"ID":"dbc3def8-0b66-446b-bac2-241bdc436dd4","Type":"ContainerDied","Data":"d0958a5672eb7db1baee4586fbb06ce6916344f7c0b9d232d250ea291901f4b1"}
Jul 30 14:02:51.888569 ip-10-0-143-153 kubenswrapper[2566]: I0730 14:02:51.888437    2566 scope.go:117] "RemoveContainer" containerID="92b461f180bb9f185afc3671b6cc2c1cbc21ab850a44b3ba5be6760f21da3df1"
Jul 30 14:02:51.889771 ip-10-0-143-153 kubenswrapper[2566]: I0730 14:02:51.889632    2566 generic.go:356] "Generic (PLEG): container finished" podID="c8762a24-6b2f-4202-a17a-b5c8fdfc09e9" containerID="ac9fd261380598372e6c8cc27193609b07c80c1dfdcc7d56630f5cb4a16360d3" exitCode=0
Jul 30 14:02:51.889771 ip-10-0-143-153 kubenswrapper[2566]: I0730 14:02:51.889698    2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-e945a1-6c4d84789b-tbk85"
Jul 30 14:02:51.889771 ip-10-0-143-153 kubenswrapper[2566]: I0730 14:02:51.889722    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-e945a1-6c4d84789b-tbk85" event={"ID":"c8762a24-6b2f-4202-a17a-b5c8fdfc09e9","Type":"ContainerDied","Data":"ac9fd261380598372e6c8cc27193609b07c80c1dfdcc7d56630f5cb4a16360d3"}
Jul 30 14:02:51.889970 ip-10-0-143-153 kubenswrapper[2566]: I0730 14:02:51.889787    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-e945a1-6c4d84789b-tbk85" event={"ID":"c8762a24-6b2f-4202-a17a-b5c8fdfc09e9","Type":"ContainerDied","Data":"17f3015f019c62cd394c2e198546df1adf690ee3167a95ab7e0edaf6f0410202"}
Jul 30 14:02:51.891476 ip-10-0-143-153 kubenswrapper[2566]: I0730 14:02:51.891452    2566 generic.go:356] "Generic (PLEG): container finished" podID="b767dcfe-a268-4dd8-94cb-9ae86d281bfd" containerID="bf59014cd59a73e36756f773c1149206ef92841a2cd5acbeabbfa8016afb2d67" exitCode=0
Jul 30 14:02:51.891624 ip-10-0-143-153 kubenswrapper[2566]: I0730 14:02:51.891502    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-e945a1-7dd46465c9-ck9fr" event={"ID":"b767dcfe-a268-4dd8-94cb-9ae86d281bfd","Type":"ContainerDied","Data":"bf59014cd59a73e36756f773c1149206ef92841a2cd5acbeabbfa8016afb2d67"}
Jul 30 14:02:51.891624 ip-10-0-143-153 kubenswrapper[2566]: I0730 14:02:51.891567    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-e945a1-7dd46465c9-ck9fr" event={"ID":"b767dcfe-a268-4dd8-94cb-9ae86d281bfd","Type":"ContainerDied","Data":"0c49ed4f642bbdff29549e622d11bf6aabbe5cd2a06c184a7f4e69ed347c0a13"}
Jul 30 14:02:51.891624 ip-10-0-143-153 kubenswrapper[2566]: I0730 14:02:51.891512    2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-e945a1-7dd46465c9-ck9fr"
Jul 30 14:02:51.898399 ip-10-0-143-153 kubenswrapper[2566]: I0730 14:02:51.898381    2566 scope.go:117] "RemoveContainer" containerID="92b461f180bb9f185afc3671b6cc2c1cbc21ab850a44b3ba5be6760f21da3df1"
Jul 30 14:02:51.898678 ip-10-0-143-153 kubenswrapper[2566]: E0730 14:02:51.898654    2566 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"92b461f180bb9f185afc3671b6cc2c1cbc21ab850a44b3ba5be6760f21da3df1\": container with ID starting with 92b461f180bb9f185afc3671b6cc2c1cbc21ab850a44b3ba5be6760f21da3df1 not found: ID does not exist" containerID="92b461f180bb9f185afc3671b6cc2c1cbc21ab850a44b3ba5be6760f21da3df1"
Jul 30 14:02:51.898759 ip-10-0-143-153 kubenswrapper[2566]: I0730 14:02:51.898711    2566 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"92b461f180bb9f185afc3671b6cc2c1cbc21ab850a44b3ba5be6760f21da3df1"} err="failed to get container status \"92b461f180bb9f185afc3671b6cc2c1cbc21ab850a44b3ba5be6760f21da3df1\": rpc error: code = NotFound desc = could not find container \"92b461f180bb9f185afc3671b6cc2c1cbc21ab850a44b3ba5be6760f21da3df1\": container with ID starting with 92b461f180bb9f185afc3671b6cc2c1cbc21ab850a44b3ba5be6760f21da3df1 not found: ID does not exist"
Jul 30 14:02:51.898759 ip-10-0-143-153 kubenswrapper[2566]: I0730 14:02:51.898734    2566 scope.go:117] "RemoveContainer" containerID="ac9fd261380598372e6c8cc27193609b07c80c1dfdcc7d56630f5cb4a16360d3"
Jul 30 14:02:51.906736 ip-10-0-143-153 kubenswrapper[2566]: I0730 14:02:51.906715    2566 scope.go:117] "RemoveContainer" containerID="ac9fd261380598372e6c8cc27193609b07c80c1dfdcc7d56630f5cb4a16360d3"
Jul 30 14:02:51.906994 ip-10-0-143-153 kubenswrapper[2566]: E0730 14:02:51.906971    2566 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ac9fd261380598372e6c8cc27193609b07c80c1dfdcc7d56630f5cb4a16360d3\": container with ID starting with ac9fd261380598372e6c8cc27193609b07c80c1dfdcc7d56630f5cb4a16360d3 not found: ID does not exist" containerID="ac9fd261380598372e6c8cc27193609b07c80c1dfdcc7d56630f5cb4a16360d3"
Jul 30 14:02:51.907071 ip-10-0-143-153 kubenswrapper[2566]: I0730 14:02:51.906999    2566 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ac9fd261380598372e6c8cc27193609b07c80c1dfdcc7d56630f5cb4a16360d3"} err="failed to get container status \"ac9fd261380598372e6c8cc27193609b07c80c1dfdcc7d56630f5cb4a16360d3\": rpc error: code = NotFound desc = could not find container \"ac9fd261380598372e6c8cc27193609b07c80c1dfdcc7d56630f5cb4a16360d3\": container with ID starting with ac9fd261380598372e6c8cc27193609b07c80c1dfdcc7d56630f5cb4a16360d3 not found: ID does not exist"
Jul 30 14:02:51.907071 ip-10-0-143-153 kubenswrapper[2566]: I0730 14:02:51.907015    2566 scope.go:117] "RemoveContainer" containerID="bf59014cd59a73e36756f773c1149206ef92841a2cd5acbeabbfa8016afb2d67"
Jul 30 14:02:51.909713 ip-10-0-143-153 kubenswrapper[2566]: I0730 14:02:51.909691    2566 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-e945a1-7dd46465c9-ck9fr"]
Jul 30 14:02:51.913444 ip-10-0-143-153 kubenswrapper[2566]: I0730 14:02:51.913423    2566 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-e945a1-7dd46465c9-ck9fr"]
Jul 30 14:02:51.916053 ip-10-0-143-153 kubenswrapper[2566]: I0730 14:02:51.915923    2566 scope.go:117] "RemoveContainer" containerID="bf59014cd59a73e36756f773c1149206ef92841a2cd5acbeabbfa8016afb2d67"
Jul 30 14:02:51.916235 ip-10-0-143-153 kubenswrapper[2566]: E0730 14:02:51.916217    2566 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"bf59014cd59a73e36756f773c1149206ef92841a2cd5acbeabbfa8016afb2d67\": container with ID starting with bf59014cd59a73e36756f773c1149206ef92841a2cd5acbeabbfa8016afb2d67 not found: ID does not exist" containerID="bf59014cd59a73e36756f773c1149206ef92841a2cd5acbeabbfa8016afb2d67"
Jul 30 14:02:51.916283 ip-10-0-143-153 kubenswrapper[2566]: I0730 14:02:51.916242    2566 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"bf59014cd59a73e36756f773c1149206ef92841a2cd5acbeabbfa8016afb2d67"} err="failed to get container status \"bf59014cd59a73e36756f773c1149206ef92841a2cd5acbeabbfa8016afb2d67\": rpc error: code = NotFound desc = could not find container \"bf59014cd59a73e36756f773c1149206ef92841a2cd5acbeabbfa8016afb2d67\": container with ID starting with bf59014cd59a73e36756f773c1149206ef92841a2cd5acbeabbfa8016afb2d67 not found: ID does not exist"
Jul 30 14:02:51.921869 ip-10-0-143-153 kubenswrapper[2566]: I0730 14:02:51.921847    2566 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-b-e945a1-6c4d84789b-tbk85"]
Jul 30 14:02:51.925179 ip-10-0-143-153 kubenswrapper[2566]: I0730 14:02:51.925159    2566 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-b-e945a1-6c4d84789b-tbk85"]
Jul 30 14:02:51.936793 ip-10-0-143-153 kubenswrapper[2566]: I0730 14:02:51.936765    2566 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-b-e945a1-5c9b5b596b-bzzsl"]
Jul 30 14:02:51.940534 ip-10-0-143-153 kubenswrapper[2566]: I0730 14:02:51.940512    2566 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-b-e945a1-5c9b5b596b-bzzsl"]
Jul 30 14:02:53.627348 ip-10-0-143-153 kubenswrapper[2566]: I0730 14:02:53.627318    2566 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b767dcfe-a268-4dd8-94cb-9ae86d281bfd" path="/var/lib/kubelet/pods/b767dcfe-a268-4dd8-94cb-9ae86d281bfd/volumes"
Jul 30 14:02:53.627736 ip-10-0-143-153 kubenswrapper[2566]: I0730 14:02:53.627674    2566 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c8762a24-6b2f-4202-a17a-b5c8fdfc09e9" path="/var/lib/kubelet/pods/c8762a24-6b2f-4202-a17a-b5c8fdfc09e9/volumes"
Jul 30 14:02:53.627993 ip-10-0-143-153 kubenswrapper[2566]: I0730 14:02:53.627981    2566 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="dbc3def8-0b66-446b-bac2-241bdc436dd4" path="/var/lib/kubelet/pods/dbc3def8-0b66-446b-bac2-241bdc436dd4/volumes"
Jul 30 14:02:58.537948 ip-10-0-143-153 kubenswrapper[2566]: I0730 14:02:58.537905    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-6b7977fdcd-9g7f4_5b888ffe-b963-42a4-85f4-2b1080a78371/authorino/0.log"
Jul 30 14:03:05.264763 ip-10-0-143-153 kubenswrapper[2566]: I0730 14:03:05.264729    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kserve-controller-manager-d6f4b65b8-v6nkv_9a4345c8-f997-4e6e-a9d0-af2faaac547f/manager/0.log"
Jul 30 14:03:05.394033 ip-10-0-143-153 kubenswrapper[2566]: I0730 14:03:05.393999    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_llmisvc-controller-manager-777c6bd7d5-7hl55_323af4a0-6392-43b7-9b27-1454e4505327/manager/0.log"
Jul 30 14:03:05.651479 ip-10-0-143-153 kubenswrapper[2566]: I0730 14:03:05.651448    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_model-serving-api-54d89bd5fc-szgjq_bb3f0039-55d7-4311-957d-5c9932ea9e65/server/0.log"
Jul 30 14:03:05.776168 ip-10-0-143-153 kubenswrapper[2566]: I0730 14:03:05.776134    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_odh-model-controller-7998c67dc4-44z8n_4ab61f41-6eff-4806-968d-98a6d5573f4e/manager/0.log"
Jul 30 14:03:05.891256 ip-10-0-143-153 kubenswrapper[2566]: I0730 14:03:05.891227    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-6bd55cb6f4-fwjfw_d42add9d-4212-4ebe-a243-558fa6293154/copy-manifests/0.log"
Jul 30 14:03:05.898606 ip-10-0-143-153 kubenswrapper[2566]: I0730 14:03:05.898574    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-6bd55cb6f4-fwjfw_d42add9d-4212-4ebe-a243-558fa6293154/manager/0.log"
Jul 30 14:03:06.547482 ip-10-0-143-153 kubenswrapper[2566]: I0730 14:03:06.547449    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-574cd7886f-ffjb8_beb7f60a-f9d7-4885-ad1d-83fa9440a514/maas-api/0.log"
Jul 30 14:03:07.053916 ip-10-0-143-153 kubenswrapper[2566]: I0730 14:03:07.053887    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_postgres-69fb4594cf-zthfp_767dfad6-34a4-4af3-9603-f776a18fae0e/postgres/0.log"
Jul 30 14:03:08.475909 ip-10-0-143-153 kubenswrapper[2566]: I0730 14:03:08.475878    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-6b7977fdcd-9g7f4_5b888ffe-b963-42a4-85f4-2b1080a78371/authorino/0.log"
Jul 30 14:03:08.597941 ip-10-0-143-153 kubenswrapper[2566]: I0730 14:03:08.597896    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-75cc8d5cb7-v2zhh_a7a7c0f0-7a79-4b07-b1fa-0d3aabe682b7/manager/0.log"
Jul 30 14:03:08.719270 ip-10-0-143-153 kubenswrapper[2566]: I0730 14:03:08.719238    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-864dd78c4c-tv5wd_e7173845-0385-4dc6-9db0-5e68633c88a7/manager/0.log"
Jul 30 14:03:08.965439 ip-10-0-143-153 kubenswrapper[2566]: I0730 14:03:08.965401    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-catalog-hwrmt_9211d01a-c930-4bf8-8156-e83be9705acb/registry-server/0.log"
Jul 30 14:03:09.094401 ip-10-0-143-153 kubenswrapper[2566]: I0730 14:03:09.094367    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-controller-manager-86878c769f-hpvp8_12228031-211e-4518-bad3-3fe90cde4177/manager/0.log"
Jul 30 14:03:09.345645 ip-10-0-143-153 kubenswrapper[2566]: I0730 14:03:09.345553    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-859d7b78bd-psl2b_ccc93ea0-2545-4f0e-ac89-3b2a356522eb/manager/0.log"
Jul 30 14:03:09.971516 ip-10-0-143-153 kubenswrapper[2566]: I0730 14:03:09.971476    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-54d6c599cc-7s9mh_0238e0f1-c28e-45cc-a028-aa78c8a3e130/kube-auth-proxy/0.log"
Jul 30 14:03:10.365590 ip-10-0-143-153 kubenswrapper[2566]: I0730 14:03:10.365499    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-687dbb6cf6-6pdbs_a01576a6-192f-4614-b37f-3e14c28cdfb1/payload-pre-processing/0.log"
Jul 30 14:03:10.505744 ip-10-0-143-153 kubenswrapper[2566]: I0730 14:03:10.505691    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-5cc6cd444b-5tgls_9d35b27b-86d0-47b9-b35b-03725cef3b51/payload-processing/0.log"
Jul 30 14:03:11.009948 ip-10-0-143-153 kubenswrapper[2566]: I0730 14:03:11.009919    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-2-simulated-kserve-67d8d5d6d-q2n28_6e3da121-3497-4ac9-8b9e-f29aec4ea5bc/main/0.log"
Jul 30 14:03:11.261014 ip-10-0-143-153 kubenswrapper[2566]: I0730 14:03:11.260928    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-trlp-test-simulated-kserve-598466548d-dw9sg_29d044c4-90f4-452e-a379-7af25f225621/main/0.log"
Jul 30 14:03:11.635208 ip-10-0-143-153 kubenswrapper[2566]: I0730 14:03:11.635179    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_premium-simulated-simulated-premium-kserve-57fc66f697-8lqd6_50382248-94a7-4fe8-95a3-458bd04a921a/main/0.log"
Jul 30 14:03:21.074827 ip-10-0-143-153 kubenswrapper[2566]: I0730 14:03:21.074773    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-9bp7v_c2428457-ecf0-45c5-b008-7a51403785c9/global-pull-secret-syncer/0.log"
Jul 30 14:03:21.294160 ip-10-0-143-153 kubenswrapper[2566]: I0730 14:03:21.294125    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-qt2mr_9c33f673-8361-433b-847f-081d6d4b2753/konnectivity-agent/0.log"
Jul 30 14:03:21.340703 ip-10-0-143-153 kubenswrapper[2566]: I0730 14:03:21.340626    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-143-153.ec2.internal_3327a5e598b8ce026a5b536fdb99458b/haproxy/0.log"
Jul 30 14:03:27.243273 ip-10-0-143-153 kubenswrapper[2566]: I0730 14:03:27.243238    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-6b7977fdcd-9g7f4_5b888ffe-b963-42a4-85f4-2b1080a78371/authorino/0.log"
Jul 30 14:03:27.273361 ip-10-0-143-153 kubenswrapper[2566]: I0730 14:03:27.273330    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-75cc8d5cb7-v2zhh_a7a7c0f0-7a79-4b07-b1fa-0d3aabe682b7/manager/0.log"
Jul 30 14:03:27.294883 ip-10-0-143-153 kubenswrapper[2566]: I0730 14:03:27.294859    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-864dd78c4c-tv5wd_e7173845-0385-4dc6-9db0-5e68633c88a7/manager/0.log"
Jul 30 14:03:27.380748 ip-10-0-143-153 kubenswrapper[2566]: I0730 14:03:27.380714    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-catalog-hwrmt_9211d01a-c930-4bf8-8156-e83be9705acb/registry-server/0.log"
Jul 30 14:03:27.517164 ip-10-0-143-153 kubenswrapper[2566]: I0730 14:03:27.517054    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-controller-manager-86878c769f-hpvp8_12228031-211e-4518-bad3-3fe90cde4177/manager/0.log"
Jul 30 14:03:27.664715 ip-10-0-143-153 kubenswrapper[2566]: I0730 14:03:27.664673    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-859d7b78bd-psl2b_ccc93ea0-2545-4f0e-ac89-3b2a356522eb/manager/0.log"
Jul 30 14:03:29.469779 ip-10-0-143-153 kubenswrapper[2566]: I0730 14:03:29.469743    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_cluster-monitoring-operator-548b489cb8-v6zgd_a9cdd07c-66cd-4d85-bc84-b2a318f1b705/cluster-monitoring-operator/0.log"
Jul 30 14:03:29.679573 ip-10-0-143-153 kubenswrapper[2566]: I0730 14:03:29.679536    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-sj92n_de54e463-261a-4ad2-9c3b-fcd6b8ae9d8f/node-exporter/0.log"
Jul 30 14:03:29.693947 ip-10-0-143-153 kubenswrapper[2566]: I0730 14:03:29.693923    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-sj92n_de54e463-261a-4ad2-9c3b-fcd6b8ae9d8f/kube-rbac-proxy/0.log"
Jul 30 14:03:29.711300 ip-10-0-143-153 kubenswrapper[2566]: I0730 14:03:29.711281    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-sj92n_de54e463-261a-4ad2-9c3b-fcd6b8ae9d8f/init-textfile/0.log"
Jul 30 14:03:31.075721 ip-10-0-143-153 kubenswrapper[2566]: I0730 14:03:31.075686    2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-nd8l9/perf-node-gather-daemonset-nmswl"]
Jul 30 14:03:31.076132 ip-10-0-143-153 kubenswrapper[2566]: I0730 14:03:31.076045    2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="dbc3def8-0b66-446b-bac2-241bdc436dd4" containerName="payload-processing"
Jul 30 14:03:31.076132 ip-10-0-143-153 kubenswrapper[2566]: I0730 14:03:31.076056    2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="dbc3def8-0b66-446b-bac2-241bdc436dd4" containerName="payload-processing"
Jul 30 14:03:31.076132 ip-10-0-143-153 kubenswrapper[2566]: I0730 14:03:31.076068    2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c8762a24-6b2f-4202-a17a-b5c8fdfc09e9" containerName="payload-pre-processing"
Jul 30 14:03:31.076132 ip-10-0-143-153 kubenswrapper[2566]: I0730 14:03:31.076087    2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="c8762a24-6b2f-4202-a17a-b5c8fdfc09e9" containerName="payload-pre-processing"
Jul 30 14:03:31.076132 ip-10-0-143-153 kubenswrapper[2566]: I0730 14:03:31.076093    2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d07273f6-e306-4c3d-b36f-0606b9634a53" containerName="payload-processing"
Jul 30 14:03:31.076132 ip-10-0-143-153 kubenswrapper[2566]: I0730 14:03:31.076100    2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="d07273f6-e306-4c3d-b36f-0606b9634a53" containerName="payload-processing"
Jul 30 14:03:31.076132 ip-10-0-143-153 kubenswrapper[2566]: I0730 14:03:31.076109    2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="abcfa942-4318-457b-a9a5-7593cdb437f1" containerName="payload-pre-processing"
Jul 30 14:03:31.076132 ip-10-0-143-153 kubenswrapper[2566]: I0730 14:03:31.076114    2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="abcfa942-4318-457b-a9a5-7593cdb437f1" containerName="payload-pre-processing"
Jul 30 14:03:31.076132 ip-10-0-143-153 kubenswrapper[2566]: I0730 14:03:31.076123    2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0d250aef-7d08-4ea4-9bc6-7aa90acd9a88" containerName="payload-processing"
Jul 30 14:03:31.076132 ip-10-0-143-153 kubenswrapper[2566]: I0730 14:03:31.076128    2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="0d250aef-7d08-4ea4-9bc6-7aa90acd9a88" containerName="payload-processing"
Jul 30 14:03:31.076132 ip-10-0-143-153 kubenswrapper[2566]: I0730 14:03:31.076134    2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5951831b-2a96-46fc-bedd-65ceaf7f8a66" containerName="payload-pre-processing"
Jul 30 14:03:31.076132 ip-10-0-143-153 kubenswrapper[2566]: I0730 14:03:31.076139    2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="5951831b-2a96-46fc-bedd-65ceaf7f8a66" containerName="payload-pre-processing"
Jul 30 14:03:31.076512 ip-10-0-143-153 kubenswrapper[2566]: I0730 14:03:31.076146    2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2abd4aca-be43-475e-83b4-0901962e1c51" containerName="payload-pre-processing"
Jul 30 14:03:31.076512 ip-10-0-143-153 kubenswrapper[2566]: I0730 14:03:31.076151    2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="2abd4aca-be43-475e-83b4-0901962e1c51" containerName="payload-pre-processing"
Jul 30 14:03:31.076512 ip-10-0-143-153 kubenswrapper[2566]: I0730 14:03:31.076158    2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b767dcfe-a268-4dd8-94cb-9ae86d281bfd" containerName="maas-api"
Jul 30 14:03:31.076512 ip-10-0-143-153 kubenswrapper[2566]: I0730 14:03:31.076163    2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="b767dcfe-a268-4dd8-94cb-9ae86d281bfd" containerName="maas-api"
Jul 30 14:03:31.076512 ip-10-0-143-153 kubenswrapper[2566]: I0730 14:03:31.076170    2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e7b30cc1-c765-49b7-80ca-bbe7755911df" containerName="payload-processing"
Jul 30 14:03:31.076512 ip-10-0-143-153 kubenswrapper[2566]: I0730 14:03:31.076177    2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="e7b30cc1-c765-49b7-80ca-bbe7755911df" containerName="payload-processing"
Jul 30 14:03:31.076512 ip-10-0-143-153 kubenswrapper[2566]: I0730 14:03:31.076187    2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="881c595b-3957-45ae-9da4-f6655fd4c779" containerName="payload-pre-processing"
Jul 30 14:03:31.076512 ip-10-0-143-153 kubenswrapper[2566]: I0730 14:03:31.076193    2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="881c595b-3957-45ae-9da4-f6655fd4c779" containerName="payload-pre-processing"
Jul 30 14:03:31.076512 ip-10-0-143-153 kubenswrapper[2566]: I0730 14:03:31.076198    2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="fa61b3e5-e315-4b83-8252-f76b5987c5c3" containerName="payload-processing"
Jul 30 14:03:31.076512 ip-10-0-143-153 kubenswrapper[2566]: I0730 14:03:31.076203    2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="fa61b3e5-e315-4b83-8252-f76b5987c5c3" containerName="payload-processing"
Jul 30 14:03:31.076512 ip-10-0-143-153 kubenswrapper[2566]: I0730 14:03:31.076262    2566 memory_manager.go:368] "RemoveStaleState removing state" podUID="881c595b-3957-45ae-9da4-f6655fd4c779" containerName="payload-pre-processing"
Jul 30 14:03:31.076512 ip-10-0-143-153 kubenswrapper[2566]: I0730 14:03:31.076270    2566 memory_manager.go:368] "RemoveStaleState removing state" podUID="b767dcfe-a268-4dd8-94cb-9ae86d281bfd" containerName="maas-api"
Jul 30 14:03:31.076512 ip-10-0-143-153 kubenswrapper[2566]: I0730 14:03:31.076278    2566 memory_manager.go:368] "RemoveStaleState removing state" podUID="e7b30cc1-c765-49b7-80ca-bbe7755911df" containerName="payload-processing"
Jul 30 14:03:31.076512 ip-10-0-143-153 kubenswrapper[2566]: I0730 14:03:31.076284    2566 memory_manager.go:368] "RemoveStaleState removing state" podUID="2abd4aca-be43-475e-83b4-0901962e1c51" containerName="payload-pre-processing"
Jul 30 14:03:31.076512 ip-10-0-143-153 kubenswrapper[2566]: I0730 14:03:31.076290    2566 memory_manager.go:368] "RemoveStaleState removing state" podUID="c8762a24-6b2f-4202-a17a-b5c8fdfc09e9" containerName="payload-pre-processing"
Jul 30 14:03:31.076512 ip-10-0-143-153 kubenswrapper[2566]: I0730 14:03:31.076296    2566 memory_manager.go:368] "RemoveStaleState removing state" podUID="d07273f6-e306-4c3d-b36f-0606b9634a53" containerName="payload-processing"
Jul 30 14:03:31.076512 ip-10-0-143-153 kubenswrapper[2566]: I0730 14:03:31.076303    2566 memory_manager.go:368] "RemoveStaleState removing state" podUID="dbc3def8-0b66-446b-bac2-241bdc436dd4" containerName="payload-processing"
Jul 30 14:03:31.076512 ip-10-0-143-153 kubenswrapper[2566]: I0730 14:03:31.076309    2566 memory_manager.go:368] "RemoveStaleState removing state" podUID="0d250aef-7d08-4ea4-9bc6-7aa90acd9a88" containerName="payload-processing"
Jul 30 14:03:31.076512 ip-10-0-143-153 kubenswrapper[2566]: I0730 14:03:31.076314    2566 memory_manager.go:368] "RemoveStaleState removing state" podUID="abcfa942-4318-457b-a9a5-7593cdb437f1" containerName="payload-pre-processing"
Jul 30 14:03:31.076512 ip-10-0-143-153 kubenswrapper[2566]: I0730 14:03:31.076319    2566 memory_manager.go:368] "RemoveStaleState removing state" podUID="fa61b3e5-e315-4b83-8252-f76b5987c5c3" containerName="payload-processing"
Jul 30 14:03:31.076512 ip-10-0-143-153 kubenswrapper[2566]: I0730 14:03:31.076325    2566 memory_manager.go:368] "RemoveStaleState removing state" podUID="5951831b-2a96-46fc-bedd-65ceaf7f8a66" containerName="payload-pre-processing"
Jul 30 14:03:31.079583 ip-10-0-143-153 kubenswrapper[2566]: I0730 14:03:31.079560    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-nd8l9/perf-node-gather-daemonset-nmswl"
Jul 30 14:03:31.081367 ip-10-0-143-153 kubenswrapper[2566]: I0730 14:03:31.081347    2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-nd8l9\"/\"openshift-service-ca.crt\""
Jul 30 14:03:31.081473 ip-10-0-143-153 kubenswrapper[2566]: I0730 14:03:31.081387    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-nd8l9\"/\"default-dockercfg-fnqxp\""
Jul 30 14:03:31.081696 ip-10-0-143-153 kubenswrapper[2566]: I0730 14:03:31.081680    2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-nd8l9\"/\"kube-root-ca.crt\""
Jul 30 14:03:31.086937 ip-10-0-143-153 kubenswrapper[2566]: I0730 14:03:31.086918    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-nd8l9/perf-node-gather-daemonset-nmswl"]
Jul 30 14:03:31.216350 ip-10-0-143-153 kubenswrapper[2566]: I0730 14:03:31.216314    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/c68428ff-91e7-4c4d-9ed6-d79959b002f1-lib-modules\") pod \"perf-node-gather-daemonset-nmswl\" (UID: \"c68428ff-91e7-4c4d-9ed6-d79959b002f1\") " pod="openshift-must-gather-nd8l9/perf-node-gather-daemonset-nmswl"
Jul 30 14:03:31.216517 ip-10-0-143-153 kubenswrapper[2566]: I0730 14:03:31.216359    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/c68428ff-91e7-4c4d-9ed6-d79959b002f1-sys\") pod \"perf-node-gather-daemonset-nmswl\" (UID: \"c68428ff-91e7-4c4d-9ed6-d79959b002f1\") " pod="openshift-must-gather-nd8l9/perf-node-gather-daemonset-nmswl"
Jul 30 14:03:31.216517 ip-10-0-143-153 kubenswrapper[2566]: I0730 14:03:31.216378    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9rqxf\" (UniqueName: \"kubernetes.io/projected/c68428ff-91e7-4c4d-9ed6-d79959b002f1-kube-api-access-9rqxf\") pod \"perf-node-gather-daemonset-nmswl\" (UID: \"c68428ff-91e7-4c4d-9ed6-d79959b002f1\") " pod="openshift-must-gather-nd8l9/perf-node-gather-daemonset-nmswl"
Jul 30 14:03:31.216598 ip-10-0-143-153 kubenswrapper[2566]: I0730 14:03:31.216514    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/c68428ff-91e7-4c4d-9ed6-d79959b002f1-podres\") pod \"perf-node-gather-daemonset-nmswl\" (UID: \"c68428ff-91e7-4c4d-9ed6-d79959b002f1\") " pod="openshift-must-gather-nd8l9/perf-node-gather-daemonset-nmswl"
Jul 30 14:03:31.216598 ip-10-0-143-153 kubenswrapper[2566]: I0730 14:03:31.216545    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/c68428ff-91e7-4c4d-9ed6-d79959b002f1-proc\") pod \"perf-node-gather-daemonset-nmswl\" (UID: \"c68428ff-91e7-4c4d-9ed6-d79959b002f1\") " pod="openshift-must-gather-nd8l9/perf-node-gather-daemonset-nmswl"
Jul 30 14:03:31.317213 ip-10-0-143-153 kubenswrapper[2566]: I0730 14:03:31.317179    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/c68428ff-91e7-4c4d-9ed6-d79959b002f1-sys\") pod \"perf-node-gather-daemonset-nmswl\" (UID: \"c68428ff-91e7-4c4d-9ed6-d79959b002f1\") " pod="openshift-must-gather-nd8l9/perf-node-gather-daemonset-nmswl"
Jul 30 14:03:31.317213 ip-10-0-143-153 kubenswrapper[2566]: I0730 14:03:31.317218    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9rqxf\" (UniqueName: \"kubernetes.io/projected/c68428ff-91e7-4c4d-9ed6-d79959b002f1-kube-api-access-9rqxf\") pod \"perf-node-gather-daemonset-nmswl\" (UID: \"c68428ff-91e7-4c4d-9ed6-d79959b002f1\") " pod="openshift-must-gather-nd8l9/perf-node-gather-daemonset-nmswl"
Jul 30 14:03:31.317423 ip-10-0-143-153 kubenswrapper[2566]: I0730 14:03:31.317308    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/c68428ff-91e7-4c4d-9ed6-d79959b002f1-sys\") pod \"perf-node-gather-daemonset-nmswl\" (UID: \"c68428ff-91e7-4c4d-9ed6-d79959b002f1\") " pod="openshift-must-gather-nd8l9/perf-node-gather-daemonset-nmswl"
Jul 30 14:03:31.317423 ip-10-0-143-153 kubenswrapper[2566]: I0730 14:03:31.317316    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/c68428ff-91e7-4c4d-9ed6-d79959b002f1-podres\") pod \"perf-node-gather-daemonset-nmswl\" (UID: \"c68428ff-91e7-4c4d-9ed6-d79959b002f1\") " pod="openshift-must-gather-nd8l9/perf-node-gather-daemonset-nmswl"
Jul 30 14:03:31.317423 ip-10-0-143-153 kubenswrapper[2566]: I0730 14:03:31.317348    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/c68428ff-91e7-4c4d-9ed6-d79959b002f1-proc\") pod \"perf-node-gather-daemonset-nmswl\" (UID: \"c68428ff-91e7-4c4d-9ed6-d79959b002f1\") " pod="openshift-must-gather-nd8l9/perf-node-gather-daemonset-nmswl"
Jul 30 14:03:31.317423 ip-10-0-143-153 kubenswrapper[2566]: I0730 14:03:31.317380    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/c68428ff-91e7-4c4d-9ed6-d79959b002f1-lib-modules\") pod \"perf-node-gather-daemonset-nmswl\" (UID: \"c68428ff-91e7-4c4d-9ed6-d79959b002f1\") " pod="openshift-must-gather-nd8l9/perf-node-gather-daemonset-nmswl"
Jul 30 14:03:31.317423 ip-10-0-143-153 kubenswrapper[2566]: I0730 14:03:31.317416    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/c68428ff-91e7-4c4d-9ed6-d79959b002f1-podres\") pod \"perf-node-gather-daemonset-nmswl\" (UID: \"c68428ff-91e7-4c4d-9ed6-d79959b002f1\") " pod="openshift-must-gather-nd8l9/perf-node-gather-daemonset-nmswl"
Jul 30 14:03:31.317590 ip-10-0-143-153 kubenswrapper[2566]: I0730 14:03:31.317466    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/c68428ff-91e7-4c4d-9ed6-d79959b002f1-proc\") pod \"perf-node-gather-daemonset-nmswl\" (UID: \"c68428ff-91e7-4c4d-9ed6-d79959b002f1\") " pod="openshift-must-gather-nd8l9/perf-node-gather-daemonset-nmswl"
Jul 30 14:03:31.317590 ip-10-0-143-153 kubenswrapper[2566]: I0730 14:03:31.317552    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/c68428ff-91e7-4c4d-9ed6-d79959b002f1-lib-modules\") pod \"perf-node-gather-daemonset-nmswl\" (UID: \"c68428ff-91e7-4c4d-9ed6-d79959b002f1\") " pod="openshift-must-gather-nd8l9/perf-node-gather-daemonset-nmswl"
Jul 30 14:03:31.324513 ip-10-0-143-153 kubenswrapper[2566]: I0730 14:03:31.324490    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9rqxf\" (UniqueName: \"kubernetes.io/projected/c68428ff-91e7-4c4d-9ed6-d79959b002f1-kube-api-access-9rqxf\") pod \"perf-node-gather-daemonset-nmswl\" (UID: \"c68428ff-91e7-4c4d-9ed6-d79959b002f1\") " pod="openshift-must-gather-nd8l9/perf-node-gather-daemonset-nmswl"
Jul 30 14:03:31.390297 ip-10-0-143-153 kubenswrapper[2566]: I0730 14:03:31.390275    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-nd8l9/perf-node-gather-daemonset-nmswl"
Jul 30 14:03:31.521480 ip-10-0-143-153 kubenswrapper[2566]: I0730 14:03:31.521452    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-nd8l9/perf-node-gather-daemonset-nmswl"]
Jul 30 14:03:31.524135 ip-10-0-143-153 kubenswrapper[2566]: W0730 14:03:31.524110    2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-podc68428ff_91e7_4c4d_9ed6_d79959b002f1.slice/crio-2f60e15db3565e8e105fe82e674177bf8ad39cb66683a4c486f5c1ee29401bde WatchSource:0}: Error finding container 2f60e15db3565e8e105fe82e674177bf8ad39cb66683a4c486f5c1ee29401bde: Status 404 returned error can't find the container with id 2f60e15db3565e8e105fe82e674177bf8ad39cb66683a4c486f5c1ee29401bde
Jul 30 14:03:31.965265 ip-10-0-143-153 kubenswrapper[2566]: I0730 14:03:31.965225    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-bzl6w_51cdacbf-3a14-47c0-8fd4-69b0b2be0e64/console-operator/1.log"
Jul 30 14:03:31.974729 ip-10-0-143-153 kubenswrapper[2566]: I0730 14:03:31.974702    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-bzl6w_51cdacbf-3a14-47c0-8fd4-69b0b2be0e64/console-operator/2.log"
Jul 30 14:03:32.106160 ip-10-0-143-153 kubenswrapper[2566]: I0730 14:03:32.106119    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-nd8l9/perf-node-gather-daemonset-nmswl" event={"ID":"c68428ff-91e7-4c4d-9ed6-d79959b002f1","Type":"ContainerStarted","Data":"429b1a2b86aaa021dc63055517df16b766f7714007b0aea4a73ed5e18dd955ae"}
Jul 30 14:03:32.106649 ip-10-0-143-153 kubenswrapper[2566]: I0730 14:03:32.106207    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-nd8l9/perf-node-gather-daemonset-nmswl" event={"ID":"c68428ff-91e7-4c4d-9ed6-d79959b002f1","Type":"ContainerStarted","Data":"2f60e15db3565e8e105fe82e674177bf8ad39cb66683a4c486f5c1ee29401bde"}
Jul 30 14:03:32.106649 ip-10-0-143-153 kubenswrapper[2566]: I0730 14:03:32.106425    2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-nd8l9/perf-node-gather-daemonset-nmswl"
Jul 30 14:03:32.121908 ip-10-0-143-153 kubenswrapper[2566]: I0730 14:03:32.121857    2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-nd8l9/perf-node-gather-daemonset-nmswl" podStartSLOduration=1.121840764 podStartE2EDuration="1.121840764s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-30 14:03:31 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 14:03:32.12069903 +0000 UTC m=+3841.049387292" watchObservedRunningTime="2026-07-30 14:03:32.121840764 +0000 UTC m=+3841.050529069"
Jul 30 14:03:32.138009 ip-10-0-143-153 kubenswrapper[2566]: I0730 14:03:32.137979    2566 scope.go:117] "RemoveContainer" containerID="bc5e1a90a429abd2bfa0c0acedb22048d59e8cf52fc926704deb52071d3d75c7"
Jul 30 14:03:32.148527 ip-10-0-143-153 kubenswrapper[2566]: I0730 14:03:32.148501    2566 scope.go:117] "RemoveContainer" containerID="e72b6744f48ee8d83c1c75ede4641e16b072702385ab620d107465fdf2e3def1"
Jul 30 14:03:34.114101 ip-10-0-143-153 kubenswrapper[2566]: I0730 14:03:34.114050    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-f9822_1a31bbf5-b584-424a-8866-8789661dc09a/dns/0.log"
Jul 30 14:03:34.130566 ip-10-0-143-153 kubenswrapper[2566]: I0730 14:03:34.130544    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-f9822_1a31bbf5-b584-424a-8866-8789661dc09a/kube-rbac-proxy/0.log"
Jul 30 14:03:34.150615 ip-10-0-143-153 kubenswrapper[2566]: I0730 14:03:34.150586    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-4tzjz_95057af8-5515-4bb3-9147-613240e101bb/dns-node-resolver/0.log"
Jul 30 14:03:34.795045 ip-10-0-143-153 kubenswrapper[2566]: I0730 14:03:34.795015    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-9lmmp_b6cb9164-228a-4fff-b909-8be034a2b11a/node-ca/0.log"
Jul 30 14:03:35.928151 ip-10-0-143-153 kubenswrapper[2566]: I0730 14:03:35.928119    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-54d6c599cc-7s9mh_0238e0f1-c28e-45cc-a028-aa78c8a3e130/kube-auth-proxy/0.log"
Jul 30 14:03:36.057316 ip-10-0-143-153 kubenswrapper[2566]: I0730 14:03:36.057281    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-687dbb6cf6-6pdbs_a01576a6-192f-4614-b37f-3e14c28cdfb1/payload-pre-processing/0.log"
Jul 30 14:03:36.095637 ip-10-0-143-153 kubenswrapper[2566]: I0730 14:03:36.095604    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-5cc6cd444b-5tgls_9d35b27b-86d0-47b9-b35b-03725cef3b51/payload-processing/0.log"
Jul 30 14:03:36.942775 ip-10-0-143-153 kubenswrapper[2566]: I0730 14:03:36.942741    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-mlzcq_44aa0a10-5c3a-4b62-bb19-92c5b8223440/serve-healthcheck-canary/0.log"
Jul 30 14:03:37.436676 ip-10-0-143-153 kubenswrapper[2566]: I0730 14:03:37.436650    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-44fp6_4d829197-e96c-4e01-9d4c-6008b6d40c84/kube-rbac-proxy/0.log"
Jul 30 14:03:37.452054 ip-10-0-143-153 kubenswrapper[2566]: I0730 14:03:37.452030    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-44fp6_4d829197-e96c-4e01-9d4c-6008b6d40c84/exporter/0.log"
Jul 30 14:03:37.469510 ip-10-0-143-153 kubenswrapper[2566]: I0730 14:03:37.469481    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-44fp6_4d829197-e96c-4e01-9d4c-6008b6d40c84/extractor/0.log"
Jul 30 14:03:38.121302 ip-10-0-143-153 kubenswrapper[2566]: I0730 14:03:38.121272    2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-nd8l9/perf-node-gather-daemonset-nmswl"
Jul 30 14:03:39.856743 ip-10-0-143-153 kubenswrapper[2566]: I0730 14:03:39.856711    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kserve-controller-manager-d6f4b65b8-v6nkv_9a4345c8-f997-4e6e-a9d0-af2faaac547f/manager/0.log"
Jul 30 14:03:40.251963 ip-10-0-143-153 kubenswrapper[2566]: I0730 14:03:40.251874    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_llmisvc-controller-manager-777c6bd7d5-7hl55_323af4a0-6392-43b7-9b27-1454e4505327/manager/0.log"
Jul 30 14:03:40.592328 ip-10-0-143-153 kubenswrapper[2566]: I0730 14:03:40.592241    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_model-serving-api-54d89bd5fc-szgjq_bb3f0039-55d7-4311-957d-5c9932ea9e65/server/0.log"
Jul 30 14:03:40.721408 ip-10-0-143-153 kubenswrapper[2566]: I0730 14:03:40.721376    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_odh-model-controller-7998c67dc4-44z8n_4ab61f41-6eff-4806-968d-98a6d5573f4e/manager/0.log"
Jul 30 14:03:40.745992 ip-10-0-143-153 kubenswrapper[2566]: I0730 14:03:40.745969    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-6bd55cb6f4-fwjfw_d42add9d-4212-4ebe-a243-558fa6293154/manager/0.log"
Jul 30 14:03:40.764024 ip-10-0-143-153 kubenswrapper[2566]: I0730 14:03:40.763997    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-6bd55cb6f4-fwjfw_d42add9d-4212-4ebe-a243-558fa6293154/copy-manifests/0.log"
Jul 30 14:03:41.685861 ip-10-0-143-153 kubenswrapper[2566]: I0730 14:03:41.685827    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-54d6c599cc-7s9mh_0238e0f1-c28e-45cc-a028-aa78c8a3e130/kube-auth-proxy/0.log"
Jul 30 14:03:41.779409 ip-10-0-143-153 kubenswrapper[2566]: I0730 14:03:41.779383    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-687dbb6cf6-6pdbs_a01576a6-192f-4614-b37f-3e14c28cdfb1/payload-pre-processing/0.log"
Jul 30 14:03:41.806707 ip-10-0-143-153 kubenswrapper[2566]: I0730 14:03:41.806671    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-5cc6cd444b-5tgls_9d35b27b-86d0-47b9-b35b-03725cef3b51/payload-processing/0.log"
Jul 30 14:03:42.278665 ip-10-0-143-153 kubenswrapper[2566]: I0730 14:03:42.278608    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_openshift-lws-operator-fd8ccff4c-9pscf_d5ca8fa5-a694-4b65-936a-2f8ba5628c55/openshift-lws-operator/0.log"
Jul 30 14:03:43.401965 ip-10-0-143-153 kubenswrapper[2566]: I0730 14:03:43.401939    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-54d6c599cc-7s9mh_0238e0f1-c28e-45cc-a028-aa78c8a3e130/kube-auth-proxy/0.log"
Jul 30 14:03:43.503611 ip-10-0-143-153 kubenswrapper[2566]: I0730 14:03:43.503562    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-687dbb6cf6-6pdbs_a01576a6-192f-4614-b37f-3e14c28cdfb1/payload-pre-processing/0.log"
Jul 30 14:03:43.540927 ip-10-0-143-153 kubenswrapper[2566]: I0730 14:03:43.540888    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-5cc6cd444b-5tgls_9d35b27b-86d0-47b9-b35b-03725cef3b51/payload-processing/0.log"
Jul 30 14:03:47.427410 ip-10-0-143-153 kubenswrapper[2566]: I0730 14:03:47.427379    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-6f4d6fb6bc-thklp_c566cf8d-48ce-43ae-9427-e5e43d8f2e2f/kube-storage-version-migrator-operator/1.log"
Jul 30 14:03:47.429384 ip-10-0-143-153 kubenswrapper[2566]: I0730 14:03:47.429356    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-6f4d6fb6bc-thklp_c566cf8d-48ce-43ae-9427-e5e43d8f2e2f/kube-storage-version-migrator-operator/0.log"