Jul 30 00:01:51.572863 ip-10-0-133-55 systemd[1]: Starting Kubernetes Kubelet...
Jul 30 00:01:51.916555 ip-10-0-133-55 kubenswrapper[2560]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 30 00:01:51.916555 ip-10-0-133-55 kubenswrapper[2560]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version.
Jul 30 00:01:51.916555 ip-10-0-133-55 kubenswrapper[2560]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 30 00:01:51.916555 ip-10-0-133-55 kubenswrapper[2560]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI.
Jul 30 00:01:51.916555 ip-10-0-133-55 kubenswrapper[2560]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 30 00:01:51.917385 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:01:51.917310    2560 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime"
Jul 30 00:01:51.923279 ip-10-0-133-55 kubenswrapper[2560]: W0730 00:01:51.923264    2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 30 00:01:51.923279 ip-10-0-133-55 kubenswrapper[2560]: W0730 00:01:51.923279    2560 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 30 00:01:51.923343 ip-10-0-133-55 kubenswrapper[2560]: W0730 00:01:51.923283    2560 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 30 00:01:51.923343 ip-10-0-133-55 kubenswrapper[2560]: W0730 00:01:51.923287    2560 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 30 00:01:51.923343 ip-10-0-133-55 kubenswrapper[2560]: W0730 00:01:51.923290    2560 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 30 00:01:51.923343 ip-10-0-133-55 kubenswrapper[2560]: W0730 00:01:51.923293    2560 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 30 00:01:51.923343 ip-10-0-133-55 kubenswrapper[2560]: W0730 00:01:51.923296    2560 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 30 00:01:51.923343 ip-10-0-133-55 kubenswrapper[2560]: W0730 00:01:51.923300    2560 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 30 00:01:51.923343 ip-10-0-133-55 kubenswrapper[2560]: W0730 00:01:51.923303    2560 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 30 00:01:51.923343 ip-10-0-133-55 kubenswrapper[2560]: W0730 00:01:51.923306    2560 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 30 00:01:51.923343 ip-10-0-133-55 kubenswrapper[2560]: W0730 00:01:51.923309    2560 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 30 00:01:51.923343 ip-10-0-133-55 kubenswrapper[2560]: W0730 00:01:51.923312    2560 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 30 00:01:51.923343 ip-10-0-133-55 kubenswrapper[2560]: W0730 00:01:51.923314    2560 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 30 00:01:51.923343 ip-10-0-133-55 kubenswrapper[2560]: W0730 00:01:51.923317    2560 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 30 00:01:51.923343 ip-10-0-133-55 kubenswrapper[2560]: W0730 00:01:51.923320    2560 feature_gate.go:328] unrecognized feature gate: Example2
Jul 30 00:01:51.923343 ip-10-0-133-55 kubenswrapper[2560]: W0730 00:01:51.923322    2560 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 30 00:01:51.923343 ip-10-0-133-55 kubenswrapper[2560]: W0730 00:01:51.923325    2560 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 30 00:01:51.923343 ip-10-0-133-55 kubenswrapper[2560]: W0730 00:01:51.923329    2560 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 30 00:01:51.923343 ip-10-0-133-55 kubenswrapper[2560]: W0730 00:01:51.923333    2560 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 30 00:01:51.923343 ip-10-0-133-55 kubenswrapper[2560]: W0730 00:01:51.923336    2560 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 30 00:01:51.923343 ip-10-0-133-55 kubenswrapper[2560]: W0730 00:01:51.923339    2560 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 30 00:01:51.923343 ip-10-0-133-55 kubenswrapper[2560]: W0730 00:01:51.923341    2560 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 30 00:01:51.923833 ip-10-0-133-55 kubenswrapper[2560]: W0730 00:01:51.923344    2560 feature_gate.go:328] unrecognized feature gate: Example
Jul 30 00:01:51.923833 ip-10-0-133-55 kubenswrapper[2560]: W0730 00:01:51.923347    2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 30 00:01:51.923833 ip-10-0-133-55 kubenswrapper[2560]: W0730 00:01:51.923350    2560 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 30 00:01:51.923833 ip-10-0-133-55 kubenswrapper[2560]: W0730 00:01:51.923352    2560 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 30 00:01:51.923833 ip-10-0-133-55 kubenswrapper[2560]: W0730 00:01:51.923355    2560 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 30 00:01:51.923833 ip-10-0-133-55 kubenswrapper[2560]: W0730 00:01:51.923358    2560 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 30 00:01:51.923833 ip-10-0-133-55 kubenswrapper[2560]: W0730 00:01:51.923361    2560 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 30 00:01:51.923833 ip-10-0-133-55 kubenswrapper[2560]: W0730 00:01:51.923364    2560 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 30 00:01:51.923833 ip-10-0-133-55 kubenswrapper[2560]: W0730 00:01:51.923366    2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 30 00:01:51.923833 ip-10-0-133-55 kubenswrapper[2560]: W0730 00:01:51.923369    2560 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 30 00:01:51.923833 ip-10-0-133-55 kubenswrapper[2560]: W0730 00:01:51.923371    2560 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 30 00:01:51.923833 ip-10-0-133-55 kubenswrapper[2560]: W0730 00:01:51.923374    2560 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 30 00:01:51.923833 ip-10-0-133-55 kubenswrapper[2560]: W0730 00:01:51.923377    2560 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 30 00:01:51.923833 ip-10-0-133-55 kubenswrapper[2560]: W0730 00:01:51.923381    2560 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 30 00:01:51.923833 ip-10-0-133-55 kubenswrapper[2560]: W0730 00:01:51.923384    2560 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 30 00:01:51.923833 ip-10-0-133-55 kubenswrapper[2560]: W0730 00:01:51.923387    2560 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 30 00:01:51.923833 ip-10-0-133-55 kubenswrapper[2560]: W0730 00:01:51.923390    2560 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 30 00:01:51.923833 ip-10-0-133-55 kubenswrapper[2560]: W0730 00:01:51.923392    2560 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 30 00:01:51.923833 ip-10-0-133-55 kubenswrapper[2560]: W0730 00:01:51.923395    2560 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 30 00:01:51.923833 ip-10-0-133-55 kubenswrapper[2560]: W0730 00:01:51.923398    2560 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 30 00:01:51.924344 ip-10-0-133-55 kubenswrapper[2560]: W0730 00:01:51.923401    2560 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 30 00:01:51.924344 ip-10-0-133-55 kubenswrapper[2560]: W0730 00:01:51.923403    2560 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 30 00:01:51.924344 ip-10-0-133-55 kubenswrapper[2560]: W0730 00:01:51.923406    2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 30 00:01:51.924344 ip-10-0-133-55 kubenswrapper[2560]: W0730 00:01:51.923408    2560 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 30 00:01:51.924344 ip-10-0-133-55 kubenswrapper[2560]: W0730 00:01:51.923411    2560 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 30 00:01:51.924344 ip-10-0-133-55 kubenswrapper[2560]: W0730 00:01:51.923413    2560 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 30 00:01:51.924344 ip-10-0-133-55 kubenswrapper[2560]: W0730 00:01:51.923415    2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 30 00:01:51.924344 ip-10-0-133-55 kubenswrapper[2560]: W0730 00:01:51.923418    2560 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 30 00:01:51.924344 ip-10-0-133-55 kubenswrapper[2560]: W0730 00:01:51.923421    2560 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 30 00:01:51.924344 ip-10-0-133-55 kubenswrapper[2560]: W0730 00:01:51.923424    2560 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 30 00:01:51.924344 ip-10-0-133-55 kubenswrapper[2560]: W0730 00:01:51.923426    2560 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 30 00:01:51.924344 ip-10-0-133-55 kubenswrapper[2560]: W0730 00:01:51.923429    2560 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 30 00:01:51.924344 ip-10-0-133-55 kubenswrapper[2560]: W0730 00:01:51.923432    2560 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 30 00:01:51.924344 ip-10-0-133-55 kubenswrapper[2560]: W0730 00:01:51.923436    2560 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 30 00:01:51.924344 ip-10-0-133-55 kubenswrapper[2560]: W0730 00:01:51.923438    2560 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 30 00:01:51.924344 ip-10-0-133-55 kubenswrapper[2560]: W0730 00:01:51.923441    2560 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 30 00:01:51.924344 ip-10-0-133-55 kubenswrapper[2560]: W0730 00:01:51.923443    2560 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 30 00:01:51.924344 ip-10-0-133-55 kubenswrapper[2560]: W0730 00:01:51.923446    2560 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 30 00:01:51.924344 ip-10-0-133-55 kubenswrapper[2560]: W0730 00:01:51.923449    2560 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 30 00:01:51.924822 ip-10-0-133-55 kubenswrapper[2560]: W0730 00:01:51.923451    2560 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 30 00:01:51.924822 ip-10-0-133-55 kubenswrapper[2560]: W0730 00:01:51.923454    2560 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 30 00:01:51.924822 ip-10-0-133-55 kubenswrapper[2560]: W0730 00:01:51.923457    2560 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 30 00:01:51.924822 ip-10-0-133-55 kubenswrapper[2560]: W0730 00:01:51.923459    2560 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 30 00:01:51.924822 ip-10-0-133-55 kubenswrapper[2560]: W0730 00:01:51.923462    2560 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 30 00:01:51.924822 ip-10-0-133-55 kubenswrapper[2560]: W0730 00:01:51.923465    2560 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 30 00:01:51.924822 ip-10-0-133-55 kubenswrapper[2560]: W0730 00:01:51.923467    2560 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 30 00:01:51.924822 ip-10-0-133-55 kubenswrapper[2560]: W0730 00:01:51.923470    2560 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 30 00:01:51.924822 ip-10-0-133-55 kubenswrapper[2560]: W0730 00:01:51.923472    2560 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 30 00:01:51.924822 ip-10-0-133-55 kubenswrapper[2560]: W0730 00:01:51.923475    2560 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 30 00:01:51.924822 ip-10-0-133-55 kubenswrapper[2560]: W0730 00:01:51.923477    2560 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 30 00:01:51.924822 ip-10-0-133-55 kubenswrapper[2560]: W0730 00:01:51.923480    2560 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 30 00:01:51.924822 ip-10-0-133-55 kubenswrapper[2560]: W0730 00:01:51.923482    2560 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 30 00:01:51.924822 ip-10-0-133-55 kubenswrapper[2560]: W0730 00:01:51.923485    2560 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 30 00:01:51.924822 ip-10-0-133-55 kubenswrapper[2560]: W0730 00:01:51.923487    2560 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 30 00:01:51.924822 ip-10-0-133-55 kubenswrapper[2560]: W0730 00:01:51.923490    2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 30 00:01:51.924822 ip-10-0-133-55 kubenswrapper[2560]: W0730 00:01:51.923492    2560 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 30 00:01:51.924822 ip-10-0-133-55 kubenswrapper[2560]: W0730 00:01:51.923495    2560 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 30 00:01:51.924822 ip-10-0-133-55 kubenswrapper[2560]: W0730 00:01:51.923497    2560 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 30 00:01:51.925271 ip-10-0-133-55 kubenswrapper[2560]: W0730 00:01:51.923501    2560 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 30 00:01:51.925271 ip-10-0-133-55 kubenswrapper[2560]: W0730 00:01:51.923505    2560 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 30 00:01:51.925271 ip-10-0-133-55 kubenswrapper[2560]: W0730 00:01:51.923508    2560 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 30 00:01:51.925271 ip-10-0-133-55 kubenswrapper[2560]: W0730 00:01:51.923511    2560 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 30 00:01:51.925271 ip-10-0-133-55 kubenswrapper[2560]: W0730 00:01:51.923514    2560 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 30 00:01:51.925271 ip-10-0-133-55 kubenswrapper[2560]: W0730 00:01:51.923519    2560 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 30 00:01:51.925271 ip-10-0-133-55 kubenswrapper[2560]: W0730 00:01:51.923522    2560 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 30 00:01:51.925271 ip-10-0-133-55 kubenswrapper[2560]: W0730 00:01:51.923527    2560 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 30 00:01:51.925271 ip-10-0-133-55 kubenswrapper[2560]: W0730 00:01:51.923531    2560 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 30 00:01:51.925271 ip-10-0-133-55 kubenswrapper[2560]: W0730 00:01:51.923533    2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 30 00:01:51.925271 ip-10-0-133-55 kubenswrapper[2560]: W0730 00:01:51.923537    2560 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 30 00:01:51.925271 ip-10-0-133-55 kubenswrapper[2560]: W0730 00:01:51.923540    2560 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 30 00:01:51.925271 ip-10-0-133-55 kubenswrapper[2560]: W0730 00:01:51.923543    2560 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 30 00:01:51.925271 ip-10-0-133-55 kubenswrapper[2560]: W0730 00:01:51.923546    2560 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 30 00:01:51.925271 ip-10-0-133-55 kubenswrapper[2560]: W0730 00:01:51.923549    2560 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 30 00:01:51.925271 ip-10-0-133-55 kubenswrapper[2560]: W0730 00:01:51.923551    2560 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 30 00:01:51.925271 ip-10-0-133-55 kubenswrapper[2560]: W0730 00:01:51.923554    2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 30 00:01:51.925271 ip-10-0-133-55 kubenswrapper[2560]: W0730 00:01:51.923557    2560 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 30 00:01:51.925271 ip-10-0-133-55 kubenswrapper[2560]: W0730 00:01:51.923560    2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 30 00:01:51.925758 ip-10-0-133-55 kubenswrapper[2560]: W0730 00:01:51.924277    2560 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 30 00:01:51.925758 ip-10-0-133-55 kubenswrapper[2560]: W0730 00:01:51.924283    2560 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 30 00:01:51.925758 ip-10-0-133-55 kubenswrapper[2560]: W0730 00:01:51.924286    2560 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 30 00:01:51.925758 ip-10-0-133-55 kubenswrapper[2560]: W0730 00:01:51.924289    2560 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 30 00:01:51.925758 ip-10-0-133-55 kubenswrapper[2560]: W0730 00:01:51.924292    2560 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 30 00:01:51.925758 ip-10-0-133-55 kubenswrapper[2560]: W0730 00:01:51.924295    2560 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 30 00:01:51.925758 ip-10-0-133-55 kubenswrapper[2560]: W0730 00:01:51.924297    2560 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 30 00:01:51.925758 ip-10-0-133-55 kubenswrapper[2560]: W0730 00:01:51.924300    2560 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 30 00:01:51.925758 ip-10-0-133-55 kubenswrapper[2560]: W0730 00:01:51.924302    2560 feature_gate.go:328] unrecognized feature gate: Example2
Jul 30 00:01:51.925758 ip-10-0-133-55 kubenswrapper[2560]: W0730 00:01:51.924305    2560 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 30 00:01:51.925758 ip-10-0-133-55 kubenswrapper[2560]: W0730 00:01:51.924308    2560 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 30 00:01:51.925758 ip-10-0-133-55 kubenswrapper[2560]: W0730 00:01:51.924311    2560 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 30 00:01:51.925758 ip-10-0-133-55 kubenswrapper[2560]: W0730 00:01:51.924313    2560 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 30 00:01:51.925758 ip-10-0-133-55 kubenswrapper[2560]: W0730 00:01:51.924316    2560 feature_gate.go:328] unrecognized feature gate: Example
Jul 30 00:01:51.925758 ip-10-0-133-55 kubenswrapper[2560]: W0730 00:01:51.924319    2560 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 30 00:01:51.925758 ip-10-0-133-55 kubenswrapper[2560]: W0730 00:01:51.924321    2560 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 30 00:01:51.925758 ip-10-0-133-55 kubenswrapper[2560]: W0730 00:01:51.924324    2560 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 30 00:01:51.925758 ip-10-0-133-55 kubenswrapper[2560]: W0730 00:01:51.924326    2560 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 30 00:01:51.925758 ip-10-0-133-55 kubenswrapper[2560]: W0730 00:01:51.924329    2560 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 30 00:01:51.925758 ip-10-0-133-55 kubenswrapper[2560]: W0730 00:01:51.924332    2560 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 30 00:01:51.926249 ip-10-0-133-55 kubenswrapper[2560]: W0730 00:01:51.924335    2560 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 30 00:01:51.926249 ip-10-0-133-55 kubenswrapper[2560]: W0730 00:01:51.924339    2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 30 00:01:51.926249 ip-10-0-133-55 kubenswrapper[2560]: W0730 00:01:51.924341    2560 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 30 00:01:51.926249 ip-10-0-133-55 kubenswrapper[2560]: W0730 00:01:51.924345    2560 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 30 00:01:51.926249 ip-10-0-133-55 kubenswrapper[2560]: W0730 00:01:51.924348    2560 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 30 00:01:51.926249 ip-10-0-133-55 kubenswrapper[2560]: W0730 00:01:51.924351    2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 30 00:01:51.926249 ip-10-0-133-55 kubenswrapper[2560]: W0730 00:01:51.924353    2560 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 30 00:01:51.926249 ip-10-0-133-55 kubenswrapper[2560]: W0730 00:01:51.924356    2560 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 30 00:01:51.926249 ip-10-0-133-55 kubenswrapper[2560]: W0730 00:01:51.924359    2560 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 30 00:01:51.926249 ip-10-0-133-55 kubenswrapper[2560]: W0730 00:01:51.924362    2560 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 30 00:01:51.926249 ip-10-0-133-55 kubenswrapper[2560]: W0730 00:01:51.924364    2560 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 30 00:01:51.926249 ip-10-0-133-55 kubenswrapper[2560]: W0730 00:01:51.924366    2560 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 30 00:01:51.926249 ip-10-0-133-55 kubenswrapper[2560]: W0730 00:01:51.924369    2560 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 30 00:01:51.926249 ip-10-0-133-55 kubenswrapper[2560]: W0730 00:01:51.924372    2560 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 30 00:01:51.926249 ip-10-0-133-55 kubenswrapper[2560]: W0730 00:01:51.924375    2560 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 30 00:01:51.926249 ip-10-0-133-55 kubenswrapper[2560]: W0730 00:01:51.924377    2560 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 30 00:01:51.926249 ip-10-0-133-55 kubenswrapper[2560]: W0730 00:01:51.924380    2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 30 00:01:51.926249 ip-10-0-133-55 kubenswrapper[2560]: W0730 00:01:51.924383    2560 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 30 00:01:51.926249 ip-10-0-133-55 kubenswrapper[2560]: W0730 00:01:51.924385    2560 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 30 00:01:51.926249 ip-10-0-133-55 kubenswrapper[2560]: W0730 00:01:51.924388    2560 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 30 00:01:51.926749 ip-10-0-133-55 kubenswrapper[2560]: W0730 00:01:51.924391    2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 30 00:01:51.926749 ip-10-0-133-55 kubenswrapper[2560]: W0730 00:01:51.924393    2560 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 30 00:01:51.926749 ip-10-0-133-55 kubenswrapper[2560]: W0730 00:01:51.924396    2560 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 30 00:01:51.926749 ip-10-0-133-55 kubenswrapper[2560]: W0730 00:01:51.924398    2560 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 30 00:01:51.926749 ip-10-0-133-55 kubenswrapper[2560]: W0730 00:01:51.924401    2560 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 30 00:01:51.926749 ip-10-0-133-55 kubenswrapper[2560]: W0730 00:01:51.924403    2560 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 30 00:01:51.926749 ip-10-0-133-55 kubenswrapper[2560]: W0730 00:01:51.924406    2560 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 30 00:01:51.926749 ip-10-0-133-55 kubenswrapper[2560]: W0730 00:01:51.924410    2560 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 30 00:01:51.926749 ip-10-0-133-55 kubenswrapper[2560]: W0730 00:01:51.924412    2560 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 30 00:01:51.926749 ip-10-0-133-55 kubenswrapper[2560]: W0730 00:01:51.924415    2560 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 30 00:01:51.926749 ip-10-0-133-55 kubenswrapper[2560]: W0730 00:01:51.924417    2560 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 30 00:01:51.926749 ip-10-0-133-55 kubenswrapper[2560]: W0730 00:01:51.924421    2560 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 30 00:01:51.926749 ip-10-0-133-55 kubenswrapper[2560]: W0730 00:01:51.924424    2560 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 30 00:01:51.926749 ip-10-0-133-55 kubenswrapper[2560]: W0730 00:01:51.924426    2560 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 30 00:01:51.926749 ip-10-0-133-55 kubenswrapper[2560]: W0730 00:01:51.924429    2560 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 30 00:01:51.926749 ip-10-0-133-55 kubenswrapper[2560]: W0730 00:01:51.924431    2560 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 30 00:01:51.926749 ip-10-0-133-55 kubenswrapper[2560]: W0730 00:01:51.924434    2560 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 30 00:01:51.926749 ip-10-0-133-55 kubenswrapper[2560]: W0730 00:01:51.924438    2560 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 30 00:01:51.926749 ip-10-0-133-55 kubenswrapper[2560]: W0730 00:01:51.924442    2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 30 00:01:51.927212 ip-10-0-133-55 kubenswrapper[2560]: W0730 00:01:51.924445    2560 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 30 00:01:51.927212 ip-10-0-133-55 kubenswrapper[2560]: W0730 00:01:51.924447    2560 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 30 00:01:51.927212 ip-10-0-133-55 kubenswrapper[2560]: W0730 00:01:51.924450    2560 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 30 00:01:51.927212 ip-10-0-133-55 kubenswrapper[2560]: W0730 00:01:51.924453    2560 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 30 00:01:51.927212 ip-10-0-133-55 kubenswrapper[2560]: W0730 00:01:51.924455    2560 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 30 00:01:51.927212 ip-10-0-133-55 kubenswrapper[2560]: W0730 00:01:51.924458    2560 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 30 00:01:51.927212 ip-10-0-133-55 kubenswrapper[2560]: W0730 00:01:51.924460    2560 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 30 00:01:51.927212 ip-10-0-133-55 kubenswrapper[2560]: W0730 00:01:51.924463    2560 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 30 00:01:51.927212 ip-10-0-133-55 kubenswrapper[2560]: W0730 00:01:51.924465    2560 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 30 00:01:51.927212 ip-10-0-133-55 kubenswrapper[2560]: W0730 00:01:51.924468    2560 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 30 00:01:51.927212 ip-10-0-133-55 kubenswrapper[2560]: W0730 00:01:51.924471    2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 30 00:01:51.927212 ip-10-0-133-55 kubenswrapper[2560]: W0730 00:01:51.924473    2560 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 30 00:01:51.927212 ip-10-0-133-55 kubenswrapper[2560]: W0730 00:01:51.924476    2560 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 30 00:01:51.927212 ip-10-0-133-55 kubenswrapper[2560]: W0730 00:01:51.924479    2560 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 30 00:01:51.927212 ip-10-0-133-55 kubenswrapper[2560]: W0730 00:01:51.924481    2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 30 00:01:51.927212 ip-10-0-133-55 kubenswrapper[2560]: W0730 00:01:51.924483    2560 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 30 00:01:51.927212 ip-10-0-133-55 kubenswrapper[2560]: W0730 00:01:51.924487    2560 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 30 00:01:51.927212 ip-10-0-133-55 kubenswrapper[2560]: W0730 00:01:51.924491    2560 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 30 00:01:51.927212 ip-10-0-133-55 kubenswrapper[2560]: W0730 00:01:51.924494    2560 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 30 00:01:51.927698 ip-10-0-133-55 kubenswrapper[2560]: W0730 00:01:51.924496    2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 30 00:01:51.927698 ip-10-0-133-55 kubenswrapper[2560]: W0730 00:01:51.924500    2560 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 30 00:01:51.927698 ip-10-0-133-55 kubenswrapper[2560]: W0730 00:01:51.924503    2560 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 30 00:01:51.927698 ip-10-0-133-55 kubenswrapper[2560]: W0730 00:01:51.924507    2560 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 30 00:01:51.927698 ip-10-0-133-55 kubenswrapper[2560]: W0730 00:01:51.924509    2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 30 00:01:51.927698 ip-10-0-133-55 kubenswrapper[2560]: W0730 00:01:51.924512    2560 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 30 00:01:51.927698 ip-10-0-133-55 kubenswrapper[2560]: W0730 00:01:51.924516    2560 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 30 00:01:51.927698 ip-10-0-133-55 kubenswrapper[2560]: W0730 00:01:51.924520    2560 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 30 00:01:51.927698 ip-10-0-133-55 kubenswrapper[2560]: W0730 00:01:51.924523    2560 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 30 00:01:51.927698 ip-10-0-133-55 kubenswrapper[2560]: W0730 00:01:51.924526    2560 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 30 00:01:51.927698 ip-10-0-133-55 kubenswrapper[2560]: W0730 00:01:51.924529    2560 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 30 00:01:51.927698 ip-10-0-133-55 kubenswrapper[2560]: W0730 00:01:51.924531    2560 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 30 00:01:51.927698 ip-10-0-133-55 kubenswrapper[2560]: W0730 00:01:51.924534    2560 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 30 00:01:51.927698 ip-10-0-133-55 kubenswrapper[2560]: W0730 00:01:51.924537    2560 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 30 00:01:51.927698 ip-10-0-133-55 kubenswrapper[2560]: W0730 00:01:51.924540    2560 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 30 00:01:51.927698 ip-10-0-133-55 kubenswrapper[2560]: W0730 00:01:51.924543    2560 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 30 00:01:51.927698 ip-10-0-133-55 kubenswrapper[2560]: W0730 00:01:51.924545    2560 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 30 00:01:51.927698 ip-10-0-133-55 kubenswrapper[2560]: W0730 00:01:51.924548    2560 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 30 00:01:51.927698 ip-10-0-133-55 kubenswrapper[2560]: W0730 00:01:51.924550    2560 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 30 00:01:51.928173 ip-10-0-133-55 kubenswrapper[2560]: W0730 00:01:51.924552    2560 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 30 00:01:51.928173 ip-10-0-133-55 kubenswrapper[2560]: W0730 00:01:51.924555    2560 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 30 00:01:51.928173 ip-10-0-133-55 kubenswrapper[2560]: W0730 00:01:51.924953    2560 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 30 00:01:51.928173 ip-10-0-133-55 kubenswrapper[2560]: W0730 00:01:51.924960    2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 30 00:01:51.928173 ip-10-0-133-55 kubenswrapper[2560]: W0730 00:01:51.924964    2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 30 00:01:51.928173 ip-10-0-133-55 kubenswrapper[2560]: W0730 00:01:51.924967    2560 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 30 00:01:51.928173 ip-10-0-133-55 kubenswrapper[2560]: W0730 00:01:51.924969    2560 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 30 00:01:51.928173 ip-10-0-133-55 kubenswrapper[2560]: W0730 00:01:51.924975    2560 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 30 00:01:51.928173 ip-10-0-133-55 kubenswrapper[2560]: W0730 00:01:51.924977    2560 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 30 00:01:51.928173 ip-10-0-133-55 kubenswrapper[2560]: W0730 00:01:51.924980    2560 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 30 00:01:51.928173 ip-10-0-133-55 kubenswrapper[2560]: W0730 00:01:51.924983    2560 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 30 00:01:51.928173 ip-10-0-133-55 kubenswrapper[2560]: W0730 00:01:51.924986    2560 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 30 00:01:51.928173 ip-10-0-133-55 kubenswrapper[2560]: W0730 00:01:51.924988    2560 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 30 00:01:51.928173 ip-10-0-133-55 kubenswrapper[2560]: W0730 00:01:51.924991    2560 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 30 00:01:51.928173 ip-10-0-133-55 kubenswrapper[2560]: W0730 00:01:51.924994    2560 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 30 00:01:51.928173 ip-10-0-133-55 kubenswrapper[2560]: W0730 00:01:51.924996    2560 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 30 00:01:51.928173 ip-10-0-133-55 kubenswrapper[2560]: W0730 00:01:51.925001    2560 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 30 00:01:51.928173 ip-10-0-133-55 kubenswrapper[2560]: W0730 00:01:51.925004    2560 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 30 00:01:51.928173 ip-10-0-133-55 kubenswrapper[2560]: W0730 00:01:51.925009    2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 30 00:01:51.928173 ip-10-0-133-55 kubenswrapper[2560]: W0730 00:01:51.925013    2560 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 30 00:01:51.928676 ip-10-0-133-55 kubenswrapper[2560]: W0730 00:01:51.925016    2560 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 30 00:01:51.928676 ip-10-0-133-55 kubenswrapper[2560]: W0730 00:01:51.925019    2560 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 30 00:01:51.928676 ip-10-0-133-55 kubenswrapper[2560]: W0730 00:01:51.925022    2560 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 30 00:01:51.928676 ip-10-0-133-55 kubenswrapper[2560]: W0730 00:01:51.925025    2560 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 30 00:01:51.928676 ip-10-0-133-55 kubenswrapper[2560]: W0730 00:01:51.925028    2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 30 00:01:51.928676 ip-10-0-133-55 kubenswrapper[2560]: W0730 00:01:51.925030    2560 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 30 00:01:51.928676 ip-10-0-133-55 kubenswrapper[2560]: W0730 00:01:51.925033    2560 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 30 00:01:51.928676 ip-10-0-133-55 kubenswrapper[2560]: W0730 00:01:51.925036    2560 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 30 00:01:51.928676 ip-10-0-133-55 kubenswrapper[2560]: W0730 00:01:51.925038    2560 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 30 00:01:51.928676 ip-10-0-133-55 kubenswrapper[2560]: W0730 00:01:51.925041    2560 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 30 00:01:51.928676 ip-10-0-133-55 kubenswrapper[2560]: W0730 00:01:51.925044    2560 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 30 00:01:51.928676 ip-10-0-133-55 kubenswrapper[2560]: W0730 00:01:51.925046    2560 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 30 00:01:51.928676 ip-10-0-133-55 kubenswrapper[2560]: W0730 00:01:51.925049    2560 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 30 00:01:51.928676 ip-10-0-133-55 kubenswrapper[2560]: W0730 00:01:51.925052    2560 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 30 00:01:51.928676 ip-10-0-133-55 kubenswrapper[2560]: W0730 00:01:51.925054    2560 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 30 00:01:51.928676 ip-10-0-133-55 kubenswrapper[2560]: W0730 00:01:51.925057    2560 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 30 00:01:51.928676 ip-10-0-133-55 kubenswrapper[2560]: W0730 00:01:51.925060    2560 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 30 00:01:51.928676 ip-10-0-133-55 kubenswrapper[2560]: W0730 00:01:51.925063    2560 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 30 00:01:51.928676 ip-10-0-133-55 kubenswrapper[2560]: W0730 00:01:51.925065    2560 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 30 00:01:51.929136 ip-10-0-133-55 kubenswrapper[2560]: W0730 00:01:51.925069    2560 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 30 00:01:51.929136 ip-10-0-133-55 kubenswrapper[2560]: W0730 00:01:51.925072    2560 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 30 00:01:51.929136 ip-10-0-133-55 kubenswrapper[2560]: W0730 00:01:51.925074    2560 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 30 00:01:51.929136 ip-10-0-133-55 kubenswrapper[2560]: W0730 00:01:51.925077    2560 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 30 00:01:51.929136 ip-10-0-133-55 kubenswrapper[2560]: W0730 00:01:51.925080    2560 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 30 00:01:51.929136 ip-10-0-133-55 kubenswrapper[2560]: W0730 00:01:51.925082    2560 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 30 00:01:51.929136 ip-10-0-133-55 kubenswrapper[2560]: W0730 00:01:51.925086    2560 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 30 00:01:51.929136 ip-10-0-133-55 kubenswrapper[2560]: W0730 00:01:51.925090    2560 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 30 00:01:51.929136 ip-10-0-133-55 kubenswrapper[2560]: W0730 00:01:51.925093    2560 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 30 00:01:51.929136 ip-10-0-133-55 kubenswrapper[2560]: W0730 00:01:51.925096    2560 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 30 00:01:51.929136 ip-10-0-133-55 kubenswrapper[2560]: W0730 00:01:51.925099    2560 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 30 00:01:51.929136 ip-10-0-133-55 kubenswrapper[2560]: W0730 00:01:51.925103    2560 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 30 00:01:51.929136 ip-10-0-133-55 kubenswrapper[2560]: W0730 00:01:51.925106    2560 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 30 00:01:51.929136 ip-10-0-133-55 kubenswrapper[2560]: W0730 00:01:51.925109    2560 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 30 00:01:51.929136 ip-10-0-133-55 kubenswrapper[2560]: W0730 00:01:51.925111    2560 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 30 00:01:51.929136 ip-10-0-133-55 kubenswrapper[2560]: W0730 00:01:51.925114    2560 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 30 00:01:51.929136 ip-10-0-133-55 kubenswrapper[2560]: W0730 00:01:51.925116    2560 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 30 00:01:51.929136 ip-10-0-133-55 kubenswrapper[2560]: W0730 00:01:51.925119    2560 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 30 00:01:51.929136 ip-10-0-133-55 kubenswrapper[2560]: W0730 00:01:51.925122    2560 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 30 00:01:51.929680 ip-10-0-133-55 kubenswrapper[2560]: W0730 00:01:51.925124    2560 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 30 00:01:51.929680 ip-10-0-133-55 kubenswrapper[2560]: W0730 00:01:51.925127    2560 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 30 00:01:51.929680 ip-10-0-133-55 kubenswrapper[2560]: W0730 00:01:51.925129    2560 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 30 00:01:51.929680 ip-10-0-133-55 kubenswrapper[2560]: W0730 00:01:51.925132    2560 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 30 00:01:51.929680 ip-10-0-133-55 kubenswrapper[2560]: W0730 00:01:51.925135    2560 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 30 00:01:51.929680 ip-10-0-133-55 kubenswrapper[2560]: W0730 00:01:51.925139    2560 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 30 00:01:51.929680 ip-10-0-133-55 kubenswrapper[2560]: W0730 00:01:51.925141    2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 30 00:01:51.929680 ip-10-0-133-55 kubenswrapper[2560]: W0730 00:01:51.925145    2560 feature_gate.go:328] unrecognized feature gate: Example
Jul 30 00:01:51.929680 ip-10-0-133-55 kubenswrapper[2560]: W0730 00:01:51.925148    2560 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 30 00:01:51.929680 ip-10-0-133-55 kubenswrapper[2560]: W0730 00:01:51.925150    2560 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 30 00:01:51.929680 ip-10-0-133-55 kubenswrapper[2560]: W0730 00:01:51.925153    2560 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 30 00:01:51.929680 ip-10-0-133-55 kubenswrapper[2560]: W0730 00:01:51.925155    2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 30 00:01:51.929680 ip-10-0-133-55 kubenswrapper[2560]: W0730 00:01:51.925158    2560 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 30 00:01:51.929680 ip-10-0-133-55 kubenswrapper[2560]: W0730 00:01:51.925162    2560 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 30 00:01:51.929680 ip-10-0-133-55 kubenswrapper[2560]: W0730 00:01:51.925164    2560 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 30 00:01:51.929680 ip-10-0-133-55 kubenswrapper[2560]: W0730 00:01:51.925167    2560 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 30 00:01:51.929680 ip-10-0-133-55 kubenswrapper[2560]: W0730 00:01:51.925169    2560 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 30 00:01:51.929680 ip-10-0-133-55 kubenswrapper[2560]: W0730 00:01:51.925172    2560 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 30 00:01:51.929680 ip-10-0-133-55 kubenswrapper[2560]: W0730 00:01:51.925175    2560 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 30 00:01:51.929680 ip-10-0-133-55 kubenswrapper[2560]: W0730 00:01:51.925177    2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 30 00:01:51.930160 ip-10-0-133-55 kubenswrapper[2560]: W0730 00:01:51.925180    2560 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 30 00:01:51.930160 ip-10-0-133-55 kubenswrapper[2560]: W0730 00:01:51.925182    2560 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 30 00:01:51.930160 ip-10-0-133-55 kubenswrapper[2560]: W0730 00:01:51.925185    2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 30 00:01:51.930160 ip-10-0-133-55 kubenswrapper[2560]: W0730 00:01:51.925187    2560 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 30 00:01:51.930160 ip-10-0-133-55 kubenswrapper[2560]: W0730 00:01:51.925191    2560 feature_gate.go:328] unrecognized feature gate: Example2
Jul 30 00:01:51.930160 ip-10-0-133-55 kubenswrapper[2560]: W0730 00:01:51.925194    2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 30 00:01:51.930160 ip-10-0-133-55 kubenswrapper[2560]: W0730 00:01:51.925196    2560 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 30 00:01:51.930160 ip-10-0-133-55 kubenswrapper[2560]: W0730 00:01:51.925199    2560 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 30 00:01:51.930160 ip-10-0-133-55 kubenswrapper[2560]: W0730 00:01:51.925202    2560 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 30 00:01:51.930160 ip-10-0-133-55 kubenswrapper[2560]: W0730 00:01:51.925205    2560 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 30 00:01:51.930160 ip-10-0-133-55 kubenswrapper[2560]: W0730 00:01:51.925207    2560 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 30 00:01:51.930160 ip-10-0-133-55 kubenswrapper[2560]: W0730 00:01:51.925210    2560 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 30 00:01:51.930160 ip-10-0-133-55 kubenswrapper[2560]: W0730 00:01:51.925212    2560 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 30 00:01:51.930160 ip-10-0-133-55 kubenswrapper[2560]: W0730 00:01:51.925215    2560 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 30 00:01:51.930160 ip-10-0-133-55 kubenswrapper[2560]: W0730 00:01:51.925218    2560 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 30 00:01:51.930160 ip-10-0-133-55 kubenswrapper[2560]: W0730 00:01:51.925221    2560 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 30 00:01:51.930160 ip-10-0-133-55 kubenswrapper[2560]: W0730 00:01:51.925224    2560 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 30 00:01:51.930160 ip-10-0-133-55 kubenswrapper[2560]: W0730 00:01:51.925227    2560 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 30 00:01:51.930160 ip-10-0-133-55 kubenswrapper[2560]: W0730 00:01:51.925229    2560 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 30 00:01:51.930160 ip-10-0-133-55 kubenswrapper[2560]: W0730 00:01:51.925232    2560 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 30 00:01:51.930683 ip-10-0-133-55 kubenswrapper[2560]: W0730 00:01:51.925234    2560 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 30 00:01:51.930683 ip-10-0-133-55 kubenswrapper[2560]: W0730 00:01:51.925237    2560 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 30 00:01:51.930683 ip-10-0-133-55 kubenswrapper[2560]: W0730 00:01:51.925239    2560 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 30 00:01:51.930683 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:01:51.925320    2560 flags.go:64] FLAG: --address="0.0.0.0"
Jul 30 00:01:51.930683 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:01:51.925327    2560 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]"
Jul 30 00:01:51.930683 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:01:51.925336    2560 flags.go:64] FLAG: --anonymous-auth="true"
Jul 30 00:01:51.930683 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:01:51.925342    2560 flags.go:64] FLAG: --application-metrics-count-limit="100"
Jul 30 00:01:51.930683 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:01:51.925348    2560 flags.go:64] FLAG: --authentication-token-webhook="false"
Jul 30 00:01:51.930683 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:01:51.925353    2560 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s"
Jul 30 00:01:51.930683 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:01:51.925358    2560 flags.go:64] FLAG: --authorization-mode="AlwaysAllow"
Jul 30 00:01:51.930683 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:01:51.925362    2560 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s"
Jul 30 00:01:51.930683 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:01:51.925365    2560 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s"
Jul 30 00:01:51.930683 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:01:51.925368    2560 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id"
Jul 30 00:01:51.930683 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:01:51.925371    2560 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig"
Jul 30 00:01:51.930683 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:01:51.925375    2560 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki"
Jul 30 00:01:51.930683 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:01:51.925378    2560 flags.go:64] FLAG: --cgroup-driver="cgroupfs"
Jul 30 00:01:51.930683 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:01:51.925382    2560 flags.go:64] FLAG: --cgroup-root=""
Jul 30 00:01:51.930683 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:01:51.925385    2560 flags.go:64] FLAG: --cgroups-per-qos="true"
Jul 30 00:01:51.930683 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:01:51.925388    2560 flags.go:64] FLAG: --client-ca-file=""
Jul 30 00:01:51.930683 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:01:51.925390    2560 flags.go:64] FLAG: --cloud-provider="external"
Jul 30 00:01:51.930683 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:01:51.925394    2560 flags.go:64] FLAG: --cluster-dns="[]"
Jul 30 00:01:51.930683 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:01:51.925398    2560 flags.go:64] FLAG: --cluster-domain=""
Jul 30 00:01:51.930683 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:01:51.925402    2560 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf"
Jul 30 00:01:51.930683 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:01:51.925405    2560 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d"
Jul 30 00:01:51.931290 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:01:51.925408    2560 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json"
Jul 30 00:01:51.931290 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:01:51.925411    2560 flags.go:64] FLAG: --container-log-max-files="5"
Jul 30 00:01:51.931290 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:01:51.925415    2560 flags.go:64] FLAG: --container-log-max-size="10Mi"
Jul 30 00:01:51.931290 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:01:51.925418    2560 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock"
Jul 30 00:01:51.931290 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:01:51.925421    2560 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock"
Jul 30 00:01:51.931290 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:01:51.925425    2560 flags.go:64] FLAG: --containerd-namespace="k8s.io"
Jul 30 00:01:51.931290 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:01:51.925428    2560 flags.go:64] FLAG: --contention-profiling="false"
Jul 30 00:01:51.931290 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:01:51.925431    2560 flags.go:64] FLAG: --cpu-cfs-quota="true"
Jul 30 00:01:51.931290 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:01:51.925434    2560 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms"
Jul 30 00:01:51.931290 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:01:51.925437    2560 flags.go:64] FLAG: --cpu-manager-policy="none"
Jul 30 00:01:51.931290 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:01:51.925440    2560 flags.go:64] FLAG: --cpu-manager-policy-options=""
Jul 30 00:01:51.931290 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:01:51.925444    2560 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s"
Jul 30 00:01:51.931290 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:01:51.925447    2560 flags.go:64] FLAG: --enable-controller-attach-detach="true"
Jul 30 00:01:51.931290 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:01:51.925451    2560 flags.go:64] FLAG: --enable-debugging-handlers="true"
Jul 30 00:01:51.931290 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:01:51.925454    2560 flags.go:64] FLAG: --enable-load-reader="false"
Jul 30 00:01:51.931290 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:01:51.925457    2560 flags.go:64] FLAG: --enable-server="true"
Jul 30 00:01:51.931290 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:01:51.925460    2560 flags.go:64] FLAG: --enforce-node-allocatable="[pods]"
Jul 30 00:01:51.931290 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:01:51.925464    2560 flags.go:64] FLAG: --event-burst="100"
Jul 30 00:01:51.931290 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:01:51.925467    2560 flags.go:64] FLAG: --event-qps="50"
Jul 30 00:01:51.931290 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:01:51.925469    2560 flags.go:64] FLAG: --event-storage-age-limit="default=0"
Jul 30 00:01:51.931290 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:01:51.925472    2560 flags.go:64] FLAG: --event-storage-event-limit="default=0"
Jul 30 00:01:51.931290 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:01:51.925476    2560 flags.go:64] FLAG: --eviction-hard=""
Jul 30 00:01:51.931290 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:01:51.925479    2560 flags.go:64] FLAG: --eviction-max-pod-grace-period="0"
Jul 30 00:01:51.931290 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:01:51.925482    2560 flags.go:64] FLAG: --eviction-minimum-reclaim=""
Jul 30 00:01:51.931876 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:01:51.925485    2560 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s"
Jul 30 00:01:51.931876 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:01:51.925489    2560 flags.go:64] FLAG: --eviction-soft=""
Jul 30 00:01:51.931876 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:01:51.925491    2560 flags.go:64] FLAG: --eviction-soft-grace-period=""
Jul 30 00:01:51.931876 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:01:51.925494    2560 flags.go:64] FLAG: --exit-on-lock-contention="false"
Jul 30 00:01:51.931876 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:01:51.925497    2560 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false"
Jul 30 00:01:51.931876 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:01:51.925501    2560 flags.go:64] FLAG: --experimental-mounter-path=""
Jul 30 00:01:51.931876 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:01:51.925504    2560 flags.go:64] FLAG: --fail-cgroupv1="false"
Jul 30 00:01:51.931876 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:01:51.925507    2560 flags.go:64] FLAG: --fail-swap-on="true"
Jul 30 00:01:51.931876 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:01:51.925510    2560 flags.go:64] FLAG: --feature-gates=""
Jul 30 00:01:51.931876 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:01:51.925513    2560 flags.go:64] FLAG: --file-check-frequency="20s"
Jul 30 00:01:51.931876 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:01:51.925516    2560 flags.go:64] FLAG: --global-housekeeping-interval="1m0s"
Jul 30 00:01:51.931876 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:01:51.925519    2560 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge"
Jul 30 00:01:51.931876 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:01:51.925522    2560 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1"
Jul 30 00:01:51.931876 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:01:51.925525    2560 flags.go:64] FLAG: --healthz-port="10248"
Jul 30 00:01:51.931876 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:01:51.925528    2560 flags.go:64] FLAG: --help="false"
Jul 30 00:01:51.931876 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:01:51.925531    2560 flags.go:64] FLAG: --hostname-override="ip-10-0-133-55.ec2.internal"
Jul 30 00:01:51.931876 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:01:51.925534    2560 flags.go:64] FLAG: --housekeeping-interval="10s"
Jul 30 00:01:51.931876 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:01:51.925537    2560 flags.go:64] FLAG: --http-check-frequency="20s"
Jul 30 00:01:51.931876 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:01:51.925540    2560 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins"
Jul 30 00:01:51.931876 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:01:51.925543    2560 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml"
Jul 30 00:01:51.931876 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:01:51.925547    2560 flags.go:64] FLAG: --image-gc-high-threshold="85"
Jul 30 00:01:51.931876 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:01:51.925551    2560 flags.go:64] FLAG: --image-gc-low-threshold="80"
Jul 30 00:01:51.931876 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:01:51.925554    2560 flags.go:64] FLAG: --image-service-endpoint=""
Jul 30 00:01:51.932625 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:01:51.925557    2560 flags.go:64] FLAG: --kernel-memcg-notification="false"
Jul 30 00:01:51.932625 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:01:51.925560    2560 flags.go:64] FLAG: --kube-api-burst="100"
Jul 30 00:01:51.932625 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:01:51.925563    2560 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf"
Jul 30 00:01:51.932625 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:01:51.925566    2560 flags.go:64] FLAG: --kube-api-qps="50"
Jul 30 00:01:51.932625 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:01:51.925569    2560 flags.go:64] FLAG: --kube-reserved=""
Jul 30 00:01:51.932625 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:01:51.925572    2560 flags.go:64] FLAG: --kube-reserved-cgroup=""
Jul 30 00:01:51.932625 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:01:51.925574    2560 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig"
Jul 30 00:01:51.932625 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:01:51.925577    2560 flags.go:64] FLAG: --kubelet-cgroups=""
Jul 30 00:01:51.932625 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:01:51.925580    2560 flags.go:64] FLAG: --local-storage-capacity-isolation="true"
Jul 30 00:01:51.932625 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:01:51.925592    2560 flags.go:64] FLAG: --lock-file=""
Jul 30 00:01:51.932625 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:01:51.925596    2560 flags.go:64] FLAG: --log-cadvisor-usage="false"
Jul 30 00:01:51.932625 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:01:51.925611    2560 flags.go:64] FLAG: --log-flush-frequency="5s"
Jul 30 00:01:51.932625 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:01:51.925614    2560 flags.go:64] FLAG: --log-json-info-buffer-size="0"
Jul 30 00:01:51.932625 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:01:51.925619    2560 flags.go:64] FLAG: --log-json-split-stream="false"
Jul 30 00:01:51.932625 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:01:51.925632    2560 flags.go:64] FLAG: --log-text-info-buffer-size="0"
Jul 30 00:01:51.932625 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:01:51.925635    2560 flags.go:64] FLAG: --log-text-split-stream="false"
Jul 30 00:01:51.932625 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:01:51.925638    2560 flags.go:64] FLAG: --logging-format="text"
Jul 30 00:01:51.932625 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:01:51.925641    2560 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id"
Jul 30 00:01:51.932625 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:01:51.925645    2560 flags.go:64] FLAG: --make-iptables-util-chains="true"
Jul 30 00:01:51.932625 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:01:51.925648    2560 flags.go:64] FLAG: --manifest-url=""
Jul 30 00:01:51.932625 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:01:51.925651    2560 flags.go:64] FLAG: --manifest-url-header=""
Jul 30 00:01:51.932625 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:01:51.925654    2560 flags.go:64] FLAG: --max-housekeeping-interval="15s"
Jul 30 00:01:51.932625 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:01:51.925657    2560 flags.go:64] FLAG: --max-open-files="1000000"
Jul 30 00:01:51.932625 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:01:51.925661    2560 flags.go:64] FLAG: --max-pods="110"
Jul 30 00:01:51.932625 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:01:51.925664    2560 flags.go:64] FLAG: --maximum-dead-containers="-1"
Jul 30 00:01:51.933663 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:01:51.925667    2560 flags.go:64] FLAG: --maximum-dead-containers-per-container="1"
Jul 30 00:01:51.933663 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:01:51.925670    2560 flags.go:64] FLAG: --memory-manager-policy="None"
Jul 30 00:01:51.933663 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:01:51.925673    2560 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s"
Jul 30 00:01:51.933663 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:01:51.925676    2560 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s"
Jul 30 00:01:51.933663 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:01:51.925679    2560 flags.go:64] FLAG: --node-ip="0.0.0.0"
Jul 30 00:01:51.933663 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:01:51.925683    2560 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel"
Jul 30 00:01:51.933663 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:01:51.925690    2560 flags.go:64] FLAG: --node-status-max-images="50"
Jul 30 00:01:51.933663 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:01:51.925693    2560 flags.go:64] FLAG: --node-status-update-frequency="10s"
Jul 30 00:01:51.933663 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:01:51.925696    2560 flags.go:64] FLAG: --oom-score-adj="-999"
Jul 30 00:01:51.933663 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:01:51.925700    2560 flags.go:64] FLAG: --pod-cidr=""
Jul 30 00:01:51.933663 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:01:51.925702    2560 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:7505336a406394b8c1c77d14d890a9f628aa4cfff172312179cb9af8c28c30bb"
Jul 30 00:01:51.933663 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:01:51.925708    2560 flags.go:64] FLAG: --pod-manifest-path=""
Jul 30 00:01:51.933663 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:01:51.925711    2560 flags.go:64] FLAG: --pod-max-pids="-1"
Jul 30 00:01:51.933663 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:01:51.925714    2560 flags.go:64] FLAG: --pods-per-core="0"
Jul 30 00:01:51.933663 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:01:51.925717    2560 flags.go:64] FLAG: --port="10250"
Jul 30 00:01:51.933663 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:01:51.925720    2560 flags.go:64] FLAG: --protect-kernel-defaults="false"
Jul 30 00:01:51.933663 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:01:51.925723    2560 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-085b50f55331f8c57"
Jul 30 00:01:51.933663 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:01:51.925726    2560 flags.go:64] FLAG: --qos-reserved=""
Jul 30 00:01:51.933663 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:01:51.925729    2560 flags.go:64] FLAG: --read-only-port="10255"
Jul 30 00:01:51.933663 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:01:51.925732    2560 flags.go:64] FLAG: --register-node="true"
Jul 30 00:01:51.933663 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:01:51.925735    2560 flags.go:64] FLAG: --register-with-taints=""
Jul 30 00:01:51.933663 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:01:51.925738    2560 flags.go:64] FLAG: --registry-burst="10"
Jul 30 00:01:51.933663 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:01:51.925741    2560 flags.go:64] FLAG: --registry-qps="5"
Jul 30 00:01:51.933663 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:01:51.925744    2560 flags.go:64] FLAG: --reserved-cpus=""
Jul 30 00:01:51.934391 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:01:51.925747    2560 flags.go:64] FLAG: --reserved-memory=""
Jul 30 00:01:51.934391 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:01:51.925751    2560 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf"
Jul 30 00:01:51.934391 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:01:51.925754    2560 flags.go:64] FLAG: --root-dir="/var/lib/kubelet"
Jul 30 00:01:51.934391 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:01:51.925757    2560 flags.go:64] FLAG: --rotate-certificates="false"
Jul 30 00:01:51.934391 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:01:51.925760    2560 flags.go:64] FLAG: --rotate-server-certificates="false"
Jul 30 00:01:51.934391 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:01:51.925762    2560 flags.go:64] FLAG: --runonce="false"
Jul 30 00:01:51.934391 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:01:51.925765    2560 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service"
Jul 30 00:01:51.934391 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:01:51.925769    2560 flags.go:64] FLAG: --runtime-request-timeout="2m0s"
Jul 30 00:01:51.934391 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:01:51.925772    2560 flags.go:64] FLAG: --seccomp-default="false"
Jul 30 00:01:51.934391 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:01:51.925775    2560 flags.go:64] FLAG: --serialize-image-pulls="true"
Jul 30 00:01:51.934391 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:01:51.925778    2560 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s"
Jul 30 00:01:51.934391 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:01:51.925781    2560 flags.go:64] FLAG: --storage-driver-db="cadvisor"
Jul 30 00:01:51.934391 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:01:51.925784    2560 flags.go:64] FLAG: --storage-driver-host="localhost:8086"
Jul 30 00:01:51.934391 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:01:51.925787    2560 flags.go:64] FLAG: --storage-driver-password="root"
Jul 30 00:01:51.934391 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:01:51.925790    2560 flags.go:64] FLAG: --storage-driver-secure="false"
Jul 30 00:01:51.934391 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:01:51.925793    2560 flags.go:64] FLAG: --storage-driver-table="stats"
Jul 30 00:01:51.934391 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:01:51.925796    2560 flags.go:64] FLAG: --storage-driver-user="root"
Jul 30 00:01:51.934391 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:01:51.925799    2560 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s"
Jul 30 00:01:51.934391 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:01:51.925802    2560 flags.go:64] FLAG: --sync-frequency="1m0s"
Jul 30 00:01:51.934391 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:01:51.925805    2560 flags.go:64] FLAG: --system-cgroups=""
Jul 30 00:01:51.934391 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:01:51.925807    2560 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi"
Jul 30 00:01:51.934391 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:01:51.925812    2560 flags.go:64] FLAG: --system-reserved-cgroup=""
Jul 30 00:01:51.934391 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:01:51.925817    2560 flags.go:64] FLAG: --tls-cert-file=""
Jul 30 00:01:51.934391 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:01:51.925819    2560 flags.go:64] FLAG: --tls-cipher-suites="[]"
Jul 30 00:01:51.934391 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:01:51.925823    2560 flags.go:64] FLAG: --tls-min-version=""
Jul 30 00:01:51.935052 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:01:51.925826    2560 flags.go:64] FLAG: --tls-private-key-file=""
Jul 30 00:01:51.935052 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:01:51.925829    2560 flags.go:64] FLAG: --topology-manager-policy="none"
Jul 30 00:01:51.935052 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:01:51.925832    2560 flags.go:64] FLAG: --topology-manager-policy-options=""
Jul 30 00:01:51.935052 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:01:51.925835    2560 flags.go:64] FLAG: --topology-manager-scope="container"
Jul 30 00:01:51.935052 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:01:51.925837    2560 flags.go:64] FLAG: --v="2"
Jul 30 00:01:51.935052 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:01:51.925841    2560 flags.go:64] FLAG: --version="false"
Jul 30 00:01:51.935052 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:01:51.925845    2560 flags.go:64] FLAG: --vmodule=""
Jul 30 00:01:51.935052 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:01:51.925849    2560 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec"
Jul 30 00:01:51.935052 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:01:51.925852    2560 flags.go:64] FLAG: --volume-stats-agg-period="1m0s"
Jul 30 00:01:51.935052 ip-10-0-133-55 kubenswrapper[2560]: W0730 00:01:51.925966    2560 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 30 00:01:51.935052 ip-10-0-133-55 kubenswrapper[2560]: W0730 00:01:51.925969    2560 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 30 00:01:51.935052 ip-10-0-133-55 kubenswrapper[2560]: W0730 00:01:51.925974    2560 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 30 00:01:51.935052 ip-10-0-133-55 kubenswrapper[2560]: W0730 00:01:51.925978    2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 30 00:01:51.935052 ip-10-0-133-55 kubenswrapper[2560]: W0730 00:01:51.925981    2560 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 30 00:01:51.935052 ip-10-0-133-55 kubenswrapper[2560]: W0730 00:01:51.925984    2560 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 30 00:01:51.935052 ip-10-0-133-55 kubenswrapper[2560]: W0730 00:01:51.925987    2560 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 30 00:01:51.935052 ip-10-0-133-55 kubenswrapper[2560]: W0730 00:01:51.925989    2560 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 30 00:01:51.935052 ip-10-0-133-55 kubenswrapper[2560]: W0730 00:01:51.925991    2560 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 30 00:01:51.935052 ip-10-0-133-55 kubenswrapper[2560]: W0730 00:01:51.925994    2560 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 30 00:01:51.935052 ip-10-0-133-55 kubenswrapper[2560]: W0730 00:01:51.925997    2560 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 30 00:01:51.935052 ip-10-0-133-55 kubenswrapper[2560]: W0730 00:01:51.925999    2560 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 30 00:01:51.935582 ip-10-0-133-55 kubenswrapper[2560]: W0730 00:01:51.926002    2560 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 30 00:01:51.935582 ip-10-0-133-55 kubenswrapper[2560]: W0730 00:01:51.926006    2560 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 30 00:01:51.935582 ip-10-0-133-55 kubenswrapper[2560]: W0730 00:01:51.926009    2560 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 30 00:01:51.935582 ip-10-0-133-55 kubenswrapper[2560]: W0730 00:01:51.926013    2560 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 30 00:01:51.935582 ip-10-0-133-55 kubenswrapper[2560]: W0730 00:01:51.926015    2560 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 30 00:01:51.935582 ip-10-0-133-55 kubenswrapper[2560]: W0730 00:01:51.926018    2560 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 30 00:01:51.935582 ip-10-0-133-55 kubenswrapper[2560]: W0730 00:01:51.926021    2560 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 30 00:01:51.935582 ip-10-0-133-55 kubenswrapper[2560]: W0730 00:01:51.926024    2560 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 30 00:01:51.935582 ip-10-0-133-55 kubenswrapper[2560]: W0730 00:01:51.926028    2560 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 30 00:01:51.935582 ip-10-0-133-55 kubenswrapper[2560]: W0730 00:01:51.926031    2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 30 00:01:51.935582 ip-10-0-133-55 kubenswrapper[2560]: W0730 00:01:51.926034    2560 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 30 00:01:51.935582 ip-10-0-133-55 kubenswrapper[2560]: W0730 00:01:51.926037    2560 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 30 00:01:51.935582 ip-10-0-133-55 kubenswrapper[2560]: W0730 00:01:51.926040    2560 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 30 00:01:51.935582 ip-10-0-133-55 kubenswrapper[2560]: W0730 00:01:51.926043    2560 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 30 00:01:51.935582 ip-10-0-133-55 kubenswrapper[2560]: W0730 00:01:51.926045    2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 30 00:01:51.935582 ip-10-0-133-55 kubenswrapper[2560]: W0730 00:01:51.926048    2560 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 30 00:01:51.935582 ip-10-0-133-55 kubenswrapper[2560]: W0730 00:01:51.926051    2560 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 30 00:01:51.935582 ip-10-0-133-55 kubenswrapper[2560]: W0730 00:01:51.926054    2560 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 30 00:01:51.935582 ip-10-0-133-55 kubenswrapper[2560]: W0730 00:01:51.926056    2560 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 30 00:01:51.936065 ip-10-0-133-55 kubenswrapper[2560]: W0730 00:01:51.926059    2560 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 30 00:01:51.936065 ip-10-0-133-55 kubenswrapper[2560]: W0730 00:01:51.926062    2560 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 30 00:01:51.936065 ip-10-0-133-55 kubenswrapper[2560]: W0730 00:01:51.926065    2560 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 30 00:01:51.936065 ip-10-0-133-55 kubenswrapper[2560]: W0730 00:01:51.926067    2560 feature_gate.go:328] unrecognized feature gate: Example
Jul 30 00:01:51.936065 ip-10-0-133-55 kubenswrapper[2560]: W0730 00:01:51.926070    2560 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 30 00:01:51.936065 ip-10-0-133-55 kubenswrapper[2560]: W0730 00:01:51.926072    2560 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 30 00:01:51.936065 ip-10-0-133-55 kubenswrapper[2560]: W0730 00:01:51.926075    2560 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 30 00:01:51.936065 ip-10-0-133-55 kubenswrapper[2560]: W0730 00:01:51.926078    2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 30 00:01:51.936065 ip-10-0-133-55 kubenswrapper[2560]: W0730 00:01:51.926080    2560 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 30 00:01:51.936065 ip-10-0-133-55 kubenswrapper[2560]: W0730 00:01:51.926083    2560 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 30 00:01:51.936065 ip-10-0-133-55 kubenswrapper[2560]: W0730 00:01:51.926086    2560 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 30 00:01:51.936065 ip-10-0-133-55 kubenswrapper[2560]: W0730 00:01:51.926088    2560 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 30 00:01:51.936065 ip-10-0-133-55 kubenswrapper[2560]: W0730 00:01:51.926091    2560 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 30 00:01:51.936065 ip-10-0-133-55 kubenswrapper[2560]: W0730 00:01:51.926093    2560 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 30 00:01:51.936065 ip-10-0-133-55 kubenswrapper[2560]: W0730 00:01:51.926096    2560 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 30 00:01:51.936065 ip-10-0-133-55 kubenswrapper[2560]: W0730 00:01:51.926099    2560 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 30 00:01:51.936065 ip-10-0-133-55 kubenswrapper[2560]: W0730 00:01:51.926101    2560 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 30 00:01:51.936065 ip-10-0-133-55 kubenswrapper[2560]: W0730 00:01:51.926104    2560 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 30 00:01:51.936065 ip-10-0-133-55 kubenswrapper[2560]: W0730 00:01:51.926106    2560 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 30 00:01:51.936065 ip-10-0-133-55 kubenswrapper[2560]: W0730 00:01:51.926109    2560 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 30 00:01:51.936545 ip-10-0-133-55 kubenswrapper[2560]: W0730 00:01:51.926111    2560 feature_gate.go:328] unrecognized feature gate: Example2
Jul 30 00:01:51.936545 ip-10-0-133-55 kubenswrapper[2560]: W0730 00:01:51.926115    2560 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 30 00:01:51.936545 ip-10-0-133-55 kubenswrapper[2560]: W0730 00:01:51.926117    2560 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 30 00:01:51.936545 ip-10-0-133-55 kubenswrapper[2560]: W0730 00:01:51.926120    2560 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 30 00:01:51.936545 ip-10-0-133-55 kubenswrapper[2560]: W0730 00:01:51.926123    2560 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 30 00:01:51.936545 ip-10-0-133-55 kubenswrapper[2560]: W0730 00:01:51.926125    2560 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 30 00:01:51.936545 ip-10-0-133-55 kubenswrapper[2560]: W0730 00:01:51.926128    2560 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 30 00:01:51.936545 ip-10-0-133-55 kubenswrapper[2560]: W0730 00:01:51.926130    2560 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 30 00:01:51.936545 ip-10-0-133-55 kubenswrapper[2560]: W0730 00:01:51.926133    2560 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 30 00:01:51.936545 ip-10-0-133-55 kubenswrapper[2560]: W0730 00:01:51.926135    2560 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 30 00:01:51.936545 ip-10-0-133-55 kubenswrapper[2560]: W0730 00:01:51.926138    2560 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 30 00:01:51.936545 ip-10-0-133-55 kubenswrapper[2560]: W0730 00:01:51.926140    2560 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 30 00:01:51.936545 ip-10-0-133-55 kubenswrapper[2560]: W0730 00:01:51.926143    2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 30 00:01:51.936545 ip-10-0-133-55 kubenswrapper[2560]: W0730 00:01:51.926146    2560 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 30 00:01:51.936545 ip-10-0-133-55 kubenswrapper[2560]: W0730 00:01:51.926149    2560 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 30 00:01:51.936545 ip-10-0-133-55 kubenswrapper[2560]: W0730 00:01:51.926151    2560 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 30 00:01:51.936545 ip-10-0-133-55 kubenswrapper[2560]: W0730 00:01:51.926154    2560 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 30 00:01:51.936545 ip-10-0-133-55 kubenswrapper[2560]: W0730 00:01:51.926156    2560 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 30 00:01:51.936545 ip-10-0-133-55 kubenswrapper[2560]: W0730 00:01:51.926159    2560 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 30 00:01:51.936545 ip-10-0-133-55 kubenswrapper[2560]: W0730 00:01:51.926161    2560 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 30 00:01:51.937048 ip-10-0-133-55 kubenswrapper[2560]: W0730 00:01:51.926164    2560 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 30 00:01:51.937048 ip-10-0-133-55 kubenswrapper[2560]: W0730 00:01:51.926166    2560 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 30 00:01:51.937048 ip-10-0-133-55 kubenswrapper[2560]: W0730 00:01:51.926169    2560 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 30 00:01:51.937048 ip-10-0-133-55 kubenswrapper[2560]: W0730 00:01:51.926172    2560 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 30 00:01:51.937048 ip-10-0-133-55 kubenswrapper[2560]: W0730 00:01:51.926174    2560 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 30 00:01:51.937048 ip-10-0-133-55 kubenswrapper[2560]: W0730 00:01:51.926177    2560 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 30 00:01:51.937048 ip-10-0-133-55 kubenswrapper[2560]: W0730 00:01:51.926179    2560 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 30 00:01:51.937048 ip-10-0-133-55 kubenswrapper[2560]: W0730 00:01:51.926182    2560 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 30 00:01:51.937048 ip-10-0-133-55 kubenswrapper[2560]: W0730 00:01:51.926184    2560 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 30 00:01:51.937048 ip-10-0-133-55 kubenswrapper[2560]: W0730 00:01:51.926187    2560 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 30 00:01:51.937048 ip-10-0-133-55 kubenswrapper[2560]: W0730 00:01:51.926189    2560 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 30 00:01:51.937048 ip-10-0-133-55 kubenswrapper[2560]: W0730 00:01:51.926193    2560 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 30 00:01:51.937048 ip-10-0-133-55 kubenswrapper[2560]: W0730 00:01:51.926196    2560 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 30 00:01:51.937048 ip-10-0-133-55 kubenswrapper[2560]: W0730 00:01:51.926200    2560 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 30 00:01:51.937048 ip-10-0-133-55 kubenswrapper[2560]: W0730 00:01:51.926202    2560 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 30 00:01:51.937048 ip-10-0-133-55 kubenswrapper[2560]: W0730 00:01:51.926205    2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 30 00:01:51.937048 ip-10-0-133-55 kubenswrapper[2560]: W0730 00:01:51.926207    2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 30 00:01:51.937048 ip-10-0-133-55 kubenswrapper[2560]: W0730 00:01:51.926210    2560 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 30 00:01:51.937048 ip-10-0-133-55 kubenswrapper[2560]: W0730 00:01:51.926212    2560 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 30 00:01:51.937048 ip-10-0-133-55 kubenswrapper[2560]: W0730 00:01:51.926215    2560 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 30 00:01:51.937535 ip-10-0-133-55 kubenswrapper[2560]: W0730 00:01:51.926217    2560 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 30 00:01:51.937535 ip-10-0-133-55 kubenswrapper[2560]: W0730 00:01:51.926220    2560 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 30 00:01:51.937535 ip-10-0-133-55 kubenswrapper[2560]: W0730 00:01:51.926223    2560 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 30 00:01:51.937535 ip-10-0-133-55 kubenswrapper[2560]: W0730 00:01:51.926225    2560 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 30 00:01:51.937535 ip-10-0-133-55 kubenswrapper[2560]: W0730 00:01:51.926228    2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 30 00:01:51.937535 ip-10-0-133-55 kubenswrapper[2560]: W0730 00:01:51.926230    2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 30 00:01:51.937535 ip-10-0-133-55 kubenswrapper[2560]: W0730 00:01:51.926233    2560 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 30 00:01:51.937535 ip-10-0-133-55 kubenswrapper[2560]: W0730 00:01:51.926236    2560 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 30 00:01:51.937535 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:01:51.926241    2560 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 30 00:01:51.937535 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:01:51.934555    2560 server.go:529] "Kubelet version" kubeletVersion="v1.34.9"
Jul 30 00:01:51.937535 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:01:51.934569    2560 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK=""
Jul 30 00:01:51.937535 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:01:51.934588    2560 watchdog_linux.go:95] "Systemd watchdog is not enabled"
Jul 30 00:01:51.937535 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:01:51.934594    2560 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started."
Jul 30 00:01:51.937535 ip-10-0-133-55 kubenswrapper[2560]: W0730 00:01:51.934665    2560 feature_gate.go:328] unrecognized feature gate: Example
Jul 30 00:01:51.937535 ip-10-0-133-55 kubenswrapper[2560]: W0730 00:01:51.934670    2560 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 30 00:01:51.937994 ip-10-0-133-55 kubenswrapper[2560]: W0730 00:01:51.934674    2560 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 30 00:01:51.937994 ip-10-0-133-55 kubenswrapper[2560]: W0730 00:01:51.934677    2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 30 00:01:51.937994 ip-10-0-133-55 kubenswrapper[2560]: W0730 00:01:51.934681    2560 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 30 00:01:51.937994 ip-10-0-133-55 kubenswrapper[2560]: W0730 00:01:51.934683    2560 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 30 00:01:51.937994 ip-10-0-133-55 kubenswrapper[2560]: W0730 00:01:51.934686    2560 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 30 00:01:51.937994 ip-10-0-133-55 kubenswrapper[2560]: W0730 00:01:51.934689    2560 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 30 00:01:51.937994 ip-10-0-133-55 kubenswrapper[2560]: W0730 00:01:51.934691    2560 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 30 00:01:51.937994 ip-10-0-133-55 kubenswrapper[2560]: W0730 00:01:51.934694    2560 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 30 00:01:51.937994 ip-10-0-133-55 kubenswrapper[2560]: W0730 00:01:51.934697    2560 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 30 00:01:51.937994 ip-10-0-133-55 kubenswrapper[2560]: W0730 00:01:51.934699    2560 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 30 00:01:51.937994 ip-10-0-133-55 kubenswrapper[2560]: W0730 00:01:51.934702    2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 30 00:01:51.937994 ip-10-0-133-55 kubenswrapper[2560]: W0730 00:01:51.934704    2560 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 30 00:01:51.937994 ip-10-0-133-55 kubenswrapper[2560]: W0730 00:01:51.934708    2560 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 30 00:01:51.937994 ip-10-0-133-55 kubenswrapper[2560]: W0730 00:01:51.934710    2560 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 30 00:01:51.937994 ip-10-0-133-55 kubenswrapper[2560]: W0730 00:01:51.934713    2560 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 30 00:01:51.937994 ip-10-0-133-55 kubenswrapper[2560]: W0730 00:01:51.934715    2560 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 30 00:01:51.937994 ip-10-0-133-55 kubenswrapper[2560]: W0730 00:01:51.934719    2560 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 30 00:01:51.937994 ip-10-0-133-55 kubenswrapper[2560]: W0730 00:01:51.934722    2560 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 30 00:01:51.937994 ip-10-0-133-55 kubenswrapper[2560]: W0730 00:01:51.934724    2560 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 30 00:01:51.937994 ip-10-0-133-55 kubenswrapper[2560]: W0730 00:01:51.934727    2560 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 30 00:01:51.938482 ip-10-0-133-55 kubenswrapper[2560]: W0730 00:01:51.934730    2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 30 00:01:51.938482 ip-10-0-133-55 kubenswrapper[2560]: W0730 00:01:51.934732    2560 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 30 00:01:51.938482 ip-10-0-133-55 kubenswrapper[2560]: W0730 00:01:51.934735    2560 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 30 00:01:51.938482 ip-10-0-133-55 kubenswrapper[2560]: W0730 00:01:51.934737    2560 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 30 00:01:51.938482 ip-10-0-133-55 kubenswrapper[2560]: W0730 00:01:51.934740    2560 feature_gate.go:328] unrecognized feature gate: Example2
Jul 30 00:01:51.938482 ip-10-0-133-55 kubenswrapper[2560]: W0730 00:01:51.934742    2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 30 00:01:51.938482 ip-10-0-133-55 kubenswrapper[2560]: W0730 00:01:51.934745    2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 30 00:01:51.938482 ip-10-0-133-55 kubenswrapper[2560]: W0730 00:01:51.934749    2560 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 30 00:01:51.938482 ip-10-0-133-55 kubenswrapper[2560]: W0730 00:01:51.934752    2560 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 30 00:01:51.938482 ip-10-0-133-55 kubenswrapper[2560]: W0730 00:01:51.934754    2560 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 30 00:01:51.938482 ip-10-0-133-55 kubenswrapper[2560]: W0730 00:01:51.934757    2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 30 00:01:51.938482 ip-10-0-133-55 kubenswrapper[2560]: W0730 00:01:51.934760    2560 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 30 00:01:51.938482 ip-10-0-133-55 kubenswrapper[2560]: W0730 00:01:51.934763    2560 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 30 00:01:51.938482 ip-10-0-133-55 kubenswrapper[2560]: W0730 00:01:51.934766    2560 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 30 00:01:51.938482 ip-10-0-133-55 kubenswrapper[2560]: W0730 00:01:51.934768    2560 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 30 00:01:51.938482 ip-10-0-133-55 kubenswrapper[2560]: W0730 00:01:51.934771    2560 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 30 00:01:51.938482 ip-10-0-133-55 kubenswrapper[2560]: W0730 00:01:51.934775    2560 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 30 00:01:51.938482 ip-10-0-133-55 kubenswrapper[2560]: W0730 00:01:51.934779    2560 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 30 00:01:51.938482 ip-10-0-133-55 kubenswrapper[2560]: W0730 00:01:51.934781    2560 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 30 00:01:51.938482 ip-10-0-133-55 kubenswrapper[2560]: W0730 00:01:51.934784    2560 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 30 00:01:51.938987 ip-10-0-133-55 kubenswrapper[2560]: W0730 00:01:51.934787    2560 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 30 00:01:51.938987 ip-10-0-133-55 kubenswrapper[2560]: W0730 00:01:51.934790    2560 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 30 00:01:51.938987 ip-10-0-133-55 kubenswrapper[2560]: W0730 00:01:51.934792    2560 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 30 00:01:51.938987 ip-10-0-133-55 kubenswrapper[2560]: W0730 00:01:51.934795    2560 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 30 00:01:51.938987 ip-10-0-133-55 kubenswrapper[2560]: W0730 00:01:51.934798    2560 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 30 00:01:51.938987 ip-10-0-133-55 kubenswrapper[2560]: W0730 00:01:51.934801    2560 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 30 00:01:51.938987 ip-10-0-133-55 kubenswrapper[2560]: W0730 00:01:51.934804    2560 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 30 00:01:51.938987 ip-10-0-133-55 kubenswrapper[2560]: W0730 00:01:51.934806    2560 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 30 00:01:51.938987 ip-10-0-133-55 kubenswrapper[2560]: W0730 00:01:51.934809    2560 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 30 00:01:51.938987 ip-10-0-133-55 kubenswrapper[2560]: W0730 00:01:51.934811    2560 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 30 00:01:51.938987 ip-10-0-133-55 kubenswrapper[2560]: W0730 00:01:51.934814    2560 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 30 00:01:51.938987 ip-10-0-133-55 kubenswrapper[2560]: W0730 00:01:51.934816    2560 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 30 00:01:51.938987 ip-10-0-133-55 kubenswrapper[2560]: W0730 00:01:51.934819    2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 30 00:01:51.938987 ip-10-0-133-55 kubenswrapper[2560]: W0730 00:01:51.934821    2560 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 30 00:01:51.938987 ip-10-0-133-55 kubenswrapper[2560]: W0730 00:01:51.934824    2560 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 30 00:01:51.938987 ip-10-0-133-55 kubenswrapper[2560]: W0730 00:01:51.934828    2560 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 30 00:01:51.938987 ip-10-0-133-55 kubenswrapper[2560]: W0730 00:01:51.934832    2560 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 30 00:01:51.938987 ip-10-0-133-55 kubenswrapper[2560]: W0730 00:01:51.934834    2560 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 30 00:01:51.938987 ip-10-0-133-55 kubenswrapper[2560]: W0730 00:01:51.934837    2560 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 30 00:01:51.938987 ip-10-0-133-55 kubenswrapper[2560]: W0730 00:01:51.934841    2560 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 30 00:01:51.939476 ip-10-0-133-55 kubenswrapper[2560]: W0730 00:01:51.934844    2560 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 30 00:01:51.939476 ip-10-0-133-55 kubenswrapper[2560]: W0730 00:01:51.934846    2560 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 30 00:01:51.939476 ip-10-0-133-55 kubenswrapper[2560]: W0730 00:01:51.934849    2560 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 30 00:01:51.939476 ip-10-0-133-55 kubenswrapper[2560]: W0730 00:01:51.934853    2560 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 30 00:01:51.939476 ip-10-0-133-55 kubenswrapper[2560]: W0730 00:01:51.934856    2560 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 30 00:01:51.939476 ip-10-0-133-55 kubenswrapper[2560]: W0730 00:01:51.934859    2560 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 30 00:01:51.939476 ip-10-0-133-55 kubenswrapper[2560]: W0730 00:01:51.934862    2560 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 30 00:01:51.939476 ip-10-0-133-55 kubenswrapper[2560]: W0730 00:01:51.934865    2560 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 30 00:01:51.939476 ip-10-0-133-55 kubenswrapper[2560]: W0730 00:01:51.934867    2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 30 00:01:51.939476 ip-10-0-133-55 kubenswrapper[2560]: W0730 00:01:51.934870    2560 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 30 00:01:51.939476 ip-10-0-133-55 kubenswrapper[2560]: W0730 00:01:51.934873    2560 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 30 00:01:51.939476 ip-10-0-133-55 kubenswrapper[2560]: W0730 00:01:51.934875    2560 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 30 00:01:51.939476 ip-10-0-133-55 kubenswrapper[2560]: W0730 00:01:51.934878    2560 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 30 00:01:51.939476 ip-10-0-133-55 kubenswrapper[2560]: W0730 00:01:51.934880    2560 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 30 00:01:51.939476 ip-10-0-133-55 kubenswrapper[2560]: W0730 00:01:51.934884    2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 30 00:01:51.939476 ip-10-0-133-55 kubenswrapper[2560]: W0730 00:01:51.934886    2560 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 30 00:01:51.939476 ip-10-0-133-55 kubenswrapper[2560]: W0730 00:01:51.934888    2560 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 30 00:01:51.939476 ip-10-0-133-55 kubenswrapper[2560]: W0730 00:01:51.934891    2560 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 30 00:01:51.939476 ip-10-0-133-55 kubenswrapper[2560]: W0730 00:01:51.934894    2560 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 30 00:01:51.939948 ip-10-0-133-55 kubenswrapper[2560]: W0730 00:01:51.934896    2560 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 30 00:01:51.939948 ip-10-0-133-55 kubenswrapper[2560]: W0730 00:01:51.934899    2560 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 30 00:01:51.939948 ip-10-0-133-55 kubenswrapper[2560]: W0730 00:01:51.934901    2560 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 30 00:01:51.939948 ip-10-0-133-55 kubenswrapper[2560]: W0730 00:01:51.934904    2560 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 30 00:01:51.939948 ip-10-0-133-55 kubenswrapper[2560]: W0730 00:01:51.934907    2560 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 30 00:01:51.939948 ip-10-0-133-55 kubenswrapper[2560]: W0730 00:01:51.934910    2560 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 30 00:01:51.939948 ip-10-0-133-55 kubenswrapper[2560]: W0730 00:01:51.934912    2560 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 30 00:01:51.939948 ip-10-0-133-55 kubenswrapper[2560]: W0730 00:01:51.934915    2560 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 30 00:01:51.939948 ip-10-0-133-55 kubenswrapper[2560]: W0730 00:01:51.934917    2560 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 30 00:01:51.939948 ip-10-0-133-55 kubenswrapper[2560]: W0730 00:01:51.934920    2560 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 30 00:01:51.939948 ip-10-0-133-55 kubenswrapper[2560]: W0730 00:01:51.934922    2560 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 30 00:01:51.939948 ip-10-0-133-55 kubenswrapper[2560]: W0730 00:01:51.934925    2560 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 30 00:01:51.939948 ip-10-0-133-55 kubenswrapper[2560]: W0730 00:01:51.934927    2560 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 30 00:01:51.939948 ip-10-0-133-55 kubenswrapper[2560]: W0730 00:01:51.934930    2560 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 30 00:01:51.939948 ip-10-0-133-55 kubenswrapper[2560]: W0730 00:01:51.934933    2560 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 30 00:01:51.939948 ip-10-0-133-55 kubenswrapper[2560]: W0730 00:01:51.934936    2560 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 30 00:01:51.939948 ip-10-0-133-55 kubenswrapper[2560]: W0730 00:01:51.934938    2560 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 30 00:01:51.939948 ip-10-0-133-55 kubenswrapper[2560]: W0730 00:01:51.934941    2560 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 30 00:01:51.940383 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:01:51.934946    2560 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 30 00:01:51.940383 ip-10-0-133-55 kubenswrapper[2560]: W0730 00:01:51.935061    2560 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 30 00:01:51.940383 ip-10-0-133-55 kubenswrapper[2560]: W0730 00:01:51.935066    2560 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 30 00:01:51.940383 ip-10-0-133-55 kubenswrapper[2560]: W0730 00:01:51.935069    2560 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 30 00:01:51.940383 ip-10-0-133-55 kubenswrapper[2560]: W0730 00:01:51.935072    2560 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 30 00:01:51.940383 ip-10-0-133-55 kubenswrapper[2560]: W0730 00:01:51.935075    2560 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 30 00:01:51.940383 ip-10-0-133-55 kubenswrapper[2560]: W0730 00:01:51.935078    2560 feature_gate.go:328] unrecognized feature gate: Example
Jul 30 00:01:51.940383 ip-10-0-133-55 kubenswrapper[2560]: W0730 00:01:51.935081    2560 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 30 00:01:51.940383 ip-10-0-133-55 kubenswrapper[2560]: W0730 00:01:51.935083    2560 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 30 00:01:51.940383 ip-10-0-133-55 kubenswrapper[2560]: W0730 00:01:51.935086    2560 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 30 00:01:51.940383 ip-10-0-133-55 kubenswrapper[2560]: W0730 00:01:51.935088    2560 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 30 00:01:51.940383 ip-10-0-133-55 kubenswrapper[2560]: W0730 00:01:51.935091    2560 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 30 00:01:51.940383 ip-10-0-133-55 kubenswrapper[2560]: W0730 00:01:51.935094    2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 30 00:01:51.940383 ip-10-0-133-55 kubenswrapper[2560]: W0730 00:01:51.935096    2560 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 30 00:01:51.940383 ip-10-0-133-55 kubenswrapper[2560]: W0730 00:01:51.935099    2560 feature_gate.go:328] unrecognized feature gate: Example2
Jul 30 00:01:51.940770 ip-10-0-133-55 kubenswrapper[2560]: W0730 00:01:51.935102    2560 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 30 00:01:51.940770 ip-10-0-133-55 kubenswrapper[2560]: W0730 00:01:51.935104    2560 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 30 00:01:51.940770 ip-10-0-133-55 kubenswrapper[2560]: W0730 00:01:51.935107    2560 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 30 00:01:51.940770 ip-10-0-133-55 kubenswrapper[2560]: W0730 00:01:51.935110    2560 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 30 00:01:51.940770 ip-10-0-133-55 kubenswrapper[2560]: W0730 00:01:51.935112    2560 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 30 00:01:51.940770 ip-10-0-133-55 kubenswrapper[2560]: W0730 00:01:51.935115    2560 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 30 00:01:51.940770 ip-10-0-133-55 kubenswrapper[2560]: W0730 00:01:51.935117    2560 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 30 00:01:51.940770 ip-10-0-133-55 kubenswrapper[2560]: W0730 00:01:51.935120    2560 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 30 00:01:51.940770 ip-10-0-133-55 kubenswrapper[2560]: W0730 00:01:51.935122    2560 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 30 00:01:51.940770 ip-10-0-133-55 kubenswrapper[2560]: W0730 00:01:51.935125    2560 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 30 00:01:51.940770 ip-10-0-133-55 kubenswrapper[2560]: W0730 00:01:51.935127    2560 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 30 00:01:51.940770 ip-10-0-133-55 kubenswrapper[2560]: W0730 00:01:51.935130    2560 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 30 00:01:51.940770 ip-10-0-133-55 kubenswrapper[2560]: W0730 00:01:51.935133    2560 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 30 00:01:51.940770 ip-10-0-133-55 kubenswrapper[2560]: W0730 00:01:51.935135    2560 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 30 00:01:51.940770 ip-10-0-133-55 kubenswrapper[2560]: W0730 00:01:51.935138    2560 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 30 00:01:51.940770 ip-10-0-133-55 kubenswrapper[2560]: W0730 00:01:51.935140    2560 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 30 00:01:51.940770 ip-10-0-133-55 kubenswrapper[2560]: W0730 00:01:51.935143    2560 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 30 00:01:51.940770 ip-10-0-133-55 kubenswrapper[2560]: W0730 00:01:51.935145    2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 30 00:01:51.940770 ip-10-0-133-55 kubenswrapper[2560]: W0730 00:01:51.935148    2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 30 00:01:51.940770 ip-10-0-133-55 kubenswrapper[2560]: W0730 00:01:51.935150    2560 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 30 00:01:51.941288 ip-10-0-133-55 kubenswrapper[2560]: W0730 00:01:51.935153    2560 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 30 00:01:51.941288 ip-10-0-133-55 kubenswrapper[2560]: W0730 00:01:51.935156    2560 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 30 00:01:51.941288 ip-10-0-133-55 kubenswrapper[2560]: W0730 00:01:51.935158    2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 30 00:01:51.941288 ip-10-0-133-55 kubenswrapper[2560]: W0730 00:01:51.935161    2560 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 30 00:01:51.941288 ip-10-0-133-55 kubenswrapper[2560]: W0730 00:01:51.935163    2560 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 30 00:01:51.941288 ip-10-0-133-55 kubenswrapper[2560]: W0730 00:01:51.935166    2560 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 30 00:01:51.941288 ip-10-0-133-55 kubenswrapper[2560]: W0730 00:01:51.935168    2560 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 30 00:01:51.941288 ip-10-0-133-55 kubenswrapper[2560]: W0730 00:01:51.935171    2560 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 30 00:01:51.941288 ip-10-0-133-55 kubenswrapper[2560]: W0730 00:01:51.935173    2560 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 30 00:01:51.941288 ip-10-0-133-55 kubenswrapper[2560]: W0730 00:01:51.935176    2560 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 30 00:01:51.941288 ip-10-0-133-55 kubenswrapper[2560]: W0730 00:01:51.935178    2560 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 30 00:01:51.941288 ip-10-0-133-55 kubenswrapper[2560]: W0730 00:01:51.935181    2560 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 30 00:01:51.941288 ip-10-0-133-55 kubenswrapper[2560]: W0730 00:01:51.935184    2560 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 30 00:01:51.941288 ip-10-0-133-55 kubenswrapper[2560]: W0730 00:01:51.935186    2560 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 30 00:01:51.941288 ip-10-0-133-55 kubenswrapper[2560]: W0730 00:01:51.935190    2560 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 30 00:01:51.941288 ip-10-0-133-55 kubenswrapper[2560]: W0730 00:01:51.935194    2560 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 30 00:01:51.941288 ip-10-0-133-55 kubenswrapper[2560]: W0730 00:01:51.935198    2560 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 30 00:01:51.941288 ip-10-0-133-55 kubenswrapper[2560]: W0730 00:01:51.935201    2560 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 30 00:01:51.941288 ip-10-0-133-55 kubenswrapper[2560]: W0730 00:01:51.935203    2560 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 30 00:01:51.941906 ip-10-0-133-55 kubenswrapper[2560]: W0730 00:01:51.935206    2560 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 30 00:01:51.941906 ip-10-0-133-55 kubenswrapper[2560]: W0730 00:01:51.935209    2560 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 30 00:01:51.941906 ip-10-0-133-55 kubenswrapper[2560]: W0730 00:01:51.935211    2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 30 00:01:51.941906 ip-10-0-133-55 kubenswrapper[2560]: W0730 00:01:51.935214    2560 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 30 00:01:51.941906 ip-10-0-133-55 kubenswrapper[2560]: W0730 00:01:51.935216    2560 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 30 00:01:51.941906 ip-10-0-133-55 kubenswrapper[2560]: W0730 00:01:51.935219    2560 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 30 00:01:51.941906 ip-10-0-133-55 kubenswrapper[2560]: W0730 00:01:51.935221    2560 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 30 00:01:51.941906 ip-10-0-133-55 kubenswrapper[2560]: W0730 00:01:51.935224    2560 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 30 00:01:51.941906 ip-10-0-133-55 kubenswrapper[2560]: W0730 00:01:51.935226    2560 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 30 00:01:51.941906 ip-10-0-133-55 kubenswrapper[2560]: W0730 00:01:51.935229    2560 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 30 00:01:51.941906 ip-10-0-133-55 kubenswrapper[2560]: W0730 00:01:51.935231    2560 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 30 00:01:51.941906 ip-10-0-133-55 kubenswrapper[2560]: W0730 00:01:51.935234    2560 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 30 00:01:51.941906 ip-10-0-133-55 kubenswrapper[2560]: W0730 00:01:51.935236    2560 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 30 00:01:51.941906 ip-10-0-133-55 kubenswrapper[2560]: W0730 00:01:51.935239    2560 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 30 00:01:51.941906 ip-10-0-133-55 kubenswrapper[2560]: W0730 00:01:51.935242    2560 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 30 00:01:51.941906 ip-10-0-133-55 kubenswrapper[2560]: W0730 00:01:51.935244    2560 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 30 00:01:51.941906 ip-10-0-133-55 kubenswrapper[2560]: W0730 00:01:51.935246    2560 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 30 00:01:51.941906 ip-10-0-133-55 kubenswrapper[2560]: W0730 00:01:51.935249    2560 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 30 00:01:51.941906 ip-10-0-133-55 kubenswrapper[2560]: W0730 00:01:51.935251    2560 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 30 00:01:51.941906 ip-10-0-133-55 kubenswrapper[2560]: W0730 00:01:51.935254    2560 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 30 00:01:51.942392 ip-10-0-133-55 kubenswrapper[2560]: W0730 00:01:51.935256    2560 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 30 00:01:51.942392 ip-10-0-133-55 kubenswrapper[2560]: W0730 00:01:51.935259    2560 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 30 00:01:51.942392 ip-10-0-133-55 kubenswrapper[2560]: W0730 00:01:51.935262    2560 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 30 00:01:51.942392 ip-10-0-133-55 kubenswrapper[2560]: W0730 00:01:51.935264    2560 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 30 00:01:51.942392 ip-10-0-133-55 kubenswrapper[2560]: W0730 00:01:51.935267    2560 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 30 00:01:51.942392 ip-10-0-133-55 kubenswrapper[2560]: W0730 00:01:51.935270    2560 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 30 00:01:51.942392 ip-10-0-133-55 kubenswrapper[2560]: W0730 00:01:51.935272    2560 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 30 00:01:51.942392 ip-10-0-133-55 kubenswrapper[2560]: W0730 00:01:51.935275    2560 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 30 00:01:51.942392 ip-10-0-133-55 kubenswrapper[2560]: W0730 00:01:51.935278    2560 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 30 00:01:51.942392 ip-10-0-133-55 kubenswrapper[2560]: W0730 00:01:51.935280    2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 30 00:01:51.942392 ip-10-0-133-55 kubenswrapper[2560]: W0730 00:01:51.935283    2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 30 00:01:51.942392 ip-10-0-133-55 kubenswrapper[2560]: W0730 00:01:51.935286    2560 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 30 00:01:51.942392 ip-10-0-133-55 kubenswrapper[2560]: W0730 00:01:51.935288    2560 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 30 00:01:51.942392 ip-10-0-133-55 kubenswrapper[2560]: W0730 00:01:51.935290    2560 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 30 00:01:51.942392 ip-10-0-133-55 kubenswrapper[2560]: W0730 00:01:51.935293    2560 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 30 00:01:51.942392 ip-10-0-133-55 kubenswrapper[2560]: W0730 00:01:51.935295    2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 30 00:01:51.942392 ip-10-0-133-55 kubenswrapper[2560]: W0730 00:01:51.935298    2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 30 00:01:51.942392 ip-10-0-133-55 kubenswrapper[2560]: W0730 00:01:51.935300    2560 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 30 00:01:51.942392 ip-10-0-133-55 kubenswrapper[2560]: W0730 00:01:51.935303    2560 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 30 00:01:51.942867 ip-10-0-133-55 kubenswrapper[2560]: W0730 00:01:51.935307    2560 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 30 00:01:51.942867 ip-10-0-133-55 kubenswrapper[2560]: W0730 00:01:51.935310    2560 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 30 00:01:51.942867 ip-10-0-133-55 kubenswrapper[2560]: W0730 00:01:51.935313    2560 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 30 00:01:51.942867 ip-10-0-133-55 kubenswrapper[2560]: W0730 00:01:51.935316    2560 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 30 00:01:51.942867 ip-10-0-133-55 kubenswrapper[2560]: W0730 00:01:51.935319    2560 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 30 00:01:51.942867 ip-10-0-133-55 kubenswrapper[2560]: W0730 00:01:51.935323    2560 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 30 00:01:51.942867 ip-10-0-133-55 kubenswrapper[2560]: W0730 00:01:51.935326    2560 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 30 00:01:51.942867 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:01:51.935331    2560 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 30 00:01:51.942867 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:01:51.935432    2560 server.go:962] "Client rotation is on, will bootstrap in background"
Jul 30 00:01:51.942867 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:01:51.937488    2560 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir"
Jul 30 00:01:51.942867 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:01:51.938847    2560 server.go:1019] "Starting client certificate rotation"
Jul 30 00:01:51.942867 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:01:51.938948    2560 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet"
Jul 30 00:01:51.942867 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:01:51.938985    2560 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet"
Jul 30 00:01:51.943187 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:01:51.941185    2560 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Jul 30 00:01:51.945200 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:01:51.945182    2560 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Jul 30 00:01:51.956564 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:01:51.956549    2560 log.go:25] "Validated CRI v1 runtime API"
Jul 30 00:01:51.958868 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:01:51.958853    2560 log.go:25] "Validated CRI v1 image API"
Jul 30 00:01:51.959657 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:01:51.959642    2560 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd"
Jul 30 00:01:51.964476 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:01:51.964456    2560 fs.go:135] Filesystem UUIDs: map[1d53d632-493c-4ca8-b057-d8a3b5c8d334:/dev/nvme0n1p3 7B77-95E7:/dev/nvme0n1p2 912e2763-5cc2-4529-a541-2859788ea649:/dev/nvme0n1p4]
Jul 30 00:01:51.964534 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:01:51.964477    2560 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}]
Jul 30 00:01:51.970615 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:01:51.970472    2560 manager.go:216] Machine: {Timestamp:2026-07-30 00:01:51.969159515 +0000 UTC m=+0.294086209 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3099282 MemoryCapacity:33164496896 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec22d2a1c93e882d62ebeb88674df9e1 SystemUUID:ec22d2a1-c93e-882d-62eb-eb88674df9e1 BootID:26125c54-07df-41ba-9c04-6dbbe6ce2f6f Filesystems:[{Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6111232 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582250496 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582246400 Type:vfs Inodes:4048400 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632902656 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:c8:7c:23:98:ed Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:c8:7c:23:98:ed Speed:0 Mtu:9001} {Name:ovs-system MacAddress:66:b2:32:fc:a1:8e Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164496896 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None}
Jul 30 00:01:51.970615 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:01:51.970612    2560 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available.
Jul 30 00:01:51.970734 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:01:51.970702    2560 manager.go:232] Version: {KernelVersion:5.14.0-570.129.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260717-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:}
Jul 30 00:01:51.971578 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:01:51.971556    2560 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[]
Jul 30 00:01:51.971861 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:01:51.971582    2560 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-133-55.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2}
Jul 30 00:01:51.973278 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:01:51.972791    2560 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Jul 30 00:01:51.974431 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:01:51.974410    2560 topology_manager.go:138] "Creating topology manager with none policy"
Jul 30 00:01:51.974531 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:01:51.974443    2560 container_manager_linux.go:309] "Creating device plugin manager"
Jul 30 00:01:51.974531 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:01:51.974455    2560 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock"
Jul 30 00:01:51.975249 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:01:51.975232    2560 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock"
Jul 30 00:01:51.976557 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:01:51.976545    2560 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager"
Jul 30 00:01:51.980415 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:01:51.980404    2560 state_mem.go:36] "Initialized new in-memory state store"
Jul 30 00:01:51.980521 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:01:51.980513    2560 server.go:1240] "Using root directory" path="/var/lib/kubelet"
Jul 30 00:01:51.980560 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:01:51.980541    2560 kubelet.go:486] "Attempting to sync node with API server"
Jul 30 00:01:51.980560 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:01:51.980551    2560 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests"
Jul 30 00:01:51.980622 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:01:51.980565    2560 file.go:69] "Watching path" path="/etc/kubernetes/manifests"
Jul 30 00:01:51.980622 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:01:51.980574    2560 kubelet.go:398] "Adding apiserver pod source"
Jul 30 00:01:51.980622 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:01:51.980582    2560 apiserver.go:42] "Waiting for node sync before watching apiserver pods"
Jul 30 00:01:51.980914 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:01:51.980901    2560 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Jul 30 00:01:51.980980 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:01:51.980922    2560 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Jul 30 00:01:51.983389 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:01:51.983373    2560 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.10-2.rhaos4.21.git83ee25b.el9" apiVersion="v1"
Jul 30 00:01:51.985497 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:01:51.985481    2560 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled"
Jul 30 00:01:51.985573 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:01:51.985518    2560 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled"
Jul 30 00:01:51.986743 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:01:51.986730    2560 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume"
Jul 30 00:01:51.986820 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:01:51.986749    2560 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir"
Jul 30 00:01:51.986820 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:01:51.986760    2560 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo"
Jul 30 00:01:51.986820 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:01:51.986768    2560 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path"
Jul 30 00:01:51.986820 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:01:51.986782    2560 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs"
Jul 30 00:01:51.986820 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:01:51.986791    2560 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret"
Jul 30 00:01:51.986820 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:01:51.986804    2560 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi"
Jul 30 00:01:51.986820 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:01:51.986812    2560 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api"
Jul 30 00:01:51.986820 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:01:51.986822    2560 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc"
Jul 30 00:01:51.987087 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:01:51.986831    2560 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap"
Jul 30 00:01:51.987087 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:01:51.986843    2560 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected"
Jul 30 00:01:51.987087 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:01:51.986852    2560 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume"
Jul 30 00:01:51.987593 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:01:51.987570    2560 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi"
Jul 30 00:01:51.987665 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:01:51.987596    2560 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image"
Jul 30 00:01:51.990728 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:01:51.990713    2560 server.go:1268] "Started kubelet"
Jul 30 00:01:51.990812 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:01:51.990790    2560 server.go:180] "Starting to listen" address="0.0.0.0" port=10250
Jul 30 00:01:51.991018 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:01:51.990956    2560 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10
Jul 30 00:01:51.991119 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:01:51.991039    2560 server_v1.go:49] "podresources" method="list" useActivePods=true
Jul 30 00:01:51.991386 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:01:51.991367    2560 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-133-55.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope
Jul 30 00:01:51.991454 ip-10-0-133-55 kubenswrapper[2560]: E0730 00:01:51.991377    2560 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service"
Jul 30 00:01:51.991525 ip-10-0-133-55 kubenswrapper[2560]: E0730 00:01:51.991510    2560 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-133-55.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node"
Jul 30 00:01:51.992727 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:01:51.992708    2560 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock"
Jul 30 00:01:51.992862 ip-10-0-133-55 systemd[1]: Started Kubernetes Kubelet.
Jul 30 00:01:51.994251 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:01:51.994235    2560 server.go:310] "Adding debug handlers to kubelet server"
Jul 30 00:01:51.994959 ip-10-0-133-55 kubenswrapper[2560]: E0730 00:01:51.994938    2560 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache"
Jul 30 00:01:51.997204 ip-10-0-133-55 kubenswrapper[2560]: E0730 00:01:51.996350    2560 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-133-55.ec2.internal.18c6e84b33f24c2f  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-133-55.ec2.internal,UID:ip-10-0-133-55.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-133-55.ec2.internal,},FirstTimestamp:2026-07-30 00:01:51.990688815 +0000 UTC m=+0.315615507,LastTimestamp:2026-07-30 00:01:51.990688815 +0000 UTC m=+0.315615507,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-133-55.ec2.internal,}"
Jul 30 00:01:52.000124 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:01:52.000108    2560 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer"
Jul 30 00:01:52.000584 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:01:52.000117    2560 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving"
Jul 30 00:01:52.000772 ip-10-0-133-55 kubenswrapper[2560]: E0730 00:01:52.000647    2560 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-133-55.ec2.internal\" not found"
Jul 30 00:01:52.000918 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:01:52.000891    2560 volume_manager.go:311] "The desired_state_of_world populator starts"
Jul 30 00:01:52.001004 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:01:52.000934    2560 volume_manager.go:313] "Starting Kubelet Volume Manager"
Jul 30 00:01:52.001083 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:01:52.000911    2560 desired_state_of_world_populator.go:146] "Desired state populator starts to run"
Jul 30 00:01:52.001797 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:01:52.001696    2560 reconstruct.go:97] "Volume reconstruction finished"
Jul 30 00:01:52.001797 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:01:52.001708    2560 reconciler.go:29] "Reconciler: start to sync state"
Jul 30 00:01:52.001970 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:01:52.001827    2560 factory.go:55] Registering systemd factory
Jul 30 00:01:52.001970 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:01:52.001841    2560 factory.go:223] Registration of the systemd container factory successfully
Jul 30 00:01:52.002108 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:01:52.002091    2560 factory.go:153] Registering CRI-O factory
Jul 30 00:01:52.002445 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:01:52.002433    2560 factory.go:223] Registration of the crio container factory successfully
Jul 30 00:01:52.002619 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:01:52.002563    2560 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory
Jul 30 00:01:52.002714 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:01:52.002647    2560 factory.go:103] Registering Raw factory
Jul 30 00:01:52.002714 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:01:52.002663    2560 manager.go:1196] Started watching for new ooms in manager
Jul 30 00:01:52.003096 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:01:52.003083    2560 manager.go:349] Starting recovery of all containers
Jul 30 00:01:52.004417 ip-10-0-133-55 kubenswrapper[2560]: E0730 00:01:52.004393    2560 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver"
Jul 30 00:01:52.004562 ip-10-0-133-55 kubenswrapper[2560]: E0730 00:01:52.004517    2560 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-133-55.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms"
Jul 30 00:01:52.010563 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:01:52.010537    2560 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-58dwp"
Jul 30 00:01:52.014715 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:01:52.014694    2560 manager.go:354] Recovery completed
Jul 30 00:01:52.017498 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:01:52.017479    2560 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-58dwp"
Jul 30 00:01:52.018803 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:01:52.018790    2560 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 30 00:01:52.020958 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:01:52.020939    2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-55.ec2.internal" event="NodeHasSufficientMemory"
Jul 30 00:01:52.021025 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:01:52.020974    2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-55.ec2.internal" event="NodeHasNoDiskPressure"
Jul 30 00:01:52.021025 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:01:52.020990    2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-55.ec2.internal" event="NodeHasSufficientPID"
Jul 30 00:01:52.021490 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:01:52.021475    2560 cpu_manager.go:222] "Starting CPU manager" policy="none"
Jul 30 00:01:52.021490 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:01:52.021486    2560 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 30 00:01:52.021628 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:01:52.021489    2560 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s"
Jul 30 00:01:52.021628 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:01:52.021520    2560 state_mem.go:36] "Initialized new in-memory state store"
Jul 30 00:01:52.023354 ip-10-0-133-55 kubenswrapper[2560]: E0730 00:01:52.023275    2560 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-133-55.ec2.internal.18c6e84b35c02a9c  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-133-55.ec2.internal,UID:ip-10-0-133-55.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-133-55.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-133-55.ec2.internal,},FirstTimestamp:2026-07-30 00:01:52.020957852 +0000 UTC m=+0.345884545,LastTimestamp:2026-07-30 00:01:52.020957852 +0000 UTC m=+0.345884545,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-133-55.ec2.internal,}"
Jul 30 00:01:52.023452 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:01:52.023430    2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-55.ec2.internal" event="NodeHasSufficientMemory"
Jul 30 00:01:52.023502 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:01:52.023458    2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-55.ec2.internal" event="NodeHasNoDiskPressure"
Jul 30 00:01:52.023502 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:01:52.023473    2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-55.ec2.internal" event="NodeHasSufficientPID"
Jul 30 00:01:52.023502 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:01:52.023487    2560 policy_none.go:49] "None policy: Start"
Jul 30 00:01:52.023502 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:01:52.023500    2560 memory_manager.go:187] "Starting memorymanager" policy="None"
Jul 30 00:01:52.023628 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:01:52.023511    2560 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint"
Jul 30 00:01:52.025491 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:01:52.025480    2560 policy_none.go:47] "Start"
Jul 30 00:01:52.062220 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:01:52.062115    2560 manager.go:337] "Starting Device Plugin manager"
Jul 30 00:01:52.062300 ip-10-0-133-55 kubenswrapper[2560]: E0730 00:01:52.062238    2560 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint"
Jul 30 00:01:52.062300 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:01:52.062252    2560 server.go:87] "Starting device plugin registration server"
Jul 30 00:01:52.062475 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:01:52.062463    2560 eviction_manager.go:189] "Eviction manager: starting control loop"
Jul 30 00:01:52.062529 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:01:52.062478    2560 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s"
Jul 30 00:01:52.062868 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:01:52.062700    2560 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry"
Jul 30 00:01:52.062868 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:01:52.062777    2560 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts"
Jul 30 00:01:52.062868 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:01:52.062785    2560 plugin_manager.go:118] "Starting Kubelet Plugin Manager"
Jul 30 00:01:52.063115 ip-10-0-133-55 kubenswrapper[2560]: E0730 00:01:52.063097    2560 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\""
Jul 30 00:01:52.063167 ip-10-0-133-55 kubenswrapper[2560]: E0730 00:01:52.063151    2560 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-133-55.ec2.internal\" not found"
Jul 30 00:01:52.131339 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:01:52.131307    2560 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4"
Jul 30 00:01:52.133486 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:01:52.132581    2560 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6"
Jul 30 00:01:52.133486 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:01:52.132630    2560 status_manager.go:244] "Starting to sync pod status with apiserver"
Jul 30 00:01:52.133486 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:01:52.132653    2560 kubelet.go:2448] "Starting kubelet main sync loop"
Jul 30 00:01:52.133486 ip-10-0-133-55 kubenswrapper[2560]: E0730 00:01:52.132686    2560 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful"
Jul 30 00:01:52.135181 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:01:52.135164    2560 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 30 00:01:52.162852 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:01:52.162828    2560 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 30 00:01:52.163732 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:01:52.163713    2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-55.ec2.internal" event="NodeHasSufficientMemory"
Jul 30 00:01:52.163815 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:01:52.163745    2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-55.ec2.internal" event="NodeHasNoDiskPressure"
Jul 30 00:01:52.163815 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:01:52.163760    2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-55.ec2.internal" event="NodeHasSufficientPID"
Jul 30 00:01:52.163815 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:01:52.163785    2560 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-133-55.ec2.internal"
Jul 30 00:01:52.171693 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:01:52.171630    2560 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-133-55.ec2.internal"
Jul 30 00:01:52.171693 ip-10-0-133-55 kubenswrapper[2560]: E0730 00:01:52.171651    2560 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-133-55.ec2.internal\": node \"ip-10-0-133-55.ec2.internal\" not found"
Jul 30 00:01:52.191322 ip-10-0-133-55 kubenswrapper[2560]: E0730 00:01:52.191285    2560 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-133-55.ec2.internal\" not found"
Jul 30 00:01:52.232753 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:01:52.232729    2560 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-55.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-133-55.ec2.internal"]
Jul 30 00:01:52.232832 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:01:52.232786    2560 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 30 00:01:52.233623 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:01:52.233591    2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-55.ec2.internal" event="NodeHasSufficientMemory"
Jul 30 00:01:52.233696 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:01:52.233637    2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-55.ec2.internal" event="NodeHasNoDiskPressure"
Jul 30 00:01:52.233696 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:01:52.233650    2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-55.ec2.internal" event="NodeHasSufficientPID"
Jul 30 00:01:52.236384 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:01:52.236372    2560 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 30 00:01:52.236489 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:01:52.236474    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-55.ec2.internal"
Jul 30 00:01:52.236529 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:01:52.236502    2560 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 30 00:01:52.237050 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:01:52.237033    2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-55.ec2.internal" event="NodeHasSufficientMemory"
Jul 30 00:01:52.237125 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:01:52.237051    2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-55.ec2.internal" event="NodeHasSufficientMemory"
Jul 30 00:01:52.237125 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:01:52.237071    2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-55.ec2.internal" event="NodeHasNoDiskPressure"
Jul 30 00:01:52.237125 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:01:52.237080    2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-55.ec2.internal" event="NodeHasSufficientPID"
Jul 30 00:01:52.237125 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:01:52.237055    2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-55.ec2.internal" event="NodeHasNoDiskPressure"
Jul 30 00:01:52.237125 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:01:52.237113    2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-55.ec2.internal" event="NodeHasSufficientPID"
Jul 30 00:01:52.239283 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:01:52.239270    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-133-55.ec2.internal"
Jul 30 00:01:52.239341 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:01:52.239295    2560 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 30 00:01:52.239952 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:01:52.239936    2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-55.ec2.internal" event="NodeHasSufficientMemory"
Jul 30 00:01:52.240021 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:01:52.239958    2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-55.ec2.internal" event="NodeHasNoDiskPressure"
Jul 30 00:01:52.240021 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:01:52.239967    2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-55.ec2.internal" event="NodeHasSufficientPID"
Jul 30 00:01:52.267347 ip-10-0-133-55 kubenswrapper[2560]: E0730 00:01:52.267329    2560 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-133-55.ec2.internal\" not found" node="ip-10-0-133-55.ec2.internal"
Jul 30 00:01:52.271689 ip-10-0-133-55 kubenswrapper[2560]: E0730 00:01:52.271674    2560 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-133-55.ec2.internal\" not found" node="ip-10-0-133-55.ec2.internal"
Jul 30 00:01:52.291636 ip-10-0-133-55 kubenswrapper[2560]: E0730 00:01:52.291619    2560 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-133-55.ec2.internal\" not found"
Jul 30 00:01:52.303112 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:01:52.303095    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/7c492b170a03fda6652336c23f5889cf-config\") pod \"kube-apiserver-proxy-ip-10-0-133-55.ec2.internal\" (UID: \"7c492b170a03fda6652336c23f5889cf\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-133-55.ec2.internal"
Jul 30 00:01:52.303177 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:01:52.303120    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/66ffe78bc58e6acd2d85ae99006f0330-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-133-55.ec2.internal\" (UID: \"66ffe78bc58e6acd2d85ae99006f0330\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-55.ec2.internal"
Jul 30 00:01:52.303177 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:01:52.303138    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/66ffe78bc58e6acd2d85ae99006f0330-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-133-55.ec2.internal\" (UID: \"66ffe78bc58e6acd2d85ae99006f0330\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-55.ec2.internal"
Jul 30 00:01:52.392187 ip-10-0-133-55 kubenswrapper[2560]: E0730 00:01:52.392158    2560 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-133-55.ec2.internal\" not found"
Jul 30 00:01:52.403514 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:01:52.403492    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/66ffe78bc58e6acd2d85ae99006f0330-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-133-55.ec2.internal\" (UID: \"66ffe78bc58e6acd2d85ae99006f0330\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-55.ec2.internal"
Jul 30 00:01:52.403582 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:01:52.403521    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/66ffe78bc58e6acd2d85ae99006f0330-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-133-55.ec2.internal\" (UID: \"66ffe78bc58e6acd2d85ae99006f0330\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-55.ec2.internal"
Jul 30 00:01:52.403582 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:01:52.403548    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/7c492b170a03fda6652336c23f5889cf-config\") pod \"kube-apiserver-proxy-ip-10-0-133-55.ec2.internal\" (UID: \"7c492b170a03fda6652336c23f5889cf\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-133-55.ec2.internal"
Jul 30 00:01:52.403675 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:01:52.403579    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/66ffe78bc58e6acd2d85ae99006f0330-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-133-55.ec2.internal\" (UID: \"66ffe78bc58e6acd2d85ae99006f0330\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-55.ec2.internal"
Jul 30 00:01:52.403675 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:01:52.403584    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/66ffe78bc58e6acd2d85ae99006f0330-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-133-55.ec2.internal\" (UID: \"66ffe78bc58e6acd2d85ae99006f0330\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-55.ec2.internal"
Jul 30 00:01:52.403675 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:01:52.403584    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/7c492b170a03fda6652336c23f5889cf-config\") pod \"kube-apiserver-proxy-ip-10-0-133-55.ec2.internal\" (UID: \"7c492b170a03fda6652336c23f5889cf\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-133-55.ec2.internal"
Jul 30 00:01:53.758630 ip-10-0-133-55 kubenswrapper[2560]: E0730 00:01:53.758592    2560 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-133-55.ec2.internal\" not found"
Jul 30 00:01:53.837134 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:01:53.837095    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-55.ec2.internal"
Jul 30 00:01:53.840502 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:01:53.840481    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-133-55.ec2.internal"
Jul 30 00:01:53.859414 ip-10-0-133-55 kubenswrapper[2560]: E0730 00:01:53.859398    2560 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-133-55.ec2.internal\" not found"
Jul 30 00:01:53.959914 ip-10-0-133-55 kubenswrapper[2560]: E0730 00:01:53.959883    2560 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-133-55.ec2.internal\" not found"
Jul 30 00:01:54.060411 ip-10-0-133-55 kubenswrapper[2560]: E0730 00:01:54.060347    2560 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-133-55.ec2.internal\" not found"
Jul 30 00:01:54.160840 ip-10-0-133-55 kubenswrapper[2560]: E0730 00:01:54.160809    2560 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-133-55.ec2.internal\" not found"
Jul 30 00:01:54.204246 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:01:54.204210    2560 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials"
Jul 30 00:01:54.204695 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:01:54.204377    2560 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
Jul 30 00:01:54.261270 ip-10-0-133-55 kubenswrapper[2560]: E0730 00:01:54.261248    2560 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-133-55.ec2.internal\" not found"
Jul 30 00:01:54.288832 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:01:54.288802    2560 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-07-28 23:56:53 +0000 UTC" deadline="2028-05-12 09:21:23.244912756 +0000 UTC"
Jul 30 00:01:54.288832 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:01:54.288830    2560 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="15657h19m28.956086266s"
Jul 30 00:01:54.362177 ip-10-0-133-55 kubenswrapper[2560]: E0730 00:01:54.362118    2560 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-133-55.ec2.internal\" not found"
Jul 30 00:01:54.399262 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:01:54.399242    2560 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 30 00:01:54.451504 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:01:54.451475    2560 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 30 00:01:54.467503 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:01:54.467476    2560 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-133-55.ec2.internal"
Jul 30 00:01:54.476742 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:01:54.476721    2560 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Jul 30 00:01:54.478213 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:01:54.478198    2560 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-55.ec2.internal"
Jul 30 00:01:54.487604 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:01:54.487587    2560 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Jul 30 00:01:54.513341 ip-10-0-133-55 kubenswrapper[2560]: W0730 00:01:54.513293    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7c492b170a03fda6652336c23f5889cf.slice/crio-f341420728c2edbf23f5e747e0c1bf53615ddb3af9e1c29885532d80b775dc01 WatchSource:0}: Error finding container f341420728c2edbf23f5e747e0c1bf53615ddb3af9e1c29885532d80b775dc01: Status 404 returned error can't find the container with id f341420728c2edbf23f5e747e0c1bf53615ddb3af9e1c29885532d80b775dc01
Jul 30 00:01:54.513727 ip-10-0-133-55 kubenswrapper[2560]: W0730 00:01:54.513706    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod66ffe78bc58e6acd2d85ae99006f0330.slice/crio-9ece27495eea4bcce5f3840f946462592c45bc8f3b9314bbb192d8d782cbd59c WatchSource:0}: Error finding container 9ece27495eea4bcce5f3840f946462592c45bc8f3b9314bbb192d8d782cbd59c: Status 404 returned error can't find the container with id 9ece27495eea4bcce5f3840f946462592c45bc8f3b9314bbb192d8d782cbd59c
Jul 30 00:01:54.519197 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:01:54.519178    2560 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 30 00:01:54.700052 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:01:54.700030    2560 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 30 00:01:55.240563 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:01:55.240529    2560 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 30 00:01:55.247570 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:01:55.247538    2560 apiserver.go:52] "Watching apiserver"
Jul 30 00:01:55.257189 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:01:55.257161    2560 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66"
Jul 30 00:01:55.257549 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:01:55.257528    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kube-system/global-pull-secret-syncer-nfssx","kube-system/konnectivity-agent-n8zl8","kube-system/kube-apiserver-proxy-ip-10-0-133-55.ec2.internal","openshift-image-registry/node-ca-7vc9d","openshift-multus/multus-additional-cni-plugins-ms6sp","openshift-multus/multus-x8swq","openshift-ovn-kubernetes/ovnkube-node-4p5kl","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-55z4f","openshift-cluster-node-tuning-operator/tuned-2mr4v","openshift-dns/node-resolver-5ffvl","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-55.ec2.internal","openshift-multus/network-metrics-daemon-9g97b","openshift-network-diagnostics/network-check-target-lx827","openshift-network-operator/iptables-alerter-kztbf"]
Jul 30 00:01:55.260162 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:01:55.260143    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-4p5kl"
Jul 30 00:01:55.262416 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:01:55.262396    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-lx827"
Jul 30 00:01:55.262519 ip-10-0-133-55 kubenswrapper[2560]: E0730 00:01:55.262470    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-lx827" podUID="aaa633f6-b8db-4e08-a83b-07ec5ca2d154"
Jul 30 00:01:55.262714 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:01:55.262578    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\""
Jul 30 00:01:55.262714 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:01:55.262589    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-xmr29\""
Jul 30 00:01:55.262714 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:01:55.262611    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\""
Jul 30 00:01:55.263652 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:01:55.263626    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\""
Jul 30 00:01:55.263652 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:01:55.263637    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\""
Jul 30 00:01:55.263805 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:01:55.263631    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\""
Jul 30 00:01:55.263805 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:01:55.263637    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\""
Jul 30 00:01:55.264745 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:01:55.264723    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-kztbf"
Jul 30 00:01:55.266857 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:01:55.266803    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-7vc9d"
Jul 30 00:01:55.267348 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:01:55.267326    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\""
Jul 30 00:01:55.267348 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:01:55.267338    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\""
Jul 30 00:01:55.267485 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:01:55.267347    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-vglbv\""
Jul 30 00:01:55.267485 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:01:55.267370    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\""
Jul 30 00:01:55.267574 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:01:55.267550    2560 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving"
Jul 30 00:01:55.268795 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:01:55.268780    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\""
Jul 30 00:01:55.269045 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:01:55.269010    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\""
Jul 30 00:01:55.269151 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:01:55.269136    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-ms6sp"
Jul 30 00:01:55.269581 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:01:55.269560    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\""
Jul 30 00:01:55.269674 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:01:55.269609    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-lhc52\""
Jul 30 00:01:55.271478 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:01:55.271408    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\""
Jul 30 00:01:55.271564 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:01:55.271465    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-x8swq"
Jul 30 00:01:55.272652 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:01:55.272486    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\""
Jul 30 00:01:55.272744 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:01:55.272730    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\""
Jul 30 00:01:55.273432 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:01:55.273121    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\""
Jul 30 00:01:55.273432 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:01:55.273223    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-7mmvs\""
Jul 30 00:01:55.273432 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:01:55.273242    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\""
Jul 30 00:01:55.274713 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:01:55.274696    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-8s4xs\""
Jul 30 00:01:55.275007 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:01:55.274873    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\""
Jul 30 00:01:55.275680 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:01:55.275660    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-2mr4v"
Jul 30 00:01:55.277125 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:01:55.276784    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-z5hvt\" (UniqueName: \"kubernetes.io/projected/aaa633f6-b8db-4e08-a83b-07ec5ca2d154-kube-api-access-z5hvt\") pod \"network-check-target-lx827\" (UID: \"aaa633f6-b8db-4e08-a83b-07ec5ca2d154\") " pod="openshift-network-diagnostics/network-check-target-lx827"
Jul 30 00:01:55.277125 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:01:55.276819    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/de66dc13-ad46-4e8a-8ce5-2c54b63d852a-system-cni-dir\") pod \"multus-additional-cni-plugins-ms6sp\" (UID: \"de66dc13-ad46-4e8a-8ce5-2c54b63d852a\") " pod="openshift-multus/multus-additional-cni-plugins-ms6sp"
Jul 30 00:01:55.277125 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:01:55.276845    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/de66dc13-ad46-4e8a-8ce5-2c54b63d852a-os-release\") pod \"multus-additional-cni-plugins-ms6sp\" (UID: \"de66dc13-ad46-4e8a-8ce5-2c54b63d852a\") " pod="openshift-multus/multus-additional-cni-plugins-ms6sp"
Jul 30 00:01:55.277125 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:01:55.276867    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/de66dc13-ad46-4e8a-8ce5-2c54b63d852a-cni-binary-copy\") pod \"multus-additional-cni-plugins-ms6sp\" (UID: \"de66dc13-ad46-4e8a-8ce5-2c54b63d852a\") " pod="openshift-multus/multus-additional-cni-plugins-ms6sp"
Jul 30 00:01:55.277125 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:01:55.276891    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/de66dc13-ad46-4e8a-8ce5-2c54b63d852a-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-ms6sp\" (UID: \"de66dc13-ad46-4e8a-8ce5-2c54b63d852a\") " pod="openshift-multus/multus-additional-cni-plugins-ms6sp"
Jul 30 00:01:55.277125 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:01:55.276914    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/bc5b2026-4ab4-46f6-a807-a51339c2f60e-run-openvswitch\") pod \"ovnkube-node-4p5kl\" (UID: \"bc5b2026-4ab4-46f6-a807-a51339c2f60e\") " pod="openshift-ovn-kubernetes/ovnkube-node-4p5kl"
Jul 30 00:01:55.277125 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:01:55.276935    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/bc5b2026-4ab4-46f6-a807-a51339c2f60e-host-run-ovn-kubernetes\") pod \"ovnkube-node-4p5kl\" (UID: \"bc5b2026-4ab4-46f6-a807-a51339c2f60e\") " pod="openshift-ovn-kubernetes/ovnkube-node-4p5kl"
Jul 30 00:01:55.277125 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:01:55.276955    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/bc5b2026-4ab4-46f6-a807-a51339c2f60e-host-kubelet\") pod \"ovnkube-node-4p5kl\" (UID: \"bc5b2026-4ab4-46f6-a807-a51339c2f60e\") " pod="openshift-ovn-kubernetes/ovnkube-node-4p5kl"
Jul 30 00:01:55.277125 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:01:55.276980    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/bc5b2026-4ab4-46f6-a807-a51339c2f60e-host-slash\") pod \"ovnkube-node-4p5kl\" (UID: \"bc5b2026-4ab4-46f6-a807-a51339c2f60e\") " pod="openshift-ovn-kubernetes/ovnkube-node-4p5kl"
Jul 30 00:01:55.277125 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:01:55.277006    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/bc5b2026-4ab4-46f6-a807-a51339c2f60e-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-4p5kl\" (UID: \"bc5b2026-4ab4-46f6-a807-a51339c2f60e\") " pod="openshift-ovn-kubernetes/ovnkube-node-4p5kl"
Jul 30 00:01:55.277125 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:01:55.277051    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/bc5b2026-4ab4-46f6-a807-a51339c2f60e-ovn-node-metrics-cert\") pod \"ovnkube-node-4p5kl\" (UID: \"bc5b2026-4ab4-46f6-a807-a51339c2f60e\") " pod="openshift-ovn-kubernetes/ovnkube-node-4p5kl"
Jul 30 00:01:55.277125 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:01:55.277102    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/bc5b2026-4ab4-46f6-a807-a51339c2f60e-ovnkube-script-lib\") pod \"ovnkube-node-4p5kl\" (UID: \"bc5b2026-4ab4-46f6-a807-a51339c2f60e\") " pod="openshift-ovn-kubernetes/ovnkube-node-4p5kl"
Jul 30 00:01:55.277125 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:01:55.277120    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-c886x\" (UniqueName: \"kubernetes.io/projected/bc5b2026-4ab4-46f6-a807-a51339c2f60e-kube-api-access-c886x\") pod \"ovnkube-node-4p5kl\" (UID: \"bc5b2026-4ab4-46f6-a807-a51339c2f60e\") " pod="openshift-ovn-kubernetes/ovnkube-node-4p5kl"
Jul 30 00:01:55.277125 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:01:55.277134    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/274292b8-556c-44ad-b462-c1ea04a30abd-host\") pod \"node-ca-7vc9d\" (UID: \"274292b8-556c-44ad-b462-c1ea04a30abd\") " pod="openshift-image-registry/node-ca-7vc9d"
Jul 30 00:01:55.277824 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:01:55.277152    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/de66dc13-ad46-4e8a-8ce5-2c54b63d852a-cnibin\") pod \"multus-additional-cni-plugins-ms6sp\" (UID: \"de66dc13-ad46-4e8a-8ce5-2c54b63d852a\") " pod="openshift-multus/multus-additional-cni-plugins-ms6sp"
Jul 30 00:01:55.277824 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:01:55.277172    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/bc5b2026-4ab4-46f6-a807-a51339c2f60e-systemd-units\") pod \"ovnkube-node-4p5kl\" (UID: \"bc5b2026-4ab4-46f6-a807-a51339c2f60e\") " pod="openshift-ovn-kubernetes/ovnkube-node-4p5kl"
Jul 30 00:01:55.277824 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:01:55.277193    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/bc5b2026-4ab4-46f6-a807-a51339c2f60e-run-ovn\") pod \"ovnkube-node-4p5kl\" (UID: \"bc5b2026-4ab4-46f6-a807-a51339c2f60e\") " pod="openshift-ovn-kubernetes/ovnkube-node-4p5kl"
Jul 30 00:01:55.277824 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:01:55.277213    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/bc5b2026-4ab4-46f6-a807-a51339c2f60e-log-socket\") pod \"ovnkube-node-4p5kl\" (UID: \"bc5b2026-4ab4-46f6-a807-a51339c2f60e\") " pod="openshift-ovn-kubernetes/ovnkube-node-4p5kl"
Jul 30 00:01:55.277824 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:01:55.277236    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gdglm\" (UniqueName: \"kubernetes.io/projected/20473ed5-4a9f-4c87-9925-92b6543dad41-kube-api-access-gdglm\") pod \"iptables-alerter-kztbf\" (UID: \"20473ed5-4a9f-4c87-9925-92b6543dad41\") " pod="openshift-network-operator/iptables-alerter-kztbf"
Jul 30 00:01:55.277824 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:01:55.277256    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/274292b8-556c-44ad-b462-c1ea04a30abd-serviceca\") pod \"node-ca-7vc9d\" (UID: \"274292b8-556c-44ad-b462-c1ea04a30abd\") " pod="openshift-image-registry/node-ca-7vc9d"
Jul 30 00:01:55.277824 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:01:55.277291    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/bc5b2026-4ab4-46f6-a807-a51339c2f60e-var-lib-openvswitch\") pod \"ovnkube-node-4p5kl\" (UID: \"bc5b2026-4ab4-46f6-a807-a51339c2f60e\") " pod="openshift-ovn-kubernetes/ovnkube-node-4p5kl"
Jul 30 00:01:55.277824 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:01:55.277341    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/bc5b2026-4ab4-46f6-a807-a51339c2f60e-etc-openvswitch\") pod \"ovnkube-node-4p5kl\" (UID: \"bc5b2026-4ab4-46f6-a807-a51339c2f60e\") " pod="openshift-ovn-kubernetes/ovnkube-node-4p5kl"
Jul 30 00:01:55.277824 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:01:55.277370    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/bc5b2026-4ab4-46f6-a807-a51339c2f60e-ovnkube-config\") pod \"ovnkube-node-4p5kl\" (UID: \"bc5b2026-4ab4-46f6-a807-a51339c2f60e\") " pod="openshift-ovn-kubernetes/ovnkube-node-4p5kl"
Jul 30 00:01:55.277824 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:01:55.277410    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/de66dc13-ad46-4e8a-8ce5-2c54b63d852a-tuning-conf-dir\") pod \"multus-additional-cni-plugins-ms6sp\" (UID: \"de66dc13-ad46-4e8a-8ce5-2c54b63d852a\") " pod="openshift-multus/multus-additional-cni-plugins-ms6sp"
Jul 30 00:01:55.277824 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:01:55.277431    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-985cs\" (UniqueName: \"kubernetes.io/projected/de66dc13-ad46-4e8a-8ce5-2c54b63d852a-kube-api-access-985cs\") pod \"multus-additional-cni-plugins-ms6sp\" (UID: \"de66dc13-ad46-4e8a-8ce5-2c54b63d852a\") " pod="openshift-multus/multus-additional-cni-plugins-ms6sp"
Jul 30 00:01:55.277824 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:01:55.277447    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/bc5b2026-4ab4-46f6-a807-a51339c2f60e-run-systemd\") pod \"ovnkube-node-4p5kl\" (UID: \"bc5b2026-4ab4-46f6-a807-a51339c2f60e\") " pod="openshift-ovn-kubernetes/ovnkube-node-4p5kl"
Jul 30 00:01:55.277824 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:01:55.277464    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-46td2\" (UniqueName: \"kubernetes.io/projected/274292b8-556c-44ad-b462-c1ea04a30abd-kube-api-access-46td2\") pod \"node-ca-7vc9d\" (UID: \"274292b8-556c-44ad-b462-c1ea04a30abd\") " pod="openshift-image-registry/node-ca-7vc9d"
Jul 30 00:01:55.277824 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:01:55.277501    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/de66dc13-ad46-4e8a-8ce5-2c54b63d852a-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-ms6sp\" (UID: \"de66dc13-ad46-4e8a-8ce5-2c54b63d852a\") " pod="openshift-multus/multus-additional-cni-plugins-ms6sp"
Jul 30 00:01:55.277824 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:01:55.277543    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/bc5b2026-4ab4-46f6-a807-a51339c2f60e-node-log\") pod \"ovnkube-node-4p5kl\" (UID: \"bc5b2026-4ab4-46f6-a807-a51339c2f60e\") " pod="openshift-ovn-kubernetes/ovnkube-node-4p5kl"
Jul 30 00:01:55.277824 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:01:55.277569    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/bc5b2026-4ab4-46f6-a807-a51339c2f60e-env-overrides\") pod \"ovnkube-node-4p5kl\" (UID: \"bc5b2026-4ab4-46f6-a807-a51339c2f60e\") " pod="openshift-ovn-kubernetes/ovnkube-node-4p5kl"
Jul 30 00:01:55.278581 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:01:55.277595    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/20473ed5-4a9f-4c87-9925-92b6543dad41-iptables-alerter-script\") pod \"iptables-alerter-kztbf\" (UID: \"20473ed5-4a9f-4c87-9925-92b6543dad41\") " pod="openshift-network-operator/iptables-alerter-kztbf"
Jul 30 00:01:55.278581 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:01:55.277611    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/20473ed5-4a9f-4c87-9925-92b6543dad41-host-slash\") pod \"iptables-alerter-kztbf\" (UID: \"20473ed5-4a9f-4c87-9925-92b6543dad41\") " pod="openshift-network-operator/iptables-alerter-kztbf"
Jul 30 00:01:55.278581 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:01:55.277633    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/bc5b2026-4ab4-46f6-a807-a51339c2f60e-host-run-netns\") pod \"ovnkube-node-4p5kl\" (UID: \"bc5b2026-4ab4-46f6-a807-a51339c2f60e\") " pod="openshift-ovn-kubernetes/ovnkube-node-4p5kl"
Jul 30 00:01:55.278581 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:01:55.277650    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/bc5b2026-4ab4-46f6-a807-a51339c2f60e-host-cni-bin\") pod \"ovnkube-node-4p5kl\" (UID: \"bc5b2026-4ab4-46f6-a807-a51339c2f60e\") " pod="openshift-ovn-kubernetes/ovnkube-node-4p5kl"
Jul 30 00:01:55.278581 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:01:55.277663    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/bc5b2026-4ab4-46f6-a807-a51339c2f60e-host-cni-netd\") pod \"ovnkube-node-4p5kl\" (UID: \"bc5b2026-4ab4-46f6-a807-a51339c2f60e\") " pod="openshift-ovn-kubernetes/ovnkube-node-4p5kl"
Jul 30 00:01:55.278581 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:01:55.278425    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\""
Jul 30 00:01:55.278771 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:01:55.278619    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\""
Jul 30 00:01:55.278771 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:01:55.278652    2560 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Jul 30 00:01:55.278771 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:01:55.278717    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-nfssx"
Jul 30 00:01:55.278882 ip-10-0-133-55 kubenswrapper[2560]: E0730 00:01:55.278778    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-nfssx" podUID="e1fdf440-f1f1-40b4-9660-32cc39e1de67"
Jul 30 00:01:55.279094 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:01:55.279076    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-hmr2v\""
Jul 30 00:01:55.281150 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:01:55.281130    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-n8zl8"
Jul 30 00:01:55.283500 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:01:55.283482    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-5ffvl"
Jul 30 00:01:55.283591 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:01:55.283555    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\""
Jul 30 00:01:55.283653 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:01:55.283611    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-fs72l\""
Jul 30 00:01:55.283701 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:01:55.283483    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\""
Jul 30 00:01:55.285818 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:01:55.285798    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-55z4f"
Jul 30 00:01:55.285945 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:01:55.285929    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\""
Jul 30 00:01:55.286181 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:01:55.285933    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-4hr66\""
Jul 30 00:01:55.286262 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:01:55.286170    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\""
Jul 30 00:01:55.288332 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:01:55.288244    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\""
Jul 30 00:01:55.288332 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:01:55.288257    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-9g97b"
Jul 30 00:01:55.288478 ip-10-0-133-55 kubenswrapper[2560]: E0730 00:01:55.288453    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-9g97b" podUID="05dcf00e-2c10-495a-b61b-9221eb8286e5"
Jul 30 00:01:55.288553 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:01:55.288537    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\""
Jul 30 00:01:55.289617 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:01:55.289598    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\""
Jul 30 00:01:55.289708 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:01:55.289631    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-9xd28\""
Jul 30 00:01:55.347640 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:01:55.347618    2560 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-khm4v"
Jul 30 00:01:55.358741 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:01:55.358716    2560 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-khm4v"
Jul 30 00:01:55.367588 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:01:55.367568    2560 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world"
Jul 30 00:01:55.378583 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:01:55.378555    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/b180523f-d9e2-4514-9b5c-091192407dc0-host-run-netns\") pod \"multus-x8swq\" (UID: \"b180523f-d9e2-4514-9b5c-091192407dc0\") " pod="openshift-multus/multus-x8swq"
Jul 30 00:01:55.378746 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:01:55.378591    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/b180523f-d9e2-4514-9b5c-091192407dc0-multus-cni-dir\") pod \"multus-x8swq\" (UID: \"b180523f-d9e2-4514-9b5c-091192407dc0\") " pod="openshift-multus/multus-x8swq"
Jul 30 00:01:55.378746 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:01:55.378617    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/b180523f-d9e2-4514-9b5c-091192407dc0-cni-binary-copy\") pod \"multus-x8swq\" (UID: \"b180523f-d9e2-4514-9b5c-091192407dc0\") " pod="openshift-multus/multus-x8swq"
Jul 30 00:01:55.378746 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:01:55.378650    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/bc5b2026-4ab4-46f6-a807-a51339c2f60e-host-kubelet\") pod \"ovnkube-node-4p5kl\" (UID: \"bc5b2026-4ab4-46f6-a807-a51339c2f60e\") " pod="openshift-ovn-kubernetes/ovnkube-node-4p5kl"
Jul 30 00:01:55.378746 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:01:55.378671    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/bc5b2026-4ab4-46f6-a807-a51339c2f60e-host-slash\") pod \"ovnkube-node-4p5kl\" (UID: \"bc5b2026-4ab4-46f6-a807-a51339c2f60e\") " pod="openshift-ovn-kubernetes/ovnkube-node-4p5kl"
Jul 30 00:01:55.378746 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:01:55.378711    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/bc5b2026-4ab4-46f6-a807-a51339c2f60e-ovn-node-metrics-cert\") pod \"ovnkube-node-4p5kl\" (UID: \"bc5b2026-4ab4-46f6-a807-a51339c2f60e\") " pod="openshift-ovn-kubernetes/ovnkube-node-4p5kl"
Jul 30 00:01:55.378746 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:01:55.378734    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/c2108e9a-b8cd-4419-82ea-2f677d5e3a01-konnectivity-ca\") pod \"konnectivity-agent-n8zl8\" (UID: \"c2108e9a-b8cd-4419-82ea-2f677d5e3a01\") " pod="kube-system/konnectivity-agent-n8zl8"
Jul 30 00:01:55.378746 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:01:55.378735    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/bc5b2026-4ab4-46f6-a807-a51339c2f60e-host-kubelet\") pod \"ovnkube-node-4p5kl\" (UID: \"bc5b2026-4ab4-46f6-a807-a51339c2f60e\") " pod="openshift-ovn-kubernetes/ovnkube-node-4p5kl"
Jul 30 00:01:55.379085 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:01:55.378750    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/b180523f-d9e2-4514-9b5c-091192407dc0-host-var-lib-kubelet\") pod \"multus-x8swq\" (UID: \"b180523f-d9e2-4514-9b5c-091192407dc0\") " pod="openshift-multus/multus-x8swq"
Jul 30 00:01:55.379085 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:01:55.378772    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/8eb20838-c71f-4ac8-bded-78851ea49e22-etc-sysctl-d\") pod \"tuned-2mr4v\" (UID: \"8eb20838-c71f-4ac8-bded-78851ea49e22\") " pod="openshift-cluster-node-tuning-operator/tuned-2mr4v"
Jul 30 00:01:55.379085 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:01:55.378794    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/bc5b2026-4ab4-46f6-a807-a51339c2f60e-systemd-units\") pod \"ovnkube-node-4p5kl\" (UID: \"bc5b2026-4ab4-46f6-a807-a51339c2f60e\") " pod="openshift-ovn-kubernetes/ovnkube-node-4p5kl"
Jul 30 00:01:55.379085 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:01:55.378797    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/bc5b2026-4ab4-46f6-a807-a51339c2f60e-host-slash\") pod \"ovnkube-node-4p5kl\" (UID: \"bc5b2026-4ab4-46f6-a807-a51339c2f60e\") " pod="openshift-ovn-kubernetes/ovnkube-node-4p5kl"
Jul 30 00:01:55.379085 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:01:55.378815    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/bc5b2026-4ab4-46f6-a807-a51339c2f60e-log-socket\") pod \"ovnkube-node-4p5kl\" (UID: \"bc5b2026-4ab4-46f6-a807-a51339c2f60e\") " pod="openshift-ovn-kubernetes/ovnkube-node-4p5kl"
Jul 30 00:01:55.379085 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:01:55.378838    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/b180523f-d9e2-4514-9b5c-091192407dc0-multus-conf-dir\") pod \"multus-x8swq\" (UID: \"b180523f-d9e2-4514-9b5c-091192407dc0\") " pod="openshift-multus/multus-x8swq"
Jul 30 00:01:55.379085 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:01:55.378858    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/e1fdf440-f1f1-40b4-9660-32cc39e1de67-dbus\") pod \"global-pull-secret-syncer-nfssx\" (UID: \"e1fdf440-f1f1-40b4-9660-32cc39e1de67\") " pod="kube-system/global-pull-secret-syncer-nfssx"
Jul 30 00:01:55.379085 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:01:55.378861    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/bc5b2026-4ab4-46f6-a807-a51339c2f60e-systemd-units\") pod \"ovnkube-node-4p5kl\" (UID: \"bc5b2026-4ab4-46f6-a807-a51339c2f60e\") " pod="openshift-ovn-kubernetes/ovnkube-node-4p5kl"
Jul 30 00:01:55.379085 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:01:55.378879    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/bc5b2026-4ab4-46f6-a807-a51339c2f60e-var-lib-openvswitch\") pod \"ovnkube-node-4p5kl\" (UID: \"bc5b2026-4ab4-46f6-a807-a51339c2f60e\") " pod="openshift-ovn-kubernetes/ovnkube-node-4p5kl"
Jul 30 00:01:55.379085 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:01:55.378928    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/bc5b2026-4ab4-46f6-a807-a51339c2f60e-log-socket\") pod \"ovnkube-node-4p5kl\" (UID: \"bc5b2026-4ab4-46f6-a807-a51339c2f60e\") " pod="openshift-ovn-kubernetes/ovnkube-node-4p5kl"
Jul 30 00:01:55.379085 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:01:55.378942    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/bc5b2026-4ab4-46f6-a807-a51339c2f60e-var-lib-openvswitch\") pod \"ovnkube-node-4p5kl\" (UID: \"bc5b2026-4ab4-46f6-a807-a51339c2f60e\") " pod="openshift-ovn-kubernetes/ovnkube-node-4p5kl"
Jul 30 00:01:55.379085 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:01:55.378945    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/c2108e9a-b8cd-4419-82ea-2f677d5e3a01-agent-certs\") pod \"konnectivity-agent-n8zl8\" (UID: \"c2108e9a-b8cd-4419-82ea-2f677d5e3a01\") " pod="kube-system/konnectivity-agent-n8zl8"
Jul 30 00:01:55.379085 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:01:55.378987    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vmrwj\" (UniqueName: \"kubernetes.io/projected/4f585163-3e80-4055-bfdd-17d37e755a71-kube-api-access-vmrwj\") pod \"node-resolver-5ffvl\" (UID: \"4f585163-3e80-4055-bfdd-17d37e755a71\") " pod="openshift-dns/node-resolver-5ffvl"
Jul 30 00:01:55.379085 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:01:55.379011    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/8eb20838-c71f-4ac8-bded-78851ea49e22-etc-sysconfig\") pod \"tuned-2mr4v\" (UID: \"8eb20838-c71f-4ac8-bded-78851ea49e22\") " pod="openshift-cluster-node-tuning-operator/tuned-2mr4v"
Jul 30 00:01:55.379085 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:01:55.379033    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/8eb20838-c71f-4ac8-bded-78851ea49e22-sys\") pod \"tuned-2mr4v\" (UID: \"8eb20838-c71f-4ac8-bded-78851ea49e22\") " pod="openshift-cluster-node-tuning-operator/tuned-2mr4v"
Jul 30 00:01:55.379085 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:01:55.379054    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/8eb20838-c71f-4ac8-bded-78851ea49e22-var-lib-kubelet\") pod \"tuned-2mr4v\" (UID: \"8eb20838-c71f-4ac8-bded-78851ea49e22\") " pod="openshift-cluster-node-tuning-operator/tuned-2mr4v"
Jul 30 00:01:55.379085 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:01:55.379083    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/05dcf00e-2c10-495a-b61b-9221eb8286e5-metrics-certs\") pod \"network-metrics-daemon-9g97b\" (UID: \"05dcf00e-2c10-495a-b61b-9221eb8286e5\") " pod="openshift-multus/network-metrics-daemon-9g97b"
Jul 30 00:01:55.379996 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:01:55.379107    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/d52805f6-d4e7-4896-871c-0845b47a6452-device-dir\") pod \"aws-ebs-csi-driver-node-55z4f\" (UID: \"d52805f6-d4e7-4896-871c-0845b47a6452\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-55z4f"
Jul 30 00:01:55.379996 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:01:55.379105    2560 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory"
Jul 30 00:01:55.379996 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:01:55.379145    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/d52805f6-d4e7-4896-871c-0845b47a6452-etc-selinux\") pod \"aws-ebs-csi-driver-node-55z4f\" (UID: \"d52805f6-d4e7-4896-871c-0845b47a6452\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-55z4f"
Jul 30 00:01:55.379996 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:01:55.379192    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-z2hds\" (UniqueName: \"kubernetes.io/projected/b180523f-d9e2-4514-9b5c-091192407dc0-kube-api-access-z2hds\") pod \"multus-x8swq\" (UID: \"b180523f-d9e2-4514-9b5c-091192407dc0\") " pod="openshift-multus/multus-x8swq"
Jul 30 00:01:55.379996 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:01:55.379231    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/8eb20838-c71f-4ac8-bded-78851ea49e22-etc-systemd\") pod \"tuned-2mr4v\" (UID: \"8eb20838-c71f-4ac8-bded-78851ea49e22\") " pod="openshift-cluster-node-tuning-operator/tuned-2mr4v"
Jul 30 00:01:55.379996 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:01:55.379265    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-46td2\" (UniqueName: \"kubernetes.io/projected/274292b8-556c-44ad-b462-c1ea04a30abd-kube-api-access-46td2\") pod \"node-ca-7vc9d\" (UID: \"274292b8-556c-44ad-b462-c1ea04a30abd\") " pod="openshift-image-registry/node-ca-7vc9d"
Jul 30 00:01:55.379996 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:01:55.379299    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/de66dc13-ad46-4e8a-8ce5-2c54b63d852a-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-ms6sp\" (UID: \"de66dc13-ad46-4e8a-8ce5-2c54b63d852a\") " pod="openshift-multus/multus-additional-cni-plugins-ms6sp"
Jul 30 00:01:55.379996 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:01:55.379471    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/4f585163-3e80-4055-bfdd-17d37e755a71-tmp-dir\") pod \"node-resolver-5ffvl\" (UID: \"4f585163-3e80-4055-bfdd-17d37e755a71\") " pod="openshift-dns/node-resolver-5ffvl"
Jul 30 00:01:55.379996 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:01:55.379498    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9wkl9\" (UniqueName: \"kubernetes.io/projected/d52805f6-d4e7-4896-871c-0845b47a6452-kube-api-access-9wkl9\") pod \"aws-ebs-csi-driver-node-55z4f\" (UID: \"d52805f6-d4e7-4896-871c-0845b47a6452\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-55z4f"
Jul 30 00:01:55.379996 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:01:55.379519    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/b180523f-d9e2-4514-9b5c-091192407dc0-os-release\") pod \"multus-x8swq\" (UID: \"b180523f-d9e2-4514-9b5c-091192407dc0\") " pod="openshift-multus/multus-x8swq"
Jul 30 00:01:55.379996 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:01:55.379553    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/b180523f-d9e2-4514-9b5c-091192407dc0-host-run-k8s-cni-cncf-io\") pod \"multus-x8swq\" (UID: \"b180523f-d9e2-4514-9b5c-091192407dc0\") " pod="openshift-multus/multus-x8swq"
Jul 30 00:01:55.379996 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:01:55.379577    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/8eb20838-c71f-4ac8-bded-78851ea49e22-etc-tuned\") pod \"tuned-2mr4v\" (UID: \"8eb20838-c71f-4ac8-bded-78851ea49e22\") " pod="openshift-cluster-node-tuning-operator/tuned-2mr4v"
Jul 30 00:01:55.379996 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:01:55.379625    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/e1fdf440-f1f1-40b4-9660-32cc39e1de67-kubelet-config\") pod \"global-pull-secret-syncer-nfssx\" (UID: \"e1fdf440-f1f1-40b4-9660-32cc39e1de67\") " pod="kube-system/global-pull-secret-syncer-nfssx"
Jul 30 00:01:55.379996 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:01:55.379651    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/20473ed5-4a9f-4c87-9925-92b6543dad41-iptables-alerter-script\") pod \"iptables-alerter-kztbf\" (UID: \"20473ed5-4a9f-4c87-9925-92b6543dad41\") " pod="openshift-network-operator/iptables-alerter-kztbf"
Jul 30 00:01:55.379996 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:01:55.379667    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/8eb20838-c71f-4ac8-bded-78851ea49e22-etc-modprobe-d\") pod \"tuned-2mr4v\" (UID: \"8eb20838-c71f-4ac8-bded-78851ea49e22\") " pod="openshift-cluster-node-tuning-operator/tuned-2mr4v"
Jul 30 00:01:55.379996 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:01:55.379682    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/d52805f6-d4e7-4896-871c-0845b47a6452-registration-dir\") pod \"aws-ebs-csi-driver-node-55z4f\" (UID: \"d52805f6-d4e7-4896-871c-0845b47a6452\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-55z4f"
Jul 30 00:01:55.379996 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:01:55.379701    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/b180523f-d9e2-4514-9b5c-091192407dc0-multus-socket-dir-parent\") pod \"multus-x8swq\" (UID: \"b180523f-d9e2-4514-9b5c-091192407dc0\") " pod="openshift-multus/multus-x8swq"
Jul 30 00:01:55.380813 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:01:55.379737    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/de66dc13-ad46-4e8a-8ce5-2c54b63d852a-system-cni-dir\") pod \"multus-additional-cni-plugins-ms6sp\" (UID: \"de66dc13-ad46-4e8a-8ce5-2c54b63d852a\") " pod="openshift-multus/multus-additional-cni-plugins-ms6sp"
Jul 30 00:01:55.380813 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:01:55.379761    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/de66dc13-ad46-4e8a-8ce5-2c54b63d852a-cni-binary-copy\") pod \"multus-additional-cni-plugins-ms6sp\" (UID: \"de66dc13-ad46-4e8a-8ce5-2c54b63d852a\") " pod="openshift-multus/multus-additional-cni-plugins-ms6sp"
Jul 30 00:01:55.380813 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:01:55.379784    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/bc5b2026-4ab4-46f6-a807-a51339c2f60e-host-run-ovn-kubernetes\") pod \"ovnkube-node-4p5kl\" (UID: \"bc5b2026-4ab4-46f6-a807-a51339c2f60e\") " pod="openshift-ovn-kubernetes/ovnkube-node-4p5kl"
Jul 30 00:01:55.380813 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:01:55.379802    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/de66dc13-ad46-4e8a-8ce5-2c54b63d852a-system-cni-dir\") pod \"multus-additional-cni-plugins-ms6sp\" (UID: \"de66dc13-ad46-4e8a-8ce5-2c54b63d852a\") " pod="openshift-multus/multus-additional-cni-plugins-ms6sp"
Jul 30 00:01:55.380813 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:01:55.379807    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/bc5b2026-4ab4-46f6-a807-a51339c2f60e-ovnkube-script-lib\") pod \"ovnkube-node-4p5kl\" (UID: \"bc5b2026-4ab4-46f6-a807-a51339c2f60e\") " pod="openshift-ovn-kubernetes/ovnkube-node-4p5kl"
Jul 30 00:01:55.380813 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:01:55.379845    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/4f585163-3e80-4055-bfdd-17d37e755a71-hosts-file\") pod \"node-resolver-5ffvl\" (UID: \"4f585163-3e80-4055-bfdd-17d37e755a71\") " pod="openshift-dns/node-resolver-5ffvl"
Jul 30 00:01:55.380813 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:01:55.379868    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/de66dc13-ad46-4e8a-8ce5-2c54b63d852a-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-ms6sp\" (UID: \"de66dc13-ad46-4e8a-8ce5-2c54b63d852a\") " pod="openshift-multus/multus-additional-cni-plugins-ms6sp"
Jul 30 00:01:55.380813 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:01:55.379869    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/8eb20838-c71f-4ac8-bded-78851ea49e22-tmp\") pod \"tuned-2mr4v\" (UID: \"8eb20838-c71f-4ac8-bded-78851ea49e22\") " pod="openshift-cluster-node-tuning-operator/tuned-2mr4v"
Jul 30 00:01:55.380813 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:01:55.379938    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/274292b8-556c-44ad-b462-c1ea04a30abd-host\") pod \"node-ca-7vc9d\" (UID: \"274292b8-556c-44ad-b462-c1ea04a30abd\") " pod="openshift-image-registry/node-ca-7vc9d"
Jul 30 00:01:55.380813 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:01:55.379870    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/bc5b2026-4ab4-46f6-a807-a51339c2f60e-host-run-ovn-kubernetes\") pod \"ovnkube-node-4p5kl\" (UID: \"bc5b2026-4ab4-46f6-a807-a51339c2f60e\") " pod="openshift-ovn-kubernetes/ovnkube-node-4p5kl"
Jul 30 00:01:55.380813 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:01:55.379962    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/de66dc13-ad46-4e8a-8ce5-2c54b63d852a-cnibin\") pod \"multus-additional-cni-plugins-ms6sp\" (UID: \"de66dc13-ad46-4e8a-8ce5-2c54b63d852a\") " pod="openshift-multus/multus-additional-cni-plugins-ms6sp"
Jul 30 00:01:55.380813 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:01:55.380001    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/bc5b2026-4ab4-46f6-a807-a51339c2f60e-run-ovn\") pod \"ovnkube-node-4p5kl\" (UID: \"bc5b2026-4ab4-46f6-a807-a51339c2f60e\") " pod="openshift-ovn-kubernetes/ovnkube-node-4p5kl"
Jul 30 00:01:55.380813 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:01:55.380006    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/de66dc13-ad46-4e8a-8ce5-2c54b63d852a-cnibin\") pod \"multus-additional-cni-plugins-ms6sp\" (UID: \"de66dc13-ad46-4e8a-8ce5-2c54b63d852a\") " pod="openshift-multus/multus-additional-cni-plugins-ms6sp"
Jul 30 00:01:55.380813 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:01:55.380028    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/d52805f6-d4e7-4896-871c-0845b47a6452-sys-fs\") pod \"aws-ebs-csi-driver-node-55z4f\" (UID: \"d52805f6-d4e7-4896-871c-0845b47a6452\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-55z4f"
Jul 30 00:01:55.380813 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:01:55.380040    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/274292b8-556c-44ad-b462-c1ea04a30abd-host\") pod \"node-ca-7vc9d\" (UID: \"274292b8-556c-44ad-b462-c1ea04a30abd\") " pod="openshift-image-registry/node-ca-7vc9d"
Jul 30 00:01:55.380813 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:01:55.380053    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gdglm\" (UniqueName: \"kubernetes.io/projected/20473ed5-4a9f-4c87-9925-92b6543dad41-kube-api-access-gdglm\") pod \"iptables-alerter-kztbf\" (UID: \"20473ed5-4a9f-4c87-9925-92b6543dad41\") " pod="openshift-network-operator/iptables-alerter-kztbf"
Jul 30 00:01:55.380813 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:01:55.380076    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/274292b8-556c-44ad-b462-c1ea04a30abd-serviceca\") pod \"node-ca-7vc9d\" (UID: \"274292b8-556c-44ad-b462-c1ea04a30abd\") " pod="openshift-image-registry/node-ca-7vc9d"
Jul 30 00:01:55.381632 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:01:55.380085    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/bc5b2026-4ab4-46f6-a807-a51339c2f60e-run-ovn\") pod \"ovnkube-node-4p5kl\" (UID: \"bc5b2026-4ab4-46f6-a807-a51339c2f60e\") " pod="openshift-ovn-kubernetes/ovnkube-node-4p5kl"
Jul 30 00:01:55.381632 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:01:55.380098    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/bc5b2026-4ab4-46f6-a807-a51339c2f60e-etc-openvswitch\") pod \"ovnkube-node-4p5kl\" (UID: \"bc5b2026-4ab4-46f6-a807-a51339c2f60e\") " pod="openshift-ovn-kubernetes/ovnkube-node-4p5kl"
Jul 30 00:01:55.381632 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:01:55.380122    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/bc5b2026-4ab4-46f6-a807-a51339c2f60e-ovnkube-config\") pod \"ovnkube-node-4p5kl\" (UID: \"bc5b2026-4ab4-46f6-a807-a51339c2f60e\") " pod="openshift-ovn-kubernetes/ovnkube-node-4p5kl"
Jul 30 00:01:55.381632 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:01:55.380145    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/8eb20838-c71f-4ac8-bded-78851ea49e22-etc-kubernetes\") pod \"tuned-2mr4v\" (UID: \"8eb20838-c71f-4ac8-bded-78851ea49e22\") " pod="openshift-cluster-node-tuning-operator/tuned-2mr4v"
Jul 30 00:01:55.381632 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:01:55.380167    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/8eb20838-c71f-4ac8-bded-78851ea49e22-etc-sysctl-conf\") pod \"tuned-2mr4v\" (UID: \"8eb20838-c71f-4ac8-bded-78851ea49e22\") " pod="openshift-cluster-node-tuning-operator/tuned-2mr4v"
Jul 30 00:01:55.381632 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:01:55.380188    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/8eb20838-c71f-4ac8-bded-78851ea49e22-host\") pod \"tuned-2mr4v\" (UID: \"8eb20838-c71f-4ac8-bded-78851ea49e22\") " pod="openshift-cluster-node-tuning-operator/tuned-2mr4v"
Jul 30 00:01:55.381632 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:01:55.380209    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/e1fdf440-f1f1-40b4-9660-32cc39e1de67-original-pull-secret\") pod \"global-pull-secret-syncer-nfssx\" (UID: \"e1fdf440-f1f1-40b4-9660-32cc39e1de67\") " pod="kube-system/global-pull-secret-syncer-nfssx"
Jul 30 00:01:55.381632 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:01:55.380223    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/20473ed5-4a9f-4c87-9925-92b6543dad41-iptables-alerter-script\") pod \"iptables-alerter-kztbf\" (UID: \"20473ed5-4a9f-4c87-9925-92b6543dad41\") " pod="openshift-network-operator/iptables-alerter-kztbf"
Jul 30 00:01:55.381632 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:01:55.380239    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/de66dc13-ad46-4e8a-8ce5-2c54b63d852a-tuning-conf-dir\") pod \"multus-additional-cni-plugins-ms6sp\" (UID: \"de66dc13-ad46-4e8a-8ce5-2c54b63d852a\") " pod="openshift-multus/multus-additional-cni-plugins-ms6sp"
Jul 30 00:01:55.381632 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:01:55.380267    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/de66dc13-ad46-4e8a-8ce5-2c54b63d852a-cni-binary-copy\") pod \"multus-additional-cni-plugins-ms6sp\" (UID: \"de66dc13-ad46-4e8a-8ce5-2c54b63d852a\") " pod="openshift-multus/multus-additional-cni-plugins-ms6sp"
Jul 30 00:01:55.381632 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:01:55.380275    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-985cs\" (UniqueName: \"kubernetes.io/projected/de66dc13-ad46-4e8a-8ce5-2c54b63d852a-kube-api-access-985cs\") pod \"multus-additional-cni-plugins-ms6sp\" (UID: \"de66dc13-ad46-4e8a-8ce5-2c54b63d852a\") " pod="openshift-multus/multus-additional-cni-plugins-ms6sp"
Jul 30 00:01:55.381632 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:01:55.380300    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/bc5b2026-4ab4-46f6-a807-a51339c2f60e-run-systemd\") pod \"ovnkube-node-4p5kl\" (UID: \"bc5b2026-4ab4-46f6-a807-a51339c2f60e\") " pod="openshift-ovn-kubernetes/ovnkube-node-4p5kl"
Jul 30 00:01:55.381632 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:01:55.380336    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/bc5b2026-4ab4-46f6-a807-a51339c2f60e-etc-openvswitch\") pod \"ovnkube-node-4p5kl\" (UID: \"bc5b2026-4ab4-46f6-a807-a51339c2f60e\") " pod="openshift-ovn-kubernetes/ovnkube-node-4p5kl"
Jul 30 00:01:55.381632 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:01:55.380350    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/d52805f6-d4e7-4896-871c-0845b47a6452-kubelet-dir\") pod \"aws-ebs-csi-driver-node-55z4f\" (UID: \"d52805f6-d4e7-4896-871c-0845b47a6452\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-55z4f"
Jul 30 00:01:55.381632 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:01:55.380375    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/b180523f-d9e2-4514-9b5c-091192407dc0-host-var-lib-cni-bin\") pod \"multus-x8swq\" (UID: \"b180523f-d9e2-4514-9b5c-091192407dc0\") " pod="openshift-multus/multus-x8swq"
Jul 30 00:01:55.381632 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:01:55.380398    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/b180523f-d9e2-4514-9b5c-091192407dc0-host-var-lib-cni-multus\") pod \"multus-x8swq\" (UID: \"b180523f-d9e2-4514-9b5c-091192407dc0\") " pod="openshift-multus/multus-x8swq"
Jul 30 00:01:55.381632 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:01:55.380422    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/bc5b2026-4ab4-46f6-a807-a51339c2f60e-node-log\") pod \"ovnkube-node-4p5kl\" (UID: \"bc5b2026-4ab4-46f6-a807-a51339c2f60e\") " pod="openshift-ovn-kubernetes/ovnkube-node-4p5kl"
Jul 30 00:01:55.382472 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:01:55.380445    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/bc5b2026-4ab4-46f6-a807-a51339c2f60e-env-overrides\") pod \"ovnkube-node-4p5kl\" (UID: \"bc5b2026-4ab4-46f6-a807-a51339c2f60e\") " pod="openshift-ovn-kubernetes/ovnkube-node-4p5kl"
Jul 30 00:01:55.382472 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:01:55.380468    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/b180523f-d9e2-4514-9b5c-091192407dc0-system-cni-dir\") pod \"multus-x8swq\" (UID: \"b180523f-d9e2-4514-9b5c-091192407dc0\") " pod="openshift-multus/multus-x8swq"
Jul 30 00:01:55.382472 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:01:55.380493    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/b180523f-d9e2-4514-9b5c-091192407dc0-host-run-multus-certs\") pod \"multus-x8swq\" (UID: \"b180523f-d9e2-4514-9b5c-091192407dc0\") " pod="openshift-multus/multus-x8swq"
Jul 30 00:01:55.382472 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:01:55.380542    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/8eb20838-c71f-4ac8-bded-78851ea49e22-run\") pod \"tuned-2mr4v\" (UID: \"8eb20838-c71f-4ac8-bded-78851ea49e22\") " pod="openshift-cluster-node-tuning-operator/tuned-2mr4v"
Jul 30 00:01:55.382472 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:01:55.380550    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/bc5b2026-4ab4-46f6-a807-a51339c2f60e-run-systemd\") pod \"ovnkube-node-4p5kl\" (UID: \"bc5b2026-4ab4-46f6-a807-a51339c2f60e\") " pod="openshift-ovn-kubernetes/ovnkube-node-4p5kl"
Jul 30 00:01:55.382472 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:01:55.380595    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/20473ed5-4a9f-4c87-9925-92b6543dad41-host-slash\") pod \"iptables-alerter-kztbf\" (UID: \"20473ed5-4a9f-4c87-9925-92b6543dad41\") " pod="openshift-network-operator/iptables-alerter-kztbf"
Jul 30 00:01:55.382472 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:01:55.380651    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/bc5b2026-4ab4-46f6-a807-a51339c2f60e-host-run-netns\") pod \"ovnkube-node-4p5kl\" (UID: \"bc5b2026-4ab4-46f6-a807-a51339c2f60e\") " pod="openshift-ovn-kubernetes/ovnkube-node-4p5kl"
Jul 30 00:01:55.382472 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:01:55.380683    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/b180523f-d9e2-4514-9b5c-091192407dc0-cnibin\") pod \"multus-x8swq\" (UID: \"b180523f-d9e2-4514-9b5c-091192407dc0\") " pod="openshift-multus/multus-x8swq"
Jul 30 00:01:55.382472 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:01:55.380695    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/274292b8-556c-44ad-b462-c1ea04a30abd-serviceca\") pod \"node-ca-7vc9d\" (UID: \"274292b8-556c-44ad-b462-c1ea04a30abd\") " pod="openshift-image-registry/node-ca-7vc9d"
Jul 30 00:01:55.382472 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:01:55.380729    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/8eb20838-c71f-4ac8-bded-78851ea49e22-lib-modules\") pod \"tuned-2mr4v\" (UID: \"8eb20838-c71f-4ac8-bded-78851ea49e22\") " pod="openshift-cluster-node-tuning-operator/tuned-2mr4v"
Jul 30 00:01:55.382472 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:01:55.380737    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/de66dc13-ad46-4e8a-8ce5-2c54b63d852a-tuning-conf-dir\") pod \"multus-additional-cni-plugins-ms6sp\" (UID: \"de66dc13-ad46-4e8a-8ce5-2c54b63d852a\") " pod="openshift-multus/multus-additional-cni-plugins-ms6sp"
Jul 30 00:01:55.382472 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:01:55.380742    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/bc5b2026-4ab4-46f6-a807-a51339c2f60e-host-run-netns\") pod \"ovnkube-node-4p5kl\" (UID: \"bc5b2026-4ab4-46f6-a807-a51339c2f60e\") " pod="openshift-ovn-kubernetes/ovnkube-node-4p5kl"
Jul 30 00:01:55.382472 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:01:55.380755    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mfrr8\" (UniqueName: \"kubernetes.io/projected/05dcf00e-2c10-495a-b61b-9221eb8286e5-kube-api-access-mfrr8\") pod \"network-metrics-daemon-9g97b\" (UID: \"05dcf00e-2c10-495a-b61b-9221eb8286e5\") " pod="openshift-multus/network-metrics-daemon-9g97b"
Jul 30 00:01:55.382472 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:01:55.380782    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/bc5b2026-4ab4-46f6-a807-a51339c2f60e-host-cni-bin\") pod \"ovnkube-node-4p5kl\" (UID: \"bc5b2026-4ab4-46f6-a807-a51339c2f60e\") " pod="openshift-ovn-kubernetes/ovnkube-node-4p5kl"
Jul 30 00:01:55.382472 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:01:55.380782    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/bc5b2026-4ab4-46f6-a807-a51339c2f60e-node-log\") pod \"ovnkube-node-4p5kl\" (UID: \"bc5b2026-4ab4-46f6-a807-a51339c2f60e\") " pod="openshift-ovn-kubernetes/ovnkube-node-4p5kl"
Jul 30 00:01:55.382472 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:01:55.380808    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/20473ed5-4a9f-4c87-9925-92b6543dad41-host-slash\") pod \"iptables-alerter-kztbf\" (UID: \"20473ed5-4a9f-4c87-9925-92b6543dad41\") " pod="openshift-network-operator/iptables-alerter-kztbf"
Jul 30 00:01:55.382472 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:01:55.380812    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/bc5b2026-4ab4-46f6-a807-a51339c2f60e-host-cni-netd\") pod \"ovnkube-node-4p5kl\" (UID: \"bc5b2026-4ab4-46f6-a807-a51339c2f60e\") " pod="openshift-ovn-kubernetes/ovnkube-node-4p5kl"
Jul 30 00:01:55.383174 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:01:55.380849    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/bc5b2026-4ab4-46f6-a807-a51339c2f60e-host-cni-bin\") pod \"ovnkube-node-4p5kl\" (UID: \"bc5b2026-4ab4-46f6-a807-a51339c2f60e\") " pod="openshift-ovn-kubernetes/ovnkube-node-4p5kl"
Jul 30 00:01:55.383174 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:01:55.380879    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/d52805f6-d4e7-4896-871c-0845b47a6452-socket-dir\") pod \"aws-ebs-csi-driver-node-55z4f\" (UID: \"d52805f6-d4e7-4896-871c-0845b47a6452\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-55z4f"
Jul 30 00:01:55.383174 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:01:55.380893    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/bc5b2026-4ab4-46f6-a807-a51339c2f60e-host-cni-netd\") pod \"ovnkube-node-4p5kl\" (UID: \"bc5b2026-4ab4-46f6-a807-a51339c2f60e\") " pod="openshift-ovn-kubernetes/ovnkube-node-4p5kl"
Jul 30 00:01:55.383174 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:01:55.380926    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/b180523f-d9e2-4514-9b5c-091192407dc0-hostroot\") pod \"multus-x8swq\" (UID: \"b180523f-d9e2-4514-9b5c-091192407dc0\") " pod="openshift-multus/multus-x8swq"
Jul 30 00:01:55.383174 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:01:55.380942    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/bc5b2026-4ab4-46f6-a807-a51339c2f60e-ovnkube-config\") pod \"ovnkube-node-4p5kl\" (UID: \"bc5b2026-4ab4-46f6-a807-a51339c2f60e\") " pod="openshift-ovn-kubernetes/ovnkube-node-4p5kl"
Jul 30 00:01:55.383174 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:01:55.380950    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/b180523f-d9e2-4514-9b5c-091192407dc0-multus-daemon-config\") pod \"multus-x8swq\" (UID: \"b180523f-d9e2-4514-9b5c-091192407dc0\") " pod="openshift-multus/multus-x8swq"
Jul 30 00:01:55.383174 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:01:55.380987    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/b180523f-d9e2-4514-9b5c-091192407dc0-etc-kubernetes\") pod \"multus-x8swq\" (UID: \"b180523f-d9e2-4514-9b5c-091192407dc0\") " pod="openshift-multus/multus-x8swq"
Jul 30 00:01:55.383174 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:01:55.381012    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2xqhn\" (UniqueName: \"kubernetes.io/projected/8eb20838-c71f-4ac8-bded-78851ea49e22-kube-api-access-2xqhn\") pod \"tuned-2mr4v\" (UID: \"8eb20838-c71f-4ac8-bded-78851ea49e22\") " pod="openshift-cluster-node-tuning-operator/tuned-2mr4v"
Jul 30 00:01:55.383174 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:01:55.381042    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-z5hvt\" (UniqueName: \"kubernetes.io/projected/aaa633f6-b8db-4e08-a83b-07ec5ca2d154-kube-api-access-z5hvt\") pod \"network-check-target-lx827\" (UID: \"aaa633f6-b8db-4e08-a83b-07ec5ca2d154\") " pod="openshift-network-diagnostics/network-check-target-lx827"
Jul 30 00:01:55.383174 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:01:55.381095    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/de66dc13-ad46-4e8a-8ce5-2c54b63d852a-os-release\") pod \"multus-additional-cni-plugins-ms6sp\" (UID: \"de66dc13-ad46-4e8a-8ce5-2c54b63d852a\") " pod="openshift-multus/multus-additional-cni-plugins-ms6sp"
Jul 30 00:01:55.383174 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:01:55.381119    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/de66dc13-ad46-4e8a-8ce5-2c54b63d852a-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-ms6sp\" (UID: \"de66dc13-ad46-4e8a-8ce5-2c54b63d852a\") " pod="openshift-multus/multus-additional-cni-plugins-ms6sp"
Jul 30 00:01:55.383174 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:01:55.381187    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/bc5b2026-4ab4-46f6-a807-a51339c2f60e-run-openvswitch\") pod \"ovnkube-node-4p5kl\" (UID: \"bc5b2026-4ab4-46f6-a807-a51339c2f60e\") " pod="openshift-ovn-kubernetes/ovnkube-node-4p5kl"
Jul 30 00:01:55.383174 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:01:55.381213    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/bc5b2026-4ab4-46f6-a807-a51339c2f60e-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-4p5kl\" (UID: \"bc5b2026-4ab4-46f6-a807-a51339c2f60e\") " pod="openshift-ovn-kubernetes/ovnkube-node-4p5kl"
Jul 30 00:01:55.383174 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:01:55.381241    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-c886x\" (UniqueName: \"kubernetes.io/projected/bc5b2026-4ab4-46f6-a807-a51339c2f60e-kube-api-access-c886x\") pod \"ovnkube-node-4p5kl\" (UID: \"bc5b2026-4ab4-46f6-a807-a51339c2f60e\") " pod="openshift-ovn-kubernetes/ovnkube-node-4p5kl"
Jul 30 00:01:55.383174 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:01:55.381259    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/bc5b2026-4ab4-46f6-a807-a51339c2f60e-env-overrides\") pod \"ovnkube-node-4p5kl\" (UID: \"bc5b2026-4ab4-46f6-a807-a51339c2f60e\") " pod="openshift-ovn-kubernetes/ovnkube-node-4p5kl"
Jul 30 00:01:55.383174 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:01:55.381302    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/bc5b2026-4ab4-46f6-a807-a51339c2f60e-ovnkube-script-lib\") pod \"ovnkube-node-4p5kl\" (UID: \"bc5b2026-4ab4-46f6-a807-a51339c2f60e\") " pod="openshift-ovn-kubernetes/ovnkube-node-4p5kl"
Jul 30 00:01:55.383174 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:01:55.381496    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/de66dc13-ad46-4e8a-8ce5-2c54b63d852a-os-release\") pod \"multus-additional-cni-plugins-ms6sp\" (UID: \"de66dc13-ad46-4e8a-8ce5-2c54b63d852a\") " pod="openshift-multus/multus-additional-cni-plugins-ms6sp"
Jul 30 00:01:55.383789 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:01:55.381516    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/bc5b2026-4ab4-46f6-a807-a51339c2f60e-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-4p5kl\" (UID: \"bc5b2026-4ab4-46f6-a807-a51339c2f60e\") " pod="openshift-ovn-kubernetes/ovnkube-node-4p5kl"
Jul 30 00:01:55.383789 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:01:55.381533    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/bc5b2026-4ab4-46f6-a807-a51339c2f60e-run-openvswitch\") pod \"ovnkube-node-4p5kl\" (UID: \"bc5b2026-4ab4-46f6-a807-a51339c2f60e\") " pod="openshift-ovn-kubernetes/ovnkube-node-4p5kl"
Jul 30 00:01:55.383789 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:01:55.381901    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/de66dc13-ad46-4e8a-8ce5-2c54b63d852a-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-ms6sp\" (UID: \"de66dc13-ad46-4e8a-8ce5-2c54b63d852a\") " pod="openshift-multus/multus-additional-cni-plugins-ms6sp"
Jul 30 00:01:55.383789 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:01:55.383073    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/bc5b2026-4ab4-46f6-a807-a51339c2f60e-ovn-node-metrics-cert\") pod \"ovnkube-node-4p5kl\" (UID: \"bc5b2026-4ab4-46f6-a807-a51339c2f60e\") " pod="openshift-ovn-kubernetes/ovnkube-node-4p5kl"
Jul 30 00:01:55.392068 ip-10-0-133-55 kubenswrapper[2560]: E0730 00:01:55.392049    2560 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 30 00:01:55.392167 ip-10-0-133-55 kubenswrapper[2560]: E0730 00:01:55.392073    2560 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 30 00:01:55.392167 ip-10-0-133-55 kubenswrapper[2560]: E0730 00:01:55.392086    2560 projected.go:196] Error preparing data for projected volume kube-api-access-z5hvt for pod openshift-network-diagnostics/network-check-target-lx827: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 30 00:01:55.392278 ip-10-0-133-55 kubenswrapper[2560]: E0730 00:01:55.392188    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/aaa633f6-b8db-4e08-a83b-07ec5ca2d154-kube-api-access-z5hvt podName:aaa633f6-b8db-4e08-a83b-07ec5ca2d154 nodeName:}" failed. No retries permitted until 2026-07-30 00:01:55.892155063 +0000 UTC m=+2.951371858 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-z5hvt" (UniqueName: "kubernetes.io/projected/aaa633f6-b8db-4e08-a83b-07ec5ca2d154-kube-api-access-z5hvt") pod "network-check-target-lx827" (UID: "aaa633f6-b8db-4e08-a83b-07ec5ca2d154") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 30 00:01:55.393490 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:01:55.393466    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-985cs\" (UniqueName: \"kubernetes.io/projected/de66dc13-ad46-4e8a-8ce5-2c54b63d852a-kube-api-access-985cs\") pod \"multus-additional-cni-plugins-ms6sp\" (UID: \"de66dc13-ad46-4e8a-8ce5-2c54b63d852a\") " pod="openshift-multus/multus-additional-cni-plugins-ms6sp"
Jul 30 00:01:55.394369 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:01:55.394349    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-46td2\" (UniqueName: \"kubernetes.io/projected/274292b8-556c-44ad-b462-c1ea04a30abd-kube-api-access-46td2\") pod \"node-ca-7vc9d\" (UID: \"274292b8-556c-44ad-b462-c1ea04a30abd\") " pod="openshift-image-registry/node-ca-7vc9d"
Jul 30 00:01:55.394441 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:01:55.394355    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gdglm\" (UniqueName: \"kubernetes.io/projected/20473ed5-4a9f-4c87-9925-92b6543dad41-kube-api-access-gdglm\") pod \"iptables-alerter-kztbf\" (UID: \"20473ed5-4a9f-4c87-9925-92b6543dad41\") " pod="openshift-network-operator/iptables-alerter-kztbf"
Jul 30 00:01:55.394730 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:01:55.394716    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-c886x\" (UniqueName: \"kubernetes.io/projected/bc5b2026-4ab4-46f6-a807-a51339c2f60e-kube-api-access-c886x\") pod \"ovnkube-node-4p5kl\" (UID: \"bc5b2026-4ab4-46f6-a807-a51339c2f60e\") " pod="openshift-ovn-kubernetes/ovnkube-node-4p5kl"
Jul 30 00:01:55.402857 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:01:55.402824    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-55.ec2.internal" event={"ID":"66ffe78bc58e6acd2d85ae99006f0330","Type":"ContainerStarted","Data":"9ece27495eea4bcce5f3840f946462592c45bc8f3b9314bbb192d8d782cbd59c"}
Jul 30 00:01:55.403890 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:01:55.403866    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-133-55.ec2.internal" event={"ID":"7c492b170a03fda6652336c23f5889cf","Type":"ContainerStarted","Data":"f341420728c2edbf23f5e747e0c1bf53615ddb3af9e1c29885532d80b775dc01"}
Jul 30 00:01:55.481489 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:01:55.481457    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/b180523f-d9e2-4514-9b5c-091192407dc0-system-cni-dir\") pod \"multus-x8swq\" (UID: \"b180523f-d9e2-4514-9b5c-091192407dc0\") " pod="openshift-multus/multus-x8swq"
Jul 30 00:01:55.481658 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:01:55.481497    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/b180523f-d9e2-4514-9b5c-091192407dc0-host-run-multus-certs\") pod \"multus-x8swq\" (UID: \"b180523f-d9e2-4514-9b5c-091192407dc0\") " pod="openshift-multus/multus-x8swq"
Jul 30 00:01:55.481658 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:01:55.481520    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/8eb20838-c71f-4ac8-bded-78851ea49e22-run\") pod \"tuned-2mr4v\" (UID: \"8eb20838-c71f-4ac8-bded-78851ea49e22\") " pod="openshift-cluster-node-tuning-operator/tuned-2mr4v"
Jul 30 00:01:55.481658 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:01:55.481546    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/b180523f-d9e2-4514-9b5c-091192407dc0-cnibin\") pod \"multus-x8swq\" (UID: \"b180523f-d9e2-4514-9b5c-091192407dc0\") " pod="openshift-multus/multus-x8swq"
Jul 30 00:01:55.481658 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:01:55.481611    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/b180523f-d9e2-4514-9b5c-091192407dc0-host-run-multus-certs\") pod \"multus-x8swq\" (UID: \"b180523f-d9e2-4514-9b5c-091192407dc0\") " pod="openshift-multus/multus-x8swq"
Jul 30 00:01:55.481658 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:01:55.481641    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/b180523f-d9e2-4514-9b5c-091192407dc0-cnibin\") pod \"multus-x8swq\" (UID: \"b180523f-d9e2-4514-9b5c-091192407dc0\") " pod="openshift-multus/multus-x8swq"
Jul 30 00:01:55.481902 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:01:55.481665    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/8eb20838-c71f-4ac8-bded-78851ea49e22-lib-modules\") pod \"tuned-2mr4v\" (UID: \"8eb20838-c71f-4ac8-bded-78851ea49e22\") " pod="openshift-cluster-node-tuning-operator/tuned-2mr4v"
Jul 30 00:01:55.481902 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:01:55.481703    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/b180523f-d9e2-4514-9b5c-091192407dc0-system-cni-dir\") pod \"multus-x8swq\" (UID: \"b180523f-d9e2-4514-9b5c-091192407dc0\") " pod="openshift-multus/multus-x8swq"
Jul 30 00:01:55.481902 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:01:55.481816    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/8eb20838-c71f-4ac8-bded-78851ea49e22-run\") pod \"tuned-2mr4v\" (UID: \"8eb20838-c71f-4ac8-bded-78851ea49e22\") " pod="openshift-cluster-node-tuning-operator/tuned-2mr4v"
Jul 30 00:01:55.481902 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:01:55.481816    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/8eb20838-c71f-4ac8-bded-78851ea49e22-lib-modules\") pod \"tuned-2mr4v\" (UID: \"8eb20838-c71f-4ac8-bded-78851ea49e22\") " pod="openshift-cluster-node-tuning-operator/tuned-2mr4v"
Jul 30 00:01:55.481902 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:01:55.481703    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mfrr8\" (UniqueName: \"kubernetes.io/projected/05dcf00e-2c10-495a-b61b-9221eb8286e5-kube-api-access-mfrr8\") pod \"network-metrics-daemon-9g97b\" (UID: \"05dcf00e-2c10-495a-b61b-9221eb8286e5\") " pod="openshift-multus/network-metrics-daemon-9g97b"
Jul 30 00:01:55.481902 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:01:55.481898    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/d52805f6-d4e7-4896-871c-0845b47a6452-socket-dir\") pod \"aws-ebs-csi-driver-node-55z4f\" (UID: \"d52805f6-d4e7-4896-871c-0845b47a6452\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-55z4f"
Jul 30 00:01:55.482199 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:01:55.481925    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/b180523f-d9e2-4514-9b5c-091192407dc0-hostroot\") pod \"multus-x8swq\" (UID: \"b180523f-d9e2-4514-9b5c-091192407dc0\") " pod="openshift-multus/multus-x8swq"
Jul 30 00:01:55.482199 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:01:55.481964    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/b180523f-d9e2-4514-9b5c-091192407dc0-multus-daemon-config\") pod \"multus-x8swq\" (UID: \"b180523f-d9e2-4514-9b5c-091192407dc0\") " pod="openshift-multus/multus-x8swq"
Jul 30 00:01:55.482199 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:01:55.481988    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/b180523f-d9e2-4514-9b5c-091192407dc0-etc-kubernetes\") pod \"multus-x8swq\" (UID: \"b180523f-d9e2-4514-9b5c-091192407dc0\") " pod="openshift-multus/multus-x8swq"
Jul 30 00:01:55.482199 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:01:55.482016    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2xqhn\" (UniqueName: \"kubernetes.io/projected/8eb20838-c71f-4ac8-bded-78851ea49e22-kube-api-access-2xqhn\") pod \"tuned-2mr4v\" (UID: \"8eb20838-c71f-4ac8-bded-78851ea49e22\") " pod="openshift-cluster-node-tuning-operator/tuned-2mr4v"
Jul 30 00:01:55.482199 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:01:55.482061    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/b180523f-d9e2-4514-9b5c-091192407dc0-host-run-netns\") pod \"multus-x8swq\" (UID: \"b180523f-d9e2-4514-9b5c-091192407dc0\") " pod="openshift-multus/multus-x8swq"
Jul 30 00:01:55.482199 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:01:55.482084    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/b180523f-d9e2-4514-9b5c-091192407dc0-multus-cni-dir\") pod \"multus-x8swq\" (UID: \"b180523f-d9e2-4514-9b5c-091192407dc0\") " pod="openshift-multus/multus-x8swq"
Jul 30 00:01:55.482199 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:01:55.482107    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/b180523f-d9e2-4514-9b5c-091192407dc0-cni-binary-copy\") pod \"multus-x8swq\" (UID: \"b180523f-d9e2-4514-9b5c-091192407dc0\") " pod="openshift-multus/multus-x8swq"
Jul 30 00:01:55.482199 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:01:55.482135    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/c2108e9a-b8cd-4419-82ea-2f677d5e3a01-konnectivity-ca\") pod \"konnectivity-agent-n8zl8\" (UID: \"c2108e9a-b8cd-4419-82ea-2f677d5e3a01\") " pod="kube-system/konnectivity-agent-n8zl8"
Jul 30 00:01:55.482199 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:01:55.482160    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/b180523f-d9e2-4514-9b5c-091192407dc0-host-var-lib-kubelet\") pod \"multus-x8swq\" (UID: \"b180523f-d9e2-4514-9b5c-091192407dc0\") " pod="openshift-multus/multus-x8swq"
Jul 30 00:01:55.482199 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:01:55.482181    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/8eb20838-c71f-4ac8-bded-78851ea49e22-etc-sysctl-d\") pod \"tuned-2mr4v\" (UID: \"8eb20838-c71f-4ac8-bded-78851ea49e22\") " pod="openshift-cluster-node-tuning-operator/tuned-2mr4v"
Jul 30 00:01:55.482659 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:01:55.482212    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/b180523f-d9e2-4514-9b5c-091192407dc0-multus-conf-dir\") pod \"multus-x8swq\" (UID: \"b180523f-d9e2-4514-9b5c-091192407dc0\") " pod="openshift-multus/multus-x8swq"
Jul 30 00:01:55.482659 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:01:55.482235    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/e1fdf440-f1f1-40b4-9660-32cc39e1de67-dbus\") pod \"global-pull-secret-syncer-nfssx\" (UID: \"e1fdf440-f1f1-40b4-9660-32cc39e1de67\") " pod="kube-system/global-pull-secret-syncer-nfssx"
Jul 30 00:01:55.482659 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:01:55.482261    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/c2108e9a-b8cd-4419-82ea-2f677d5e3a01-agent-certs\") pod \"konnectivity-agent-n8zl8\" (UID: \"c2108e9a-b8cd-4419-82ea-2f677d5e3a01\") " pod="kube-system/konnectivity-agent-n8zl8"
Jul 30 00:01:55.482659 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:01:55.482276    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/b180523f-d9e2-4514-9b5c-091192407dc0-host-run-netns\") pod \"multus-x8swq\" (UID: \"b180523f-d9e2-4514-9b5c-091192407dc0\") " pod="openshift-multus/multus-x8swq"
Jul 30 00:01:55.482659 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:01:55.482420    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/b180523f-d9e2-4514-9b5c-091192407dc0-etc-kubernetes\") pod \"multus-x8swq\" (UID: \"b180523f-d9e2-4514-9b5c-091192407dc0\") " pod="openshift-multus/multus-x8swq"
Jul 30 00:01:55.482659 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:01:55.482417    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/d52805f6-d4e7-4896-871c-0845b47a6452-socket-dir\") pod \"aws-ebs-csi-driver-node-55z4f\" (UID: \"d52805f6-d4e7-4896-871c-0845b47a6452\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-55z4f"
Jul 30 00:01:55.482659 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:01:55.482479    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/b180523f-d9e2-4514-9b5c-091192407dc0-hostroot\") pod \"multus-x8swq\" (UID: \"b180523f-d9e2-4514-9b5c-091192407dc0\") " pod="openshift-multus/multus-x8swq"
Jul 30 00:01:55.482659 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:01:55.482522    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/b180523f-d9e2-4514-9b5c-091192407dc0-host-var-lib-kubelet\") pod \"multus-x8swq\" (UID: \"b180523f-d9e2-4514-9b5c-091192407dc0\") " pod="openshift-multus/multus-x8swq"
Jul 30 00:01:55.482659 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:01:55.482628    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/b180523f-d9e2-4514-9b5c-091192407dc0-multus-conf-dir\") pod \"multus-x8swq\" (UID: \"b180523f-d9e2-4514-9b5c-091192407dc0\") " pod="openshift-multus/multus-x8swq"
Jul 30 00:01:55.482659 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:01:55.482641    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/b180523f-d9e2-4514-9b5c-091192407dc0-multus-cni-dir\") pod \"multus-x8swq\" (UID: \"b180523f-d9e2-4514-9b5c-091192407dc0\") " pod="openshift-multus/multus-x8swq"
Jul 30 00:01:55.483107 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:01:55.482672    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/e1fdf440-f1f1-40b4-9660-32cc39e1de67-dbus\") pod \"global-pull-secret-syncer-nfssx\" (UID: \"e1fdf440-f1f1-40b4-9660-32cc39e1de67\") " pod="kube-system/global-pull-secret-syncer-nfssx"
Jul 30 00:01:55.483107 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:01:55.482735    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/8eb20838-c71f-4ac8-bded-78851ea49e22-etc-sysctl-d\") pod \"tuned-2mr4v\" (UID: \"8eb20838-c71f-4ac8-bded-78851ea49e22\") " pod="openshift-cluster-node-tuning-operator/tuned-2mr4v"
Jul 30 00:01:55.483107 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:01:55.482836    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vmrwj\" (UniqueName: \"kubernetes.io/projected/4f585163-3e80-4055-bfdd-17d37e755a71-kube-api-access-vmrwj\") pod \"node-resolver-5ffvl\" (UID: \"4f585163-3e80-4055-bfdd-17d37e755a71\") " pod="openshift-dns/node-resolver-5ffvl"
Jul 30 00:01:55.483107 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:01:55.482865    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/8eb20838-c71f-4ac8-bded-78851ea49e22-etc-sysconfig\") pod \"tuned-2mr4v\" (UID: \"8eb20838-c71f-4ac8-bded-78851ea49e22\") " pod="openshift-cluster-node-tuning-operator/tuned-2mr4v"
Jul 30 00:01:55.483107 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:01:55.482887    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/8eb20838-c71f-4ac8-bded-78851ea49e22-sys\") pod \"tuned-2mr4v\" (UID: \"8eb20838-c71f-4ac8-bded-78851ea49e22\") " pod="openshift-cluster-node-tuning-operator/tuned-2mr4v"
Jul 30 00:01:55.483107 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:01:55.482912    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/8eb20838-c71f-4ac8-bded-78851ea49e22-var-lib-kubelet\") pod \"tuned-2mr4v\" (UID: \"8eb20838-c71f-4ac8-bded-78851ea49e22\") " pod="openshift-cluster-node-tuning-operator/tuned-2mr4v"
Jul 30 00:01:55.483107 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:01:55.482937    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/05dcf00e-2c10-495a-b61b-9221eb8286e5-metrics-certs\") pod \"network-metrics-daemon-9g97b\" (UID: \"05dcf00e-2c10-495a-b61b-9221eb8286e5\") " pod="openshift-multus/network-metrics-daemon-9g97b"
Jul 30 00:01:55.483107 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:01:55.482961    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/d52805f6-d4e7-4896-871c-0845b47a6452-device-dir\") pod \"aws-ebs-csi-driver-node-55z4f\" (UID: \"d52805f6-d4e7-4896-871c-0845b47a6452\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-55z4f"
Jul 30 00:01:55.483107 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:01:55.482982    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/d52805f6-d4e7-4896-871c-0845b47a6452-etc-selinux\") pod \"aws-ebs-csi-driver-node-55z4f\" (UID: \"d52805f6-d4e7-4896-871c-0845b47a6452\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-55z4f"
Jul 30 00:01:55.483107 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:01:55.483007    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-z2hds\" (UniqueName: \"kubernetes.io/projected/b180523f-d9e2-4514-9b5c-091192407dc0-kube-api-access-z2hds\") pod \"multus-x8swq\" (UID: \"b180523f-d9e2-4514-9b5c-091192407dc0\") " pod="openshift-multus/multus-x8swq"
Jul 30 00:01:55.483107 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:01:55.483041    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/8eb20838-c71f-4ac8-bded-78851ea49e22-etc-systemd\") pod \"tuned-2mr4v\" (UID: \"8eb20838-c71f-4ac8-bded-78851ea49e22\") " pod="openshift-cluster-node-tuning-operator/tuned-2mr4v"
Jul 30 00:01:55.483107 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:01:55.483067    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/4f585163-3e80-4055-bfdd-17d37e755a71-tmp-dir\") pod \"node-resolver-5ffvl\" (UID: \"4f585163-3e80-4055-bfdd-17d37e755a71\") " pod="openshift-dns/node-resolver-5ffvl"
Jul 30 00:01:55.483107 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:01:55.483101    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9wkl9\" (UniqueName: \"kubernetes.io/projected/d52805f6-d4e7-4896-871c-0845b47a6452-kube-api-access-9wkl9\") pod \"aws-ebs-csi-driver-node-55z4f\" (UID: \"d52805f6-d4e7-4896-871c-0845b47a6452\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-55z4f"
Jul 30 00:01:55.483699 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:01:55.483125    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/b180523f-d9e2-4514-9b5c-091192407dc0-os-release\") pod \"multus-x8swq\" (UID: \"b180523f-d9e2-4514-9b5c-091192407dc0\") " pod="openshift-multus/multus-x8swq"
Jul 30 00:01:55.483699 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:01:55.483149    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/b180523f-d9e2-4514-9b5c-091192407dc0-host-run-k8s-cni-cncf-io\") pod \"multus-x8swq\" (UID: \"b180523f-d9e2-4514-9b5c-091192407dc0\") " pod="openshift-multus/multus-x8swq"
Jul 30 00:01:55.483699 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:01:55.483171    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/8eb20838-c71f-4ac8-bded-78851ea49e22-etc-tuned\") pod \"tuned-2mr4v\" (UID: \"8eb20838-c71f-4ac8-bded-78851ea49e22\") " pod="openshift-cluster-node-tuning-operator/tuned-2mr4v"
Jul 30 00:01:55.483699 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:01:55.483194    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/e1fdf440-f1f1-40b4-9660-32cc39e1de67-kubelet-config\") pod \"global-pull-secret-syncer-nfssx\" (UID: \"e1fdf440-f1f1-40b4-9660-32cc39e1de67\") " pod="kube-system/global-pull-secret-syncer-nfssx"
Jul 30 00:01:55.483699 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:01:55.483211    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/c2108e9a-b8cd-4419-82ea-2f677d5e3a01-konnectivity-ca\") pod \"konnectivity-agent-n8zl8\" (UID: \"c2108e9a-b8cd-4419-82ea-2f677d5e3a01\") " pod="kube-system/konnectivity-agent-n8zl8"
Jul 30 00:01:55.483699 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:01:55.483221    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/8eb20838-c71f-4ac8-bded-78851ea49e22-etc-modprobe-d\") pod \"tuned-2mr4v\" (UID: \"8eb20838-c71f-4ac8-bded-78851ea49e22\") " pod="openshift-cluster-node-tuning-operator/tuned-2mr4v"
Jul 30 00:01:55.483699 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:01:55.483254    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/d52805f6-d4e7-4896-871c-0845b47a6452-registration-dir\") pod \"aws-ebs-csi-driver-node-55z4f\" (UID: \"d52805f6-d4e7-4896-871c-0845b47a6452\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-55z4f"
Jul 30 00:01:55.483699 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:01:55.483238    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/b180523f-d9e2-4514-9b5c-091192407dc0-cni-binary-copy\") pod \"multus-x8swq\" (UID: \"b180523f-d9e2-4514-9b5c-091192407dc0\") " pod="openshift-multus/multus-x8swq"
Jul 30 00:01:55.483699 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:01:55.483281    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/8eb20838-c71f-4ac8-bded-78851ea49e22-etc-sysconfig\") pod \"tuned-2mr4v\" (UID: \"8eb20838-c71f-4ac8-bded-78851ea49e22\") " pod="openshift-cluster-node-tuning-operator/tuned-2mr4v"
Jul 30 00:01:55.483699 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:01:55.483284    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/b180523f-d9e2-4514-9b5c-091192407dc0-multus-socket-dir-parent\") pod \"multus-x8swq\" (UID: \"b180523f-d9e2-4514-9b5c-091192407dc0\") " pod="openshift-multus/multus-x8swq"
Jul 30 00:01:55.483699 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:01:55.483353    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/b180523f-d9e2-4514-9b5c-091192407dc0-multus-socket-dir-parent\") pod \"multus-x8swq\" (UID: \"b180523f-d9e2-4514-9b5c-091192407dc0\") " pod="openshift-multus/multus-x8swq"
Jul 30 00:01:55.483699 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:01:55.483354    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/8eb20838-c71f-4ac8-bded-78851ea49e22-sys\") pod \"tuned-2mr4v\" (UID: \"8eb20838-c71f-4ac8-bded-78851ea49e22\") " pod="openshift-cluster-node-tuning-operator/tuned-2mr4v"
Jul 30 00:01:55.483699 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:01:55.483398    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/d52805f6-d4e7-4896-871c-0845b47a6452-registration-dir\") pod \"aws-ebs-csi-driver-node-55z4f\" (UID: \"d52805f6-d4e7-4896-871c-0845b47a6452\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-55z4f"
Jul 30 00:01:55.483699 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:01:55.483458    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/b180523f-d9e2-4514-9b5c-091192407dc0-host-run-k8s-cni-cncf-io\") pod \"multus-x8swq\" (UID: \"b180523f-d9e2-4514-9b5c-091192407dc0\") " pod="openshift-multus/multus-x8swq"
Jul 30 00:01:55.483699 ip-10-0-133-55 kubenswrapper[2560]: E0730 00:01:55.483488    2560 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 30 00:01:55.483699 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:01:55.483488    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/8eb20838-c71f-4ac8-bded-78851ea49e22-etc-modprobe-d\") pod \"tuned-2mr4v\" (UID: \"8eb20838-c71f-4ac8-bded-78851ea49e22\") " pod="openshift-cluster-node-tuning-operator/tuned-2mr4v"
Jul 30 00:01:55.483699 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:01:55.483526    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/b180523f-d9e2-4514-9b5c-091192407dc0-multus-daemon-config\") pod \"multus-x8swq\" (UID: \"b180523f-d9e2-4514-9b5c-091192407dc0\") " pod="openshift-multus/multus-x8swq"
Jul 30 00:01:55.484409 ip-10-0-133-55 kubenswrapper[2560]: E0730 00:01:55.483545    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/05dcf00e-2c10-495a-b61b-9221eb8286e5-metrics-certs podName:05dcf00e-2c10-495a-b61b-9221eb8286e5 nodeName:}" failed. No retries permitted until 2026-07-30 00:01:55.983529121 +0000 UTC m=+3.042745908 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/05dcf00e-2c10-495a-b61b-9221eb8286e5-metrics-certs") pod "network-metrics-daemon-9g97b" (UID: "05dcf00e-2c10-495a-b61b-9221eb8286e5") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 30 00:01:55.484409 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:01:55.483605    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/4f585163-3e80-4055-bfdd-17d37e755a71-hosts-file\") pod \"node-resolver-5ffvl\" (UID: \"4f585163-3e80-4055-bfdd-17d37e755a71\") " pod="openshift-dns/node-resolver-5ffvl"
Jul 30 00:01:55.484409 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:01:55.483641    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/8eb20838-c71f-4ac8-bded-78851ea49e22-tmp\") pod \"tuned-2mr4v\" (UID: \"8eb20838-c71f-4ac8-bded-78851ea49e22\") " pod="openshift-cluster-node-tuning-operator/tuned-2mr4v"
Jul 30 00:01:55.484409 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:01:55.483692    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/d52805f6-d4e7-4896-871c-0845b47a6452-device-dir\") pod \"aws-ebs-csi-driver-node-55z4f\" (UID: \"d52805f6-d4e7-4896-871c-0845b47a6452\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-55z4f"
Jul 30 00:01:55.484409 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:01:55.483706    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/4f585163-3e80-4055-bfdd-17d37e755a71-hosts-file\") pod \"node-resolver-5ffvl\" (UID: \"4f585163-3e80-4055-bfdd-17d37e755a71\") " pod="openshift-dns/node-resolver-5ffvl"
Jul 30 00:01:55.484409 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:01:55.483739    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/d52805f6-d4e7-4896-871c-0845b47a6452-sys-fs\") pod \"aws-ebs-csi-driver-node-55z4f\" (UID: \"d52805f6-d4e7-4896-871c-0845b47a6452\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-55z4f"
Jul 30 00:01:55.484409 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:01:55.483762    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/b180523f-d9e2-4514-9b5c-091192407dc0-os-release\") pod \"multus-x8swq\" (UID: \"b180523f-d9e2-4514-9b5c-091192407dc0\") " pod="openshift-multus/multus-x8swq"
Jul 30 00:01:55.484409 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:01:55.483778    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/8eb20838-c71f-4ac8-bded-78851ea49e22-etc-kubernetes\") pod \"tuned-2mr4v\" (UID: \"8eb20838-c71f-4ac8-bded-78851ea49e22\") " pod="openshift-cluster-node-tuning-operator/tuned-2mr4v"
Jul 30 00:01:55.484409 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:01:55.483825    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/e1fdf440-f1f1-40b4-9660-32cc39e1de67-kubelet-config\") pod \"global-pull-secret-syncer-nfssx\" (UID: \"e1fdf440-f1f1-40b4-9660-32cc39e1de67\") " pod="kube-system/global-pull-secret-syncer-nfssx"
Jul 30 00:01:55.484409 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:01:55.483836    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/8eb20838-c71f-4ac8-bded-78851ea49e22-etc-systemd\") pod \"tuned-2mr4v\" (UID: \"8eb20838-c71f-4ac8-bded-78851ea49e22\") " pod="openshift-cluster-node-tuning-operator/tuned-2mr4v"
Jul 30 00:01:55.484409 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:01:55.483870    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/d52805f6-d4e7-4896-871c-0845b47a6452-sys-fs\") pod \"aws-ebs-csi-driver-node-55z4f\" (UID: \"d52805f6-d4e7-4896-871c-0845b47a6452\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-55z4f"
Jul 30 00:01:55.484409 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:01:55.483881    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/8eb20838-c71f-4ac8-bded-78851ea49e22-etc-kubernetes\") pod \"tuned-2mr4v\" (UID: \"8eb20838-c71f-4ac8-bded-78851ea49e22\") " pod="openshift-cluster-node-tuning-operator/tuned-2mr4v"
Jul 30 00:01:55.484409 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:01:55.483893    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/8eb20838-c71f-4ac8-bded-78851ea49e22-etc-sysctl-conf\") pod \"tuned-2mr4v\" (UID: \"8eb20838-c71f-4ac8-bded-78851ea49e22\") " pod="openshift-cluster-node-tuning-operator/tuned-2mr4v"
Jul 30 00:01:55.484409 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:01:55.483946    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/8eb20838-c71f-4ac8-bded-78851ea49e22-host\") pod \"tuned-2mr4v\" (UID: \"8eb20838-c71f-4ac8-bded-78851ea49e22\") " pod="openshift-cluster-node-tuning-operator/tuned-2mr4v"
Jul 30 00:01:55.484409 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:01:55.483952    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/d52805f6-d4e7-4896-871c-0845b47a6452-etc-selinux\") pod \"aws-ebs-csi-driver-node-55z4f\" (UID: \"d52805f6-d4e7-4896-871c-0845b47a6452\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-55z4f"
Jul 30 00:01:55.484409 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:01:55.483971    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/e1fdf440-f1f1-40b4-9660-32cc39e1de67-original-pull-secret\") pod \"global-pull-secret-syncer-nfssx\" (UID: \"e1fdf440-f1f1-40b4-9660-32cc39e1de67\") " pod="kube-system/global-pull-secret-syncer-nfssx"
Jul 30 00:01:55.484409 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:01:55.483974    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/4f585163-3e80-4055-bfdd-17d37e755a71-tmp-dir\") pod \"node-resolver-5ffvl\" (UID: \"4f585163-3e80-4055-bfdd-17d37e755a71\") " pod="openshift-dns/node-resolver-5ffvl"
Jul 30 00:01:55.485251 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:01:55.484006    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/8eb20838-c71f-4ac8-bded-78851ea49e22-host\") pod \"tuned-2mr4v\" (UID: \"8eb20838-c71f-4ac8-bded-78851ea49e22\") " pod="openshift-cluster-node-tuning-operator/tuned-2mr4v"
Jul 30 00:01:55.485251 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:01:55.484026    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/8eb20838-c71f-4ac8-bded-78851ea49e22-var-lib-kubelet\") pod \"tuned-2mr4v\" (UID: \"8eb20838-c71f-4ac8-bded-78851ea49e22\") " pod="openshift-cluster-node-tuning-operator/tuned-2mr4v"
Jul 30 00:01:55.485251 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:01:55.484014    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/d52805f6-d4e7-4896-871c-0845b47a6452-kubelet-dir\") pod \"aws-ebs-csi-driver-node-55z4f\" (UID: \"d52805f6-d4e7-4896-871c-0845b47a6452\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-55z4f"
Jul 30 00:01:55.485251 ip-10-0-133-55 kubenswrapper[2560]: E0730 00:01:55.484061    2560 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 30 00:01:55.485251 ip-10-0-133-55 kubenswrapper[2560]: E0730 00:01:55.484147    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e1fdf440-f1f1-40b4-9660-32cc39e1de67-original-pull-secret podName:e1fdf440-f1f1-40b4-9660-32cc39e1de67 nodeName:}" failed. No retries permitted until 2026-07-30 00:01:55.984128528 +0000 UTC m=+3.043345313 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/e1fdf440-f1f1-40b4-9660-32cc39e1de67-original-pull-secret") pod "global-pull-secret-syncer-nfssx" (UID: "e1fdf440-f1f1-40b4-9660-32cc39e1de67") : object "kube-system"/"original-pull-secret" not registered
Jul 30 00:01:55.485251 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:01:55.484157    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/d52805f6-d4e7-4896-871c-0845b47a6452-kubelet-dir\") pod \"aws-ebs-csi-driver-node-55z4f\" (UID: \"d52805f6-d4e7-4896-871c-0845b47a6452\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-55z4f"
Jul 30 00:01:55.485251 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:01:55.484195    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/8eb20838-c71f-4ac8-bded-78851ea49e22-etc-sysctl-conf\") pod \"tuned-2mr4v\" (UID: \"8eb20838-c71f-4ac8-bded-78851ea49e22\") " pod="openshift-cluster-node-tuning-operator/tuned-2mr4v"
Jul 30 00:01:55.485251 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:01:55.484203    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/b180523f-d9e2-4514-9b5c-091192407dc0-host-var-lib-cni-bin\") pod \"multus-x8swq\" (UID: \"b180523f-d9e2-4514-9b5c-091192407dc0\") " pod="openshift-multus/multus-x8swq"
Jul 30 00:01:55.485251 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:01:55.484240    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/b180523f-d9e2-4514-9b5c-091192407dc0-host-var-lib-cni-bin\") pod \"multus-x8swq\" (UID: \"b180523f-d9e2-4514-9b5c-091192407dc0\") " pod="openshift-multus/multus-x8swq"
Jul 30 00:01:55.485251 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:01:55.484238    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/b180523f-d9e2-4514-9b5c-091192407dc0-host-var-lib-cni-multus\") pod \"multus-x8swq\" (UID: \"b180523f-d9e2-4514-9b5c-091192407dc0\") " pod="openshift-multus/multus-x8swq"
Jul 30 00:01:55.485251 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:01:55.484272    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/b180523f-d9e2-4514-9b5c-091192407dc0-host-var-lib-cni-multus\") pod \"multus-x8swq\" (UID: \"b180523f-d9e2-4514-9b5c-091192407dc0\") " pod="openshift-multus/multus-x8swq"
Jul 30 00:01:55.485251 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:01:55.485208    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/c2108e9a-b8cd-4419-82ea-2f677d5e3a01-agent-certs\") pod \"konnectivity-agent-n8zl8\" (UID: \"c2108e9a-b8cd-4419-82ea-2f677d5e3a01\") " pod="kube-system/konnectivity-agent-n8zl8"
Jul 30 00:01:55.485959 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:01:55.485938    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/8eb20838-c71f-4ac8-bded-78851ea49e22-etc-tuned\") pod \"tuned-2mr4v\" (UID: \"8eb20838-c71f-4ac8-bded-78851ea49e22\") " pod="openshift-cluster-node-tuning-operator/tuned-2mr4v"
Jul 30 00:01:55.486536 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:01:55.486514    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/8eb20838-c71f-4ac8-bded-78851ea49e22-tmp\") pod \"tuned-2mr4v\" (UID: \"8eb20838-c71f-4ac8-bded-78851ea49e22\") " pod="openshift-cluster-node-tuning-operator/tuned-2mr4v"
Jul 30 00:01:55.490211 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:01:55.490133    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2xqhn\" (UniqueName: \"kubernetes.io/projected/8eb20838-c71f-4ac8-bded-78851ea49e22-kube-api-access-2xqhn\") pod \"tuned-2mr4v\" (UID: \"8eb20838-c71f-4ac8-bded-78851ea49e22\") " pod="openshift-cluster-node-tuning-operator/tuned-2mr4v"
Jul 30 00:01:55.491081 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:01:55.491021    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mfrr8\" (UniqueName: \"kubernetes.io/projected/05dcf00e-2c10-495a-b61b-9221eb8286e5-kube-api-access-mfrr8\") pod \"network-metrics-daemon-9g97b\" (UID: \"05dcf00e-2c10-495a-b61b-9221eb8286e5\") " pod="openshift-multus/network-metrics-daemon-9g97b"
Jul 30 00:01:55.491878 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:01:55.491854    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-z2hds\" (UniqueName: \"kubernetes.io/projected/b180523f-d9e2-4514-9b5c-091192407dc0-kube-api-access-z2hds\") pod \"multus-x8swq\" (UID: \"b180523f-d9e2-4514-9b5c-091192407dc0\") " pod="openshift-multus/multus-x8swq"
Jul 30 00:01:55.492123 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:01:55.492101    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vmrwj\" (UniqueName: \"kubernetes.io/projected/4f585163-3e80-4055-bfdd-17d37e755a71-kube-api-access-vmrwj\") pod \"node-resolver-5ffvl\" (UID: \"4f585163-3e80-4055-bfdd-17d37e755a71\") " pod="openshift-dns/node-resolver-5ffvl"
Jul 30 00:01:55.492184 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:01:55.492134    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9wkl9\" (UniqueName: \"kubernetes.io/projected/d52805f6-d4e7-4896-871c-0845b47a6452-kube-api-access-9wkl9\") pod \"aws-ebs-csi-driver-node-55z4f\" (UID: \"d52805f6-d4e7-4896-871c-0845b47a6452\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-55z4f"
Jul 30 00:01:55.572555 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:01:55.572295    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-4p5kl"
Jul 30 00:01:55.581754 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:01:55.581703    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-kztbf"
Jul 30 00:01:55.589993 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:01:55.589823    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-7vc9d"
Jul 30 00:01:55.596141 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:01:55.596120    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-ms6sp"
Jul 30 00:01:55.602953 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:01:55.602932    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-x8swq"
Jul 30 00:01:55.610786 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:01:55.610766    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-2mr4v"
Jul 30 00:01:55.618434 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:01:55.618393    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-n8zl8"
Jul 30 00:01:55.624030 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:01:55.624005    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-5ffvl"
Jul 30 00:01:55.629288 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:01:55.629269    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-55z4f"
Jul 30 00:01:55.837348 ip-10-0-133-55 kubenswrapper[2560]: W0730 00:01:55.837290    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8eb20838_c71f_4ac8_bded_78851ea49e22.slice/crio-c29fed54d8dffc5d6a0a4bc5eed4b5763b570232de37bbecae240096354a9961 WatchSource:0}: Error finding container c29fed54d8dffc5d6a0a4bc5eed4b5763b570232de37bbecae240096354a9961: Status 404 returned error can't find the container with id c29fed54d8dffc5d6a0a4bc5eed4b5763b570232de37bbecae240096354a9961
Jul 30 00:01:55.839009 ip-10-0-133-55 kubenswrapper[2560]: W0730 00:01:55.838982    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod20473ed5_4a9f_4c87_9925_92b6543dad41.slice/crio-fb805536aebd6d7c76731c40bc442b20d5d64135ff8bedcc4b0212d64a100add WatchSource:0}: Error finding container fb805536aebd6d7c76731c40bc442b20d5d64135ff8bedcc4b0212d64a100add: Status 404 returned error can't find the container with id fb805536aebd6d7c76731c40bc442b20d5d64135ff8bedcc4b0212d64a100add
Jul 30 00:01:55.841149 ip-10-0-133-55 kubenswrapper[2560]: W0730 00:01:55.841003    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd52805f6_d4e7_4896_871c_0845b47a6452.slice/crio-5cf26ce02f322cca62794268eedfe189c1a4cf1f6d07c86b610fabcd2bcf64e8 WatchSource:0}: Error finding container 5cf26ce02f322cca62794268eedfe189c1a4cf1f6d07c86b610fabcd2bcf64e8: Status 404 returned error can't find the container with id 5cf26ce02f322cca62794268eedfe189c1a4cf1f6d07c86b610fabcd2bcf64e8
Jul 30 00:01:55.865765 ip-10-0-133-55 kubenswrapper[2560]: W0730 00:01:55.865738    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbc5b2026_4ab4_46f6_a807_a51339c2f60e.slice/crio-5eea6a703a630472df4a2aad2cd3bcf873eb012408484d446cb160fc88d94b17 WatchSource:0}: Error finding container 5eea6a703a630472df4a2aad2cd3bcf873eb012408484d446cb160fc88d94b17: Status 404 returned error can't find the container with id 5eea6a703a630472df4a2aad2cd3bcf873eb012408484d446cb160fc88d94b17
Jul 30 00:01:55.865974 ip-10-0-133-55 kubenswrapper[2560]: W0730 00:01:55.865947    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podde66dc13_ad46_4e8a_8ce5_2c54b63d852a.slice/crio-594a0f8c302bca877721bad5244b264e5961bc4068c00475e6fbb356ee31891a WatchSource:0}: Error finding container 594a0f8c302bca877721bad5244b264e5961bc4068c00475e6fbb356ee31891a: Status 404 returned error can't find the container with id 594a0f8c302bca877721bad5244b264e5961bc4068c00475e6fbb356ee31891a
Jul 30 00:01:55.866616 ip-10-0-133-55 kubenswrapper[2560]: W0730 00:01:55.866564    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc2108e9a_b8cd_4419_82ea_2f677d5e3a01.slice/crio-16bf35bdd6abc3bd14c457bf661b7b393a128d302c041037b9c0a9c3f8e9b588 WatchSource:0}: Error finding container 16bf35bdd6abc3bd14c457bf661b7b393a128d302c041037b9c0a9c3f8e9b588: Status 404 returned error can't find the container with id 16bf35bdd6abc3bd14c457bf661b7b393a128d302c041037b9c0a9c3f8e9b588
Jul 30 00:01:55.869485 ip-10-0-133-55 kubenswrapper[2560]: W0730 00:01:55.869466    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4f585163_3e80_4055_bfdd_17d37e755a71.slice/crio-298a24d25881fc2ab743a040eb2d0f9f5f253bf77de1de44b025911790d6030c WatchSource:0}: Error finding container 298a24d25881fc2ab743a040eb2d0f9f5f253bf77de1de44b025911790d6030c: Status 404 returned error can't find the container with id 298a24d25881fc2ab743a040eb2d0f9f5f253bf77de1de44b025911790d6030c
Jul 30 00:01:55.870650 ip-10-0-133-55 kubenswrapper[2560]: W0730 00:01:55.870625    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb180523f_d9e2_4514_9b5c_091192407dc0.slice/crio-9ba6cf126639cb1afaaa13c08840264622f31cb4550d20120fc8ebcdc66a46e7 WatchSource:0}: Error finding container 9ba6cf126639cb1afaaa13c08840264622f31cb4550d20120fc8ebcdc66a46e7: Status 404 returned error can't find the container with id 9ba6cf126639cb1afaaa13c08840264622f31cb4550d20120fc8ebcdc66a46e7
Jul 30 00:01:55.987473 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:01:55.987442    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/e1fdf440-f1f1-40b4-9660-32cc39e1de67-original-pull-secret\") pod \"global-pull-secret-syncer-nfssx\" (UID: \"e1fdf440-f1f1-40b4-9660-32cc39e1de67\") " pod="kube-system/global-pull-secret-syncer-nfssx"
Jul 30 00:01:55.987617 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:01:55.987498    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-z5hvt\" (UniqueName: \"kubernetes.io/projected/aaa633f6-b8db-4e08-a83b-07ec5ca2d154-kube-api-access-z5hvt\") pod \"network-check-target-lx827\" (UID: \"aaa633f6-b8db-4e08-a83b-07ec5ca2d154\") " pod="openshift-network-diagnostics/network-check-target-lx827"
Jul 30 00:01:55.987617 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:01:55.987538    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/05dcf00e-2c10-495a-b61b-9221eb8286e5-metrics-certs\") pod \"network-metrics-daemon-9g97b\" (UID: \"05dcf00e-2c10-495a-b61b-9221eb8286e5\") " pod="openshift-multus/network-metrics-daemon-9g97b"
Jul 30 00:01:55.987617 ip-10-0-133-55 kubenswrapper[2560]: E0730 00:01:55.987553    2560 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 30 00:01:55.987617 ip-10-0-133-55 kubenswrapper[2560]: E0730 00:01:55.987607    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e1fdf440-f1f1-40b4-9660-32cc39e1de67-original-pull-secret podName:e1fdf440-f1f1-40b4-9660-32cc39e1de67 nodeName:}" failed. No retries permitted until 2026-07-30 00:01:56.987591557 +0000 UTC m=+4.046808354 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/e1fdf440-f1f1-40b4-9660-32cc39e1de67-original-pull-secret") pod "global-pull-secret-syncer-nfssx" (UID: "e1fdf440-f1f1-40b4-9660-32cc39e1de67") : object "kube-system"/"original-pull-secret" not registered
Jul 30 00:01:55.987818 ip-10-0-133-55 kubenswrapper[2560]: E0730 00:01:55.987638    2560 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 30 00:01:55.987818 ip-10-0-133-55 kubenswrapper[2560]: E0730 00:01:55.987695    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/05dcf00e-2c10-495a-b61b-9221eb8286e5-metrics-certs podName:05dcf00e-2c10-495a-b61b-9221eb8286e5 nodeName:}" failed. No retries permitted until 2026-07-30 00:01:56.987679249 +0000 UTC m=+4.046896048 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/05dcf00e-2c10-495a-b61b-9221eb8286e5-metrics-certs") pod "network-metrics-daemon-9g97b" (UID: "05dcf00e-2c10-495a-b61b-9221eb8286e5") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 30 00:01:55.987818 ip-10-0-133-55 kubenswrapper[2560]: E0730 00:01:55.987766    2560 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 30 00:01:55.987818 ip-10-0-133-55 kubenswrapper[2560]: E0730 00:01:55.987787    2560 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 30 00:01:55.987818 ip-10-0-133-55 kubenswrapper[2560]: E0730 00:01:55.987801    2560 projected.go:196] Error preparing data for projected volume kube-api-access-z5hvt for pod openshift-network-diagnostics/network-check-target-lx827: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 30 00:01:55.988029 ip-10-0-133-55 kubenswrapper[2560]: E0730 00:01:55.987845    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/aaa633f6-b8db-4e08-a83b-07ec5ca2d154-kube-api-access-z5hvt podName:aaa633f6-b8db-4e08-a83b-07ec5ca2d154 nodeName:}" failed. No retries permitted until 2026-07-30 00:01:56.98783097 +0000 UTC m=+4.047047757 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-z5hvt" (UniqueName: "kubernetes.io/projected/aaa633f6-b8db-4e08-a83b-07ec5ca2d154-kube-api-access-z5hvt") pod "network-check-target-lx827" (UID: "aaa633f6-b8db-4e08-a83b-07ec5ca2d154") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 30 00:01:56.187461 ip-10-0-133-55 kubenswrapper[2560]: W0730 00:01:56.187418    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod274292b8_556c_44ad_b462_c1ea04a30abd.slice/crio-959ee5628f288e37324844e5ab096ab2bb6ea7ff0ce8faf60ff12a44224afc07 WatchSource:0}: Error finding container 959ee5628f288e37324844e5ab096ab2bb6ea7ff0ce8faf60ff12a44224afc07: Status 404 returned error can't find the container with id 959ee5628f288e37324844e5ab096ab2bb6ea7ff0ce8faf60ff12a44224afc07
Jul 30 00:01:56.362360 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:01:56.362286    2560 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-28 23:56:55 +0000 UTC" deadline="2028-02-21 00:52:31.028124779 +0000 UTC"
Jul 30 00:01:56.362360 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:01:56.362355    2560 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="13704h50m34.665774012s"
Jul 30 00:01:56.407605 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:01:56.407570    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-7vc9d" event={"ID":"274292b8-556c-44ad-b462-c1ea04a30abd","Type":"ContainerStarted","Data":"959ee5628f288e37324844e5ab096ab2bb6ea7ff0ce8faf60ff12a44224afc07"}
Jul 30 00:01:56.408776 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:01:56.408749    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-5ffvl" event={"ID":"4f585163-3e80-4055-bfdd-17d37e755a71","Type":"ContainerStarted","Data":"298a24d25881fc2ab743a040eb2d0f9f5f253bf77de1de44b025911790d6030c"}
Jul 30 00:01:56.409861 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:01:56.409825    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-n8zl8" event={"ID":"c2108e9a-b8cd-4419-82ea-2f677d5e3a01","Type":"ContainerStarted","Data":"16bf35bdd6abc3bd14c457bf661b7b393a128d302c041037b9c0a9c3f8e9b588"}
Jul 30 00:01:56.410899 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:01:56.410876    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-55z4f" event={"ID":"d52805f6-d4e7-4896-871c-0845b47a6452","Type":"ContainerStarted","Data":"5cf26ce02f322cca62794268eedfe189c1a4cf1f6d07c86b610fabcd2bcf64e8"}
Jul 30 00:01:56.411920 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:01:56.411890    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-kztbf" event={"ID":"20473ed5-4a9f-4c87-9925-92b6543dad41","Type":"ContainerStarted","Data":"fb805536aebd6d7c76731c40bc442b20d5d64135ff8bedcc4b0212d64a100add"}
Jul 30 00:01:56.412975 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:01:56.412951    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-2mr4v" event={"ID":"8eb20838-c71f-4ac8-bded-78851ea49e22","Type":"ContainerStarted","Data":"c29fed54d8dffc5d6a0a4bc5eed4b5763b570232de37bbecae240096354a9961"}
Jul 30 00:01:56.414009 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:01:56.413984    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-x8swq" event={"ID":"b180523f-d9e2-4514-9b5c-091192407dc0","Type":"ContainerStarted","Data":"9ba6cf126639cb1afaaa13c08840264622f31cb4550d20120fc8ebcdc66a46e7"}
Jul 30 00:01:56.415091 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:01:56.415070    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-ms6sp" event={"ID":"de66dc13-ad46-4e8a-8ce5-2c54b63d852a","Type":"ContainerStarted","Data":"594a0f8c302bca877721bad5244b264e5961bc4068c00475e6fbb356ee31891a"}
Jul 30 00:01:56.416179 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:01:56.416153    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-4p5kl" event={"ID":"bc5b2026-4ab4-46f6-a807-a51339c2f60e","Type":"ContainerStarted","Data":"5eea6a703a630472df4a2aad2cd3bcf873eb012408484d446cb160fc88d94b17"}
Jul 30 00:01:56.995439 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:01:56.995190    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/e1fdf440-f1f1-40b4-9660-32cc39e1de67-original-pull-secret\") pod \"global-pull-secret-syncer-nfssx\" (UID: \"e1fdf440-f1f1-40b4-9660-32cc39e1de67\") " pod="kube-system/global-pull-secret-syncer-nfssx"
Jul 30 00:01:56.995627 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:01:56.995493    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-z5hvt\" (UniqueName: \"kubernetes.io/projected/aaa633f6-b8db-4e08-a83b-07ec5ca2d154-kube-api-access-z5hvt\") pod \"network-check-target-lx827\" (UID: \"aaa633f6-b8db-4e08-a83b-07ec5ca2d154\") " pod="openshift-network-diagnostics/network-check-target-lx827"
Jul 30 00:01:56.995627 ip-10-0-133-55 kubenswrapper[2560]: E0730 00:01:56.995369    2560 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 30 00:01:56.995627 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:01:56.995544    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/05dcf00e-2c10-495a-b61b-9221eb8286e5-metrics-certs\") pod \"network-metrics-daemon-9g97b\" (UID: \"05dcf00e-2c10-495a-b61b-9221eb8286e5\") " pod="openshift-multus/network-metrics-daemon-9g97b"
Jul 30 00:01:56.995627 ip-10-0-133-55 kubenswrapper[2560]: E0730 00:01:56.995581    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e1fdf440-f1f1-40b4-9660-32cc39e1de67-original-pull-secret podName:e1fdf440-f1f1-40b4-9660-32cc39e1de67 nodeName:}" failed. No retries permitted until 2026-07-30 00:01:58.995559685 +0000 UTC m=+6.054776485 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/e1fdf440-f1f1-40b4-9660-32cc39e1de67-original-pull-secret") pod "global-pull-secret-syncer-nfssx" (UID: "e1fdf440-f1f1-40b4-9660-32cc39e1de67") : object "kube-system"/"original-pull-secret" not registered
Jul 30 00:01:56.995839 ip-10-0-133-55 kubenswrapper[2560]: E0730 00:01:56.995634    2560 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 30 00:01:56.995839 ip-10-0-133-55 kubenswrapper[2560]: E0730 00:01:56.995683    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/05dcf00e-2c10-495a-b61b-9221eb8286e5-metrics-certs podName:05dcf00e-2c10-495a-b61b-9221eb8286e5 nodeName:}" failed. No retries permitted until 2026-07-30 00:01:58.995667458 +0000 UTC m=+6.054884243 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/05dcf00e-2c10-495a-b61b-9221eb8286e5-metrics-certs") pod "network-metrics-daemon-9g97b" (UID: "05dcf00e-2c10-495a-b61b-9221eb8286e5") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 30 00:01:56.995839 ip-10-0-133-55 kubenswrapper[2560]: E0730 00:01:56.995760    2560 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 30 00:01:56.995839 ip-10-0-133-55 kubenswrapper[2560]: E0730 00:01:56.995772    2560 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 30 00:01:56.995839 ip-10-0-133-55 kubenswrapper[2560]: E0730 00:01:56.995784    2560 projected.go:196] Error preparing data for projected volume kube-api-access-z5hvt for pod openshift-network-diagnostics/network-check-target-lx827: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 30 00:01:56.995839 ip-10-0-133-55 kubenswrapper[2560]: E0730 00:01:56.995821    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/aaa633f6-b8db-4e08-a83b-07ec5ca2d154-kube-api-access-z5hvt podName:aaa633f6-b8db-4e08-a83b-07ec5ca2d154 nodeName:}" failed. No retries permitted until 2026-07-30 00:01:58.995809812 +0000 UTC m=+6.055026613 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-z5hvt" (UniqueName: "kubernetes.io/projected/aaa633f6-b8db-4e08-a83b-07ec5ca2d154-kube-api-access-z5hvt") pod "network-check-target-lx827" (UID: "aaa633f6-b8db-4e08-a83b-07ec5ca2d154") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 30 00:01:57.363222 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:01:57.363135    2560 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-28 23:56:55 +0000 UTC" deadline="2028-03-09 21:14:19.838073761 +0000 UTC"
Jul 30 00:01:57.363222 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:01:57.363174    2560 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="14133h12m22.47490422s"
Jul 30 00:01:57.399192 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:01:57.398992    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-lx827"
Jul 30 00:01:57.399192 ip-10-0-133-55 kubenswrapper[2560]: E0730 00:01:57.399122    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-lx827" podUID="aaa633f6-b8db-4e08-a83b-07ec5ca2d154"
Jul 30 00:01:57.399506 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:01:57.399447    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-9g97b"
Jul 30 00:01:57.399776 ip-10-0-133-55 kubenswrapper[2560]: E0730 00:01:57.399560    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-9g97b" podUID="05dcf00e-2c10-495a-b61b-9221eb8286e5"
Jul 30 00:01:57.399776 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:01:57.399650    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-nfssx"
Jul 30 00:01:57.399776 ip-10-0-133-55 kubenswrapper[2560]: E0730 00:01:57.399725    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-nfssx" podUID="e1fdf440-f1f1-40b4-9660-32cc39e1de67"
Jul 30 00:01:57.425897 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:01:57.425864    2560 generic.go:356] "Generic (PLEG): container finished" podID="66ffe78bc58e6acd2d85ae99006f0330" containerID="43c61d7704920d873ed084819230b1f0eafbb52288f6b41c1c50e755e5bd265d" exitCode=0
Jul 30 00:01:57.426035 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:01:57.425950    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-55.ec2.internal" event={"ID":"66ffe78bc58e6acd2d85ae99006f0330","Type":"ContainerDied","Data":"43c61d7704920d873ed084819230b1f0eafbb52288f6b41c1c50e755e5bd265d"}
Jul 30 00:01:57.432622 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:01:57.432593    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-133-55.ec2.internal" event={"ID":"7c492b170a03fda6652336c23f5889cf","Type":"ContainerStarted","Data":"f29c26334603bf04e4803b9a392c616b84fe29f5cfb673cdb372d3560eea7622"}
Jul 30 00:01:57.453110 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:01:57.453057    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-133-55.ec2.internal" podStartSLOduration=3.453031744 podStartE2EDuration="3.453031744s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-30 00:01:54 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 00:01:57.452439482 +0000 UTC m=+4.511656286" watchObservedRunningTime="2026-07-30 00:01:57.453031744 +0000 UTC m=+4.512248552"
Jul 30 00:01:58.441403 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:01:58.441368    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-55.ec2.internal" event={"ID":"66ffe78bc58e6acd2d85ae99006f0330","Type":"ContainerStarted","Data":"c8a13af0f8f0a5b6b3c897db7ae364c358a1f9724b0a12d1c5886b15ba06c8a4"}
Jul 30 00:01:59.012660 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:01:59.012626    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/05dcf00e-2c10-495a-b61b-9221eb8286e5-metrics-certs\") pod \"network-metrics-daemon-9g97b\" (UID: \"05dcf00e-2c10-495a-b61b-9221eb8286e5\") " pod="openshift-multus/network-metrics-daemon-9g97b"
Jul 30 00:01:59.012822 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:01:59.012693    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/e1fdf440-f1f1-40b4-9660-32cc39e1de67-original-pull-secret\") pod \"global-pull-secret-syncer-nfssx\" (UID: \"e1fdf440-f1f1-40b4-9660-32cc39e1de67\") " pod="kube-system/global-pull-secret-syncer-nfssx"
Jul 30 00:01:59.012822 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:01:59.012743    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-z5hvt\" (UniqueName: \"kubernetes.io/projected/aaa633f6-b8db-4e08-a83b-07ec5ca2d154-kube-api-access-z5hvt\") pod \"network-check-target-lx827\" (UID: \"aaa633f6-b8db-4e08-a83b-07ec5ca2d154\") " pod="openshift-network-diagnostics/network-check-target-lx827"
Jul 30 00:01:59.012936 ip-10-0-133-55 kubenswrapper[2560]: E0730 00:01:59.012877    2560 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 30 00:01:59.012936 ip-10-0-133-55 kubenswrapper[2560]: E0730 00:01:59.012896    2560 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 30 00:01:59.012936 ip-10-0-133-55 kubenswrapper[2560]: E0730 00:01:59.012908    2560 projected.go:196] Error preparing data for projected volume kube-api-access-z5hvt for pod openshift-network-diagnostics/network-check-target-lx827: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 30 00:01:59.013089 ip-10-0-133-55 kubenswrapper[2560]: E0730 00:01:59.012972    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/aaa633f6-b8db-4e08-a83b-07ec5ca2d154-kube-api-access-z5hvt podName:aaa633f6-b8db-4e08-a83b-07ec5ca2d154 nodeName:}" failed. No retries permitted until 2026-07-30 00:02:03.012945443 +0000 UTC m=+10.072162252 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-z5hvt" (UniqueName: "kubernetes.io/projected/aaa633f6-b8db-4e08-a83b-07ec5ca2d154-kube-api-access-z5hvt") pod "network-check-target-lx827" (UID: "aaa633f6-b8db-4e08-a83b-07ec5ca2d154") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 30 00:01:59.013415 ip-10-0-133-55 kubenswrapper[2560]: E0730 00:01:59.013391    2560 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 30 00:01:59.013500 ip-10-0-133-55 kubenswrapper[2560]: E0730 00:01:59.013448    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/05dcf00e-2c10-495a-b61b-9221eb8286e5-metrics-certs podName:05dcf00e-2c10-495a-b61b-9221eb8286e5 nodeName:}" failed. No retries permitted until 2026-07-30 00:02:03.013431594 +0000 UTC m=+10.072648392 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/05dcf00e-2c10-495a-b61b-9221eb8286e5-metrics-certs") pod "network-metrics-daemon-9g97b" (UID: "05dcf00e-2c10-495a-b61b-9221eb8286e5") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 30 00:01:59.013556 ip-10-0-133-55 kubenswrapper[2560]: E0730 00:01:59.013503    2560 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 30 00:01:59.013556 ip-10-0-133-55 kubenswrapper[2560]: E0730 00:01:59.013535    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e1fdf440-f1f1-40b4-9660-32cc39e1de67-original-pull-secret podName:e1fdf440-f1f1-40b4-9660-32cc39e1de67 nodeName:}" failed. No retries permitted until 2026-07-30 00:02:03.013524487 +0000 UTC m=+10.072741273 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/e1fdf440-f1f1-40b4-9660-32cc39e1de67-original-pull-secret") pod "global-pull-secret-syncer-nfssx" (UID: "e1fdf440-f1f1-40b4-9660-32cc39e1de67") : object "kube-system"/"original-pull-secret" not registered
Jul 30 00:01:59.398923 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:01:59.398886    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-9g97b"
Jul 30 00:01:59.399104 ip-10-0-133-55 kubenswrapper[2560]: E0730 00:01:59.399027    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-9g97b" podUID="05dcf00e-2c10-495a-b61b-9221eb8286e5"
Jul 30 00:01:59.401874 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:01:59.399421    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-lx827"
Jul 30 00:01:59.401874 ip-10-0-133-55 kubenswrapper[2560]: E0730 00:01:59.399510    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-lx827" podUID="aaa633f6-b8db-4e08-a83b-07ec5ca2d154"
Jul 30 00:01:59.401874 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:01:59.399726    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-nfssx"
Jul 30 00:01:59.401874 ip-10-0-133-55 kubenswrapper[2560]: E0730 00:01:59.399872    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-nfssx" podUID="e1fdf440-f1f1-40b4-9660-32cc39e1de67"
Jul 30 00:02:01.398714 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:02:01.398683    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-nfssx"
Jul 30 00:02:01.399092 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:02:01.398722    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-9g97b"
Jul 30 00:02:01.399092 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:02:01.398824    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-lx827"
Jul 30 00:02:01.399092 ip-10-0-133-55 kubenswrapper[2560]: E0730 00:02:01.398845    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-nfssx" podUID="e1fdf440-f1f1-40b4-9660-32cc39e1de67"
Jul 30 00:02:01.399092 ip-10-0-133-55 kubenswrapper[2560]: E0730 00:02:01.398921    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-lx827" podUID="aaa633f6-b8db-4e08-a83b-07ec5ca2d154"
Jul 30 00:02:01.399092 ip-10-0-133-55 kubenswrapper[2560]: E0730 00:02:01.399008    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-9g97b" podUID="05dcf00e-2c10-495a-b61b-9221eb8286e5"
Jul 30 00:02:03.046100 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:02:03.046055    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/e1fdf440-f1f1-40b4-9660-32cc39e1de67-original-pull-secret\") pod \"global-pull-secret-syncer-nfssx\" (UID: \"e1fdf440-f1f1-40b4-9660-32cc39e1de67\") " pod="kube-system/global-pull-secret-syncer-nfssx"
Jul 30 00:02:03.046580 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:02:03.046126    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-z5hvt\" (UniqueName: \"kubernetes.io/projected/aaa633f6-b8db-4e08-a83b-07ec5ca2d154-kube-api-access-z5hvt\") pod \"network-check-target-lx827\" (UID: \"aaa633f6-b8db-4e08-a83b-07ec5ca2d154\") " pod="openshift-network-diagnostics/network-check-target-lx827"
Jul 30 00:02:03.046580 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:02:03.046170    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/05dcf00e-2c10-495a-b61b-9221eb8286e5-metrics-certs\") pod \"network-metrics-daemon-9g97b\" (UID: \"05dcf00e-2c10-495a-b61b-9221eb8286e5\") " pod="openshift-multus/network-metrics-daemon-9g97b"
Jul 30 00:02:03.046580 ip-10-0-133-55 kubenswrapper[2560]: E0730 00:02:03.046298    2560 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 30 00:02:03.046580 ip-10-0-133-55 kubenswrapper[2560]: E0730 00:02:03.046378    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/05dcf00e-2c10-495a-b61b-9221eb8286e5-metrics-certs podName:05dcf00e-2c10-495a-b61b-9221eb8286e5 nodeName:}" failed. No retries permitted until 2026-07-30 00:02:11.046359033 +0000 UTC m=+18.105575829 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/05dcf00e-2c10-495a-b61b-9221eb8286e5-metrics-certs") pod "network-metrics-daemon-9g97b" (UID: "05dcf00e-2c10-495a-b61b-9221eb8286e5") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 30 00:02:03.046580 ip-10-0-133-55 kubenswrapper[2560]: E0730 00:02:03.046550    2560 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 30 00:02:03.046580 ip-10-0-133-55 kubenswrapper[2560]: E0730 00:02:03.046568    2560 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 30 00:02:03.046580 ip-10-0-133-55 kubenswrapper[2560]: E0730 00:02:03.046580    2560 projected.go:196] Error preparing data for projected volume kube-api-access-z5hvt for pod openshift-network-diagnostics/network-check-target-lx827: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 30 00:02:03.046943 ip-10-0-133-55 kubenswrapper[2560]: E0730 00:02:03.046625    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/aaa633f6-b8db-4e08-a83b-07ec5ca2d154-kube-api-access-z5hvt podName:aaa633f6-b8db-4e08-a83b-07ec5ca2d154 nodeName:}" failed. No retries permitted until 2026-07-30 00:02:11.04661156 +0000 UTC m=+18.105828351 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-z5hvt" (UniqueName: "kubernetes.io/projected/aaa633f6-b8db-4e08-a83b-07ec5ca2d154-kube-api-access-z5hvt") pod "network-check-target-lx827" (UID: "aaa633f6-b8db-4e08-a83b-07ec5ca2d154") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 30 00:02:03.046943 ip-10-0-133-55 kubenswrapper[2560]: E0730 00:02:03.046682    2560 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 30 00:02:03.046943 ip-10-0-133-55 kubenswrapper[2560]: E0730 00:02:03.046713    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e1fdf440-f1f1-40b4-9660-32cc39e1de67-original-pull-secret podName:e1fdf440-f1f1-40b4-9660-32cc39e1de67 nodeName:}" failed. No retries permitted until 2026-07-30 00:02:11.046701941 +0000 UTC m=+18.105918724 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/e1fdf440-f1f1-40b4-9660-32cc39e1de67-original-pull-secret") pod "global-pull-secret-syncer-nfssx" (UID: "e1fdf440-f1f1-40b4-9660-32cc39e1de67") : object "kube-system"/"original-pull-secret" not registered
Jul 30 00:02:03.403118 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:02:03.403086    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-lx827"
Jul 30 00:02:03.403303 ip-10-0-133-55 kubenswrapper[2560]: E0730 00:02:03.403183    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-lx827" podUID="aaa633f6-b8db-4e08-a83b-07ec5ca2d154"
Jul 30 00:02:03.403303 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:02:03.403257    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-nfssx"
Jul 30 00:02:03.403435 ip-10-0-133-55 kubenswrapper[2560]: E0730 00:02:03.403336    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-nfssx" podUID="e1fdf440-f1f1-40b4-9660-32cc39e1de67"
Jul 30 00:02:03.403435 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:02:03.403375    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-9g97b"
Jul 30 00:02:03.403538 ip-10-0-133-55 kubenswrapper[2560]: E0730 00:02:03.403456    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-9g97b" podUID="05dcf00e-2c10-495a-b61b-9221eb8286e5"
Jul 30 00:02:05.399010 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:02:05.398973    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-nfssx"
Jul 30 00:02:05.399010 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:02:05.399014    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-9g97b"
Jul 30 00:02:05.399541 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:02:05.398973    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-lx827"
Jul 30 00:02:05.399541 ip-10-0-133-55 kubenswrapper[2560]: E0730 00:02:05.399101    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-nfssx" podUID="e1fdf440-f1f1-40b4-9660-32cc39e1de67"
Jul 30 00:02:05.399541 ip-10-0-133-55 kubenswrapper[2560]: E0730 00:02:05.399190    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-9g97b" podUID="05dcf00e-2c10-495a-b61b-9221eb8286e5"
Jul 30 00:02:05.399541 ip-10-0-133-55 kubenswrapper[2560]: E0730 00:02:05.399297    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-lx827" podUID="aaa633f6-b8db-4e08-a83b-07ec5ca2d154"
Jul 30 00:02:07.399662 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:02:07.399616    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-nfssx"
Jul 30 00:02:07.399662 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:02:07.399636    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-9g97b"
Jul 30 00:02:07.400127 ip-10-0-133-55 kubenswrapper[2560]: E0730 00:02:07.399748    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-nfssx" podUID="e1fdf440-f1f1-40b4-9660-32cc39e1de67"
Jul 30 00:02:07.400127 ip-10-0-133-55 kubenswrapper[2560]: E0730 00:02:07.399821    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-9g97b" podUID="05dcf00e-2c10-495a-b61b-9221eb8286e5"
Jul 30 00:02:07.400127 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:02:07.399877    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-lx827"
Jul 30 00:02:07.400127 ip-10-0-133-55 kubenswrapper[2560]: E0730 00:02:07.399947    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-lx827" podUID="aaa633f6-b8db-4e08-a83b-07ec5ca2d154"
Jul 30 00:02:09.399521 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:02:09.399492    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-9g97b"
Jul 30 00:02:09.399521 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:02:09.399524    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-lx827"
Jul 30 00:02:09.399994 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:02:09.399492    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-nfssx"
Jul 30 00:02:09.399994 ip-10-0-133-55 kubenswrapper[2560]: E0730 00:02:09.399617    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-9g97b" podUID="05dcf00e-2c10-495a-b61b-9221eb8286e5"
Jul 30 00:02:09.399994 ip-10-0-133-55 kubenswrapper[2560]: E0730 00:02:09.399693    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-nfssx" podUID="e1fdf440-f1f1-40b4-9660-32cc39e1de67"
Jul 30 00:02:09.399994 ip-10-0-133-55 kubenswrapper[2560]: E0730 00:02:09.399757    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-lx827" podUID="aaa633f6-b8db-4e08-a83b-07ec5ca2d154"
Jul 30 00:02:11.105226 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:02:11.105188    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-z5hvt\" (UniqueName: \"kubernetes.io/projected/aaa633f6-b8db-4e08-a83b-07ec5ca2d154-kube-api-access-z5hvt\") pod \"network-check-target-lx827\" (UID: \"aaa633f6-b8db-4e08-a83b-07ec5ca2d154\") " pod="openshift-network-diagnostics/network-check-target-lx827"
Jul 30 00:02:11.105755 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:02:11.105244    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/05dcf00e-2c10-495a-b61b-9221eb8286e5-metrics-certs\") pod \"network-metrics-daemon-9g97b\" (UID: \"05dcf00e-2c10-495a-b61b-9221eb8286e5\") " pod="openshift-multus/network-metrics-daemon-9g97b"
Jul 30 00:02:11.105755 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:02:11.105292    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/e1fdf440-f1f1-40b4-9660-32cc39e1de67-original-pull-secret\") pod \"global-pull-secret-syncer-nfssx\" (UID: \"e1fdf440-f1f1-40b4-9660-32cc39e1de67\") " pod="kube-system/global-pull-secret-syncer-nfssx"
Jul 30 00:02:11.105755 ip-10-0-133-55 kubenswrapper[2560]: E0730 00:02:11.105382    2560 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 30 00:02:11.105755 ip-10-0-133-55 kubenswrapper[2560]: E0730 00:02:11.105399    2560 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 30 00:02:11.105755 ip-10-0-133-55 kubenswrapper[2560]: E0730 00:02:11.105409    2560 projected.go:196] Error preparing data for projected volume kube-api-access-z5hvt for pod openshift-network-diagnostics/network-check-target-lx827: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 30 00:02:11.105755 ip-10-0-133-55 kubenswrapper[2560]: E0730 00:02:11.105441    2560 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 30 00:02:11.105755 ip-10-0-133-55 kubenswrapper[2560]: E0730 00:02:11.105455    2560 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 30 00:02:11.105755 ip-10-0-133-55 kubenswrapper[2560]: E0730 00:02:11.105460    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/aaa633f6-b8db-4e08-a83b-07ec5ca2d154-kube-api-access-z5hvt podName:aaa633f6-b8db-4e08-a83b-07ec5ca2d154 nodeName:}" failed. No retries permitted until 2026-07-30 00:02:27.105446122 +0000 UTC m=+34.164662916 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-z5hvt" (UniqueName: "kubernetes.io/projected/aaa633f6-b8db-4e08-a83b-07ec5ca2d154-kube-api-access-z5hvt") pod "network-check-target-lx827" (UID: "aaa633f6-b8db-4e08-a83b-07ec5ca2d154") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 30 00:02:11.105755 ip-10-0-133-55 kubenswrapper[2560]: E0730 00:02:11.105520    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/05dcf00e-2c10-495a-b61b-9221eb8286e5-metrics-certs podName:05dcf00e-2c10-495a-b61b-9221eb8286e5 nodeName:}" failed. No retries permitted until 2026-07-30 00:02:27.105501682 +0000 UTC m=+34.164718479 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/05dcf00e-2c10-495a-b61b-9221eb8286e5-metrics-certs") pod "network-metrics-daemon-9g97b" (UID: "05dcf00e-2c10-495a-b61b-9221eb8286e5") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 30 00:02:11.105755 ip-10-0-133-55 kubenswrapper[2560]: E0730 00:02:11.105542    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e1fdf440-f1f1-40b4-9660-32cc39e1de67-original-pull-secret podName:e1fdf440-f1f1-40b4-9660-32cc39e1de67 nodeName:}" failed. No retries permitted until 2026-07-30 00:02:27.105531992 +0000 UTC m=+34.164748781 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/e1fdf440-f1f1-40b4-9660-32cc39e1de67-original-pull-secret") pod "global-pull-secret-syncer-nfssx" (UID: "e1fdf440-f1f1-40b4-9660-32cc39e1de67") : object "kube-system"/"original-pull-secret" not registered
Jul 30 00:02:11.399655 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:02:11.399624    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-9g97b"
Jul 30 00:02:11.399655 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:02:11.399657    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-nfssx"
Jul 30 00:02:11.399894 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:02:11.399693    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-lx827"
Jul 30 00:02:11.399894 ip-10-0-133-55 kubenswrapper[2560]: E0730 00:02:11.399789    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-nfssx" podUID="e1fdf440-f1f1-40b4-9660-32cc39e1de67"
Jul 30 00:02:11.399894 ip-10-0-133-55 kubenswrapper[2560]: E0730 00:02:11.399869    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-9g97b" podUID="05dcf00e-2c10-495a-b61b-9221eb8286e5"
Jul 30 00:02:11.400036 ip-10-0-133-55 kubenswrapper[2560]: E0730 00:02:11.399960    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-lx827" podUID="aaa633f6-b8db-4e08-a83b-07ec5ca2d154"
Jul 30 00:02:13.399926 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:02:13.399895    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-nfssx"
Jul 30 00:02:13.400414 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:02:13.399993    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-9g97b"
Jul 30 00:02:13.400414 ip-10-0-133-55 kubenswrapper[2560]: E0730 00:02:13.400116    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-9g97b" podUID="05dcf00e-2c10-495a-b61b-9221eb8286e5"
Jul 30 00:02:13.400414 ip-10-0-133-55 kubenswrapper[2560]: E0730 00:02:13.399991    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-nfssx" podUID="e1fdf440-f1f1-40b4-9660-32cc39e1de67"
Jul 30 00:02:13.400414 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:02:13.400186    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-lx827"
Jul 30 00:02:13.400414 ip-10-0-133-55 kubenswrapper[2560]: E0730 00:02:13.400253    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-lx827" podUID="aaa633f6-b8db-4e08-a83b-07ec5ca2d154"
Jul 30 00:02:15.398821 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:02:15.398613    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-nfssx"
Jul 30 00:02:15.399742 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:02:15.398621    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-9g97b"
Jul 30 00:02:15.399742 ip-10-0-133-55 kubenswrapper[2560]: E0730 00:02:15.398847    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-nfssx" podUID="e1fdf440-f1f1-40b4-9660-32cc39e1de67"
Jul 30 00:02:15.399742 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:02:15.398688    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-lx827"
Jul 30 00:02:15.399742 ip-10-0-133-55 kubenswrapper[2560]: E0730 00:02:15.398921    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-9g97b" podUID="05dcf00e-2c10-495a-b61b-9221eb8286e5"
Jul 30 00:02:15.399742 ip-10-0-133-55 kubenswrapper[2560]: E0730 00:02:15.398996    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-lx827" podUID="aaa633f6-b8db-4e08-a83b-07ec5ca2d154"
Jul 30 00:02:15.476771 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:02:15.476735    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-7vc9d" event={"ID":"274292b8-556c-44ad-b462-c1ea04a30abd","Type":"ContainerStarted","Data":"7ebde8ec9ddb86cd742fec474412ddfdddd451709b540dcebbfd5e9823d0e635"}
Jul 30 00:02:15.480463 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:02:15.480437    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-5ffvl" event={"ID":"4f585163-3e80-4055-bfdd-17d37e755a71","Type":"ContainerStarted","Data":"533d14b67f28475ba9caa1d7dceec9f39fd02f56e13c2abb96e3f790e0ba149c"}
Jul 30 00:02:15.481998 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:02:15.481956    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-n8zl8" event={"ID":"c2108e9a-b8cd-4419-82ea-2f677d5e3a01","Type":"ContainerStarted","Data":"7eaadc108dad7ecc63072e30bd127a52ec19b49232b47f38e3b61108fff0d4eb"}
Jul 30 00:02:15.483406 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:02:15.483383    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-55z4f" event={"ID":"d52805f6-d4e7-4896-871c-0845b47a6452","Type":"ContainerStarted","Data":"6948643ac0a3a1f095ff481aa557af62722156643cba53211bd9b7a900ff0f83"}
Jul 30 00:02:15.484973 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:02:15.484948    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-2mr4v" event={"ID":"8eb20838-c71f-4ac8-bded-78851ea49e22","Type":"ContainerStarted","Data":"638a979691630a349801c987b8bb1f4f1daa41508055aa710483d7f9ad950a40"}
Jul 30 00:02:15.486519 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:02:15.486496    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-x8swq" event={"ID":"b180523f-d9e2-4514-9b5c-091192407dc0","Type":"ContainerStarted","Data":"461918faf2691c13bfb09fa74f7bc827d8b57d3d95148758e3fdbc88f2ebc468"}
Jul 30 00:02:15.488029 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:02:15.488007    2560 generic.go:356] "Generic (PLEG): container finished" podID="de66dc13-ad46-4e8a-8ce5-2c54b63d852a" containerID="acba213c3de6d34ef35a7f195b2b8ee848b93d2a9d2df2bf04316d8240167c2d" exitCode=0
Jul 30 00:02:15.488121 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:02:15.488095    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-ms6sp" event={"ID":"de66dc13-ad46-4e8a-8ce5-2c54b63d852a","Type":"ContainerDied","Data":"acba213c3de6d34ef35a7f195b2b8ee848b93d2a9d2df2bf04316d8240167c2d"}
Jul 30 00:02:15.491783 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:02:15.491731    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-4p5kl" event={"ID":"bc5b2026-4ab4-46f6-a807-a51339c2f60e","Type":"ContainerStarted","Data":"79feb55eb6f37be9a10afeb71e2a955347c93600c733043ea8a458d3b0756123"}
Jul 30 00:02:15.491865 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:02:15.491805    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-4p5kl" event={"ID":"bc5b2026-4ab4-46f6-a807-a51339c2f60e","Type":"ContainerStarted","Data":"92bd0eedd14550eed953e34ced3e39c430f77623b3c4c1e87055986bb11729be"}
Jul 30 00:02:15.491865 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:02:15.491823    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-7vc9d" podStartSLOduration=4.29356996 podStartE2EDuration="22.491811352s" totalImagesPullingTime="18.198241392s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-30 00:01:53 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 00:02:15.491737564 +0000 UTC m=+22.550954367" watchObservedRunningTime="2026-07-30 00:02:15.491811352 +0000 UTC m=+22.551028152"
Jul 30 00:02:15.491865 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:02:15.491854    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-4p5kl" event={"ID":"bc5b2026-4ab4-46f6-a807-a51339c2f60e","Type":"ContainerStarted","Data":"f5b11290391993366da331f13ff0ddc7a279798f8f9ef58f8b6048bf2db47930"}
Jul 30 00:02:15.492035 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:02:15.491899    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-4p5kl" event={"ID":"bc5b2026-4ab4-46f6-a807-a51339c2f60e","Type":"ContainerStarted","Data":"c51a00d05e52acdc7516010f5a94bebe509928ecbadeb0d64de762a76c776bc4"}
Jul 30 00:02:15.492035 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:02:15.491949    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-4p5kl" event={"ID":"bc5b2026-4ab4-46f6-a807-a51339c2f60e","Type":"ContainerStarted","Data":"3e69bd452817425355f0a51e9d9984a2cd95d88cde6e0bb02b204c22391d99ae"}
Jul 30 00:02:15.492035 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:02:15.491993    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-4p5kl" event={"ID":"bc5b2026-4ab4-46f6-a807-a51339c2f60e","Type":"ContainerStarted","Data":"d78e188fea9f14d50ccdf075b1cb7a634c39d610194aaca8f674a76bb0b00d8e"}
Jul 30 00:02:15.492359 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:02:15.492332    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-55.ec2.internal" podStartSLOduration=21.492300494 podStartE2EDuration="21.492300494s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-30 00:01:54 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 00:01:58.457280633 +0000 UTC m=+5.516497438" watchObservedRunningTime="2026-07-30 00:02:15.492300494 +0000 UTC m=+22.551517302"
Jul 30 00:02:15.524283 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:02:15.524244    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-5ffvl" podStartSLOduration=3.896029631 podStartE2EDuration="22.524228072s" totalImagesPullingTime="18.628198441s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-30 00:01:53 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 00:02:15.504463484 +0000 UTC m=+22.563680301" watchObservedRunningTime="2026-07-30 00:02:15.524228072 +0000 UTC m=+22.583444882"
Jul 30 00:02:15.538420 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:02:15.538371    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-x8swq" podStartSLOduration=3.91152716 podStartE2EDuration="22.538352949s" totalImagesPullingTime="18.626825789s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-30 00:01:53 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 00:02:15.537734504 +0000 UTC m=+22.596951309" watchObservedRunningTime="2026-07-30 00:02:15.538352949 +0000 UTC m=+22.597569755"
Jul 30 00:02:15.573624 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:02:15.573581    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-2mr4v" podStartSLOduration=3.915254409 podStartE2EDuration="22.573563977s" totalImagesPullingTime="18.658309568s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-30 00:01:53 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 00:02:15.554515801 +0000 UTC m=+22.613732600" watchObservedRunningTime="2026-07-30 00:02:15.573563977 +0000 UTC m=+22.632780781"
Jul 30 00:02:15.573909 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:02:15.573881    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-n8zl8" podStartSLOduration=8.021223768 podStartE2EDuration="22.573874374s" totalImagesPullingTime="14.552650606s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-30 00:01:53 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 00:02:15.573650188 +0000 UTC m=+22.632866993" watchObservedRunningTime="2026-07-30 00:02:15.573874374 +0000 UTC m=+22.633091178"
Jul 30 00:02:15.946623 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:02:15.946601    2560 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock"
Jul 30 00:02:16.340446 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:02:16.340335    2560 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-07-30T00:02:15.946616466Z","UUID":"7e20d7cb-964d-4108-811d-afb405ce3b44","Handler":null,"Name":"","Endpoint":""}
Jul 30 00:02:16.341787 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:02:16.341768    2560 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0
Jul 30 00:02:16.341937 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:02:16.341803    2560 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock
Jul 30 00:02:16.496326 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:02:16.496268    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-kztbf" event={"ID":"20473ed5-4a9f-4c87-9925-92b6543dad41","Type":"ContainerStarted","Data":"dafcbf9e45a250b3e16107387cf9f32f7e02a33ef829668377112e27d0e67a67"}
Jul 30 00:02:16.498631 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:02:16.498286    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-55z4f" event={"ID":"d52805f6-d4e7-4896-871c-0845b47a6452","Type":"ContainerStarted","Data":"1008a02ac7b7f3b6f373c798654be656de839c4aa00f3ae241650ae76ec74d82"}
Jul 30 00:02:16.510636 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:02:16.510585    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-kztbf" podStartSLOduration=4.984006505 podStartE2EDuration="23.510571107s" totalImagesPullingTime="18.526564602s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-30 00:01:53 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 00:02:16.509411188 +0000 UTC m=+23.568627992" watchObservedRunningTime="2026-07-30 00:02:16.510571107 +0000 UTC m=+23.569787911"
Jul 30 00:02:17.399521 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:02:17.399494    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-9g97b"
Jul 30 00:02:17.399695 ip-10-0-133-55 kubenswrapper[2560]: E0730 00:02:17.399645    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-9g97b" podUID="05dcf00e-2c10-495a-b61b-9221eb8286e5"
Jul 30 00:02:17.399695 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:02:17.399499    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-lx827"
Jul 30 00:02:17.399819 ip-10-0-133-55 kubenswrapper[2560]: E0730 00:02:17.399742    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-lx827" podUID="aaa633f6-b8db-4e08-a83b-07ec5ca2d154"
Jul 30 00:02:17.399819 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:02:17.399494    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-nfssx"
Jul 30 00:02:17.399965 ip-10-0-133-55 kubenswrapper[2560]: E0730 00:02:17.399822    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-nfssx" podUID="e1fdf440-f1f1-40b4-9660-32cc39e1de67"
Jul 30 00:02:17.503890 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:02:17.503293    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-55z4f" event={"ID":"d52805f6-d4e7-4896-871c-0845b47a6452","Type":"ContainerStarted","Data":"6865fef73c8c8336d5312fe407826be706e67c650551c0ec9debf8b7d5af82fe"}
Jul 30 00:02:17.507163 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:02:17.507138    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-4p5kl" event={"ID":"bc5b2026-4ab4-46f6-a807-a51339c2f60e","Type":"ContainerStarted","Data":"845295df1023fd67944b7fce0bd80aa754e2b392295203a7081d31121ad3f87a"}
Jul 30 00:02:17.519823 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:02:17.519771    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-55z4f" podStartSLOduration=3.734503215 podStartE2EDuration="24.519755324s" totalImagesPullingTime="20.785252109s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-30 00:01:53 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 00:02:17.519192526 +0000 UTC m=+24.578409331" watchObservedRunningTime="2026-07-30 00:02:17.519755324 +0000 UTC m=+24.578972128"
Jul 30 00:02:19.399519 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:02:19.399480    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-nfssx"
Jul 30 00:02:19.399952 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:02:19.399491    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-9g97b"
Jul 30 00:02:19.399952 ip-10-0-133-55 kubenswrapper[2560]: E0730 00:02:19.399611    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-nfssx" podUID="e1fdf440-f1f1-40b4-9660-32cc39e1de67"
Jul 30 00:02:19.399952 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:02:19.399622    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-lx827"
Jul 30 00:02:19.399952 ip-10-0-133-55 kubenswrapper[2560]: E0730 00:02:19.399731    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-9g97b" podUID="05dcf00e-2c10-495a-b61b-9221eb8286e5"
Jul 30 00:02:19.399952 ip-10-0-133-55 kubenswrapper[2560]: E0730 00:02:19.399803    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-lx827" podUID="aaa633f6-b8db-4e08-a83b-07ec5ca2d154"
Jul 30 00:02:19.793183 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:02:19.793114    2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-n8zl8"
Jul 30 00:02:19.793721 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:02:19.793700    2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-n8zl8"
Jul 30 00:02:20.516999 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:02:20.516824    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-n8zl8"
Jul 30 00:02:20.517682 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:02:20.517285    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-n8zl8"
Jul 30 00:02:20.518198 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:02:20.518173    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-ms6sp" event={"ID":"de66dc13-ad46-4e8a-8ce5-2c54b63d852a","Type":"ContainerStarted","Data":"bc303b586b926cdbabd1c7aa953dced7916b887f6d6e306c6ac674876c6672f7"}
Jul 30 00:02:20.522117 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:02:20.522092    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-4p5kl" event={"ID":"bc5b2026-4ab4-46f6-a807-a51339c2f60e","Type":"ContainerStarted","Data":"33e5dda05c93885bad3a377f4c20535cbaa2be13b071be73f7cd8e5f961b6b6f"}
Jul 30 00:02:20.522496 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:02:20.522359    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-4p5kl"
Jul 30 00:02:20.522496 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:02:20.522439    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-4p5kl"
Jul 30 00:02:20.522746 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:02:20.522727    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-4p5kl"
Jul 30 00:02:20.536952 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:02:20.536921    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-4p5kl"
Jul 30 00:02:20.537047 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:02:20.537014    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-4p5kl"
Jul 30 00:02:20.554832 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:02:20.554795    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-4p5kl" podStartSLOduration=8.695304728 podStartE2EDuration="27.554782255s" totalImagesPullingTime="18.859477527s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-30 00:01:53 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 00:02:20.553305904 +0000 UTC m=+27.612522707" watchObservedRunningTime="2026-07-30 00:02:20.554782255 +0000 UTC m=+27.613999058"
Jul 30 00:02:21.403559 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:02:21.403528    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-nfssx"
Jul 30 00:02:21.403559 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:02:21.403547    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-lx827"
Jul 30 00:02:21.403559 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:02:21.403528    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-9g97b"
Jul 30 00:02:21.403885 ip-10-0-133-55 kubenswrapper[2560]: E0730 00:02:21.403651    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-lx827" podUID="aaa633f6-b8db-4e08-a83b-07ec5ca2d154"
Jul 30 00:02:21.404066 ip-10-0-133-55 kubenswrapper[2560]: E0730 00:02:21.404035    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-9g97b" podUID="05dcf00e-2c10-495a-b61b-9221eb8286e5"
Jul 30 00:02:21.404203 ip-10-0-133-55 kubenswrapper[2560]: E0730 00:02:21.404143    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-nfssx" podUID="e1fdf440-f1f1-40b4-9660-32cc39e1de67"
Jul 30 00:02:21.527055 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:02:21.527024    2560 generic.go:356] "Generic (PLEG): container finished" podID="de66dc13-ad46-4e8a-8ce5-2c54b63d852a" containerID="bc303b586b926cdbabd1c7aa953dced7916b887f6d6e306c6ac674876c6672f7" exitCode=0
Jul 30 00:02:21.527484 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:02:21.527096    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-ms6sp" event={"ID":"de66dc13-ad46-4e8a-8ce5-2c54b63d852a","Type":"ContainerDied","Data":"bc303b586b926cdbabd1c7aa953dced7916b887f6d6e306c6ac674876c6672f7"}
Jul 30 00:02:22.209659 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:02:22.209632    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-lx827"]
Jul 30 00:02:22.209800 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:02:22.209723    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-lx827"
Jul 30 00:02:22.209851 ip-10-0-133-55 kubenswrapper[2560]: E0730 00:02:22.209801    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-lx827" podUID="aaa633f6-b8db-4e08-a83b-07ec5ca2d154"
Jul 30 00:02:22.212585 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:02:22.212560    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-9g97b"]
Jul 30 00:02:22.212714 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:02:22.212663    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-9g97b"
Jul 30 00:02:22.212796 ip-10-0-133-55 kubenswrapper[2560]: E0730 00:02:22.212778    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-9g97b" podUID="05dcf00e-2c10-495a-b61b-9221eb8286e5"
Jul 30 00:02:22.213245 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:02:22.213225    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-nfssx"]
Jul 30 00:02:22.213353 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:02:22.213329    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-nfssx"
Jul 30 00:02:22.213440 ip-10-0-133-55 kubenswrapper[2560]: E0730 00:02:22.213418    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-nfssx" podUID="e1fdf440-f1f1-40b4-9660-32cc39e1de67"
Jul 30 00:02:22.531705 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:02:22.531672    2560 generic.go:356] "Generic (PLEG): container finished" podID="de66dc13-ad46-4e8a-8ce5-2c54b63d852a" containerID="d4d52bef72dffc3f1375296920d950948a1b3bb9d5dd2c5dd2ff8a0b837fba02" exitCode=0
Jul 30 00:02:22.532136 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:02:22.531757    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-ms6sp" event={"ID":"de66dc13-ad46-4e8a-8ce5-2c54b63d852a","Type":"ContainerDied","Data":"d4d52bef72dffc3f1375296920d950948a1b3bb9d5dd2c5dd2ff8a0b837fba02"}
Jul 30 00:02:23.400230 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:02:23.400201    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-nfssx"
Jul 30 00:02:23.400399 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:02:23.400267    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-9g97b"
Jul 30 00:02:23.400399 ip-10-0-133-55 kubenswrapper[2560]: E0730 00:02:23.400280    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-nfssx" podUID="e1fdf440-f1f1-40b4-9660-32cc39e1de67"
Jul 30 00:02:23.400399 ip-10-0-133-55 kubenswrapper[2560]: E0730 00:02:23.400376    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-9g97b" podUID="05dcf00e-2c10-495a-b61b-9221eb8286e5"
Jul 30 00:02:24.399624 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:02:24.399459    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-lx827"
Jul 30 00:02:24.400006 ip-10-0-133-55 kubenswrapper[2560]: E0730 00:02:24.399695    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-lx827" podUID="aaa633f6-b8db-4e08-a83b-07ec5ca2d154"
Jul 30 00:02:24.537493 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:02:24.537419    2560 generic.go:356] "Generic (PLEG): container finished" podID="de66dc13-ad46-4e8a-8ce5-2c54b63d852a" containerID="a62c4f732926ca87e1a2c7a319a0df06660bcd9763554fd89e3913e479297395" exitCode=0
Jul 30 00:02:24.537493 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:02:24.537478    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-ms6sp" event={"ID":"de66dc13-ad46-4e8a-8ce5-2c54b63d852a","Type":"ContainerDied","Data":"a62c4f732926ca87e1a2c7a319a0df06660bcd9763554fd89e3913e479297395"}
Jul 30 00:02:25.399069 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:02:25.399034    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-9g97b"
Jul 30 00:02:25.399069 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:02:25.399075    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-nfssx"
Jul 30 00:02:25.399260 ip-10-0-133-55 kubenswrapper[2560]: E0730 00:02:25.399180    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-9g97b" podUID="05dcf00e-2c10-495a-b61b-9221eb8286e5"
Jul 30 00:02:25.399375 ip-10-0-133-55 kubenswrapper[2560]: E0730 00:02:25.399345    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-nfssx" podUID="e1fdf440-f1f1-40b4-9660-32cc39e1de67"
Jul 30 00:02:26.398850 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:02:26.398818    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-lx827"
Jul 30 00:02:26.399447 ip-10-0-133-55 kubenswrapper[2560]: E0730 00:02:26.398935    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-lx827" podUID="aaa633f6-b8db-4e08-a83b-07ec5ca2d154"
Jul 30 00:02:27.133164 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:02:27.133122    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-z5hvt\" (UniqueName: \"kubernetes.io/projected/aaa633f6-b8db-4e08-a83b-07ec5ca2d154-kube-api-access-z5hvt\") pod \"network-check-target-lx827\" (UID: \"aaa633f6-b8db-4e08-a83b-07ec5ca2d154\") " pod="openshift-network-diagnostics/network-check-target-lx827"
Jul 30 00:02:27.133379 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:02:27.133183    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/05dcf00e-2c10-495a-b61b-9221eb8286e5-metrics-certs\") pod \"network-metrics-daemon-9g97b\" (UID: \"05dcf00e-2c10-495a-b61b-9221eb8286e5\") " pod="openshift-multus/network-metrics-daemon-9g97b"
Jul 30 00:02:27.133379 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:02:27.133226    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/e1fdf440-f1f1-40b4-9660-32cc39e1de67-original-pull-secret\") pod \"global-pull-secret-syncer-nfssx\" (UID: \"e1fdf440-f1f1-40b4-9660-32cc39e1de67\") " pod="kube-system/global-pull-secret-syncer-nfssx"
Jul 30 00:02:27.133379 ip-10-0-133-55 kubenswrapper[2560]: E0730 00:02:27.133331    2560 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 30 00:02:27.133379 ip-10-0-133-55 kubenswrapper[2560]: E0730 00:02:27.133347    2560 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 30 00:02:27.133379 ip-10-0-133-55 kubenswrapper[2560]: E0730 00:02:27.133357    2560 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 30 00:02:27.133379 ip-10-0-133-55 kubenswrapper[2560]: E0730 00:02:27.133370    2560 projected.go:196] Error preparing data for projected volume kube-api-access-z5hvt for pod openshift-network-diagnostics/network-check-target-lx827: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 30 00:02:27.133679 ip-10-0-133-55 kubenswrapper[2560]: E0730 00:02:27.133356    2560 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 30 00:02:27.133679 ip-10-0-133-55 kubenswrapper[2560]: E0730 00:02:27.133409    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e1fdf440-f1f1-40b4-9660-32cc39e1de67-original-pull-secret podName:e1fdf440-f1f1-40b4-9660-32cc39e1de67 nodeName:}" failed. No retries permitted until 2026-07-30 00:02:59.133390228 +0000 UTC m=+66.192607038 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/e1fdf440-f1f1-40b4-9660-32cc39e1de67-original-pull-secret") pod "global-pull-secret-syncer-nfssx" (UID: "e1fdf440-f1f1-40b4-9660-32cc39e1de67") : object "kube-system"/"original-pull-secret" not registered
Jul 30 00:02:27.133679 ip-10-0-133-55 kubenswrapper[2560]: E0730 00:02:27.133444    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/aaa633f6-b8db-4e08-a83b-07ec5ca2d154-kube-api-access-z5hvt podName:aaa633f6-b8db-4e08-a83b-07ec5ca2d154 nodeName:}" failed. No retries permitted until 2026-07-30 00:02:59.133432946 +0000 UTC m=+66.192649728 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-z5hvt" (UniqueName: "kubernetes.io/projected/aaa633f6-b8db-4e08-a83b-07ec5ca2d154-kube-api-access-z5hvt") pod "network-check-target-lx827" (UID: "aaa633f6-b8db-4e08-a83b-07ec5ca2d154") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 30 00:02:27.133679 ip-10-0-133-55 kubenswrapper[2560]: E0730 00:02:27.133456    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/05dcf00e-2c10-495a-b61b-9221eb8286e5-metrics-certs podName:05dcf00e-2c10-495a-b61b-9221eb8286e5 nodeName:}" failed. No retries permitted until 2026-07-30 00:02:59.133449669 +0000 UTC m=+66.192666451 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/05dcf00e-2c10-495a-b61b-9221eb8286e5-metrics-certs") pod "network-metrics-daemon-9g97b" (UID: "05dcf00e-2c10-495a-b61b-9221eb8286e5") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 30 00:02:27.264269 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:02:27.264192    2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-55.ec2.internal" event="NodeReady"
Jul 30 00:02:27.264428 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:02:27.264350    2560 kubelet_node_status.go:489] "Fast updating node status as it just became ready"
Jul 30 00:02:27.294810 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:02:27.294776    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-console/networking-console-plugin-74c9f884b7-cvf92"]
Jul 30 00:02:27.299576 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:02:27.299554    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-pruner-29756160-vhqfx"]
Jul 30 00:02:27.299697 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:02:27.299669    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-74c9f884b7-cvf92"
Jul 30 00:02:27.301824 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:02:27.301801    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"networking-console-plugin-cert\""
Jul 30 00:02:27.301922 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:02:27.301894    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"default-dockercfg-tjpdq\""
Jul 30 00:02:27.301992 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:02:27.301894    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-console\"/\"networking-console-plugin\""
Jul 30 00:02:27.302562 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:02:27.302547    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-777dddd7cd-bw4wt"]
Jul 30 00:02:27.302684 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:02:27.302661    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-pruner-29756160-vhqfx"
Jul 30 00:02:27.304817 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:02:27.304787    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"pruner-dockercfg-2m5zt\""
Jul 30 00:02:27.304969 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:02:27.304928    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"serviceca\""
Jul 30 00:02:27.306351 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:02:27.306331    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-777dddd7cd-bw4wt"
Jul 30 00:02:27.307360 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:02:27.307320    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-74c9f884b7-cvf92"]
Jul 30 00:02:27.309506 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:02:27.309486    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-pt2ls\""
Jul 30 00:02:27.309704 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:02:27.309689    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\""
Jul 30 00:02:27.309880 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:02:27.309866    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\""
Jul 30 00:02:27.310826 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:02:27.310038    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\""
Jul 30 00:02:27.310826 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:02:27.310489    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-9q6wf"]
Jul 30 00:02:27.314822 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:02:27.314765    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-9q6wf"
Jul 30 00:02:27.315001 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:02:27.314985    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-777dddd7cd-bw4wt"]
Jul 30 00:02:27.316093 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:02:27.316074    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\""
Jul 30 00:02:27.316226 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:02:27.316208    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-zprkl"]
Jul 30 00:02:27.317103 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:02:27.317084    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-nxhcc\""
Jul 30 00:02:27.317830 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:02:27.317374    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\""
Jul 30 00:02:27.317830 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:02:27.317503    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\""
Jul 30 00:02:27.319955 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:02:27.319936    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-pruner-29756160-vhqfx"]
Jul 30 00:02:27.320044 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:02:27.320024    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-zprkl"
Jul 30 00:02:27.322556 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:02:27.322537    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\""
Jul 30 00:02:27.323557 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:02:27.323408    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\""
Jul 30 00:02:27.323741 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:02:27.323707    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-559dl\""
Jul 30 00:02:27.323820 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:02:27.323768    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\""
Jul 30 00:02:27.326996 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:02:27.326978    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-zprkl"]
Jul 30 00:02:27.330289 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:02:27.330268    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-9q6wf"]
Jul 30 00:02:27.399695 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:02:27.399662    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-nfssx"
Jul 30 00:02:27.400163 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:02:27.399847    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-9g97b"
Jul 30 00:02:27.402296 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:02:27.402245    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Jul 30 00:02:27.402437 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:02:27.402357    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Jul 30 00:02:27.402437 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:02:27.402388    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-qpk4b\""
Jul 30 00:02:27.435649 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:02:27.435623    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/29e3c7fe-e0a9-4098-8415-4c2f716a92eb-trusted-ca\") pod \"image-registry-777dddd7cd-bw4wt\" (UID: \"29e3c7fe-e0a9-4098-8415-4c2f716a92eb\") " pod="openshift-image-registry/image-registry-777dddd7cd-bw4wt"
Jul 30 00:02:27.435767 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:02:27.435667    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/29e3c7fe-e0a9-4098-8415-4c2f716a92eb-bound-sa-token\") pod \"image-registry-777dddd7cd-bw4wt\" (UID: \"29e3c7fe-e0a9-4098-8415-4c2f716a92eb\") " pod="openshift-image-registry/image-registry-777dddd7cd-bw4wt"
Jul 30 00:02:27.435767 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:02:27.435698    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/29e3c7fe-e0a9-4098-8415-4c2f716a92eb-registry-tls\") pod \"image-registry-777dddd7cd-bw4wt\" (UID: \"29e3c7fe-e0a9-4098-8415-4c2f716a92eb\") " pod="openshift-image-registry/image-registry-777dddd7cd-bw4wt"
Jul 30 00:02:27.435854 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:02:27.435795    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/fc66861e-ab18-4d71-bed7-1fa000323b4a-nginx-conf\") pod \"networking-console-plugin-74c9f884b7-cvf92\" (UID: \"fc66861e-ab18-4d71-bed7-1fa000323b4a\") " pod="openshift-network-console/networking-console-plugin-74c9f884b7-cvf92"
Jul 30 00:02:27.435854 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:02:27.435828    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/fc66861e-ab18-4d71-bed7-1fa000323b4a-networking-console-plugin-cert\") pod \"networking-console-plugin-74c9f884b7-cvf92\" (UID: \"fc66861e-ab18-4d71-bed7-1fa000323b4a\") " pod="openshift-network-console/networking-console-plugin-74c9f884b7-cvf92"
Jul 30 00:02:27.435949 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:02:27.435855    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/511107bb-85d6-4f7e-9598-0f4aac95ba34-tmp-dir\") pod \"dns-default-9q6wf\" (UID: \"511107bb-85d6-4f7e-9598-0f4aac95ba34\") " pod="openshift-dns/dns-default-9q6wf"
Jul 30 00:02:27.435949 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:02:27.435886    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/29e3c7fe-e0a9-4098-8415-4c2f716a92eb-image-registry-private-configuration\") pod \"image-registry-777dddd7cd-bw4wt\" (UID: \"29e3c7fe-e0a9-4098-8415-4c2f716a92eb\") " pod="openshift-image-registry/image-registry-777dddd7cd-bw4wt"
Jul 30 00:02:27.436047 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:02:27.435975    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/29e3c7fe-e0a9-4098-8415-4c2f716a92eb-registry-certificates\") pod \"image-registry-777dddd7cd-bw4wt\" (UID: \"29e3c7fe-e0a9-4098-8415-4c2f716a92eb\") " pod="openshift-image-registry/image-registry-777dddd7cd-bw4wt"
Jul 30 00:02:27.436047 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:02:27.436009    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cz4x5\" (UniqueName: \"kubernetes.io/projected/29e3c7fe-e0a9-4098-8415-4c2f716a92eb-kube-api-access-cz4x5\") pod \"image-registry-777dddd7cd-bw4wt\" (UID: \"29e3c7fe-e0a9-4098-8415-4c2f716a92eb\") " pod="openshift-image-registry/image-registry-777dddd7cd-bw4wt"
Jul 30 00:02:27.436047 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:02:27.436035    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/511107bb-85d6-4f7e-9598-0f4aac95ba34-config-volume\") pod \"dns-default-9q6wf\" (UID: \"511107bb-85d6-4f7e-9598-0f4aac95ba34\") " pod="openshift-dns/dns-default-9q6wf"
Jul 30 00:02:27.436184 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:02:27.436060    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/511107bb-85d6-4f7e-9598-0f4aac95ba34-metrics-tls\") pod \"dns-default-9q6wf\" (UID: \"511107bb-85d6-4f7e-9598-0f4aac95ba34\") " pod="openshift-dns/dns-default-9q6wf"
Jul 30 00:02:27.436184 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:02:27.436100    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/29e3c7fe-e0a9-4098-8415-4c2f716a92eb-ca-trust-extracted\") pod \"image-registry-777dddd7cd-bw4wt\" (UID: \"29e3c7fe-e0a9-4098-8415-4c2f716a92eb\") " pod="openshift-image-registry/image-registry-777dddd7cd-bw4wt"
Jul 30 00:02:27.436184 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:02:27.436127    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/29e3c7fe-e0a9-4098-8415-4c2f716a92eb-installation-pull-secrets\") pod \"image-registry-777dddd7cd-bw4wt\" (UID: \"29e3c7fe-e0a9-4098-8415-4c2f716a92eb\") " pod="openshift-image-registry/image-registry-777dddd7cd-bw4wt"
Jul 30 00:02:27.436184 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:02:27.436152    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ks6lc\" (UniqueName: \"kubernetes.io/projected/511107bb-85d6-4f7e-9598-0f4aac95ba34-kube-api-access-ks6lc\") pod \"dns-default-9q6wf\" (UID: \"511107bb-85d6-4f7e-9598-0f4aac95ba34\") " pod="openshift-dns/dns-default-9q6wf"
Jul 30 00:02:27.436401 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:02:27.436190    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/e4926e4b-1b99-4889-afe0-459d8080ff96-cert\") pod \"ingress-canary-zprkl\" (UID: \"e4926e4b-1b99-4889-afe0-459d8080ff96\") " pod="openshift-ingress-canary/ingress-canary-zprkl"
Jul 30 00:02:27.436401 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:02:27.436213    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-w4rm6\" (UniqueName: \"kubernetes.io/projected/e4926e4b-1b99-4889-afe0-459d8080ff96-kube-api-access-w4rm6\") pod \"ingress-canary-zprkl\" (UID: \"e4926e4b-1b99-4889-afe0-459d8080ff96\") " pod="openshift-ingress-canary/ingress-canary-zprkl"
Jul 30 00:02:27.436401 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:02:27.436238    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/04c8ee63-4c22-45a4-ac5a-0321b09d3dd1-serviceca\") pod \"image-pruner-29756160-vhqfx\" (UID: \"04c8ee63-4c22-45a4-ac5a-0321b09d3dd1\") " pod="openshift-image-registry/image-pruner-29756160-vhqfx"
Jul 30 00:02:27.436401 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:02:27.436262    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-g8jwm\" (UniqueName: \"kubernetes.io/projected/04c8ee63-4c22-45a4-ac5a-0321b09d3dd1-kube-api-access-g8jwm\") pod \"image-pruner-29756160-vhqfx\" (UID: \"04c8ee63-4c22-45a4-ac5a-0321b09d3dd1\") " pod="openshift-image-registry/image-pruner-29756160-vhqfx"
Jul 30 00:02:27.537037 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:02:27.536959    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/29e3c7fe-e0a9-4098-8415-4c2f716a92eb-bound-sa-token\") pod \"image-registry-777dddd7cd-bw4wt\" (UID: \"29e3c7fe-e0a9-4098-8415-4c2f716a92eb\") " pod="openshift-image-registry/image-registry-777dddd7cd-bw4wt"
Jul 30 00:02:27.537037 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:02:27.536994    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/29e3c7fe-e0a9-4098-8415-4c2f716a92eb-registry-tls\") pod \"image-registry-777dddd7cd-bw4wt\" (UID: \"29e3c7fe-e0a9-4098-8415-4c2f716a92eb\") " pod="openshift-image-registry/image-registry-777dddd7cd-bw4wt"
Jul 30 00:02:27.537257 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:02:27.537044    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/fc66861e-ab18-4d71-bed7-1fa000323b4a-nginx-conf\") pod \"networking-console-plugin-74c9f884b7-cvf92\" (UID: \"fc66861e-ab18-4d71-bed7-1fa000323b4a\") " pod="openshift-network-console/networking-console-plugin-74c9f884b7-cvf92"
Jul 30 00:02:27.537257 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:02:27.537070    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/fc66861e-ab18-4d71-bed7-1fa000323b4a-networking-console-plugin-cert\") pod \"networking-console-plugin-74c9f884b7-cvf92\" (UID: \"fc66861e-ab18-4d71-bed7-1fa000323b4a\") " pod="openshift-network-console/networking-console-plugin-74c9f884b7-cvf92"
Jul 30 00:02:27.537257 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:02:27.537115    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/511107bb-85d6-4f7e-9598-0f4aac95ba34-tmp-dir\") pod \"dns-default-9q6wf\" (UID: \"511107bb-85d6-4f7e-9598-0f4aac95ba34\") " pod="openshift-dns/dns-default-9q6wf"
Jul 30 00:02:27.537257 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:02:27.537143    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/29e3c7fe-e0a9-4098-8415-4c2f716a92eb-image-registry-private-configuration\") pod \"image-registry-777dddd7cd-bw4wt\" (UID: \"29e3c7fe-e0a9-4098-8415-4c2f716a92eb\") " pod="openshift-image-registry/image-registry-777dddd7cd-bw4wt"
Jul 30 00:02:27.537257 ip-10-0-133-55 kubenswrapper[2560]: E0730 00:02:27.537167    2560 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 30 00:02:27.537257 ip-10-0-133-55 kubenswrapper[2560]: E0730 00:02:27.537191    2560 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-777dddd7cd-bw4wt: secret "image-registry-tls" not found
Jul 30 00:02:27.537257 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:02:27.537193    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/29e3c7fe-e0a9-4098-8415-4c2f716a92eb-registry-certificates\") pod \"image-registry-777dddd7cd-bw4wt\" (UID: \"29e3c7fe-e0a9-4098-8415-4c2f716a92eb\") " pod="openshift-image-registry/image-registry-777dddd7cd-bw4wt"
Jul 30 00:02:27.537257 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:02:27.537216    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cz4x5\" (UniqueName: \"kubernetes.io/projected/29e3c7fe-e0a9-4098-8415-4c2f716a92eb-kube-api-access-cz4x5\") pod \"image-registry-777dddd7cd-bw4wt\" (UID: \"29e3c7fe-e0a9-4098-8415-4c2f716a92eb\") " pod="openshift-image-registry/image-registry-777dddd7cd-bw4wt"
Jul 30 00:02:27.537257 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:02:27.537241    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/511107bb-85d6-4f7e-9598-0f4aac95ba34-config-volume\") pod \"dns-default-9q6wf\" (UID: \"511107bb-85d6-4f7e-9598-0f4aac95ba34\") " pod="openshift-dns/dns-default-9q6wf"
Jul 30 00:02:27.537257 ip-10-0-133-55 kubenswrapper[2560]: E0730 00:02:27.537256    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/29e3c7fe-e0a9-4098-8415-4c2f716a92eb-registry-tls podName:29e3c7fe-e0a9-4098-8415-4c2f716a92eb nodeName:}" failed. No retries permitted until 2026-07-30 00:02:28.037235288 +0000 UTC m=+35.096452083 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/29e3c7fe-e0a9-4098-8415-4c2f716a92eb-registry-tls") pod "image-registry-777dddd7cd-bw4wt" (UID: "29e3c7fe-e0a9-4098-8415-4c2f716a92eb") : secret "image-registry-tls" not found
Jul 30 00:02:27.537796 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:02:27.537293    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/511107bb-85d6-4f7e-9598-0f4aac95ba34-metrics-tls\") pod \"dns-default-9q6wf\" (UID: \"511107bb-85d6-4f7e-9598-0f4aac95ba34\") " pod="openshift-dns/dns-default-9q6wf"
Jul 30 00:02:27.537796 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:02:27.537357    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/29e3c7fe-e0a9-4098-8415-4c2f716a92eb-ca-trust-extracted\") pod \"image-registry-777dddd7cd-bw4wt\" (UID: \"29e3c7fe-e0a9-4098-8415-4c2f716a92eb\") " pod="openshift-image-registry/image-registry-777dddd7cd-bw4wt"
Jul 30 00:02:27.537796 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:02:27.537378    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/29e3c7fe-e0a9-4098-8415-4c2f716a92eb-installation-pull-secrets\") pod \"image-registry-777dddd7cd-bw4wt\" (UID: \"29e3c7fe-e0a9-4098-8415-4c2f716a92eb\") " pod="openshift-image-registry/image-registry-777dddd7cd-bw4wt"
Jul 30 00:02:27.537796 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:02:27.537395    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ks6lc\" (UniqueName: \"kubernetes.io/projected/511107bb-85d6-4f7e-9598-0f4aac95ba34-kube-api-access-ks6lc\") pod \"dns-default-9q6wf\" (UID: \"511107bb-85d6-4f7e-9598-0f4aac95ba34\") " pod="openshift-dns/dns-default-9q6wf"
Jul 30 00:02:27.537796 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:02:27.537424    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/e4926e4b-1b99-4889-afe0-459d8080ff96-cert\") pod \"ingress-canary-zprkl\" (UID: \"e4926e4b-1b99-4889-afe0-459d8080ff96\") " pod="openshift-ingress-canary/ingress-canary-zprkl"
Jul 30 00:02:27.537796 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:02:27.537449    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-w4rm6\" (UniqueName: \"kubernetes.io/projected/e4926e4b-1b99-4889-afe0-459d8080ff96-kube-api-access-w4rm6\") pod \"ingress-canary-zprkl\" (UID: \"e4926e4b-1b99-4889-afe0-459d8080ff96\") " pod="openshift-ingress-canary/ingress-canary-zprkl"
Jul 30 00:02:27.537796 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:02:27.537472    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/04c8ee63-4c22-45a4-ac5a-0321b09d3dd1-serviceca\") pod \"image-pruner-29756160-vhqfx\" (UID: \"04c8ee63-4c22-45a4-ac5a-0321b09d3dd1\") " pod="openshift-image-registry/image-pruner-29756160-vhqfx"
Jul 30 00:02:27.537796 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:02:27.537495    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-g8jwm\" (UniqueName: \"kubernetes.io/projected/04c8ee63-4c22-45a4-ac5a-0321b09d3dd1-kube-api-access-g8jwm\") pod \"image-pruner-29756160-vhqfx\" (UID: \"04c8ee63-4c22-45a4-ac5a-0321b09d3dd1\") " pod="openshift-image-registry/image-pruner-29756160-vhqfx"
Jul 30 00:02:27.537796 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:02:27.537515    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/29e3c7fe-e0a9-4098-8415-4c2f716a92eb-trusted-ca\") pod \"image-registry-777dddd7cd-bw4wt\" (UID: \"29e3c7fe-e0a9-4098-8415-4c2f716a92eb\") " pod="openshift-image-registry/image-registry-777dddd7cd-bw4wt"
Jul 30 00:02:27.538212 ip-10-0-133-55 kubenswrapper[2560]: E0730 00:02:27.537809    2560 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 30 00:02:27.538212 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:02:27.537840    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/511107bb-85d6-4f7e-9598-0f4aac95ba34-config-volume\") pod \"dns-default-9q6wf\" (UID: \"511107bb-85d6-4f7e-9598-0f4aac95ba34\") " pod="openshift-dns/dns-default-9q6wf"
Jul 30 00:02:27.538212 ip-10-0-133-55 kubenswrapper[2560]: E0730 00:02:27.537857    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/511107bb-85d6-4f7e-9598-0f4aac95ba34-metrics-tls podName:511107bb-85d6-4f7e-9598-0f4aac95ba34 nodeName:}" failed. No retries permitted until 2026-07-30 00:02:28.037841616 +0000 UTC m=+35.097058401 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/511107bb-85d6-4f7e-9598-0f4aac95ba34-metrics-tls") pod "dns-default-9q6wf" (UID: "511107bb-85d6-4f7e-9598-0f4aac95ba34") : secret "dns-default-metrics-tls" not found
Jul 30 00:02:27.538212 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:02:27.537842    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/fc66861e-ab18-4d71-bed7-1fa000323b4a-nginx-conf\") pod \"networking-console-plugin-74c9f884b7-cvf92\" (UID: \"fc66861e-ab18-4d71-bed7-1fa000323b4a\") " pod="openshift-network-console/networking-console-plugin-74c9f884b7-cvf92"
Jul 30 00:02:27.538212 ip-10-0-133-55 kubenswrapper[2560]: E0730 00:02:27.537945    2560 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Jul 30 00:02:27.538212 ip-10-0-133-55 kubenswrapper[2560]: E0730 00:02:27.537995    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fc66861e-ab18-4d71-bed7-1fa000323b4a-networking-console-plugin-cert podName:fc66861e-ab18-4d71-bed7-1fa000323b4a nodeName:}" failed. No retries permitted until 2026-07-30 00:02:28.037979118 +0000 UTC m=+35.097195916 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/fc66861e-ab18-4d71-bed7-1fa000323b4a-networking-console-plugin-cert") pod "networking-console-plugin-74c9f884b7-cvf92" (UID: "fc66861e-ab18-4d71-bed7-1fa000323b4a") : secret "networking-console-plugin-cert" not found
Jul 30 00:02:27.538212 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:02:27.538021    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/04c8ee63-4c22-45a4-ac5a-0321b09d3dd1-serviceca\") pod \"image-pruner-29756160-vhqfx\" (UID: \"04c8ee63-4c22-45a4-ac5a-0321b09d3dd1\") " pod="openshift-image-registry/image-pruner-29756160-vhqfx"
Jul 30 00:02:27.538212 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:02:27.538152    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/29e3c7fe-e0a9-4098-8415-4c2f716a92eb-ca-trust-extracted\") pod \"image-registry-777dddd7cd-bw4wt\" (UID: \"29e3c7fe-e0a9-4098-8415-4c2f716a92eb\") " pod="openshift-image-registry/image-registry-777dddd7cd-bw4wt"
Jul 30 00:02:27.538727 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:02:27.538701    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/511107bb-85d6-4f7e-9598-0f4aac95ba34-tmp-dir\") pod \"dns-default-9q6wf\" (UID: \"511107bb-85d6-4f7e-9598-0f4aac95ba34\") " pod="openshift-dns/dns-default-9q6wf"
Jul 30 00:02:27.538952 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:02:27.538935    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/29e3c7fe-e0a9-4098-8415-4c2f716a92eb-registry-certificates\") pod \"image-registry-777dddd7cd-bw4wt\" (UID: \"29e3c7fe-e0a9-4098-8415-4c2f716a92eb\") " pod="openshift-image-registry/image-registry-777dddd7cd-bw4wt"
Jul 30 00:02:27.539618 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:02:27.539591    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/29e3c7fe-e0a9-4098-8415-4c2f716a92eb-trusted-ca\") pod \"image-registry-777dddd7cd-bw4wt\" (UID: \"29e3c7fe-e0a9-4098-8415-4c2f716a92eb\") " pod="openshift-image-registry/image-registry-777dddd7cd-bw4wt"
Jul 30 00:02:27.542895 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:02:27.542848    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/29e3c7fe-e0a9-4098-8415-4c2f716a92eb-installation-pull-secrets\") pod \"image-registry-777dddd7cd-bw4wt\" (UID: \"29e3c7fe-e0a9-4098-8415-4c2f716a92eb\") " pod="openshift-image-registry/image-registry-777dddd7cd-bw4wt"
Jul 30 00:02:27.542895 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:02:27.542861    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/29e3c7fe-e0a9-4098-8415-4c2f716a92eb-image-registry-private-configuration\") pod \"image-registry-777dddd7cd-bw4wt\" (UID: \"29e3c7fe-e0a9-4098-8415-4c2f716a92eb\") " pod="openshift-image-registry/image-registry-777dddd7cd-bw4wt"
Jul 30 00:02:27.542895 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:02:27.542865    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/e4926e4b-1b99-4889-afe0-459d8080ff96-cert\") pod \"ingress-canary-zprkl\" (UID: \"e4926e4b-1b99-4889-afe0-459d8080ff96\") " pod="openshift-ingress-canary/ingress-canary-zprkl"
Jul 30 00:02:27.546752 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:02:27.546729    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-g8jwm\" (UniqueName: \"kubernetes.io/projected/04c8ee63-4c22-45a4-ac5a-0321b09d3dd1-kube-api-access-g8jwm\") pod \"image-pruner-29756160-vhqfx\" (UID: \"04c8ee63-4c22-45a4-ac5a-0321b09d3dd1\") " pod="openshift-image-registry/image-pruner-29756160-vhqfx"
Jul 30 00:02:27.546840 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:02:27.546785    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/29e3c7fe-e0a9-4098-8415-4c2f716a92eb-bound-sa-token\") pod \"image-registry-777dddd7cd-bw4wt\" (UID: \"29e3c7fe-e0a9-4098-8415-4c2f716a92eb\") " pod="openshift-image-registry/image-registry-777dddd7cd-bw4wt"
Jul 30 00:02:27.546898 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:02:27.546860    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ks6lc\" (UniqueName: \"kubernetes.io/projected/511107bb-85d6-4f7e-9598-0f4aac95ba34-kube-api-access-ks6lc\") pod \"dns-default-9q6wf\" (UID: \"511107bb-85d6-4f7e-9598-0f4aac95ba34\") " pod="openshift-dns/dns-default-9q6wf"
Jul 30 00:02:27.549961 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:02:27.549926    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-cz4x5\" (UniqueName: \"kubernetes.io/projected/29e3c7fe-e0a9-4098-8415-4c2f716a92eb-kube-api-access-cz4x5\") pod \"image-registry-777dddd7cd-bw4wt\" (UID: \"29e3c7fe-e0a9-4098-8415-4c2f716a92eb\") " pod="openshift-image-registry/image-registry-777dddd7cd-bw4wt"
Jul 30 00:02:27.551261 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:02:27.551238    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-w4rm6\" (UniqueName: \"kubernetes.io/projected/e4926e4b-1b99-4889-afe0-459d8080ff96-kube-api-access-w4rm6\") pod \"ingress-canary-zprkl\" (UID: \"e4926e4b-1b99-4889-afe0-459d8080ff96\") " pod="openshift-ingress-canary/ingress-canary-zprkl"
Jul 30 00:02:27.621824 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:02:27.621787    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-pruner-29756160-vhqfx"
Jul 30 00:02:27.644389 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:02:27.644359    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-zprkl"
Jul 30 00:02:28.041769 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:02:28.041728    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/fc66861e-ab18-4d71-bed7-1fa000323b4a-networking-console-plugin-cert\") pod \"networking-console-plugin-74c9f884b7-cvf92\" (UID: \"fc66861e-ab18-4d71-bed7-1fa000323b4a\") " pod="openshift-network-console/networking-console-plugin-74c9f884b7-cvf92"
Jul 30 00:02:28.041967 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:02:28.041812    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/511107bb-85d6-4f7e-9598-0f4aac95ba34-metrics-tls\") pod \"dns-default-9q6wf\" (UID: \"511107bb-85d6-4f7e-9598-0f4aac95ba34\") " pod="openshift-dns/dns-default-9q6wf"
Jul 30 00:02:28.041967 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:02:28.041873    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/29e3c7fe-e0a9-4098-8415-4c2f716a92eb-registry-tls\") pod \"image-registry-777dddd7cd-bw4wt\" (UID: \"29e3c7fe-e0a9-4098-8415-4c2f716a92eb\") " pod="openshift-image-registry/image-registry-777dddd7cd-bw4wt"
Jul 30 00:02:28.041967 ip-10-0-133-55 kubenswrapper[2560]: E0730 00:02:28.041912    2560 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Jul 30 00:02:28.042118 ip-10-0-133-55 kubenswrapper[2560]: E0730 00:02:28.041980    2560 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 30 00:02:28.042118 ip-10-0-133-55 kubenswrapper[2560]: E0730 00:02:28.041989    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fc66861e-ab18-4d71-bed7-1fa000323b4a-networking-console-plugin-cert podName:fc66861e-ab18-4d71-bed7-1fa000323b4a nodeName:}" failed. No retries permitted until 2026-07-30 00:02:29.041972712 +0000 UTC m=+36.101189495 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/fc66861e-ab18-4d71-bed7-1fa000323b4a-networking-console-plugin-cert") pod "networking-console-plugin-74c9f884b7-cvf92" (UID: "fc66861e-ab18-4d71-bed7-1fa000323b4a") : secret "networking-console-plugin-cert" not found
Jul 30 00:02:28.042118 ip-10-0-133-55 kubenswrapper[2560]: E0730 00:02:28.042037    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/511107bb-85d6-4f7e-9598-0f4aac95ba34-metrics-tls podName:511107bb-85d6-4f7e-9598-0f4aac95ba34 nodeName:}" failed. No retries permitted until 2026-07-30 00:02:29.042020634 +0000 UTC m=+36.101237430 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/511107bb-85d6-4f7e-9598-0f4aac95ba34-metrics-tls") pod "dns-default-9q6wf" (UID: "511107bb-85d6-4f7e-9598-0f4aac95ba34") : secret "dns-default-metrics-tls" not found
Jul 30 00:02:28.042118 ip-10-0-133-55 kubenswrapper[2560]: E0730 00:02:28.041980    2560 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 30 00:02:28.042118 ip-10-0-133-55 kubenswrapper[2560]: E0730 00:02:28.042058    2560 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-777dddd7cd-bw4wt: secret "image-registry-tls" not found
Jul 30 00:02:28.042118 ip-10-0-133-55 kubenswrapper[2560]: E0730 00:02:28.042119    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/29e3c7fe-e0a9-4098-8415-4c2f716a92eb-registry-tls podName:29e3c7fe-e0a9-4098-8415-4c2f716a92eb nodeName:}" failed. No retries permitted until 2026-07-30 00:02:29.042105727 +0000 UTC m=+36.101322523 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/29e3c7fe-e0a9-4098-8415-4c2f716a92eb-registry-tls") pod "image-registry-777dddd7cd-bw4wt" (UID: "29e3c7fe-e0a9-4098-8415-4c2f716a92eb") : secret "image-registry-tls" not found
Jul 30 00:02:28.398576 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:02:28.398540    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-lx827"
Jul 30 00:02:28.401428 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:02:28.401400    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Jul 30 00:02:28.402704 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:02:28.402684    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Jul 30 00:02:28.402829 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:02:28.402690    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-p64v7\""
Jul 30 00:02:28.688023 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:02:28.687843    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-zprkl"]
Jul 30 00:02:28.690354 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:02:28.690332    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-pruner-29756160-vhqfx"]
Jul 30 00:02:28.691128 ip-10-0-133-55 kubenswrapper[2560]: W0730 00:02:28.691102    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode4926e4b_1b99_4889_afe0_459d8080ff96.slice/crio-d0bb2e6b88e0a4f25937a980939433f451ab9f8c0656d5feeb6d8e13d9205107 WatchSource:0}: Error finding container d0bb2e6b88e0a4f25937a980939433f451ab9f8c0656d5feeb6d8e13d9205107: Status 404 returned error can't find the container with id d0bb2e6b88e0a4f25937a980939433f451ab9f8c0656d5feeb6d8e13d9205107
Jul 30 00:02:28.693066 ip-10-0-133-55 kubenswrapper[2560]: W0730 00:02:28.693038    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod04c8ee63_4c22_45a4_ac5a_0321b09d3dd1.slice/crio-8bdc4c6ac0d36be0aee53d282e9f565adbb6eb3f31d30bf255765222e98f18da WatchSource:0}: Error finding container 8bdc4c6ac0d36be0aee53d282e9f565adbb6eb3f31d30bf255765222e98f18da: Status 404 returned error can't find the container with id 8bdc4c6ac0d36be0aee53d282e9f565adbb6eb3f31d30bf255765222e98f18da
Jul 30 00:02:29.049469 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:02:29.049380    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/29e3c7fe-e0a9-4098-8415-4c2f716a92eb-registry-tls\") pod \"image-registry-777dddd7cd-bw4wt\" (UID: \"29e3c7fe-e0a9-4098-8415-4c2f716a92eb\") " pod="openshift-image-registry/image-registry-777dddd7cd-bw4wt"
Jul 30 00:02:29.049469 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:02:29.049432    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/fc66861e-ab18-4d71-bed7-1fa000323b4a-networking-console-plugin-cert\") pod \"networking-console-plugin-74c9f884b7-cvf92\" (UID: \"fc66861e-ab18-4d71-bed7-1fa000323b4a\") " pod="openshift-network-console/networking-console-plugin-74c9f884b7-cvf92"
Jul 30 00:02:29.049683 ip-10-0-133-55 kubenswrapper[2560]: E0730 00:02:29.049553    2560 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 30 00:02:29.049683 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:02:29.049572    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/511107bb-85d6-4f7e-9598-0f4aac95ba34-metrics-tls\") pod \"dns-default-9q6wf\" (UID: \"511107bb-85d6-4f7e-9598-0f4aac95ba34\") " pod="openshift-dns/dns-default-9q6wf"
Jul 30 00:02:29.049683 ip-10-0-133-55 kubenswrapper[2560]: E0730 00:02:29.049576    2560 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-777dddd7cd-bw4wt: secret "image-registry-tls" not found
Jul 30 00:02:29.049683 ip-10-0-133-55 kubenswrapper[2560]: E0730 00:02:29.049631    2560 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Jul 30 00:02:29.049683 ip-10-0-133-55 kubenswrapper[2560]: E0730 00:02:29.049654    2560 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 30 00:02:29.049848 ip-10-0-133-55 kubenswrapper[2560]: E0730 00:02:29.049667    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/29e3c7fe-e0a9-4098-8415-4c2f716a92eb-registry-tls podName:29e3c7fe-e0a9-4098-8415-4c2f716a92eb nodeName:}" failed. No retries permitted until 2026-07-30 00:02:31.049651538 +0000 UTC m=+38.108868319 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/29e3c7fe-e0a9-4098-8415-4c2f716a92eb-registry-tls") pod "image-registry-777dddd7cd-bw4wt" (UID: "29e3c7fe-e0a9-4098-8415-4c2f716a92eb") : secret "image-registry-tls" not found
Jul 30 00:02:29.049848 ip-10-0-133-55 kubenswrapper[2560]: E0730 00:02:29.049703    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fc66861e-ab18-4d71-bed7-1fa000323b4a-networking-console-plugin-cert podName:fc66861e-ab18-4d71-bed7-1fa000323b4a nodeName:}" failed. No retries permitted until 2026-07-30 00:02:31.049695607 +0000 UTC m=+38.108912389 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/fc66861e-ab18-4d71-bed7-1fa000323b4a-networking-console-plugin-cert") pod "networking-console-plugin-74c9f884b7-cvf92" (UID: "fc66861e-ab18-4d71-bed7-1fa000323b4a") : secret "networking-console-plugin-cert" not found
Jul 30 00:02:29.049848 ip-10-0-133-55 kubenswrapper[2560]: E0730 00:02:29.049714    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/511107bb-85d6-4f7e-9598-0f4aac95ba34-metrics-tls podName:511107bb-85d6-4f7e-9598-0f4aac95ba34 nodeName:}" failed. No retries permitted until 2026-07-30 00:02:31.049709451 +0000 UTC m=+38.108926232 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/511107bb-85d6-4f7e-9598-0f4aac95ba34-metrics-tls") pod "dns-default-9q6wf" (UID: "511107bb-85d6-4f7e-9598-0f4aac95ba34") : secret "dns-default-metrics-tls" not found
Jul 30 00:02:29.554429 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:02:29.554401    2560 generic.go:356] "Generic (PLEG): container finished" podID="de66dc13-ad46-4e8a-8ce5-2c54b63d852a" containerID="9493e97f114bb53ac4df1fac391e05fac7a49c0951e7f77e2dad3fafca353bc3" exitCode=0
Jul 30 00:02:29.554893 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:02:29.554488    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-ms6sp" event={"ID":"de66dc13-ad46-4e8a-8ce5-2c54b63d852a","Type":"ContainerDied","Data":"9493e97f114bb53ac4df1fac391e05fac7a49c0951e7f77e2dad3fafca353bc3"}
Jul 30 00:02:29.556342 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:02:29.556279    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-pruner-29756160-vhqfx" event={"ID":"04c8ee63-4c22-45a4-ac5a-0321b09d3dd1","Type":"ContainerStarted","Data":"e748829af5c1c7fc986de2b3a7e8f2564e122f53742dee8d92b189429e7fde0c"}
Jul 30 00:02:29.556342 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:02:29.556338    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-pruner-29756160-vhqfx" event={"ID":"04c8ee63-4c22-45a4-ac5a-0321b09d3dd1","Type":"ContainerStarted","Data":"8bdc4c6ac0d36be0aee53d282e9f565adbb6eb3f31d30bf255765222e98f18da"}
Jul 30 00:02:29.557976 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:02:29.557936    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-zprkl" event={"ID":"e4926e4b-1b99-4889-afe0-459d8080ff96","Type":"ContainerStarted","Data":"d0bb2e6b88e0a4f25937a980939433f451ab9f8c0656d5feeb6d8e13d9205107"}
Jul 30 00:02:29.591890 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:02:29.591839    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-pruner-29756160-vhqfx" podStartSLOduration=149.591820024 podStartE2EDuration="2m29.591820024s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-30 00:00:00 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 00:02:29.591778613 +0000 UTC m=+36.650995419" watchObservedRunningTime="2026-07-30 00:02:29.591820024 +0000 UTC m=+36.651036831"
Jul 30 00:02:30.564018 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:02:30.563987    2560 generic.go:356] "Generic (PLEG): container finished" podID="de66dc13-ad46-4e8a-8ce5-2c54b63d852a" containerID="45a2153c48b192c966d584e6e52d62b1ca722b3509c5298ef1e53b4dc77051d6" exitCode=0
Jul 30 00:02:30.564500 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:02:30.564057    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-ms6sp" event={"ID":"de66dc13-ad46-4e8a-8ce5-2c54b63d852a","Type":"ContainerDied","Data":"45a2153c48b192c966d584e6e52d62b1ca722b3509c5298ef1e53b4dc77051d6"}
Jul 30 00:02:31.063662 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:02:31.063622    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/511107bb-85d6-4f7e-9598-0f4aac95ba34-metrics-tls\") pod \"dns-default-9q6wf\" (UID: \"511107bb-85d6-4f7e-9598-0f4aac95ba34\") " pod="openshift-dns/dns-default-9q6wf"
Jul 30 00:02:31.063804 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:02:31.063681    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/29e3c7fe-e0a9-4098-8415-4c2f716a92eb-registry-tls\") pod \"image-registry-777dddd7cd-bw4wt\" (UID: \"29e3c7fe-e0a9-4098-8415-4c2f716a92eb\") " pod="openshift-image-registry/image-registry-777dddd7cd-bw4wt"
Jul 30 00:02:31.063804 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:02:31.063718    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/fc66861e-ab18-4d71-bed7-1fa000323b4a-networking-console-plugin-cert\") pod \"networking-console-plugin-74c9f884b7-cvf92\" (UID: \"fc66861e-ab18-4d71-bed7-1fa000323b4a\") " pod="openshift-network-console/networking-console-plugin-74c9f884b7-cvf92"
Jul 30 00:02:31.063804 ip-10-0-133-55 kubenswrapper[2560]: E0730 00:02:31.063790    2560 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 30 00:02:31.063912 ip-10-0-133-55 kubenswrapper[2560]: E0730 00:02:31.063813    2560 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Jul 30 00:02:31.063912 ip-10-0-133-55 kubenswrapper[2560]: E0730 00:02:31.063833    2560 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 30 00:02:31.063912 ip-10-0-133-55 kubenswrapper[2560]: E0730 00:02:31.063849    2560 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-777dddd7cd-bw4wt: secret "image-registry-tls" not found
Jul 30 00:02:31.063912 ip-10-0-133-55 kubenswrapper[2560]: E0730 00:02:31.063869    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/511107bb-85d6-4f7e-9598-0f4aac95ba34-metrics-tls podName:511107bb-85d6-4f7e-9598-0f4aac95ba34 nodeName:}" failed. No retries permitted until 2026-07-30 00:02:35.063849184 +0000 UTC m=+42.123065986 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/511107bb-85d6-4f7e-9598-0f4aac95ba34-metrics-tls") pod "dns-default-9q6wf" (UID: "511107bb-85d6-4f7e-9598-0f4aac95ba34") : secret "dns-default-metrics-tls" not found
Jul 30 00:02:31.063912 ip-10-0-133-55 kubenswrapper[2560]: E0730 00:02:31.063890    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fc66861e-ab18-4d71-bed7-1fa000323b4a-networking-console-plugin-cert podName:fc66861e-ab18-4d71-bed7-1fa000323b4a nodeName:}" failed. No retries permitted until 2026-07-30 00:02:35.063880753 +0000 UTC m=+42.123097535 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/fc66861e-ab18-4d71-bed7-1fa000323b4a-networking-console-plugin-cert") pod "networking-console-plugin-74c9f884b7-cvf92" (UID: "fc66861e-ab18-4d71-bed7-1fa000323b4a") : secret "networking-console-plugin-cert" not found
Jul 30 00:02:31.064059 ip-10-0-133-55 kubenswrapper[2560]: E0730 00:02:31.063932    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/29e3c7fe-e0a9-4098-8415-4c2f716a92eb-registry-tls podName:29e3c7fe-e0a9-4098-8415-4c2f716a92eb nodeName:}" failed. No retries permitted until 2026-07-30 00:02:35.063920657 +0000 UTC m=+42.123137456 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/29e3c7fe-e0a9-4098-8415-4c2f716a92eb-registry-tls") pod "image-registry-777dddd7cd-bw4wt" (UID: "29e3c7fe-e0a9-4098-8415-4c2f716a92eb") : secret "image-registry-tls" not found
Jul 30 00:02:31.570178 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:02:31.569947    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-ms6sp" event={"ID":"de66dc13-ad46-4e8a-8ce5-2c54b63d852a","Type":"ContainerStarted","Data":"864255d22ee9cca20bbc3cbea3e82afe9d6a5670e9c33d349ed3a3e08718a50f"}
Jul 30 00:02:31.571584 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:02:31.571540    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-zprkl" event={"ID":"e4926e4b-1b99-4889-afe0-459d8080ff96","Type":"ContainerStarted","Data":"64330a1143cedbcc30f3571797ea1f50d5e26201b13d6af4923a2ec4b767dd97"}
Jul 30 00:02:31.591662 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:02:31.591611    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-ms6sp" podStartSLOduration=8.269575167 podStartE2EDuration="38.591594564s" totalImagesPullingTime="30.322019397s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-30 00:01:53 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 00:02:31.591247833 +0000 UTC m=+38.650464648" watchObservedRunningTime="2026-07-30 00:02:31.591594564 +0000 UTC m=+38.650811368"
Jul 30 00:02:31.608773 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:02:31.608709    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-zprkl" podStartSLOduration=1.8486330930000001 podStartE2EDuration="4.608694115s" totalImagesPullingTime="2.760061022s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-30 00:02:27 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 00:02:31.608410605 +0000 UTC m=+38.667627420" watchObservedRunningTime="2026-07-30 00:02:31.608694115 +0000 UTC m=+38.667910920"
Jul 30 00:02:35.093212 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:02:35.093166    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/29e3c7fe-e0a9-4098-8415-4c2f716a92eb-registry-tls\") pod \"image-registry-777dddd7cd-bw4wt\" (UID: \"29e3c7fe-e0a9-4098-8415-4c2f716a92eb\") " pod="openshift-image-registry/image-registry-777dddd7cd-bw4wt"
Jul 30 00:02:35.093651 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:02:35.093233    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/fc66861e-ab18-4d71-bed7-1fa000323b4a-networking-console-plugin-cert\") pod \"networking-console-plugin-74c9f884b7-cvf92\" (UID: \"fc66861e-ab18-4d71-bed7-1fa000323b4a\") " pod="openshift-network-console/networking-console-plugin-74c9f884b7-cvf92"
Jul 30 00:02:35.093651 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:02:35.093290    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/511107bb-85d6-4f7e-9598-0f4aac95ba34-metrics-tls\") pod \"dns-default-9q6wf\" (UID: \"511107bb-85d6-4f7e-9598-0f4aac95ba34\") " pod="openshift-dns/dns-default-9q6wf"
Jul 30 00:02:35.093651 ip-10-0-133-55 kubenswrapper[2560]: E0730 00:02:35.093335    2560 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 30 00:02:35.093651 ip-10-0-133-55 kubenswrapper[2560]: E0730 00:02:35.093359    2560 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-777dddd7cd-bw4wt: secret "image-registry-tls" not found
Jul 30 00:02:35.093651 ip-10-0-133-55 kubenswrapper[2560]: E0730 00:02:35.093392    2560 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Jul 30 00:02:35.093651 ip-10-0-133-55 kubenswrapper[2560]: E0730 00:02:35.093429    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/29e3c7fe-e0a9-4098-8415-4c2f716a92eb-registry-tls podName:29e3c7fe-e0a9-4098-8415-4c2f716a92eb nodeName:}" failed. No retries permitted until 2026-07-30 00:02:43.093407941 +0000 UTC m=+50.152624742 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/29e3c7fe-e0a9-4098-8415-4c2f716a92eb-registry-tls") pod "image-registry-777dddd7cd-bw4wt" (UID: "29e3c7fe-e0a9-4098-8415-4c2f716a92eb") : secret "image-registry-tls" not found
Jul 30 00:02:35.093651 ip-10-0-133-55 kubenswrapper[2560]: E0730 00:02:35.093437    2560 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 30 00:02:35.093651 ip-10-0-133-55 kubenswrapper[2560]: E0730 00:02:35.093446    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fc66861e-ab18-4d71-bed7-1fa000323b4a-networking-console-plugin-cert podName:fc66861e-ab18-4d71-bed7-1fa000323b4a nodeName:}" failed. No retries permitted until 2026-07-30 00:02:43.093439549 +0000 UTC m=+50.152656331 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/fc66861e-ab18-4d71-bed7-1fa000323b4a-networking-console-plugin-cert") pod "networking-console-plugin-74c9f884b7-cvf92" (UID: "fc66861e-ab18-4d71-bed7-1fa000323b4a") : secret "networking-console-plugin-cert" not found
Jul 30 00:02:35.093651 ip-10-0-133-55 kubenswrapper[2560]: E0730 00:02:35.093491    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/511107bb-85d6-4f7e-9598-0f4aac95ba34-metrics-tls podName:511107bb-85d6-4f7e-9598-0f4aac95ba34 nodeName:}" failed. No retries permitted until 2026-07-30 00:02:43.093474456 +0000 UTC m=+50.152691282 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/511107bb-85d6-4f7e-9598-0f4aac95ba34-metrics-tls") pod "dns-default-9q6wf" (UID: "511107bb-85d6-4f7e-9598-0f4aac95ba34") : secret "dns-default-metrics-tls" not found
Jul 30 00:02:43.156318 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:02:43.156284    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/29e3c7fe-e0a9-4098-8415-4c2f716a92eb-registry-tls\") pod \"image-registry-777dddd7cd-bw4wt\" (UID: \"29e3c7fe-e0a9-4098-8415-4c2f716a92eb\") " pod="openshift-image-registry/image-registry-777dddd7cd-bw4wt"
Jul 30 00:02:43.156765 ip-10-0-133-55 kubenswrapper[2560]: E0730 00:02:43.156428    2560 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 30 00:02:43.156765 ip-10-0-133-55 kubenswrapper[2560]: E0730 00:02:43.156448    2560 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-777dddd7cd-bw4wt: secret "image-registry-tls" not found
Jul 30 00:02:43.156765 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:02:43.156447    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/fc66861e-ab18-4d71-bed7-1fa000323b4a-networking-console-plugin-cert\") pod \"networking-console-plugin-74c9f884b7-cvf92\" (UID: \"fc66861e-ab18-4d71-bed7-1fa000323b4a\") " pod="openshift-network-console/networking-console-plugin-74c9f884b7-cvf92"
Jul 30 00:02:43.156765 ip-10-0-133-55 kubenswrapper[2560]: E0730 00:02:43.156496    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/29e3c7fe-e0a9-4098-8415-4c2f716a92eb-registry-tls podName:29e3c7fe-e0a9-4098-8415-4c2f716a92eb nodeName:}" failed. No retries permitted until 2026-07-30 00:02:59.156480713 +0000 UTC m=+66.215697512 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/29e3c7fe-e0a9-4098-8415-4c2f716a92eb-registry-tls") pod "image-registry-777dddd7cd-bw4wt" (UID: "29e3c7fe-e0a9-4098-8415-4c2f716a92eb") : secret "image-registry-tls" not found
Jul 30 00:02:43.156765 ip-10-0-133-55 kubenswrapper[2560]: E0730 00:02:43.156537    2560 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Jul 30 00:02:43.156765 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:02:43.156538    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/511107bb-85d6-4f7e-9598-0f4aac95ba34-metrics-tls\") pod \"dns-default-9q6wf\" (UID: \"511107bb-85d6-4f7e-9598-0f4aac95ba34\") " pod="openshift-dns/dns-default-9q6wf"
Jul 30 00:02:43.156765 ip-10-0-133-55 kubenswrapper[2560]: E0730 00:02:43.156577    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fc66861e-ab18-4d71-bed7-1fa000323b4a-networking-console-plugin-cert podName:fc66861e-ab18-4d71-bed7-1fa000323b4a nodeName:}" failed. No retries permitted until 2026-07-30 00:02:59.156565535 +0000 UTC m=+66.215782318 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/fc66861e-ab18-4d71-bed7-1fa000323b4a-networking-console-plugin-cert") pod "networking-console-plugin-74c9f884b7-cvf92" (UID: "fc66861e-ab18-4d71-bed7-1fa000323b4a") : secret "networking-console-plugin-cert" not found
Jul 30 00:02:43.156765 ip-10-0-133-55 kubenswrapper[2560]: E0730 00:02:43.156606    2560 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 30 00:02:43.156765 ip-10-0-133-55 kubenswrapper[2560]: E0730 00:02:43.156641    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/511107bb-85d6-4f7e-9598-0f4aac95ba34-metrics-tls podName:511107bb-85d6-4f7e-9598-0f4aac95ba34 nodeName:}" failed. No retries permitted until 2026-07-30 00:02:59.15662994 +0000 UTC m=+66.215846725 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/511107bb-85d6-4f7e-9598-0f4aac95ba34-metrics-tls") pod "dns-default-9q6wf" (UID: "511107bb-85d6-4f7e-9598-0f4aac95ba34") : secret "dns-default-metrics-tls" not found
Jul 30 00:02:52.552497 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:02:52.552469    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-4p5kl"
Jul 30 00:02:59.179792 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:02:59.179755    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-z5hvt\" (UniqueName: \"kubernetes.io/projected/aaa633f6-b8db-4e08-a83b-07ec5ca2d154-kube-api-access-z5hvt\") pod \"network-check-target-lx827\" (UID: \"aaa633f6-b8db-4e08-a83b-07ec5ca2d154\") " pod="openshift-network-diagnostics/network-check-target-lx827"
Jul 30 00:02:59.179792 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:02:59.179804    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/511107bb-85d6-4f7e-9598-0f4aac95ba34-metrics-tls\") pod \"dns-default-9q6wf\" (UID: \"511107bb-85d6-4f7e-9598-0f4aac95ba34\") " pod="openshift-dns/dns-default-9q6wf"
Jul 30 00:02:59.180385 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:02:59.179825    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/05dcf00e-2c10-495a-b61b-9221eb8286e5-metrics-certs\") pod \"network-metrics-daemon-9g97b\" (UID: \"05dcf00e-2c10-495a-b61b-9221eb8286e5\") " pod="openshift-multus/network-metrics-daemon-9g97b"
Jul 30 00:02:59.180385 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:02:59.179854    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/29e3c7fe-e0a9-4098-8415-4c2f716a92eb-registry-tls\") pod \"image-registry-777dddd7cd-bw4wt\" (UID: \"29e3c7fe-e0a9-4098-8415-4c2f716a92eb\") " pod="openshift-image-registry/image-registry-777dddd7cd-bw4wt"
Jul 30 00:02:59.180385 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:02:59.179881    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/e1fdf440-f1f1-40b4-9660-32cc39e1de67-original-pull-secret\") pod \"global-pull-secret-syncer-nfssx\" (UID: \"e1fdf440-f1f1-40b4-9660-32cc39e1de67\") " pod="kube-system/global-pull-secret-syncer-nfssx"
Jul 30 00:02:59.180385 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:02:59.179914    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/fc66861e-ab18-4d71-bed7-1fa000323b4a-networking-console-plugin-cert\") pod \"networking-console-plugin-74c9f884b7-cvf92\" (UID: \"fc66861e-ab18-4d71-bed7-1fa000323b4a\") " pod="openshift-network-console/networking-console-plugin-74c9f884b7-cvf92"
Jul 30 00:02:59.180385 ip-10-0-133-55 kubenswrapper[2560]: E0730 00:02:59.179943    2560 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 30 00:02:59.180385 ip-10-0-133-55 kubenswrapper[2560]: E0730 00:02:59.179981    2560 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 30 00:02:59.180385 ip-10-0-133-55 kubenswrapper[2560]: E0730 00:02:59.179994    2560 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Jul 30 00:02:59.180385 ip-10-0-133-55 kubenswrapper[2560]: E0730 00:02:59.179999    2560 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-777dddd7cd-bw4wt: secret "image-registry-tls" not found
Jul 30 00:02:59.180385 ip-10-0-133-55 kubenswrapper[2560]: E0730 00:02:59.180024    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/511107bb-85d6-4f7e-9598-0f4aac95ba34-metrics-tls podName:511107bb-85d6-4f7e-9598-0f4aac95ba34 nodeName:}" failed. No retries permitted until 2026-07-30 00:03:31.180002157 +0000 UTC m=+98.239218960 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/511107bb-85d6-4f7e-9598-0f4aac95ba34-metrics-tls") pod "dns-default-9q6wf" (UID: "511107bb-85d6-4f7e-9598-0f4aac95ba34") : secret "dns-default-metrics-tls" not found
Jul 30 00:02:59.180385 ip-10-0-133-55 kubenswrapper[2560]: E0730 00:02:59.180053    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fc66861e-ab18-4d71-bed7-1fa000323b4a-networking-console-plugin-cert podName:fc66861e-ab18-4d71-bed7-1fa000323b4a nodeName:}" failed. No retries permitted until 2026-07-30 00:03:31.180037996 +0000 UTC m=+98.239254778 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/fc66861e-ab18-4d71-bed7-1fa000323b4a-networking-console-plugin-cert") pod "networking-console-plugin-74c9f884b7-cvf92" (UID: "fc66861e-ab18-4d71-bed7-1fa000323b4a") : secret "networking-console-plugin-cert" not found
Jul 30 00:02:59.180385 ip-10-0-133-55 kubenswrapper[2560]: E0730 00:02:59.180068    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/29e3c7fe-e0a9-4098-8415-4c2f716a92eb-registry-tls podName:29e3c7fe-e0a9-4098-8415-4c2f716a92eb nodeName:}" failed. No retries permitted until 2026-07-30 00:03:31.180059894 +0000 UTC m=+98.239276676 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/29e3c7fe-e0a9-4098-8415-4c2f716a92eb-registry-tls") pod "image-registry-777dddd7cd-bw4wt" (UID: "29e3c7fe-e0a9-4098-8415-4c2f716a92eb") : secret "image-registry-tls" not found
Jul 30 00:02:59.182463 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:02:59.182442    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Jul 30 00:02:59.182547 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:02:59.182460    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Jul 30 00:02:59.182547 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:02:59.182483    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Jul 30 00:02:59.190167 ip-10-0-133-55 kubenswrapper[2560]: E0730 00:02:59.190144    2560 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found
Jul 30 00:02:59.190232 ip-10-0-133-55 kubenswrapper[2560]: E0730 00:02:59.190197    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/05dcf00e-2c10-495a-b61b-9221eb8286e5-metrics-certs podName:05dcf00e-2c10-495a-b61b-9221eb8286e5 nodeName:}" failed. No retries permitted until 2026-07-30 00:04:03.190182558 +0000 UTC m=+130.249399359 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/05dcf00e-2c10-495a-b61b-9221eb8286e5-metrics-certs") pod "network-metrics-daemon-9g97b" (UID: "05dcf00e-2c10-495a-b61b-9221eb8286e5") : secret "metrics-daemon-secret" not found
Jul 30 00:02:59.191990 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:02:59.191972    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Jul 30 00:02:59.193801 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:02:59.193778    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/e1fdf440-f1f1-40b4-9660-32cc39e1de67-original-pull-secret\") pod \"global-pull-secret-syncer-nfssx\" (UID: \"e1fdf440-f1f1-40b4-9660-32cc39e1de67\") " pod="kube-system/global-pull-secret-syncer-nfssx"
Jul 30 00:02:59.202427 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:02:59.202405    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-z5hvt\" (UniqueName: \"kubernetes.io/projected/aaa633f6-b8db-4e08-a83b-07ec5ca2d154-kube-api-access-z5hvt\") pod \"network-check-target-lx827\" (UID: \"aaa633f6-b8db-4e08-a83b-07ec5ca2d154\") " pod="openshift-network-diagnostics/network-check-target-lx827"
Jul 30 00:02:59.211140 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:02:59.211122    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-nfssx"
Jul 30 00:02:59.316503 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:02:59.316262    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-p64v7\""
Jul 30 00:02:59.326664 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:02:59.326431    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-lx827"
Jul 30 00:02:59.393443 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:02:59.393412    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-nfssx"]
Jul 30 00:02:59.408134 ip-10-0-133-55 kubenswrapper[2560]: W0730 00:02:59.408098    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode1fdf440_f1f1_40b4_9660_32cc39e1de67.slice/crio-70c9431376870238b99bc2d1e36ec83a531dc2868582b6b72079043fab9dd348 WatchSource:0}: Error finding container 70c9431376870238b99bc2d1e36ec83a531dc2868582b6b72079043fab9dd348: Status 404 returned error can't find the container with id 70c9431376870238b99bc2d1e36ec83a531dc2868582b6b72079043fab9dd348
Jul 30 00:02:59.456870 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:02:59.456782    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-lx827"]
Jul 30 00:02:59.459444 ip-10-0-133-55 kubenswrapper[2560]: W0730 00:02:59.459420    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podaaa633f6_b8db_4e08_a83b_07ec5ca2d154.slice/crio-025afe3c165fde9a3421ba24f4437595d5e13862b233580f02649c528c14f47a WatchSource:0}: Error finding container 025afe3c165fde9a3421ba24f4437595d5e13862b233580f02649c528c14f47a: Status 404 returned error can't find the container with id 025afe3c165fde9a3421ba24f4437595d5e13862b233580f02649c528c14f47a
Jul 30 00:02:59.641541 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:02:59.641501    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-nfssx" event={"ID":"e1fdf440-f1f1-40b4-9660-32cc39e1de67","Type":"ContainerStarted","Data":"70c9431376870238b99bc2d1e36ec83a531dc2868582b6b72079043fab9dd348"}
Jul 30 00:02:59.642548 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:02:59.642530    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-lx827" event={"ID":"aaa633f6-b8db-4e08-a83b-07ec5ca2d154","Type":"ContainerStarted","Data":"025afe3c165fde9a3421ba24f4437595d5e13862b233580f02649c528c14f47a"}
Jul 30 00:03:04.656878 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:03:04.656844    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-nfssx" event={"ID":"e1fdf440-f1f1-40b4-9660-32cc39e1de67","Type":"ContainerStarted","Data":"605cfde7c2e1c74cdd4583d5fdcc18eb99108448baa0f0e4f5676c94e6d90c3c"}
Jul 30 00:03:04.658260 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:03:04.658236    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-lx827" event={"ID":"aaa633f6-b8db-4e08-a83b-07ec5ca2d154","Type":"ContainerStarted","Data":"789b9ba4f74571e0625cb7bd06f8fc7df51fa2fea8167c0cad72b1d101c939e2"}
Jul 30 00:03:04.658385 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:03:04.658350    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-lx827"
Jul 30 00:03:04.672127 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:03:04.672085    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-nfssx" podStartSLOduration=66.934654354 podStartE2EDuration="1m11.672072616s" totalImagesPullingTime="4.737418262s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-30 00:01:53 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 00:03:04.671637755 +0000 UTC m=+71.730854558" watchObservedRunningTime="2026-07-30 00:03:04.672072616 +0000 UTC m=+71.731289420"
Jul 30 00:03:04.685108 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:03:04.685066    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-lx827" podStartSLOduration=67.003122896 podStartE2EDuration="1m11.685055122s" totalImagesPullingTime="4.681932226s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-30 00:01:53 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 00:03:04.684865408 +0000 UTC m=+71.744082213" watchObservedRunningTime="2026-07-30 00:03:04.685055122 +0000 UTC m=+71.744271917"
Jul 30 00:03:31.213285 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:03:31.213168    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/29e3c7fe-e0a9-4098-8415-4c2f716a92eb-registry-tls\") pod \"image-registry-777dddd7cd-bw4wt\" (UID: \"29e3c7fe-e0a9-4098-8415-4c2f716a92eb\") " pod="openshift-image-registry/image-registry-777dddd7cd-bw4wt"
Jul 30 00:03:31.213285 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:03:31.213227    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/fc66861e-ab18-4d71-bed7-1fa000323b4a-networking-console-plugin-cert\") pod \"networking-console-plugin-74c9f884b7-cvf92\" (UID: \"fc66861e-ab18-4d71-bed7-1fa000323b4a\") " pod="openshift-network-console/networking-console-plugin-74c9f884b7-cvf92"
Jul 30 00:03:31.213285 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:03:31.213257    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/511107bb-85d6-4f7e-9598-0f4aac95ba34-metrics-tls\") pod \"dns-default-9q6wf\" (UID: \"511107bb-85d6-4f7e-9598-0f4aac95ba34\") " pod="openshift-dns/dns-default-9q6wf"
Jul 30 00:03:31.213794 ip-10-0-133-55 kubenswrapper[2560]: E0730 00:03:31.213329    2560 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 30 00:03:31.213794 ip-10-0-133-55 kubenswrapper[2560]: E0730 00:03:31.213351    2560 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-777dddd7cd-bw4wt: secret "image-registry-tls" not found
Jul 30 00:03:31.213794 ip-10-0-133-55 kubenswrapper[2560]: E0730 00:03:31.213368    2560 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 30 00:03:31.213794 ip-10-0-133-55 kubenswrapper[2560]: E0730 00:03:31.213391    2560 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Jul 30 00:03:31.213794 ip-10-0-133-55 kubenswrapper[2560]: E0730 00:03:31.213761    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/29e3c7fe-e0a9-4098-8415-4c2f716a92eb-registry-tls podName:29e3c7fe-e0a9-4098-8415-4c2f716a92eb nodeName:}" failed. No retries permitted until 2026-07-30 00:04:35.21339063 +0000 UTC m=+162.272607428 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/29e3c7fe-e0a9-4098-8415-4c2f716a92eb-registry-tls") pod "image-registry-777dddd7cd-bw4wt" (UID: "29e3c7fe-e0a9-4098-8415-4c2f716a92eb") : secret "image-registry-tls" not found
Jul 30 00:03:31.213794 ip-10-0-133-55 kubenswrapper[2560]: E0730 00:03:31.213800    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/511107bb-85d6-4f7e-9598-0f4aac95ba34-metrics-tls podName:511107bb-85d6-4f7e-9598-0f4aac95ba34 nodeName:}" failed. No retries permitted until 2026-07-30 00:04:35.213779636 +0000 UTC m=+162.272996425 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/511107bb-85d6-4f7e-9598-0f4aac95ba34-metrics-tls") pod "dns-default-9q6wf" (UID: "511107bb-85d6-4f7e-9598-0f4aac95ba34") : secret "dns-default-metrics-tls" not found
Jul 30 00:03:31.214220 ip-10-0-133-55 kubenswrapper[2560]: E0730 00:03:31.214017    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fc66861e-ab18-4d71-bed7-1fa000323b4a-networking-console-plugin-cert podName:fc66861e-ab18-4d71-bed7-1fa000323b4a nodeName:}" failed. No retries permitted until 2026-07-30 00:04:35.213978961 +0000 UTC m=+162.273195749 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/fc66861e-ab18-4d71-bed7-1fa000323b4a-networking-console-plugin-cert") pod "networking-console-plugin-74c9f884b7-cvf92" (UID: "fc66861e-ab18-4d71-bed7-1fa000323b4a") : secret "networking-console-plugin-cert" not found
Jul 30 00:03:35.663799 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:03:35.663769    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-lx827"
Jul 30 00:04:03.242868 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:04:03.242824    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/05dcf00e-2c10-495a-b61b-9221eb8286e5-metrics-certs\") pod \"network-metrics-daemon-9g97b\" (UID: \"05dcf00e-2c10-495a-b61b-9221eb8286e5\") " pod="openshift-multus/network-metrics-daemon-9g97b"
Jul 30 00:04:03.243367 ip-10-0-133-55 kubenswrapper[2560]: E0730 00:04:03.242962    2560 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found
Jul 30 00:04:03.243367 ip-10-0-133-55 kubenswrapper[2560]: E0730 00:04:03.243024    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/05dcf00e-2c10-495a-b61b-9221eb8286e5-metrics-certs podName:05dcf00e-2c10-495a-b61b-9221eb8286e5 nodeName:}" failed. No retries permitted until 2026-07-30 00:06:05.243008671 +0000 UTC m=+252.302225456 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/05dcf00e-2c10-495a-b61b-9221eb8286e5-metrics-certs") pod "network-metrics-daemon-9g97b" (UID: "05dcf00e-2c10-495a-b61b-9221eb8286e5") : secret "metrics-daemon-secret" not found
Jul 30 00:04:30.313044 ip-10-0-133-55 kubenswrapper[2560]: E0730 00:04:30.312995    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[networking-console-plugin-cert], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-network-console/networking-console-plugin-74c9f884b7-cvf92" podUID="fc66861e-ab18-4d71-bed7-1fa000323b4a"
Jul 30 00:04:30.333177 ip-10-0-133-55 kubenswrapper[2560]: E0730 00:04:30.333156    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[registry-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-image-registry/image-registry-777dddd7cd-bw4wt" podUID="29e3c7fe-e0a9-4098-8415-4c2f716a92eb"
Jul 30 00:04:30.339445 ip-10-0-133-55 kubenswrapper[2560]: E0730 00:04:30.339419    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-9q6wf" podUID="511107bb-85d6-4f7e-9598-0f4aac95ba34"
Jul 30 00:04:30.415728 ip-10-0-133-55 kubenswrapper[2560]: E0730 00:04:30.415706    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-certs], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-multus/network-metrics-daemon-9g97b" podUID="05dcf00e-2c10-495a-b61b-9221eb8286e5"
Jul 30 00:04:30.865667 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:04:30.865637    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-74c9f884b7-cvf92"
Jul 30 00:04:30.865849 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:04:30.865637    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-777dddd7cd-bw4wt"
Jul 30 00:04:30.865849 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:04:30.865637    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-9q6wf"
Jul 30 00:04:35.269867 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:04:35.269810    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/fc66861e-ab18-4d71-bed7-1fa000323b4a-networking-console-plugin-cert\") pod \"networking-console-plugin-74c9f884b7-cvf92\" (UID: \"fc66861e-ab18-4d71-bed7-1fa000323b4a\") " pod="openshift-network-console/networking-console-plugin-74c9f884b7-cvf92"
Jul 30 00:04:35.269867 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:04:35.269879    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/511107bb-85d6-4f7e-9598-0f4aac95ba34-metrics-tls\") pod \"dns-default-9q6wf\" (UID: \"511107bb-85d6-4f7e-9598-0f4aac95ba34\") " pod="openshift-dns/dns-default-9q6wf"
Jul 30 00:04:35.270425 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:04:35.269919    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/29e3c7fe-e0a9-4098-8415-4c2f716a92eb-registry-tls\") pod \"image-registry-777dddd7cd-bw4wt\" (UID: \"29e3c7fe-e0a9-4098-8415-4c2f716a92eb\") " pod="openshift-image-registry/image-registry-777dddd7cd-bw4wt"
Jul 30 00:04:35.270425 ip-10-0-133-55 kubenswrapper[2560]: E0730 00:04:35.269968    2560 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Jul 30 00:04:35.270425 ip-10-0-133-55 kubenswrapper[2560]: E0730 00:04:35.270006    2560 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 30 00:04:35.270425 ip-10-0-133-55 kubenswrapper[2560]: E0730 00:04:35.270012    2560 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 30 00:04:35.270425 ip-10-0-133-55 kubenswrapper[2560]: E0730 00:04:35.270064    2560 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-777dddd7cd-bw4wt: secret "image-registry-tls" not found
Jul 30 00:04:35.270425 ip-10-0-133-55 kubenswrapper[2560]: E0730 00:04:35.270051    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fc66861e-ab18-4d71-bed7-1fa000323b4a-networking-console-plugin-cert podName:fc66861e-ab18-4d71-bed7-1fa000323b4a nodeName:}" failed. No retries permitted until 2026-07-30 00:06:37.270028695 +0000 UTC m=+284.329245499 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/fc66861e-ab18-4d71-bed7-1fa000323b4a-networking-console-plugin-cert") pod "networking-console-plugin-74c9f884b7-cvf92" (UID: "fc66861e-ab18-4d71-bed7-1fa000323b4a") : secret "networking-console-plugin-cert" not found
Jul 30 00:04:35.270425 ip-10-0-133-55 kubenswrapper[2560]: E0730 00:04:35.270101    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/511107bb-85d6-4f7e-9598-0f4aac95ba34-metrics-tls podName:511107bb-85d6-4f7e-9598-0f4aac95ba34 nodeName:}" failed. No retries permitted until 2026-07-30 00:06:37.270090148 +0000 UTC m=+284.329306929 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/511107bb-85d6-4f7e-9598-0f4aac95ba34-metrics-tls") pod "dns-default-9q6wf" (UID: "511107bb-85d6-4f7e-9598-0f4aac95ba34") : secret "dns-default-metrics-tls" not found
Jul 30 00:04:35.270425 ip-10-0-133-55 kubenswrapper[2560]: E0730 00:04:35.270114    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/29e3c7fe-e0a9-4098-8415-4c2f716a92eb-registry-tls podName:29e3c7fe-e0a9-4098-8415-4c2f716a92eb nodeName:}" failed. No retries permitted until 2026-07-30 00:06:37.270107097 +0000 UTC m=+284.329323878 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/29e3c7fe-e0a9-4098-8415-4c2f716a92eb-registry-tls") pod "image-registry-777dddd7cd-bw4wt" (UID: "29e3c7fe-e0a9-4098-8415-4c2f716a92eb") : secret "image-registry-tls" not found
Jul 30 00:04:43.399979 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:04:43.399939    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-9g97b"
Jul 30 00:06:05.296423 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:06:05.296379    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/05dcf00e-2c10-495a-b61b-9221eb8286e5-metrics-certs\") pod \"network-metrics-daemon-9g97b\" (UID: \"05dcf00e-2c10-495a-b61b-9221eb8286e5\") " pod="openshift-multus/network-metrics-daemon-9g97b"
Jul 30 00:06:05.296857 ip-10-0-133-55 kubenswrapper[2560]: E0730 00:06:05.296531    2560 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found
Jul 30 00:06:05.296857 ip-10-0-133-55 kubenswrapper[2560]: E0730 00:06:05.296603    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/05dcf00e-2c10-495a-b61b-9221eb8286e5-metrics-certs podName:05dcf00e-2c10-495a-b61b-9221eb8286e5 nodeName:}" failed. No retries permitted until 2026-07-30 00:08:07.296586226 +0000 UTC m=+374.355803012 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/05dcf00e-2c10-495a-b61b-9221eb8286e5-metrics-certs") pod "network-metrics-daemon-9g97b" (UID: "05dcf00e-2c10-495a-b61b-9221eb8286e5") : secret "metrics-daemon-secret" not found
Jul 30 00:06:15.092358 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:06:15.092320    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console-operator/console-operator-584dcb6b54-kchgc"]
Jul 30 00:06:15.095293 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:06:15.095271    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-584dcb6b54-kchgc"
Jul 30 00:06:15.097926 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:06:15.097899    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"console-operator-config\""
Jul 30 00:06:15.098054 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:06:15.098022    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"console-operator-dockercfg-ktfqq\""
Jul 30 00:06:15.098054 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:06:15.098033    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"openshift-service-ca.crt\""
Jul 30 00:06:15.099166 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:06:15.099149    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"kube-root-ca.crt\""
Jul 30 00:06:15.099239 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:06:15.099162    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"serving-cert\""
Jul 30 00:06:15.103095 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:06:15.103050    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"trusted-ca\""
Jul 30 00:06:15.107538 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:06:15.107517    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-584dcb6b54-kchgc"]
Jul 30 00:06:15.162654 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:06:15.162630    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/324341b7-120c-4f8b-9ddd-e28b9a40ce9e-config\") pod \"console-operator-584dcb6b54-kchgc\" (UID: \"324341b7-120c-4f8b-9ddd-e28b9a40ce9e\") " pod="openshift-console-operator/console-operator-584dcb6b54-kchgc"
Jul 30 00:06:15.162822 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:06:15.162707    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/324341b7-120c-4f8b-9ddd-e28b9a40ce9e-serving-cert\") pod \"console-operator-584dcb6b54-kchgc\" (UID: \"324341b7-120c-4f8b-9ddd-e28b9a40ce9e\") " pod="openshift-console-operator/console-operator-584dcb6b54-kchgc"
Jul 30 00:06:15.162822 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:06:15.162728    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/324341b7-120c-4f8b-9ddd-e28b9a40ce9e-trusted-ca\") pod \"console-operator-584dcb6b54-kchgc\" (UID: \"324341b7-120c-4f8b-9ddd-e28b9a40ce9e\") " pod="openshift-console-operator/console-operator-584dcb6b54-kchgc"
Jul 30 00:06:15.162822 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:06:15.162750    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2tsrs\" (UniqueName: \"kubernetes.io/projected/324341b7-120c-4f8b-9ddd-e28b9a40ce9e-kube-api-access-2tsrs\") pod \"console-operator-584dcb6b54-kchgc\" (UID: \"324341b7-120c-4f8b-9ddd-e28b9a40ce9e\") " pod="openshift-console-operator/console-operator-584dcb6b54-kchgc"
Jul 30 00:06:15.181719 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:06:15.181692    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-diagnostics/network-check-source-7d88cb55d8-kvjsg"]
Jul 30 00:06:15.184518 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:06:15.184497    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-549c6d54cf-986zd"]
Jul 30 00:06:15.184635 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:06:15.184618    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-7d88cb55d8-kvjsg"
Jul 30 00:06:15.187083 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:06:15.187065    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"network-diagnostics-dockercfg-zfwh4\""
Jul 30 00:06:15.187264 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:06:15.187250    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-operator-5885fdb759-kxgst"]
Jul 30 00:06:15.187396 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:06:15.187381    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-549c6d54cf-986zd"
Jul 30 00:06:15.189791 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:06:15.189777    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"openshift-service-ca.crt\""
Jul 30 00:06:15.189934 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:06:15.189918    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-5885fdb759-kxgst"
Jul 30 00:06:15.189997 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:06:15.189976    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"kube-root-ca.crt\""
Jul 30 00:06:15.190047 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:06:15.190014    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-storage-operator\"/\"volume-data-source-validator-dockercfg-jgqz7\""
Jul 30 00:06:15.192653 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:06:15.192635    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"operator-dockercfg-msxrq\""
Jul 30 00:06:15.192752 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:06:15.192711    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"service-ca-bundle\""
Jul 30 00:06:15.192966 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:06:15.192951    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"openshift-insights-serving-cert\""
Jul 30 00:06:15.193034 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:06:15.192955    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\""
Jul 30 00:06:15.193176 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:06:15.193164    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\""
Jul 30 00:06:15.195361 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:06:15.195345    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-7d88cb55d8-kvjsg"]
Jul 30 00:06:15.198298 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:06:15.198272    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-5885fdb759-kxgst"]
Jul 30 00:06:15.200039 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:06:15.199998    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"trusted-ca-bundle\""
Jul 30 00:06:15.207050 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:06:15.207034    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-549c6d54cf-986zd"]
Jul 30 00:06:15.263794 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:06:15.263760    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/660cabd1-7819-4fb9-aae2-76019d1fa428-serving-cert\") pod \"insights-operator-5885fdb759-kxgst\" (UID: \"660cabd1-7819-4fb9-aae2-76019d1fa428\") " pod="openshift-insights/insights-operator-5885fdb759-kxgst"
Jul 30 00:06:15.263794 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:06:15.263793    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rh88p\" (UniqueName: \"kubernetes.io/projected/660cabd1-7819-4fb9-aae2-76019d1fa428-kube-api-access-rh88p\") pod \"insights-operator-5885fdb759-kxgst\" (UID: \"660cabd1-7819-4fb9-aae2-76019d1fa428\") " pod="openshift-insights/insights-operator-5885fdb759-kxgst"
Jul 30 00:06:15.263995 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:06:15.263815    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pmb6v\" (UniqueName: \"kubernetes.io/projected/6f683c75-ab5b-41d3-91cf-5586ea1cb57e-kube-api-access-pmb6v\") pod \"network-check-source-7d88cb55d8-kvjsg\" (UID: \"6f683c75-ab5b-41d3-91cf-5586ea1cb57e\") " pod="openshift-network-diagnostics/network-check-source-7d88cb55d8-kvjsg"
Jul 30 00:06:15.263995 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:06:15.263835    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/660cabd1-7819-4fb9-aae2-76019d1fa428-trusted-ca-bundle\") pod \"insights-operator-5885fdb759-kxgst\" (UID: \"660cabd1-7819-4fb9-aae2-76019d1fa428\") " pod="openshift-insights/insights-operator-5885fdb759-kxgst"
Jul 30 00:06:15.263995 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:06:15.263900    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/660cabd1-7819-4fb9-aae2-76019d1fa428-snapshots\") pod \"insights-operator-5885fdb759-kxgst\" (UID: \"660cabd1-7819-4fb9-aae2-76019d1fa428\") " pod="openshift-insights/insights-operator-5885fdb759-kxgst"
Jul 30 00:06:15.263995 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:06:15.263927    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/324341b7-120c-4f8b-9ddd-e28b9a40ce9e-trusted-ca\") pod \"console-operator-584dcb6b54-kchgc\" (UID: \"324341b7-120c-4f8b-9ddd-e28b9a40ce9e\") " pod="openshift-console-operator/console-operator-584dcb6b54-kchgc"
Jul 30 00:06:15.263995 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:06:15.263952    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/324341b7-120c-4f8b-9ddd-e28b9a40ce9e-serving-cert\") pod \"console-operator-584dcb6b54-kchgc\" (UID: \"324341b7-120c-4f8b-9ddd-e28b9a40ce9e\") " pod="openshift-console-operator/console-operator-584dcb6b54-kchgc"
Jul 30 00:06:15.263995 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:06:15.263980    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/324341b7-120c-4f8b-9ddd-e28b9a40ce9e-config\") pod \"console-operator-584dcb6b54-kchgc\" (UID: \"324341b7-120c-4f8b-9ddd-e28b9a40ce9e\") " pod="openshift-console-operator/console-operator-584dcb6b54-kchgc"
Jul 30 00:06:15.264191 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:06:15.264100    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/660cabd1-7819-4fb9-aae2-76019d1fa428-service-ca-bundle\") pod \"insights-operator-5885fdb759-kxgst\" (UID: \"660cabd1-7819-4fb9-aae2-76019d1fa428\") " pod="openshift-insights/insights-operator-5885fdb759-kxgst"
Jul 30 00:06:15.264191 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:06:15.264143    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2tsrs\" (UniqueName: \"kubernetes.io/projected/324341b7-120c-4f8b-9ddd-e28b9a40ce9e-kube-api-access-2tsrs\") pod \"console-operator-584dcb6b54-kchgc\" (UID: \"324341b7-120c-4f8b-9ddd-e28b9a40ce9e\") " pod="openshift-console-operator/console-operator-584dcb6b54-kchgc"
Jul 30 00:06:15.264261 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:06:15.264192    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/660cabd1-7819-4fb9-aae2-76019d1fa428-tmp\") pod \"insights-operator-5885fdb759-kxgst\" (UID: \"660cabd1-7819-4fb9-aae2-76019d1fa428\") " pod="openshift-insights/insights-operator-5885fdb759-kxgst"
Jul 30 00:06:15.264261 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:06:15.264228    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lqrp4\" (UniqueName: \"kubernetes.io/projected/aa32c593-1abb-40d2-8603-b7ae714705a5-kube-api-access-lqrp4\") pod \"volume-data-source-validator-549c6d54cf-986zd\" (UID: \"aa32c593-1abb-40d2-8603-b7ae714705a5\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-549c6d54cf-986zd"
Jul 30 00:06:15.264714 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:06:15.264690    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/324341b7-120c-4f8b-9ddd-e28b9a40ce9e-config\") pod \"console-operator-584dcb6b54-kchgc\" (UID: \"324341b7-120c-4f8b-9ddd-e28b9a40ce9e\") " pod="openshift-console-operator/console-operator-584dcb6b54-kchgc"
Jul 30 00:06:15.264903 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:06:15.264886    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/324341b7-120c-4f8b-9ddd-e28b9a40ce9e-trusted-ca\") pod \"console-operator-584dcb6b54-kchgc\" (UID: \"324341b7-120c-4f8b-9ddd-e28b9a40ce9e\") " pod="openshift-console-operator/console-operator-584dcb6b54-kchgc"
Jul 30 00:06:15.266150 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:06:15.266132    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/324341b7-120c-4f8b-9ddd-e28b9a40ce9e-serving-cert\") pod \"console-operator-584dcb6b54-kchgc\" (UID: \"324341b7-120c-4f8b-9ddd-e28b9a40ce9e\") " pod="openshift-console-operator/console-operator-584dcb6b54-kchgc"
Jul 30 00:06:15.271815 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:06:15.271794    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2tsrs\" (UniqueName: \"kubernetes.io/projected/324341b7-120c-4f8b-9ddd-e28b9a40ce9e-kube-api-access-2tsrs\") pod \"console-operator-584dcb6b54-kchgc\" (UID: \"324341b7-120c-4f8b-9ddd-e28b9a40ce9e\") " pod="openshift-console-operator/console-operator-584dcb6b54-kchgc"
Jul 30 00:06:15.365500 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:06:15.365427    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lqrp4\" (UniqueName: \"kubernetes.io/projected/aa32c593-1abb-40d2-8603-b7ae714705a5-kube-api-access-lqrp4\") pod \"volume-data-source-validator-549c6d54cf-986zd\" (UID: \"aa32c593-1abb-40d2-8603-b7ae714705a5\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-549c6d54cf-986zd"
Jul 30 00:06:15.365500 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:06:15.365463    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/660cabd1-7819-4fb9-aae2-76019d1fa428-serving-cert\") pod \"insights-operator-5885fdb759-kxgst\" (UID: \"660cabd1-7819-4fb9-aae2-76019d1fa428\") " pod="openshift-insights/insights-operator-5885fdb759-kxgst"
Jul 30 00:06:15.365500 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:06:15.365482    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rh88p\" (UniqueName: \"kubernetes.io/projected/660cabd1-7819-4fb9-aae2-76019d1fa428-kube-api-access-rh88p\") pod \"insights-operator-5885fdb759-kxgst\" (UID: \"660cabd1-7819-4fb9-aae2-76019d1fa428\") " pod="openshift-insights/insights-operator-5885fdb759-kxgst"
Jul 30 00:06:15.365744 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:06:15.365507    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pmb6v\" (UniqueName: \"kubernetes.io/projected/6f683c75-ab5b-41d3-91cf-5586ea1cb57e-kube-api-access-pmb6v\") pod \"network-check-source-7d88cb55d8-kvjsg\" (UID: \"6f683c75-ab5b-41d3-91cf-5586ea1cb57e\") " pod="openshift-network-diagnostics/network-check-source-7d88cb55d8-kvjsg"
Jul 30 00:06:15.365744 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:06:15.365539    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/660cabd1-7819-4fb9-aae2-76019d1fa428-trusted-ca-bundle\") pod \"insights-operator-5885fdb759-kxgst\" (UID: \"660cabd1-7819-4fb9-aae2-76019d1fa428\") " pod="openshift-insights/insights-operator-5885fdb759-kxgst"
Jul 30 00:06:15.365744 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:06:15.365568    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/660cabd1-7819-4fb9-aae2-76019d1fa428-snapshots\") pod \"insights-operator-5885fdb759-kxgst\" (UID: \"660cabd1-7819-4fb9-aae2-76019d1fa428\") " pod="openshift-insights/insights-operator-5885fdb759-kxgst"
Jul 30 00:06:15.365744 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:06:15.365630    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/660cabd1-7819-4fb9-aae2-76019d1fa428-service-ca-bundle\") pod \"insights-operator-5885fdb759-kxgst\" (UID: \"660cabd1-7819-4fb9-aae2-76019d1fa428\") " pod="openshift-insights/insights-operator-5885fdb759-kxgst"
Jul 30 00:06:15.365744 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:06:15.365674    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/660cabd1-7819-4fb9-aae2-76019d1fa428-tmp\") pod \"insights-operator-5885fdb759-kxgst\" (UID: \"660cabd1-7819-4fb9-aae2-76019d1fa428\") " pod="openshift-insights/insights-operator-5885fdb759-kxgst"
Jul 30 00:06:15.366155 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:06:15.366135    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/660cabd1-7819-4fb9-aae2-76019d1fa428-tmp\") pod \"insights-operator-5885fdb759-kxgst\" (UID: \"660cabd1-7819-4fb9-aae2-76019d1fa428\") " pod="openshift-insights/insights-operator-5885fdb759-kxgst"
Jul 30 00:06:15.366228 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:06:15.366177    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/660cabd1-7819-4fb9-aae2-76019d1fa428-snapshots\") pod \"insights-operator-5885fdb759-kxgst\" (UID: \"660cabd1-7819-4fb9-aae2-76019d1fa428\") " pod="openshift-insights/insights-operator-5885fdb759-kxgst"
Jul 30 00:06:15.366281 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:06:15.366260    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/660cabd1-7819-4fb9-aae2-76019d1fa428-service-ca-bundle\") pod \"insights-operator-5885fdb759-kxgst\" (UID: \"660cabd1-7819-4fb9-aae2-76019d1fa428\") " pod="openshift-insights/insights-operator-5885fdb759-kxgst"
Jul 30 00:06:15.366483 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:06:15.366467    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/660cabd1-7819-4fb9-aae2-76019d1fa428-trusted-ca-bundle\") pod \"insights-operator-5885fdb759-kxgst\" (UID: \"660cabd1-7819-4fb9-aae2-76019d1fa428\") " pod="openshift-insights/insights-operator-5885fdb759-kxgst"
Jul 30 00:06:15.367607 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:06:15.367592    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/660cabd1-7819-4fb9-aae2-76019d1fa428-serving-cert\") pod \"insights-operator-5885fdb759-kxgst\" (UID: \"660cabd1-7819-4fb9-aae2-76019d1fa428\") " pod="openshift-insights/insights-operator-5885fdb759-kxgst"
Jul 30 00:06:15.373040 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:06:15.373016    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lqrp4\" (UniqueName: \"kubernetes.io/projected/aa32c593-1abb-40d2-8603-b7ae714705a5-kube-api-access-lqrp4\") pod \"volume-data-source-validator-549c6d54cf-986zd\" (UID: \"aa32c593-1abb-40d2-8603-b7ae714705a5\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-549c6d54cf-986zd"
Jul 30 00:06:15.373231 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:06:15.373215    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rh88p\" (UniqueName: \"kubernetes.io/projected/660cabd1-7819-4fb9-aae2-76019d1fa428-kube-api-access-rh88p\") pod \"insights-operator-5885fdb759-kxgst\" (UID: \"660cabd1-7819-4fb9-aae2-76019d1fa428\") " pod="openshift-insights/insights-operator-5885fdb759-kxgst"
Jul 30 00:06:15.373273 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:06:15.373232    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pmb6v\" (UniqueName: \"kubernetes.io/projected/6f683c75-ab5b-41d3-91cf-5586ea1cb57e-kube-api-access-pmb6v\") pod \"network-check-source-7d88cb55d8-kvjsg\" (UID: \"6f683c75-ab5b-41d3-91cf-5586ea1cb57e\") " pod="openshift-network-diagnostics/network-check-source-7d88cb55d8-kvjsg"
Jul 30 00:06:15.404089 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:06:15.404074    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-584dcb6b54-kchgc"
Jul 30 00:06:15.494740 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:06:15.494706    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-7d88cb55d8-kvjsg"
Jul 30 00:06:15.502813 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:06:15.502787    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-549c6d54cf-986zd"
Jul 30 00:06:15.507687 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:06:15.507663    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-5885fdb759-kxgst"
Jul 30 00:06:15.520720 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:06:15.520691    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-584dcb6b54-kchgc"]
Jul 30 00:06:15.526179 ip-10-0-133-55 kubenswrapper[2560]: W0730 00:06:15.526153    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod324341b7_120c_4f8b_9ddd_e28b9a40ce9e.slice/crio-c1d4f2f90efb798bce6fa43c5d9bc606d0a54e01e231f33f569b35384ff1f4e5 WatchSource:0}: Error finding container c1d4f2f90efb798bce6fa43c5d9bc606d0a54e01e231f33f569b35384ff1f4e5: Status 404 returned error can't find the container with id c1d4f2f90efb798bce6fa43c5d9bc606d0a54e01e231f33f569b35384ff1f4e5
Jul 30 00:06:15.629000 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:06:15.628901    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-7d88cb55d8-kvjsg"]
Jul 30 00:06:15.632141 ip-10-0-133-55 kubenswrapper[2560]: W0730 00:06:15.632113    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6f683c75_ab5b_41d3_91cf_5586ea1cb57e.slice/crio-5d904d20423fd042cf0852730269bf9b9557a6fdd6387a54f7482cf0c66242ad WatchSource:0}: Error finding container 5d904d20423fd042cf0852730269bf9b9557a6fdd6387a54f7482cf0c66242ad: Status 404 returned error can't find the container with id 5d904d20423fd042cf0852730269bf9b9557a6fdd6387a54f7482cf0c66242ad
Jul 30 00:06:15.646840 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:06:15.646809    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-549c6d54cf-986zd"]
Jul 30 00:06:15.652121 ip-10-0-133-55 kubenswrapper[2560]: W0730 00:06:15.652095    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podaa32c593_1abb_40d2_8603_b7ae714705a5.slice/crio-1be2f2ba1d5298a07ad3ce2cb52029e1abb3dabffcbc4ce99cfb0bc6046d30f7 WatchSource:0}: Error finding container 1be2f2ba1d5298a07ad3ce2cb52029e1abb3dabffcbc4ce99cfb0bc6046d30f7: Status 404 returned error can't find the container with id 1be2f2ba1d5298a07ad3ce2cb52029e1abb3dabffcbc4ce99cfb0bc6046d30f7
Jul 30 00:06:15.665933 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:06:15.665906    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-5885fdb759-kxgst"]
Jul 30 00:06:15.668430 ip-10-0-133-55 kubenswrapper[2560]: W0730 00:06:15.668407    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod660cabd1_7819_4fb9_aae2_76019d1fa428.slice/crio-6db8e492a9cc9046499c9d192827b5b535793cfddc6c5925b9de9431185c82ba WatchSource:0}: Error finding container 6db8e492a9cc9046499c9d192827b5b535793cfddc6c5925b9de9431185c82ba: Status 404 returned error can't find the container with id 6db8e492a9cc9046499c9d192827b5b535793cfddc6c5925b9de9431185c82ba
Jul 30 00:06:16.110214 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:06:16.110176    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-7d88cb55d8-kvjsg" event={"ID":"6f683c75-ab5b-41d3-91cf-5586ea1cb57e","Type":"ContainerStarted","Data":"dcf2e8e0b55527ba42b2b4e86f7767df4c17e4934fec9e816ea078ba0b67b60f"}
Jul 30 00:06:16.110652 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:06:16.110228    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-7d88cb55d8-kvjsg" event={"ID":"6f683c75-ab5b-41d3-91cf-5586ea1cb57e","Type":"ContainerStarted","Data":"5d904d20423fd042cf0852730269bf9b9557a6fdd6387a54f7482cf0c66242ad"}
Jul 30 00:06:16.111355 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:06:16.111305    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-584dcb6b54-kchgc" event={"ID":"324341b7-120c-4f8b-9ddd-e28b9a40ce9e","Type":"ContainerStarted","Data":"c1d4f2f90efb798bce6fa43c5d9bc606d0a54e01e231f33f569b35384ff1f4e5"}
Jul 30 00:06:16.112328 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:06:16.112292    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-5885fdb759-kxgst" event={"ID":"660cabd1-7819-4fb9-aae2-76019d1fa428","Type":"ContainerStarted","Data":"6db8e492a9cc9046499c9d192827b5b535793cfddc6c5925b9de9431185c82ba"}
Jul 30 00:06:16.113207 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:06:16.113187    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-549c6d54cf-986zd" event={"ID":"aa32c593-1abb-40d2-8603-b7ae714705a5","Type":"ContainerStarted","Data":"1be2f2ba1d5298a07ad3ce2cb52029e1abb3dabffcbc4ce99cfb0bc6046d30f7"}
Jul 30 00:06:16.124249 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:06:16.124205    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-source-7d88cb55d8-kvjsg" podStartSLOduration=1.124188191 podStartE2EDuration="1.124188191s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-30 00:06:15 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 00:06:16.123597136 +0000 UTC m=+263.182813953" watchObservedRunningTime="2026-07-30 00:06:16.124188191 +0000 UTC m=+263.183404996"
Jul 30 00:06:18.120773 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:06:18.120324    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-5885fdb759-kxgst" event={"ID":"660cabd1-7819-4fb9-aae2-76019d1fa428","Type":"ContainerStarted","Data":"5fa996dad3395c08682863eaa8be6e405cd2d8235e1940e26d37268dd78b6bc8"}
Jul 30 00:06:18.121949 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:06:18.121912    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-549c6d54cf-986zd" event={"ID":"aa32c593-1abb-40d2-8603-b7ae714705a5","Type":"ContainerStarted","Data":"949d9ccc50aff00573a5b32a926997db70d2a901c07646d7a5b300a27fbbf2e8"}
Jul 30 00:06:18.136222 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:06:18.136181    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-operator-5885fdb759-kxgst" podStartSLOduration=0.87163017 podStartE2EDuration="3.136167947s" totalImagesPullingTime="2.264537777s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-30 00:06:15 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 00:06:18.134515398 +0000 UTC m=+265.193732204" watchObservedRunningTime="2026-07-30 00:06:18.136167947 +0000 UTC m=+265.195384768"
Jul 30 00:06:18.148968 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:06:18.148869    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-storage-operator/volume-data-source-validator-549c6d54cf-986zd" podStartSLOduration=1.643151401 podStartE2EDuration="3.148853341s" totalImagesPullingTime="1.50570194s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-30 00:06:15 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 00:06:18.147430089 +0000 UTC m=+265.206646900" watchObservedRunningTime="2026-07-30 00:06:18.148853341 +0000 UTC m=+265.208070147"
Jul 30 00:06:18.738901 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:06:18.738860    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-g69zk"]
Jul 30 00:06:18.742621 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:06:18.742564    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-g69zk"
Jul 30 00:06:18.745158 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:06:18.744978    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\""
Jul 30 00:06:18.745158 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:06:18.745017    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-47ttk\""
Jul 30 00:06:18.745987 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:06:18.745925    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\""
Jul 30 00:06:18.752737 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:06:18.752643    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-g69zk"]
Jul 30 00:06:18.796737 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:06:18.796706    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/7e1181b5-9505-4a82-84b2-48086fb162f0-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-g69zk\" (UID: \"7e1181b5-9505-4a82-84b2-48086fb162f0\") " pod="openshift-insights/insights-runtime-extractor-g69zk"
Jul 30 00:06:18.796859 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:06:18.796765    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-c5cmw\" (UniqueName: \"kubernetes.io/projected/7e1181b5-9505-4a82-84b2-48086fb162f0-kube-api-access-c5cmw\") pod \"insights-runtime-extractor-g69zk\" (UID: \"7e1181b5-9505-4a82-84b2-48086fb162f0\") " pod="openshift-insights/insights-runtime-extractor-g69zk"
Jul 30 00:06:18.796859 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:06:18.796814    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/7e1181b5-9505-4a82-84b2-48086fb162f0-data-volume\") pod \"insights-runtime-extractor-g69zk\" (UID: \"7e1181b5-9505-4a82-84b2-48086fb162f0\") " pod="openshift-insights/insights-runtime-extractor-g69zk"
Jul 30 00:06:18.796966 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:06:18.796871    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/7e1181b5-9505-4a82-84b2-48086fb162f0-crio-socket\") pod \"insights-runtime-extractor-g69zk\" (UID: \"7e1181b5-9505-4a82-84b2-48086fb162f0\") " pod="openshift-insights/insights-runtime-extractor-g69zk"
Jul 30 00:06:18.796966 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:06:18.796900    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/7e1181b5-9505-4a82-84b2-48086fb162f0-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-g69zk\" (UID: \"7e1181b5-9505-4a82-84b2-48086fb162f0\") " pod="openshift-insights/insights-runtime-extractor-g69zk"
Jul 30 00:06:18.897577 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:06:18.897518    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/7e1181b5-9505-4a82-84b2-48086fb162f0-crio-socket\") pod \"insights-runtime-extractor-g69zk\" (UID: \"7e1181b5-9505-4a82-84b2-48086fb162f0\") " pod="openshift-insights/insights-runtime-extractor-g69zk"
Jul 30 00:06:18.897577 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:06:18.897552    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/7e1181b5-9505-4a82-84b2-48086fb162f0-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-g69zk\" (UID: \"7e1181b5-9505-4a82-84b2-48086fb162f0\") " pod="openshift-insights/insights-runtime-extractor-g69zk"
Jul 30 00:06:18.897757 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:06:18.897601    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/7e1181b5-9505-4a82-84b2-48086fb162f0-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-g69zk\" (UID: \"7e1181b5-9505-4a82-84b2-48086fb162f0\") " pod="openshift-insights/insights-runtime-extractor-g69zk"
Jul 30 00:06:18.897757 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:06:18.897632    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/7e1181b5-9505-4a82-84b2-48086fb162f0-crio-socket\") pod \"insights-runtime-extractor-g69zk\" (UID: \"7e1181b5-9505-4a82-84b2-48086fb162f0\") " pod="openshift-insights/insights-runtime-extractor-g69zk"
Jul 30 00:06:18.897757 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:06:18.897636    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-c5cmw\" (UniqueName: \"kubernetes.io/projected/7e1181b5-9505-4a82-84b2-48086fb162f0-kube-api-access-c5cmw\") pod \"insights-runtime-extractor-g69zk\" (UID: \"7e1181b5-9505-4a82-84b2-48086fb162f0\") " pod="openshift-insights/insights-runtime-extractor-g69zk"
Jul 30 00:06:18.897757 ip-10-0-133-55 kubenswrapper[2560]: E0730 00:06:18.897699    2560 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 30 00:06:18.897757 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:06:18.897717    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/7e1181b5-9505-4a82-84b2-48086fb162f0-data-volume\") pod \"insights-runtime-extractor-g69zk\" (UID: \"7e1181b5-9505-4a82-84b2-48086fb162f0\") " pod="openshift-insights/insights-runtime-extractor-g69zk"
Jul 30 00:06:18.897757 ip-10-0-133-55 kubenswrapper[2560]: E0730 00:06:18.897741    2560 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 30 00:06:18.897974 ip-10-0-133-55 kubenswrapper[2560]: E0730 00:06:18.897762    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/7e1181b5-9505-4a82-84b2-48086fb162f0-kube-rbac-proxy-cm podName:7e1181b5-9505-4a82-84b2-48086fb162f0 nodeName:}" failed. No retries permitted until 2026-07-30 00:06:19.397743671 +0000 UTC m=+266.456960475 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/7e1181b5-9505-4a82-84b2-48086fb162f0-kube-rbac-proxy-cm") pod "insights-runtime-extractor-g69zk" (UID: "7e1181b5-9505-4a82-84b2-48086fb162f0") : configmap "kube-rbac-proxy" not found
Jul 30 00:06:18.897974 ip-10-0-133-55 kubenswrapper[2560]: E0730 00:06:18.897802    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7e1181b5-9505-4a82-84b2-48086fb162f0-insights-runtime-extractor-tls podName:7e1181b5-9505-4a82-84b2-48086fb162f0 nodeName:}" failed. No retries permitted until 2026-07-30 00:06:19.397782704 +0000 UTC m=+266.456999492 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/7e1181b5-9505-4a82-84b2-48086fb162f0-insights-runtime-extractor-tls") pod "insights-runtime-extractor-g69zk" (UID: "7e1181b5-9505-4a82-84b2-48086fb162f0") : secret "insights-runtime-extractor-tls" not found
Jul 30 00:06:18.898048 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:06:18.898029    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/7e1181b5-9505-4a82-84b2-48086fb162f0-data-volume\") pod \"insights-runtime-extractor-g69zk\" (UID: \"7e1181b5-9505-4a82-84b2-48086fb162f0\") " pod="openshift-insights/insights-runtime-extractor-g69zk"
Jul 30 00:06:18.905044 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:06:18.905025    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-c5cmw\" (UniqueName: \"kubernetes.io/projected/7e1181b5-9505-4a82-84b2-48086fb162f0-kube-api-access-c5cmw\") pod \"insights-runtime-extractor-g69zk\" (UID: \"7e1181b5-9505-4a82-84b2-48086fb162f0\") " pod="openshift-insights/insights-runtime-extractor-g69zk"
Jul 30 00:06:19.127437 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:06:19.127410    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-kchgc_324341b7-120c-4f8b-9ddd-e28b9a40ce9e/console-operator/0.log"
Jul 30 00:06:19.127849 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:06:19.127447    2560 generic.go:356] "Generic (PLEG): container finished" podID="324341b7-120c-4f8b-9ddd-e28b9a40ce9e" containerID="03a384e92d2efbc35edab17a0f078fffcadfb03507c21481e9fe40aebcf32796" exitCode=255
Jul 30 00:06:19.127849 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:06:19.127534    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-584dcb6b54-kchgc" event={"ID":"324341b7-120c-4f8b-9ddd-e28b9a40ce9e","Type":"ContainerDied","Data":"03a384e92d2efbc35edab17a0f078fffcadfb03507c21481e9fe40aebcf32796"}
Jul 30 00:06:19.127849 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:06:19.127718    2560 scope.go:117] "RemoveContainer" containerID="03a384e92d2efbc35edab17a0f078fffcadfb03507c21481e9fe40aebcf32796"
Jul 30 00:06:19.402387 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:06:19.402351    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/7e1181b5-9505-4a82-84b2-48086fb162f0-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-g69zk\" (UID: \"7e1181b5-9505-4a82-84b2-48086fb162f0\") " pod="openshift-insights/insights-runtime-extractor-g69zk"
Jul 30 00:06:19.402541 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:06:19.402421    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/7e1181b5-9505-4a82-84b2-48086fb162f0-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-g69zk\" (UID: \"7e1181b5-9505-4a82-84b2-48086fb162f0\") " pod="openshift-insights/insights-runtime-extractor-g69zk"
Jul 30 00:06:19.402541 ip-10-0-133-55 kubenswrapper[2560]: E0730 00:06:19.402451    2560 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 30 00:06:19.402541 ip-10-0-133-55 kubenswrapper[2560]: E0730 00:06:19.402503    2560 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 30 00:06:19.402541 ip-10-0-133-55 kubenswrapper[2560]: E0730 00:06:19.402520    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/7e1181b5-9505-4a82-84b2-48086fb162f0-kube-rbac-proxy-cm podName:7e1181b5-9505-4a82-84b2-48086fb162f0 nodeName:}" failed. No retries permitted until 2026-07-30 00:06:20.402502753 +0000 UTC m=+267.461719536 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/7e1181b5-9505-4a82-84b2-48086fb162f0-kube-rbac-proxy-cm") pod "insights-runtime-extractor-g69zk" (UID: "7e1181b5-9505-4a82-84b2-48086fb162f0") : configmap "kube-rbac-proxy" not found
Jul 30 00:06:19.402766 ip-10-0-133-55 kubenswrapper[2560]: E0730 00:06:19.402548    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7e1181b5-9505-4a82-84b2-48086fb162f0-insights-runtime-extractor-tls podName:7e1181b5-9505-4a82-84b2-48086fb162f0 nodeName:}" failed. No retries permitted until 2026-07-30 00:06:20.402536486 +0000 UTC m=+267.461753268 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/7e1181b5-9505-4a82-84b2-48086fb162f0-insights-runtime-extractor-tls") pod "insights-runtime-extractor-g69zk" (UID: "7e1181b5-9505-4a82-84b2-48086fb162f0") : secret "insights-runtime-extractor-tls" not found
Jul 30 00:06:20.133276 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:06:20.133251    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-kchgc_324341b7-120c-4f8b-9ddd-e28b9a40ce9e/console-operator/1.log"
Jul 30 00:06:20.133706 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:06:20.133624    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-kchgc_324341b7-120c-4f8b-9ddd-e28b9a40ce9e/console-operator/0.log"
Jul 30 00:06:20.133706 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:06:20.133658    2560 generic.go:356] "Generic (PLEG): container finished" podID="324341b7-120c-4f8b-9ddd-e28b9a40ce9e" containerID="0cb30aab5cb71a28691f8e36ffde231cef06b4d8a6efebbb3e82294efb317ce1" exitCode=255
Jul 30 00:06:20.133774 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:06:20.133706    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-584dcb6b54-kchgc" event={"ID":"324341b7-120c-4f8b-9ddd-e28b9a40ce9e","Type":"ContainerDied","Data":"0cb30aab5cb71a28691f8e36ffde231cef06b4d8a6efebbb3e82294efb317ce1"}
Jul 30 00:06:20.133774 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:06:20.133762    2560 scope.go:117] "RemoveContainer" containerID="03a384e92d2efbc35edab17a0f078fffcadfb03507c21481e9fe40aebcf32796"
Jul 30 00:06:20.133975 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:06:20.133957    2560 scope.go:117] "RemoveContainer" containerID="0cb30aab5cb71a28691f8e36ffde231cef06b4d8a6efebbb3e82294efb317ce1"
Jul 30 00:06:20.134153 ip-10-0-133-55 kubenswrapper[2560]: E0730 00:06:20.134135    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-584dcb6b54-kchgc_openshift-console-operator(324341b7-120c-4f8b-9ddd-e28b9a40ce9e)\"" pod="openshift-console-operator/console-operator-584dcb6b54-kchgc" podUID="324341b7-120c-4f8b-9ddd-e28b9a40ce9e"
Jul 30 00:06:20.411137 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:06:20.411036    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/7e1181b5-9505-4a82-84b2-48086fb162f0-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-g69zk\" (UID: \"7e1181b5-9505-4a82-84b2-48086fb162f0\") " pod="openshift-insights/insights-runtime-extractor-g69zk"
Jul 30 00:06:20.411294 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:06:20.411141    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/7e1181b5-9505-4a82-84b2-48086fb162f0-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-g69zk\" (UID: \"7e1181b5-9505-4a82-84b2-48086fb162f0\") " pod="openshift-insights/insights-runtime-extractor-g69zk"
Jul 30 00:06:20.411294 ip-10-0-133-55 kubenswrapper[2560]: E0730 00:06:20.411191    2560 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 30 00:06:20.411294 ip-10-0-133-55 kubenswrapper[2560]: E0730 00:06:20.411249    2560 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 30 00:06:20.411294 ip-10-0-133-55 kubenswrapper[2560]: E0730 00:06:20.411272    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7e1181b5-9505-4a82-84b2-48086fb162f0-insights-runtime-extractor-tls podName:7e1181b5-9505-4a82-84b2-48086fb162f0 nodeName:}" failed. No retries permitted until 2026-07-30 00:06:22.411252536 +0000 UTC m=+269.470469339 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/7e1181b5-9505-4a82-84b2-48086fb162f0-insights-runtime-extractor-tls") pod "insights-runtime-extractor-g69zk" (UID: "7e1181b5-9505-4a82-84b2-48086fb162f0") : secret "insights-runtime-extractor-tls" not found
Jul 30 00:06:20.411294 ip-10-0-133-55 kubenswrapper[2560]: E0730 00:06:20.411289    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/7e1181b5-9505-4a82-84b2-48086fb162f0-kube-rbac-proxy-cm podName:7e1181b5-9505-4a82-84b2-48086fb162f0 nodeName:}" failed. No retries permitted until 2026-07-30 00:06:22.41127892 +0000 UTC m=+269.470495702 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/7e1181b5-9505-4a82-84b2-48086fb162f0-kube-rbac-proxy-cm") pod "insights-runtime-extractor-g69zk" (UID: "7e1181b5-9505-4a82-84b2-48086fb162f0") : configmap "kube-rbac-proxy" not found
Jul 30 00:06:20.532632 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:06:20.532568    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-5ffvl_4f585163-3e80-4055-bfdd-17d37e755a71/dns-node-resolver/0.log"
Jul 30 00:06:21.131916 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:06:21.131885    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_image-pruner-29756160-vhqfx_04c8ee63-4c22-45a4-ac5a-0321b09d3dd1/image-pruner/0.log"
Jul 30 00:06:21.137406 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:06:21.137384    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-kchgc_324341b7-120c-4f8b-9ddd-e28b9a40ce9e/console-operator/1.log"
Jul 30 00:06:21.137774 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:06:21.137691    2560 scope.go:117] "RemoveContainer" containerID="0cb30aab5cb71a28691f8e36ffde231cef06b4d8a6efebbb3e82294efb317ce1"
Jul 30 00:06:21.137850 ip-10-0-133-55 kubenswrapper[2560]: E0730 00:06:21.137831    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-584dcb6b54-kchgc_openshift-console-operator(324341b7-120c-4f8b-9ddd-e28b9a40ce9e)\"" pod="openshift-console-operator/console-operator-584dcb6b54-kchgc" podUID="324341b7-120c-4f8b-9ddd-e28b9a40ce9e"
Jul 30 00:06:21.240482 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:06:21.240452    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-service-ca/service-ca-658d7b7c78-w97jb"]
Jul 30 00:06:21.244625 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:06:21.244609    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-658d7b7c78-w97jb"
Jul 30 00:06:21.246844 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:06:21.246823    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"kube-root-ca.crt\""
Jul 30 00:06:21.247106 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:06:21.247090    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"openshift-service-ca.crt\""
Jul 30 00:06:21.247182 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:06:21.247112    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"signing-cabundle\""
Jul 30 00:06:21.247182 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:06:21.247114    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"service-ca-dockercfg-qjcrh\""
Jul 30 00:06:21.247289 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:06:21.247214    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"signing-key\""
Jul 30 00:06:21.249688 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:06:21.249666    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-658d7b7c78-w97jb"]
Jul 30 00:06:21.318225 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:06:21.318193    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/2ed97f59-0fc0-4e82-a5ec-7bfddab59a0c-signing-key\") pod \"service-ca-658d7b7c78-w97jb\" (UID: \"2ed97f59-0fc0-4e82-a5ec-7bfddab59a0c\") " pod="openshift-service-ca/service-ca-658d7b7c78-w97jb"
Jul 30 00:06:21.318387 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:06:21.318229    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/2ed97f59-0fc0-4e82-a5ec-7bfddab59a0c-signing-cabundle\") pod \"service-ca-658d7b7c78-w97jb\" (UID: \"2ed97f59-0fc0-4e82-a5ec-7bfddab59a0c\") " pod="openshift-service-ca/service-ca-658d7b7c78-w97jb"
Jul 30 00:06:21.318387 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:06:21.318331    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-k58v2\" (UniqueName: \"kubernetes.io/projected/2ed97f59-0fc0-4e82-a5ec-7bfddab59a0c-kube-api-access-k58v2\") pod \"service-ca-658d7b7c78-w97jb\" (UID: \"2ed97f59-0fc0-4e82-a5ec-7bfddab59a0c\") " pod="openshift-service-ca/service-ca-658d7b7c78-w97jb"
Jul 30 00:06:21.367582 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:06:21.367548    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator/migrator-6865c9967-7lcmw"]
Jul 30 00:06:21.370623 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:06:21.370601    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-6865c9967-7lcmw"
Jul 30 00:06:21.372905 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:06:21.372888    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-storage-version-migrator-sa-dockercfg-fknrd\""
Jul 30 00:06:21.372967 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:06:21.372875    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"openshift-service-ca.crt\""
Jul 30 00:06:21.373010 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:06:21.372895    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-root-ca.crt\""
Jul 30 00:06:21.379750 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:06:21.379731    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-6865c9967-7lcmw"]
Jul 30 00:06:21.419547 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:06:21.419499    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/2ed97f59-0fc0-4e82-a5ec-7bfddab59a0c-signing-key\") pod \"service-ca-658d7b7c78-w97jb\" (UID: \"2ed97f59-0fc0-4e82-a5ec-7bfddab59a0c\") " pod="openshift-service-ca/service-ca-658d7b7c78-w97jb"
Jul 30 00:06:21.419547 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:06:21.419531    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/2ed97f59-0fc0-4e82-a5ec-7bfddab59a0c-signing-cabundle\") pod \"service-ca-658d7b7c78-w97jb\" (UID: \"2ed97f59-0fc0-4e82-a5ec-7bfddab59a0c\") " pod="openshift-service-ca/service-ca-658d7b7c78-w97jb"
Jul 30 00:06:21.419678 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:06:21.419655    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-k58v2\" (UniqueName: \"kubernetes.io/projected/2ed97f59-0fc0-4e82-a5ec-7bfddab59a0c-kube-api-access-k58v2\") pod \"service-ca-658d7b7c78-w97jb\" (UID: \"2ed97f59-0fc0-4e82-a5ec-7bfddab59a0c\") " pod="openshift-service-ca/service-ca-658d7b7c78-w97jb"
Jul 30 00:06:21.419719 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:06:21.419692    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qlmwf\" (UniqueName: \"kubernetes.io/projected/2a3fd37f-be73-45ca-816c-2a4204134fbb-kube-api-access-qlmwf\") pod \"migrator-6865c9967-7lcmw\" (UID: \"2a3fd37f-be73-45ca-816c-2a4204134fbb\") " pod="openshift-kube-storage-version-migrator/migrator-6865c9967-7lcmw"
Jul 30 00:06:21.420255 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:06:21.420238    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/2ed97f59-0fc0-4e82-a5ec-7bfddab59a0c-signing-cabundle\") pod \"service-ca-658d7b7c78-w97jb\" (UID: \"2ed97f59-0fc0-4e82-a5ec-7bfddab59a0c\") " pod="openshift-service-ca/service-ca-658d7b7c78-w97jb"
Jul 30 00:06:21.421757 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:06:21.421740    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/2ed97f59-0fc0-4e82-a5ec-7bfddab59a0c-signing-key\") pod \"service-ca-658d7b7c78-w97jb\" (UID: \"2ed97f59-0fc0-4e82-a5ec-7bfddab59a0c\") " pod="openshift-service-ca/service-ca-658d7b7c78-w97jb"
Jul 30 00:06:21.427522 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:06:21.427502    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-k58v2\" (UniqueName: \"kubernetes.io/projected/2ed97f59-0fc0-4e82-a5ec-7bfddab59a0c-kube-api-access-k58v2\") pod \"service-ca-658d7b7c78-w97jb\" (UID: \"2ed97f59-0fc0-4e82-a5ec-7bfddab59a0c\") " pod="openshift-service-ca/service-ca-658d7b7c78-w97jb"
Jul 30 00:06:21.520230 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:06:21.520193    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qlmwf\" (UniqueName: \"kubernetes.io/projected/2a3fd37f-be73-45ca-816c-2a4204134fbb-kube-api-access-qlmwf\") pod \"migrator-6865c9967-7lcmw\" (UID: \"2a3fd37f-be73-45ca-816c-2a4204134fbb\") " pod="openshift-kube-storage-version-migrator/migrator-6865c9967-7lcmw"
Jul 30 00:06:21.527304 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:06:21.527283    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qlmwf\" (UniqueName: \"kubernetes.io/projected/2a3fd37f-be73-45ca-816c-2a4204134fbb-kube-api-access-qlmwf\") pod \"migrator-6865c9967-7lcmw\" (UID: \"2a3fd37f-be73-45ca-816c-2a4204134fbb\") " pod="openshift-kube-storage-version-migrator/migrator-6865c9967-7lcmw"
Jul 30 00:06:21.554165 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:06:21.554135    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-658d7b7c78-w97jb"
Jul 30 00:06:21.672802 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:06:21.672728    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-658d7b7c78-w97jb"]
Jul 30 00:06:21.675699 ip-10-0-133-55 kubenswrapper[2560]: W0730 00:06:21.675675    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2ed97f59_0fc0_4e82_a5ec_7bfddab59a0c.slice/crio-38e37f1e4b4434cd83af43363bc97d888a97c3b08a68ba70192d2f01dfd5690d WatchSource:0}: Error finding container 38e37f1e4b4434cd83af43363bc97d888a97c3b08a68ba70192d2f01dfd5690d: Status 404 returned error can't find the container with id 38e37f1e4b4434cd83af43363bc97d888a97c3b08a68ba70192d2f01dfd5690d
Jul 30 00:06:21.679231 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:06:21.679137    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-6865c9967-7lcmw"
Jul 30 00:06:21.798709 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:06:21.798682    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-6865c9967-7lcmw"]
Jul 30 00:06:21.801196 ip-10-0-133-55 kubenswrapper[2560]: W0730 00:06:21.801176    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2a3fd37f_be73_45ca_816c_2a4204134fbb.slice/crio-77a5c36a5d6bf98ee8854d84c29047eb61d2578ecd7c5ddadd9a20525ff612db WatchSource:0}: Error finding container 77a5c36a5d6bf98ee8854d84c29047eb61d2578ecd7c5ddadd9a20525ff612db: Status 404 returned error can't find the container with id 77a5c36a5d6bf98ee8854d84c29047eb61d2578ecd7c5ddadd9a20525ff612db
Jul 30 00:06:21.932760 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:06:21.932685    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-7vc9d_274292b8-556c-44ad-b462-c1ea04a30abd/node-ca/0.log"
Jul 30 00:06:22.141540 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:06:22.141509    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-6865c9967-7lcmw" event={"ID":"2a3fd37f-be73-45ca-816c-2a4204134fbb","Type":"ContainerStarted","Data":"77a5c36a5d6bf98ee8854d84c29047eb61d2578ecd7c5ddadd9a20525ff612db"}
Jul 30 00:06:22.142567 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:06:22.142546    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-658d7b7c78-w97jb" event={"ID":"2ed97f59-0fc0-4e82-a5ec-7bfddab59a0c","Type":"ContainerStarted","Data":"38e37f1e4b4434cd83af43363bc97d888a97c3b08a68ba70192d2f01dfd5690d"}
Jul 30 00:06:22.426933 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:06:22.426898    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/7e1181b5-9505-4a82-84b2-48086fb162f0-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-g69zk\" (UID: \"7e1181b5-9505-4a82-84b2-48086fb162f0\") " pod="openshift-insights/insights-runtime-extractor-g69zk"
Jul 30 00:06:22.427091 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:06:22.427017    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/7e1181b5-9505-4a82-84b2-48086fb162f0-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-g69zk\" (UID: \"7e1181b5-9505-4a82-84b2-48086fb162f0\") " pod="openshift-insights/insights-runtime-extractor-g69zk"
Jul 30 00:06:22.427091 ip-10-0-133-55 kubenswrapper[2560]: E0730 00:06:22.427039    2560 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 30 00:06:22.427209 ip-10-0-133-55 kubenswrapper[2560]: E0730 00:06:22.427120    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/7e1181b5-9505-4a82-84b2-48086fb162f0-kube-rbac-proxy-cm podName:7e1181b5-9505-4a82-84b2-48086fb162f0 nodeName:}" failed. No retries permitted until 2026-07-30 00:06:26.427097625 +0000 UTC m=+273.486314409 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/7e1181b5-9505-4a82-84b2-48086fb162f0-kube-rbac-proxy-cm") pod "insights-runtime-extractor-g69zk" (UID: "7e1181b5-9505-4a82-84b2-48086fb162f0") : configmap "kube-rbac-proxy" not found
Jul 30 00:06:22.427209 ip-10-0-133-55 kubenswrapper[2560]: E0730 00:06:22.427182    2560 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 30 00:06:22.427349 ip-10-0-133-55 kubenswrapper[2560]: E0730 00:06:22.427241    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7e1181b5-9505-4a82-84b2-48086fb162f0-insights-runtime-extractor-tls podName:7e1181b5-9505-4a82-84b2-48086fb162f0 nodeName:}" failed. No retries permitted until 2026-07-30 00:06:26.427224646 +0000 UTC m=+273.486441431 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/7e1181b5-9505-4a82-84b2-48086fb162f0-insights-runtime-extractor-tls") pod "insights-runtime-extractor-g69zk" (UID: "7e1181b5-9505-4a82-84b2-48086fb162f0") : secret "insights-runtime-extractor-tls" not found
Jul 30 00:06:22.932388 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:06:22.932356    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-zprkl_e4926e4b-1b99-4889-afe0-459d8080ff96/serve-healthcheck-canary/0.log"
Jul 30 00:06:24.150354 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:06:24.150299    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-658d7b7c78-w97jb" event={"ID":"2ed97f59-0fc0-4e82-a5ec-7bfddab59a0c","Type":"ContainerStarted","Data":"92336f9b7ac088a72f5b325ad25f080fbd251fcfc3e72e5c85b14a5414447251"}
Jul 30 00:06:24.152110 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:06:24.152085    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-6865c9967-7lcmw" event={"ID":"2a3fd37f-be73-45ca-816c-2a4204134fbb","Type":"ContainerStarted","Data":"d5899f2a85a3e5616ad6e18e3daa4e05784705883f950a563b14327a9de67d38"}
Jul 30 00:06:24.152254 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:06:24.152126    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-6865c9967-7lcmw" event={"ID":"2a3fd37f-be73-45ca-816c-2a4204134fbb","Type":"ContainerStarted","Data":"831d61d6bcfe3eef8e1bf149ee9c9ffe594fc12d995146b46f9360eba77f7a89"}
Jul 30 00:06:24.164233 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:06:24.164183    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-service-ca/service-ca-658d7b7c78-w97jb" podStartSLOduration=0.99515267 podStartE2EDuration="3.164166044s" totalImagesPullingTime="2.169013374s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-30 00:06:21 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 00:06:24.164150493 +0000 UTC m=+271.223367301" watchObservedRunningTime="2026-07-30 00:06:24.164166044 +0000 UTC m=+271.223382851"
Jul 30 00:06:24.177371 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:06:24.177329    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator/migrator-6865c9967-7lcmw" podStartSLOduration=1.134499486 podStartE2EDuration="3.177296985s" totalImagesPullingTime="2.042797499s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-30 00:06:21 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 00:06:24.177178335 +0000 UTC m=+271.236395139" watchObservedRunningTime="2026-07-30 00:06:24.177296985 +0000 UTC m=+271.236513776"
Jul 30 00:06:25.404792 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:06:25.404756    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-584dcb6b54-kchgc"
Jul 30 00:06:25.405191 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:06:25.404808    2560 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="openshift-console-operator/console-operator-584dcb6b54-kchgc"
Jul 30 00:06:25.405191 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:06:25.405128    2560 scope.go:117] "RemoveContainer" containerID="0cb30aab5cb71a28691f8e36ffde231cef06b4d8a6efebbb3e82294efb317ce1"
Jul 30 00:06:25.405336 ip-10-0-133-55 kubenswrapper[2560]: E0730 00:06:25.405293    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-584dcb6b54-kchgc_openshift-console-operator(324341b7-120c-4f8b-9ddd-e28b9a40ce9e)\"" pod="openshift-console-operator/console-operator-584dcb6b54-kchgc" podUID="324341b7-120c-4f8b-9ddd-e28b9a40ce9e"
Jul 30 00:06:26.463527 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:06:26.463487    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/7e1181b5-9505-4a82-84b2-48086fb162f0-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-g69zk\" (UID: \"7e1181b5-9505-4a82-84b2-48086fb162f0\") " pod="openshift-insights/insights-runtime-extractor-g69zk"
Jul 30 00:06:26.464031 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:06:26.463587    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/7e1181b5-9505-4a82-84b2-48086fb162f0-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-g69zk\" (UID: \"7e1181b5-9505-4a82-84b2-48086fb162f0\") " pod="openshift-insights/insights-runtime-extractor-g69zk"
Jul 30 00:06:26.464031 ip-10-0-133-55 kubenswrapper[2560]: E0730 00:06:26.463731    2560 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 30 00:06:26.464031 ip-10-0-133-55 kubenswrapper[2560]: E0730 00:06:26.463799    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7e1181b5-9505-4a82-84b2-48086fb162f0-insights-runtime-extractor-tls podName:7e1181b5-9505-4a82-84b2-48086fb162f0 nodeName:}" failed. No retries permitted until 2026-07-30 00:06:34.463779755 +0000 UTC m=+281.522996540 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/7e1181b5-9505-4a82-84b2-48086fb162f0-insights-runtime-extractor-tls") pod "insights-runtime-extractor-g69zk" (UID: "7e1181b5-9505-4a82-84b2-48086fb162f0") : secret "insights-runtime-extractor-tls" not found
Jul 30 00:06:26.464189 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:06:26.464094    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/7e1181b5-9505-4a82-84b2-48086fb162f0-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-g69zk\" (UID: \"7e1181b5-9505-4a82-84b2-48086fb162f0\") " pod="openshift-insights/insights-runtime-extractor-g69zk"
Jul 30 00:06:33.866515 ip-10-0-133-55 kubenswrapper[2560]: E0730 00:06:33.866476    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[registry-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-image-registry/image-registry-777dddd7cd-bw4wt" podUID="29e3c7fe-e0a9-4098-8415-4c2f716a92eb"
Jul 30 00:06:33.866515 ip-10-0-133-55 kubenswrapper[2560]: E0730 00:06:33.866507    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[networking-console-plugin-cert], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-network-console/networking-console-plugin-74c9f884b7-cvf92" podUID="fc66861e-ab18-4d71-bed7-1fa000323b4a"
Jul 30 00:06:33.866902 ip-10-0-133-55 kubenswrapper[2560]: E0730 00:06:33.866507    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-9q6wf" podUID="511107bb-85d6-4f7e-9598-0f4aac95ba34"
Jul 30 00:06:34.185695 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:06:34.185671    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-9q6wf"
Jul 30 00:06:34.185842 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:06:34.185669    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-777dddd7cd-bw4wt"
Jul 30 00:06:34.185842 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:06:34.185671    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-74c9f884b7-cvf92"
Jul 30 00:06:34.531592 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:06:34.531488    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/7e1181b5-9505-4a82-84b2-48086fb162f0-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-g69zk\" (UID: \"7e1181b5-9505-4a82-84b2-48086fb162f0\") " pod="openshift-insights/insights-runtime-extractor-g69zk"
Jul 30 00:06:34.531757 ip-10-0-133-55 kubenswrapper[2560]: E0730 00:06:34.531631    2560 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 30 00:06:34.531757 ip-10-0-133-55 kubenswrapper[2560]: E0730 00:06:34.531701    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7e1181b5-9505-4a82-84b2-48086fb162f0-insights-runtime-extractor-tls podName:7e1181b5-9505-4a82-84b2-48086fb162f0 nodeName:}" failed. No retries permitted until 2026-07-30 00:06:50.531684317 +0000 UTC m=+297.590901099 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/7e1181b5-9505-4a82-84b2-48086fb162f0-insights-runtime-extractor-tls") pod "insights-runtime-extractor-g69zk" (UID: "7e1181b5-9505-4a82-84b2-48086fb162f0") : secret "insights-runtime-extractor-tls" not found
Jul 30 00:06:37.353147 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:06:37.353113    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/511107bb-85d6-4f7e-9598-0f4aac95ba34-metrics-tls\") pod \"dns-default-9q6wf\" (UID: \"511107bb-85d6-4f7e-9598-0f4aac95ba34\") " pod="openshift-dns/dns-default-9q6wf"
Jul 30 00:06:37.353604 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:06:37.353196    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/29e3c7fe-e0a9-4098-8415-4c2f716a92eb-registry-tls\") pod \"image-registry-777dddd7cd-bw4wt\" (UID: \"29e3c7fe-e0a9-4098-8415-4c2f716a92eb\") " pod="openshift-image-registry/image-registry-777dddd7cd-bw4wt"
Jul 30 00:06:37.353604 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:06:37.353219    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/fc66861e-ab18-4d71-bed7-1fa000323b4a-networking-console-plugin-cert\") pod \"networking-console-plugin-74c9f884b7-cvf92\" (UID: \"fc66861e-ab18-4d71-bed7-1fa000323b4a\") " pod="openshift-network-console/networking-console-plugin-74c9f884b7-cvf92"
Jul 30 00:06:37.355551 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:06:37.355525    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/511107bb-85d6-4f7e-9598-0f4aac95ba34-metrics-tls\") pod \"dns-default-9q6wf\" (UID: \"511107bb-85d6-4f7e-9598-0f4aac95ba34\") " pod="openshift-dns/dns-default-9q6wf"
Jul 30 00:06:37.355668 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:06:37.355533    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/29e3c7fe-e0a9-4098-8415-4c2f716a92eb-registry-tls\") pod \"image-registry-777dddd7cd-bw4wt\" (UID: \"29e3c7fe-e0a9-4098-8415-4c2f716a92eb\") " pod="openshift-image-registry/image-registry-777dddd7cd-bw4wt"
Jul 30 00:06:37.355668 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:06:37.355556    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/fc66861e-ab18-4d71-bed7-1fa000323b4a-networking-console-plugin-cert\") pod \"networking-console-plugin-74c9f884b7-cvf92\" (UID: \"fc66861e-ab18-4d71-bed7-1fa000323b4a\") " pod="openshift-network-console/networking-console-plugin-74c9f884b7-cvf92"
Jul 30 00:06:37.490790 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:06:37.490764    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-nxhcc\""
Jul 30 00:06:37.490790 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:06:37.490788    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-pt2ls\""
Jul 30 00:06:37.491036 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:06:37.490766    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"default-dockercfg-tjpdq\""
Jul 30 00:06:37.497110 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:06:37.497090    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-9q6wf"
Jul 30 00:06:37.497213 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:06:37.497112    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-74c9f884b7-cvf92"
Jul 30 00:06:37.497213 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:06:37.497146    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-777dddd7cd-bw4wt"
Jul 30 00:06:37.639234 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:06:37.639211    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-9q6wf"]
Jul 30 00:06:37.641923 ip-10-0-133-55 kubenswrapper[2560]: W0730 00:06:37.641897    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod511107bb_85d6_4f7e_9598_0f4aac95ba34.slice/crio-6afb31c736d4917f4eacf631c50a2176a738128500fec5f549e4bf7f4ff3c792 WatchSource:0}: Error finding container 6afb31c736d4917f4eacf631c50a2176a738128500fec5f549e4bf7f4ff3c792: Status 404 returned error can't find the container with id 6afb31c736d4917f4eacf631c50a2176a738128500fec5f549e4bf7f4ff3c792
Jul 30 00:06:37.652956 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:06:37.652929    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-74c9f884b7-cvf92"]
Jul 30 00:06:37.656209 ip-10-0-133-55 kubenswrapper[2560]: W0730 00:06:37.656178    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfc66861e_ab18_4d71_bed7_1fa000323b4a.slice/crio-e2f75f075744870326b7e1062821ce3d7459d644e9cbffbfbcf917d0b92e626d WatchSource:0}: Error finding container e2f75f075744870326b7e1062821ce3d7459d644e9cbffbfbcf917d0b92e626d: Status 404 returned error can't find the container with id e2f75f075744870326b7e1062821ce3d7459d644e9cbffbfbcf917d0b92e626d
Jul 30 00:06:37.693630 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:06:37.693598    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-777dddd7cd-bw4wt"]
Jul 30 00:06:37.698163 ip-10-0-133-55 kubenswrapper[2560]: W0730 00:06:37.698142    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod29e3c7fe_e0a9_4098_8415_4c2f716a92eb.slice/crio-f4c6e14200a0b04e51e120758edd5aa9e64e9a2ef6d870f249cf0ca0068a2969 WatchSource:0}: Error finding container f4c6e14200a0b04e51e120758edd5aa9e64e9a2ef6d870f249cf0ca0068a2969: Status 404 returned error can't find the container with id f4c6e14200a0b04e51e120758edd5aa9e64e9a2ef6d870f249cf0ca0068a2969
Jul 30 00:06:38.199358 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:06:38.199304    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-9q6wf" event={"ID":"511107bb-85d6-4f7e-9598-0f4aac95ba34","Type":"ContainerStarted","Data":"6afb31c736d4917f4eacf631c50a2176a738128500fec5f549e4bf7f4ff3c792"}
Jul 30 00:06:38.200602 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:06:38.200579    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-777dddd7cd-bw4wt" event={"ID":"29e3c7fe-e0a9-4098-8415-4c2f716a92eb","Type":"ContainerStarted","Data":"47b5c42e201a0716ba64b178fc8ed15c96a0f45aa64aa72f48ccd3dd273bcef0"}
Jul 30 00:06:38.200710 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:06:38.200618    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-777dddd7cd-bw4wt" event={"ID":"29e3c7fe-e0a9-4098-8415-4c2f716a92eb","Type":"ContainerStarted","Data":"f4c6e14200a0b04e51e120758edd5aa9e64e9a2ef6d870f249cf0ca0068a2969"}
Jul 30 00:06:38.200710 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:06:38.200637    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-777dddd7cd-bw4wt"
Jul 30 00:06:38.201732 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:06:38.201710    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-74c9f884b7-cvf92" event={"ID":"fc66861e-ab18-4d71-bed7-1fa000323b4a","Type":"ContainerStarted","Data":"e2f75f075744870326b7e1062821ce3d7459d644e9cbffbfbcf917d0b92e626d"}
Jul 30 00:06:38.220673 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:06:38.220635    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-777dddd7cd-bw4wt" podStartSLOduration=285.220622145 podStartE2EDuration="4m45.220622145s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-30 00:01:53 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 00:06:38.21888967 +0000 UTC m=+285.278106473" watchObservedRunningTime="2026-07-30 00:06:38.220622145 +0000 UTC m=+285.279838927"
Jul 30 00:06:39.399590 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:06:39.399561    2560 scope.go:117] "RemoveContainer" containerID="0cb30aab5cb71a28691f8e36ffde231cef06b4d8a6efebbb3e82294efb317ce1"
Jul 30 00:06:40.210207 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:06:40.210104    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-74c9f884b7-cvf92" event={"ID":"fc66861e-ab18-4d71-bed7-1fa000323b4a","Type":"ContainerStarted","Data":"5b83c1cd4ae3db79ae618f3024bd21b9e1f936511a8f2d435a0ef9dddc67b9a3"}
Jul 30 00:06:40.212231 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:06:40.212211    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-kchgc_324341b7-120c-4f8b-9ddd-e28b9a40ce9e/console-operator/1.log"
Jul 30 00:06:40.212347 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:06:40.212294    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-584dcb6b54-kchgc" event={"ID":"324341b7-120c-4f8b-9ddd-e28b9a40ce9e","Type":"ContainerStarted","Data":"5a9ff3d2bb07ca779408b9da71c278479663dc74bf38786715b2e224201392bf"}
Jul 30 00:06:40.212617 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:06:40.212594    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-584dcb6b54-kchgc"
Jul 30 00:06:40.214588 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:06:40.214556    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-9q6wf" event={"ID":"511107bb-85d6-4f7e-9598-0f4aac95ba34","Type":"ContainerStarted","Data":"4eab124149def9be4d664728f85e137a41a2be3e6863c0833ad28de7c3f22377"}
Jul 30 00:06:40.219000 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:06:40.218957    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console-operator/console-operator-584dcb6b54-kchgc"
Jul 30 00:06:40.226727 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:06:40.226254    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-console/networking-console-plugin-74c9f884b7-cvf92" podStartSLOduration=260.436372649 podStartE2EDuration="4m22.226236986s" totalImagesPullingTime="1.789864337s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-30 00:02:18 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 00:06:40.225231025 +0000 UTC m=+287.284447830" watchObservedRunningTime="2026-07-30 00:06:40.226236986 +0000 UTC m=+287.285453790"
Jul 30 00:06:40.244484 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:06:40.244383    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console-operator/console-operator-584dcb6b54-kchgc" podStartSLOduration=22.138492537 podStartE2EDuration="25.244364219s" totalImagesPullingTime="3.105871682s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-30 00:06:15 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 00:06:40.24364341 +0000 UTC m=+287.302860214" watchObservedRunningTime="2026-07-30 00:06:40.244364219 +0000 UTC m=+287.303581021"
Jul 30 00:06:41.219563 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:06:41.219526    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-9q6wf" event={"ID":"511107bb-85d6-4f7e-9598-0f4aac95ba34","Type":"ContainerStarted","Data":"6c7b2c32d72857322ea6fe43db10b3d5cbb43de466b72e7ce9e6aa4ba3bb4f4b"}
Jul 30 00:06:41.236474 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:06:41.236409    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-9q6wf" podStartSLOduration=251.763086384 podStartE2EDuration="4m14.236388541s" totalImagesPullingTime="2.473302157s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-30 00:02:27 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 00:06:41.235033521 +0000 UTC m=+288.294250326" watchObservedRunningTime="2026-07-30 00:06:41.236388541 +0000 UTC m=+288.295605347"
Jul 30 00:06:42.223057 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:06:42.223028    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-9q6wf"
Jul 30 00:06:46.400536 ip-10-0-133-55 kubenswrapper[2560]: E0730 00:06:46.400485    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-certs], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-multus/network-metrics-daemon-9g97b" podUID="05dcf00e-2c10-495a-b61b-9221eb8286e5"
Jul 30 00:06:49.000867 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:06:49.000834    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-7b4fbb6948-p47t2"]
Jul 30 00:06:49.006559 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:06:49.006540    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7b4fbb6948-p47t2"
Jul 30 00:06:49.009227 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:06:49.009200    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\""
Jul 30 00:06:49.009341 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:06:49.009204    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\""
Jul 30 00:06:49.009341 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:06:49.009253    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\""
Jul 30 00:06:49.009341 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:06:49.009257    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\""
Jul 30 00:06:49.010471 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:06:49.010454    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\""
Jul 30 00:06:49.010594 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:06:49.010579    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\""
Jul 30 00:06:49.010656 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:06:49.010598    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-nh5wl\""
Jul 30 00:06:49.010656 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:06:49.010621    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\""
Jul 30 00:06:49.014095 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:06:49.014076    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-7b4fbb6948-p47t2"]
Jul 30 00:06:49.148881 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:06:49.148851    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/6b882eab-fcc7-48fb-a729-802af0ba24b5-console-config\") pod \"console-7b4fbb6948-p47t2\" (UID: \"6b882eab-fcc7-48fb-a729-802af0ba24b5\") " pod="openshift-console/console-7b4fbb6948-p47t2"
Jul 30 00:06:49.148881 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:06:49.148882    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/6b882eab-fcc7-48fb-a729-802af0ba24b5-oauth-serving-cert\") pod \"console-7b4fbb6948-p47t2\" (UID: \"6b882eab-fcc7-48fb-a729-802af0ba24b5\") " pod="openshift-console/console-7b4fbb6948-p47t2"
Jul 30 00:06:49.149089 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:06:49.148921    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-r9sh4\" (UniqueName: \"kubernetes.io/projected/6b882eab-fcc7-48fb-a729-802af0ba24b5-kube-api-access-r9sh4\") pod \"console-7b4fbb6948-p47t2\" (UID: \"6b882eab-fcc7-48fb-a729-802af0ba24b5\") " pod="openshift-console/console-7b4fbb6948-p47t2"
Jul 30 00:06:49.149089 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:06:49.148963    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/6b882eab-fcc7-48fb-a729-802af0ba24b5-service-ca\") pod \"console-7b4fbb6948-p47t2\" (UID: \"6b882eab-fcc7-48fb-a729-802af0ba24b5\") " pod="openshift-console/console-7b4fbb6948-p47t2"
Jul 30 00:06:49.149089 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:06:49.148995    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/6b882eab-fcc7-48fb-a729-802af0ba24b5-console-serving-cert\") pod \"console-7b4fbb6948-p47t2\" (UID: \"6b882eab-fcc7-48fb-a729-802af0ba24b5\") " pod="openshift-console/console-7b4fbb6948-p47t2"
Jul 30 00:06:49.149089 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:06:49.149065    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/6b882eab-fcc7-48fb-a729-802af0ba24b5-console-oauth-config\") pod \"console-7b4fbb6948-p47t2\" (UID: \"6b882eab-fcc7-48fb-a729-802af0ba24b5\") " pod="openshift-console/console-7b4fbb6948-p47t2"
Jul 30 00:06:49.250120 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:06:49.250087    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/6b882eab-fcc7-48fb-a729-802af0ba24b5-console-oauth-config\") pod \"console-7b4fbb6948-p47t2\" (UID: \"6b882eab-fcc7-48fb-a729-802af0ba24b5\") " pod="openshift-console/console-7b4fbb6948-p47t2"
Jul 30 00:06:49.250288 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:06:49.250128    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/6b882eab-fcc7-48fb-a729-802af0ba24b5-console-config\") pod \"console-7b4fbb6948-p47t2\" (UID: \"6b882eab-fcc7-48fb-a729-802af0ba24b5\") " pod="openshift-console/console-7b4fbb6948-p47t2"
Jul 30 00:06:49.250288 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:06:49.250151    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/6b882eab-fcc7-48fb-a729-802af0ba24b5-oauth-serving-cert\") pod \"console-7b4fbb6948-p47t2\" (UID: \"6b882eab-fcc7-48fb-a729-802af0ba24b5\") " pod="openshift-console/console-7b4fbb6948-p47t2"
Jul 30 00:06:49.250288 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:06:49.250193    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-r9sh4\" (UniqueName: \"kubernetes.io/projected/6b882eab-fcc7-48fb-a729-802af0ba24b5-kube-api-access-r9sh4\") pod \"console-7b4fbb6948-p47t2\" (UID: \"6b882eab-fcc7-48fb-a729-802af0ba24b5\") " pod="openshift-console/console-7b4fbb6948-p47t2"
Jul 30 00:06:49.250288 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:06:49.250234    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/6b882eab-fcc7-48fb-a729-802af0ba24b5-service-ca\") pod \"console-7b4fbb6948-p47t2\" (UID: \"6b882eab-fcc7-48fb-a729-802af0ba24b5\") " pod="openshift-console/console-7b4fbb6948-p47t2"
Jul 30 00:06:49.250533 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:06:49.250294    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/6b882eab-fcc7-48fb-a729-802af0ba24b5-console-serving-cert\") pod \"console-7b4fbb6948-p47t2\" (UID: \"6b882eab-fcc7-48fb-a729-802af0ba24b5\") " pod="openshift-console/console-7b4fbb6948-p47t2"
Jul 30 00:06:49.250992 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:06:49.250940    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/6b882eab-fcc7-48fb-a729-802af0ba24b5-service-ca\") pod \"console-7b4fbb6948-p47t2\" (UID: \"6b882eab-fcc7-48fb-a729-802af0ba24b5\") " pod="openshift-console/console-7b4fbb6948-p47t2"
Jul 30 00:06:49.250992 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:06:49.250963    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/6b882eab-fcc7-48fb-a729-802af0ba24b5-console-config\") pod \"console-7b4fbb6948-p47t2\" (UID: \"6b882eab-fcc7-48fb-a729-802af0ba24b5\") " pod="openshift-console/console-7b4fbb6948-p47t2"
Jul 30 00:06:49.251102 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:06:49.250991    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/6b882eab-fcc7-48fb-a729-802af0ba24b5-oauth-serving-cert\") pod \"console-7b4fbb6948-p47t2\" (UID: \"6b882eab-fcc7-48fb-a729-802af0ba24b5\") " pod="openshift-console/console-7b4fbb6948-p47t2"
Jul 30 00:06:49.252424 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:06:49.252407    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/6b882eab-fcc7-48fb-a729-802af0ba24b5-console-oauth-config\") pod \"console-7b4fbb6948-p47t2\" (UID: \"6b882eab-fcc7-48fb-a729-802af0ba24b5\") " pod="openshift-console/console-7b4fbb6948-p47t2"
Jul 30 00:06:49.252498 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:06:49.252482    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/6b882eab-fcc7-48fb-a729-802af0ba24b5-console-serving-cert\") pod \"console-7b4fbb6948-p47t2\" (UID: \"6b882eab-fcc7-48fb-a729-802af0ba24b5\") " pod="openshift-console/console-7b4fbb6948-p47t2"
Jul 30 00:06:49.259018 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:06:49.258998    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-r9sh4\" (UniqueName: \"kubernetes.io/projected/6b882eab-fcc7-48fb-a729-802af0ba24b5-kube-api-access-r9sh4\") pod \"console-7b4fbb6948-p47t2\" (UID: \"6b882eab-fcc7-48fb-a729-802af0ba24b5\") " pod="openshift-console/console-7b4fbb6948-p47t2"
Jul 30 00:06:49.317004 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:06:49.316983    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7b4fbb6948-p47t2"
Jul 30 00:06:49.440378 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:06:49.440342    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-7b4fbb6948-p47t2"]
Jul 30 00:06:49.442633 ip-10-0-133-55 kubenswrapper[2560]: W0730 00:06:49.442606    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6b882eab_fcc7_48fb_a729_802af0ba24b5.slice/crio-f8c3bc28d46f77a272bdea1eca8030cb382b6cdff179b863fb9635e9693b4150 WatchSource:0}: Error finding container f8c3bc28d46f77a272bdea1eca8030cb382b6cdff179b863fb9635e9693b4150: Status 404 returned error can't find the container with id f8c3bc28d46f77a272bdea1eca8030cb382b6cdff179b863fb9635e9693b4150
Jul 30 00:06:50.010971 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:06:50.010939    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-7f8d78f54b-4bmmq"]
Jul 30 00:06:50.016579 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:06:50.016559    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-7f8d78f54b-4bmmq"
Jul 30 00:06:50.019167 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:06:50.019144    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-tls\""
Jul 30 00:06:50.019400 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:06:50.019360    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-dockercfg-d9rbz\""
Jul 30 00:06:50.021415 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:06:50.021391    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-7f8d78f54b-4bmmq"]
Jul 30 00:06:50.157750 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:06:50.157711    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/a75f3d93-0358-4a87-bf82-d632101db00e-tls-certificates\") pod \"prometheus-operator-admission-webhook-7f8d78f54b-4bmmq\" (UID: \"a75f3d93-0358-4a87-bf82-d632101db00e\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-7f8d78f54b-4bmmq"
Jul 30 00:06:50.250117 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:06:50.250077    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7b4fbb6948-p47t2" event={"ID":"6b882eab-fcc7-48fb-a729-802af0ba24b5","Type":"ContainerStarted","Data":"f8c3bc28d46f77a272bdea1eca8030cb382b6cdff179b863fb9635e9693b4150"}
Jul 30 00:06:50.258582 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:06:50.258504    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/a75f3d93-0358-4a87-bf82-d632101db00e-tls-certificates\") pod \"prometheus-operator-admission-webhook-7f8d78f54b-4bmmq\" (UID: \"a75f3d93-0358-4a87-bf82-d632101db00e\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-7f8d78f54b-4bmmq"
Jul 30 00:06:50.261489 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:06:50.261429    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/a75f3d93-0358-4a87-bf82-d632101db00e-tls-certificates\") pod \"prometheus-operator-admission-webhook-7f8d78f54b-4bmmq\" (UID: \"a75f3d93-0358-4a87-bf82-d632101db00e\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-7f8d78f54b-4bmmq"
Jul 30 00:06:50.326641 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:06:50.326478    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-7f8d78f54b-4bmmq"
Jul 30 00:06:50.474389 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:06:50.474304    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-7f8d78f54b-4bmmq"]
Jul 30 00:06:50.477166 ip-10-0-133-55 kubenswrapper[2560]: W0730 00:06:50.477137    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda75f3d93_0358_4a87_bf82_d632101db00e.slice/crio-f97f05e36ff546a5ca8dd05226487a709e3e37ea4b013889d317df269b2062ee WatchSource:0}: Error finding container f97f05e36ff546a5ca8dd05226487a709e3e37ea4b013889d317df269b2062ee: Status 404 returned error can't find the container with id f97f05e36ff546a5ca8dd05226487a709e3e37ea4b013889d317df269b2062ee
Jul 30 00:06:50.561928 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:06:50.561847    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/7e1181b5-9505-4a82-84b2-48086fb162f0-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-g69zk\" (UID: \"7e1181b5-9505-4a82-84b2-48086fb162f0\") " pod="openshift-insights/insights-runtime-extractor-g69zk"
Jul 30 00:06:50.564672 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:06:50.564619    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/7e1181b5-9505-4a82-84b2-48086fb162f0-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-g69zk\" (UID: \"7e1181b5-9505-4a82-84b2-48086fb162f0\") " pod="openshift-insights/insights-runtime-extractor-g69zk"
Jul 30 00:06:50.612270 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:06:50.612233    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-g69zk"
Jul 30 00:06:50.772167 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:06:50.772070    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-g69zk"]
Jul 30 00:06:50.777784 ip-10-0-133-55 kubenswrapper[2560]: W0730 00:06:50.777753    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7e1181b5_9505_4a82_84b2_48086fb162f0.slice/crio-f6278eea652eca07f59e967fc235602fd2e8e531bd84bfcf0bade832fedcb647 WatchSource:0}: Error finding container f6278eea652eca07f59e967fc235602fd2e8e531bd84bfcf0bade832fedcb647: Status 404 returned error can't find the container with id f6278eea652eca07f59e967fc235602fd2e8e531bd84bfcf0bade832fedcb647
Jul 30 00:06:51.187200 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:06:51.187159    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-6df644895b-wslwm"]
Jul 30 00:06:51.190766 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:06:51.190741    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6df644895b-wslwm"
Jul 30 00:06:51.200631 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:06:51.200606    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\""
Jul 30 00:06:51.201098 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:06:51.201075    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-6df644895b-wslwm"]
Jul 30 00:06:51.256182 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:06:51.256139    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-g69zk" event={"ID":"7e1181b5-9505-4a82-84b2-48086fb162f0","Type":"ContainerStarted","Data":"f6278eea652eca07f59e967fc235602fd2e8e531bd84bfcf0bade832fedcb647"}
Jul 30 00:06:51.257710 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:06:51.257678    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-7f8d78f54b-4bmmq" event={"ID":"a75f3d93-0358-4a87-bf82-d632101db00e","Type":"ContainerStarted","Data":"f97f05e36ff546a5ca8dd05226487a709e3e37ea4b013889d317df269b2062ee"}
Jul 30 00:06:51.369707 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:06:51.369660    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/86d7c62c-c012-4722-9599-b2d9ff4c73bd-oauth-serving-cert\") pod \"console-6df644895b-wslwm\" (UID: \"86d7c62c-c012-4722-9599-b2d9ff4c73bd\") " pod="openshift-console/console-6df644895b-wslwm"
Jul 30 00:06:51.369707 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:06:51.369710    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/86d7c62c-c012-4722-9599-b2d9ff4c73bd-trusted-ca-bundle\") pod \"console-6df644895b-wslwm\" (UID: \"86d7c62c-c012-4722-9599-b2d9ff4c73bd\") " pod="openshift-console/console-6df644895b-wslwm"
Jul 30 00:06:51.369922 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:06:51.369756    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/86d7c62c-c012-4722-9599-b2d9ff4c73bd-console-config\") pod \"console-6df644895b-wslwm\" (UID: \"86d7c62c-c012-4722-9599-b2d9ff4c73bd\") " pod="openshift-console/console-6df644895b-wslwm"
Jul 30 00:06:51.369922 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:06:51.369789    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/86d7c62c-c012-4722-9599-b2d9ff4c73bd-console-oauth-config\") pod \"console-6df644895b-wslwm\" (UID: \"86d7c62c-c012-4722-9599-b2d9ff4c73bd\") " pod="openshift-console/console-6df644895b-wslwm"
Jul 30 00:06:51.369922 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:06:51.369849    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/86d7c62c-c012-4722-9599-b2d9ff4c73bd-service-ca\") pod \"console-6df644895b-wslwm\" (UID: \"86d7c62c-c012-4722-9599-b2d9ff4c73bd\") " pod="openshift-console/console-6df644895b-wslwm"
Jul 30 00:06:51.369922 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:06:51.369877    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/86d7c62c-c012-4722-9599-b2d9ff4c73bd-console-serving-cert\") pod \"console-6df644895b-wslwm\" (UID: \"86d7c62c-c012-4722-9599-b2d9ff4c73bd\") " pod="openshift-console/console-6df644895b-wslwm"
Jul 30 00:06:51.369922 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:06:51.369904    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dwqtx\" (UniqueName: \"kubernetes.io/projected/86d7c62c-c012-4722-9599-b2d9ff4c73bd-kube-api-access-dwqtx\") pod \"console-6df644895b-wslwm\" (UID: \"86d7c62c-c012-4722-9599-b2d9ff4c73bd\") " pod="openshift-console/console-6df644895b-wslwm"
Jul 30 00:06:51.471123 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:06:51.471044    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/86d7c62c-c012-4722-9599-b2d9ff4c73bd-console-oauth-config\") pod \"console-6df644895b-wslwm\" (UID: \"86d7c62c-c012-4722-9599-b2d9ff4c73bd\") " pod="openshift-console/console-6df644895b-wslwm"
Jul 30 00:06:51.471123 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:06:51.471110    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/86d7c62c-c012-4722-9599-b2d9ff4c73bd-service-ca\") pod \"console-6df644895b-wslwm\" (UID: \"86d7c62c-c012-4722-9599-b2d9ff4c73bd\") " pod="openshift-console/console-6df644895b-wslwm"
Jul 30 00:06:51.471384 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:06:51.471142    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/86d7c62c-c012-4722-9599-b2d9ff4c73bd-console-serving-cert\") pod \"console-6df644895b-wslwm\" (UID: \"86d7c62c-c012-4722-9599-b2d9ff4c73bd\") " pod="openshift-console/console-6df644895b-wslwm"
Jul 30 00:06:51.471384 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:06:51.471171    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dwqtx\" (UniqueName: \"kubernetes.io/projected/86d7c62c-c012-4722-9599-b2d9ff4c73bd-kube-api-access-dwqtx\") pod \"console-6df644895b-wslwm\" (UID: \"86d7c62c-c012-4722-9599-b2d9ff4c73bd\") " pod="openshift-console/console-6df644895b-wslwm"
Jul 30 00:06:51.471384 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:06:51.471205    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/86d7c62c-c012-4722-9599-b2d9ff4c73bd-oauth-serving-cert\") pod \"console-6df644895b-wslwm\" (UID: \"86d7c62c-c012-4722-9599-b2d9ff4c73bd\") " pod="openshift-console/console-6df644895b-wslwm"
Jul 30 00:06:51.471384 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:06:51.471245    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/86d7c62c-c012-4722-9599-b2d9ff4c73bd-trusted-ca-bundle\") pod \"console-6df644895b-wslwm\" (UID: \"86d7c62c-c012-4722-9599-b2d9ff4c73bd\") " pod="openshift-console/console-6df644895b-wslwm"
Jul 30 00:06:51.471384 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:06:51.471290    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/86d7c62c-c012-4722-9599-b2d9ff4c73bd-console-config\") pod \"console-6df644895b-wslwm\" (UID: \"86d7c62c-c012-4722-9599-b2d9ff4c73bd\") " pod="openshift-console/console-6df644895b-wslwm"
Jul 30 00:06:51.471976 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:06:51.471951    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/86d7c62c-c012-4722-9599-b2d9ff4c73bd-service-ca\") pod \"console-6df644895b-wslwm\" (UID: \"86d7c62c-c012-4722-9599-b2d9ff4c73bd\") " pod="openshift-console/console-6df644895b-wslwm"
Jul 30 00:06:51.472072 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:06:51.472027    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/86d7c62c-c012-4722-9599-b2d9ff4c73bd-oauth-serving-cert\") pod \"console-6df644895b-wslwm\" (UID: \"86d7c62c-c012-4722-9599-b2d9ff4c73bd\") " pod="openshift-console/console-6df644895b-wslwm"
Jul 30 00:06:51.472169 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:06:51.472144    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/86d7c62c-c012-4722-9599-b2d9ff4c73bd-console-config\") pod \"console-6df644895b-wslwm\" (UID: \"86d7c62c-c012-4722-9599-b2d9ff4c73bd\") " pod="openshift-console/console-6df644895b-wslwm"
Jul 30 00:06:51.472428 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:06:51.472408    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/86d7c62c-c012-4722-9599-b2d9ff4c73bd-trusted-ca-bundle\") pod \"console-6df644895b-wslwm\" (UID: \"86d7c62c-c012-4722-9599-b2d9ff4c73bd\") " pod="openshift-console/console-6df644895b-wslwm"
Jul 30 00:06:51.474081 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:06:51.474054    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/86d7c62c-c012-4722-9599-b2d9ff4c73bd-console-oauth-config\") pod \"console-6df644895b-wslwm\" (UID: \"86d7c62c-c012-4722-9599-b2d9ff4c73bd\") " pod="openshift-console/console-6df644895b-wslwm"
Jul 30 00:06:51.474284 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:06:51.474251    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/86d7c62c-c012-4722-9599-b2d9ff4c73bd-console-serving-cert\") pod \"console-6df644895b-wslwm\" (UID: \"86d7c62c-c012-4722-9599-b2d9ff4c73bd\") " pod="openshift-console/console-6df644895b-wslwm"
Jul 30 00:06:51.479860 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:06:51.479836    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dwqtx\" (UniqueName: \"kubernetes.io/projected/86d7c62c-c012-4722-9599-b2d9ff4c73bd-kube-api-access-dwqtx\") pod \"console-6df644895b-wslwm\" (UID: \"86d7c62c-c012-4722-9599-b2d9ff4c73bd\") " pod="openshift-console/console-6df644895b-wslwm"
Jul 30 00:06:51.504351 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:06:51.504287    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6df644895b-wslwm"
Jul 30 00:06:51.721010 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:06:51.720914    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-6df644895b-wslwm"]
Jul 30 00:06:52.228327 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:06:52.228279    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-9q6wf"
Jul 30 00:06:52.264442 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:06:52.264405    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-7f8d78f54b-4bmmq" event={"ID":"a75f3d93-0358-4a87-bf82-d632101db00e","Type":"ContainerStarted","Data":"c15ebce5201e2245196dee6434b9a1bd63f56939717a01959125b60c94dd73c5"}
Jul 30 00:06:52.264712 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:06:52.264692    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-7f8d78f54b-4bmmq"
Jul 30 00:06:52.270277 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:06:52.270253    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-7f8d78f54b-4bmmq"
Jul 30 00:06:52.281182 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:06:52.281120    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-admission-webhook-7f8d78f54b-4bmmq" podStartSLOduration=2.121509096 podStartE2EDuration="3.281100073s" totalImagesPullingTime="1.159590977s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-30 00:06:49 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 00:06:52.27914194 +0000 UTC m=+299.338358746" watchObservedRunningTime="2026-07-30 00:06:52.281100073 +0000 UTC m=+299.340316894"
Jul 30 00:06:52.810090 ip-10-0-133-55 kubenswrapper[2560]: W0730 00:06:52.810053    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod86d7c62c_c012_4722_9599_b2d9ff4c73bd.slice/crio-6398f832b8aba1e95436c7b884578d810e102ceb0c30bae9a6dac5032587f742 WatchSource:0}: Error finding container 6398f832b8aba1e95436c7b884578d810e102ceb0c30bae9a6dac5032587f742: Status 404 returned error can't find the container with id 6398f832b8aba1e95436c7b884578d810e102ceb0c30bae9a6dac5032587f742
Jul 30 00:06:53.275281 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:06:53.275177    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7b4fbb6948-p47t2" event={"ID":"6b882eab-fcc7-48fb-a729-802af0ba24b5","Type":"ContainerStarted","Data":"b2c9b6bde5578f849517e44f24e0a340a3001287100e9a9693ce8e6be71d5830"}
Jul 30 00:06:53.280348 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:06:53.280270    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6df644895b-wslwm" event={"ID":"86d7c62c-c012-4722-9599-b2d9ff4c73bd","Type":"ContainerStarted","Data":"6398f832b8aba1e95436c7b884578d810e102ceb0c30bae9a6dac5032587f742"}
Jul 30 00:06:53.302818 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:06:53.302763    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-7b4fbb6948-p47t2" podStartSLOduration=1.671758689 podStartE2EDuration="5.302744423s" totalImagesPullingTime="3.630985734s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-30 00:06:48 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 00:06:53.301384991 +0000 UTC m=+300.360601797" watchObservedRunningTime="2026-07-30 00:06:53.302744423 +0000 UTC m=+300.361961228"
Jul 30 00:06:53.303009 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:06:53.302828    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-kchgc_324341b7-120c-4f8b-9ddd-e28b9a40ce9e/console-operator/1.log"
Jul 30 00:06:53.304653 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:06:53.304633    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-kchgc_324341b7-120c-4f8b-9ddd-e28b9a40ce9e/console-operator/1.log"
Jul 30 00:06:53.326659 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:06:53.326603    2560 kubelet.go:1648] "Image garbage collection succeeded"
Jul 30 00:06:54.286143 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:06:54.286104    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6df644895b-wslwm" event={"ID":"86d7c62c-c012-4722-9599-b2d9ff4c73bd","Type":"ContainerStarted","Data":"13cff55f13587cabf18b7b14b8071f06f4fe27b0a044982cc288781f0ffc1fe3"}
Jul 30 00:06:54.305426 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:06:54.305347    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-6df644895b-wslwm" podStartSLOduration=1.978552826 podStartE2EDuration="3.30530568s" totalImagesPullingTime="1.326752854s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-30 00:06:51 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 00:06:54.304115353 +0000 UTC m=+301.363332161" watchObservedRunningTime="2026-07-30 00:06:54.30530568 +0000 UTC m=+301.364522491"
Jul 30 00:06:57.502357 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:06:57.502284    2560 patch_prober.go:28] interesting pod/image-registry-777dddd7cd-bw4wt container/registry namespace/openshift-image-registry: Liveness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]}
Jul 30 00:06:57.502842 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:06:57.502378    2560 prober.go:120] "Probe failed" probeType="Liveness" pod="openshift-image-registry/image-registry-777dddd7cd-bw4wt" podUID="29e3c7fe-e0a9-4098-8415-4c2f716a92eb" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 30 00:06:57.648449 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:06:57.648428    2560 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 30 00:06:58.304701 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:06:58.304668    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-g69zk" event={"ID":"7e1181b5-9505-4a82-84b2-48086fb162f0","Type":"ContainerStarted","Data":"2efb01a540ad5e23711d532371f7ab95ba225e27d73bfb7939dfda1ad66659e6"}
Jul 30 00:06:59.212021 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:06:59.211958    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-777dddd7cd-bw4wt"
Jul 30 00:06:59.317993 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:06:59.317916    2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-7b4fbb6948-p47t2"
Jul 30 00:06:59.318170 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:06:59.318022    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-7b4fbb6948-p47t2"
Jul 30 00:06:59.323920 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:06:59.323890    2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-7b4fbb6948-p47t2"
Jul 30 00:06:59.445238 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:06:59.444165    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-wxnvd"]
Jul 30 00:06:59.448252 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:06:59.448183    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-wxnvd"
Jul 30 00:06:59.451079 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:06:59.450675    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\""
Jul 30 00:06:59.451554 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:06:59.451331    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\""
Jul 30 00:06:59.451554 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:06:59.451429    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\""
Jul 30 00:06:59.451554 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:06:59.451433    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\""
Jul 30 00:06:59.451818 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:06:59.451591    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\""
Jul 30 00:06:59.451818 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:06:59.451709    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\""
Jul 30 00:06:59.451818 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:06:59.451774    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-zmzzb\""
Jul 30 00:06:59.537818 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:06:59.537373    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/a132b604-b1d6-4461-a916-d9bea9b5ca63-node-exporter-tls\") pod \"node-exporter-wxnvd\" (UID: \"a132b604-b1d6-4461-a916-d9bea9b5ca63\") " pod="openshift-monitoring/node-exporter-wxnvd"
Jul 30 00:06:59.537818 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:06:59.537415    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/a132b604-b1d6-4461-a916-d9bea9b5ca63-node-exporter-accelerators-collector-config\") pod \"node-exporter-wxnvd\" (UID: \"a132b604-b1d6-4461-a916-d9bea9b5ca63\") " pod="openshift-monitoring/node-exporter-wxnvd"
Jul 30 00:06:59.537818 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:06:59.537444    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/a132b604-b1d6-4461-a916-d9bea9b5ca63-node-exporter-textfile\") pod \"node-exporter-wxnvd\" (UID: \"a132b604-b1d6-4461-a916-d9bea9b5ca63\") " pod="openshift-monitoring/node-exporter-wxnvd"
Jul 30 00:06:59.537818 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:06:59.537469    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xgw7v\" (UniqueName: \"kubernetes.io/projected/a132b604-b1d6-4461-a916-d9bea9b5ca63-kube-api-access-xgw7v\") pod \"node-exporter-wxnvd\" (UID: \"a132b604-b1d6-4461-a916-d9bea9b5ca63\") " pod="openshift-monitoring/node-exporter-wxnvd"
Jul 30 00:06:59.537818 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:06:59.537505    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/a132b604-b1d6-4461-a916-d9bea9b5ca63-root\") pod \"node-exporter-wxnvd\" (UID: \"a132b604-b1d6-4461-a916-d9bea9b5ca63\") " pod="openshift-monitoring/node-exporter-wxnvd"
Jul 30 00:06:59.537818 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:06:59.537532    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/a132b604-b1d6-4461-a916-d9bea9b5ca63-sys\") pod \"node-exporter-wxnvd\" (UID: \"a132b604-b1d6-4461-a916-d9bea9b5ca63\") " pod="openshift-monitoring/node-exporter-wxnvd"
Jul 30 00:06:59.537818 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:06:59.537573    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/a132b604-b1d6-4461-a916-d9bea9b5ca63-metrics-client-ca\") pod \"node-exporter-wxnvd\" (UID: \"a132b604-b1d6-4461-a916-d9bea9b5ca63\") " pod="openshift-monitoring/node-exporter-wxnvd"
Jul 30 00:06:59.537818 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:06:59.537602    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/a132b604-b1d6-4461-a916-d9bea9b5ca63-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-wxnvd\" (UID: \"a132b604-b1d6-4461-a916-d9bea9b5ca63\") " pod="openshift-monitoring/node-exporter-wxnvd"
Jul 30 00:06:59.537818 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:06:59.537656    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/a132b604-b1d6-4461-a916-d9bea9b5ca63-node-exporter-wtmp\") pod \"node-exporter-wxnvd\" (UID: \"a132b604-b1d6-4461-a916-d9bea9b5ca63\") " pod="openshift-monitoring/node-exporter-wxnvd"
Jul 30 00:06:59.638190 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:06:59.638159    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/a132b604-b1d6-4461-a916-d9bea9b5ca63-metrics-client-ca\") pod \"node-exporter-wxnvd\" (UID: \"a132b604-b1d6-4461-a916-d9bea9b5ca63\") " pod="openshift-monitoring/node-exporter-wxnvd"
Jul 30 00:06:59.638404 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:06:59.638199    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/a132b604-b1d6-4461-a916-d9bea9b5ca63-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-wxnvd\" (UID: \"a132b604-b1d6-4461-a916-d9bea9b5ca63\") " pod="openshift-monitoring/node-exporter-wxnvd"
Jul 30 00:06:59.638404 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:06:59.638241    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/a132b604-b1d6-4461-a916-d9bea9b5ca63-node-exporter-wtmp\") pod \"node-exporter-wxnvd\" (UID: \"a132b604-b1d6-4461-a916-d9bea9b5ca63\") " pod="openshift-monitoring/node-exporter-wxnvd"
Jul 30 00:06:59.638404 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:06:59.638289    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/a132b604-b1d6-4461-a916-d9bea9b5ca63-node-exporter-tls\") pod \"node-exporter-wxnvd\" (UID: \"a132b604-b1d6-4461-a916-d9bea9b5ca63\") " pod="openshift-monitoring/node-exporter-wxnvd"
Jul 30 00:06:59.638404 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:06:59.638344    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/a132b604-b1d6-4461-a916-d9bea9b5ca63-node-exporter-accelerators-collector-config\") pod \"node-exporter-wxnvd\" (UID: \"a132b604-b1d6-4461-a916-d9bea9b5ca63\") " pod="openshift-monitoring/node-exporter-wxnvd"
Jul 30 00:06:59.638404 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:06:59.638371    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/a132b604-b1d6-4461-a916-d9bea9b5ca63-node-exporter-textfile\") pod \"node-exporter-wxnvd\" (UID: \"a132b604-b1d6-4461-a916-d9bea9b5ca63\") " pod="openshift-monitoring/node-exporter-wxnvd"
Jul 30 00:06:59.638404 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:06:59.638394    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xgw7v\" (UniqueName: \"kubernetes.io/projected/a132b604-b1d6-4461-a916-d9bea9b5ca63-kube-api-access-xgw7v\") pod \"node-exporter-wxnvd\" (UID: \"a132b604-b1d6-4461-a916-d9bea9b5ca63\") " pod="openshift-monitoring/node-exporter-wxnvd"
Jul 30 00:06:59.638718 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:06:59.638438    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/a132b604-b1d6-4461-a916-d9bea9b5ca63-root\") pod \"node-exporter-wxnvd\" (UID: \"a132b604-b1d6-4461-a916-d9bea9b5ca63\") " pod="openshift-monitoring/node-exporter-wxnvd"
Jul 30 00:06:59.638718 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:06:59.638473    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/a132b604-b1d6-4461-a916-d9bea9b5ca63-sys\") pod \"node-exporter-wxnvd\" (UID: \"a132b604-b1d6-4461-a916-d9bea9b5ca63\") " pod="openshift-monitoring/node-exporter-wxnvd"
Jul 30 00:06:59.638718 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:06:59.638562    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/a132b604-b1d6-4461-a916-d9bea9b5ca63-sys\") pod \"node-exporter-wxnvd\" (UID: \"a132b604-b1d6-4461-a916-d9bea9b5ca63\") " pod="openshift-monitoring/node-exporter-wxnvd"
Jul 30 00:06:59.638718 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:06:59.638686    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/a132b604-b1d6-4461-a916-d9bea9b5ca63-node-exporter-wtmp\") pod \"node-exporter-wxnvd\" (UID: \"a132b604-b1d6-4461-a916-d9bea9b5ca63\") " pod="openshift-monitoring/node-exporter-wxnvd"
Jul 30 00:06:59.638926 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:06:59.638878    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/a132b604-b1d6-4461-a916-d9bea9b5ca63-metrics-client-ca\") pod \"node-exporter-wxnvd\" (UID: \"a132b604-b1d6-4461-a916-d9bea9b5ca63\") " pod="openshift-monitoring/node-exporter-wxnvd"
Jul 30 00:06:59.638982 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:06:59.638937    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/a132b604-b1d6-4461-a916-d9bea9b5ca63-node-exporter-textfile\") pod \"node-exporter-wxnvd\" (UID: \"a132b604-b1d6-4461-a916-d9bea9b5ca63\") " pod="openshift-monitoring/node-exporter-wxnvd"
Jul 30 00:06:59.639029 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:06:59.639005    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/a132b604-b1d6-4461-a916-d9bea9b5ca63-root\") pod \"node-exporter-wxnvd\" (UID: \"a132b604-b1d6-4461-a916-d9bea9b5ca63\") " pod="openshift-monitoring/node-exporter-wxnvd"
Jul 30 00:06:59.661102 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:06:59.650214    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/a132b604-b1d6-4461-a916-d9bea9b5ca63-node-exporter-tls\") pod \"node-exporter-wxnvd\" (UID: \"a132b604-b1d6-4461-a916-d9bea9b5ca63\") " pod="openshift-monitoring/node-exporter-wxnvd"
Jul 30 00:06:59.661102 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:06:59.650699    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/a132b604-b1d6-4461-a916-d9bea9b5ca63-node-exporter-accelerators-collector-config\") pod \"node-exporter-wxnvd\" (UID: \"a132b604-b1d6-4461-a916-d9bea9b5ca63\") " pod="openshift-monitoring/node-exporter-wxnvd"
Jul 30 00:06:59.661102 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:06:59.653028    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/a132b604-b1d6-4461-a916-d9bea9b5ca63-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-wxnvd\" (UID: \"a132b604-b1d6-4461-a916-d9bea9b5ca63\") " pod="openshift-monitoring/node-exporter-wxnvd"
Jul 30 00:06:59.669820 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:06:59.669791    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xgw7v\" (UniqueName: \"kubernetes.io/projected/a132b604-b1d6-4461-a916-d9bea9b5ca63-kube-api-access-xgw7v\") pod \"node-exporter-wxnvd\" (UID: \"a132b604-b1d6-4461-a916-d9bea9b5ca63\") " pod="openshift-monitoring/node-exporter-wxnvd"
Jul 30 00:06:59.763624 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:06:59.763588    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-wxnvd"
Jul 30 00:06:59.777624 ip-10-0-133-55 kubenswrapper[2560]: W0730 00:06:59.777593    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda132b604_b1d6_4461_a916_d9bea9b5ca63.slice/crio-0d5054b8f84837a69020768a4adb611b99fb19f392946760b5e50a56f6052f94 WatchSource:0}: Error finding container 0d5054b8f84837a69020768a4adb611b99fb19f392946760b5e50a56f6052f94: Status 404 returned error can't find the container with id 0d5054b8f84837a69020768a4adb611b99fb19f392946760b5e50a56f6052f94
Jul 30 00:07:00.316116 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:07:00.315994    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-wxnvd" event={"ID":"a132b604-b1d6-4461-a916-d9bea9b5ca63","Type":"ContainerStarted","Data":"0d5054b8f84837a69020768a4adb611b99fb19f392946760b5e50a56f6052f94"}
Jul 30 00:07:00.320937 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:07:00.320880    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-7b4fbb6948-p47t2"
Jul 30 00:07:00.399537 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:07:00.399506    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-9g97b"
Jul 30 00:07:01.505158 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:07:01.505123    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-6df644895b-wslwm"
Jul 30 00:07:01.505570 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:07:01.505205    2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-6df644895b-wslwm"
Jul 30 00:07:01.510068 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:07:01.510043    2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-6df644895b-wslwm"
Jul 30 00:07:01.932661 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:07:01.932628    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-777dddd7cd-bw4wt"]
Jul 30 00:07:02.329929 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:07:02.329847    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-6df644895b-wslwm"
Jul 30 00:07:02.382673 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:07:02.382636    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-7b4fbb6948-p47t2"]
Jul 30 00:07:02.429178 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:07:02.429147    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/thanos-querier-6b45bfd7bb-kp4bm"]
Jul 30 00:07:02.433698 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:07:02.433674    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-6b45bfd7bb-kp4bm"
Jul 30 00:07:02.436651 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:07:02.436136    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-rules\""
Jul 30 00:07:02.436651 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:07:02.436190    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-dockercfg-qvgln\""
Jul 30 00:07:02.436651 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:07:02.436200    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-metrics\""
Jul 30 00:07:02.436651 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:07:02.436137    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-web\""
Jul 30 00:07:02.436651 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:07:02.436470    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-tls\""
Jul 30 00:07:02.436651 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:07:02.436598    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy\""
Jul 30 00:07:02.437069 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:07:02.436662    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-grpc-tls-bicbetuhjqn3i\""
Jul 30 00:07:02.445999 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:07:02.445974    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-6b45bfd7bb-kp4bm"]
Jul 30 00:07:02.455812 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:07:02.455790    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/ba31c693-68e9-4a01-879f-62a25337eebe-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-6b45bfd7bb-kp4bm\" (UID: \"ba31c693-68e9-4a01-879f-62a25337eebe\") " pod="openshift-monitoring/thanos-querier-6b45bfd7bb-kp4bm"
Jul 30 00:07:02.455903 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:07:02.455861    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/ba31c693-68e9-4a01-879f-62a25337eebe-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-6b45bfd7bb-kp4bm\" (UID: \"ba31c693-68e9-4a01-879f-62a25337eebe\") " pod="openshift-monitoring/thanos-querier-6b45bfd7bb-kp4bm"
Jul 30 00:07:02.455975 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:07:02.455899    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/ba31c693-68e9-4a01-879f-62a25337eebe-secret-grpc-tls\") pod \"thanos-querier-6b45bfd7bb-kp4bm\" (UID: \"ba31c693-68e9-4a01-879f-62a25337eebe\") " pod="openshift-monitoring/thanos-querier-6b45bfd7bb-kp4bm"
Jul 30 00:07:02.455975 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:07:02.455963    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/ba31c693-68e9-4a01-879f-62a25337eebe-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-6b45bfd7bb-kp4bm\" (UID: \"ba31c693-68e9-4a01-879f-62a25337eebe\") " pod="openshift-monitoring/thanos-querier-6b45bfd7bb-kp4bm"
Jul 30 00:07:02.456089 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:07:02.455980    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9wvks\" (UniqueName: \"kubernetes.io/projected/ba31c693-68e9-4a01-879f-62a25337eebe-kube-api-access-9wvks\") pod \"thanos-querier-6b45bfd7bb-kp4bm\" (UID: \"ba31c693-68e9-4a01-879f-62a25337eebe\") " pod="openshift-monitoring/thanos-querier-6b45bfd7bb-kp4bm"
Jul 30 00:07:02.456089 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:07:02.456003    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/ba31c693-68e9-4a01-879f-62a25337eebe-metrics-client-ca\") pod \"thanos-querier-6b45bfd7bb-kp4bm\" (UID: \"ba31c693-68e9-4a01-879f-62a25337eebe\") " pod="openshift-monitoring/thanos-querier-6b45bfd7bb-kp4bm"
Jul 30 00:07:02.456089 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:07:02.456027    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/ba31c693-68e9-4a01-879f-62a25337eebe-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-6b45bfd7bb-kp4bm\" (UID: \"ba31c693-68e9-4a01-879f-62a25337eebe\") " pod="openshift-monitoring/thanos-querier-6b45bfd7bb-kp4bm"
Jul 30 00:07:02.456204 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:07:02.456087    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/ba31c693-68e9-4a01-879f-62a25337eebe-secret-thanos-querier-tls\") pod \"thanos-querier-6b45bfd7bb-kp4bm\" (UID: \"ba31c693-68e9-4a01-879f-62a25337eebe\") " pod="openshift-monitoring/thanos-querier-6b45bfd7bb-kp4bm"
Jul 30 00:07:02.556705 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:07:02.556677    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/ba31c693-68e9-4a01-879f-62a25337eebe-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-6b45bfd7bb-kp4bm\" (UID: \"ba31c693-68e9-4a01-879f-62a25337eebe\") " pod="openshift-monitoring/thanos-querier-6b45bfd7bb-kp4bm"
Jul 30 00:07:02.557047 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:07:02.556719    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9wvks\" (UniqueName: \"kubernetes.io/projected/ba31c693-68e9-4a01-879f-62a25337eebe-kube-api-access-9wvks\") pod \"thanos-querier-6b45bfd7bb-kp4bm\" (UID: \"ba31c693-68e9-4a01-879f-62a25337eebe\") " pod="openshift-monitoring/thanos-querier-6b45bfd7bb-kp4bm"
Jul 30 00:07:02.557047 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:07:02.556961    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/ba31c693-68e9-4a01-879f-62a25337eebe-metrics-client-ca\") pod \"thanos-querier-6b45bfd7bb-kp4bm\" (UID: \"ba31c693-68e9-4a01-879f-62a25337eebe\") " pod="openshift-monitoring/thanos-querier-6b45bfd7bb-kp4bm"
Jul 30 00:07:02.557047 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:07:02.557005    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/ba31c693-68e9-4a01-879f-62a25337eebe-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-6b45bfd7bb-kp4bm\" (UID: \"ba31c693-68e9-4a01-879f-62a25337eebe\") " pod="openshift-monitoring/thanos-querier-6b45bfd7bb-kp4bm"
Jul 30 00:07:02.557047 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:07:02.557033    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/ba31c693-68e9-4a01-879f-62a25337eebe-secret-thanos-querier-tls\") pod \"thanos-querier-6b45bfd7bb-kp4bm\" (UID: \"ba31c693-68e9-4a01-879f-62a25337eebe\") " pod="openshift-monitoring/thanos-querier-6b45bfd7bb-kp4bm"
Jul 30 00:07:02.557261 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:07:02.557072    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/ba31c693-68e9-4a01-879f-62a25337eebe-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-6b45bfd7bb-kp4bm\" (UID: \"ba31c693-68e9-4a01-879f-62a25337eebe\") " pod="openshift-monitoring/thanos-querier-6b45bfd7bb-kp4bm"
Jul 30 00:07:02.557261 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:07:02.557148    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/ba31c693-68e9-4a01-879f-62a25337eebe-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-6b45bfd7bb-kp4bm\" (UID: \"ba31c693-68e9-4a01-879f-62a25337eebe\") " pod="openshift-monitoring/thanos-querier-6b45bfd7bb-kp4bm"
Jul 30 00:07:02.557261 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:07:02.557188    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/ba31c693-68e9-4a01-879f-62a25337eebe-secret-grpc-tls\") pod \"thanos-querier-6b45bfd7bb-kp4bm\" (UID: \"ba31c693-68e9-4a01-879f-62a25337eebe\") " pod="openshift-monitoring/thanos-querier-6b45bfd7bb-kp4bm"
Jul 30 00:07:02.557855 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:07:02.557703    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/ba31c693-68e9-4a01-879f-62a25337eebe-metrics-client-ca\") pod \"thanos-querier-6b45bfd7bb-kp4bm\" (UID: \"ba31c693-68e9-4a01-879f-62a25337eebe\") " pod="openshift-monitoring/thanos-querier-6b45bfd7bb-kp4bm"
Jul 30 00:07:02.559396 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:07:02.559372    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/ba31c693-68e9-4a01-879f-62a25337eebe-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-6b45bfd7bb-kp4bm\" (UID: \"ba31c693-68e9-4a01-879f-62a25337eebe\") " pod="openshift-monitoring/thanos-querier-6b45bfd7bb-kp4bm"
Jul 30 00:07:02.560990 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:07:02.560915    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/ba31c693-68e9-4a01-879f-62a25337eebe-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-6b45bfd7bb-kp4bm\" (UID: \"ba31c693-68e9-4a01-879f-62a25337eebe\") " pod="openshift-monitoring/thanos-querier-6b45bfd7bb-kp4bm"
Jul 30 00:07:02.560990 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:07:02.560956    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/ba31c693-68e9-4a01-879f-62a25337eebe-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-6b45bfd7bb-kp4bm\" (UID: \"ba31c693-68e9-4a01-879f-62a25337eebe\") " pod="openshift-monitoring/thanos-querier-6b45bfd7bb-kp4bm"
Jul 30 00:07:02.561096 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:07:02.561054    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/ba31c693-68e9-4a01-879f-62a25337eebe-secret-thanos-querier-tls\") pod \"thanos-querier-6b45bfd7bb-kp4bm\" (UID: \"ba31c693-68e9-4a01-879f-62a25337eebe\") " pod="openshift-monitoring/thanos-querier-6b45bfd7bb-kp4bm"
Jul 30 00:07:02.561799 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:07:02.561772    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/ba31c693-68e9-4a01-879f-62a25337eebe-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-6b45bfd7bb-kp4bm\" (UID: \"ba31c693-68e9-4a01-879f-62a25337eebe\") " pod="openshift-monitoring/thanos-querier-6b45bfd7bb-kp4bm"
Jul 30 00:07:02.562425 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:07:02.562405    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/ba31c693-68e9-4a01-879f-62a25337eebe-secret-grpc-tls\") pod \"thanos-querier-6b45bfd7bb-kp4bm\" (UID: \"ba31c693-68e9-4a01-879f-62a25337eebe\") " pod="openshift-monitoring/thanos-querier-6b45bfd7bb-kp4bm"
Jul 30 00:07:02.568862 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:07:02.568824    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9wvks\" (UniqueName: \"kubernetes.io/projected/ba31c693-68e9-4a01-879f-62a25337eebe-kube-api-access-9wvks\") pod \"thanos-querier-6b45bfd7bb-kp4bm\" (UID: \"ba31c693-68e9-4a01-879f-62a25337eebe\") " pod="openshift-monitoring/thanos-querier-6b45bfd7bb-kp4bm"
Jul 30 00:07:02.753831 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:07:02.753801    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-6b45bfd7bb-kp4bm"
Jul 30 00:07:02.882068 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:07:02.882026    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-6b45bfd7bb-kp4bm"]
Jul 30 00:07:02.886092 ip-10-0-133-55 kubenswrapper[2560]: W0730 00:07:02.886068    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podba31c693_68e9_4a01_879f_62a25337eebe.slice/crio-ddabe95909e21fb4a57ec934aec0a522aac1af81e50dde82ca4e2f4c6362a244 WatchSource:0}: Error finding container ddabe95909e21fb4a57ec934aec0a522aac1af81e50dde82ca4e2f4c6362a244: Status 404 returned error can't find the container with id ddabe95909e21fb4a57ec934aec0a522aac1af81e50dde82ca4e2f4c6362a244
Jul 30 00:07:03.330900 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:07:03.330869    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-6b45bfd7bb-kp4bm" event={"ID":"ba31c693-68e9-4a01-879f-62a25337eebe","Type":"ContainerStarted","Data":"ddabe95909e21fb4a57ec934aec0a522aac1af81e50dde82ca4e2f4c6362a244"}
Jul 30 00:07:03.332586 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:07:03.332555    2560 generic.go:356] "Generic (PLEG): container finished" podID="a132b604-b1d6-4461-a916-d9bea9b5ca63" containerID="692ee394f66df43e3d9dd08b1819f6e072caf6d1c220797fd5f700cf08c93ee3" exitCode=0
Jul 30 00:07:03.332710 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:07:03.332642    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-wxnvd" event={"ID":"a132b604-b1d6-4461-a916-d9bea9b5ca63","Type":"ContainerDied","Data":"692ee394f66df43e3d9dd08b1819f6e072caf6d1c220797fd5f700cf08c93ee3"}
Jul 30 00:07:03.334471 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:07:03.334448    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-g69zk" event={"ID":"7e1181b5-9505-4a82-84b2-48086fb162f0","Type":"ContainerStarted","Data":"8c12a9268763defd57c3c6c88116446f2bba67e54031545b0f0e58cd55684a99"}
Jul 30 00:07:04.214820 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:07:04.214758    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/monitoring-plugin-68b7fc9574-qmq2l"]
Jul 30 00:07:04.218184 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:07:04.218163    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-68b7fc9574-qmq2l"
Jul 30 00:07:04.220571 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:07:04.220547    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-dockercfg-vbqst\""
Jul 30 00:07:04.220689 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:07:04.220596    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-cert\""
Jul 30 00:07:04.231088 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:07:04.231068    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-68b7fc9574-qmq2l"]
Jul 30 00:07:04.270798 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:07:04.270667    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/3f85b798-f561-4c04-9d52-4d8e5b4d1621-monitoring-plugin-cert\") pod \"monitoring-plugin-68b7fc9574-qmq2l\" (UID: \"3f85b798-f561-4c04-9d52-4d8e5b4d1621\") " pod="openshift-monitoring/monitoring-plugin-68b7fc9574-qmq2l"
Jul 30 00:07:04.270920 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:07:04.270827    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-98rcx\" (UniqueName: \"kubernetes.io/projected/3f85b798-f561-4c04-9d52-4d8e5b4d1621-kube-api-access-98rcx\") pod \"monitoring-plugin-68b7fc9574-qmq2l\" (UID: \"3f85b798-f561-4c04-9d52-4d8e5b4d1621\") " pod="openshift-monitoring/monitoring-plugin-68b7fc9574-qmq2l"
Jul 30 00:07:04.341391 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:07:04.341293    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-wxnvd" event={"ID":"a132b604-b1d6-4461-a916-d9bea9b5ca63","Type":"ContainerStarted","Data":"a51c754daf9f144223aa3f8adf21e81839b11b17ad985a92c865bc4c1addc1cf"}
Jul 30 00:07:04.341391 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:07:04.341364    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-wxnvd" event={"ID":"a132b604-b1d6-4461-a916-d9bea9b5ca63","Type":"ContainerStarted","Data":"2d73d1d4c2b5a46455a5e8ed2ddd6fe0c3e75fc1ea243630a3001a851a8d2528"}
Jul 30 00:07:04.361185 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:07:04.361118    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-wxnvd" podStartSLOduration=2.581031537 podStartE2EDuration="5.36110061s" totalImagesPullingTime="2.714913663s" totalInitContainerRuntime="65.15541ms" isStatefulPod=true podCreationTimestamp="2026-07-30 00:06:59 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 00:07:04.359284601 +0000 UTC m=+311.418501409" watchObservedRunningTime="2026-07-30 00:07:04.36110061 +0000 UTC m=+311.420317415"
Jul 30 00:07:04.371935 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:07:04.371905    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/3f85b798-f561-4c04-9d52-4d8e5b4d1621-monitoring-plugin-cert\") pod \"monitoring-plugin-68b7fc9574-qmq2l\" (UID: \"3f85b798-f561-4c04-9d52-4d8e5b4d1621\") " pod="openshift-monitoring/monitoring-plugin-68b7fc9574-qmq2l"
Jul 30 00:07:04.372249 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:07:04.372203    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-98rcx\" (UniqueName: \"kubernetes.io/projected/3f85b798-f561-4c04-9d52-4d8e5b4d1621-kube-api-access-98rcx\") pod \"monitoring-plugin-68b7fc9574-qmq2l\" (UID: \"3f85b798-f561-4c04-9d52-4d8e5b4d1621\") " pod="openshift-monitoring/monitoring-plugin-68b7fc9574-qmq2l"
Jul 30 00:07:04.375331 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:07:04.375285    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/3f85b798-f561-4c04-9d52-4d8e5b4d1621-monitoring-plugin-cert\") pod \"monitoring-plugin-68b7fc9574-qmq2l\" (UID: \"3f85b798-f561-4c04-9d52-4d8e5b4d1621\") " pod="openshift-monitoring/monitoring-plugin-68b7fc9574-qmq2l"
Jul 30 00:07:04.379955 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:07:04.379926    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-98rcx\" (UniqueName: \"kubernetes.io/projected/3f85b798-f561-4c04-9d52-4d8e5b4d1621-kube-api-access-98rcx\") pod \"monitoring-plugin-68b7fc9574-qmq2l\" (UID: \"3f85b798-f561-4c04-9d52-4d8e5b4d1621\") " pod="openshift-monitoring/monitoring-plugin-68b7fc9574-qmq2l"
Jul 30 00:07:04.529450 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:07:04.529368    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-68b7fc9574-qmq2l"
Jul 30 00:07:04.674850 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:07:04.674822    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-68b7fc9574-qmq2l"]
Jul 30 00:07:04.677662 ip-10-0-133-55 kubenswrapper[2560]: W0730 00:07:04.677631    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3f85b798_f561_4c04_9d52_4d8e5b4d1621.slice/crio-d097d7f748ebc509cf375beaef3123241eaf9f5e1ec117eb96c9e0b07377dbb3 WatchSource:0}: Error finding container d097d7f748ebc509cf375beaef3123241eaf9f5e1ec117eb96c9e0b07377dbb3: Status 404 returned error can't find the container with id d097d7f748ebc509cf375beaef3123241eaf9f5e1ec117eb96c9e0b07377dbb3
Jul 30 00:07:05.347803 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:07:05.347717    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-68b7fc9574-qmq2l" event={"ID":"3f85b798-f561-4c04-9d52-4d8e5b4d1621","Type":"ContainerStarted","Data":"d097d7f748ebc509cf375beaef3123241eaf9f5e1ec117eb96c9e0b07377dbb3"}
Jul 30 00:07:05.582407 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:07:05.582372    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 30 00:07:05.586154 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:07:05.586130    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Jul 30 00:07:05.588834 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:07:05.588788    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\""
Jul 30 00:07:05.588958 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:07:05.588872    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\""
Jul 30 00:07:05.589017 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:07:05.588975    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-j6rws\""
Jul 30 00:07:05.589017 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:07:05.588982    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\""
Jul 30 00:07:05.589265 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:07:05.589250    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\""
Jul 30 00:07:05.589377 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:07:05.589360    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\""
Jul 30 00:07:05.589441 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:07:05.589367    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\""
Jul 30 00:07:05.589988 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:07:05.589739    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\""
Jul 30 00:07:05.590069 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:07:05.590008    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\""
Jul 30 00:07:05.590456 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:07:05.590155    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\""
Jul 30 00:07:05.590456 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:07:05.590168    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-1\""
Jul 30 00:07:05.590456 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:07:05.590302    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\""
Jul 30 00:07:05.590456 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:07:05.590331    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\""
Jul 30 00:07:05.590456 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:07:05.590303    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-2\""
Jul 30 00:07:05.590456 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:07:05.590439    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-9s4aav1e6ijoh\""
Jul 30 00:07:05.592483 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:07:05.592420    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\""
Jul 30 00:07:05.596047 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:07:05.596025    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\""
Jul 30 00:07:05.602249 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:07:05.602196    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 30 00:07:05.685094 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:07:05.685072    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/3e055160-b969-4006-be53-f8624ce4acc2-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"3e055160-b969-4006-be53-f8624ce4acc2\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 30 00:07:05.685207 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:07:05.685115    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/3e055160-b969-4006-be53-f8624ce4acc2-web-config\") pod \"prometheus-k8s-0\" (UID: \"3e055160-b969-4006-be53-f8624ce4acc2\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 30 00:07:05.685207 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:07:05.685143    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/3e055160-b969-4006-be53-f8624ce4acc2-config-out\") pod \"prometheus-k8s-0\" (UID: \"3e055160-b969-4006-be53-f8624ce4acc2\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 30 00:07:05.685207 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:07:05.685184    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/3e055160-b969-4006-be53-f8624ce4acc2-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"3e055160-b969-4006-be53-f8624ce4acc2\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 30 00:07:05.685349 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:07:05.685210    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/3e055160-b969-4006-be53-f8624ce4acc2-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"3e055160-b969-4006-be53-f8624ce4acc2\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 30 00:07:05.685349 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:07:05.685265    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3e055160-b969-4006-be53-f8624ce4acc2-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"3e055160-b969-4006-be53-f8624ce4acc2\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 30 00:07:05.685349 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:07:05.685291    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/3e055160-b969-4006-be53-f8624ce4acc2-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"3e055160-b969-4006-be53-f8624ce4acc2\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 30 00:07:05.685349 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:07:05.685325    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/3e055160-b969-4006-be53-f8624ce4acc2-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"3e055160-b969-4006-be53-f8624ce4acc2\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 30 00:07:05.685349 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:07:05.685342    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3e055160-b969-4006-be53-f8624ce4acc2-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"3e055160-b969-4006-be53-f8624ce4acc2\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 30 00:07:05.685551 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:07:05.685362    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-m2kn6\" (UniqueName: \"kubernetes.io/projected/3e055160-b969-4006-be53-f8624ce4acc2-kube-api-access-m2kn6\") pod \"prometheus-k8s-0\" (UID: \"3e055160-b969-4006-be53-f8624ce4acc2\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 30 00:07:05.685551 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:07:05.685391    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/3e055160-b969-4006-be53-f8624ce4acc2-config\") pod \"prometheus-k8s-0\" (UID: \"3e055160-b969-4006-be53-f8624ce4acc2\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 30 00:07:05.685551 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:07:05.685406    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/3e055160-b969-4006-be53-f8624ce4acc2-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"3e055160-b969-4006-be53-f8624ce4acc2\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 30 00:07:05.685551 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:07:05.685423    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3e055160-b969-4006-be53-f8624ce4acc2-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"3e055160-b969-4006-be53-f8624ce4acc2\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 30 00:07:05.685551 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:07:05.685446    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/3e055160-b969-4006-be53-f8624ce4acc2-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"3e055160-b969-4006-be53-f8624ce4acc2\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 30 00:07:05.685551 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:07:05.685482    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/3e055160-b969-4006-be53-f8624ce4acc2-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"3e055160-b969-4006-be53-f8624ce4acc2\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 30 00:07:05.685739 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:07:05.685577    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/3e055160-b969-4006-be53-f8624ce4acc2-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"3e055160-b969-4006-be53-f8624ce4acc2\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 30 00:07:05.685739 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:07:05.685641    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/3e055160-b969-4006-be53-f8624ce4acc2-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"3e055160-b969-4006-be53-f8624ce4acc2\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 30 00:07:05.685739 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:07:05.685676    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/3e055160-b969-4006-be53-f8624ce4acc2-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"3e055160-b969-4006-be53-f8624ce4acc2\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 30 00:07:05.685739 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:07:05.685702    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/3e055160-b969-4006-be53-f8624ce4acc2-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"3e055160-b969-4006-be53-f8624ce4acc2\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 30 00:07:05.685739 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:07:05.685729    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/3e055160-b969-4006-be53-f8624ce4acc2-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"3e055160-b969-4006-be53-f8624ce4acc2\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 30 00:07:05.786861 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:07:05.786825    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/3e055160-b969-4006-be53-f8624ce4acc2-config\") pod \"prometheus-k8s-0\" (UID: \"3e055160-b969-4006-be53-f8624ce4acc2\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 30 00:07:05.787036 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:07:05.786869    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/3e055160-b969-4006-be53-f8624ce4acc2-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"3e055160-b969-4006-be53-f8624ce4acc2\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 30 00:07:05.787036 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:07:05.786901    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3e055160-b969-4006-be53-f8624ce4acc2-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"3e055160-b969-4006-be53-f8624ce4acc2\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 30 00:07:05.787036 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:07:05.786934    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/3e055160-b969-4006-be53-f8624ce4acc2-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"3e055160-b969-4006-be53-f8624ce4acc2\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 30 00:07:05.787036 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:07:05.786956    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/3e055160-b969-4006-be53-f8624ce4acc2-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"3e055160-b969-4006-be53-f8624ce4acc2\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 30 00:07:05.787036 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:07:05.786989    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/3e055160-b969-4006-be53-f8624ce4acc2-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"3e055160-b969-4006-be53-f8624ce4acc2\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 30 00:07:05.787036 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:07:05.787022    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/3e055160-b969-4006-be53-f8624ce4acc2-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"3e055160-b969-4006-be53-f8624ce4acc2\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 30 00:07:05.787535 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:07:05.787054    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/3e055160-b969-4006-be53-f8624ce4acc2-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"3e055160-b969-4006-be53-f8624ce4acc2\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 30 00:07:05.787535 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:07:05.787077    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/3e055160-b969-4006-be53-f8624ce4acc2-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"3e055160-b969-4006-be53-f8624ce4acc2\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 30 00:07:05.787535 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:07:05.787109    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/3e055160-b969-4006-be53-f8624ce4acc2-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"3e055160-b969-4006-be53-f8624ce4acc2\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 30 00:07:05.787535 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:07:05.787186    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/3e055160-b969-4006-be53-f8624ce4acc2-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"3e055160-b969-4006-be53-f8624ce4acc2\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 30 00:07:05.787535 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:07:05.787220    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/3e055160-b969-4006-be53-f8624ce4acc2-web-config\") pod \"prometheus-k8s-0\" (UID: \"3e055160-b969-4006-be53-f8624ce4acc2\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 30 00:07:05.787535 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:07:05.787243    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/3e055160-b969-4006-be53-f8624ce4acc2-config-out\") pod \"prometheus-k8s-0\" (UID: \"3e055160-b969-4006-be53-f8624ce4acc2\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 30 00:07:05.787535 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:07:05.787274    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/3e055160-b969-4006-be53-f8624ce4acc2-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"3e055160-b969-4006-be53-f8624ce4acc2\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 30 00:07:05.787535 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:07:05.787325    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/3e055160-b969-4006-be53-f8624ce4acc2-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"3e055160-b969-4006-be53-f8624ce4acc2\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 30 00:07:05.787535 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:07:05.787368    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3e055160-b969-4006-be53-f8624ce4acc2-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"3e055160-b969-4006-be53-f8624ce4acc2\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 30 00:07:05.787535 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:07:05.787397    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/3e055160-b969-4006-be53-f8624ce4acc2-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"3e055160-b969-4006-be53-f8624ce4acc2\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 30 00:07:05.787535 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:07:05.787422    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/3e055160-b969-4006-be53-f8624ce4acc2-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"3e055160-b969-4006-be53-f8624ce4acc2\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 30 00:07:05.787535 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:07:05.787445    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3e055160-b969-4006-be53-f8624ce4acc2-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"3e055160-b969-4006-be53-f8624ce4acc2\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 30 00:07:05.787535 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:07:05.787482    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-m2kn6\" (UniqueName: \"kubernetes.io/projected/3e055160-b969-4006-be53-f8624ce4acc2-kube-api-access-m2kn6\") pod \"prometheus-k8s-0\" (UID: \"3e055160-b969-4006-be53-f8624ce4acc2\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 30 00:07:05.788361 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:07:05.787713    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/3e055160-b969-4006-be53-f8624ce4acc2-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"3e055160-b969-4006-be53-f8624ce4acc2\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 30 00:07:05.788361 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:07:05.787848    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/3e055160-b969-4006-be53-f8624ce4acc2-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"3e055160-b969-4006-be53-f8624ce4acc2\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 30 00:07:05.790665 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:07:05.790577    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3e055160-b969-4006-be53-f8624ce4acc2-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"3e055160-b969-4006-be53-f8624ce4acc2\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 30 00:07:05.790665 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:07:05.790610    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/3e055160-b969-4006-be53-f8624ce4acc2-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"3e055160-b969-4006-be53-f8624ce4acc2\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 30 00:07:05.790665 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:07:05.790663    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/3e055160-b969-4006-be53-f8624ce4acc2-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"3e055160-b969-4006-be53-f8624ce4acc2\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 30 00:07:05.790967 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:07:05.790906    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/3e055160-b969-4006-be53-f8624ce4acc2-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"3e055160-b969-4006-be53-f8624ce4acc2\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 30 00:07:05.791346 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:07:05.791265    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3e055160-b969-4006-be53-f8624ce4acc2-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"3e055160-b969-4006-be53-f8624ce4acc2\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 30 00:07:05.791920 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:07:05.791899    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/3e055160-b969-4006-be53-f8624ce4acc2-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"3e055160-b969-4006-be53-f8624ce4acc2\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 30 00:07:05.792260 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:07:05.792232    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/3e055160-b969-4006-be53-f8624ce4acc2-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"3e055160-b969-4006-be53-f8624ce4acc2\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 30 00:07:05.792510 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:07:05.792491    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/3e055160-b969-4006-be53-f8624ce4acc2-config\") pod \"prometheus-k8s-0\" (UID: \"3e055160-b969-4006-be53-f8624ce4acc2\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 30 00:07:05.792686 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:07:05.792664    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/3e055160-b969-4006-be53-f8624ce4acc2-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"3e055160-b969-4006-be53-f8624ce4acc2\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 30 00:07:05.794167 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:07:05.794134    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/3e055160-b969-4006-be53-f8624ce4acc2-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"3e055160-b969-4006-be53-f8624ce4acc2\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 30 00:07:05.794266 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:07:05.794173    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/3e055160-b969-4006-be53-f8624ce4acc2-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"3e055160-b969-4006-be53-f8624ce4acc2\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 30 00:07:05.794459 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:07:05.794384    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3e055160-b969-4006-be53-f8624ce4acc2-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"3e055160-b969-4006-be53-f8624ce4acc2\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 30 00:07:05.794459 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:07:05.794390    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/3e055160-b969-4006-be53-f8624ce4acc2-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"3e055160-b969-4006-be53-f8624ce4acc2\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 30 00:07:05.794597 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:07:05.794546    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/3e055160-b969-4006-be53-f8624ce4acc2-config-out\") pod \"prometheus-k8s-0\" (UID: \"3e055160-b969-4006-be53-f8624ce4acc2\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 30 00:07:05.795122 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:07:05.794776    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/3e055160-b969-4006-be53-f8624ce4acc2-web-config\") pod \"prometheus-k8s-0\" (UID: \"3e055160-b969-4006-be53-f8624ce4acc2\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 30 00:07:05.795122 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:07:05.795097    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/3e055160-b969-4006-be53-f8624ce4acc2-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"3e055160-b969-4006-be53-f8624ce4acc2\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 30 00:07:05.796503 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:07:05.796446    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-m2kn6\" (UniqueName: \"kubernetes.io/projected/3e055160-b969-4006-be53-f8624ce4acc2-kube-api-access-m2kn6\") pod \"prometheus-k8s-0\" (UID: \"3e055160-b969-4006-be53-f8624ce4acc2\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 30 00:07:05.797141 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:07:05.796971    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/3e055160-b969-4006-be53-f8624ce4acc2-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"3e055160-b969-4006-be53-f8624ce4acc2\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 30 00:07:05.898598 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:07:05.898564    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Jul 30 00:07:06.353219 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:07:06.353135    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-6b45bfd7bb-kp4bm" event={"ID":"ba31c693-68e9-4a01-879f-62a25337eebe","Type":"ContainerStarted","Data":"06ca96e04459f85fc228cf72e339cc3ec8c4b28405536d239272fc1e5ea9e4ab"}
Jul 30 00:07:06.797810 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:07:06.797777    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-67df797bd9-7zcn4"]
Jul 30 00:07:06.808233 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:07:06.808208    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-67df797bd9-7zcn4"
Jul 30 00:07:06.813790 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:07:06.813731    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-67df797bd9-7zcn4"]
Jul 30 00:07:06.898395 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:07:06.898364    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/68f2d620-c8be-48e4-8ef7-a7ad10654f46-console-oauth-config\") pod \"console-67df797bd9-7zcn4\" (UID: \"68f2d620-c8be-48e4-8ef7-a7ad10654f46\") " pod="openshift-console/console-67df797bd9-7zcn4"
Jul 30 00:07:06.898552 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:07:06.898408    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/68f2d620-c8be-48e4-8ef7-a7ad10654f46-trusted-ca-bundle\") pod \"console-67df797bd9-7zcn4\" (UID: \"68f2d620-c8be-48e4-8ef7-a7ad10654f46\") " pod="openshift-console/console-67df797bd9-7zcn4"
Jul 30 00:07:06.898552 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:07:06.898460    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/68f2d620-c8be-48e4-8ef7-a7ad10654f46-console-config\") pod \"console-67df797bd9-7zcn4\" (UID: \"68f2d620-c8be-48e4-8ef7-a7ad10654f46\") " pod="openshift-console/console-67df797bd9-7zcn4"
Jul 30 00:07:06.898552 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:07:06.898488    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/68f2d620-c8be-48e4-8ef7-a7ad10654f46-oauth-serving-cert\") pod \"console-67df797bd9-7zcn4\" (UID: \"68f2d620-c8be-48e4-8ef7-a7ad10654f46\") " pod="openshift-console/console-67df797bd9-7zcn4"
Jul 30 00:07:06.898552 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:07:06.898511    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/68f2d620-c8be-48e4-8ef7-a7ad10654f46-console-serving-cert\") pod \"console-67df797bd9-7zcn4\" (UID: \"68f2d620-c8be-48e4-8ef7-a7ad10654f46\") " pod="openshift-console/console-67df797bd9-7zcn4"
Jul 30 00:07:06.898778 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:07:06.898554    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/68f2d620-c8be-48e4-8ef7-a7ad10654f46-service-ca\") pod \"console-67df797bd9-7zcn4\" (UID: \"68f2d620-c8be-48e4-8ef7-a7ad10654f46\") " pod="openshift-console/console-67df797bd9-7zcn4"
Jul 30 00:07:06.898778 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:07:06.898611    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kq47f\" (UniqueName: \"kubernetes.io/projected/68f2d620-c8be-48e4-8ef7-a7ad10654f46-kube-api-access-kq47f\") pod \"console-67df797bd9-7zcn4\" (UID: \"68f2d620-c8be-48e4-8ef7-a7ad10654f46\") " pod="openshift-console/console-67df797bd9-7zcn4"
Jul 30 00:07:06.999407 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:07:06.999370    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kq47f\" (UniqueName: \"kubernetes.io/projected/68f2d620-c8be-48e4-8ef7-a7ad10654f46-kube-api-access-kq47f\") pod \"console-67df797bd9-7zcn4\" (UID: \"68f2d620-c8be-48e4-8ef7-a7ad10654f46\") " pod="openshift-console/console-67df797bd9-7zcn4"
Jul 30 00:07:06.999596 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:07:06.999429    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/68f2d620-c8be-48e4-8ef7-a7ad10654f46-console-oauth-config\") pod \"console-67df797bd9-7zcn4\" (UID: \"68f2d620-c8be-48e4-8ef7-a7ad10654f46\") " pod="openshift-console/console-67df797bd9-7zcn4"
Jul 30 00:07:06.999596 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:07:06.999459    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/68f2d620-c8be-48e4-8ef7-a7ad10654f46-trusted-ca-bundle\") pod \"console-67df797bd9-7zcn4\" (UID: \"68f2d620-c8be-48e4-8ef7-a7ad10654f46\") " pod="openshift-console/console-67df797bd9-7zcn4"
Jul 30 00:07:06.999596 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:07:06.999492    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/68f2d620-c8be-48e4-8ef7-a7ad10654f46-console-config\") pod \"console-67df797bd9-7zcn4\" (UID: \"68f2d620-c8be-48e4-8ef7-a7ad10654f46\") " pod="openshift-console/console-67df797bd9-7zcn4"
Jul 30 00:07:06.999596 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:07:06.999520    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/68f2d620-c8be-48e4-8ef7-a7ad10654f46-oauth-serving-cert\") pod \"console-67df797bd9-7zcn4\" (UID: \"68f2d620-c8be-48e4-8ef7-a7ad10654f46\") " pod="openshift-console/console-67df797bd9-7zcn4"
Jul 30 00:07:06.999596 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:07:06.999538    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/68f2d620-c8be-48e4-8ef7-a7ad10654f46-console-serving-cert\") pod \"console-67df797bd9-7zcn4\" (UID: \"68f2d620-c8be-48e4-8ef7-a7ad10654f46\") " pod="openshift-console/console-67df797bd9-7zcn4"
Jul 30 00:07:06.999596 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:07:06.999578    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/68f2d620-c8be-48e4-8ef7-a7ad10654f46-service-ca\") pod \"console-67df797bd9-7zcn4\" (UID: \"68f2d620-c8be-48e4-8ef7-a7ad10654f46\") " pod="openshift-console/console-67df797bd9-7zcn4"
Jul 30 00:07:07.000833 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:07:07.000748    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/68f2d620-c8be-48e4-8ef7-a7ad10654f46-console-config\") pod \"console-67df797bd9-7zcn4\" (UID: \"68f2d620-c8be-48e4-8ef7-a7ad10654f46\") " pod="openshift-console/console-67df797bd9-7zcn4"
Jul 30 00:07:07.000961 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:07:07.000905    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/68f2d620-c8be-48e4-8ef7-a7ad10654f46-service-ca\") pod \"console-67df797bd9-7zcn4\" (UID: \"68f2d620-c8be-48e4-8ef7-a7ad10654f46\") " pod="openshift-console/console-67df797bd9-7zcn4"
Jul 30 00:07:07.001089 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:07:07.001059    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/68f2d620-c8be-48e4-8ef7-a7ad10654f46-oauth-serving-cert\") pod \"console-67df797bd9-7zcn4\" (UID: \"68f2d620-c8be-48e4-8ef7-a7ad10654f46\") " pod="openshift-console/console-67df797bd9-7zcn4"
Jul 30 00:07:07.001260 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:07:07.001242    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/68f2d620-c8be-48e4-8ef7-a7ad10654f46-trusted-ca-bundle\") pod \"console-67df797bd9-7zcn4\" (UID: \"68f2d620-c8be-48e4-8ef7-a7ad10654f46\") " pod="openshift-console/console-67df797bd9-7zcn4"
Jul 30 00:07:07.002957 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:07:07.002932    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/68f2d620-c8be-48e4-8ef7-a7ad10654f46-console-serving-cert\") pod \"console-67df797bd9-7zcn4\" (UID: \"68f2d620-c8be-48e4-8ef7-a7ad10654f46\") " pod="openshift-console/console-67df797bd9-7zcn4"
Jul 30 00:07:07.003054 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:07:07.003007    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/68f2d620-c8be-48e4-8ef7-a7ad10654f46-console-oauth-config\") pod \"console-67df797bd9-7zcn4\" (UID: \"68f2d620-c8be-48e4-8ef7-a7ad10654f46\") " pod="openshift-console/console-67df797bd9-7zcn4"
Jul 30 00:07:07.010219 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:07:07.010195    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kq47f\" (UniqueName: \"kubernetes.io/projected/68f2d620-c8be-48e4-8ef7-a7ad10654f46-kube-api-access-kq47f\") pod \"console-67df797bd9-7zcn4\" (UID: \"68f2d620-c8be-48e4-8ef7-a7ad10654f46\") " pod="openshift-console/console-67df797bd9-7zcn4"
Jul 30 00:07:07.122399 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:07:07.122301    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-67df797bd9-7zcn4"
Jul 30 00:07:07.940667 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:07:07.940629    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 30 00:07:07.943293 ip-10-0-133-55 kubenswrapper[2560]: W0730 00:07:07.943267    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3e055160_b969_4006_be53_f8624ce4acc2.slice/crio-bdb66ffda358ca686712d91674e95d6919327312d8f235808f4e6386d932a599 WatchSource:0}: Error finding container bdb66ffda358ca686712d91674e95d6919327312d8f235808f4e6386d932a599: Status 404 returned error can't find the container with id bdb66ffda358ca686712d91674e95d6919327312d8f235808f4e6386d932a599
Jul 30 00:07:07.963750 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:07:07.963725    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-67df797bd9-7zcn4"]
Jul 30 00:07:07.965881 ip-10-0-133-55 kubenswrapper[2560]: W0730 00:07:07.965858    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod68f2d620_c8be_48e4_8ef7_a7ad10654f46.slice/crio-143142dc1600a8c294bbf0cd8dc7b9827bd9d70a84a961d07328dd38878a7b04 WatchSource:0}: Error finding container 143142dc1600a8c294bbf0cd8dc7b9827bd9d70a84a961d07328dd38878a7b04: Status 404 returned error can't find the container with id 143142dc1600a8c294bbf0cd8dc7b9827bd9d70a84a961d07328dd38878a7b04
Jul 30 00:07:08.363037 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:07:08.362944    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-g69zk" event={"ID":"7e1181b5-9505-4a82-84b2-48086fb162f0","Type":"ContainerStarted","Data":"e5a894eabdbeaddf1bbc8898f54a5a2474d3f2f940a2811fcde1fbcefbbb33d9"}
Jul 30 00:07:08.364405 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:07:08.364372    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-67df797bd9-7zcn4" event={"ID":"68f2d620-c8be-48e4-8ef7-a7ad10654f46","Type":"ContainerStarted","Data":"e14ba4f14984022efc30c7658db673af997adbcef07816d30f919387ccfebebe"}
Jul 30 00:07:08.364538 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:07:08.364416    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-67df797bd9-7zcn4" event={"ID":"68f2d620-c8be-48e4-8ef7-a7ad10654f46","Type":"ContainerStarted","Data":"143142dc1600a8c294bbf0cd8dc7b9827bd9d70a84a961d07328dd38878a7b04"}
Jul 30 00:07:08.365426 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:07:08.365406    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"3e055160-b969-4006-be53-f8624ce4acc2","Type":"ContainerStarted","Data":"bdb66ffda358ca686712d91674e95d6919327312d8f235808f4e6386d932a599"}
Jul 30 00:07:08.366840 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:07:08.366817    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-68b7fc9574-qmq2l" event={"ID":"3f85b798-f561-4c04-9d52-4d8e5b4d1621","Type":"ContainerStarted","Data":"33a151338620c0946283e60d231c4bad29cb7d322af94983772d84933521b5fb"}
Jul 30 00:07:08.367010 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:07:08.366985    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/monitoring-plugin-68b7fc9574-qmq2l"
Jul 30 00:07:08.368938 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:07:08.368915    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-6b45bfd7bb-kp4bm" event={"ID":"ba31c693-68e9-4a01-879f-62a25337eebe","Type":"ContainerStarted","Data":"b36577a6548c8eed1520281b8ab489605d133d2558711fada6b572abd9b689d8"}
Jul 30 00:07:08.369011 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:07:08.368973    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-6b45bfd7bb-kp4bm" event={"ID":"ba31c693-68e9-4a01-879f-62a25337eebe","Type":"ContainerStarted","Data":"6dd340a66e7b33b6a8e9b260614a608806c31d24c3ce45a35b8b185104301218"}
Jul 30 00:07:08.372272 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:07:08.372255    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/monitoring-plugin-68b7fc9574-qmq2l"
Jul 30 00:07:08.379507 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:07:08.379467    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-g69zk" podStartSLOduration=33.541559952 podStartE2EDuration="50.379453282s" totalImagesPullingTime="16.83789333s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-30 00:06:18 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 00:07:08.378136875 +0000 UTC m=+315.437353679" watchObservedRunningTime="2026-07-30 00:07:08.379453282 +0000 UTC m=+315.438670479"
Jul 30 00:07:08.396450 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:07:08.392390    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/monitoring-plugin-68b7fc9574-qmq2l" podStartSLOduration=1.300320705 podStartE2EDuration="4.39236983s" totalImagesPullingTime="3.092049125s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-30 00:07:04 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 00:07:08.391440962 +0000 UTC m=+315.450657767" watchObservedRunningTime="2026-07-30 00:07:08.39236983 +0000 UTC m=+315.451586635"
Jul 30 00:07:08.413110 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:07:08.413062    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-67df797bd9-7zcn4" podStartSLOduration=2.413042589 podStartE2EDuration="2.413042589s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-30 00:07:06 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 00:07:08.411532768 +0000 UTC m=+315.470749571" watchObservedRunningTime="2026-07-30 00:07:08.413042589 +0000 UTC m=+315.472259394"
Jul 30 00:07:09.375403 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:07:09.375369    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-6b45bfd7bb-kp4bm" event={"ID":"ba31c693-68e9-4a01-879f-62a25337eebe","Type":"ContainerStarted","Data":"68526cac9381e03fcdef17d49da34eae6d266fd4213437d43ca68010f8e2a53d"}
Jul 30 00:07:09.375853 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:07:09.375437    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-6b45bfd7bb-kp4bm" event={"ID":"ba31c693-68e9-4a01-879f-62a25337eebe","Type":"ContainerStarted","Data":"3aaf34dae26fc1d3d573a7535ab5b7d97d12b951eeeae447b09fdfeaf6646915"}
Jul 30 00:07:09.375853 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:07:09.375478    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/thanos-querier-6b45bfd7bb-kp4bm"
Jul 30 00:07:09.375853 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:07:09.375515    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-6b45bfd7bb-kp4bm" event={"ID":"ba31c693-68e9-4a01-879f-62a25337eebe","Type":"ContainerStarted","Data":"b160a9be203f3c58b1021d05e980242bc0afa161d17a8dd11fbd16e8dca26413"}
Jul 30 00:07:09.376915 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:07:09.376894    2560 generic.go:356] "Generic (PLEG): container finished" podID="3e055160-b969-4006-be53-f8624ce4acc2" containerID="807c21d07eb055cc5c69361c176a562ff56bd20fb6d3bf9407ca0f295ec557d9" exitCode=0
Jul 30 00:07:09.377010 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:07:09.376986    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"3e055160-b969-4006-be53-f8624ce4acc2","Type":"ContainerDied","Data":"807c21d07eb055cc5c69361c176a562ff56bd20fb6d3bf9407ca0f295ec557d9"}
Jul 30 00:07:09.395857 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:07:09.395818    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/thanos-querier-6b45bfd7bb-kp4bm" podStartSLOduration=3.553556712 podStartE2EDuration="7.395803799s" totalImagesPullingTime="3.842247087s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-30 00:07:02 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 00:07:09.394660296 +0000 UTC m=+316.453877132" watchObservedRunningTime="2026-07-30 00:07:09.395803799 +0000 UTC m=+316.455020602"
Jul 30 00:07:13.408231 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:07:13.408097    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"3e055160-b969-4006-be53-f8624ce4acc2","Type":"ContainerStarted","Data":"798fdffc31bfe3fe276eb229b726acb5791a3d6778fe5c274781c82120ef9900"}
Jul 30 00:07:13.408231 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:07:13.408178    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"3e055160-b969-4006-be53-f8624ce4acc2","Type":"ContainerStarted","Data":"8c11ce4b87cc6385696c845ed99ce033251c1a31d5eef69c2d0919484c456ce9"}
Jul 30 00:07:14.410952 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:07:14.410917    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"3e055160-b969-4006-be53-f8624ce4acc2","Type":"ContainerStarted","Data":"eb732a84eeb7805160e01d637f274e533ddbe0d309feac0e804d1e4f7a574b2b"}
Jul 30 00:07:14.411338 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:07:14.410979    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"3e055160-b969-4006-be53-f8624ce4acc2","Type":"ContainerStarted","Data":"5eee43097ee187ba3735eb5493393b9e592265b5970e3cd241a87984007912b5"}
Jul 30 00:07:14.411338 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:07:14.411004    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"3e055160-b969-4006-be53-f8624ce4acc2","Type":"ContainerStarted","Data":"1c0f3525164ad6424e8a36db4855a04cfa16b19620b9296299d1a702121c4f14"}
Jul 30 00:07:14.411338 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:07:14.411030    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"3e055160-b969-4006-be53-f8624ce4acc2","Type":"ContainerStarted","Data":"64971c162427d7994b07016a194c1074c2341396f69ed941bffae39ba82ba073"}
Jul 30 00:07:14.443594 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:07:14.443546    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=4.481703868 podStartE2EDuration="9.443531529s" totalImagesPullingTime="4.934004706s" totalInitContainerRuntime="27.822955ms" isStatefulPod=false podCreationTimestamp="2026-07-30 00:07:05 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 00:07:14.437975786 +0000 UTC m=+321.497192617" watchObservedRunningTime="2026-07-30 00:07:14.443531529 +0000 UTC m=+321.502748332"
Jul 30 00:07:15.388710 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:07:15.388684    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/thanos-querier-6b45bfd7bb-kp4bm"
Jul 30 00:07:15.899478 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:07:15.899445    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0"
Jul 30 00:07:17.122668 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:07:17.122633    2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-67df797bd9-7zcn4"
Jul 30 00:07:17.123073 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:07:17.122683    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-67df797bd9-7zcn4"
Jul 30 00:07:17.127432 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:07:17.127408    2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-67df797bd9-7zcn4"
Jul 30 00:07:17.426374 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:07:17.426347    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-67df797bd9-7zcn4"
Jul 30 00:07:17.468878 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:07:17.468848    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-6df644895b-wslwm"]
Jul 30 00:07:26.953813 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:07:26.953740    2560 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-image-registry/image-registry-777dddd7cd-bw4wt" podUID="29e3c7fe-e0a9-4098-8415-4c2f716a92eb" containerName="registry" containerID="cri-o://47b5c42e201a0716ba64b178fc8ed15c96a0f45aa64aa72f48ccd3dd273bcef0" gracePeriod=30
Jul 30 00:07:27.245536 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:07:27.245510    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-777dddd7cd-bw4wt"
Jul 30 00:07:27.385059 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:07:27.385023    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/29e3c7fe-e0a9-4098-8415-4c2f716a92eb-registry-certificates\") pod \"29e3c7fe-e0a9-4098-8415-4c2f716a92eb\" (UID: \"29e3c7fe-e0a9-4098-8415-4c2f716a92eb\") "
Jul 30 00:07:27.385212 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:07:27.385069    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/29e3c7fe-e0a9-4098-8415-4c2f716a92eb-bound-sa-token\") pod \"29e3c7fe-e0a9-4098-8415-4c2f716a92eb\" (UID: \"29e3c7fe-e0a9-4098-8415-4c2f716a92eb\") "
Jul 30 00:07:27.385212 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:07:27.385088    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-cz4x5\" (UniqueName: \"kubernetes.io/projected/29e3c7fe-e0a9-4098-8415-4c2f716a92eb-kube-api-access-cz4x5\") pod \"29e3c7fe-e0a9-4098-8415-4c2f716a92eb\" (UID: \"29e3c7fe-e0a9-4098-8415-4c2f716a92eb\") "
Jul 30 00:07:27.385212 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:07:27.385114    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/29e3c7fe-e0a9-4098-8415-4c2f716a92eb-trusted-ca\") pod \"29e3c7fe-e0a9-4098-8415-4c2f716a92eb\" (UID: \"29e3c7fe-e0a9-4098-8415-4c2f716a92eb\") "
Jul 30 00:07:27.385212 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:07:27.385139    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/29e3c7fe-e0a9-4098-8415-4c2f716a92eb-image-registry-private-configuration\") pod \"29e3c7fe-e0a9-4098-8415-4c2f716a92eb\" (UID: \"29e3c7fe-e0a9-4098-8415-4c2f716a92eb\") "
Jul 30 00:07:27.385212 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:07:27.385164    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/29e3c7fe-e0a9-4098-8415-4c2f716a92eb-installation-pull-secrets\") pod \"29e3c7fe-e0a9-4098-8415-4c2f716a92eb\" (UID: \"29e3c7fe-e0a9-4098-8415-4c2f716a92eb\") "
Jul 30 00:07:27.385567 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:07:27.385238    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/29e3c7fe-e0a9-4098-8415-4c2f716a92eb-registry-tls\") pod \"29e3c7fe-e0a9-4098-8415-4c2f716a92eb\" (UID: \"29e3c7fe-e0a9-4098-8415-4c2f716a92eb\") "
Jul 30 00:07:27.385567 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:07:27.385303    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/29e3c7fe-e0a9-4098-8415-4c2f716a92eb-ca-trust-extracted\") pod \"29e3c7fe-e0a9-4098-8415-4c2f716a92eb\" (UID: \"29e3c7fe-e0a9-4098-8415-4c2f716a92eb\") "
Jul 30 00:07:27.385667 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:07:27.385560    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/29e3c7fe-e0a9-4098-8415-4c2f716a92eb-registry-certificates" (OuterVolumeSpecName: "registry-certificates") pod "29e3c7fe-e0a9-4098-8415-4c2f716a92eb" (UID: "29e3c7fe-e0a9-4098-8415-4c2f716a92eb"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 30 00:07:27.385667 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:07:27.385623    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/29e3c7fe-e0a9-4098-8415-4c2f716a92eb-trusted-ca" (OuterVolumeSpecName: "trusted-ca") pod "29e3c7fe-e0a9-4098-8415-4c2f716a92eb" (UID: "29e3c7fe-e0a9-4098-8415-4c2f716a92eb"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 30 00:07:27.385764 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:07:27.385667    2560 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/29e3c7fe-e0a9-4098-8415-4c2f716a92eb-registry-certificates\") on node \"ip-10-0-133-55.ec2.internal\" DevicePath \"\""
Jul 30 00:07:27.387905 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:07:27.387866    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/29e3c7fe-e0a9-4098-8415-4c2f716a92eb-bound-sa-token" (OuterVolumeSpecName: "bound-sa-token") pod "29e3c7fe-e0a9-4098-8415-4c2f716a92eb" (UID: "29e3c7fe-e0a9-4098-8415-4c2f716a92eb"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 30 00:07:27.388066 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:07:27.387939    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/29e3c7fe-e0a9-4098-8415-4c2f716a92eb-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "29e3c7fe-e0a9-4098-8415-4c2f716a92eb" (UID: "29e3c7fe-e0a9-4098-8415-4c2f716a92eb"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 30 00:07:27.388147 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:07:27.388074    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/29e3c7fe-e0a9-4098-8415-4c2f716a92eb-kube-api-access-cz4x5" (OuterVolumeSpecName: "kube-api-access-cz4x5") pod "29e3c7fe-e0a9-4098-8415-4c2f716a92eb" (UID: "29e3c7fe-e0a9-4098-8415-4c2f716a92eb"). InnerVolumeSpecName "kube-api-access-cz4x5". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 30 00:07:27.388147 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:07:27.388106    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/29e3c7fe-e0a9-4098-8415-4c2f716a92eb-installation-pull-secrets" (OuterVolumeSpecName: "installation-pull-secrets") pod "29e3c7fe-e0a9-4098-8415-4c2f716a92eb" (UID: "29e3c7fe-e0a9-4098-8415-4c2f716a92eb"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 30 00:07:27.388250 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:07:27.388201    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/29e3c7fe-e0a9-4098-8415-4c2f716a92eb-image-registry-private-configuration" (OuterVolumeSpecName: "image-registry-private-configuration") pod "29e3c7fe-e0a9-4098-8415-4c2f716a92eb" (UID: "29e3c7fe-e0a9-4098-8415-4c2f716a92eb"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 30 00:07:27.394354 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:07:27.394292    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/29e3c7fe-e0a9-4098-8415-4c2f716a92eb-ca-trust-extracted" (OuterVolumeSpecName: "ca-trust-extracted") pod "29e3c7fe-e0a9-4098-8415-4c2f716a92eb" (UID: "29e3c7fe-e0a9-4098-8415-4c2f716a92eb"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 30 00:07:27.409847 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:07:27.409801    2560 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-7b4fbb6948-p47t2" podUID="6b882eab-fcc7-48fb-a729-802af0ba24b5" containerName="console" containerID="cri-o://b2c9b6bde5578f849517e44f24e0a340a3001287100e9a9693ce8e6be71d5830" gracePeriod=15
Jul 30 00:07:27.464985 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:07:27.464959    2560 generic.go:356] "Generic (PLEG): container finished" podID="29e3c7fe-e0a9-4098-8415-4c2f716a92eb" containerID="47b5c42e201a0716ba64b178fc8ed15c96a0f45aa64aa72f48ccd3dd273bcef0" exitCode=0
Jul 30 00:07:27.465093 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:07:27.465002    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-777dddd7cd-bw4wt"
Jul 30 00:07:27.465093 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:07:27.465041    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-777dddd7cd-bw4wt" event={"ID":"29e3c7fe-e0a9-4098-8415-4c2f716a92eb","Type":"ContainerDied","Data":"47b5c42e201a0716ba64b178fc8ed15c96a0f45aa64aa72f48ccd3dd273bcef0"}
Jul 30 00:07:27.465220 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:07:27.465098    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-777dddd7cd-bw4wt" event={"ID":"29e3c7fe-e0a9-4098-8415-4c2f716a92eb","Type":"ContainerDied","Data":"f4c6e14200a0b04e51e120758edd5aa9e64e9a2ef6d870f249cf0ca0068a2969"}
Jul 30 00:07:27.465220 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:07:27.465128    2560 scope.go:117] "RemoveContainer" containerID="47b5c42e201a0716ba64b178fc8ed15c96a0f45aa64aa72f48ccd3dd273bcef0"
Jul 30 00:07:27.486519 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:07:27.486498    2560 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/29e3c7fe-e0a9-4098-8415-4c2f716a92eb-trusted-ca\") on node \"ip-10-0-133-55.ec2.internal\" DevicePath \"\""
Jul 30 00:07:27.486519 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:07:27.486519    2560 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/29e3c7fe-e0a9-4098-8415-4c2f716a92eb-image-registry-private-configuration\") on node \"ip-10-0-133-55.ec2.internal\" DevicePath \"\""
Jul 30 00:07:27.486624 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:07:27.486528    2560 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/29e3c7fe-e0a9-4098-8415-4c2f716a92eb-installation-pull-secrets\") on node \"ip-10-0-133-55.ec2.internal\" DevicePath \"\""
Jul 30 00:07:27.486624 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:07:27.486537    2560 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/29e3c7fe-e0a9-4098-8415-4c2f716a92eb-registry-tls\") on node \"ip-10-0-133-55.ec2.internal\" DevicePath \"\""
Jul 30 00:07:27.486624 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:07:27.486545    2560 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/29e3c7fe-e0a9-4098-8415-4c2f716a92eb-ca-trust-extracted\") on node \"ip-10-0-133-55.ec2.internal\" DevicePath \"\""
Jul 30 00:07:27.486624 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:07:27.486554    2560 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/29e3c7fe-e0a9-4098-8415-4c2f716a92eb-bound-sa-token\") on node \"ip-10-0-133-55.ec2.internal\" DevicePath \"\""
Jul 30 00:07:27.486624 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:07:27.486562    2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-cz4x5\" (UniqueName: \"kubernetes.io/projected/29e3c7fe-e0a9-4098-8415-4c2f716a92eb-kube-api-access-cz4x5\") on node \"ip-10-0-133-55.ec2.internal\" DevicePath \"\""
Jul 30 00:07:27.522244 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:07:27.522225    2560 scope.go:117] "RemoveContainer" containerID="47b5c42e201a0716ba64b178fc8ed15c96a0f45aa64aa72f48ccd3dd273bcef0"
Jul 30 00:07:27.522626 ip-10-0-133-55 kubenswrapper[2560]: E0730 00:07:27.522603    2560 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"47b5c42e201a0716ba64b178fc8ed15c96a0f45aa64aa72f48ccd3dd273bcef0\": container with ID starting with 47b5c42e201a0716ba64b178fc8ed15c96a0f45aa64aa72f48ccd3dd273bcef0 not found: ID does not exist" containerID="47b5c42e201a0716ba64b178fc8ed15c96a0f45aa64aa72f48ccd3dd273bcef0"
Jul 30 00:07:27.522711 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:07:27.522634    2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"47b5c42e201a0716ba64b178fc8ed15c96a0f45aa64aa72f48ccd3dd273bcef0"} err="failed to get container status \"47b5c42e201a0716ba64b178fc8ed15c96a0f45aa64aa72f48ccd3dd273bcef0\": rpc error: code = NotFound desc = could not find container \"47b5c42e201a0716ba64b178fc8ed15c96a0f45aa64aa72f48ccd3dd273bcef0\": container with ID starting with 47b5c42e201a0716ba64b178fc8ed15c96a0f45aa64aa72f48ccd3dd273bcef0 not found: ID does not exist"
Jul 30 00:07:27.532241 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:07:27.532218    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-777dddd7cd-bw4wt"]
Jul 30 00:07:27.536441 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:07:27.536419    2560 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-777dddd7cd-bw4wt"]
Jul 30 00:07:27.702891 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:07:27.702862    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7b4fbb6948-p47t2"
Jul 30 00:07:27.788521 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:07:27.788450    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-r9sh4\" (UniqueName: \"kubernetes.io/projected/6b882eab-fcc7-48fb-a729-802af0ba24b5-kube-api-access-r9sh4\") pod \"6b882eab-fcc7-48fb-a729-802af0ba24b5\" (UID: \"6b882eab-fcc7-48fb-a729-802af0ba24b5\") "
Jul 30 00:07:27.788521 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:07:27.788482    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/6b882eab-fcc7-48fb-a729-802af0ba24b5-console-config\") pod \"6b882eab-fcc7-48fb-a729-802af0ba24b5\" (UID: \"6b882eab-fcc7-48fb-a729-802af0ba24b5\") "
Jul 30 00:07:27.788521 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:07:27.788507    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/6b882eab-fcc7-48fb-a729-802af0ba24b5-console-oauth-config\") pod \"6b882eab-fcc7-48fb-a729-802af0ba24b5\" (UID: \"6b882eab-fcc7-48fb-a729-802af0ba24b5\") "
Jul 30 00:07:27.788781 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:07:27.788546    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/6b882eab-fcc7-48fb-a729-802af0ba24b5-service-ca\") pod \"6b882eab-fcc7-48fb-a729-802af0ba24b5\" (UID: \"6b882eab-fcc7-48fb-a729-802af0ba24b5\") "
Jul 30 00:07:27.788781 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:07:27.788594    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/6b882eab-fcc7-48fb-a729-802af0ba24b5-oauth-serving-cert\") pod \"6b882eab-fcc7-48fb-a729-802af0ba24b5\" (UID: \"6b882eab-fcc7-48fb-a729-802af0ba24b5\") "
Jul 30 00:07:27.788781 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:07:27.788732    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/6b882eab-fcc7-48fb-a729-802af0ba24b5-console-serving-cert\") pod \"6b882eab-fcc7-48fb-a729-802af0ba24b5\" (UID: \"6b882eab-fcc7-48fb-a729-802af0ba24b5\") "
Jul 30 00:07:27.788957 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:07:27.788928    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6b882eab-fcc7-48fb-a729-802af0ba24b5-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "6b882eab-fcc7-48fb-a729-802af0ba24b5" (UID: "6b882eab-fcc7-48fb-a729-802af0ba24b5"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 30 00:07:27.789016 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:07:27.788955    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6b882eab-fcc7-48fb-a729-802af0ba24b5-service-ca" (OuterVolumeSpecName: "service-ca") pod "6b882eab-fcc7-48fb-a729-802af0ba24b5" (UID: "6b882eab-fcc7-48fb-a729-802af0ba24b5"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 30 00:07:27.789016 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:07:27.788982    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6b882eab-fcc7-48fb-a729-802af0ba24b5-console-config" (OuterVolumeSpecName: "console-config") pod "6b882eab-fcc7-48fb-a729-802af0ba24b5" (UID: "6b882eab-fcc7-48fb-a729-802af0ba24b5"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 30 00:07:27.789113 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:07:27.789077    2560 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/6b882eab-fcc7-48fb-a729-802af0ba24b5-console-config\") on node \"ip-10-0-133-55.ec2.internal\" DevicePath \"\""
Jul 30 00:07:27.789113 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:07:27.789091    2560 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/6b882eab-fcc7-48fb-a729-802af0ba24b5-service-ca\") on node \"ip-10-0-133-55.ec2.internal\" DevicePath \"\""
Jul 30 00:07:27.789113 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:07:27.789099    2560 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/6b882eab-fcc7-48fb-a729-802af0ba24b5-oauth-serving-cert\") on node \"ip-10-0-133-55.ec2.internal\" DevicePath \"\""
Jul 30 00:07:27.790699 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:07:27.790676    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6b882eab-fcc7-48fb-a729-802af0ba24b5-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "6b882eab-fcc7-48fb-a729-802af0ba24b5" (UID: "6b882eab-fcc7-48fb-a729-802af0ba24b5"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 30 00:07:27.790803 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:07:27.790705    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6b882eab-fcc7-48fb-a729-802af0ba24b5-kube-api-access-r9sh4" (OuterVolumeSpecName: "kube-api-access-r9sh4") pod "6b882eab-fcc7-48fb-a729-802af0ba24b5" (UID: "6b882eab-fcc7-48fb-a729-802af0ba24b5"). InnerVolumeSpecName "kube-api-access-r9sh4". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 30 00:07:27.790803 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:07:27.790729    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6b882eab-fcc7-48fb-a729-802af0ba24b5-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "6b882eab-fcc7-48fb-a729-802af0ba24b5" (UID: "6b882eab-fcc7-48fb-a729-802af0ba24b5"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 30 00:07:27.890145 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:07:27.890119    2560 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/6b882eab-fcc7-48fb-a729-802af0ba24b5-console-serving-cert\") on node \"ip-10-0-133-55.ec2.internal\" DevicePath \"\""
Jul 30 00:07:27.890145 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:07:27.890142    2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-r9sh4\" (UniqueName: \"kubernetes.io/projected/6b882eab-fcc7-48fb-a729-802af0ba24b5-kube-api-access-r9sh4\") on node \"ip-10-0-133-55.ec2.internal\" DevicePath \"\""
Jul 30 00:07:27.890145 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:07:27.890152    2560 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/6b882eab-fcc7-48fb-a729-802af0ba24b5-console-oauth-config\") on node \"ip-10-0-133-55.ec2.internal\" DevicePath \"\""
Jul 30 00:07:28.473056 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:07:28.473016    2560 generic.go:356] "Generic (PLEG): container finished" podID="6b882eab-fcc7-48fb-a729-802af0ba24b5" containerID="b2c9b6bde5578f849517e44f24e0a340a3001287100e9a9693ce8e6be71d5830" exitCode=0
Jul 30 00:07:28.473056 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:07:28.473051    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7b4fbb6948-p47t2"
Jul 30 00:07:28.473534 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:07:28.473128    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7b4fbb6948-p47t2" event={"ID":"6b882eab-fcc7-48fb-a729-802af0ba24b5","Type":"ContainerDied","Data":"b2c9b6bde5578f849517e44f24e0a340a3001287100e9a9693ce8e6be71d5830"}
Jul 30 00:07:28.473534 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:07:28.473180    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7b4fbb6948-p47t2" event={"ID":"6b882eab-fcc7-48fb-a729-802af0ba24b5","Type":"ContainerDied","Data":"f8c3bc28d46f77a272bdea1eca8030cb382b6cdff179b863fb9635e9693b4150"}
Jul 30 00:07:28.473534 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:07:28.473201    2560 scope.go:117] "RemoveContainer" containerID="b2c9b6bde5578f849517e44f24e0a340a3001287100e9a9693ce8e6be71d5830"
Jul 30 00:07:28.488010 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:07:28.487990    2560 scope.go:117] "RemoveContainer" containerID="b2c9b6bde5578f849517e44f24e0a340a3001287100e9a9693ce8e6be71d5830"
Jul 30 00:07:28.488257 ip-10-0-133-55 kubenswrapper[2560]: E0730 00:07:28.488237    2560 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b2c9b6bde5578f849517e44f24e0a340a3001287100e9a9693ce8e6be71d5830\": container with ID starting with b2c9b6bde5578f849517e44f24e0a340a3001287100e9a9693ce8e6be71d5830 not found: ID does not exist" containerID="b2c9b6bde5578f849517e44f24e0a340a3001287100e9a9693ce8e6be71d5830"
Jul 30 00:07:28.488350 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:07:28.488269    2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b2c9b6bde5578f849517e44f24e0a340a3001287100e9a9693ce8e6be71d5830"} err="failed to get container status \"b2c9b6bde5578f849517e44f24e0a340a3001287100e9a9693ce8e6be71d5830\": rpc error: code = NotFound desc = could not find container \"b2c9b6bde5578f849517e44f24e0a340a3001287100e9a9693ce8e6be71d5830\": container with ID starting with b2c9b6bde5578f849517e44f24e0a340a3001287100e9a9693ce8e6be71d5830 not found: ID does not exist"
Jul 30 00:07:28.497409 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:07:28.497373    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-7b4fbb6948-p47t2"]
Jul 30 00:07:28.499291 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:07:28.499272    2560 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-7b4fbb6948-p47t2"]
Jul 30 00:07:29.404198 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:07:29.404165    2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="29e3c7fe-e0a9-4098-8415-4c2f716a92eb" path="/var/lib/kubelet/pods/29e3c7fe-e0a9-4098-8415-4c2f716a92eb/volumes"
Jul 30 00:07:29.404587 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:07:29.404573    2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="6b882eab-fcc7-48fb-a729-802af0ba24b5" path="/var/lib/kubelet/pods/6b882eab-fcc7-48fb-a729-802af0ba24b5/volumes"
Jul 30 00:07:38.514684 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:07:38.514653    2560 generic.go:356] "Generic (PLEG): container finished" podID="660cabd1-7819-4fb9-aae2-76019d1fa428" containerID="5fa996dad3395c08682863eaa8be6e405cd2d8235e1940e26d37268dd78b6bc8" exitCode=0
Jul 30 00:07:38.515056 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:07:38.514709    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-5885fdb759-kxgst" event={"ID":"660cabd1-7819-4fb9-aae2-76019d1fa428","Type":"ContainerDied","Data":"5fa996dad3395c08682863eaa8be6e405cd2d8235e1940e26d37268dd78b6bc8"}
Jul 30 00:07:38.515056 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:07:38.515018    2560 scope.go:117] "RemoveContainer" containerID="5fa996dad3395c08682863eaa8be6e405cd2d8235e1940e26d37268dd78b6bc8"
Jul 30 00:07:39.520836 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:07:39.520799    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-5885fdb759-kxgst" event={"ID":"660cabd1-7819-4fb9-aae2-76019d1fa428","Type":"ContainerStarted","Data":"223b64ae46b00911f67324faba52657963f109ebc01cebefb474df9c474ae85d"}
Jul 30 00:07:42.488448 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:07:42.488389    2560 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-6df644895b-wslwm" podUID="86d7c62c-c012-4722-9599-b2d9ff4c73bd" containerName="console" containerID="cri-o://13cff55f13587cabf18b7b14b8071f06f4fe27b0a044982cc288781f0ffc1fe3" gracePeriod=15
Jul 30 00:07:42.733428 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:07:42.733402    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6df644895b-wslwm"
Jul 30 00:07:42.832869 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:07:42.832782    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/86d7c62c-c012-4722-9599-b2d9ff4c73bd-console-config\") pod \"86d7c62c-c012-4722-9599-b2d9ff4c73bd\" (UID: \"86d7c62c-c012-4722-9599-b2d9ff4c73bd\") "
Jul 30 00:07:42.832869 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:07:42.832838    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/86d7c62c-c012-4722-9599-b2d9ff4c73bd-oauth-serving-cert\") pod \"86d7c62c-c012-4722-9599-b2d9ff4c73bd\" (UID: \"86d7c62c-c012-4722-9599-b2d9ff4c73bd\") "
Jul 30 00:07:42.832869 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:07:42.832862    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/86d7c62c-c012-4722-9599-b2d9ff4c73bd-trusted-ca-bundle\") pod \"86d7c62c-c012-4722-9599-b2d9ff4c73bd\" (UID: \"86d7c62c-c012-4722-9599-b2d9ff4c73bd\") "
Jul 30 00:07:42.833132 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:07:42.832892    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/86d7c62c-c012-4722-9599-b2d9ff4c73bd-console-oauth-config\") pod \"86d7c62c-c012-4722-9599-b2d9ff4c73bd\" (UID: \"86d7c62c-c012-4722-9599-b2d9ff4c73bd\") "
Jul 30 00:07:42.833132 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:07:42.832915    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/86d7c62c-c012-4722-9599-b2d9ff4c73bd-service-ca\") pod \"86d7c62c-c012-4722-9599-b2d9ff4c73bd\" (UID: \"86d7c62c-c012-4722-9599-b2d9ff4c73bd\") "
Jul 30 00:07:42.833256 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:07:42.833230    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/86d7c62c-c012-4722-9599-b2d9ff4c73bd-console-config" (OuterVolumeSpecName: "console-config") pod "86d7c62c-c012-4722-9599-b2d9ff4c73bd" (UID: "86d7c62c-c012-4722-9599-b2d9ff4c73bd"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 30 00:07:42.833302 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:07:42.833278    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/86d7c62c-c012-4722-9599-b2d9ff4c73bd-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "86d7c62c-c012-4722-9599-b2d9ff4c73bd" (UID: "86d7c62c-c012-4722-9599-b2d9ff4c73bd"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 30 00:07:42.833376 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:07:42.833361    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/86d7c62c-c012-4722-9599-b2d9ff4c73bd-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "86d7c62c-c012-4722-9599-b2d9ff4c73bd" (UID: "86d7c62c-c012-4722-9599-b2d9ff4c73bd"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 30 00:07:42.833420 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:07:42.833397    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/86d7c62c-c012-4722-9599-b2d9ff4c73bd-service-ca" (OuterVolumeSpecName: "service-ca") pod "86d7c62c-c012-4722-9599-b2d9ff4c73bd" (UID: "86d7c62c-c012-4722-9599-b2d9ff4c73bd"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 30 00:07:42.835005 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:07:42.834979    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/86d7c62c-c012-4722-9599-b2d9ff4c73bd-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "86d7c62c-c012-4722-9599-b2d9ff4c73bd" (UID: "86d7c62c-c012-4722-9599-b2d9ff4c73bd"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 30 00:07:42.933465 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:07:42.933432    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-dwqtx\" (UniqueName: \"kubernetes.io/projected/86d7c62c-c012-4722-9599-b2d9ff4c73bd-kube-api-access-dwqtx\") pod \"86d7c62c-c012-4722-9599-b2d9ff4c73bd\" (UID: \"86d7c62c-c012-4722-9599-b2d9ff4c73bd\") "
Jul 30 00:07:42.933465 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:07:42.933472    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/86d7c62c-c012-4722-9599-b2d9ff4c73bd-console-serving-cert\") pod \"86d7c62c-c012-4722-9599-b2d9ff4c73bd\" (UID: \"86d7c62c-c012-4722-9599-b2d9ff4c73bd\") "
Jul 30 00:07:42.933653 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:07:42.933609    2560 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/86d7c62c-c012-4722-9599-b2d9ff4c73bd-console-config\") on node \"ip-10-0-133-55.ec2.internal\" DevicePath \"\""
Jul 30 00:07:42.933653 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:07:42.933620    2560 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/86d7c62c-c012-4722-9599-b2d9ff4c73bd-oauth-serving-cert\") on node \"ip-10-0-133-55.ec2.internal\" DevicePath \"\""
Jul 30 00:07:42.933653 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:07:42.933629    2560 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/86d7c62c-c012-4722-9599-b2d9ff4c73bd-trusted-ca-bundle\") on node \"ip-10-0-133-55.ec2.internal\" DevicePath \"\""
Jul 30 00:07:42.933653 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:07:42.933638    2560 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/86d7c62c-c012-4722-9599-b2d9ff4c73bd-console-oauth-config\") on node \"ip-10-0-133-55.ec2.internal\" DevicePath \"\""
Jul 30 00:07:42.933653 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:07:42.933646    2560 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/86d7c62c-c012-4722-9599-b2d9ff4c73bd-service-ca\") on node \"ip-10-0-133-55.ec2.internal\" DevicePath \"\""
Jul 30 00:07:42.935400 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:07:42.935375    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/86d7c62c-c012-4722-9599-b2d9ff4c73bd-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "86d7c62c-c012-4722-9599-b2d9ff4c73bd" (UID: "86d7c62c-c012-4722-9599-b2d9ff4c73bd"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 30 00:07:42.935481 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:07:42.935414    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/86d7c62c-c012-4722-9599-b2d9ff4c73bd-kube-api-access-dwqtx" (OuterVolumeSpecName: "kube-api-access-dwqtx") pod "86d7c62c-c012-4722-9599-b2d9ff4c73bd" (UID: "86d7c62c-c012-4722-9599-b2d9ff4c73bd"). InnerVolumeSpecName "kube-api-access-dwqtx". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 30 00:07:43.034465 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:07:43.034435    2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-dwqtx\" (UniqueName: \"kubernetes.io/projected/86d7c62c-c012-4722-9599-b2d9ff4c73bd-kube-api-access-dwqtx\") on node \"ip-10-0-133-55.ec2.internal\" DevicePath \"\""
Jul 30 00:07:43.034465 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:07:43.034459    2560 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/86d7c62c-c012-4722-9599-b2d9ff4c73bd-console-serving-cert\") on node \"ip-10-0-133-55.ec2.internal\" DevicePath \"\""
Jul 30 00:07:43.537926 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:07:43.537892    2560 generic.go:356] "Generic (PLEG): container finished" podID="86d7c62c-c012-4722-9599-b2d9ff4c73bd" containerID="13cff55f13587cabf18b7b14b8071f06f4fe27b0a044982cc288781f0ffc1fe3" exitCode=0
Jul 30 00:07:43.538407 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:07:43.537942    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6df644895b-wslwm"
Jul 30 00:07:43.538407 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:07:43.537975    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6df644895b-wslwm" event={"ID":"86d7c62c-c012-4722-9599-b2d9ff4c73bd","Type":"ContainerDied","Data":"13cff55f13587cabf18b7b14b8071f06f4fe27b0a044982cc288781f0ffc1fe3"}
Jul 30 00:07:43.538407 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:07:43.538026    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6df644895b-wslwm" event={"ID":"86d7c62c-c012-4722-9599-b2d9ff4c73bd","Type":"ContainerDied","Data":"6398f832b8aba1e95436c7b884578d810e102ceb0c30bae9a6dac5032587f742"}
Jul 30 00:07:43.538407 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:07:43.538048    2560 scope.go:117] "RemoveContainer" containerID="13cff55f13587cabf18b7b14b8071f06f4fe27b0a044982cc288781f0ffc1fe3"
Jul 30 00:07:43.545981 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:07:43.545965    2560 scope.go:117] "RemoveContainer" containerID="13cff55f13587cabf18b7b14b8071f06f4fe27b0a044982cc288781f0ffc1fe3"
Jul 30 00:07:43.546239 ip-10-0-133-55 kubenswrapper[2560]: E0730 00:07:43.546216    2560 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"13cff55f13587cabf18b7b14b8071f06f4fe27b0a044982cc288781f0ffc1fe3\": container with ID starting with 13cff55f13587cabf18b7b14b8071f06f4fe27b0a044982cc288781f0ffc1fe3 not found: ID does not exist" containerID="13cff55f13587cabf18b7b14b8071f06f4fe27b0a044982cc288781f0ffc1fe3"
Jul 30 00:07:43.546286 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:07:43.546238    2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"13cff55f13587cabf18b7b14b8071f06f4fe27b0a044982cc288781f0ffc1fe3"} err="failed to get container status \"13cff55f13587cabf18b7b14b8071f06f4fe27b0a044982cc288781f0ffc1fe3\": rpc error: code = NotFound desc = could not find container \"13cff55f13587cabf18b7b14b8071f06f4fe27b0a044982cc288781f0ffc1fe3\": container with ID starting with 13cff55f13587cabf18b7b14b8071f06f4fe27b0a044982cc288781f0ffc1fe3 not found: ID does not exist"
Jul 30 00:07:43.552465 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:07:43.552444    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-6df644895b-wslwm"]
Jul 30 00:07:43.556175 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:07:43.556152    2560 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-6df644895b-wslwm"]
Jul 30 00:07:45.403952 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:07:45.403917    2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="86d7c62c-c012-4722-9599-b2d9ff4c73bd" path="/var/lib/kubelet/pods/86d7c62c-c012-4722-9599-b2d9ff4c73bd/volumes"
Jul 30 00:08:05.899429 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:08:05.899384    2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0"
Jul 30 00:08:05.918329 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:08:05.918287    2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0"
Jul 30 00:08:06.650677 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:08:06.650646    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0"
Jul 30 00:08:07.333978 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:08:07.333935    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/05dcf00e-2c10-495a-b61b-9221eb8286e5-metrics-certs\") pod \"network-metrics-daemon-9g97b\" (UID: \"05dcf00e-2c10-495a-b61b-9221eb8286e5\") " pod="openshift-multus/network-metrics-daemon-9g97b"
Jul 30 00:08:07.336335 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:08:07.336286    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/05dcf00e-2c10-495a-b61b-9221eb8286e5-metrics-certs\") pod \"network-metrics-daemon-9g97b\" (UID: \"05dcf00e-2c10-495a-b61b-9221eb8286e5\") " pod="openshift-multus/network-metrics-daemon-9g97b"
Jul 30 00:08:07.602576 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:08:07.602497    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-qpk4b\""
Jul 30 00:08:07.610376 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:08:07.610345    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-9g97b"
Jul 30 00:08:07.738743 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:08:07.738722    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-9g97b"]
Jul 30 00:08:07.740841 ip-10-0-133-55 kubenswrapper[2560]: W0730 00:08:07.740816    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod05dcf00e_2c10_495a_b61b_9221eb8286e5.slice/crio-e916e00530903f630538734187661fcfcb85693da77b3954a707760672b39a7a WatchSource:0}: Error finding container e916e00530903f630538734187661fcfcb85693da77b3954a707760672b39a7a: Status 404 returned error can't find the container with id e916e00530903f630538734187661fcfcb85693da77b3954a707760672b39a7a
Jul 30 00:08:08.645191 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:08:08.645157    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-9g97b" event={"ID":"05dcf00e-2c10-495a-b61b-9221eb8286e5","Type":"ContainerStarted","Data":"e916e00530903f630538734187661fcfcb85693da77b3954a707760672b39a7a"}
Jul 30 00:08:09.650431 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:08:09.650393    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-9g97b" event={"ID":"05dcf00e-2c10-495a-b61b-9221eb8286e5","Type":"ContainerStarted","Data":"7ef12407286b8e2f00adf3728985a74a74549c4105e70b46a16a1cd0f636659d"}
Jul 30 00:08:09.650819 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:08:09.650450    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-9g97b" event={"ID":"05dcf00e-2c10-495a-b61b-9221eb8286e5","Type":"ContainerStarted","Data":"fea599e0f54ae585f552101c6d914e4a20a181a0715216cf34b45bc677ffc992"}
Jul 30 00:08:09.668865 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:08:09.668810    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-9g97b" podStartSLOduration=375.796847918 podStartE2EDuration="6m16.668795224s" totalImagesPullingTime="871.947306ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-30 00:01:53 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 00:08:09.666598019 +0000 UTC m=+376.725814822" watchObservedRunningTime="2026-07-30 00:08:09.668795224 +0000 UTC m=+376.728012070"
Jul 30 00:08:27.252685 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:08:27.252648    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-59c4f4c8c-ws7gs"]
Jul 30 00:08:27.253559 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:08:27.253537    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6b882eab-fcc7-48fb-a729-802af0ba24b5" containerName="console"
Jul 30 00:08:27.253559 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:08:27.253558    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="6b882eab-fcc7-48fb-a729-802af0ba24b5" containerName="console"
Jul 30 00:08:27.253714 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:08:27.253570    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="29e3c7fe-e0a9-4098-8415-4c2f716a92eb" containerName="registry"
Jul 30 00:08:27.253714 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:08:27.253575    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="29e3c7fe-e0a9-4098-8415-4c2f716a92eb" containerName="registry"
Jul 30 00:08:27.253714 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:08:27.253586    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="86d7c62c-c012-4722-9599-b2d9ff4c73bd" containerName="console"
Jul 30 00:08:27.253714 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:08:27.253592    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="86d7c62c-c012-4722-9599-b2d9ff4c73bd" containerName="console"
Jul 30 00:08:27.253714 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:08:27.253646    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="6b882eab-fcc7-48fb-a729-802af0ba24b5" containerName="console"
Jul 30 00:08:27.253714 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:08:27.253656    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="29e3c7fe-e0a9-4098-8415-4c2f716a92eb" containerName="registry"
Jul 30 00:08:27.253714 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:08:27.253665    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="86d7c62c-c012-4722-9599-b2d9ff4c73bd" containerName="console"
Jul 30 00:08:27.256686 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:08:27.256667    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-59c4f4c8c-ws7gs"
Jul 30 00:08:27.265020 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:08:27.264995    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-59c4f4c8c-ws7gs"]
Jul 30 00:08:27.402877 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:08:27.402840    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/7bdf9de2-885f-4f20-aca3-7c1e2abc6152-service-ca\") pod \"console-59c4f4c8c-ws7gs\" (UID: \"7bdf9de2-885f-4f20-aca3-7c1e2abc6152\") " pod="openshift-console/console-59c4f4c8c-ws7gs"
Jul 30 00:08:27.403068 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:08:27.402887    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/7bdf9de2-885f-4f20-aca3-7c1e2abc6152-console-config\") pod \"console-59c4f4c8c-ws7gs\" (UID: \"7bdf9de2-885f-4f20-aca3-7c1e2abc6152\") " pod="openshift-console/console-59c4f4c8c-ws7gs"
Jul 30 00:08:27.403068 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:08:27.402910    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7bdf9de2-885f-4f20-aca3-7c1e2abc6152-trusted-ca-bundle\") pod \"console-59c4f4c8c-ws7gs\" (UID: \"7bdf9de2-885f-4f20-aca3-7c1e2abc6152\") " pod="openshift-console/console-59c4f4c8c-ws7gs"
Jul 30 00:08:27.403068 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:08:27.402969    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/7bdf9de2-885f-4f20-aca3-7c1e2abc6152-console-serving-cert\") pod \"console-59c4f4c8c-ws7gs\" (UID: \"7bdf9de2-885f-4f20-aca3-7c1e2abc6152\") " pod="openshift-console/console-59c4f4c8c-ws7gs"
Jul 30 00:08:27.403068 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:08:27.402999    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/7bdf9de2-885f-4f20-aca3-7c1e2abc6152-oauth-serving-cert\") pod \"console-59c4f4c8c-ws7gs\" (UID: \"7bdf9de2-885f-4f20-aca3-7c1e2abc6152\") " pod="openshift-console/console-59c4f4c8c-ws7gs"
Jul 30 00:08:27.403068 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:08:27.403016    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pk5rn\" (UniqueName: \"kubernetes.io/projected/7bdf9de2-885f-4f20-aca3-7c1e2abc6152-kube-api-access-pk5rn\") pod \"console-59c4f4c8c-ws7gs\" (UID: \"7bdf9de2-885f-4f20-aca3-7c1e2abc6152\") " pod="openshift-console/console-59c4f4c8c-ws7gs"
Jul 30 00:08:27.403265 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:08:27.403073    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/7bdf9de2-885f-4f20-aca3-7c1e2abc6152-console-oauth-config\") pod \"console-59c4f4c8c-ws7gs\" (UID: \"7bdf9de2-885f-4f20-aca3-7c1e2abc6152\") " pod="openshift-console/console-59c4f4c8c-ws7gs"
Jul 30 00:08:27.503974 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:08:27.503888    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/7bdf9de2-885f-4f20-aca3-7c1e2abc6152-console-serving-cert\") pod \"console-59c4f4c8c-ws7gs\" (UID: \"7bdf9de2-885f-4f20-aca3-7c1e2abc6152\") " pod="openshift-console/console-59c4f4c8c-ws7gs"
Jul 30 00:08:27.503974 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:08:27.503928    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/7bdf9de2-885f-4f20-aca3-7c1e2abc6152-oauth-serving-cert\") pod \"console-59c4f4c8c-ws7gs\" (UID: \"7bdf9de2-885f-4f20-aca3-7c1e2abc6152\") " pod="openshift-console/console-59c4f4c8c-ws7gs"
Jul 30 00:08:27.503974 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:08:27.503953    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pk5rn\" (UniqueName: \"kubernetes.io/projected/7bdf9de2-885f-4f20-aca3-7c1e2abc6152-kube-api-access-pk5rn\") pod \"console-59c4f4c8c-ws7gs\" (UID: \"7bdf9de2-885f-4f20-aca3-7c1e2abc6152\") " pod="openshift-console/console-59c4f4c8c-ws7gs"
Jul 30 00:08:27.504293 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:08:27.503990    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/7bdf9de2-885f-4f20-aca3-7c1e2abc6152-console-oauth-config\") pod \"console-59c4f4c8c-ws7gs\" (UID: \"7bdf9de2-885f-4f20-aca3-7c1e2abc6152\") " pod="openshift-console/console-59c4f4c8c-ws7gs"
Jul 30 00:08:27.504293 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:08:27.504018    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/7bdf9de2-885f-4f20-aca3-7c1e2abc6152-service-ca\") pod \"console-59c4f4c8c-ws7gs\" (UID: \"7bdf9de2-885f-4f20-aca3-7c1e2abc6152\") " pod="openshift-console/console-59c4f4c8c-ws7gs"
Jul 30 00:08:27.504419 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:08:27.504346    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/7bdf9de2-885f-4f20-aca3-7c1e2abc6152-console-config\") pod \"console-59c4f4c8c-ws7gs\" (UID: \"7bdf9de2-885f-4f20-aca3-7c1e2abc6152\") " pod="openshift-console/console-59c4f4c8c-ws7gs"
Jul 30 00:08:27.504918 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:08:27.504885    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/7bdf9de2-885f-4f20-aca3-7c1e2abc6152-service-ca\") pod \"console-59c4f4c8c-ws7gs\" (UID: \"7bdf9de2-885f-4f20-aca3-7c1e2abc6152\") " pod="openshift-console/console-59c4f4c8c-ws7gs"
Jul 30 00:08:27.505022 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:08:27.504914    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/7bdf9de2-885f-4f20-aca3-7c1e2abc6152-oauth-serving-cert\") pod \"console-59c4f4c8c-ws7gs\" (UID: \"7bdf9de2-885f-4f20-aca3-7c1e2abc6152\") " pod="openshift-console/console-59c4f4c8c-ws7gs"
Jul 30 00:08:27.505022 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:08:27.504921    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/7bdf9de2-885f-4f20-aca3-7c1e2abc6152-console-config\") pod \"console-59c4f4c8c-ws7gs\" (UID: \"7bdf9de2-885f-4f20-aca3-7c1e2abc6152\") " pod="openshift-console/console-59c4f4c8c-ws7gs"
Jul 30 00:08:27.505022 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:08:27.504960    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7bdf9de2-885f-4f20-aca3-7c1e2abc6152-trusted-ca-bundle\") pod \"console-59c4f4c8c-ws7gs\" (UID: \"7bdf9de2-885f-4f20-aca3-7c1e2abc6152\") " pod="openshift-console/console-59c4f4c8c-ws7gs"
Jul 30 00:08:27.505387 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:08:27.505364    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7bdf9de2-885f-4f20-aca3-7c1e2abc6152-trusted-ca-bundle\") pod \"console-59c4f4c8c-ws7gs\" (UID: \"7bdf9de2-885f-4f20-aca3-7c1e2abc6152\") " pod="openshift-console/console-59c4f4c8c-ws7gs"
Jul 30 00:08:27.506537 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:08:27.506515    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/7bdf9de2-885f-4f20-aca3-7c1e2abc6152-console-serving-cert\") pod \"console-59c4f4c8c-ws7gs\" (UID: \"7bdf9de2-885f-4f20-aca3-7c1e2abc6152\") " pod="openshift-console/console-59c4f4c8c-ws7gs"
Jul 30 00:08:27.506636 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:08:27.506540    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/7bdf9de2-885f-4f20-aca3-7c1e2abc6152-console-oauth-config\") pod \"console-59c4f4c8c-ws7gs\" (UID: \"7bdf9de2-885f-4f20-aca3-7c1e2abc6152\") " pod="openshift-console/console-59c4f4c8c-ws7gs"
Jul 30 00:08:27.511061 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:08:27.511035    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pk5rn\" (UniqueName: \"kubernetes.io/projected/7bdf9de2-885f-4f20-aca3-7c1e2abc6152-kube-api-access-pk5rn\") pod \"console-59c4f4c8c-ws7gs\" (UID: \"7bdf9de2-885f-4f20-aca3-7c1e2abc6152\") " pod="openshift-console/console-59c4f4c8c-ws7gs"
Jul 30 00:08:27.567241 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:08:27.567209    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-59c4f4c8c-ws7gs"
Jul 30 00:08:27.702357 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:08:27.702332    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-59c4f4c8c-ws7gs"]
Jul 30 00:08:27.704161 ip-10-0-133-55 kubenswrapper[2560]: W0730 00:08:27.704134    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7bdf9de2_885f_4f20_aca3_7c1e2abc6152.slice/crio-d7a8cdee9fc453e845f4a5041d2ee8727e9656261abd61df6670badd42c0860b WatchSource:0}: Error finding container d7a8cdee9fc453e845f4a5041d2ee8727e9656261abd61df6670badd42c0860b: Status 404 returned error can't find the container with id d7a8cdee9fc453e845f4a5041d2ee8727e9656261abd61df6670badd42c0860b
Jul 30 00:08:27.721727 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:08:27.721700    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-59c4f4c8c-ws7gs" event={"ID":"7bdf9de2-885f-4f20-aca3-7c1e2abc6152","Type":"ContainerStarted","Data":"d7a8cdee9fc453e845f4a5041d2ee8727e9656261abd61df6670badd42c0860b"}
Jul 30 00:08:28.727975 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:08:28.727940    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-59c4f4c8c-ws7gs" event={"ID":"7bdf9de2-885f-4f20-aca3-7c1e2abc6152","Type":"ContainerStarted","Data":"e3287a09f0cc7f11ebcdf3a7fdd2dd44dbce707a37eadc8d74fb0bb420459d10"}
Jul 30 00:08:28.744654 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:08:28.744603    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-59c4f4c8c-ws7gs" podStartSLOduration=1.744589323 podStartE2EDuration="1.744589323s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-30 00:08:27 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 00:08:28.743398752 +0000 UTC m=+395.802615556" watchObservedRunningTime="2026-07-30 00:08:28.744589323 +0000 UTC m=+395.803806126"
Jul 30 00:08:37.567571 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:08:37.567536    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-59c4f4c8c-ws7gs"
Jul 30 00:08:37.568056 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:08:37.567596    2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-59c4f4c8c-ws7gs"
Jul 30 00:08:37.572471 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:08:37.572446    2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-59c4f4c8c-ws7gs"
Jul 30 00:08:37.768191 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:08:37.768162    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-59c4f4c8c-ws7gs"
Jul 30 00:08:37.807783 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:08:37.807752    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-67df797bd9-7zcn4"]
Jul 30 00:08:37.876495 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:08:37.876463    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-599858b585-v7xck"]
Jul 30 00:08:37.880478 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:08:37.880455    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-599858b585-v7xck"
Jul 30 00:08:37.887859 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:08:37.887829    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-599858b585-v7xck"]
Jul 30 00:08:37.897212 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:08:37.897156    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/f56dcb5e-35af-4685-bbda-bc1571f0604a-console-oauth-config\") pod \"console-599858b585-v7xck\" (UID: \"f56dcb5e-35af-4685-bbda-bc1571f0604a\") " pod="openshift-console/console-599858b585-v7xck"
Jul 30 00:08:37.897212 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:08:37.897198    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/f56dcb5e-35af-4685-bbda-bc1571f0604a-service-ca\") pod \"console-599858b585-v7xck\" (UID: \"f56dcb5e-35af-4685-bbda-bc1571f0604a\") " pod="openshift-console/console-599858b585-v7xck"
Jul 30 00:08:37.897425 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:08:37.897225    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/f56dcb5e-35af-4685-bbda-bc1571f0604a-console-serving-cert\") pod \"console-599858b585-v7xck\" (UID: \"f56dcb5e-35af-4685-bbda-bc1571f0604a\") " pod="openshift-console/console-599858b585-v7xck"
Jul 30 00:08:37.897425 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:08:37.897271    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pjmms\" (UniqueName: \"kubernetes.io/projected/f56dcb5e-35af-4685-bbda-bc1571f0604a-kube-api-access-pjmms\") pod \"console-599858b585-v7xck\" (UID: \"f56dcb5e-35af-4685-bbda-bc1571f0604a\") " pod="openshift-console/console-599858b585-v7xck"
Jul 30 00:08:37.897425 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:08:37.897370    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/f56dcb5e-35af-4685-bbda-bc1571f0604a-console-config\") pod \"console-599858b585-v7xck\" (UID: \"f56dcb5e-35af-4685-bbda-bc1571f0604a\") " pod="openshift-console/console-599858b585-v7xck"
Jul 30 00:08:37.897425 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:08:37.897416    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f56dcb5e-35af-4685-bbda-bc1571f0604a-trusted-ca-bundle\") pod \"console-599858b585-v7xck\" (UID: \"f56dcb5e-35af-4685-bbda-bc1571f0604a\") " pod="openshift-console/console-599858b585-v7xck"
Jul 30 00:08:37.897621 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:08:37.897449    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/f56dcb5e-35af-4685-bbda-bc1571f0604a-oauth-serving-cert\") pod \"console-599858b585-v7xck\" (UID: \"f56dcb5e-35af-4685-bbda-bc1571f0604a\") " pod="openshift-console/console-599858b585-v7xck"
Jul 30 00:08:37.998476 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:08:37.998446    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/f56dcb5e-35af-4685-bbda-bc1571f0604a-service-ca\") pod \"console-599858b585-v7xck\" (UID: \"f56dcb5e-35af-4685-bbda-bc1571f0604a\") " pod="openshift-console/console-599858b585-v7xck"
Jul 30 00:08:37.998476 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:08:37.998477    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/f56dcb5e-35af-4685-bbda-bc1571f0604a-console-serving-cert\") pod \"console-599858b585-v7xck\" (UID: \"f56dcb5e-35af-4685-bbda-bc1571f0604a\") " pod="openshift-console/console-599858b585-v7xck"
Jul 30 00:08:37.998671 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:08:37.998495    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pjmms\" (UniqueName: \"kubernetes.io/projected/f56dcb5e-35af-4685-bbda-bc1571f0604a-kube-api-access-pjmms\") pod \"console-599858b585-v7xck\" (UID: \"f56dcb5e-35af-4685-bbda-bc1571f0604a\") " pod="openshift-console/console-599858b585-v7xck"
Jul 30 00:08:37.998671 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:08:37.998531    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/f56dcb5e-35af-4685-bbda-bc1571f0604a-console-config\") pod \"console-599858b585-v7xck\" (UID: \"f56dcb5e-35af-4685-bbda-bc1571f0604a\") " pod="openshift-console/console-599858b585-v7xck"
Jul 30 00:08:37.998671 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:08:37.998562    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f56dcb5e-35af-4685-bbda-bc1571f0604a-trusted-ca-bundle\") pod \"console-599858b585-v7xck\" (UID: \"f56dcb5e-35af-4685-bbda-bc1571f0604a\") " pod="openshift-console/console-599858b585-v7xck"
Jul 30 00:08:37.998671 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:08:37.998585    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/f56dcb5e-35af-4685-bbda-bc1571f0604a-oauth-serving-cert\") pod \"console-599858b585-v7xck\" (UID: \"f56dcb5e-35af-4685-bbda-bc1571f0604a\") " pod="openshift-console/console-599858b585-v7xck"
Jul 30 00:08:37.998671 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:08:37.998636    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/f56dcb5e-35af-4685-bbda-bc1571f0604a-console-oauth-config\") pod \"console-599858b585-v7xck\" (UID: \"f56dcb5e-35af-4685-bbda-bc1571f0604a\") " pod="openshift-console/console-599858b585-v7xck"
Jul 30 00:08:37.999285 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:08:37.999254    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/f56dcb5e-35af-4685-bbda-bc1571f0604a-service-ca\") pod \"console-599858b585-v7xck\" (UID: \"f56dcb5e-35af-4685-bbda-bc1571f0604a\") " pod="openshift-console/console-599858b585-v7xck"
Jul 30 00:08:37.999447 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:08:37.999304    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/f56dcb5e-35af-4685-bbda-bc1571f0604a-console-config\") pod \"console-599858b585-v7xck\" (UID: \"f56dcb5e-35af-4685-bbda-bc1571f0604a\") " pod="openshift-console/console-599858b585-v7xck"
Jul 30 00:08:37.999447 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:08:37.999385    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/f56dcb5e-35af-4685-bbda-bc1571f0604a-oauth-serving-cert\") pod \"console-599858b585-v7xck\" (UID: \"f56dcb5e-35af-4685-bbda-bc1571f0604a\") " pod="openshift-console/console-599858b585-v7xck"
Jul 30 00:08:37.999564 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:08:37.999505    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f56dcb5e-35af-4685-bbda-bc1571f0604a-trusted-ca-bundle\") pod \"console-599858b585-v7xck\" (UID: \"f56dcb5e-35af-4685-bbda-bc1571f0604a\") " pod="openshift-console/console-599858b585-v7xck"
Jul 30 00:08:38.001006 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:08:38.000982    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/f56dcb5e-35af-4685-bbda-bc1571f0604a-console-oauth-config\") pod \"console-599858b585-v7xck\" (UID: \"f56dcb5e-35af-4685-bbda-bc1571f0604a\") " pod="openshift-console/console-599858b585-v7xck"
Jul 30 00:08:38.001080 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:08:38.001045    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/f56dcb5e-35af-4685-bbda-bc1571f0604a-console-serving-cert\") pod \"console-599858b585-v7xck\" (UID: \"f56dcb5e-35af-4685-bbda-bc1571f0604a\") " pod="openshift-console/console-599858b585-v7xck"
Jul 30 00:08:38.010537 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:08:38.010517    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pjmms\" (UniqueName: \"kubernetes.io/projected/f56dcb5e-35af-4685-bbda-bc1571f0604a-kube-api-access-pjmms\") pod \"console-599858b585-v7xck\" (UID: \"f56dcb5e-35af-4685-bbda-bc1571f0604a\") " pod="openshift-console/console-599858b585-v7xck"
Jul 30 00:08:38.192258 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:08:38.192183    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-599858b585-v7xck"
Jul 30 00:08:38.341732 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:08:38.341706    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-599858b585-v7xck"]
Jul 30 00:08:38.344152 ip-10-0-133-55 kubenswrapper[2560]: W0730 00:08:38.344127    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf56dcb5e_35af_4685_bbda_bc1571f0604a.slice/crio-7c2f5c275ec2e1d15e3e86a6317b4be7fd776bc68d438b3456b95166d0b72ef0 WatchSource:0}: Error finding container 7c2f5c275ec2e1d15e3e86a6317b4be7fd776bc68d438b3456b95166d0b72ef0: Status 404 returned error can't find the container with id 7c2f5c275ec2e1d15e3e86a6317b4be7fd776bc68d438b3456b95166d0b72ef0
Jul 30 00:08:38.770029 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:08:38.769987    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-599858b585-v7xck" event={"ID":"f56dcb5e-35af-4685-bbda-bc1571f0604a","Type":"ContainerStarted","Data":"2b5fb20daf23dd695180c0d4904700fcc4cf7dc1af1b7f394f7de8cfb216881c"}
Jul 30 00:08:38.770527 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:08:38.770044    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-599858b585-v7xck" event={"ID":"f56dcb5e-35af-4685-bbda-bc1571f0604a","Type":"ContainerStarted","Data":"7c2f5c275ec2e1d15e3e86a6317b4be7fd776bc68d438b3456b95166d0b72ef0"}
Jul 30 00:08:38.787199 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:08:38.787154    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-599858b585-v7xck" podStartSLOduration=1.7871400899999998 podStartE2EDuration="1.78714009s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-30 00:08:37 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 00:08:38.785708773 +0000 UTC m=+405.844925573" watchObservedRunningTime="2026-07-30 00:08:38.78714009 +0000 UTC m=+405.846356893"
Jul 30 00:08:48.192732 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:08:48.192694    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-599858b585-v7xck"
Jul 30 00:08:48.193187 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:08:48.192921    2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-599858b585-v7xck"
Jul 30 00:08:48.197498 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:08:48.197478    2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-599858b585-v7xck"
Jul 30 00:08:48.812144 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:08:48.812116    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-599858b585-v7xck"
Jul 30 00:08:48.854945 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:08:48.854914    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-59c4f4c8c-ws7gs"]
Jul 30 00:09:02.832948 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:09:02.832891    2560 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-67df797bd9-7zcn4" podUID="68f2d620-c8be-48e4-8ef7-a7ad10654f46" containerName="console" containerID="cri-o://e14ba4f14984022efc30c7658db673af997adbcef07816d30f919387ccfebebe" gracePeriod=15
Jul 30 00:09:03.076768 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:09:03.076741    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-67df797bd9-7zcn4"
Jul 30 00:09:03.226461 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:09:03.226435    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/68f2d620-c8be-48e4-8ef7-a7ad10654f46-service-ca\") pod \"68f2d620-c8be-48e4-8ef7-a7ad10654f46\" (UID: \"68f2d620-c8be-48e4-8ef7-a7ad10654f46\") "
Jul 30 00:09:03.226645 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:09:03.226480    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/68f2d620-c8be-48e4-8ef7-a7ad10654f46-oauth-serving-cert\") pod \"68f2d620-c8be-48e4-8ef7-a7ad10654f46\" (UID: \"68f2d620-c8be-48e4-8ef7-a7ad10654f46\") "
Jul 30 00:09:03.226645 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:09:03.226527    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/68f2d620-c8be-48e4-8ef7-a7ad10654f46-trusted-ca-bundle\") pod \"68f2d620-c8be-48e4-8ef7-a7ad10654f46\" (UID: \"68f2d620-c8be-48e4-8ef7-a7ad10654f46\") "
Jul 30 00:09:03.226645 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:09:03.226557    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/68f2d620-c8be-48e4-8ef7-a7ad10654f46-console-serving-cert\") pod \"68f2d620-c8be-48e4-8ef7-a7ad10654f46\" (UID: \"68f2d620-c8be-48e4-8ef7-a7ad10654f46\") "
Jul 30 00:09:03.226645 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:09:03.226597    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/68f2d620-c8be-48e4-8ef7-a7ad10654f46-console-config\") pod \"68f2d620-c8be-48e4-8ef7-a7ad10654f46\" (UID: \"68f2d620-c8be-48e4-8ef7-a7ad10654f46\") "
Jul 30 00:09:03.226645 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:09:03.226619    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-kq47f\" (UniqueName: \"kubernetes.io/projected/68f2d620-c8be-48e4-8ef7-a7ad10654f46-kube-api-access-kq47f\") pod \"68f2d620-c8be-48e4-8ef7-a7ad10654f46\" (UID: \"68f2d620-c8be-48e4-8ef7-a7ad10654f46\") "
Jul 30 00:09:03.226884 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:09:03.226678    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/68f2d620-c8be-48e4-8ef7-a7ad10654f46-console-oauth-config\") pod \"68f2d620-c8be-48e4-8ef7-a7ad10654f46\" (UID: \"68f2d620-c8be-48e4-8ef7-a7ad10654f46\") "
Jul 30 00:09:03.226987 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:09:03.226937    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/68f2d620-c8be-48e4-8ef7-a7ad10654f46-service-ca" (OuterVolumeSpecName: "service-ca") pod "68f2d620-c8be-48e4-8ef7-a7ad10654f46" (UID: "68f2d620-c8be-48e4-8ef7-a7ad10654f46"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 30 00:09:03.226987 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:09:03.226971    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/68f2d620-c8be-48e4-8ef7-a7ad10654f46-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "68f2d620-c8be-48e4-8ef7-a7ad10654f46" (UID: "68f2d620-c8be-48e4-8ef7-a7ad10654f46"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 30 00:09:03.227142 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:09:03.226977    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/68f2d620-c8be-48e4-8ef7-a7ad10654f46-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "68f2d620-c8be-48e4-8ef7-a7ad10654f46" (UID: "68f2d620-c8be-48e4-8ef7-a7ad10654f46"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 30 00:09:03.227142 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:09:03.227098    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/68f2d620-c8be-48e4-8ef7-a7ad10654f46-console-config" (OuterVolumeSpecName: "console-config") pod "68f2d620-c8be-48e4-8ef7-a7ad10654f46" (UID: "68f2d620-c8be-48e4-8ef7-a7ad10654f46"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 30 00:09:03.228805 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:09:03.228778    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/68f2d620-c8be-48e4-8ef7-a7ad10654f46-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "68f2d620-c8be-48e4-8ef7-a7ad10654f46" (UID: "68f2d620-c8be-48e4-8ef7-a7ad10654f46"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 30 00:09:03.228890 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:09:03.228815    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/68f2d620-c8be-48e4-8ef7-a7ad10654f46-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "68f2d620-c8be-48e4-8ef7-a7ad10654f46" (UID: "68f2d620-c8be-48e4-8ef7-a7ad10654f46"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 30 00:09:03.228890 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:09:03.228826    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/68f2d620-c8be-48e4-8ef7-a7ad10654f46-kube-api-access-kq47f" (OuterVolumeSpecName: "kube-api-access-kq47f") pod "68f2d620-c8be-48e4-8ef7-a7ad10654f46" (UID: "68f2d620-c8be-48e4-8ef7-a7ad10654f46"). InnerVolumeSpecName "kube-api-access-kq47f". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 30 00:09:03.327531 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:09:03.327494    2560 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/68f2d620-c8be-48e4-8ef7-a7ad10654f46-console-oauth-config\") on node \"ip-10-0-133-55.ec2.internal\" DevicePath \"\""
Jul 30 00:09:03.327531 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:09:03.327521    2560 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/68f2d620-c8be-48e4-8ef7-a7ad10654f46-service-ca\") on node \"ip-10-0-133-55.ec2.internal\" DevicePath \"\""
Jul 30 00:09:03.327531 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:09:03.327535    2560 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/68f2d620-c8be-48e4-8ef7-a7ad10654f46-oauth-serving-cert\") on node \"ip-10-0-133-55.ec2.internal\" DevicePath \"\""
Jul 30 00:09:03.327757 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:09:03.327549    2560 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/68f2d620-c8be-48e4-8ef7-a7ad10654f46-trusted-ca-bundle\") on node \"ip-10-0-133-55.ec2.internal\" DevicePath \"\""
Jul 30 00:09:03.327757 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:09:03.327557    2560 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/68f2d620-c8be-48e4-8ef7-a7ad10654f46-console-serving-cert\") on node \"ip-10-0-133-55.ec2.internal\" DevicePath \"\""
Jul 30 00:09:03.327757 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:09:03.327565    2560 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/68f2d620-c8be-48e4-8ef7-a7ad10654f46-console-config\") on node \"ip-10-0-133-55.ec2.internal\" DevicePath \"\""
Jul 30 00:09:03.327757 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:09:03.327573    2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-kq47f\" (UniqueName: \"kubernetes.io/projected/68f2d620-c8be-48e4-8ef7-a7ad10654f46-kube-api-access-kq47f\") on node \"ip-10-0-133-55.ec2.internal\" DevicePath \"\""
Jul 30 00:09:03.867160 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:09:03.867118    2560 generic.go:356] "Generic (PLEG): container finished" podID="68f2d620-c8be-48e4-8ef7-a7ad10654f46" containerID="e14ba4f14984022efc30c7658db673af997adbcef07816d30f919387ccfebebe" exitCode=0
Jul 30 00:09:03.867661 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:09:03.867173    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-67df797bd9-7zcn4" event={"ID":"68f2d620-c8be-48e4-8ef7-a7ad10654f46","Type":"ContainerDied","Data":"e14ba4f14984022efc30c7658db673af997adbcef07816d30f919387ccfebebe"}
Jul 30 00:09:03.867661 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:09:03.867179    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-67df797bd9-7zcn4"
Jul 30 00:09:03.867661 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:09:03.867246    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-67df797bd9-7zcn4" event={"ID":"68f2d620-c8be-48e4-8ef7-a7ad10654f46","Type":"ContainerDied","Data":"143142dc1600a8c294bbf0cd8dc7b9827bd9d70a84a961d07328dd38878a7b04"}
Jul 30 00:09:03.867661 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:09:03.867269    2560 scope.go:117] "RemoveContainer" containerID="e14ba4f14984022efc30c7658db673af997adbcef07816d30f919387ccfebebe"
Jul 30 00:09:03.875347 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:09:03.875318    2560 scope.go:117] "RemoveContainer" containerID="e14ba4f14984022efc30c7658db673af997adbcef07816d30f919387ccfebebe"
Jul 30 00:09:03.875592 ip-10-0-133-55 kubenswrapper[2560]: E0730 00:09:03.875575    2560 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e14ba4f14984022efc30c7658db673af997adbcef07816d30f919387ccfebebe\": container with ID starting with e14ba4f14984022efc30c7658db673af997adbcef07816d30f919387ccfebebe not found: ID does not exist" containerID="e14ba4f14984022efc30c7658db673af997adbcef07816d30f919387ccfebebe"
Jul 30 00:09:03.875635 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:09:03.875602    2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e14ba4f14984022efc30c7658db673af997adbcef07816d30f919387ccfebebe"} err="failed to get container status \"e14ba4f14984022efc30c7658db673af997adbcef07816d30f919387ccfebebe\": rpc error: code = NotFound desc = could not find container \"e14ba4f14984022efc30c7658db673af997adbcef07816d30f919387ccfebebe\": container with ID starting with e14ba4f14984022efc30c7658db673af997adbcef07816d30f919387ccfebebe not found: ID does not exist"
Jul 30 00:09:03.882463 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:09:03.882438    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-67df797bd9-7zcn4"]
Jul 30 00:09:03.886072 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:09:03.886055    2560 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-67df797bd9-7zcn4"]
Jul 30 00:09:05.403972 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:09:05.403941    2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="68f2d620-c8be-48e4-8ef7-a7ad10654f46" path="/var/lib/kubelet/pods/68f2d620-c8be-48e4-8ef7-a7ad10654f46/volumes"
Jul 30 00:09:13.875269 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:09:13.875224    2560 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-59c4f4c8c-ws7gs" podUID="7bdf9de2-885f-4f20-aca3-7c1e2abc6152" containerName="console" containerID="cri-o://e3287a09f0cc7f11ebcdf3a7fdd2dd44dbce707a37eadc8d74fb0bb420459d10" gracePeriod=15
Jul 30 00:09:14.118991 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:09:14.118963    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-59c4f4c8c-ws7gs"
Jul 30 00:09:14.221745 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:09:14.221714    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/7bdf9de2-885f-4f20-aca3-7c1e2abc6152-console-config\") pod \"7bdf9de2-885f-4f20-aca3-7c1e2abc6152\" (UID: \"7bdf9de2-885f-4f20-aca3-7c1e2abc6152\") "
Jul 30 00:09:14.221902 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:09:14.221756    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/7bdf9de2-885f-4f20-aca3-7c1e2abc6152-console-serving-cert\") pod \"7bdf9de2-885f-4f20-aca3-7c1e2abc6152\" (UID: \"7bdf9de2-885f-4f20-aca3-7c1e2abc6152\") "
Jul 30 00:09:14.221902 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:09:14.221796    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/7bdf9de2-885f-4f20-aca3-7c1e2abc6152-service-ca\") pod \"7bdf9de2-885f-4f20-aca3-7c1e2abc6152\" (UID: \"7bdf9de2-885f-4f20-aca3-7c1e2abc6152\") "
Jul 30 00:09:14.221902 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:09:14.221836    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7bdf9de2-885f-4f20-aca3-7c1e2abc6152-trusted-ca-bundle\") pod \"7bdf9de2-885f-4f20-aca3-7c1e2abc6152\" (UID: \"7bdf9de2-885f-4f20-aca3-7c1e2abc6152\") "
Jul 30 00:09:14.221902 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:09:14.221877    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-pk5rn\" (UniqueName: \"kubernetes.io/projected/7bdf9de2-885f-4f20-aca3-7c1e2abc6152-kube-api-access-pk5rn\") pod \"7bdf9de2-885f-4f20-aca3-7c1e2abc6152\" (UID: \"7bdf9de2-885f-4f20-aca3-7c1e2abc6152\") "
Jul 30 00:09:14.222107 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:09:14.221903    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/7bdf9de2-885f-4f20-aca3-7c1e2abc6152-oauth-serving-cert\") pod \"7bdf9de2-885f-4f20-aca3-7c1e2abc6152\" (UID: \"7bdf9de2-885f-4f20-aca3-7c1e2abc6152\") "
Jul 30 00:09:14.222107 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:09:14.221930    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/7bdf9de2-885f-4f20-aca3-7c1e2abc6152-console-oauth-config\") pod \"7bdf9de2-885f-4f20-aca3-7c1e2abc6152\" (UID: \"7bdf9de2-885f-4f20-aca3-7c1e2abc6152\") "
Jul 30 00:09:14.222213 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:09:14.222156    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/7bdf9de2-885f-4f20-aca3-7c1e2abc6152-console-config" (OuterVolumeSpecName: "console-config") pod "7bdf9de2-885f-4f20-aca3-7c1e2abc6152" (UID: "7bdf9de2-885f-4f20-aca3-7c1e2abc6152"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 30 00:09:14.222290 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:09:14.222263    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/7bdf9de2-885f-4f20-aca3-7c1e2abc6152-service-ca" (OuterVolumeSpecName: "service-ca") pod "7bdf9de2-885f-4f20-aca3-7c1e2abc6152" (UID: "7bdf9de2-885f-4f20-aca3-7c1e2abc6152"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 30 00:09:14.222377 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:09:14.222306    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/7bdf9de2-885f-4f20-aca3-7c1e2abc6152-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "7bdf9de2-885f-4f20-aca3-7c1e2abc6152" (UID: "7bdf9de2-885f-4f20-aca3-7c1e2abc6152"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 30 00:09:14.222431 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:09:14.222391    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/7bdf9de2-885f-4f20-aca3-7c1e2abc6152-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "7bdf9de2-885f-4f20-aca3-7c1e2abc6152" (UID: "7bdf9de2-885f-4f20-aca3-7c1e2abc6152"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 30 00:09:14.224039 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:09:14.224020    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7bdf9de2-885f-4f20-aca3-7c1e2abc6152-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "7bdf9de2-885f-4f20-aca3-7c1e2abc6152" (UID: "7bdf9de2-885f-4f20-aca3-7c1e2abc6152"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 30 00:09:14.224131 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:09:14.224101    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7bdf9de2-885f-4f20-aca3-7c1e2abc6152-kube-api-access-pk5rn" (OuterVolumeSpecName: "kube-api-access-pk5rn") pod "7bdf9de2-885f-4f20-aca3-7c1e2abc6152" (UID: "7bdf9de2-885f-4f20-aca3-7c1e2abc6152"). InnerVolumeSpecName "kube-api-access-pk5rn". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 30 00:09:14.224176 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:09:14.224117    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7bdf9de2-885f-4f20-aca3-7c1e2abc6152-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "7bdf9de2-885f-4f20-aca3-7c1e2abc6152" (UID: "7bdf9de2-885f-4f20-aca3-7c1e2abc6152"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 30 00:09:14.322938 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:09:14.322901    2560 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/7bdf9de2-885f-4f20-aca3-7c1e2abc6152-console-config\") on node \"ip-10-0-133-55.ec2.internal\" DevicePath \"\""
Jul 30 00:09:14.322938 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:09:14.322931    2560 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/7bdf9de2-885f-4f20-aca3-7c1e2abc6152-console-serving-cert\") on node \"ip-10-0-133-55.ec2.internal\" DevicePath \"\""
Jul 30 00:09:14.322938 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:09:14.322941    2560 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/7bdf9de2-885f-4f20-aca3-7c1e2abc6152-service-ca\") on node \"ip-10-0-133-55.ec2.internal\" DevicePath \"\""
Jul 30 00:09:14.323164 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:09:14.322950    2560 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7bdf9de2-885f-4f20-aca3-7c1e2abc6152-trusted-ca-bundle\") on node \"ip-10-0-133-55.ec2.internal\" DevicePath \"\""
Jul 30 00:09:14.323164 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:09:14.322960    2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-pk5rn\" (UniqueName: \"kubernetes.io/projected/7bdf9de2-885f-4f20-aca3-7c1e2abc6152-kube-api-access-pk5rn\") on node \"ip-10-0-133-55.ec2.internal\" DevicePath \"\""
Jul 30 00:09:14.323164 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:09:14.322969    2560 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/7bdf9de2-885f-4f20-aca3-7c1e2abc6152-oauth-serving-cert\") on node \"ip-10-0-133-55.ec2.internal\" DevicePath \"\""
Jul 30 00:09:14.323164 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:09:14.322978    2560 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/7bdf9de2-885f-4f20-aca3-7c1e2abc6152-console-oauth-config\") on node \"ip-10-0-133-55.ec2.internal\" DevicePath \"\""
Jul 30 00:09:14.912103 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:09:14.912068    2560 generic.go:356] "Generic (PLEG): container finished" podID="7bdf9de2-885f-4f20-aca3-7c1e2abc6152" containerID="e3287a09f0cc7f11ebcdf3a7fdd2dd44dbce707a37eadc8d74fb0bb420459d10" exitCode=0
Jul 30 00:09:14.912554 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:09:14.912136    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-59c4f4c8c-ws7gs"
Jul 30 00:09:14.912554 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:09:14.912149    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-59c4f4c8c-ws7gs" event={"ID":"7bdf9de2-885f-4f20-aca3-7c1e2abc6152","Type":"ContainerDied","Data":"e3287a09f0cc7f11ebcdf3a7fdd2dd44dbce707a37eadc8d74fb0bb420459d10"}
Jul 30 00:09:14.912554 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:09:14.912201    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-59c4f4c8c-ws7gs" event={"ID":"7bdf9de2-885f-4f20-aca3-7c1e2abc6152","Type":"ContainerDied","Data":"d7a8cdee9fc453e845f4a5041d2ee8727e9656261abd61df6670badd42c0860b"}
Jul 30 00:09:14.912554 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:09:14.912221    2560 scope.go:117] "RemoveContainer" containerID="e3287a09f0cc7f11ebcdf3a7fdd2dd44dbce707a37eadc8d74fb0bb420459d10"
Jul 30 00:09:14.920622 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:09:14.920603    2560 scope.go:117] "RemoveContainer" containerID="e3287a09f0cc7f11ebcdf3a7fdd2dd44dbce707a37eadc8d74fb0bb420459d10"
Jul 30 00:09:14.920878 ip-10-0-133-55 kubenswrapper[2560]: E0730 00:09:14.920860    2560 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e3287a09f0cc7f11ebcdf3a7fdd2dd44dbce707a37eadc8d74fb0bb420459d10\": container with ID starting with e3287a09f0cc7f11ebcdf3a7fdd2dd44dbce707a37eadc8d74fb0bb420459d10 not found: ID does not exist" containerID="e3287a09f0cc7f11ebcdf3a7fdd2dd44dbce707a37eadc8d74fb0bb420459d10"
Jul 30 00:09:14.920931 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:09:14.920885    2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e3287a09f0cc7f11ebcdf3a7fdd2dd44dbce707a37eadc8d74fb0bb420459d10"} err="failed to get container status \"e3287a09f0cc7f11ebcdf3a7fdd2dd44dbce707a37eadc8d74fb0bb420459d10\": rpc error: code = NotFound desc = could not find container \"e3287a09f0cc7f11ebcdf3a7fdd2dd44dbce707a37eadc8d74fb0bb420459d10\": container with ID starting with e3287a09f0cc7f11ebcdf3a7fdd2dd44dbce707a37eadc8d74fb0bb420459d10 not found: ID does not exist"
Jul 30 00:09:14.934402 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:09:14.934382    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-59c4f4c8c-ws7gs"]
Jul 30 00:09:14.938072 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:09:14.938052    2560 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-59c4f4c8c-ws7gs"]
Jul 30 00:09:15.404122 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:09:15.404093    2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="7bdf9de2-885f-4f20-aca3-7c1e2abc6152" path="/var/lib/kubelet/pods/7bdf9de2-885f-4f20-aca3-7c1e2abc6152/volumes"
Jul 30 00:10:00.089792 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:10:00.089758    2560 generic.go:356] "Generic (PLEG): container finished" podID="04c8ee63-4c22-45a4-ac5a-0321b09d3dd1" containerID="e748829af5c1c7fc986de2b3a7e8f2564e122f53742dee8d92b189429e7fde0c" exitCode=0
Jul 30 00:10:00.090298 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:10:00.089832    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-pruner-29756160-vhqfx" event={"ID":"04c8ee63-4c22-45a4-ac5a-0321b09d3dd1","Type":"ContainerDied","Data":"e748829af5c1c7fc986de2b3a7e8f2564e122f53742dee8d92b189429e7fde0c"}
Jul 30 00:10:01.226396 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:10:01.226368    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-pruner-29756160-vhqfx"
Jul 30 00:10:01.299666 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:10:01.299631    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-g8jwm\" (UniqueName: \"kubernetes.io/projected/04c8ee63-4c22-45a4-ac5a-0321b09d3dd1-kube-api-access-g8jwm\") pod \"04c8ee63-4c22-45a4-ac5a-0321b09d3dd1\" (UID: \"04c8ee63-4c22-45a4-ac5a-0321b09d3dd1\") "
Jul 30 00:10:01.299849 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:10:01.299685    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/04c8ee63-4c22-45a4-ac5a-0321b09d3dd1-serviceca\") pod \"04c8ee63-4c22-45a4-ac5a-0321b09d3dd1\" (UID: \"04c8ee63-4c22-45a4-ac5a-0321b09d3dd1\") "
Jul 30 00:10:01.300079 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:10:01.300051    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/04c8ee63-4c22-45a4-ac5a-0321b09d3dd1-serviceca" (OuterVolumeSpecName: "serviceca") pod "04c8ee63-4c22-45a4-ac5a-0321b09d3dd1" (UID: "04c8ee63-4c22-45a4-ac5a-0321b09d3dd1"). InnerVolumeSpecName "serviceca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 30 00:10:01.301792 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:10:01.301757    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/04c8ee63-4c22-45a4-ac5a-0321b09d3dd1-kube-api-access-g8jwm" (OuterVolumeSpecName: "kube-api-access-g8jwm") pod "04c8ee63-4c22-45a4-ac5a-0321b09d3dd1" (UID: "04c8ee63-4c22-45a4-ac5a-0321b09d3dd1"). InnerVolumeSpecName "kube-api-access-g8jwm". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 30 00:10:01.400731 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:10:01.400707    2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-g8jwm\" (UniqueName: \"kubernetes.io/projected/04c8ee63-4c22-45a4-ac5a-0321b09d3dd1-kube-api-access-g8jwm\") on node \"ip-10-0-133-55.ec2.internal\" DevicePath \"\""
Jul 30 00:10:01.400731 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:10:01.400729    2560 reconciler_common.go:299] "Volume detached for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/04c8ee63-4c22-45a4-ac5a-0321b09d3dd1-serviceca\") on node \"ip-10-0-133-55.ec2.internal\" DevicePath \"\""
Jul 30 00:10:02.098836 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:10:02.098807    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-pruner-29756160-vhqfx"
Jul 30 00:10:02.098836 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:10:02.098819    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-pruner-29756160-vhqfx" event={"ID":"04c8ee63-4c22-45a4-ac5a-0321b09d3dd1","Type":"ContainerDied","Data":"8bdc4c6ac0d36be0aee53d282e9f565adbb6eb3f31d30bf255765222e98f18da"}
Jul 30 00:10:02.099038 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:10:02.098857    2560 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="8bdc4c6ac0d36be0aee53d282e9f565adbb6eb3f31d30bf255765222e98f18da"
Jul 30 00:10:03.878918 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:10:03.878884    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-55b4d954d5-b48xw"]
Jul 30 00:10:03.879290 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:10:03.879197    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7bdf9de2-885f-4f20-aca3-7c1e2abc6152" containerName="console"
Jul 30 00:10:03.879290 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:10:03.879209    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="7bdf9de2-885f-4f20-aca3-7c1e2abc6152" containerName="console"
Jul 30 00:10:03.879290 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:10:03.879226    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="04c8ee63-4c22-45a4-ac5a-0321b09d3dd1" containerName="image-pruner"
Jul 30 00:10:03.879290 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:10:03.879231    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="04c8ee63-4c22-45a4-ac5a-0321b09d3dd1" containerName="image-pruner"
Jul 30 00:10:03.879290 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:10:03.879247    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="68f2d620-c8be-48e4-8ef7-a7ad10654f46" containerName="console"
Jul 30 00:10:03.879290 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:10:03.879257    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="68f2d620-c8be-48e4-8ef7-a7ad10654f46" containerName="console"
Jul 30 00:10:03.879510 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:10:03.879326    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="04c8ee63-4c22-45a4-ac5a-0321b09d3dd1" containerName="image-pruner"
Jul 30 00:10:03.879510 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:10:03.879346    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="7bdf9de2-885f-4f20-aca3-7c1e2abc6152" containerName="console"
Jul 30 00:10:03.879510 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:10:03.879355    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="68f2d620-c8be-48e4-8ef7-a7ad10654f46" containerName="console"
Jul 30 00:10:03.882358 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:10:03.882341    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-55b4d954d5-b48xw"
Jul 30 00:10:03.884856 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:10:03.884831    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"openshift-service-ca.crt\""
Jul 30 00:10:03.884977 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:10:03.884857    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"kube-root-ca.crt\""
Jul 30 00:10:03.884977 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:10:03.884868    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-dockercfg-zp5vt\""
Jul 30 00:10:03.889025 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:10:03.888999    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-55b4d954d5-b48xw"]
Jul 30 00:10:04.024617 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:10:04.024580    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/2fa9e71a-b0b0-4186-9a06-2317f7df9bc5-bound-sa-token\") pod \"cert-manager-55b4d954d5-b48xw\" (UID: \"2fa9e71a-b0b0-4186-9a06-2317f7df9bc5\") " pod="cert-manager/cert-manager-55b4d954d5-b48xw"
Jul 30 00:10:04.024793 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:10:04.024630    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jpkdn\" (UniqueName: \"kubernetes.io/projected/2fa9e71a-b0b0-4186-9a06-2317f7df9bc5-kube-api-access-jpkdn\") pod \"cert-manager-55b4d954d5-b48xw\" (UID: \"2fa9e71a-b0b0-4186-9a06-2317f7df9bc5\") " pod="cert-manager/cert-manager-55b4d954d5-b48xw"
Jul 30 00:10:04.125552 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:10:04.125526    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/2fa9e71a-b0b0-4186-9a06-2317f7df9bc5-bound-sa-token\") pod \"cert-manager-55b4d954d5-b48xw\" (UID: \"2fa9e71a-b0b0-4186-9a06-2317f7df9bc5\") " pod="cert-manager/cert-manager-55b4d954d5-b48xw"
Jul 30 00:10:04.125679 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:10:04.125565    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jpkdn\" (UniqueName: \"kubernetes.io/projected/2fa9e71a-b0b0-4186-9a06-2317f7df9bc5-kube-api-access-jpkdn\") pod \"cert-manager-55b4d954d5-b48xw\" (UID: \"2fa9e71a-b0b0-4186-9a06-2317f7df9bc5\") " pod="cert-manager/cert-manager-55b4d954d5-b48xw"
Jul 30 00:10:04.133436 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:10:04.133375    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/2fa9e71a-b0b0-4186-9a06-2317f7df9bc5-bound-sa-token\") pod \"cert-manager-55b4d954d5-b48xw\" (UID: \"2fa9e71a-b0b0-4186-9a06-2317f7df9bc5\") " pod="cert-manager/cert-manager-55b4d954d5-b48xw"
Jul 30 00:10:04.133436 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:10:04.133420    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jpkdn\" (UniqueName: \"kubernetes.io/projected/2fa9e71a-b0b0-4186-9a06-2317f7df9bc5-kube-api-access-jpkdn\") pod \"cert-manager-55b4d954d5-b48xw\" (UID: \"2fa9e71a-b0b0-4186-9a06-2317f7df9bc5\") " pod="cert-manager/cert-manager-55b4d954d5-b48xw"
Jul 30 00:10:04.205183 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:10:04.205152    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-55b4d954d5-b48xw"
Jul 30 00:10:04.330782 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:10:04.330757    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-55b4d954d5-b48xw"]
Jul 30 00:10:04.333473 ip-10-0-133-55 kubenswrapper[2560]: W0730 00:10:04.333445    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod2fa9e71a_b0b0_4186_9a06_2317f7df9bc5.slice/crio-fc1a20a29de3e90c94bc21138dc6ff69e11b68f257f0d3e44a9c3835eee8330f WatchSource:0}: Error finding container fc1a20a29de3e90c94bc21138dc6ff69e11b68f257f0d3e44a9c3835eee8330f: Status 404 returned error can't find the container with id fc1a20a29de3e90c94bc21138dc6ff69e11b68f257f0d3e44a9c3835eee8330f
Jul 30 00:10:05.111358 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:10:05.111294    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-55b4d954d5-b48xw" event={"ID":"2fa9e71a-b0b0-4186-9a06-2317f7df9bc5","Type":"ContainerStarted","Data":"fc1a20a29de3e90c94bc21138dc6ff69e11b68f257f0d3e44a9c3835eee8330f"}
Jul 30 00:10:06.834684 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:10:06.834649    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-4nxrt"]
Jul 30 00:10:06.839438 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:10:06.839410    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-4nxrt"
Jul 30 00:10:06.842034 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:10:06.842013    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"openshift-service-ca.crt\""
Jul 30 00:10:06.842172 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:10:06.842034    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"kube-root-ca.crt\""
Jul 30 00:10:06.842847 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:10:06.842827    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"openshift-lws-operator-dockercfg-td8wg\""
Jul 30 00:10:06.849332 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:10:06.849265    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-4nxrt"]
Jul 30 00:10:06.952674 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:10:06.952642    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-djtqp\" (UniqueName: \"kubernetes.io/projected/44a0613c-c3a5-4c78-9640-7178fe84899e-kube-api-access-djtqp\") pod \"openshift-lws-operator-fd8ccff4c-4nxrt\" (UID: \"44a0613c-c3a5-4c78-9640-7178fe84899e\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-4nxrt"
Jul 30 00:10:06.952849 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:10:06.952751    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/44a0613c-c3a5-4c78-9640-7178fe84899e-tmp\") pod \"openshift-lws-operator-fd8ccff4c-4nxrt\" (UID: \"44a0613c-c3a5-4c78-9640-7178fe84899e\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-4nxrt"
Jul 30 00:10:07.054111 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:10:07.054076    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-djtqp\" (UniqueName: \"kubernetes.io/projected/44a0613c-c3a5-4c78-9640-7178fe84899e-kube-api-access-djtqp\") pod \"openshift-lws-operator-fd8ccff4c-4nxrt\" (UID: \"44a0613c-c3a5-4c78-9640-7178fe84899e\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-4nxrt"
Jul 30 00:10:07.054265 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:10:07.054154    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/44a0613c-c3a5-4c78-9640-7178fe84899e-tmp\") pod \"openshift-lws-operator-fd8ccff4c-4nxrt\" (UID: \"44a0613c-c3a5-4c78-9640-7178fe84899e\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-4nxrt"
Jul 30 00:10:07.054485 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:10:07.054468    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/44a0613c-c3a5-4c78-9640-7178fe84899e-tmp\") pod \"openshift-lws-operator-fd8ccff4c-4nxrt\" (UID: \"44a0613c-c3a5-4c78-9640-7178fe84899e\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-4nxrt"
Jul 30 00:10:07.063181 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:10:07.063150    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-djtqp\" (UniqueName: \"kubernetes.io/projected/44a0613c-c3a5-4c78-9640-7178fe84899e-kube-api-access-djtqp\") pod \"openshift-lws-operator-fd8ccff4c-4nxrt\" (UID: \"44a0613c-c3a5-4c78-9640-7178fe84899e\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-4nxrt"
Jul 30 00:10:07.150652 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:10:07.150619    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-4nxrt"
Jul 30 00:10:08.040097 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:10:08.040073    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-4nxrt"]
Jul 30 00:10:08.042071 ip-10-0-133-55 kubenswrapper[2560]: W0730 00:10:08.042042    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod44a0613c_c3a5_4c78_9640_7178fe84899e.slice/crio-c11b834754c0314b1730b2a87c856603b9820228d1033bf40078186d8c90cc9e WatchSource:0}: Error finding container c11b834754c0314b1730b2a87c856603b9820228d1033bf40078186d8c90cc9e: Status 404 returned error can't find the container with id c11b834754c0314b1730b2a87c856603b9820228d1033bf40078186d8c90cc9e
Jul 30 00:10:08.131386 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:10:08.131338    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-55b4d954d5-b48xw" event={"ID":"2fa9e71a-b0b0-4186-9a06-2317f7df9bc5","Type":"ContainerStarted","Data":"1fa4f47b7c88d45c337163a7bf59476a45b29e862ab28d04349a06960cb5f93f"}
Jul 30 00:10:08.132629 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:10:08.132604    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-4nxrt" event={"ID":"44a0613c-c3a5-4c78-9640-7178fe84899e","Type":"ContainerStarted","Data":"c11b834754c0314b1730b2a87c856603b9820228d1033bf40078186d8c90cc9e"}
Jul 30 00:10:12.152084 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:10:12.152044    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-4nxrt" event={"ID":"44a0613c-c3a5-4c78-9640-7178fe84899e","Type":"ContainerStarted","Data":"0f7344faca93b6e1b8587db8508aa25e6a16b7ede3215ce4c055bcfbfaafb32a"}
Jul 30 00:10:12.168199 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:10:12.168154    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-55b4d954d5-b48xw" podStartSLOduration=5.519500974 podStartE2EDuration="9.16813785s" totalImagesPullingTime="3.648636876s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-30 00:10:03 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 00:10:08.145639539 +0000 UTC m=+495.204856342" watchObservedRunningTime="2026-07-30 00:10:12.16813785 +0000 UTC m=+499.227354653"
Jul 30 00:10:12.168635 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:10:12.168612    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-4nxrt" podStartSLOduration=2.842689804 podStartE2EDuration="6.168603349s" totalImagesPullingTime="3.325913545s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-30 00:10:06 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 00:10:12.167484529 +0000 UTC m=+499.226701332" watchObservedRunningTime="2026-07-30 00:10:12.168603349 +0000 UTC m=+499.227820153"
Jul 30 00:10:29.380225 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:10:29.380191    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-655d97b687-jztcs"]
Jul 30 00:10:29.383762 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:10:29.383746    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-655d97b687-jztcs"
Jul 30 00:10:29.387463 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:10:29.387441    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\""
Jul 30 00:10:29.387569 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:10:29.387492    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-59lxz\""
Jul 30 00:10:29.387569 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:10:29.387501    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\""
Jul 30 00:10:29.387569 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:10:29.387512    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\""
Jul 30 00:10:29.388366 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:10:29.388352    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\""
Jul 30 00:10:29.404890 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:10:29.404868    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-655d97b687-jztcs"]
Jul 30 00:10:29.436630 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:10:29.436605    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gsnsr\" (UniqueName: \"kubernetes.io/projected/e13b47e6-3a05-49b1-8639-3dab7c0840ec-kube-api-access-gsnsr\") pod \"opendatahub-operator-controller-manager-655d97b687-jztcs\" (UID: \"e13b47e6-3a05-49b1-8639-3dab7c0840ec\") " pod="opendatahub/opendatahub-operator-controller-manager-655d97b687-jztcs"
Jul 30 00:10:29.436752 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:10:29.436656    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/e13b47e6-3a05-49b1-8639-3dab7c0840ec-webhook-cert\") pod \"opendatahub-operator-controller-manager-655d97b687-jztcs\" (UID: \"e13b47e6-3a05-49b1-8639-3dab7c0840ec\") " pod="opendatahub/opendatahub-operator-controller-manager-655d97b687-jztcs"
Jul 30 00:10:29.436752 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:10:29.436686    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/e13b47e6-3a05-49b1-8639-3dab7c0840ec-manifests\") pod \"opendatahub-operator-controller-manager-655d97b687-jztcs\" (UID: \"e13b47e6-3a05-49b1-8639-3dab7c0840ec\") " pod="opendatahub/opendatahub-operator-controller-manager-655d97b687-jztcs"
Jul 30 00:10:29.436752 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:10:29.436705    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/e13b47e6-3a05-49b1-8639-3dab7c0840ec-tmp\") pod \"opendatahub-operator-controller-manager-655d97b687-jztcs\" (UID: \"e13b47e6-3a05-49b1-8639-3dab7c0840ec\") " pod="opendatahub/opendatahub-operator-controller-manager-655d97b687-jztcs"
Jul 30 00:10:29.436900 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:10:29.436762    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/e13b47e6-3a05-49b1-8639-3dab7c0840ec-apiservice-cert\") pod \"opendatahub-operator-controller-manager-655d97b687-jztcs\" (UID: \"e13b47e6-3a05-49b1-8639-3dab7c0840ec\") " pod="opendatahub/opendatahub-operator-controller-manager-655d97b687-jztcs"
Jul 30 00:10:29.538078 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:10:29.538043    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/e13b47e6-3a05-49b1-8639-3dab7c0840ec-manifests\") pod \"opendatahub-operator-controller-manager-655d97b687-jztcs\" (UID: \"e13b47e6-3a05-49b1-8639-3dab7c0840ec\") " pod="opendatahub/opendatahub-operator-controller-manager-655d97b687-jztcs"
Jul 30 00:10:29.538078 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:10:29.538081    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/e13b47e6-3a05-49b1-8639-3dab7c0840ec-tmp\") pod \"opendatahub-operator-controller-manager-655d97b687-jztcs\" (UID: \"e13b47e6-3a05-49b1-8639-3dab7c0840ec\") " pod="opendatahub/opendatahub-operator-controller-manager-655d97b687-jztcs"
Jul 30 00:10:29.538280 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:10:29.538109    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/e13b47e6-3a05-49b1-8639-3dab7c0840ec-apiservice-cert\") pod \"opendatahub-operator-controller-manager-655d97b687-jztcs\" (UID: \"e13b47e6-3a05-49b1-8639-3dab7c0840ec\") " pod="opendatahub/opendatahub-operator-controller-manager-655d97b687-jztcs"
Jul 30 00:10:29.538280 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:10:29.538138    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gsnsr\" (UniqueName: \"kubernetes.io/projected/e13b47e6-3a05-49b1-8639-3dab7c0840ec-kube-api-access-gsnsr\") pod \"opendatahub-operator-controller-manager-655d97b687-jztcs\" (UID: \"e13b47e6-3a05-49b1-8639-3dab7c0840ec\") " pod="opendatahub/opendatahub-operator-controller-manager-655d97b687-jztcs"
Jul 30 00:10:29.538280 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:10:29.538197    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/e13b47e6-3a05-49b1-8639-3dab7c0840ec-webhook-cert\") pod \"opendatahub-operator-controller-manager-655d97b687-jztcs\" (UID: \"e13b47e6-3a05-49b1-8639-3dab7c0840ec\") " pod="opendatahub/opendatahub-operator-controller-manager-655d97b687-jztcs"
Jul 30 00:10:29.538543 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:10:29.538520    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/e13b47e6-3a05-49b1-8639-3dab7c0840ec-manifests\") pod \"opendatahub-operator-controller-manager-655d97b687-jztcs\" (UID: \"e13b47e6-3a05-49b1-8639-3dab7c0840ec\") " pod="opendatahub/opendatahub-operator-controller-manager-655d97b687-jztcs"
Jul 30 00:10:29.540611 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:10:29.540576    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/e13b47e6-3a05-49b1-8639-3dab7c0840ec-tmp\") pod \"opendatahub-operator-controller-manager-655d97b687-jztcs\" (UID: \"e13b47e6-3a05-49b1-8639-3dab7c0840ec\") " pod="opendatahub/opendatahub-operator-controller-manager-655d97b687-jztcs"
Jul 30 00:10:29.540714 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:10:29.540665    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/e13b47e6-3a05-49b1-8639-3dab7c0840ec-webhook-cert\") pod \"opendatahub-operator-controller-manager-655d97b687-jztcs\" (UID: \"e13b47e6-3a05-49b1-8639-3dab7c0840ec\") " pod="opendatahub/opendatahub-operator-controller-manager-655d97b687-jztcs"
Jul 30 00:10:29.540714 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:10:29.540678    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/e13b47e6-3a05-49b1-8639-3dab7c0840ec-apiservice-cert\") pod \"opendatahub-operator-controller-manager-655d97b687-jztcs\" (UID: \"e13b47e6-3a05-49b1-8639-3dab7c0840ec\") " pod="opendatahub/opendatahub-operator-controller-manager-655d97b687-jztcs"
Jul 30 00:10:29.549961 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:10:29.549941    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gsnsr\" (UniqueName: \"kubernetes.io/projected/e13b47e6-3a05-49b1-8639-3dab7c0840ec-kube-api-access-gsnsr\") pod \"opendatahub-operator-controller-manager-655d97b687-jztcs\" (UID: \"e13b47e6-3a05-49b1-8639-3dab7c0840ec\") " pod="opendatahub/opendatahub-operator-controller-manager-655d97b687-jztcs"
Jul 30 00:10:29.694436 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:10:29.694351    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-655d97b687-jztcs"
Jul 30 00:10:29.826823 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:10:29.826666    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-655d97b687-jztcs"]
Jul 30 00:10:29.829764 ip-10-0-133-55 kubenswrapper[2560]: W0730 00:10:29.829736    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode13b47e6_3a05_49b1_8639_3dab7c0840ec.slice/crio-d1b5877b519e03db539d09a2aeac5dc82b5b7134d3df21fccf8f65590349ec05 WatchSource:0}: Error finding container d1b5877b519e03db539d09a2aeac5dc82b5b7134d3df21fccf8f65590349ec05: Status 404 returned error can't find the container with id d1b5877b519e03db539d09a2aeac5dc82b5b7134d3df21fccf8f65590349ec05
Jul 30 00:10:30.223187 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:10:30.223154    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-655d97b687-jztcs" event={"ID":"e13b47e6-3a05-49b1-8639-3dab7c0840ec","Type":"ContainerStarted","Data":"d1b5877b519e03db539d09a2aeac5dc82b5b7134d3df21fccf8f65590349ec05"}
Jul 30 00:10:33.239236 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:10:33.239149    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-655d97b687-jztcs" event={"ID":"e13b47e6-3a05-49b1-8639-3dab7c0840ec","Type":"ContainerStarted","Data":"902dda4b34b755ae89f877daac2ca5424a5407038b5dca5e68958fc7a96f820e"}
Jul 30 00:10:34.245177 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:10:34.245145    2560 generic.go:356] "Generic (PLEG): container finished" podID="e13b47e6-3a05-49b1-8639-3dab7c0840ec" containerID="902dda4b34b755ae89f877daac2ca5424a5407038b5dca5e68958fc7a96f820e" exitCode=0
Jul 30 00:10:34.245543 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:10:34.245227    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-655d97b687-jztcs" event={"ID":"e13b47e6-3a05-49b1-8639-3dab7c0840ec","Type":"ContainerDied","Data":"902dda4b34b755ae89f877daac2ca5424a5407038b5dca5e68958fc7a96f820e"}
Jul 30 00:10:35.251132 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:10:35.251091    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-655d97b687-jztcs" event={"ID":"e13b47e6-3a05-49b1-8639-3dab7c0840ec","Type":"ContainerStarted","Data":"0a66773c5e2c4f9a6ebb7c4c82d5cf773335f8f09f2fc1778f10577ff23ecbc5"}
Jul 30 00:10:35.251712 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:10:35.251209    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-655d97b687-jztcs"
Jul 30 00:10:35.272521 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:10:35.272465    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-655d97b687-jztcs" podStartSLOduration=1.755767224 podStartE2EDuration="6.272445629s" totalImagesPullingTime="3.470101537s" totalInitContainerRuntime="1.046576868s" isStatefulPod=false podCreationTimestamp="2026-07-30 00:10:29 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 00:10:35.270796698 +0000 UTC m=+522.330013504" watchObservedRunningTime="2026-07-30 00:10:35.272445629 +0000 UTC m=+522.331662433"
Jul 30 00:10:46.258437 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:10:46.258362    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-655d97b687-jztcs"
Jul 30 00:10:47.152079 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:10:47.152047    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/lws-controller-manager-5977989bd7-rnf8k"]
Jul 30 00:10:47.155282 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:10:47.155267    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-5977989bd7-rnf8k"
Jul 30 00:10:47.159626 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:10:47.159581    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"lws-controller-manager-dockercfg-l58xp\""
Jul 30 00:10:47.159626 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:10:47.159587    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"webhook-server-cert\""
Jul 30 00:10:47.159881 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:10:47.159846    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"lws-manager-config\""
Jul 30 00:10:47.160014 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:10:47.159894    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"metrics-server-cert\""
Jul 30 00:10:47.165191 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:10:47.165170    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-5977989bd7-rnf8k"]
Jul 30 00:10:47.299441 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:10:47.299406    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/61a27f35-7e9d-4b38-b3dd-94f671da67d8-metrics-cert\") pod \"lws-controller-manager-5977989bd7-rnf8k\" (UID: \"61a27f35-7e9d-4b38-b3dd-94f671da67d8\") " pod="openshift-lws-operator/lws-controller-manager-5977989bd7-rnf8k"
Jul 30 00:10:47.299815 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:10:47.299452    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/61a27f35-7e9d-4b38-b3dd-94f671da67d8-cert\") pod \"lws-controller-manager-5977989bd7-rnf8k\" (UID: \"61a27f35-7e9d-4b38-b3dd-94f671da67d8\") " pod="openshift-lws-operator/lws-controller-manager-5977989bd7-rnf8k"
Jul 30 00:10:47.299815 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:10:47.299533    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/61a27f35-7e9d-4b38-b3dd-94f671da67d8-manager-config\") pod \"lws-controller-manager-5977989bd7-rnf8k\" (UID: \"61a27f35-7e9d-4b38-b3dd-94f671da67d8\") " pod="openshift-lws-operator/lws-controller-manager-5977989bd7-rnf8k"
Jul 30 00:10:47.299815 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:10:47.299565    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kxndr\" (UniqueName: \"kubernetes.io/projected/61a27f35-7e9d-4b38-b3dd-94f671da67d8-kube-api-access-kxndr\") pod \"lws-controller-manager-5977989bd7-rnf8k\" (UID: \"61a27f35-7e9d-4b38-b3dd-94f671da67d8\") " pod="openshift-lws-operator/lws-controller-manager-5977989bd7-rnf8k"
Jul 30 00:10:47.400617 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:10:47.400582    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/61a27f35-7e9d-4b38-b3dd-94f671da67d8-metrics-cert\") pod \"lws-controller-manager-5977989bd7-rnf8k\" (UID: \"61a27f35-7e9d-4b38-b3dd-94f671da67d8\") " pod="openshift-lws-operator/lws-controller-manager-5977989bd7-rnf8k"
Jul 30 00:10:47.400810 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:10:47.400645    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/61a27f35-7e9d-4b38-b3dd-94f671da67d8-cert\") pod \"lws-controller-manager-5977989bd7-rnf8k\" (UID: \"61a27f35-7e9d-4b38-b3dd-94f671da67d8\") " pod="openshift-lws-operator/lws-controller-manager-5977989bd7-rnf8k"
Jul 30 00:10:47.400810 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:10:47.400727    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/61a27f35-7e9d-4b38-b3dd-94f671da67d8-manager-config\") pod \"lws-controller-manager-5977989bd7-rnf8k\" (UID: \"61a27f35-7e9d-4b38-b3dd-94f671da67d8\") " pod="openshift-lws-operator/lws-controller-manager-5977989bd7-rnf8k"
Jul 30 00:10:47.400810 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:10:47.400757    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kxndr\" (UniqueName: \"kubernetes.io/projected/61a27f35-7e9d-4b38-b3dd-94f671da67d8-kube-api-access-kxndr\") pod \"lws-controller-manager-5977989bd7-rnf8k\" (UID: \"61a27f35-7e9d-4b38-b3dd-94f671da67d8\") " pod="openshift-lws-operator/lws-controller-manager-5977989bd7-rnf8k"
Jul 30 00:10:47.401553 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:10:47.401526    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/61a27f35-7e9d-4b38-b3dd-94f671da67d8-manager-config\") pod \"lws-controller-manager-5977989bd7-rnf8k\" (UID: \"61a27f35-7e9d-4b38-b3dd-94f671da67d8\") " pod="openshift-lws-operator/lws-controller-manager-5977989bd7-rnf8k"
Jul 30 00:10:47.403328 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:10:47.403240    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/61a27f35-7e9d-4b38-b3dd-94f671da67d8-metrics-cert\") pod \"lws-controller-manager-5977989bd7-rnf8k\" (UID: \"61a27f35-7e9d-4b38-b3dd-94f671da67d8\") " pod="openshift-lws-operator/lws-controller-manager-5977989bd7-rnf8k"
Jul 30 00:10:47.403869 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:10:47.403846    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/61a27f35-7e9d-4b38-b3dd-94f671da67d8-cert\") pod \"lws-controller-manager-5977989bd7-rnf8k\" (UID: \"61a27f35-7e9d-4b38-b3dd-94f671da67d8\") " pod="openshift-lws-operator/lws-controller-manager-5977989bd7-rnf8k"
Jul 30 00:10:47.422772 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:10:47.422736    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kxndr\" (UniqueName: \"kubernetes.io/projected/61a27f35-7e9d-4b38-b3dd-94f671da67d8-kube-api-access-kxndr\") pod \"lws-controller-manager-5977989bd7-rnf8k\" (UID: \"61a27f35-7e9d-4b38-b3dd-94f671da67d8\") " pod="openshift-lws-operator/lws-controller-manager-5977989bd7-rnf8k"
Jul 30 00:10:47.465301 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:10:47.465269    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-5977989bd7-rnf8k"
Jul 30 00:10:47.592102 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:10:47.591966    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-5977989bd7-rnf8k"]
Jul 30 00:10:47.594356 ip-10-0-133-55 kubenswrapper[2560]: W0730 00:10:47.594331    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod61a27f35_7e9d_4b38_b3dd_94f671da67d8.slice/crio-9e898421547f5a15b4c4c53239fd7d92a1f2dc633538b51d8480878c61100bb4 WatchSource:0}: Error finding container 9e898421547f5a15b4c4c53239fd7d92a1f2dc633538b51d8480878c61100bb4: Status 404 returned error can't find the container with id 9e898421547f5a15b4c4c53239fd7d92a1f2dc633538b51d8480878c61100bb4
Jul 30 00:10:48.310105 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:10:48.310071    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-5977989bd7-rnf8k" event={"ID":"61a27f35-7e9d-4b38-b3dd-94f671da67d8","Type":"ContainerStarted","Data":"9e898421547f5a15b4c4c53239fd7d92a1f2dc633538b51d8480878c61100bb4"}
Jul 30 00:10:49.269343 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:10:49.269299    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/kube-auth-proxy-59c4b4bfcf-qsdmz"]
Jul 30 00:10:49.274388 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:10:49.274364    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-59c4b4bfcf-qsdmz"
Jul 30 00:10:49.278169 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:10:49.278147    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-dockercfg-tl87w\""
Jul 30 00:10:49.279924 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:10:49.279904    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-tls\""
Jul 30 00:10:49.280245 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:10:49.280141    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-creds\""
Jul 30 00:10:49.280375 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:10:49.280259    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\""
Jul 30 00:10:49.281053 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:10:49.281032    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\""
Jul 30 00:10:49.288981 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:10:49.288958    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-59c4b4bfcf-qsdmz"]
Jul 30 00:10:49.418600 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:10:49.418566    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-46dvl\" (UniqueName: \"kubernetes.io/projected/ca09c72b-01af-4369-a33f-7cd5af50baad-kube-api-access-46dvl\") pod \"kube-auth-proxy-59c4b4bfcf-qsdmz\" (UID: \"ca09c72b-01af-4369-a33f-7cd5af50baad\") " pod="openshift-ingress/kube-auth-proxy-59c4b4bfcf-qsdmz"
Jul 30 00:10:49.418972 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:10:49.418670    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/ca09c72b-01af-4369-a33f-7cd5af50baad-tls-certs\") pod \"kube-auth-proxy-59c4b4bfcf-qsdmz\" (UID: \"ca09c72b-01af-4369-a33f-7cd5af50baad\") " pod="openshift-ingress/kube-auth-proxy-59c4b4bfcf-qsdmz"
Jul 30 00:10:49.418972 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:10:49.418696    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/ca09c72b-01af-4369-a33f-7cd5af50baad-tmp\") pod \"kube-auth-proxy-59c4b4bfcf-qsdmz\" (UID: \"ca09c72b-01af-4369-a33f-7cd5af50baad\") " pod="openshift-ingress/kube-auth-proxy-59c4b4bfcf-qsdmz"
Jul 30 00:10:49.520169 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:10:49.520069    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/ca09c72b-01af-4369-a33f-7cd5af50baad-tls-certs\") pod \"kube-auth-proxy-59c4b4bfcf-qsdmz\" (UID: \"ca09c72b-01af-4369-a33f-7cd5af50baad\") " pod="openshift-ingress/kube-auth-proxy-59c4b4bfcf-qsdmz"
Jul 30 00:10:49.520169 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:10:49.520121    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/ca09c72b-01af-4369-a33f-7cd5af50baad-tmp\") pod \"kube-auth-proxy-59c4b4bfcf-qsdmz\" (UID: \"ca09c72b-01af-4369-a33f-7cd5af50baad\") " pod="openshift-ingress/kube-auth-proxy-59c4b4bfcf-qsdmz"
Jul 30 00:10:49.520169 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:10:49.520159    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-46dvl\" (UniqueName: \"kubernetes.io/projected/ca09c72b-01af-4369-a33f-7cd5af50baad-kube-api-access-46dvl\") pod \"kube-auth-proxy-59c4b4bfcf-qsdmz\" (UID: \"ca09c72b-01af-4369-a33f-7cd5af50baad\") " pod="openshift-ingress/kube-auth-proxy-59c4b4bfcf-qsdmz"
Jul 30 00:10:49.522477 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:10:49.522441    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/ca09c72b-01af-4369-a33f-7cd5af50baad-tmp\") pod \"kube-auth-proxy-59c4b4bfcf-qsdmz\" (UID: \"ca09c72b-01af-4369-a33f-7cd5af50baad\") " pod="openshift-ingress/kube-auth-proxy-59c4b4bfcf-qsdmz"
Jul 30 00:10:49.522809 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:10:49.522783    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/ca09c72b-01af-4369-a33f-7cd5af50baad-tls-certs\") pod \"kube-auth-proxy-59c4b4bfcf-qsdmz\" (UID: \"ca09c72b-01af-4369-a33f-7cd5af50baad\") " pod="openshift-ingress/kube-auth-proxy-59c4b4bfcf-qsdmz"
Jul 30 00:10:49.536249 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:10:49.536221    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-46dvl\" (UniqueName: \"kubernetes.io/projected/ca09c72b-01af-4369-a33f-7cd5af50baad-kube-api-access-46dvl\") pod \"kube-auth-proxy-59c4b4bfcf-qsdmz\" (UID: \"ca09c72b-01af-4369-a33f-7cd5af50baad\") " pod="openshift-ingress/kube-auth-proxy-59c4b4bfcf-qsdmz"
Jul 30 00:10:49.585011 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:10:49.584969    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-59c4b4bfcf-qsdmz"
Jul 30 00:10:49.732810 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:10:49.732784    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-59c4b4bfcf-qsdmz"]
Jul 30 00:10:49.734801 ip-10-0-133-55 kubenswrapper[2560]: W0730 00:10:49.734769    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podca09c72b_01af_4369_a33f_7cd5af50baad.slice/crio-7b68629bc0c37fd87816e255afecf73ab2c38c76b153e72b3d77dd94bc2e96d3 WatchSource:0}: Error finding container 7b68629bc0c37fd87816e255afecf73ab2c38c76b153e72b3d77dd94bc2e96d3: Status 404 returned error can't find the container with id 7b68629bc0c37fd87816e255afecf73ab2c38c76b153e72b3d77dd94bc2e96d3
Jul 30 00:10:50.320350 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:10:50.320297    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-59c4b4bfcf-qsdmz" event={"ID":"ca09c72b-01af-4369-a33f-7cd5af50baad","Type":"ContainerStarted","Data":"7b68629bc0c37fd87816e255afecf73ab2c38c76b153e72b3d77dd94bc2e96d3"}
Jul 30 00:10:53.337661 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:10:53.337627    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-59c4b4bfcf-qsdmz" event={"ID":"ca09c72b-01af-4369-a33f-7cd5af50baad","Type":"ContainerStarted","Data":"d2d07483334e034058d986e89a59158f6412de26adfe94a89496e2e0bc67e769"}
Jul 30 00:10:53.354611 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:10:53.354570    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/kube-auth-proxy-59c4b4bfcf-qsdmz" podStartSLOduration=1.548275436 podStartE2EDuration="4.354555468s" totalImagesPullingTime="2.806280032s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-30 00:10:49 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 00:10:53.35315373 +0000 UTC m=+540.412370534" watchObservedRunningTime="2026-07-30 00:10:53.354555468 +0000 UTC m=+540.413772271"
Jul 30 00:10:57.357291 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:10:57.357254    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-5977989bd7-rnf8k" event={"ID":"61a27f35-7e9d-4b38-b3dd-94f671da67d8","Type":"ContainerStarted","Data":"20d0c63bf11db75725e83b14b9f9bef7a82d1dc20444ac2d3162780794cc6a69"}
Jul 30 00:10:57.357800 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:10:57.357376    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-lws-operator/lws-controller-manager-5977989bd7-rnf8k"
Jul 30 00:10:57.387733 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:10:57.387690    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/lws-controller-manager-5977989bd7-rnf8k" podStartSLOduration=0.81263219 podStartE2EDuration="10.38767705s" totalImagesPullingTime="9.57504486s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-30 00:10:47 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 00:10:57.386812022 +0000 UTC m=+544.446028827" watchObservedRunningTime="2026-07-30 00:10:57.38767705 +0000 UTC m=+544.446893853"
Jul 30 00:11:08.365279 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:11:08.365236    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-lws-operator/lws-controller-manager-5977989bd7-rnf8k"
Jul 30 00:11:53.346467 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:11:53.346437    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-kchgc_324341b7-120c-4f8b-9ddd-e28b9a40ce9e/console-operator/1.log"
Jul 30 00:11:53.346970 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:11:53.346547    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-kchgc_324341b7-120c-4f8b-9ddd-e28b9a40ce9e/console-operator/1.log"
Jul 30 00:12:51.535900 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:12:51.535869    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-vlv6d"]
Jul 30 00:12:51.539238 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:12:51.539216    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-vlv6d"
Jul 30 00:12:51.542167 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:12:51.542146    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\""
Jul 30 00:12:51.542283 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:12:51.542150    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\""
Jul 30 00:12:51.543249 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:12:51.543222    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"limitador-operator-controller-manager-dockercfg-z28g8\""
Jul 30 00:12:51.551497 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:12:51.551479    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-vlv6d"]
Jul 30 00:12:51.636555 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:12:51.636524    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pkhl7\" (UniqueName: \"kubernetes.io/projected/adc44d58-7632-4ead-8afa-c94c6632e16e-kube-api-access-pkhl7\") pod \"limitador-operator-controller-manager-859d7b78bd-vlv6d\" (UID: \"adc44d58-7632-4ead-8afa-c94c6632e16e\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-vlv6d"
Jul 30 00:12:51.737683 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:12:51.737644    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pkhl7\" (UniqueName: \"kubernetes.io/projected/adc44d58-7632-4ead-8afa-c94c6632e16e-kube-api-access-pkhl7\") pod \"limitador-operator-controller-manager-859d7b78bd-vlv6d\" (UID: \"adc44d58-7632-4ead-8afa-c94c6632e16e\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-vlv6d"
Jul 30 00:12:51.753938 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:12:51.753904    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pkhl7\" (UniqueName: \"kubernetes.io/projected/adc44d58-7632-4ead-8afa-c94c6632e16e-kube-api-access-pkhl7\") pod \"limitador-operator-controller-manager-859d7b78bd-vlv6d\" (UID: \"adc44d58-7632-4ead-8afa-c94c6632e16e\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-vlv6d"
Jul 30 00:12:51.852697 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:12:51.852611    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-vlv6d"
Jul 30 00:12:52.000198 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:12:52.000169    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-vlv6d"]
Jul 30 00:12:52.001362 ip-10-0-133-55 kubenswrapper[2560]: W0730 00:12:52.001335    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podadc44d58_7632_4ead_8afa_c94c6632e16e.slice/crio-65d7aaa3f9fe6b31e95a404e3837c3858e939c54a098468ffc5ea877923c4f93 WatchSource:0}: Error finding container 65d7aaa3f9fe6b31e95a404e3837c3858e939c54a098468ffc5ea877923c4f93: Status 404 returned error can't find the container with id 65d7aaa3f9fe6b31e95a404e3837c3858e939c54a098468ffc5ea877923c4f93
Jul 30 00:12:52.003301 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:12:52.003284    2560 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 30 00:12:52.864430 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:12:52.864394    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-vlv6d" event={"ID":"adc44d58-7632-4ead-8afa-c94c6632e16e","Type":"ContainerStarted","Data":"65d7aaa3f9fe6b31e95a404e3837c3858e939c54a098468ffc5ea877923c4f93"}
Jul 30 00:12:54.875724 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:12:54.875685    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-vlv6d" event={"ID":"adc44d58-7632-4ead-8afa-c94c6632e16e","Type":"ContainerStarted","Data":"3012d4109ffb10834a36dd5479908ec037be1893ee4bd2d2b8a7f50cffb6ced7"}
Jul 30 00:12:54.876129 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:12:54.875827    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-vlv6d"
Jul 30 00:12:54.892691 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:12:54.892638    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-vlv6d" podStartSLOduration=1.98215239 podStartE2EDuration="3.892620792s" totalImagesPullingTime="1.910468402s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-30 00:12:51 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 00:12:54.891007956 +0000 UTC m=+661.950224759" watchObservedRunningTime="2026-07-30 00:12:54.892620792 +0000 UTC m=+661.951837595"
Jul 30 00:13:05.884105 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:13:05.884075    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-vlv6d"
Jul 30 00:13:29.309300 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:13:29.309264    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-744c88f754-q9thp"]
Jul 30 00:13:29.313496 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:13:29.313460    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-744c88f754-q9thp"
Jul 30 00:13:29.323524 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:13:29.323497    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-744c88f754-q9thp"]
Jul 30 00:13:29.461741 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:13:29.461705    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/a8370f4a-47c8-469e-9099-f7982f1f1be3-console-config\") pod \"console-744c88f754-q9thp\" (UID: \"a8370f4a-47c8-469e-9099-f7982f1f1be3\") " pod="openshift-console/console-744c88f754-q9thp"
Jul 30 00:13:29.461957 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:13:29.461761    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/a8370f4a-47c8-469e-9099-f7982f1f1be3-service-ca\") pod \"console-744c88f754-q9thp\" (UID: \"a8370f4a-47c8-469e-9099-f7982f1f1be3\") " pod="openshift-console/console-744c88f754-q9thp"
Jul 30 00:13:29.462042 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:13:29.461978    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/a8370f4a-47c8-469e-9099-f7982f1f1be3-oauth-serving-cert\") pod \"console-744c88f754-q9thp\" (UID: \"a8370f4a-47c8-469e-9099-f7982f1f1be3\") " pod="openshift-console/console-744c88f754-q9thp"
Jul 30 00:13:29.462042 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:13:29.462033    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/a8370f4a-47c8-469e-9099-f7982f1f1be3-console-oauth-config\") pod \"console-744c88f754-q9thp\" (UID: \"a8370f4a-47c8-469e-9099-f7982f1f1be3\") " pod="openshift-console/console-744c88f754-q9thp"
Jul 30 00:13:29.462129 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:13:29.462086    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a8370f4a-47c8-469e-9099-f7982f1f1be3-trusted-ca-bundle\") pod \"console-744c88f754-q9thp\" (UID: \"a8370f4a-47c8-469e-9099-f7982f1f1be3\") " pod="openshift-console/console-744c88f754-q9thp"
Jul 30 00:13:29.462129 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:13:29.462109    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-v5rm7\" (UniqueName: \"kubernetes.io/projected/a8370f4a-47c8-469e-9099-f7982f1f1be3-kube-api-access-v5rm7\") pod \"console-744c88f754-q9thp\" (UID: \"a8370f4a-47c8-469e-9099-f7982f1f1be3\") " pod="openshift-console/console-744c88f754-q9thp"
Jul 30 00:13:29.462206 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:13:29.462175    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/a8370f4a-47c8-469e-9099-f7982f1f1be3-console-serving-cert\") pod \"console-744c88f754-q9thp\" (UID: \"a8370f4a-47c8-469e-9099-f7982f1f1be3\") " pod="openshift-console/console-744c88f754-q9thp"
Jul 30 00:13:29.563390 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:13:29.563280    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/a8370f4a-47c8-469e-9099-f7982f1f1be3-oauth-serving-cert\") pod \"console-744c88f754-q9thp\" (UID: \"a8370f4a-47c8-469e-9099-f7982f1f1be3\") " pod="openshift-console/console-744c88f754-q9thp"
Jul 30 00:13:29.563390 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:13:29.563342    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/a8370f4a-47c8-469e-9099-f7982f1f1be3-console-oauth-config\") pod \"console-744c88f754-q9thp\" (UID: \"a8370f4a-47c8-469e-9099-f7982f1f1be3\") " pod="openshift-console/console-744c88f754-q9thp"
Jul 30 00:13:29.563390 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:13:29.563376    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a8370f4a-47c8-469e-9099-f7982f1f1be3-trusted-ca-bundle\") pod \"console-744c88f754-q9thp\" (UID: \"a8370f4a-47c8-469e-9099-f7982f1f1be3\") " pod="openshift-console/console-744c88f754-q9thp"
Jul 30 00:13:29.563637 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:13:29.563394    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-v5rm7\" (UniqueName: \"kubernetes.io/projected/a8370f4a-47c8-469e-9099-f7982f1f1be3-kube-api-access-v5rm7\") pod \"console-744c88f754-q9thp\" (UID: \"a8370f4a-47c8-469e-9099-f7982f1f1be3\") " pod="openshift-console/console-744c88f754-q9thp"
Jul 30 00:13:29.563637 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:13:29.563419    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/a8370f4a-47c8-469e-9099-f7982f1f1be3-console-serving-cert\") pod \"console-744c88f754-q9thp\" (UID: \"a8370f4a-47c8-469e-9099-f7982f1f1be3\") " pod="openshift-console/console-744c88f754-q9thp"
Jul 30 00:13:29.563637 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:13:29.563437    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/a8370f4a-47c8-469e-9099-f7982f1f1be3-console-config\") pod \"console-744c88f754-q9thp\" (UID: \"a8370f4a-47c8-469e-9099-f7982f1f1be3\") " pod="openshift-console/console-744c88f754-q9thp"
Jul 30 00:13:29.563637 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:13:29.563461    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/a8370f4a-47c8-469e-9099-f7982f1f1be3-service-ca\") pod \"console-744c88f754-q9thp\" (UID: \"a8370f4a-47c8-469e-9099-f7982f1f1be3\") " pod="openshift-console/console-744c88f754-q9thp"
Jul 30 00:13:29.564763 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:13:29.564733    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/a8370f4a-47c8-469e-9099-f7982f1f1be3-service-ca\") pod \"console-744c88f754-q9thp\" (UID: \"a8370f4a-47c8-469e-9099-f7982f1f1be3\") " pod="openshift-console/console-744c88f754-q9thp"
Jul 30 00:13:29.564993 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:13:29.564860    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/a8370f4a-47c8-469e-9099-f7982f1f1be3-oauth-serving-cert\") pod \"console-744c88f754-q9thp\" (UID: \"a8370f4a-47c8-469e-9099-f7982f1f1be3\") " pod="openshift-console/console-744c88f754-q9thp"
Jul 30 00:13:29.565097 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:13:29.565014    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/a8370f4a-47c8-469e-9099-f7982f1f1be3-console-config\") pod \"console-744c88f754-q9thp\" (UID: \"a8370f4a-47c8-469e-9099-f7982f1f1be3\") " pod="openshift-console/console-744c88f754-q9thp"
Jul 30 00:13:29.570210 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:13:29.566906    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/a8370f4a-47c8-469e-9099-f7982f1f1be3-console-oauth-config\") pod \"console-744c88f754-q9thp\" (UID: \"a8370f4a-47c8-469e-9099-f7982f1f1be3\") " pod="openshift-console/console-744c88f754-q9thp"
Jul 30 00:13:29.571235 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:13:29.571210    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a8370f4a-47c8-469e-9099-f7982f1f1be3-trusted-ca-bundle\") pod \"console-744c88f754-q9thp\" (UID: \"a8370f4a-47c8-469e-9099-f7982f1f1be3\") " pod="openshift-console/console-744c88f754-q9thp"
Jul 30 00:13:29.572366 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:13:29.572343    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/a8370f4a-47c8-469e-9099-f7982f1f1be3-console-serving-cert\") pod \"console-744c88f754-q9thp\" (UID: \"a8370f4a-47c8-469e-9099-f7982f1f1be3\") " pod="openshift-console/console-744c88f754-q9thp"
Jul 30 00:13:29.576416 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:13:29.576397    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-v5rm7\" (UniqueName: \"kubernetes.io/projected/a8370f4a-47c8-469e-9099-f7982f1f1be3-kube-api-access-v5rm7\") pod \"console-744c88f754-q9thp\" (UID: \"a8370f4a-47c8-469e-9099-f7982f1f1be3\") " pod="openshift-console/console-744c88f754-q9thp"
Jul 30 00:13:29.624506 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:13:29.624467    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-744c88f754-q9thp"
Jul 30 00:13:29.759614 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:13:29.759589    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-744c88f754-q9thp"]
Jul 30 00:13:29.761641 ip-10-0-133-55 kubenswrapper[2560]: W0730 00:13:29.761600    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda8370f4a_47c8_469e_9099_f7982f1f1be3.slice/crio-7b1f54ecb23e0a63efb8c3c2ea489ddfa0a139ee960f4fa045ca527b9bc825b6 WatchSource:0}: Error finding container 7b1f54ecb23e0a63efb8c3c2ea489ddfa0a139ee960f4fa045ca527b9bc825b6: Status 404 returned error can't find the container with id 7b1f54ecb23e0a63efb8c3c2ea489ddfa0a139ee960f4fa045ca527b9bc825b6
Jul 30 00:13:30.042398 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:13:30.042364    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-744c88f754-q9thp" event={"ID":"a8370f4a-47c8-469e-9099-f7982f1f1be3","Type":"ContainerStarted","Data":"72dc58098fa7aced2d430b993192c981a0f743b034ef939aa0e78f44a906159a"}
Jul 30 00:13:30.042578 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:13:30.042413    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-744c88f754-q9thp" event={"ID":"a8370f4a-47c8-469e-9099-f7982f1f1be3","Type":"ContainerStarted","Data":"7b1f54ecb23e0a63efb8c3c2ea489ddfa0a139ee960f4fa045ca527b9bc825b6"}
Jul 30 00:13:30.059487 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:13:30.059439    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-744c88f754-q9thp" podStartSLOduration=1.059423714 podStartE2EDuration="1.059423714s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-30 00:13:29 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 00:13:30.057805812 +0000 UTC m=+697.117022615" watchObservedRunningTime="2026-07-30 00:13:30.059423714 +0000 UTC m=+697.118640517"
Jul 30 00:13:39.625594 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:13:39.625555    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-744c88f754-q9thp"
Jul 30 00:13:39.626103 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:13:39.625617    2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-744c88f754-q9thp"
Jul 30 00:13:39.630394 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:13:39.630370    2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-744c88f754-q9thp"
Jul 30 00:13:40.091173 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:13:40.091089    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-744c88f754-q9thp"
Jul 30 00:13:40.135964 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:13:40.135933    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-599858b585-v7xck"]
Jul 30 00:13:45.042834 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:13:45.042800    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-58cd955675-twhg4"]
Jul 30 00:13:45.046569 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:13:45.046545    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-twhg4"
Jul 30 00:13:45.049082 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:13:45.049057    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-authorino-dockercfg-j2x5b\""
Jul 30 00:13:45.053523 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:13:45.053495    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-58cd955675-twhg4"]
Jul 30 00:13:45.119022 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:13:45.118957    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-l8fph\" (UniqueName: \"kubernetes.io/projected/90d5e719-0eac-4800-9672-7791a6f1d47d-kube-api-access-l8fph\") pod \"authorino-58cd955675-twhg4\" (UID: \"90d5e719-0eac-4800-9672-7791a6f1d47d\") " pod="kuadrant-system/authorino-58cd955675-twhg4"
Jul 30 00:13:45.220115 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:13:45.220085    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-l8fph\" (UniqueName: \"kubernetes.io/projected/90d5e719-0eac-4800-9672-7791a6f1d47d-kube-api-access-l8fph\") pod \"authorino-58cd955675-twhg4\" (UID: \"90d5e719-0eac-4800-9672-7791a6f1d47d\") " pod="kuadrant-system/authorino-58cd955675-twhg4"
Jul 30 00:13:45.231271 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:13:45.231245    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-l8fph\" (UniqueName: \"kubernetes.io/projected/90d5e719-0eac-4800-9672-7791a6f1d47d-kube-api-access-l8fph\") pod \"authorino-58cd955675-twhg4\" (UID: \"90d5e719-0eac-4800-9672-7791a6f1d47d\") " pod="kuadrant-system/authorino-58cd955675-twhg4"
Jul 30 00:13:45.358063 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:13:45.358029    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-twhg4"
Jul 30 00:13:45.484616 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:13:45.484559    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-58cd955675-twhg4"]
Jul 30 00:13:45.487409 ip-10-0-133-55 kubenswrapper[2560]: W0730 00:13:45.487376    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod90d5e719_0eac_4800_9672_7791a6f1d47d.slice/crio-161cb92734e108b05c357b18be32ca1abe83eda18a83b6765aae7409b27e0652 WatchSource:0}: Error finding container 161cb92734e108b05c357b18be32ca1abe83eda18a83b6765aae7409b27e0652: Status 404 returned error can't find the container with id 161cb92734e108b05c357b18be32ca1abe83eda18a83b6765aae7409b27e0652
Jul 30 00:13:46.116094 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:13:46.116056    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-twhg4" event={"ID":"90d5e719-0eac-4800-9672-7791a6f1d47d","Type":"ContainerStarted","Data":"161cb92734e108b05c357b18be32ca1abe83eda18a83b6765aae7409b27e0652"}
Jul 30 00:13:49.132499 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:13:49.132461    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-twhg4" event={"ID":"90d5e719-0eac-4800-9672-7791a6f1d47d","Type":"ContainerStarted","Data":"f56ced547a2dccf914eea15c55fabc69cb42b287caabe0a6a36392d1a276aaa5"}
Jul 30 00:13:49.146646 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:13:49.146603    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-58cd955675-twhg4" podStartSLOduration=0.962408094 podStartE2EDuration="4.146587779s" totalImagesPullingTime="3.184179685s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-30 00:13:45 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 00:13:49.145858675 +0000 UTC m=+716.205075470" watchObservedRunningTime="2026-07-30 00:13:49.146587779 +0000 UTC m=+716.205804583"
Jul 30 00:13:50.322544 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:13:50.322511    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-58cd955675-twhg4"]
Jul 30 00:13:51.142601 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:13:51.142535    2560 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/authorino-58cd955675-twhg4" podUID="90d5e719-0eac-4800-9672-7791a6f1d47d" containerName="authorino" containerID="cri-o://f56ced547a2dccf914eea15c55fabc69cb42b287caabe0a6a36392d1a276aaa5" gracePeriod=30
Jul 30 00:13:51.392412 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:13:51.392390    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-twhg4"
Jul 30 00:13:51.478826 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:13:51.478743    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-l8fph\" (UniqueName: \"kubernetes.io/projected/90d5e719-0eac-4800-9672-7791a6f1d47d-kube-api-access-l8fph\") pod \"90d5e719-0eac-4800-9672-7791a6f1d47d\" (UID: \"90d5e719-0eac-4800-9672-7791a6f1d47d\") "
Jul 30 00:13:51.480884 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:13:51.480852    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/90d5e719-0eac-4800-9672-7791a6f1d47d-kube-api-access-l8fph" (OuterVolumeSpecName: "kube-api-access-l8fph") pod "90d5e719-0eac-4800-9672-7791a6f1d47d" (UID: "90d5e719-0eac-4800-9672-7791a6f1d47d"). InnerVolumeSpecName "kube-api-access-l8fph". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 30 00:13:51.579891 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:13:51.579864    2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-l8fph\" (UniqueName: \"kubernetes.io/projected/90d5e719-0eac-4800-9672-7791a6f1d47d-kube-api-access-l8fph\") on node \"ip-10-0-133-55.ec2.internal\" DevicePath \"\""
Jul 30 00:13:52.149206 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:13:52.149167    2560 generic.go:356] "Generic (PLEG): container finished" podID="90d5e719-0eac-4800-9672-7791a6f1d47d" containerID="f56ced547a2dccf914eea15c55fabc69cb42b287caabe0a6a36392d1a276aaa5" exitCode=0
Jul 30 00:13:52.149431 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:13:52.149210    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-twhg4"
Jul 30 00:13:52.149431 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:13:52.149256    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-twhg4" event={"ID":"90d5e719-0eac-4800-9672-7791a6f1d47d","Type":"ContainerDied","Data":"f56ced547a2dccf914eea15c55fabc69cb42b287caabe0a6a36392d1a276aaa5"}
Jul 30 00:13:52.149431 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:13:52.149300    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-twhg4" event={"ID":"90d5e719-0eac-4800-9672-7791a6f1d47d","Type":"ContainerDied","Data":"161cb92734e108b05c357b18be32ca1abe83eda18a83b6765aae7409b27e0652"}
Jul 30 00:13:52.149431 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:13:52.149337    2560 scope.go:117] "RemoveContainer" containerID="f56ced547a2dccf914eea15c55fabc69cb42b287caabe0a6a36392d1a276aaa5"
Jul 30 00:13:52.158193 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:13:52.158173    2560 scope.go:117] "RemoveContainer" containerID="f56ced547a2dccf914eea15c55fabc69cb42b287caabe0a6a36392d1a276aaa5"
Jul 30 00:13:52.158443 ip-10-0-133-55 kubenswrapper[2560]: E0730 00:13:52.158421    2560 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f56ced547a2dccf914eea15c55fabc69cb42b287caabe0a6a36392d1a276aaa5\": container with ID starting with f56ced547a2dccf914eea15c55fabc69cb42b287caabe0a6a36392d1a276aaa5 not found: ID does not exist" containerID="f56ced547a2dccf914eea15c55fabc69cb42b287caabe0a6a36392d1a276aaa5"
Jul 30 00:13:52.158506 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:13:52.158454    2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f56ced547a2dccf914eea15c55fabc69cb42b287caabe0a6a36392d1a276aaa5"} err="failed to get container status \"f56ced547a2dccf914eea15c55fabc69cb42b287caabe0a6a36392d1a276aaa5\": rpc error: code = NotFound desc = could not find container \"f56ced547a2dccf914eea15c55fabc69cb42b287caabe0a6a36392d1a276aaa5\": container with ID starting with f56ced547a2dccf914eea15c55fabc69cb42b287caabe0a6a36392d1a276aaa5 not found: ID does not exist"
Jul 30 00:13:52.170489 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:13:52.170465    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-58cd955675-twhg4"]
Jul 30 00:13:52.173732 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:13:52.173715    2560 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-58cd955675-twhg4"]
Jul 30 00:13:53.411544 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:13:53.411514    2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="90d5e719-0eac-4800-9672-7791a6f1d47d" path="/var/lib/kubelet/pods/90d5e719-0eac-4800-9672-7791a6f1d47d/volumes"
Jul 30 00:14:05.156903 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:14:05.156868    2560 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-599858b585-v7xck" podUID="f56dcb5e-35af-4685-bbda-bc1571f0604a" containerName="console" containerID="cri-o://2b5fb20daf23dd695180c0d4904700fcc4cf7dc1af1b7f394f7de8cfb216881c" gracePeriod=15
Jul 30 00:14:05.417837 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:14:05.417777    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-599858b585-v7xck"
Jul 30 00:14:05.495104 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:14:05.495077    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/f56dcb5e-35af-4685-bbda-bc1571f0604a-console-oauth-config\") pod \"f56dcb5e-35af-4685-bbda-bc1571f0604a\" (UID: \"f56dcb5e-35af-4685-bbda-bc1571f0604a\") "
Jul 30 00:14:05.495283 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:14:05.495129    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f56dcb5e-35af-4685-bbda-bc1571f0604a-trusted-ca-bundle\") pod \"f56dcb5e-35af-4685-bbda-bc1571f0604a\" (UID: \"f56dcb5e-35af-4685-bbda-bc1571f0604a\") "
Jul 30 00:14:05.495283 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:14:05.495164    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/f56dcb5e-35af-4685-bbda-bc1571f0604a-console-config\") pod \"f56dcb5e-35af-4685-bbda-bc1571f0604a\" (UID: \"f56dcb5e-35af-4685-bbda-bc1571f0604a\") "
Jul 30 00:14:05.495283 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:14:05.495178    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/f56dcb5e-35af-4685-bbda-bc1571f0604a-oauth-serving-cert\") pod \"f56dcb5e-35af-4685-bbda-bc1571f0604a\" (UID: \"f56dcb5e-35af-4685-bbda-bc1571f0604a\") "
Jul 30 00:14:05.495283 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:14:05.495216    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/f56dcb5e-35af-4685-bbda-bc1571f0604a-service-ca\") pod \"f56dcb5e-35af-4685-bbda-bc1571f0604a\" (UID: \"f56dcb5e-35af-4685-bbda-bc1571f0604a\") "
Jul 30 00:14:05.495283 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:14:05.495240    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/f56dcb5e-35af-4685-bbda-bc1571f0604a-console-serving-cert\") pod \"f56dcb5e-35af-4685-bbda-bc1571f0604a\" (UID: \"f56dcb5e-35af-4685-bbda-bc1571f0604a\") "
Jul 30 00:14:05.495586 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:14:05.495346    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-pjmms\" (UniqueName: \"kubernetes.io/projected/f56dcb5e-35af-4685-bbda-bc1571f0604a-kube-api-access-pjmms\") pod \"f56dcb5e-35af-4685-bbda-bc1571f0604a\" (UID: \"f56dcb5e-35af-4685-bbda-bc1571f0604a\") "
Jul 30 00:14:05.495643 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:14:05.495622    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f56dcb5e-35af-4685-bbda-bc1571f0604a-console-config" (OuterVolumeSpecName: "console-config") pod "f56dcb5e-35af-4685-bbda-bc1571f0604a" (UID: "f56dcb5e-35af-4685-bbda-bc1571f0604a"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 30 00:14:05.495643 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:14:05.495628    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f56dcb5e-35af-4685-bbda-bc1571f0604a-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "f56dcb5e-35af-4685-bbda-bc1571f0604a" (UID: "f56dcb5e-35af-4685-bbda-bc1571f0604a"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 30 00:14:05.495746 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:14:05.495615    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f56dcb5e-35af-4685-bbda-bc1571f0604a-service-ca" (OuterVolumeSpecName: "service-ca") pod "f56dcb5e-35af-4685-bbda-bc1571f0604a" (UID: "f56dcb5e-35af-4685-bbda-bc1571f0604a"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 30 00:14:05.495808 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:14:05.495767    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f56dcb5e-35af-4685-bbda-bc1571f0604a-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "f56dcb5e-35af-4685-bbda-bc1571f0604a" (UID: "f56dcb5e-35af-4685-bbda-bc1571f0604a"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 30 00:14:05.497528 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:14:05.497504    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f56dcb5e-35af-4685-bbda-bc1571f0604a-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "f56dcb5e-35af-4685-bbda-bc1571f0604a" (UID: "f56dcb5e-35af-4685-bbda-bc1571f0604a"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 30 00:14:05.497620 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:14:05.497595    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f56dcb5e-35af-4685-bbda-bc1571f0604a-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "f56dcb5e-35af-4685-bbda-bc1571f0604a" (UID: "f56dcb5e-35af-4685-bbda-bc1571f0604a"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 30 00:14:05.497620 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:14:05.497601    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f56dcb5e-35af-4685-bbda-bc1571f0604a-kube-api-access-pjmms" (OuterVolumeSpecName: "kube-api-access-pjmms") pod "f56dcb5e-35af-4685-bbda-bc1571f0604a" (UID: "f56dcb5e-35af-4685-bbda-bc1571f0604a"). InnerVolumeSpecName "kube-api-access-pjmms". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 30 00:14:05.596206 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:14:05.596173    2560 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f56dcb5e-35af-4685-bbda-bc1571f0604a-trusted-ca-bundle\") on node \"ip-10-0-133-55.ec2.internal\" DevicePath \"\""
Jul 30 00:14:05.596206 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:14:05.596200    2560 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/f56dcb5e-35af-4685-bbda-bc1571f0604a-console-config\") on node \"ip-10-0-133-55.ec2.internal\" DevicePath \"\""
Jul 30 00:14:05.596206 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:14:05.596211    2560 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/f56dcb5e-35af-4685-bbda-bc1571f0604a-oauth-serving-cert\") on node \"ip-10-0-133-55.ec2.internal\" DevicePath \"\""
Jul 30 00:14:05.596449 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:14:05.596219    2560 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/f56dcb5e-35af-4685-bbda-bc1571f0604a-service-ca\") on node \"ip-10-0-133-55.ec2.internal\" DevicePath \"\""
Jul 30 00:14:05.596449 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:14:05.596228    2560 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/f56dcb5e-35af-4685-bbda-bc1571f0604a-console-serving-cert\") on node \"ip-10-0-133-55.ec2.internal\" DevicePath \"\""
Jul 30 00:14:05.596449 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:14:05.596236    2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-pjmms\" (UniqueName: \"kubernetes.io/projected/f56dcb5e-35af-4685-bbda-bc1571f0604a-kube-api-access-pjmms\") on node \"ip-10-0-133-55.ec2.internal\" DevicePath \"\""
Jul 30 00:14:05.596449 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:14:05.596245    2560 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/f56dcb5e-35af-4685-bbda-bc1571f0604a-console-oauth-config\") on node \"ip-10-0-133-55.ec2.internal\" DevicePath \"\""
Jul 30 00:14:06.212676 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:14:06.212642    2560 generic.go:356] "Generic (PLEG): container finished" podID="f56dcb5e-35af-4685-bbda-bc1571f0604a" containerID="2b5fb20daf23dd695180c0d4904700fcc4cf7dc1af1b7f394f7de8cfb216881c" exitCode=0
Jul 30 00:14:06.213061 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:14:06.212683    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-599858b585-v7xck"
Jul 30 00:14:06.213061 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:14:06.212726    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-599858b585-v7xck" event={"ID":"f56dcb5e-35af-4685-bbda-bc1571f0604a","Type":"ContainerDied","Data":"2b5fb20daf23dd695180c0d4904700fcc4cf7dc1af1b7f394f7de8cfb216881c"}
Jul 30 00:14:06.213061 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:14:06.212773    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-599858b585-v7xck" event={"ID":"f56dcb5e-35af-4685-bbda-bc1571f0604a","Type":"ContainerDied","Data":"7c2f5c275ec2e1d15e3e86a6317b4be7fd776bc68d438b3456b95166d0b72ef0"}
Jul 30 00:14:06.213061 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:14:06.212794    2560 scope.go:117] "RemoveContainer" containerID="2b5fb20daf23dd695180c0d4904700fcc4cf7dc1af1b7f394f7de8cfb216881c"
Jul 30 00:14:06.221739 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:14:06.221724    2560 scope.go:117] "RemoveContainer" containerID="2b5fb20daf23dd695180c0d4904700fcc4cf7dc1af1b7f394f7de8cfb216881c"
Jul 30 00:14:06.221989 ip-10-0-133-55 kubenswrapper[2560]: E0730 00:14:06.221970    2560 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2b5fb20daf23dd695180c0d4904700fcc4cf7dc1af1b7f394f7de8cfb216881c\": container with ID starting with 2b5fb20daf23dd695180c0d4904700fcc4cf7dc1af1b7f394f7de8cfb216881c not found: ID does not exist" containerID="2b5fb20daf23dd695180c0d4904700fcc4cf7dc1af1b7f394f7de8cfb216881c"
Jul 30 00:14:06.222033 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:14:06.221996    2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2b5fb20daf23dd695180c0d4904700fcc4cf7dc1af1b7f394f7de8cfb216881c"} err="failed to get container status \"2b5fb20daf23dd695180c0d4904700fcc4cf7dc1af1b7f394f7de8cfb216881c\": rpc error: code = NotFound desc = could not find container \"2b5fb20daf23dd695180c0d4904700fcc4cf7dc1af1b7f394f7de8cfb216881c\": container with ID starting with 2b5fb20daf23dd695180c0d4904700fcc4cf7dc1af1b7f394f7de8cfb216881c not found: ID does not exist"
Jul 30 00:14:06.232908 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:14:06.232887    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-599858b585-v7xck"]
Jul 30 00:14:06.236597 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:14:06.236576    2560 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-599858b585-v7xck"]
Jul 30 00:14:07.405138 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:14:07.405105    2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f56dcb5e-35af-4685-bbda-bc1571f0604a" path="/var/lib/kubelet/pods/f56dcb5e-35af-4685-bbda-bc1571f0604a/volumes"
Jul 30 00:14:17.334733 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:14:17.334695    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-6dd9f59587-cjrwv"]
Jul 30 00:14:17.335293 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:14:17.335024    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f56dcb5e-35af-4685-bbda-bc1571f0604a" containerName="console"
Jul 30 00:14:17.335293 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:14:17.335037    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="f56dcb5e-35af-4685-bbda-bc1571f0604a" containerName="console"
Jul 30 00:14:17.335293 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:14:17.335048    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="90d5e719-0eac-4800-9672-7791a6f1d47d" containerName="authorino"
Jul 30 00:14:17.335293 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:14:17.335054    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="90d5e719-0eac-4800-9672-7791a6f1d47d" containerName="authorino"
Jul 30 00:14:17.335293 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:14:17.335134    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="90d5e719-0eac-4800-9672-7791a6f1d47d" containerName="authorino"
Jul 30 00:14:17.335293 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:14:17.335144    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="f56dcb5e-35af-4685-bbda-bc1571f0604a" containerName="console"
Jul 30 00:14:17.339826 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:14:17.339804    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-6dd9f59587-cjrwv"
Jul 30 00:14:17.343545 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:14:17.343522    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-authorino-dockercfg-j2x5b\""
Jul 30 00:14:17.343717 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:14:17.343524    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-server-cert\""
Jul 30 00:14:17.345991 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:14:17.345964    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-6dd9f59587-cjrwv"]
Jul 30 00:14:17.499347 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:14:17.499306    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/d8877a26-3742-4ab2-a7f8-14e46e7322a3-tls-cert\") pod \"authorino-6dd9f59587-cjrwv\" (UID: \"d8877a26-3742-4ab2-a7f8-14e46e7322a3\") " pod="kuadrant-system/authorino-6dd9f59587-cjrwv"
Jul 30 00:14:17.499505 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:14:17.499427    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dzz2l\" (UniqueName: \"kubernetes.io/projected/d8877a26-3742-4ab2-a7f8-14e46e7322a3-kube-api-access-dzz2l\") pod \"authorino-6dd9f59587-cjrwv\" (UID: \"d8877a26-3742-4ab2-a7f8-14e46e7322a3\") " pod="kuadrant-system/authorino-6dd9f59587-cjrwv"
Jul 30 00:14:17.600028 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:14:17.599956    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/d8877a26-3742-4ab2-a7f8-14e46e7322a3-tls-cert\") pod \"authorino-6dd9f59587-cjrwv\" (UID: \"d8877a26-3742-4ab2-a7f8-14e46e7322a3\") " pod="kuadrant-system/authorino-6dd9f59587-cjrwv"
Jul 30 00:14:17.600164 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:14:17.600028    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dzz2l\" (UniqueName: \"kubernetes.io/projected/d8877a26-3742-4ab2-a7f8-14e46e7322a3-kube-api-access-dzz2l\") pod \"authorino-6dd9f59587-cjrwv\" (UID: \"d8877a26-3742-4ab2-a7f8-14e46e7322a3\") " pod="kuadrant-system/authorino-6dd9f59587-cjrwv"
Jul 30 00:14:17.602341 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:14:17.602321    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/d8877a26-3742-4ab2-a7f8-14e46e7322a3-tls-cert\") pod \"authorino-6dd9f59587-cjrwv\" (UID: \"d8877a26-3742-4ab2-a7f8-14e46e7322a3\") " pod="kuadrant-system/authorino-6dd9f59587-cjrwv"
Jul 30 00:14:17.607541 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:14:17.607515    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dzz2l\" (UniqueName: \"kubernetes.io/projected/d8877a26-3742-4ab2-a7f8-14e46e7322a3-kube-api-access-dzz2l\") pod \"authorino-6dd9f59587-cjrwv\" (UID: \"d8877a26-3742-4ab2-a7f8-14e46e7322a3\") " pod="kuadrant-system/authorino-6dd9f59587-cjrwv"
Jul 30 00:14:17.650588 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:14:17.650564    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-6dd9f59587-cjrwv"
Jul 30 00:14:17.772778 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:14:17.772753    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-6dd9f59587-cjrwv"]
Jul 30 00:14:17.774942 ip-10-0-133-55 kubenswrapper[2560]: W0730 00:14:17.774916    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podd8877a26_3742_4ab2_a7f8_14e46e7322a3.slice/crio-93c241112a5d1efdab90b86148e9f464e98adab2f8d63fcedaee4b64feca359f WatchSource:0}: Error finding container 93c241112a5d1efdab90b86148e9f464e98adab2f8d63fcedaee4b64feca359f: Status 404 returned error can't find the container with id 93c241112a5d1efdab90b86148e9f464e98adab2f8d63fcedaee4b64feca359f
Jul 30 00:14:17.991508 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:14:17.991474    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-6dd9f59587-cjrwv"]
Jul 30 00:14:18.266447 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:14:18.266350    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-6dd9f59587-cjrwv" event={"ID":"d8877a26-3742-4ab2-a7f8-14e46e7322a3","Type":"ContainerStarted","Data":"ee4e5eb7ca886f04067ee2ba0bb8fad0ab22167d5e4a7b487d1e609572558717"}
Jul 30 00:14:18.266447 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:14:18.266376    2560 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/authorino-6dd9f59587-cjrwv" podUID="d8877a26-3742-4ab2-a7f8-14e46e7322a3" containerName="authorino" containerID="cri-o://ee4e5eb7ca886f04067ee2ba0bb8fad0ab22167d5e4a7b487d1e609572558717" gracePeriod=30
Jul 30 00:14:18.266447 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:14:18.266404    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-6dd9f59587-cjrwv" event={"ID":"d8877a26-3742-4ab2-a7f8-14e46e7322a3","Type":"ContainerStarted","Data":"93c241112a5d1efdab90b86148e9f464e98adab2f8d63fcedaee4b64feca359f"}
Jul 30 00:14:18.282625 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:14:18.282587    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-6dd9f59587-cjrwv" podStartSLOduration=0.921116795 podStartE2EDuration="1.282573645s" totalImagesPullingTime="361.45685ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-30 00:14:17 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 00:14:18.280625953 +0000 UTC m=+745.339842757" watchObservedRunningTime="2026-07-30 00:14:18.282573645 +0000 UTC m=+745.341790450"
Jul 30 00:14:18.497030 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:14:18.497004    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-6dd9f59587-cjrwv"
Jul 30 00:14:18.609754 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:14:18.609730    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-dzz2l\" (UniqueName: \"kubernetes.io/projected/d8877a26-3742-4ab2-a7f8-14e46e7322a3-kube-api-access-dzz2l\") pod \"d8877a26-3742-4ab2-a7f8-14e46e7322a3\" (UID: \"d8877a26-3742-4ab2-a7f8-14e46e7322a3\") "
Jul 30 00:14:18.609878 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:14:18.609783    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/d8877a26-3742-4ab2-a7f8-14e46e7322a3-tls-cert\") pod \"d8877a26-3742-4ab2-a7f8-14e46e7322a3\" (UID: \"d8877a26-3742-4ab2-a7f8-14e46e7322a3\") "
Jul 30 00:14:18.612350 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:14:18.612321    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d8877a26-3742-4ab2-a7f8-14e46e7322a3-kube-api-access-dzz2l" (OuterVolumeSpecName: "kube-api-access-dzz2l") pod "d8877a26-3742-4ab2-a7f8-14e46e7322a3" (UID: "d8877a26-3742-4ab2-a7f8-14e46e7322a3"). InnerVolumeSpecName "kube-api-access-dzz2l". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 30 00:14:18.620554 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:14:18.620526    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d8877a26-3742-4ab2-a7f8-14e46e7322a3-tls-cert" (OuterVolumeSpecName: "tls-cert") pod "d8877a26-3742-4ab2-a7f8-14e46e7322a3" (UID: "d8877a26-3742-4ab2-a7f8-14e46e7322a3"). InnerVolumeSpecName "tls-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 30 00:14:18.710825 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:14:18.710797    2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-dzz2l\" (UniqueName: \"kubernetes.io/projected/d8877a26-3742-4ab2-a7f8-14e46e7322a3-kube-api-access-dzz2l\") on node \"ip-10-0-133-55.ec2.internal\" DevicePath \"\""
Jul 30 00:14:18.710825 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:14:18.710823    2560 reconciler_common.go:299] "Volume detached for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/d8877a26-3742-4ab2-a7f8-14e46e7322a3-tls-cert\") on node \"ip-10-0-133-55.ec2.internal\" DevicePath \"\""
Jul 30 00:14:19.271935 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:14:19.271900    2560 generic.go:356] "Generic (PLEG): container finished" podID="d8877a26-3742-4ab2-a7f8-14e46e7322a3" containerID="ee4e5eb7ca886f04067ee2ba0bb8fad0ab22167d5e4a7b487d1e609572558717" exitCode=0
Jul 30 00:14:19.272093 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:14:19.271946    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-6dd9f59587-cjrwv"
Jul 30 00:14:19.272093 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:14:19.271961    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-6dd9f59587-cjrwv" event={"ID":"d8877a26-3742-4ab2-a7f8-14e46e7322a3","Type":"ContainerDied","Data":"ee4e5eb7ca886f04067ee2ba0bb8fad0ab22167d5e4a7b487d1e609572558717"}
Jul 30 00:14:19.272093 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:14:19.271992    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-6dd9f59587-cjrwv" event={"ID":"d8877a26-3742-4ab2-a7f8-14e46e7322a3","Type":"ContainerDied","Data":"93c241112a5d1efdab90b86148e9f464e98adab2f8d63fcedaee4b64feca359f"}
Jul 30 00:14:19.272093 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:14:19.272009    2560 scope.go:117] "RemoveContainer" containerID="ee4e5eb7ca886f04067ee2ba0bb8fad0ab22167d5e4a7b487d1e609572558717"
Jul 30 00:14:19.281538 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:14:19.281519    2560 scope.go:117] "RemoveContainer" containerID="ee4e5eb7ca886f04067ee2ba0bb8fad0ab22167d5e4a7b487d1e609572558717"
Jul 30 00:14:19.281828 ip-10-0-133-55 kubenswrapper[2560]: E0730 00:14:19.281806    2560 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ee4e5eb7ca886f04067ee2ba0bb8fad0ab22167d5e4a7b487d1e609572558717\": container with ID starting with ee4e5eb7ca886f04067ee2ba0bb8fad0ab22167d5e4a7b487d1e609572558717 not found: ID does not exist" containerID="ee4e5eb7ca886f04067ee2ba0bb8fad0ab22167d5e4a7b487d1e609572558717"
Jul 30 00:14:19.281910 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:14:19.281836    2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ee4e5eb7ca886f04067ee2ba0bb8fad0ab22167d5e4a7b487d1e609572558717"} err="failed to get container status \"ee4e5eb7ca886f04067ee2ba0bb8fad0ab22167d5e4a7b487d1e609572558717\": rpc error: code = NotFound desc = could not find container \"ee4e5eb7ca886f04067ee2ba0bb8fad0ab22167d5e4a7b487d1e609572558717\": container with ID starting with ee4e5eb7ca886f04067ee2ba0bb8fad0ab22167d5e4a7b487d1e609572558717 not found: ID does not exist"
Jul 30 00:14:19.293273 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:14:19.293243    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-6dd9f59587-cjrwv"]
Jul 30 00:14:19.295280 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:14:19.295260    2560 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-6dd9f59587-cjrwv"]
Jul 30 00:14:19.405130 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:14:19.405097    2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d8877a26-3742-4ab2-a7f8-14e46e7322a3" path="/var/lib/kubelet/pods/d8877a26-3742-4ab2-a7f8-14e46e7322a3/volumes"
Jul 30 00:15:01.097535 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:15:01.097501    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-5cc6cd444b-6txxf"]
Jul 30 00:15:01.097921 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:15:01.097822    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d8877a26-3742-4ab2-a7f8-14e46e7322a3" containerName="authorino"
Jul 30 00:15:01.097921 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:15:01.097833    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="d8877a26-3742-4ab2-a7f8-14e46e7322a3" containerName="authorino"
Jul 30 00:15:01.097921 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:15:01.097901    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="d8877a26-3742-4ab2-a7f8-14e46e7322a3" containerName="authorino"
Jul 30 00:15:01.102291 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:15:01.102271    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-5cc6cd444b-6txxf"
Jul 30 00:15:01.104966 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:15:01.104946    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins\""
Jul 30 00:15:01.110253 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:15:01.110229    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-5cc6cd444b-6txxf"]
Jul 30 00:15:01.167881 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:15:01.167843    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-b4p2b\" (UniqueName: \"kubernetes.io/projected/59139f9a-241a-42f1-a0c9-97c147cf4f7e-kube-api-access-b4p2b\") pod \"payload-processing-5cc6cd444b-6txxf\" (UID: \"59139f9a-241a-42f1-a0c9-97c147cf4f7e\") " pod="openshift-ingress/payload-processing-5cc6cd444b-6txxf"
Jul 30 00:15:01.168028 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:15:01.167973    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/59139f9a-241a-42f1-a0c9-97c147cf4f7e-plugins-config-volume\") pod \"payload-processing-5cc6cd444b-6txxf\" (UID: \"59139f9a-241a-42f1-a0c9-97c147cf4f7e\") " pod="openshift-ingress/payload-processing-5cc6cd444b-6txxf"
Jul 30 00:15:01.268721 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:15:01.268686    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-b4p2b\" (UniqueName: \"kubernetes.io/projected/59139f9a-241a-42f1-a0c9-97c147cf4f7e-kube-api-access-b4p2b\") pod \"payload-processing-5cc6cd444b-6txxf\" (UID: \"59139f9a-241a-42f1-a0c9-97c147cf4f7e\") " pod="openshift-ingress/payload-processing-5cc6cd444b-6txxf"
Jul 30 00:15:01.268879 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:15:01.268785    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/59139f9a-241a-42f1-a0c9-97c147cf4f7e-plugins-config-volume\") pod \"payload-processing-5cc6cd444b-6txxf\" (UID: \"59139f9a-241a-42f1-a0c9-97c147cf4f7e\") " pod="openshift-ingress/payload-processing-5cc6cd444b-6txxf"
Jul 30 00:15:01.269503 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:15:01.269484    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/59139f9a-241a-42f1-a0c9-97c147cf4f7e-plugins-config-volume\") pod \"payload-processing-5cc6cd444b-6txxf\" (UID: \"59139f9a-241a-42f1-a0c9-97c147cf4f7e\") " pod="openshift-ingress/payload-processing-5cc6cd444b-6txxf"
Jul 30 00:15:01.276382 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:15:01.276361    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-b4p2b\" (UniqueName: \"kubernetes.io/projected/59139f9a-241a-42f1-a0c9-97c147cf4f7e-kube-api-access-b4p2b\") pod \"payload-processing-5cc6cd444b-6txxf\" (UID: \"59139f9a-241a-42f1-a0c9-97c147cf4f7e\") " pod="openshift-ingress/payload-processing-5cc6cd444b-6txxf"
Jul 30 00:15:01.413383 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:15:01.413351    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-5cc6cd444b-6txxf"
Jul 30 00:15:01.746719 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:15:01.745015    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-5cc6cd444b-6txxf"]
Jul 30 00:15:01.748473 ip-10-0-133-55 kubenswrapper[2560]: W0730 00:15:01.748441    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod59139f9a_241a_42f1_a0c9_97c147cf4f7e.slice/crio-19c36b9acfab2f0f3377040f5b7c79fccf8b7f7210cd7689c81b33da380883bf WatchSource:0}: Error finding container 19c36b9acfab2f0f3377040f5b7c79fccf8b7f7210cd7689c81b33da380883bf: Status 404 returned error can't find the container with id 19c36b9acfab2f0f3377040f5b7c79fccf8b7f7210cd7689c81b33da380883bf
Jul 30 00:15:02.464714 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:15:02.464678    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-5cc6cd444b-6txxf" event={"ID":"59139f9a-241a-42f1-a0c9-97c147cf4f7e","Type":"ContainerStarted","Data":"19c36b9acfab2f0f3377040f5b7c79fccf8b7f7210cd7689c81b33da380883bf"}
Jul 30 00:15:04.475995 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:15:04.475957    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-5cc6cd444b-6txxf" event={"ID":"59139f9a-241a-42f1-a0c9-97c147cf4f7e","Type":"ContainerStarted","Data":"6d8651ab68aa896c8e2db59606e6f14dc25a5468923bb5a7ee14205a4eb4e508"}
Jul 30 00:15:04.476425 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:15:04.476065    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-5cc6cd444b-6txxf"
Jul 30 00:15:04.490747 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:15:04.490684    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-5cc6cd444b-6txxf" podStartSLOduration=1.763350258 podStartE2EDuration="3.490671373s" totalImagesPullingTime="1.727321115s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-30 00:15:01 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 00:15:04.490044424 +0000 UTC m=+791.549261228" watchObservedRunningTime="2026-07-30 00:15:04.490671373 +0000 UTC m=+791.549888177"
Jul 30 00:15:15.482922 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:15:15.482836    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-5cc6cd444b-6txxf"
Jul 30 00:15:24.502408 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:15:24.502374    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-qd87f"]
Jul 30 00:15:24.505621 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:15:24.505602    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-qd87f"
Jul 30 00:15:24.509289 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:15:24.509266    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\""
Jul 30 00:15:24.509289 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:15:24.509276    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\""
Jul 30 00:15:24.509289 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:15:24.509288    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-dw4m6\""
Jul 30 00:15:24.509511 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:15:24.509277    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-distinct-2-simulated-kserve-self-signed-certs\""
Jul 30 00:15:24.514564 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:15:24.514538    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-qd87f"]
Jul 30 00:15:24.571470 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:15:24.571439    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/6b7761c6-b890-4b58-91e0-f1f87238e75a-model-cache\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-qd87f\" (UID: \"6b7761c6-b890-4b58-91e0-f1f87238e75a\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-qd87f"
Jul 30 00:15:24.571637 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:15:24.571479    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/6b7761c6-b890-4b58-91e0-f1f87238e75a-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-qd87f\" (UID: \"6b7761c6-b890-4b58-91e0-f1f87238e75a\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-qd87f"
Jul 30 00:15:24.571637 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:15:24.571546    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/6b7761c6-b890-4b58-91e0-f1f87238e75a-home\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-qd87f\" (UID: \"6b7761c6-b890-4b58-91e0-f1f87238e75a\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-qd87f"
Jul 30 00:15:24.571637 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:15:24.571595    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/6b7761c6-b890-4b58-91e0-f1f87238e75a-dshm\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-qd87f\" (UID: \"6b7761c6-b890-4b58-91e0-f1f87238e75a\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-qd87f"
Jul 30 00:15:24.571637 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:15:24.571629    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zqjkx\" (UniqueName: \"kubernetes.io/projected/6b7761c6-b890-4b58-91e0-f1f87238e75a-kube-api-access-zqjkx\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-qd87f\" (UID: \"6b7761c6-b890-4b58-91e0-f1f87238e75a\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-qd87f"
Jul 30 00:15:24.571856 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:15:24.571665    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/6b7761c6-b890-4b58-91e0-f1f87238e75a-tmp-dir\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-qd87f\" (UID: \"6b7761c6-b890-4b58-91e0-f1f87238e75a\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-qd87f"
Jul 30 00:15:24.672793 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:15:24.672758    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/6b7761c6-b890-4b58-91e0-f1f87238e75a-tmp-dir\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-qd87f\" (UID: \"6b7761c6-b890-4b58-91e0-f1f87238e75a\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-qd87f"
Jul 30 00:15:24.672948 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:15:24.672808    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/6b7761c6-b890-4b58-91e0-f1f87238e75a-model-cache\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-qd87f\" (UID: \"6b7761c6-b890-4b58-91e0-f1f87238e75a\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-qd87f"
Jul 30 00:15:24.672948 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:15:24.672845    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/6b7761c6-b890-4b58-91e0-f1f87238e75a-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-qd87f\" (UID: \"6b7761c6-b890-4b58-91e0-f1f87238e75a\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-qd87f"
Jul 30 00:15:24.672948 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:15:24.672904    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/6b7761c6-b890-4b58-91e0-f1f87238e75a-home\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-qd87f\" (UID: \"6b7761c6-b890-4b58-91e0-f1f87238e75a\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-qd87f"
Jul 30 00:15:24.672948 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:15:24.672923    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/6b7761c6-b890-4b58-91e0-f1f87238e75a-dshm\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-qd87f\" (UID: \"6b7761c6-b890-4b58-91e0-f1f87238e75a\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-qd87f"
Jul 30 00:15:24.672948 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:15:24.672940    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zqjkx\" (UniqueName: \"kubernetes.io/projected/6b7761c6-b890-4b58-91e0-f1f87238e75a-kube-api-access-zqjkx\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-qd87f\" (UID: \"6b7761c6-b890-4b58-91e0-f1f87238e75a\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-qd87f"
Jul 30 00:15:24.673208 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:15:24.673181    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/6b7761c6-b890-4b58-91e0-f1f87238e75a-tmp-dir\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-qd87f\" (UID: \"6b7761c6-b890-4b58-91e0-f1f87238e75a\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-qd87f"
Jul 30 00:15:24.673290 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:15:24.673267    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/6b7761c6-b890-4b58-91e0-f1f87238e75a-home\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-qd87f\" (UID: \"6b7761c6-b890-4b58-91e0-f1f87238e75a\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-qd87f"
Jul 30 00:15:24.673376 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:15:24.673293    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/6b7761c6-b890-4b58-91e0-f1f87238e75a-model-cache\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-qd87f\" (UID: \"6b7761c6-b890-4b58-91e0-f1f87238e75a\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-qd87f"
Jul 30 00:15:24.675209 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:15:24.675190    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/6b7761c6-b890-4b58-91e0-f1f87238e75a-dshm\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-qd87f\" (UID: \"6b7761c6-b890-4b58-91e0-f1f87238e75a\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-qd87f"
Jul 30 00:15:24.675383 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:15:24.675359    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/6b7761c6-b890-4b58-91e0-f1f87238e75a-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-qd87f\" (UID: \"6b7761c6-b890-4b58-91e0-f1f87238e75a\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-qd87f"
Jul 30 00:15:24.680170 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:15:24.680147    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zqjkx\" (UniqueName: \"kubernetes.io/projected/6b7761c6-b890-4b58-91e0-f1f87238e75a-kube-api-access-zqjkx\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-qd87f\" (UID: \"6b7761c6-b890-4b58-91e0-f1f87238e75a\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-qd87f"
Jul 30 00:15:24.816958 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:15:24.816880    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-qd87f"
Jul 30 00:15:24.948055 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:15:24.948030    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-qd87f"]
Jul 30 00:15:24.949653 ip-10-0-133-55 kubenswrapper[2560]: W0730 00:15:24.949627    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6b7761c6_b890_4b58_91e0_f1f87238e75a.slice/crio-99f1a6d1f7d4d98316e31de0de95a0620b6e2c8377fc73862817b242ef1aa290 WatchSource:0}: Error finding container 99f1a6d1f7d4d98316e31de0de95a0620b6e2c8377fc73862817b242ef1aa290: Status 404 returned error can't find the container with id 99f1a6d1f7d4d98316e31de0de95a0620b6e2c8377fc73862817b242ef1aa290
Jul 30 00:15:25.570457 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:15:25.570418    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-qd87f" event={"ID":"6b7761c6-b890-4b58-91e0-f1f87238e75a","Type":"ContainerStarted","Data":"99f1a6d1f7d4d98316e31de0de95a0620b6e2c8377fc73862817b242ef1aa290"}
Jul 30 00:15:26.576678 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:15:26.576639    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-qd87f" event={"ID":"6b7761c6-b890-4b58-91e0-f1f87238e75a","Type":"ContainerStarted","Data":"3da16a146af76060a2513d4047be1e360e525607564da8e068cc82bbe5f38914"}
Jul 30 00:15:26.593279 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:15:26.593234    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-qd87f" podStartSLOduration=1.4495774240000001 podStartE2EDuration="2.593219245s" totalImagesPullingTime="1.143641821s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-30 00:15:24 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 00:15:26.591964612 +0000 UTC m=+813.651181415" watchObservedRunningTime="2026-07-30 00:15:26.593219245 +0000 UTC m=+813.652436049"
Jul 30 00:15:34.817945 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:15:34.817890    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-qd87f"
Jul 30 00:15:34.817945 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:15:34.817960    2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-qd87f"
Jul 30 00:15:34.830580 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:15:34.830558    2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-qd87f"
Jul 30 00:15:35.628764 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:15:35.628736    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-qd87f"
Jul 30 00:15:49.799653 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:15:49.799622    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-598466548d-vr28c"]
Jul 30 00:15:49.803003 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:15:49.802982    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-vr28c"
Jul 30 00:15:49.805522 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:15:49.805492    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-trlp-test-simulated-kserve-self-signed-certs\""
Jul 30 00:15:49.811068 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:15:49.811051    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-598466548d-vr28c"]
Jul 30 00:15:49.897463 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:15:49.897437    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/28162862-9b92-43aa-b271-bbce806ae795-tmp-dir\") pod \"e2e-trlp-test-simulated-kserve-598466548d-vr28c\" (UID: \"28162862-9b92-43aa-b271-bbce806ae795\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-vr28c"
Jul 30 00:15:49.897587 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:15:49.897470    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/28162862-9b92-43aa-b271-bbce806ae795-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-598466548d-vr28c\" (UID: \"28162862-9b92-43aa-b271-bbce806ae795\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-vr28c"
Jul 30 00:15:49.897587 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:15:49.897500    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/28162862-9b92-43aa-b271-bbce806ae795-dshm\") pod \"e2e-trlp-test-simulated-kserve-598466548d-vr28c\" (UID: \"28162862-9b92-43aa-b271-bbce806ae795\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-vr28c"
Jul 30 00:15:49.897587 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:15:49.897527    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/28162862-9b92-43aa-b271-bbce806ae795-model-cache\") pod \"e2e-trlp-test-simulated-kserve-598466548d-vr28c\" (UID: \"28162862-9b92-43aa-b271-bbce806ae795\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-vr28c"
Jul 30 00:15:49.897587 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:15:49.897562    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/28162862-9b92-43aa-b271-bbce806ae795-home\") pod \"e2e-trlp-test-simulated-kserve-598466548d-vr28c\" (UID: \"28162862-9b92-43aa-b271-bbce806ae795\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-vr28c"
Jul 30 00:15:49.897746 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:15:49.897589    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rz56c\" (UniqueName: \"kubernetes.io/projected/28162862-9b92-43aa-b271-bbce806ae795-kube-api-access-rz56c\") pod \"e2e-trlp-test-simulated-kserve-598466548d-vr28c\" (UID: \"28162862-9b92-43aa-b271-bbce806ae795\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-vr28c"
Jul 30 00:15:49.998334 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:15:49.998281    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/28162862-9b92-43aa-b271-bbce806ae795-home\") pod \"e2e-trlp-test-simulated-kserve-598466548d-vr28c\" (UID: \"28162862-9b92-43aa-b271-bbce806ae795\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-vr28c"
Jul 30 00:15:49.998489 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:15:49.998346    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rz56c\" (UniqueName: \"kubernetes.io/projected/28162862-9b92-43aa-b271-bbce806ae795-kube-api-access-rz56c\") pod \"e2e-trlp-test-simulated-kserve-598466548d-vr28c\" (UID: \"28162862-9b92-43aa-b271-bbce806ae795\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-vr28c"
Jul 30 00:15:49.998489 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:15:49.998389    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/28162862-9b92-43aa-b271-bbce806ae795-tmp-dir\") pod \"e2e-trlp-test-simulated-kserve-598466548d-vr28c\" (UID: \"28162862-9b92-43aa-b271-bbce806ae795\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-vr28c"
Jul 30 00:15:49.998489 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:15:49.998411    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/28162862-9b92-43aa-b271-bbce806ae795-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-598466548d-vr28c\" (UID: \"28162862-9b92-43aa-b271-bbce806ae795\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-vr28c"
Jul 30 00:15:49.998489 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:15:49.998435    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/28162862-9b92-43aa-b271-bbce806ae795-dshm\") pod \"e2e-trlp-test-simulated-kserve-598466548d-vr28c\" (UID: \"28162862-9b92-43aa-b271-bbce806ae795\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-vr28c"
Jul 30 00:15:49.998697 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:15:49.998543    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/28162862-9b92-43aa-b271-bbce806ae795-model-cache\") pod \"e2e-trlp-test-simulated-kserve-598466548d-vr28c\" (UID: \"28162862-9b92-43aa-b271-bbce806ae795\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-vr28c"
Jul 30 00:15:49.998697 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:15:49.998678    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/28162862-9b92-43aa-b271-bbce806ae795-home\") pod \"e2e-trlp-test-simulated-kserve-598466548d-vr28c\" (UID: \"28162862-9b92-43aa-b271-bbce806ae795\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-vr28c"
Jul 30 00:15:49.998799 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:15:49.998766    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/28162862-9b92-43aa-b271-bbce806ae795-tmp-dir\") pod \"e2e-trlp-test-simulated-kserve-598466548d-vr28c\" (UID: \"28162862-9b92-43aa-b271-bbce806ae795\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-vr28c"
Jul 30 00:15:49.998861 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:15:49.998823    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/28162862-9b92-43aa-b271-bbce806ae795-model-cache\") pod \"e2e-trlp-test-simulated-kserve-598466548d-vr28c\" (UID: \"28162862-9b92-43aa-b271-bbce806ae795\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-vr28c"
Jul 30 00:15:50.000610 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:15:50.000589    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/28162862-9b92-43aa-b271-bbce806ae795-dshm\") pod \"e2e-trlp-test-simulated-kserve-598466548d-vr28c\" (UID: \"28162862-9b92-43aa-b271-bbce806ae795\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-vr28c"
Jul 30 00:15:50.000811 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:15:50.000798    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/28162862-9b92-43aa-b271-bbce806ae795-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-598466548d-vr28c\" (UID: \"28162862-9b92-43aa-b271-bbce806ae795\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-vr28c"
Jul 30 00:15:50.005581 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:15:50.005560    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rz56c\" (UniqueName: \"kubernetes.io/projected/28162862-9b92-43aa-b271-bbce806ae795-kube-api-access-rz56c\") pod \"e2e-trlp-test-simulated-kserve-598466548d-vr28c\" (UID: \"28162862-9b92-43aa-b271-bbce806ae795\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-vr28c"
Jul 30 00:15:50.113755 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:15:50.113675    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-vr28c"
Jul 30 00:15:50.241081 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:15:50.241057    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-598466548d-vr28c"]
Jul 30 00:15:50.243073 ip-10-0-133-55 kubenswrapper[2560]: W0730 00:15:50.243041    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod28162862_9b92_43aa_b271_bbce806ae795.slice/crio-ca61469f728e275d1df9daae0d7776677d6ec75652fba7fd825dbe349bd21472 WatchSource:0}: Error finding container ca61469f728e275d1df9daae0d7776677d6ec75652fba7fd825dbe349bd21472: Status 404 returned error can't find the container with id ca61469f728e275d1df9daae0d7776677d6ec75652fba7fd825dbe349bd21472
Jul 30 00:15:50.684195 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:15:50.684110    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-vr28c" event={"ID":"28162862-9b92-43aa-b271-bbce806ae795","Type":"ContainerStarted","Data":"764045cc9cde415dbfcfddc98550d94c2c7000c4348e1c056daff80b9b78dac0"}
Jul 30 00:15:50.684195 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:15:50.684166    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-vr28c" event={"ID":"28162862-9b92-43aa-b271-bbce806ae795","Type":"ContainerStarted","Data":"ca61469f728e275d1df9daae0d7776677d6ec75652fba7fd825dbe349bd21472"}
Jul 30 00:15:50.701630 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:15:50.701588    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-vr28c" podStartSLOduration=1.518384712 podStartE2EDuration="1.701569474s" totalImagesPullingTime="183.184762ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-30 00:15:49 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 00:15:50.700039918 +0000 UTC m=+837.759256723" watchObservedRunningTime="2026-07-30 00:15:50.701569474 +0000 UTC m=+837.760786278"
Jul 30 00:16:00.114003 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:16:00.113963    2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-vr28c"
Jul 30 00:16:00.114498 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:16:00.114028    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-vr28c"
Jul 30 00:16:00.126402 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:16:00.126375    2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-vr28c"
Jul 30 00:16:00.742036 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:16:00.742005    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-vr28c"
Jul 30 00:16:21.600415 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:16:21.600369    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-57fc66f697-gb8zz"]
Jul 30 00:16:21.603914 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:16:21.603891    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-gb8zz"
Jul 30 00:16:21.606601 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:16:21.606578    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"premium-simulated-simulated-premium-kserve-self-signed-certs\""
Jul 30 00:16:21.611871 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:16:21.611847    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-57fc66f697-gb8zz"]
Jul 30 00:16:21.659653 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:16:21.659609    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/c4633223-25b1-4000-84da-adb60d1a9982-model-cache\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-gb8zz\" (UID: \"c4633223-25b1-4000-84da-adb60d1a9982\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-gb8zz"
Jul 30 00:16:21.659795 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:16:21.659697    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c4633223-25b1-4000-84da-adb60d1a9982-tmp-dir\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-gb8zz\" (UID: \"c4633223-25b1-4000-84da-adb60d1a9982\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-gb8zz"
Jul 30 00:16:21.659795 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:16:21.659756    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/c4633223-25b1-4000-84da-adb60d1a9982-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-gb8zz\" (UID: \"c4633223-25b1-4000-84da-adb60d1a9982\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-gb8zz"
Jul 30 00:16:21.659890 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:16:21.659842    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zpgh4\" (UniqueName: \"kubernetes.io/projected/c4633223-25b1-4000-84da-adb60d1a9982-kube-api-access-zpgh4\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-gb8zz\" (UID: \"c4633223-25b1-4000-84da-adb60d1a9982\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-gb8zz"
Jul 30 00:16:21.659932 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:16:21.659894    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/c4633223-25b1-4000-84da-adb60d1a9982-home\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-gb8zz\" (UID: \"c4633223-25b1-4000-84da-adb60d1a9982\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-gb8zz"
Jul 30 00:16:21.659978 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:16:21.659950    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/c4633223-25b1-4000-84da-adb60d1a9982-dshm\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-gb8zz\" (UID: \"c4633223-25b1-4000-84da-adb60d1a9982\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-gb8zz"
Jul 30 00:16:21.761070 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:16:21.761032    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/c4633223-25b1-4000-84da-adb60d1a9982-dshm\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-gb8zz\" (UID: \"c4633223-25b1-4000-84da-adb60d1a9982\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-gb8zz"
Jul 30 00:16:21.761246 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:16:21.761091    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/c4633223-25b1-4000-84da-adb60d1a9982-model-cache\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-gb8zz\" (UID: \"c4633223-25b1-4000-84da-adb60d1a9982\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-gb8zz"
Jul 30 00:16:21.761246 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:16:21.761121    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c4633223-25b1-4000-84da-adb60d1a9982-tmp-dir\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-gb8zz\" (UID: \"c4633223-25b1-4000-84da-adb60d1a9982\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-gb8zz"
Jul 30 00:16:21.761246 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:16:21.761160    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/c4633223-25b1-4000-84da-adb60d1a9982-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-gb8zz\" (UID: \"c4633223-25b1-4000-84da-adb60d1a9982\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-gb8zz"
Jul 30 00:16:21.761246 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:16:21.761200    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zpgh4\" (UniqueName: \"kubernetes.io/projected/c4633223-25b1-4000-84da-adb60d1a9982-kube-api-access-zpgh4\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-gb8zz\" (UID: \"c4633223-25b1-4000-84da-adb60d1a9982\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-gb8zz"
Jul 30 00:16:21.761246 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:16:21.761229    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/c4633223-25b1-4000-84da-adb60d1a9982-home\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-gb8zz\" (UID: \"c4633223-25b1-4000-84da-adb60d1a9982\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-gb8zz"
Jul 30 00:16:21.761604 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:16:21.761578    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c4633223-25b1-4000-84da-adb60d1a9982-tmp-dir\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-gb8zz\" (UID: \"c4633223-25b1-4000-84da-adb60d1a9982\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-gb8zz"
Jul 30 00:16:21.761683 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:16:21.761647    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/c4633223-25b1-4000-84da-adb60d1a9982-model-cache\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-gb8zz\" (UID: \"c4633223-25b1-4000-84da-adb60d1a9982\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-gb8zz"
Jul 30 00:16:21.761746 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:16:21.761653    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/c4633223-25b1-4000-84da-adb60d1a9982-home\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-gb8zz\" (UID: \"c4633223-25b1-4000-84da-adb60d1a9982\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-gb8zz"
Jul 30 00:16:21.763363 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:16:21.763327    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/c4633223-25b1-4000-84da-adb60d1a9982-dshm\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-gb8zz\" (UID: \"c4633223-25b1-4000-84da-adb60d1a9982\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-gb8zz"
Jul 30 00:16:21.763537 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:16:21.763521    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/c4633223-25b1-4000-84da-adb60d1a9982-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-gb8zz\" (UID: \"c4633223-25b1-4000-84da-adb60d1a9982\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-gb8zz"
Jul 30 00:16:21.768609 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:16:21.768587    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zpgh4\" (UniqueName: \"kubernetes.io/projected/c4633223-25b1-4000-84da-adb60d1a9982-kube-api-access-zpgh4\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-gb8zz\" (UID: \"c4633223-25b1-4000-84da-adb60d1a9982\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-gb8zz"
Jul 30 00:16:21.915498 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:16:21.915472    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-gb8zz"
Jul 30 00:16:22.045358 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:16:22.045334    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-57fc66f697-gb8zz"]
Jul 30 00:16:22.047273 ip-10-0-133-55 kubenswrapper[2560]: W0730 00:16:22.047251    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podc4633223_25b1_4000_84da_adb60d1a9982.slice/crio-de2417e7cf655bdc3968eef87d7c5f734f8242069a033035d9388533031479b1 WatchSource:0}: Error finding container de2417e7cf655bdc3968eef87d7c5f734f8242069a033035d9388533031479b1: Status 404 returned error can't find the container with id de2417e7cf655bdc3968eef87d7c5f734f8242069a033035d9388533031479b1
Jul 30 00:16:22.837554 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:16:22.837514    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-gb8zz" event={"ID":"c4633223-25b1-4000-84da-adb60d1a9982","Type":"ContainerStarted","Data":"ffb572cb34cc13b306f07300ce01ff0d4ba99966e402935e89667293ec9d7def"}
Jul 30 00:16:22.837554 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:16:22.837558    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-gb8zz" event={"ID":"c4633223-25b1-4000-84da-adb60d1a9982","Type":"ContainerStarted","Data":"de2417e7cf655bdc3968eef87d7c5f734f8242069a033035d9388533031479b1"}
Jul 30 00:16:22.854066 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:16:22.854015    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-gb8zz" podStartSLOduration=1.678586825 podStartE2EDuration="1.85400176s" totalImagesPullingTime="175.414935ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-30 00:16:21 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 00:16:22.85316191 +0000 UTC m=+869.912378736" watchObservedRunningTime="2026-07-30 00:16:22.85400176 +0000 UTC m=+869.913218564"
Jul 30 00:16:31.915804 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:16:31.915758    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-gb8zz"
Jul 30 00:16:31.915804 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:16:31.915807    2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-gb8zz"
Jul 30 00:16:31.928210 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:16:31.928186    2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-gb8zz"
Jul 30 00:16:32.895293 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:16:32.895258    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-gb8zz"
Jul 30 00:16:53.381473 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:16:53.381401    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-kchgc_324341b7-120c-4f8b-9ddd-e28b9a40ce9e/console-operator/1.log"
Jul 30 00:16:53.383893 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:16:53.383867    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-kchgc_324341b7-120c-4f8b-9ddd-e28b9a40ce9e/console-operator/1.log"
Jul 30 00:21:53.412051 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:21:53.411974    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-kchgc_324341b7-120c-4f8b-9ddd-e28b9a40ce9e/console-operator/1.log"
Jul 30 00:21:53.414659 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:21:53.414637    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-kchgc_324341b7-120c-4f8b-9ddd-e28b9a40ce9e/console-operator/1.log"
Jul 30 00:26:53.440631 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:26:53.440605    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-kchgc_324341b7-120c-4f8b-9ddd-e28b9a40ce9e/console-operator/1.log"
Jul 30 00:26:53.454068 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:26:53.454045    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-kchgc_324341b7-120c-4f8b-9ddd-e28b9a40ce9e/console-operator/1.log"
Jul 30 00:28:50.407060 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:28:50.406981    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-same-id-a-abb9f543-kserve-f789ffc75-qf2pk"]
Jul 30 00:28:50.410682 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:28:50.410663    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-same-id-a-abb9f543-kserve-f789ffc75-qf2pk"
Jul 30 00:28:50.413158 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:28:50.413136    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-same-id-a-abb9f543-kserve-self-signed-certs\""
Jul 30 00:28:50.427535 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:28:50.427514    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-same-id-a-abb9f543-kserve-f789ffc75-qf2pk"]
Jul 30 00:28:50.549368 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:28:50.549338    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2xdmh\" (UniqueName: \"kubernetes.io/projected/156bd24f-e17f-4b4f-a340-ed384c347889-kube-api-access-2xdmh\") pod \"e2e-same-id-a-abb9f543-kserve-f789ffc75-qf2pk\" (UID: \"156bd24f-e17f-4b4f-a340-ed384c347889\") " pod="llm/e2e-same-id-a-abb9f543-kserve-f789ffc75-qf2pk"
Jul 30 00:28:50.549525 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:28:50.549386    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/156bd24f-e17f-4b4f-a340-ed384c347889-tls-certs\") pod \"e2e-same-id-a-abb9f543-kserve-f789ffc75-qf2pk\" (UID: \"156bd24f-e17f-4b4f-a340-ed384c347889\") " pod="llm/e2e-same-id-a-abb9f543-kserve-f789ffc75-qf2pk"
Jul 30 00:28:50.549525 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:28:50.549453    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/156bd24f-e17f-4b4f-a340-ed384c347889-model-cache\") pod \"e2e-same-id-a-abb9f543-kserve-f789ffc75-qf2pk\" (UID: \"156bd24f-e17f-4b4f-a340-ed384c347889\") " pod="llm/e2e-same-id-a-abb9f543-kserve-f789ffc75-qf2pk"
Jul 30 00:28:50.549525 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:28:50.549471    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/156bd24f-e17f-4b4f-a340-ed384c347889-home\") pod \"e2e-same-id-a-abb9f543-kserve-f789ffc75-qf2pk\" (UID: \"156bd24f-e17f-4b4f-a340-ed384c347889\") " pod="llm/e2e-same-id-a-abb9f543-kserve-f789ffc75-qf2pk"
Jul 30 00:28:50.549525 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:28:50.549486    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/156bd24f-e17f-4b4f-a340-ed384c347889-tmp-dir\") pod \"e2e-same-id-a-abb9f543-kserve-f789ffc75-qf2pk\" (UID: \"156bd24f-e17f-4b4f-a340-ed384c347889\") " pod="llm/e2e-same-id-a-abb9f543-kserve-f789ffc75-qf2pk"
Jul 30 00:28:50.549677 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:28:50.549539    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/156bd24f-e17f-4b4f-a340-ed384c347889-dshm\") pod \"e2e-same-id-a-abb9f543-kserve-f789ffc75-qf2pk\" (UID: \"156bd24f-e17f-4b4f-a340-ed384c347889\") " pod="llm/e2e-same-id-a-abb9f543-kserve-f789ffc75-qf2pk"
Jul 30 00:28:50.650950 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:28:50.650919    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/156bd24f-e17f-4b4f-a340-ed384c347889-model-cache\") pod \"e2e-same-id-a-abb9f543-kserve-f789ffc75-qf2pk\" (UID: \"156bd24f-e17f-4b4f-a340-ed384c347889\") " pod="llm/e2e-same-id-a-abb9f543-kserve-f789ffc75-qf2pk"
Jul 30 00:28:50.651121 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:28:50.650956    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/156bd24f-e17f-4b4f-a340-ed384c347889-home\") pod \"e2e-same-id-a-abb9f543-kserve-f789ffc75-qf2pk\" (UID: \"156bd24f-e17f-4b4f-a340-ed384c347889\") " pod="llm/e2e-same-id-a-abb9f543-kserve-f789ffc75-qf2pk"
Jul 30 00:28:50.651121 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:28:50.650981    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/156bd24f-e17f-4b4f-a340-ed384c347889-tmp-dir\") pod \"e2e-same-id-a-abb9f543-kserve-f789ffc75-qf2pk\" (UID: \"156bd24f-e17f-4b4f-a340-ed384c347889\") " pod="llm/e2e-same-id-a-abb9f543-kserve-f789ffc75-qf2pk"
Jul 30 00:28:50.651121 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:28:50.651056    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/156bd24f-e17f-4b4f-a340-ed384c347889-dshm\") pod \"e2e-same-id-a-abb9f543-kserve-f789ffc75-qf2pk\" (UID: \"156bd24f-e17f-4b4f-a340-ed384c347889\") " pod="llm/e2e-same-id-a-abb9f543-kserve-f789ffc75-qf2pk"
Jul 30 00:28:50.651121 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:28:50.651108    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2xdmh\" (UniqueName: \"kubernetes.io/projected/156bd24f-e17f-4b4f-a340-ed384c347889-kube-api-access-2xdmh\") pod \"e2e-same-id-a-abb9f543-kserve-f789ffc75-qf2pk\" (UID: \"156bd24f-e17f-4b4f-a340-ed384c347889\") " pod="llm/e2e-same-id-a-abb9f543-kserve-f789ffc75-qf2pk"
Jul 30 00:28:50.651345 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:28:50.651141    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/156bd24f-e17f-4b4f-a340-ed384c347889-tls-certs\") pod \"e2e-same-id-a-abb9f543-kserve-f789ffc75-qf2pk\" (UID: \"156bd24f-e17f-4b4f-a340-ed384c347889\") " pod="llm/e2e-same-id-a-abb9f543-kserve-f789ffc75-qf2pk"
Jul 30 00:28:50.651345 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:28:50.651331    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/156bd24f-e17f-4b4f-a340-ed384c347889-model-cache\") pod \"e2e-same-id-a-abb9f543-kserve-f789ffc75-qf2pk\" (UID: \"156bd24f-e17f-4b4f-a340-ed384c347889\") " pod="llm/e2e-same-id-a-abb9f543-kserve-f789ffc75-qf2pk"
Jul 30 00:28:50.651466 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:28:50.651366    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/156bd24f-e17f-4b4f-a340-ed384c347889-home\") pod \"e2e-same-id-a-abb9f543-kserve-f789ffc75-qf2pk\" (UID: \"156bd24f-e17f-4b4f-a340-ed384c347889\") " pod="llm/e2e-same-id-a-abb9f543-kserve-f789ffc75-qf2pk"
Jul 30 00:28:50.651466 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:28:50.651399    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/156bd24f-e17f-4b4f-a340-ed384c347889-tmp-dir\") pod \"e2e-same-id-a-abb9f543-kserve-f789ffc75-qf2pk\" (UID: \"156bd24f-e17f-4b4f-a340-ed384c347889\") " pod="llm/e2e-same-id-a-abb9f543-kserve-f789ffc75-qf2pk"
Jul 30 00:28:50.653247 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:28:50.653217    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/156bd24f-e17f-4b4f-a340-ed384c347889-dshm\") pod \"e2e-same-id-a-abb9f543-kserve-f789ffc75-qf2pk\" (UID: \"156bd24f-e17f-4b4f-a340-ed384c347889\") " pod="llm/e2e-same-id-a-abb9f543-kserve-f789ffc75-qf2pk"
Jul 30 00:28:50.653514 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:28:50.653495    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/156bd24f-e17f-4b4f-a340-ed384c347889-tls-certs\") pod \"e2e-same-id-a-abb9f543-kserve-f789ffc75-qf2pk\" (UID: \"156bd24f-e17f-4b4f-a340-ed384c347889\") " pod="llm/e2e-same-id-a-abb9f543-kserve-f789ffc75-qf2pk"
Jul 30 00:28:50.658841 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:28:50.658797    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2xdmh\" (UniqueName: \"kubernetes.io/projected/156bd24f-e17f-4b4f-a340-ed384c347889-kube-api-access-2xdmh\") pod \"e2e-same-id-a-abb9f543-kserve-f789ffc75-qf2pk\" (UID: \"156bd24f-e17f-4b4f-a340-ed384c347889\") " pod="llm/e2e-same-id-a-abb9f543-kserve-f789ffc75-qf2pk"
Jul 30 00:28:50.720068 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:28:50.720045    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-same-id-a-abb9f543-kserve-f789ffc75-qf2pk"
Jul 30 00:28:50.847570 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:28:50.847545    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-same-id-a-abb9f543-kserve-f789ffc75-qf2pk"]
Jul 30 00:28:50.849249 ip-10-0-133-55 kubenswrapper[2560]: W0730 00:28:50.849222    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod156bd24f_e17f_4b4f_a340_ed384c347889.slice/crio-329df19b503c5d571d9c82e108c9593158010f9a121f4a8b85bb1c3842f0bca2 WatchSource:0}: Error finding container 329df19b503c5d571d9c82e108c9593158010f9a121f4a8b85bb1c3842f0bca2: Status 404 returned error can't find the container with id 329df19b503c5d571d9c82e108c9593158010f9a121f4a8b85bb1c3842f0bca2
Jul 30 00:28:51.317894 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:28:51.317856    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-same-id-a-abb9f543-kserve-f789ffc75-qf2pk" event={"ID":"156bd24f-e17f-4b4f-a340-ed384c347889","Type":"ContainerStarted","Data":"bc47c7f5bae5988d7644b78435e811a69a134b26a75da469a93e15cbdfd90c6c"}
Jul 30 00:28:51.317894 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:28:51.317899    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-same-id-a-abb9f543-kserve-f789ffc75-qf2pk" event={"ID":"156bd24f-e17f-4b4f-a340-ed384c347889","Type":"ContainerStarted","Data":"329df19b503c5d571d9c82e108c9593158010f9a121f4a8b85bb1c3842f0bca2"}
Jul 30 00:28:51.334540 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:28:51.334496    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-same-id-a-abb9f543-kserve-f789ffc75-qf2pk" podStartSLOduration=1.334481866 podStartE2EDuration="1.334481866s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-30 00:28:50 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 00:28:51.333104569 +0000 UTC m=+1618.392321376" watchObservedRunningTime="2026-07-30 00:28:51.334481866 +0000 UTC m=+1618.393698670"
Jul 30 00:29:00.721119 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:29:00.721019    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-same-id-a-abb9f543-kserve-f789ffc75-qf2pk"
Jul 30 00:29:00.721119 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:29:00.721084    2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-same-id-a-abb9f543-kserve-f789ffc75-qf2pk"
Jul 30 00:29:00.734434 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:29:00.734407    2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-same-id-a-abb9f543-kserve-f789ffc75-qf2pk"
Jul 30 00:29:01.376112 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:29:01.376084    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-same-id-a-abb9f543-kserve-f789ffc75-qf2pk"
Jul 30 00:29:25.181186 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:29:25.181154    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["llm/e2e-same-id-a-abb9f543-kserve-f789ffc75-qf2pk"]
Jul 30 00:29:40.200427 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:29:40.200381    2560 kuberuntime_container.go:873] "Killing container with a grace period" pod="llm/e2e-same-id-a-abb9f543-kserve-f789ffc75-qf2pk" podUID="156bd24f-e17f-4b4f-a340-ed384c347889" containerName="main" containerID="cri-o://bc47c7f5bae5988d7644b78435e811a69a134b26a75da469a93e15cbdfd90c6c" gracePeriod=45
Jul 30 00:29:40.449806 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:29:40.449782    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="llm/e2e-same-id-a-abb9f543-kserve-f789ffc75-qf2pk"
Jul 30 00:29:40.499678 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:29:40.499617    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-2xdmh\" (UniqueName: \"kubernetes.io/projected/156bd24f-e17f-4b4f-a340-ed384c347889-kube-api-access-2xdmh\") pod \"156bd24f-e17f-4b4f-a340-ed384c347889\" (UID: \"156bd24f-e17f-4b4f-a340-ed384c347889\") "
Jul 30 00:29:40.499678 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:29:40.499648    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/156bd24f-e17f-4b4f-a340-ed384c347889-dshm\") pod \"156bd24f-e17f-4b4f-a340-ed384c347889\" (UID: \"156bd24f-e17f-4b4f-a340-ed384c347889\") "
Jul 30 00:29:40.499870 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:29:40.499681    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/156bd24f-e17f-4b4f-a340-ed384c347889-tls-certs\") pod \"156bd24f-e17f-4b4f-a340-ed384c347889\" (UID: \"156bd24f-e17f-4b4f-a340-ed384c347889\") "
Jul 30 00:29:40.499870 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:29:40.499696    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/156bd24f-e17f-4b4f-a340-ed384c347889-home\") pod \"156bd24f-e17f-4b4f-a340-ed384c347889\" (UID: \"156bd24f-e17f-4b4f-a340-ed384c347889\") "
Jul 30 00:29:40.499870 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:29:40.499720    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/156bd24f-e17f-4b4f-a340-ed384c347889-model-cache\") pod \"156bd24f-e17f-4b4f-a340-ed384c347889\" (UID: \"156bd24f-e17f-4b4f-a340-ed384c347889\") "
Jul 30 00:29:40.499870 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:29:40.499856    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/156bd24f-e17f-4b4f-a340-ed384c347889-tmp-dir\") pod \"156bd24f-e17f-4b4f-a340-ed384c347889\" (UID: \"156bd24f-e17f-4b4f-a340-ed384c347889\") "
Jul 30 00:29:40.500082 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:29:40.499960    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/156bd24f-e17f-4b4f-a340-ed384c347889-model-cache" (OuterVolumeSpecName: "model-cache") pod "156bd24f-e17f-4b4f-a340-ed384c347889" (UID: "156bd24f-e17f-4b4f-a340-ed384c347889"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 30 00:29:40.500082 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:29:40.499975    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/156bd24f-e17f-4b4f-a340-ed384c347889-home" (OuterVolumeSpecName: "home") pod "156bd24f-e17f-4b4f-a340-ed384c347889" (UID: "156bd24f-e17f-4b4f-a340-ed384c347889"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 30 00:29:40.500184 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:29:40.500090    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/156bd24f-e17f-4b4f-a340-ed384c347889-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "156bd24f-e17f-4b4f-a340-ed384c347889" (UID: "156bd24f-e17f-4b4f-a340-ed384c347889"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 30 00:29:40.500238 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:29:40.500207    2560 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/156bd24f-e17f-4b4f-a340-ed384c347889-home\") on node \"ip-10-0-133-55.ec2.internal\" DevicePath \"\""
Jul 30 00:29:40.500238 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:29:40.500219    2560 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/156bd24f-e17f-4b4f-a340-ed384c347889-model-cache\") on node \"ip-10-0-133-55.ec2.internal\" DevicePath \"\""
Jul 30 00:29:40.500369 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:29:40.500238    2560 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/156bd24f-e17f-4b4f-a340-ed384c347889-tmp-dir\") on node \"ip-10-0-133-55.ec2.internal\" DevicePath \"\""
Jul 30 00:29:40.501855 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:29:40.501831    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/156bd24f-e17f-4b4f-a340-ed384c347889-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "156bd24f-e17f-4b4f-a340-ed384c347889" (UID: "156bd24f-e17f-4b4f-a340-ed384c347889"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 30 00:29:40.501855 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:29:40.501832    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/156bd24f-e17f-4b4f-a340-ed384c347889-dshm" (OuterVolumeSpecName: "dshm") pod "156bd24f-e17f-4b4f-a340-ed384c347889" (UID: "156bd24f-e17f-4b4f-a340-ed384c347889"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 30 00:29:40.501986 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:29:40.501867    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/156bd24f-e17f-4b4f-a340-ed384c347889-kube-api-access-2xdmh" (OuterVolumeSpecName: "kube-api-access-2xdmh") pod "156bd24f-e17f-4b4f-a340-ed384c347889" (UID: "156bd24f-e17f-4b4f-a340-ed384c347889"). InnerVolumeSpecName "kube-api-access-2xdmh". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 30 00:29:40.545161 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:29:40.545137    2560 generic.go:356] "Generic (PLEG): container finished" podID="156bd24f-e17f-4b4f-a340-ed384c347889" containerID="bc47c7f5bae5988d7644b78435e811a69a134b26a75da469a93e15cbdfd90c6c" exitCode=0
Jul 30 00:29:40.545279 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:29:40.545175    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="llm/e2e-same-id-a-abb9f543-kserve-f789ffc75-qf2pk"
Jul 30 00:29:40.545279 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:29:40.545204    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-same-id-a-abb9f543-kserve-f789ffc75-qf2pk" event={"ID":"156bd24f-e17f-4b4f-a340-ed384c347889","Type":"ContainerDied","Data":"bc47c7f5bae5988d7644b78435e811a69a134b26a75da469a93e15cbdfd90c6c"}
Jul 30 00:29:40.545279 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:29:40.545237    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-same-id-a-abb9f543-kserve-f789ffc75-qf2pk" event={"ID":"156bd24f-e17f-4b4f-a340-ed384c347889","Type":"ContainerDied","Data":"329df19b503c5d571d9c82e108c9593158010f9a121f4a8b85bb1c3842f0bca2"}
Jul 30 00:29:40.545279 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:29:40.545253    2560 scope.go:117] "RemoveContainer" containerID="bc47c7f5bae5988d7644b78435e811a69a134b26a75da469a93e15cbdfd90c6c"
Jul 30 00:29:40.553475 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:29:40.553457    2560 scope.go:117] "RemoveContainer" containerID="bc47c7f5bae5988d7644b78435e811a69a134b26a75da469a93e15cbdfd90c6c"
Jul 30 00:29:40.553703 ip-10-0-133-55 kubenswrapper[2560]: E0730 00:29:40.553686    2560 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"bc47c7f5bae5988d7644b78435e811a69a134b26a75da469a93e15cbdfd90c6c\": container with ID starting with bc47c7f5bae5988d7644b78435e811a69a134b26a75da469a93e15cbdfd90c6c not found: ID does not exist" containerID="bc47c7f5bae5988d7644b78435e811a69a134b26a75da469a93e15cbdfd90c6c"
Jul 30 00:29:40.553748 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:29:40.553712    2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"bc47c7f5bae5988d7644b78435e811a69a134b26a75da469a93e15cbdfd90c6c"} err="failed to get container status \"bc47c7f5bae5988d7644b78435e811a69a134b26a75da469a93e15cbdfd90c6c\": rpc error: code = NotFound desc = could not find container \"bc47c7f5bae5988d7644b78435e811a69a134b26a75da469a93e15cbdfd90c6c\": container with ID starting with bc47c7f5bae5988d7644b78435e811a69a134b26a75da469a93e15cbdfd90c6c not found: ID does not exist"
Jul 30 00:29:40.565041 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:29:40.565021    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["llm/e2e-same-id-a-abb9f543-kserve-f789ffc75-qf2pk"]
Jul 30 00:29:40.568325 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:29:40.568289    2560 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["llm/e2e-same-id-a-abb9f543-kserve-f789ffc75-qf2pk"]
Jul 30 00:29:40.601004 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:29:40.600982    2560 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/156bd24f-e17f-4b4f-a340-ed384c347889-tls-certs\") on node \"ip-10-0-133-55.ec2.internal\" DevicePath \"\""
Jul 30 00:29:40.601091 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:29:40.601005    2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-2xdmh\" (UniqueName: \"kubernetes.io/projected/156bd24f-e17f-4b4f-a340-ed384c347889-kube-api-access-2xdmh\") on node \"ip-10-0-133-55.ec2.internal\" DevicePath \"\""
Jul 30 00:29:40.601091 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:29:40.601019    2560 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/156bd24f-e17f-4b4f-a340-ed384c347889-dshm\") on node \"ip-10-0-133-55.ec2.internal\" DevicePath \"\""
Jul 30 00:29:41.404960 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:29:41.404929    2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="156bd24f-e17f-4b4f-a340-ed384c347889" path="/var/lib/kubelet/pods/156bd24f-e17f-4b4f-a340-ed384c347889/volumes"
Jul 30 00:31:53.477963 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:31:53.477934    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-kchgc_324341b7-120c-4f8b-9ddd-e28b9a40ce9e/console-operator/1.log"
Jul 30 00:31:53.483606 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:31:53.483583    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-kchgc_324341b7-120c-4f8b-9ddd-e28b9a40ce9e/console-operator/1.log"
Jul 30 00:33:12.066205 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:33:12.066172    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-9092d698-6bb7b994bd-dj2qh"]
Jul 30 00:33:12.066688 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:33:12.066567    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="156bd24f-e17f-4b4f-a340-ed384c347889" containerName="main"
Jul 30 00:33:12.066688 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:33:12.066580    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="156bd24f-e17f-4b4f-a340-ed384c347889" containerName="main"
Jul 30 00:33:12.066688 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:33:12.066641    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="156bd24f-e17f-4b4f-a340-ed384c347889" containerName="main"
Jul 30 00:33:12.069786 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:33:12.069770    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ait-9092d698-6bb7b994bd-dj2qh"
Jul 30 00:33:12.072627 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:33:12.072600    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-ait-9092d698-dockercfg-llgns\""
Jul 30 00:33:12.072739 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:33:12.072658    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-ait-9092d698\""
Jul 30 00:33:12.079714 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:33:12.079687    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-9092d698-6bb7b994bd-dj2qh"]
Jul 30 00:33:12.104737 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:33:12.104704    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-9092d698-55bb5774b6-pdxkz"]
Jul 30 00:33:12.108280 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:33:12.108258    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ait-9092d698-55bb5774b6-pdxkz"
Jul 30 00:33:12.117927 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:33:12.117904    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-9092d698-55bb5774b6-pdxkz"]
Jul 30 00:33:12.174578 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:33:12.174550    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/4ef0b851-da6d-4bca-8c26-13cc1ab9e1cf-plugins-config-volume\") pod \"payload-pre-processing-e2e-ait-9092d698-6bb7b994bd-dj2qh\" (UID: \"4ef0b851-da6d-4bca-8c26-13cc1ab9e1cf\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-9092d698-6bb7b994bd-dj2qh"
Jul 30 00:33:12.174578 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:33:12.174582    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tvlfv\" (UniqueName: \"kubernetes.io/projected/4ef0b851-da6d-4bca-8c26-13cc1ab9e1cf-kube-api-access-tvlfv\") pod \"payload-pre-processing-e2e-ait-9092d698-6bb7b994bd-dj2qh\" (UID: \"4ef0b851-da6d-4bca-8c26-13cc1ab9e1cf\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-9092d698-6bb7b994bd-dj2qh"
Jul 30 00:33:12.275761 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:33:12.275728    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-24xjm\" (UniqueName: \"kubernetes.io/projected/00c68efa-7cf2-42f0-8293-c49302c6b37f-kube-api-access-24xjm\") pod \"payload-processing-e2e-ait-9092d698-55bb5774b6-pdxkz\" (UID: \"00c68efa-7cf2-42f0-8293-c49302c6b37f\") " pod="openshift-ingress/payload-processing-e2e-ait-9092d698-55bb5774b6-pdxkz"
Jul 30 00:33:12.275950 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:33:12.275789    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/00c68efa-7cf2-42f0-8293-c49302c6b37f-plugins-config-volume\") pod \"payload-processing-e2e-ait-9092d698-55bb5774b6-pdxkz\" (UID: \"00c68efa-7cf2-42f0-8293-c49302c6b37f\") " pod="openshift-ingress/payload-processing-e2e-ait-9092d698-55bb5774b6-pdxkz"
Jul 30 00:33:12.275950 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:33:12.275859    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/4ef0b851-da6d-4bca-8c26-13cc1ab9e1cf-plugins-config-volume\") pod \"payload-pre-processing-e2e-ait-9092d698-6bb7b994bd-dj2qh\" (UID: \"4ef0b851-da6d-4bca-8c26-13cc1ab9e1cf\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-9092d698-6bb7b994bd-dj2qh"
Jul 30 00:33:12.275950 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:33:12.275887    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tvlfv\" (UniqueName: \"kubernetes.io/projected/4ef0b851-da6d-4bca-8c26-13cc1ab9e1cf-kube-api-access-tvlfv\") pod \"payload-pre-processing-e2e-ait-9092d698-6bb7b994bd-dj2qh\" (UID: \"4ef0b851-da6d-4bca-8c26-13cc1ab9e1cf\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-9092d698-6bb7b994bd-dj2qh"
Jul 30 00:33:12.276626 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:33:12.276600    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/4ef0b851-da6d-4bca-8c26-13cc1ab9e1cf-plugins-config-volume\") pod \"payload-pre-processing-e2e-ait-9092d698-6bb7b994bd-dj2qh\" (UID: \"4ef0b851-da6d-4bca-8c26-13cc1ab9e1cf\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-9092d698-6bb7b994bd-dj2qh"
Jul 30 00:33:12.283551 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:33:12.283526    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tvlfv\" (UniqueName: \"kubernetes.io/projected/4ef0b851-da6d-4bca-8c26-13cc1ab9e1cf-kube-api-access-tvlfv\") pod \"payload-pre-processing-e2e-ait-9092d698-6bb7b994bd-dj2qh\" (UID: \"4ef0b851-da6d-4bca-8c26-13cc1ab9e1cf\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-9092d698-6bb7b994bd-dj2qh"
Jul 30 00:33:12.376378 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:33:12.376342    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-24xjm\" (UniqueName: \"kubernetes.io/projected/00c68efa-7cf2-42f0-8293-c49302c6b37f-kube-api-access-24xjm\") pod \"payload-processing-e2e-ait-9092d698-55bb5774b6-pdxkz\" (UID: \"00c68efa-7cf2-42f0-8293-c49302c6b37f\") " pod="openshift-ingress/payload-processing-e2e-ait-9092d698-55bb5774b6-pdxkz"
Jul 30 00:33:12.376550 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:33:12.376426    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/00c68efa-7cf2-42f0-8293-c49302c6b37f-plugins-config-volume\") pod \"payload-processing-e2e-ait-9092d698-55bb5774b6-pdxkz\" (UID: \"00c68efa-7cf2-42f0-8293-c49302c6b37f\") " pod="openshift-ingress/payload-processing-e2e-ait-9092d698-55bb5774b6-pdxkz"
Jul 30 00:33:12.377084 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:33:12.377062    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/00c68efa-7cf2-42f0-8293-c49302c6b37f-plugins-config-volume\") pod \"payload-processing-e2e-ait-9092d698-55bb5774b6-pdxkz\" (UID: \"00c68efa-7cf2-42f0-8293-c49302c6b37f\") " pod="openshift-ingress/payload-processing-e2e-ait-9092d698-55bb5774b6-pdxkz"
Jul 30 00:33:12.380153 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:33:12.380135    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ait-9092d698-6bb7b994bd-dj2qh"
Jul 30 00:33:12.385147 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:33:12.385127    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-24xjm\" (UniqueName: \"kubernetes.io/projected/00c68efa-7cf2-42f0-8293-c49302c6b37f-kube-api-access-24xjm\") pod \"payload-processing-e2e-ait-9092d698-55bb5774b6-pdxkz\" (UID: \"00c68efa-7cf2-42f0-8293-c49302c6b37f\") " pod="openshift-ingress/payload-processing-e2e-ait-9092d698-55bb5774b6-pdxkz"
Jul 30 00:33:12.418921 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:33:12.418878    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ait-9092d698-55bb5774b6-pdxkz"
Jul 30 00:33:12.524380 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:33:12.524352    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-9092d698-6bb7b994bd-dj2qh"]
Jul 30 00:33:12.526900 ip-10-0-133-55 kubenswrapper[2560]: W0730 00:33:12.526869    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4ef0b851_da6d_4bca_8c26_13cc1ab9e1cf.slice/crio-a43dfa9b6dc4a2ed566d4e97757c1fe4c039c1508417874dd89740f2c03d9fa7 WatchSource:0}: Error finding container a43dfa9b6dc4a2ed566d4e97757c1fe4c039c1508417874dd89740f2c03d9fa7: Status 404 returned error can't find the container with id a43dfa9b6dc4a2ed566d4e97757c1fe4c039c1508417874dd89740f2c03d9fa7
Jul 30 00:33:12.534032 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:33:12.533977    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ait-9092d698-6bb7b994bd-dj2qh" event={"ID":"4ef0b851-da6d-4bca-8c26-13cc1ab9e1cf","Type":"ContainerStarted","Data":"a43dfa9b6dc4a2ed566d4e97757c1fe4c039c1508417874dd89740f2c03d9fa7"}
Jul 30 00:33:12.568140 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:33:12.568119    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-9092d698-55bb5774b6-pdxkz"]
Jul 30 00:33:12.571403 ip-10-0-133-55 kubenswrapper[2560]: W0730 00:33:12.571379    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod00c68efa_7cf2_42f0_8293_c49302c6b37f.slice/crio-a2358bd37004b837cae8772f018c75170ae5ff447e2c881089c780baf6b17a04 WatchSource:0}: Error finding container a2358bd37004b837cae8772f018c75170ae5ff447e2c881089c780baf6b17a04: Status 404 returned error can't find the container with id a2358bd37004b837cae8772f018c75170ae5ff447e2c881089c780baf6b17a04
Jul 30 00:33:13.540732 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:33:13.540700    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ait-9092d698-6bb7b994bd-dj2qh" event={"ID":"4ef0b851-da6d-4bca-8c26-13cc1ab9e1cf","Type":"ContainerStarted","Data":"154eb04af7419656a05ad5390de5e8bdb426f7b14a147e24568be0eb9f433228"}
Jul 30 00:33:13.541170 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:33:13.540790    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-ait-9092d698-6bb7b994bd-dj2qh"
Jul 30 00:33:13.542230 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:33:13.542207    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ait-9092d698-55bb5774b6-pdxkz" event={"ID":"00c68efa-7cf2-42f0-8293-c49302c6b37f","Type":"ContainerStarted","Data":"2dfba802fd4b2056c67ae48d4667af703214b7e6eb31052f77258239aa180c70"}
Jul 30 00:33:13.542361 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:33:13.542241    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ait-9092d698-55bb5774b6-pdxkz" event={"ID":"00c68efa-7cf2-42f0-8293-c49302c6b37f","Type":"ContainerStarted","Data":"a2358bd37004b837cae8772f018c75170ae5ff447e2c881089c780baf6b17a04"}
Jul 30 00:33:13.542361 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:33:13.542293    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-ait-9092d698-55bb5774b6-pdxkz"
Jul 30 00:33:13.556790 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:33:13.556749    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-ait-9092d698-6bb7b994bd-dj2qh" podStartSLOduration=1.556735999 podStartE2EDuration="1.556735999s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-30 00:33:12 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 00:33:13.5556398 +0000 UTC m=+1880.614856608" watchObservedRunningTime="2026-07-30 00:33:13.556735999 +0000 UTC m=+1880.615952802"
Jul 30 00:33:13.572336 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:33:13.572273    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-ait-9092d698-55bb5774b6-pdxkz" podStartSLOduration=1.5722570070000002 podStartE2EDuration="1.572257007s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-30 00:33:12 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 00:33:13.57035869 +0000 UTC m=+1880.629575494" watchObservedRunningTime="2026-07-30 00:33:13.572257007 +0000 UTC m=+1880.631473817"
Jul 30 00:33:24.548510 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:33:24.548476    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-ait-9092d698-55bb5774b6-pdxkz"
Jul 30 00:33:24.548908 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:33:24.548627    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-ait-9092d698-6bb7b994bd-dj2qh"
Jul 30 00:33:41.783666 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:33:41.783634    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-9092d698-55bb5774b6-pdxkz"]
Jul 30 00:33:41.784170 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:33:41.783881    2560 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-ait-9092d698-55bb5774b6-pdxkz" podUID="00c68efa-7cf2-42f0-8293-c49302c6b37f" containerName="payload-processing" containerID="cri-o://2dfba802fd4b2056c67ae48d4667af703214b7e6eb31052f77258239aa180c70" gracePeriod=30
Jul 30 00:33:41.789904 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:33:41.789543    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-9092d698-6bb7b994bd-dj2qh"]
Jul 30 00:33:41.789904 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:33:41.789754    2560 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-ait-9092d698-6bb7b994bd-dj2qh" podUID="4ef0b851-da6d-4bca-8c26-13cc1ab9e1cf" containerName="payload-pre-processing" containerID="cri-o://154eb04af7419656a05ad5390de5e8bdb426f7b14a147e24568be0eb9f433228" gracePeriod=30
Jul 30 00:33:42.063443 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:33:42.063416    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ait-9092d698-55bb5774b6-pdxkz"
Jul 30 00:33:42.071806 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:33:42.071782    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ait-9092d698-6bb7b994bd-dj2qh"
Jul 30 00:33:42.146863 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:33:42.146832    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-tvlfv\" (UniqueName: \"kubernetes.io/projected/4ef0b851-da6d-4bca-8c26-13cc1ab9e1cf-kube-api-access-tvlfv\") pod \"4ef0b851-da6d-4bca-8c26-13cc1ab9e1cf\" (UID: \"4ef0b851-da6d-4bca-8c26-13cc1ab9e1cf\") "
Jul 30 00:33:42.146863 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:33:42.146866    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-24xjm\" (UniqueName: \"kubernetes.io/projected/00c68efa-7cf2-42f0-8293-c49302c6b37f-kube-api-access-24xjm\") pod \"00c68efa-7cf2-42f0-8293-c49302c6b37f\" (UID: \"00c68efa-7cf2-42f0-8293-c49302c6b37f\") "
Jul 30 00:33:42.147057 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:33:42.146887    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/00c68efa-7cf2-42f0-8293-c49302c6b37f-plugins-config-volume\") pod \"00c68efa-7cf2-42f0-8293-c49302c6b37f\" (UID: \"00c68efa-7cf2-42f0-8293-c49302c6b37f\") "
Jul 30 00:33:42.147057 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:33:42.146951    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/4ef0b851-da6d-4bca-8c26-13cc1ab9e1cf-plugins-config-volume\") pod \"4ef0b851-da6d-4bca-8c26-13cc1ab9e1cf\" (UID: \"4ef0b851-da6d-4bca-8c26-13cc1ab9e1cf\") "
Jul 30 00:33:42.147327 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:33:42.147282    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/00c68efa-7cf2-42f0-8293-c49302c6b37f-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "00c68efa-7cf2-42f0-8293-c49302c6b37f" (UID: "00c68efa-7cf2-42f0-8293-c49302c6b37f"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 30 00:33:42.147449 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:33:42.147392    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4ef0b851-da6d-4bca-8c26-13cc1ab9e1cf-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "4ef0b851-da6d-4bca-8c26-13cc1ab9e1cf" (UID: "4ef0b851-da6d-4bca-8c26-13cc1ab9e1cf"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 30 00:33:42.149018 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:33:42.149001    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4ef0b851-da6d-4bca-8c26-13cc1ab9e1cf-kube-api-access-tvlfv" (OuterVolumeSpecName: "kube-api-access-tvlfv") pod "4ef0b851-da6d-4bca-8c26-13cc1ab9e1cf" (UID: "4ef0b851-da6d-4bca-8c26-13cc1ab9e1cf"). InnerVolumeSpecName "kube-api-access-tvlfv". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 30 00:33:42.149087 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:33:42.149046    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/00c68efa-7cf2-42f0-8293-c49302c6b37f-kube-api-access-24xjm" (OuterVolumeSpecName: "kube-api-access-24xjm") pod "00c68efa-7cf2-42f0-8293-c49302c6b37f" (UID: "00c68efa-7cf2-42f0-8293-c49302c6b37f"). InnerVolumeSpecName "kube-api-access-24xjm". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 30 00:33:42.248389 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:33:42.248355    2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-tvlfv\" (UniqueName: \"kubernetes.io/projected/4ef0b851-da6d-4bca-8c26-13cc1ab9e1cf-kube-api-access-tvlfv\") on node \"ip-10-0-133-55.ec2.internal\" DevicePath \"\""
Jul 30 00:33:42.248389 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:33:42.248389    2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-24xjm\" (UniqueName: \"kubernetes.io/projected/00c68efa-7cf2-42f0-8293-c49302c6b37f-kube-api-access-24xjm\") on node \"ip-10-0-133-55.ec2.internal\" DevicePath \"\""
Jul 30 00:33:42.248625 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:33:42.248403    2560 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/00c68efa-7cf2-42f0-8293-c49302c6b37f-plugins-config-volume\") on node \"ip-10-0-133-55.ec2.internal\" DevicePath \"\""
Jul 30 00:33:42.248625 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:33:42.248416    2560 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/4ef0b851-da6d-4bca-8c26-13cc1ab9e1cf-plugins-config-volume\") on node \"ip-10-0-133-55.ec2.internal\" DevicePath \"\""
Jul 30 00:33:42.682177 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:33:42.682122    2560 generic.go:356] "Generic (PLEG): container finished" podID="4ef0b851-da6d-4bca-8c26-13cc1ab9e1cf" containerID="154eb04af7419656a05ad5390de5e8bdb426f7b14a147e24568be0eb9f433228" exitCode=0
Jul 30 00:33:42.682177 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:33:42.682185    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ait-9092d698-6bb7b994bd-dj2qh"
Jul 30 00:33:42.682644 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:33:42.682217    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ait-9092d698-6bb7b994bd-dj2qh" event={"ID":"4ef0b851-da6d-4bca-8c26-13cc1ab9e1cf","Type":"ContainerDied","Data":"154eb04af7419656a05ad5390de5e8bdb426f7b14a147e24568be0eb9f433228"}
Jul 30 00:33:42.682644 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:33:42.682285    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ait-9092d698-6bb7b994bd-dj2qh" event={"ID":"4ef0b851-da6d-4bca-8c26-13cc1ab9e1cf","Type":"ContainerDied","Data":"a43dfa9b6dc4a2ed566d4e97757c1fe4c039c1508417874dd89740f2c03d9fa7"}
Jul 30 00:33:42.682644 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:33:42.682348    2560 scope.go:117] "RemoveContainer" containerID="154eb04af7419656a05ad5390de5e8bdb426f7b14a147e24568be0eb9f433228"
Jul 30 00:33:42.683775 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:33:42.683753    2560 generic.go:356] "Generic (PLEG): container finished" podID="00c68efa-7cf2-42f0-8293-c49302c6b37f" containerID="2dfba802fd4b2056c67ae48d4667af703214b7e6eb31052f77258239aa180c70" exitCode=0
Jul 30 00:33:42.683882 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:33:42.683794    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ait-9092d698-55bb5774b6-pdxkz"
Jul 30 00:33:42.683882 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:33:42.683842    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ait-9092d698-55bb5774b6-pdxkz" event={"ID":"00c68efa-7cf2-42f0-8293-c49302c6b37f","Type":"ContainerDied","Data":"2dfba802fd4b2056c67ae48d4667af703214b7e6eb31052f77258239aa180c70"}
Jul 30 00:33:42.683987 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:33:42.683895    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ait-9092d698-55bb5774b6-pdxkz" event={"ID":"00c68efa-7cf2-42f0-8293-c49302c6b37f","Type":"ContainerDied","Data":"a2358bd37004b837cae8772f018c75170ae5ff447e2c881089c780baf6b17a04"}
Jul 30 00:33:42.691011 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:33:42.690992    2560 scope.go:117] "RemoveContainer" containerID="154eb04af7419656a05ad5390de5e8bdb426f7b14a147e24568be0eb9f433228"
Jul 30 00:33:42.691290 ip-10-0-133-55 kubenswrapper[2560]: E0730 00:33:42.691268    2560 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"154eb04af7419656a05ad5390de5e8bdb426f7b14a147e24568be0eb9f433228\": container with ID starting with 154eb04af7419656a05ad5390de5e8bdb426f7b14a147e24568be0eb9f433228 not found: ID does not exist" containerID="154eb04af7419656a05ad5390de5e8bdb426f7b14a147e24568be0eb9f433228"
Jul 30 00:33:42.691442 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:33:42.691301    2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"154eb04af7419656a05ad5390de5e8bdb426f7b14a147e24568be0eb9f433228"} err="failed to get container status \"154eb04af7419656a05ad5390de5e8bdb426f7b14a147e24568be0eb9f433228\": rpc error: code = NotFound desc = could not find container \"154eb04af7419656a05ad5390de5e8bdb426f7b14a147e24568be0eb9f433228\": container with ID starting with 154eb04af7419656a05ad5390de5e8bdb426f7b14a147e24568be0eb9f433228 not found: ID does not exist"
Jul 30 00:33:42.691442 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:33:42.691445    2560 scope.go:117] "RemoveContainer" containerID="2dfba802fd4b2056c67ae48d4667af703214b7e6eb31052f77258239aa180c70"
Jul 30 00:33:42.699670 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:33:42.699656    2560 scope.go:117] "RemoveContainer" containerID="2dfba802fd4b2056c67ae48d4667af703214b7e6eb31052f77258239aa180c70"
Jul 30 00:33:42.699913 ip-10-0-133-55 kubenswrapper[2560]: E0730 00:33:42.699897    2560 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2dfba802fd4b2056c67ae48d4667af703214b7e6eb31052f77258239aa180c70\": container with ID starting with 2dfba802fd4b2056c67ae48d4667af703214b7e6eb31052f77258239aa180c70 not found: ID does not exist" containerID="2dfba802fd4b2056c67ae48d4667af703214b7e6eb31052f77258239aa180c70"
Jul 30 00:33:42.699974 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:33:42.699920    2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2dfba802fd4b2056c67ae48d4667af703214b7e6eb31052f77258239aa180c70"} err="failed to get container status \"2dfba802fd4b2056c67ae48d4667af703214b7e6eb31052f77258239aa180c70\": rpc error: code = NotFound desc = could not find container \"2dfba802fd4b2056c67ae48d4667af703214b7e6eb31052f77258239aa180c70\": container with ID starting with 2dfba802fd4b2056c67ae48d4667af703214b7e6eb31052f77258239aa180c70 not found: ID does not exist"
Jul 30 00:33:42.707652 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:33:42.707630    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-9092d698-6bb7b994bd-dj2qh"]
Jul 30 00:33:42.711633 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:33:42.711607    2560 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-9092d698-6bb7b994bd-dj2qh"]
Jul 30 00:33:42.722064 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:33:42.722041    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-9092d698-55bb5774b6-pdxkz"]
Jul 30 00:33:42.725885 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:33:42.725865    2560 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-9092d698-55bb5774b6-pdxkz"]
Jul 30 00:33:43.404539 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:33:43.404508    2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="00c68efa-7cf2-42f0-8293-c49302c6b37f" path="/var/lib/kubelet/pods/00c68efa-7cf2-42f0-8293-c49302c6b37f/volumes"
Jul 30 00:33:43.404986 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:33:43.404865    2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="4ef0b851-da6d-4bca-8c26-13cc1ab9e1cf" path="/var/lib/kubelet/pods/4ef0b851-da6d-4bca-8c26-13cc1ab9e1cf/volumes"
Jul 30 00:33:46.313374 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:33:46.313332    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-migrate-e5dec626-574d4cfbf6-bsjkp"]
Jul 30 00:33:46.313868 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:33:46.313849    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4ef0b851-da6d-4bca-8c26-13cc1ab9e1cf" containerName="payload-pre-processing"
Jul 30 00:33:46.313963 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:33:46.313873    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="4ef0b851-da6d-4bca-8c26-13cc1ab9e1cf" containerName="payload-pre-processing"
Jul 30 00:33:46.313963 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:33:46.313899    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="00c68efa-7cf2-42f0-8293-c49302c6b37f" containerName="payload-processing"
Jul 30 00:33:46.313963 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:33:46.313910    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="00c68efa-7cf2-42f0-8293-c49302c6b37f" containerName="payload-processing"
Jul 30 00:33:46.314105 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:33:46.314045    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="4ef0b851-da6d-4bca-8c26-13cc1ab9e1cf" containerName="payload-pre-processing"
Jul 30 00:33:46.314105 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:33:46.314061    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="00c68efa-7cf2-42f0-8293-c49302c6b37f" containerName="payload-processing"
Jul 30 00:33:46.318840 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:33:46.318817    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-migrate-e5dec626-574d4cfbf6-bsjkp"
Jul 30 00:33:46.321487 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:33:46.321462    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-migrate-e5dec626\""
Jul 30 00:33:46.321602 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:33:46.321554    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-migrate-e5dec626-dockercfg-cqqfl\""
Jul 30 00:33:46.325267 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:33:46.325242    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-migrate-e5dec626-574d4cfbf6-bsjkp"]
Jul 30 00:33:46.352480 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:33:46.352454    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-migrate-e5dec626-d94bfb8d9-2dqh2"]
Jul 30 00:33:46.355841 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:33:46.355823    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-migrate-e5dec626-d94bfb8d9-2dqh2"
Jul 30 00:33:46.363327 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:33:46.363286    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-migrate-e5dec626-d94bfb8d9-2dqh2"]
Jul 30 00:33:46.386384 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:33:46.386349    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/402d8920-7528-4817-ad87-94f30ef7ce0b-plugins-config-volume\") pod \"payload-pre-processing-e2e-migrate-e5dec626-574d4cfbf6-bsjkp\" (UID: \"402d8920-7528-4817-ad87-94f30ef7ce0b\") " pod="openshift-ingress/payload-pre-processing-e2e-migrate-e5dec626-574d4cfbf6-bsjkp"
Jul 30 00:33:46.386510 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:33:46.386459    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-x5lvj\" (UniqueName: \"kubernetes.io/projected/402d8920-7528-4817-ad87-94f30ef7ce0b-kube-api-access-x5lvj\") pod \"payload-pre-processing-e2e-migrate-e5dec626-574d4cfbf6-bsjkp\" (UID: \"402d8920-7528-4817-ad87-94f30ef7ce0b\") " pod="openshift-ingress/payload-pre-processing-e2e-migrate-e5dec626-574d4cfbf6-bsjkp"
Jul 30 00:33:46.487019 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:33:46.486971    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/f2ec8bbb-e7d5-4f78-83de-7f1bdb4349ea-plugins-config-volume\") pod \"payload-processing-e2e-migrate-e5dec626-d94bfb8d9-2dqh2\" (UID: \"f2ec8bbb-e7d5-4f78-83de-7f1bdb4349ea\") " pod="openshift-ingress/payload-processing-e2e-migrate-e5dec626-d94bfb8d9-2dqh2"
Jul 30 00:33:46.487186 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:33:46.487034    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-x5lvj\" (UniqueName: \"kubernetes.io/projected/402d8920-7528-4817-ad87-94f30ef7ce0b-kube-api-access-x5lvj\") pod \"payload-pre-processing-e2e-migrate-e5dec626-574d4cfbf6-bsjkp\" (UID: \"402d8920-7528-4817-ad87-94f30ef7ce0b\") " pod="openshift-ingress/payload-pre-processing-e2e-migrate-e5dec626-574d4cfbf6-bsjkp"
Jul 30 00:33:46.487186 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:33:46.487115    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/402d8920-7528-4817-ad87-94f30ef7ce0b-plugins-config-volume\") pod \"payload-pre-processing-e2e-migrate-e5dec626-574d4cfbf6-bsjkp\" (UID: \"402d8920-7528-4817-ad87-94f30ef7ce0b\") " pod="openshift-ingress/payload-pre-processing-e2e-migrate-e5dec626-574d4cfbf6-bsjkp"
Jul 30 00:33:46.487186 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:33:46.487154    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-p9hx8\" (UniqueName: \"kubernetes.io/projected/f2ec8bbb-e7d5-4f78-83de-7f1bdb4349ea-kube-api-access-p9hx8\") pod \"payload-processing-e2e-migrate-e5dec626-d94bfb8d9-2dqh2\" (UID: \"f2ec8bbb-e7d5-4f78-83de-7f1bdb4349ea\") " pod="openshift-ingress/payload-processing-e2e-migrate-e5dec626-d94bfb8d9-2dqh2"
Jul 30 00:33:46.487836 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:33:46.487818    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/402d8920-7528-4817-ad87-94f30ef7ce0b-plugins-config-volume\") pod \"payload-pre-processing-e2e-migrate-e5dec626-574d4cfbf6-bsjkp\" (UID: \"402d8920-7528-4817-ad87-94f30ef7ce0b\") " pod="openshift-ingress/payload-pre-processing-e2e-migrate-e5dec626-574d4cfbf6-bsjkp"
Jul 30 00:33:46.495674 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:33:46.495641    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-x5lvj\" (UniqueName: \"kubernetes.io/projected/402d8920-7528-4817-ad87-94f30ef7ce0b-kube-api-access-x5lvj\") pod \"payload-pre-processing-e2e-migrate-e5dec626-574d4cfbf6-bsjkp\" (UID: \"402d8920-7528-4817-ad87-94f30ef7ce0b\") " pod="openshift-ingress/payload-pre-processing-e2e-migrate-e5dec626-574d4cfbf6-bsjkp"
Jul 30 00:33:46.587756 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:33:46.587680    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-p9hx8\" (UniqueName: \"kubernetes.io/projected/f2ec8bbb-e7d5-4f78-83de-7f1bdb4349ea-kube-api-access-p9hx8\") pod \"payload-processing-e2e-migrate-e5dec626-d94bfb8d9-2dqh2\" (UID: \"f2ec8bbb-e7d5-4f78-83de-7f1bdb4349ea\") " pod="openshift-ingress/payload-processing-e2e-migrate-e5dec626-d94bfb8d9-2dqh2"
Jul 30 00:33:46.587756 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:33:46.587714    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/f2ec8bbb-e7d5-4f78-83de-7f1bdb4349ea-plugins-config-volume\") pod \"payload-processing-e2e-migrate-e5dec626-d94bfb8d9-2dqh2\" (UID: \"f2ec8bbb-e7d5-4f78-83de-7f1bdb4349ea\") " pod="openshift-ingress/payload-processing-e2e-migrate-e5dec626-d94bfb8d9-2dqh2"
Jul 30 00:33:46.588330 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:33:46.588294    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/f2ec8bbb-e7d5-4f78-83de-7f1bdb4349ea-plugins-config-volume\") pod \"payload-processing-e2e-migrate-e5dec626-d94bfb8d9-2dqh2\" (UID: \"f2ec8bbb-e7d5-4f78-83de-7f1bdb4349ea\") " pod="openshift-ingress/payload-processing-e2e-migrate-e5dec626-d94bfb8d9-2dqh2"
Jul 30 00:33:46.595399 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:33:46.595378    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-p9hx8\" (UniqueName: \"kubernetes.io/projected/f2ec8bbb-e7d5-4f78-83de-7f1bdb4349ea-kube-api-access-p9hx8\") pod \"payload-processing-e2e-migrate-e5dec626-d94bfb8d9-2dqh2\" (UID: \"f2ec8bbb-e7d5-4f78-83de-7f1bdb4349ea\") " pod="openshift-ingress/payload-processing-e2e-migrate-e5dec626-d94bfb8d9-2dqh2"
Jul 30 00:33:46.630281 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:33:46.630250    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-migrate-e5dec626-574d4cfbf6-bsjkp"
Jul 30 00:33:46.667244 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:33:46.667213    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-migrate-e5dec626-d94bfb8d9-2dqh2"
Jul 30 00:33:46.771677 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:33:46.771649    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-migrate-e5dec626-574d4cfbf6-bsjkp"]
Jul 30 00:33:46.773400 ip-10-0-133-55 kubenswrapper[2560]: W0730 00:33:46.773371    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod402d8920_7528_4817_ad87_94f30ef7ce0b.slice/crio-fff2695f8fc2142af7d9900f1ecd21a7b435387d82374edefcac49746a0cc129 WatchSource:0}: Error finding container fff2695f8fc2142af7d9900f1ecd21a7b435387d82374edefcac49746a0cc129: Status 404 returned error can't find the container with id fff2695f8fc2142af7d9900f1ecd21a7b435387d82374edefcac49746a0cc129
Jul 30 00:33:46.810775 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:33:46.810675    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-migrate-e5dec626-d94bfb8d9-2dqh2"]
Jul 30 00:33:46.812846 ip-10-0-133-55 kubenswrapper[2560]: W0730 00:33:46.812813    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf2ec8bbb_e7d5_4f78_83de_7f1bdb4349ea.slice/crio-4322c335c2749893776b4a88c9eec666bf3f4980cdcfc04053f4dacf1e2fda50 WatchSource:0}: Error finding container 4322c335c2749893776b4a88c9eec666bf3f4980cdcfc04053f4dacf1e2fda50: Status 404 returned error can't find the container with id 4322c335c2749893776b4a88c9eec666bf3f4980cdcfc04053f4dacf1e2fda50
Jul 30 00:33:47.710665 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:33:47.710612    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-migrate-e5dec626-574d4cfbf6-bsjkp" event={"ID":"402d8920-7528-4817-ad87-94f30ef7ce0b","Type":"ContainerStarted","Data":"4d6e4658b25c6a9d3548f5dfa60703ee53b9cb02fc690a08a0f564da827a6fc9"}
Jul 30 00:33:47.711114 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:33:47.710682    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-migrate-e5dec626-574d4cfbf6-bsjkp" event={"ID":"402d8920-7528-4817-ad87-94f30ef7ce0b","Type":"ContainerStarted","Data":"fff2695f8fc2142af7d9900f1ecd21a7b435387d82374edefcac49746a0cc129"}
Jul 30 00:33:47.711114 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:33:47.710712    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-migrate-e5dec626-574d4cfbf6-bsjkp"
Jul 30 00:33:47.712052 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:33:47.712027    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-migrate-e5dec626-d94bfb8d9-2dqh2" event={"ID":"f2ec8bbb-e7d5-4f78-83de-7f1bdb4349ea","Type":"ContainerStarted","Data":"43812b4100d7f265865f80bef0bbfb24a331f5ba6410f57621265300b5734f90"}
Jul 30 00:33:47.712178 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:33:47.712071    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-migrate-e5dec626-d94bfb8d9-2dqh2" event={"ID":"f2ec8bbb-e7d5-4f78-83de-7f1bdb4349ea","Type":"ContainerStarted","Data":"4322c335c2749893776b4a88c9eec666bf3f4980cdcfc04053f4dacf1e2fda50"}
Jul 30 00:33:47.712178 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:33:47.712094    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-migrate-e5dec626-d94bfb8d9-2dqh2"
Jul 30 00:33:47.725998 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:33:47.725957    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-migrate-e5dec626-574d4cfbf6-bsjkp" podStartSLOduration=1.725942901 podStartE2EDuration="1.725942901s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-30 00:33:46 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 00:33:47.725384634 +0000 UTC m=+1914.784601439" watchObservedRunningTime="2026-07-30 00:33:47.725942901 +0000 UTC m=+1914.785159705"
Jul 30 00:33:58.719494 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:33:58.719461    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-migrate-e5dec626-574d4cfbf6-bsjkp"
Jul 30 00:33:58.719869 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:33:58.719532    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-migrate-e5dec626-d94bfb8d9-2dqh2"
Jul 30 00:33:58.735433 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:33:58.735387    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-migrate-e5dec626-d94bfb8d9-2dqh2" podStartSLOduration=12.73536437 podStartE2EDuration="12.73536437s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-30 00:33:46 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 00:33:47.739636561 +0000 UTC m=+1914.798853373" watchObservedRunningTime="2026-07-30 00:33:58.73536437 +0000 UTC m=+1925.794581183"
Jul 30 00:34:16.313626 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:34:16.313589    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-migrate-e5dec626-d94bfb8d9-2dqh2"]
Jul 30 00:34:16.314232 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:34:16.313840    2560 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-migrate-e5dec626-d94bfb8d9-2dqh2" podUID="f2ec8bbb-e7d5-4f78-83de-7f1bdb4349ea" containerName="payload-processing" containerID="cri-o://43812b4100d7f265865f80bef0bbfb24a331f5ba6410f57621265300b5734f90" gracePeriod=30
Jul 30 00:34:16.320097 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:34:16.320032    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-migrate-e5dec626-574d4cfbf6-bsjkp"]
Jul 30 00:34:16.320304 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:34:16.320258    2560 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-migrate-e5dec626-574d4cfbf6-bsjkp" podUID="402d8920-7528-4817-ad87-94f30ef7ce0b" containerName="payload-pre-processing" containerID="cri-o://4d6e4658b25c6a9d3548f5dfa60703ee53b9cb02fc690a08a0f564da827a6fc9" gracePeriod=30
Jul 30 00:34:16.597891 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:34:16.597867    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-migrate-e5dec626-d94bfb8d9-2dqh2"
Jul 30 00:34:16.600566 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:34:16.600516    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-migrate-e5dec626-574d4cfbf6-bsjkp"
Jul 30 00:34:16.654067 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:34:16.654040    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-p9hx8\" (UniqueName: \"kubernetes.io/projected/f2ec8bbb-e7d5-4f78-83de-7f1bdb4349ea-kube-api-access-p9hx8\") pod \"f2ec8bbb-e7d5-4f78-83de-7f1bdb4349ea\" (UID: \"f2ec8bbb-e7d5-4f78-83de-7f1bdb4349ea\") "
Jul 30 00:34:16.654221 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:34:16.654109    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/402d8920-7528-4817-ad87-94f30ef7ce0b-plugins-config-volume\") pod \"402d8920-7528-4817-ad87-94f30ef7ce0b\" (UID: \"402d8920-7528-4817-ad87-94f30ef7ce0b\") "
Jul 30 00:34:16.654221 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:34:16.654127    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-x5lvj\" (UniqueName: \"kubernetes.io/projected/402d8920-7528-4817-ad87-94f30ef7ce0b-kube-api-access-x5lvj\") pod \"402d8920-7528-4817-ad87-94f30ef7ce0b\" (UID: \"402d8920-7528-4817-ad87-94f30ef7ce0b\") "
Jul 30 00:34:16.654221 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:34:16.654162    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/f2ec8bbb-e7d5-4f78-83de-7f1bdb4349ea-plugins-config-volume\") pod \"f2ec8bbb-e7d5-4f78-83de-7f1bdb4349ea\" (UID: \"f2ec8bbb-e7d5-4f78-83de-7f1bdb4349ea\") "
Jul 30 00:34:16.654540 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:34:16.654516    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/402d8920-7528-4817-ad87-94f30ef7ce0b-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "402d8920-7528-4817-ad87-94f30ef7ce0b" (UID: "402d8920-7528-4817-ad87-94f30ef7ce0b"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 30 00:34:16.654620 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:34:16.654556    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f2ec8bbb-e7d5-4f78-83de-7f1bdb4349ea-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "f2ec8bbb-e7d5-4f78-83de-7f1bdb4349ea" (UID: "f2ec8bbb-e7d5-4f78-83de-7f1bdb4349ea"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 30 00:34:16.656064 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:34:16.656039    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/402d8920-7528-4817-ad87-94f30ef7ce0b-kube-api-access-x5lvj" (OuterVolumeSpecName: "kube-api-access-x5lvj") pod "402d8920-7528-4817-ad87-94f30ef7ce0b" (UID: "402d8920-7528-4817-ad87-94f30ef7ce0b"). InnerVolumeSpecName "kube-api-access-x5lvj". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 30 00:34:16.656154 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:34:16.656080    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f2ec8bbb-e7d5-4f78-83de-7f1bdb4349ea-kube-api-access-p9hx8" (OuterVolumeSpecName: "kube-api-access-p9hx8") pod "f2ec8bbb-e7d5-4f78-83de-7f1bdb4349ea" (UID: "f2ec8bbb-e7d5-4f78-83de-7f1bdb4349ea"). InnerVolumeSpecName "kube-api-access-p9hx8". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 30 00:34:16.755038 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:34:16.755003    2560 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/402d8920-7528-4817-ad87-94f30ef7ce0b-plugins-config-volume\") on node \"ip-10-0-133-55.ec2.internal\" DevicePath \"\""
Jul 30 00:34:16.755038 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:34:16.755031    2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-x5lvj\" (UniqueName: \"kubernetes.io/projected/402d8920-7528-4817-ad87-94f30ef7ce0b-kube-api-access-x5lvj\") on node \"ip-10-0-133-55.ec2.internal\" DevicePath \"\""
Jul 30 00:34:16.755038 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:34:16.755041    2560 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/f2ec8bbb-e7d5-4f78-83de-7f1bdb4349ea-plugins-config-volume\") on node \"ip-10-0-133-55.ec2.internal\" DevicePath \"\""
Jul 30 00:34:16.755264 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:34:16.755051    2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-p9hx8\" (UniqueName: \"kubernetes.io/projected/f2ec8bbb-e7d5-4f78-83de-7f1bdb4349ea-kube-api-access-p9hx8\") on node \"ip-10-0-133-55.ec2.internal\" DevicePath \"\""
Jul 30 00:34:16.855072 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:34:16.854988    2560 generic.go:356] "Generic (PLEG): container finished" podID="402d8920-7528-4817-ad87-94f30ef7ce0b" containerID="4d6e4658b25c6a9d3548f5dfa60703ee53b9cb02fc690a08a0f564da827a6fc9" exitCode=0
Jul 30 00:34:16.855072 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:34:16.855039    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-migrate-e5dec626-574d4cfbf6-bsjkp"
Jul 30 00:34:16.855358 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:34:16.855066    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-migrate-e5dec626-574d4cfbf6-bsjkp" event={"ID":"402d8920-7528-4817-ad87-94f30ef7ce0b","Type":"ContainerDied","Data":"4d6e4658b25c6a9d3548f5dfa60703ee53b9cb02fc690a08a0f564da827a6fc9"}
Jul 30 00:34:16.855358 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:34:16.855125    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-migrate-e5dec626-574d4cfbf6-bsjkp" event={"ID":"402d8920-7528-4817-ad87-94f30ef7ce0b","Type":"ContainerDied","Data":"fff2695f8fc2142af7d9900f1ecd21a7b435387d82374edefcac49746a0cc129"}
Jul 30 00:34:16.855358 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:34:16.855143    2560 scope.go:117] "RemoveContainer" containerID="4d6e4658b25c6a9d3548f5dfa60703ee53b9cb02fc690a08a0f564da827a6fc9"
Jul 30 00:34:16.856598 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:34:16.856572    2560 generic.go:356] "Generic (PLEG): container finished" podID="f2ec8bbb-e7d5-4f78-83de-7f1bdb4349ea" containerID="43812b4100d7f265865f80bef0bbfb24a331f5ba6410f57621265300b5734f90" exitCode=0
Jul 30 00:34:16.856725 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:34:16.856616    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-migrate-e5dec626-d94bfb8d9-2dqh2"
Jul 30 00:34:16.856725 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:34:16.856668    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-migrate-e5dec626-d94bfb8d9-2dqh2" event={"ID":"f2ec8bbb-e7d5-4f78-83de-7f1bdb4349ea","Type":"ContainerDied","Data":"43812b4100d7f265865f80bef0bbfb24a331f5ba6410f57621265300b5734f90"}
Jul 30 00:34:16.856725 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:34:16.856706    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-migrate-e5dec626-d94bfb8d9-2dqh2" event={"ID":"f2ec8bbb-e7d5-4f78-83de-7f1bdb4349ea","Type":"ContainerDied","Data":"4322c335c2749893776b4a88c9eec666bf3f4980cdcfc04053f4dacf1e2fda50"}
Jul 30 00:34:16.864649 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:34:16.864626    2560 scope.go:117] "RemoveContainer" containerID="4d6e4658b25c6a9d3548f5dfa60703ee53b9cb02fc690a08a0f564da827a6fc9"
Jul 30 00:34:16.864926 ip-10-0-133-55 kubenswrapper[2560]: E0730 00:34:16.864903    2560 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4d6e4658b25c6a9d3548f5dfa60703ee53b9cb02fc690a08a0f564da827a6fc9\": container with ID starting with 4d6e4658b25c6a9d3548f5dfa60703ee53b9cb02fc690a08a0f564da827a6fc9 not found: ID does not exist" containerID="4d6e4658b25c6a9d3548f5dfa60703ee53b9cb02fc690a08a0f564da827a6fc9"
Jul 30 00:34:16.864997 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:34:16.864932    2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4d6e4658b25c6a9d3548f5dfa60703ee53b9cb02fc690a08a0f564da827a6fc9"} err="failed to get container status \"4d6e4658b25c6a9d3548f5dfa60703ee53b9cb02fc690a08a0f564da827a6fc9\": rpc error: code = NotFound desc = could not find container \"4d6e4658b25c6a9d3548f5dfa60703ee53b9cb02fc690a08a0f564da827a6fc9\": container with ID starting with 4d6e4658b25c6a9d3548f5dfa60703ee53b9cb02fc690a08a0f564da827a6fc9 not found: ID does not exist"
Jul 30 00:34:16.864997 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:34:16.864948    2560 scope.go:117] "RemoveContainer" containerID="43812b4100d7f265865f80bef0bbfb24a331f5ba6410f57621265300b5734f90"
Jul 30 00:34:16.872355 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:34:16.872334    2560 scope.go:117] "RemoveContainer" containerID="43812b4100d7f265865f80bef0bbfb24a331f5ba6410f57621265300b5734f90"
Jul 30 00:34:16.872577 ip-10-0-133-55 kubenswrapper[2560]: E0730 00:34:16.872560    2560 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"43812b4100d7f265865f80bef0bbfb24a331f5ba6410f57621265300b5734f90\": container with ID starting with 43812b4100d7f265865f80bef0bbfb24a331f5ba6410f57621265300b5734f90 not found: ID does not exist" containerID="43812b4100d7f265865f80bef0bbfb24a331f5ba6410f57621265300b5734f90"
Jul 30 00:34:16.872627 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:34:16.872585    2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"43812b4100d7f265865f80bef0bbfb24a331f5ba6410f57621265300b5734f90"} err="failed to get container status \"43812b4100d7f265865f80bef0bbfb24a331f5ba6410f57621265300b5734f90\": rpc error: code = NotFound desc = could not find container \"43812b4100d7f265865f80bef0bbfb24a331f5ba6410f57621265300b5734f90\": container with ID starting with 43812b4100d7f265865f80bef0bbfb24a331f5ba6410f57621265300b5734f90 not found: ID does not exist"
Jul 30 00:34:16.877712 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:34:16.877689    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-migrate-e5dec626-574d4cfbf6-bsjkp"]
Jul 30 00:34:16.879361 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:34:16.879294    2560 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-migrate-e5dec626-574d4cfbf6-bsjkp"]
Jul 30 00:34:16.889147 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:34:16.889129    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-migrate-e5dec626-d94bfb8d9-2dqh2"]
Jul 30 00:34:16.892635 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:34:16.892617    2560 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-migrate-e5dec626-d94bfb8d9-2dqh2"]
Jul 30 00:34:17.405765 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:34:17.405733    2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="402d8920-7528-4817-ad87-94f30ef7ce0b" path="/var/lib/kubelet/pods/402d8920-7528-4817-ad87-94f30ef7ce0b/volumes"
Jul 30 00:34:17.406121 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:34:17.406111    2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f2ec8bbb-e7d5-4f78-83de-7f1bdb4349ea" path="/var/lib/kubelet/pods/f2ec8bbb-e7d5-4f78-83de-7f1bdb4349ea/volumes"
Jul 30 00:34:21.959329 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:34:21.959281    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-cd573186-69788d9648-6fnbp"]
Jul 30 00:34:21.959885 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:34:21.959865    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f2ec8bbb-e7d5-4f78-83de-7f1bdb4349ea" containerName="payload-processing"
Jul 30 00:34:21.959968 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:34:21.959888    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="f2ec8bbb-e7d5-4f78-83de-7f1bdb4349ea" containerName="payload-processing"
Jul 30 00:34:21.959968 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:34:21.959914    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="402d8920-7528-4817-ad87-94f30ef7ce0b" containerName="payload-pre-processing"
Jul 30 00:34:21.959968 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:34:21.959923    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="402d8920-7528-4817-ad87-94f30ef7ce0b" containerName="payload-pre-processing"
Jul 30 00:34:21.960113 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:34:21.960051    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="402d8920-7528-4817-ad87-94f30ef7ce0b" containerName="payload-pre-processing"
Jul 30 00:34:21.960113 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:34:21.960067    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="f2ec8bbb-e7d5-4f78-83de-7f1bdb4349ea" containerName="payload-processing"
Jul 30 00:34:21.964547 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:34:21.964525    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ait-cd573186-69788d9648-6fnbp"
Jul 30 00:34:21.968830 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:34:21.968810    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-ait-cd573186-dockercfg-27fvl\""
Jul 30 00:34:21.969091 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:34:21.969075    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-ait-cd573186\""
Jul 30 00:34:21.977975 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:34:21.977957    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-cd573186-69788d9648-6fnbp"]
Jul 30 00:34:21.999079 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:34:21.999053    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-cd573186-69d8cd79d6-k74ld"]
Jul 30 00:34:22.002447 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:34:22.002432    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ait-cd573186-69d8cd79d6-k74ld"
Jul 30 00:34:22.003567 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:34:22.003542    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/ae01ed4a-cfb1-436f-8ffc-99aa4a6fb03c-plugins-config-volume\") pod \"payload-pre-processing-e2e-ait-cd573186-69788d9648-6fnbp\" (UID: \"ae01ed4a-cfb1-436f-8ffc-99aa4a6fb03c\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-cd573186-69788d9648-6fnbp"
Jul 30 00:34:22.003656 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:34:22.003572    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nkn7q\" (UniqueName: \"kubernetes.io/projected/ae01ed4a-cfb1-436f-8ffc-99aa4a6fb03c-kube-api-access-nkn7q\") pod \"payload-pre-processing-e2e-ait-cd573186-69788d9648-6fnbp\" (UID: \"ae01ed4a-cfb1-436f-8ffc-99aa4a6fb03c\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-cd573186-69788d9648-6fnbp"
Jul 30 00:34:22.018557 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:34:22.018536    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-cd573186-69d8cd79d6-k74ld"]
Jul 30 00:34:22.104063 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:34:22.104033    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/b83529f0-4a3a-4302-ba08-e6fe89fef322-plugins-config-volume\") pod \"payload-processing-e2e-ait-cd573186-69d8cd79d6-k74ld\" (UID: \"b83529f0-4a3a-4302-ba08-e6fe89fef322\") " pod="openshift-ingress/payload-processing-e2e-ait-cd573186-69d8cd79d6-k74ld"
Jul 30 00:34:22.104181 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:34:22.104072    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/ae01ed4a-cfb1-436f-8ffc-99aa4a6fb03c-plugins-config-volume\") pod \"payload-pre-processing-e2e-ait-cd573186-69788d9648-6fnbp\" (UID: \"ae01ed4a-cfb1-436f-8ffc-99aa4a6fb03c\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-cd573186-69788d9648-6fnbp"
Jul 30 00:34:22.104181 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:34:22.104090    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nkn7q\" (UniqueName: \"kubernetes.io/projected/ae01ed4a-cfb1-436f-8ffc-99aa4a6fb03c-kube-api-access-nkn7q\") pod \"payload-pre-processing-e2e-ait-cd573186-69788d9648-6fnbp\" (UID: \"ae01ed4a-cfb1-436f-8ffc-99aa4a6fb03c\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-cd573186-69788d9648-6fnbp"
Jul 30 00:34:22.104181 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:34:22.104157    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-k9dnk\" (UniqueName: \"kubernetes.io/projected/b83529f0-4a3a-4302-ba08-e6fe89fef322-kube-api-access-k9dnk\") pod \"payload-processing-e2e-ait-cd573186-69d8cd79d6-k74ld\" (UID: \"b83529f0-4a3a-4302-ba08-e6fe89fef322\") " pod="openshift-ingress/payload-processing-e2e-ait-cd573186-69d8cd79d6-k74ld"
Jul 30 00:34:22.104784 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:34:22.104768    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/ae01ed4a-cfb1-436f-8ffc-99aa4a6fb03c-plugins-config-volume\") pod \"payload-pre-processing-e2e-ait-cd573186-69788d9648-6fnbp\" (UID: \"ae01ed4a-cfb1-436f-8ffc-99aa4a6fb03c\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-cd573186-69788d9648-6fnbp"
Jul 30 00:34:22.111793 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:34:22.111767    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-nkn7q\" (UniqueName: \"kubernetes.io/projected/ae01ed4a-cfb1-436f-8ffc-99aa4a6fb03c-kube-api-access-nkn7q\") pod \"payload-pre-processing-e2e-ait-cd573186-69788d9648-6fnbp\" (UID: \"ae01ed4a-cfb1-436f-8ffc-99aa4a6fb03c\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-cd573186-69788d9648-6fnbp"
Jul 30 00:34:22.204818 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:34:22.204789    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/b83529f0-4a3a-4302-ba08-e6fe89fef322-plugins-config-volume\") pod \"payload-processing-e2e-ait-cd573186-69d8cd79d6-k74ld\" (UID: \"b83529f0-4a3a-4302-ba08-e6fe89fef322\") " pod="openshift-ingress/payload-processing-e2e-ait-cd573186-69d8cd79d6-k74ld"
Jul 30 00:34:22.204949 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:34:22.204844    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-k9dnk\" (UniqueName: \"kubernetes.io/projected/b83529f0-4a3a-4302-ba08-e6fe89fef322-kube-api-access-k9dnk\") pod \"payload-processing-e2e-ait-cd573186-69d8cd79d6-k74ld\" (UID: \"b83529f0-4a3a-4302-ba08-e6fe89fef322\") " pod="openshift-ingress/payload-processing-e2e-ait-cd573186-69d8cd79d6-k74ld"
Jul 30 00:34:22.205526 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:34:22.205509    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/b83529f0-4a3a-4302-ba08-e6fe89fef322-plugins-config-volume\") pod \"payload-processing-e2e-ait-cd573186-69d8cd79d6-k74ld\" (UID: \"b83529f0-4a3a-4302-ba08-e6fe89fef322\") " pod="openshift-ingress/payload-processing-e2e-ait-cd573186-69d8cd79d6-k74ld"
Jul 30 00:34:22.215419 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:34:22.215358    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-k9dnk\" (UniqueName: \"kubernetes.io/projected/b83529f0-4a3a-4302-ba08-e6fe89fef322-kube-api-access-k9dnk\") pod \"payload-processing-e2e-ait-cd573186-69d8cd79d6-k74ld\" (UID: \"b83529f0-4a3a-4302-ba08-e6fe89fef322\") " pod="openshift-ingress/payload-processing-e2e-ait-cd573186-69d8cd79d6-k74ld"
Jul 30 00:34:22.274717 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:34:22.274688    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ait-cd573186-69788d9648-6fnbp"
Jul 30 00:34:22.311997 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:34:22.311965    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ait-cd573186-69d8cd79d6-k74ld"
Jul 30 00:34:22.416589 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:34:22.416458    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-cd573186-69788d9648-6fnbp"]
Jul 30 00:34:22.418836 ip-10-0-133-55 kubenswrapper[2560]: W0730 00:34:22.418812    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podae01ed4a_cfb1_436f_8ffc_99aa4a6fb03c.slice/crio-c21f74cb40d206de1d75d202c5012cc4ec1efbca52c03866e361cc060c105754 WatchSource:0}: Error finding container c21f74cb40d206de1d75d202c5012cc4ec1efbca52c03866e361cc060c105754: Status 404 returned error can't find the container with id c21f74cb40d206de1d75d202c5012cc4ec1efbca52c03866e361cc060c105754
Jul 30 00:34:22.663558 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:34:22.663524    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-cd573186-69d8cd79d6-k74ld"]
Jul 30 00:34:22.666470 ip-10-0-133-55 kubenswrapper[2560]: W0730 00:34:22.666443    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb83529f0_4a3a_4302_ba08_e6fe89fef322.slice/crio-f8c858e663bb5e6557b8dd71d7da20f53ac00649723a57f568bb7f93bfd94998 WatchSource:0}: Error finding container f8c858e663bb5e6557b8dd71d7da20f53ac00649723a57f568bb7f93bfd94998: Status 404 returned error can't find the container with id f8c858e663bb5e6557b8dd71d7da20f53ac00649723a57f568bb7f93bfd94998
Jul 30 00:34:22.888636 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:34:22.888599    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ait-cd573186-69d8cd79d6-k74ld" event={"ID":"b83529f0-4a3a-4302-ba08-e6fe89fef322","Type":"ContainerStarted","Data":"8080ed3e410f70701b33d20826daa65f1d22342f96f002d81358f98096b1863a"}
Jul 30 00:34:22.888833 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:34:22.888655    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ait-cd573186-69d8cd79d6-k74ld" event={"ID":"b83529f0-4a3a-4302-ba08-e6fe89fef322","Type":"ContainerStarted","Data":"f8c858e663bb5e6557b8dd71d7da20f53ac00649723a57f568bb7f93bfd94998"}
Jul 30 00:34:22.888833 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:34:22.888716    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-ait-cd573186-69d8cd79d6-k74ld"
Jul 30 00:34:22.890457 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:34:22.890432    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ait-cd573186-69788d9648-6fnbp" event={"ID":"ae01ed4a-cfb1-436f-8ffc-99aa4a6fb03c","Type":"ContainerStarted","Data":"8828fdf331a9ba3310da93883fdd528f5f5507d9a35fa867e2234522cd173b8f"}
Jul 30 00:34:22.890612 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:34:22.890482    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-ait-cd573186-69788d9648-6fnbp"
Jul 30 00:34:22.890612 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:34:22.890505    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ait-cd573186-69788d9648-6fnbp" event={"ID":"ae01ed4a-cfb1-436f-8ffc-99aa4a6fb03c","Type":"ContainerStarted","Data":"c21f74cb40d206de1d75d202c5012cc4ec1efbca52c03866e361cc060c105754"}
Jul 30 00:34:22.903594 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:34:22.903534    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-ait-cd573186-69d8cd79d6-k74ld" podStartSLOduration=1.903519482 podStartE2EDuration="1.903519482s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-30 00:34:21 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 00:34:22.902996565 +0000 UTC m=+1949.962213369" watchObservedRunningTime="2026-07-30 00:34:22.903519482 +0000 UTC m=+1949.962736287"
Jul 30 00:34:22.918665 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:34:22.918614    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-ait-cd573186-69788d9648-6fnbp" podStartSLOduration=1.9186009830000001 podStartE2EDuration="1.918600983s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-30 00:34:21 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 00:34:22.916843952 +0000 UTC m=+1949.976060757" watchObservedRunningTime="2026-07-30 00:34:22.918600983 +0000 UTC m=+1949.977817798"
Jul 30 00:34:33.904370 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:34:33.904342    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-ait-cd573186-69788d9648-6fnbp"
Jul 30 00:34:33.904749 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:34:33.904410    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-ait-cd573186-69d8cd79d6-k74ld"
Jul 30 00:34:51.725183 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:34:51.725101    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-cd573186-69d8cd79d6-k74ld"]
Jul 30 00:34:51.727703 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:34:51.725397    2560 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-ait-cd573186-69d8cd79d6-k74ld" podUID="b83529f0-4a3a-4302-ba08-e6fe89fef322" containerName="payload-processing" containerID="cri-o://8080ed3e410f70701b33d20826daa65f1d22342f96f002d81358f98096b1863a" gracePeriod=30
Jul 30 00:34:51.735635 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:34:51.735608    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-cd573186-69788d9648-6fnbp"]
Jul 30 00:34:51.736639 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:34:51.736575    2560 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-ait-cd573186-69788d9648-6fnbp" podUID="ae01ed4a-cfb1-436f-8ffc-99aa4a6fb03c" containerName="payload-pre-processing" containerID="cri-o://8828fdf331a9ba3310da93883fdd528f5f5507d9a35fa867e2234522cd173b8f" gracePeriod=30
Jul 30 00:34:52.012701 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:34:52.012676    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ait-cd573186-69d8cd79d6-k74ld"
Jul 30 00:34:52.015486 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:34:52.015467    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ait-cd573186-69788d9648-6fnbp"
Jul 30 00:34:52.050488 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:34:52.050458    2560 generic.go:356] "Generic (PLEG): container finished" podID="b83529f0-4a3a-4302-ba08-e6fe89fef322" containerID="8080ed3e410f70701b33d20826daa65f1d22342f96f002d81358f98096b1863a" exitCode=0
Jul 30 00:34:52.050636 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:34:52.050492    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ait-cd573186-69d8cd79d6-k74ld" event={"ID":"b83529f0-4a3a-4302-ba08-e6fe89fef322","Type":"ContainerDied","Data":"8080ed3e410f70701b33d20826daa65f1d22342f96f002d81358f98096b1863a"}
Jul 30 00:34:52.050636 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:34:52.050513    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ait-cd573186-69d8cd79d6-k74ld"
Jul 30 00:34:52.050636 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:34:52.050539    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ait-cd573186-69d8cd79d6-k74ld" event={"ID":"b83529f0-4a3a-4302-ba08-e6fe89fef322","Type":"ContainerDied","Data":"f8c858e663bb5e6557b8dd71d7da20f53ac00649723a57f568bb7f93bfd94998"}
Jul 30 00:34:52.050636 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:34:52.050554    2560 scope.go:117] "RemoveContainer" containerID="8080ed3e410f70701b33d20826daa65f1d22342f96f002d81358f98096b1863a"
Jul 30 00:34:52.051959 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:34:52.051936    2560 generic.go:356] "Generic (PLEG): container finished" podID="ae01ed4a-cfb1-436f-8ffc-99aa4a6fb03c" containerID="8828fdf331a9ba3310da93883fdd528f5f5507d9a35fa867e2234522cd173b8f" exitCode=0
Jul 30 00:34:52.052040 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:34:52.051972    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ait-cd573186-69788d9648-6fnbp" event={"ID":"ae01ed4a-cfb1-436f-8ffc-99aa4a6fb03c","Type":"ContainerDied","Data":"8828fdf331a9ba3310da93883fdd528f5f5507d9a35fa867e2234522cd173b8f"}
Jul 30 00:34:52.052040 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:34:52.051994    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ait-cd573186-69788d9648-6fnbp"
Jul 30 00:34:52.052040 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:34:52.052011    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ait-cd573186-69788d9648-6fnbp" event={"ID":"ae01ed4a-cfb1-436f-8ffc-99aa4a6fb03c","Type":"ContainerDied","Data":"c21f74cb40d206de1d75d202c5012cc4ec1efbca52c03866e361cc060c105754"}
Jul 30 00:34:52.061047 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:34:52.061031    2560 scope.go:117] "RemoveContainer" containerID="8080ed3e410f70701b33d20826daa65f1d22342f96f002d81358f98096b1863a"
Jul 30 00:34:52.061353 ip-10-0-133-55 kubenswrapper[2560]: E0730 00:34:52.061302    2560 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8080ed3e410f70701b33d20826daa65f1d22342f96f002d81358f98096b1863a\": container with ID starting with 8080ed3e410f70701b33d20826daa65f1d22342f96f002d81358f98096b1863a not found: ID does not exist" containerID="8080ed3e410f70701b33d20826daa65f1d22342f96f002d81358f98096b1863a"
Jul 30 00:34:52.061423 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:34:52.061367    2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8080ed3e410f70701b33d20826daa65f1d22342f96f002d81358f98096b1863a"} err="failed to get container status \"8080ed3e410f70701b33d20826daa65f1d22342f96f002d81358f98096b1863a\": rpc error: code = NotFound desc = could not find container \"8080ed3e410f70701b33d20826daa65f1d22342f96f002d81358f98096b1863a\": container with ID starting with 8080ed3e410f70701b33d20826daa65f1d22342f96f002d81358f98096b1863a not found: ID does not exist"
Jul 30 00:34:52.061423 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:34:52.061390    2560 scope.go:117] "RemoveContainer" containerID="8828fdf331a9ba3310da93883fdd528f5f5507d9a35fa867e2234522cd173b8f"
Jul 30 00:34:52.069121 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:34:52.069103    2560 scope.go:117] "RemoveContainer" containerID="8828fdf331a9ba3310da93883fdd528f5f5507d9a35fa867e2234522cd173b8f"
Jul 30 00:34:52.069392 ip-10-0-133-55 kubenswrapper[2560]: E0730 00:34:52.069368    2560 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8828fdf331a9ba3310da93883fdd528f5f5507d9a35fa867e2234522cd173b8f\": container with ID starting with 8828fdf331a9ba3310da93883fdd528f5f5507d9a35fa867e2234522cd173b8f not found: ID does not exist" containerID="8828fdf331a9ba3310da93883fdd528f5f5507d9a35fa867e2234522cd173b8f"
Jul 30 00:34:52.069451 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:34:52.069398    2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8828fdf331a9ba3310da93883fdd528f5f5507d9a35fa867e2234522cd173b8f"} err="failed to get container status \"8828fdf331a9ba3310da93883fdd528f5f5507d9a35fa867e2234522cd173b8f\": rpc error: code = NotFound desc = could not find container \"8828fdf331a9ba3310da93883fdd528f5f5507d9a35fa867e2234522cd173b8f\": container with ID starting with 8828fdf331a9ba3310da93883fdd528f5f5507d9a35fa867e2234522cd173b8f not found: ID does not exist"
Jul 30 00:34:52.077740 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:34:52.077724    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-k9dnk\" (UniqueName: \"kubernetes.io/projected/b83529f0-4a3a-4302-ba08-e6fe89fef322-kube-api-access-k9dnk\") pod \"b83529f0-4a3a-4302-ba08-e6fe89fef322\" (UID: \"b83529f0-4a3a-4302-ba08-e6fe89fef322\") "
Jul 30 00:34:52.077822 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:34:52.077753    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/ae01ed4a-cfb1-436f-8ffc-99aa4a6fb03c-plugins-config-volume\") pod \"ae01ed4a-cfb1-436f-8ffc-99aa4a6fb03c\" (UID: \"ae01ed4a-cfb1-436f-8ffc-99aa4a6fb03c\") "
Jul 30 00:34:52.077822 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:34:52.077774    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-nkn7q\" (UniqueName: \"kubernetes.io/projected/ae01ed4a-cfb1-436f-8ffc-99aa4a6fb03c-kube-api-access-nkn7q\") pod \"ae01ed4a-cfb1-436f-8ffc-99aa4a6fb03c\" (UID: \"ae01ed4a-cfb1-436f-8ffc-99aa4a6fb03c\") "
Jul 30 00:34:52.078102 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:34:52.078076    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ae01ed4a-cfb1-436f-8ffc-99aa4a6fb03c-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "ae01ed4a-cfb1-436f-8ffc-99aa4a6fb03c" (UID: "ae01ed4a-cfb1-436f-8ffc-99aa4a6fb03c"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 30 00:34:52.079764 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:34:52.079743    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ae01ed4a-cfb1-436f-8ffc-99aa4a6fb03c-kube-api-access-nkn7q" (OuterVolumeSpecName: "kube-api-access-nkn7q") pod "ae01ed4a-cfb1-436f-8ffc-99aa4a6fb03c" (UID: "ae01ed4a-cfb1-436f-8ffc-99aa4a6fb03c"). InnerVolumeSpecName "kube-api-access-nkn7q". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 30 00:34:52.079865 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:34:52.079837    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b83529f0-4a3a-4302-ba08-e6fe89fef322-kube-api-access-k9dnk" (OuterVolumeSpecName: "kube-api-access-k9dnk") pod "b83529f0-4a3a-4302-ba08-e6fe89fef322" (UID: "b83529f0-4a3a-4302-ba08-e6fe89fef322"). InnerVolumeSpecName "kube-api-access-k9dnk". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 30 00:34:52.178432 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:34:52.178401    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/b83529f0-4a3a-4302-ba08-e6fe89fef322-plugins-config-volume\") pod \"b83529f0-4a3a-4302-ba08-e6fe89fef322\" (UID: \"b83529f0-4a3a-4302-ba08-e6fe89fef322\") "
Jul 30 00:34:52.178687 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:34:52.178671    2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-k9dnk\" (UniqueName: \"kubernetes.io/projected/b83529f0-4a3a-4302-ba08-e6fe89fef322-kube-api-access-k9dnk\") on node \"ip-10-0-133-55.ec2.internal\" DevicePath \"\""
Jul 30 00:34:52.178754 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:34:52.178693    2560 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/ae01ed4a-cfb1-436f-8ffc-99aa4a6fb03c-plugins-config-volume\") on node \"ip-10-0-133-55.ec2.internal\" DevicePath \"\""
Jul 30 00:34:52.178754 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:34:52.178707    2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-nkn7q\" (UniqueName: \"kubernetes.io/projected/ae01ed4a-cfb1-436f-8ffc-99aa4a6fb03c-kube-api-access-nkn7q\") on node \"ip-10-0-133-55.ec2.internal\" DevicePath \"\""
Jul 30 00:34:52.178829 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:34:52.178757    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b83529f0-4a3a-4302-ba08-e6fe89fef322-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "b83529f0-4a3a-4302-ba08-e6fe89fef322" (UID: "b83529f0-4a3a-4302-ba08-e6fe89fef322"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 30 00:34:52.279412 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:34:52.279335    2560 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/b83529f0-4a3a-4302-ba08-e6fe89fef322-plugins-config-volume\") on node \"ip-10-0-133-55.ec2.internal\" DevicePath \"\""
Jul 30 00:34:52.373972 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:34:52.373945    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-cd573186-69d8cd79d6-k74ld"]
Jul 30 00:34:52.379612 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:34:52.379586    2560 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-cd573186-69d8cd79d6-k74ld"]
Jul 30 00:34:52.389619 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:34:52.389596    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-cd573186-69788d9648-6fnbp"]
Jul 30 00:34:52.393823 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:34:52.393802    2560 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-cd573186-69788d9648-6fnbp"]
Jul 30 00:34:53.405283 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:34:53.405250    2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ae01ed4a-cfb1-436f-8ffc-99aa4a6fb03c" path="/var/lib/kubelet/pods/ae01ed4a-cfb1-436f-8ffc-99aa4a6fb03c/volumes"
Jul 30 00:34:53.405654 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:34:53.405627    2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b83529f0-4a3a-4302-ba08-e6fe89fef322" path="/var/lib/kubelet/pods/b83529f0-4a3a-4302-ba08-e6fe89fef322/volumes"
Jul 30 00:34:57.411191 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:34:57.411159    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-derive-2de2fd7b-58cb7598bd-b9w29"]
Jul 30 00:34:57.411665 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:34:57.411554    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b83529f0-4a3a-4302-ba08-e6fe89fef322" containerName="payload-processing"
Jul 30 00:34:57.411665 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:34:57.411568    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="b83529f0-4a3a-4302-ba08-e6fe89fef322" containerName="payload-processing"
Jul 30 00:34:57.411665 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:34:57.411582    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ae01ed4a-cfb1-436f-8ffc-99aa4a6fb03c" containerName="payload-pre-processing"
Jul 30 00:34:57.411665 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:34:57.411588    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="ae01ed4a-cfb1-436f-8ffc-99aa4a6fb03c" containerName="payload-pre-processing"
Jul 30 00:34:57.411665 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:34:57.411659    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="ae01ed4a-cfb1-436f-8ffc-99aa4a6fb03c" containerName="payload-pre-processing"
Jul 30 00:34:57.411665 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:34:57.411669    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="b83529f0-4a3a-4302-ba08-e6fe89fef322" containerName="payload-processing"
Jul 30 00:34:57.414551 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:34:57.414530    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-derive-2de2fd7b-58cb7598bd-b9w29"
Jul 30 00:34:57.417072 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:34:57.417049    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-derive-2de2fd7b\""
Jul 30 00:34:57.422956 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:34:57.422923    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-derive-2de2fd7b-58cb7598bd-b9w29"]
Jul 30 00:34:57.443328 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:34:57.443280    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-derive-2de2fd7b-568fdfc8c8-rglbw"]
Jul 30 00:34:57.446774 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:34:57.446758    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-derive-2de2fd7b-568fdfc8c8-rglbw"
Jul 30 00:34:57.449883 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:34:57.449861    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-derive-2de2fd7b-dockercfg-hlhv7\""
Jul 30 00:34:57.457277 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:34:57.457256    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-derive-2de2fd7b-568fdfc8c8-rglbw"]
Jul 30 00:34:57.526578 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:34:57.526546    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-m4m65\" (UniqueName: \"kubernetes.io/projected/91e3ad22-b3d0-4791-96ff-d812fd240a56-kube-api-access-m4m65\") pod \"payload-processing-e2e-derive-2de2fd7b-568fdfc8c8-rglbw\" (UID: \"91e3ad22-b3d0-4791-96ff-d812fd240a56\") " pod="openshift-ingress/payload-processing-e2e-derive-2de2fd7b-568fdfc8c8-rglbw"
Jul 30 00:34:57.526751 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:34:57.526657    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2gwrc\" (UniqueName: \"kubernetes.io/projected/8858eda9-5a67-47e2-bab4-9d0151431044-kube-api-access-2gwrc\") pod \"payload-pre-processing-e2e-derive-2de2fd7b-58cb7598bd-b9w29\" (UID: \"8858eda9-5a67-47e2-bab4-9d0151431044\") " pod="openshift-ingress/payload-pre-processing-e2e-derive-2de2fd7b-58cb7598bd-b9w29"
Jul 30 00:34:57.526751 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:34:57.526689    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/8858eda9-5a67-47e2-bab4-9d0151431044-plugins-config-volume\") pod \"payload-pre-processing-e2e-derive-2de2fd7b-58cb7598bd-b9w29\" (UID: \"8858eda9-5a67-47e2-bab4-9d0151431044\") " pod="openshift-ingress/payload-pre-processing-e2e-derive-2de2fd7b-58cb7598bd-b9w29"
Jul 30 00:34:57.526751 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:34:57.526708    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/91e3ad22-b3d0-4791-96ff-d812fd240a56-plugins-config-volume\") pod \"payload-processing-e2e-derive-2de2fd7b-568fdfc8c8-rglbw\" (UID: \"91e3ad22-b3d0-4791-96ff-d812fd240a56\") " pod="openshift-ingress/payload-processing-e2e-derive-2de2fd7b-568fdfc8c8-rglbw"
Jul 30 00:34:57.628139 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:34:57.628104    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2gwrc\" (UniqueName: \"kubernetes.io/projected/8858eda9-5a67-47e2-bab4-9d0151431044-kube-api-access-2gwrc\") pod \"payload-pre-processing-e2e-derive-2de2fd7b-58cb7598bd-b9w29\" (UID: \"8858eda9-5a67-47e2-bab4-9d0151431044\") " pod="openshift-ingress/payload-pre-processing-e2e-derive-2de2fd7b-58cb7598bd-b9w29"
Jul 30 00:34:57.628139 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:34:57.628145    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/8858eda9-5a67-47e2-bab4-9d0151431044-plugins-config-volume\") pod \"payload-pre-processing-e2e-derive-2de2fd7b-58cb7598bd-b9w29\" (UID: \"8858eda9-5a67-47e2-bab4-9d0151431044\") " pod="openshift-ingress/payload-pre-processing-e2e-derive-2de2fd7b-58cb7598bd-b9w29"
Jul 30 00:34:57.628390 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:34:57.628164    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/91e3ad22-b3d0-4791-96ff-d812fd240a56-plugins-config-volume\") pod \"payload-processing-e2e-derive-2de2fd7b-568fdfc8c8-rglbw\" (UID: \"91e3ad22-b3d0-4791-96ff-d812fd240a56\") " pod="openshift-ingress/payload-processing-e2e-derive-2de2fd7b-568fdfc8c8-rglbw"
Jul 30 00:34:57.628390 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:34:57.628193    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-m4m65\" (UniqueName: \"kubernetes.io/projected/91e3ad22-b3d0-4791-96ff-d812fd240a56-kube-api-access-m4m65\") pod \"payload-processing-e2e-derive-2de2fd7b-568fdfc8c8-rglbw\" (UID: \"91e3ad22-b3d0-4791-96ff-d812fd240a56\") " pod="openshift-ingress/payload-processing-e2e-derive-2de2fd7b-568fdfc8c8-rglbw"
Jul 30 00:34:57.628842 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:34:57.628822    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/8858eda9-5a67-47e2-bab4-9d0151431044-plugins-config-volume\") pod \"payload-pre-processing-e2e-derive-2de2fd7b-58cb7598bd-b9w29\" (UID: \"8858eda9-5a67-47e2-bab4-9d0151431044\") " pod="openshift-ingress/payload-pre-processing-e2e-derive-2de2fd7b-58cb7598bd-b9w29"
Jul 30 00:34:57.628909 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:34:57.628892    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/91e3ad22-b3d0-4791-96ff-d812fd240a56-plugins-config-volume\") pod \"payload-processing-e2e-derive-2de2fd7b-568fdfc8c8-rglbw\" (UID: \"91e3ad22-b3d0-4791-96ff-d812fd240a56\") " pod="openshift-ingress/payload-processing-e2e-derive-2de2fd7b-568fdfc8c8-rglbw"
Jul 30 00:34:57.636329 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:34:57.636289    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2gwrc\" (UniqueName: \"kubernetes.io/projected/8858eda9-5a67-47e2-bab4-9d0151431044-kube-api-access-2gwrc\") pod \"payload-pre-processing-e2e-derive-2de2fd7b-58cb7598bd-b9w29\" (UID: \"8858eda9-5a67-47e2-bab4-9d0151431044\") " pod="openshift-ingress/payload-pre-processing-e2e-derive-2de2fd7b-58cb7598bd-b9w29"
Jul 30 00:34:57.636458 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:34:57.636415    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-m4m65\" (UniqueName: \"kubernetes.io/projected/91e3ad22-b3d0-4791-96ff-d812fd240a56-kube-api-access-m4m65\") pod \"payload-processing-e2e-derive-2de2fd7b-568fdfc8c8-rglbw\" (UID: \"91e3ad22-b3d0-4791-96ff-d812fd240a56\") " pod="openshift-ingress/payload-processing-e2e-derive-2de2fd7b-568fdfc8c8-rglbw"
Jul 30 00:34:57.725726 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:34:57.725656    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-derive-2de2fd7b-58cb7598bd-b9w29"
Jul 30 00:34:57.757357 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:34:57.757327    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-derive-2de2fd7b-568fdfc8c8-rglbw"
Jul 30 00:34:58.070523 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:34:58.070490    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-derive-2de2fd7b-58cb7598bd-b9w29"]
Jul 30 00:34:58.073012 ip-10-0-133-55 kubenswrapper[2560]: W0730 00:34:58.072986    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8858eda9_5a67_47e2_bab4_9d0151431044.slice/crio-a25031c005e9cf8b7ba25472464ce2a5410d90982df1e83dfdbb2ad4de7c8f4b WatchSource:0}: Error finding container a25031c005e9cf8b7ba25472464ce2a5410d90982df1e83dfdbb2ad4de7c8f4b: Status 404 returned error can't find the container with id a25031c005e9cf8b7ba25472464ce2a5410d90982df1e83dfdbb2ad4de7c8f4b
Jul 30 00:34:58.083378 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:34:58.083341    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-derive-2de2fd7b-58cb7598bd-b9w29" event={"ID":"8858eda9-5a67-47e2-bab4-9d0151431044","Type":"ContainerStarted","Data":"a25031c005e9cf8b7ba25472464ce2a5410d90982df1e83dfdbb2ad4de7c8f4b"}
Jul 30 00:34:58.099894 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:34:58.099873    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-derive-2de2fd7b-568fdfc8c8-rglbw"]
Jul 30 00:34:58.106383 ip-10-0-133-55 kubenswrapper[2560]: W0730 00:34:58.106362    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod91e3ad22_b3d0_4791_96ff_d812fd240a56.slice/crio-286792f3abb268b54b2539f60b59fc621599b3a0c83598e3676c2140f331c82c WatchSource:0}: Error finding container 286792f3abb268b54b2539f60b59fc621599b3a0c83598e3676c2140f331c82c: Status 404 returned error can't find the container with id 286792f3abb268b54b2539f60b59fc621599b3a0c83598e3676c2140f331c82c
Jul 30 00:34:59.090145 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:34:59.090106    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-derive-2de2fd7b-58cb7598bd-b9w29" event={"ID":"8858eda9-5a67-47e2-bab4-9d0151431044","Type":"ContainerStarted","Data":"fed64417d958a7882880eac246762d4a5cb9d72f80f39f9af20a99b274c0d992"}
Jul 30 00:34:59.090631 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:34:59.090198    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-derive-2de2fd7b-58cb7598bd-b9w29"
Jul 30 00:34:59.091694 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:34:59.091672    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-derive-2de2fd7b-568fdfc8c8-rglbw" event={"ID":"91e3ad22-b3d0-4791-96ff-d812fd240a56","Type":"ContainerStarted","Data":"8c98bd9ff64b65cb59cb83940dbb4d1644d4ec6334948542ac76286617c66512"}
Jul 30 00:34:59.091838 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:34:59.091712    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-derive-2de2fd7b-568fdfc8c8-rglbw" event={"ID":"91e3ad22-b3d0-4791-96ff-d812fd240a56","Type":"ContainerStarted","Data":"286792f3abb268b54b2539f60b59fc621599b3a0c83598e3676c2140f331c82c"}
Jul 30 00:34:59.091838 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:34:59.091740    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-derive-2de2fd7b-568fdfc8c8-rglbw"
Jul 30 00:34:59.105180 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:34:59.105137    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-derive-2de2fd7b-58cb7598bd-b9w29" podStartSLOduration=2.105123024 podStartE2EDuration="2.105123024s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-30 00:34:57 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 00:34:59.104546269 +0000 UTC m=+1986.163763073" watchObservedRunningTime="2026-07-30 00:34:59.105123024 +0000 UTC m=+1986.164339828"
Jul 30 00:34:59.121783 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:34:59.121736    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-derive-2de2fd7b-568fdfc8c8-rglbw" podStartSLOduration=2.121721246 podStartE2EDuration="2.121721246s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-30 00:34:57 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 00:34:59.12047869 +0000 UTC m=+1986.179695494" watchObservedRunningTime="2026-07-30 00:34:59.121721246 +0000 UTC m=+1986.180938108"
Jul 30 00:35:10.100292 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:35:10.100262    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-derive-2de2fd7b-568fdfc8c8-rglbw"
Jul 30 00:35:10.100682 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:35:10.100428    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-derive-2de2fd7b-58cb7598bd-b9w29"
Jul 30 00:35:27.287815 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:35:27.287771    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-derive-2de2fd7b-568fdfc8c8-rglbw"]
Jul 30 00:35:27.288361 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:35:27.288029    2560 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-derive-2de2fd7b-568fdfc8c8-rglbw" podUID="91e3ad22-b3d0-4791-96ff-d812fd240a56" containerName="payload-processing" containerID="cri-o://8c98bd9ff64b65cb59cb83940dbb4d1644d4ec6334948542ac76286617c66512" gracePeriod=30
Jul 30 00:35:27.294474 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:35:27.294446    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-derive-2de2fd7b-58cb7598bd-b9w29"]
Jul 30 00:35:27.294678 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:35:27.294652    2560 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-derive-2de2fd7b-58cb7598bd-b9w29" podUID="8858eda9-5a67-47e2-bab4-9d0151431044" containerName="payload-pre-processing" containerID="cri-o://fed64417d958a7882880eac246762d4a5cb9d72f80f39f9af20a99b274c0d992" gracePeriod=30
Jul 30 00:35:27.567624 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:35:27.567595    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-derive-2de2fd7b-568fdfc8c8-rglbw"
Jul 30 00:35:27.573434 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:35:27.573410    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-derive-2de2fd7b-58cb7598bd-b9w29"
Jul 30 00:35:27.691229 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:35:27.691192    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-2gwrc\" (UniqueName: \"kubernetes.io/projected/8858eda9-5a67-47e2-bab4-9d0151431044-kube-api-access-2gwrc\") pod \"8858eda9-5a67-47e2-bab4-9d0151431044\" (UID: \"8858eda9-5a67-47e2-bab4-9d0151431044\") "
Jul 30 00:35:27.691451 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:35:27.691260    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/91e3ad22-b3d0-4791-96ff-d812fd240a56-plugins-config-volume\") pod \"91e3ad22-b3d0-4791-96ff-d812fd240a56\" (UID: \"91e3ad22-b3d0-4791-96ff-d812fd240a56\") "
Jul 30 00:35:27.691451 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:35:27.691287    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/8858eda9-5a67-47e2-bab4-9d0151431044-plugins-config-volume\") pod \"8858eda9-5a67-47e2-bab4-9d0151431044\" (UID: \"8858eda9-5a67-47e2-bab4-9d0151431044\") "
Jul 30 00:35:27.691451 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:35:27.691401    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-m4m65\" (UniqueName: \"kubernetes.io/projected/91e3ad22-b3d0-4791-96ff-d812fd240a56-kube-api-access-m4m65\") pod \"91e3ad22-b3d0-4791-96ff-d812fd240a56\" (UID: \"91e3ad22-b3d0-4791-96ff-d812fd240a56\") "
Jul 30 00:35:27.691720 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:35:27.691691    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8858eda9-5a67-47e2-bab4-9d0151431044-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "8858eda9-5a67-47e2-bab4-9d0151431044" (UID: "8858eda9-5a67-47e2-bab4-9d0151431044"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 30 00:35:27.691859 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:35:27.691695    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/91e3ad22-b3d0-4791-96ff-d812fd240a56-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "91e3ad22-b3d0-4791-96ff-d812fd240a56" (UID: "91e3ad22-b3d0-4791-96ff-d812fd240a56"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 30 00:35:27.693440 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:35:27.693411    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/91e3ad22-b3d0-4791-96ff-d812fd240a56-kube-api-access-m4m65" (OuterVolumeSpecName: "kube-api-access-m4m65") pod "91e3ad22-b3d0-4791-96ff-d812fd240a56" (UID: "91e3ad22-b3d0-4791-96ff-d812fd240a56"). InnerVolumeSpecName "kube-api-access-m4m65". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 30 00:35:27.693440 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:35:27.693417    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8858eda9-5a67-47e2-bab4-9d0151431044-kube-api-access-2gwrc" (OuterVolumeSpecName: "kube-api-access-2gwrc") pod "8858eda9-5a67-47e2-bab4-9d0151431044" (UID: "8858eda9-5a67-47e2-bab4-9d0151431044"). InnerVolumeSpecName "kube-api-access-2gwrc". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 30 00:35:27.792667 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:35:27.792583    2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-m4m65\" (UniqueName: \"kubernetes.io/projected/91e3ad22-b3d0-4791-96ff-d812fd240a56-kube-api-access-m4m65\") on node \"ip-10-0-133-55.ec2.internal\" DevicePath \"\""
Jul 30 00:35:27.792667 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:35:27.792615    2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-2gwrc\" (UniqueName: \"kubernetes.io/projected/8858eda9-5a67-47e2-bab4-9d0151431044-kube-api-access-2gwrc\") on node \"ip-10-0-133-55.ec2.internal\" DevicePath \"\""
Jul 30 00:35:27.792667 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:35:27.792624    2560 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/91e3ad22-b3d0-4791-96ff-d812fd240a56-plugins-config-volume\") on node \"ip-10-0-133-55.ec2.internal\" DevicePath \"\""
Jul 30 00:35:27.792667 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:35:27.792634    2560 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/8858eda9-5a67-47e2-bab4-9d0151431044-plugins-config-volume\") on node \"ip-10-0-133-55.ec2.internal\" DevicePath \"\""
Jul 30 00:35:28.232377 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:35:28.232343    2560 generic.go:356] "Generic (PLEG): container finished" podID="8858eda9-5a67-47e2-bab4-9d0151431044" containerID="fed64417d958a7882880eac246762d4a5cb9d72f80f39f9af20a99b274c0d992" exitCode=0
Jul 30 00:35:28.232555 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:35:28.232389    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-derive-2de2fd7b-58cb7598bd-b9w29"
Jul 30 00:35:28.232555 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:35:28.232427    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-derive-2de2fd7b-58cb7598bd-b9w29" event={"ID":"8858eda9-5a67-47e2-bab4-9d0151431044","Type":"ContainerDied","Data":"fed64417d958a7882880eac246762d4a5cb9d72f80f39f9af20a99b274c0d992"}
Jul 30 00:35:28.232555 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:35:28.232477    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-derive-2de2fd7b-58cb7598bd-b9w29" event={"ID":"8858eda9-5a67-47e2-bab4-9d0151431044","Type":"ContainerDied","Data":"a25031c005e9cf8b7ba25472464ce2a5410d90982df1e83dfdbb2ad4de7c8f4b"}
Jul 30 00:35:28.232555 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:35:28.232509    2560 scope.go:117] "RemoveContainer" containerID="fed64417d958a7882880eac246762d4a5cb9d72f80f39f9af20a99b274c0d992"
Jul 30 00:35:28.233722 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:35:28.233699    2560 generic.go:356] "Generic (PLEG): container finished" podID="91e3ad22-b3d0-4791-96ff-d812fd240a56" containerID="8c98bd9ff64b65cb59cb83940dbb4d1644d4ec6334948542ac76286617c66512" exitCode=0
Jul 30 00:35:28.233813 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:35:28.233730    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-derive-2de2fd7b-568fdfc8c8-rglbw"
Jul 30 00:35:28.233813 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:35:28.233741    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-derive-2de2fd7b-568fdfc8c8-rglbw" event={"ID":"91e3ad22-b3d0-4791-96ff-d812fd240a56","Type":"ContainerDied","Data":"8c98bd9ff64b65cb59cb83940dbb4d1644d4ec6334948542ac76286617c66512"}
Jul 30 00:35:28.233813 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:35:28.233781    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-derive-2de2fd7b-568fdfc8c8-rglbw" event={"ID":"91e3ad22-b3d0-4791-96ff-d812fd240a56","Type":"ContainerDied","Data":"286792f3abb268b54b2539f60b59fc621599b3a0c83598e3676c2140f331c82c"}
Jul 30 00:35:28.242500 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:35:28.242425    2560 scope.go:117] "RemoveContainer" containerID="fed64417d958a7882880eac246762d4a5cb9d72f80f39f9af20a99b274c0d992"
Jul 30 00:35:28.242782 ip-10-0-133-55 kubenswrapper[2560]: E0730 00:35:28.242760    2560 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"fed64417d958a7882880eac246762d4a5cb9d72f80f39f9af20a99b274c0d992\": container with ID starting with fed64417d958a7882880eac246762d4a5cb9d72f80f39f9af20a99b274c0d992 not found: ID does not exist" containerID="fed64417d958a7882880eac246762d4a5cb9d72f80f39f9af20a99b274c0d992"
Jul 30 00:35:28.242855 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:35:28.242788    2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"fed64417d958a7882880eac246762d4a5cb9d72f80f39f9af20a99b274c0d992"} err="failed to get container status \"fed64417d958a7882880eac246762d4a5cb9d72f80f39f9af20a99b274c0d992\": rpc error: code = NotFound desc = could not find container \"fed64417d958a7882880eac246762d4a5cb9d72f80f39f9af20a99b274c0d992\": container with ID starting with fed64417d958a7882880eac246762d4a5cb9d72f80f39f9af20a99b274c0d992 not found: ID does not exist"
Jul 30 00:35:28.242855 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:35:28.242805    2560 scope.go:117] "RemoveContainer" containerID="8c98bd9ff64b65cb59cb83940dbb4d1644d4ec6334948542ac76286617c66512"
Jul 30 00:35:28.251040 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:35:28.251025    2560 scope.go:117] "RemoveContainer" containerID="8c98bd9ff64b65cb59cb83940dbb4d1644d4ec6334948542ac76286617c66512"
Jul 30 00:35:28.251281 ip-10-0-133-55 kubenswrapper[2560]: E0730 00:35:28.251262    2560 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8c98bd9ff64b65cb59cb83940dbb4d1644d4ec6334948542ac76286617c66512\": container with ID starting with 8c98bd9ff64b65cb59cb83940dbb4d1644d4ec6334948542ac76286617c66512 not found: ID does not exist" containerID="8c98bd9ff64b65cb59cb83940dbb4d1644d4ec6334948542ac76286617c66512"
Jul 30 00:35:28.251344 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:35:28.251288    2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8c98bd9ff64b65cb59cb83940dbb4d1644d4ec6334948542ac76286617c66512"} err="failed to get container status \"8c98bd9ff64b65cb59cb83940dbb4d1644d4ec6334948542ac76286617c66512\": rpc error: code = NotFound desc = could not find container \"8c98bd9ff64b65cb59cb83940dbb4d1644d4ec6334948542ac76286617c66512\": container with ID starting with 8c98bd9ff64b65cb59cb83940dbb4d1644d4ec6334948542ac76286617c66512 not found: ID does not exist"
Jul 30 00:35:28.263622 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:35:28.263598    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-derive-2de2fd7b-58cb7598bd-b9w29"]
Jul 30 00:35:28.272202 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:35:28.272182    2560 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-derive-2de2fd7b-58cb7598bd-b9w29"]
Jul 30 00:35:28.285161 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:35:28.285139    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-derive-2de2fd7b-568fdfc8c8-rglbw"]
Jul 30 00:35:28.290430 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:35:28.290410    2560 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-derive-2de2fd7b-568fdfc8c8-rglbw"]
Jul 30 00:35:29.411506 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:35:29.411471    2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="8858eda9-5a67-47e2-bab4-9d0151431044" path="/var/lib/kubelet/pods/8858eda9-5a67-47e2-bab4-9d0151431044/volumes"
Jul 30 00:35:29.411881 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:35:29.411806    2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="91e3ad22-b3d0-4791-96ff-d812fd240a56" path="/var/lib/kubelet/pods/91e3ad22-b3d0-4791-96ff-d812fd240a56/volumes"
Jul 30 00:36:53.506738 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:36:53.506710    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-kchgc_324341b7-120c-4f8b-9ddd-e28b9a40ce9e/console-operator/1.log"
Jul 30 00:36:53.512266 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:36:53.512242    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-kchgc_324341b7-120c-4f8b-9ddd-e28b9a40ce9e/console-operator/1.log"
Jul 30 00:37:13.570784 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:37:13.570749    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-8c9d47c1-94b6c8884-6bvlg"]
Jul 30 00:37:13.571220 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:37:13.571103    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="91e3ad22-b3d0-4791-96ff-d812fd240a56" containerName="payload-processing"
Jul 30 00:37:13.571220 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:37:13.571114    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="91e3ad22-b3d0-4791-96ff-d812fd240a56" containerName="payload-processing"
Jul 30 00:37:13.571220 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:37:13.571133    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8858eda9-5a67-47e2-bab4-9d0151431044" containerName="payload-pre-processing"
Jul 30 00:37:13.571220 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:37:13.571139    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="8858eda9-5a67-47e2-bab4-9d0151431044" containerName="payload-pre-processing"
Jul 30 00:37:13.571220 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:37:13.571197    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="91e3ad22-b3d0-4791-96ff-d812fd240a56" containerName="payload-processing"
Jul 30 00:37:13.571220 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:37:13.571208    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="8858eda9-5a67-47e2-bab4-9d0151431044" containerName="payload-pre-processing"
Jul 30 00:37:13.573863 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:37:13.573847    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-mt-8c9d47c1-94b6c8884-6bvlg"
Jul 30 00:37:13.577000 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:37:13.576974    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-mt-8c9d47c1\""
Jul 30 00:37:13.577141 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:37:13.577020    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-mt-8c9d47c1-dockercfg-6dk6p\""
Jul 30 00:37:13.587769 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:37:13.587746    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-8c9d47c1-94b6c8884-6bvlg"]
Jul 30 00:37:13.608136 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:37:13.608106    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-mt-8c9d47c1-5758bf646b-xcncx"]
Jul 30 00:37:13.611613 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:37:13.611597    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-mt-8c9d47c1-5758bf646b-xcncx"
Jul 30 00:37:13.621901 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:37:13.621877    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-mt-8c9d47c1-5758bf646b-xcncx"]
Jul 30 00:37:13.637653 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:37:13.637622    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2s7jk\" (UniqueName: \"kubernetes.io/projected/03a58d8d-1508-4837-a5c1-a32ad48d1051-kube-api-access-2s7jk\") pod \"payload-processing-e2e-mt-8c9d47c1-5758bf646b-xcncx\" (UID: \"03a58d8d-1508-4837-a5c1-a32ad48d1051\") " pod="openshift-ingress/payload-processing-e2e-mt-8c9d47c1-5758bf646b-xcncx"
Jul 30 00:37:13.637783 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:37:13.637664    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ccjp2\" (UniqueName: \"kubernetes.io/projected/183f31ef-de6e-4fc2-909d-aeca9eaffee9-kube-api-access-ccjp2\") pod \"payload-pre-processing-e2e-mt-8c9d47c1-94b6c8884-6bvlg\" (UID: \"183f31ef-de6e-4fc2-909d-aeca9eaffee9\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-8c9d47c1-94b6c8884-6bvlg"
Jul 30 00:37:13.637783 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:37:13.637728    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/183f31ef-de6e-4fc2-909d-aeca9eaffee9-plugins-config-volume\") pod \"payload-pre-processing-e2e-mt-8c9d47c1-94b6c8884-6bvlg\" (UID: \"183f31ef-de6e-4fc2-909d-aeca9eaffee9\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-8c9d47c1-94b6c8884-6bvlg"
Jul 30 00:37:13.637872 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:37:13.637790    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/03a58d8d-1508-4837-a5c1-a32ad48d1051-plugins-config-volume\") pod \"payload-processing-e2e-mt-8c9d47c1-5758bf646b-xcncx\" (UID: \"03a58d8d-1508-4837-a5c1-a32ad48d1051\") " pod="openshift-ingress/payload-processing-e2e-mt-8c9d47c1-5758bf646b-xcncx"
Jul 30 00:37:13.738925 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:37:13.738895    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ccjp2\" (UniqueName: \"kubernetes.io/projected/183f31ef-de6e-4fc2-909d-aeca9eaffee9-kube-api-access-ccjp2\") pod \"payload-pre-processing-e2e-mt-8c9d47c1-94b6c8884-6bvlg\" (UID: \"183f31ef-de6e-4fc2-909d-aeca9eaffee9\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-8c9d47c1-94b6c8884-6bvlg"
Jul 30 00:37:13.739095 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:37:13.738946    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/183f31ef-de6e-4fc2-909d-aeca9eaffee9-plugins-config-volume\") pod \"payload-pre-processing-e2e-mt-8c9d47c1-94b6c8884-6bvlg\" (UID: \"183f31ef-de6e-4fc2-909d-aeca9eaffee9\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-8c9d47c1-94b6c8884-6bvlg"
Jul 30 00:37:13.739095 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:37:13.738990    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/03a58d8d-1508-4837-a5c1-a32ad48d1051-plugins-config-volume\") pod \"payload-processing-e2e-mt-8c9d47c1-5758bf646b-xcncx\" (UID: \"03a58d8d-1508-4837-a5c1-a32ad48d1051\") " pod="openshift-ingress/payload-processing-e2e-mt-8c9d47c1-5758bf646b-xcncx"
Jul 30 00:37:13.739095 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:37:13.739043    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2s7jk\" (UniqueName: \"kubernetes.io/projected/03a58d8d-1508-4837-a5c1-a32ad48d1051-kube-api-access-2s7jk\") pod \"payload-processing-e2e-mt-8c9d47c1-5758bf646b-xcncx\" (UID: \"03a58d8d-1508-4837-a5c1-a32ad48d1051\") " pod="openshift-ingress/payload-processing-e2e-mt-8c9d47c1-5758bf646b-xcncx"
Jul 30 00:37:13.739961 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:37:13.739937    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/03a58d8d-1508-4837-a5c1-a32ad48d1051-plugins-config-volume\") pod \"payload-processing-e2e-mt-8c9d47c1-5758bf646b-xcncx\" (UID: \"03a58d8d-1508-4837-a5c1-a32ad48d1051\") " pod="openshift-ingress/payload-processing-e2e-mt-8c9d47c1-5758bf646b-xcncx"
Jul 30 00:37:13.740006 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:37:13.739937    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/183f31ef-de6e-4fc2-909d-aeca9eaffee9-plugins-config-volume\") pod \"payload-pre-processing-e2e-mt-8c9d47c1-94b6c8884-6bvlg\" (UID: \"183f31ef-de6e-4fc2-909d-aeca9eaffee9\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-8c9d47c1-94b6c8884-6bvlg"
Jul 30 00:37:13.748157 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:37:13.748136    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ccjp2\" (UniqueName: \"kubernetes.io/projected/183f31ef-de6e-4fc2-909d-aeca9eaffee9-kube-api-access-ccjp2\") pod \"payload-pre-processing-e2e-mt-8c9d47c1-94b6c8884-6bvlg\" (UID: \"183f31ef-de6e-4fc2-909d-aeca9eaffee9\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-8c9d47c1-94b6c8884-6bvlg"
Jul 30 00:37:13.748253 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:37:13.748224    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2s7jk\" (UniqueName: \"kubernetes.io/projected/03a58d8d-1508-4837-a5c1-a32ad48d1051-kube-api-access-2s7jk\") pod \"payload-processing-e2e-mt-8c9d47c1-5758bf646b-xcncx\" (UID: \"03a58d8d-1508-4837-a5c1-a32ad48d1051\") " pod="openshift-ingress/payload-processing-e2e-mt-8c9d47c1-5758bf646b-xcncx"
Jul 30 00:37:13.883695 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:37:13.883671    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-mt-8c9d47c1-94b6c8884-6bvlg"
Jul 30 00:37:13.922563 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:37:13.922510    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-mt-8c9d47c1-5758bf646b-xcncx"
Jul 30 00:37:14.227707 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:37:14.227678    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-8c9d47c1-94b6c8884-6bvlg"]
Jul 30 00:37:14.229265 ip-10-0-133-55 kubenswrapper[2560]: W0730 00:37:14.229243    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod183f31ef_de6e_4fc2_909d_aeca9eaffee9.slice/crio-d05f00e77381f615a3ce81a393b3b0046a4e2715f653b8027fafd5d3e1da516f WatchSource:0}: Error finding container d05f00e77381f615a3ce81a393b3b0046a4e2715f653b8027fafd5d3e1da516f: Status 404 returned error can't find the container with id d05f00e77381f615a3ce81a393b3b0046a4e2715f653b8027fafd5d3e1da516f
Jul 30 00:37:14.286088 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:37:14.286063    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-mt-8c9d47c1-5758bf646b-xcncx"]
Jul 30 00:37:14.287691 ip-10-0-133-55 kubenswrapper[2560]: W0730 00:37:14.287664    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod03a58d8d_1508_4837_a5c1_a32ad48d1051.slice/crio-3bcbf87807948254ab9f29b2b4c1755506a163b1be1ab9661c168e0d8e04294b WatchSource:0}: Error finding container 3bcbf87807948254ab9f29b2b4c1755506a163b1be1ab9661c168e0d8e04294b: Status 404 returned error can't find the container with id 3bcbf87807948254ab9f29b2b4c1755506a163b1be1ab9661c168e0d8e04294b
Jul 30 00:37:14.723053 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:37:14.723009    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-mt-8c9d47c1-94b6c8884-6bvlg" event={"ID":"183f31ef-de6e-4fc2-909d-aeca9eaffee9","Type":"ContainerStarted","Data":"6d569e5b94aea048da192b080a1bfd3c5331b88f5e9193ddd5fa70cd0c35297c"}
Jul 30 00:37:14.723551 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:37:14.723102    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-mt-8c9d47c1-94b6c8884-6bvlg" event={"ID":"183f31ef-de6e-4fc2-909d-aeca9eaffee9","Type":"ContainerStarted","Data":"d05f00e77381f615a3ce81a393b3b0046a4e2715f653b8027fafd5d3e1da516f"}
Jul 30 00:37:14.723551 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:37:14.723132    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-mt-8c9d47c1-94b6c8884-6bvlg"
Jul 30 00:37:14.724539 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:37:14.724513    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-mt-8c9d47c1-5758bf646b-xcncx" event={"ID":"03a58d8d-1508-4837-a5c1-a32ad48d1051","Type":"ContainerStarted","Data":"0fd798ddaafefcedf0d98fa2d56d1ca6e7261244334e166c26b579698c942813"}
Jul 30 00:37:14.724643 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:37:14.724553    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-mt-8c9d47c1-5758bf646b-xcncx" event={"ID":"03a58d8d-1508-4837-a5c1-a32ad48d1051","Type":"ContainerStarted","Data":"3bcbf87807948254ab9f29b2b4c1755506a163b1be1ab9661c168e0d8e04294b"}
Jul 30 00:37:14.724643 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:37:14.724588    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-mt-8c9d47c1-5758bf646b-xcncx"
Jul 30 00:37:14.737709 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:37:14.737670    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-mt-8c9d47c1-94b6c8884-6bvlg" podStartSLOduration=1.737657632 podStartE2EDuration="1.737657632s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-30 00:37:13 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 00:37:14.736970551 +0000 UTC m=+2121.796187350" watchObservedRunningTime="2026-07-30 00:37:14.737657632 +0000 UTC m=+2121.796874436"
Jul 30 00:37:14.751988 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:37:14.751942    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-mt-8c9d47c1-5758bf646b-xcncx" podStartSLOduration=1.75192805 podStartE2EDuration="1.75192805s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-30 00:37:13 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 00:37:14.74937053 +0000 UTC m=+2121.808587330" watchObservedRunningTime="2026-07-30 00:37:14.75192805 +0000 UTC m=+2121.811144854"
Jul 30 00:37:25.731684 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:37:25.731651    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-mt-8c9d47c1-5758bf646b-xcncx"
Jul 30 00:37:25.732149 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:37:25.731733    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-mt-8c9d47c1-94b6c8884-6bvlg"
Jul 30 00:37:54.383722 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:37:54.383677    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-mt-8c9d47c1-5758bf646b-xcncx"]
Jul 30 00:37:54.384356 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:37:54.383924    2560 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-mt-8c9d47c1-5758bf646b-xcncx" podUID="03a58d8d-1508-4837-a5c1-a32ad48d1051" containerName="payload-processing" containerID="cri-o://0fd798ddaafefcedf0d98fa2d56d1ca6e7261244334e166c26b579698c942813" gracePeriod=30
Jul 30 00:37:54.389153 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:37:54.389127    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-8c9d47c1-94b6c8884-6bvlg"]
Jul 30 00:37:54.389416 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:37:54.389359    2560 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-mt-8c9d47c1-94b6c8884-6bvlg" podUID="183f31ef-de6e-4fc2-909d-aeca9eaffee9" containerName="payload-pre-processing" containerID="cri-o://6d569e5b94aea048da192b080a1bfd3c5331b88f5e9193ddd5fa70cd0c35297c" gracePeriod=30
Jul 30 00:37:54.664777 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:37:54.664753    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-mt-8c9d47c1-5758bf646b-xcncx"
Jul 30 00:37:54.667297 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:37:54.667279    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-mt-8c9d47c1-94b6c8884-6bvlg"
Jul 30 00:37:54.801931 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:37:54.801899    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-ccjp2\" (UniqueName: \"kubernetes.io/projected/183f31ef-de6e-4fc2-909d-aeca9eaffee9-kube-api-access-ccjp2\") pod \"183f31ef-de6e-4fc2-909d-aeca9eaffee9\" (UID: \"183f31ef-de6e-4fc2-909d-aeca9eaffee9\") "
Jul 30 00:37:54.802094 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:37:54.801966    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/183f31ef-de6e-4fc2-909d-aeca9eaffee9-plugins-config-volume\") pod \"183f31ef-de6e-4fc2-909d-aeca9eaffee9\" (UID: \"183f31ef-de6e-4fc2-909d-aeca9eaffee9\") "
Jul 30 00:37:54.802094 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:37:54.802023    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-2s7jk\" (UniqueName: \"kubernetes.io/projected/03a58d8d-1508-4837-a5c1-a32ad48d1051-kube-api-access-2s7jk\") pod \"03a58d8d-1508-4837-a5c1-a32ad48d1051\" (UID: \"03a58d8d-1508-4837-a5c1-a32ad48d1051\") "
Jul 30 00:37:54.802094 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:37:54.802047    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/03a58d8d-1508-4837-a5c1-a32ad48d1051-plugins-config-volume\") pod \"03a58d8d-1508-4837-a5c1-a32ad48d1051\" (UID: \"03a58d8d-1508-4837-a5c1-a32ad48d1051\") "
Jul 30 00:37:54.802408 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:37:54.802379    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/183f31ef-de6e-4fc2-909d-aeca9eaffee9-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "183f31ef-de6e-4fc2-909d-aeca9eaffee9" (UID: "183f31ef-de6e-4fc2-909d-aeca9eaffee9"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 30 00:37:54.802524 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:37:54.802417    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/03a58d8d-1508-4837-a5c1-a32ad48d1051-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "03a58d8d-1508-4837-a5c1-a32ad48d1051" (UID: "03a58d8d-1508-4837-a5c1-a32ad48d1051"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 30 00:37:54.804104 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:37:54.804077    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/183f31ef-de6e-4fc2-909d-aeca9eaffee9-kube-api-access-ccjp2" (OuterVolumeSpecName: "kube-api-access-ccjp2") pod "183f31ef-de6e-4fc2-909d-aeca9eaffee9" (UID: "183f31ef-de6e-4fc2-909d-aeca9eaffee9"). InnerVolumeSpecName "kube-api-access-ccjp2". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 30 00:37:54.804195 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:37:54.804097    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/03a58d8d-1508-4837-a5c1-a32ad48d1051-kube-api-access-2s7jk" (OuterVolumeSpecName: "kube-api-access-2s7jk") pod "03a58d8d-1508-4837-a5c1-a32ad48d1051" (UID: "03a58d8d-1508-4837-a5c1-a32ad48d1051"). InnerVolumeSpecName "kube-api-access-2s7jk". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 30 00:37:54.903387 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:37:54.903277    2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-ccjp2\" (UniqueName: \"kubernetes.io/projected/183f31ef-de6e-4fc2-909d-aeca9eaffee9-kube-api-access-ccjp2\") on node \"ip-10-0-133-55.ec2.internal\" DevicePath \"\""
Jul 30 00:37:54.903387 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:37:54.903330    2560 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/183f31ef-de6e-4fc2-909d-aeca9eaffee9-plugins-config-volume\") on node \"ip-10-0-133-55.ec2.internal\" DevicePath \"\""
Jul 30 00:37:54.903387 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:37:54.903341    2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-2s7jk\" (UniqueName: \"kubernetes.io/projected/03a58d8d-1508-4837-a5c1-a32ad48d1051-kube-api-access-2s7jk\") on node \"ip-10-0-133-55.ec2.internal\" DevicePath \"\""
Jul 30 00:37:54.903387 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:37:54.903350    2560 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/03a58d8d-1508-4837-a5c1-a32ad48d1051-plugins-config-volume\") on node \"ip-10-0-133-55.ec2.internal\" DevicePath \"\""
Jul 30 00:37:54.917635 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:37:54.917605    2560 generic.go:356] "Generic (PLEG): container finished" podID="03a58d8d-1508-4837-a5c1-a32ad48d1051" containerID="0fd798ddaafefcedf0d98fa2d56d1ca6e7261244334e166c26b579698c942813" exitCode=0
Jul 30 00:37:54.917791 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:37:54.917649    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-mt-8c9d47c1-5758bf646b-xcncx"
Jul 30 00:37:54.917791 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:37:54.917693    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-mt-8c9d47c1-5758bf646b-xcncx" event={"ID":"03a58d8d-1508-4837-a5c1-a32ad48d1051","Type":"ContainerDied","Data":"0fd798ddaafefcedf0d98fa2d56d1ca6e7261244334e166c26b579698c942813"}
Jul 30 00:37:54.917791 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:37:54.917783    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-mt-8c9d47c1-5758bf646b-xcncx" event={"ID":"03a58d8d-1508-4837-a5c1-a32ad48d1051","Type":"ContainerDied","Data":"3bcbf87807948254ab9f29b2b4c1755506a163b1be1ab9661c168e0d8e04294b"}
Jul 30 00:37:54.917958 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:37:54.917814    2560 scope.go:117] "RemoveContainer" containerID="0fd798ddaafefcedf0d98fa2d56d1ca6e7261244334e166c26b579698c942813"
Jul 30 00:37:54.919076 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:37:54.919056    2560 generic.go:356] "Generic (PLEG): container finished" podID="183f31ef-de6e-4fc2-909d-aeca9eaffee9" containerID="6d569e5b94aea048da192b080a1bfd3c5331b88f5e9193ddd5fa70cd0c35297c" exitCode=0
Jul 30 00:37:54.919196 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:37:54.919090    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-mt-8c9d47c1-94b6c8884-6bvlg"
Jul 30 00:37:54.919196 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:37:54.919124    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-mt-8c9d47c1-94b6c8884-6bvlg" event={"ID":"183f31ef-de6e-4fc2-909d-aeca9eaffee9","Type":"ContainerDied","Data":"6d569e5b94aea048da192b080a1bfd3c5331b88f5e9193ddd5fa70cd0c35297c"}
Jul 30 00:37:54.919196 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:37:54.919164    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-mt-8c9d47c1-94b6c8884-6bvlg" event={"ID":"183f31ef-de6e-4fc2-909d-aeca9eaffee9","Type":"ContainerDied","Data":"d05f00e77381f615a3ce81a393b3b0046a4e2715f653b8027fafd5d3e1da516f"}
Jul 30 00:37:54.926305 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:37:54.926287    2560 scope.go:117] "RemoveContainer" containerID="0fd798ddaafefcedf0d98fa2d56d1ca6e7261244334e166c26b579698c942813"
Jul 30 00:37:54.926592 ip-10-0-133-55 kubenswrapper[2560]: E0730 00:37:54.926565    2560 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0fd798ddaafefcedf0d98fa2d56d1ca6e7261244334e166c26b579698c942813\": container with ID starting with 0fd798ddaafefcedf0d98fa2d56d1ca6e7261244334e166c26b579698c942813 not found: ID does not exist" containerID="0fd798ddaafefcedf0d98fa2d56d1ca6e7261244334e166c26b579698c942813"
Jul 30 00:37:54.926697 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:37:54.926603    2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0fd798ddaafefcedf0d98fa2d56d1ca6e7261244334e166c26b579698c942813"} err="failed to get container status \"0fd798ddaafefcedf0d98fa2d56d1ca6e7261244334e166c26b579698c942813\": rpc error: code = NotFound desc = could not find container \"0fd798ddaafefcedf0d98fa2d56d1ca6e7261244334e166c26b579698c942813\": container with ID starting with 0fd798ddaafefcedf0d98fa2d56d1ca6e7261244334e166c26b579698c942813 not found: ID does not exist"
Jul 30 00:37:54.926697 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:37:54.926622    2560 scope.go:117] "RemoveContainer" containerID="6d569e5b94aea048da192b080a1bfd3c5331b88f5e9193ddd5fa70cd0c35297c"
Jul 30 00:37:54.934481 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:37:54.934462    2560 scope.go:117] "RemoveContainer" containerID="6d569e5b94aea048da192b080a1bfd3c5331b88f5e9193ddd5fa70cd0c35297c"
Jul 30 00:37:54.934716 ip-10-0-133-55 kubenswrapper[2560]: E0730 00:37:54.934696    2560 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6d569e5b94aea048da192b080a1bfd3c5331b88f5e9193ddd5fa70cd0c35297c\": container with ID starting with 6d569e5b94aea048da192b080a1bfd3c5331b88f5e9193ddd5fa70cd0c35297c not found: ID does not exist" containerID="6d569e5b94aea048da192b080a1bfd3c5331b88f5e9193ddd5fa70cd0c35297c"
Jul 30 00:37:54.934807 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:37:54.934723    2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6d569e5b94aea048da192b080a1bfd3c5331b88f5e9193ddd5fa70cd0c35297c"} err="failed to get container status \"6d569e5b94aea048da192b080a1bfd3c5331b88f5e9193ddd5fa70cd0c35297c\": rpc error: code = NotFound desc = could not find container \"6d569e5b94aea048da192b080a1bfd3c5331b88f5e9193ddd5fa70cd0c35297c\": container with ID starting with 6d569e5b94aea048da192b080a1bfd3c5331b88f5e9193ddd5fa70cd0c35297c not found: ID does not exist"
Jul 30 00:37:54.941645 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:37:54.941623    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-8c9d47c1-94b6c8884-6bvlg"]
Jul 30 00:37:54.945522 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:37:54.945503    2560 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-8c9d47c1-94b6c8884-6bvlg"]
Jul 30 00:37:54.954755 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:37:54.954734    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-mt-8c9d47c1-5758bf646b-xcncx"]
Jul 30 00:37:54.956714 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:37:54.956696    2560 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-mt-8c9d47c1-5758bf646b-xcncx"]
Jul 30 00:37:55.406046 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:37:55.406012    2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="03a58d8d-1508-4837-a5c1-a32ad48d1051" path="/var/lib/kubelet/pods/03a58d8d-1508-4837-a5c1-a32ad48d1051/volumes"
Jul 30 00:37:55.406539 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:37:55.406520    2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="183f31ef-de6e-4fc2-909d-aeca9eaffee9" path="/var/lib/kubelet/pods/183f31ef-de6e-4fc2-909d-aeca9eaffee9/volumes"
Jul 30 00:38:24.980599 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:38:24.980563    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-99c2ecca-659c669fb-hbldj"]
Jul 30 00:38:24.981028 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:38:24.980935    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="183f31ef-de6e-4fc2-909d-aeca9eaffee9" containerName="payload-pre-processing"
Jul 30 00:38:24.981028 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:38:24.980947    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="183f31ef-de6e-4fc2-909d-aeca9eaffee9" containerName="payload-pre-processing"
Jul 30 00:38:24.981028 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:38:24.980962    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="03a58d8d-1508-4837-a5c1-a32ad48d1051" containerName="payload-processing"
Jul 30 00:38:24.981028 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:38:24.980967    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="03a58d8d-1508-4837-a5c1-a32ad48d1051" containerName="payload-processing"
Jul 30 00:38:24.981028 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:38:24.981029    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="183f31ef-de6e-4fc2-909d-aeca9eaffee9" containerName="payload-pre-processing"
Jul 30 00:38:24.981193 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:38:24.981037    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="03a58d8d-1508-4837-a5c1-a32ad48d1051" containerName="payload-processing"
Jul 30 00:38:24.987679 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:38:24.986583    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-mt-99c2ecca-659c669fb-hbldj"
Jul 30 00:38:24.991048 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:38:24.991022    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-mt-99c2ecca\""
Jul 30 00:38:24.991218 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:38:24.991052    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-mt-99c2ecca-dockercfg-6pw4l\""
Jul 30 00:38:24.992612 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:38:24.992586    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-99c2ecca-659c669fb-hbldj"]
Jul 30 00:38:25.014579 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:38:25.014553    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-mt-99c2ecca-67855c4f78-2jfsm"]
Jul 30 00:38:25.018056 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:38:25.018041    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-mt-99c2ecca-67855c4f78-2jfsm"
Jul 30 00:38:25.028449 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:38:25.028424    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-mt-99c2ecca-67855c4f78-2jfsm"]
Jul 30 00:38:25.059512 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:38:25.059477    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/38e3eec3-e92e-4dfc-b037-aa786729aa8b-plugins-config-volume\") pod \"payload-pre-processing-e2e-mt-99c2ecca-659c669fb-hbldj\" (UID: \"38e3eec3-e92e-4dfc-b037-aa786729aa8b\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-99c2ecca-659c669fb-hbldj"
Jul 30 00:38:25.059677 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:38:25.059529    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5sbtr\" (UniqueName: \"kubernetes.io/projected/38e3eec3-e92e-4dfc-b037-aa786729aa8b-kube-api-access-5sbtr\") pod \"payload-pre-processing-e2e-mt-99c2ecca-659c669fb-hbldj\" (UID: \"38e3eec3-e92e-4dfc-b037-aa786729aa8b\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-99c2ecca-659c669fb-hbldj"
Jul 30 00:38:25.160802 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:38:25.160751    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/38e3eec3-e92e-4dfc-b037-aa786729aa8b-plugins-config-volume\") pod \"payload-pre-processing-e2e-mt-99c2ecca-659c669fb-hbldj\" (UID: \"38e3eec3-e92e-4dfc-b037-aa786729aa8b\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-99c2ecca-659c669fb-hbldj"
Jul 30 00:38:25.161010 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:38:25.160893    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5sbtr\" (UniqueName: \"kubernetes.io/projected/38e3eec3-e92e-4dfc-b037-aa786729aa8b-kube-api-access-5sbtr\") pod \"payload-pre-processing-e2e-mt-99c2ecca-659c669fb-hbldj\" (UID: \"38e3eec3-e92e-4dfc-b037-aa786729aa8b\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-99c2ecca-659c669fb-hbldj"
Jul 30 00:38:25.161010 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:38:25.160949    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/fb3446b9-88de-44ef-807c-2c9038e523ef-plugins-config-volume\") pod \"payload-processing-e2e-mt-99c2ecca-67855c4f78-2jfsm\" (UID: \"fb3446b9-88de-44ef-807c-2c9038e523ef\") " pod="openshift-ingress/payload-processing-e2e-mt-99c2ecca-67855c4f78-2jfsm"
Jul 30 00:38:25.161010 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:38:25.160986    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7s2gb\" (UniqueName: \"kubernetes.io/projected/fb3446b9-88de-44ef-807c-2c9038e523ef-kube-api-access-7s2gb\") pod \"payload-processing-e2e-mt-99c2ecca-67855c4f78-2jfsm\" (UID: \"fb3446b9-88de-44ef-807c-2c9038e523ef\") " pod="openshift-ingress/payload-processing-e2e-mt-99c2ecca-67855c4f78-2jfsm"
Jul 30 00:38:25.161556 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:38:25.161538    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/38e3eec3-e92e-4dfc-b037-aa786729aa8b-plugins-config-volume\") pod \"payload-pre-processing-e2e-mt-99c2ecca-659c669fb-hbldj\" (UID: \"38e3eec3-e92e-4dfc-b037-aa786729aa8b\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-99c2ecca-659c669fb-hbldj"
Jul 30 00:38:25.169480 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:38:25.169458    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5sbtr\" (UniqueName: \"kubernetes.io/projected/38e3eec3-e92e-4dfc-b037-aa786729aa8b-kube-api-access-5sbtr\") pod \"payload-pre-processing-e2e-mt-99c2ecca-659c669fb-hbldj\" (UID: \"38e3eec3-e92e-4dfc-b037-aa786729aa8b\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-99c2ecca-659c669fb-hbldj"
Jul 30 00:38:25.261549 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:38:25.261469    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/fb3446b9-88de-44ef-807c-2c9038e523ef-plugins-config-volume\") pod \"payload-processing-e2e-mt-99c2ecca-67855c4f78-2jfsm\" (UID: \"fb3446b9-88de-44ef-807c-2c9038e523ef\") " pod="openshift-ingress/payload-processing-e2e-mt-99c2ecca-67855c4f78-2jfsm"
Jul 30 00:38:25.261549 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:38:25.261508    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7s2gb\" (UniqueName: \"kubernetes.io/projected/fb3446b9-88de-44ef-807c-2c9038e523ef-kube-api-access-7s2gb\") pod \"payload-processing-e2e-mt-99c2ecca-67855c4f78-2jfsm\" (UID: \"fb3446b9-88de-44ef-807c-2c9038e523ef\") " pod="openshift-ingress/payload-processing-e2e-mt-99c2ecca-67855c4f78-2jfsm"
Jul 30 00:38:25.262146 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:38:25.262127    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/fb3446b9-88de-44ef-807c-2c9038e523ef-plugins-config-volume\") pod \"payload-processing-e2e-mt-99c2ecca-67855c4f78-2jfsm\" (UID: \"fb3446b9-88de-44ef-807c-2c9038e523ef\") " pod="openshift-ingress/payload-processing-e2e-mt-99c2ecca-67855c4f78-2jfsm"
Jul 30 00:38:25.269399 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:38:25.269370    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7s2gb\" (UniqueName: \"kubernetes.io/projected/fb3446b9-88de-44ef-807c-2c9038e523ef-kube-api-access-7s2gb\") pod \"payload-processing-e2e-mt-99c2ecca-67855c4f78-2jfsm\" (UID: \"fb3446b9-88de-44ef-807c-2c9038e523ef\") " pod="openshift-ingress/payload-processing-e2e-mt-99c2ecca-67855c4f78-2jfsm"
Jul 30 00:38:25.300250 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:38:25.300220    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-mt-99c2ecca-659c669fb-hbldj"
Jul 30 00:38:25.329840 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:38:25.329809    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-mt-99c2ecca-67855c4f78-2jfsm"
Jul 30 00:38:25.453638 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:38:25.453611    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-99c2ecca-659c669fb-hbldj"]
Jul 30 00:38:25.456281 ip-10-0-133-55 kubenswrapper[2560]: W0730 00:38:25.456247    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod38e3eec3_e92e_4dfc_b037_aa786729aa8b.slice/crio-6756a2e2612c046e52a18429252aca123f864c961523b5fb3913e7bd8e2efa5a WatchSource:0}: Error finding container 6756a2e2612c046e52a18429252aca123f864c961523b5fb3913e7bd8e2efa5a: Status 404 returned error can't find the container with id 6756a2e2612c046e52a18429252aca123f864c961523b5fb3913e7bd8e2efa5a
Jul 30 00:38:25.488085 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:38:25.488064    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-mt-99c2ecca-67855c4f78-2jfsm"]
Jul 30 00:38:25.492411 ip-10-0-133-55 kubenswrapper[2560]: W0730 00:38:25.492390    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfb3446b9_88de_44ef_807c_2c9038e523ef.slice/crio-fef5786a72bb867a8ab362f99e5278d891c0d367aa92a433c80543edd12738b3 WatchSource:0}: Error finding container fef5786a72bb867a8ab362f99e5278d891c0d367aa92a433c80543edd12738b3: Status 404 returned error can't find the container with id fef5786a72bb867a8ab362f99e5278d891c0d367aa92a433c80543edd12738b3
Jul 30 00:38:26.074541 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:38:26.074500    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-mt-99c2ecca-659c669fb-hbldj" event={"ID":"38e3eec3-e92e-4dfc-b037-aa786729aa8b","Type":"ContainerStarted","Data":"147f5838050bd3cb4cdac0dc71fccdab8b1867a02f6af4e9b522bcb13c596144"}
Jul 30 00:38:26.075024 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:38:26.074675    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-mt-99c2ecca-659c669fb-hbldj"
Jul 30 00:38:26.075024 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:38:26.074715    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-mt-99c2ecca-659c669fb-hbldj" event={"ID":"38e3eec3-e92e-4dfc-b037-aa786729aa8b","Type":"ContainerStarted","Data":"6756a2e2612c046e52a18429252aca123f864c961523b5fb3913e7bd8e2efa5a"}
Jul 30 00:38:26.076186 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:38:26.076165    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-mt-99c2ecca-67855c4f78-2jfsm" event={"ID":"fb3446b9-88de-44ef-807c-2c9038e523ef","Type":"ContainerStarted","Data":"f52abbc0b8861f4b385a35ac8a3a36792b30de8c9e92ca9f96c067df70e18b46"}
Jul 30 00:38:26.076285 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:38:26.076201    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-mt-99c2ecca-67855c4f78-2jfsm" event={"ID":"fb3446b9-88de-44ef-807c-2c9038e523ef","Type":"ContainerStarted","Data":"fef5786a72bb867a8ab362f99e5278d891c0d367aa92a433c80543edd12738b3"}
Jul 30 00:38:26.076285 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:38:26.076257    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-mt-99c2ecca-67855c4f78-2jfsm"
Jul 30 00:38:26.091262 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:38:26.091222    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-mt-99c2ecca-659c669fb-hbldj" podStartSLOduration=2.091209078 podStartE2EDuration="2.091209078s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-30 00:38:24 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 00:38:26.08886629 +0000 UTC m=+2193.148083095" watchObservedRunningTime="2026-07-30 00:38:26.091209078 +0000 UTC m=+2193.150425881"
Jul 30 00:38:26.106013 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:38:26.105956    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-mt-99c2ecca-67855c4f78-2jfsm" podStartSLOduration=2.105941486 podStartE2EDuration="2.105941486s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-30 00:38:24 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 00:38:26.104221866 +0000 UTC m=+2193.163438670" watchObservedRunningTime="2026-07-30 00:38:26.105941486 +0000 UTC m=+2193.165158289"
Jul 30 00:38:37.083556 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:38:37.083515    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-mt-99c2ecca-659c669fb-hbldj"
Jul 30 00:38:37.084016 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:38:37.083842    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-mt-99c2ecca-67855c4f78-2jfsm"
Jul 30 00:38:56.997847 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:38:56.997814    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-mt-99c2ecca/e2e-lifecycle-model-99c2ecca-kserve-5d87465799-6pxq6"]
Jul 30 00:38:57.002635 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:38:57.002618    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-mt-99c2ecca/e2e-lifecycle-model-99c2ecca-kserve-5d87465799-6pxq6"
Jul 30 00:38:57.006914 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:38:57.006886    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-mt-99c2ecca\"/\"openshift-service-ca.crt\""
Jul 30 00:38:57.007607 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:38:57.007584    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-mt-99c2ecca\"/\"e2e-lifecycle-model-99c2ecca-kserve-self-signed-certs\""
Jul 30 00:38:57.007824 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:38:57.007802    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-mt-99c2ecca\"/\"kube-root-ca.crt\""
Jul 30 00:38:57.007966 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:38:57.007947    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-mt-99c2ecca\"/\"default-dockercfg-m8qmn\""
Jul 30 00:38:57.009241 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:38:57.009217    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-mt-99c2ecca/e2e-lifecycle-model-99c2ecca-kserve-5d87465799-6pxq6"]
Jul 30 00:38:57.049966 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:38:57.049918    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f60b503e-fa64-4a3a-8d6d-2d4867259f3a-tmp-dir\") pod \"e2e-lifecycle-model-99c2ecca-kserve-5d87465799-6pxq6\" (UID: \"f60b503e-fa64-4a3a-8d6d-2d4867259f3a\") " pod="ai-tenant-e2e-mt-99c2ecca/e2e-lifecycle-model-99c2ecca-kserve-5d87465799-6pxq6"
Jul 30 00:38:57.050107 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:38:57.049982    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/f60b503e-fa64-4a3a-8d6d-2d4867259f3a-model-cache\") pod \"e2e-lifecycle-model-99c2ecca-kserve-5d87465799-6pxq6\" (UID: \"f60b503e-fa64-4a3a-8d6d-2d4867259f3a\") " pod="ai-tenant-e2e-mt-99c2ecca/e2e-lifecycle-model-99c2ecca-kserve-5d87465799-6pxq6"
Jul 30 00:38:57.050107 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:38:57.050039    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dgfv7\" (UniqueName: \"kubernetes.io/projected/f60b503e-fa64-4a3a-8d6d-2d4867259f3a-kube-api-access-dgfv7\") pod \"e2e-lifecycle-model-99c2ecca-kserve-5d87465799-6pxq6\" (UID: \"f60b503e-fa64-4a3a-8d6d-2d4867259f3a\") " pod="ai-tenant-e2e-mt-99c2ecca/e2e-lifecycle-model-99c2ecca-kserve-5d87465799-6pxq6"
Jul 30 00:38:57.050107 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:38:57.050068    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/f60b503e-fa64-4a3a-8d6d-2d4867259f3a-home\") pod \"e2e-lifecycle-model-99c2ecca-kserve-5d87465799-6pxq6\" (UID: \"f60b503e-fa64-4a3a-8d6d-2d4867259f3a\") " pod="ai-tenant-e2e-mt-99c2ecca/e2e-lifecycle-model-99c2ecca-kserve-5d87465799-6pxq6"
Jul 30 00:38:57.050220 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:38:57.050110    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/f60b503e-fa64-4a3a-8d6d-2d4867259f3a-dshm\") pod \"e2e-lifecycle-model-99c2ecca-kserve-5d87465799-6pxq6\" (UID: \"f60b503e-fa64-4a3a-8d6d-2d4867259f3a\") " pod="ai-tenant-e2e-mt-99c2ecca/e2e-lifecycle-model-99c2ecca-kserve-5d87465799-6pxq6"
Jul 30 00:38:57.050220 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:38:57.050189    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f60b503e-fa64-4a3a-8d6d-2d4867259f3a-tls-certs\") pod \"e2e-lifecycle-model-99c2ecca-kserve-5d87465799-6pxq6\" (UID: \"f60b503e-fa64-4a3a-8d6d-2d4867259f3a\") " pod="ai-tenant-e2e-mt-99c2ecca/e2e-lifecycle-model-99c2ecca-kserve-5d87465799-6pxq6"
Jul 30 00:38:57.151079 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:38:57.151049    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dgfv7\" (UniqueName: \"kubernetes.io/projected/f60b503e-fa64-4a3a-8d6d-2d4867259f3a-kube-api-access-dgfv7\") pod \"e2e-lifecycle-model-99c2ecca-kserve-5d87465799-6pxq6\" (UID: \"f60b503e-fa64-4a3a-8d6d-2d4867259f3a\") " pod="ai-tenant-e2e-mt-99c2ecca/e2e-lifecycle-model-99c2ecca-kserve-5d87465799-6pxq6"
Jul 30 00:38:57.151253 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:38:57.151084    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/f60b503e-fa64-4a3a-8d6d-2d4867259f3a-home\") pod \"e2e-lifecycle-model-99c2ecca-kserve-5d87465799-6pxq6\" (UID: \"f60b503e-fa64-4a3a-8d6d-2d4867259f3a\") " pod="ai-tenant-e2e-mt-99c2ecca/e2e-lifecycle-model-99c2ecca-kserve-5d87465799-6pxq6"
Jul 30 00:38:57.151253 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:38:57.151135    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/f60b503e-fa64-4a3a-8d6d-2d4867259f3a-dshm\") pod \"e2e-lifecycle-model-99c2ecca-kserve-5d87465799-6pxq6\" (UID: \"f60b503e-fa64-4a3a-8d6d-2d4867259f3a\") " pod="ai-tenant-e2e-mt-99c2ecca/e2e-lifecycle-model-99c2ecca-kserve-5d87465799-6pxq6"
Jul 30 00:38:57.151253 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:38:57.151171    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f60b503e-fa64-4a3a-8d6d-2d4867259f3a-tls-certs\") pod \"e2e-lifecycle-model-99c2ecca-kserve-5d87465799-6pxq6\" (UID: \"f60b503e-fa64-4a3a-8d6d-2d4867259f3a\") " pod="ai-tenant-e2e-mt-99c2ecca/e2e-lifecycle-model-99c2ecca-kserve-5d87465799-6pxq6"
Jul 30 00:38:57.151253 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:38:57.151225    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f60b503e-fa64-4a3a-8d6d-2d4867259f3a-tmp-dir\") pod \"e2e-lifecycle-model-99c2ecca-kserve-5d87465799-6pxq6\" (UID: \"f60b503e-fa64-4a3a-8d6d-2d4867259f3a\") " pod="ai-tenant-e2e-mt-99c2ecca/e2e-lifecycle-model-99c2ecca-kserve-5d87465799-6pxq6"
Jul 30 00:38:57.151474 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:38:57.151280    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/f60b503e-fa64-4a3a-8d6d-2d4867259f3a-model-cache\") pod \"e2e-lifecycle-model-99c2ecca-kserve-5d87465799-6pxq6\" (UID: \"f60b503e-fa64-4a3a-8d6d-2d4867259f3a\") " pod="ai-tenant-e2e-mt-99c2ecca/e2e-lifecycle-model-99c2ecca-kserve-5d87465799-6pxq6"
Jul 30 00:38:57.151636 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:38:57.151617    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/f60b503e-fa64-4a3a-8d6d-2d4867259f3a-home\") pod \"e2e-lifecycle-model-99c2ecca-kserve-5d87465799-6pxq6\" (UID: \"f60b503e-fa64-4a3a-8d6d-2d4867259f3a\") " pod="ai-tenant-e2e-mt-99c2ecca/e2e-lifecycle-model-99c2ecca-kserve-5d87465799-6pxq6"
Jul 30 00:38:57.151693 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:38:57.151680    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f60b503e-fa64-4a3a-8d6d-2d4867259f3a-tmp-dir\") pod \"e2e-lifecycle-model-99c2ecca-kserve-5d87465799-6pxq6\" (UID: \"f60b503e-fa64-4a3a-8d6d-2d4867259f3a\") " pod="ai-tenant-e2e-mt-99c2ecca/e2e-lifecycle-model-99c2ecca-kserve-5d87465799-6pxq6"
Jul 30 00:38:57.151747 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:38:57.151698    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/f60b503e-fa64-4a3a-8d6d-2d4867259f3a-model-cache\") pod \"e2e-lifecycle-model-99c2ecca-kserve-5d87465799-6pxq6\" (UID: \"f60b503e-fa64-4a3a-8d6d-2d4867259f3a\") " pod="ai-tenant-e2e-mt-99c2ecca/e2e-lifecycle-model-99c2ecca-kserve-5d87465799-6pxq6"
Jul 30 00:38:57.153433 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:38:57.153414    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/f60b503e-fa64-4a3a-8d6d-2d4867259f3a-dshm\") pod \"e2e-lifecycle-model-99c2ecca-kserve-5d87465799-6pxq6\" (UID: \"f60b503e-fa64-4a3a-8d6d-2d4867259f3a\") " pod="ai-tenant-e2e-mt-99c2ecca/e2e-lifecycle-model-99c2ecca-kserve-5d87465799-6pxq6"
Jul 30 00:38:57.153685 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:38:57.153669    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f60b503e-fa64-4a3a-8d6d-2d4867259f3a-tls-certs\") pod \"e2e-lifecycle-model-99c2ecca-kserve-5d87465799-6pxq6\" (UID: \"f60b503e-fa64-4a3a-8d6d-2d4867259f3a\") " pod="ai-tenant-e2e-mt-99c2ecca/e2e-lifecycle-model-99c2ecca-kserve-5d87465799-6pxq6"
Jul 30 00:38:57.159052 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:38:57.159032    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dgfv7\" (UniqueName: \"kubernetes.io/projected/f60b503e-fa64-4a3a-8d6d-2d4867259f3a-kube-api-access-dgfv7\") pod \"e2e-lifecycle-model-99c2ecca-kserve-5d87465799-6pxq6\" (UID: \"f60b503e-fa64-4a3a-8d6d-2d4867259f3a\") " pod="ai-tenant-e2e-mt-99c2ecca/e2e-lifecycle-model-99c2ecca-kserve-5d87465799-6pxq6"
Jul 30 00:38:57.312788 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:38:57.312709    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-mt-99c2ecca/e2e-lifecycle-model-99c2ecca-kserve-5d87465799-6pxq6"
Jul 30 00:38:57.443761 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:38:57.443736    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-mt-99c2ecca/e2e-lifecycle-model-99c2ecca-kserve-5d87465799-6pxq6"]
Jul 30 00:38:57.445624 ip-10-0-133-55 kubenswrapper[2560]: W0730 00:38:57.445598    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podf60b503e_fa64_4a3a_8d6d_2d4867259f3a.slice/crio-eaf168e98c78f0537705a3d4f3b55774463c624614c871abd6788c1684da29d6 WatchSource:0}: Error finding container eaf168e98c78f0537705a3d4f3b55774463c624614c871abd6788c1684da29d6: Status 404 returned error can't find the container with id eaf168e98c78f0537705a3d4f3b55774463c624614c871abd6788c1684da29d6
Jul 30 00:38:58.235575 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:38:58.235538    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-mt-99c2ecca/e2e-lifecycle-model-99c2ecca-kserve-5d87465799-6pxq6" event={"ID":"f60b503e-fa64-4a3a-8d6d-2d4867259f3a","Type":"ContainerStarted","Data":"50535ffcf2d24d696d10b06bc29e2760850a239cfe6c574817b3a739c478a5a3"}
Jul 30 00:38:58.235954 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:38:58.235584    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-mt-99c2ecca/e2e-lifecycle-model-99c2ecca-kserve-5d87465799-6pxq6" event={"ID":"f60b503e-fa64-4a3a-8d6d-2d4867259f3a","Type":"ContainerStarted","Data":"eaf168e98c78f0537705a3d4f3b55774463c624614c871abd6788c1684da29d6"}
Jul 30 00:38:58.253452 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:38:58.253406    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-mt-99c2ecca/e2e-lifecycle-model-99c2ecca-kserve-5d87465799-6pxq6" podStartSLOduration=2.253391 podStartE2EDuration="2.253391s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-30 00:38:56 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 00:38:58.252290556 +0000 UTC m=+2225.311507360" watchObservedRunningTime="2026-07-30 00:38:58.253391 +0000 UTC m=+2225.312607803"
Jul 30 00:39:07.312859 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:39:07.312827    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-mt-99c2ecca/e2e-lifecycle-model-99c2ecca-kserve-5d87465799-6pxq6"
Jul 30 00:39:07.313256 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:39:07.313121    2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-mt-99c2ecca/e2e-lifecycle-model-99c2ecca-kserve-5d87465799-6pxq6"
Jul 30 00:39:07.327002 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:39:07.326970    2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-mt-99c2ecca/e2e-lifecycle-model-99c2ecca-kserve-5d87465799-6pxq6"
Jul 30 00:39:08.293156 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:39:08.293120    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-mt-99c2ecca/e2e-lifecycle-model-99c2ecca-kserve-5d87465799-6pxq6"
Jul 30 00:39:32.729718 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:39:32.729684    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-mt-99c2ecca-67855c4f78-2jfsm"]
Jul 30 00:39:32.730354 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:39:32.729903    2560 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-mt-99c2ecca-67855c4f78-2jfsm" podUID="fb3446b9-88de-44ef-807c-2c9038e523ef" containerName="payload-processing" containerID="cri-o://f52abbc0b8861f4b385a35ac8a3a36792b30de8c9e92ca9f96c067df70e18b46" gracePeriod=30
Jul 30 00:39:32.737130 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:39:32.737104    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-99c2ecca-659c669fb-hbldj"]
Jul 30 00:39:32.737416 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:39:32.737387    2560 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-mt-99c2ecca-659c669fb-hbldj" podUID="38e3eec3-e92e-4dfc-b037-aa786729aa8b" containerName="payload-pre-processing" containerID="cri-o://147f5838050bd3cb4cdac0dc71fccdab8b1867a02f6af4e9b522bcb13c596144" gracePeriod=30
Jul 30 00:39:33.009017 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:39:33.008994    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-mt-99c2ecca-67855c4f78-2jfsm"
Jul 30 00:39:33.011731 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:39:33.011710    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-mt-99c2ecca-659c669fb-hbldj"
Jul 30 00:39:33.070242 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:39:33.070213    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/38e3eec3-e92e-4dfc-b037-aa786729aa8b-plugins-config-volume\") pod \"38e3eec3-e92e-4dfc-b037-aa786729aa8b\" (UID: \"38e3eec3-e92e-4dfc-b037-aa786729aa8b\") "
Jul 30 00:39:33.070411 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:39:33.070277    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/fb3446b9-88de-44ef-807c-2c9038e523ef-plugins-config-volume\") pod \"fb3446b9-88de-44ef-807c-2c9038e523ef\" (UID: \"fb3446b9-88de-44ef-807c-2c9038e523ef\") "
Jul 30 00:39:33.070411 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:39:33.070369    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-5sbtr\" (UniqueName: \"kubernetes.io/projected/38e3eec3-e92e-4dfc-b037-aa786729aa8b-kube-api-access-5sbtr\") pod \"38e3eec3-e92e-4dfc-b037-aa786729aa8b\" (UID: \"38e3eec3-e92e-4dfc-b037-aa786729aa8b\") "
Jul 30 00:39:33.070411 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:39:33.070391    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-7s2gb\" (UniqueName: \"kubernetes.io/projected/fb3446b9-88de-44ef-807c-2c9038e523ef-kube-api-access-7s2gb\") pod \"fb3446b9-88de-44ef-807c-2c9038e523ef\" (UID: \"fb3446b9-88de-44ef-807c-2c9038e523ef\") "
Jul 30 00:39:33.070523 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:39:33.070437    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/38e3eec3-e92e-4dfc-b037-aa786729aa8b-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "38e3eec3-e92e-4dfc-b037-aa786729aa8b" (UID: "38e3eec3-e92e-4dfc-b037-aa786729aa8b"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 30 00:39:33.070632 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:39:33.070619    2560 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/38e3eec3-e92e-4dfc-b037-aa786729aa8b-plugins-config-volume\") on node \"ip-10-0-133-55.ec2.internal\" DevicePath \"\""
Jul 30 00:39:33.070682 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:39:33.070661    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/fb3446b9-88de-44ef-807c-2c9038e523ef-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "fb3446b9-88de-44ef-807c-2c9038e523ef" (UID: "fb3446b9-88de-44ef-807c-2c9038e523ef"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 30 00:39:33.072415 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:39:33.072386    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/fb3446b9-88de-44ef-807c-2c9038e523ef-kube-api-access-7s2gb" (OuterVolumeSpecName: "kube-api-access-7s2gb") pod "fb3446b9-88de-44ef-807c-2c9038e523ef" (UID: "fb3446b9-88de-44ef-807c-2c9038e523ef"). InnerVolumeSpecName "kube-api-access-7s2gb". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 30 00:39:33.072531 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:39:33.072446    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/38e3eec3-e92e-4dfc-b037-aa786729aa8b-kube-api-access-5sbtr" (OuterVolumeSpecName: "kube-api-access-5sbtr") pod "38e3eec3-e92e-4dfc-b037-aa786729aa8b" (UID: "38e3eec3-e92e-4dfc-b037-aa786729aa8b"). InnerVolumeSpecName "kube-api-access-5sbtr". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 30 00:39:33.171528 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:39:33.171487    2560 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/fb3446b9-88de-44ef-807c-2c9038e523ef-plugins-config-volume\") on node \"ip-10-0-133-55.ec2.internal\" DevicePath \"\""
Jul 30 00:39:33.171528 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:39:33.171523    2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-5sbtr\" (UniqueName: \"kubernetes.io/projected/38e3eec3-e92e-4dfc-b037-aa786729aa8b-kube-api-access-5sbtr\") on node \"ip-10-0-133-55.ec2.internal\" DevicePath \"\""
Jul 30 00:39:33.171528 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:39:33.171533    2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-7s2gb\" (UniqueName: \"kubernetes.io/projected/fb3446b9-88de-44ef-807c-2c9038e523ef-kube-api-access-7s2gb\") on node \"ip-10-0-133-55.ec2.internal\" DevicePath \"\""
Jul 30 00:39:33.407820 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:39:33.407781    2560 generic.go:356] "Generic (PLEG): container finished" podID="38e3eec3-e92e-4dfc-b037-aa786729aa8b" containerID="147f5838050bd3cb4cdac0dc71fccdab8b1867a02f6af4e9b522bcb13c596144" exitCode=0
Jul 30 00:39:33.408016 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:39:33.407825    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-mt-99c2ecca-659c669fb-hbldj"
Jul 30 00:39:33.408016 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:39:33.407865    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-mt-99c2ecca-659c669fb-hbldj" event={"ID":"38e3eec3-e92e-4dfc-b037-aa786729aa8b","Type":"ContainerDied","Data":"147f5838050bd3cb4cdac0dc71fccdab8b1867a02f6af4e9b522bcb13c596144"}
Jul 30 00:39:33.408016 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:39:33.407912    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-mt-99c2ecca-659c669fb-hbldj" event={"ID":"38e3eec3-e92e-4dfc-b037-aa786729aa8b","Type":"ContainerDied","Data":"6756a2e2612c046e52a18429252aca123f864c961523b5fb3913e7bd8e2efa5a"}
Jul 30 00:39:33.408016 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:39:33.407940    2560 scope.go:117] "RemoveContainer" containerID="147f5838050bd3cb4cdac0dc71fccdab8b1867a02f6af4e9b522bcb13c596144"
Jul 30 00:39:33.409294 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:39:33.409272    2560 generic.go:356] "Generic (PLEG): container finished" podID="fb3446b9-88de-44ef-807c-2c9038e523ef" containerID="f52abbc0b8861f4b385a35ac8a3a36792b30de8c9e92ca9f96c067df70e18b46" exitCode=0
Jul 30 00:39:33.409416 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:39:33.409297    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-mt-99c2ecca-67855c4f78-2jfsm" event={"ID":"fb3446b9-88de-44ef-807c-2c9038e523ef","Type":"ContainerDied","Data":"f52abbc0b8861f4b385a35ac8a3a36792b30de8c9e92ca9f96c067df70e18b46"}
Jul 30 00:39:33.409416 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:39:33.409359    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-mt-99c2ecca-67855c4f78-2jfsm" event={"ID":"fb3446b9-88de-44ef-807c-2c9038e523ef","Type":"ContainerDied","Data":"fef5786a72bb867a8ab362f99e5278d891c0d367aa92a433c80543edd12738b3"}
Jul 30 00:39:33.409527 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:39:33.409416    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-mt-99c2ecca-67855c4f78-2jfsm"
Jul 30 00:39:33.418658 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:39:33.418620    2560 scope.go:117] "RemoveContainer" containerID="147f5838050bd3cb4cdac0dc71fccdab8b1867a02f6af4e9b522bcb13c596144"
Jul 30 00:39:33.418919 ip-10-0-133-55 kubenswrapper[2560]: E0730 00:39:33.418896    2560 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"147f5838050bd3cb4cdac0dc71fccdab8b1867a02f6af4e9b522bcb13c596144\": container with ID starting with 147f5838050bd3cb4cdac0dc71fccdab8b1867a02f6af4e9b522bcb13c596144 not found: ID does not exist" containerID="147f5838050bd3cb4cdac0dc71fccdab8b1867a02f6af4e9b522bcb13c596144"
Jul 30 00:39:33.419033 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:39:33.418924    2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"147f5838050bd3cb4cdac0dc71fccdab8b1867a02f6af4e9b522bcb13c596144"} err="failed to get container status \"147f5838050bd3cb4cdac0dc71fccdab8b1867a02f6af4e9b522bcb13c596144\": rpc error: code = NotFound desc = could not find container \"147f5838050bd3cb4cdac0dc71fccdab8b1867a02f6af4e9b522bcb13c596144\": container with ID starting with 147f5838050bd3cb4cdac0dc71fccdab8b1867a02f6af4e9b522bcb13c596144 not found: ID does not exist"
Jul 30 00:39:33.419033 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:39:33.418939    2560 scope.go:117] "RemoveContainer" containerID="f52abbc0b8861f4b385a35ac8a3a36792b30de8c9e92ca9f96c067df70e18b46"
Jul 30 00:39:33.427224 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:39:33.427207    2560 scope.go:117] "RemoveContainer" containerID="f52abbc0b8861f4b385a35ac8a3a36792b30de8c9e92ca9f96c067df70e18b46"
Jul 30 00:39:33.427478 ip-10-0-133-55 kubenswrapper[2560]: E0730 00:39:33.427459    2560 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f52abbc0b8861f4b385a35ac8a3a36792b30de8c9e92ca9f96c067df70e18b46\": container with ID starting with f52abbc0b8861f4b385a35ac8a3a36792b30de8c9e92ca9f96c067df70e18b46 not found: ID does not exist" containerID="f52abbc0b8861f4b385a35ac8a3a36792b30de8c9e92ca9f96c067df70e18b46"
Jul 30 00:39:33.427536 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:39:33.427484    2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f52abbc0b8861f4b385a35ac8a3a36792b30de8c9e92ca9f96c067df70e18b46"} err="failed to get container status \"f52abbc0b8861f4b385a35ac8a3a36792b30de8c9e92ca9f96c067df70e18b46\": rpc error: code = NotFound desc = could not find container \"f52abbc0b8861f4b385a35ac8a3a36792b30de8c9e92ca9f96c067df70e18b46\": container with ID starting with f52abbc0b8861f4b385a35ac8a3a36792b30de8c9e92ca9f96c067df70e18b46 not found: ID does not exist"
Jul 30 00:39:33.437109 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:39:33.437088    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-99c2ecca-659c669fb-hbldj"]
Jul 30 00:39:33.440730 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:39:33.440710    2560 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-99c2ecca-659c669fb-hbldj"]
Jul 30 00:39:33.450341 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:39:33.450301    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-mt-99c2ecca-67855c4f78-2jfsm"]
Jul 30 00:39:33.455409 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:39:33.455391    2560 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-mt-99c2ecca-67855c4f78-2jfsm"]
Jul 30 00:39:35.405651 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:39:35.405613    2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="38e3eec3-e92e-4dfc-b037-aa786729aa8b" path="/var/lib/kubelet/pods/38e3eec3-e92e-4dfc-b037-aa786729aa8b/volumes"
Jul 30 00:39:35.406120 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:39:35.405979    2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="fb3446b9-88de-44ef-807c-2c9038e523ef" path="/var/lib/kubelet/pods/fb3446b9-88de-44ef-807c-2c9038e523ef/volumes"
Jul 30 00:39:41.023576 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:39:41.023541    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-mt-99c2ecca/e2e-lifecycle-model-99c2ecca-kserve-5d87465799-6pxq6"]
Jul 30 00:39:56.042465 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:39:56.042405    2560 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-mt-99c2ecca/e2e-lifecycle-model-99c2ecca-kserve-5d87465799-6pxq6" podUID="f60b503e-fa64-4a3a-8d6d-2d4867259f3a" containerName="main" containerID="cri-o://50535ffcf2d24d696d10b06bc29e2760850a239cfe6c574817b3a739c478a5a3" gracePeriod=45
Jul 30 00:39:56.301709 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:39:56.301652    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-mt-99c2ecca/e2e-lifecycle-model-99c2ecca-kserve-5d87465799-6pxq6"
Jul 30 00:39:56.384304 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:39:56.384272    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/f60b503e-fa64-4a3a-8d6d-2d4867259f3a-dshm\") pod \"f60b503e-fa64-4a3a-8d6d-2d4867259f3a\" (UID: \"f60b503e-fa64-4a3a-8d6d-2d4867259f3a\") "
Jul 30 00:39:56.384506 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:39:56.384355    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f60b503e-fa64-4a3a-8d6d-2d4867259f3a-tmp-dir\") pod \"f60b503e-fa64-4a3a-8d6d-2d4867259f3a\" (UID: \"f60b503e-fa64-4a3a-8d6d-2d4867259f3a\") "
Jul 30 00:39:56.384506 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:39:56.384386    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/f60b503e-fa64-4a3a-8d6d-2d4867259f3a-home\") pod \"f60b503e-fa64-4a3a-8d6d-2d4867259f3a\" (UID: \"f60b503e-fa64-4a3a-8d6d-2d4867259f3a\") "
Jul 30 00:39:56.384506 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:39:56.384418    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f60b503e-fa64-4a3a-8d6d-2d4867259f3a-tls-certs\") pod \"f60b503e-fa64-4a3a-8d6d-2d4867259f3a\" (UID: \"f60b503e-fa64-4a3a-8d6d-2d4867259f3a\") "
Jul 30 00:39:56.384506 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:39:56.384461    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-dgfv7\" (UniqueName: \"kubernetes.io/projected/f60b503e-fa64-4a3a-8d6d-2d4867259f3a-kube-api-access-dgfv7\") pod \"f60b503e-fa64-4a3a-8d6d-2d4867259f3a\" (UID: \"f60b503e-fa64-4a3a-8d6d-2d4867259f3a\") "
Jul 30 00:39:56.384716 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:39:56.384515    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/f60b503e-fa64-4a3a-8d6d-2d4867259f3a-model-cache\") pod \"f60b503e-fa64-4a3a-8d6d-2d4867259f3a\" (UID: \"f60b503e-fa64-4a3a-8d6d-2d4867259f3a\") "
Jul 30 00:39:56.384716 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:39:56.384641    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f60b503e-fa64-4a3a-8d6d-2d4867259f3a-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "f60b503e-fa64-4a3a-8d6d-2d4867259f3a" (UID: "f60b503e-fa64-4a3a-8d6d-2d4867259f3a"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 30 00:39:56.384716 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:39:56.384656    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f60b503e-fa64-4a3a-8d6d-2d4867259f3a-home" (OuterVolumeSpecName: "home") pod "f60b503e-fa64-4a3a-8d6d-2d4867259f3a" (UID: "f60b503e-fa64-4a3a-8d6d-2d4867259f3a"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 30 00:39:56.384843 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:39:56.384826    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f60b503e-fa64-4a3a-8d6d-2d4867259f3a-model-cache" (OuterVolumeSpecName: "model-cache") pod "f60b503e-fa64-4a3a-8d6d-2d4867259f3a" (UID: "f60b503e-fa64-4a3a-8d6d-2d4867259f3a"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 30 00:39:56.384904 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:39:56.384888    2560 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f60b503e-fa64-4a3a-8d6d-2d4867259f3a-tmp-dir\") on node \"ip-10-0-133-55.ec2.internal\" DevicePath \"\""
Jul 30 00:39:56.384904 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:39:56.384903    2560 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/f60b503e-fa64-4a3a-8d6d-2d4867259f3a-home\") on node \"ip-10-0-133-55.ec2.internal\" DevicePath \"\""
Jul 30 00:39:56.386573 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:39:56.386543    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f60b503e-fa64-4a3a-8d6d-2d4867259f3a-dshm" (OuterVolumeSpecName: "dshm") pod "f60b503e-fa64-4a3a-8d6d-2d4867259f3a" (UID: "f60b503e-fa64-4a3a-8d6d-2d4867259f3a"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 30 00:39:56.386573 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:39:56.386540    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f60b503e-fa64-4a3a-8d6d-2d4867259f3a-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "f60b503e-fa64-4a3a-8d6d-2d4867259f3a" (UID: "f60b503e-fa64-4a3a-8d6d-2d4867259f3a"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 30 00:39:56.386714 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:39:56.386590    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f60b503e-fa64-4a3a-8d6d-2d4867259f3a-kube-api-access-dgfv7" (OuterVolumeSpecName: "kube-api-access-dgfv7") pod "f60b503e-fa64-4a3a-8d6d-2d4867259f3a" (UID: "f60b503e-fa64-4a3a-8d6d-2d4867259f3a"). InnerVolumeSpecName "kube-api-access-dgfv7". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 30 00:39:56.485935 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:39:56.485903    2560 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/f60b503e-fa64-4a3a-8d6d-2d4867259f3a-dshm\") on node \"ip-10-0-133-55.ec2.internal\" DevicePath \"\""
Jul 30 00:39:56.485935 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:39:56.485934    2560 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f60b503e-fa64-4a3a-8d6d-2d4867259f3a-tls-certs\") on node \"ip-10-0-133-55.ec2.internal\" DevicePath \"\""
Jul 30 00:39:56.486138 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:39:56.485949    2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-dgfv7\" (UniqueName: \"kubernetes.io/projected/f60b503e-fa64-4a3a-8d6d-2d4867259f3a-kube-api-access-dgfv7\") on node \"ip-10-0-133-55.ec2.internal\" DevicePath \"\""
Jul 30 00:39:56.486138 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:39:56.485962    2560 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/f60b503e-fa64-4a3a-8d6d-2d4867259f3a-model-cache\") on node \"ip-10-0-133-55.ec2.internal\" DevicePath \"\""
Jul 30 00:39:56.524066 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:39:56.524030    2560 generic.go:356] "Generic (PLEG): container finished" podID="f60b503e-fa64-4a3a-8d6d-2d4867259f3a" containerID="50535ffcf2d24d696d10b06bc29e2760850a239cfe6c574817b3a739c478a5a3" exitCode=0
Jul 30 00:39:56.524230 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:39:56.524076    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-mt-99c2ecca/e2e-lifecycle-model-99c2ecca-kserve-5d87465799-6pxq6"
Jul 30 00:39:56.524230 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:39:56.524109    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-mt-99c2ecca/e2e-lifecycle-model-99c2ecca-kserve-5d87465799-6pxq6" event={"ID":"f60b503e-fa64-4a3a-8d6d-2d4867259f3a","Type":"ContainerDied","Data":"50535ffcf2d24d696d10b06bc29e2760850a239cfe6c574817b3a739c478a5a3"}
Jul 30 00:39:56.524230 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:39:56.524154    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-mt-99c2ecca/e2e-lifecycle-model-99c2ecca-kserve-5d87465799-6pxq6" event={"ID":"f60b503e-fa64-4a3a-8d6d-2d4867259f3a","Type":"ContainerDied","Data":"eaf168e98c78f0537705a3d4f3b55774463c624614c871abd6788c1684da29d6"}
Jul 30 00:39:56.524230 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:39:56.524171    2560 scope.go:117] "RemoveContainer" containerID="50535ffcf2d24d696d10b06bc29e2760850a239cfe6c574817b3a739c478a5a3"
Jul 30 00:39:56.533118 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:39:56.533103    2560 scope.go:117] "RemoveContainer" containerID="50535ffcf2d24d696d10b06bc29e2760850a239cfe6c574817b3a739c478a5a3"
Jul 30 00:39:56.533408 ip-10-0-133-55 kubenswrapper[2560]: E0730 00:39:56.533383    2560 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"50535ffcf2d24d696d10b06bc29e2760850a239cfe6c574817b3a739c478a5a3\": container with ID starting with 50535ffcf2d24d696d10b06bc29e2760850a239cfe6c574817b3a739c478a5a3 not found: ID does not exist" containerID="50535ffcf2d24d696d10b06bc29e2760850a239cfe6c574817b3a739c478a5a3"
Jul 30 00:39:56.533472 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:39:56.533420    2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"50535ffcf2d24d696d10b06bc29e2760850a239cfe6c574817b3a739c478a5a3"} err="failed to get container status \"50535ffcf2d24d696d10b06bc29e2760850a239cfe6c574817b3a739c478a5a3\": rpc error: code = NotFound desc = could not find container \"50535ffcf2d24d696d10b06bc29e2760850a239cfe6c574817b3a739c478a5a3\": container with ID starting with 50535ffcf2d24d696d10b06bc29e2760850a239cfe6c574817b3a739c478a5a3 not found: ID does not exist"
Jul 30 00:39:56.544281 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:39:56.544257    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-mt-99c2ecca/e2e-lifecycle-model-99c2ecca-kserve-5d87465799-6pxq6"]
Jul 30 00:39:56.547425 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:39:56.547401    2560 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-mt-99c2ecca/e2e-lifecycle-model-99c2ecca-kserve-5d87465799-6pxq6"]
Jul 30 00:39:57.406414 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:39:57.406372    2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f60b503e-fa64-4a3a-8d6d-2d4867259f3a" path="/var/lib/kubelet/pods/f60b503e-fa64-4a3a-8d6d-2d4867259f3a/volumes"
Jul 30 00:41:23.695153 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:41:23.695114    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-inf-a-d11ca7-79dcd779f6-wtwvp"]
Jul 30 00:41:23.695607 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:41:23.695519    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="fb3446b9-88de-44ef-807c-2c9038e523ef" containerName="payload-processing"
Jul 30 00:41:23.695607 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:41:23.695533    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="fb3446b9-88de-44ef-807c-2c9038e523ef" containerName="payload-processing"
Jul 30 00:41:23.695607 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:41:23.695545    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="38e3eec3-e92e-4dfc-b037-aa786729aa8b" containerName="payload-pre-processing"
Jul 30 00:41:23.695607 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:41:23.695551    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="38e3eec3-e92e-4dfc-b037-aa786729aa8b" containerName="payload-pre-processing"
Jul 30 00:41:23.695607 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:41:23.695560    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f60b503e-fa64-4a3a-8d6d-2d4867259f3a" containerName="main"
Jul 30 00:41:23.695607 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:41:23.695565    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="f60b503e-fa64-4a3a-8d6d-2d4867259f3a" containerName="main"
Jul 30 00:41:23.695797 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:41:23.695638    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="fb3446b9-88de-44ef-807c-2c9038e523ef" containerName="payload-processing"
Jul 30 00:41:23.695797 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:41:23.695645    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="38e3eec3-e92e-4dfc-b037-aa786729aa8b" containerName="payload-pre-processing"
Jul 30 00:41:23.695797 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:41:23.695651    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="f60b503e-fa64-4a3a-8d6d-2d4867259f3a" containerName="main"
Jul 30 00:41:23.698701 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:41:23.698682    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-d11ca7-79dcd779f6-wtwvp"
Jul 30 00:41:23.701441 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:41:23.701420    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-inf-a-d11ca7-dockercfg-2nmhj\""
Jul 30 00:41:23.701612 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:41:23.701455    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-inf-a-d11ca7\""
Jul 30 00:41:23.708656 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:41:23.708633    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-inf-a-d11ca7-79dcd779f6-wtwvp"]
Jul 30 00:41:23.736571 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:41:23.736542    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-inf-a-d11ca7-754bd64756-spl62"]
Jul 30 00:41:23.739895 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:41:23.739877    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-inf-a-d11ca7-754bd64756-spl62"
Jul 30 00:41:23.749205 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:41:23.749185    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-inf-a-d11ca7-754bd64756-spl62"]
Jul 30 00:41:23.780647 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:41:23.780622    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-28d7h\" (UniqueName: \"kubernetes.io/projected/ecedae3a-a993-45e3-9535-51b02f998d34-kube-api-access-28d7h\") pod \"payload-pre-processing-e2e-inf-a-d11ca7-79dcd779f6-wtwvp\" (UID: \"ecedae3a-a993-45e3-9535-51b02f998d34\") " pod="openshift-ingress/payload-pre-processing-e2e-inf-a-d11ca7-79dcd779f6-wtwvp"
Jul 30 00:41:23.780750 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:41:23.780656    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/a161f813-b20f-43a8-b5a4-762daca5c60b-plugins-config-volume\") pod \"payload-processing-e2e-inf-a-d11ca7-754bd64756-spl62\" (UID: \"a161f813-b20f-43a8-b5a4-762daca5c60b\") " pod="openshift-ingress/payload-processing-e2e-inf-a-d11ca7-754bd64756-spl62"
Jul 30 00:41:23.780750 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:41:23.780681    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/ecedae3a-a993-45e3-9535-51b02f998d34-plugins-config-volume\") pod \"payload-pre-processing-e2e-inf-a-d11ca7-79dcd779f6-wtwvp\" (UID: \"ecedae3a-a993-45e3-9535-51b02f998d34\") " pod="openshift-ingress/payload-pre-processing-e2e-inf-a-d11ca7-79dcd779f6-wtwvp"
Jul 30 00:41:23.780831 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:41:23.780773    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zrrbz\" (UniqueName: \"kubernetes.io/projected/a161f813-b20f-43a8-b5a4-762daca5c60b-kube-api-access-zrrbz\") pod \"payload-processing-e2e-inf-a-d11ca7-754bd64756-spl62\" (UID: \"a161f813-b20f-43a8-b5a4-762daca5c60b\") " pod="openshift-ingress/payload-processing-e2e-inf-a-d11ca7-754bd64756-spl62"
Jul 30 00:41:23.881854 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:41:23.881825    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/ecedae3a-a993-45e3-9535-51b02f998d34-plugins-config-volume\") pod \"payload-pre-processing-e2e-inf-a-d11ca7-79dcd779f6-wtwvp\" (UID: \"ecedae3a-a993-45e3-9535-51b02f998d34\") " pod="openshift-ingress/payload-pre-processing-e2e-inf-a-d11ca7-79dcd779f6-wtwvp"
Jul 30 00:41:23.881999 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:41:23.881886    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zrrbz\" (UniqueName: \"kubernetes.io/projected/a161f813-b20f-43a8-b5a4-762daca5c60b-kube-api-access-zrrbz\") pod \"payload-processing-e2e-inf-a-d11ca7-754bd64756-spl62\" (UID: \"a161f813-b20f-43a8-b5a4-762daca5c60b\") " pod="openshift-ingress/payload-processing-e2e-inf-a-d11ca7-754bd64756-spl62"
Jul 30 00:41:23.881999 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:41:23.881961    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-28d7h\" (UniqueName: \"kubernetes.io/projected/ecedae3a-a993-45e3-9535-51b02f998d34-kube-api-access-28d7h\") pod \"payload-pre-processing-e2e-inf-a-d11ca7-79dcd779f6-wtwvp\" (UID: \"ecedae3a-a993-45e3-9535-51b02f998d34\") " pod="openshift-ingress/payload-pre-processing-e2e-inf-a-d11ca7-79dcd779f6-wtwvp"
Jul 30 00:41:23.881999 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:41:23.881996    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/a161f813-b20f-43a8-b5a4-762daca5c60b-plugins-config-volume\") pod \"payload-processing-e2e-inf-a-d11ca7-754bd64756-spl62\" (UID: \"a161f813-b20f-43a8-b5a4-762daca5c60b\") " pod="openshift-ingress/payload-processing-e2e-inf-a-d11ca7-754bd64756-spl62"
Jul 30 00:41:23.882790 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:41:23.882767    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/ecedae3a-a993-45e3-9535-51b02f998d34-plugins-config-volume\") pod \"payload-pre-processing-e2e-inf-a-d11ca7-79dcd779f6-wtwvp\" (UID: \"ecedae3a-a993-45e3-9535-51b02f998d34\") " pod="openshift-ingress/payload-pre-processing-e2e-inf-a-d11ca7-79dcd779f6-wtwvp"
Jul 30 00:41:23.882860 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:41:23.882789    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/a161f813-b20f-43a8-b5a4-762daca5c60b-plugins-config-volume\") pod \"payload-processing-e2e-inf-a-d11ca7-754bd64756-spl62\" (UID: \"a161f813-b20f-43a8-b5a4-762daca5c60b\") " pod="openshift-ingress/payload-processing-e2e-inf-a-d11ca7-754bd64756-spl62"
Jul 30 00:41:23.889425 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:41:23.889404    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-28d7h\" (UniqueName: \"kubernetes.io/projected/ecedae3a-a993-45e3-9535-51b02f998d34-kube-api-access-28d7h\") pod \"payload-pre-processing-e2e-inf-a-d11ca7-79dcd779f6-wtwvp\" (UID: \"ecedae3a-a993-45e3-9535-51b02f998d34\") " pod="openshift-ingress/payload-pre-processing-e2e-inf-a-d11ca7-79dcd779f6-wtwvp"
Jul 30 00:41:23.889520 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:41:23.889410    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zrrbz\" (UniqueName: \"kubernetes.io/projected/a161f813-b20f-43a8-b5a4-762daca5c60b-kube-api-access-zrrbz\") pod \"payload-processing-e2e-inf-a-d11ca7-754bd64756-spl62\" (UID: \"a161f813-b20f-43a8-b5a4-762daca5c60b\") " pod="openshift-ingress/payload-processing-e2e-inf-a-d11ca7-754bd64756-spl62"
Jul 30 00:41:24.010352 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:41:24.010251    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-d11ca7-79dcd779f6-wtwvp"
Jul 30 00:41:24.050490 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:41:24.050461    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-inf-a-d11ca7-754bd64756-spl62"
Jul 30 00:41:24.150602 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:41:24.150573    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-inf-a-d11ca7-79dcd779f6-wtwvp"]
Jul 30 00:41:24.151680 ip-10-0-133-55 kubenswrapper[2560]: W0730 00:41:24.151653    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podecedae3a_a993_45e3_9535_51b02f998d34.slice/crio-da45a58e85f06238f48be0c16d02789237482191a5a172bc2d53ac9c9018e3ba WatchSource:0}: Error finding container da45a58e85f06238f48be0c16d02789237482191a5a172bc2d53ac9c9018e3ba: Status 404 returned error can't find the container with id da45a58e85f06238f48be0c16d02789237482191a5a172bc2d53ac9c9018e3ba
Jul 30 00:41:24.195197 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:41:24.193101    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-inf-a-d11ca7-754bd64756-spl62"]
Jul 30 00:41:24.202410 ip-10-0-133-55 kubenswrapper[2560]: W0730 00:41:24.202380    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda161f813_b20f_43a8_b5a4_762daca5c60b.slice/crio-f596fbeb797f9f2b718470b0dd9d2b62339e7e8ba9a8814a0afc2bf52fa38441 WatchSource:0}: Error finding container f596fbeb797f9f2b718470b0dd9d2b62339e7e8ba9a8814a0afc2bf52fa38441: Status 404 returned error can't find the container with id f596fbeb797f9f2b718470b0dd9d2b62339e7e8ba9a8814a0afc2bf52fa38441
Jul 30 00:41:24.948457 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:41:24.948421    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-inf-a-d11ca7-754bd64756-spl62" event={"ID":"a161f813-b20f-43a8-b5a4-762daca5c60b","Type":"ContainerStarted","Data":"be86bf67fd91bcb51379d859fc11733bdfe22bc9354f2cf4872df98b91502d55"}
Jul 30 00:41:24.948954 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:41:24.948471    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-inf-a-d11ca7-754bd64756-spl62" event={"ID":"a161f813-b20f-43a8-b5a4-762daca5c60b","Type":"ContainerStarted","Data":"f596fbeb797f9f2b718470b0dd9d2b62339e7e8ba9a8814a0afc2bf52fa38441"}
Jul 30 00:41:24.948954 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:41:24.948512    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-inf-a-d11ca7-754bd64756-spl62"
Jul 30 00:41:24.950020 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:41:24.949994    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-d11ca7-79dcd779f6-wtwvp" event={"ID":"ecedae3a-a993-45e3-9535-51b02f998d34","Type":"ContainerStarted","Data":"4b351a60da4a2430e6ff82dc5d526175d1a6c3db90e549e6917a6d980804a1dd"}
Jul 30 00:41:24.950146 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:41:24.950045    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-d11ca7-79dcd779f6-wtwvp" event={"ID":"ecedae3a-a993-45e3-9535-51b02f998d34","Type":"ContainerStarted","Data":"da45a58e85f06238f48be0c16d02789237482191a5a172bc2d53ac9c9018e3ba"}
Jul 30 00:41:24.950146 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:41:24.950072    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-d11ca7-79dcd779f6-wtwvp"
Jul 30 00:41:24.964990 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:41:24.964949    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-inf-a-d11ca7-754bd64756-spl62" podStartSLOduration=1.9649341649999998 podStartE2EDuration="1.964934165s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-30 00:41:23 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 00:41:24.963784852 +0000 UTC m=+2372.023001694" watchObservedRunningTime="2026-07-30 00:41:24.964934165 +0000 UTC m=+2372.024150970"
Jul 30 00:41:24.980025 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:41:24.979972    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-d11ca7-79dcd779f6-wtwvp" podStartSLOduration=1.979959051 podStartE2EDuration="1.979959051s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-30 00:41:23 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 00:41:24.978073794 +0000 UTC m=+2372.037290594" watchObservedRunningTime="2026-07-30 00:41:24.979959051 +0000 UTC m=+2372.039175858"
Jul 30 00:41:35.957533 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:41:35.957502    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-d11ca7-79dcd779f6-wtwvp"
Jul 30 00:41:35.957932 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:41:35.957730    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-inf-a-d11ca7-754bd64756-spl62"
Jul 30 00:41:51.854513 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:41:51.854481    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-inf-b-5f678c-79b675885b-hh5pt"]
Jul 30 00:41:51.857965 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:41:51.857947    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-inf-b-5f678c-79b675885b-hh5pt"
Jul 30 00:41:51.860333 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:41:51.860299    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-inf-b-5f678c\""
Jul 30 00:41:51.869431 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:41:51.869406    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-inf-b-5f678c-79b675885b-hh5pt"]
Jul 30 00:41:51.887848 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:41:51.887814    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-inf-b-5f678c-7dd7f6d7f4-6k4hg"]
Jul 30 00:41:51.891263 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:41:51.891245    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-inf-b-5f678c-7dd7f6d7f4-6k4hg"
Jul 30 00:41:51.893928 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:41:51.893906    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-inf-b-5f678c-dockercfg-bkm6h\""
Jul 30 00:41:51.899278 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:41:51.899259    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-inf-b-5f678c-7dd7f6d7f4-6k4hg"]
Jul 30 00:41:51.949864 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:41:51.949827    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/bfa354cb-1377-4f83-8214-aaf50f6278d7-plugins-config-volume\") pod \"payload-pre-processing-e2e-inf-b-5f678c-79b675885b-hh5pt\" (UID: \"bfa354cb-1377-4f83-8214-aaf50f6278d7\") " pod="openshift-ingress/payload-pre-processing-e2e-inf-b-5f678c-79b675885b-hh5pt"
Jul 30 00:41:51.950022 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:41:51.949966    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7v6nb\" (UniqueName: \"kubernetes.io/projected/bfa354cb-1377-4f83-8214-aaf50f6278d7-kube-api-access-7v6nb\") pod \"payload-pre-processing-e2e-inf-b-5f678c-79b675885b-hh5pt\" (UID: \"bfa354cb-1377-4f83-8214-aaf50f6278d7\") " pod="openshift-ingress/payload-pre-processing-e2e-inf-b-5f678c-79b675885b-hh5pt"
Jul 30 00:41:52.050740 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:41:52.050697    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7v6nb\" (UniqueName: \"kubernetes.io/projected/bfa354cb-1377-4f83-8214-aaf50f6278d7-kube-api-access-7v6nb\") pod \"payload-pre-processing-e2e-inf-b-5f678c-79b675885b-hh5pt\" (UID: \"bfa354cb-1377-4f83-8214-aaf50f6278d7\") " pod="openshift-ingress/payload-pre-processing-e2e-inf-b-5f678c-79b675885b-hh5pt"
Jul 30 00:41:52.050918 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:41:52.050867    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/bfa354cb-1377-4f83-8214-aaf50f6278d7-plugins-config-volume\") pod \"payload-pre-processing-e2e-inf-b-5f678c-79b675885b-hh5pt\" (UID: \"bfa354cb-1377-4f83-8214-aaf50f6278d7\") " pod="openshift-ingress/payload-pre-processing-e2e-inf-b-5f678c-79b675885b-hh5pt"
Jul 30 00:41:52.050983 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:41:52.050957    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cmz5z\" (UniqueName: \"kubernetes.io/projected/ab0739e0-5311-4fda-ab2f-f6a4aa36b5e6-kube-api-access-cmz5z\") pod \"payload-processing-e2e-inf-b-5f678c-7dd7f6d7f4-6k4hg\" (UID: \"ab0739e0-5311-4fda-ab2f-f6a4aa36b5e6\") " pod="openshift-ingress/payload-processing-e2e-inf-b-5f678c-7dd7f6d7f4-6k4hg"
Jul 30 00:41:52.051041 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:41:52.051018    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/ab0739e0-5311-4fda-ab2f-f6a4aa36b5e6-plugins-config-volume\") pod \"payload-processing-e2e-inf-b-5f678c-7dd7f6d7f4-6k4hg\" (UID: \"ab0739e0-5311-4fda-ab2f-f6a4aa36b5e6\") " pod="openshift-ingress/payload-processing-e2e-inf-b-5f678c-7dd7f6d7f4-6k4hg"
Jul 30 00:41:52.051641 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:41:52.051616    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/bfa354cb-1377-4f83-8214-aaf50f6278d7-plugins-config-volume\") pod \"payload-pre-processing-e2e-inf-b-5f678c-79b675885b-hh5pt\" (UID: \"bfa354cb-1377-4f83-8214-aaf50f6278d7\") " pod="openshift-ingress/payload-pre-processing-e2e-inf-b-5f678c-79b675885b-hh5pt"
Jul 30 00:41:52.059511 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:41:52.059494    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7v6nb\" (UniqueName: \"kubernetes.io/projected/bfa354cb-1377-4f83-8214-aaf50f6278d7-kube-api-access-7v6nb\") pod \"payload-pre-processing-e2e-inf-b-5f678c-79b675885b-hh5pt\" (UID: \"bfa354cb-1377-4f83-8214-aaf50f6278d7\") " pod="openshift-ingress/payload-pre-processing-e2e-inf-b-5f678c-79b675885b-hh5pt"
Jul 30 00:41:52.151956 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:41:52.151925    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cmz5z\" (UniqueName: \"kubernetes.io/projected/ab0739e0-5311-4fda-ab2f-f6a4aa36b5e6-kube-api-access-cmz5z\") pod \"payload-processing-e2e-inf-b-5f678c-7dd7f6d7f4-6k4hg\" (UID: \"ab0739e0-5311-4fda-ab2f-f6a4aa36b5e6\") " pod="openshift-ingress/payload-processing-e2e-inf-b-5f678c-7dd7f6d7f4-6k4hg"
Jul 30 00:41:52.152142 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:41:52.151978    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/ab0739e0-5311-4fda-ab2f-f6a4aa36b5e6-plugins-config-volume\") pod \"payload-processing-e2e-inf-b-5f678c-7dd7f6d7f4-6k4hg\" (UID: \"ab0739e0-5311-4fda-ab2f-f6a4aa36b5e6\") " pod="openshift-ingress/payload-processing-e2e-inf-b-5f678c-7dd7f6d7f4-6k4hg"
Jul 30 00:41:52.152667 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:41:52.152647    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/ab0739e0-5311-4fda-ab2f-f6a4aa36b5e6-plugins-config-volume\") pod \"payload-processing-e2e-inf-b-5f678c-7dd7f6d7f4-6k4hg\" (UID: \"ab0739e0-5311-4fda-ab2f-f6a4aa36b5e6\") " pod="openshift-ingress/payload-processing-e2e-inf-b-5f678c-7dd7f6d7f4-6k4hg"
Jul 30 00:41:52.159904 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:41:52.159882    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-cmz5z\" (UniqueName: \"kubernetes.io/projected/ab0739e0-5311-4fda-ab2f-f6a4aa36b5e6-kube-api-access-cmz5z\") pod \"payload-processing-e2e-inf-b-5f678c-7dd7f6d7f4-6k4hg\" (UID: \"ab0739e0-5311-4fda-ab2f-f6a4aa36b5e6\") " pod="openshift-ingress/payload-processing-e2e-inf-b-5f678c-7dd7f6d7f4-6k4hg"
Jul 30 00:41:52.169754 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:41:52.169732    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-inf-b-5f678c-79b675885b-hh5pt"
Jul 30 00:41:52.202603 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:41:52.202569    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-inf-b-5f678c-7dd7f6d7f4-6k4hg"
Jul 30 00:41:52.316078 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:41:52.315974    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-inf-b-5f678c-79b675885b-hh5pt"]
Jul 30 00:41:52.320412 ip-10-0-133-55 kubenswrapper[2560]: W0730 00:41:52.320377    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbfa354cb_1377_4f83_8214_aaf50f6278d7.slice/crio-bc1d7c49e1adb57149e3677a06e703cab0c4ffee14179d0429712cbd95fc2afb WatchSource:0}: Error finding container bc1d7c49e1adb57149e3677a06e703cab0c4ffee14179d0429712cbd95fc2afb: Status 404 returned error can't find the container with id bc1d7c49e1adb57149e3677a06e703cab0c4ffee14179d0429712cbd95fc2afb
Jul 30 00:41:52.351325 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:41:52.351292    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-inf-b-5f678c-7dd7f6d7f4-6k4hg"]
Jul 30 00:41:52.356539 ip-10-0-133-55 kubenswrapper[2560]: W0730 00:41:52.356511    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podab0739e0_5311_4fda_ab2f_f6a4aa36b5e6.slice/crio-d9a62282faa955e1604867baeb55ec8641e2e2c6d3f404b9d4d5ccf9791a3175 WatchSource:0}: Error finding container d9a62282faa955e1604867baeb55ec8641e2e2c6d3f404b9d4d5ccf9791a3175: Status 404 returned error can't find the container with id d9a62282faa955e1604867baeb55ec8641e2e2c6d3f404b9d4d5ccf9791a3175
Jul 30 00:41:53.085956 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:41:53.085921    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-inf-b-5f678c-7dd7f6d7f4-6k4hg" event={"ID":"ab0739e0-5311-4fda-ab2f-f6a4aa36b5e6","Type":"ContainerStarted","Data":"13e9673a3d1e08b29cf016770c6399d680a7e8481346b8f607b0cd55221ecb11"}
Jul 30 00:41:53.086421 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:41:53.085984    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-inf-b-5f678c-7dd7f6d7f4-6k4hg" event={"ID":"ab0739e0-5311-4fda-ab2f-f6a4aa36b5e6","Type":"ContainerStarted","Data":"d9a62282faa955e1604867baeb55ec8641e2e2c6d3f404b9d4d5ccf9791a3175"}
Jul 30 00:41:53.086421 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:41:53.086054    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-inf-b-5f678c-7dd7f6d7f4-6k4hg"
Jul 30 00:41:53.087550 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:41:53.087526    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-inf-b-5f678c-79b675885b-hh5pt" event={"ID":"bfa354cb-1377-4f83-8214-aaf50f6278d7","Type":"ContainerStarted","Data":"08b7dfd8c0f87be7cad10daef116c138aab367e80178da6c35f6bdd0bf4465d9"}
Jul 30 00:41:53.087677 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:41:53.087563    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-inf-b-5f678c-79b675885b-hh5pt" event={"ID":"bfa354cb-1377-4f83-8214-aaf50f6278d7","Type":"ContainerStarted","Data":"bc1d7c49e1adb57149e3677a06e703cab0c4ffee14179d0429712cbd95fc2afb"}
Jul 30 00:41:53.087677 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:41:53.087625    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-inf-b-5f678c-79b675885b-hh5pt"
Jul 30 00:41:53.102805 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:41:53.102755    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-inf-b-5f678c-7dd7f6d7f4-6k4hg" podStartSLOduration=2.102739397 podStartE2EDuration="2.102739397s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-30 00:41:51 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 00:41:53.100438338 +0000 UTC m=+2400.159655143" watchObservedRunningTime="2026-07-30 00:41:53.102739397 +0000 UTC m=+2400.161956264"
Jul 30 00:41:53.116224 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:41:53.116176    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-inf-b-5f678c-79b675885b-hh5pt" podStartSLOduration=2.116163507 podStartE2EDuration="2.116163507s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-30 00:41:51 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 00:41:53.114100379 +0000 UTC m=+2400.173317195" watchObservedRunningTime="2026-07-30 00:41:53.116163507 +0000 UTC m=+2400.175380344"
Jul 30 00:41:53.535438 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:41:53.535412    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-kchgc_324341b7-120c-4f8b-9ddd-e28b9a40ce9e/console-operator/1.log"
Jul 30 00:41:53.540398 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:41:53.540374    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-kchgc_324341b7-120c-4f8b-9ddd-e28b9a40ce9e/console-operator/1.log"
Jul 30 00:42:04.095501 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:42:04.095470    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-inf-b-5f678c-7dd7f6d7f4-6k4hg"
Jul 30 00:42:04.095998 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:42:04.095549    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-inf-b-5f678c-79b675885b-hh5pt"
Jul 30 00:42:20.003229 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:42:20.003189    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-inf-a-d11ca7/test-model-d11ca7-kserve-8546c77487-txb2m"]
Jul 30 00:42:20.007466 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:42:20.007447    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-a-d11ca7/test-model-d11ca7-kserve-8546c77487-txb2m"
Jul 30 00:42:20.011402 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:42:20.011362    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-inf-a-d11ca7\"/\"kube-root-ca.crt\""
Jul 30 00:42:20.011402 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:42:20.011383    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-inf-a-d11ca7\"/\"test-model-d11ca7-kserve-self-signed-certs\""
Jul 30 00:42:20.011566 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:42:20.011429    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-inf-a-d11ca7\"/\"openshift-service-ca.crt\""
Jul 30 00:42:20.011566 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:42:20.011363    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-inf-a-d11ca7\"/\"default-dockercfg-wt45c\""
Jul 30 00:42:20.015769 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:42:20.015748    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-inf-a-d11ca7/test-model-d11ca7-kserve-8546c77487-txb2m"]
Jul 30 00:42:20.097493 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:42:20.097453    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hwxv5\" (UniqueName: \"kubernetes.io/projected/d3a26029-0c6f-4c5a-bb16-70cdadc591de-kube-api-access-hwxv5\") pod \"test-model-d11ca7-kserve-8546c77487-txb2m\" (UID: \"d3a26029-0c6f-4c5a-bb16-70cdadc591de\") " pod="ai-tenant-e2e-inf-a-d11ca7/test-model-d11ca7-kserve-8546c77487-txb2m"
Jul 30 00:42:20.097652 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:42:20.097508    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/d3a26029-0c6f-4c5a-bb16-70cdadc591de-home\") pod \"test-model-d11ca7-kserve-8546c77487-txb2m\" (UID: \"d3a26029-0c6f-4c5a-bb16-70cdadc591de\") " pod="ai-tenant-e2e-inf-a-d11ca7/test-model-d11ca7-kserve-8546c77487-txb2m"
Jul 30 00:42:20.097652 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:42:20.097533    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d3a26029-0c6f-4c5a-bb16-70cdadc591de-tmp-dir\") pod \"test-model-d11ca7-kserve-8546c77487-txb2m\" (UID: \"d3a26029-0c6f-4c5a-bb16-70cdadc591de\") " pod="ai-tenant-e2e-inf-a-d11ca7/test-model-d11ca7-kserve-8546c77487-txb2m"
Jul 30 00:42:20.097652 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:42:20.097568    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/d3a26029-0c6f-4c5a-bb16-70cdadc591de-model-cache\") pod \"test-model-d11ca7-kserve-8546c77487-txb2m\" (UID: \"d3a26029-0c6f-4c5a-bb16-70cdadc591de\") " pod="ai-tenant-e2e-inf-a-d11ca7/test-model-d11ca7-kserve-8546c77487-txb2m"
Jul 30 00:42:20.097652 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:42:20.097592    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d3a26029-0c6f-4c5a-bb16-70cdadc591de-tls-certs\") pod \"test-model-d11ca7-kserve-8546c77487-txb2m\" (UID: \"d3a26029-0c6f-4c5a-bb16-70cdadc591de\") " pod="ai-tenant-e2e-inf-a-d11ca7/test-model-d11ca7-kserve-8546c77487-txb2m"
Jul 30 00:42:20.097791 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:42:20.097657    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/d3a26029-0c6f-4c5a-bb16-70cdadc591de-dshm\") pod \"test-model-d11ca7-kserve-8546c77487-txb2m\" (UID: \"d3a26029-0c6f-4c5a-bb16-70cdadc591de\") " pod="ai-tenant-e2e-inf-a-d11ca7/test-model-d11ca7-kserve-8546c77487-txb2m"
Jul 30 00:42:20.199061 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:42:20.199023    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/d3a26029-0c6f-4c5a-bb16-70cdadc591de-dshm\") pod \"test-model-d11ca7-kserve-8546c77487-txb2m\" (UID: \"d3a26029-0c6f-4c5a-bb16-70cdadc591de\") " pod="ai-tenant-e2e-inf-a-d11ca7/test-model-d11ca7-kserve-8546c77487-txb2m"
Jul 30 00:42:20.199230 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:42:20.199099    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hwxv5\" (UniqueName: \"kubernetes.io/projected/d3a26029-0c6f-4c5a-bb16-70cdadc591de-kube-api-access-hwxv5\") pod \"test-model-d11ca7-kserve-8546c77487-txb2m\" (UID: \"d3a26029-0c6f-4c5a-bb16-70cdadc591de\") " pod="ai-tenant-e2e-inf-a-d11ca7/test-model-d11ca7-kserve-8546c77487-txb2m"
Jul 30 00:42:20.199230 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:42:20.199144    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/d3a26029-0c6f-4c5a-bb16-70cdadc591de-home\") pod \"test-model-d11ca7-kserve-8546c77487-txb2m\" (UID: \"d3a26029-0c6f-4c5a-bb16-70cdadc591de\") " pod="ai-tenant-e2e-inf-a-d11ca7/test-model-d11ca7-kserve-8546c77487-txb2m"
Jul 30 00:42:20.199230 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:42:20.199166    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d3a26029-0c6f-4c5a-bb16-70cdadc591de-tmp-dir\") pod \"test-model-d11ca7-kserve-8546c77487-txb2m\" (UID: \"d3a26029-0c6f-4c5a-bb16-70cdadc591de\") " pod="ai-tenant-e2e-inf-a-d11ca7/test-model-d11ca7-kserve-8546c77487-txb2m"
Jul 30 00:42:20.199230 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:42:20.199191    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/d3a26029-0c6f-4c5a-bb16-70cdadc591de-model-cache\") pod \"test-model-d11ca7-kserve-8546c77487-txb2m\" (UID: \"d3a26029-0c6f-4c5a-bb16-70cdadc591de\") " pod="ai-tenant-e2e-inf-a-d11ca7/test-model-d11ca7-kserve-8546c77487-txb2m"
Jul 30 00:42:20.199230 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:42:20.199218    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d3a26029-0c6f-4c5a-bb16-70cdadc591de-tls-certs\") pod \"test-model-d11ca7-kserve-8546c77487-txb2m\" (UID: \"d3a26029-0c6f-4c5a-bb16-70cdadc591de\") " pod="ai-tenant-e2e-inf-a-d11ca7/test-model-d11ca7-kserve-8546c77487-txb2m"
Jul 30 00:42:20.199591 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:42:20.199566    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/d3a26029-0c6f-4c5a-bb16-70cdadc591de-home\") pod \"test-model-d11ca7-kserve-8546c77487-txb2m\" (UID: \"d3a26029-0c6f-4c5a-bb16-70cdadc591de\") " pod="ai-tenant-e2e-inf-a-d11ca7/test-model-d11ca7-kserve-8546c77487-txb2m"
Jul 30 00:42:20.199661 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:42:20.199613    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/d3a26029-0c6f-4c5a-bb16-70cdadc591de-model-cache\") pod \"test-model-d11ca7-kserve-8546c77487-txb2m\" (UID: \"d3a26029-0c6f-4c5a-bb16-70cdadc591de\") " pod="ai-tenant-e2e-inf-a-d11ca7/test-model-d11ca7-kserve-8546c77487-txb2m"
Jul 30 00:42:20.199661 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:42:20.199634    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d3a26029-0c6f-4c5a-bb16-70cdadc591de-tmp-dir\") pod \"test-model-d11ca7-kserve-8546c77487-txb2m\" (UID: \"d3a26029-0c6f-4c5a-bb16-70cdadc591de\") " pod="ai-tenant-e2e-inf-a-d11ca7/test-model-d11ca7-kserve-8546c77487-txb2m"
Jul 30 00:42:20.201406 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:42:20.201384    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/d3a26029-0c6f-4c5a-bb16-70cdadc591de-dshm\") pod \"test-model-d11ca7-kserve-8546c77487-txb2m\" (UID: \"d3a26029-0c6f-4c5a-bb16-70cdadc591de\") " pod="ai-tenant-e2e-inf-a-d11ca7/test-model-d11ca7-kserve-8546c77487-txb2m"
Jul 30 00:42:20.201591 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:42:20.201577    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d3a26029-0c6f-4c5a-bb16-70cdadc591de-tls-certs\") pod \"test-model-d11ca7-kserve-8546c77487-txb2m\" (UID: \"d3a26029-0c6f-4c5a-bb16-70cdadc591de\") " pod="ai-tenant-e2e-inf-a-d11ca7/test-model-d11ca7-kserve-8546c77487-txb2m"
Jul 30 00:42:20.207154 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:42:20.207127    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hwxv5\" (UniqueName: \"kubernetes.io/projected/d3a26029-0c6f-4c5a-bb16-70cdadc591de-kube-api-access-hwxv5\") pod \"test-model-d11ca7-kserve-8546c77487-txb2m\" (UID: \"d3a26029-0c6f-4c5a-bb16-70cdadc591de\") " pod="ai-tenant-e2e-inf-a-d11ca7/test-model-d11ca7-kserve-8546c77487-txb2m"
Jul 30 00:42:20.319478 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:42:20.319379    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-a-d11ca7/test-model-d11ca7-kserve-8546c77487-txb2m"
Jul 30 00:42:20.450024 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:42:20.450000    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-inf-a-d11ca7/test-model-d11ca7-kserve-8546c77487-txb2m"]
Jul 30 00:42:20.452245 ip-10-0-133-55 kubenswrapper[2560]: W0730 00:42:20.452209    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podd3a26029_0c6f_4c5a_bb16_70cdadc591de.slice/crio-38184cdd028f80734f3a2049cd6a1efcdc932c9ca11d3b0f2746222e0dc275ff WatchSource:0}: Error finding container 38184cdd028f80734f3a2049cd6a1efcdc932c9ca11d3b0f2746222e0dc275ff: Status 404 returned error can't find the container with id 38184cdd028f80734f3a2049cd6a1efcdc932c9ca11d3b0f2746222e0dc275ff
Jul 30 00:42:21.226507 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:42:21.226464    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-a-d11ca7/test-model-d11ca7-kserve-8546c77487-txb2m" event={"ID":"d3a26029-0c6f-4c5a-bb16-70cdadc591de","Type":"ContainerStarted","Data":"8383474f85870dd292aa85e40f02134b31c35acac43d238069952fc561fac620"}
Jul 30 00:42:21.226507 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:42:21.226512    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-a-d11ca7/test-model-d11ca7-kserve-8546c77487-txb2m" event={"ID":"d3a26029-0c6f-4c5a-bb16-70cdadc591de","Type":"ContainerStarted","Data":"38184cdd028f80734f3a2049cd6a1efcdc932c9ca11d3b0f2746222e0dc275ff"}
Jul 30 00:42:21.243153 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:42:21.243096    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-inf-a-d11ca7/test-model-d11ca7-kserve-8546c77487-txb2m" podStartSLOduration=2.243075292 podStartE2EDuration="2.243075292s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-30 00:42:19 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 00:42:21.241762274 +0000 UTC m=+2428.300979079" watchObservedRunningTime="2026-07-30 00:42:21.243075292 +0000 UTC m=+2428.302292097"
Jul 30 00:42:30.319987 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:42:30.319951    2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-inf-a-d11ca7/test-model-d11ca7-kserve-8546c77487-txb2m"
Jul 30 00:42:30.320426 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:42:30.320000    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-inf-a-d11ca7/test-model-d11ca7-kserve-8546c77487-txb2m"
Jul 30 00:42:30.332449 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:42:30.332420    2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-inf-a-d11ca7/test-model-d11ca7-kserve-8546c77487-txb2m"
Jul 30 00:42:31.285576 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:42:31.285544    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-inf-a-d11ca7/test-model-d11ca7-kserve-8546c77487-txb2m"
Jul 30 00:42:54.209365 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:42:54.209324    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-inf-b-5f678c/test-model-5f678c-kserve-7bbdc449d7-flbmx"]
Jul 30 00:42:54.212936 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:42:54.212919    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-b-5f678c/test-model-5f678c-kserve-7bbdc449d7-flbmx"
Jul 30 00:42:54.216888 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:42:54.216863    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-inf-b-5f678c\"/\"openshift-service-ca.crt\""
Jul 30 00:42:54.217040 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:42:54.217025    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-inf-b-5f678c\"/\"test-model-5f678c-kserve-self-signed-certs\""
Jul 30 00:42:54.217112 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:42:54.217025    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-inf-b-5f678c\"/\"default-dockercfg-qmf65\""
Jul 30 00:42:54.217112 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:42:54.217078    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-inf-b-5f678c\"/\"kube-root-ca.crt\""
Jul 30 00:42:54.222496 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:42:54.222475    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-inf-b-5f678c/test-model-5f678c-kserve-7bbdc449d7-flbmx"]
Jul 30 00:42:54.310509 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:42:54.310472    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/e4569860-1384-49e6-9f33-2bfcf4355a99-home\") pod \"test-model-5f678c-kserve-7bbdc449d7-flbmx\" (UID: \"e4569860-1384-49e6-9f33-2bfcf4355a99\") " pod="ai-tenant-e2e-inf-b-5f678c/test-model-5f678c-kserve-7bbdc449d7-flbmx"
Jul 30 00:42:54.310683 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:42:54.310517    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dqqfg\" (UniqueName: \"kubernetes.io/projected/e4569860-1384-49e6-9f33-2bfcf4355a99-kube-api-access-dqqfg\") pod \"test-model-5f678c-kserve-7bbdc449d7-flbmx\" (UID: \"e4569860-1384-49e6-9f33-2bfcf4355a99\") " pod="ai-tenant-e2e-inf-b-5f678c/test-model-5f678c-kserve-7bbdc449d7-flbmx"
Jul 30 00:42:54.310683 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:42:54.310564    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/e4569860-1384-49e6-9f33-2bfcf4355a99-model-cache\") pod \"test-model-5f678c-kserve-7bbdc449d7-flbmx\" (UID: \"e4569860-1384-49e6-9f33-2bfcf4355a99\") " pod="ai-tenant-e2e-inf-b-5f678c/test-model-5f678c-kserve-7bbdc449d7-flbmx"
Jul 30 00:42:54.310683 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:42:54.310591    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/e4569860-1384-49e6-9f33-2bfcf4355a99-tmp-dir\") pod \"test-model-5f678c-kserve-7bbdc449d7-flbmx\" (UID: \"e4569860-1384-49e6-9f33-2bfcf4355a99\") " pod="ai-tenant-e2e-inf-b-5f678c/test-model-5f678c-kserve-7bbdc449d7-flbmx"
Jul 30 00:42:54.310683 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:42:54.310649    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/e4569860-1384-49e6-9f33-2bfcf4355a99-dshm\") pod \"test-model-5f678c-kserve-7bbdc449d7-flbmx\" (UID: \"e4569860-1384-49e6-9f33-2bfcf4355a99\") " pod="ai-tenant-e2e-inf-b-5f678c/test-model-5f678c-kserve-7bbdc449d7-flbmx"
Jul 30 00:42:54.310846 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:42:54.310687    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/e4569860-1384-49e6-9f33-2bfcf4355a99-tls-certs\") pod \"test-model-5f678c-kserve-7bbdc449d7-flbmx\" (UID: \"e4569860-1384-49e6-9f33-2bfcf4355a99\") " pod="ai-tenant-e2e-inf-b-5f678c/test-model-5f678c-kserve-7bbdc449d7-flbmx"
Jul 30 00:42:54.411606 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:42:54.411575    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/e4569860-1384-49e6-9f33-2bfcf4355a99-home\") pod \"test-model-5f678c-kserve-7bbdc449d7-flbmx\" (UID: \"e4569860-1384-49e6-9f33-2bfcf4355a99\") " pod="ai-tenant-e2e-inf-b-5f678c/test-model-5f678c-kserve-7bbdc449d7-flbmx"
Jul 30 00:42:54.411784 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:42:54.411622    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dqqfg\" (UniqueName: \"kubernetes.io/projected/e4569860-1384-49e6-9f33-2bfcf4355a99-kube-api-access-dqqfg\") pod \"test-model-5f678c-kserve-7bbdc449d7-flbmx\" (UID: \"e4569860-1384-49e6-9f33-2bfcf4355a99\") " pod="ai-tenant-e2e-inf-b-5f678c/test-model-5f678c-kserve-7bbdc449d7-flbmx"
Jul 30 00:42:54.411784 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:42:54.411749    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/e4569860-1384-49e6-9f33-2bfcf4355a99-model-cache\") pod \"test-model-5f678c-kserve-7bbdc449d7-flbmx\" (UID: \"e4569860-1384-49e6-9f33-2bfcf4355a99\") " pod="ai-tenant-e2e-inf-b-5f678c/test-model-5f678c-kserve-7bbdc449d7-flbmx"
Jul 30 00:42:54.411883 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:42:54.411792    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/e4569860-1384-49e6-9f33-2bfcf4355a99-tmp-dir\") pod \"test-model-5f678c-kserve-7bbdc449d7-flbmx\" (UID: \"e4569860-1384-49e6-9f33-2bfcf4355a99\") " pod="ai-tenant-e2e-inf-b-5f678c/test-model-5f678c-kserve-7bbdc449d7-flbmx"
Jul 30 00:42:54.411883 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:42:54.411826    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/e4569860-1384-49e6-9f33-2bfcf4355a99-dshm\") pod \"test-model-5f678c-kserve-7bbdc449d7-flbmx\" (UID: \"e4569860-1384-49e6-9f33-2bfcf4355a99\") " pod="ai-tenant-e2e-inf-b-5f678c/test-model-5f678c-kserve-7bbdc449d7-flbmx"
Jul 30 00:42:54.411883 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:42:54.411850    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/e4569860-1384-49e6-9f33-2bfcf4355a99-tls-certs\") pod \"test-model-5f678c-kserve-7bbdc449d7-flbmx\" (UID: \"e4569860-1384-49e6-9f33-2bfcf4355a99\") " pod="ai-tenant-e2e-inf-b-5f678c/test-model-5f678c-kserve-7bbdc449d7-flbmx"
Jul 30 00:42:54.412067 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:42:54.412045    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/e4569860-1384-49e6-9f33-2bfcf4355a99-home\") pod \"test-model-5f678c-kserve-7bbdc449d7-flbmx\" (UID: \"e4569860-1384-49e6-9f33-2bfcf4355a99\") " pod="ai-tenant-e2e-inf-b-5f678c/test-model-5f678c-kserve-7bbdc449d7-flbmx"
Jul 30 00:42:54.412136 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:42:54.412079    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/e4569860-1384-49e6-9f33-2bfcf4355a99-model-cache\") pod \"test-model-5f678c-kserve-7bbdc449d7-flbmx\" (UID: \"e4569860-1384-49e6-9f33-2bfcf4355a99\") " pod="ai-tenant-e2e-inf-b-5f678c/test-model-5f678c-kserve-7bbdc449d7-flbmx"
Jul 30 00:42:54.412267 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:42:54.412248    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/e4569860-1384-49e6-9f33-2bfcf4355a99-tmp-dir\") pod \"test-model-5f678c-kserve-7bbdc449d7-flbmx\" (UID: \"e4569860-1384-49e6-9f33-2bfcf4355a99\") " pod="ai-tenant-e2e-inf-b-5f678c/test-model-5f678c-kserve-7bbdc449d7-flbmx"
Jul 30 00:42:54.414006 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:42:54.413987    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/e4569860-1384-49e6-9f33-2bfcf4355a99-dshm\") pod \"test-model-5f678c-kserve-7bbdc449d7-flbmx\" (UID: \"e4569860-1384-49e6-9f33-2bfcf4355a99\") " pod="ai-tenant-e2e-inf-b-5f678c/test-model-5f678c-kserve-7bbdc449d7-flbmx"
Jul 30 00:42:54.414270 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:42:54.414253    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/e4569860-1384-49e6-9f33-2bfcf4355a99-tls-certs\") pod \"test-model-5f678c-kserve-7bbdc449d7-flbmx\" (UID: \"e4569860-1384-49e6-9f33-2bfcf4355a99\") " pod="ai-tenant-e2e-inf-b-5f678c/test-model-5f678c-kserve-7bbdc449d7-flbmx"
Jul 30 00:42:54.419101 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:42:54.419076    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dqqfg\" (UniqueName: \"kubernetes.io/projected/e4569860-1384-49e6-9f33-2bfcf4355a99-kube-api-access-dqqfg\") pod \"test-model-5f678c-kserve-7bbdc449d7-flbmx\" (UID: \"e4569860-1384-49e6-9f33-2bfcf4355a99\") " pod="ai-tenant-e2e-inf-b-5f678c/test-model-5f678c-kserve-7bbdc449d7-flbmx"
Jul 30 00:42:54.523356 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:42:54.523248    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-b-5f678c/test-model-5f678c-kserve-7bbdc449d7-flbmx"
Jul 30 00:42:54.654704 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:42:54.654674    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-inf-b-5f678c/test-model-5f678c-kserve-7bbdc449d7-flbmx"]
Jul 30 00:42:54.657063 ip-10-0-133-55 kubenswrapper[2560]: W0730 00:42:54.657037    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pode4569860_1384_49e6_9f33_2bfcf4355a99.slice/crio-4860b77dc682fc3c5e5e53e52b13fb4357f96eba65b8bce9b7721f3482905419 WatchSource:0}: Error finding container 4860b77dc682fc3c5e5e53e52b13fb4357f96eba65b8bce9b7721f3482905419: Status 404 returned error can't find the container with id 4860b77dc682fc3c5e5e53e52b13fb4357f96eba65b8bce9b7721f3482905419
Jul 30 00:42:55.404201 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:42:55.404170    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-b-5f678c/test-model-5f678c-kserve-7bbdc449d7-flbmx" event={"ID":"e4569860-1384-49e6-9f33-2bfcf4355a99","Type":"ContainerStarted","Data":"3297aa0d8bde2f33c2d217ff1940f7e3f83af8a8ea97ccf46cc1332834a642e3"}
Jul 30 00:42:55.404201 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:42:55.404208    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-b-5f678c/test-model-5f678c-kserve-7bbdc449d7-flbmx" event={"ID":"e4569860-1384-49e6-9f33-2bfcf4355a99","Type":"ContainerStarted","Data":"4860b77dc682fc3c5e5e53e52b13fb4357f96eba65b8bce9b7721f3482905419"}
Jul 30 00:42:55.418774 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:42:55.418731    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-inf-b-5f678c/test-model-5f678c-kserve-7bbdc449d7-flbmx" podStartSLOduration=1.41871195 podStartE2EDuration="1.41871195s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-30 00:42:54 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 00:42:55.418256928 +0000 UTC m=+2462.477473734" watchObservedRunningTime="2026-07-30 00:42:55.41871195 +0000 UTC m=+2462.477928755"
Jul 30 00:43:04.523948 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:43:04.523906    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-inf-b-5f678c/test-model-5f678c-kserve-7bbdc449d7-flbmx"
Jul 30 00:43:04.523948 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:43:04.523954    2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-inf-b-5f678c/test-model-5f678c-kserve-7bbdc449d7-flbmx"
Jul 30 00:43:04.536541 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:43:04.536519    2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-inf-b-5f678c/test-model-5f678c-kserve-7bbdc449d7-flbmx"
Jul 30 00:43:05.460078 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:43:05.460042    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-inf-b-5f678c/test-model-5f678c-kserve-7bbdc449d7-flbmx"
Jul 30 00:43:44.642922 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:43:44.642886    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-inf-a-d11ca7/test-model-d11ca7-kserve-8546c77487-txb2m"]
Jul 30 00:43:45.704951 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:43:45.704870    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-inf-b-5f678c/test-model-5f678c-kserve-7bbdc449d7-flbmx"]
Jul 30 00:43:56.259755 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:43:56.259719    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-inf-a-d11ca7-754bd64756-spl62"]
Jul 30 00:43:56.260198 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:43:56.259970    2560 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-inf-a-d11ca7-754bd64756-spl62" podUID="a161f813-b20f-43a8-b5a4-762daca5c60b" containerName="payload-processing" containerID="cri-o://be86bf67fd91bcb51379d859fc11733bdfe22bc9354f2cf4872df98b91502d55" gracePeriod=30
Jul 30 00:43:56.269962 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:43:56.269932    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-inf-a-d11ca7-79dcd779f6-wtwvp"]
Jul 30 00:43:56.270339 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:43:56.270146    2560 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-d11ca7-79dcd779f6-wtwvp" podUID="ecedae3a-a993-45e3-9535-51b02f998d34" containerName="payload-pre-processing" containerID="cri-o://4b351a60da4a2430e6ff82dc5d526175d1a6c3db90e549e6917a6d980804a1dd" gracePeriod=30
Jul 30 00:43:56.546616 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:43:56.546589    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-inf-a-d11ca7-754bd64756-spl62"
Jul 30 00:43:56.549641 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:43:56.549622    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-d11ca7-79dcd779f6-wtwvp"
Jul 30 00:43:56.696636 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:43:56.696606    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/a161f813-b20f-43a8-b5a4-762daca5c60b-plugins-config-volume\") pod \"a161f813-b20f-43a8-b5a4-762daca5c60b\" (UID: \"a161f813-b20f-43a8-b5a4-762daca5c60b\") "
Jul 30 00:43:56.696831 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:43:56.696642    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-zrrbz\" (UniqueName: \"kubernetes.io/projected/a161f813-b20f-43a8-b5a4-762daca5c60b-kube-api-access-zrrbz\") pod \"a161f813-b20f-43a8-b5a4-762daca5c60b\" (UID: \"a161f813-b20f-43a8-b5a4-762daca5c60b\") "
Jul 30 00:43:56.696831 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:43:56.696722    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/ecedae3a-a993-45e3-9535-51b02f998d34-plugins-config-volume\") pod \"ecedae3a-a993-45e3-9535-51b02f998d34\" (UID: \"ecedae3a-a993-45e3-9535-51b02f998d34\") "
Jul 30 00:43:56.696831 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:43:56.696756    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-28d7h\" (UniqueName: \"kubernetes.io/projected/ecedae3a-a993-45e3-9535-51b02f998d34-kube-api-access-28d7h\") pod \"ecedae3a-a993-45e3-9535-51b02f998d34\" (UID: \"ecedae3a-a993-45e3-9535-51b02f998d34\") "
Jul 30 00:43:56.697058 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:43:56.697006    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a161f813-b20f-43a8-b5a4-762daca5c60b-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "a161f813-b20f-43a8-b5a4-762daca5c60b" (UID: "a161f813-b20f-43a8-b5a4-762daca5c60b"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 30 00:43:56.697393 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:43:56.697369    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ecedae3a-a993-45e3-9535-51b02f998d34-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "ecedae3a-a993-45e3-9535-51b02f998d34" (UID: "ecedae3a-a993-45e3-9535-51b02f998d34"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 30 00:43:56.697767 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:43:56.697738    2560 generic.go:356] "Generic (PLEG): container finished" podID="a161f813-b20f-43a8-b5a4-762daca5c60b" containerID="be86bf67fd91bcb51379d859fc11733bdfe22bc9354f2cf4872df98b91502d55" exitCode=0
Jul 30 00:43:56.697868 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:43:56.697798    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-inf-a-d11ca7-754bd64756-spl62"
Jul 30 00:43:56.697868 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:43:56.697823    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-inf-a-d11ca7-754bd64756-spl62" event={"ID":"a161f813-b20f-43a8-b5a4-762daca5c60b","Type":"ContainerDied","Data":"be86bf67fd91bcb51379d859fc11733bdfe22bc9354f2cf4872df98b91502d55"}
Jul 30 00:43:56.697986 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:43:56.697886    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-inf-a-d11ca7-754bd64756-spl62" event={"ID":"a161f813-b20f-43a8-b5a4-762daca5c60b","Type":"ContainerDied","Data":"f596fbeb797f9f2b718470b0dd9d2b62339e7e8ba9a8814a0afc2bf52fa38441"}
Jul 30 00:43:56.697986 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:43:56.697920    2560 scope.go:117] "RemoveContainer" containerID="be86bf67fd91bcb51379d859fc11733bdfe22bc9354f2cf4872df98b91502d55"
Jul 30 00:43:56.699275 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:43:56.699249    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a161f813-b20f-43a8-b5a4-762daca5c60b-kube-api-access-zrrbz" (OuterVolumeSpecName: "kube-api-access-zrrbz") pod "a161f813-b20f-43a8-b5a4-762daca5c60b" (UID: "a161f813-b20f-43a8-b5a4-762daca5c60b"). InnerVolumeSpecName "kube-api-access-zrrbz". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 30 00:43:56.699392 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:43:56.699333    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ecedae3a-a993-45e3-9535-51b02f998d34-kube-api-access-28d7h" (OuterVolumeSpecName: "kube-api-access-28d7h") pod "ecedae3a-a993-45e3-9535-51b02f998d34" (UID: "ecedae3a-a993-45e3-9535-51b02f998d34"). InnerVolumeSpecName "kube-api-access-28d7h". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 30 00:43:56.699392 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:43:56.699345    2560 generic.go:356] "Generic (PLEG): container finished" podID="ecedae3a-a993-45e3-9535-51b02f998d34" containerID="4b351a60da4a2430e6ff82dc5d526175d1a6c3db90e549e6917a6d980804a1dd" exitCode=0
Jul 30 00:43:56.699392 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:43:56.699375    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-d11ca7-79dcd779f6-wtwvp" event={"ID":"ecedae3a-a993-45e3-9535-51b02f998d34","Type":"ContainerDied","Data":"4b351a60da4a2430e6ff82dc5d526175d1a6c3db90e549e6917a6d980804a1dd"}
Jul 30 00:43:56.699567 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:43:56.699400    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-d11ca7-79dcd779f6-wtwvp"
Jul 30 00:43:56.699567 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:43:56.699418    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-d11ca7-79dcd779f6-wtwvp" event={"ID":"ecedae3a-a993-45e3-9535-51b02f998d34","Type":"ContainerDied","Data":"da45a58e85f06238f48be0c16d02789237482191a5a172bc2d53ac9c9018e3ba"}
Jul 30 00:43:56.706705 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:43:56.706690    2560 scope.go:117] "RemoveContainer" containerID="be86bf67fd91bcb51379d859fc11733bdfe22bc9354f2cf4872df98b91502d55"
Jul 30 00:43:56.706979 ip-10-0-133-55 kubenswrapper[2560]: E0730 00:43:56.706957    2560 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"be86bf67fd91bcb51379d859fc11733bdfe22bc9354f2cf4872df98b91502d55\": container with ID starting with be86bf67fd91bcb51379d859fc11733bdfe22bc9354f2cf4872df98b91502d55 not found: ID does not exist" containerID="be86bf67fd91bcb51379d859fc11733bdfe22bc9354f2cf4872df98b91502d55"
Jul 30 00:43:56.707066 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:43:56.706984    2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"be86bf67fd91bcb51379d859fc11733bdfe22bc9354f2cf4872df98b91502d55"} err="failed to get container status \"be86bf67fd91bcb51379d859fc11733bdfe22bc9354f2cf4872df98b91502d55\": rpc error: code = NotFound desc = could not find container \"be86bf67fd91bcb51379d859fc11733bdfe22bc9354f2cf4872df98b91502d55\": container with ID starting with be86bf67fd91bcb51379d859fc11733bdfe22bc9354f2cf4872df98b91502d55 not found: ID does not exist"
Jul 30 00:43:56.707066 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:43:56.707001    2560 scope.go:117] "RemoveContainer" containerID="4b351a60da4a2430e6ff82dc5d526175d1a6c3db90e549e6917a6d980804a1dd"
Jul 30 00:43:56.715151 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:43:56.715134    2560 scope.go:117] "RemoveContainer" containerID="4b351a60da4a2430e6ff82dc5d526175d1a6c3db90e549e6917a6d980804a1dd"
Jul 30 00:43:56.715461 ip-10-0-133-55 kubenswrapper[2560]: E0730 00:43:56.715442    2560 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4b351a60da4a2430e6ff82dc5d526175d1a6c3db90e549e6917a6d980804a1dd\": container with ID starting with 4b351a60da4a2430e6ff82dc5d526175d1a6c3db90e549e6917a6d980804a1dd not found: ID does not exist" containerID="4b351a60da4a2430e6ff82dc5d526175d1a6c3db90e549e6917a6d980804a1dd"
Jul 30 00:43:56.715519 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:43:56.715469    2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4b351a60da4a2430e6ff82dc5d526175d1a6c3db90e549e6917a6d980804a1dd"} err="failed to get container status \"4b351a60da4a2430e6ff82dc5d526175d1a6c3db90e549e6917a6d980804a1dd\": rpc error: code = NotFound desc = could not find container \"4b351a60da4a2430e6ff82dc5d526175d1a6c3db90e549e6917a6d980804a1dd\": container with ID starting with 4b351a60da4a2430e6ff82dc5d526175d1a6c3db90e549e6917a6d980804a1dd not found: ID does not exist"
Jul 30 00:43:56.724184 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:43:56.724162    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-inf-a-d11ca7-79dcd779f6-wtwvp"]
Jul 30 00:43:56.727821 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:43:56.727800    2560 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-inf-a-d11ca7-79dcd779f6-wtwvp"]
Jul 30 00:43:56.797631 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:43:56.797557    2560 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/ecedae3a-a993-45e3-9535-51b02f998d34-plugins-config-volume\") on node \"ip-10-0-133-55.ec2.internal\" DevicePath \"\""
Jul 30 00:43:56.797631 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:43:56.797583    2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-28d7h\" (UniqueName: \"kubernetes.io/projected/ecedae3a-a993-45e3-9535-51b02f998d34-kube-api-access-28d7h\") on node \"ip-10-0-133-55.ec2.internal\" DevicePath \"\""
Jul 30 00:43:56.797631 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:43:56.797596    2560 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/a161f813-b20f-43a8-b5a4-762daca5c60b-plugins-config-volume\") on node \"ip-10-0-133-55.ec2.internal\" DevicePath \"\""
Jul 30 00:43:56.797631 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:43:56.797605    2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-zrrbz\" (UniqueName: \"kubernetes.io/projected/a161f813-b20f-43a8-b5a4-762daca5c60b-kube-api-access-zrrbz\") on node \"ip-10-0-133-55.ec2.internal\" DevicePath \"\""
Jul 30 00:43:57.023579 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:43:57.023547    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-inf-a-d11ca7-754bd64756-spl62"]
Jul 30 00:43:57.027298 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:43:57.027274    2560 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-inf-a-d11ca7-754bd64756-spl62"]
Jul 30 00:43:57.405172 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:43:57.405141    2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a161f813-b20f-43a8-b5a4-762daca5c60b" path="/var/lib/kubelet/pods/a161f813-b20f-43a8-b5a4-762daca5c60b/volumes"
Jul 30 00:43:57.405555 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:43:57.405538    2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ecedae3a-a993-45e3-9535-51b02f998d34" path="/var/lib/kubelet/pods/ecedae3a-a993-45e3-9535-51b02f998d34/volumes"
Jul 30 00:43:59.662177 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:43:59.662141    2560 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-inf-a-d11ca7/test-model-d11ca7-kserve-8546c77487-txb2m" podUID="d3a26029-0c6f-4c5a-bb16-70cdadc591de" containerName="main" containerID="cri-o://8383474f85870dd292aa85e40f02134b31c35acac43d238069952fc561fac620" gracePeriod=45
Jul 30 00:43:59.909830 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:43:59.909805    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-a-d11ca7/test-model-d11ca7-kserve-8546c77487-txb2m"
Jul 30 00:44:00.026930 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:44:00.026840    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/d3a26029-0c6f-4c5a-bb16-70cdadc591de-dshm\") pod \"d3a26029-0c6f-4c5a-bb16-70cdadc591de\" (UID: \"d3a26029-0c6f-4c5a-bb16-70cdadc591de\") "
Jul 30 00:44:00.026930 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:44:00.026918    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d3a26029-0c6f-4c5a-bb16-70cdadc591de-tls-certs\") pod \"d3a26029-0c6f-4c5a-bb16-70cdadc591de\" (UID: \"d3a26029-0c6f-4c5a-bb16-70cdadc591de\") "
Jul 30 00:44:00.027162 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:44:00.026964    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d3a26029-0c6f-4c5a-bb16-70cdadc591de-tmp-dir\") pod \"d3a26029-0c6f-4c5a-bb16-70cdadc591de\" (UID: \"d3a26029-0c6f-4c5a-bb16-70cdadc591de\") "
Jul 30 00:44:00.027162 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:44:00.026994    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/d3a26029-0c6f-4c5a-bb16-70cdadc591de-home\") pod \"d3a26029-0c6f-4c5a-bb16-70cdadc591de\" (UID: \"d3a26029-0c6f-4c5a-bb16-70cdadc591de\") "
Jul 30 00:44:00.027162 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:44:00.027013    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/d3a26029-0c6f-4c5a-bb16-70cdadc591de-model-cache\") pod \"d3a26029-0c6f-4c5a-bb16-70cdadc591de\" (UID: \"d3a26029-0c6f-4c5a-bb16-70cdadc591de\") "
Jul 30 00:44:00.027162 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:44:00.027072    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-hwxv5\" (UniqueName: \"kubernetes.io/projected/d3a26029-0c6f-4c5a-bb16-70cdadc591de-kube-api-access-hwxv5\") pod \"d3a26029-0c6f-4c5a-bb16-70cdadc591de\" (UID: \"d3a26029-0c6f-4c5a-bb16-70cdadc591de\") "
Jul 30 00:44:00.027388 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:44:00.027245    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d3a26029-0c6f-4c5a-bb16-70cdadc591de-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "d3a26029-0c6f-4c5a-bb16-70cdadc591de" (UID: "d3a26029-0c6f-4c5a-bb16-70cdadc591de"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 30 00:44:00.027388 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:44:00.027240    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d3a26029-0c6f-4c5a-bb16-70cdadc591de-home" (OuterVolumeSpecName: "home") pod "d3a26029-0c6f-4c5a-bb16-70cdadc591de" (UID: "d3a26029-0c6f-4c5a-bb16-70cdadc591de"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 30 00:44:00.027388 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:44:00.027340    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d3a26029-0c6f-4c5a-bb16-70cdadc591de-model-cache" (OuterVolumeSpecName: "model-cache") pod "d3a26029-0c6f-4c5a-bb16-70cdadc591de" (UID: "d3a26029-0c6f-4c5a-bb16-70cdadc591de"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 30 00:44:00.027517 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:44:00.027459    2560 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d3a26029-0c6f-4c5a-bb16-70cdadc591de-tmp-dir\") on node \"ip-10-0-133-55.ec2.internal\" DevicePath \"\""
Jul 30 00:44:00.027517 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:44:00.027479    2560 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/d3a26029-0c6f-4c5a-bb16-70cdadc591de-home\") on node \"ip-10-0-133-55.ec2.internal\" DevicePath \"\""
Jul 30 00:44:00.027517 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:44:00.027493    2560 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/d3a26029-0c6f-4c5a-bb16-70cdadc591de-model-cache\") on node \"ip-10-0-133-55.ec2.internal\" DevicePath \"\""
Jul 30 00:44:00.029137 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:44:00.029108    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d3a26029-0c6f-4c5a-bb16-70cdadc591de-kube-api-access-hwxv5" (OuterVolumeSpecName: "kube-api-access-hwxv5") pod "d3a26029-0c6f-4c5a-bb16-70cdadc591de" (UID: "d3a26029-0c6f-4c5a-bb16-70cdadc591de"). InnerVolumeSpecName "kube-api-access-hwxv5". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 30 00:44:00.029137 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:44:00.029125    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d3a26029-0c6f-4c5a-bb16-70cdadc591de-dshm" (OuterVolumeSpecName: "dshm") pod "d3a26029-0c6f-4c5a-bb16-70cdadc591de" (UID: "d3a26029-0c6f-4c5a-bb16-70cdadc591de"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 30 00:44:00.029284 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:44:00.029144    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d3a26029-0c6f-4c5a-bb16-70cdadc591de-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "d3a26029-0c6f-4c5a-bb16-70cdadc591de" (UID: "d3a26029-0c6f-4c5a-bb16-70cdadc591de"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 30 00:44:00.128930 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:44:00.128896    2560 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d3a26029-0c6f-4c5a-bb16-70cdadc591de-tls-certs\") on node \"ip-10-0-133-55.ec2.internal\" DevicePath \"\""
Jul 30 00:44:00.128930 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:44:00.128923    2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-hwxv5\" (UniqueName: \"kubernetes.io/projected/d3a26029-0c6f-4c5a-bb16-70cdadc591de-kube-api-access-hwxv5\") on node \"ip-10-0-133-55.ec2.internal\" DevicePath \"\""
Jul 30 00:44:00.128930 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:44:00.128932    2560 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/d3a26029-0c6f-4c5a-bb16-70cdadc591de-dshm\") on node \"ip-10-0-133-55.ec2.internal\" DevicePath \"\""
Jul 30 00:44:00.722757 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:44:00.722716    2560 generic.go:356] "Generic (PLEG): container finished" podID="d3a26029-0c6f-4c5a-bb16-70cdadc591de" containerID="8383474f85870dd292aa85e40f02134b31c35acac43d238069952fc561fac620" exitCode=0
Jul 30 00:44:00.722757 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:44:00.722758    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-a-d11ca7/test-model-d11ca7-kserve-8546c77487-txb2m"
Jul 30 00:44:00.723274 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:44:00.722783    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-a-d11ca7/test-model-d11ca7-kserve-8546c77487-txb2m" event={"ID":"d3a26029-0c6f-4c5a-bb16-70cdadc591de","Type":"ContainerDied","Data":"8383474f85870dd292aa85e40f02134b31c35acac43d238069952fc561fac620"}
Jul 30 00:44:00.723274 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:44:00.722824    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-a-d11ca7/test-model-d11ca7-kserve-8546c77487-txb2m" event={"ID":"d3a26029-0c6f-4c5a-bb16-70cdadc591de","Type":"ContainerDied","Data":"38184cdd028f80734f3a2049cd6a1efcdc932c9ca11d3b0f2746222e0dc275ff"}
Jul 30 00:44:00.723274 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:44:00.722842    2560 scope.go:117] "RemoveContainer" containerID="8383474f85870dd292aa85e40f02134b31c35acac43d238069952fc561fac620"
Jul 30 00:44:00.723573 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:44:00.723547    2560 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-inf-b-5f678c/test-model-5f678c-kserve-7bbdc449d7-flbmx" podUID="e4569860-1384-49e6-9f33-2bfcf4355a99" containerName="main" containerID="cri-o://3297aa0d8bde2f33c2d217ff1940f7e3f83af8a8ea97ccf46cc1332834a642e3" gracePeriod=45
Jul 30 00:44:00.731962 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:44:00.731944    2560 scope.go:117] "RemoveContainer" containerID="8383474f85870dd292aa85e40f02134b31c35acac43d238069952fc561fac620"
Jul 30 00:44:00.732245 ip-10-0-133-55 kubenswrapper[2560]: E0730 00:44:00.732225    2560 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8383474f85870dd292aa85e40f02134b31c35acac43d238069952fc561fac620\": container with ID starting with 8383474f85870dd292aa85e40f02134b31c35acac43d238069952fc561fac620 not found: ID does not exist" containerID="8383474f85870dd292aa85e40f02134b31c35acac43d238069952fc561fac620"
Jul 30 00:44:00.732306 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:44:00.732252    2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8383474f85870dd292aa85e40f02134b31c35acac43d238069952fc561fac620"} err="failed to get container status \"8383474f85870dd292aa85e40f02134b31c35acac43d238069952fc561fac620\": rpc error: code = NotFound desc = could not find container \"8383474f85870dd292aa85e40f02134b31c35acac43d238069952fc561fac620\": container with ID starting with 8383474f85870dd292aa85e40f02134b31c35acac43d238069952fc561fac620 not found: ID does not exist"
Jul 30 00:44:00.785799 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:44:00.785774    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-inf-a-d11ca7/test-model-d11ca7-kserve-8546c77487-txb2m"]
Jul 30 00:44:00.789034 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:44:00.789015    2560 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-inf-a-d11ca7/test-model-d11ca7-kserve-8546c77487-txb2m"]
Jul 30 00:44:00.978293 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:44:00.978231    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-b-5f678c/test-model-5f678c-kserve-7bbdc449d7-flbmx"
Jul 30 00:44:01.138227 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:44:01.138191    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/e4569860-1384-49e6-9f33-2bfcf4355a99-home\") pod \"e4569860-1384-49e6-9f33-2bfcf4355a99\" (UID: \"e4569860-1384-49e6-9f33-2bfcf4355a99\") "
Jul 30 00:44:01.138227 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:44:01.138227    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/e4569860-1384-49e6-9f33-2bfcf4355a99-tls-certs\") pod \"e4569860-1384-49e6-9f33-2bfcf4355a99\" (UID: \"e4569860-1384-49e6-9f33-2bfcf4355a99\") "
Jul 30 00:44:01.138446 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:44:01.138301    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/e4569860-1384-49e6-9f33-2bfcf4355a99-model-cache\") pod \"e4569860-1384-49e6-9f33-2bfcf4355a99\" (UID: \"e4569860-1384-49e6-9f33-2bfcf4355a99\") "
Jul 30 00:44:01.138446 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:44:01.138355    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-dqqfg\" (UniqueName: \"kubernetes.io/projected/e4569860-1384-49e6-9f33-2bfcf4355a99-kube-api-access-dqqfg\") pod \"e4569860-1384-49e6-9f33-2bfcf4355a99\" (UID: \"e4569860-1384-49e6-9f33-2bfcf4355a99\") "
Jul 30 00:44:01.138446 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:44:01.138397    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/e4569860-1384-49e6-9f33-2bfcf4355a99-tmp-dir\") pod \"e4569860-1384-49e6-9f33-2bfcf4355a99\" (UID: \"e4569860-1384-49e6-9f33-2bfcf4355a99\") "
Jul 30 00:44:01.138599 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:44:01.138453    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/e4569860-1384-49e6-9f33-2bfcf4355a99-dshm\") pod \"e4569860-1384-49e6-9f33-2bfcf4355a99\" (UID: \"e4569860-1384-49e6-9f33-2bfcf4355a99\") "
Jul 30 00:44:01.138599 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:44:01.138520    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e4569860-1384-49e6-9f33-2bfcf4355a99-home" (OuterVolumeSpecName: "home") pod "e4569860-1384-49e6-9f33-2bfcf4355a99" (UID: "e4569860-1384-49e6-9f33-2bfcf4355a99"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 30 00:44:01.138711 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:44:01.138608    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e4569860-1384-49e6-9f33-2bfcf4355a99-model-cache" (OuterVolumeSpecName: "model-cache") pod "e4569860-1384-49e6-9f33-2bfcf4355a99" (UID: "e4569860-1384-49e6-9f33-2bfcf4355a99"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 30 00:44:01.138767 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:44:01.138719    2560 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/e4569860-1384-49e6-9f33-2bfcf4355a99-home\") on node \"ip-10-0-133-55.ec2.internal\" DevicePath \"\""
Jul 30 00:44:01.138767 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:44:01.138732    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e4569860-1384-49e6-9f33-2bfcf4355a99-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "e4569860-1384-49e6-9f33-2bfcf4355a99" (UID: "e4569860-1384-49e6-9f33-2bfcf4355a99"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 30 00:44:01.138767 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:44:01.138739    2560 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/e4569860-1384-49e6-9f33-2bfcf4355a99-model-cache\") on node \"ip-10-0-133-55.ec2.internal\" DevicePath \"\""
Jul 30 00:44:01.140612 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:44:01.140586    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e4569860-1384-49e6-9f33-2bfcf4355a99-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "e4569860-1384-49e6-9f33-2bfcf4355a99" (UID: "e4569860-1384-49e6-9f33-2bfcf4355a99"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 30 00:44:01.140612 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:44:01.140601    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e4569860-1384-49e6-9f33-2bfcf4355a99-dshm" (OuterVolumeSpecName: "dshm") pod "e4569860-1384-49e6-9f33-2bfcf4355a99" (UID: "e4569860-1384-49e6-9f33-2bfcf4355a99"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 30 00:44:01.140612 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:44:01.140604    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e4569860-1384-49e6-9f33-2bfcf4355a99-kube-api-access-dqqfg" (OuterVolumeSpecName: "kube-api-access-dqqfg") pod "e4569860-1384-49e6-9f33-2bfcf4355a99" (UID: "e4569860-1384-49e6-9f33-2bfcf4355a99"). InnerVolumeSpecName "kube-api-access-dqqfg". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 30 00:44:01.239626 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:44:01.239551    2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-dqqfg\" (UniqueName: \"kubernetes.io/projected/e4569860-1384-49e6-9f33-2bfcf4355a99-kube-api-access-dqqfg\") on node \"ip-10-0-133-55.ec2.internal\" DevicePath \"\""
Jul 30 00:44:01.239626 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:44:01.239578    2560 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/e4569860-1384-49e6-9f33-2bfcf4355a99-tmp-dir\") on node \"ip-10-0-133-55.ec2.internal\" DevicePath \"\""
Jul 30 00:44:01.239626 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:44:01.239587    2560 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/e4569860-1384-49e6-9f33-2bfcf4355a99-dshm\") on node \"ip-10-0-133-55.ec2.internal\" DevicePath \"\""
Jul 30 00:44:01.239626 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:44:01.239595    2560 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/e4569860-1384-49e6-9f33-2bfcf4355a99-tls-certs\") on node \"ip-10-0-133-55.ec2.internal\" DevicePath \"\""
Jul 30 00:44:01.404687 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:44:01.404653    2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d3a26029-0c6f-4c5a-bb16-70cdadc591de" path="/var/lib/kubelet/pods/d3a26029-0c6f-4c5a-bb16-70cdadc591de/volumes"
Jul 30 00:44:01.730807 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:44:01.730775    2560 generic.go:356] "Generic (PLEG): container finished" podID="e4569860-1384-49e6-9f33-2bfcf4355a99" containerID="3297aa0d8bde2f33c2d217ff1940f7e3f83af8a8ea97ccf46cc1332834a642e3" exitCode=0
Jul 30 00:44:01.731185 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:44:01.730818    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-b-5f678c/test-model-5f678c-kserve-7bbdc449d7-flbmx"
Jul 30 00:44:01.731185 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:44:01.730862    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-b-5f678c/test-model-5f678c-kserve-7bbdc449d7-flbmx" event={"ID":"e4569860-1384-49e6-9f33-2bfcf4355a99","Type":"ContainerDied","Data":"3297aa0d8bde2f33c2d217ff1940f7e3f83af8a8ea97ccf46cc1332834a642e3"}
Jul 30 00:44:01.731185 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:44:01.730908    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-b-5f678c/test-model-5f678c-kserve-7bbdc449d7-flbmx" event={"ID":"e4569860-1384-49e6-9f33-2bfcf4355a99","Type":"ContainerDied","Data":"4860b77dc682fc3c5e5e53e52b13fb4357f96eba65b8bce9b7721f3482905419"}
Jul 30 00:44:01.731185 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:44:01.730929    2560 scope.go:117] "RemoveContainer" containerID="3297aa0d8bde2f33c2d217ff1940f7e3f83af8a8ea97ccf46cc1332834a642e3"
Jul 30 00:44:01.739179 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:44:01.739163    2560 scope.go:117] "RemoveContainer" containerID="3297aa0d8bde2f33c2d217ff1940f7e3f83af8a8ea97ccf46cc1332834a642e3"
Jul 30 00:44:01.739465 ip-10-0-133-55 kubenswrapper[2560]: E0730 00:44:01.739447    2560 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3297aa0d8bde2f33c2d217ff1940f7e3f83af8a8ea97ccf46cc1332834a642e3\": container with ID starting with 3297aa0d8bde2f33c2d217ff1940f7e3f83af8a8ea97ccf46cc1332834a642e3 not found: ID does not exist" containerID="3297aa0d8bde2f33c2d217ff1940f7e3f83af8a8ea97ccf46cc1332834a642e3"
Jul 30 00:44:01.739519 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:44:01.739470    2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3297aa0d8bde2f33c2d217ff1940f7e3f83af8a8ea97ccf46cc1332834a642e3"} err="failed to get container status \"3297aa0d8bde2f33c2d217ff1940f7e3f83af8a8ea97ccf46cc1332834a642e3\": rpc error: code = NotFound desc = could not find container \"3297aa0d8bde2f33c2d217ff1940f7e3f83af8a8ea97ccf46cc1332834a642e3\": container with ID starting with 3297aa0d8bde2f33c2d217ff1940f7e3f83af8a8ea97ccf46cc1332834a642e3 not found: ID does not exist"
Jul 30 00:44:01.746225 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:44:01.746204    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-inf-b-5f678c/test-model-5f678c-kserve-7bbdc449d7-flbmx"]
Jul 30 00:44:01.751401 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:44:01.751381    2560 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-inf-b-5f678c/test-model-5f678c-kserve-7bbdc449d7-flbmx"]
Jul 30 00:44:03.406494 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:44:03.406459    2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e4569860-1384-49e6-9f33-2bfcf4355a99" path="/var/lib/kubelet/pods/e4569860-1384-49e6-9f33-2bfcf4355a99/volumes"
Jul 30 00:44:13.446027 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:44:13.445995    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-inf-b-5f678c-7dd7f6d7f4-6k4hg"]
Jul 30 00:44:13.446636 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:44:13.446215    2560 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-inf-b-5f678c-7dd7f6d7f4-6k4hg" podUID="ab0739e0-5311-4fda-ab2f-f6a4aa36b5e6" containerName="payload-processing" containerID="cri-o://13e9673a3d1e08b29cf016770c6399d680a7e8481346b8f607b0cd55221ecb11" gracePeriod=30
Jul 30 00:44:13.453470 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:44:13.453441    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-inf-b-5f678c-79b675885b-hh5pt"]
Jul 30 00:44:13.453691 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:44:13.453661    2560 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-inf-b-5f678c-79b675885b-hh5pt" podUID="bfa354cb-1377-4f83-8214-aaf50f6278d7" containerName="payload-pre-processing" containerID="cri-o://08b7dfd8c0f87be7cad10daef116c138aab367e80178da6c35f6bdd0bf4465d9" gracePeriod=30
Jul 30 00:44:13.718936 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:44:13.718913    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-inf-b-5f678c-7dd7f6d7f4-6k4hg"
Jul 30 00:44:13.721617 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:44:13.721599    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-inf-b-5f678c-79b675885b-hh5pt"
Jul 30 00:44:13.757117 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:44:13.757088    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-cmz5z\" (UniqueName: \"kubernetes.io/projected/ab0739e0-5311-4fda-ab2f-f6a4aa36b5e6-kube-api-access-cmz5z\") pod \"ab0739e0-5311-4fda-ab2f-f6a4aa36b5e6\" (UID: \"ab0739e0-5311-4fda-ab2f-f6a4aa36b5e6\") "
Jul 30 00:44:13.757290 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:44:13.757145    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-7v6nb\" (UniqueName: \"kubernetes.io/projected/bfa354cb-1377-4f83-8214-aaf50f6278d7-kube-api-access-7v6nb\") pod \"bfa354cb-1377-4f83-8214-aaf50f6278d7\" (UID: \"bfa354cb-1377-4f83-8214-aaf50f6278d7\") "
Jul 30 00:44:13.757290 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:44:13.757178    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/bfa354cb-1377-4f83-8214-aaf50f6278d7-plugins-config-volume\") pod \"bfa354cb-1377-4f83-8214-aaf50f6278d7\" (UID: \"bfa354cb-1377-4f83-8214-aaf50f6278d7\") "
Jul 30 00:44:13.757290 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:44:13.757196    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/ab0739e0-5311-4fda-ab2f-f6a4aa36b5e6-plugins-config-volume\") pod \"ab0739e0-5311-4fda-ab2f-f6a4aa36b5e6\" (UID: \"ab0739e0-5311-4fda-ab2f-f6a4aa36b5e6\") "
Jul 30 00:44:13.757778 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:44:13.757747    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/bfa354cb-1377-4f83-8214-aaf50f6278d7-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "bfa354cb-1377-4f83-8214-aaf50f6278d7" (UID: "bfa354cb-1377-4f83-8214-aaf50f6278d7"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 30 00:44:13.757778 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:44:13.757770    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ab0739e0-5311-4fda-ab2f-f6a4aa36b5e6-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "ab0739e0-5311-4fda-ab2f-f6a4aa36b5e6" (UID: "ab0739e0-5311-4fda-ab2f-f6a4aa36b5e6"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 30 00:44:13.759378 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:44:13.759349    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/bfa354cb-1377-4f83-8214-aaf50f6278d7-kube-api-access-7v6nb" (OuterVolumeSpecName: "kube-api-access-7v6nb") pod "bfa354cb-1377-4f83-8214-aaf50f6278d7" (UID: "bfa354cb-1377-4f83-8214-aaf50f6278d7"). InnerVolumeSpecName "kube-api-access-7v6nb". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 30 00:44:13.759468 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:44:13.759410    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ab0739e0-5311-4fda-ab2f-f6a4aa36b5e6-kube-api-access-cmz5z" (OuterVolumeSpecName: "kube-api-access-cmz5z") pod "ab0739e0-5311-4fda-ab2f-f6a4aa36b5e6" (UID: "ab0739e0-5311-4fda-ab2f-f6a4aa36b5e6"). InnerVolumeSpecName "kube-api-access-cmz5z". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 30 00:44:13.790136 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:44:13.790102    2560 generic.go:356] "Generic (PLEG): container finished" podID="ab0739e0-5311-4fda-ab2f-f6a4aa36b5e6" containerID="13e9673a3d1e08b29cf016770c6399d680a7e8481346b8f607b0cd55221ecb11" exitCode=0
Jul 30 00:44:13.790262 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:44:13.790145    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-inf-b-5f678c-7dd7f6d7f4-6k4hg"
Jul 30 00:44:13.790262 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:44:13.790180    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-inf-b-5f678c-7dd7f6d7f4-6k4hg" event={"ID":"ab0739e0-5311-4fda-ab2f-f6a4aa36b5e6","Type":"ContainerDied","Data":"13e9673a3d1e08b29cf016770c6399d680a7e8481346b8f607b0cd55221ecb11"}
Jul 30 00:44:13.790262 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:44:13.790226    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-inf-b-5f678c-7dd7f6d7f4-6k4hg" event={"ID":"ab0739e0-5311-4fda-ab2f-f6a4aa36b5e6","Type":"ContainerDied","Data":"d9a62282faa955e1604867baeb55ec8641e2e2c6d3f404b9d4d5ccf9791a3175"}
Jul 30 00:44:13.790449 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:44:13.790247    2560 scope.go:117] "RemoveContainer" containerID="13e9673a3d1e08b29cf016770c6399d680a7e8481346b8f607b0cd55221ecb11"
Jul 30 00:44:13.791852 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:44:13.791822    2560 generic.go:356] "Generic (PLEG): container finished" podID="bfa354cb-1377-4f83-8214-aaf50f6278d7" containerID="08b7dfd8c0f87be7cad10daef116c138aab367e80178da6c35f6bdd0bf4465d9" exitCode=0
Jul 30 00:44:13.791967 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:44:13.791861    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-inf-b-5f678c-79b675885b-hh5pt"
Jul 30 00:44:13.791967 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:44:13.791904    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-inf-b-5f678c-79b675885b-hh5pt" event={"ID":"bfa354cb-1377-4f83-8214-aaf50f6278d7","Type":"ContainerDied","Data":"08b7dfd8c0f87be7cad10daef116c138aab367e80178da6c35f6bdd0bf4465d9"}
Jul 30 00:44:13.791967 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:44:13.791960    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-inf-b-5f678c-79b675885b-hh5pt" event={"ID":"bfa354cb-1377-4f83-8214-aaf50f6278d7","Type":"ContainerDied","Data":"bc1d7c49e1adb57149e3677a06e703cab0c4ffee14179d0429712cbd95fc2afb"}
Jul 30 00:44:13.801345 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:44:13.801301    2560 scope.go:117] "RemoveContainer" containerID="13e9673a3d1e08b29cf016770c6399d680a7e8481346b8f607b0cd55221ecb11"
Jul 30 00:44:13.801594 ip-10-0-133-55 kubenswrapper[2560]: E0730 00:44:13.801574    2560 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"13e9673a3d1e08b29cf016770c6399d680a7e8481346b8f607b0cd55221ecb11\": container with ID starting with 13e9673a3d1e08b29cf016770c6399d680a7e8481346b8f607b0cd55221ecb11 not found: ID does not exist" containerID="13e9673a3d1e08b29cf016770c6399d680a7e8481346b8f607b0cd55221ecb11"
Jul 30 00:44:13.801686 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:44:13.801605    2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"13e9673a3d1e08b29cf016770c6399d680a7e8481346b8f607b0cd55221ecb11"} err="failed to get container status \"13e9673a3d1e08b29cf016770c6399d680a7e8481346b8f607b0cd55221ecb11\": rpc error: code = NotFound desc = could not find container \"13e9673a3d1e08b29cf016770c6399d680a7e8481346b8f607b0cd55221ecb11\": container with ID starting with 13e9673a3d1e08b29cf016770c6399d680a7e8481346b8f607b0cd55221ecb11 not found: ID does not exist"
Jul 30 00:44:13.801686 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:44:13.801624    2560 scope.go:117] "RemoveContainer" containerID="08b7dfd8c0f87be7cad10daef116c138aab367e80178da6c35f6bdd0bf4465d9"
Jul 30 00:44:13.809217 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:44:13.809202    2560 scope.go:117] "RemoveContainer" containerID="08b7dfd8c0f87be7cad10daef116c138aab367e80178da6c35f6bdd0bf4465d9"
Jul 30 00:44:13.809482 ip-10-0-133-55 kubenswrapper[2560]: E0730 00:44:13.809463    2560 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"08b7dfd8c0f87be7cad10daef116c138aab367e80178da6c35f6bdd0bf4465d9\": container with ID starting with 08b7dfd8c0f87be7cad10daef116c138aab367e80178da6c35f6bdd0bf4465d9 not found: ID does not exist" containerID="08b7dfd8c0f87be7cad10daef116c138aab367e80178da6c35f6bdd0bf4465d9"
Jul 30 00:44:13.809543 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:44:13.809491    2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"08b7dfd8c0f87be7cad10daef116c138aab367e80178da6c35f6bdd0bf4465d9"} err="failed to get container status \"08b7dfd8c0f87be7cad10daef116c138aab367e80178da6c35f6bdd0bf4465d9\": rpc error: code = NotFound desc = could not find container \"08b7dfd8c0f87be7cad10daef116c138aab367e80178da6c35f6bdd0bf4465d9\": container with ID starting with 08b7dfd8c0f87be7cad10daef116c138aab367e80178da6c35f6bdd0bf4465d9 not found: ID does not exist"
Jul 30 00:44:13.817244 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:44:13.817222    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-inf-b-5f678c-79b675885b-hh5pt"]
Jul 30 00:44:13.818923 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:44:13.818897    2560 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-inf-b-5f678c-79b675885b-hh5pt"]
Jul 30 00:44:13.828983 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:44:13.828958    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-inf-b-5f678c-7dd7f6d7f4-6k4hg"]
Jul 30 00:44:13.832728 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:44:13.832708    2560 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-inf-b-5f678c-7dd7f6d7f4-6k4hg"]
Jul 30 00:44:13.857998 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:44:13.857974    2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-cmz5z\" (UniqueName: \"kubernetes.io/projected/ab0739e0-5311-4fda-ab2f-f6a4aa36b5e6-kube-api-access-cmz5z\") on node \"ip-10-0-133-55.ec2.internal\" DevicePath \"\""
Jul 30 00:44:13.857998 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:44:13.857995    2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-7v6nb\" (UniqueName: \"kubernetes.io/projected/bfa354cb-1377-4f83-8214-aaf50f6278d7-kube-api-access-7v6nb\") on node \"ip-10-0-133-55.ec2.internal\" DevicePath \"\""
Jul 30 00:44:13.858119 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:44:13.858005    2560 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/bfa354cb-1377-4f83-8214-aaf50f6278d7-plugins-config-volume\") on node \"ip-10-0-133-55.ec2.internal\" DevicePath \"\""
Jul 30 00:44:13.858119 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:44:13.858015    2560 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/ab0739e0-5311-4fda-ab2f-f6a4aa36b5e6-plugins-config-volume\") on node \"ip-10-0-133-55.ec2.internal\" DevicePath \"\""
Jul 30 00:44:15.404461 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:44:15.404428    2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ab0739e0-5311-4fda-ab2f-f6a4aa36b5e6" path="/var/lib/kubelet/pods/ab0739e0-5311-4fda-ab2f-f6a4aa36b5e6/volumes"
Jul 30 00:44:15.404938 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:44:15.404922    2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="bfa354cb-1377-4f83-8214-aaf50f6278d7" path="/var/lib/kubelet/pods/bfa354cb-1377-4f83-8214-aaf50f6278d7/volumes"
Jul 30 00:44:25.271732 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:44:25.271704    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-a-dc78bf-66c7d85bdd-f7666"]
Jul 30 00:44:25.272138 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:44:25.272065    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ab0739e0-5311-4fda-ab2f-f6a4aa36b5e6" containerName="payload-processing"
Jul 30 00:44:25.272138 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:44:25.272077    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="ab0739e0-5311-4fda-ab2f-f6a4aa36b5e6" containerName="payload-processing"
Jul 30 00:44:25.272138 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:44:25.272095    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a161f813-b20f-43a8-b5a4-762daca5c60b" containerName="payload-processing"
Jul 30 00:44:25.272138 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:44:25.272101    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="a161f813-b20f-43a8-b5a4-762daca5c60b" containerName="payload-processing"
Jul 30 00:44:25.272138 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:44:25.272113    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e4569860-1384-49e6-9f33-2bfcf4355a99" containerName="main"
Jul 30 00:44:25.272138 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:44:25.272119    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="e4569860-1384-49e6-9f33-2bfcf4355a99" containerName="main"
Jul 30 00:44:25.272138 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:44:25.272127    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ecedae3a-a993-45e3-9535-51b02f998d34" containerName="payload-pre-processing"
Jul 30 00:44:25.272138 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:44:25.272132    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="ecedae3a-a993-45e3-9535-51b02f998d34" containerName="payload-pre-processing"
Jul 30 00:44:25.272419 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:44:25.272146    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="bfa354cb-1377-4f83-8214-aaf50f6278d7" containerName="payload-pre-processing"
Jul 30 00:44:25.272419 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:44:25.272152    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="bfa354cb-1377-4f83-8214-aaf50f6278d7" containerName="payload-pre-processing"
Jul 30 00:44:25.272419 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:44:25.272159    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d3a26029-0c6f-4c5a-bb16-70cdadc591de" containerName="main"
Jul 30 00:44:25.272419 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:44:25.272164    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="d3a26029-0c6f-4c5a-bb16-70cdadc591de" containerName="main"
Jul 30 00:44:25.272419 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:44:25.272217    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="d3a26029-0c6f-4c5a-bb16-70cdadc591de" containerName="main"
Jul 30 00:44:25.272419 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:44:25.272228    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="ab0739e0-5311-4fda-ab2f-f6a4aa36b5e6" containerName="payload-processing"
Jul 30 00:44:25.272419 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:44:25.272235    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="bfa354cb-1377-4f83-8214-aaf50f6278d7" containerName="payload-pre-processing"
Jul 30 00:44:25.272419 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:44:25.272242    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="ecedae3a-a993-45e3-9535-51b02f998d34" containerName="payload-pre-processing"
Jul 30 00:44:25.272419 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:44:25.272247    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="e4569860-1384-49e6-9f33-2bfcf4355a99" containerName="main"
Jul 30 00:44:25.272419 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:44:25.272252    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="a161f813-b20f-43a8-b5a4-762daca5c60b" containerName="payload-processing"
Jul 30 00:44:25.277255 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:44:25.277216    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-api-a-dc78bf-66c7d85bdd-f7666"
Jul 30 00:44:25.279876 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:44:25.279851    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-api-a-dc78bf-dockercfg-k554l\""
Jul 30 00:44:25.279996 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:44:25.279900    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-api-a-dc78bf\""
Jul 30 00:44:25.286520 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:44:25.286498    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-a-dc78bf-66c7d85bdd-f7666"]
Jul 30 00:44:25.288294 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:44:25.288272    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-api-a-dc78bf-78878865dd-sz5m8"]
Jul 30 00:44:25.291584 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:44:25.291566    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-api-a-dc78bf-78878865dd-sz5m8"
Jul 30 00:44:25.300982 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:44:25.300960    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-api-a-dc78bf-78878865dd-sz5m8"]
Jul 30 00:44:25.343552 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:44:25.343520    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-55wdg\" (UniqueName: \"kubernetes.io/projected/55d20fa5-3dbb-476b-8e5c-544c8cc65a55-kube-api-access-55wdg\") pod \"payload-processing-e2e-api-a-dc78bf-78878865dd-sz5m8\" (UID: \"55d20fa5-3dbb-476b-8e5c-544c8cc65a55\") " pod="openshift-ingress/payload-processing-e2e-api-a-dc78bf-78878865dd-sz5m8"
Jul 30 00:44:25.343694 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:44:25.343577    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/55d20fa5-3dbb-476b-8e5c-544c8cc65a55-plugins-config-volume\") pod \"payload-processing-e2e-api-a-dc78bf-78878865dd-sz5m8\" (UID: \"55d20fa5-3dbb-476b-8e5c-544c8cc65a55\") " pod="openshift-ingress/payload-processing-e2e-api-a-dc78bf-78878865dd-sz5m8"
Jul 30 00:44:25.343694 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:44:25.343602    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jtqbn\" (UniqueName: \"kubernetes.io/projected/57b363d4-e69c-4885-b956-1b2204501336-kube-api-access-jtqbn\") pod \"payload-pre-processing-e2e-api-a-dc78bf-66c7d85bdd-f7666\" (UID: \"57b363d4-e69c-4885-b956-1b2204501336\") " pod="openshift-ingress/payload-pre-processing-e2e-api-a-dc78bf-66c7d85bdd-f7666"
Jul 30 00:44:25.343694 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:44:25.343635    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/57b363d4-e69c-4885-b956-1b2204501336-plugins-config-volume\") pod \"payload-pre-processing-e2e-api-a-dc78bf-66c7d85bdd-f7666\" (UID: \"57b363d4-e69c-4885-b956-1b2204501336\") " pod="openshift-ingress/payload-pre-processing-e2e-api-a-dc78bf-66c7d85bdd-f7666"
Jul 30 00:44:25.444071 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:44:25.444039    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/57b363d4-e69c-4885-b956-1b2204501336-plugins-config-volume\") pod \"payload-pre-processing-e2e-api-a-dc78bf-66c7d85bdd-f7666\" (UID: \"57b363d4-e69c-4885-b956-1b2204501336\") " pod="openshift-ingress/payload-pre-processing-e2e-api-a-dc78bf-66c7d85bdd-f7666"
Jul 30 00:44:25.444232 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:44:25.444120    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-55wdg\" (UniqueName: \"kubernetes.io/projected/55d20fa5-3dbb-476b-8e5c-544c8cc65a55-kube-api-access-55wdg\") pod \"payload-processing-e2e-api-a-dc78bf-78878865dd-sz5m8\" (UID: \"55d20fa5-3dbb-476b-8e5c-544c8cc65a55\") " pod="openshift-ingress/payload-processing-e2e-api-a-dc78bf-78878865dd-sz5m8"
Jul 30 00:44:25.444232 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:44:25.444152    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/55d20fa5-3dbb-476b-8e5c-544c8cc65a55-plugins-config-volume\") pod \"payload-processing-e2e-api-a-dc78bf-78878865dd-sz5m8\" (UID: \"55d20fa5-3dbb-476b-8e5c-544c8cc65a55\") " pod="openshift-ingress/payload-processing-e2e-api-a-dc78bf-78878865dd-sz5m8"
Jul 30 00:44:25.444232 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:44:25.444172    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jtqbn\" (UniqueName: \"kubernetes.io/projected/57b363d4-e69c-4885-b956-1b2204501336-kube-api-access-jtqbn\") pod \"payload-pre-processing-e2e-api-a-dc78bf-66c7d85bdd-f7666\" (UID: \"57b363d4-e69c-4885-b956-1b2204501336\") " pod="openshift-ingress/payload-pre-processing-e2e-api-a-dc78bf-66c7d85bdd-f7666"
Jul 30 00:44:25.444964 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:44:25.444940    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/57b363d4-e69c-4885-b956-1b2204501336-plugins-config-volume\") pod \"payload-pre-processing-e2e-api-a-dc78bf-66c7d85bdd-f7666\" (UID: \"57b363d4-e69c-4885-b956-1b2204501336\") " pod="openshift-ingress/payload-pre-processing-e2e-api-a-dc78bf-66c7d85bdd-f7666"
Jul 30 00:44:25.445033 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:44:25.444940    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/55d20fa5-3dbb-476b-8e5c-544c8cc65a55-plugins-config-volume\") pod \"payload-processing-e2e-api-a-dc78bf-78878865dd-sz5m8\" (UID: \"55d20fa5-3dbb-476b-8e5c-544c8cc65a55\") " pod="openshift-ingress/payload-processing-e2e-api-a-dc78bf-78878865dd-sz5m8"
Jul 30 00:44:25.451849 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:44:25.451827    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jtqbn\" (UniqueName: \"kubernetes.io/projected/57b363d4-e69c-4885-b956-1b2204501336-kube-api-access-jtqbn\") pod \"payload-pre-processing-e2e-api-a-dc78bf-66c7d85bdd-f7666\" (UID: \"57b363d4-e69c-4885-b956-1b2204501336\") " pod="openshift-ingress/payload-pre-processing-e2e-api-a-dc78bf-66c7d85bdd-f7666"
Jul 30 00:44:25.451982 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:44:25.451961    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-55wdg\" (UniqueName: \"kubernetes.io/projected/55d20fa5-3dbb-476b-8e5c-544c8cc65a55-kube-api-access-55wdg\") pod \"payload-processing-e2e-api-a-dc78bf-78878865dd-sz5m8\" (UID: \"55d20fa5-3dbb-476b-8e5c-544c8cc65a55\") " pod="openshift-ingress/payload-processing-e2e-api-a-dc78bf-78878865dd-sz5m8"
Jul 30 00:44:25.590472 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:44:25.590391    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-api-a-dc78bf-66c7d85bdd-f7666"
Jul 30 00:44:25.601781 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:44:25.601754    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-api-a-dc78bf-78878865dd-sz5m8"
Jul 30 00:44:25.737491 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:44:25.737092    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-a-dc78bf-66c7d85bdd-f7666"]
Jul 30 00:44:25.739551 ip-10-0-133-55 kubenswrapper[2560]: W0730 00:44:25.739520    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod57b363d4_e69c_4885_b956_1b2204501336.slice/crio-a5511964b349637b252d49b27d684c9da6b30123a12f1af2660a922955592329 WatchSource:0}: Error finding container a5511964b349637b252d49b27d684c9da6b30123a12f1af2660a922955592329: Status 404 returned error can't find the container with id a5511964b349637b252d49b27d684c9da6b30123a12f1af2660a922955592329
Jul 30 00:44:25.852766 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:44:25.852682    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-api-a-dc78bf-66c7d85bdd-f7666" event={"ID":"57b363d4-e69c-4885-b956-1b2204501336","Type":"ContainerStarted","Data":"ab0bebf15903dfc3677b1e56370cbaea97f4e2d3ea018e5fca1e1341b5ab6cf4"}
Jul 30 00:44:25.852766 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:44:25.852741    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-api-a-dc78bf-66c7d85bdd-f7666" event={"ID":"57b363d4-e69c-4885-b956-1b2204501336","Type":"ContainerStarted","Data":"a5511964b349637b252d49b27d684c9da6b30123a12f1af2660a922955592329"}
Jul 30 00:44:25.852939 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:44:25.852779    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-api-a-dc78bf-66c7d85bdd-f7666"
Jul 30 00:44:25.868858 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:44:25.868810    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-api-a-dc78bf-66c7d85bdd-f7666" podStartSLOduration=0.868796766 podStartE2EDuration="868.796766ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-30 00:44:25 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 00:44:25.866969394 +0000 UTC m=+2552.926186200" watchObservedRunningTime="2026-07-30 00:44:25.868796766 +0000 UTC m=+2552.928013614"
Jul 30 00:44:25.964924 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:44:25.964902    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-api-a-dc78bf-78878865dd-sz5m8"]
Jul 30 00:44:25.966520 ip-10-0-133-55 kubenswrapper[2560]: W0730 00:44:25.966494    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod55d20fa5_3dbb_476b_8e5c_544c8cc65a55.slice/crio-d6b5a94e9393cd1ea3da82f7295f400e17d04024c478dacf2be87c6f243ccfd2 WatchSource:0}: Error finding container d6b5a94e9393cd1ea3da82f7295f400e17d04024c478dacf2be87c6f243ccfd2: Status 404 returned error can't find the container with id d6b5a94e9393cd1ea3da82f7295f400e17d04024c478dacf2be87c6f243ccfd2
Jul 30 00:44:26.859145 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:44:26.859105    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-api-a-dc78bf-78878865dd-sz5m8" event={"ID":"55d20fa5-3dbb-476b-8e5c-544c8cc65a55","Type":"ContainerStarted","Data":"3c104d6279d574c71b54ff7ed7e5e1a1858b4f399cf41ae9cc1d1e38e804d2d3"}
Jul 30 00:44:26.859590 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:44:26.859163    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-api-a-dc78bf-78878865dd-sz5m8" event={"ID":"55d20fa5-3dbb-476b-8e5c-544c8cc65a55","Type":"ContainerStarted","Data":"d6b5a94e9393cd1ea3da82f7295f400e17d04024c478dacf2be87c6f243ccfd2"}
Jul 30 00:44:26.859590 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:44:26.859190    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-api-a-dc78bf-78878865dd-sz5m8"
Jul 30 00:44:26.876661 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:44:26.876609    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-api-a-dc78bf-78878865dd-sz5m8" podStartSLOduration=1.876593437 podStartE2EDuration="1.876593437s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-30 00:44:25 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 00:44:26.875091705 +0000 UTC m=+2553.934308510" watchObservedRunningTime="2026-07-30 00:44:26.876593437 +0000 UTC m=+2553.935810255"
Jul 30 00:44:36.861092 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:44:36.861046    2560 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/payload-pre-processing-e2e-api-a-dc78bf-66c7d85bdd-f7666" podUID="57b363d4-e69c-4885-b956-1b2204501336" containerName="payload-pre-processing" probeResult="failure" output="dial tcp 10.132.0.60:9004: connect: connection refused"
Jul 30 00:44:37.866716 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:44:37.866684    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-api-a-dc78bf-78878865dd-sz5m8"
Jul 30 00:44:46.860620 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:44:46.860586    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-api-a-dc78bf-66c7d85bdd-f7666"
Jul 30 00:44:53.571453 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:44:53.571421    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-b-fb2e9f-8bcc8f984-dgxmr"]
Jul 30 00:44:53.575003 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:44:53.574986    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-api-b-fb2e9f-8bcc8f984-dgxmr"
Jul 30 00:44:53.577402 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:44:53.577379    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-api-b-fb2e9f-dockercfg-bdqf6\""
Jul 30 00:44:53.577534 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:44:53.577382    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-api-b-fb2e9f\""
Jul 30 00:44:53.584297 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:44:53.584273    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-b-fb2e9f-8bcc8f984-dgxmr"]
Jul 30 00:44:53.686633 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:44:53.686607    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-s4llr\" (UniqueName: \"kubernetes.io/projected/898db05c-e3f3-44a4-b1ae-f6c3dd9e8025-kube-api-access-s4llr\") pod \"payload-pre-processing-e2e-api-b-fb2e9f-8bcc8f984-dgxmr\" (UID: \"898db05c-e3f3-44a4-b1ae-f6c3dd9e8025\") " pod="openshift-ingress/payload-pre-processing-e2e-api-b-fb2e9f-8bcc8f984-dgxmr"
Jul 30 00:44:53.686751 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:44:53.686691    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/898db05c-e3f3-44a4-b1ae-f6c3dd9e8025-plugins-config-volume\") pod \"payload-pre-processing-e2e-api-b-fb2e9f-8bcc8f984-dgxmr\" (UID: \"898db05c-e3f3-44a4-b1ae-f6c3dd9e8025\") " pod="openshift-ingress/payload-pre-processing-e2e-api-b-fb2e9f-8bcc8f984-dgxmr"
Jul 30 00:44:53.787445 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:44:53.787410    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-s4llr\" (UniqueName: \"kubernetes.io/projected/898db05c-e3f3-44a4-b1ae-f6c3dd9e8025-kube-api-access-s4llr\") pod \"payload-pre-processing-e2e-api-b-fb2e9f-8bcc8f984-dgxmr\" (UID: \"898db05c-e3f3-44a4-b1ae-f6c3dd9e8025\") " pod="openshift-ingress/payload-pre-processing-e2e-api-b-fb2e9f-8bcc8f984-dgxmr"
Jul 30 00:44:53.787598 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:44:53.787483    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/898db05c-e3f3-44a4-b1ae-f6c3dd9e8025-plugins-config-volume\") pod \"payload-pre-processing-e2e-api-b-fb2e9f-8bcc8f984-dgxmr\" (UID: \"898db05c-e3f3-44a4-b1ae-f6c3dd9e8025\") " pod="openshift-ingress/payload-pre-processing-e2e-api-b-fb2e9f-8bcc8f984-dgxmr"
Jul 30 00:44:53.788113 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:44:53.788094    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/898db05c-e3f3-44a4-b1ae-f6c3dd9e8025-plugins-config-volume\") pod \"payload-pre-processing-e2e-api-b-fb2e9f-8bcc8f984-dgxmr\" (UID: \"898db05c-e3f3-44a4-b1ae-f6c3dd9e8025\") " pod="openshift-ingress/payload-pre-processing-e2e-api-b-fb2e9f-8bcc8f984-dgxmr"
Jul 30 00:44:53.795479 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:44:53.795452    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-s4llr\" (UniqueName: \"kubernetes.io/projected/898db05c-e3f3-44a4-b1ae-f6c3dd9e8025-kube-api-access-s4llr\") pod \"payload-pre-processing-e2e-api-b-fb2e9f-8bcc8f984-dgxmr\" (UID: \"898db05c-e3f3-44a4-b1ae-f6c3dd9e8025\") " pod="openshift-ingress/payload-pre-processing-e2e-api-b-fb2e9f-8bcc8f984-dgxmr"
Jul 30 00:44:53.885994 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:44:53.885966    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-api-b-fb2e9f-8bcc8f984-dgxmr"
Jul 30 00:44:54.019869 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:44:54.019842    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-b-fb2e9f-8bcc8f984-dgxmr"]
Jul 30 00:44:54.021851 ip-10-0-133-55 kubenswrapper[2560]: W0730 00:44:54.021824    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod898db05c_e3f3_44a4_b1ae_f6c3dd9e8025.slice/crio-107e23c0454a0814affd74683841f29b2e3c77b89436583f138eab9135de1474 WatchSource:0}: Error finding container 107e23c0454a0814affd74683841f29b2e3c77b89436583f138eab9135de1474: Status 404 returned error can't find the container with id 107e23c0454a0814affd74683841f29b2e3c77b89436583f138eab9135de1474
Jul 30 00:44:55.000689 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:44:55.000651    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-api-b-fb2e9f-8bcc8f984-dgxmr" event={"ID":"898db05c-e3f3-44a4-b1ae-f6c3dd9e8025","Type":"ContainerStarted","Data":"6ef39204db44c3ffe26148006a78d74630c1a1ee9ff64adf771d2d4ca6512b95"}
Jul 30 00:44:55.001109 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:44:55.000709    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-api-b-fb2e9f-8bcc8f984-dgxmr" event={"ID":"898db05c-e3f3-44a4-b1ae-f6c3dd9e8025","Type":"ContainerStarted","Data":"107e23c0454a0814affd74683841f29b2e3c77b89436583f138eab9135de1474"}
Jul 30 00:44:55.001109 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:44:55.000748    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-api-b-fb2e9f-8bcc8f984-dgxmr"
Jul 30 00:44:55.017998 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:44:55.017953    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-api-b-fb2e9f-8bcc8f984-dgxmr" podStartSLOduration=2.01793866 podStartE2EDuration="2.01793866s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-30 00:44:53 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 00:44:55.017583093 +0000 UTC m=+2582.076799907" watchObservedRunningTime="2026-07-30 00:44:55.01793866 +0000 UTC m=+2582.077155464"
Jul 30 00:45:06.007817 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:45:06.007781    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-api-b-fb2e9f-8bcc8f984-dgxmr"
Jul 30 00:45:35.810053 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:45:35.810017    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-api-a-dc78bf-78878865dd-sz5m8"]
Jul 30 00:45:35.810667 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:45:35.810295    2560 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-api-a-dc78bf-78878865dd-sz5m8" podUID="55d20fa5-3dbb-476b-8e5c-544c8cc65a55" containerName="payload-processing" containerID="cri-o://3c104d6279d574c71b54ff7ed7e5e1a1858b4f399cf41ae9cc1d1e38e804d2d3" gracePeriod=30
Jul 30 00:45:35.816030 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:45:35.815989    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-a-dc78bf-66c7d85bdd-f7666"]
Jul 30 00:45:35.816266 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:45:35.816193    2560 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-api-a-dc78bf-66c7d85bdd-f7666" podUID="57b363d4-e69c-4885-b956-1b2204501336" containerName="payload-pre-processing" containerID="cri-o://ab0bebf15903dfc3677b1e56370cbaea97f4e2d3ea018e5fca1e1341b5ab6cf4" gracePeriod=30
Jul 30 00:45:36.072280 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:45:36.072214    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-api-a-dc78bf-78878865dd-sz5m8"
Jul 30 00:45:36.095728 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:45:36.095704    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-api-a-dc78bf-66c7d85bdd-f7666"
Jul 30 00:45:36.146798 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:45:36.146770    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-55wdg\" (UniqueName: \"kubernetes.io/projected/55d20fa5-3dbb-476b-8e5c-544c8cc65a55-kube-api-access-55wdg\") pod \"55d20fa5-3dbb-476b-8e5c-544c8cc65a55\" (UID: \"55d20fa5-3dbb-476b-8e5c-544c8cc65a55\") "
Jul 30 00:45:36.146798 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:45:36.146800    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-jtqbn\" (UniqueName: \"kubernetes.io/projected/57b363d4-e69c-4885-b956-1b2204501336-kube-api-access-jtqbn\") pod \"57b363d4-e69c-4885-b956-1b2204501336\" (UID: \"57b363d4-e69c-4885-b956-1b2204501336\") "
Jul 30 00:45:36.147020 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:45:36.146855    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/57b363d4-e69c-4885-b956-1b2204501336-plugins-config-volume\") pod \"57b363d4-e69c-4885-b956-1b2204501336\" (UID: \"57b363d4-e69c-4885-b956-1b2204501336\") "
Jul 30 00:45:36.147020 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:45:36.146892    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/55d20fa5-3dbb-476b-8e5c-544c8cc65a55-plugins-config-volume\") pod \"55d20fa5-3dbb-476b-8e5c-544c8cc65a55\" (UID: \"55d20fa5-3dbb-476b-8e5c-544c8cc65a55\") "
Jul 30 00:45:36.147263 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:45:36.147234    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/57b363d4-e69c-4885-b956-1b2204501336-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "57b363d4-e69c-4885-b956-1b2204501336" (UID: "57b363d4-e69c-4885-b956-1b2204501336"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 30 00:45:36.147432 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:45:36.147328    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/55d20fa5-3dbb-476b-8e5c-544c8cc65a55-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "55d20fa5-3dbb-476b-8e5c-544c8cc65a55" (UID: "55d20fa5-3dbb-476b-8e5c-544c8cc65a55"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 30 00:45:36.148932 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:45:36.148910    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/55d20fa5-3dbb-476b-8e5c-544c8cc65a55-kube-api-access-55wdg" (OuterVolumeSpecName: "kube-api-access-55wdg") pod "55d20fa5-3dbb-476b-8e5c-544c8cc65a55" (UID: "55d20fa5-3dbb-476b-8e5c-544c8cc65a55"). InnerVolumeSpecName "kube-api-access-55wdg". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 30 00:45:36.149024 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:45:36.148949    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/57b363d4-e69c-4885-b956-1b2204501336-kube-api-access-jtqbn" (OuterVolumeSpecName: "kube-api-access-jtqbn") pod "57b363d4-e69c-4885-b956-1b2204501336" (UID: "57b363d4-e69c-4885-b956-1b2204501336"). InnerVolumeSpecName "kube-api-access-jtqbn". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 30 00:45:36.198359 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:45:36.198302    2560 generic.go:356] "Generic (PLEG): container finished" podID="57b363d4-e69c-4885-b956-1b2204501336" containerID="ab0bebf15903dfc3677b1e56370cbaea97f4e2d3ea018e5fca1e1341b5ab6cf4" exitCode=0
Jul 30 00:45:36.198518 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:45:36.198380    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-api-a-dc78bf-66c7d85bdd-f7666"
Jul 30 00:45:36.198518 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:45:36.198407    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-api-a-dc78bf-66c7d85bdd-f7666" event={"ID":"57b363d4-e69c-4885-b956-1b2204501336","Type":"ContainerDied","Data":"ab0bebf15903dfc3677b1e56370cbaea97f4e2d3ea018e5fca1e1341b5ab6cf4"}
Jul 30 00:45:36.198518 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:45:36.198461    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-api-a-dc78bf-66c7d85bdd-f7666" event={"ID":"57b363d4-e69c-4885-b956-1b2204501336","Type":"ContainerDied","Data":"a5511964b349637b252d49b27d684c9da6b30123a12f1af2660a922955592329"}
Jul 30 00:45:36.198518 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:45:36.198486    2560 scope.go:117] "RemoveContainer" containerID="ab0bebf15903dfc3677b1e56370cbaea97f4e2d3ea018e5fca1e1341b5ab6cf4"
Jul 30 00:45:36.199688 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:45:36.199659    2560 generic.go:356] "Generic (PLEG): container finished" podID="55d20fa5-3dbb-476b-8e5c-544c8cc65a55" containerID="3c104d6279d574c71b54ff7ed7e5e1a1858b4f399cf41ae9cc1d1e38e804d2d3" exitCode=0
Jul 30 00:45:36.199820 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:45:36.199696    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-api-a-dc78bf-78878865dd-sz5m8"
Jul 30 00:45:36.199820 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:45:36.199790    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-api-a-dc78bf-78878865dd-sz5m8" event={"ID":"55d20fa5-3dbb-476b-8e5c-544c8cc65a55","Type":"ContainerDied","Data":"3c104d6279d574c71b54ff7ed7e5e1a1858b4f399cf41ae9cc1d1e38e804d2d3"}
Jul 30 00:45:36.199954 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:45:36.199830    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-api-a-dc78bf-78878865dd-sz5m8" event={"ID":"55d20fa5-3dbb-476b-8e5c-544c8cc65a55","Type":"ContainerDied","Data":"d6b5a94e9393cd1ea3da82f7295f400e17d04024c478dacf2be87c6f243ccfd2"}
Jul 30 00:45:36.209897 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:45:36.209108    2560 scope.go:117] "RemoveContainer" containerID="ab0bebf15903dfc3677b1e56370cbaea97f4e2d3ea018e5fca1e1341b5ab6cf4"
Jul 30 00:45:36.209897 ip-10-0-133-55 kubenswrapper[2560]: E0730 00:45:36.209481    2560 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ab0bebf15903dfc3677b1e56370cbaea97f4e2d3ea018e5fca1e1341b5ab6cf4\": container with ID starting with ab0bebf15903dfc3677b1e56370cbaea97f4e2d3ea018e5fca1e1341b5ab6cf4 not found: ID does not exist" containerID="ab0bebf15903dfc3677b1e56370cbaea97f4e2d3ea018e5fca1e1341b5ab6cf4"
Jul 30 00:45:36.209897 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:45:36.209514    2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ab0bebf15903dfc3677b1e56370cbaea97f4e2d3ea018e5fca1e1341b5ab6cf4"} err="failed to get container status \"ab0bebf15903dfc3677b1e56370cbaea97f4e2d3ea018e5fca1e1341b5ab6cf4\": rpc error: code = NotFound desc = could not find container \"ab0bebf15903dfc3677b1e56370cbaea97f4e2d3ea018e5fca1e1341b5ab6cf4\": container with ID starting with ab0bebf15903dfc3677b1e56370cbaea97f4e2d3ea018e5fca1e1341b5ab6cf4 not found: ID does not exist"
Jul 30 00:45:36.209897 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:45:36.209540    2560 scope.go:117] "RemoveContainer" containerID="3c104d6279d574c71b54ff7ed7e5e1a1858b4f399cf41ae9cc1d1e38e804d2d3"
Jul 30 00:45:36.218139 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:45:36.218124    2560 scope.go:117] "RemoveContainer" containerID="3c104d6279d574c71b54ff7ed7e5e1a1858b4f399cf41ae9cc1d1e38e804d2d3"
Jul 30 00:45:36.218399 ip-10-0-133-55 kubenswrapper[2560]: E0730 00:45:36.218372    2560 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3c104d6279d574c71b54ff7ed7e5e1a1858b4f399cf41ae9cc1d1e38e804d2d3\": container with ID starting with 3c104d6279d574c71b54ff7ed7e5e1a1858b4f399cf41ae9cc1d1e38e804d2d3 not found: ID does not exist" containerID="3c104d6279d574c71b54ff7ed7e5e1a1858b4f399cf41ae9cc1d1e38e804d2d3"
Jul 30 00:45:36.218446 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:45:36.218411    2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3c104d6279d574c71b54ff7ed7e5e1a1858b4f399cf41ae9cc1d1e38e804d2d3"} err="failed to get container status \"3c104d6279d574c71b54ff7ed7e5e1a1858b4f399cf41ae9cc1d1e38e804d2d3\": rpc error: code = NotFound desc = could not find container \"3c104d6279d574c71b54ff7ed7e5e1a1858b4f399cf41ae9cc1d1e38e804d2d3\": container with ID starting with 3c104d6279d574c71b54ff7ed7e5e1a1858b4f399cf41ae9cc1d1e38e804d2d3 not found: ID does not exist"
Jul 30 00:45:36.225670 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:45:36.225650    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-a-dc78bf-66c7d85bdd-f7666"]
Jul 30 00:45:36.227493 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:45:36.227474    2560 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-a-dc78bf-66c7d85bdd-f7666"]
Jul 30 00:45:36.237384 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:45:36.237364    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-api-a-dc78bf-78878865dd-sz5m8"]
Jul 30 00:45:36.243200 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:45:36.243180    2560 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-api-a-dc78bf-78878865dd-sz5m8"]
Jul 30 00:45:36.247892 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:45:36.247874    2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-55wdg\" (UniqueName: \"kubernetes.io/projected/55d20fa5-3dbb-476b-8e5c-544c8cc65a55-kube-api-access-55wdg\") on node \"ip-10-0-133-55.ec2.internal\" DevicePath \"\""
Jul 30 00:45:36.247962 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:45:36.247894    2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-jtqbn\" (UniqueName: \"kubernetes.io/projected/57b363d4-e69c-4885-b956-1b2204501336-kube-api-access-jtqbn\") on node \"ip-10-0-133-55.ec2.internal\" DevicePath \"\""
Jul 30 00:45:36.247962 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:45:36.247904    2560 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/57b363d4-e69c-4885-b956-1b2204501336-plugins-config-volume\") on node \"ip-10-0-133-55.ec2.internal\" DevicePath \"\""
Jul 30 00:45:36.247962 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:45:36.247913    2560 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/55d20fa5-3dbb-476b-8e5c-544c8cc65a55-plugins-config-volume\") on node \"ip-10-0-133-55.ec2.internal\" DevicePath \"\""
Jul 30 00:45:37.405794 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:45:37.405762    2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="55d20fa5-3dbb-476b-8e5c-544c8cc65a55" path="/var/lib/kubelet/pods/55d20fa5-3dbb-476b-8e5c-544c8cc65a55/volumes"
Jul 30 00:45:37.406167 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:45:37.406127    2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="57b363d4-e69c-4885-b956-1b2204501336" path="/var/lib/kubelet/pods/57b363d4-e69c-4885-b956-1b2204501336/volumes"
Jul 30 00:45:42.653424 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:45:42.653387    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-fb2e9f-w7djq"]
Jul 30 00:45:42.653880 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:45:42.653750    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="57b363d4-e69c-4885-b956-1b2204501336" containerName="payload-pre-processing"
Jul 30 00:45:42.653880 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:45:42.653761    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="57b363d4-e69c-4885-b956-1b2204501336" containerName="payload-pre-processing"
Jul 30 00:45:42.653880 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:45:42.653769    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="55d20fa5-3dbb-476b-8e5c-544c8cc65a55" containerName="payload-processing"
Jul 30 00:45:42.653880 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:45:42.653776    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="55d20fa5-3dbb-476b-8e5c-544c8cc65a55" containerName="payload-processing"
Jul 30 00:45:42.653880 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:45:42.653836    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="55d20fa5-3dbb-476b-8e5c-544c8cc65a55" containerName="payload-processing"
Jul 30 00:45:42.653880 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:45:42.653847    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="57b363d4-e69c-4885-b956-1b2204501336" containerName="payload-pre-processing"
Jul 30 00:45:42.658322 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:45:42.658295    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-fb2e9f-w7djq"
Jul 30 00:45:42.661782 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:45:42.661671    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 30 00:45:42.662257 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:45:42.662230    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-t42rq\""
Jul 30 00:45:42.662913 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:45:42.662889    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-fb2e9f-w7djq"]
Jul 30 00:45:42.809341 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:45:42.809290    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/99735498-c9ef-4ebc-8bd9-075cdff3a2a7-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-api-b-fb2e9f-w7djq\" (UID: \"99735498-c9ef-4ebc-8bd9-075cdff3a2a7\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-fb2e9f-w7djq"
Jul 30 00:45:42.910521 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:45:42.910438    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/99735498-c9ef-4ebc-8bd9-075cdff3a2a7-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-api-b-fb2e9f-w7djq\" (UID: \"99735498-c9ef-4ebc-8bd9-075cdff3a2a7\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-fb2e9f-w7djq"
Jul 30 00:45:42.911054 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:45:42.911035    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/99735498-c9ef-4ebc-8bd9-075cdff3a2a7-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-api-b-fb2e9f-w7djq\" (UID: \"99735498-c9ef-4ebc-8bd9-075cdff3a2a7\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-fb2e9f-w7djq"
Jul 30 00:45:42.969932 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:45:42.969901    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-fb2e9f-w7djq"
Jul 30 00:45:43.101475 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:45:43.101445    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-fb2e9f-w7djq"]
Jul 30 00:45:43.103498 ip-10-0-133-55 kubenswrapper[2560]: W0730 00:45:43.103465    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod99735498_c9ef_4ebc_8bd9_075cdff3a2a7.slice/crio-eef4e0934283293858d75c36465e3cf48ec9f861f9fbc7ccfaa4816666e2177a WatchSource:0}: Error finding container eef4e0934283293858d75c36465e3cf48ec9f861f9fbc7ccfaa4816666e2177a: Status 404 returned error can't find the container with id eef4e0934283293858d75c36465e3cf48ec9f861f9fbc7ccfaa4816666e2177a
Jul 30 00:45:43.105356 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:45:43.105338    2560 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 30 00:45:43.238576 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:45:43.238496    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-fb2e9f-w7djq" event={"ID":"99735498-c9ef-4ebc-8bd9-075cdff3a2a7","Type":"ContainerStarted","Data":"eef4e0934283293858d75c36465e3cf48ec9f861f9fbc7ccfaa4816666e2177a"}
Jul 30 00:45:46.257429 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:45:46.257389    2560 generic.go:356] "Generic (PLEG): container finished" podID="99735498-c9ef-4ebc-8bd9-075cdff3a2a7" containerID="a11c59a53876f556ec3b013fcb1253ad1109d83c945e3ab281c6d4d32ce84d8b" exitCode=0
Jul 30 00:45:46.257819 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:45:46.257469    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-fb2e9f-w7djq" event={"ID":"99735498-c9ef-4ebc-8bd9-075cdff3a2a7","Type":"ContainerDied","Data":"a11c59a53876f556ec3b013fcb1253ad1109d83c945e3ab281c6d4d32ce84d8b"}
Jul 30 00:45:47.416724 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:45:47.416700    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-fb2e9f-w7djq"
Jul 30 00:45:47.556149 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:45:47.556057    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/99735498-c9ef-4ebc-8bd9-075cdff3a2a7-maas-api-service-ca\") pod \"99735498-c9ef-4ebc-8bd9-075cdff3a2a7\" (UID: \"99735498-c9ef-4ebc-8bd9-075cdff3a2a7\") "
Jul 30 00:45:47.556460 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:45:47.556435    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/99735498-c9ef-4ebc-8bd9-075cdff3a2a7-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "99735498-c9ef-4ebc-8bd9-075cdff3a2a7" (UID: "99735498-c9ef-4ebc-8bd9-075cdff3a2a7"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 30 00:45:47.657484 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:45:47.657450    2560 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/99735498-c9ef-4ebc-8bd9-075cdff3a2a7-maas-api-service-ca\") on node \"ip-10-0-133-55.ec2.internal\" DevicePath \"\""
Jul 30 00:45:48.268178 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:45:48.268151    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-fb2e9f-w7djq"
Jul 30 00:45:48.268178 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:45:48.268156    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-fb2e9f-w7djq" event={"ID":"99735498-c9ef-4ebc-8bd9-075cdff3a2a7","Type":"ContainerDied","Data":"eef4e0934283293858d75c36465e3cf48ec9f861f9fbc7ccfaa4816666e2177a"}
Jul 30 00:45:48.268410 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:45:48.268200    2560 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="eef4e0934283293858d75c36465e3cf48ec9f861f9fbc7ccfaa4816666e2177a"
Jul 30 00:45:58.092159 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:45:58.092122    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-b-fb2e9f-8bcc8f984-dgxmr"]
Jul 30 00:45:58.092634 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:45:58.092416    2560 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-api-b-fb2e9f-8bcc8f984-dgxmr" podUID="898db05c-e3f3-44a4-b1ae-f6c3dd9e8025" containerName="payload-pre-processing" containerID="cri-o://6ef39204db44c3ffe26148006a78d74630c1a1ee9ff64adf771d2d4ca6512b95" gracePeriod=30
Jul 30 00:45:58.216061 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:45:58.216023    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-fb2e9f-w7djq"]
Jul 30 00:45:58.220474 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:45:58.220449    2560 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-fb2e9f-w7djq"]
Jul 30 00:45:58.319890 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:45:58.319854    2560 generic.go:356] "Generic (PLEG): container finished" podID="898db05c-e3f3-44a4-b1ae-f6c3dd9e8025" containerID="6ef39204db44c3ffe26148006a78d74630c1a1ee9ff64adf771d2d4ca6512b95" exitCode=0
Jul 30 00:45:58.320083 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:45:58.319926    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-api-b-fb2e9f-8bcc8f984-dgxmr" event={"ID":"898db05c-e3f3-44a4-b1ae-f6c3dd9e8025","Type":"ContainerDied","Data":"6ef39204db44c3ffe26148006a78d74630c1a1ee9ff64adf771d2d4ca6512b95"}
Jul 30 00:45:58.352181 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:45:58.352130    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-api-b-fb2e9f-8bcc8f984-dgxmr"
Jul 30 00:45:58.452189 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:45:58.452156    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-s4llr\" (UniqueName: \"kubernetes.io/projected/898db05c-e3f3-44a4-b1ae-f6c3dd9e8025-kube-api-access-s4llr\") pod \"898db05c-e3f3-44a4-b1ae-f6c3dd9e8025\" (UID: \"898db05c-e3f3-44a4-b1ae-f6c3dd9e8025\") "
Jul 30 00:45:58.452365 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:45:58.452272    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/898db05c-e3f3-44a4-b1ae-f6c3dd9e8025-plugins-config-volume\") pod \"898db05c-e3f3-44a4-b1ae-f6c3dd9e8025\" (UID: \"898db05c-e3f3-44a4-b1ae-f6c3dd9e8025\") "
Jul 30 00:45:58.452652 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:45:58.452629    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/898db05c-e3f3-44a4-b1ae-f6c3dd9e8025-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "898db05c-e3f3-44a4-b1ae-f6c3dd9e8025" (UID: "898db05c-e3f3-44a4-b1ae-f6c3dd9e8025"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 30 00:45:58.454139 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:45:58.454112    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/898db05c-e3f3-44a4-b1ae-f6c3dd9e8025-kube-api-access-s4llr" (OuterVolumeSpecName: "kube-api-access-s4llr") pod "898db05c-e3f3-44a4-b1ae-f6c3dd9e8025" (UID: "898db05c-e3f3-44a4-b1ae-f6c3dd9e8025"). InnerVolumeSpecName "kube-api-access-s4llr". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 30 00:45:58.553408 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:45:58.553376    2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-s4llr\" (UniqueName: \"kubernetes.io/projected/898db05c-e3f3-44a4-b1ae-f6c3dd9e8025-kube-api-access-s4llr\") on node \"ip-10-0-133-55.ec2.internal\" DevicePath \"\""
Jul 30 00:45:58.553408 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:45:58.553403    2560 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/898db05c-e3f3-44a4-b1ae-f6c3dd9e8025-plugins-config-volume\") on node \"ip-10-0-133-55.ec2.internal\" DevicePath \"\""
Jul 30 00:45:59.325775 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:45:59.325743    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-api-b-fb2e9f-8bcc8f984-dgxmr"
Jul 30 00:45:59.326178 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:45:59.325746    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-api-b-fb2e9f-8bcc8f984-dgxmr" event={"ID":"898db05c-e3f3-44a4-b1ae-f6c3dd9e8025","Type":"ContainerDied","Data":"107e23c0454a0814affd74683841f29b2e3c77b89436583f138eab9135de1474"}
Jul 30 00:45:59.326178 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:45:59.325879    2560 scope.go:117] "RemoveContainer" containerID="6ef39204db44c3ffe26148006a78d74630c1a1ee9ff64adf771d2d4ca6512b95"
Jul 30 00:45:59.348296 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:45:59.348270    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-b-fb2e9f-8bcc8f984-dgxmr"]
Jul 30 00:45:59.354372 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:45:59.354350    2560 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-b-fb2e9f-8bcc8f984-dgxmr"]
Jul 30 00:45:59.404807 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:45:59.404776    2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="898db05c-e3f3-44a4-b1ae-f6c3dd9e8025" path="/var/lib/kubelet/pods/898db05c-e3f3-44a4-b1ae-f6c3dd9e8025/volumes"
Jul 30 00:45:59.405117 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:45:59.405105    2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="99735498-c9ef-4ebc-8bd9-075cdff3a2a7" path="/var/lib/kubelet/pods/99735498-c9ef-4ebc-8bd9-075cdff3a2a7/volumes"
Jul 30 00:46:09.836786 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:46:09.836751    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-a-4ef902-5cf4cc99cb-qpkvr"]
Jul 30 00:46:09.837336 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:46:09.837289    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="898db05c-e3f3-44a4-b1ae-f6c3dd9e8025" containerName="payload-pre-processing"
Jul 30 00:46:09.837438 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:46:09.837338    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="898db05c-e3f3-44a4-b1ae-f6c3dd9e8025" containerName="payload-pre-processing"
Jul 30 00:46:09.837438 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:46:09.837359    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="99735498-c9ef-4ebc-8bd9-075cdff3a2a7" containerName="revoke-keys"
Jul 30 00:46:09.837438 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:46:09.837367    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="99735498-c9ef-4ebc-8bd9-075cdff3a2a7" containerName="revoke-keys"
Jul 30 00:46:09.837591 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:46:09.837477    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="99735498-c9ef-4ebc-8bd9-075cdff3a2a7" containerName="revoke-keys"
Jul 30 00:46:09.837591 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:46:09.837494    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="898db05c-e3f3-44a4-b1ae-f6c3dd9e8025" containerName="payload-pre-processing"
Jul 30 00:46:09.840628 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:46:09.840607    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-4ef902-5cf4cc99cb-qpkvr"
Jul 30 00:46:09.843405 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:46:09.843383    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-shared-a-4ef902\""
Jul 30 00:46:09.843540 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:46:09.843387    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-shared-a-4ef902-dockercfg-kfd49\""
Jul 30 00:46:09.848039 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:46:09.848018    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zpbmq\" (UniqueName: \"kubernetes.io/projected/532c2d6c-48d3-49fa-a3e9-3ce294c162fb-kube-api-access-zpbmq\") pod \"payload-pre-processing-e2e-shared-a-4ef902-5cf4cc99cb-qpkvr\" (UID: \"532c2d6c-48d3-49fa-a3e9-3ce294c162fb\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-a-4ef902-5cf4cc99cb-qpkvr"
Jul 30 00:46:09.848211 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:46:09.848192    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/532c2d6c-48d3-49fa-a3e9-3ce294c162fb-plugins-config-volume\") pod \"payload-pre-processing-e2e-shared-a-4ef902-5cf4cc99cb-qpkvr\" (UID: \"532c2d6c-48d3-49fa-a3e9-3ce294c162fb\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-a-4ef902-5cf4cc99cb-qpkvr"
Jul 30 00:46:09.850489 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:46:09.850460    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-a-4ef902-5cf4cc99cb-qpkvr"]
Jul 30 00:46:09.870435 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:46:09.870409    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-a-4ef902-7d6ff4cc78-rzpv5"]
Jul 30 00:46:09.873824 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:46:09.873807    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-a-4ef902-7d6ff4cc78-rzpv5"
Jul 30 00:46:09.885574 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:46:09.885548    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-a-4ef902-7d6ff4cc78-rzpv5"]
Jul 30 00:46:09.948953 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:46:09.948924    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zpbmq\" (UniqueName: \"kubernetes.io/projected/532c2d6c-48d3-49fa-a3e9-3ce294c162fb-kube-api-access-zpbmq\") pod \"payload-pre-processing-e2e-shared-a-4ef902-5cf4cc99cb-qpkvr\" (UID: \"532c2d6c-48d3-49fa-a3e9-3ce294c162fb\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-a-4ef902-5cf4cc99cb-qpkvr"
Jul 30 00:46:09.949113 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:46:09.948962    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-m7mxv\" (UniqueName: \"kubernetes.io/projected/4196f26e-db36-4dbb-bc3a-cd447eb14720-kube-api-access-m7mxv\") pod \"payload-processing-e2e-shared-a-4ef902-7d6ff4cc78-rzpv5\" (UID: \"4196f26e-db36-4dbb-bc3a-cd447eb14720\") " pod="openshift-ingress/payload-processing-e2e-shared-a-4ef902-7d6ff4cc78-rzpv5"
Jul 30 00:46:09.949113 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:46:09.948983    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/532c2d6c-48d3-49fa-a3e9-3ce294c162fb-plugins-config-volume\") pod \"payload-pre-processing-e2e-shared-a-4ef902-5cf4cc99cb-qpkvr\" (UID: \"532c2d6c-48d3-49fa-a3e9-3ce294c162fb\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-a-4ef902-5cf4cc99cb-qpkvr"
Jul 30 00:46:09.949113 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:46:09.949089    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/4196f26e-db36-4dbb-bc3a-cd447eb14720-plugins-config-volume\") pod \"payload-processing-e2e-shared-a-4ef902-7d6ff4cc78-rzpv5\" (UID: \"4196f26e-db36-4dbb-bc3a-cd447eb14720\") " pod="openshift-ingress/payload-processing-e2e-shared-a-4ef902-7d6ff4cc78-rzpv5"
Jul 30 00:46:09.949819 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:46:09.949797    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/532c2d6c-48d3-49fa-a3e9-3ce294c162fb-plugins-config-volume\") pod \"payload-pre-processing-e2e-shared-a-4ef902-5cf4cc99cb-qpkvr\" (UID: \"532c2d6c-48d3-49fa-a3e9-3ce294c162fb\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-a-4ef902-5cf4cc99cb-qpkvr"
Jul 30 00:46:09.959323 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:46:09.959284    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zpbmq\" (UniqueName: \"kubernetes.io/projected/532c2d6c-48d3-49fa-a3e9-3ce294c162fb-kube-api-access-zpbmq\") pod \"payload-pre-processing-e2e-shared-a-4ef902-5cf4cc99cb-qpkvr\" (UID: \"532c2d6c-48d3-49fa-a3e9-3ce294c162fb\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-a-4ef902-5cf4cc99cb-qpkvr"
Jul 30 00:46:10.050368 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:46:10.050333    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-m7mxv\" (UniqueName: \"kubernetes.io/projected/4196f26e-db36-4dbb-bc3a-cd447eb14720-kube-api-access-m7mxv\") pod \"payload-processing-e2e-shared-a-4ef902-7d6ff4cc78-rzpv5\" (UID: \"4196f26e-db36-4dbb-bc3a-cd447eb14720\") " pod="openshift-ingress/payload-processing-e2e-shared-a-4ef902-7d6ff4cc78-rzpv5"
Jul 30 00:46:10.050565 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:46:10.050378    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/4196f26e-db36-4dbb-bc3a-cd447eb14720-plugins-config-volume\") pod \"payload-processing-e2e-shared-a-4ef902-7d6ff4cc78-rzpv5\" (UID: \"4196f26e-db36-4dbb-bc3a-cd447eb14720\") " pod="openshift-ingress/payload-processing-e2e-shared-a-4ef902-7d6ff4cc78-rzpv5"
Jul 30 00:46:10.051129 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:46:10.051101    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/4196f26e-db36-4dbb-bc3a-cd447eb14720-plugins-config-volume\") pod \"payload-processing-e2e-shared-a-4ef902-7d6ff4cc78-rzpv5\" (UID: \"4196f26e-db36-4dbb-bc3a-cd447eb14720\") " pod="openshift-ingress/payload-processing-e2e-shared-a-4ef902-7d6ff4cc78-rzpv5"
Jul 30 00:46:10.058573 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:46:10.058546    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-m7mxv\" (UniqueName: \"kubernetes.io/projected/4196f26e-db36-4dbb-bc3a-cd447eb14720-kube-api-access-m7mxv\") pod \"payload-processing-e2e-shared-a-4ef902-7d6ff4cc78-rzpv5\" (UID: \"4196f26e-db36-4dbb-bc3a-cd447eb14720\") " pod="openshift-ingress/payload-processing-e2e-shared-a-4ef902-7d6ff4cc78-rzpv5"
Jul 30 00:46:10.151173 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:46:10.151143    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-4ef902-5cf4cc99cb-qpkvr"
Jul 30 00:46:10.185428 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:46:10.185399    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-a-4ef902-7d6ff4cc78-rzpv5"
Jul 30 00:46:10.507605 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:46:10.507578    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-a-4ef902-5cf4cc99cb-qpkvr"]
Jul 30 00:46:10.509141 ip-10-0-133-55 kubenswrapper[2560]: W0730 00:46:10.509119    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod532c2d6c_48d3_49fa_a3e9_3ce294c162fb.slice/crio-145249dd231a58aae8c06ece79c0db5f8a6ca492a3cd8e9b5a65f034b1d5d547 WatchSource:0}: Error finding container 145249dd231a58aae8c06ece79c0db5f8a6ca492a3cd8e9b5a65f034b1d5d547: Status 404 returned error can't find the container with id 145249dd231a58aae8c06ece79c0db5f8a6ca492a3cd8e9b5a65f034b1d5d547
Jul 30 00:46:10.536204 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:46:10.535326    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-a-4ef902-7d6ff4cc78-rzpv5"]
Jul 30 00:46:10.539709 ip-10-0-133-55 kubenswrapper[2560]: W0730 00:46:10.539678    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4196f26e_db36_4dbb_bc3a_cd447eb14720.slice/crio-b49ff2dcd5c9673bcd68f0c1945a9a1a3608ad8c204f37d97378b3d4f6cabd8a WatchSource:0}: Error finding container b49ff2dcd5c9673bcd68f0c1945a9a1a3608ad8c204f37d97378b3d4f6cabd8a: Status 404 returned error can't find the container with id b49ff2dcd5c9673bcd68f0c1945a9a1a3608ad8c204f37d97378b3d4f6cabd8a
Jul 30 00:46:11.387182 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:46:11.387138    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-4ef902-5cf4cc99cb-qpkvr" event={"ID":"532c2d6c-48d3-49fa-a3e9-3ce294c162fb","Type":"ContainerStarted","Data":"b705df8904d81be7757f63afa1cff3c5e2c61488fb6987cd19af57af284f2cb1"}
Jul 30 00:46:11.387684 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:46:11.387202    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-4ef902-5cf4cc99cb-qpkvr" event={"ID":"532c2d6c-48d3-49fa-a3e9-3ce294c162fb","Type":"ContainerStarted","Data":"145249dd231a58aae8c06ece79c0db5f8a6ca492a3cd8e9b5a65f034b1d5d547"}
Jul 30 00:46:11.387684 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:46:11.387236    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-4ef902-5cf4cc99cb-qpkvr"
Jul 30 00:46:11.388858 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:46:11.388829    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-a-4ef902-7d6ff4cc78-rzpv5" event={"ID":"4196f26e-db36-4dbb-bc3a-cd447eb14720","Type":"ContainerStarted","Data":"d68b3653c9b082c43a18fec62c95bd21547640e04c4cd9289c190267ced07de6"}
Jul 30 00:46:11.388974 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:46:11.388884    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-shared-a-4ef902-7d6ff4cc78-rzpv5"
Jul 30 00:46:11.388974 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:46:11.388907    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-a-4ef902-7d6ff4cc78-rzpv5" event={"ID":"4196f26e-db36-4dbb-bc3a-cd447eb14720","Type":"ContainerStarted","Data":"b49ff2dcd5c9673bcd68f0c1945a9a1a3608ad8c204f37d97378b3d4f6cabd8a"}
Jul 30 00:46:11.406004 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:46:11.405955    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-4ef902-5cf4cc99cb-qpkvr" podStartSLOduration=2.405939894 podStartE2EDuration="2.405939894s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-30 00:46:09 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 00:46:11.404355576 +0000 UTC m=+2658.463572381" watchObservedRunningTime="2026-07-30 00:46:11.405939894 +0000 UTC m=+2658.465156700"
Jul 30 00:46:11.422187 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:46:11.422147    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-shared-a-4ef902-7d6ff4cc78-rzpv5" podStartSLOduration=2.422134116 podStartE2EDuration="2.422134116s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-30 00:46:09 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 00:46:11.420407252 +0000 UTC m=+2658.479624067" watchObservedRunningTime="2026-07-30 00:46:11.422134116 +0000 UTC m=+2658.481350919"
Jul 30 00:46:22.396061 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:46:22.396030    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-shared-a-4ef902-7d6ff4cc78-rzpv5"
Jul 30 00:46:22.396510 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:46:22.396104    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-4ef902-5cf4cc99cb-qpkvr"
Jul 30 00:46:37.914599 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:46:37.914566    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-b-0b2dae-5d9846886d-f9p9n"]
Jul 30 00:46:37.918159 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:46:37.918140    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-0b2dae-5d9846886d-f9p9n"
Jul 30 00:46:37.921008 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:46:37.920989    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-shared-b-0b2dae\""
Jul 30 00:46:37.929547 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:46:37.929528    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-b-0b2dae-5d9846886d-f9p9n"]
Jul 30 00:46:37.932543 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:46:37.932521    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-b-0b2dae-7fdb5b4f58-kzb8m"]
Jul 30 00:46:37.936479 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:46:37.936458    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-b-0b2dae-7fdb5b4f58-kzb8m"
Jul 30 00:46:37.939432 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:46:37.939412    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-shared-b-0b2dae-dockercfg-mmhrp\""
Jul 30 00:46:37.945630 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:46:37.945606    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-b-0b2dae-7fdb5b4f58-kzb8m"]
Jul 30 00:46:37.997690 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:46:37.997660    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-55tjs\" (UniqueName: \"kubernetes.io/projected/b489d67f-5cab-48d9-aae5-7cb0d27fbdf9-kube-api-access-55tjs\") pod \"payload-pre-processing-e2e-shared-b-0b2dae-5d9846886d-f9p9n\" (UID: \"b489d67f-5cab-48d9-aae5-7cb0d27fbdf9\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-b-0b2dae-5d9846886d-f9p9n"
Jul 30 00:46:37.997822 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:46:37.997745    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/b489d67f-5cab-48d9-aae5-7cb0d27fbdf9-plugins-config-volume\") pod \"payload-pre-processing-e2e-shared-b-0b2dae-5d9846886d-f9p9n\" (UID: \"b489d67f-5cab-48d9-aae5-7cb0d27fbdf9\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-b-0b2dae-5d9846886d-f9p9n"
Jul 30 00:46:38.099199 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:46:38.099164    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/b489d67f-5cab-48d9-aae5-7cb0d27fbdf9-plugins-config-volume\") pod \"payload-pre-processing-e2e-shared-b-0b2dae-5d9846886d-f9p9n\" (UID: \"b489d67f-5cab-48d9-aae5-7cb0d27fbdf9\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-b-0b2dae-5d9846886d-f9p9n"
Jul 30 00:46:38.099400 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:46:38.099204    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/7bbec726-d0dd-463c-81fb-57caf0182742-plugins-config-volume\") pod \"payload-processing-e2e-shared-b-0b2dae-7fdb5b4f58-kzb8m\" (UID: \"7bbec726-d0dd-463c-81fb-57caf0182742\") " pod="openshift-ingress/payload-processing-e2e-shared-b-0b2dae-7fdb5b4f58-kzb8m"
Jul 30 00:46:38.099400 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:46:38.099239    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-55tjs\" (UniqueName: \"kubernetes.io/projected/b489d67f-5cab-48d9-aae5-7cb0d27fbdf9-kube-api-access-55tjs\") pod \"payload-pre-processing-e2e-shared-b-0b2dae-5d9846886d-f9p9n\" (UID: \"b489d67f-5cab-48d9-aae5-7cb0d27fbdf9\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-b-0b2dae-5d9846886d-f9p9n"
Jul 30 00:46:38.099400 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:46:38.099262    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vnzj6\" (UniqueName: \"kubernetes.io/projected/7bbec726-d0dd-463c-81fb-57caf0182742-kube-api-access-vnzj6\") pod \"payload-processing-e2e-shared-b-0b2dae-7fdb5b4f58-kzb8m\" (UID: \"7bbec726-d0dd-463c-81fb-57caf0182742\") " pod="openshift-ingress/payload-processing-e2e-shared-b-0b2dae-7fdb5b4f58-kzb8m"
Jul 30 00:46:38.099887 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:46:38.099868    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/b489d67f-5cab-48d9-aae5-7cb0d27fbdf9-plugins-config-volume\") pod \"payload-pre-processing-e2e-shared-b-0b2dae-5d9846886d-f9p9n\" (UID: \"b489d67f-5cab-48d9-aae5-7cb0d27fbdf9\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-b-0b2dae-5d9846886d-f9p9n"
Jul 30 00:46:38.106957 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:46:38.106925    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-55tjs\" (UniqueName: \"kubernetes.io/projected/b489d67f-5cab-48d9-aae5-7cb0d27fbdf9-kube-api-access-55tjs\") pod \"payload-pre-processing-e2e-shared-b-0b2dae-5d9846886d-f9p9n\" (UID: \"b489d67f-5cab-48d9-aae5-7cb0d27fbdf9\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-b-0b2dae-5d9846886d-f9p9n"
Jul 30 00:46:38.200384 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:46:38.200270    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vnzj6\" (UniqueName: \"kubernetes.io/projected/7bbec726-d0dd-463c-81fb-57caf0182742-kube-api-access-vnzj6\") pod \"payload-processing-e2e-shared-b-0b2dae-7fdb5b4f58-kzb8m\" (UID: \"7bbec726-d0dd-463c-81fb-57caf0182742\") " pod="openshift-ingress/payload-processing-e2e-shared-b-0b2dae-7fdb5b4f58-kzb8m"
Jul 30 00:46:38.200561 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:46:38.200450    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/7bbec726-d0dd-463c-81fb-57caf0182742-plugins-config-volume\") pod \"payload-processing-e2e-shared-b-0b2dae-7fdb5b4f58-kzb8m\" (UID: \"7bbec726-d0dd-463c-81fb-57caf0182742\") " pod="openshift-ingress/payload-processing-e2e-shared-b-0b2dae-7fdb5b4f58-kzb8m"
Jul 30 00:46:38.201191 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:46:38.201172    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/7bbec726-d0dd-463c-81fb-57caf0182742-plugins-config-volume\") pod \"payload-processing-e2e-shared-b-0b2dae-7fdb5b4f58-kzb8m\" (UID: \"7bbec726-d0dd-463c-81fb-57caf0182742\") " pod="openshift-ingress/payload-processing-e2e-shared-b-0b2dae-7fdb5b4f58-kzb8m"
Jul 30 00:46:38.207696 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:46:38.207673    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vnzj6\" (UniqueName: \"kubernetes.io/projected/7bbec726-d0dd-463c-81fb-57caf0182742-kube-api-access-vnzj6\") pod \"payload-processing-e2e-shared-b-0b2dae-7fdb5b4f58-kzb8m\" (UID: \"7bbec726-d0dd-463c-81fb-57caf0182742\") " pod="openshift-ingress/payload-processing-e2e-shared-b-0b2dae-7fdb5b4f58-kzb8m"
Jul 30 00:46:38.229432 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:46:38.229410    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-0b2dae-5d9846886d-f9p9n"
Jul 30 00:46:38.248650 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:46:38.248626    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-b-0b2dae-7fdb5b4f58-kzb8m"
Jul 30 00:46:38.578078 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:46:38.578050    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-b-0b2dae-5d9846886d-f9p9n"]
Jul 30 00:46:38.580346 ip-10-0-133-55 kubenswrapper[2560]: W0730 00:46:38.580072    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb489d67f_5cab_48d9_aae5_7cb0d27fbdf9.slice/crio-1ce11276b89be4ffa101f054f6c8200b86def3741a4dabcf944b2d8518ee51a3 WatchSource:0}: Error finding container 1ce11276b89be4ffa101f054f6c8200b86def3741a4dabcf944b2d8518ee51a3: Status 404 returned error can't find the container with id 1ce11276b89be4ffa101f054f6c8200b86def3741a4dabcf944b2d8518ee51a3
Jul 30 00:46:38.607906 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:46:38.607884    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-b-0b2dae-7fdb5b4f58-kzb8m"]
Jul 30 00:46:38.614400 ip-10-0-133-55 kubenswrapper[2560]: W0730 00:46:38.614375    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7bbec726_d0dd_463c_81fb_57caf0182742.slice/crio-f3b45264af61cd8f60cd730ec5f23baacaaa21fdcb09a348617afb1f4f13e714 WatchSource:0}: Error finding container f3b45264af61cd8f60cd730ec5f23baacaaa21fdcb09a348617afb1f4f13e714: Status 404 returned error can't find the container with id f3b45264af61cd8f60cd730ec5f23baacaaa21fdcb09a348617afb1f4f13e714
Jul 30 00:46:39.529268 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:46:39.529222    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-b-0b2dae-7fdb5b4f58-kzb8m" event={"ID":"7bbec726-d0dd-463c-81fb-57caf0182742","Type":"ContainerStarted","Data":"e39982931565e0e6130409dd4b18ee659a29423a4c1939073543bd72399dd20d"}
Jul 30 00:46:39.529719 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:46:39.529293    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-b-0b2dae-7fdb5b4f58-kzb8m" event={"ID":"7bbec726-d0dd-463c-81fb-57caf0182742","Type":"ContainerStarted","Data":"f3b45264af61cd8f60cd730ec5f23baacaaa21fdcb09a348617afb1f4f13e714"}
Jul 30 00:46:39.529719 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:46:39.529351    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-shared-b-0b2dae-7fdb5b4f58-kzb8m"
Jul 30 00:46:39.530726 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:46:39.530702    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-0b2dae-5d9846886d-f9p9n" event={"ID":"b489d67f-5cab-48d9-aae5-7cb0d27fbdf9","Type":"ContainerStarted","Data":"883e2e7f9a83c834687f2632733f5fa1c0c84769373ae09ac61a06619cf05ba9"}
Jul 30 00:46:39.530854 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:46:39.530751    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-0b2dae-5d9846886d-f9p9n" event={"ID":"b489d67f-5cab-48d9-aae5-7cb0d27fbdf9","Type":"ContainerStarted","Data":"1ce11276b89be4ffa101f054f6c8200b86def3741a4dabcf944b2d8518ee51a3"}
Jul 30 00:46:39.530854 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:46:39.530779    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-0b2dae-5d9846886d-f9p9n"
Jul 30 00:46:39.545252 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:46:39.545210    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-shared-b-0b2dae-7fdb5b4f58-kzb8m" podStartSLOduration=2.5451974379999998 podStartE2EDuration="2.545197438s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-30 00:46:37 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 00:46:39.54474588 +0000 UTC m=+2686.603962684" watchObservedRunningTime="2026-07-30 00:46:39.545197438 +0000 UTC m=+2686.604414232"
Jul 30 00:46:39.560350 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:46:39.560286    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-0b2dae-5d9846886d-f9p9n" podStartSLOduration=2.56027739 podStartE2EDuration="2.56027739s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-30 00:46:37 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 00:46:39.559728705 +0000 UTC m=+2686.618945510" watchObservedRunningTime="2026-07-30 00:46:39.56027739 +0000 UTC m=+2686.619494193"
Jul 30 00:46:50.538344 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:46:50.538245    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-shared-b-0b2dae-7fdb5b4f58-kzb8m"
Jul 30 00:46:50.538833 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:46:50.538346    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-0b2dae-5d9846886d-f9p9n"
Jul 30 00:46:53.564583 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:46:53.564550    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-kchgc_324341b7-120c-4f8b-9ddd-e28b9a40ce9e/console-operator/1.log"
Jul 30 00:46:53.574162 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:46:53.574141    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-kchgc_324341b7-120c-4f8b-9ddd-e28b9a40ce9e/console-operator/1.log"
Jul 30 00:47:10.193572 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:47:10.193537    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-a-4ef902/auth-test-model-4ef902-kserve-78cb9c7fff-vbc4w"]
Jul 30 00:47:10.197271 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:47:10.197248    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-4ef902/auth-test-model-4ef902-kserve-78cb9c7fff-vbc4w"
Jul 30 00:47:10.199846 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:47:10.199825    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-a-4ef902\"/\"openshift-service-ca.crt\""
Jul 30 00:47:10.200934 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:47:10.200917    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-a-4ef902\"/\"auth-test-model-4ef902-kserve-self-signed-certs\""
Jul 30 00:47:10.200934 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:47:10.200929    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-a-4ef902\"/\"default-dockercfg-nvlpj\""
Jul 30 00:47:10.201114 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:47:10.201054    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-a-4ef902\"/\"kube-root-ca.crt\""
Jul 30 00:47:10.208181 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:47:10.208163    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-4ef902/auth-test-model-4ef902-kserve-78cb9c7fff-vbc4w"]
Jul 30 00:47:10.279087 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:47:10.279050    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2z247\" (UniqueName: \"kubernetes.io/projected/db35b352-3166-4c74-a296-0def7745dd25-kube-api-access-2z247\") pod \"auth-test-model-4ef902-kserve-78cb9c7fff-vbc4w\" (UID: \"db35b352-3166-4c74-a296-0def7745dd25\") " pod="ai-tenant-e2e-shared-a-4ef902/auth-test-model-4ef902-kserve-78cb9c7fff-vbc4w"
Jul 30 00:47:10.279253 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:47:10.279111    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/db35b352-3166-4c74-a296-0def7745dd25-tmp-dir\") pod \"auth-test-model-4ef902-kserve-78cb9c7fff-vbc4w\" (UID: \"db35b352-3166-4c74-a296-0def7745dd25\") " pod="ai-tenant-e2e-shared-a-4ef902/auth-test-model-4ef902-kserve-78cb9c7fff-vbc4w"
Jul 30 00:47:10.279253 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:47:10.279177    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/db35b352-3166-4c74-a296-0def7745dd25-dshm\") pod \"auth-test-model-4ef902-kserve-78cb9c7fff-vbc4w\" (UID: \"db35b352-3166-4c74-a296-0def7745dd25\") " pod="ai-tenant-e2e-shared-a-4ef902/auth-test-model-4ef902-kserve-78cb9c7fff-vbc4w"
Jul 30 00:47:10.279253 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:47:10.279217    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/db35b352-3166-4c74-a296-0def7745dd25-model-cache\") pod \"auth-test-model-4ef902-kserve-78cb9c7fff-vbc4w\" (UID: \"db35b352-3166-4c74-a296-0def7745dd25\") " pod="ai-tenant-e2e-shared-a-4ef902/auth-test-model-4ef902-kserve-78cb9c7fff-vbc4w"
Jul 30 00:47:10.279253 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:47:10.279253    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/db35b352-3166-4c74-a296-0def7745dd25-home\") pod \"auth-test-model-4ef902-kserve-78cb9c7fff-vbc4w\" (UID: \"db35b352-3166-4c74-a296-0def7745dd25\") " pod="ai-tenant-e2e-shared-a-4ef902/auth-test-model-4ef902-kserve-78cb9c7fff-vbc4w"
Jul 30 00:47:10.279474 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:47:10.279304    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/db35b352-3166-4c74-a296-0def7745dd25-tls-certs\") pod \"auth-test-model-4ef902-kserve-78cb9c7fff-vbc4w\" (UID: \"db35b352-3166-4c74-a296-0def7745dd25\") " pod="ai-tenant-e2e-shared-a-4ef902/auth-test-model-4ef902-kserve-78cb9c7fff-vbc4w"
Jul 30 00:47:10.379981 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:47:10.379943    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/db35b352-3166-4c74-a296-0def7745dd25-tmp-dir\") pod \"auth-test-model-4ef902-kserve-78cb9c7fff-vbc4w\" (UID: \"db35b352-3166-4c74-a296-0def7745dd25\") " pod="ai-tenant-e2e-shared-a-4ef902/auth-test-model-4ef902-kserve-78cb9c7fff-vbc4w"
Jul 30 00:47:10.380182 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:47:10.380003    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/db35b352-3166-4c74-a296-0def7745dd25-dshm\") pod \"auth-test-model-4ef902-kserve-78cb9c7fff-vbc4w\" (UID: \"db35b352-3166-4c74-a296-0def7745dd25\") " pod="ai-tenant-e2e-shared-a-4ef902/auth-test-model-4ef902-kserve-78cb9c7fff-vbc4w"
Jul 30 00:47:10.380182 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:47:10.380040    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/db35b352-3166-4c74-a296-0def7745dd25-model-cache\") pod \"auth-test-model-4ef902-kserve-78cb9c7fff-vbc4w\" (UID: \"db35b352-3166-4c74-a296-0def7745dd25\") " pod="ai-tenant-e2e-shared-a-4ef902/auth-test-model-4ef902-kserve-78cb9c7fff-vbc4w"
Jul 30 00:47:10.380182 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:47:10.380082    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/db35b352-3166-4c74-a296-0def7745dd25-home\") pod \"auth-test-model-4ef902-kserve-78cb9c7fff-vbc4w\" (UID: \"db35b352-3166-4c74-a296-0def7745dd25\") " pod="ai-tenant-e2e-shared-a-4ef902/auth-test-model-4ef902-kserve-78cb9c7fff-vbc4w"
Jul 30 00:47:10.380182 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:47:10.380140    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/db35b352-3166-4c74-a296-0def7745dd25-tls-certs\") pod \"auth-test-model-4ef902-kserve-78cb9c7fff-vbc4w\" (UID: \"db35b352-3166-4c74-a296-0def7745dd25\") " pod="ai-tenant-e2e-shared-a-4ef902/auth-test-model-4ef902-kserve-78cb9c7fff-vbc4w"
Jul 30 00:47:10.380424 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:47:10.380190    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2z247\" (UniqueName: \"kubernetes.io/projected/db35b352-3166-4c74-a296-0def7745dd25-kube-api-access-2z247\") pod \"auth-test-model-4ef902-kserve-78cb9c7fff-vbc4w\" (UID: \"db35b352-3166-4c74-a296-0def7745dd25\") " pod="ai-tenant-e2e-shared-a-4ef902/auth-test-model-4ef902-kserve-78cb9c7fff-vbc4w"
Jul 30 00:47:10.380505 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:47:10.380473    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/db35b352-3166-4c74-a296-0def7745dd25-tmp-dir\") pod \"auth-test-model-4ef902-kserve-78cb9c7fff-vbc4w\" (UID: \"db35b352-3166-4c74-a296-0def7745dd25\") " pod="ai-tenant-e2e-shared-a-4ef902/auth-test-model-4ef902-kserve-78cb9c7fff-vbc4w"
Jul 30 00:47:10.380505 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:47:10.380485    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/db35b352-3166-4c74-a296-0def7745dd25-model-cache\") pod \"auth-test-model-4ef902-kserve-78cb9c7fff-vbc4w\" (UID: \"db35b352-3166-4c74-a296-0def7745dd25\") " pod="ai-tenant-e2e-shared-a-4ef902/auth-test-model-4ef902-kserve-78cb9c7fff-vbc4w"
Jul 30 00:47:10.380626 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:47:10.380568    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/db35b352-3166-4c74-a296-0def7745dd25-home\") pod \"auth-test-model-4ef902-kserve-78cb9c7fff-vbc4w\" (UID: \"db35b352-3166-4c74-a296-0def7745dd25\") " pod="ai-tenant-e2e-shared-a-4ef902/auth-test-model-4ef902-kserve-78cb9c7fff-vbc4w"
Jul 30 00:47:10.382381 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:47:10.382361    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/db35b352-3166-4c74-a296-0def7745dd25-dshm\") pod \"auth-test-model-4ef902-kserve-78cb9c7fff-vbc4w\" (UID: \"db35b352-3166-4c74-a296-0def7745dd25\") " pod="ai-tenant-e2e-shared-a-4ef902/auth-test-model-4ef902-kserve-78cb9c7fff-vbc4w"
Jul 30 00:47:10.382668 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:47:10.382652    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/db35b352-3166-4c74-a296-0def7745dd25-tls-certs\") pod \"auth-test-model-4ef902-kserve-78cb9c7fff-vbc4w\" (UID: \"db35b352-3166-4c74-a296-0def7745dd25\") " pod="ai-tenant-e2e-shared-a-4ef902/auth-test-model-4ef902-kserve-78cb9c7fff-vbc4w"
Jul 30 00:47:10.388429 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:47:10.388407    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2z247\" (UniqueName: \"kubernetes.io/projected/db35b352-3166-4c74-a296-0def7745dd25-kube-api-access-2z247\") pod \"auth-test-model-4ef902-kserve-78cb9c7fff-vbc4w\" (UID: \"db35b352-3166-4c74-a296-0def7745dd25\") " pod="ai-tenant-e2e-shared-a-4ef902/auth-test-model-4ef902-kserve-78cb9c7fff-vbc4w"
Jul 30 00:47:10.508226 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:47:10.508128    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-4ef902/auth-test-model-4ef902-kserve-78cb9c7fff-vbc4w"
Jul 30 00:47:10.638245 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:47:10.638214    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-4ef902/auth-test-model-4ef902-kserve-78cb9c7fff-vbc4w"]
Jul 30 00:47:10.640817 ip-10-0-133-55 kubenswrapper[2560]: W0730 00:47:10.640790    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-poddb35b352_3166_4c74_a296_0def7745dd25.slice/crio-06e01557929adbaa03f8d0019311ed08dacd66cf865192562b3c901b538d36e8 WatchSource:0}: Error finding container 06e01557929adbaa03f8d0019311ed08dacd66cf865192562b3c901b538d36e8: Status 404 returned error can't find the container with id 06e01557929adbaa03f8d0019311ed08dacd66cf865192562b3c901b538d36e8
Jul 30 00:47:10.679055 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:47:10.679024    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-4ef902/auth-test-model-4ef902-kserve-78cb9c7fff-vbc4w" event={"ID":"db35b352-3166-4c74-a296-0def7745dd25","Type":"ContainerStarted","Data":"06e01557929adbaa03f8d0019311ed08dacd66cf865192562b3c901b538d36e8"}
Jul 30 00:47:11.685183 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:47:11.685144    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-4ef902/auth-test-model-4ef902-kserve-78cb9c7fff-vbc4w" event={"ID":"db35b352-3166-4c74-a296-0def7745dd25","Type":"ContainerStarted","Data":"b6c79739b7cd3252c1a5ab4c7ad2bfe08e3c439cb8942fe1edb488747d08bb23"}
Jul 30 00:47:11.702820 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:47:11.702768    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-a-4ef902/auth-test-model-4ef902-kserve-78cb9c7fff-vbc4w" podStartSLOduration=1.7027524619999999 podStartE2EDuration="1.702752462s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-30 00:47:10 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 00:47:11.7004336 +0000 UTC m=+2718.759650405" watchObservedRunningTime="2026-07-30 00:47:11.702752462 +0000 UTC m=+2718.761969266"
Jul 30 00:47:20.508742 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:47:20.508697    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-a-4ef902/auth-test-model-4ef902-kserve-78cb9c7fff-vbc4w"
Jul 30 00:47:20.508742 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:47:20.508753    2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-a-4ef902/auth-test-model-4ef902-kserve-78cb9c7fff-vbc4w"
Jul 30 00:47:20.521169 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:47:20.521142    2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-a-4ef902/auth-test-model-4ef902-kserve-78cb9c7fff-vbc4w"
Jul 30 00:47:20.740626 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:47:20.740600    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-a-4ef902/auth-test-model-4ef902-kserve-78cb9c7fff-vbc4w"
Jul 30 00:47:59.204990 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:47:59.204956    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-b-0b2dae/auth-test-model-0b2dae-kserve-5c6d7bbcd7-7wv2h"]
Jul 30 00:47:59.208895 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:47:59.208873    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-0b2dae/auth-test-model-0b2dae-kserve-5c6d7bbcd7-7wv2h"
Jul 30 00:47:59.211773 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:47:59.211748    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-0b2dae\"/\"openshift-service-ca.crt\""
Jul 30 00:47:59.212786 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:47:59.212763    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-0b2dae\"/\"kube-root-ca.crt\""
Jul 30 00:47:59.212786 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:47:59.212776    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-0b2dae\"/\"auth-test-model-0b2dae-kserve-self-signed-certs\""
Jul 30 00:47:59.212952 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:47:59.212819    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-0b2dae\"/\"default-dockercfg-64tx7\""
Jul 30 00:47:59.217493 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:47:59.217300    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-0b2dae/auth-test-model-0b2dae-kserve-5c6d7bbcd7-7wv2h"]
Jul 30 00:47:59.342456 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:47:59.342426    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vb2ll\" (UniqueName: \"kubernetes.io/projected/9e2447e2-becb-486e-b5cb-09cd6e2034a2-kube-api-access-vb2ll\") pod \"auth-test-model-0b2dae-kserve-5c6d7bbcd7-7wv2h\" (UID: \"9e2447e2-becb-486e-b5cb-09cd6e2034a2\") " pod="ai-tenant-e2e-shared-b-0b2dae/auth-test-model-0b2dae-kserve-5c6d7bbcd7-7wv2h"
Jul 30 00:47:59.342636 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:47:59.342484    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/9e2447e2-becb-486e-b5cb-09cd6e2034a2-tls-certs\") pod \"auth-test-model-0b2dae-kserve-5c6d7bbcd7-7wv2h\" (UID: \"9e2447e2-becb-486e-b5cb-09cd6e2034a2\") " pod="ai-tenant-e2e-shared-b-0b2dae/auth-test-model-0b2dae-kserve-5c6d7bbcd7-7wv2h"
Jul 30 00:47:59.342636 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:47:59.342595    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/9e2447e2-becb-486e-b5cb-09cd6e2034a2-home\") pod \"auth-test-model-0b2dae-kserve-5c6d7bbcd7-7wv2h\" (UID: \"9e2447e2-becb-486e-b5cb-09cd6e2034a2\") " pod="ai-tenant-e2e-shared-b-0b2dae/auth-test-model-0b2dae-kserve-5c6d7bbcd7-7wv2h"
Jul 30 00:47:59.342717 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:47:59.342635    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/9e2447e2-becb-486e-b5cb-09cd6e2034a2-model-cache\") pod \"auth-test-model-0b2dae-kserve-5c6d7bbcd7-7wv2h\" (UID: \"9e2447e2-becb-486e-b5cb-09cd6e2034a2\") " pod="ai-tenant-e2e-shared-b-0b2dae/auth-test-model-0b2dae-kserve-5c6d7bbcd7-7wv2h"
Jul 30 00:47:59.342717 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:47:59.342701    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/9e2447e2-becb-486e-b5cb-09cd6e2034a2-tmp-dir\") pod \"auth-test-model-0b2dae-kserve-5c6d7bbcd7-7wv2h\" (UID: \"9e2447e2-becb-486e-b5cb-09cd6e2034a2\") " pod="ai-tenant-e2e-shared-b-0b2dae/auth-test-model-0b2dae-kserve-5c6d7bbcd7-7wv2h"
Jul 30 00:47:59.342790 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:47:59.342722    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/9e2447e2-becb-486e-b5cb-09cd6e2034a2-dshm\") pod \"auth-test-model-0b2dae-kserve-5c6d7bbcd7-7wv2h\" (UID: \"9e2447e2-becb-486e-b5cb-09cd6e2034a2\") " pod="ai-tenant-e2e-shared-b-0b2dae/auth-test-model-0b2dae-kserve-5c6d7bbcd7-7wv2h"
Jul 30 00:47:59.443934 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:47:59.443904    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/9e2447e2-becb-486e-b5cb-09cd6e2034a2-tls-certs\") pod \"auth-test-model-0b2dae-kserve-5c6d7bbcd7-7wv2h\" (UID: \"9e2447e2-becb-486e-b5cb-09cd6e2034a2\") " pod="ai-tenant-e2e-shared-b-0b2dae/auth-test-model-0b2dae-kserve-5c6d7bbcd7-7wv2h"
Jul 30 00:47:59.444097 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:47:59.443957    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/9e2447e2-becb-486e-b5cb-09cd6e2034a2-home\") pod \"auth-test-model-0b2dae-kserve-5c6d7bbcd7-7wv2h\" (UID: \"9e2447e2-becb-486e-b5cb-09cd6e2034a2\") " pod="ai-tenant-e2e-shared-b-0b2dae/auth-test-model-0b2dae-kserve-5c6d7bbcd7-7wv2h"
Jul 30 00:47:59.444097 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:47:59.443981    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/9e2447e2-becb-486e-b5cb-09cd6e2034a2-model-cache\") pod \"auth-test-model-0b2dae-kserve-5c6d7bbcd7-7wv2h\" (UID: \"9e2447e2-becb-486e-b5cb-09cd6e2034a2\") " pod="ai-tenant-e2e-shared-b-0b2dae/auth-test-model-0b2dae-kserve-5c6d7bbcd7-7wv2h"
Jul 30 00:47:59.444097 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:47:59.444015    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/9e2447e2-becb-486e-b5cb-09cd6e2034a2-tmp-dir\") pod \"auth-test-model-0b2dae-kserve-5c6d7bbcd7-7wv2h\" (UID: \"9e2447e2-becb-486e-b5cb-09cd6e2034a2\") " pod="ai-tenant-e2e-shared-b-0b2dae/auth-test-model-0b2dae-kserve-5c6d7bbcd7-7wv2h"
Jul 30 00:47:59.444097 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:47:59.444032    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/9e2447e2-becb-486e-b5cb-09cd6e2034a2-dshm\") pod \"auth-test-model-0b2dae-kserve-5c6d7bbcd7-7wv2h\" (UID: \"9e2447e2-becb-486e-b5cb-09cd6e2034a2\") " pod="ai-tenant-e2e-shared-b-0b2dae/auth-test-model-0b2dae-kserve-5c6d7bbcd7-7wv2h"
Jul 30 00:47:59.444097 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:47:59.444070    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vb2ll\" (UniqueName: \"kubernetes.io/projected/9e2447e2-becb-486e-b5cb-09cd6e2034a2-kube-api-access-vb2ll\") pod \"auth-test-model-0b2dae-kserve-5c6d7bbcd7-7wv2h\" (UID: \"9e2447e2-becb-486e-b5cb-09cd6e2034a2\") " pod="ai-tenant-e2e-shared-b-0b2dae/auth-test-model-0b2dae-kserve-5c6d7bbcd7-7wv2h"
Jul 30 00:47:59.444394 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:47:59.444372    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/9e2447e2-becb-486e-b5cb-09cd6e2034a2-home\") pod \"auth-test-model-0b2dae-kserve-5c6d7bbcd7-7wv2h\" (UID: \"9e2447e2-becb-486e-b5cb-09cd6e2034a2\") " pod="ai-tenant-e2e-shared-b-0b2dae/auth-test-model-0b2dae-kserve-5c6d7bbcd7-7wv2h"
Jul 30 00:47:59.444457 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:47:59.444406    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/9e2447e2-becb-486e-b5cb-09cd6e2034a2-tmp-dir\") pod \"auth-test-model-0b2dae-kserve-5c6d7bbcd7-7wv2h\" (UID: \"9e2447e2-becb-486e-b5cb-09cd6e2034a2\") " pod="ai-tenant-e2e-shared-b-0b2dae/auth-test-model-0b2dae-kserve-5c6d7bbcd7-7wv2h"
Jul 30 00:47:59.444504 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:47:59.444458    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/9e2447e2-becb-486e-b5cb-09cd6e2034a2-model-cache\") pod \"auth-test-model-0b2dae-kserve-5c6d7bbcd7-7wv2h\" (UID: \"9e2447e2-becb-486e-b5cb-09cd6e2034a2\") " pod="ai-tenant-e2e-shared-b-0b2dae/auth-test-model-0b2dae-kserve-5c6d7bbcd7-7wv2h"
Jul 30 00:47:59.446295 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:47:59.446270    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/9e2447e2-becb-486e-b5cb-09cd6e2034a2-dshm\") pod \"auth-test-model-0b2dae-kserve-5c6d7bbcd7-7wv2h\" (UID: \"9e2447e2-becb-486e-b5cb-09cd6e2034a2\") " pod="ai-tenant-e2e-shared-b-0b2dae/auth-test-model-0b2dae-kserve-5c6d7bbcd7-7wv2h"
Jul 30 00:47:59.446546 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:47:59.446526    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/9e2447e2-becb-486e-b5cb-09cd6e2034a2-tls-certs\") pod \"auth-test-model-0b2dae-kserve-5c6d7bbcd7-7wv2h\" (UID: \"9e2447e2-becb-486e-b5cb-09cd6e2034a2\") " pod="ai-tenant-e2e-shared-b-0b2dae/auth-test-model-0b2dae-kserve-5c6d7bbcd7-7wv2h"
Jul 30 00:47:59.452193 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:47:59.452172    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vb2ll\" (UniqueName: \"kubernetes.io/projected/9e2447e2-becb-486e-b5cb-09cd6e2034a2-kube-api-access-vb2ll\") pod \"auth-test-model-0b2dae-kserve-5c6d7bbcd7-7wv2h\" (UID: \"9e2447e2-becb-486e-b5cb-09cd6e2034a2\") " pod="ai-tenant-e2e-shared-b-0b2dae/auth-test-model-0b2dae-kserve-5c6d7bbcd7-7wv2h"
Jul 30 00:47:59.520038 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:47:59.519976    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-0b2dae/auth-test-model-0b2dae-kserve-5c6d7bbcd7-7wv2h"
Jul 30 00:47:59.651399 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:47:59.651360    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-0b2dae/auth-test-model-0b2dae-kserve-5c6d7bbcd7-7wv2h"]
Jul 30 00:47:59.652672 ip-10-0-133-55 kubenswrapper[2560]: W0730 00:47:59.652650    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod9e2447e2_becb_486e_b5cb_09cd6e2034a2.slice/crio-024a0cbce1219a95aa04442979bb4fc3a0a25759a2a421e3a7dca1819d72212b WatchSource:0}: Error finding container 024a0cbce1219a95aa04442979bb4fc3a0a25759a2a421e3a7dca1819d72212b: Status 404 returned error can't find the container with id 024a0cbce1219a95aa04442979bb4fc3a0a25759a2a421e3a7dca1819d72212b
Jul 30 00:47:59.918411 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:47:59.918370    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-0b2dae/auth-test-model-0b2dae-kserve-5c6d7bbcd7-7wv2h" event={"ID":"9e2447e2-becb-486e-b5cb-09cd6e2034a2","Type":"ContainerStarted","Data":"eb0efdb1c257b93b9030d943fb8eb790174ce9f21848939c46ddb4bb90973b63"}
Jul 30 00:47:59.918584 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:47:59.918417    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-0b2dae/auth-test-model-0b2dae-kserve-5c6d7bbcd7-7wv2h" event={"ID":"9e2447e2-becb-486e-b5cb-09cd6e2034a2","Type":"ContainerStarted","Data":"024a0cbce1219a95aa04442979bb4fc3a0a25759a2a421e3a7dca1819d72212b"}
Jul 30 00:47:59.935048 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:47:59.935002    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-b-0b2dae/auth-test-model-0b2dae-kserve-5c6d7bbcd7-7wv2h" podStartSLOduration=0.93498898 podStartE2EDuration="934.98898ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-30 00:47:59 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 00:47:59.933717969 +0000 UTC m=+2766.992934772" watchObservedRunningTime="2026-07-30 00:47:59.93498898 +0000 UTC m=+2766.994205783"
Jul 30 00:48:09.520206 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:48:09.520176    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-b-0b2dae/auth-test-model-0b2dae-kserve-5c6d7bbcd7-7wv2h"
Jul 30 00:48:09.520660 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:48:09.520447    2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-b-0b2dae/auth-test-model-0b2dae-kserve-5c6d7bbcd7-7wv2h"
Jul 30 00:48:09.532708 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:48:09.532688    2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-b-0b2dae/auth-test-model-0b2dae-kserve-5c6d7bbcd7-7wv2h"
Jul 30 00:48:09.978071 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:48:09.978043    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-b-0b2dae/auth-test-model-0b2dae-kserve-5c6d7bbcd7-7wv2h"
Jul 30 00:51:53.601653 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:51:53.601585    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-kchgc_324341b7-120c-4f8b-9ddd-e28b9a40ce9e/console-operator/1.log"
Jul 30 00:51:53.614951 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:51:53.614918    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-kchgc_324341b7-120c-4f8b-9ddd-e28b9a40ce9e/console-operator/1.log"
Jul 30 00:51:53.739601 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:51:53.739572    2560 scope.go:117] "RemoveContainer" containerID="a11c59a53876f556ec3b013fcb1253ad1109d83c945e3ab281c6d4d32ce84d8b"
Jul 30 00:52:06.346209 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:52:06.346172    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-4ef902/auth-test-model-4ef902-kserve-78cb9c7fff-vbc4w"]
Jul 30 00:52:07.199896 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:52:07.199858    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-0b2dae/auth-test-model-0b2dae-kserve-5c6d7bbcd7-7wv2h"]
Jul 30 00:52:21.365965 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:52:21.365917    2560 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-shared-a-4ef902/auth-test-model-4ef902-kserve-78cb9c7fff-vbc4w" podUID="db35b352-3166-4c74-a296-0def7745dd25" containerName="main" containerID="cri-o://b6c79739b7cd3252c1a5ab4c7ad2bfe08e3c439cb8942fe1edb488747d08bb23" gracePeriod=45
Jul 30 00:52:21.619884 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:52:21.619824    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-4ef902/auth-test-model-4ef902-kserve-78cb9c7fff-vbc4w"
Jul 30 00:52:21.763656 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:52:21.763620    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-2z247\" (UniqueName: \"kubernetes.io/projected/db35b352-3166-4c74-a296-0def7745dd25-kube-api-access-2z247\") pod \"db35b352-3166-4c74-a296-0def7745dd25\" (UID: \"db35b352-3166-4c74-a296-0def7745dd25\") "
Jul 30 00:52:21.763828 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:52:21.763677    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/db35b352-3166-4c74-a296-0def7745dd25-tls-certs\") pod \"db35b352-3166-4c74-a296-0def7745dd25\" (UID: \"db35b352-3166-4c74-a296-0def7745dd25\") "
Jul 30 00:52:21.763828 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:52:21.763749    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/db35b352-3166-4c74-a296-0def7745dd25-dshm\") pod \"db35b352-3166-4c74-a296-0def7745dd25\" (UID: \"db35b352-3166-4c74-a296-0def7745dd25\") "
Jul 30 00:52:21.763828 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:52:21.763773    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/db35b352-3166-4c74-a296-0def7745dd25-model-cache\") pod \"db35b352-3166-4c74-a296-0def7745dd25\" (UID: \"db35b352-3166-4c74-a296-0def7745dd25\") "
Jul 30 00:52:21.763828 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:52:21.763806    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/db35b352-3166-4c74-a296-0def7745dd25-tmp-dir\") pod \"db35b352-3166-4c74-a296-0def7745dd25\" (UID: \"db35b352-3166-4c74-a296-0def7745dd25\") "
Jul 30 00:52:21.763991 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:52:21.763840    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/db35b352-3166-4c74-a296-0def7745dd25-home\") pod \"db35b352-3166-4c74-a296-0def7745dd25\" (UID: \"db35b352-3166-4c74-a296-0def7745dd25\") "
Jul 30 00:52:21.764132 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:52:21.764081    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/db35b352-3166-4c74-a296-0def7745dd25-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "db35b352-3166-4c74-a296-0def7745dd25" (UID: "db35b352-3166-4c74-a296-0def7745dd25"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 30 00:52:21.764132 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:52:21.764098    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/db35b352-3166-4c74-a296-0def7745dd25-model-cache" (OuterVolumeSpecName: "model-cache") pod "db35b352-3166-4c74-a296-0def7745dd25" (UID: "db35b352-3166-4c74-a296-0def7745dd25"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 30 00:52:21.764303 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:52:21.764191    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/db35b352-3166-4c74-a296-0def7745dd25-home" (OuterVolumeSpecName: "home") pod "db35b352-3166-4c74-a296-0def7745dd25" (UID: "db35b352-3166-4c74-a296-0def7745dd25"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 30 00:52:21.765962 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:52:21.765940    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/db35b352-3166-4c74-a296-0def7745dd25-dshm" (OuterVolumeSpecName: "dshm") pod "db35b352-3166-4c74-a296-0def7745dd25" (UID: "db35b352-3166-4c74-a296-0def7745dd25"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 30 00:52:21.766041 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:52:21.765996    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/db35b352-3166-4c74-a296-0def7745dd25-kube-api-access-2z247" (OuterVolumeSpecName: "kube-api-access-2z247") pod "db35b352-3166-4c74-a296-0def7745dd25" (UID: "db35b352-3166-4c74-a296-0def7745dd25"). InnerVolumeSpecName "kube-api-access-2z247". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 30 00:52:21.766087 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:52:21.766055    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/db35b352-3166-4c74-a296-0def7745dd25-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "db35b352-3166-4c74-a296-0def7745dd25" (UID: "db35b352-3166-4c74-a296-0def7745dd25"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 30 00:52:21.865478 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:52:21.865440    2560 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/db35b352-3166-4c74-a296-0def7745dd25-home\") on node \"ip-10-0-133-55.ec2.internal\" DevicePath \"\""
Jul 30 00:52:21.865478 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:52:21.865472    2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-2z247\" (UniqueName: \"kubernetes.io/projected/db35b352-3166-4c74-a296-0def7745dd25-kube-api-access-2z247\") on node \"ip-10-0-133-55.ec2.internal\" DevicePath \"\""
Jul 30 00:52:21.865478 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:52:21.865482    2560 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/db35b352-3166-4c74-a296-0def7745dd25-tls-certs\") on node \"ip-10-0-133-55.ec2.internal\" DevicePath \"\""
Jul 30 00:52:21.865478 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:52:21.865491    2560 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/db35b352-3166-4c74-a296-0def7745dd25-dshm\") on node \"ip-10-0-133-55.ec2.internal\" DevicePath \"\""
Jul 30 00:52:21.865755 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:52:21.865500    2560 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/db35b352-3166-4c74-a296-0def7745dd25-model-cache\") on node \"ip-10-0-133-55.ec2.internal\" DevicePath \"\""
Jul 30 00:52:21.865755 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:52:21.865508    2560 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/db35b352-3166-4c74-a296-0def7745dd25-tmp-dir\") on node \"ip-10-0-133-55.ec2.internal\" DevicePath \"\""
Jul 30 00:52:22.219496 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:52:22.219440    2560 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-shared-b-0b2dae/auth-test-model-0b2dae-kserve-5c6d7bbcd7-7wv2h" podUID="9e2447e2-becb-486e-b5cb-09cd6e2034a2" containerName="main" containerID="cri-o://eb0efdb1c257b93b9030d943fb8eb790174ce9f21848939c46ddb4bb90973b63" gracePeriod=45
Jul 30 00:52:22.228558 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:52:22.228530    2560 generic.go:356] "Generic (PLEG): container finished" podID="db35b352-3166-4c74-a296-0def7745dd25" containerID="b6c79739b7cd3252c1a5ab4c7ad2bfe08e3c439cb8942fe1edb488747d08bb23" exitCode=0
Jul 30 00:52:22.228681 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:52:22.228576    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-4ef902/auth-test-model-4ef902-kserve-78cb9c7fff-vbc4w"
Jul 30 00:52:22.228681 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:52:22.228608    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-4ef902/auth-test-model-4ef902-kserve-78cb9c7fff-vbc4w" event={"ID":"db35b352-3166-4c74-a296-0def7745dd25","Type":"ContainerDied","Data":"b6c79739b7cd3252c1a5ab4c7ad2bfe08e3c439cb8942fe1edb488747d08bb23"}
Jul 30 00:52:22.228681 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:52:22.228649    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-4ef902/auth-test-model-4ef902-kserve-78cb9c7fff-vbc4w" event={"ID":"db35b352-3166-4c74-a296-0def7745dd25","Type":"ContainerDied","Data":"06e01557929adbaa03f8d0019311ed08dacd66cf865192562b3c901b538d36e8"}
Jul 30 00:52:22.228681 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:52:22.228668    2560 scope.go:117] "RemoveContainer" containerID="b6c79739b7cd3252c1a5ab4c7ad2bfe08e3c439cb8942fe1edb488747d08bb23"
Jul 30 00:52:22.289002 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:52:22.288975    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-4ef902/auth-test-model-4ef902-kserve-78cb9c7fff-vbc4w"]
Jul 30 00:52:22.292415 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:52:22.292393    2560 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-a-4ef902/auth-test-model-4ef902-kserve-78cb9c7fff-vbc4w"]
Jul 30 00:52:22.330027 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:52:22.330003    2560 scope.go:117] "RemoveContainer" containerID="b6c79739b7cd3252c1a5ab4c7ad2bfe08e3c439cb8942fe1edb488747d08bb23"
Jul 30 00:52:22.330343 ip-10-0-133-55 kubenswrapper[2560]: E0730 00:52:22.330302    2560 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b6c79739b7cd3252c1a5ab4c7ad2bfe08e3c439cb8942fe1edb488747d08bb23\": container with ID starting with b6c79739b7cd3252c1a5ab4c7ad2bfe08e3c439cb8942fe1edb488747d08bb23 not found: ID does not exist" containerID="b6c79739b7cd3252c1a5ab4c7ad2bfe08e3c439cb8942fe1edb488747d08bb23"
Jul 30 00:52:22.330441 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:52:22.330348    2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b6c79739b7cd3252c1a5ab4c7ad2bfe08e3c439cb8942fe1edb488747d08bb23"} err="failed to get container status \"b6c79739b7cd3252c1a5ab4c7ad2bfe08e3c439cb8942fe1edb488747d08bb23\": rpc error: code = NotFound desc = could not find container \"b6c79739b7cd3252c1a5ab4c7ad2bfe08e3c439cb8942fe1edb488747d08bb23\": container with ID starting with b6c79739b7cd3252c1a5ab4c7ad2bfe08e3c439cb8942fe1edb488747d08bb23 not found: ID does not exist"
Jul 30 00:52:22.478005 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:52:22.477906    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-0b2dae/auth-test-model-0b2dae-kserve-5c6d7bbcd7-7wv2h"
Jul 30 00:52:22.572207 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:52:22.572180    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/9e2447e2-becb-486e-b5cb-09cd6e2034a2-tls-certs\") pod \"9e2447e2-becb-486e-b5cb-09cd6e2034a2\" (UID: \"9e2447e2-becb-486e-b5cb-09cd6e2034a2\") "
Jul 30 00:52:22.572417 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:52:22.572222    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/9e2447e2-becb-486e-b5cb-09cd6e2034a2-home\") pod \"9e2447e2-becb-486e-b5cb-09cd6e2034a2\" (UID: \"9e2447e2-becb-486e-b5cb-09cd6e2034a2\") "
Jul 30 00:52:22.572417 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:52:22.572257    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/9e2447e2-becb-486e-b5cb-09cd6e2034a2-tmp-dir\") pod \"9e2447e2-becb-486e-b5cb-09cd6e2034a2\" (UID: \"9e2447e2-becb-486e-b5cb-09cd6e2034a2\") "
Jul 30 00:52:22.572417 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:52:22.572353    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/9e2447e2-becb-486e-b5cb-09cd6e2034a2-dshm\") pod \"9e2447e2-becb-486e-b5cb-09cd6e2034a2\" (UID: \"9e2447e2-becb-486e-b5cb-09cd6e2034a2\") "
Jul 30 00:52:22.572417 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:52:22.572388    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-vb2ll\" (UniqueName: \"kubernetes.io/projected/9e2447e2-becb-486e-b5cb-09cd6e2034a2-kube-api-access-vb2ll\") pod \"9e2447e2-becb-486e-b5cb-09cd6e2034a2\" (UID: \"9e2447e2-becb-486e-b5cb-09cd6e2034a2\") "
Jul 30 00:52:22.572641 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:52:22.572465    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/9e2447e2-becb-486e-b5cb-09cd6e2034a2-model-cache\") pod \"9e2447e2-becb-486e-b5cb-09cd6e2034a2\" (UID: \"9e2447e2-becb-486e-b5cb-09cd6e2034a2\") "
Jul 30 00:52:22.572641 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:52:22.572567    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9e2447e2-becb-486e-b5cb-09cd6e2034a2-home" (OuterVolumeSpecName: "home") pod "9e2447e2-becb-486e-b5cb-09cd6e2034a2" (UID: "9e2447e2-becb-486e-b5cb-09cd6e2034a2"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 30 00:52:22.572641 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:52:22.572581    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9e2447e2-becb-486e-b5cb-09cd6e2034a2-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "9e2447e2-becb-486e-b5cb-09cd6e2034a2" (UID: "9e2447e2-becb-486e-b5cb-09cd6e2034a2"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 30 00:52:22.572813 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:52:22.572781    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9e2447e2-becb-486e-b5cb-09cd6e2034a2-model-cache" (OuterVolumeSpecName: "model-cache") pod "9e2447e2-becb-486e-b5cb-09cd6e2034a2" (UID: "9e2447e2-becb-486e-b5cb-09cd6e2034a2"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 30 00:52:22.572813 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:52:22.572798    2560 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/9e2447e2-becb-486e-b5cb-09cd6e2034a2-home\") on node \"ip-10-0-133-55.ec2.internal\" DevicePath \"\""
Jul 30 00:52:22.572974 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:52:22.572833    2560 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/9e2447e2-becb-486e-b5cb-09cd6e2034a2-tmp-dir\") on node \"ip-10-0-133-55.ec2.internal\" DevicePath \"\""
Jul 30 00:52:22.574389 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:52:22.574362    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9e2447e2-becb-486e-b5cb-09cd6e2034a2-dshm" (OuterVolumeSpecName: "dshm") pod "9e2447e2-becb-486e-b5cb-09cd6e2034a2" (UID: "9e2447e2-becb-486e-b5cb-09cd6e2034a2"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 30 00:52:22.574483 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:52:22.574430    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9e2447e2-becb-486e-b5cb-09cd6e2034a2-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "9e2447e2-becb-486e-b5cb-09cd6e2034a2" (UID: "9e2447e2-becb-486e-b5cb-09cd6e2034a2"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 30 00:52:22.574483 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:52:22.574463    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9e2447e2-becb-486e-b5cb-09cd6e2034a2-kube-api-access-vb2ll" (OuterVolumeSpecName: "kube-api-access-vb2ll") pod "9e2447e2-becb-486e-b5cb-09cd6e2034a2" (UID: "9e2447e2-becb-486e-b5cb-09cd6e2034a2"). InnerVolumeSpecName "kube-api-access-vb2ll". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 30 00:52:22.674246 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:52:22.674211    2560 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/9e2447e2-becb-486e-b5cb-09cd6e2034a2-dshm\") on node \"ip-10-0-133-55.ec2.internal\" DevicePath \"\""
Jul 30 00:52:22.674246 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:52:22.674242    2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-vb2ll\" (UniqueName: \"kubernetes.io/projected/9e2447e2-becb-486e-b5cb-09cd6e2034a2-kube-api-access-vb2ll\") on node \"ip-10-0-133-55.ec2.internal\" DevicePath \"\""
Jul 30 00:52:22.674246 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:52:22.674252    2560 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/9e2447e2-becb-486e-b5cb-09cd6e2034a2-model-cache\") on node \"ip-10-0-133-55.ec2.internal\" DevicePath \"\""
Jul 30 00:52:22.674489 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:52:22.674261    2560 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/9e2447e2-becb-486e-b5cb-09cd6e2034a2-tls-certs\") on node \"ip-10-0-133-55.ec2.internal\" DevicePath \"\""
Jul 30 00:52:23.235836 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:52:23.235804    2560 generic.go:356] "Generic (PLEG): container finished" podID="9e2447e2-becb-486e-b5cb-09cd6e2034a2" containerID="eb0efdb1c257b93b9030d943fb8eb790174ce9f21848939c46ddb4bb90973b63" exitCode=0
Jul 30 00:52:23.236021 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:52:23.235849    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-0b2dae/auth-test-model-0b2dae-kserve-5c6d7bbcd7-7wv2h"
Jul 30 00:52:23.236021 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:52:23.235890    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-0b2dae/auth-test-model-0b2dae-kserve-5c6d7bbcd7-7wv2h" event={"ID":"9e2447e2-becb-486e-b5cb-09cd6e2034a2","Type":"ContainerDied","Data":"eb0efdb1c257b93b9030d943fb8eb790174ce9f21848939c46ddb4bb90973b63"}
Jul 30 00:52:23.236021 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:52:23.235932    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-0b2dae/auth-test-model-0b2dae-kserve-5c6d7bbcd7-7wv2h" event={"ID":"9e2447e2-becb-486e-b5cb-09cd6e2034a2","Type":"ContainerDied","Data":"024a0cbce1219a95aa04442979bb4fc3a0a25759a2a421e3a7dca1819d72212b"}
Jul 30 00:52:23.236021 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:52:23.235949    2560 scope.go:117] "RemoveContainer" containerID="eb0efdb1c257b93b9030d943fb8eb790174ce9f21848939c46ddb4bb90973b63"
Jul 30 00:52:23.245207 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:52:23.245190    2560 scope.go:117] "RemoveContainer" containerID="eb0efdb1c257b93b9030d943fb8eb790174ce9f21848939c46ddb4bb90973b63"
Jul 30 00:52:23.245463 ip-10-0-133-55 kubenswrapper[2560]: E0730 00:52:23.245445    2560 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"eb0efdb1c257b93b9030d943fb8eb790174ce9f21848939c46ddb4bb90973b63\": container with ID starting with eb0efdb1c257b93b9030d943fb8eb790174ce9f21848939c46ddb4bb90973b63 not found: ID does not exist" containerID="eb0efdb1c257b93b9030d943fb8eb790174ce9f21848939c46ddb4bb90973b63"
Jul 30 00:52:23.245536 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:52:23.245469    2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"eb0efdb1c257b93b9030d943fb8eb790174ce9f21848939c46ddb4bb90973b63"} err="failed to get container status \"eb0efdb1c257b93b9030d943fb8eb790174ce9f21848939c46ddb4bb90973b63\": rpc error: code = NotFound desc = could not find container \"eb0efdb1c257b93b9030d943fb8eb790174ce9f21848939c46ddb4bb90973b63\": container with ID starting with eb0efdb1c257b93b9030d943fb8eb790174ce9f21848939c46ddb4bb90973b63 not found: ID does not exist"
Jul 30 00:52:23.257565 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:52:23.257544    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-0b2dae/auth-test-model-0b2dae-kserve-5c6d7bbcd7-7wv2h"]
Jul 30 00:52:23.261426 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:52:23.261404    2560 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-b-0b2dae/auth-test-model-0b2dae-kserve-5c6d7bbcd7-7wv2h"]
Jul 30 00:52:23.405405 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:52:23.405372    2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="9e2447e2-becb-486e-b5cb-09cd6e2034a2" path="/var/lib/kubelet/pods/9e2447e2-becb-486e-b5cb-09cd6e2034a2/volumes"
Jul 30 00:52:23.405866 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:52:23.405846    2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="db35b352-3166-4c74-a296-0def7745dd25" path="/var/lib/kubelet/pods/db35b352-3166-4c74-a296-0def7745dd25/volumes"
Jul 30 00:52:40.802177 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:52:40.802127    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-b-0b2dae/sub-test-model-0b2dae-kserve-657fdd79c9-stn6d"]
Jul 30 00:52:40.802666 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:52:40.802535    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="db35b352-3166-4c74-a296-0def7745dd25" containerName="main"
Jul 30 00:52:40.802666 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:52:40.802549    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="db35b352-3166-4c74-a296-0def7745dd25" containerName="main"
Jul 30 00:52:40.802666 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:52:40.802575    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9e2447e2-becb-486e-b5cb-09cd6e2034a2" containerName="main"
Jul 30 00:52:40.802666 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:52:40.802581    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="9e2447e2-becb-486e-b5cb-09cd6e2034a2" containerName="main"
Jul 30 00:52:40.802666 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:52:40.802640    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="db35b352-3166-4c74-a296-0def7745dd25" containerName="main"
Jul 30 00:52:40.802666 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:52:40.802648    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="9e2447e2-becb-486e-b5cb-09cd6e2034a2" containerName="main"
Jul 30 00:52:40.806141 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:52:40.806125    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-0b2dae/sub-test-model-0b2dae-kserve-657fdd79c9-stn6d"
Jul 30 00:52:40.809398 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:52:40.809375    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-0b2dae\"/\"sub-test-model-0b2dae-kserve-self-signed-certs\""
Jul 30 00:52:40.809548 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:52:40.809393    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-0b2dae\"/\"default-dockercfg-64tx7\""
Jul 30 00:52:40.809548 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:52:40.809466    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-0b2dae\"/\"kube-root-ca.crt\""
Jul 30 00:52:40.809673 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:52:40.809591    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-0b2dae\"/\"openshift-service-ca.crt\""
Jul 30 00:52:40.814996 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:52:40.814974    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-0b2dae/sub-test-model-0b2dae-kserve-657fdd79c9-stn6d"]
Jul 30 00:52:40.945401 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:52:40.945360    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/46cc2965-ac08-43eb-a481-ac17e3892e73-tmp-dir\") pod \"sub-test-model-0b2dae-kserve-657fdd79c9-stn6d\" (UID: \"46cc2965-ac08-43eb-a481-ac17e3892e73\") " pod="ai-tenant-e2e-shared-b-0b2dae/sub-test-model-0b2dae-kserve-657fdd79c9-stn6d"
Jul 30 00:52:40.945401 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:52:40.945409    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/46cc2965-ac08-43eb-a481-ac17e3892e73-dshm\") pod \"sub-test-model-0b2dae-kserve-657fdd79c9-stn6d\" (UID: \"46cc2965-ac08-43eb-a481-ac17e3892e73\") " pod="ai-tenant-e2e-shared-b-0b2dae/sub-test-model-0b2dae-kserve-657fdd79c9-stn6d"
Jul 30 00:52:40.945633 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:52:40.945486    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/46cc2965-ac08-43eb-a481-ac17e3892e73-model-cache\") pod \"sub-test-model-0b2dae-kserve-657fdd79c9-stn6d\" (UID: \"46cc2965-ac08-43eb-a481-ac17e3892e73\") " pod="ai-tenant-e2e-shared-b-0b2dae/sub-test-model-0b2dae-kserve-657fdd79c9-stn6d"
Jul 30 00:52:40.945633 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:52:40.945561    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/46cc2965-ac08-43eb-a481-ac17e3892e73-home\") pod \"sub-test-model-0b2dae-kserve-657fdd79c9-stn6d\" (UID: \"46cc2965-ac08-43eb-a481-ac17e3892e73\") " pod="ai-tenant-e2e-shared-b-0b2dae/sub-test-model-0b2dae-kserve-657fdd79c9-stn6d"
Jul 30 00:52:40.945633 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:52:40.945593    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vwd94\" (UniqueName: \"kubernetes.io/projected/46cc2965-ac08-43eb-a481-ac17e3892e73-kube-api-access-vwd94\") pod \"sub-test-model-0b2dae-kserve-657fdd79c9-stn6d\" (UID: \"46cc2965-ac08-43eb-a481-ac17e3892e73\") " pod="ai-tenant-e2e-shared-b-0b2dae/sub-test-model-0b2dae-kserve-657fdd79c9-stn6d"
Jul 30 00:52:40.945633 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:52:40.945616    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/46cc2965-ac08-43eb-a481-ac17e3892e73-tls-certs\") pod \"sub-test-model-0b2dae-kserve-657fdd79c9-stn6d\" (UID: \"46cc2965-ac08-43eb-a481-ac17e3892e73\") " pod="ai-tenant-e2e-shared-b-0b2dae/sub-test-model-0b2dae-kserve-657fdd79c9-stn6d"
Jul 30 00:52:41.047027 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:52:41.046994    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/46cc2965-ac08-43eb-a481-ac17e3892e73-model-cache\") pod \"sub-test-model-0b2dae-kserve-657fdd79c9-stn6d\" (UID: \"46cc2965-ac08-43eb-a481-ac17e3892e73\") " pod="ai-tenant-e2e-shared-b-0b2dae/sub-test-model-0b2dae-kserve-657fdd79c9-stn6d"
Jul 30 00:52:41.047202 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:52:41.047049    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/46cc2965-ac08-43eb-a481-ac17e3892e73-home\") pod \"sub-test-model-0b2dae-kserve-657fdd79c9-stn6d\" (UID: \"46cc2965-ac08-43eb-a481-ac17e3892e73\") " pod="ai-tenant-e2e-shared-b-0b2dae/sub-test-model-0b2dae-kserve-657fdd79c9-stn6d"
Jul 30 00:52:41.047202 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:52:41.047070    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vwd94\" (UniqueName: \"kubernetes.io/projected/46cc2965-ac08-43eb-a481-ac17e3892e73-kube-api-access-vwd94\") pod \"sub-test-model-0b2dae-kserve-657fdd79c9-stn6d\" (UID: \"46cc2965-ac08-43eb-a481-ac17e3892e73\") " pod="ai-tenant-e2e-shared-b-0b2dae/sub-test-model-0b2dae-kserve-657fdd79c9-stn6d"
Jul 30 00:52:41.047202 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:52:41.047098    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/46cc2965-ac08-43eb-a481-ac17e3892e73-tls-certs\") pod \"sub-test-model-0b2dae-kserve-657fdd79c9-stn6d\" (UID: \"46cc2965-ac08-43eb-a481-ac17e3892e73\") " pod="ai-tenant-e2e-shared-b-0b2dae/sub-test-model-0b2dae-kserve-657fdd79c9-stn6d"
Jul 30 00:52:41.047202 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:52:41.047154    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/46cc2965-ac08-43eb-a481-ac17e3892e73-tmp-dir\") pod \"sub-test-model-0b2dae-kserve-657fdd79c9-stn6d\" (UID: \"46cc2965-ac08-43eb-a481-ac17e3892e73\") " pod="ai-tenant-e2e-shared-b-0b2dae/sub-test-model-0b2dae-kserve-657fdd79c9-stn6d"
Jul 30 00:52:41.047202 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:52:41.047179    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/46cc2965-ac08-43eb-a481-ac17e3892e73-dshm\") pod \"sub-test-model-0b2dae-kserve-657fdd79c9-stn6d\" (UID: \"46cc2965-ac08-43eb-a481-ac17e3892e73\") " pod="ai-tenant-e2e-shared-b-0b2dae/sub-test-model-0b2dae-kserve-657fdd79c9-stn6d"
Jul 30 00:52:41.047504 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:52:41.047480    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/46cc2965-ac08-43eb-a481-ac17e3892e73-model-cache\") pod \"sub-test-model-0b2dae-kserve-657fdd79c9-stn6d\" (UID: \"46cc2965-ac08-43eb-a481-ac17e3892e73\") " pod="ai-tenant-e2e-shared-b-0b2dae/sub-test-model-0b2dae-kserve-657fdd79c9-stn6d"
Jul 30 00:52:41.047549 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:52:41.047508    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/46cc2965-ac08-43eb-a481-ac17e3892e73-home\") pod \"sub-test-model-0b2dae-kserve-657fdd79c9-stn6d\" (UID: \"46cc2965-ac08-43eb-a481-ac17e3892e73\") " pod="ai-tenant-e2e-shared-b-0b2dae/sub-test-model-0b2dae-kserve-657fdd79c9-stn6d"
Jul 30 00:52:41.047549 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:52:41.047535    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/46cc2965-ac08-43eb-a481-ac17e3892e73-tmp-dir\") pod \"sub-test-model-0b2dae-kserve-657fdd79c9-stn6d\" (UID: \"46cc2965-ac08-43eb-a481-ac17e3892e73\") " pod="ai-tenant-e2e-shared-b-0b2dae/sub-test-model-0b2dae-kserve-657fdd79c9-stn6d"
Jul 30 00:52:41.049453 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:52:41.049430    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/46cc2965-ac08-43eb-a481-ac17e3892e73-dshm\") pod \"sub-test-model-0b2dae-kserve-657fdd79c9-stn6d\" (UID: \"46cc2965-ac08-43eb-a481-ac17e3892e73\") " pod="ai-tenant-e2e-shared-b-0b2dae/sub-test-model-0b2dae-kserve-657fdd79c9-stn6d"
Jul 30 00:52:41.049667 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:52:41.049653    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/46cc2965-ac08-43eb-a481-ac17e3892e73-tls-certs\") pod \"sub-test-model-0b2dae-kserve-657fdd79c9-stn6d\" (UID: \"46cc2965-ac08-43eb-a481-ac17e3892e73\") " pod="ai-tenant-e2e-shared-b-0b2dae/sub-test-model-0b2dae-kserve-657fdd79c9-stn6d"
Jul 30 00:52:41.054567 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:52:41.054525    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vwd94\" (UniqueName: \"kubernetes.io/projected/46cc2965-ac08-43eb-a481-ac17e3892e73-kube-api-access-vwd94\") pod \"sub-test-model-0b2dae-kserve-657fdd79c9-stn6d\" (UID: \"46cc2965-ac08-43eb-a481-ac17e3892e73\") " pod="ai-tenant-e2e-shared-b-0b2dae/sub-test-model-0b2dae-kserve-657fdd79c9-stn6d"
Jul 30 00:52:41.116580 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:52:41.116550    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-0b2dae/sub-test-model-0b2dae-kserve-657fdd79c9-stn6d"
Jul 30 00:52:41.248142 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:52:41.248108    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-0b2dae/sub-test-model-0b2dae-kserve-657fdd79c9-stn6d"]
Jul 30 00:52:41.249475 ip-10-0-133-55 kubenswrapper[2560]: W0730 00:52:41.249444    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod46cc2965_ac08_43eb_a481_ac17e3892e73.slice/crio-b4d237b0c009a5d3f2268e2aff182e751b61aa2dd7f18d26bac43c5d0cac10ce WatchSource:0}: Error finding container b4d237b0c009a5d3f2268e2aff182e751b61aa2dd7f18d26bac43c5d0cac10ce: Status 404 returned error can't find the container with id b4d237b0c009a5d3f2268e2aff182e751b61aa2dd7f18d26bac43c5d0cac10ce
Jul 30 00:52:41.325709 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:52:41.325613    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-0b2dae/sub-test-model-0b2dae-kserve-657fdd79c9-stn6d" event={"ID":"46cc2965-ac08-43eb-a481-ac17e3892e73","Type":"ContainerStarted","Data":"ae18e6463d57d93eef2db27d150dec0cf8315ac763e842084603df52ed731297"}
Jul 30 00:52:41.325709 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:52:41.325678    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-0b2dae/sub-test-model-0b2dae-kserve-657fdd79c9-stn6d" event={"ID":"46cc2965-ac08-43eb-a481-ac17e3892e73","Type":"ContainerStarted","Data":"b4d237b0c009a5d3f2268e2aff182e751b61aa2dd7f18d26bac43c5d0cac10ce"}
Jul 30 00:52:41.341896 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:52:41.341848    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-b-0b2dae/sub-test-model-0b2dae-kserve-657fdd79c9-stn6d" podStartSLOduration=1.341833196 podStartE2EDuration="1.341833196s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-30 00:52:40 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 00:52:41.340151343 +0000 UTC m=+3048.399368148" watchObservedRunningTime="2026-07-30 00:52:41.341833196 +0000 UTC m=+3048.401049999"
Jul 30 00:52:51.117159 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:52:51.117065    2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-b-0b2dae/sub-test-model-0b2dae-kserve-657fdd79c9-stn6d"
Jul 30 00:52:51.117159 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:52:51.117119    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-b-0b2dae/sub-test-model-0b2dae-kserve-657fdd79c9-stn6d"
Jul 30 00:52:51.129864 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:52:51.129836    2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-b-0b2dae/sub-test-model-0b2dae-kserve-657fdd79c9-stn6d"
Jul 30 00:52:51.388091 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:52:51.388063    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-b-0b2dae/sub-test-model-0b2dae-kserve-657fdd79c9-stn6d"
Jul 30 00:53:46.924491 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:53:46.924456    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-0b2dae/sub-test-model-0b2dae-kserve-657fdd79c9-stn6d"]
Jul 30 00:54:01.943079 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:54:01.943024    2560 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-shared-b-0b2dae/sub-test-model-0b2dae-kserve-657fdd79c9-stn6d" podUID="46cc2965-ac08-43eb-a481-ac17e3892e73" containerName="main" containerID="cri-o://ae18e6463d57d93eef2db27d150dec0cf8315ac763e842084603df52ed731297" gracePeriod=45
Jul 30 00:54:02.191773 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:54:02.191744    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-0b2dae/sub-test-model-0b2dae-kserve-657fdd79c9-stn6d"
Jul 30 00:54:02.289340 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:54:02.289236    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/46cc2965-ac08-43eb-a481-ac17e3892e73-tls-certs\") pod \"46cc2965-ac08-43eb-a481-ac17e3892e73\" (UID: \"46cc2965-ac08-43eb-a481-ac17e3892e73\") "
Jul 30 00:54:02.289340 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:54:02.289280    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-vwd94\" (UniqueName: \"kubernetes.io/projected/46cc2965-ac08-43eb-a481-ac17e3892e73-kube-api-access-vwd94\") pod \"46cc2965-ac08-43eb-a481-ac17e3892e73\" (UID: \"46cc2965-ac08-43eb-a481-ac17e3892e73\") "
Jul 30 00:54:02.289340 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:54:02.289340    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/46cc2965-ac08-43eb-a481-ac17e3892e73-model-cache\") pod \"46cc2965-ac08-43eb-a481-ac17e3892e73\" (UID: \"46cc2965-ac08-43eb-a481-ac17e3892e73\") "
Jul 30 00:54:02.289585 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:54:02.289450    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/46cc2965-ac08-43eb-a481-ac17e3892e73-home\") pod \"46cc2965-ac08-43eb-a481-ac17e3892e73\" (UID: \"46cc2965-ac08-43eb-a481-ac17e3892e73\") "
Jul 30 00:54:02.289585 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:54:02.289517    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/46cc2965-ac08-43eb-a481-ac17e3892e73-dshm\") pod \"46cc2965-ac08-43eb-a481-ac17e3892e73\" (UID: \"46cc2965-ac08-43eb-a481-ac17e3892e73\") "
Jul 30 00:54:02.289701 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:54:02.289581    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/46cc2965-ac08-43eb-a481-ac17e3892e73-tmp-dir\") pod \"46cc2965-ac08-43eb-a481-ac17e3892e73\" (UID: \"46cc2965-ac08-43eb-a481-ac17e3892e73\") "
Jul 30 00:54:02.289763 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:54:02.289597    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/46cc2965-ac08-43eb-a481-ac17e3892e73-model-cache" (OuterVolumeSpecName: "model-cache") pod "46cc2965-ac08-43eb-a481-ac17e3892e73" (UID: "46cc2965-ac08-43eb-a481-ac17e3892e73"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 30 00:54:02.289818 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:54:02.289716    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/46cc2965-ac08-43eb-a481-ac17e3892e73-home" (OuterVolumeSpecName: "home") pod "46cc2965-ac08-43eb-a481-ac17e3892e73" (UID: "46cc2965-ac08-43eb-a481-ac17e3892e73"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 30 00:54:02.289909 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:54:02.289870    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/46cc2965-ac08-43eb-a481-ac17e3892e73-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "46cc2965-ac08-43eb-a481-ac17e3892e73" (UID: "46cc2965-ac08-43eb-a481-ac17e3892e73"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 30 00:54:02.290036 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:54:02.289972    2560 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/46cc2965-ac08-43eb-a481-ac17e3892e73-home\") on node \"ip-10-0-133-55.ec2.internal\" DevicePath \"\""
Jul 30 00:54:02.290036 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:54:02.289990    2560 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/46cc2965-ac08-43eb-a481-ac17e3892e73-tmp-dir\") on node \"ip-10-0-133-55.ec2.internal\" DevicePath \"\""
Jul 30 00:54:02.290036 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:54:02.290004    2560 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/46cc2965-ac08-43eb-a481-ac17e3892e73-model-cache\") on node \"ip-10-0-133-55.ec2.internal\" DevicePath \"\""
Jul 30 00:54:02.291510 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:54:02.291488    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/46cc2965-ac08-43eb-a481-ac17e3892e73-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "46cc2965-ac08-43eb-a481-ac17e3892e73" (UID: "46cc2965-ac08-43eb-a481-ac17e3892e73"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 30 00:54:02.291573 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:54:02.291505    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/46cc2965-ac08-43eb-a481-ac17e3892e73-kube-api-access-vwd94" (OuterVolumeSpecName: "kube-api-access-vwd94") pod "46cc2965-ac08-43eb-a481-ac17e3892e73" (UID: "46cc2965-ac08-43eb-a481-ac17e3892e73"). InnerVolumeSpecName "kube-api-access-vwd94". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 30 00:54:02.291623 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:54:02.291582    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/46cc2965-ac08-43eb-a481-ac17e3892e73-dshm" (OuterVolumeSpecName: "dshm") pod "46cc2965-ac08-43eb-a481-ac17e3892e73" (UID: "46cc2965-ac08-43eb-a481-ac17e3892e73"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 30 00:54:02.390906 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:54:02.390868    2560 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/46cc2965-ac08-43eb-a481-ac17e3892e73-dshm\") on node \"ip-10-0-133-55.ec2.internal\" DevicePath \"\""
Jul 30 00:54:02.390906 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:54:02.390898    2560 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/46cc2965-ac08-43eb-a481-ac17e3892e73-tls-certs\") on node \"ip-10-0-133-55.ec2.internal\" DevicePath \"\""
Jul 30 00:54:02.390906 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:54:02.390910    2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-vwd94\" (UniqueName: \"kubernetes.io/projected/46cc2965-ac08-43eb-a481-ac17e3892e73-kube-api-access-vwd94\") on node \"ip-10-0-133-55.ec2.internal\" DevicePath \"\""
Jul 30 00:54:02.720412 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:54:02.720377    2560 generic.go:356] "Generic (PLEG): container finished" podID="46cc2965-ac08-43eb-a481-ac17e3892e73" containerID="ae18e6463d57d93eef2db27d150dec0cf8315ac763e842084603df52ed731297" exitCode=0
Jul 30 00:54:02.720604 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:54:02.720422    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-0b2dae/sub-test-model-0b2dae-kserve-657fdd79c9-stn6d"
Jul 30 00:54:02.720604 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:54:02.720458    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-0b2dae/sub-test-model-0b2dae-kserve-657fdd79c9-stn6d" event={"ID":"46cc2965-ac08-43eb-a481-ac17e3892e73","Type":"ContainerDied","Data":"ae18e6463d57d93eef2db27d150dec0cf8315ac763e842084603df52ed731297"}
Jul 30 00:54:02.720604 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:54:02.720500    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-0b2dae/sub-test-model-0b2dae-kserve-657fdd79c9-stn6d" event={"ID":"46cc2965-ac08-43eb-a481-ac17e3892e73","Type":"ContainerDied","Data":"b4d237b0c009a5d3f2268e2aff182e751b61aa2dd7f18d26bac43c5d0cac10ce"}
Jul 30 00:54:02.720604 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:54:02.720516    2560 scope.go:117] "RemoveContainer" containerID="ae18e6463d57d93eef2db27d150dec0cf8315ac763e842084603df52ed731297"
Jul 30 00:54:02.729864 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:54:02.729843    2560 scope.go:117] "RemoveContainer" containerID="ae18e6463d57d93eef2db27d150dec0cf8315ac763e842084603df52ed731297"
Jul 30 00:54:02.730136 ip-10-0-133-55 kubenswrapper[2560]: E0730 00:54:02.730115    2560 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ae18e6463d57d93eef2db27d150dec0cf8315ac763e842084603df52ed731297\": container with ID starting with ae18e6463d57d93eef2db27d150dec0cf8315ac763e842084603df52ed731297 not found: ID does not exist" containerID="ae18e6463d57d93eef2db27d150dec0cf8315ac763e842084603df52ed731297"
Jul 30 00:54:02.730209 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:54:02.730145    2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ae18e6463d57d93eef2db27d150dec0cf8315ac763e842084603df52ed731297"} err="failed to get container status \"ae18e6463d57d93eef2db27d150dec0cf8315ac763e842084603df52ed731297\": rpc error: code = NotFound desc = could not find container \"ae18e6463d57d93eef2db27d150dec0cf8315ac763e842084603df52ed731297\": container with ID starting with ae18e6463d57d93eef2db27d150dec0cf8315ac763e842084603df52ed731297 not found: ID does not exist"
Jul 30 00:54:02.743104 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:54:02.743085    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-0b2dae/sub-test-model-0b2dae-kserve-657fdd79c9-stn6d"]
Jul 30 00:54:02.755856 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:54:02.750449    2560 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-b-0b2dae/sub-test-model-0b2dae-kserve-657fdd79c9-stn6d"]
Jul 30 00:54:03.405668 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:54:03.405631    2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="46cc2965-ac08-43eb-a481-ac17e3892e73" path="/var/lib/kubelet/pods/46cc2965-ac08-43eb-a481-ac17e3892e73/volumes"
Jul 30 00:54:07.208075 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:54:07.208038    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-a-4ef902/rate-test-model-4ef902-kserve-697777b7-mg26f"]
Jul 30 00:54:07.208476 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:54:07.208464    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="46cc2965-ac08-43eb-a481-ac17e3892e73" containerName="main"
Jul 30 00:54:07.208519 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:54:07.208479    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="46cc2965-ac08-43eb-a481-ac17e3892e73" containerName="main"
Jul 30 00:54:07.208577 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:54:07.208565    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="46cc2965-ac08-43eb-a481-ac17e3892e73" containerName="main"
Jul 30 00:54:07.211355 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:54:07.211339    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-4ef902/rate-test-model-4ef902-kserve-697777b7-mg26f"
Jul 30 00:54:07.213871 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:54:07.213849    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-a-4ef902\"/\"kube-root-ca.crt\""
Jul 30 00:54:07.214010 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:54:07.213990    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-a-4ef902\"/\"default-dockercfg-nvlpj\""
Jul 30 00:54:07.214085 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:54:07.213990    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-a-4ef902\"/\"rate-test-model-4ef902-kserve-self-signed-certs\""
Jul 30 00:54:07.214085 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:54:07.214027    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-a-4ef902\"/\"openshift-service-ca.crt\""
Jul 30 00:54:07.219751 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:54:07.219727    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-4ef902/rate-test-model-4ef902-kserve-697777b7-mg26f"]
Jul 30 00:54:07.336401 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:54:07.336369    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/32e19fad-1985-4351-8f91-29de459a9173-home\") pod \"rate-test-model-4ef902-kserve-697777b7-mg26f\" (UID: \"32e19fad-1985-4351-8f91-29de459a9173\") " pod="ai-tenant-e2e-shared-a-4ef902/rate-test-model-4ef902-kserve-697777b7-mg26f"
Jul 30 00:54:07.336401 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:54:07.336404    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/32e19fad-1985-4351-8f91-29de459a9173-dshm\") pod \"rate-test-model-4ef902-kserve-697777b7-mg26f\" (UID: \"32e19fad-1985-4351-8f91-29de459a9173\") " pod="ai-tenant-e2e-shared-a-4ef902/rate-test-model-4ef902-kserve-697777b7-mg26f"
Jul 30 00:54:07.336679 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:54:07.336448    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/32e19fad-1985-4351-8f91-29de459a9173-model-cache\") pod \"rate-test-model-4ef902-kserve-697777b7-mg26f\" (UID: \"32e19fad-1985-4351-8f91-29de459a9173\") " pod="ai-tenant-e2e-shared-a-4ef902/rate-test-model-4ef902-kserve-697777b7-mg26f"
Jul 30 00:54:07.336679 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:54:07.336487    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/32e19fad-1985-4351-8f91-29de459a9173-tmp-dir\") pod \"rate-test-model-4ef902-kserve-697777b7-mg26f\" (UID: \"32e19fad-1985-4351-8f91-29de459a9173\") " pod="ai-tenant-e2e-shared-a-4ef902/rate-test-model-4ef902-kserve-697777b7-mg26f"
Jul 30 00:54:07.336679 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:54:07.336502    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/32e19fad-1985-4351-8f91-29de459a9173-tls-certs\") pod \"rate-test-model-4ef902-kserve-697777b7-mg26f\" (UID: \"32e19fad-1985-4351-8f91-29de459a9173\") " pod="ai-tenant-e2e-shared-a-4ef902/rate-test-model-4ef902-kserve-697777b7-mg26f"
Jul 30 00:54:07.336679 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:54:07.336617    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2dvqd\" (UniqueName: \"kubernetes.io/projected/32e19fad-1985-4351-8f91-29de459a9173-kube-api-access-2dvqd\") pod \"rate-test-model-4ef902-kserve-697777b7-mg26f\" (UID: \"32e19fad-1985-4351-8f91-29de459a9173\") " pod="ai-tenant-e2e-shared-a-4ef902/rate-test-model-4ef902-kserve-697777b7-mg26f"
Jul 30 00:54:07.437374 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:54:07.437328    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/32e19fad-1985-4351-8f91-29de459a9173-model-cache\") pod \"rate-test-model-4ef902-kserve-697777b7-mg26f\" (UID: \"32e19fad-1985-4351-8f91-29de459a9173\") " pod="ai-tenant-e2e-shared-a-4ef902/rate-test-model-4ef902-kserve-697777b7-mg26f"
Jul 30 00:54:07.437374 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:54:07.437376    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/32e19fad-1985-4351-8f91-29de459a9173-tmp-dir\") pod \"rate-test-model-4ef902-kserve-697777b7-mg26f\" (UID: \"32e19fad-1985-4351-8f91-29de459a9173\") " pod="ai-tenant-e2e-shared-a-4ef902/rate-test-model-4ef902-kserve-697777b7-mg26f"
Jul 30 00:54:07.437639 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:54:07.437395    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/32e19fad-1985-4351-8f91-29de459a9173-tls-certs\") pod \"rate-test-model-4ef902-kserve-697777b7-mg26f\" (UID: \"32e19fad-1985-4351-8f91-29de459a9173\") " pod="ai-tenant-e2e-shared-a-4ef902/rate-test-model-4ef902-kserve-697777b7-mg26f"
Jul 30 00:54:07.437639 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:54:07.437439    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2dvqd\" (UniqueName: \"kubernetes.io/projected/32e19fad-1985-4351-8f91-29de459a9173-kube-api-access-2dvqd\") pod \"rate-test-model-4ef902-kserve-697777b7-mg26f\" (UID: \"32e19fad-1985-4351-8f91-29de459a9173\") " pod="ai-tenant-e2e-shared-a-4ef902/rate-test-model-4ef902-kserve-697777b7-mg26f"
Jul 30 00:54:07.437639 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:54:07.437465    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/32e19fad-1985-4351-8f91-29de459a9173-home\") pod \"rate-test-model-4ef902-kserve-697777b7-mg26f\" (UID: \"32e19fad-1985-4351-8f91-29de459a9173\") " pod="ai-tenant-e2e-shared-a-4ef902/rate-test-model-4ef902-kserve-697777b7-mg26f"
Jul 30 00:54:07.437639 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:54:07.437484    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/32e19fad-1985-4351-8f91-29de459a9173-dshm\") pod \"rate-test-model-4ef902-kserve-697777b7-mg26f\" (UID: \"32e19fad-1985-4351-8f91-29de459a9173\") " pod="ai-tenant-e2e-shared-a-4ef902/rate-test-model-4ef902-kserve-697777b7-mg26f"
Jul 30 00:54:07.437861 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:54:07.437747    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/32e19fad-1985-4351-8f91-29de459a9173-tmp-dir\") pod \"rate-test-model-4ef902-kserve-697777b7-mg26f\" (UID: \"32e19fad-1985-4351-8f91-29de459a9173\") " pod="ai-tenant-e2e-shared-a-4ef902/rate-test-model-4ef902-kserve-697777b7-mg26f"
Jul 30 00:54:07.437861 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:54:07.437822    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/32e19fad-1985-4351-8f91-29de459a9173-model-cache\") pod \"rate-test-model-4ef902-kserve-697777b7-mg26f\" (UID: \"32e19fad-1985-4351-8f91-29de459a9173\") " pod="ai-tenant-e2e-shared-a-4ef902/rate-test-model-4ef902-kserve-697777b7-mg26f"
Jul 30 00:54:07.437940 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:54:07.437855    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/32e19fad-1985-4351-8f91-29de459a9173-home\") pod \"rate-test-model-4ef902-kserve-697777b7-mg26f\" (UID: \"32e19fad-1985-4351-8f91-29de459a9173\") " pod="ai-tenant-e2e-shared-a-4ef902/rate-test-model-4ef902-kserve-697777b7-mg26f"
Jul 30 00:54:07.439733 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:54:07.439712    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/32e19fad-1985-4351-8f91-29de459a9173-dshm\") pod \"rate-test-model-4ef902-kserve-697777b7-mg26f\" (UID: \"32e19fad-1985-4351-8f91-29de459a9173\") " pod="ai-tenant-e2e-shared-a-4ef902/rate-test-model-4ef902-kserve-697777b7-mg26f"
Jul 30 00:54:07.439985 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:54:07.439968    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/32e19fad-1985-4351-8f91-29de459a9173-tls-certs\") pod \"rate-test-model-4ef902-kserve-697777b7-mg26f\" (UID: \"32e19fad-1985-4351-8f91-29de459a9173\") " pod="ai-tenant-e2e-shared-a-4ef902/rate-test-model-4ef902-kserve-697777b7-mg26f"
Jul 30 00:54:07.445389 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:54:07.445368    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2dvqd\" (UniqueName: \"kubernetes.io/projected/32e19fad-1985-4351-8f91-29de459a9173-kube-api-access-2dvqd\") pod \"rate-test-model-4ef902-kserve-697777b7-mg26f\" (UID: \"32e19fad-1985-4351-8f91-29de459a9173\") " pod="ai-tenant-e2e-shared-a-4ef902/rate-test-model-4ef902-kserve-697777b7-mg26f"
Jul 30 00:54:07.521613 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:54:07.521529    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-4ef902/rate-test-model-4ef902-kserve-697777b7-mg26f"
Jul 30 00:54:07.651452 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:54:07.651427    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-4ef902/rate-test-model-4ef902-kserve-697777b7-mg26f"]
Jul 30 00:54:07.653417 ip-10-0-133-55 kubenswrapper[2560]: W0730 00:54:07.653375    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod32e19fad_1985_4351_8f91_29de459a9173.slice/crio-7ca57ed74f134c281fccd754f0ebfb8e00ab3b1be5e00bf4ac3986f502db3abc WatchSource:0}: Error finding container 7ca57ed74f134c281fccd754f0ebfb8e00ab3b1be5e00bf4ac3986f502db3abc: Status 404 returned error can't find the container with id 7ca57ed74f134c281fccd754f0ebfb8e00ab3b1be5e00bf4ac3986f502db3abc
Jul 30 00:54:07.747238 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:54:07.747191    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-4ef902/rate-test-model-4ef902-kserve-697777b7-mg26f" event={"ID":"32e19fad-1985-4351-8f91-29de459a9173","Type":"ContainerStarted","Data":"08df7e036fc8355b3e2f41e3f6c504c41f78bb1e2927f039f077dcf9864f5420"}
Jul 30 00:54:07.747238 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:54:07.747235    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-4ef902/rate-test-model-4ef902-kserve-697777b7-mg26f" event={"ID":"32e19fad-1985-4351-8f91-29de459a9173","Type":"ContainerStarted","Data":"7ca57ed74f134c281fccd754f0ebfb8e00ab3b1be5e00bf4ac3986f502db3abc"}
Jul 30 00:54:07.763900 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:54:07.763848    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-a-4ef902/rate-test-model-4ef902-kserve-697777b7-mg26f" podStartSLOduration=0.763832835 podStartE2EDuration="763.832835ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-30 00:54:07 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 00:54:07.762923307 +0000 UTC m=+3134.822140113" watchObservedRunningTime="2026-07-30 00:54:07.763832835 +0000 UTC m=+3134.823049639"
Jul 30 00:54:17.522021 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:54:17.521981    2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-a-4ef902/rate-test-model-4ef902-kserve-697777b7-mg26f"
Jul 30 00:54:17.522021 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:54:17.522036    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-a-4ef902/rate-test-model-4ef902-kserve-697777b7-mg26f"
Jul 30 00:54:17.535021 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:54:17.534993    2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-a-4ef902/rate-test-model-4ef902-kserve-697777b7-mg26f"
Jul 30 00:54:17.814952 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:54:17.814870    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-a-4ef902/rate-test-model-4ef902-kserve-697777b7-mg26f"
Jul 30 00:54:36.409280 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:54:36.409244    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-b-0b2dae/rate-test-model-0b2dae-kserve-5c5bf9b68c-h4vsn"]
Jul 30 00:54:36.412811 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:54:36.412791    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-0b2dae/rate-test-model-0b2dae-kserve-5c5bf9b68c-h4vsn"
Jul 30 00:54:36.415284 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:54:36.415264    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-0b2dae\"/\"openshift-service-ca.crt\""
Jul 30 00:54:36.416280 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:54:36.416260    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-0b2dae\"/\"kube-root-ca.crt\""
Jul 30 00:54:36.416422 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:54:36.416262    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-0b2dae\"/\"default-dockercfg-64tx7\""
Jul 30 00:54:36.416422 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:54:36.416386    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-0b2dae\"/\"rate-test-model-0b2dae-kserve-self-signed-certs\""
Jul 30 00:54:36.421279 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:54:36.421248    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-0b2dae/rate-test-model-0b2dae-kserve-5c5bf9b68c-h4vsn"]
Jul 30 00:54:36.498701 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:54:36.498665    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/5867a7dc-3fb0-49d8-8bd2-31f6cd2da675-model-cache\") pod \"rate-test-model-0b2dae-kserve-5c5bf9b68c-h4vsn\" (UID: \"5867a7dc-3fb0-49d8-8bd2-31f6cd2da675\") " pod="ai-tenant-e2e-shared-b-0b2dae/rate-test-model-0b2dae-kserve-5c5bf9b68c-h4vsn"
Jul 30 00:54:36.498868 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:54:36.498709    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/5867a7dc-3fb0-49d8-8bd2-31f6cd2da675-dshm\") pod \"rate-test-model-0b2dae-kserve-5c5bf9b68c-h4vsn\" (UID: \"5867a7dc-3fb0-49d8-8bd2-31f6cd2da675\") " pod="ai-tenant-e2e-shared-b-0b2dae/rate-test-model-0b2dae-kserve-5c5bf9b68c-h4vsn"
Jul 30 00:54:36.498868 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:54:36.498728    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/5867a7dc-3fb0-49d8-8bd2-31f6cd2da675-tls-certs\") pod \"rate-test-model-0b2dae-kserve-5c5bf9b68c-h4vsn\" (UID: \"5867a7dc-3fb0-49d8-8bd2-31f6cd2da675\") " pod="ai-tenant-e2e-shared-b-0b2dae/rate-test-model-0b2dae-kserve-5c5bf9b68c-h4vsn"
Jul 30 00:54:36.498868 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:54:36.498803    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sjtcm\" (UniqueName: \"kubernetes.io/projected/5867a7dc-3fb0-49d8-8bd2-31f6cd2da675-kube-api-access-sjtcm\") pod \"rate-test-model-0b2dae-kserve-5c5bf9b68c-h4vsn\" (UID: \"5867a7dc-3fb0-49d8-8bd2-31f6cd2da675\") " pod="ai-tenant-e2e-shared-b-0b2dae/rate-test-model-0b2dae-kserve-5c5bf9b68c-h4vsn"
Jul 30 00:54:36.498868 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:54:36.498852    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/5867a7dc-3fb0-49d8-8bd2-31f6cd2da675-home\") pod \"rate-test-model-0b2dae-kserve-5c5bf9b68c-h4vsn\" (UID: \"5867a7dc-3fb0-49d8-8bd2-31f6cd2da675\") " pod="ai-tenant-e2e-shared-b-0b2dae/rate-test-model-0b2dae-kserve-5c5bf9b68c-h4vsn"
Jul 30 00:54:36.499080 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:54:36.498942    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/5867a7dc-3fb0-49d8-8bd2-31f6cd2da675-tmp-dir\") pod \"rate-test-model-0b2dae-kserve-5c5bf9b68c-h4vsn\" (UID: \"5867a7dc-3fb0-49d8-8bd2-31f6cd2da675\") " pod="ai-tenant-e2e-shared-b-0b2dae/rate-test-model-0b2dae-kserve-5c5bf9b68c-h4vsn"
Jul 30 00:54:36.600002 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:54:36.599973    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/5867a7dc-3fb0-49d8-8bd2-31f6cd2da675-model-cache\") pod \"rate-test-model-0b2dae-kserve-5c5bf9b68c-h4vsn\" (UID: \"5867a7dc-3fb0-49d8-8bd2-31f6cd2da675\") " pod="ai-tenant-e2e-shared-b-0b2dae/rate-test-model-0b2dae-kserve-5c5bf9b68c-h4vsn"
Jul 30 00:54:36.600182 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:54:36.600016    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/5867a7dc-3fb0-49d8-8bd2-31f6cd2da675-dshm\") pod \"rate-test-model-0b2dae-kserve-5c5bf9b68c-h4vsn\" (UID: \"5867a7dc-3fb0-49d8-8bd2-31f6cd2da675\") " pod="ai-tenant-e2e-shared-b-0b2dae/rate-test-model-0b2dae-kserve-5c5bf9b68c-h4vsn"
Jul 30 00:54:36.600182 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:54:36.600035    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/5867a7dc-3fb0-49d8-8bd2-31f6cd2da675-tls-certs\") pod \"rate-test-model-0b2dae-kserve-5c5bf9b68c-h4vsn\" (UID: \"5867a7dc-3fb0-49d8-8bd2-31f6cd2da675\") " pod="ai-tenant-e2e-shared-b-0b2dae/rate-test-model-0b2dae-kserve-5c5bf9b68c-h4vsn"
Jul 30 00:54:36.600182 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:54:36.600059    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sjtcm\" (UniqueName: \"kubernetes.io/projected/5867a7dc-3fb0-49d8-8bd2-31f6cd2da675-kube-api-access-sjtcm\") pod \"rate-test-model-0b2dae-kserve-5c5bf9b68c-h4vsn\" (UID: \"5867a7dc-3fb0-49d8-8bd2-31f6cd2da675\") " pod="ai-tenant-e2e-shared-b-0b2dae/rate-test-model-0b2dae-kserve-5c5bf9b68c-h4vsn"
Jul 30 00:54:36.600182 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:54:36.600090    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/5867a7dc-3fb0-49d8-8bd2-31f6cd2da675-home\") pod \"rate-test-model-0b2dae-kserve-5c5bf9b68c-h4vsn\" (UID: \"5867a7dc-3fb0-49d8-8bd2-31f6cd2da675\") " pod="ai-tenant-e2e-shared-b-0b2dae/rate-test-model-0b2dae-kserve-5c5bf9b68c-h4vsn"
Jul 30 00:54:36.600182 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:54:36.600122    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/5867a7dc-3fb0-49d8-8bd2-31f6cd2da675-tmp-dir\") pod \"rate-test-model-0b2dae-kserve-5c5bf9b68c-h4vsn\" (UID: \"5867a7dc-3fb0-49d8-8bd2-31f6cd2da675\") " pod="ai-tenant-e2e-shared-b-0b2dae/rate-test-model-0b2dae-kserve-5c5bf9b68c-h4vsn"
Jul 30 00:54:36.600500 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:54:36.600436    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/5867a7dc-3fb0-49d8-8bd2-31f6cd2da675-model-cache\") pod \"rate-test-model-0b2dae-kserve-5c5bf9b68c-h4vsn\" (UID: \"5867a7dc-3fb0-49d8-8bd2-31f6cd2da675\") " pod="ai-tenant-e2e-shared-b-0b2dae/rate-test-model-0b2dae-kserve-5c5bf9b68c-h4vsn"
Jul 30 00:54:36.600551 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:54:36.600499    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/5867a7dc-3fb0-49d8-8bd2-31f6cd2da675-home\") pod \"rate-test-model-0b2dae-kserve-5c5bf9b68c-h4vsn\" (UID: \"5867a7dc-3fb0-49d8-8bd2-31f6cd2da675\") " pod="ai-tenant-e2e-shared-b-0b2dae/rate-test-model-0b2dae-kserve-5c5bf9b68c-h4vsn"
Jul 30 00:54:36.600551 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:54:36.600540    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/5867a7dc-3fb0-49d8-8bd2-31f6cd2da675-tmp-dir\") pod \"rate-test-model-0b2dae-kserve-5c5bf9b68c-h4vsn\" (UID: \"5867a7dc-3fb0-49d8-8bd2-31f6cd2da675\") " pod="ai-tenant-e2e-shared-b-0b2dae/rate-test-model-0b2dae-kserve-5c5bf9b68c-h4vsn"
Jul 30 00:54:36.602361 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:54:36.602339    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/5867a7dc-3fb0-49d8-8bd2-31f6cd2da675-dshm\") pod \"rate-test-model-0b2dae-kserve-5c5bf9b68c-h4vsn\" (UID: \"5867a7dc-3fb0-49d8-8bd2-31f6cd2da675\") " pod="ai-tenant-e2e-shared-b-0b2dae/rate-test-model-0b2dae-kserve-5c5bf9b68c-h4vsn"
Jul 30 00:54:36.602644 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:54:36.602625    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/5867a7dc-3fb0-49d8-8bd2-31f6cd2da675-tls-certs\") pod \"rate-test-model-0b2dae-kserve-5c5bf9b68c-h4vsn\" (UID: \"5867a7dc-3fb0-49d8-8bd2-31f6cd2da675\") " pod="ai-tenant-e2e-shared-b-0b2dae/rate-test-model-0b2dae-kserve-5c5bf9b68c-h4vsn"
Jul 30 00:54:36.607684 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:54:36.607657    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-sjtcm\" (UniqueName: \"kubernetes.io/projected/5867a7dc-3fb0-49d8-8bd2-31f6cd2da675-kube-api-access-sjtcm\") pod \"rate-test-model-0b2dae-kserve-5c5bf9b68c-h4vsn\" (UID: \"5867a7dc-3fb0-49d8-8bd2-31f6cd2da675\") " pod="ai-tenant-e2e-shared-b-0b2dae/rate-test-model-0b2dae-kserve-5c5bf9b68c-h4vsn"
Jul 30 00:54:36.724502 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:54:36.724421    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-0b2dae/rate-test-model-0b2dae-kserve-5c5bf9b68c-h4vsn"
Jul 30 00:54:36.852700 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:54:36.852669    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-0b2dae/rate-test-model-0b2dae-kserve-5c5bf9b68c-h4vsn"]
Jul 30 00:54:36.855953 ip-10-0-133-55 kubenswrapper[2560]: W0730 00:54:36.855924    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod5867a7dc_3fb0_49d8_8bd2_31f6cd2da675.slice/crio-37f44dd5a38d04d382ac52cef01e9c4327f04b43ef6df9ee6aca33fc80eadeee WatchSource:0}: Error finding container 37f44dd5a38d04d382ac52cef01e9c4327f04b43ef6df9ee6aca33fc80eadeee: Status 404 returned error can't find the container with id 37f44dd5a38d04d382ac52cef01e9c4327f04b43ef6df9ee6aca33fc80eadeee
Jul 30 00:54:36.896989 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:54:36.896961    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-0b2dae/rate-test-model-0b2dae-kserve-5c5bf9b68c-h4vsn" event={"ID":"5867a7dc-3fb0-49d8-8bd2-31f6cd2da675","Type":"ContainerStarted","Data":"37f44dd5a38d04d382ac52cef01e9c4327f04b43ef6df9ee6aca33fc80eadeee"}
Jul 30 00:54:37.903902 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:54:37.903862    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-0b2dae/rate-test-model-0b2dae-kserve-5c5bf9b68c-h4vsn" event={"ID":"5867a7dc-3fb0-49d8-8bd2-31f6cd2da675","Type":"ContainerStarted","Data":"e0f671fd570521a4048ea185fc448bf8745ca6e9332d1fcde18116f1c8464b7e"}
Jul 30 00:54:37.921008 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:54:37.920961    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-b-0b2dae/rate-test-model-0b2dae-kserve-5c5bf9b68c-h4vsn" podStartSLOduration=1.920944055 podStartE2EDuration="1.920944055s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-30 00:54:36 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 00:54:37.919194254 +0000 UTC m=+3164.978411061" watchObservedRunningTime="2026-07-30 00:54:37.920944055 +0000 UTC m=+3164.980160859"
Jul 30 00:54:46.724903 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:54:46.724868    2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-b-0b2dae/rate-test-model-0b2dae-kserve-5c5bf9b68c-h4vsn"
Jul 30 00:54:46.725501 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:54:46.724914    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-b-0b2dae/rate-test-model-0b2dae-kserve-5c5bf9b68c-h4vsn"
Jul 30 00:54:46.737045 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:54:46.737022    2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-b-0b2dae/rate-test-model-0b2dae-kserve-5c5bf9b68c-h4vsn"
Jul 30 00:54:46.965080 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:54:46.965052    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-b-0b2dae/rate-test-model-0b2dae-kserve-5c5bf9b68c-h4vsn"
Jul 30 00:55:58.712557 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:55:58.712524    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-4ef902/rate-test-model-4ef902-kserve-697777b7-mg26f"]
Jul 30 00:55:59.505590 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:55:59.505557    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-0b2dae/rate-test-model-0b2dae-kserve-5c5bf9b68c-h4vsn"]
Jul 30 00:56:13.731438 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:56:13.731373    2560 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-shared-a-4ef902/rate-test-model-4ef902-kserve-697777b7-mg26f" podUID="32e19fad-1985-4351-8f91-29de459a9173" containerName="main" containerID="cri-o://08df7e036fc8355b3e2f41e3f6c504c41f78bb1e2927f039f077dcf9864f5420" gracePeriod=45
Jul 30 00:56:13.986190 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:56:13.986137    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-4ef902/rate-test-model-4ef902-kserve-697777b7-mg26f"
Jul 30 00:56:14.104805 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:56:14.104770    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/32e19fad-1985-4351-8f91-29de459a9173-tmp-dir\") pod \"32e19fad-1985-4351-8f91-29de459a9173\" (UID: \"32e19fad-1985-4351-8f91-29de459a9173\") "
Jul 30 00:56:14.105000 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:56:14.104815    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/32e19fad-1985-4351-8f91-29de459a9173-model-cache\") pod \"32e19fad-1985-4351-8f91-29de459a9173\" (UID: \"32e19fad-1985-4351-8f91-29de459a9173\") "
Jul 30 00:56:14.105000 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:56:14.104845    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-2dvqd\" (UniqueName: \"kubernetes.io/projected/32e19fad-1985-4351-8f91-29de459a9173-kube-api-access-2dvqd\") pod \"32e19fad-1985-4351-8f91-29de459a9173\" (UID: \"32e19fad-1985-4351-8f91-29de459a9173\") "
Jul 30 00:56:14.105000 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:56:14.104913    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/32e19fad-1985-4351-8f91-29de459a9173-home\") pod \"32e19fad-1985-4351-8f91-29de459a9173\" (UID: \"32e19fad-1985-4351-8f91-29de459a9173\") "
Jul 30 00:56:14.105000 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:56:14.104971    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/32e19fad-1985-4351-8f91-29de459a9173-dshm\") pod \"32e19fad-1985-4351-8f91-29de459a9173\" (UID: \"32e19fad-1985-4351-8f91-29de459a9173\") "
Jul 30 00:56:14.105210 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:56:14.105006    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/32e19fad-1985-4351-8f91-29de459a9173-tls-certs\") pod \"32e19fad-1985-4351-8f91-29de459a9173\" (UID: \"32e19fad-1985-4351-8f91-29de459a9173\") "
Jul 30 00:56:14.105210 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:56:14.105110    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/32e19fad-1985-4351-8f91-29de459a9173-model-cache" (OuterVolumeSpecName: "model-cache") pod "32e19fad-1985-4351-8f91-29de459a9173" (UID: "32e19fad-1985-4351-8f91-29de459a9173"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 30 00:56:14.105210 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:56:14.105117    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/32e19fad-1985-4351-8f91-29de459a9173-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "32e19fad-1985-4351-8f91-29de459a9173" (UID: "32e19fad-1985-4351-8f91-29de459a9173"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 30 00:56:14.105402 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:56:14.105256    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/32e19fad-1985-4351-8f91-29de459a9173-home" (OuterVolumeSpecName: "home") pod "32e19fad-1985-4351-8f91-29de459a9173" (UID: "32e19fad-1985-4351-8f91-29de459a9173"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 30 00:56:14.105402 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:56:14.105361    2560 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/32e19fad-1985-4351-8f91-29de459a9173-tmp-dir\") on node \"ip-10-0-133-55.ec2.internal\" DevicePath \"\""
Jul 30 00:56:14.105402 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:56:14.105381    2560 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/32e19fad-1985-4351-8f91-29de459a9173-model-cache\") on node \"ip-10-0-133-55.ec2.internal\" DevicePath \"\""
Jul 30 00:56:14.107027 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:56:14.107006    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/32e19fad-1985-4351-8f91-29de459a9173-dshm" (OuterVolumeSpecName: "dshm") pod "32e19fad-1985-4351-8f91-29de459a9173" (UID: "32e19fad-1985-4351-8f91-29de459a9173"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 30 00:56:14.107091 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:56:14.107030    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/32e19fad-1985-4351-8f91-29de459a9173-kube-api-access-2dvqd" (OuterVolumeSpecName: "kube-api-access-2dvqd") pod "32e19fad-1985-4351-8f91-29de459a9173" (UID: "32e19fad-1985-4351-8f91-29de459a9173"). InnerVolumeSpecName "kube-api-access-2dvqd". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 30 00:56:14.107129 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:56:14.107096    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/32e19fad-1985-4351-8f91-29de459a9173-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "32e19fad-1985-4351-8f91-29de459a9173" (UID: "32e19fad-1985-4351-8f91-29de459a9173"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 30 00:56:14.206013 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:56:14.205981    2560 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/32e19fad-1985-4351-8f91-29de459a9173-dshm\") on node \"ip-10-0-133-55.ec2.internal\" DevicePath \"\""
Jul 30 00:56:14.206013 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:56:14.206007    2560 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/32e19fad-1985-4351-8f91-29de459a9173-tls-certs\") on node \"ip-10-0-133-55.ec2.internal\" DevicePath \"\""
Jul 30 00:56:14.206013 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:56:14.206017    2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-2dvqd\" (UniqueName: \"kubernetes.io/projected/32e19fad-1985-4351-8f91-29de459a9173-kube-api-access-2dvqd\") on node \"ip-10-0-133-55.ec2.internal\" DevicePath \"\""
Jul 30 00:56:14.206266 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:56:14.206027    2560 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/32e19fad-1985-4351-8f91-29de459a9173-home\") on node \"ip-10-0-133-55.ec2.internal\" DevicePath \"\""
Jul 30 00:56:14.392596 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:56:14.392565    2560 generic.go:356] "Generic (PLEG): container finished" podID="32e19fad-1985-4351-8f91-29de459a9173" containerID="08df7e036fc8355b3e2f41e3f6c504c41f78bb1e2927f039f077dcf9864f5420" exitCode=0
Jul 30 00:56:14.392766 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:56:14.392616    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-4ef902/rate-test-model-4ef902-kserve-697777b7-mg26f"
Jul 30 00:56:14.392766 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:56:14.392656    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-4ef902/rate-test-model-4ef902-kserve-697777b7-mg26f" event={"ID":"32e19fad-1985-4351-8f91-29de459a9173","Type":"ContainerDied","Data":"08df7e036fc8355b3e2f41e3f6c504c41f78bb1e2927f039f077dcf9864f5420"}
Jul 30 00:56:14.392766 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:56:14.392700    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-4ef902/rate-test-model-4ef902-kserve-697777b7-mg26f" event={"ID":"32e19fad-1985-4351-8f91-29de459a9173","Type":"ContainerDied","Data":"7ca57ed74f134c281fccd754f0ebfb8e00ab3b1be5e00bf4ac3986f502db3abc"}
Jul 30 00:56:14.392766 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:56:14.392719    2560 scope.go:117] "RemoveContainer" containerID="08df7e036fc8355b3e2f41e3f6c504c41f78bb1e2927f039f077dcf9864f5420"
Jul 30 00:56:14.402020 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:56:14.402007    2560 scope.go:117] "RemoveContainer" containerID="08df7e036fc8355b3e2f41e3f6c504c41f78bb1e2927f039f077dcf9864f5420"
Jul 30 00:56:14.402235 ip-10-0-133-55 kubenswrapper[2560]: E0730 00:56:14.402219    2560 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"08df7e036fc8355b3e2f41e3f6c504c41f78bb1e2927f039f077dcf9864f5420\": container with ID starting with 08df7e036fc8355b3e2f41e3f6c504c41f78bb1e2927f039f077dcf9864f5420 not found: ID does not exist" containerID="08df7e036fc8355b3e2f41e3f6c504c41f78bb1e2927f039f077dcf9864f5420"
Jul 30 00:56:14.402274 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:56:14.402243    2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"08df7e036fc8355b3e2f41e3f6c504c41f78bb1e2927f039f077dcf9864f5420"} err="failed to get container status \"08df7e036fc8355b3e2f41e3f6c504c41f78bb1e2927f039f077dcf9864f5420\": rpc error: code = NotFound desc = could not find container \"08df7e036fc8355b3e2f41e3f6c504c41f78bb1e2927f039f077dcf9864f5420\": container with ID starting with 08df7e036fc8355b3e2f41e3f6c504c41f78bb1e2927f039f077dcf9864f5420 not found: ID does not exist"
Jul 30 00:56:14.413048 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:56:14.413026    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-4ef902/rate-test-model-4ef902-kserve-697777b7-mg26f"]
Jul 30 00:56:14.416414 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:56:14.416395    2560 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-a-4ef902/rate-test-model-4ef902-kserve-697777b7-mg26f"]
Jul 30 00:56:14.524735 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:56:14.524699    2560 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-shared-b-0b2dae/rate-test-model-0b2dae-kserve-5c5bf9b68c-h4vsn" podUID="5867a7dc-3fb0-49d8-8bd2-31f6cd2da675" containerName="main" containerID="cri-o://e0f671fd570521a4048ea185fc448bf8745ca6e9332d1fcde18116f1c8464b7e" gracePeriod=45
Jul 30 00:56:14.772384 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:56:14.772355    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-0b2dae/rate-test-model-0b2dae-kserve-5c5bf9b68c-h4vsn"
Jul 30 00:56:14.912815 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:56:14.912780    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/5867a7dc-3fb0-49d8-8bd2-31f6cd2da675-dshm\") pod \"5867a7dc-3fb0-49d8-8bd2-31f6cd2da675\" (UID: \"5867a7dc-3fb0-49d8-8bd2-31f6cd2da675\") "
Jul 30 00:56:14.912815 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:56:14.912821    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-sjtcm\" (UniqueName: \"kubernetes.io/projected/5867a7dc-3fb0-49d8-8bd2-31f6cd2da675-kube-api-access-sjtcm\") pod \"5867a7dc-3fb0-49d8-8bd2-31f6cd2da675\" (UID: \"5867a7dc-3fb0-49d8-8bd2-31f6cd2da675\") "
Jul 30 00:56:14.913013 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:56:14.912905    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/5867a7dc-3fb0-49d8-8bd2-31f6cd2da675-model-cache\") pod \"5867a7dc-3fb0-49d8-8bd2-31f6cd2da675\" (UID: \"5867a7dc-3fb0-49d8-8bd2-31f6cd2da675\") "
Jul 30 00:56:14.913013 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:56:14.912961    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/5867a7dc-3fb0-49d8-8bd2-31f6cd2da675-home\") pod \"5867a7dc-3fb0-49d8-8bd2-31f6cd2da675\" (UID: \"5867a7dc-3fb0-49d8-8bd2-31f6cd2da675\") "
Jul 30 00:56:14.913089 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:56:14.913019    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/5867a7dc-3fb0-49d8-8bd2-31f6cd2da675-tls-certs\") pod \"5867a7dc-3fb0-49d8-8bd2-31f6cd2da675\" (UID: \"5867a7dc-3fb0-49d8-8bd2-31f6cd2da675\") "
Jul 30 00:56:14.913089 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:56:14.913045    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/5867a7dc-3fb0-49d8-8bd2-31f6cd2da675-tmp-dir\") pod \"5867a7dc-3fb0-49d8-8bd2-31f6cd2da675\" (UID: \"5867a7dc-3fb0-49d8-8bd2-31f6cd2da675\") "
Jul 30 00:56:14.913266 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:56:14.913206    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5867a7dc-3fb0-49d8-8bd2-31f6cd2da675-model-cache" (OuterVolumeSpecName: "model-cache") pod "5867a7dc-3fb0-49d8-8bd2-31f6cd2da675" (UID: "5867a7dc-3fb0-49d8-8bd2-31f6cd2da675"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 30 00:56:14.913376 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:56:14.913257    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5867a7dc-3fb0-49d8-8bd2-31f6cd2da675-home" (OuterVolumeSpecName: "home") pod "5867a7dc-3fb0-49d8-8bd2-31f6cd2da675" (UID: "5867a7dc-3fb0-49d8-8bd2-31f6cd2da675"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 30 00:56:14.913442 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:56:14.913391    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5867a7dc-3fb0-49d8-8bd2-31f6cd2da675-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "5867a7dc-3fb0-49d8-8bd2-31f6cd2da675" (UID: "5867a7dc-3fb0-49d8-8bd2-31f6cd2da675"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 30 00:56:14.913442 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:56:14.913408    2560 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/5867a7dc-3fb0-49d8-8bd2-31f6cd2da675-model-cache\") on node \"ip-10-0-133-55.ec2.internal\" DevicePath \"\""
Jul 30 00:56:14.913442 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:56:14.913426    2560 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/5867a7dc-3fb0-49d8-8bd2-31f6cd2da675-home\") on node \"ip-10-0-133-55.ec2.internal\" DevicePath \"\""
Jul 30 00:56:14.914947 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:56:14.914921    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5867a7dc-3fb0-49d8-8bd2-31f6cd2da675-dshm" (OuterVolumeSpecName: "dshm") pod "5867a7dc-3fb0-49d8-8bd2-31f6cd2da675" (UID: "5867a7dc-3fb0-49d8-8bd2-31f6cd2da675"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 30 00:56:14.915054 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:56:14.914991    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5867a7dc-3fb0-49d8-8bd2-31f6cd2da675-kube-api-access-sjtcm" (OuterVolumeSpecName: "kube-api-access-sjtcm") pod "5867a7dc-3fb0-49d8-8bd2-31f6cd2da675" (UID: "5867a7dc-3fb0-49d8-8bd2-31f6cd2da675"). InnerVolumeSpecName "kube-api-access-sjtcm". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 30 00:56:14.915110 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:56:14.915068    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5867a7dc-3fb0-49d8-8bd2-31f6cd2da675-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "5867a7dc-3fb0-49d8-8bd2-31f6cd2da675" (UID: "5867a7dc-3fb0-49d8-8bd2-31f6cd2da675"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 30 00:56:15.014737 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:56:15.014647    2560 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/5867a7dc-3fb0-49d8-8bd2-31f6cd2da675-tls-certs\") on node \"ip-10-0-133-55.ec2.internal\" DevicePath \"\""
Jul 30 00:56:15.014737 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:56:15.014679    2560 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/5867a7dc-3fb0-49d8-8bd2-31f6cd2da675-tmp-dir\") on node \"ip-10-0-133-55.ec2.internal\" DevicePath \"\""
Jul 30 00:56:15.014737 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:56:15.014687    2560 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/5867a7dc-3fb0-49d8-8bd2-31f6cd2da675-dshm\") on node \"ip-10-0-133-55.ec2.internal\" DevicePath \"\""
Jul 30 00:56:15.014737 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:56:15.014696    2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-sjtcm\" (UniqueName: \"kubernetes.io/projected/5867a7dc-3fb0-49d8-8bd2-31f6cd2da675-kube-api-access-sjtcm\") on node \"ip-10-0-133-55.ec2.internal\" DevicePath \"\""
Jul 30 00:56:15.400985 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:56:15.400955    2560 generic.go:356] "Generic (PLEG): container finished" podID="5867a7dc-3fb0-49d8-8bd2-31f6cd2da675" containerID="e0f671fd570521a4048ea185fc448bf8745ca6e9332d1fcde18116f1c8464b7e" exitCode=0
Jul 30 00:56:15.401165 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:56:15.401073    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-0b2dae/rate-test-model-0b2dae-kserve-5c5bf9b68c-h4vsn"
Jul 30 00:56:15.405481 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:56:15.405457    2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="32e19fad-1985-4351-8f91-29de459a9173" path="/var/lib/kubelet/pods/32e19fad-1985-4351-8f91-29de459a9173/volumes"
Jul 30 00:56:15.405888 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:56:15.405871    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-0b2dae/rate-test-model-0b2dae-kserve-5c5bf9b68c-h4vsn" event={"ID":"5867a7dc-3fb0-49d8-8bd2-31f6cd2da675","Type":"ContainerDied","Data":"e0f671fd570521a4048ea185fc448bf8745ca6e9332d1fcde18116f1c8464b7e"}
Jul 30 00:56:15.405937 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:56:15.405899    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-0b2dae/rate-test-model-0b2dae-kserve-5c5bf9b68c-h4vsn" event={"ID":"5867a7dc-3fb0-49d8-8bd2-31f6cd2da675","Type":"ContainerDied","Data":"37f44dd5a38d04d382ac52cef01e9c4327f04b43ef6df9ee6aca33fc80eadeee"}
Jul 30 00:56:15.405937 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:56:15.405916    2560 scope.go:117] "RemoveContainer" containerID="e0f671fd570521a4048ea185fc448bf8745ca6e9332d1fcde18116f1c8464b7e"
Jul 30 00:56:15.415178 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:56:15.415160    2560 scope.go:117] "RemoveContainer" containerID="e0f671fd570521a4048ea185fc448bf8745ca6e9332d1fcde18116f1c8464b7e"
Jul 30 00:56:15.415454 ip-10-0-133-55 kubenswrapper[2560]: E0730 00:56:15.415436    2560 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e0f671fd570521a4048ea185fc448bf8745ca6e9332d1fcde18116f1c8464b7e\": container with ID starting with e0f671fd570521a4048ea185fc448bf8745ca6e9332d1fcde18116f1c8464b7e not found: ID does not exist" containerID="e0f671fd570521a4048ea185fc448bf8745ca6e9332d1fcde18116f1c8464b7e"
Jul 30 00:56:15.415510 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:56:15.415461    2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e0f671fd570521a4048ea185fc448bf8745ca6e9332d1fcde18116f1c8464b7e"} err="failed to get container status \"e0f671fd570521a4048ea185fc448bf8745ca6e9332d1fcde18116f1c8464b7e\": rpc error: code = NotFound desc = could not find container \"e0f671fd570521a4048ea185fc448bf8745ca6e9332d1fcde18116f1c8464b7e\": container with ID starting with e0f671fd570521a4048ea185fc448bf8745ca6e9332d1fcde18116f1c8464b7e not found: ID does not exist"
Jul 30 00:56:15.425694 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:56:15.425674    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-0b2dae/rate-test-model-0b2dae-kserve-5c5bf9b68c-h4vsn"]
Jul 30 00:56:15.429214 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:56:15.429190    2560 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-b-0b2dae/rate-test-model-0b2dae-kserve-5c5bf9b68c-h4vsn"]
Jul 30 00:56:17.404924 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:56:17.404891    2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="5867a7dc-3fb0-49d8-8bd2-31f6cd2da675" path="/var/lib/kubelet/pods/5867a7dc-3fb0-49d8-8bd2-31f6cd2da675/volumes"
Jul 30 00:56:23.745703 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:56:23.745662    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-a-7fa598-5df7f9cdb8-htb45"]
Jul 30 00:56:23.746233 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:56:23.746212    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5867a7dc-3fb0-49d8-8bd2-31f6cd2da675" containerName="main"
Jul 30 00:56:23.746357 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:56:23.746236    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="5867a7dc-3fb0-49d8-8bd2-31f6cd2da675" containerName="main"
Jul 30 00:56:23.746357 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:56:23.746258    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="32e19fad-1985-4351-8f91-29de459a9173" containerName="main"
Jul 30 00:56:23.746357 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:56:23.746266    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="32e19fad-1985-4351-8f91-29de459a9173" containerName="main"
Jul 30 00:56:23.746520 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:56:23.746380    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="5867a7dc-3fb0-49d8-8bd2-31f6cd2da675" containerName="main"
Jul 30 00:56:23.746520 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:56:23.746397    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="32e19fad-1985-4351-8f91-29de459a9173" containerName="main"
Jul 30 00:56:23.750582 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:56:23.750560    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-7fa598-5df7f9cdb8-htb45"
Jul 30 00:56:23.753395 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:56:23.753372    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-ipp-a-7fa598\""
Jul 30 00:56:23.754469 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:56:23.754445    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-ipp-a-7fa598-dockercfg-nnw59\""
Jul 30 00:56:23.755898 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:56:23.755874    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-a-7fa598-5df7f9cdb8-htb45"]
Jul 30 00:56:23.773106 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:56:23.773085    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-a-7fa598-685fd85574-cjbp5"]
Jul 30 00:56:23.776513 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:56:23.776496    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-a-7fa598-685fd85574-cjbp5"
Jul 30 00:56:23.782343 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:56:23.782324    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-a-7fa598-685fd85574-cjbp5"]
Jul 30 00:56:23.902421 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:56:23.902386    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/cf7cbd8c-65e2-4984-bbbd-34786d5bfef8-plugins-config-volume\") pod \"payload-processing-e2e-ipp-a-7fa598-685fd85574-cjbp5\" (UID: \"cf7cbd8c-65e2-4984-bbbd-34786d5bfef8\") " pod="openshift-ingress/payload-processing-e2e-ipp-a-7fa598-685fd85574-cjbp5"
Jul 30 00:56:23.902587 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:56:23.902448    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4xgjv\" (UniqueName: \"kubernetes.io/projected/3f3269de-4c41-409c-b755-918b3c0f0ac8-kube-api-access-4xgjv\") pod \"payload-pre-processing-e2e-ipp-a-7fa598-5df7f9cdb8-htb45\" (UID: \"3f3269de-4c41-409c-b755-918b3c0f0ac8\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-7fa598-5df7f9cdb8-htb45"
Jul 30 00:56:23.902587 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:56:23.902524    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7djpt\" (UniqueName: \"kubernetes.io/projected/cf7cbd8c-65e2-4984-bbbd-34786d5bfef8-kube-api-access-7djpt\") pod \"payload-processing-e2e-ipp-a-7fa598-685fd85574-cjbp5\" (UID: \"cf7cbd8c-65e2-4984-bbbd-34786d5bfef8\") " pod="openshift-ingress/payload-processing-e2e-ipp-a-7fa598-685fd85574-cjbp5"
Jul 30 00:56:23.902587 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:56:23.902572    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/3f3269de-4c41-409c-b755-918b3c0f0ac8-plugins-config-volume\") pod \"payload-pre-processing-e2e-ipp-a-7fa598-5df7f9cdb8-htb45\" (UID: \"3f3269de-4c41-409c-b755-918b3c0f0ac8\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-7fa598-5df7f9cdb8-htb45"
Jul 30 00:56:24.003999 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:56:24.003917    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4xgjv\" (UniqueName: \"kubernetes.io/projected/3f3269de-4c41-409c-b755-918b3c0f0ac8-kube-api-access-4xgjv\") pod \"payload-pre-processing-e2e-ipp-a-7fa598-5df7f9cdb8-htb45\" (UID: \"3f3269de-4c41-409c-b755-918b3c0f0ac8\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-7fa598-5df7f9cdb8-htb45"
Jul 30 00:56:24.003999 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:56:24.003970    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7djpt\" (UniqueName: \"kubernetes.io/projected/cf7cbd8c-65e2-4984-bbbd-34786d5bfef8-kube-api-access-7djpt\") pod \"payload-processing-e2e-ipp-a-7fa598-685fd85574-cjbp5\" (UID: \"cf7cbd8c-65e2-4984-bbbd-34786d5bfef8\") " pod="openshift-ingress/payload-processing-e2e-ipp-a-7fa598-685fd85574-cjbp5"
Jul 30 00:56:24.004176 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:56:24.004009    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/3f3269de-4c41-409c-b755-918b3c0f0ac8-plugins-config-volume\") pod \"payload-pre-processing-e2e-ipp-a-7fa598-5df7f9cdb8-htb45\" (UID: \"3f3269de-4c41-409c-b755-918b3c0f0ac8\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-7fa598-5df7f9cdb8-htb45"
Jul 30 00:56:24.004176 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:56:24.004044    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/cf7cbd8c-65e2-4984-bbbd-34786d5bfef8-plugins-config-volume\") pod \"payload-processing-e2e-ipp-a-7fa598-685fd85574-cjbp5\" (UID: \"cf7cbd8c-65e2-4984-bbbd-34786d5bfef8\") " pod="openshift-ingress/payload-processing-e2e-ipp-a-7fa598-685fd85574-cjbp5"
Jul 30 00:56:24.004764 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:56:24.004745    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/3f3269de-4c41-409c-b755-918b3c0f0ac8-plugins-config-volume\") pod \"payload-pre-processing-e2e-ipp-a-7fa598-5df7f9cdb8-htb45\" (UID: \"3f3269de-4c41-409c-b755-918b3c0f0ac8\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-7fa598-5df7f9cdb8-htb45"
Jul 30 00:56:24.004802 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:56:24.004763    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/cf7cbd8c-65e2-4984-bbbd-34786d5bfef8-plugins-config-volume\") pod \"payload-processing-e2e-ipp-a-7fa598-685fd85574-cjbp5\" (UID: \"cf7cbd8c-65e2-4984-bbbd-34786d5bfef8\") " pod="openshift-ingress/payload-processing-e2e-ipp-a-7fa598-685fd85574-cjbp5"
Jul 30 00:56:24.011598 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:56:24.011572    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4xgjv\" (UniqueName: \"kubernetes.io/projected/3f3269de-4c41-409c-b755-918b3c0f0ac8-kube-api-access-4xgjv\") pod \"payload-pre-processing-e2e-ipp-a-7fa598-5df7f9cdb8-htb45\" (UID: \"3f3269de-4c41-409c-b755-918b3c0f0ac8\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-7fa598-5df7f9cdb8-htb45"
Jul 30 00:56:24.011750 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:56:24.011734    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7djpt\" (UniqueName: \"kubernetes.io/projected/cf7cbd8c-65e2-4984-bbbd-34786d5bfef8-kube-api-access-7djpt\") pod \"payload-processing-e2e-ipp-a-7fa598-685fd85574-cjbp5\" (UID: \"cf7cbd8c-65e2-4984-bbbd-34786d5bfef8\") " pod="openshift-ingress/payload-processing-e2e-ipp-a-7fa598-685fd85574-cjbp5"
Jul 30 00:56:24.062432 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:56:24.062401    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-7fa598-5df7f9cdb8-htb45"
Jul 30 00:56:24.090233 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:56:24.090208    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-a-7fa598-685fd85574-cjbp5"
Jul 30 00:56:24.414347 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:56:24.414157    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-a-7fa598-5df7f9cdb8-htb45"]
Jul 30 00:56:24.416685 ip-10-0-133-55 kubenswrapper[2560]: W0730 00:56:24.416656    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3f3269de_4c41_409c_b755_918b3c0f0ac8.slice/crio-804932ead2a240cdb4b3c6d9a411781c362e4e472ba24290c7ef29cd1e8120c3 WatchSource:0}: Error finding container 804932ead2a240cdb4b3c6d9a411781c362e4e472ba24290c7ef29cd1e8120c3: Status 404 returned error can't find the container with id 804932ead2a240cdb4b3c6d9a411781c362e4e472ba24290c7ef29cd1e8120c3
Jul 30 00:56:24.448239 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:56:24.448194    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-a-7fa598-685fd85574-cjbp5"]
Jul 30 00:56:24.448603 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:56:24.448582    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-7fa598-5df7f9cdb8-htb45" event={"ID":"3f3269de-4c41-409c-b755-918b3c0f0ac8","Type":"ContainerStarted","Data":"804932ead2a240cdb4b3c6d9a411781c362e4e472ba24290c7ef29cd1e8120c3"}
Jul 30 00:56:24.450458 ip-10-0-133-55 kubenswrapper[2560]: W0730 00:56:24.450437    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcf7cbd8c_65e2_4984_bbbd_34786d5bfef8.slice/crio-254f7dea4efa6706c054c69d9212ebeeca3bade797d5f90499c4ced11ea29101 WatchSource:0}: Error finding container 254f7dea4efa6706c054c69d9212ebeeca3bade797d5f90499c4ced11ea29101: Status 404 returned error can't find the container with id 254f7dea4efa6706c054c69d9212ebeeca3bade797d5f90499c4ced11ea29101
Jul 30 00:56:25.455243 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:56:25.455204    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-a-7fa598-685fd85574-cjbp5" event={"ID":"cf7cbd8c-65e2-4984-bbbd-34786d5bfef8","Type":"ContainerStarted","Data":"26e1ccf9f1b968d4aff7bf5bb7ec80a922b349179036d5e1081d8b9afdab7a7a"}
Jul 30 00:56:25.455749 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:56:25.455258    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-a-7fa598-685fd85574-cjbp5" event={"ID":"cf7cbd8c-65e2-4984-bbbd-34786d5bfef8","Type":"ContainerStarted","Data":"254f7dea4efa6706c054c69d9212ebeeca3bade797d5f90499c4ced11ea29101"}
Jul 30 00:56:25.455749 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:56:25.455393    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-ipp-a-7fa598-685fd85574-cjbp5"
Jul 30 00:56:25.456880 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:56:25.456847    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-7fa598-5df7f9cdb8-htb45" event={"ID":"3f3269de-4c41-409c-b755-918b3c0f0ac8","Type":"ContainerStarted","Data":"b7c41a0e85a5f0b91df9274f7ab30f3c2d6988a462fccf4edca165e5930af6a6"}
Jul 30 00:56:25.456965 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:56:25.456935    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-7fa598-5df7f9cdb8-htb45"
Jul 30 00:56:25.475068 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:56:25.475019    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-ipp-a-7fa598-685fd85574-cjbp5" podStartSLOduration=2.475002273 podStartE2EDuration="2.475002273s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-30 00:56:23 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 00:56:25.471205405 +0000 UTC m=+3272.530422210" watchObservedRunningTime="2026-07-30 00:56:25.475002273 +0000 UTC m=+3272.534219077"
Jul 30 00:56:25.492881 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:56:25.492837    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-7fa598-5df7f9cdb8-htb45" podStartSLOduration=2.492822968 podStartE2EDuration="2.492822968s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-30 00:56:23 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 00:56:25.490981224 +0000 UTC m=+3272.550198029" watchObservedRunningTime="2026-07-30 00:56:25.492822968 +0000 UTC m=+3272.552039822"
Jul 30 00:56:36.464528 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:56:36.464490    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-7fa598-5df7f9cdb8-htb45"
Jul 30 00:56:36.465030 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:56:36.464567    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-ipp-a-7fa598-685fd85574-cjbp5"
Jul 30 00:56:53.638555 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:56:53.638533    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-kchgc_324341b7-120c-4f8b-9ddd-e28b9a40ce9e/console-operator/1.log"
Jul 30 00:56:53.645610 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:56:53.645586    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-kchgc_324341b7-120c-4f8b-9ddd-e28b9a40ce9e/console-operator/1.log"
Jul 30 00:56:57.920997 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:56:57.920955    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-b-edaa93-c66d77c76-958ph"]
Jul 30 00:56:57.925864 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:56:57.925846    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-edaa93-c66d77c76-958ph"
Jul 30 00:56:57.928764 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:56:57.928743    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-ipp-b-edaa93\""
Jul 30 00:56:57.933128 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:56:57.933106    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-b-edaa93-c66d77c76-958ph"]
Jul 30 00:56:57.965971 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:56:57.965940    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-b-edaa93-99c599b66-7jjdk"]
Jul 30 00:56:57.969541 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:56:57.969526    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-b-edaa93-99c599b66-7jjdk"
Jul 30 00:56:57.972068 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:56:57.972051    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-ipp-b-edaa93-dockercfg-jjt6k\""
Jul 30 00:56:57.979734 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:56:57.979710    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-b-edaa93-99c599b66-7jjdk"]
Jul 30 00:56:58.022358 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:56:58.022324    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8qjbb\" (UniqueName: \"kubernetes.io/projected/275c5f78-1bff-41b7-b1cd-ed82d29ba129-kube-api-access-8qjbb\") pod \"payload-pre-processing-e2e-ipp-b-edaa93-c66d77c76-958ph\" (UID: \"275c5f78-1bff-41b7-b1cd-ed82d29ba129\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-edaa93-c66d77c76-958ph"
Jul 30 00:56:58.022516 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:56:58.022389    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/275c5f78-1bff-41b7-b1cd-ed82d29ba129-plugins-config-volume\") pod \"payload-pre-processing-e2e-ipp-b-edaa93-c66d77c76-958ph\" (UID: \"275c5f78-1bff-41b7-b1cd-ed82d29ba129\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-edaa93-c66d77c76-958ph"
Jul 30 00:56:58.123687 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:56:58.123645    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8qjbb\" (UniqueName: \"kubernetes.io/projected/275c5f78-1bff-41b7-b1cd-ed82d29ba129-kube-api-access-8qjbb\") pod \"payload-pre-processing-e2e-ipp-b-edaa93-c66d77c76-958ph\" (UID: \"275c5f78-1bff-41b7-b1cd-ed82d29ba129\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-edaa93-c66d77c76-958ph"
Jul 30 00:56:58.123863 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:56:58.123703    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/275c5f78-1bff-41b7-b1cd-ed82d29ba129-plugins-config-volume\") pod \"payload-pre-processing-e2e-ipp-b-edaa93-c66d77c76-958ph\" (UID: \"275c5f78-1bff-41b7-b1cd-ed82d29ba129\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-edaa93-c66d77c76-958ph"
Jul 30 00:56:58.123863 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:56:58.123724    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-c6wr8\" (UniqueName: \"kubernetes.io/projected/303a4bf9-6849-4f8f-b17f-36c25f4f397b-kube-api-access-c6wr8\") pod \"payload-processing-e2e-ipp-b-edaa93-99c599b66-7jjdk\" (UID: \"303a4bf9-6849-4f8f-b17f-36c25f4f397b\") " pod="openshift-ingress/payload-processing-e2e-ipp-b-edaa93-99c599b66-7jjdk"
Jul 30 00:56:58.123863 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:56:58.123776    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/303a4bf9-6849-4f8f-b17f-36c25f4f397b-plugins-config-volume\") pod \"payload-processing-e2e-ipp-b-edaa93-99c599b66-7jjdk\" (UID: \"303a4bf9-6849-4f8f-b17f-36c25f4f397b\") " pod="openshift-ingress/payload-processing-e2e-ipp-b-edaa93-99c599b66-7jjdk"
Jul 30 00:56:58.124514 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:56:58.124494    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/275c5f78-1bff-41b7-b1cd-ed82d29ba129-plugins-config-volume\") pod \"payload-pre-processing-e2e-ipp-b-edaa93-c66d77c76-958ph\" (UID: \"275c5f78-1bff-41b7-b1cd-ed82d29ba129\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-edaa93-c66d77c76-958ph"
Jul 30 00:56:58.133505 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:56:58.133474    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8qjbb\" (UniqueName: \"kubernetes.io/projected/275c5f78-1bff-41b7-b1cd-ed82d29ba129-kube-api-access-8qjbb\") pod \"payload-pre-processing-e2e-ipp-b-edaa93-c66d77c76-958ph\" (UID: \"275c5f78-1bff-41b7-b1cd-ed82d29ba129\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-edaa93-c66d77c76-958ph"
Jul 30 00:56:58.224643 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:56:58.224550    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/303a4bf9-6849-4f8f-b17f-36c25f4f397b-plugins-config-volume\") pod \"payload-processing-e2e-ipp-b-edaa93-99c599b66-7jjdk\" (UID: \"303a4bf9-6849-4f8f-b17f-36c25f4f397b\") " pod="openshift-ingress/payload-processing-e2e-ipp-b-edaa93-99c599b66-7jjdk"
Jul 30 00:56:58.224820 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:56:58.224665    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-c6wr8\" (UniqueName: \"kubernetes.io/projected/303a4bf9-6849-4f8f-b17f-36c25f4f397b-kube-api-access-c6wr8\") pod \"payload-processing-e2e-ipp-b-edaa93-99c599b66-7jjdk\" (UID: \"303a4bf9-6849-4f8f-b17f-36c25f4f397b\") " pod="openshift-ingress/payload-processing-e2e-ipp-b-edaa93-99c599b66-7jjdk"
Jul 30 00:56:58.225265 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:56:58.225233    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/303a4bf9-6849-4f8f-b17f-36c25f4f397b-plugins-config-volume\") pod \"payload-processing-e2e-ipp-b-edaa93-99c599b66-7jjdk\" (UID: \"303a4bf9-6849-4f8f-b17f-36c25f4f397b\") " pod="openshift-ingress/payload-processing-e2e-ipp-b-edaa93-99c599b66-7jjdk"
Jul 30 00:56:58.232876 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:56:58.232849    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-c6wr8\" (UniqueName: \"kubernetes.io/projected/303a4bf9-6849-4f8f-b17f-36c25f4f397b-kube-api-access-c6wr8\") pod \"payload-processing-e2e-ipp-b-edaa93-99c599b66-7jjdk\" (UID: \"303a4bf9-6849-4f8f-b17f-36c25f4f397b\") " pod="openshift-ingress/payload-processing-e2e-ipp-b-edaa93-99c599b66-7jjdk"
Jul 30 00:56:58.237445 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:56:58.237428    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-edaa93-c66d77c76-958ph"
Jul 30 00:56:58.280480 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:56:58.280444    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-b-edaa93-99c599b66-7jjdk"
Jul 30 00:56:58.391939 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:56:58.391907    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-b-edaa93-c66d77c76-958ph"]
Jul 30 00:56:58.393662 ip-10-0-133-55 kubenswrapper[2560]: W0730 00:56:58.393634    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod275c5f78_1bff_41b7_b1cd_ed82d29ba129.slice/crio-88e5f4621323626fcdd6844b1bd9dcc56b0fe545812a53dbb191377215f00317 WatchSource:0}: Error finding container 88e5f4621323626fcdd6844b1bd9dcc56b0fe545812a53dbb191377215f00317: Status 404 returned error can't find the container with id 88e5f4621323626fcdd6844b1bd9dcc56b0fe545812a53dbb191377215f00317
Jul 30 00:56:58.449030 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:56:58.449006    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-b-edaa93-99c599b66-7jjdk"]
Jul 30 00:56:58.450977 ip-10-0-133-55 kubenswrapper[2560]: W0730 00:56:58.450950    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod303a4bf9_6849_4f8f_b17f_36c25f4f397b.slice/crio-3b8d6242fbbcc36fbca81c31d9a148d59e5d1f0e04bfc7f66534a1913d6fbcb1 WatchSource:0}: Error finding container 3b8d6242fbbcc36fbca81c31d9a148d59e5d1f0e04bfc7f66534a1913d6fbcb1: Status 404 returned error can't find the container with id 3b8d6242fbbcc36fbca81c31d9a148d59e5d1f0e04bfc7f66534a1913d6fbcb1
Jul 30 00:56:58.625989 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:56:58.625954    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-edaa93-c66d77c76-958ph" event={"ID":"275c5f78-1bff-41b7-b1cd-ed82d29ba129","Type":"ContainerStarted","Data":"ebc854bc4c955b28f88c59ccbbaad9b6144a423873d8c6931b2e448d22f9b213"}
Jul 30 00:56:58.626172 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:56:58.626018    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-edaa93-c66d77c76-958ph"
Jul 30 00:56:58.626172 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:56:58.626048    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-edaa93-c66d77c76-958ph" event={"ID":"275c5f78-1bff-41b7-b1cd-ed82d29ba129","Type":"ContainerStarted","Data":"88e5f4621323626fcdd6844b1bd9dcc56b0fe545812a53dbb191377215f00317"}
Jul 30 00:56:58.627499 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:56:58.627469    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-b-edaa93-99c599b66-7jjdk" event={"ID":"303a4bf9-6849-4f8f-b17f-36c25f4f397b","Type":"ContainerStarted","Data":"6af00b01a03bb31fac59884e0be4a0bc23c02c885f145cd78e5bf814e52e26d5"}
Jul 30 00:56:58.627610 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:56:58.627523    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-b-edaa93-99c599b66-7jjdk" event={"ID":"303a4bf9-6849-4f8f-b17f-36c25f4f397b","Type":"ContainerStarted","Data":"3b8d6242fbbcc36fbca81c31d9a148d59e5d1f0e04bfc7f66534a1913d6fbcb1"}
Jul 30 00:56:58.627610 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:56:58.627559    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-ipp-b-edaa93-99c599b66-7jjdk"
Jul 30 00:56:58.641815 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:56:58.641771    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-edaa93-c66d77c76-958ph" podStartSLOduration=1.641756677 podStartE2EDuration="1.641756677s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-30 00:56:57 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 00:56:58.640670186 +0000 UTC m=+3305.699887001" watchObservedRunningTime="2026-07-30 00:56:58.641756677 +0000 UTC m=+3305.700973480"
Jul 30 00:56:58.657743 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:56:58.657700    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-ipp-b-edaa93-99c599b66-7jjdk" podStartSLOduration=1.65768506 podStartE2EDuration="1.65768506s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-30 00:56:57 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 00:56:58.656838365 +0000 UTC m=+3305.716055170" watchObservedRunningTime="2026-07-30 00:56:58.65768506 +0000 UTC m=+3305.716901864"
Jul 30 00:57:09.634936 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:57:09.634903    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-ipp-b-edaa93-99c599b66-7jjdk"
Jul 30 00:57:09.635498 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:57:09.635083    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-edaa93-c66d77c76-958ph"
Jul 30 00:57:28.081306 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:57:28.081272    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-5cc6cd444b-6txxf_59139f9a-241a-42f1-a0c9-97c147cf4f7e/payload-processing/0.log"
Jul 30 00:57:28.199751 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:57:28.199720    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-e2e-ipp-b-edaa93-99c599b66-7jjdk_303a4bf9-6849-4f8f-b17f-36c25f4f397b/payload-processing/0.log"
Jul 30 00:57:47.852629 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:57:47.852596    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-ipp-a-7fa598/ipp-route-7fa598-kserve-6978f99cd7-5cpks"]
Jul 30 00:57:47.856081 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:57:47.856062    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-ipp-a-7fa598/ipp-route-7fa598-kserve-6978f99cd7-5cpks"
Jul 30 00:57:47.860041 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:57:47.860021    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-ipp-a-7fa598\"/\"kube-root-ca.crt\""
Jul 30 00:57:47.861199 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:57:47.861179    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-ipp-a-7fa598\"/\"openshift-service-ca.crt\""
Jul 30 00:57:47.861271 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:57:47.861186    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-ipp-a-7fa598\"/\"ipp-route-7fa598-kserve-self-signed-certs\""
Jul 30 00:57:47.861271 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:57:47.861220    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-ipp-a-7fa598\"/\"default-dockercfg-d5jk6\""
Jul 30 00:57:47.876089 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:57:47.876062    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-ipp-a-7fa598/ipp-route-7fa598-kserve-6978f99cd7-5cpks"]
Jul 30 00:57:47.894799 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:57:47.894775    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/00e808eb-9e9c-465d-9c16-46f454fd7f48-tmp-dir\") pod \"ipp-route-7fa598-kserve-6978f99cd7-5cpks\" (UID: \"00e808eb-9e9c-465d-9c16-46f454fd7f48\") " pod="ai-tenant-e2e-ipp-a-7fa598/ipp-route-7fa598-kserve-6978f99cd7-5cpks"
Jul 30 00:57:47.894917 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:57:47.894805    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/00e808eb-9e9c-465d-9c16-46f454fd7f48-model-cache\") pod \"ipp-route-7fa598-kserve-6978f99cd7-5cpks\" (UID: \"00e808eb-9e9c-465d-9c16-46f454fd7f48\") " pod="ai-tenant-e2e-ipp-a-7fa598/ipp-route-7fa598-kserve-6978f99cd7-5cpks"
Jul 30 00:57:47.894917 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:57:47.894830    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/00e808eb-9e9c-465d-9c16-46f454fd7f48-dshm\") pod \"ipp-route-7fa598-kserve-6978f99cd7-5cpks\" (UID: \"00e808eb-9e9c-465d-9c16-46f454fd7f48\") " pod="ai-tenant-e2e-ipp-a-7fa598/ipp-route-7fa598-kserve-6978f99cd7-5cpks"
Jul 30 00:57:47.894917 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:57:47.894880    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wrx2l\" (UniqueName: \"kubernetes.io/projected/00e808eb-9e9c-465d-9c16-46f454fd7f48-kube-api-access-wrx2l\") pod \"ipp-route-7fa598-kserve-6978f99cd7-5cpks\" (UID: \"00e808eb-9e9c-465d-9c16-46f454fd7f48\") " pod="ai-tenant-e2e-ipp-a-7fa598/ipp-route-7fa598-kserve-6978f99cd7-5cpks"
Jul 30 00:57:47.895072 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:57:47.894940    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/00e808eb-9e9c-465d-9c16-46f454fd7f48-tls-certs\") pod \"ipp-route-7fa598-kserve-6978f99cd7-5cpks\" (UID: \"00e808eb-9e9c-465d-9c16-46f454fd7f48\") " pod="ai-tenant-e2e-ipp-a-7fa598/ipp-route-7fa598-kserve-6978f99cd7-5cpks"
Jul 30 00:57:47.895072 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:57:47.894982    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/00e808eb-9e9c-465d-9c16-46f454fd7f48-home\") pod \"ipp-route-7fa598-kserve-6978f99cd7-5cpks\" (UID: \"00e808eb-9e9c-465d-9c16-46f454fd7f48\") " pod="ai-tenant-e2e-ipp-a-7fa598/ipp-route-7fa598-kserve-6978f99cd7-5cpks"
Jul 30 00:57:47.995848 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:57:47.995810    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/00e808eb-9e9c-465d-9c16-46f454fd7f48-tmp-dir\") pod \"ipp-route-7fa598-kserve-6978f99cd7-5cpks\" (UID: \"00e808eb-9e9c-465d-9c16-46f454fd7f48\") " pod="ai-tenant-e2e-ipp-a-7fa598/ipp-route-7fa598-kserve-6978f99cd7-5cpks"
Jul 30 00:57:47.995848 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:57:47.995848    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/00e808eb-9e9c-465d-9c16-46f454fd7f48-model-cache\") pod \"ipp-route-7fa598-kserve-6978f99cd7-5cpks\" (UID: \"00e808eb-9e9c-465d-9c16-46f454fd7f48\") " pod="ai-tenant-e2e-ipp-a-7fa598/ipp-route-7fa598-kserve-6978f99cd7-5cpks"
Jul 30 00:57:47.996102 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:57:47.995868    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/00e808eb-9e9c-465d-9c16-46f454fd7f48-dshm\") pod \"ipp-route-7fa598-kserve-6978f99cd7-5cpks\" (UID: \"00e808eb-9e9c-465d-9c16-46f454fd7f48\") " pod="ai-tenant-e2e-ipp-a-7fa598/ipp-route-7fa598-kserve-6978f99cd7-5cpks"
Jul 30 00:57:47.996102 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:57:47.995999    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wrx2l\" (UniqueName: \"kubernetes.io/projected/00e808eb-9e9c-465d-9c16-46f454fd7f48-kube-api-access-wrx2l\") pod \"ipp-route-7fa598-kserve-6978f99cd7-5cpks\" (UID: \"00e808eb-9e9c-465d-9c16-46f454fd7f48\") " pod="ai-tenant-e2e-ipp-a-7fa598/ipp-route-7fa598-kserve-6978f99cd7-5cpks"
Jul 30 00:57:47.996102 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:57:47.996049    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/00e808eb-9e9c-465d-9c16-46f454fd7f48-tls-certs\") pod \"ipp-route-7fa598-kserve-6978f99cd7-5cpks\" (UID: \"00e808eb-9e9c-465d-9c16-46f454fd7f48\") " pod="ai-tenant-e2e-ipp-a-7fa598/ipp-route-7fa598-kserve-6978f99cd7-5cpks"
Jul 30 00:57:47.996102 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:57:47.996093    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/00e808eb-9e9c-465d-9c16-46f454fd7f48-home\") pod \"ipp-route-7fa598-kserve-6978f99cd7-5cpks\" (UID: \"00e808eb-9e9c-465d-9c16-46f454fd7f48\") " pod="ai-tenant-e2e-ipp-a-7fa598/ipp-route-7fa598-kserve-6978f99cd7-5cpks"
Jul 30 00:57:47.996303 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:57:47.996237    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/00e808eb-9e9c-465d-9c16-46f454fd7f48-tmp-dir\") pod \"ipp-route-7fa598-kserve-6978f99cd7-5cpks\" (UID: \"00e808eb-9e9c-465d-9c16-46f454fd7f48\") " pod="ai-tenant-e2e-ipp-a-7fa598/ipp-route-7fa598-kserve-6978f99cd7-5cpks"
Jul 30 00:57:47.996404 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:57:47.996356    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/00e808eb-9e9c-465d-9c16-46f454fd7f48-model-cache\") pod \"ipp-route-7fa598-kserve-6978f99cd7-5cpks\" (UID: \"00e808eb-9e9c-465d-9c16-46f454fd7f48\") " pod="ai-tenant-e2e-ipp-a-7fa598/ipp-route-7fa598-kserve-6978f99cd7-5cpks"
Jul 30 00:57:47.996530 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:57:47.996512    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/00e808eb-9e9c-465d-9c16-46f454fd7f48-home\") pod \"ipp-route-7fa598-kserve-6978f99cd7-5cpks\" (UID: \"00e808eb-9e9c-465d-9c16-46f454fd7f48\") " pod="ai-tenant-e2e-ipp-a-7fa598/ipp-route-7fa598-kserve-6978f99cd7-5cpks"
Jul 30 00:57:47.998120 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:57:47.998099    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/00e808eb-9e9c-465d-9c16-46f454fd7f48-dshm\") pod \"ipp-route-7fa598-kserve-6978f99cd7-5cpks\" (UID: \"00e808eb-9e9c-465d-9c16-46f454fd7f48\") " pod="ai-tenant-e2e-ipp-a-7fa598/ipp-route-7fa598-kserve-6978f99cd7-5cpks"
Jul 30 00:57:47.998670 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:57:47.998650    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/00e808eb-9e9c-465d-9c16-46f454fd7f48-tls-certs\") pod \"ipp-route-7fa598-kserve-6978f99cd7-5cpks\" (UID: \"00e808eb-9e9c-465d-9c16-46f454fd7f48\") " pod="ai-tenant-e2e-ipp-a-7fa598/ipp-route-7fa598-kserve-6978f99cd7-5cpks"
Jul 30 00:57:48.011991 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:57:48.011963    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wrx2l\" (UniqueName: \"kubernetes.io/projected/00e808eb-9e9c-465d-9c16-46f454fd7f48-kube-api-access-wrx2l\") pod \"ipp-route-7fa598-kserve-6978f99cd7-5cpks\" (UID: \"00e808eb-9e9c-465d-9c16-46f454fd7f48\") " pod="ai-tenant-e2e-ipp-a-7fa598/ipp-route-7fa598-kserve-6978f99cd7-5cpks"
Jul 30 00:57:48.165727 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:57:48.165687    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-ipp-a-7fa598/ipp-route-7fa598-kserve-6978f99cd7-5cpks"
Jul 30 00:57:48.298339 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:57:48.298292    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-ipp-a-7fa598/ipp-route-7fa598-kserve-6978f99cd7-5cpks"]
Jul 30 00:57:48.299981 ip-10-0-133-55 kubenswrapper[2560]: W0730 00:57:48.299956    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod00e808eb_9e9c_465d_9c16_46f454fd7f48.slice/crio-34fd66b5d9ab814793078a3b66717c8496039b12c000a2389fc3c5bde6610ea3 WatchSource:0}: Error finding container 34fd66b5d9ab814793078a3b66717c8496039b12c000a2389fc3c5bde6610ea3: Status 404 returned error can't find the container with id 34fd66b5d9ab814793078a3b66717c8496039b12c000a2389fc3c5bde6610ea3
Jul 30 00:57:48.882160 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:57:48.882123    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-ipp-a-7fa598/ipp-route-7fa598-kserve-6978f99cd7-5cpks" event={"ID":"00e808eb-9e9c-465d-9c16-46f454fd7f48","Type":"ContainerStarted","Data":"274d8cd803508ea614cd93e5cd6ffebae0c2159d061f0518c41a13e80abf0c29"}
Jul 30 00:57:48.882160 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:57:48.882162    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-ipp-a-7fa598/ipp-route-7fa598-kserve-6978f99cd7-5cpks" event={"ID":"00e808eb-9e9c-465d-9c16-46f454fd7f48","Type":"ContainerStarted","Data":"34fd66b5d9ab814793078a3b66717c8496039b12c000a2389fc3c5bde6610ea3"}
Jul 30 00:57:48.902178 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:57:48.902127    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-ipp-a-7fa598/ipp-route-7fa598-kserve-6978f99cd7-5cpks" podStartSLOduration=1.9021126929999999 podStartE2EDuration="1.902112693s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-30 00:57:47 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 00:57:48.901583725 +0000 UTC m=+3355.960800541" watchObservedRunningTime="2026-07-30 00:57:48.902112693 +0000 UTC m=+3355.961329510"
Jul 30 00:57:58.166665 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:57:58.166628    2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-ipp-a-7fa598/ipp-route-7fa598-kserve-6978f99cd7-5cpks"
Jul 30 00:57:58.167072 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:57:58.166682    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-ipp-a-7fa598/ipp-route-7fa598-kserve-6978f99cd7-5cpks"
Jul 30 00:57:58.179531 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:57:58.179504    2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-ipp-a-7fa598/ipp-route-7fa598-kserve-6978f99cd7-5cpks"
Jul 30 00:57:58.945989 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:57:58.945960    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-ipp-a-7fa598/ipp-route-7fa598-kserve-6978f99cd7-5cpks"
Jul 30 00:58:28.438407 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:58:28.438369    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-e2e-ipp-a-7fa598-685fd85574-cjbp5_cf7cbd8c-65e2-4984-bbbd-34786d5bfef8/payload-processing/0.log"
Jul 30 00:58:28.552836 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:58:28.552799    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-5cc6cd444b-6txxf_59139f9a-241a-42f1-a0c9-97c147cf4f7e/payload-processing/0.log"
Jul 30 00:58:28.666787 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:58:28.666759    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-e2e-ipp-b-edaa93-99c599b66-7jjdk_303a4bf9-6849-4f8f-b17f-36c25f4f397b/payload-processing/0.log"
Jul 30 00:58:33.971104 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:58:33.971071    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-859003-79948c7c7b-kh98h"]
Jul 30 00:58:33.974822 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:58:33.974806    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-859003-79948c7c7b-kh98h"
Jul 30 00:58:33.977364 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:58:33.977339    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-ipp-cleanup-859003-dockercfg-wqm72\""
Jul 30 00:58:33.977502 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:58:33.977363    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-ipp-cleanup-859003\""
Jul 30 00:58:33.986342 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:58:33.986293    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-859003-79948c7c7b-kh98h"]
Jul 30 00:58:34.007891 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:58:34.007858    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-cleanup-859003-67cbc4f5fd-s7klv"]
Jul 30 00:58:34.012160 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:58:34.012140    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-859003-67cbc4f5fd-s7klv"
Jul 30 00:58:34.018642 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:58:34.018616    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-cleanup-859003-67cbc4f5fd-s7klv"]
Jul 30 00:58:34.030467 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:58:34.030437    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9sqfz\" (UniqueName: \"kubernetes.io/projected/b54aaddf-80cb-496d-9972-62ef0d520be1-kube-api-access-9sqfz\") pod \"payload-pre-processing-e2e-ipp-cleanup-859003-79948c7c7b-kh98h\" (UID: \"b54aaddf-80cb-496d-9972-62ef0d520be1\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-859003-79948c7c7b-kh98h"
Jul 30 00:58:34.030582 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:58:34.030500    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/b54aaddf-80cb-496d-9972-62ef0d520be1-plugins-config-volume\") pod \"payload-pre-processing-e2e-ipp-cleanup-859003-79948c7c7b-kh98h\" (UID: \"b54aaddf-80cb-496d-9972-62ef0d520be1\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-859003-79948c7c7b-kh98h"
Jul 30 00:58:34.131401 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:58:34.131362    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pd7zf\" (UniqueName: \"kubernetes.io/projected/c4e05e92-362a-49ba-90d7-dc5ba4819253-kube-api-access-pd7zf\") pod \"payload-processing-e2e-ipp-cleanup-859003-67cbc4f5fd-s7klv\" (UID: \"c4e05e92-362a-49ba-90d7-dc5ba4819253\") " pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-859003-67cbc4f5fd-s7klv"
Jul 30 00:58:34.131622 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:58:34.131416    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/b54aaddf-80cb-496d-9972-62ef0d520be1-plugins-config-volume\") pod \"payload-pre-processing-e2e-ipp-cleanup-859003-79948c7c7b-kh98h\" (UID: \"b54aaddf-80cb-496d-9972-62ef0d520be1\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-859003-79948c7c7b-kh98h"
Jul 30 00:58:34.131622 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:58:34.131449    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/c4e05e92-362a-49ba-90d7-dc5ba4819253-plugins-config-volume\") pod \"payload-processing-e2e-ipp-cleanup-859003-67cbc4f5fd-s7klv\" (UID: \"c4e05e92-362a-49ba-90d7-dc5ba4819253\") " pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-859003-67cbc4f5fd-s7klv"
Jul 30 00:58:34.131622 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:58:34.131552    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9sqfz\" (UniqueName: \"kubernetes.io/projected/b54aaddf-80cb-496d-9972-62ef0d520be1-kube-api-access-9sqfz\") pod \"payload-pre-processing-e2e-ipp-cleanup-859003-79948c7c7b-kh98h\" (UID: \"b54aaddf-80cb-496d-9972-62ef0d520be1\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-859003-79948c7c7b-kh98h"
Jul 30 00:58:34.132177 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:58:34.132155    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/b54aaddf-80cb-496d-9972-62ef0d520be1-plugins-config-volume\") pod \"payload-pre-processing-e2e-ipp-cleanup-859003-79948c7c7b-kh98h\" (UID: \"b54aaddf-80cb-496d-9972-62ef0d520be1\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-859003-79948c7c7b-kh98h"
Jul 30 00:58:34.139276 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:58:34.139250    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9sqfz\" (UniqueName: \"kubernetes.io/projected/b54aaddf-80cb-496d-9972-62ef0d520be1-kube-api-access-9sqfz\") pod \"payload-pre-processing-e2e-ipp-cleanup-859003-79948c7c7b-kh98h\" (UID: \"b54aaddf-80cb-496d-9972-62ef0d520be1\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-859003-79948c7c7b-kh98h"
Jul 30 00:58:34.232271 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:58:34.232186    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pd7zf\" (UniqueName: \"kubernetes.io/projected/c4e05e92-362a-49ba-90d7-dc5ba4819253-kube-api-access-pd7zf\") pod \"payload-processing-e2e-ipp-cleanup-859003-67cbc4f5fd-s7klv\" (UID: \"c4e05e92-362a-49ba-90d7-dc5ba4819253\") " pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-859003-67cbc4f5fd-s7klv"
Jul 30 00:58:34.232271 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:58:34.232243    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/c4e05e92-362a-49ba-90d7-dc5ba4819253-plugins-config-volume\") pod \"payload-processing-e2e-ipp-cleanup-859003-67cbc4f5fd-s7klv\" (UID: \"c4e05e92-362a-49ba-90d7-dc5ba4819253\") " pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-859003-67cbc4f5fd-s7klv"
Jul 30 00:58:34.233012 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:58:34.232988    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/c4e05e92-362a-49ba-90d7-dc5ba4819253-plugins-config-volume\") pod \"payload-processing-e2e-ipp-cleanup-859003-67cbc4f5fd-s7klv\" (UID: \"c4e05e92-362a-49ba-90d7-dc5ba4819253\") " pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-859003-67cbc4f5fd-s7klv"
Jul 30 00:58:34.239727 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:58:34.239705    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pd7zf\" (UniqueName: \"kubernetes.io/projected/c4e05e92-362a-49ba-90d7-dc5ba4819253-kube-api-access-pd7zf\") pod \"payload-processing-e2e-ipp-cleanup-859003-67cbc4f5fd-s7klv\" (UID: \"c4e05e92-362a-49ba-90d7-dc5ba4819253\") " pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-859003-67cbc4f5fd-s7klv"
Jul 30 00:58:34.286392 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:58:34.286354    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-859003-79948c7c7b-kh98h"
Jul 30 00:58:34.323828 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:58:34.323797    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-859003-67cbc4f5fd-s7klv"
Jul 30 00:58:34.475181 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:58:34.475158    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-cleanup-859003-67cbc4f5fd-s7klv"]
Jul 30 00:58:34.477517 ip-10-0-133-55 kubenswrapper[2560]: W0730 00:58:34.477492    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc4e05e92_362a_49ba_90d7_dc5ba4819253.slice/crio-5868d3cc6f503e14633afc174087959819c2971462f78fb26cc62d97f90eddbe WatchSource:0}: Error finding container 5868d3cc6f503e14633afc174087959819c2971462f78fb26cc62d97f90eddbe: Status 404 returned error can't find the container with id 5868d3cc6f503e14633afc174087959819c2971462f78fb26cc62d97f90eddbe
Jul 30 00:58:34.639262 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:58:34.639236    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-859003-79948c7c7b-kh98h"]
Jul 30 00:58:34.641170 ip-10-0-133-55 kubenswrapper[2560]: W0730 00:58:34.641135    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb54aaddf_80cb_496d_9972_62ef0d520be1.slice/crio-cb1dc1bc0f7d6347198167026dfa439099d233ad54f15d8ad5a18ed036ddd149 WatchSource:0}: Error finding container cb1dc1bc0f7d6347198167026dfa439099d233ad54f15d8ad5a18ed036ddd149: Status 404 returned error can't find the container with id cb1dc1bc0f7d6347198167026dfa439099d233ad54f15d8ad5a18ed036ddd149
Jul 30 00:58:35.121301 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:58:35.121264    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-859003-79948c7c7b-kh98h" event={"ID":"b54aaddf-80cb-496d-9972-62ef0d520be1","Type":"ContainerStarted","Data":"314f3060235755a184ad45b7ac783ce2520f48b5ee957ed967400b7411a9235b"}
Jul 30 00:58:35.121794 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:58:35.121346    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-859003-79948c7c7b-kh98h" event={"ID":"b54aaddf-80cb-496d-9972-62ef0d520be1","Type":"ContainerStarted","Data":"cb1dc1bc0f7d6347198167026dfa439099d233ad54f15d8ad5a18ed036ddd149"}
Jul 30 00:58:35.121794 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:58:35.121456    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-859003-79948c7c7b-kh98h"
Jul 30 00:58:35.122893 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:58:35.122865    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-859003-67cbc4f5fd-s7klv" event={"ID":"c4e05e92-362a-49ba-90d7-dc5ba4819253","Type":"ContainerStarted","Data":"a11c61fa239005bf079b0ddc0a7d67b2f2ee0f348f5870651408b311012e0395"}
Jul 30 00:58:35.123029 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:58:35.122902    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-859003-67cbc4f5fd-s7klv" event={"ID":"c4e05e92-362a-49ba-90d7-dc5ba4819253","Type":"ContainerStarted","Data":"5868d3cc6f503e14633afc174087959819c2971462f78fb26cc62d97f90eddbe"}
Jul 30 00:58:35.123029 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:58:35.122940    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-859003-67cbc4f5fd-s7klv"
Jul 30 00:58:35.136997 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:58:35.136952    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-859003-79948c7c7b-kh98h" podStartSLOduration=2.136938679 podStartE2EDuration="2.136938679s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-30 00:58:33 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 00:58:35.136559096 +0000 UTC m=+3402.195775895" watchObservedRunningTime="2026-07-30 00:58:35.136938679 +0000 UTC m=+3402.196155482"
Jul 30 00:58:35.152619 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:58:35.152576    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-859003-67cbc4f5fd-s7klv" podStartSLOduration=2.152561061 podStartE2EDuration="2.152561061s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-30 00:58:33 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 00:58:35.150948912 +0000 UTC m=+3402.210165729" watchObservedRunningTime="2026-07-30 00:58:35.152561061 +0000 UTC m=+3402.211777864"
Jul 30 00:58:46.130429 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:58:46.130353    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-859003-67cbc4f5fd-s7klv"
Jul 30 00:58:46.130799 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:58:46.130434    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-859003-79948c7c7b-kh98h"
Jul 30 00:59:03.905192 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:59:03.905158    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-cleanup-859003-67cbc4f5fd-s7klv"]
Jul 30 00:59:03.905815 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:59:03.905413    2560 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-859003-67cbc4f5fd-s7klv" podUID="c4e05e92-362a-49ba-90d7-dc5ba4819253" containerName="payload-processing" containerID="cri-o://a11c61fa239005bf079b0ddc0a7d67b2f2ee0f348f5870651408b311012e0395" gracePeriod=30
Jul 30 00:59:03.914948 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:59:03.914917    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-859003-79948c7c7b-kh98h"]
Jul 30 00:59:03.915204 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:59:03.915140    2560 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-859003-79948c7c7b-kh98h" podUID="b54aaddf-80cb-496d-9972-62ef0d520be1" containerName="payload-pre-processing" containerID="cri-o://314f3060235755a184ad45b7ac783ce2520f48b5ee957ed967400b7411a9235b" gracePeriod=30
Jul 30 00:59:04.162539 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:59:04.162472    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-859003-67cbc4f5fd-s7klv"
Jul 30 00:59:04.207127 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:59:04.207099    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-859003-79948c7c7b-kh98h"
Jul 30 00:59:04.227341 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:59:04.227268    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/c4e05e92-362a-49ba-90d7-dc5ba4819253-plugins-config-volume\") pod \"c4e05e92-362a-49ba-90d7-dc5ba4819253\" (UID: \"c4e05e92-362a-49ba-90d7-dc5ba4819253\") "
Jul 30 00:59:04.227523 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:59:04.227358    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-9sqfz\" (UniqueName: \"kubernetes.io/projected/b54aaddf-80cb-496d-9972-62ef0d520be1-kube-api-access-9sqfz\") pod \"b54aaddf-80cb-496d-9972-62ef0d520be1\" (UID: \"b54aaddf-80cb-496d-9972-62ef0d520be1\") "
Jul 30 00:59:04.227523 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:59:04.227440    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/b54aaddf-80cb-496d-9972-62ef0d520be1-plugins-config-volume\") pod \"b54aaddf-80cb-496d-9972-62ef0d520be1\" (UID: \"b54aaddf-80cb-496d-9972-62ef0d520be1\") "
Jul 30 00:59:04.227523 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:59:04.227466    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-pd7zf\" (UniqueName: \"kubernetes.io/projected/c4e05e92-362a-49ba-90d7-dc5ba4819253-kube-api-access-pd7zf\") pod \"c4e05e92-362a-49ba-90d7-dc5ba4819253\" (UID: \"c4e05e92-362a-49ba-90d7-dc5ba4819253\") "
Jul 30 00:59:04.227722 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:59:04.227689    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c4e05e92-362a-49ba-90d7-dc5ba4819253-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "c4e05e92-362a-49ba-90d7-dc5ba4819253" (UID: "c4e05e92-362a-49ba-90d7-dc5ba4819253"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 30 00:59:04.228325 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:59:04.228211    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b54aaddf-80cb-496d-9972-62ef0d520be1-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "b54aaddf-80cb-496d-9972-62ef0d520be1" (UID: "b54aaddf-80cb-496d-9972-62ef0d520be1"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 30 00:59:04.230135 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:59:04.230109    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c4e05e92-362a-49ba-90d7-dc5ba4819253-kube-api-access-pd7zf" (OuterVolumeSpecName: "kube-api-access-pd7zf") pod "c4e05e92-362a-49ba-90d7-dc5ba4819253" (UID: "c4e05e92-362a-49ba-90d7-dc5ba4819253"). InnerVolumeSpecName "kube-api-access-pd7zf". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 30 00:59:04.230452 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:59:04.230426    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b54aaddf-80cb-496d-9972-62ef0d520be1-kube-api-access-9sqfz" (OuterVolumeSpecName: "kube-api-access-9sqfz") pod "b54aaddf-80cb-496d-9972-62ef0d520be1" (UID: "b54aaddf-80cb-496d-9972-62ef0d520be1"). InnerVolumeSpecName "kube-api-access-9sqfz". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 30 00:59:04.276337 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:59:04.276286    2560 generic.go:356] "Generic (PLEG): container finished" podID="b54aaddf-80cb-496d-9972-62ef0d520be1" containerID="314f3060235755a184ad45b7ac783ce2520f48b5ee957ed967400b7411a9235b" exitCode=0
Jul 30 00:59:04.276515 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:59:04.276356    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-859003-79948c7c7b-kh98h"
Jul 30 00:59:04.276515 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:59:04.276384    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-859003-79948c7c7b-kh98h" event={"ID":"b54aaddf-80cb-496d-9972-62ef0d520be1","Type":"ContainerDied","Data":"314f3060235755a184ad45b7ac783ce2520f48b5ee957ed967400b7411a9235b"}
Jul 30 00:59:04.276515 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:59:04.276439    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-859003-79948c7c7b-kh98h" event={"ID":"b54aaddf-80cb-496d-9972-62ef0d520be1","Type":"ContainerDied","Data":"cb1dc1bc0f7d6347198167026dfa439099d233ad54f15d8ad5a18ed036ddd149"}
Jul 30 00:59:04.276515 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:59:04.276469    2560 scope.go:117] "RemoveContainer" containerID="314f3060235755a184ad45b7ac783ce2520f48b5ee957ed967400b7411a9235b"
Jul 30 00:59:04.277884 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:59:04.277851    2560 generic.go:356] "Generic (PLEG): container finished" podID="c4e05e92-362a-49ba-90d7-dc5ba4819253" containerID="a11c61fa239005bf079b0ddc0a7d67b2f2ee0f348f5870651408b311012e0395" exitCode=0
Jul 30 00:59:04.277991 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:59:04.277923    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-859003-67cbc4f5fd-s7klv" event={"ID":"c4e05e92-362a-49ba-90d7-dc5ba4819253","Type":"ContainerDied","Data":"a11c61fa239005bf079b0ddc0a7d67b2f2ee0f348f5870651408b311012e0395"}
Jul 30 00:59:04.277991 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:59:04.277949    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-859003-67cbc4f5fd-s7klv"
Jul 30 00:59:04.277991 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:59:04.277954    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-859003-67cbc4f5fd-s7klv" event={"ID":"c4e05e92-362a-49ba-90d7-dc5ba4819253","Type":"ContainerDied","Data":"5868d3cc6f503e14633afc174087959819c2971462f78fb26cc62d97f90eddbe"}
Jul 30 00:59:04.287029 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:59:04.287009    2560 scope.go:117] "RemoveContainer" containerID="314f3060235755a184ad45b7ac783ce2520f48b5ee957ed967400b7411a9235b"
Jul 30 00:59:04.287288 ip-10-0-133-55 kubenswrapper[2560]: E0730 00:59:04.287272    2560 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"314f3060235755a184ad45b7ac783ce2520f48b5ee957ed967400b7411a9235b\": container with ID starting with 314f3060235755a184ad45b7ac783ce2520f48b5ee957ed967400b7411a9235b not found: ID does not exist" containerID="314f3060235755a184ad45b7ac783ce2520f48b5ee957ed967400b7411a9235b"
Jul 30 00:59:04.287375 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:59:04.287296    2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"314f3060235755a184ad45b7ac783ce2520f48b5ee957ed967400b7411a9235b"} err="failed to get container status \"314f3060235755a184ad45b7ac783ce2520f48b5ee957ed967400b7411a9235b\": rpc error: code = NotFound desc = could not find container \"314f3060235755a184ad45b7ac783ce2520f48b5ee957ed967400b7411a9235b\": container with ID starting with 314f3060235755a184ad45b7ac783ce2520f48b5ee957ed967400b7411a9235b not found: ID does not exist"
Jul 30 00:59:04.287375 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:59:04.287331    2560 scope.go:117] "RemoveContainer" containerID="a11c61fa239005bf079b0ddc0a7d67b2f2ee0f348f5870651408b311012e0395"
Jul 30 00:59:04.295419 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:59:04.295396    2560 scope.go:117] "RemoveContainer" containerID="a11c61fa239005bf079b0ddc0a7d67b2f2ee0f348f5870651408b311012e0395"
Jul 30 00:59:04.295691 ip-10-0-133-55 kubenswrapper[2560]: E0730 00:59:04.295670    2560 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a11c61fa239005bf079b0ddc0a7d67b2f2ee0f348f5870651408b311012e0395\": container with ID starting with a11c61fa239005bf079b0ddc0a7d67b2f2ee0f348f5870651408b311012e0395 not found: ID does not exist" containerID="a11c61fa239005bf079b0ddc0a7d67b2f2ee0f348f5870651408b311012e0395"
Jul 30 00:59:04.295762 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:59:04.295698    2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a11c61fa239005bf079b0ddc0a7d67b2f2ee0f348f5870651408b311012e0395"} err="failed to get container status \"a11c61fa239005bf079b0ddc0a7d67b2f2ee0f348f5870651408b311012e0395\": rpc error: code = NotFound desc = could not find container \"a11c61fa239005bf079b0ddc0a7d67b2f2ee0f348f5870651408b311012e0395\": container with ID starting with a11c61fa239005bf079b0ddc0a7d67b2f2ee0f348f5870651408b311012e0395 not found: ID does not exist"
Jul 30 00:59:04.302441 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:59:04.302418    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-cleanup-859003-67cbc4f5fd-s7klv"]
Jul 30 00:59:04.305878 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:59:04.305858    2560 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-cleanup-859003-67cbc4f5fd-s7klv"]
Jul 30 00:59:04.315725 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:59:04.315703    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-859003-79948c7c7b-kh98h"]
Jul 30 00:59:04.319765 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:59:04.319743    2560 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-859003-79948c7c7b-kh98h"]
Jul 30 00:59:04.328582 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:59:04.328558    2560 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/c4e05e92-362a-49ba-90d7-dc5ba4819253-plugins-config-volume\") on node \"ip-10-0-133-55.ec2.internal\" DevicePath \"\""
Jul 30 00:59:04.328658 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:59:04.328582    2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-9sqfz\" (UniqueName: \"kubernetes.io/projected/b54aaddf-80cb-496d-9972-62ef0d520be1-kube-api-access-9sqfz\") on node \"ip-10-0-133-55.ec2.internal\" DevicePath \"\""
Jul 30 00:59:04.328658 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:59:04.328597    2560 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/b54aaddf-80cb-496d-9972-62ef0d520be1-plugins-config-volume\") on node \"ip-10-0-133-55.ec2.internal\" DevicePath \"\""
Jul 30 00:59:04.328658 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:59:04.328605    2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-pd7zf\" (UniqueName: \"kubernetes.io/projected/c4e05e92-362a-49ba-90d7-dc5ba4819253-kube-api-access-pd7zf\") on node \"ip-10-0-133-55.ec2.internal\" DevicePath \"\""
Jul 30 00:59:05.405918 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:59:05.405882    2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b54aaddf-80cb-496d-9972-62ef0d520be1" path="/var/lib/kubelet/pods/b54aaddf-80cb-496d-9972-62ef0d520be1/volumes"
Jul 30 00:59:05.406306 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:59:05.406297    2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c4e05e92-362a-49ba-90d7-dc5ba4819253" path="/var/lib/kubelet/pods/c4e05e92-362a-49ba-90d7-dc5ba4819253/volumes"
Jul 30 00:59:29.263439 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:59:29.263404    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-a-7fa598-685fd85574-cjbp5"]
Jul 30 00:59:29.264028 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:59:29.263620    2560 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-ipp-a-7fa598-685fd85574-cjbp5" podUID="cf7cbd8c-65e2-4984-bbbd-34786d5bfef8" containerName="payload-processing" containerID="cri-o://26e1ccf9f1b968d4aff7bf5bb7ec80a922b349179036d5e1081d8b9afdab7a7a" gracePeriod=30
Jul 30 00:59:29.269526 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:59:29.269499    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-a-7fa598-5df7f9cdb8-htb45"]
Jul 30 00:59:29.269726 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:59:29.269705    2560 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-7fa598-5df7f9cdb8-htb45" podUID="3f3269de-4c41-409c-b755-918b3c0f0ac8" containerName="payload-pre-processing" containerID="cri-o://b7c41a0e85a5f0b91df9274f7ab30f3c2d6988a462fccf4edca165e5930af6a6" gracePeriod=30
Jul 30 00:59:29.415471 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:59:29.415437    2560 generic.go:356] "Generic (PLEG): container finished" podID="cf7cbd8c-65e2-4984-bbbd-34786d5bfef8" containerID="26e1ccf9f1b968d4aff7bf5bb7ec80a922b349179036d5e1081d8b9afdab7a7a" exitCode=0
Jul 30 00:59:29.415653 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:59:29.415522    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-a-7fa598-685fd85574-cjbp5" event={"ID":"cf7cbd8c-65e2-4984-bbbd-34786d5bfef8","Type":"ContainerDied","Data":"26e1ccf9f1b968d4aff7bf5bb7ec80a922b349179036d5e1081d8b9afdab7a7a"}
Jul 30 00:59:29.417398 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:59:29.417370    2560 generic.go:356] "Generic (PLEG): container finished" podID="3f3269de-4c41-409c-b755-918b3c0f0ac8" containerID="b7c41a0e85a5f0b91df9274f7ab30f3c2d6988a462fccf4edca165e5930af6a6" exitCode=0
Jul 30 00:59:29.417537 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:59:29.417419    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-7fa598-5df7f9cdb8-htb45" event={"ID":"3f3269de-4c41-409c-b755-918b3c0f0ac8","Type":"ContainerDied","Data":"b7c41a0e85a5f0b91df9274f7ab30f3c2d6988a462fccf4edca165e5930af6a6"}
Jul 30 00:59:29.556162 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:59:29.556134    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-7fa598-5df7f9cdb8-htb45"
Jul 30 00:59:29.559046 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:59:29.559027    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-a-7fa598-685fd85574-cjbp5"
Jul 30 00:59:29.685664 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:59:29.685630    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-7djpt\" (UniqueName: \"kubernetes.io/projected/cf7cbd8c-65e2-4984-bbbd-34786d5bfef8-kube-api-access-7djpt\") pod \"cf7cbd8c-65e2-4984-bbbd-34786d5bfef8\" (UID: \"cf7cbd8c-65e2-4984-bbbd-34786d5bfef8\") "
Jul 30 00:59:29.685664 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:59:29.685665    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-4xgjv\" (UniqueName: \"kubernetes.io/projected/3f3269de-4c41-409c-b755-918b3c0f0ac8-kube-api-access-4xgjv\") pod \"3f3269de-4c41-409c-b755-918b3c0f0ac8\" (UID: \"3f3269de-4c41-409c-b755-918b3c0f0ac8\") "
Jul 30 00:59:29.685865 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:59:29.685712    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/cf7cbd8c-65e2-4984-bbbd-34786d5bfef8-plugins-config-volume\") pod \"cf7cbd8c-65e2-4984-bbbd-34786d5bfef8\" (UID: \"cf7cbd8c-65e2-4984-bbbd-34786d5bfef8\") "
Jul 30 00:59:29.685865 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:59:29.685817    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/3f3269de-4c41-409c-b755-918b3c0f0ac8-plugins-config-volume\") pod \"3f3269de-4c41-409c-b755-918b3c0f0ac8\" (UID: \"3f3269de-4c41-409c-b755-918b3c0f0ac8\") "
Jul 30 00:59:29.686169 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:59:29.686141    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/cf7cbd8c-65e2-4984-bbbd-34786d5bfef8-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "cf7cbd8c-65e2-4984-bbbd-34786d5bfef8" (UID: "cf7cbd8c-65e2-4984-bbbd-34786d5bfef8"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 30 00:59:29.686249 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:59:29.686197    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3f3269de-4c41-409c-b755-918b3c0f0ac8-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "3f3269de-4c41-409c-b755-918b3c0f0ac8" (UID: "3f3269de-4c41-409c-b755-918b3c0f0ac8"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 30 00:59:29.687759 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:59:29.687736    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/cf7cbd8c-65e2-4984-bbbd-34786d5bfef8-kube-api-access-7djpt" (OuterVolumeSpecName: "kube-api-access-7djpt") pod "cf7cbd8c-65e2-4984-bbbd-34786d5bfef8" (UID: "cf7cbd8c-65e2-4984-bbbd-34786d5bfef8"). InnerVolumeSpecName "kube-api-access-7djpt". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 30 00:59:29.687873 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:59:29.687852    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3f3269de-4c41-409c-b755-918b3c0f0ac8-kube-api-access-4xgjv" (OuterVolumeSpecName: "kube-api-access-4xgjv") pod "3f3269de-4c41-409c-b755-918b3c0f0ac8" (UID: "3f3269de-4c41-409c-b755-918b3c0f0ac8"). InnerVolumeSpecName "kube-api-access-4xgjv". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 30 00:59:29.787084 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:59:29.787020    2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-7djpt\" (UniqueName: \"kubernetes.io/projected/cf7cbd8c-65e2-4984-bbbd-34786d5bfef8-kube-api-access-7djpt\") on node \"ip-10-0-133-55.ec2.internal\" DevicePath \"\""
Jul 30 00:59:29.787084 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:59:29.787043    2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-4xgjv\" (UniqueName: \"kubernetes.io/projected/3f3269de-4c41-409c-b755-918b3c0f0ac8-kube-api-access-4xgjv\") on node \"ip-10-0-133-55.ec2.internal\" DevicePath \"\""
Jul 30 00:59:29.787084 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:59:29.787054    2560 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/cf7cbd8c-65e2-4984-bbbd-34786d5bfef8-plugins-config-volume\") on node \"ip-10-0-133-55.ec2.internal\" DevicePath \"\""
Jul 30 00:59:29.787084 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:59:29.787062    2560 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/3f3269de-4c41-409c-b755-918b3c0f0ac8-plugins-config-volume\") on node \"ip-10-0-133-55.ec2.internal\" DevicePath \"\""
Jul 30 00:59:30.424136 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:59:30.424101    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-a-7fa598-685fd85574-cjbp5"
Jul 30 00:59:30.424633 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:59:30.424101    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-a-7fa598-685fd85574-cjbp5" event={"ID":"cf7cbd8c-65e2-4984-bbbd-34786d5bfef8","Type":"ContainerDied","Data":"254f7dea4efa6706c054c69d9212ebeeca3bade797d5f90499c4ced11ea29101"}
Jul 30 00:59:30.424633 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:59:30.424233    2560 scope.go:117] "RemoveContainer" containerID="26e1ccf9f1b968d4aff7bf5bb7ec80a922b349179036d5e1081d8b9afdab7a7a"
Jul 30 00:59:30.425736 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:59:30.425399    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-7fa598-5df7f9cdb8-htb45" event={"ID":"3f3269de-4c41-409c-b755-918b3c0f0ac8","Type":"ContainerDied","Data":"804932ead2a240cdb4b3c6d9a411781c362e4e472ba24290c7ef29cd1e8120c3"}
Jul 30 00:59:30.425736 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:59:30.425424    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-7fa598-5df7f9cdb8-htb45"
Jul 30 00:59:30.434447 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:59:30.434427    2560 scope.go:117] "RemoveContainer" containerID="b7c41a0e85a5f0b91df9274f7ab30f3c2d6988a462fccf4edca165e5930af6a6"
Jul 30 00:59:30.449943 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:59:30.449923    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-a-7fa598-5df7f9cdb8-htb45"]
Jul 30 00:59:30.457416 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:59:30.457396    2560 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-a-7fa598-5df7f9cdb8-htb45"]
Jul 30 00:59:30.467444 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:59:30.467425    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-a-7fa598-685fd85574-cjbp5"]
Jul 30 00:59:30.470620 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:59:30.470600    2560 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-a-7fa598-685fd85574-cjbp5"]
Jul 30 00:59:31.406420 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:59:31.406385    2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="3f3269de-4c41-409c-b755-918b3c0f0ac8" path="/var/lib/kubelet/pods/3f3269de-4c41-409c-b755-918b3c0f0ac8/volumes"
Jul 30 00:59:31.406751 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:59:31.406738    2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="cf7cbd8c-65e2-4984-bbbd-34786d5bfef8" path="/var/lib/kubelet/pods/cf7cbd8c-65e2-4984-bbbd-34786d5bfef8/volumes"
Jul 30 00:59:34.753719 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:59:34.753683    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-ipp-a-7fa598/ipp-route-7fa598-kserve-6978f99cd7-5cpks"]
Jul 30 00:59:49.773093 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:59:49.773047    2560 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-ipp-a-7fa598/ipp-route-7fa598-kserve-6978f99cd7-5cpks" podUID="00e808eb-9e9c-465d-9c16-46f454fd7f48" containerName="main" containerID="cri-o://274d8cd803508ea614cd93e5cd6ffebae0c2159d061f0518c41a13e80abf0c29" gracePeriod=45
Jul 30 00:59:50.036108 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:59:50.036049    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-ipp-a-7fa598/ipp-route-7fa598-kserve-6978f99cd7-5cpks"
Jul 30 00:59:50.092195 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:59:50.092164    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/00e808eb-9e9c-465d-9c16-46f454fd7f48-home\") pod \"00e808eb-9e9c-465d-9c16-46f454fd7f48\" (UID: \"00e808eb-9e9c-465d-9c16-46f454fd7f48\") "
Jul 30 00:59:50.092393 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:59:50.092212    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/00e808eb-9e9c-465d-9c16-46f454fd7f48-tmp-dir\") pod \"00e808eb-9e9c-465d-9c16-46f454fd7f48\" (UID: \"00e808eb-9e9c-465d-9c16-46f454fd7f48\") "
Jul 30 00:59:50.092393 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:59:50.092254    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/00e808eb-9e9c-465d-9c16-46f454fd7f48-dshm\") pod \"00e808eb-9e9c-465d-9c16-46f454fd7f48\" (UID: \"00e808eb-9e9c-465d-9c16-46f454fd7f48\") "
Jul 30 00:59:50.092393 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:59:50.092300    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/00e808eb-9e9c-465d-9c16-46f454fd7f48-model-cache\") pod \"00e808eb-9e9c-465d-9c16-46f454fd7f48\" (UID: \"00e808eb-9e9c-465d-9c16-46f454fd7f48\") "
Jul 30 00:59:50.092393 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:59:50.092372    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/00e808eb-9e9c-465d-9c16-46f454fd7f48-tls-certs\") pod \"00e808eb-9e9c-465d-9c16-46f454fd7f48\" (UID: \"00e808eb-9e9c-465d-9c16-46f454fd7f48\") "
Jul 30 00:59:50.092624 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:59:50.092429    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-wrx2l\" (UniqueName: \"kubernetes.io/projected/00e808eb-9e9c-465d-9c16-46f454fd7f48-kube-api-access-wrx2l\") pod \"00e808eb-9e9c-465d-9c16-46f454fd7f48\" (UID: \"00e808eb-9e9c-465d-9c16-46f454fd7f48\") "
Jul 30 00:59:50.092624 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:59:50.092513    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/00e808eb-9e9c-465d-9c16-46f454fd7f48-home" (OuterVolumeSpecName: "home") pod "00e808eb-9e9c-465d-9c16-46f454fd7f48" (UID: "00e808eb-9e9c-465d-9c16-46f454fd7f48"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 30 00:59:50.092624 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:59:50.092534    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/00e808eb-9e9c-465d-9c16-46f454fd7f48-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "00e808eb-9e9c-465d-9c16-46f454fd7f48" (UID: "00e808eb-9e9c-465d-9c16-46f454fd7f48"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 30 00:59:50.092816 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:59:50.092794    2560 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/00e808eb-9e9c-465d-9c16-46f454fd7f48-home\") on node \"ip-10-0-133-55.ec2.internal\" DevicePath \"\""
Jul 30 00:59:50.092888 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:59:50.092819    2560 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/00e808eb-9e9c-465d-9c16-46f454fd7f48-tmp-dir\") on node \"ip-10-0-133-55.ec2.internal\" DevicePath \"\""
Jul 30 00:59:50.092942 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:59:50.092902    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/00e808eb-9e9c-465d-9c16-46f454fd7f48-model-cache" (OuterVolumeSpecName: "model-cache") pod "00e808eb-9e9c-465d-9c16-46f454fd7f48" (UID: "00e808eb-9e9c-465d-9c16-46f454fd7f48"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 30 00:59:50.094470 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:59:50.094444    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/00e808eb-9e9c-465d-9c16-46f454fd7f48-dshm" (OuterVolumeSpecName: "dshm") pod "00e808eb-9e9c-465d-9c16-46f454fd7f48" (UID: "00e808eb-9e9c-465d-9c16-46f454fd7f48"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 30 00:59:50.094585 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:59:50.094562    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/00e808eb-9e9c-465d-9c16-46f454fd7f48-kube-api-access-wrx2l" (OuterVolumeSpecName: "kube-api-access-wrx2l") pod "00e808eb-9e9c-465d-9c16-46f454fd7f48" (UID: "00e808eb-9e9c-465d-9c16-46f454fd7f48"). InnerVolumeSpecName "kube-api-access-wrx2l". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 30 00:59:50.094978 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:59:50.094959    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/00e808eb-9e9c-465d-9c16-46f454fd7f48-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "00e808eb-9e9c-465d-9c16-46f454fd7f48" (UID: "00e808eb-9e9c-465d-9c16-46f454fd7f48"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 30 00:59:50.193595 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:59:50.193560    2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-wrx2l\" (UniqueName: \"kubernetes.io/projected/00e808eb-9e9c-465d-9c16-46f454fd7f48-kube-api-access-wrx2l\") on node \"ip-10-0-133-55.ec2.internal\" DevicePath \"\""
Jul 30 00:59:50.193595 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:59:50.193590    2560 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/00e808eb-9e9c-465d-9c16-46f454fd7f48-dshm\") on node \"ip-10-0-133-55.ec2.internal\" DevicePath \"\""
Jul 30 00:59:50.193595 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:59:50.193600    2560 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/00e808eb-9e9c-465d-9c16-46f454fd7f48-model-cache\") on node \"ip-10-0-133-55.ec2.internal\" DevicePath \"\""
Jul 30 00:59:50.193814 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:59:50.193608    2560 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/00e808eb-9e9c-465d-9c16-46f454fd7f48-tls-certs\") on node \"ip-10-0-133-55.ec2.internal\" DevicePath \"\""
Jul 30 00:59:50.540127 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:59:50.540093    2560 generic.go:356] "Generic (PLEG): container finished" podID="00e808eb-9e9c-465d-9c16-46f454fd7f48" containerID="274d8cd803508ea614cd93e5cd6ffebae0c2159d061f0518c41a13e80abf0c29" exitCode=0
Jul 30 00:59:50.540300 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:59:50.540139    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-ipp-a-7fa598/ipp-route-7fa598-kserve-6978f99cd7-5cpks"
Jul 30 00:59:50.540300 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:59:50.540166    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-ipp-a-7fa598/ipp-route-7fa598-kserve-6978f99cd7-5cpks" event={"ID":"00e808eb-9e9c-465d-9c16-46f454fd7f48","Type":"ContainerDied","Data":"274d8cd803508ea614cd93e5cd6ffebae0c2159d061f0518c41a13e80abf0c29"}
Jul 30 00:59:50.540300 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:59:50.540208    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-ipp-a-7fa598/ipp-route-7fa598-kserve-6978f99cd7-5cpks" event={"ID":"00e808eb-9e9c-465d-9c16-46f454fd7f48","Type":"ContainerDied","Data":"34fd66b5d9ab814793078a3b66717c8496039b12c000a2389fc3c5bde6610ea3"}
Jul 30 00:59:50.540300 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:59:50.540227    2560 scope.go:117] "RemoveContainer" containerID="274d8cd803508ea614cd93e5cd6ffebae0c2159d061f0518c41a13e80abf0c29"
Jul 30 00:59:50.549061 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:59:50.549044    2560 scope.go:117] "RemoveContainer" containerID="274d8cd803508ea614cd93e5cd6ffebae0c2159d061f0518c41a13e80abf0c29"
Jul 30 00:59:50.549301 ip-10-0-133-55 kubenswrapper[2560]: E0730 00:59:50.549283    2560 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"274d8cd803508ea614cd93e5cd6ffebae0c2159d061f0518c41a13e80abf0c29\": container with ID starting with 274d8cd803508ea614cd93e5cd6ffebae0c2159d061f0518c41a13e80abf0c29 not found: ID does not exist" containerID="274d8cd803508ea614cd93e5cd6ffebae0c2159d061f0518c41a13e80abf0c29"
Jul 30 00:59:50.549375 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:59:50.549321    2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"274d8cd803508ea614cd93e5cd6ffebae0c2159d061f0518c41a13e80abf0c29"} err="failed to get container status \"274d8cd803508ea614cd93e5cd6ffebae0c2159d061f0518c41a13e80abf0c29\": rpc error: code = NotFound desc = could not find container \"274d8cd803508ea614cd93e5cd6ffebae0c2159d061f0518c41a13e80abf0c29\": container with ID starting with 274d8cd803508ea614cd93e5cd6ffebae0c2159d061f0518c41a13e80abf0c29 not found: ID does not exist"
Jul 30 00:59:50.560539 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:59:50.560505    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-ipp-a-7fa598/ipp-route-7fa598-kserve-6978f99cd7-5cpks"]
Jul 30 00:59:50.563908 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:59:50.563888    2560 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-ipp-a-7fa598/ipp-route-7fa598-kserve-6978f99cd7-5cpks"]
Jul 30 00:59:51.406452 ip-10-0-133-55 kubenswrapper[2560]: I0730 00:59:51.406417    2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="00e808eb-9e9c-465d-9c16-46f454fd7f48" path="/var/lib/kubelet/pods/00e808eb-9e9c-465d-9c16-46f454fd7f48/volumes"
Jul 30 01:00:00.216864 ip-10-0-133-55 kubenswrapper[2560]: I0730 01:00:00.216824    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-4ef902-29756220-v2d4l"]
Jul 30 01:00:00.217296 ip-10-0-133-55 kubenswrapper[2560]: I0730 01:00:00.217279    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="cf7cbd8c-65e2-4984-bbbd-34786d5bfef8" containerName="payload-processing"
Jul 30 01:00:00.217380 ip-10-0-133-55 kubenswrapper[2560]: I0730 01:00:00.217297    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="cf7cbd8c-65e2-4984-bbbd-34786d5bfef8" containerName="payload-processing"
Jul 30 01:00:00.217380 ip-10-0-133-55 kubenswrapper[2560]: I0730 01:00:00.217319    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b54aaddf-80cb-496d-9972-62ef0d520be1" containerName="payload-pre-processing"
Jul 30 01:00:00.217380 ip-10-0-133-55 kubenswrapper[2560]: I0730 01:00:00.217325    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="b54aaddf-80cb-496d-9972-62ef0d520be1" containerName="payload-pre-processing"
Jul 30 01:00:00.217380 ip-10-0-133-55 kubenswrapper[2560]: I0730 01:00:00.217338    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c4e05e92-362a-49ba-90d7-dc5ba4819253" containerName="payload-processing"
Jul 30 01:00:00.217380 ip-10-0-133-55 kubenswrapper[2560]: I0730 01:00:00.217344    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="c4e05e92-362a-49ba-90d7-dc5ba4819253" containerName="payload-processing"
Jul 30 01:00:00.217380 ip-10-0-133-55 kubenswrapper[2560]: I0730 01:00:00.217351    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3f3269de-4c41-409c-b755-918b3c0f0ac8" containerName="payload-pre-processing"
Jul 30 01:00:00.217380 ip-10-0-133-55 kubenswrapper[2560]: I0730 01:00:00.217357    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="3f3269de-4c41-409c-b755-918b3c0f0ac8" containerName="payload-pre-processing"
Jul 30 01:00:00.217380 ip-10-0-133-55 kubenswrapper[2560]: I0730 01:00:00.217371    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="00e808eb-9e9c-465d-9c16-46f454fd7f48" containerName="main"
Jul 30 01:00:00.217380 ip-10-0-133-55 kubenswrapper[2560]: I0730 01:00:00.217376    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="00e808eb-9e9c-465d-9c16-46f454fd7f48" containerName="main"
Jul 30 01:00:00.217665 ip-10-0-133-55 kubenswrapper[2560]: I0730 01:00:00.217449    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="cf7cbd8c-65e2-4984-bbbd-34786d5bfef8" containerName="payload-processing"
Jul 30 01:00:00.217665 ip-10-0-133-55 kubenswrapper[2560]: I0730 01:00:00.217461    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="b54aaddf-80cb-496d-9972-62ef0d520be1" containerName="payload-pre-processing"
Jul 30 01:00:00.217665 ip-10-0-133-55 kubenswrapper[2560]: I0730 01:00:00.217474    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="00e808eb-9e9c-465d-9c16-46f454fd7f48" containerName="main"
Jul 30 01:00:00.217665 ip-10-0-133-55 kubenswrapper[2560]: I0730 01:00:00.217483    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="3f3269de-4c41-409c-b755-918b3c0f0ac8" containerName="payload-pre-processing"
Jul 30 01:00:00.217665 ip-10-0-133-55 kubenswrapper[2560]: I0730 01:00:00.217489    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="c4e05e92-362a-49ba-90d7-dc5ba4819253" containerName="payload-processing"
Jul 30 01:00:00.222463 ip-10-0-133-55 kubenswrapper[2560]: I0730 01:00:00.222446    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-4ef902-29756220-v2d4l"
Jul 30 01:00:00.226708 ip-10-0-133-55 kubenswrapper[2560]: I0730 01:00:00.226685    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-t42rq\""
Jul 30 01:00:00.231662 ip-10-0-133-55 kubenswrapper[2560]: I0730 01:00:00.231644    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-4ef902-29756220-v2d4l"
Jul 30 01:00:00.246642 ip-10-0-133-55 kubenswrapper[2560]: I0730 01:00:00.246617    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-4ef902-29756220-v2d4l"]
Jul 30 01:00:00.372811 ip-10-0-133-55 kubenswrapper[2560]: I0730 01:00:00.372781    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-4ef902-29756220-v2d4l"]
Jul 30 01:00:00.373866 ip-10-0-133-55 kubenswrapper[2560]: W0730 01:00:00.373840    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd74fbc87_2f1b_4b28_a5ae_96dee9ac88a5.slice/crio-71182d14cf5d557217510c37fa11818457886df9b71f7627393e681958e63e69 WatchSource:0}: Error finding container 71182d14cf5d557217510c37fa11818457886df9b71f7627393e681958e63e69: Status 404 returned error can't find the container with id 71182d14cf5d557217510c37fa11818457886df9b71f7627393e681958e63e69
Jul 30 01:00:00.599685 ip-10-0-133-55 kubenswrapper[2560]: I0730 01:00:00.599654    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-4ef902-29756220-v2d4l" event={"ID":"d74fbc87-2f1b-4b28-a5ae-96dee9ac88a5","Type":"ContainerStarted","Data":"71182d14cf5d557217510c37fa11818457886df9b71f7627393e681958e63e69"}
Jul 30 01:00:01.606016 ip-10-0-133-55 kubenswrapper[2560]: I0730 01:00:01.605915    2560 generic.go:356] "Generic (PLEG): container finished" podID="d74fbc87-2f1b-4b28-a5ae-96dee9ac88a5" containerID="461125dff546f4081e037f18e16c0ae18f6b8444961d875ef51007b5ca63ff6b" exitCode=0
Jul 30 01:00:01.606443 ip-10-0-133-55 kubenswrapper[2560]: I0730 01:00:01.606010    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-4ef902-29756220-v2d4l" event={"ID":"d74fbc87-2f1b-4b28-a5ae-96dee9ac88a5","Type":"ContainerDied","Data":"461125dff546f4081e037f18e16c0ae18f6b8444961d875ef51007b5ca63ff6b"}
Jul 30 01:00:02.748596 ip-10-0-133-55 kubenswrapper[2560]: I0730 01:00:02.748568    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-4ef902-29756220-v2d4l"
Jul 30 01:00:03.617449 ip-10-0-133-55 kubenswrapper[2560]: I0730 01:00:03.617420    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-4ef902-29756220-v2d4l"
Jul 30 01:00:03.617625 ip-10-0-133-55 kubenswrapper[2560]: I0730 01:00:03.617420    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-4ef902-29756220-v2d4l" event={"ID":"d74fbc87-2f1b-4b28-a5ae-96dee9ac88a5","Type":"ContainerDied","Data":"71182d14cf5d557217510c37fa11818457886df9b71f7627393e681958e63e69"}
Jul 30 01:00:03.617625 ip-10-0-133-55 kubenswrapper[2560]: I0730 01:00:03.617547    2560 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="71182d14cf5d557217510c37fa11818457886df9b71f7627393e681958e63e69"
Jul 30 01:00:37.093700 ip-10-0-133-55 kubenswrapper[2560]: I0730 01:00:37.093660    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-b-edaa93-99c599b66-7jjdk"]
Jul 30 01:00:37.094272 ip-10-0-133-55 kubenswrapper[2560]: I0730 01:00:37.093943    2560 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-ipp-b-edaa93-99c599b66-7jjdk" podUID="303a4bf9-6849-4f8f-b17f-36c25f4f397b" containerName="payload-processing" containerID="cri-o://6af00b01a03bb31fac59884e0be4a0bc23c02c885f145cd78e5bf814e52e26d5" gracePeriod=30
Jul 30 01:00:37.096676 ip-10-0-133-55 kubenswrapper[2560]: I0730 01:00:37.096650    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-b-edaa93-c66d77c76-958ph"]
Jul 30 01:00:37.096899 ip-10-0-133-55 kubenswrapper[2560]: I0730 01:00:37.096857    2560 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-edaa93-c66d77c76-958ph" podUID="275c5f78-1bff-41b7-b1cd-ed82d29ba129" containerName="payload-pre-processing" containerID="cri-o://ebc854bc4c955b28f88c59ccbbaad9b6144a423873d8c6931b2e448d22f9b213" gracePeriod=30
Jul 30 01:00:37.382337 ip-10-0-133-55 kubenswrapper[2560]: I0730 01:00:37.382301    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-b-edaa93-99c599b66-7jjdk"
Jul 30 01:00:37.385272 ip-10-0-133-55 kubenswrapper[2560]: I0730 01:00:37.385253    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-edaa93-c66d77c76-958ph"
Jul 30 01:00:37.539391 ip-10-0-133-55 kubenswrapper[2560]: I0730 01:00:37.539353    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-8qjbb\" (UniqueName: \"kubernetes.io/projected/275c5f78-1bff-41b7-b1cd-ed82d29ba129-kube-api-access-8qjbb\") pod \"275c5f78-1bff-41b7-b1cd-ed82d29ba129\" (UID: \"275c5f78-1bff-41b7-b1cd-ed82d29ba129\") "
Jul 30 01:00:37.539391 ip-10-0-133-55 kubenswrapper[2560]: I0730 01:00:37.539392    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/275c5f78-1bff-41b7-b1cd-ed82d29ba129-plugins-config-volume\") pod \"275c5f78-1bff-41b7-b1cd-ed82d29ba129\" (UID: \"275c5f78-1bff-41b7-b1cd-ed82d29ba129\") "
Jul 30 01:00:37.539623 ip-10-0-133-55 kubenswrapper[2560]: I0730 01:00:37.539460    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-c6wr8\" (UniqueName: \"kubernetes.io/projected/303a4bf9-6849-4f8f-b17f-36c25f4f397b-kube-api-access-c6wr8\") pod \"303a4bf9-6849-4f8f-b17f-36c25f4f397b\" (UID: \"303a4bf9-6849-4f8f-b17f-36c25f4f397b\") "
Jul 30 01:00:37.539623 ip-10-0-133-55 kubenswrapper[2560]: I0730 01:00:37.539488    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/303a4bf9-6849-4f8f-b17f-36c25f4f397b-plugins-config-volume\") pod \"303a4bf9-6849-4f8f-b17f-36c25f4f397b\" (UID: \"303a4bf9-6849-4f8f-b17f-36c25f4f397b\") "
Jul 30 01:00:37.539854 ip-10-0-133-55 kubenswrapper[2560]: I0730 01:00:37.539827    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/275c5f78-1bff-41b7-b1cd-ed82d29ba129-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "275c5f78-1bff-41b7-b1cd-ed82d29ba129" (UID: "275c5f78-1bff-41b7-b1cd-ed82d29ba129"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 30 01:00:37.539962 ip-10-0-133-55 kubenswrapper[2560]: I0730 01:00:37.539937    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/303a4bf9-6849-4f8f-b17f-36c25f4f397b-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "303a4bf9-6849-4f8f-b17f-36c25f4f397b" (UID: "303a4bf9-6849-4f8f-b17f-36c25f4f397b"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 30 01:00:37.541614 ip-10-0-133-55 kubenswrapper[2560]: I0730 01:00:37.541591    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/303a4bf9-6849-4f8f-b17f-36c25f4f397b-kube-api-access-c6wr8" (OuterVolumeSpecName: "kube-api-access-c6wr8") pod "303a4bf9-6849-4f8f-b17f-36c25f4f397b" (UID: "303a4bf9-6849-4f8f-b17f-36c25f4f397b"). InnerVolumeSpecName "kube-api-access-c6wr8". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 30 01:00:37.541724 ip-10-0-133-55 kubenswrapper[2560]: I0730 01:00:37.541629    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/275c5f78-1bff-41b7-b1cd-ed82d29ba129-kube-api-access-8qjbb" (OuterVolumeSpecName: "kube-api-access-8qjbb") pod "275c5f78-1bff-41b7-b1cd-ed82d29ba129" (UID: "275c5f78-1bff-41b7-b1cd-ed82d29ba129"). InnerVolumeSpecName "kube-api-access-8qjbb". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 30 01:00:37.640259 ip-10-0-133-55 kubenswrapper[2560]: I0730 01:00:37.640234    2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-c6wr8\" (UniqueName: \"kubernetes.io/projected/303a4bf9-6849-4f8f-b17f-36c25f4f397b-kube-api-access-c6wr8\") on node \"ip-10-0-133-55.ec2.internal\" DevicePath \"\""
Jul 30 01:00:37.640259 ip-10-0-133-55 kubenswrapper[2560]: I0730 01:00:37.640260    2560 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/303a4bf9-6849-4f8f-b17f-36c25f4f397b-plugins-config-volume\") on node \"ip-10-0-133-55.ec2.internal\" DevicePath \"\""
Jul 30 01:00:37.640450 ip-10-0-133-55 kubenswrapper[2560]: I0730 01:00:37.640269    2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-8qjbb\" (UniqueName: \"kubernetes.io/projected/275c5f78-1bff-41b7-b1cd-ed82d29ba129-kube-api-access-8qjbb\") on node \"ip-10-0-133-55.ec2.internal\" DevicePath \"\""
Jul 30 01:00:37.640450 ip-10-0-133-55 kubenswrapper[2560]: I0730 01:00:37.640278    2560 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/275c5f78-1bff-41b7-b1cd-ed82d29ba129-plugins-config-volume\") on node \"ip-10-0-133-55.ec2.internal\" DevicePath \"\""
Jul 30 01:00:37.784205 ip-10-0-133-55 kubenswrapper[2560]: I0730 01:00:37.784173    2560 generic.go:356] "Generic (PLEG): container finished" podID="303a4bf9-6849-4f8f-b17f-36c25f4f397b" containerID="6af00b01a03bb31fac59884e0be4a0bc23c02c885f145cd78e5bf814e52e26d5" exitCode=0
Jul 30 01:00:37.784386 ip-10-0-133-55 kubenswrapper[2560]: I0730 01:00:37.784223    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-b-edaa93-99c599b66-7jjdk"
Jul 30 01:00:37.784386 ip-10-0-133-55 kubenswrapper[2560]: I0730 01:00:37.784260    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-b-edaa93-99c599b66-7jjdk" event={"ID":"303a4bf9-6849-4f8f-b17f-36c25f4f397b","Type":"ContainerDied","Data":"6af00b01a03bb31fac59884e0be4a0bc23c02c885f145cd78e5bf814e52e26d5"}
Jul 30 01:00:37.784386 ip-10-0-133-55 kubenswrapper[2560]: I0730 01:00:37.784326    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-b-edaa93-99c599b66-7jjdk" event={"ID":"303a4bf9-6849-4f8f-b17f-36c25f4f397b","Type":"ContainerDied","Data":"3b8d6242fbbcc36fbca81c31d9a148d59e5d1f0e04bfc7f66534a1913d6fbcb1"}
Jul 30 01:00:37.784386 ip-10-0-133-55 kubenswrapper[2560]: I0730 01:00:37.784353    2560 scope.go:117] "RemoveContainer" containerID="6af00b01a03bb31fac59884e0be4a0bc23c02c885f145cd78e5bf814e52e26d5"
Jul 30 01:00:37.785853 ip-10-0-133-55 kubenswrapper[2560]: I0730 01:00:37.785830    2560 generic.go:356] "Generic (PLEG): container finished" podID="275c5f78-1bff-41b7-b1cd-ed82d29ba129" containerID="ebc854bc4c955b28f88c59ccbbaad9b6144a423873d8c6931b2e448d22f9b213" exitCode=0
Jul 30 01:00:37.785984 ip-10-0-133-55 kubenswrapper[2560]: I0730 01:00:37.785959    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-edaa93-c66d77c76-958ph"
Jul 30 01:00:37.786057 ip-10-0-133-55 kubenswrapper[2560]: I0730 01:00:37.785962    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-edaa93-c66d77c76-958ph" event={"ID":"275c5f78-1bff-41b7-b1cd-ed82d29ba129","Type":"ContainerDied","Data":"ebc854bc4c955b28f88c59ccbbaad9b6144a423873d8c6931b2e448d22f9b213"}
Jul 30 01:00:37.786118 ip-10-0-133-55 kubenswrapper[2560]: I0730 01:00:37.786074    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-edaa93-c66d77c76-958ph" event={"ID":"275c5f78-1bff-41b7-b1cd-ed82d29ba129","Type":"ContainerDied","Data":"88e5f4621323626fcdd6844b1bd9dcc56b0fe545812a53dbb191377215f00317"}
Jul 30 01:00:37.794246 ip-10-0-133-55 kubenswrapper[2560]: I0730 01:00:37.794230    2560 scope.go:117] "RemoveContainer" containerID="6af00b01a03bb31fac59884e0be4a0bc23c02c885f145cd78e5bf814e52e26d5"
Jul 30 01:00:37.794543 ip-10-0-133-55 kubenswrapper[2560]: E0730 01:00:37.794516    2560 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6af00b01a03bb31fac59884e0be4a0bc23c02c885f145cd78e5bf814e52e26d5\": container with ID starting with 6af00b01a03bb31fac59884e0be4a0bc23c02c885f145cd78e5bf814e52e26d5 not found: ID does not exist" containerID="6af00b01a03bb31fac59884e0be4a0bc23c02c885f145cd78e5bf814e52e26d5"
Jul 30 01:00:37.794623 ip-10-0-133-55 kubenswrapper[2560]: I0730 01:00:37.794553    2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6af00b01a03bb31fac59884e0be4a0bc23c02c885f145cd78e5bf814e52e26d5"} err="failed to get container status \"6af00b01a03bb31fac59884e0be4a0bc23c02c885f145cd78e5bf814e52e26d5\": rpc error: code = NotFound desc = could not find container \"6af00b01a03bb31fac59884e0be4a0bc23c02c885f145cd78e5bf814e52e26d5\": container with ID starting with 6af00b01a03bb31fac59884e0be4a0bc23c02c885f145cd78e5bf814e52e26d5 not found: ID does not exist"
Jul 30 01:00:37.794623 ip-10-0-133-55 kubenswrapper[2560]: I0730 01:00:37.794576    2560 scope.go:117] "RemoveContainer" containerID="ebc854bc4c955b28f88c59ccbbaad9b6144a423873d8c6931b2e448d22f9b213"
Jul 30 01:00:37.802734 ip-10-0-133-55 kubenswrapper[2560]: I0730 01:00:37.802716    2560 scope.go:117] "RemoveContainer" containerID="ebc854bc4c955b28f88c59ccbbaad9b6144a423873d8c6931b2e448d22f9b213"
Jul 30 01:00:37.803011 ip-10-0-133-55 kubenswrapper[2560]: E0730 01:00:37.802991    2560 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ebc854bc4c955b28f88c59ccbbaad9b6144a423873d8c6931b2e448d22f9b213\": container with ID starting with ebc854bc4c955b28f88c59ccbbaad9b6144a423873d8c6931b2e448d22f9b213 not found: ID does not exist" containerID="ebc854bc4c955b28f88c59ccbbaad9b6144a423873d8c6931b2e448d22f9b213"
Jul 30 01:00:37.803053 ip-10-0-133-55 kubenswrapper[2560]: I0730 01:00:37.803019    2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ebc854bc4c955b28f88c59ccbbaad9b6144a423873d8c6931b2e448d22f9b213"} err="failed to get container status \"ebc854bc4c955b28f88c59ccbbaad9b6144a423873d8c6931b2e448d22f9b213\": rpc error: code = NotFound desc = could not find container \"ebc854bc4c955b28f88c59ccbbaad9b6144a423873d8c6931b2e448d22f9b213\": container with ID starting with ebc854bc4c955b28f88c59ccbbaad9b6144a423873d8c6931b2e448d22f9b213 not found: ID does not exist"
Jul 30 01:00:37.810347 ip-10-0-133-55 kubenswrapper[2560]: I0730 01:00:37.810324    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-b-edaa93-99c599b66-7jjdk"]
Jul 30 01:00:37.812294 ip-10-0-133-55 kubenswrapper[2560]: I0730 01:00:37.812274    2560 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-b-edaa93-99c599b66-7jjdk"]
Jul 30 01:00:37.822373 ip-10-0-133-55 kubenswrapper[2560]: I0730 01:00:37.822354    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-b-edaa93-c66d77c76-958ph"]
Jul 30 01:00:37.827413 ip-10-0-133-55 kubenswrapper[2560]: I0730 01:00:37.827392    2560 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-b-edaa93-c66d77c76-958ph"]
Jul 30 01:00:39.405874 ip-10-0-133-55 kubenswrapper[2560]: I0730 01:00:39.405842    2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="275c5f78-1bff-41b7-b1cd-ed82d29ba129" path="/var/lib/kubelet/pods/275c5f78-1bff-41b7-b1cd-ed82d29ba129/volumes"
Jul 30 01:00:39.406251 ip-10-0-133-55 kubenswrapper[2560]: I0730 01:00:39.406212    2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="303a4bf9-6849-4f8f-b17f-36c25f4f397b" path="/var/lib/kubelet/pods/303a4bf9-6849-4f8f-b17f-36c25f4f397b/volumes"
Jul 30 01:00:54.611428 ip-10-0-133-55 kubenswrapper[2560]: I0730 01:00:54.611390    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-4ef902-29756220-v2d4l"]
Jul 30 01:00:54.616725 ip-10-0-133-55 kubenswrapper[2560]: I0730 01:00:54.616700    2560 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-4ef902-29756220-v2d4l"]
Jul 30 01:00:54.644055 ip-10-0-133-55 kubenswrapper[2560]: I0730 01:00:54.644022    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-a-4ef902-7d6ff4cc78-rzpv5"]
Jul 30 01:00:54.644275 ip-10-0-133-55 kubenswrapper[2560]: I0730 01:00:54.644232    2560 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-shared-a-4ef902-7d6ff4cc78-rzpv5" podUID="4196f26e-db36-4dbb-bc3a-cd447eb14720" containerName="payload-processing" containerID="cri-o://d68b3653c9b082c43a18fec62c95bd21547640e04c4cd9289c190267ced07de6" gracePeriod=30
Jul 30 01:00:54.650302 ip-10-0-133-55 kubenswrapper[2560]: I0730 01:00:54.650275    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-a-4ef902-5cf4cc99cb-qpkvr"]
Jul 30 01:00:54.650537 ip-10-0-133-55 kubenswrapper[2560]: I0730 01:00:54.650508    2560 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-4ef902-5cf4cc99cb-qpkvr" podUID="532c2d6c-48d3-49fa-a3e9-3ce294c162fb" containerName="payload-pre-processing" containerID="cri-o://b705df8904d81be7757f63afa1cff3c5e2c61488fb6987cd19af57af284f2cb1" gracePeriod=30
Jul 30 01:00:54.875546 ip-10-0-133-55 kubenswrapper[2560]: I0730 01:00:54.875520    2560 generic.go:356] "Generic (PLEG): container finished" podID="4196f26e-db36-4dbb-bc3a-cd447eb14720" containerID="d68b3653c9b082c43a18fec62c95bd21547640e04c4cd9289c190267ced07de6" exitCode=0
Jul 30 01:00:54.875706 ip-10-0-133-55 kubenswrapper[2560]: I0730 01:00:54.875590    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-a-4ef902-7d6ff4cc78-rzpv5" event={"ID":"4196f26e-db36-4dbb-bc3a-cd447eb14720","Type":"ContainerDied","Data":"d68b3653c9b082c43a18fec62c95bd21547640e04c4cd9289c190267ced07de6"}
Jul 30 01:00:54.877370 ip-10-0-133-55 kubenswrapper[2560]: I0730 01:00:54.877344    2560 generic.go:356] "Generic (PLEG): container finished" podID="532c2d6c-48d3-49fa-a3e9-3ce294c162fb" containerID="b705df8904d81be7757f63afa1cff3c5e2c61488fb6987cd19af57af284f2cb1" exitCode=0
Jul 30 01:00:54.877515 ip-10-0-133-55 kubenswrapper[2560]: I0730 01:00:54.877419    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-4ef902-5cf4cc99cb-qpkvr" event={"ID":"532c2d6c-48d3-49fa-a3e9-3ce294c162fb","Type":"ContainerDied","Data":"b705df8904d81be7757f63afa1cff3c5e2c61488fb6987cd19af57af284f2cb1"}
Jul 30 01:00:54.926659 ip-10-0-133-55 kubenswrapper[2560]: I0730 01:00:54.926637    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-a-4ef902-7d6ff4cc78-rzpv5"
Jul 30 01:00:54.929340 ip-10-0-133-55 kubenswrapper[2560]: I0730 01:00:54.929303    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-4ef902-5cf4cc99cb-qpkvr"
Jul 30 01:00:54.994367 ip-10-0-133-55 kubenswrapper[2560]: I0730 01:00:54.994306    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-m7mxv\" (UniqueName: \"kubernetes.io/projected/4196f26e-db36-4dbb-bc3a-cd447eb14720-kube-api-access-m7mxv\") pod \"4196f26e-db36-4dbb-bc3a-cd447eb14720\" (UID: \"4196f26e-db36-4dbb-bc3a-cd447eb14720\") "
Jul 30 01:00:54.994367 ip-10-0-133-55 kubenswrapper[2560]: I0730 01:00:54.994375    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/532c2d6c-48d3-49fa-a3e9-3ce294c162fb-plugins-config-volume\") pod \"532c2d6c-48d3-49fa-a3e9-3ce294c162fb\" (UID: \"532c2d6c-48d3-49fa-a3e9-3ce294c162fb\") "
Jul 30 01:00:54.994629 ip-10-0-133-55 kubenswrapper[2560]: I0730 01:00:54.994438    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-zpbmq\" (UniqueName: \"kubernetes.io/projected/532c2d6c-48d3-49fa-a3e9-3ce294c162fb-kube-api-access-zpbmq\") pod \"532c2d6c-48d3-49fa-a3e9-3ce294c162fb\" (UID: \"532c2d6c-48d3-49fa-a3e9-3ce294c162fb\") "
Jul 30 01:00:54.994629 ip-10-0-133-55 kubenswrapper[2560]: I0730 01:00:54.994496    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/4196f26e-db36-4dbb-bc3a-cd447eb14720-plugins-config-volume\") pod \"4196f26e-db36-4dbb-bc3a-cd447eb14720\" (UID: \"4196f26e-db36-4dbb-bc3a-cd447eb14720\") "
Jul 30 01:00:54.994820 ip-10-0-133-55 kubenswrapper[2560]: I0730 01:00:54.994789    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/532c2d6c-48d3-49fa-a3e9-3ce294c162fb-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "532c2d6c-48d3-49fa-a3e9-3ce294c162fb" (UID: "532c2d6c-48d3-49fa-a3e9-3ce294c162fb"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 30 01:00:54.994915 ip-10-0-133-55 kubenswrapper[2560]: I0730 01:00:54.994893    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4196f26e-db36-4dbb-bc3a-cd447eb14720-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "4196f26e-db36-4dbb-bc3a-cd447eb14720" (UID: "4196f26e-db36-4dbb-bc3a-cd447eb14720"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 30 01:00:54.996528 ip-10-0-133-55 kubenswrapper[2560]: I0730 01:00:54.996502    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4196f26e-db36-4dbb-bc3a-cd447eb14720-kube-api-access-m7mxv" (OuterVolumeSpecName: "kube-api-access-m7mxv") pod "4196f26e-db36-4dbb-bc3a-cd447eb14720" (UID: "4196f26e-db36-4dbb-bc3a-cd447eb14720"). InnerVolumeSpecName "kube-api-access-m7mxv". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 30 01:00:54.996681 ip-10-0-133-55 kubenswrapper[2560]: I0730 01:00:54.996547    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/532c2d6c-48d3-49fa-a3e9-3ce294c162fb-kube-api-access-zpbmq" (OuterVolumeSpecName: "kube-api-access-zpbmq") pod "532c2d6c-48d3-49fa-a3e9-3ce294c162fb" (UID: "532c2d6c-48d3-49fa-a3e9-3ce294c162fb"). InnerVolumeSpecName "kube-api-access-zpbmq". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 30 01:00:55.095885 ip-10-0-133-55 kubenswrapper[2560]: I0730 01:00:55.095847    2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-m7mxv\" (UniqueName: \"kubernetes.io/projected/4196f26e-db36-4dbb-bc3a-cd447eb14720-kube-api-access-m7mxv\") on node \"ip-10-0-133-55.ec2.internal\" DevicePath \"\""
Jul 30 01:00:55.095885 ip-10-0-133-55 kubenswrapper[2560]: I0730 01:00:55.095881    2560 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/532c2d6c-48d3-49fa-a3e9-3ce294c162fb-plugins-config-volume\") on node \"ip-10-0-133-55.ec2.internal\" DevicePath \"\""
Jul 30 01:00:55.096091 ip-10-0-133-55 kubenswrapper[2560]: I0730 01:00:55.095895    2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-zpbmq\" (UniqueName: \"kubernetes.io/projected/532c2d6c-48d3-49fa-a3e9-3ce294c162fb-kube-api-access-zpbmq\") on node \"ip-10-0-133-55.ec2.internal\" DevicePath \"\""
Jul 30 01:00:55.096091 ip-10-0-133-55 kubenswrapper[2560]: I0730 01:00:55.095909    2560 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/4196f26e-db36-4dbb-bc3a-cd447eb14720-plugins-config-volume\") on node \"ip-10-0-133-55.ec2.internal\" DevicePath \"\""
Jul 30 01:00:55.404698 ip-10-0-133-55 kubenswrapper[2560]: I0730 01:00:55.404663    2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d74fbc87-2f1b-4b28-a5ae-96dee9ac88a5" path="/var/lib/kubelet/pods/d74fbc87-2f1b-4b28-a5ae-96dee9ac88a5/volumes"
Jul 30 01:00:55.883662 ip-10-0-133-55 kubenswrapper[2560]: I0730 01:00:55.883636    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-4ef902-5cf4cc99cb-qpkvr"
Jul 30 01:00:55.884106 ip-10-0-133-55 kubenswrapper[2560]: I0730 01:00:55.883677    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-4ef902-5cf4cc99cb-qpkvr" event={"ID":"532c2d6c-48d3-49fa-a3e9-3ce294c162fb","Type":"ContainerDied","Data":"145249dd231a58aae8c06ece79c0db5f8a6ca492a3cd8e9b5a65f034b1d5d547"}
Jul 30 01:00:55.884106 ip-10-0-133-55 kubenswrapper[2560]: I0730 01:00:55.883737    2560 scope.go:117] "RemoveContainer" containerID="b705df8904d81be7757f63afa1cff3c5e2c61488fb6987cd19af57af284f2cb1"
Jul 30 01:00:55.885101 ip-10-0-133-55 kubenswrapper[2560]: I0730 01:00:55.885076    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-a-4ef902-7d6ff4cc78-rzpv5" event={"ID":"4196f26e-db36-4dbb-bc3a-cd447eb14720","Type":"ContainerDied","Data":"b49ff2dcd5c9673bcd68f0c1945a9a1a3608ad8c204f37d97378b3d4f6cabd8a"}
Jul 30 01:00:55.885101 ip-10-0-133-55 kubenswrapper[2560]: I0730 01:00:55.885089    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-a-4ef902-7d6ff4cc78-rzpv5"
Jul 30 01:00:55.892357 ip-10-0-133-55 kubenswrapper[2560]: I0730 01:00:55.892339    2560 scope.go:117] "RemoveContainer" containerID="d68b3653c9b082c43a18fec62c95bd21547640e04c4cd9289c190267ced07de6"
Jul 30 01:00:55.904363 ip-10-0-133-55 kubenswrapper[2560]: I0730 01:00:55.904342    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-a-4ef902-7d6ff4cc78-rzpv5"]
Jul 30 01:00:55.908358 ip-10-0-133-55 kubenswrapper[2560]: I0730 01:00:55.908336    2560 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-a-4ef902-7d6ff4cc78-rzpv5"]
Jul 30 01:00:55.917959 ip-10-0-133-55 kubenswrapper[2560]: I0730 01:00:55.917932    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-a-4ef902-5cf4cc99cb-qpkvr"]
Jul 30 01:00:55.919911 ip-10-0-133-55 kubenswrapper[2560]: I0730 01:00:55.919891    2560 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-a-4ef902-5cf4cc99cb-qpkvr"]
Jul 30 01:00:57.405231 ip-10-0-133-55 kubenswrapper[2560]: I0730 01:00:57.405197    2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="4196f26e-db36-4dbb-bc3a-cd447eb14720" path="/var/lib/kubelet/pods/4196f26e-db36-4dbb-bc3a-cd447eb14720/volumes"
Jul 30 01:00:57.405642 ip-10-0-133-55 kubenswrapper[2560]: I0730 01:00:57.405593    2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="532c2d6c-48d3-49fa-a3e9-3ce294c162fb" path="/var/lib/kubelet/pods/532c2d6c-48d3-49fa-a3e9-3ce294c162fb/volumes"
Jul 30 01:01:12.117521 ip-10-0-133-55 kubenswrapper[2560]: I0730 01:01:12.115966    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-b-0b2dae-7fdb5b4f58-kzb8m"]
Jul 30 01:01:12.117521 ip-10-0-133-55 kubenswrapper[2560]: I0730 01:01:12.116560    2560 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-shared-b-0b2dae-7fdb5b4f58-kzb8m" podUID="7bbec726-d0dd-463c-81fb-57caf0182742" containerName="payload-processing" containerID="cri-o://e39982931565e0e6130409dd4b18ee659a29423a4c1939073543bd72399dd20d" gracePeriod=30
Jul 30 01:01:12.135701 ip-10-0-133-55 kubenswrapper[2560]: I0730 01:01:12.132007    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-b-0b2dae-5d9846886d-f9p9n"]
Jul 30 01:01:12.135701 ip-10-0-133-55 kubenswrapper[2560]: I0730 01:01:12.132240    2560 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-0b2dae-5d9846886d-f9p9n" podUID="b489d67f-5cab-48d9-aae5-7cb0d27fbdf9" containerName="payload-pre-processing" containerID="cri-o://883e2e7f9a83c834687f2632733f5fa1c0c84769373ae09ac61a06619cf05ba9" gracePeriod=30
Jul 30 01:01:12.418789 ip-10-0-133-55 kubenswrapper[2560]: I0730 01:01:12.418760    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-b-0b2dae-7fdb5b4f58-kzb8m"
Jul 30 01:01:12.422053 ip-10-0-133-55 kubenswrapper[2560]: I0730 01:01:12.422030    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-0b2dae-5d9846886d-f9p9n"
Jul 30 01:01:12.563435 ip-10-0-133-55 kubenswrapper[2560]: I0730 01:01:12.563397    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-55tjs\" (UniqueName: \"kubernetes.io/projected/b489d67f-5cab-48d9-aae5-7cb0d27fbdf9-kube-api-access-55tjs\") pod \"b489d67f-5cab-48d9-aae5-7cb0d27fbdf9\" (UID: \"b489d67f-5cab-48d9-aae5-7cb0d27fbdf9\") "
Jul 30 01:01:12.563609 ip-10-0-133-55 kubenswrapper[2560]: I0730 01:01:12.563448    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/7bbec726-d0dd-463c-81fb-57caf0182742-plugins-config-volume\") pod \"7bbec726-d0dd-463c-81fb-57caf0182742\" (UID: \"7bbec726-d0dd-463c-81fb-57caf0182742\") "
Jul 30 01:01:12.563609 ip-10-0-133-55 kubenswrapper[2560]: I0730 01:01:12.563491    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/b489d67f-5cab-48d9-aae5-7cb0d27fbdf9-plugins-config-volume\") pod \"b489d67f-5cab-48d9-aae5-7cb0d27fbdf9\" (UID: \"b489d67f-5cab-48d9-aae5-7cb0d27fbdf9\") "
Jul 30 01:01:12.563609 ip-10-0-133-55 kubenswrapper[2560]: I0730 01:01:12.563560    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-vnzj6\" (UniqueName: \"kubernetes.io/projected/7bbec726-d0dd-463c-81fb-57caf0182742-kube-api-access-vnzj6\") pod \"7bbec726-d0dd-463c-81fb-57caf0182742\" (UID: \"7bbec726-d0dd-463c-81fb-57caf0182742\") "
Jul 30 01:01:12.563908 ip-10-0-133-55 kubenswrapper[2560]: I0730 01:01:12.563887    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/7bbec726-d0dd-463c-81fb-57caf0182742-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "7bbec726-d0dd-463c-81fb-57caf0182742" (UID: "7bbec726-d0dd-463c-81fb-57caf0182742"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 30 01:01:12.563979 ip-10-0-133-55 kubenswrapper[2560]: I0730 01:01:12.563885    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b489d67f-5cab-48d9-aae5-7cb0d27fbdf9-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "b489d67f-5cab-48d9-aae5-7cb0d27fbdf9" (UID: "b489d67f-5cab-48d9-aae5-7cb0d27fbdf9"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 30 01:01:12.565651 ip-10-0-133-55 kubenswrapper[2560]: I0730 01:01:12.565627    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7bbec726-d0dd-463c-81fb-57caf0182742-kube-api-access-vnzj6" (OuterVolumeSpecName: "kube-api-access-vnzj6") pod "7bbec726-d0dd-463c-81fb-57caf0182742" (UID: "7bbec726-d0dd-463c-81fb-57caf0182742"). InnerVolumeSpecName "kube-api-access-vnzj6". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 30 01:01:12.565741 ip-10-0-133-55 kubenswrapper[2560]: I0730 01:01:12.565721    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b489d67f-5cab-48d9-aae5-7cb0d27fbdf9-kube-api-access-55tjs" (OuterVolumeSpecName: "kube-api-access-55tjs") pod "b489d67f-5cab-48d9-aae5-7cb0d27fbdf9" (UID: "b489d67f-5cab-48d9-aae5-7cb0d27fbdf9"). InnerVolumeSpecName "kube-api-access-55tjs". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 30 01:01:12.664602 ip-10-0-133-55 kubenswrapper[2560]: I0730 01:01:12.664523    2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-vnzj6\" (UniqueName: \"kubernetes.io/projected/7bbec726-d0dd-463c-81fb-57caf0182742-kube-api-access-vnzj6\") on node \"ip-10-0-133-55.ec2.internal\" DevicePath \"\""
Jul 30 01:01:12.664602 ip-10-0-133-55 kubenswrapper[2560]: I0730 01:01:12.664549    2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-55tjs\" (UniqueName: \"kubernetes.io/projected/b489d67f-5cab-48d9-aae5-7cb0d27fbdf9-kube-api-access-55tjs\") on node \"ip-10-0-133-55.ec2.internal\" DevicePath \"\""
Jul 30 01:01:12.664602 ip-10-0-133-55 kubenswrapper[2560]: I0730 01:01:12.664560    2560 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/7bbec726-d0dd-463c-81fb-57caf0182742-plugins-config-volume\") on node \"ip-10-0-133-55.ec2.internal\" DevicePath \"\""
Jul 30 01:01:12.664602 ip-10-0-133-55 kubenswrapper[2560]: I0730 01:01:12.664569    2560 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/b489d67f-5cab-48d9-aae5-7cb0d27fbdf9-plugins-config-volume\") on node \"ip-10-0-133-55.ec2.internal\" DevicePath \"\""
Jul 30 01:01:12.973157 ip-10-0-133-55 kubenswrapper[2560]: I0730 01:01:12.973059    2560 generic.go:356] "Generic (PLEG): container finished" podID="7bbec726-d0dd-463c-81fb-57caf0182742" containerID="e39982931565e0e6130409dd4b18ee659a29423a4c1939073543bd72399dd20d" exitCode=0
Jul 30 01:01:12.973157 ip-10-0-133-55 kubenswrapper[2560]: I0730 01:01:12.973123    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-b-0b2dae-7fdb5b4f58-kzb8m"
Jul 30 01:01:12.973157 ip-10-0-133-55 kubenswrapper[2560]: I0730 01:01:12.973134    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-b-0b2dae-7fdb5b4f58-kzb8m" event={"ID":"7bbec726-d0dd-463c-81fb-57caf0182742","Type":"ContainerDied","Data":"e39982931565e0e6130409dd4b18ee659a29423a4c1939073543bd72399dd20d"}
Jul 30 01:01:12.973487 ip-10-0-133-55 kubenswrapper[2560]: I0730 01:01:12.973211    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-b-0b2dae-7fdb5b4f58-kzb8m" event={"ID":"7bbec726-d0dd-463c-81fb-57caf0182742","Type":"ContainerDied","Data":"f3b45264af61cd8f60cd730ec5f23baacaaa21fdcb09a348617afb1f4f13e714"}
Jul 30 01:01:12.973487 ip-10-0-133-55 kubenswrapper[2560]: I0730 01:01:12.973240    2560 scope.go:117] "RemoveContainer" containerID="e39982931565e0e6130409dd4b18ee659a29423a4c1939073543bd72399dd20d"
Jul 30 01:01:12.974470 ip-10-0-133-55 kubenswrapper[2560]: I0730 01:01:12.974445    2560 generic.go:356] "Generic (PLEG): container finished" podID="b489d67f-5cab-48d9-aae5-7cb0d27fbdf9" containerID="883e2e7f9a83c834687f2632733f5fa1c0c84769373ae09ac61a06619cf05ba9" exitCode=0
Jul 30 01:01:12.974557 ip-10-0-133-55 kubenswrapper[2560]: I0730 01:01:12.974485    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-0b2dae-5d9846886d-f9p9n" event={"ID":"b489d67f-5cab-48d9-aae5-7cb0d27fbdf9","Type":"ContainerDied","Data":"883e2e7f9a83c834687f2632733f5fa1c0c84769373ae09ac61a06619cf05ba9"}
Jul 30 01:01:12.974557 ip-10-0-133-55 kubenswrapper[2560]: I0730 01:01:12.974502    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-0b2dae-5d9846886d-f9p9n"
Jul 30 01:01:12.974557 ip-10-0-133-55 kubenswrapper[2560]: I0730 01:01:12.974522    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-0b2dae-5d9846886d-f9p9n" event={"ID":"b489d67f-5cab-48d9-aae5-7cb0d27fbdf9","Type":"ContainerDied","Data":"1ce11276b89be4ffa101f054f6c8200b86def3741a4dabcf944b2d8518ee51a3"}
Jul 30 01:01:12.983145 ip-10-0-133-55 kubenswrapper[2560]: I0730 01:01:12.983129    2560 scope.go:117] "RemoveContainer" containerID="e39982931565e0e6130409dd4b18ee659a29423a4c1939073543bd72399dd20d"
Jul 30 01:01:12.983447 ip-10-0-133-55 kubenswrapper[2560]: E0730 01:01:12.983426    2560 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e39982931565e0e6130409dd4b18ee659a29423a4c1939073543bd72399dd20d\": container with ID starting with e39982931565e0e6130409dd4b18ee659a29423a4c1939073543bd72399dd20d not found: ID does not exist" containerID="e39982931565e0e6130409dd4b18ee659a29423a4c1939073543bd72399dd20d"
Jul 30 01:01:12.983522 ip-10-0-133-55 kubenswrapper[2560]: I0730 01:01:12.983456    2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e39982931565e0e6130409dd4b18ee659a29423a4c1939073543bd72399dd20d"} err="failed to get container status \"e39982931565e0e6130409dd4b18ee659a29423a4c1939073543bd72399dd20d\": rpc error: code = NotFound desc = could not find container \"e39982931565e0e6130409dd4b18ee659a29423a4c1939073543bd72399dd20d\": container with ID starting with e39982931565e0e6130409dd4b18ee659a29423a4c1939073543bd72399dd20d not found: ID does not exist"
Jul 30 01:01:12.983522 ip-10-0-133-55 kubenswrapper[2560]: I0730 01:01:12.983479    2560 scope.go:117] "RemoveContainer" containerID="883e2e7f9a83c834687f2632733f5fa1c0c84769373ae09ac61a06619cf05ba9"
Jul 30 01:01:12.991511 ip-10-0-133-55 kubenswrapper[2560]: I0730 01:01:12.991412    2560 scope.go:117] "RemoveContainer" containerID="883e2e7f9a83c834687f2632733f5fa1c0c84769373ae09ac61a06619cf05ba9"
Jul 30 01:01:12.991705 ip-10-0-133-55 kubenswrapper[2560]: E0730 01:01:12.991685    2560 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"883e2e7f9a83c834687f2632733f5fa1c0c84769373ae09ac61a06619cf05ba9\": container with ID starting with 883e2e7f9a83c834687f2632733f5fa1c0c84769373ae09ac61a06619cf05ba9 not found: ID does not exist" containerID="883e2e7f9a83c834687f2632733f5fa1c0c84769373ae09ac61a06619cf05ba9"
Jul 30 01:01:12.991777 ip-10-0-133-55 kubenswrapper[2560]: I0730 01:01:12.991744    2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"883e2e7f9a83c834687f2632733f5fa1c0c84769373ae09ac61a06619cf05ba9"} err="failed to get container status \"883e2e7f9a83c834687f2632733f5fa1c0c84769373ae09ac61a06619cf05ba9\": rpc error: code = NotFound desc = could not find container \"883e2e7f9a83c834687f2632733f5fa1c0c84769373ae09ac61a06619cf05ba9\": container with ID starting with 883e2e7f9a83c834687f2632733f5fa1c0c84769373ae09ac61a06619cf05ba9 not found: ID does not exist"
Jul 30 01:01:13.009134 ip-10-0-133-55 kubenswrapper[2560]: I0730 01:01:13.009108    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-b-0b2dae-7fdb5b4f58-kzb8m"]
Jul 30 01:01:13.012889 ip-10-0-133-55 kubenswrapper[2560]: I0730 01:01:13.012866    2560 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-b-0b2dae-7fdb5b4f58-kzb8m"]
Jul 30 01:01:13.022125 ip-10-0-133-55 kubenswrapper[2560]: I0730 01:01:13.022101    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-b-0b2dae-5d9846886d-f9p9n"]
Jul 30 01:01:13.025515 ip-10-0-133-55 kubenswrapper[2560]: I0730 01:01:13.025493    2560 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-b-0b2dae-5d9846886d-f9p9n"]
Jul 30 01:01:13.404609 ip-10-0-133-55 kubenswrapper[2560]: I0730 01:01:13.404578    2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="7bbec726-d0dd-463c-81fb-57caf0182742" path="/var/lib/kubelet/pods/7bbec726-d0dd-463c-81fb-57caf0182742/volumes"
Jul 30 01:01:13.404989 ip-10-0-133-55 kubenswrapper[2560]: I0730 01:01:13.404951    2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b489d67f-5cab-48d9-aae5-7cb0d27fbdf9" path="/var/lib/kubelet/pods/b489d67f-5cab-48d9-aae5-7cb0d27fbdf9/volumes"
Jul 30 01:01:25.208597 ip-10-0-133-55 kubenswrapper[2560]: I0730 01:01:25.208565    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-655d97b687-jztcs_e13b47e6-3a05-49b1-8639-3dab7c0840ec/copy-manifests/0.log"
Jul 30 01:01:25.226557 ip-10-0-133-55 kubenswrapper[2560]: I0730 01:01:25.226531    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-655d97b687-jztcs_e13b47e6-3a05-49b1-8639-3dab7c0840ec/manager/0.log"
Jul 30 01:01:28.176807 ip-10-0-133-55 kubenswrapper[2560]: I0730 01:01:28.176766    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-859d7b78bd-vlv6d_adc44d58-7632-4ead-8afa-c94c6632e16e/manager/0.log"
Jul 30 01:01:28.860712 ip-10-0-133-55 kubenswrapper[2560]: I0730 01:01:28.860684    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-59c4b4bfcf-qsdmz_ca09c72b-01af-4369-a33f-7cd5af50baad/kube-auth-proxy/0.log"
Jul 30 01:01:29.224357 ip-10-0-133-55 kubenswrapper[2560]: I0730 01:01:29.224321    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-5cc6cd444b-6txxf_59139f9a-241a-42f1-a0c9-97c147cf4f7e/payload-processing/0.log"
Jul 30 01:01:29.669526 ip-10-0-133-55 kubenswrapper[2560]: I0730 01:01:29.669497    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-2-simulated-kserve-67d8d5d6d-qd87f_6b7761c6-b890-4b58-91e0-f1f87238e75a/main/0.log"
Jul 30 01:01:29.886224 ip-10-0-133-55 kubenswrapper[2560]: I0730 01:01:29.886195    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-trlp-test-simulated-kserve-598466548d-vr28c_28162862-9b92-43aa-b271-bbce806ae795/main/0.log"
Jul 30 01:01:30.221347 ip-10-0-133-55 kubenswrapper[2560]: I0730 01:01:30.221298    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_premium-simulated-simulated-premium-kserve-57fc66f697-gb8zz_c4633223-25b1-4000-84da-adb60d1a9982/main/0.log"
Jul 30 01:01:39.179880 ip-10-0-133-55 kubenswrapper[2560]: I0730 01:01:39.179840    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-nfssx_e1fdf440-f1f1-40b4-9660-32cc39e1de67/global-pull-secret-syncer/0.log"
Jul 30 01:01:39.330820 ip-10-0-133-55 kubenswrapper[2560]: I0730 01:01:39.330786    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-n8zl8_c2108e9a-b8cd-4419-82ea-2f677d5e3a01/konnectivity-agent/0.log"
Jul 30 01:01:39.413363 ip-10-0-133-55 kubenswrapper[2560]: I0730 01:01:39.413337    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-133-55.ec2.internal_7c492b170a03fda6652336c23f5889cf/haproxy/0.log"
Jul 30 01:01:45.042571 ip-10-0-133-55 kubenswrapper[2560]: I0730 01:01:45.042487    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-859d7b78bd-vlv6d_adc44d58-7632-4ead-8afa-c94c6632e16e/manager/0.log"
Jul 30 01:01:47.048053 ip-10-0-133-55 kubenswrapper[2560]: I0730 01:01:47.048016    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_monitoring-plugin-68b7fc9574-qmq2l_3f85b798-f561-4c04-9d52-4d8e5b4d1621/monitoring-plugin/0.log"
Jul 30 01:01:47.237093 ip-10-0-133-55 kubenswrapper[2560]: I0730 01:01:47.237061    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-wxnvd_a132b604-b1d6-4461-a916-d9bea9b5ca63/node-exporter/0.log"
Jul 30 01:01:47.256159 ip-10-0-133-55 kubenswrapper[2560]: I0730 01:01:47.256135    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-wxnvd_a132b604-b1d6-4461-a916-d9bea9b5ca63/kube-rbac-proxy/0.log"
Jul 30 01:01:47.277495 ip-10-0-133-55 kubenswrapper[2560]: I0730 01:01:47.277466    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-wxnvd_a132b604-b1d6-4461-a916-d9bea9b5ca63/init-textfile/0.log"
Jul 30 01:01:47.394408 ip-10-0-133-55 kubenswrapper[2560]: I0730 01:01:47.394305    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_3e055160-b969-4006-be53-f8624ce4acc2/prometheus/0.log"
Jul 30 01:01:47.414475 ip-10-0-133-55 kubenswrapper[2560]: I0730 01:01:47.414448    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_3e055160-b969-4006-be53-f8624ce4acc2/config-reloader/0.log"
Jul 30 01:01:47.435633 ip-10-0-133-55 kubenswrapper[2560]: I0730 01:01:47.435600    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_3e055160-b969-4006-be53-f8624ce4acc2/thanos-sidecar/0.log"
Jul 30 01:01:47.455998 ip-10-0-133-55 kubenswrapper[2560]: I0730 01:01:47.455974    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_3e055160-b969-4006-be53-f8624ce4acc2/kube-rbac-proxy-web/0.log"
Jul 30 01:01:47.477148 ip-10-0-133-55 kubenswrapper[2560]: I0730 01:01:47.477120    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_3e055160-b969-4006-be53-f8624ce4acc2/kube-rbac-proxy/0.log"
Jul 30 01:01:47.499253 ip-10-0-133-55 kubenswrapper[2560]: I0730 01:01:47.499230    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_3e055160-b969-4006-be53-f8624ce4acc2/kube-rbac-proxy-thanos/0.log"
Jul 30 01:01:47.523744 ip-10-0-133-55 kubenswrapper[2560]: I0730 01:01:47.523720    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_3e055160-b969-4006-be53-f8624ce4acc2/init-config-reloader/0.log"
Jul 30 01:01:47.591356 ip-10-0-133-55 kubenswrapper[2560]: I0730 01:01:47.591299    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-admission-webhook-7f8d78f54b-4bmmq_a75f3d93-0358-4a87-bf82-d632101db00e/prometheus-operator-admission-webhook/0.log"
Jul 30 01:01:47.703191 ip-10-0-133-55 kubenswrapper[2560]: I0730 01:01:47.703112    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-6b45bfd7bb-kp4bm_ba31c693-68e9-4a01-879f-62a25337eebe/thanos-query/0.log"
Jul 30 01:01:47.724965 ip-10-0-133-55 kubenswrapper[2560]: I0730 01:01:47.724937    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-6b45bfd7bb-kp4bm_ba31c693-68e9-4a01-879f-62a25337eebe/kube-rbac-proxy-web/0.log"
Jul 30 01:01:47.744624 ip-10-0-133-55 kubenswrapper[2560]: I0730 01:01:47.744600    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-6b45bfd7bb-kp4bm_ba31c693-68e9-4a01-879f-62a25337eebe/kube-rbac-proxy/0.log"
Jul 30 01:01:47.762598 ip-10-0-133-55 kubenswrapper[2560]: I0730 01:01:47.762573    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-6b45bfd7bb-kp4bm_ba31c693-68e9-4a01-879f-62a25337eebe/prom-label-proxy/0.log"
Jul 30 01:01:47.785612 ip-10-0-133-55 kubenswrapper[2560]: I0730 01:01:47.785591    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-6b45bfd7bb-kp4bm_ba31c693-68e9-4a01-879f-62a25337eebe/kube-rbac-proxy-rules/0.log"
Jul 30 01:01:47.805976 ip-10-0-133-55 kubenswrapper[2560]: I0730 01:01:47.805955    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-6b45bfd7bb-kp4bm_ba31c693-68e9-4a01-879f-62a25337eebe/kube-rbac-proxy-metrics/0.log"
Jul 30 01:01:48.907851 ip-10-0-133-55 kubenswrapper[2560]: I0730 01:01:48.907809    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-console_networking-console-plugin-74c9f884b7-cvf92_fc66861e-ab18-4d71-bed7-1fa000323b4a/networking-console-plugin/0.log"
Jul 30 01:01:49.468848 ip-10-0-133-55 kubenswrapper[2560]: I0730 01:01:49.468820    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-kchgc_324341b7-120c-4f8b-9ddd-e28b9a40ce9e/console-operator/1.log"
Jul 30 01:01:49.479371 ip-10-0-133-55 kubenswrapper[2560]: I0730 01:01:49.479343    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-kchgc_324341b7-120c-4f8b-9ddd-e28b9a40ce9e/console-operator/2.log"
Jul 30 01:01:49.715863 ip-10-0-133-55 kubenswrapper[2560]: I0730 01:01:49.715826    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-mf94r/perf-node-gather-daemonset-9xzvr"]
Jul 30 01:01:49.716179 ip-10-0-133-55 kubenswrapper[2560]: I0730 01:01:49.716167    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d74fbc87-2f1b-4b28-a5ae-96dee9ac88a5" containerName="cleanup"
Jul 30 01:01:49.716228 ip-10-0-133-55 kubenswrapper[2560]: I0730 01:01:49.716180    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="d74fbc87-2f1b-4b28-a5ae-96dee9ac88a5" containerName="cleanup"
Jul 30 01:01:49.716228 ip-10-0-133-55 kubenswrapper[2560]: I0730 01:01:49.716194    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="275c5f78-1bff-41b7-b1cd-ed82d29ba129" containerName="payload-pre-processing"
Jul 30 01:01:49.716228 ip-10-0-133-55 kubenswrapper[2560]: I0730 01:01:49.716200    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="275c5f78-1bff-41b7-b1cd-ed82d29ba129" containerName="payload-pre-processing"
Jul 30 01:01:49.716228 ip-10-0-133-55 kubenswrapper[2560]: I0730 01:01:49.716207    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b489d67f-5cab-48d9-aae5-7cb0d27fbdf9" containerName="payload-pre-processing"
Jul 30 01:01:49.716228 ip-10-0-133-55 kubenswrapper[2560]: I0730 01:01:49.716212    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="b489d67f-5cab-48d9-aae5-7cb0d27fbdf9" containerName="payload-pre-processing"
Jul 30 01:01:49.716228 ip-10-0-133-55 kubenswrapper[2560]: I0730 01:01:49.716222    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="303a4bf9-6849-4f8f-b17f-36c25f4f397b" containerName="payload-processing"
Jul 30 01:01:49.716228 ip-10-0-133-55 kubenswrapper[2560]: I0730 01:01:49.716227    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="303a4bf9-6849-4f8f-b17f-36c25f4f397b" containerName="payload-processing"
Jul 30 01:01:49.716481 ip-10-0-133-55 kubenswrapper[2560]: I0730 01:01:49.716239    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="532c2d6c-48d3-49fa-a3e9-3ce294c162fb" containerName="payload-pre-processing"
Jul 30 01:01:49.716481 ip-10-0-133-55 kubenswrapper[2560]: I0730 01:01:49.716245    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="532c2d6c-48d3-49fa-a3e9-3ce294c162fb" containerName="payload-pre-processing"
Jul 30 01:01:49.716481 ip-10-0-133-55 kubenswrapper[2560]: I0730 01:01:49.716255    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4196f26e-db36-4dbb-bc3a-cd447eb14720" containerName="payload-processing"
Jul 30 01:01:49.716481 ip-10-0-133-55 kubenswrapper[2560]: I0730 01:01:49.716260    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="4196f26e-db36-4dbb-bc3a-cd447eb14720" containerName="payload-processing"
Jul 30 01:01:49.716481 ip-10-0-133-55 kubenswrapper[2560]: I0730 01:01:49.716270    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7bbec726-d0dd-463c-81fb-57caf0182742" containerName="payload-processing"
Jul 30 01:01:49.716481 ip-10-0-133-55 kubenswrapper[2560]: I0730 01:01:49.716275    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="7bbec726-d0dd-463c-81fb-57caf0182742" containerName="payload-processing"
Jul 30 01:01:49.716481 ip-10-0-133-55 kubenswrapper[2560]: I0730 01:01:49.716347    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="d74fbc87-2f1b-4b28-a5ae-96dee9ac88a5" containerName="cleanup"
Jul 30 01:01:49.716481 ip-10-0-133-55 kubenswrapper[2560]: I0730 01:01:49.716359    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="4196f26e-db36-4dbb-bc3a-cd447eb14720" containerName="payload-processing"
Jul 30 01:01:49.716481 ip-10-0-133-55 kubenswrapper[2560]: I0730 01:01:49.716365    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="b489d67f-5cab-48d9-aae5-7cb0d27fbdf9" containerName="payload-pre-processing"
Jul 30 01:01:49.716481 ip-10-0-133-55 kubenswrapper[2560]: I0730 01:01:49.716371    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="7bbec726-d0dd-463c-81fb-57caf0182742" containerName="payload-processing"
Jul 30 01:01:49.716481 ip-10-0-133-55 kubenswrapper[2560]: I0730 01:01:49.716375    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="275c5f78-1bff-41b7-b1cd-ed82d29ba129" containerName="payload-pre-processing"
Jul 30 01:01:49.716481 ip-10-0-133-55 kubenswrapper[2560]: I0730 01:01:49.716381    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="532c2d6c-48d3-49fa-a3e9-3ce294c162fb" containerName="payload-pre-processing"
Jul 30 01:01:49.716481 ip-10-0-133-55 kubenswrapper[2560]: I0730 01:01:49.716387    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="303a4bf9-6849-4f8f-b17f-36c25f4f397b" containerName="payload-processing"
Jul 30 01:01:49.719794 ip-10-0-133-55 kubenswrapper[2560]: I0730 01:01:49.719752    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-mf94r/perf-node-gather-daemonset-9xzvr"
Jul 30 01:01:49.722228 ip-10-0-133-55 kubenswrapper[2560]: I0730 01:01:49.722204    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-mf94r\"/\"default-dockercfg-crx64\""
Jul 30 01:01:49.722350 ip-10-0-133-55 kubenswrapper[2560]: I0730 01:01:49.722206    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-mf94r\"/\"openshift-service-ca.crt\""
Jul 30 01:01:49.723101 ip-10-0-133-55 kubenswrapper[2560]: I0730 01:01:49.723087    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-mf94r\"/\"kube-root-ca.crt\""
Jul 30 01:01:49.727026 ip-10-0-133-55 kubenswrapper[2560]: I0730 01:01:49.727007    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-mf94r/perf-node-gather-daemonset-9xzvr"]
Jul 30 01:01:49.801860 ip-10-0-133-55 kubenswrapper[2560]: I0730 01:01:49.801832    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/d4cd669f-89f6-43fb-84cc-dcc4a275f8a7-podres\") pod \"perf-node-gather-daemonset-9xzvr\" (UID: \"d4cd669f-89f6-43fb-84cc-dcc4a275f8a7\") " pod="openshift-must-gather-mf94r/perf-node-gather-daemonset-9xzvr"
Jul 30 01:01:49.802000 ip-10-0-133-55 kubenswrapper[2560]: I0730 01:01:49.801868    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/d4cd669f-89f6-43fb-84cc-dcc4a275f8a7-proc\") pod \"perf-node-gather-daemonset-9xzvr\" (UID: \"d4cd669f-89f6-43fb-84cc-dcc4a275f8a7\") " pod="openshift-must-gather-mf94r/perf-node-gather-daemonset-9xzvr"
Jul 30 01:01:49.802000 ip-10-0-133-55 kubenswrapper[2560]: I0730 01:01:49.801947    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/d4cd669f-89f6-43fb-84cc-dcc4a275f8a7-lib-modules\") pod \"perf-node-gather-daemonset-9xzvr\" (UID: \"d4cd669f-89f6-43fb-84cc-dcc4a275f8a7\") " pod="openshift-must-gather-mf94r/perf-node-gather-daemonset-9xzvr"
Jul 30 01:01:49.802000 ip-10-0-133-55 kubenswrapper[2560]: I0730 01:01:49.801978    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zf7kw\" (UniqueName: \"kubernetes.io/projected/d4cd669f-89f6-43fb-84cc-dcc4a275f8a7-kube-api-access-zf7kw\") pod \"perf-node-gather-daemonset-9xzvr\" (UID: \"d4cd669f-89f6-43fb-84cc-dcc4a275f8a7\") " pod="openshift-must-gather-mf94r/perf-node-gather-daemonset-9xzvr"
Jul 30 01:01:49.802119 ip-10-0-133-55 kubenswrapper[2560]: I0730 01:01:49.802011    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/d4cd669f-89f6-43fb-84cc-dcc4a275f8a7-sys\") pod \"perf-node-gather-daemonset-9xzvr\" (UID: \"d4cd669f-89f6-43fb-84cc-dcc4a275f8a7\") " pod="openshift-must-gather-mf94r/perf-node-gather-daemonset-9xzvr"
Jul 30 01:01:49.902520 ip-10-0-133-55 kubenswrapper[2560]: I0730 01:01:49.902492    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/d4cd669f-89f6-43fb-84cc-dcc4a275f8a7-lib-modules\") pod \"perf-node-gather-daemonset-9xzvr\" (UID: \"d4cd669f-89f6-43fb-84cc-dcc4a275f8a7\") " pod="openshift-must-gather-mf94r/perf-node-gather-daemonset-9xzvr"
Jul 30 01:01:49.902668 ip-10-0-133-55 kubenswrapper[2560]: I0730 01:01:49.902526    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zf7kw\" (UniqueName: \"kubernetes.io/projected/d4cd669f-89f6-43fb-84cc-dcc4a275f8a7-kube-api-access-zf7kw\") pod \"perf-node-gather-daemonset-9xzvr\" (UID: \"d4cd669f-89f6-43fb-84cc-dcc4a275f8a7\") " pod="openshift-must-gather-mf94r/perf-node-gather-daemonset-9xzvr"
Jul 30 01:01:49.902668 ip-10-0-133-55 kubenswrapper[2560]: I0730 01:01:49.902554    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/d4cd669f-89f6-43fb-84cc-dcc4a275f8a7-sys\") pod \"perf-node-gather-daemonset-9xzvr\" (UID: \"d4cd669f-89f6-43fb-84cc-dcc4a275f8a7\") " pod="openshift-must-gather-mf94r/perf-node-gather-daemonset-9xzvr"
Jul 30 01:01:49.902668 ip-10-0-133-55 kubenswrapper[2560]: I0730 01:01:49.902585    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/d4cd669f-89f6-43fb-84cc-dcc4a275f8a7-podres\") pod \"perf-node-gather-daemonset-9xzvr\" (UID: \"d4cd669f-89f6-43fb-84cc-dcc4a275f8a7\") " pod="openshift-must-gather-mf94r/perf-node-gather-daemonset-9xzvr"
Jul 30 01:01:49.902668 ip-10-0-133-55 kubenswrapper[2560]: I0730 01:01:49.902609    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/d4cd669f-89f6-43fb-84cc-dcc4a275f8a7-proc\") pod \"perf-node-gather-daemonset-9xzvr\" (UID: \"d4cd669f-89f6-43fb-84cc-dcc4a275f8a7\") " pod="openshift-must-gather-mf94r/perf-node-gather-daemonset-9xzvr"
Jul 30 01:01:49.902668 ip-10-0-133-55 kubenswrapper[2560]: I0730 01:01:49.902661    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/d4cd669f-89f6-43fb-84cc-dcc4a275f8a7-lib-modules\") pod \"perf-node-gather-daemonset-9xzvr\" (UID: \"d4cd669f-89f6-43fb-84cc-dcc4a275f8a7\") " pod="openshift-must-gather-mf94r/perf-node-gather-daemonset-9xzvr"
Jul 30 01:01:49.902884 ip-10-0-133-55 kubenswrapper[2560]: I0730 01:01:49.902693    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/d4cd669f-89f6-43fb-84cc-dcc4a275f8a7-sys\") pod \"perf-node-gather-daemonset-9xzvr\" (UID: \"d4cd669f-89f6-43fb-84cc-dcc4a275f8a7\") " pod="openshift-must-gather-mf94r/perf-node-gather-daemonset-9xzvr"
Jul 30 01:01:49.902884 ip-10-0-133-55 kubenswrapper[2560]: I0730 01:01:49.902712    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/d4cd669f-89f6-43fb-84cc-dcc4a275f8a7-podres\") pod \"perf-node-gather-daemonset-9xzvr\" (UID: \"d4cd669f-89f6-43fb-84cc-dcc4a275f8a7\") " pod="openshift-must-gather-mf94r/perf-node-gather-daemonset-9xzvr"
Jul 30 01:01:49.902884 ip-10-0-133-55 kubenswrapper[2560]: I0730 01:01:49.902697    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/d4cd669f-89f6-43fb-84cc-dcc4a275f8a7-proc\") pod \"perf-node-gather-daemonset-9xzvr\" (UID: \"d4cd669f-89f6-43fb-84cc-dcc4a275f8a7\") " pod="openshift-must-gather-mf94r/perf-node-gather-daemonset-9xzvr"
Jul 30 01:01:49.910975 ip-10-0-133-55 kubenswrapper[2560]: I0730 01:01:49.910954    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zf7kw\" (UniqueName: \"kubernetes.io/projected/d4cd669f-89f6-43fb-84cc-dcc4a275f8a7-kube-api-access-zf7kw\") pod \"perf-node-gather-daemonset-9xzvr\" (UID: \"d4cd669f-89f6-43fb-84cc-dcc4a275f8a7\") " pod="openshift-must-gather-mf94r/perf-node-gather-daemonset-9xzvr"
Jul 30 01:01:50.030456 ip-10-0-133-55 kubenswrapper[2560]: I0730 01:01:50.030359    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-mf94r/perf-node-gather-daemonset-9xzvr"
Jul 30 01:01:50.045061 ip-10-0-133-55 kubenswrapper[2560]: I0730 01:01:50.045027    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-744c88f754-q9thp_a8370f4a-47c8-469e-9099-f7982f1f1be3/console/0.log"
Jul 30 01:01:50.161902 ip-10-0-133-55 kubenswrapper[2560]: I0730 01:01:50.161879    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-mf94r/perf-node-gather-daemonset-9xzvr"]
Jul 30 01:01:50.163979 ip-10-0-133-55 kubenswrapper[2560]: W0730 01:01:50.163954    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-podd4cd669f_89f6_43fb_84cc_dcc4a275f8a7.slice/crio-c11cb7e0b9fff4f104cdd57f8a912eb7252cca9211278d4d9be6f59cba0f9ec2 WatchSource:0}: Error finding container c11cb7e0b9fff4f104cdd57f8a912eb7252cca9211278d4d9be6f59cba0f9ec2: Status 404 returned error can't find the container with id c11cb7e0b9fff4f104cdd57f8a912eb7252cca9211278d4d9be6f59cba0f9ec2
Jul 30 01:01:50.758016 ip-10-0-133-55 kubenswrapper[2560]: I0730 01:01:50.757981    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-storage-operator_volume-data-source-validator-549c6d54cf-986zd_aa32c593-1abb-40d2-8603-b7ae714705a5/volume-data-source-validator/0.log"
Jul 30 01:01:51.158799 ip-10-0-133-55 kubenswrapper[2560]: I0730 01:01:51.158763    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-mf94r/perf-node-gather-daemonset-9xzvr" event={"ID":"d4cd669f-89f6-43fb-84cc-dcc4a275f8a7","Type":"ContainerStarted","Data":"b4a1cf14262960a4c15d8bf2fb703675fd86046bc0b7c79992ed218ce97aa2d6"}
Jul 30 01:01:51.159194 ip-10-0-133-55 kubenswrapper[2560]: I0730 01:01:51.158857    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-mf94r/perf-node-gather-daemonset-9xzvr" event={"ID":"d4cd669f-89f6-43fb-84cc-dcc4a275f8a7","Type":"ContainerStarted","Data":"c11cb7e0b9fff4f104cdd57f8a912eb7252cca9211278d4d9be6f59cba0f9ec2"}
Jul 30 01:01:51.159194 ip-10-0-133-55 kubenswrapper[2560]: I0730 01:01:51.158887    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-mf94r/perf-node-gather-daemonset-9xzvr"
Jul 30 01:01:51.175993 ip-10-0-133-55 kubenswrapper[2560]: I0730 01:01:51.175935    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-mf94r/perf-node-gather-daemonset-9xzvr" podStartSLOduration=2.175915201 podStartE2EDuration="2.175915201s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-30 01:01:49 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 01:01:51.173054042 +0000 UTC m=+3598.232270883" watchObservedRunningTime="2026-07-30 01:01:51.175915201 +0000 UTC m=+3598.235132005"
Jul 30 01:01:51.728037 ip-10-0-133-55 kubenswrapper[2560]: I0730 01:01:51.728010    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-9q6wf_511107bb-85d6-4f7e-9598-0f4aac95ba34/dns/0.log"
Jul 30 01:01:51.749249 ip-10-0-133-55 kubenswrapper[2560]: I0730 01:01:51.749225    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-9q6wf_511107bb-85d6-4f7e-9598-0f4aac95ba34/kube-rbac-proxy/0.log"
Jul 30 01:01:51.861660 ip-10-0-133-55 kubenswrapper[2560]: I0730 01:01:51.861634    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-5ffvl_4f585163-3e80-4055-bfdd-17d37e755a71/dns-node-resolver/0.log"
Jul 30 01:01:52.407690 ip-10-0-133-55 kubenswrapper[2560]: I0730 01:01:52.407663    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_image-pruner-29756160-vhqfx_04c8ee63-4c22-45a4-ac5a-0321b09d3dd1/image-pruner/0.log"
Jul 30 01:01:52.494860 ip-10-0-133-55 kubenswrapper[2560]: I0730 01:01:52.494829    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-7vc9d_274292b8-556c-44ad-b462-c1ea04a30abd/node-ca/0.log"
Jul 30 01:01:53.621623 ip-10-0-133-55 kubenswrapper[2560]: I0730 01:01:53.621594    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-59c4b4bfcf-qsdmz_ca09c72b-01af-4369-a33f-7cd5af50baad/kube-auth-proxy/0.log"
Jul 30 01:01:53.668211 ip-10-0-133-55 kubenswrapper[2560]: I0730 01:01:53.668104    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-kchgc_324341b7-120c-4f8b-9ddd-e28b9a40ce9e/console-operator/1.log"
Jul 30 01:01:53.678926 ip-10-0-133-55 kubenswrapper[2560]: I0730 01:01:53.675719    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-kchgc_324341b7-120c-4f8b-9ddd-e28b9a40ce9e/console-operator/1.log"
Jul 30 01:01:53.796804 ip-10-0-133-55 kubenswrapper[2560]: I0730 01:01:53.796775    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-5cc6cd444b-6txxf_59139f9a-241a-42f1-a0c9-97c147cf4f7e/payload-processing/0.log"
Jul 30 01:01:54.677395 ip-10-0-133-55 kubenswrapper[2560]: I0730 01:01:54.677360    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-zprkl_e4926e4b-1b99-4889-afe0-459d8080ff96/serve-healthcheck-canary/0.log"
Jul 30 01:01:55.168781 ip-10-0-133-55 kubenswrapper[2560]: I0730 01:01:55.168750    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-5885fdb759-kxgst_660cabd1-7819-4fb9-aae2-76019d1fa428/insights-operator/0.log"
Jul 30 01:01:55.169803 ip-10-0-133-55 kubenswrapper[2560]: I0730 01:01:55.169781    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-5885fdb759-kxgst_660cabd1-7819-4fb9-aae2-76019d1fa428/insights-operator/1.log"
Jul 30 01:01:55.193085 ip-10-0-133-55 kubenswrapper[2560]: I0730 01:01:55.193062    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-g69zk_7e1181b5-9505-4a82-84b2-48086fb162f0/kube-rbac-proxy/0.log"
Jul 30 01:01:55.216143 ip-10-0-133-55 kubenswrapper[2560]: I0730 01:01:55.216119    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-g69zk_7e1181b5-9505-4a82-84b2-48086fb162f0/exporter/0.log"
Jul 30 01:01:55.236813 ip-10-0-133-55 kubenswrapper[2560]: I0730 01:01:55.236792    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-g69zk_7e1181b5-9505-4a82-84b2-48086fb162f0/extractor/0.log"
Jul 30 01:01:57.174275 ip-10-0-133-55 kubenswrapper[2560]: I0730 01:01:57.174249    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-mf94r/perf-node-gather-daemonset-9xzvr"
Jul 30 01:01:58.330565 ip-10-0-133-55 kubenswrapper[2560]: I0730 01:01:58.330534    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-655d97b687-jztcs_e13b47e6-3a05-49b1-8639-3dab7c0840ec/manager/0.log"
Jul 30 01:01:58.346948 ip-10-0-133-55 kubenswrapper[2560]: I0730 01:01:58.346921    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-655d97b687-jztcs_e13b47e6-3a05-49b1-8639-3dab7c0840ec/copy-manifests/0.log"
Jul 30 01:01:59.873847 ip-10-0-133-55 kubenswrapper[2560]: I0730 01:01:59.873757    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_lws-controller-manager-5977989bd7-rnf8k_61a27f35-7e9d-4b38-b3dd-94f671da67d8/manager/0.log"
Jul 30 01:01:59.898293 ip-10-0-133-55 kubenswrapper[2560]: I0730 01:01:59.898266    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_openshift-lws-operator-fd8ccff4c-4nxrt_44a0613c-c3a5-4c78-9640-7178fe84899e/openshift-lws-operator/0.log"
Jul 30 01:02:00.065137 ip-10-0-133-55 kubenswrapper[2560]: I0730 01:02:00.065108    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-59c4b4bfcf-qsdmz_ca09c72b-01af-4369-a33f-7cd5af50baad/kube-auth-proxy/0.log"
Jul 30 01:02:00.191403 ip-10-0-133-55 kubenswrapper[2560]: I0730 01:02:00.191369    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-5cc6cd444b-6txxf_59139f9a-241a-42f1-a0c9-97c147cf4f7e/payload-processing/0.log"
Jul 30 01:02:01.749706 ip-10-0-133-55 kubenswrapper[2560]: I0730 01:02:01.749679    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-59c4b4bfcf-qsdmz_ca09c72b-01af-4369-a33f-7cd5af50baad/kube-auth-proxy/0.log"
Jul 30 01:02:01.891352 ip-10-0-133-55 kubenswrapper[2560]: I0730 01:02:01.891302    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-5cc6cd444b-6txxf_59139f9a-241a-42f1-a0c9-97c147cf4f7e/payload-processing/0.log"
Jul 30 01:02:04.747418 ip-10-0-133-55 kubenswrapper[2560]: I0730 01:02:04.747380    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-6865c9967-7lcmw_2a3fd37f-be73-45ca-816c-2a4204134fbb/migrator/0.log"
Jul 30 01:02:04.766881 ip-10-0-133-55 kubenswrapper[2560]: I0730 01:02:04.766859    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-6865c9967-7lcmw_2a3fd37f-be73-45ca-816c-2a4204134fbb/graceful-termination/0.log"
Jul 30 01:02:06.339774 ip-10-0-133-55 kubenswrapper[2560]: I0730 01:02:06.339739    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-ms6sp_de66dc13-ad46-4e8a-8ce5-2c54b63d852a/kube-multus-additional-cni-plugins/0.log"
Jul 30 01:02:06.359821 ip-10-0-133-55 kubenswrapper[2560]: I0730 01:02:06.359790    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-ms6sp_de66dc13-ad46-4e8a-8ce5-2c54b63d852a/egress-router-binary-copy/0.log"
Jul 30 01:02:06.378422 ip-10-0-133-55 kubenswrapper[2560]: I0730 01:02:06.378400    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-ms6sp_de66dc13-ad46-4e8a-8ce5-2c54b63d852a/cni-plugins/0.log"
Jul 30 01:02:06.397102 ip-10-0-133-55 kubenswrapper[2560]: I0730 01:02:06.397083    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-ms6sp_de66dc13-ad46-4e8a-8ce5-2c54b63d852a/bond-cni-plugin/0.log"
Jul 30 01:02:06.415577 ip-10-0-133-55 kubenswrapper[2560]: I0730 01:02:06.415551    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-ms6sp_de66dc13-ad46-4e8a-8ce5-2c54b63d852a/routeoverride-cni/0.log"
Jul 30 01:02:06.434202 ip-10-0-133-55 kubenswrapper[2560]: I0730 01:02:06.434180    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-ms6sp_de66dc13-ad46-4e8a-8ce5-2c54b63d852a/whereabouts-cni-bincopy/0.log"
Jul 30 01:02:06.452527 ip-10-0-133-55 kubenswrapper[2560]: I0730 01:02:06.452502    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-ms6sp_de66dc13-ad46-4e8a-8ce5-2c54b63d852a/whereabouts-cni/0.log"
Jul 30 01:02:06.586774 ip-10-0-133-55 kubenswrapper[2560]: I0730 01:02:06.586744    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-x8swq_b180523f-d9e2-4514-9b5c-091192407dc0/kube-multus/0.log"
Jul 30 01:02:06.608399 ip-10-0-133-55 kubenswrapper[2560]: I0730 01:02:06.608325    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-9g97b_05dcf00e-2c10-495a-b61b-9221eb8286e5/network-metrics-daemon/0.log"
Jul 30 01:02:06.621911 ip-10-0-133-55 kubenswrapper[2560]: I0730 01:02:06.621886    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-9g97b_05dcf00e-2c10-495a-b61b-9221eb8286e5/kube-rbac-proxy/0.log"