Jul 22 04:22:40.613353 ip-10-0-141-238 systemd[1]: kubelet.service: Failed to load environment files: No such file or directory
Jul 22 04:22:40.613501 ip-10-0-141-238 systemd[1]: kubelet.service: Failed to run 'start-pre' task: No such file or directory
Jul 22 04:22:40.613683 ip-10-0-141-238 systemd[1]: kubelet.service: Failed with result 'resources'.
Jul 22 04:22:40.614169 ip-10-0-141-238 systemd[1]: Failed to start Kubernetes Kubelet.
Jul 22 04:22:51.888407 ip-10-0-141-238 systemd[1]: kubelet.service: Failed to schedule restart job: Unit crio.service not found.
Jul 22 04:22:51.888429 ip-10-0-141-238 systemd[1]: kubelet.service: Failed with result 'resources'.
-- Boot 8bda34d72441462e9348d1472fa92be9 --
Jul 22 04:24:44.480295 ip-10-0-141-238 systemd[1]: Starting Kubernetes Kubelet...
Jul 22 04:24:44.927447 ip-10-0-141-238 kubenswrapper[2563]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 22 04:24:44.927447 ip-10-0-141-238 kubenswrapper[2563]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version.
Jul 22 04:24:44.927447 ip-10-0-141-238 kubenswrapper[2563]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 22 04:24:44.927447 ip-10-0-141-238 kubenswrapper[2563]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI.
Jul 22 04:24:44.927447 ip-10-0-141-238 kubenswrapper[2563]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 22 04:24:44.927447 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:24:44.807690    2563 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime"
Jul 22 04:24:44.927447 ip-10-0-141-238 kubenswrapper[2563]: W0722 04:24:44.811893    2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 22 04:24:44.927447 ip-10-0-141-238 kubenswrapper[2563]: W0722 04:24:44.811904    2563 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 22 04:24:44.927447 ip-10-0-141-238 kubenswrapper[2563]: W0722 04:24:44.811909    2563 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 22 04:24:44.927447 ip-10-0-141-238 kubenswrapper[2563]: W0722 04:24:44.811912    2563 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 22 04:24:44.927447 ip-10-0-141-238 kubenswrapper[2563]: W0722 04:24:44.811915    2563 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 22 04:24:44.927447 ip-10-0-141-238 kubenswrapper[2563]: W0722 04:24:44.811918    2563 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 22 04:24:44.927447 ip-10-0-141-238 kubenswrapper[2563]: W0722 04:24:44.811921    2563 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 22 04:24:44.927447 ip-10-0-141-238 kubenswrapper[2563]: W0722 04:24:44.811924    2563 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 22 04:24:44.870351 ip-10-0-141-238 systemd[1]: Started Kubernetes Kubelet.
Jul 22 04:24:44.928444 ip-10-0-141-238 kubenswrapper[2563]: W0722 04:24:44.811927    2563 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 22 04:24:44.928444 ip-10-0-141-238 kubenswrapper[2563]: W0722 04:24:44.811930    2563 feature_gate.go:328] unrecognized feature gate: Example
Jul 22 04:24:44.928444 ip-10-0-141-238 kubenswrapper[2563]: W0722 04:24:44.811932    2563 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 22 04:24:44.928444 ip-10-0-141-238 kubenswrapper[2563]: W0722 04:24:44.811935    2563 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 22 04:24:44.928444 ip-10-0-141-238 kubenswrapper[2563]: W0722 04:24:44.811938    2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 22 04:24:44.928444 ip-10-0-141-238 kubenswrapper[2563]: W0722 04:24:44.811940    2563 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 22 04:24:44.928444 ip-10-0-141-238 kubenswrapper[2563]: W0722 04:24:44.811943    2563 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 22 04:24:44.928444 ip-10-0-141-238 kubenswrapper[2563]: W0722 04:24:44.811946    2563 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 22 04:24:44.928444 ip-10-0-141-238 kubenswrapper[2563]: W0722 04:24:44.811948    2563 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 22 04:24:44.928444 ip-10-0-141-238 kubenswrapper[2563]: W0722 04:24:44.811951    2563 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 22 04:24:44.928444 ip-10-0-141-238 kubenswrapper[2563]: W0722 04:24:44.811953    2563 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 22 04:24:44.928444 ip-10-0-141-238 kubenswrapper[2563]: W0722 04:24:44.811957    2563 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 22 04:24:44.928444 ip-10-0-141-238 kubenswrapper[2563]: W0722 04:24:44.811960    2563 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 22 04:24:44.928444 ip-10-0-141-238 kubenswrapper[2563]: W0722 04:24:44.811963    2563 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 22 04:24:44.928444 ip-10-0-141-238 kubenswrapper[2563]: W0722 04:24:44.811965    2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 22 04:24:44.928444 ip-10-0-141-238 kubenswrapper[2563]: W0722 04:24:44.811968    2563 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 22 04:24:44.928444 ip-10-0-141-238 kubenswrapper[2563]: W0722 04:24:44.811971    2563 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 22 04:24:44.928444 ip-10-0-141-238 kubenswrapper[2563]: W0722 04:24:44.811974    2563 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 22 04:24:44.928444 ip-10-0-141-238 kubenswrapper[2563]: W0722 04:24:44.811976    2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 22 04:24:44.928444 ip-10-0-141-238 kubenswrapper[2563]: W0722 04:24:44.811979    2563 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 22 04:24:44.929210 ip-10-0-141-238 kubenswrapper[2563]: W0722 04:24:44.811982    2563 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 22 04:24:44.929210 ip-10-0-141-238 kubenswrapper[2563]: W0722 04:24:44.811984    2563 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 22 04:24:44.929210 ip-10-0-141-238 kubenswrapper[2563]: W0722 04:24:44.811987    2563 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 22 04:24:44.929210 ip-10-0-141-238 kubenswrapper[2563]: W0722 04:24:44.811990    2563 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 22 04:24:44.929210 ip-10-0-141-238 kubenswrapper[2563]: W0722 04:24:44.811993    2563 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 22 04:24:44.929210 ip-10-0-141-238 kubenswrapper[2563]: W0722 04:24:44.811995    2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 22 04:24:44.929210 ip-10-0-141-238 kubenswrapper[2563]: W0722 04:24:44.811998    2563 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 22 04:24:44.929210 ip-10-0-141-238 kubenswrapper[2563]: W0722 04:24:44.812000    2563 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 22 04:24:44.929210 ip-10-0-141-238 kubenswrapper[2563]: W0722 04:24:44.812003    2563 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 22 04:24:44.929210 ip-10-0-141-238 kubenswrapper[2563]: W0722 04:24:44.812006    2563 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 22 04:24:44.929210 ip-10-0-141-238 kubenswrapper[2563]: W0722 04:24:44.812009    2563 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 22 04:24:44.929210 ip-10-0-141-238 kubenswrapper[2563]: W0722 04:24:44.812012    2563 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 22 04:24:44.929210 ip-10-0-141-238 kubenswrapper[2563]: W0722 04:24:44.812016    2563 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 22 04:24:44.929210 ip-10-0-141-238 kubenswrapper[2563]: W0722 04:24:44.812020    2563 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 22 04:24:44.929210 ip-10-0-141-238 kubenswrapper[2563]: W0722 04:24:44.812023    2563 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 22 04:24:44.929210 ip-10-0-141-238 kubenswrapper[2563]: W0722 04:24:44.812027    2563 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 22 04:24:44.929210 ip-10-0-141-238 kubenswrapper[2563]: W0722 04:24:44.812031    2563 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 22 04:24:44.929210 ip-10-0-141-238 kubenswrapper[2563]: W0722 04:24:44.812034    2563 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 22 04:24:44.929210 ip-10-0-141-238 kubenswrapper[2563]: W0722 04:24:44.812051    2563 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 22 04:24:44.929792 ip-10-0-141-238 kubenswrapper[2563]: W0722 04:24:44.812054    2563 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 22 04:24:44.929792 ip-10-0-141-238 kubenswrapper[2563]: W0722 04:24:44.812059    2563 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 22 04:24:44.929792 ip-10-0-141-238 kubenswrapper[2563]: W0722 04:24:44.812062    2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 22 04:24:44.929792 ip-10-0-141-238 kubenswrapper[2563]: W0722 04:24:44.812065    2563 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 22 04:24:44.929792 ip-10-0-141-238 kubenswrapper[2563]: W0722 04:24:44.812068    2563 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 22 04:24:44.929792 ip-10-0-141-238 kubenswrapper[2563]: W0722 04:24:44.812071    2563 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 22 04:24:44.929792 ip-10-0-141-238 kubenswrapper[2563]: W0722 04:24:44.812074    2563 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 22 04:24:44.929792 ip-10-0-141-238 kubenswrapper[2563]: W0722 04:24:44.812076    2563 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 22 04:24:44.929792 ip-10-0-141-238 kubenswrapper[2563]: W0722 04:24:44.812079    2563 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 22 04:24:44.929792 ip-10-0-141-238 kubenswrapper[2563]: W0722 04:24:44.812081    2563 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 22 04:24:44.929792 ip-10-0-141-238 kubenswrapper[2563]: W0722 04:24:44.812084    2563 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 22 04:24:44.929792 ip-10-0-141-238 kubenswrapper[2563]: W0722 04:24:44.812087    2563 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 22 04:24:44.929792 ip-10-0-141-238 kubenswrapper[2563]: W0722 04:24:44.812090    2563 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 22 04:24:44.929792 ip-10-0-141-238 kubenswrapper[2563]: W0722 04:24:44.812092    2563 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 22 04:24:44.929792 ip-10-0-141-238 kubenswrapper[2563]: W0722 04:24:44.812096    2563 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 22 04:24:44.929792 ip-10-0-141-238 kubenswrapper[2563]: W0722 04:24:44.812099    2563 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 22 04:24:44.929792 ip-10-0-141-238 kubenswrapper[2563]: W0722 04:24:44.812101    2563 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 22 04:24:44.929792 ip-10-0-141-238 kubenswrapper[2563]: W0722 04:24:44.812104    2563 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 22 04:24:44.929792 ip-10-0-141-238 kubenswrapper[2563]: W0722 04:24:44.812106    2563 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 22 04:24:44.930411 ip-10-0-141-238 kubenswrapper[2563]: W0722 04:24:44.812109    2563 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 22 04:24:44.930411 ip-10-0-141-238 kubenswrapper[2563]: W0722 04:24:44.812112    2563 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 22 04:24:44.930411 ip-10-0-141-238 kubenswrapper[2563]: W0722 04:24:44.812114    2563 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 22 04:24:44.930411 ip-10-0-141-238 kubenswrapper[2563]: W0722 04:24:44.812117    2563 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 22 04:24:44.930411 ip-10-0-141-238 kubenswrapper[2563]: W0722 04:24:44.812120    2563 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 22 04:24:44.930411 ip-10-0-141-238 kubenswrapper[2563]: W0722 04:24:44.812122    2563 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 22 04:24:44.930411 ip-10-0-141-238 kubenswrapper[2563]: W0722 04:24:44.812125    2563 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 22 04:24:44.930411 ip-10-0-141-238 kubenswrapper[2563]: W0722 04:24:44.812127    2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 22 04:24:44.930411 ip-10-0-141-238 kubenswrapper[2563]: W0722 04:24:44.812131    2563 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 22 04:24:44.930411 ip-10-0-141-238 kubenswrapper[2563]: W0722 04:24:44.812133    2563 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 22 04:24:44.930411 ip-10-0-141-238 kubenswrapper[2563]: W0722 04:24:44.812136    2563 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 22 04:24:44.930411 ip-10-0-141-238 kubenswrapper[2563]: W0722 04:24:44.812139    2563 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 22 04:24:44.930411 ip-10-0-141-238 kubenswrapper[2563]: W0722 04:24:44.812141    2563 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 22 04:24:44.930411 ip-10-0-141-238 kubenswrapper[2563]: W0722 04:24:44.812144    2563 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 22 04:24:44.930411 ip-10-0-141-238 kubenswrapper[2563]: W0722 04:24:44.812151    2563 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 22 04:24:44.930411 ip-10-0-141-238 kubenswrapper[2563]: W0722 04:24:44.812154    2563 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 22 04:24:44.930411 ip-10-0-141-238 kubenswrapper[2563]: W0722 04:24:44.812156    2563 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 22 04:24:44.930411 ip-10-0-141-238 kubenswrapper[2563]: W0722 04:24:44.812159    2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 22 04:24:44.930411 ip-10-0-141-238 kubenswrapper[2563]: W0722 04:24:44.812162    2563 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 22 04:24:44.930411 ip-10-0-141-238 kubenswrapper[2563]: W0722 04:24:44.812165    2563 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 22 04:24:44.931029 ip-10-0-141-238 kubenswrapper[2563]: W0722 04:24:44.812168    2563 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 22 04:24:44.931029 ip-10-0-141-238 kubenswrapper[2563]: W0722 04:24:44.812171    2563 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 22 04:24:44.931029 ip-10-0-141-238 kubenswrapper[2563]: W0722 04:24:44.812173    2563 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 22 04:24:44.931029 ip-10-0-141-238 kubenswrapper[2563]: W0722 04:24:44.812176    2563 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 22 04:24:44.931029 ip-10-0-141-238 kubenswrapper[2563]: W0722 04:24:44.812179    2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 22 04:24:44.931029 ip-10-0-141-238 kubenswrapper[2563]: W0722 04:24:44.812181    2563 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 22 04:24:44.931029 ip-10-0-141-238 kubenswrapper[2563]: W0722 04:24:44.812184    2563 feature_gate.go:328] unrecognized feature gate: Example2
Jul 22 04:24:44.931029 ip-10-0-141-238 kubenswrapper[2563]: W0722 04:24:44.812186    2563 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 22 04:24:44.931029 ip-10-0-141-238 kubenswrapper[2563]: W0722 04:24:44.812189    2563 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 22 04:24:44.931029 ip-10-0-141-238 kubenswrapper[2563]: W0722 04:24:44.812192    2563 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 22 04:24:44.931029 ip-10-0-141-238 kubenswrapper[2563]: W0722 04:24:44.812194    2563 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 22 04:24:44.931029 ip-10-0-141-238 kubenswrapper[2563]: W0722 04:24:44.812197    2563 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 22 04:24:44.931029 ip-10-0-141-238 kubenswrapper[2563]: W0722 04:24:44.812199    2563 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 22 04:24:44.931029 ip-10-0-141-238 kubenswrapper[2563]: W0722 04:24:44.812879    2563 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 22 04:24:44.931029 ip-10-0-141-238 kubenswrapper[2563]: W0722 04:24:44.812885    2563 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 22 04:24:44.931029 ip-10-0-141-238 kubenswrapper[2563]: W0722 04:24:44.812887    2563 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 22 04:24:44.931029 ip-10-0-141-238 kubenswrapper[2563]: W0722 04:24:44.812890    2563 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 22 04:24:44.931029 ip-10-0-141-238 kubenswrapper[2563]: W0722 04:24:44.812893    2563 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 22 04:24:44.931029 ip-10-0-141-238 kubenswrapper[2563]: W0722 04:24:44.812895    2563 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 22 04:24:44.931029 ip-10-0-141-238 kubenswrapper[2563]: W0722 04:24:44.812898    2563 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 22 04:24:44.931029 ip-10-0-141-238 kubenswrapper[2563]: W0722 04:24:44.812901    2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 22 04:24:44.931681 ip-10-0-141-238 kubenswrapper[2563]: W0722 04:24:44.812903    2563 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 22 04:24:44.931681 ip-10-0-141-238 kubenswrapper[2563]: W0722 04:24:44.812906    2563 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 22 04:24:44.931681 ip-10-0-141-238 kubenswrapper[2563]: W0722 04:24:44.812909    2563 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 22 04:24:44.931681 ip-10-0-141-238 kubenswrapper[2563]: W0722 04:24:44.812912    2563 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 22 04:24:44.931681 ip-10-0-141-238 kubenswrapper[2563]: W0722 04:24:44.812915    2563 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 22 04:24:44.931681 ip-10-0-141-238 kubenswrapper[2563]: W0722 04:24:44.812918    2563 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 22 04:24:44.931681 ip-10-0-141-238 kubenswrapper[2563]: W0722 04:24:44.812921    2563 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 22 04:24:44.931681 ip-10-0-141-238 kubenswrapper[2563]: W0722 04:24:44.812924    2563 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 22 04:24:44.931681 ip-10-0-141-238 kubenswrapper[2563]: W0722 04:24:44.812926    2563 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 22 04:24:44.931681 ip-10-0-141-238 kubenswrapper[2563]: W0722 04:24:44.812929    2563 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 22 04:24:44.931681 ip-10-0-141-238 kubenswrapper[2563]: W0722 04:24:44.812932    2563 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 22 04:24:44.931681 ip-10-0-141-238 kubenswrapper[2563]: W0722 04:24:44.812935    2563 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 22 04:24:44.931681 ip-10-0-141-238 kubenswrapper[2563]: W0722 04:24:44.812937    2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 22 04:24:44.931681 ip-10-0-141-238 kubenswrapper[2563]: W0722 04:24:44.812940    2563 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 22 04:24:44.931681 ip-10-0-141-238 kubenswrapper[2563]: W0722 04:24:44.812942    2563 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 22 04:24:44.931681 ip-10-0-141-238 kubenswrapper[2563]: W0722 04:24:44.812945    2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 22 04:24:44.931681 ip-10-0-141-238 kubenswrapper[2563]: W0722 04:24:44.812947    2563 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 22 04:24:44.931681 ip-10-0-141-238 kubenswrapper[2563]: W0722 04:24:44.812950    2563 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 22 04:24:44.931681 ip-10-0-141-238 kubenswrapper[2563]: W0722 04:24:44.812953    2563 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 22 04:24:44.931681 ip-10-0-141-238 kubenswrapper[2563]: W0722 04:24:44.812955    2563 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 22 04:24:44.932408 ip-10-0-141-238 kubenswrapper[2563]: W0722 04:24:44.812958    2563 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 22 04:24:44.932408 ip-10-0-141-238 kubenswrapper[2563]: W0722 04:24:44.812960    2563 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 22 04:24:44.932408 ip-10-0-141-238 kubenswrapper[2563]: W0722 04:24:44.812963    2563 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 22 04:24:44.932408 ip-10-0-141-238 kubenswrapper[2563]: W0722 04:24:44.812966    2563 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 22 04:24:44.932408 ip-10-0-141-238 kubenswrapper[2563]: W0722 04:24:44.812969    2563 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 22 04:24:44.932408 ip-10-0-141-238 kubenswrapper[2563]: W0722 04:24:44.812971    2563 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 22 04:24:44.932408 ip-10-0-141-238 kubenswrapper[2563]: W0722 04:24:44.812973    2563 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 22 04:24:44.932408 ip-10-0-141-238 kubenswrapper[2563]: W0722 04:24:44.812975    2563 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 22 04:24:44.932408 ip-10-0-141-238 kubenswrapper[2563]: W0722 04:24:44.812978    2563 feature_gate.go:328] unrecognized feature gate: Example2
Jul 22 04:24:44.932408 ip-10-0-141-238 kubenswrapper[2563]: W0722 04:24:44.812982    2563 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 22 04:24:44.932408 ip-10-0-141-238 kubenswrapper[2563]: W0722 04:24:44.812986    2563 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 22 04:24:44.932408 ip-10-0-141-238 kubenswrapper[2563]: W0722 04:24:44.812989    2563 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 22 04:24:44.932408 ip-10-0-141-238 kubenswrapper[2563]: W0722 04:24:44.812992    2563 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 22 04:24:44.932408 ip-10-0-141-238 kubenswrapper[2563]: W0722 04:24:44.812994    2563 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 22 04:24:44.932408 ip-10-0-141-238 kubenswrapper[2563]: W0722 04:24:44.813000    2563 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 22 04:24:44.932408 ip-10-0-141-238 kubenswrapper[2563]: W0722 04:24:44.813002    2563 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 22 04:24:44.932408 ip-10-0-141-238 kubenswrapper[2563]: W0722 04:24:44.813005    2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 22 04:24:44.932408 ip-10-0-141-238 kubenswrapper[2563]: W0722 04:24:44.813007    2563 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 22 04:24:44.932408 ip-10-0-141-238 kubenswrapper[2563]: W0722 04:24:44.813010    2563 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 22 04:24:44.932983 ip-10-0-141-238 kubenswrapper[2563]: W0722 04:24:44.813013    2563 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 22 04:24:44.932983 ip-10-0-141-238 kubenswrapper[2563]: W0722 04:24:44.813016    2563 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 22 04:24:44.932983 ip-10-0-141-238 kubenswrapper[2563]: W0722 04:24:44.813019    2563 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 22 04:24:44.932983 ip-10-0-141-238 kubenswrapper[2563]: W0722 04:24:44.813021    2563 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 22 04:24:44.932983 ip-10-0-141-238 kubenswrapper[2563]: W0722 04:24:44.813024    2563 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 22 04:24:44.932983 ip-10-0-141-238 kubenswrapper[2563]: W0722 04:24:44.813026    2563 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 22 04:24:44.932983 ip-10-0-141-238 kubenswrapper[2563]: W0722 04:24:44.813029    2563 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 22 04:24:44.932983 ip-10-0-141-238 kubenswrapper[2563]: W0722 04:24:44.813032    2563 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 22 04:24:44.932983 ip-10-0-141-238 kubenswrapper[2563]: W0722 04:24:44.813049    2563 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 22 04:24:44.932983 ip-10-0-141-238 kubenswrapper[2563]: W0722 04:24:44.813051    2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 22 04:24:44.932983 ip-10-0-141-238 kubenswrapper[2563]: W0722 04:24:44.813054    2563 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 22 04:24:44.932983 ip-10-0-141-238 kubenswrapper[2563]: W0722 04:24:44.813057    2563 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 22 04:24:44.932983 ip-10-0-141-238 kubenswrapper[2563]: W0722 04:24:44.813060    2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 22 04:24:44.932983 ip-10-0-141-238 kubenswrapper[2563]: W0722 04:24:44.813062    2563 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 22 04:24:44.932983 ip-10-0-141-238 kubenswrapper[2563]: W0722 04:24:44.813065    2563 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 22 04:24:44.932983 ip-10-0-141-238 kubenswrapper[2563]: W0722 04:24:44.813067    2563 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 22 04:24:44.932983 ip-10-0-141-238 kubenswrapper[2563]: W0722 04:24:44.813070    2563 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 22 04:24:44.932983 ip-10-0-141-238 kubenswrapper[2563]: W0722 04:24:44.813072    2563 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 22 04:24:44.932983 ip-10-0-141-238 kubenswrapper[2563]: W0722 04:24:44.813075    2563 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 22 04:24:44.932983 ip-10-0-141-238 kubenswrapper[2563]: W0722 04:24:44.813078    2563 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 22 04:24:44.933599 ip-10-0-141-238 kubenswrapper[2563]: W0722 04:24:44.813080    2563 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 22 04:24:44.933599 ip-10-0-141-238 kubenswrapper[2563]: W0722 04:24:44.813082    2563 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 22 04:24:44.933599 ip-10-0-141-238 kubenswrapper[2563]: W0722 04:24:44.813085    2563 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 22 04:24:44.933599 ip-10-0-141-238 kubenswrapper[2563]: W0722 04:24:44.813088    2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 22 04:24:44.933599 ip-10-0-141-238 kubenswrapper[2563]: W0722 04:24:44.813090    2563 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 22 04:24:44.933599 ip-10-0-141-238 kubenswrapper[2563]: W0722 04:24:44.813093    2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 22 04:24:44.933599 ip-10-0-141-238 kubenswrapper[2563]: W0722 04:24:44.813095    2563 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 22 04:24:44.933599 ip-10-0-141-238 kubenswrapper[2563]: W0722 04:24:44.813100    2563 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 22 04:24:44.933599 ip-10-0-141-238 kubenswrapper[2563]: W0722 04:24:44.813102    2563 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 22 04:24:44.933599 ip-10-0-141-238 kubenswrapper[2563]: W0722 04:24:44.813105    2563 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 22 04:24:44.933599 ip-10-0-141-238 kubenswrapper[2563]: W0722 04:24:44.813108    2563 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 22 04:24:44.933599 ip-10-0-141-238 kubenswrapper[2563]: W0722 04:24:44.813110    2563 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 22 04:24:44.933599 ip-10-0-141-238 kubenswrapper[2563]: W0722 04:24:44.813113    2563 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 22 04:24:44.933599 ip-10-0-141-238 kubenswrapper[2563]: W0722 04:24:44.813116    2563 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 22 04:24:44.933599 ip-10-0-141-238 kubenswrapper[2563]: W0722 04:24:44.813118    2563 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 22 04:24:44.933599 ip-10-0-141-238 kubenswrapper[2563]: W0722 04:24:44.813121    2563 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 22 04:24:44.933599 ip-10-0-141-238 kubenswrapper[2563]: W0722 04:24:44.813123    2563 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 22 04:24:44.933599 ip-10-0-141-238 kubenswrapper[2563]: W0722 04:24:44.813126    2563 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 22 04:24:44.933599 ip-10-0-141-238 kubenswrapper[2563]: W0722 04:24:44.813130    2563 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 22 04:24:44.934203 ip-10-0-141-238 kubenswrapper[2563]: W0722 04:24:44.813132    2563 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 22 04:24:44.934203 ip-10-0-141-238 kubenswrapper[2563]: W0722 04:24:44.813135    2563 feature_gate.go:328] unrecognized feature gate: Example
Jul 22 04:24:44.934203 ip-10-0-141-238 kubenswrapper[2563]: W0722 04:24:44.813137    2563 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 22 04:24:44.934203 ip-10-0-141-238 kubenswrapper[2563]: W0722 04:24:44.813140    2563 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 22 04:24:44.934203 ip-10-0-141-238 kubenswrapper[2563]: W0722 04:24:44.813142    2563 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 22 04:24:44.934203 ip-10-0-141-238 kubenswrapper[2563]: W0722 04:24:44.813145    2563 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 22 04:24:44.934203 ip-10-0-141-238 kubenswrapper[2563]: W0722 04:24:44.813147    2563 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 22 04:24:44.934203 ip-10-0-141-238 kubenswrapper[2563]: W0722 04:24:44.813150    2563 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 22 04:24:44.934203 ip-10-0-141-238 kubenswrapper[2563]: W0722 04:24:44.813152    2563 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 22 04:24:44.934203 ip-10-0-141-238 kubenswrapper[2563]: W0722 04:24:44.813155    2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 22 04:24:44.934203 ip-10-0-141-238 kubenswrapper[2563]: W0722 04:24:44.813158    2563 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 22 04:24:44.934203 ip-10-0-141-238 kubenswrapper[2563]: W0722 04:24:44.813162    2563 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 22 04:24:44.934203 ip-10-0-141-238 kubenswrapper[2563]: W0722 04:24:44.813166    2563 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 22 04:24:44.934203 ip-10-0-141-238 kubenswrapper[2563]: W0722 04:24:44.813562    2563 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 22 04:24:44.934203 ip-10-0-141-238 kubenswrapper[2563]: W0722 04:24:44.813568    2563 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 22 04:24:44.934203 ip-10-0-141-238 kubenswrapper[2563]: W0722 04:24:44.813572    2563 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 22 04:24:44.934203 ip-10-0-141-238 kubenswrapper[2563]: W0722 04:24:44.813576    2563 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 22 04:24:44.934203 ip-10-0-141-238 kubenswrapper[2563]: W0722 04:24:44.813579    2563 feature_gate.go:328] unrecognized feature gate: Example
Jul 22 04:24:44.934203 ip-10-0-141-238 kubenswrapper[2563]: W0722 04:24:44.813582    2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 22 04:24:44.934203 ip-10-0-141-238 kubenswrapper[2563]: W0722 04:24:44.813585    2563 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 22 04:24:44.934761 ip-10-0-141-238 kubenswrapper[2563]: W0722 04:24:44.813589    2563 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 22 04:24:44.934761 ip-10-0-141-238 kubenswrapper[2563]: W0722 04:24:44.813592    2563 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 22 04:24:44.934761 ip-10-0-141-238 kubenswrapper[2563]: W0722 04:24:44.813595    2563 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 22 04:24:44.934761 ip-10-0-141-238 kubenswrapper[2563]: W0722 04:24:44.813597    2563 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 22 04:24:44.934761 ip-10-0-141-238 kubenswrapper[2563]: W0722 04:24:44.813600    2563 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 22 04:24:44.934761 ip-10-0-141-238 kubenswrapper[2563]: W0722 04:24:44.813602    2563 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 22 04:24:44.934761 ip-10-0-141-238 kubenswrapper[2563]: W0722 04:24:44.813605    2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 22 04:24:44.934761 ip-10-0-141-238 kubenswrapper[2563]: W0722 04:24:44.813608    2563 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 22 04:24:44.934761 ip-10-0-141-238 kubenswrapper[2563]: W0722 04:24:44.813611    2563 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 22 04:24:44.934761 ip-10-0-141-238 kubenswrapper[2563]: W0722 04:24:44.813613    2563 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 22 04:24:44.934761 ip-10-0-141-238 kubenswrapper[2563]: W0722 04:24:44.813616    2563 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 22 04:24:44.934761 ip-10-0-141-238 kubenswrapper[2563]: W0722 04:24:44.813618    2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 22 04:24:44.934761 ip-10-0-141-238 kubenswrapper[2563]: W0722 04:24:44.813621    2563 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 22 04:24:44.934761 ip-10-0-141-238 kubenswrapper[2563]: W0722 04:24:44.813624    2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 22 04:24:44.934761 ip-10-0-141-238 kubenswrapper[2563]: W0722 04:24:44.813626    2563 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 22 04:24:44.934761 ip-10-0-141-238 kubenswrapper[2563]: W0722 04:24:44.813628    2563 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 22 04:24:44.934761 ip-10-0-141-238 kubenswrapper[2563]: W0722 04:24:44.813631    2563 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 22 04:24:44.934761 ip-10-0-141-238 kubenswrapper[2563]: W0722 04:24:44.813634    2563 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 22 04:24:44.934761 ip-10-0-141-238 kubenswrapper[2563]: W0722 04:24:44.813636    2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 22 04:24:44.934761 ip-10-0-141-238 kubenswrapper[2563]: W0722 04:24:44.813639    2563 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 22 04:24:44.935385 ip-10-0-141-238 kubenswrapper[2563]: W0722 04:24:44.813642    2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 22 04:24:44.935385 ip-10-0-141-238 kubenswrapper[2563]: W0722 04:24:44.813644    2563 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 22 04:24:44.935385 ip-10-0-141-238 kubenswrapper[2563]: W0722 04:24:44.813648    2563 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 22 04:24:44.935385 ip-10-0-141-238 kubenswrapper[2563]: W0722 04:24:44.813651    2563 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 22 04:24:44.935385 ip-10-0-141-238 kubenswrapper[2563]: W0722 04:24:44.813654    2563 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 22 04:24:44.935385 ip-10-0-141-238 kubenswrapper[2563]: W0722 04:24:44.813658    2563 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 22 04:24:44.935385 ip-10-0-141-238 kubenswrapper[2563]: W0722 04:24:44.813660    2563 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 22 04:24:44.935385 ip-10-0-141-238 kubenswrapper[2563]: W0722 04:24:44.813663    2563 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 22 04:24:44.935385 ip-10-0-141-238 kubenswrapper[2563]: W0722 04:24:44.813665    2563 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 22 04:24:44.935385 ip-10-0-141-238 kubenswrapper[2563]: W0722 04:24:44.813668    2563 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 22 04:24:44.935385 ip-10-0-141-238 kubenswrapper[2563]: W0722 04:24:44.813671    2563 feature_gate.go:328] unrecognized feature gate: Example2
Jul 22 04:24:44.935385 ip-10-0-141-238 kubenswrapper[2563]: W0722 04:24:44.813673    2563 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 22 04:24:44.935385 ip-10-0-141-238 kubenswrapper[2563]: W0722 04:24:44.813677    2563 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 22 04:24:44.935385 ip-10-0-141-238 kubenswrapper[2563]: W0722 04:24:44.813680    2563 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 22 04:24:44.935385 ip-10-0-141-238 kubenswrapper[2563]: W0722 04:24:44.813682    2563 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 22 04:24:44.935385 ip-10-0-141-238 kubenswrapper[2563]: W0722 04:24:44.813685    2563 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 22 04:24:44.935385 ip-10-0-141-238 kubenswrapper[2563]: W0722 04:24:44.813687    2563 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 22 04:24:44.935385 ip-10-0-141-238 kubenswrapper[2563]: W0722 04:24:44.813690    2563 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 22 04:24:44.935385 ip-10-0-141-238 kubenswrapper[2563]: W0722 04:24:44.813692    2563 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 22 04:24:44.935885 ip-10-0-141-238 kubenswrapper[2563]: W0722 04:24:44.813695    2563 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 22 04:24:44.935885 ip-10-0-141-238 kubenswrapper[2563]: W0722 04:24:44.813698    2563 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 22 04:24:44.935885 ip-10-0-141-238 kubenswrapper[2563]: W0722 04:24:44.813702    2563 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 22 04:24:44.935885 ip-10-0-141-238 kubenswrapper[2563]: W0722 04:24:44.813705    2563 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 22 04:24:44.935885 ip-10-0-141-238 kubenswrapper[2563]: W0722 04:24:44.813707    2563 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 22 04:24:44.935885 ip-10-0-141-238 kubenswrapper[2563]: W0722 04:24:44.813710    2563 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 22 04:24:44.935885 ip-10-0-141-238 kubenswrapper[2563]: W0722 04:24:44.813712    2563 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 22 04:24:44.935885 ip-10-0-141-238 kubenswrapper[2563]: W0722 04:24:44.813715    2563 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 22 04:24:44.935885 ip-10-0-141-238 kubenswrapper[2563]: W0722 04:24:44.813718    2563 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 22 04:24:44.935885 ip-10-0-141-238 kubenswrapper[2563]: W0722 04:24:44.813720    2563 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 22 04:24:44.935885 ip-10-0-141-238 kubenswrapper[2563]: W0722 04:24:44.813723    2563 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 22 04:24:44.935885 ip-10-0-141-238 kubenswrapper[2563]: W0722 04:24:44.813726    2563 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 22 04:24:44.935885 ip-10-0-141-238 kubenswrapper[2563]: W0722 04:24:44.813728    2563 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 22 04:24:44.935885 ip-10-0-141-238 kubenswrapper[2563]: W0722 04:24:44.813731    2563 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 22 04:24:44.935885 ip-10-0-141-238 kubenswrapper[2563]: W0722 04:24:44.813733    2563 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 22 04:24:44.935885 ip-10-0-141-238 kubenswrapper[2563]: W0722 04:24:44.813736    2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 22 04:24:44.935885 ip-10-0-141-238 kubenswrapper[2563]: W0722 04:24:44.813738    2563 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 22 04:24:44.935885 ip-10-0-141-238 kubenswrapper[2563]: W0722 04:24:44.813740    2563 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 22 04:24:44.935885 ip-10-0-141-238 kubenswrapper[2563]: W0722 04:24:44.813743    2563 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 22 04:24:44.935885 ip-10-0-141-238 kubenswrapper[2563]: W0722 04:24:44.813746    2563 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 22 04:24:44.936462 ip-10-0-141-238 kubenswrapper[2563]: W0722 04:24:44.813748    2563 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 22 04:24:44.936462 ip-10-0-141-238 kubenswrapper[2563]: W0722 04:24:44.813751    2563 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 22 04:24:44.936462 ip-10-0-141-238 kubenswrapper[2563]: W0722 04:24:44.813753    2563 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 22 04:24:44.936462 ip-10-0-141-238 kubenswrapper[2563]: W0722 04:24:44.813756    2563 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 22 04:24:44.936462 ip-10-0-141-238 kubenswrapper[2563]: W0722 04:24:44.813759    2563 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 22 04:24:44.936462 ip-10-0-141-238 kubenswrapper[2563]: W0722 04:24:44.813763    2563 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 22 04:24:44.936462 ip-10-0-141-238 kubenswrapper[2563]: W0722 04:24:44.813766    2563 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 22 04:24:44.936462 ip-10-0-141-238 kubenswrapper[2563]: W0722 04:24:44.813768    2563 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 22 04:24:44.936462 ip-10-0-141-238 kubenswrapper[2563]: W0722 04:24:44.813771    2563 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 22 04:24:44.936462 ip-10-0-141-238 kubenswrapper[2563]: W0722 04:24:44.813773    2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 22 04:24:44.936462 ip-10-0-141-238 kubenswrapper[2563]: W0722 04:24:44.813776    2563 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 22 04:24:44.936462 ip-10-0-141-238 kubenswrapper[2563]: W0722 04:24:44.813779    2563 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 22 04:24:44.936462 ip-10-0-141-238 kubenswrapper[2563]: W0722 04:24:44.813781    2563 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 22 04:24:44.936462 ip-10-0-141-238 kubenswrapper[2563]: W0722 04:24:44.813785    2563 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 22 04:24:44.936462 ip-10-0-141-238 kubenswrapper[2563]: W0722 04:24:44.813788    2563 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 22 04:24:44.936462 ip-10-0-141-238 kubenswrapper[2563]: W0722 04:24:44.813791    2563 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 22 04:24:44.936462 ip-10-0-141-238 kubenswrapper[2563]: W0722 04:24:44.813793    2563 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 22 04:24:44.936462 ip-10-0-141-238 kubenswrapper[2563]: W0722 04:24:44.813796    2563 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 22 04:24:44.936462 ip-10-0-141-238 kubenswrapper[2563]: W0722 04:24:44.813798    2563 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 22 04:24:44.936462 ip-10-0-141-238 kubenswrapper[2563]: W0722 04:24:44.813801    2563 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 22 04:24:44.937003 ip-10-0-141-238 kubenswrapper[2563]: W0722 04:24:44.813803    2563 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 22 04:24:44.937003 ip-10-0-141-238 kubenswrapper[2563]: W0722 04:24:44.813806    2563 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 22 04:24:44.937003 ip-10-0-141-238 kubenswrapper[2563]: W0722 04:24:44.813809    2563 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 22 04:24:44.937003 ip-10-0-141-238 kubenswrapper[2563]: W0722 04:24:44.813811    2563 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 22 04:24:44.937003 ip-10-0-141-238 kubenswrapper[2563]: W0722 04:24:44.813815    2563 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 22 04:24:44.937003 ip-10-0-141-238 kubenswrapper[2563]: W0722 04:24:44.813818    2563 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 22 04:24:44.937003 ip-10-0-141-238 kubenswrapper[2563]: W0722 04:24:44.813821    2563 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 22 04:24:44.937003 ip-10-0-141-238 kubenswrapper[2563]: W0722 04:24:44.813824    2563 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 22 04:24:44.937003 ip-10-0-141-238 kubenswrapper[2563]: W0722 04:24:44.813827    2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 22 04:24:44.937003 ip-10-0-141-238 kubenswrapper[2563]: W0722 04:24:44.813829    2563 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 22 04:24:44.937003 ip-10-0-141-238 kubenswrapper[2563]: W0722 04:24:44.813832    2563 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 22 04:24:44.937003 ip-10-0-141-238 kubenswrapper[2563]: W0722 04:24:44.813835    2563 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 22 04:24:44.937003 ip-10-0-141-238 kubenswrapper[2563]: W0722 04:24:44.813838    2563 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 22 04:24:44.937003 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:24:44.813905    2563 flags.go:64] FLAG: --address="0.0.0.0"
Jul 22 04:24:44.937003 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:24:44.813913    2563 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]"
Jul 22 04:24:44.937003 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:24:44.813919    2563 flags.go:64] FLAG: --anonymous-auth="true"
Jul 22 04:24:44.937003 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:24:44.813923    2563 flags.go:64] FLAG: --application-metrics-count-limit="100"
Jul 22 04:24:44.937003 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:24:44.813928    2563 flags.go:64] FLAG: --authentication-token-webhook="false"
Jul 22 04:24:44.937003 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:24:44.813932    2563 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s"
Jul 22 04:24:44.937003 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:24:44.813936    2563 flags.go:64] FLAG: --authorization-mode="AlwaysAllow"
Jul 22 04:24:44.937003 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:24:44.813940    2563 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s"
Jul 22 04:24:44.937614 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:24:44.813943    2563 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s"
Jul 22 04:24:44.937614 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:24:44.813946    2563 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id"
Jul 22 04:24:44.937614 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:24:44.813949    2563 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig"
Jul 22 04:24:44.937614 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:24:44.813953    2563 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki"
Jul 22 04:24:44.937614 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:24:44.813956    2563 flags.go:64] FLAG: --cgroup-driver="cgroupfs"
Jul 22 04:24:44.937614 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:24:44.813960    2563 flags.go:64] FLAG: --cgroup-root=""
Jul 22 04:24:44.937614 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:24:44.813963    2563 flags.go:64] FLAG: --cgroups-per-qos="true"
Jul 22 04:24:44.937614 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:24:44.813966    2563 flags.go:64] FLAG: --client-ca-file=""
Jul 22 04:24:44.937614 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:24:44.813969    2563 flags.go:64] FLAG: --cloud-provider="external"
Jul 22 04:24:44.937614 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:24:44.813972    2563 flags.go:64] FLAG: --cluster-dns="[]"
Jul 22 04:24:44.937614 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:24:44.813976    2563 flags.go:64] FLAG: --cluster-domain=""
Jul 22 04:24:44.937614 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:24:44.813979    2563 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf"
Jul 22 04:24:44.937614 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:24:44.813982    2563 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d"
Jul 22 04:24:44.937614 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:24:44.813985    2563 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json"
Jul 22 04:24:44.937614 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:24:44.813988    2563 flags.go:64] FLAG: --container-log-max-files="5"
Jul 22 04:24:44.937614 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:24:44.813992    2563 flags.go:64] FLAG: --container-log-max-size="10Mi"
Jul 22 04:24:44.937614 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:24:44.813994    2563 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock"
Jul 22 04:24:44.937614 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:24:44.813997    2563 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock"
Jul 22 04:24:44.937614 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:24:44.814001    2563 flags.go:64] FLAG: --containerd-namespace="k8s.io"
Jul 22 04:24:44.937614 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:24:44.814004    2563 flags.go:64] FLAG: --contention-profiling="false"
Jul 22 04:24:44.937614 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:24:44.814007    2563 flags.go:64] FLAG: --cpu-cfs-quota="true"
Jul 22 04:24:44.937614 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:24:44.814010    2563 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms"
Jul 22 04:24:44.937614 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:24:44.814013    2563 flags.go:64] FLAG: --cpu-manager-policy="none"
Jul 22 04:24:44.937614 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:24:44.814016    2563 flags.go:64] FLAG: --cpu-manager-policy-options=""
Jul 22 04:24:44.938254 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:24:44.814020    2563 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s"
Jul 22 04:24:44.938254 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:24:44.814023    2563 flags.go:64] FLAG: --enable-controller-attach-detach="true"
Jul 22 04:24:44.938254 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:24:44.814025    2563 flags.go:64] FLAG: --enable-debugging-handlers="true"
Jul 22 04:24:44.938254 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:24:44.814028    2563 flags.go:64] FLAG: --enable-load-reader="false"
Jul 22 04:24:44.938254 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:24:44.814032    2563 flags.go:64] FLAG: --enable-server="true"
Jul 22 04:24:44.938254 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:24:44.814048    2563 flags.go:64] FLAG: --enforce-node-allocatable="[pods]"
Jul 22 04:24:44.938254 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:24:44.814054    2563 flags.go:64] FLAG: --event-burst="100"
Jul 22 04:24:44.938254 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:24:44.814057    2563 flags.go:64] FLAG: --event-qps="50"
Jul 22 04:24:44.938254 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:24:44.814060    2563 flags.go:64] FLAG: --event-storage-age-limit="default=0"
Jul 22 04:24:44.938254 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:24:44.814062    2563 flags.go:64] FLAG: --event-storage-event-limit="default=0"
Jul 22 04:24:44.938254 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:24:44.814065    2563 flags.go:64] FLAG: --eviction-hard=""
Jul 22 04:24:44.938254 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:24:44.814069    2563 flags.go:64] FLAG: --eviction-max-pod-grace-period="0"
Jul 22 04:24:44.938254 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:24:44.814072    2563 flags.go:64] FLAG: --eviction-minimum-reclaim=""
Jul 22 04:24:44.938254 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:24:44.814076    2563 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s"
Jul 22 04:24:44.938254 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:24:44.814079    2563 flags.go:64] FLAG: --eviction-soft=""
Jul 22 04:24:44.938254 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:24:44.814082    2563 flags.go:64] FLAG: --eviction-soft-grace-period=""
Jul 22 04:24:44.938254 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:24:44.814085    2563 flags.go:64] FLAG: --exit-on-lock-contention="false"
Jul 22 04:24:44.938254 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:24:44.814088    2563 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false"
Jul 22 04:24:44.938254 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:24:44.814091    2563 flags.go:64] FLAG: --experimental-mounter-path=""
Jul 22 04:24:44.938254 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:24:44.814094    2563 flags.go:64] FLAG: --fail-cgroupv1="false"
Jul 22 04:24:44.938254 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:24:44.814096    2563 flags.go:64] FLAG: --fail-swap-on="true"
Jul 22 04:24:44.938254 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:24:44.814099    2563 flags.go:64] FLAG: --feature-gates=""
Jul 22 04:24:44.938254 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:24:44.814103    2563 flags.go:64] FLAG: --file-check-frequency="20s"
Jul 22 04:24:44.938254 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:24:44.814106    2563 flags.go:64] FLAG: --global-housekeeping-interval="1m0s"
Jul 22 04:24:44.938254 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:24:44.814109    2563 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge"
Jul 22 04:24:44.938959 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:24:44.814112    2563 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1"
Jul 22 04:24:44.938959 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:24:44.814116    2563 flags.go:64] FLAG: --healthz-port="10248"
Jul 22 04:24:44.938959 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:24:44.814119    2563 flags.go:64] FLAG: --help="false"
Jul 22 04:24:44.938959 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:24:44.814121    2563 flags.go:64] FLAG: --hostname-override="ip-10-0-141-238.ec2.internal"
Jul 22 04:24:44.938959 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:24:44.814125    2563 flags.go:64] FLAG: --housekeeping-interval="10s"
Jul 22 04:24:44.938959 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:24:44.814127    2563 flags.go:64] FLAG: --http-check-frequency="20s"
Jul 22 04:24:44.938959 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:24:44.814130    2563 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins"
Jul 22 04:24:44.938959 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:24:44.814134    2563 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml"
Jul 22 04:24:44.938959 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:24:44.814151    2563 flags.go:64] FLAG: --image-gc-high-threshold="85"
Jul 22 04:24:44.938959 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:24:44.814155    2563 flags.go:64] FLAG: --image-gc-low-threshold="80"
Jul 22 04:24:44.938959 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:24:44.814159    2563 flags.go:64] FLAG: --image-service-endpoint=""
Jul 22 04:24:44.938959 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:24:44.814163    2563 flags.go:64] FLAG: --kernel-memcg-notification="false"
Jul 22 04:24:44.938959 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:24:44.814166    2563 flags.go:64] FLAG: --kube-api-burst="100"
Jul 22 04:24:44.938959 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:24:44.814170    2563 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf"
Jul 22 04:24:44.938959 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:24:44.814173    2563 flags.go:64] FLAG: --kube-api-qps="50"
Jul 22 04:24:44.938959 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:24:44.814176    2563 flags.go:64] FLAG: --kube-reserved=""
Jul 22 04:24:44.938959 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:24:44.814179    2563 flags.go:64] FLAG: --kube-reserved-cgroup=""
Jul 22 04:24:44.938959 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:24:44.814182    2563 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig"
Jul 22 04:24:44.938959 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:24:44.814185    2563 flags.go:64] FLAG: --kubelet-cgroups=""
Jul 22 04:24:44.938959 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:24:44.814188    2563 flags.go:64] FLAG: --local-storage-capacity-isolation="true"
Jul 22 04:24:44.938959 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:24:44.814191    2563 flags.go:64] FLAG: --lock-file=""
Jul 22 04:24:44.938959 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:24:44.814194    2563 flags.go:64] FLAG: --log-cadvisor-usage="false"
Jul 22 04:24:44.938959 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:24:44.814197    2563 flags.go:64] FLAG: --log-flush-frequency="5s"
Jul 22 04:24:44.938959 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:24:44.814200    2563 flags.go:64] FLAG: --log-json-info-buffer-size="0"
Jul 22 04:24:44.939850 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:24:44.814205    2563 flags.go:64] FLAG: --log-json-split-stream="false"
Jul 22 04:24:44.939850 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:24:44.814208    2563 flags.go:64] FLAG: --log-text-info-buffer-size="0"
Jul 22 04:24:44.939850 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:24:44.814211    2563 flags.go:64] FLAG: --log-text-split-stream="false"
Jul 22 04:24:44.939850 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:24:44.814214    2563 flags.go:64] FLAG: --logging-format="text"
Jul 22 04:24:44.939850 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:24:44.814216    2563 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id"
Jul 22 04:24:44.939850 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:24:44.814220    2563 flags.go:64] FLAG: --make-iptables-util-chains="true"
Jul 22 04:24:44.939850 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:24:44.814222    2563 flags.go:64] FLAG: --manifest-url=""
Jul 22 04:24:44.939850 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:24:44.814225    2563 flags.go:64] FLAG: --manifest-url-header=""
Jul 22 04:24:44.939850 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:24:44.814229    2563 flags.go:64] FLAG: --max-housekeeping-interval="15s"
Jul 22 04:24:44.939850 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:24:44.814232    2563 flags.go:64] FLAG: --max-open-files="1000000"
Jul 22 04:24:44.939850 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:24:44.814236    2563 flags.go:64] FLAG: --max-pods="110"
Jul 22 04:24:44.939850 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:24:44.814239    2563 flags.go:64] FLAG: --maximum-dead-containers="-1"
Jul 22 04:24:44.939850 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:24:44.814241    2563 flags.go:64] FLAG: --maximum-dead-containers-per-container="1"
Jul 22 04:24:44.939850 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:24:44.814244    2563 flags.go:64] FLAG: --memory-manager-policy="None"
Jul 22 04:24:44.939850 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:24:44.814246    2563 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s"
Jul 22 04:24:44.939850 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:24:44.814249    2563 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s"
Jul 22 04:24:44.939850 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:24:44.814252    2563 flags.go:64] FLAG: --node-ip="0.0.0.0"
Jul 22 04:24:44.939850 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:24:44.814255    2563 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel"
Jul 22 04:24:44.939850 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:24:44.814262    2563 flags.go:64] FLAG: --node-status-max-images="50"
Jul 22 04:24:44.939850 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:24:44.814266    2563 flags.go:64] FLAG: --node-status-update-frequency="10s"
Jul 22 04:24:44.939850 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:24:44.814269    2563 flags.go:64] FLAG: --oom-score-adj="-999"
Jul 22 04:24:44.939850 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:24:44.814276    2563 flags.go:64] FLAG: --pod-cidr=""
Jul 22 04:24:44.939850 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:24:44.814279    2563 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:4017e99d76d7b91598d3a3430cd0eba6eda8b33653addd3838fdfe3cca69c5a0"
Jul 22 04:24:44.940539 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:24:44.814285    2563 flags.go:64] FLAG: --pod-manifest-path=""
Jul 22 04:24:44.940539 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:24:44.814288    2563 flags.go:64] FLAG: --pod-max-pids="-1"
Jul 22 04:24:44.940539 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:24:44.814291    2563 flags.go:64] FLAG: --pods-per-core="0"
Jul 22 04:24:44.940539 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:24:44.814294    2563 flags.go:64] FLAG: --port="10250"
Jul 22 04:24:44.940539 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:24:44.814297    2563 flags.go:64] FLAG: --protect-kernel-defaults="false"
Jul 22 04:24:44.940539 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:24:44.814300    2563 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-08916c897706952f2"
Jul 22 04:24:44.940539 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:24:44.814303    2563 flags.go:64] FLAG: --qos-reserved=""
Jul 22 04:24:44.940539 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:24:44.814306    2563 flags.go:64] FLAG: --read-only-port="10255"
Jul 22 04:24:44.940539 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:24:44.814310    2563 flags.go:64] FLAG: --register-node="true"
Jul 22 04:24:44.940539 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:24:44.814313    2563 flags.go:64] FLAG: --register-with-taints=""
Jul 22 04:24:44.940539 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:24:44.814316    2563 flags.go:64] FLAG: --registry-burst="10"
Jul 22 04:24:44.940539 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:24:44.814319    2563 flags.go:64] FLAG: --registry-qps="5"
Jul 22 04:24:44.940539 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:24:44.814322    2563 flags.go:64] FLAG: --reserved-cpus=""
Jul 22 04:24:44.940539 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:24:44.814325    2563 flags.go:64] FLAG: --reserved-memory=""
Jul 22 04:24:44.940539 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:24:44.814328    2563 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf"
Jul 22 04:24:44.940539 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:24:44.814331    2563 flags.go:64] FLAG: --root-dir="/var/lib/kubelet"
Jul 22 04:24:44.940539 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:24:44.814334    2563 flags.go:64] FLAG: --rotate-certificates="false"
Jul 22 04:24:44.940539 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:24:44.814337    2563 flags.go:64] FLAG: --rotate-server-certificates="false"
Jul 22 04:24:44.940539 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:24:44.814340    2563 flags.go:64] FLAG: --runonce="false"
Jul 22 04:24:44.940539 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:24:44.814342    2563 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service"
Jul 22 04:24:44.940539 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:24:44.814345    2563 flags.go:64] FLAG: --runtime-request-timeout="2m0s"
Jul 22 04:24:44.940539 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:24:44.814348    2563 flags.go:64] FLAG: --seccomp-default="false"
Jul 22 04:24:44.940539 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:24:44.814351    2563 flags.go:64] FLAG: --serialize-image-pulls="true"
Jul 22 04:24:44.940539 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:24:44.814354    2563 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s"
Jul 22 04:24:44.940539 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:24:44.814356    2563 flags.go:64] FLAG: --storage-driver-db="cadvisor"
Jul 22 04:24:44.940539 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:24:44.814359    2563 flags.go:64] FLAG: --storage-driver-host="localhost:8086"
Jul 22 04:24:44.941313 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:24:44.814362    2563 flags.go:64] FLAG: --storage-driver-password="root"
Jul 22 04:24:44.941313 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:24:44.814365    2563 flags.go:64] FLAG: --storage-driver-secure="false"
Jul 22 04:24:44.941313 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:24:44.814368    2563 flags.go:64] FLAG: --storage-driver-table="stats"
Jul 22 04:24:44.941313 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:24:44.814372    2563 flags.go:64] FLAG: --storage-driver-user="root"
Jul 22 04:24:44.941313 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:24:44.814376    2563 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s"
Jul 22 04:24:44.941313 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:24:44.814379    2563 flags.go:64] FLAG: --sync-frequency="1m0s"
Jul 22 04:24:44.941313 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:24:44.814382    2563 flags.go:64] FLAG: --system-cgroups=""
Jul 22 04:24:44.941313 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:24:44.814385    2563 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi"
Jul 22 04:24:44.941313 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:24:44.814390    2563 flags.go:64] FLAG: --system-reserved-cgroup=""
Jul 22 04:24:44.941313 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:24:44.814393    2563 flags.go:64] FLAG: --tls-cert-file=""
Jul 22 04:24:44.941313 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:24:44.814395    2563 flags.go:64] FLAG: --tls-cipher-suites="[]"
Jul 22 04:24:44.941313 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:24:44.814400    2563 flags.go:64] FLAG: --tls-min-version=""
Jul 22 04:24:44.941313 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:24:44.814403    2563 flags.go:64] FLAG: --tls-private-key-file=""
Jul 22 04:24:44.941313 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:24:44.814405    2563 flags.go:64] FLAG: --topology-manager-policy="none"
Jul 22 04:24:44.941313 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:24:44.814408    2563 flags.go:64] FLAG: --topology-manager-policy-options=""
Jul 22 04:24:44.941313 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:24:44.814411    2563 flags.go:64] FLAG: --topology-manager-scope="container"
Jul 22 04:24:44.941313 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:24:44.814414    2563 flags.go:64] FLAG: --v="2"
Jul 22 04:24:44.941313 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:24:44.814418    2563 flags.go:64] FLAG: --version="false"
Jul 22 04:24:44.941313 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:24:44.814422    2563 flags.go:64] FLAG: --vmodule=""
Jul 22 04:24:44.941313 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:24:44.814425    2563 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec"
Jul 22 04:24:44.941313 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:24:44.814428    2563 flags.go:64] FLAG: --volume-stats-agg-period="1m0s"
Jul 22 04:24:44.941313 ip-10-0-141-238 kubenswrapper[2563]: W0722 04:24:44.814537    2563 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 22 04:24:44.941313 ip-10-0-141-238 kubenswrapper[2563]: W0722 04:24:44.814541    2563 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 22 04:24:44.941313 ip-10-0-141-238 kubenswrapper[2563]: W0722 04:24:44.814544    2563 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 22 04:24:44.942060 ip-10-0-141-238 kubenswrapper[2563]: W0722 04:24:44.814547    2563 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 22 04:24:44.942060 ip-10-0-141-238 kubenswrapper[2563]: W0722 04:24:44.814549    2563 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 22 04:24:44.942060 ip-10-0-141-238 kubenswrapper[2563]: W0722 04:24:44.814553    2563 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 22 04:24:44.942060 ip-10-0-141-238 kubenswrapper[2563]: W0722 04:24:44.814556    2563 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 22 04:24:44.942060 ip-10-0-141-238 kubenswrapper[2563]: W0722 04:24:44.814558    2563 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 22 04:24:44.942060 ip-10-0-141-238 kubenswrapper[2563]: W0722 04:24:44.814561    2563 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 22 04:24:44.942060 ip-10-0-141-238 kubenswrapper[2563]: W0722 04:24:44.814563    2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 22 04:24:44.942060 ip-10-0-141-238 kubenswrapper[2563]: W0722 04:24:44.814565    2563 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 22 04:24:44.942060 ip-10-0-141-238 kubenswrapper[2563]: W0722 04:24:44.814568    2563 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 22 04:24:44.942060 ip-10-0-141-238 kubenswrapper[2563]: W0722 04:24:44.814570    2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 22 04:24:44.942060 ip-10-0-141-238 kubenswrapper[2563]: W0722 04:24:44.814573    2563 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 22 04:24:44.942060 ip-10-0-141-238 kubenswrapper[2563]: W0722 04:24:44.814577    2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 22 04:24:44.942060 ip-10-0-141-238 kubenswrapper[2563]: W0722 04:24:44.814581    2563 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 22 04:24:44.942060 ip-10-0-141-238 kubenswrapper[2563]: W0722 04:24:44.814584    2563 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 22 04:24:44.942060 ip-10-0-141-238 kubenswrapper[2563]: W0722 04:24:44.814587    2563 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 22 04:24:44.942060 ip-10-0-141-238 kubenswrapper[2563]: W0722 04:24:44.814589    2563 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 22 04:24:44.942060 ip-10-0-141-238 kubenswrapper[2563]: W0722 04:24:44.814592    2563 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 22 04:24:44.942060 ip-10-0-141-238 kubenswrapper[2563]: W0722 04:24:44.814594    2563 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 22 04:24:44.942060 ip-10-0-141-238 kubenswrapper[2563]: W0722 04:24:44.814597    2563 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 22 04:24:44.942060 ip-10-0-141-238 kubenswrapper[2563]: W0722 04:24:44.814599    2563 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 22 04:24:44.942867 ip-10-0-141-238 kubenswrapper[2563]: W0722 04:24:44.814602    2563 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 22 04:24:44.942867 ip-10-0-141-238 kubenswrapper[2563]: W0722 04:24:44.814605    2563 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 22 04:24:44.942867 ip-10-0-141-238 kubenswrapper[2563]: W0722 04:24:44.814607    2563 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 22 04:24:44.942867 ip-10-0-141-238 kubenswrapper[2563]: W0722 04:24:44.814610    2563 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 22 04:24:44.942867 ip-10-0-141-238 kubenswrapper[2563]: W0722 04:24:44.814613    2563 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 22 04:24:44.942867 ip-10-0-141-238 kubenswrapper[2563]: W0722 04:24:44.814615    2563 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 22 04:24:44.942867 ip-10-0-141-238 kubenswrapper[2563]: W0722 04:24:44.814618    2563 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 22 04:24:44.942867 ip-10-0-141-238 kubenswrapper[2563]: W0722 04:24:44.814620    2563 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 22 04:24:44.942867 ip-10-0-141-238 kubenswrapper[2563]: W0722 04:24:44.814623    2563 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 22 04:24:44.942867 ip-10-0-141-238 kubenswrapper[2563]: W0722 04:24:44.814625    2563 feature_gate.go:328] unrecognized feature gate: Example
Jul 22 04:24:44.942867 ip-10-0-141-238 kubenswrapper[2563]: W0722 04:24:44.814628    2563 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 22 04:24:44.942867 ip-10-0-141-238 kubenswrapper[2563]: W0722 04:24:44.814631    2563 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 22 04:24:44.942867 ip-10-0-141-238 kubenswrapper[2563]: W0722 04:24:44.814633    2563 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 22 04:24:44.942867 ip-10-0-141-238 kubenswrapper[2563]: W0722 04:24:44.814635    2563 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 22 04:24:44.942867 ip-10-0-141-238 kubenswrapper[2563]: W0722 04:24:44.814638    2563 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 22 04:24:44.942867 ip-10-0-141-238 kubenswrapper[2563]: W0722 04:24:44.814640    2563 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 22 04:24:44.942867 ip-10-0-141-238 kubenswrapper[2563]: W0722 04:24:44.814644    2563 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 22 04:24:44.942867 ip-10-0-141-238 kubenswrapper[2563]: W0722 04:24:44.814647    2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 22 04:24:44.942867 ip-10-0-141-238 kubenswrapper[2563]: W0722 04:24:44.814650    2563 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 22 04:24:44.942867 ip-10-0-141-238 kubenswrapper[2563]: W0722 04:24:44.814652    2563 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 22 04:24:44.943497 ip-10-0-141-238 kubenswrapper[2563]: W0722 04:24:44.814655    2563 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 22 04:24:44.943497 ip-10-0-141-238 kubenswrapper[2563]: W0722 04:24:44.814658    2563 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 22 04:24:44.943497 ip-10-0-141-238 kubenswrapper[2563]: W0722 04:24:44.814661    2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 22 04:24:44.943497 ip-10-0-141-238 kubenswrapper[2563]: W0722 04:24:44.814665    2563 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 22 04:24:44.943497 ip-10-0-141-238 kubenswrapper[2563]: W0722 04:24:44.814669    2563 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 22 04:24:44.943497 ip-10-0-141-238 kubenswrapper[2563]: W0722 04:24:44.814672    2563 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 22 04:24:44.943497 ip-10-0-141-238 kubenswrapper[2563]: W0722 04:24:44.814674    2563 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 22 04:24:44.943497 ip-10-0-141-238 kubenswrapper[2563]: W0722 04:24:44.814677    2563 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 22 04:24:44.943497 ip-10-0-141-238 kubenswrapper[2563]: W0722 04:24:44.814680    2563 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 22 04:24:44.943497 ip-10-0-141-238 kubenswrapper[2563]: W0722 04:24:44.814682    2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 22 04:24:44.943497 ip-10-0-141-238 kubenswrapper[2563]: W0722 04:24:44.814685    2563 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 22 04:24:44.943497 ip-10-0-141-238 kubenswrapper[2563]: W0722 04:24:44.814687    2563 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 22 04:24:44.943497 ip-10-0-141-238 kubenswrapper[2563]: W0722 04:24:44.814690    2563 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 22 04:24:44.943497 ip-10-0-141-238 kubenswrapper[2563]: W0722 04:24:44.814692    2563 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 22 04:24:44.943497 ip-10-0-141-238 kubenswrapper[2563]: W0722 04:24:44.814695    2563 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 22 04:24:44.943497 ip-10-0-141-238 kubenswrapper[2563]: W0722 04:24:44.814697    2563 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 22 04:24:44.943497 ip-10-0-141-238 kubenswrapper[2563]: W0722 04:24:44.814701    2563 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 22 04:24:44.943497 ip-10-0-141-238 kubenswrapper[2563]: W0722 04:24:44.814705    2563 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 22 04:24:44.943497 ip-10-0-141-238 kubenswrapper[2563]: W0722 04:24:44.814708    2563 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 22 04:24:45.169771 ip-10-0-141-238 kubenswrapper[2563]: W0722 04:24:44.814710    2563 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 22 04:24:45.169771 ip-10-0-141-238 kubenswrapper[2563]: W0722 04:24:44.814713    2563 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 22 04:24:45.169771 ip-10-0-141-238 kubenswrapper[2563]: W0722 04:24:44.814715    2563 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 22 04:24:45.169771 ip-10-0-141-238 kubenswrapper[2563]: W0722 04:24:44.814718    2563 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 22 04:24:45.169771 ip-10-0-141-238 kubenswrapper[2563]: W0722 04:24:44.814720    2563 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 22 04:24:45.169771 ip-10-0-141-238 kubenswrapper[2563]: W0722 04:24:44.814723    2563 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 22 04:24:45.169771 ip-10-0-141-238 kubenswrapper[2563]: W0722 04:24:44.814725    2563 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 22 04:24:45.169771 ip-10-0-141-238 kubenswrapper[2563]: W0722 04:24:44.814728    2563 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 22 04:24:45.169771 ip-10-0-141-238 kubenswrapper[2563]: W0722 04:24:44.814730    2563 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 22 04:24:45.169771 ip-10-0-141-238 kubenswrapper[2563]: W0722 04:24:44.814733    2563 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 22 04:24:45.169771 ip-10-0-141-238 kubenswrapper[2563]: W0722 04:24:44.814735    2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 22 04:24:45.169771 ip-10-0-141-238 kubenswrapper[2563]: W0722 04:24:44.814738    2563 feature_gate.go:328] unrecognized feature gate: Example2
Jul 22 04:24:45.169771 ip-10-0-141-238 kubenswrapper[2563]: W0722 04:24:44.814740    2563 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 22 04:24:45.169771 ip-10-0-141-238 kubenswrapper[2563]: W0722 04:24:44.814743    2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 22 04:24:45.169771 ip-10-0-141-238 kubenswrapper[2563]: W0722 04:24:44.814745    2563 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 22 04:24:45.169771 ip-10-0-141-238 kubenswrapper[2563]: W0722 04:24:44.814748    2563 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 22 04:24:45.169771 ip-10-0-141-238 kubenswrapper[2563]: W0722 04:24:44.814751    2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 22 04:24:45.169771 ip-10-0-141-238 kubenswrapper[2563]: W0722 04:24:44.814755    2563 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 22 04:24:45.169771 ip-10-0-141-238 kubenswrapper[2563]: W0722 04:24:44.814758    2563 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 22 04:24:45.193293 ip-10-0-141-238 kubenswrapper[2563]: W0722 04:24:44.814760    2563 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 22 04:24:45.193293 ip-10-0-141-238 kubenswrapper[2563]: W0722 04:24:44.814763    2563 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 22 04:24:45.193293 ip-10-0-141-238 kubenswrapper[2563]: W0722 04:24:44.814765    2563 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 22 04:24:45.193293 ip-10-0-141-238 kubenswrapper[2563]: W0722 04:24:44.814768    2563 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 22 04:24:45.193293 ip-10-0-141-238 kubenswrapper[2563]: W0722 04:24:44.814771    2563 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 22 04:24:45.193293 ip-10-0-141-238 kubenswrapper[2563]: W0722 04:24:44.814775    2563 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 22 04:24:45.193293 ip-10-0-141-238 kubenswrapper[2563]: W0722 04:24:44.814778    2563 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 22 04:24:45.193293 ip-10-0-141-238 kubenswrapper[2563]: W0722 04:24:44.814781    2563 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 22 04:24:45.193293 ip-10-0-141-238 kubenswrapper[2563]: W0722 04:24:44.814784    2563 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 22 04:24:45.193293 ip-10-0-141-238 kubenswrapper[2563]: W0722 04:24:44.814786    2563 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 22 04:24:45.193293 ip-10-0-141-238 kubenswrapper[2563]: W0722 04:24:44.814789    2563 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 22 04:24:45.193293 ip-10-0-141-238 kubenswrapper[2563]: W0722 04:24:44.814791    2563 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 22 04:24:45.193293 ip-10-0-141-238 kubenswrapper[2563]: W0722 04:24:44.814794    2563 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 22 04:24:45.193293 ip-10-0-141-238 kubenswrapper[2563]: W0722 04:24:44.814797    2563 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 22 04:24:45.193293 ip-10-0-141-238 kubenswrapper[2563]: W0722 04:24:44.814799    2563 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 22 04:24:45.193293 ip-10-0-141-238 kubenswrapper[2563]: W0722 04:24:44.814802    2563 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 22 04:24:45.193293 ip-10-0-141-238 kubenswrapper[2563]: W0722 04:24:44.814804    2563 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 22 04:24:45.193293 ip-10-0-141-238 kubenswrapper[2563]: W0722 04:24:44.814807    2563 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 22 04:24:45.193902 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:24:44.815351    2563 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 22 04:24:45.193902 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:24:44.821671    2563 server.go:529] "Kubelet version" kubeletVersion="v1.34.9"
Jul 22 04:24:45.193902 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:24:44.821688    2563 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK=""
Jul 22 04:24:45.193902 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:24:44.822303    2563 watchdog_linux.go:95] "Systemd watchdog is not enabled"
Jul 22 04:24:45.193902 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:24:44.822320    2563 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started."
Jul 22 04:24:45.193902 ip-10-0-141-238 kubenswrapper[2563]: W0722 04:24:44.822587    2563 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 22 04:24:45.193902 ip-10-0-141-238 kubenswrapper[2563]: W0722 04:24:44.822596    2563 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 22 04:24:45.193902 ip-10-0-141-238 kubenswrapper[2563]: W0722 04:24:44.822600    2563 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 22 04:24:45.193902 ip-10-0-141-238 kubenswrapper[2563]: W0722 04:24:44.822603    2563 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 22 04:24:45.193902 ip-10-0-141-238 kubenswrapper[2563]: W0722 04:24:44.822607    2563 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 22 04:24:45.193902 ip-10-0-141-238 kubenswrapper[2563]: W0722 04:24:44.822610    2563 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 22 04:24:45.193902 ip-10-0-141-238 kubenswrapper[2563]: W0722 04:24:44.822613    2563 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 22 04:24:45.193902 ip-10-0-141-238 kubenswrapper[2563]: W0722 04:24:44.822616    2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 22 04:24:45.193902 ip-10-0-141-238 kubenswrapper[2563]: W0722 04:24:44.822619    2563 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 22 04:24:45.194322 ip-10-0-141-238 kubenswrapper[2563]: W0722 04:24:44.822626    2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 22 04:24:45.194322 ip-10-0-141-238 kubenswrapper[2563]: W0722 04:24:44.822629    2563 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 22 04:24:45.194322 ip-10-0-141-238 kubenswrapper[2563]: W0722 04:24:44.822631    2563 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 22 04:24:45.194322 ip-10-0-141-238 kubenswrapper[2563]: W0722 04:24:44.822634    2563 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 22 04:24:45.194322 ip-10-0-141-238 kubenswrapper[2563]: W0722 04:24:44.822637    2563 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 22 04:24:45.194322 ip-10-0-141-238 kubenswrapper[2563]: W0722 04:24:44.822639    2563 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 22 04:24:45.194322 ip-10-0-141-238 kubenswrapper[2563]: W0722 04:24:44.822643    2563 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 22 04:24:45.194322 ip-10-0-141-238 kubenswrapper[2563]: W0722 04:24:44.822646    2563 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 22 04:24:45.194322 ip-10-0-141-238 kubenswrapper[2563]: W0722 04:24:44.822649    2563 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 22 04:24:45.194322 ip-10-0-141-238 kubenswrapper[2563]: W0722 04:24:44.822652    2563 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 22 04:24:45.194322 ip-10-0-141-238 kubenswrapper[2563]: W0722 04:24:44.822654    2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 22 04:24:45.194322 ip-10-0-141-238 kubenswrapper[2563]: W0722 04:24:44.822657    2563 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 22 04:24:45.194322 ip-10-0-141-238 kubenswrapper[2563]: W0722 04:24:44.822660    2563 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 22 04:24:45.194322 ip-10-0-141-238 kubenswrapper[2563]: W0722 04:24:44.822663    2563 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 22 04:24:45.194322 ip-10-0-141-238 kubenswrapper[2563]: W0722 04:24:44.822665    2563 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 22 04:24:45.194322 ip-10-0-141-238 kubenswrapper[2563]: W0722 04:24:44.822673    2563 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 22 04:24:45.194322 ip-10-0-141-238 kubenswrapper[2563]: W0722 04:24:44.822676    2563 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 22 04:24:45.194322 ip-10-0-141-238 kubenswrapper[2563]: W0722 04:24:44.822679    2563 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 22 04:24:45.194322 ip-10-0-141-238 kubenswrapper[2563]: W0722 04:24:44.822681    2563 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 22 04:24:45.194942 ip-10-0-141-238 kubenswrapper[2563]: W0722 04:24:44.822684    2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 22 04:24:45.194942 ip-10-0-141-238 kubenswrapper[2563]: W0722 04:24:44.822686    2563 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 22 04:24:45.194942 ip-10-0-141-238 kubenswrapper[2563]: W0722 04:24:44.822689    2563 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 22 04:24:45.194942 ip-10-0-141-238 kubenswrapper[2563]: W0722 04:24:44.822693    2563 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 22 04:24:45.194942 ip-10-0-141-238 kubenswrapper[2563]: W0722 04:24:44.822695    2563 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 22 04:24:45.194942 ip-10-0-141-238 kubenswrapper[2563]: W0722 04:24:44.822698    2563 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 22 04:24:45.194942 ip-10-0-141-238 kubenswrapper[2563]: W0722 04:24:44.822700    2563 feature_gate.go:328] unrecognized feature gate: Example2
Jul 22 04:24:45.194942 ip-10-0-141-238 kubenswrapper[2563]: W0722 04:24:44.822703    2563 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 22 04:24:45.194942 ip-10-0-141-238 kubenswrapper[2563]: W0722 04:24:44.822706    2563 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 22 04:24:45.194942 ip-10-0-141-238 kubenswrapper[2563]: W0722 04:24:44.822708    2563 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 22 04:24:45.194942 ip-10-0-141-238 kubenswrapper[2563]: W0722 04:24:44.822713    2563 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 22 04:24:45.194942 ip-10-0-141-238 kubenswrapper[2563]: W0722 04:24:44.822716    2563 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 22 04:24:45.194942 ip-10-0-141-238 kubenswrapper[2563]: W0722 04:24:44.822719    2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 22 04:24:45.194942 ip-10-0-141-238 kubenswrapper[2563]: W0722 04:24:44.822726    2563 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 22 04:24:45.194942 ip-10-0-141-238 kubenswrapper[2563]: W0722 04:24:44.822729    2563 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 22 04:24:45.194942 ip-10-0-141-238 kubenswrapper[2563]: W0722 04:24:44.822732    2563 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 22 04:24:45.194942 ip-10-0-141-238 kubenswrapper[2563]: W0722 04:24:44.822735    2563 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 22 04:24:45.194942 ip-10-0-141-238 kubenswrapper[2563]: W0722 04:24:44.822737    2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 22 04:24:45.194942 ip-10-0-141-238 kubenswrapper[2563]: W0722 04:24:44.822740    2563 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 22 04:24:45.195939 ip-10-0-141-238 kubenswrapper[2563]: W0722 04:24:44.822743    2563 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 22 04:24:45.195939 ip-10-0-141-238 kubenswrapper[2563]: W0722 04:24:44.822746    2563 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 22 04:24:45.195939 ip-10-0-141-238 kubenswrapper[2563]: W0722 04:24:44.822749    2563 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 22 04:24:45.195939 ip-10-0-141-238 kubenswrapper[2563]: W0722 04:24:44.822751    2563 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 22 04:24:45.195939 ip-10-0-141-238 kubenswrapper[2563]: W0722 04:24:44.822754    2563 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 22 04:24:45.195939 ip-10-0-141-238 kubenswrapper[2563]: W0722 04:24:44.822756    2563 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 22 04:24:45.195939 ip-10-0-141-238 kubenswrapper[2563]: W0722 04:24:44.822759    2563 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 22 04:24:45.195939 ip-10-0-141-238 kubenswrapper[2563]: W0722 04:24:44.822762    2563 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 22 04:24:45.195939 ip-10-0-141-238 kubenswrapper[2563]: W0722 04:24:44.822765    2563 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 22 04:24:45.195939 ip-10-0-141-238 kubenswrapper[2563]: W0722 04:24:44.822768    2563 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 22 04:24:45.195939 ip-10-0-141-238 kubenswrapper[2563]: W0722 04:24:44.822770    2563 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 22 04:24:45.195939 ip-10-0-141-238 kubenswrapper[2563]: W0722 04:24:44.822773    2563 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 22 04:24:45.195939 ip-10-0-141-238 kubenswrapper[2563]: W0722 04:24:44.822775    2563 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 22 04:24:45.195939 ip-10-0-141-238 kubenswrapper[2563]: W0722 04:24:44.822778    2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 22 04:24:45.195939 ip-10-0-141-238 kubenswrapper[2563]: W0722 04:24:44.822781    2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 22 04:24:45.195939 ip-10-0-141-238 kubenswrapper[2563]: W0722 04:24:44.822783    2563 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 22 04:24:45.195939 ip-10-0-141-238 kubenswrapper[2563]: W0722 04:24:44.822786    2563 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 22 04:24:45.195939 ip-10-0-141-238 kubenswrapper[2563]: W0722 04:24:44.822788    2563 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 22 04:24:45.195939 ip-10-0-141-238 kubenswrapper[2563]: W0722 04:24:44.822791    2563 feature_gate.go:328] unrecognized feature gate: Example
Jul 22 04:24:45.195939 ip-10-0-141-238 kubenswrapper[2563]: W0722 04:24:44.822793    2563 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 22 04:24:45.196536 ip-10-0-141-238 kubenswrapper[2563]: W0722 04:24:44.822796    2563 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 22 04:24:45.196536 ip-10-0-141-238 kubenswrapper[2563]: W0722 04:24:44.822798    2563 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 22 04:24:45.196536 ip-10-0-141-238 kubenswrapper[2563]: W0722 04:24:44.822801    2563 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 22 04:24:45.196536 ip-10-0-141-238 kubenswrapper[2563]: W0722 04:24:44.822804    2563 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 22 04:24:45.196536 ip-10-0-141-238 kubenswrapper[2563]: W0722 04:24:44.822806    2563 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 22 04:24:45.196536 ip-10-0-141-238 kubenswrapper[2563]: W0722 04:24:44.822808    2563 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 22 04:24:45.196536 ip-10-0-141-238 kubenswrapper[2563]: W0722 04:24:44.822813    2563 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 22 04:24:45.196536 ip-10-0-141-238 kubenswrapper[2563]: W0722 04:24:44.822816    2563 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 22 04:24:45.196536 ip-10-0-141-238 kubenswrapper[2563]: W0722 04:24:44.822819    2563 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 22 04:24:45.196536 ip-10-0-141-238 kubenswrapper[2563]: W0722 04:24:44.822821    2563 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 22 04:24:45.196536 ip-10-0-141-238 kubenswrapper[2563]: W0722 04:24:44.822824    2563 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 22 04:24:45.196536 ip-10-0-141-238 kubenswrapper[2563]: W0722 04:24:44.822827    2563 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 22 04:24:45.196536 ip-10-0-141-238 kubenswrapper[2563]: W0722 04:24:44.822829    2563 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 22 04:24:45.196536 ip-10-0-141-238 kubenswrapper[2563]: W0722 04:24:44.822832    2563 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 22 04:24:45.196536 ip-10-0-141-238 kubenswrapper[2563]: W0722 04:24:44.822834    2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 22 04:24:45.196536 ip-10-0-141-238 kubenswrapper[2563]: W0722 04:24:44.822837    2563 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 22 04:24:45.196536 ip-10-0-141-238 kubenswrapper[2563]: W0722 04:24:44.822840    2563 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 22 04:24:45.196536 ip-10-0-141-238 kubenswrapper[2563]: W0722 04:24:44.822843    2563 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 22 04:24:45.196536 ip-10-0-141-238 kubenswrapper[2563]: W0722 04:24:44.822846    2563 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 22 04:24:45.196536 ip-10-0-141-238 kubenswrapper[2563]: W0722 04:24:44.822848    2563 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 22 04:24:45.197130 ip-10-0-141-238 kubenswrapper[2563]: W0722 04:24:44.822851    2563 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 22 04:24:45.197130 ip-10-0-141-238 kubenswrapper[2563]: W0722 04:24:44.822853    2563 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 22 04:24:45.197130 ip-10-0-141-238 kubenswrapper[2563]: W0722 04:24:44.822856    2563 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 22 04:24:45.197130 ip-10-0-141-238 kubenswrapper[2563]: W0722 04:24:44.822858    2563 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 22 04:24:45.197130 ip-10-0-141-238 kubenswrapper[2563]: W0722 04:24:44.822861    2563 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 22 04:24:45.197130 ip-10-0-141-238 kubenswrapper[2563]: W0722 04:24:44.822863    2563 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 22 04:24:45.197130 ip-10-0-141-238 kubenswrapper[2563]: W0722 04:24:44.822866    2563 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 22 04:24:45.197130 ip-10-0-141-238 kubenswrapper[2563]: W0722 04:24:44.822868    2563 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 22 04:24:45.197130 ip-10-0-141-238 kubenswrapper[2563]: W0722 04:24:44.822870    2563 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 22 04:24:45.197130 ip-10-0-141-238 kubenswrapper[2563]: W0722 04:24:44.822874    2563 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 22 04:24:45.197130 ip-10-0-141-238 kubenswrapper[2563]: W0722 04:24:44.822878    2563 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 22 04:24:45.197130 ip-10-0-141-238 kubenswrapper[2563]: W0722 04:24:44.822882    2563 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 22 04:24:45.197130 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:24:44.822888    2563 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 22 04:24:45.197130 ip-10-0-141-238 kubenswrapper[2563]: W0722 04:24:44.823001    2563 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 22 04:24:45.197637 ip-10-0-141-238 kubenswrapper[2563]: W0722 04:24:44.823006    2563 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 22 04:24:45.197637 ip-10-0-141-238 kubenswrapper[2563]: W0722 04:24:44.823009    2563 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 22 04:24:45.197637 ip-10-0-141-238 kubenswrapper[2563]: W0722 04:24:44.823012    2563 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 22 04:24:45.197637 ip-10-0-141-238 kubenswrapper[2563]: W0722 04:24:44.823015    2563 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 22 04:24:45.197637 ip-10-0-141-238 kubenswrapper[2563]: W0722 04:24:44.823019    2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 22 04:24:45.197637 ip-10-0-141-238 kubenswrapper[2563]: W0722 04:24:44.823022    2563 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 22 04:24:45.197637 ip-10-0-141-238 kubenswrapper[2563]: W0722 04:24:44.823025    2563 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 22 04:24:45.197637 ip-10-0-141-238 kubenswrapper[2563]: W0722 04:24:44.823028    2563 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 22 04:24:45.197637 ip-10-0-141-238 kubenswrapper[2563]: W0722 04:24:44.823030    2563 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 22 04:24:45.197637 ip-10-0-141-238 kubenswrapper[2563]: W0722 04:24:44.823033    2563 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 22 04:24:45.197637 ip-10-0-141-238 kubenswrapper[2563]: W0722 04:24:44.823051    2563 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 22 04:24:45.197637 ip-10-0-141-238 kubenswrapper[2563]: W0722 04:24:44.823058    2563 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 22 04:24:45.197637 ip-10-0-141-238 kubenswrapper[2563]: W0722 04:24:44.823061    2563 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 22 04:24:45.197637 ip-10-0-141-238 kubenswrapper[2563]: W0722 04:24:44.823064    2563 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 22 04:24:45.197637 ip-10-0-141-238 kubenswrapper[2563]: W0722 04:24:44.823066    2563 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 22 04:24:45.197637 ip-10-0-141-238 kubenswrapper[2563]: W0722 04:24:44.823069    2563 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 22 04:24:45.197637 ip-10-0-141-238 kubenswrapper[2563]: W0722 04:24:44.823071    2563 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 22 04:24:45.197637 ip-10-0-141-238 kubenswrapper[2563]: W0722 04:24:44.823074    2563 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 22 04:24:45.197637 ip-10-0-141-238 kubenswrapper[2563]: W0722 04:24:44.823076    2563 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 22 04:24:45.198240 ip-10-0-141-238 kubenswrapper[2563]: W0722 04:24:44.823080    2563 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 22 04:24:45.198240 ip-10-0-141-238 kubenswrapper[2563]: W0722 04:24:44.823084    2563 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 22 04:24:45.198240 ip-10-0-141-238 kubenswrapper[2563]: W0722 04:24:44.823087    2563 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 22 04:24:45.198240 ip-10-0-141-238 kubenswrapper[2563]: W0722 04:24:44.823090    2563 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 22 04:24:45.198240 ip-10-0-141-238 kubenswrapper[2563]: W0722 04:24:44.823093    2563 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 22 04:24:45.198240 ip-10-0-141-238 kubenswrapper[2563]: W0722 04:24:44.823096    2563 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 22 04:24:45.198240 ip-10-0-141-238 kubenswrapper[2563]: W0722 04:24:44.823099    2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 22 04:24:45.198240 ip-10-0-141-238 kubenswrapper[2563]: W0722 04:24:44.823101    2563 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 22 04:24:45.198240 ip-10-0-141-238 kubenswrapper[2563]: W0722 04:24:44.823104    2563 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 22 04:24:45.198240 ip-10-0-141-238 kubenswrapper[2563]: W0722 04:24:44.823106    2563 feature_gate.go:328] unrecognized feature gate: Example2
Jul 22 04:24:45.198240 ip-10-0-141-238 kubenswrapper[2563]: W0722 04:24:44.823109    2563 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 22 04:24:45.198240 ip-10-0-141-238 kubenswrapper[2563]: W0722 04:24:44.823111    2563 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 22 04:24:45.198240 ip-10-0-141-238 kubenswrapper[2563]: W0722 04:24:44.823114    2563 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 22 04:24:45.198240 ip-10-0-141-238 kubenswrapper[2563]: W0722 04:24:44.823117    2563 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 22 04:24:45.198240 ip-10-0-141-238 kubenswrapper[2563]: W0722 04:24:44.823119    2563 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 22 04:24:45.198240 ip-10-0-141-238 kubenswrapper[2563]: W0722 04:24:44.823122    2563 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 22 04:24:45.198240 ip-10-0-141-238 kubenswrapper[2563]: W0722 04:24:44.823124    2563 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 22 04:24:45.198240 ip-10-0-141-238 kubenswrapper[2563]: W0722 04:24:44.823128    2563 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 22 04:24:45.198240 ip-10-0-141-238 kubenswrapper[2563]: W0722 04:24:44.823132    2563 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 22 04:24:45.198782 ip-10-0-141-238 kubenswrapper[2563]: W0722 04:24:44.823135    2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 22 04:24:45.198782 ip-10-0-141-238 kubenswrapper[2563]: W0722 04:24:44.823138    2563 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 22 04:24:45.198782 ip-10-0-141-238 kubenswrapper[2563]: W0722 04:24:44.823140    2563 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 22 04:24:45.198782 ip-10-0-141-238 kubenswrapper[2563]: W0722 04:24:44.823143    2563 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 22 04:24:45.198782 ip-10-0-141-238 kubenswrapper[2563]: W0722 04:24:44.823145    2563 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 22 04:24:45.198782 ip-10-0-141-238 kubenswrapper[2563]: W0722 04:24:44.823148    2563 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 22 04:24:45.198782 ip-10-0-141-238 kubenswrapper[2563]: W0722 04:24:44.823151    2563 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 22 04:24:45.198782 ip-10-0-141-238 kubenswrapper[2563]: W0722 04:24:44.823154    2563 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 22 04:24:45.198782 ip-10-0-141-238 kubenswrapper[2563]: W0722 04:24:44.823156    2563 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 22 04:24:45.198782 ip-10-0-141-238 kubenswrapper[2563]: W0722 04:24:44.823160    2563 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 22 04:24:45.198782 ip-10-0-141-238 kubenswrapper[2563]: W0722 04:24:44.823163    2563 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 22 04:24:45.198782 ip-10-0-141-238 kubenswrapper[2563]: W0722 04:24:44.823166    2563 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 22 04:24:45.198782 ip-10-0-141-238 kubenswrapper[2563]: W0722 04:24:44.823169    2563 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 22 04:24:45.198782 ip-10-0-141-238 kubenswrapper[2563]: W0722 04:24:44.823172    2563 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 22 04:24:45.198782 ip-10-0-141-238 kubenswrapper[2563]: W0722 04:24:44.823175    2563 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 22 04:24:45.198782 ip-10-0-141-238 kubenswrapper[2563]: W0722 04:24:44.823177    2563 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 22 04:24:45.198782 ip-10-0-141-238 kubenswrapper[2563]: W0722 04:24:44.823180    2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 22 04:24:45.198782 ip-10-0-141-238 kubenswrapper[2563]: W0722 04:24:44.823182    2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 22 04:24:45.198782 ip-10-0-141-238 kubenswrapper[2563]: W0722 04:24:44.823185    2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 22 04:24:45.394081 ip-10-0-141-238 kubenswrapper[2563]: W0722 04:24:44.823187    2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 22 04:24:45.394081 ip-10-0-141-238 kubenswrapper[2563]: W0722 04:24:44.823189    2563 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 22 04:24:45.394081 ip-10-0-141-238 kubenswrapper[2563]: W0722 04:24:44.823192    2563 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 22 04:24:45.394081 ip-10-0-141-238 kubenswrapper[2563]: W0722 04:24:44.823194    2563 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 22 04:24:45.394081 ip-10-0-141-238 kubenswrapper[2563]: W0722 04:24:44.823197    2563 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 22 04:24:45.394081 ip-10-0-141-238 kubenswrapper[2563]: W0722 04:24:44.823199    2563 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 22 04:24:45.394081 ip-10-0-141-238 kubenswrapper[2563]: W0722 04:24:44.823202    2563 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 22 04:24:45.394081 ip-10-0-141-238 kubenswrapper[2563]: W0722 04:24:44.823204    2563 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 22 04:24:45.394081 ip-10-0-141-238 kubenswrapper[2563]: W0722 04:24:44.823207    2563 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 22 04:24:45.394081 ip-10-0-141-238 kubenswrapper[2563]: W0722 04:24:44.823209    2563 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 22 04:24:45.394081 ip-10-0-141-238 kubenswrapper[2563]: W0722 04:24:44.823212    2563 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 22 04:24:45.394081 ip-10-0-141-238 kubenswrapper[2563]: W0722 04:24:44.823216    2563 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 22 04:24:45.394081 ip-10-0-141-238 kubenswrapper[2563]: W0722 04:24:44.823219    2563 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 22 04:24:45.394081 ip-10-0-141-238 kubenswrapper[2563]: W0722 04:24:44.823222    2563 feature_gate.go:328] unrecognized feature gate: Example
Jul 22 04:24:45.394081 ip-10-0-141-238 kubenswrapper[2563]: W0722 04:24:44.823224    2563 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 22 04:24:45.394081 ip-10-0-141-238 kubenswrapper[2563]: W0722 04:24:44.823227    2563 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 22 04:24:45.394081 ip-10-0-141-238 kubenswrapper[2563]: W0722 04:24:44.823229    2563 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 22 04:24:45.394081 ip-10-0-141-238 kubenswrapper[2563]: W0722 04:24:44.823232    2563 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 22 04:24:45.394081 ip-10-0-141-238 kubenswrapper[2563]: W0722 04:24:44.823235    2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 22 04:24:45.394081 ip-10-0-141-238 kubenswrapper[2563]: W0722 04:24:44.823237    2563 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 22 04:24:45.395104 ip-10-0-141-238 kubenswrapper[2563]: W0722 04:24:44.823240    2563 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 22 04:24:45.395104 ip-10-0-141-238 kubenswrapper[2563]: W0722 04:24:44.823243    2563 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 22 04:24:45.395104 ip-10-0-141-238 kubenswrapper[2563]: W0722 04:24:44.823245    2563 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 22 04:24:45.395104 ip-10-0-141-238 kubenswrapper[2563]: W0722 04:24:44.823248    2563 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 22 04:24:45.395104 ip-10-0-141-238 kubenswrapper[2563]: W0722 04:24:44.823250    2563 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 22 04:24:45.395104 ip-10-0-141-238 kubenswrapper[2563]: W0722 04:24:44.823253    2563 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 22 04:24:45.395104 ip-10-0-141-238 kubenswrapper[2563]: W0722 04:24:44.823255    2563 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 22 04:24:45.395104 ip-10-0-141-238 kubenswrapper[2563]: W0722 04:24:44.823258    2563 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 22 04:24:45.395104 ip-10-0-141-238 kubenswrapper[2563]: W0722 04:24:44.823260    2563 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 22 04:24:45.395104 ip-10-0-141-238 kubenswrapper[2563]: W0722 04:24:44.823263    2563 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 22 04:24:45.395104 ip-10-0-141-238 kubenswrapper[2563]: W0722 04:24:44.823265    2563 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 22 04:24:45.395104 ip-10-0-141-238 kubenswrapper[2563]: W0722 04:24:44.823268    2563 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 22 04:24:45.395104 ip-10-0-141-238 kubenswrapper[2563]: W0722 04:24:44.823270    2563 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 22 04:24:45.395104 ip-10-0-141-238 kubenswrapper[2563]: W0722 04:24:44.823272    2563 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 22 04:24:45.395104 ip-10-0-141-238 kubenswrapper[2563]: W0722 04:24:44.823275    2563 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 22 04:24:45.395104 ip-10-0-141-238 kubenswrapper[2563]: W0722 04:24:44.823277    2563 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 22 04:24:45.395104 ip-10-0-141-238 kubenswrapper[2563]: W0722 04:24:44.823281    2563 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 22 04:24:45.395104 ip-10-0-141-238 kubenswrapper[2563]: W0722 04:24:44.823284    2563 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 22 04:24:45.395104 ip-10-0-141-238 kubenswrapper[2563]: W0722 04:24:44.823287    2563 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 22 04:24:45.395104 ip-10-0-141-238 kubenswrapper[2563]: W0722 04:24:44.823289    2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 22 04:24:45.396793 ip-10-0-141-238 kubenswrapper[2563]: W0722 04:24:44.823292    2563 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 22 04:24:45.396793 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:24:44.823296    2563 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 22 04:24:45.396793 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:24:44.823412    2563 server.go:962] "Client rotation is on, will bootstrap in background"
Jul 22 04:24:45.396793 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:24:44.825238    2563 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir"
Jul 22 04:24:45.396793 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:24:44.826261    2563 server.go:1019] "Starting client certificate rotation"
Jul 22 04:24:45.396793 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:24:44.826366    2563 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet"
Jul 22 04:24:45.396793 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:24:44.826404    2563 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet"
Jul 22 04:24:45.396793 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:24:44.828553    2563 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Jul 22 04:24:45.396793 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:24:44.829663    2563 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Jul 22 04:24:45.396793 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:24:44.837579    2563 log.go:25] "Validated CRI v1 runtime API"
Jul 22 04:24:45.396793 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:24:44.839309    2563 log.go:25] "Validated CRI v1 image API"
Jul 22 04:24:45.396793 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:24:44.843145    2563 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd"
Jul 22 04:24:45.397446 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:24:44.845375    2563 fs.go:135] Filesystem UUIDs: map[1d420fea-3aef-420f-be8e-f4bac45e3f1e:/dev/nvme0n1p4 681093f6-de68-4645-9637-3d2da2e81f7e:/dev/nvme0n1p3 7B77-95E7:/dev/nvme0n1p2]
Jul 22 04:24:45.397446 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:24:44.845390    2563 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}]
Jul 22 04:24:45.398694 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:24:44.850960    2563 manager.go:216] Machine: {Timestamp:2026-07-22 04:24:44.849838307 +0000 UTC m=+0.268847054 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3103096 MemoryCapacity:33164492800 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec2d2cee6d7a68bfe1e2674794635157 SystemUUID:ec2d2cee-6d7a-68bf-e1e2-674794635157 BootID:8bda34d7-2441-462e-9348-d1472fa92be9 Filesystems:[{Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582246400 Type:vfs Inodes:4048400 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632898560 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6111232 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582246400 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:e5:ac:cb:59:ef Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:e5:ac:cb:59:ef Speed:0 Mtu:9001} {Name:ovs-system MacAddress:f6:bc:ff:0b:6b:f1 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164492800 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None}
Jul 22 04:24:45.398694 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:24:44.851868    2563 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available.
Jul 22 04:24:45.398694 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:24:44.851947    2563 manager.go:232] Version: {KernelVersion:5.14.0-570.128.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260715-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:}
Jul 22 04:24:45.398694 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:24:44.854389    2563 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[]
Jul 22 04:24:45.398694 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:24:44.854421    2563 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-141-238.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2}
Jul 22 04:24:45.398694 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:24:44.855121    2563 topology_manager.go:138] "Creating topology manager with none policy"
Jul 22 04:24:45.398694 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:24:44.855131    2563 container_manager_linux.go:309] "Creating device plugin manager"
Jul 22 04:24:45.398694 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:24:44.855157    2563 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock"
Jul 22 04:24:45.398694 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:24:44.855173    2563 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock"
Jul 22 04:24:45.398694 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:24:44.856317    2563 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager"
Jul 22 04:24:45.398694 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:24:44.857743    2563 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Jul 22 04:24:45.398694 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:24:44.859922    2563 state_mem.go:36] "Initialized new in-memory state store"
Jul 22 04:24:45.398694 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:24:44.860059    2563 server.go:1240] "Using root directory" path="/var/lib/kubelet"
Jul 22 04:24:45.398694 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:24:44.860085    2563 kubelet.go:486] "Attempting to sync node with API server"
Jul 22 04:24:45.398694 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:24:44.860095    2563 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests"
Jul 22 04:24:45.398694 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:24:44.860118    2563 file.go:69] "Watching path" path="/etc/kubernetes/manifests"
Jul 22 04:24:45.398694 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:24:44.860137    2563 kubelet.go:398] "Adding apiserver pod source"
Jul 22 04:24:45.399552 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:24:44.860154    2563 apiserver.go:42] "Waiting for node sync before watching apiserver pods"
Jul 22 04:24:45.399552 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:24:44.860528    2563 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Jul 22 04:24:45.399552 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:24:44.860546    2563 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Jul 22 04:24:45.399552 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:24:44.862684    2563 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.10-2.rhaos4.21.git83ee25b.el9" apiVersion="v1"
Jul 22 04:24:45.399552 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:24:44.864714    2563 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled"
Jul 22 04:24:45.399552 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:24:44.864743    2563 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled"
Jul 22 04:24:45.399552 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:24:44.865681    2563 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume"
Jul 22 04:24:45.399552 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:24:44.865694    2563 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir"
Jul 22 04:24:45.399552 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:24:44.865701    2563 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo"
Jul 22 04:24:45.399552 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:24:44.865706    2563 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path"
Jul 22 04:24:45.399552 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:24:44.865718    2563 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs"
Jul 22 04:24:45.399552 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:24:44.865763    2563 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret"
Jul 22 04:24:45.399552 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:24:44.865774    2563 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi"
Jul 22 04:24:45.399552 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:24:44.865779    2563 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api"
Jul 22 04:24:45.399552 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:24:44.865786    2563 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc"
Jul 22 04:24:45.399552 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:24:44.865791    2563 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap"
Jul 22 04:24:45.399552 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:24:44.865800    2563 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected"
Jul 22 04:24:45.399552 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:24:44.865831    2563 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume"
Jul 22 04:24:45.399552 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:24:44.866377    2563 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi"
Jul 22 04:24:45.399552 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:24:44.866385    2563 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image"
Jul 22 04:24:45.399552 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:24:44.869484    2563 server.go:1268] "Started kubelet"
Jul 22 04:24:45.399552 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:24:44.869569    2563 server.go:180] "Starting to listen" address="0.0.0.0" port=10250
Jul 22 04:24:45.399552 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:24:44.869630    2563 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10
Jul 22 04:24:45.399552 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:24:44.869711    2563 server_v1.go:49] "podresources" method="list" useActivePods=true
Jul 22 04:24:45.399552 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:24:44.871360    2563 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock"
Jul 22 04:24:45.399552 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:24:44.871867    2563 server.go:310] "Adding debug handlers to kubelet server"
Jul 22 04:24:45.399552 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:24:44.872222    2563 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-141-238.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope
Jul 22 04:24:45.399552 ip-10-0-141-238 kubenswrapper[2563]: E0722 04:24:44.872726    2563 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service"
Jul 22 04:24:45.399552 ip-10-0-141-238 kubenswrapper[2563]: E0722 04:24:44.872726    2563 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-141-238.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node"
Jul 22 04:24:45.399552 ip-10-0-141-238 kubenswrapper[2563]: E0722 04:24:44.875317    2563 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache"
Jul 22 04:24:45.399552 ip-10-0-141-238 kubenswrapper[2563]: E0722 04:24:44.875298    2563 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-141-238.ec2.internal.18c481ff12504ada  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-141-238.ec2.internal,UID:ip-10-0-141-238.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-141-238.ec2.internal,},FirstTimestamp:2026-07-22 04:24:44.869454554 +0000 UTC m=+0.288463303,LastTimestamp:2026-07-22 04:24:44.869454554 +0000 UTC m=+0.288463303,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-141-238.ec2.internal,}"
Jul 22 04:24:45.399552 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:24:44.876484    2563 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer"
Jul 22 04:24:45.399552 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:24:44.876545    2563 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving"
Jul 22 04:24:45.399552 ip-10-0-141-238 kubenswrapper[2563]: E0722 04:24:44.876567    2563 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-238.ec2.internal\" not found"
Jul 22 04:24:45.399552 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:24:44.877064    2563 desired_state_of_world_populator.go:146] "Desired state populator starts to run"
Jul 22 04:24:45.399552 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:24:44.877113    2563 volume_manager.go:311] "The desired_state_of_world populator starts"
Jul 22 04:24:45.399552 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:24:44.877147    2563 volume_manager.go:313] "Starting Kubelet Volume Manager"
Jul 22 04:24:45.399552 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:24:44.877222    2563 reconstruct.go:97] "Volume reconstruction finished"
Jul 22 04:24:45.399552 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:24:44.877232    2563 reconciler.go:29] "Reconciler: start to sync state"
Jul 22 04:24:45.399552 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:24:44.877326    2563 factory.go:55] Registering systemd factory
Jul 22 04:24:45.399552 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:24:44.877339    2563 factory.go:223] Registration of the systemd container factory successfully
Jul 22 04:24:45.401251 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:24:44.877528    2563 factory.go:153] Registering CRI-O factory
Jul 22 04:24:45.401251 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:24:44.877541    2563 factory.go:223] Registration of the crio container factory successfully
Jul 22 04:24:45.401251 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:24:44.877583    2563 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory
Jul 22 04:24:45.401251 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:24:44.877605    2563 factory.go:103] Registering Raw factory
Jul 22 04:24:45.401251 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:24:44.877620    2563 manager.go:1196] Started watching for new ooms in manager
Jul 22 04:24:45.401251 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:24:44.878021    2563 manager.go:349] Starting recovery of all containers
Jul 22 04:24:45.401251 ip-10-0-141-238 kubenswrapper[2563]: E0722 04:24:44.881738    2563 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-141-238.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms"
Jul 22 04:24:45.401251 ip-10-0-141-238 kubenswrapper[2563]: E0722 04:24:44.881781    2563 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver"
Jul 22 04:24:45.401251 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:24:44.884788    2563 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-4sqck"
Jul 22 04:24:45.401251 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:24:44.889944    2563 manager.go:354] Recovery completed
Jul 22 04:24:45.401251 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:24:44.895235    2563 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-4sqck"
Jul 22 04:24:45.401251 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:24:44.895292    2563 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 22 04:24:45.401251 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:24:44.896970    2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-238.ec2.internal" event="NodeHasSufficientMemory"
Jul 22 04:24:45.401251 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:24:44.897014    2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-238.ec2.internal" event="NodeHasNoDiskPressure"
Jul 22 04:24:45.401251 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:24:44.897028    2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-238.ec2.internal" event="NodeHasSufficientPID"
Jul 22 04:24:45.401251 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:24:44.897530    2563 cpu_manager.go:222] "Starting CPU manager" policy="none"
Jul 22 04:24:45.401251 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:24:44.897538    2563 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 22 04:24:45.401251 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:24:44.897539    2563 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s"
Jul 22 04:24:45.401251 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:24:44.897570    2563 state_mem.go:36] "Initialized new in-memory state store"
Jul 22 04:24:45.401251 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:24:44.898190    2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-238.ec2.internal" event="NodeHasSufficientMemory"
Jul 22 04:24:45.401251 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:24:44.898217    2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-238.ec2.internal" event="NodeHasNoDiskPressure"
Jul 22 04:24:45.401251 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:24:44.898228    2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-238.ec2.internal" event="NodeHasSufficientPID"
Jul 22 04:24:45.401251 ip-10-0-141-238 kubenswrapper[2563]: E0722 04:24:44.899230    2563 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-141-238.ec2.internal.18c481ff13f494b2  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-141-238.ec2.internal,UID:ip-10-0-141-238.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-141-238.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-141-238.ec2.internal,},FirstTimestamp:2026-07-22 04:24:44.896998578 +0000 UTC m=+0.316007327,LastTimestamp:2026-07-22 04:24:44.896998578 +0000 UTC m=+0.316007327,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-141-238.ec2.internal,}"
Jul 22 04:24:45.401251 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:24:44.901019    2563 policy_none.go:49] "None policy: Start"
Jul 22 04:24:45.401251 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:24:44.901368    2563 memory_manager.go:187] "Starting memorymanager" policy="None"
Jul 22 04:24:45.401251 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:24:44.901386    2563 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint"
Jul 22 04:24:45.401251 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:24:44.904412    2563 policy_none.go:47] "Start"
Jul 22 04:24:45.401251 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:24:44.947586    2563 manager.go:337] "Starting Device Plugin manager"
Jul 22 04:24:45.401251 ip-10-0-141-238 kubenswrapper[2563]: E0722 04:24:44.947712    2563 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint"
Jul 22 04:24:45.401251 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:24:44.947726    2563 server.go:87] "Starting device plugin registration server"
Jul 22 04:24:45.401251 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:24:44.947930    2563 eviction_manager.go:189] "Eviction manager: starting control loop"
Jul 22 04:24:45.401251 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:24:44.947939    2563 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s"
Jul 22 04:24:45.401251 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:24:44.948061    2563 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry"
Jul 22 04:24:45.401251 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:24:44.948121    2563 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts"
Jul 22 04:24:45.401251 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:24:44.948127    2563 plugin_manager.go:118] "Starting Kubelet Plugin Manager"
Jul 22 04:24:45.401251 ip-10-0-141-238 kubenswrapper[2563]: E0722 04:24:44.948542    2563 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\""
Jul 22 04:24:45.401251 ip-10-0-141-238 kubenswrapper[2563]: E0722 04:24:44.948584    2563 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-141-238.ec2.internal\" not found"
Jul 22 04:24:45.401251 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:24:45.048424    2563 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 22 04:24:45.401251 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:24:45.049283    2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-238.ec2.internal" event="NodeHasSufficientMemory"
Jul 22 04:24:45.402970 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:24:45.049309    2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-238.ec2.internal" event="NodeHasNoDiskPressure"
Jul 22 04:24:45.402970 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:24:45.049319    2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-238.ec2.internal" event="NodeHasSufficientPID"
Jul 22 04:24:45.402970 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:24:45.049344    2563 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-141-238.ec2.internal"
Jul 22 04:24:45.402970 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:24:45.057137    2563 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-141-238.ec2.internal"
Jul 22 04:24:45.402970 ip-10-0-141-238 kubenswrapper[2563]: E0722 04:24:45.057156    2563 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-141-238.ec2.internal\": node \"ip-10-0-141-238.ec2.internal\" not found"
Jul 22 04:24:45.402970 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:24:45.057901    2563 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4"
Jul 22 04:24:45.402970 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:24:45.059075    2563 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6"
Jul 22 04:24:45.402970 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:24:45.059107    2563 status_manager.go:244] "Starting to sync pod status with apiserver"
Jul 22 04:24:45.402970 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:24:45.059125    2563 kubelet.go:2448] "Starting kubelet main sync loop"
Jul 22 04:24:45.402970 ip-10-0-141-238 kubenswrapper[2563]: E0722 04:24:45.059154    2563 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful"
Jul 22 04:24:45.402970 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:24:45.061340    2563 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 22 04:24:45.402970 ip-10-0-141-238 kubenswrapper[2563]: E0722 04:24:45.088785    2563 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-238.ec2.internal\" not found"
Jul 22 04:24:45.402970 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:24:45.159329    2563 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["kube-system/kube-apiserver-proxy-ip-10-0-141-238.ec2.internal","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-238.ec2.internal"]
Jul 22 04:24:45.402970 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:24:45.159407    2563 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 22 04:24:45.402970 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:24:45.160824    2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-238.ec2.internal" event="NodeHasSufficientMemory"
Jul 22 04:24:45.402970 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:24:45.160850    2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-238.ec2.internal" event="NodeHasNoDiskPressure"
Jul 22 04:24:45.402970 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:24:45.160860    2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-238.ec2.internal" event="NodeHasSufficientPID"
Jul 22 04:24:45.402970 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:24:45.163098    2563 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 22 04:24:45.402970 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:24:45.163206    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-141-238.ec2.internal"
Jul 22 04:24:45.402970 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:24:45.163230    2563 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 22 04:24:45.402970 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:24:45.163749    2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-238.ec2.internal" event="NodeHasSufficientMemory"
Jul 22 04:24:45.402970 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:24:45.163775    2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-238.ec2.internal" event="NodeHasNoDiskPressure"
Jul 22 04:24:45.402970 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:24:45.163784    2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-238.ec2.internal" event="NodeHasSufficientPID"
Jul 22 04:24:45.402970 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:24:45.164206    2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-238.ec2.internal" event="NodeHasSufficientMemory"
Jul 22 04:24:45.402970 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:24:45.164229    2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-238.ec2.internal" event="NodeHasNoDiskPressure"
Jul 22 04:24:45.402970 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:24:45.164241    2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-238.ec2.internal" event="NodeHasSufficientPID"
Jul 22 04:24:45.402970 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:24:45.166283    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-238.ec2.internal"
Jul 22 04:24:45.402970 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:24:45.166313    2563 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 22 04:24:45.402970 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:24:45.167750    2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-238.ec2.internal" event="NodeHasSufficientMemory"
Jul 22 04:24:45.402970 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:24:45.167774    2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-238.ec2.internal" event="NodeHasNoDiskPressure"
Jul 22 04:24:45.402970 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:24:45.167786    2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-238.ec2.internal" event="NodeHasSufficientPID"
Jul 22 04:24:45.402970 ip-10-0-141-238 kubenswrapper[2563]: E0722 04:24:45.189511    2563 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-238.ec2.internal\" not found"
Jul 22 04:24:45.402970 ip-10-0-141-238 kubenswrapper[2563]: E0722 04:24:45.202741    2563 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-141-238.ec2.internal\" not found" node="ip-10-0-141-238.ec2.internal"
Jul 22 04:24:45.402970 ip-10-0-141-238 kubenswrapper[2563]: E0722 04:24:45.208760    2563 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-141-238.ec2.internal\" not found" node="ip-10-0-141-238.ec2.internal"
Jul 22 04:24:45.402970 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:24:45.278638    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/6eb34c1251007ab488f516cf74fa28ca-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-141-238.ec2.internal\" (UID: \"6eb34c1251007ab488f516cf74fa28ca\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-238.ec2.internal"
Jul 22 04:24:45.402970 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:24:45.278661    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/6eb34c1251007ab488f516cf74fa28ca-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-141-238.ec2.internal\" (UID: \"6eb34c1251007ab488f516cf74fa28ca\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-238.ec2.internal"
Jul 22 04:24:45.404464 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:24:45.278678    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/7cbc186c127cef111ab8584862a4a734-config\") pod \"kube-apiserver-proxy-ip-10-0-141-238.ec2.internal\" (UID: \"7cbc186c127cef111ab8584862a4a734\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-141-238.ec2.internal"
Jul 22 04:24:45.404464 ip-10-0-141-238 kubenswrapper[2563]: E0722 04:24:45.289726    2563 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-238.ec2.internal\" not found"
Jul 22 04:24:45.404464 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:24:45.379479    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/7cbc186c127cef111ab8584862a4a734-config\") pod \"kube-apiserver-proxy-ip-10-0-141-238.ec2.internal\" (UID: \"7cbc186c127cef111ab8584862a4a734\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-141-238.ec2.internal"
Jul 22 04:24:45.404464 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:24:45.379511    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/6eb34c1251007ab488f516cf74fa28ca-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-141-238.ec2.internal\" (UID: \"6eb34c1251007ab488f516cf74fa28ca\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-238.ec2.internal"
Jul 22 04:24:45.404464 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:24:45.379528    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/6eb34c1251007ab488f516cf74fa28ca-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-141-238.ec2.internal\" (UID: \"6eb34c1251007ab488f516cf74fa28ca\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-238.ec2.internal"
Jul 22 04:24:45.404464 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:24:45.379574    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/6eb34c1251007ab488f516cf74fa28ca-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-141-238.ec2.internal\" (UID: \"6eb34c1251007ab488f516cf74fa28ca\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-238.ec2.internal"
Jul 22 04:24:45.404464 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:24:45.379581    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/7cbc186c127cef111ab8584862a4a734-config\") pod \"kube-apiserver-proxy-ip-10-0-141-238.ec2.internal\" (UID: \"7cbc186c127cef111ab8584862a4a734\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-141-238.ec2.internal"
Jul 22 04:24:45.404464 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:24:45.379581    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/6eb34c1251007ab488f516cf74fa28ca-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-141-238.ec2.internal\" (UID: \"6eb34c1251007ab488f516cf74fa28ca\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-238.ec2.internal"
Jul 22 04:24:45.404464 ip-10-0-141-238 kubenswrapper[2563]: E0722 04:24:45.390579    2563 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-238.ec2.internal\" not found"
Jul 22 04:24:45.637923 ip-10-0-141-238 kubenswrapper[2563]: E0722 04:24:45.491610    2563 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-238.ec2.internal\" not found"
Jul 22 04:24:45.637923 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:24:45.506645    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-141-238.ec2.internal"
Jul 22 04:24:45.637923 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:24:45.511531    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-238.ec2.internal"
Jul 22 04:24:45.637923 ip-10-0-141-238 kubenswrapper[2563]: E0722 04:24:45.592161    2563 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-238.ec2.internal\" not found"
Jul 22 04:24:45.829097 ip-10-0-141-238 kubenswrapper[2563]: E0722 04:24:45.693694    2563 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-238.ec2.internal\" not found"
Jul 22 04:24:45.829097 ip-10-0-141-238 kubenswrapper[2563]: E0722 04:24:45.794799    2563 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-238.ec2.internal\" not found"
Jul 22 04:24:45.829097 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:24:45.828418    2563 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials"
Jul 22 04:24:45.829097 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:24:45.828569    2563 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
Jul 22 04:24:46.038460 ip-10-0-141-238 kubenswrapper[2563]: E0722 04:24:45.895175    2563 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-238.ec2.internal\" not found"
Jul 22 04:24:46.038460 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:24:45.899623    2563 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-07-21 04:19:45 +0000 UTC" deadline="2027-12-29 02:28:00.279090201 +0000 UTC"
Jul 22 04:24:46.038460 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:24:45.899648    2563 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="12598h3m14.379445284s"
Jul 22 04:24:46.038460 ip-10-0-141-238 kubenswrapper[2563]: E0722 04:24:45.995351    2563 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-238.ec2.internal\" not found"
Jul 22 04:24:46.211448 ip-10-0-141-238 kubenswrapper[2563]: E0722 04:24:46.095637    2563 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-238.ec2.internal\" not found"
Jul 22 04:24:46.211448 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:24:46.112692    2563 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 22 04:24:46.211448 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:24:46.158430    2563 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 22 04:24:46.211448 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:24:46.177410    2563 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-238.ec2.internal"
Jul 22 04:24:46.211448 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:24:46.188125    2563 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Jul 22 04:24:46.211448 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:24:46.189816    2563 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-141-238.ec2.internal"
Jul 22 04:24:46.211448 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:24:46.198411    2563 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Jul 22 04:24:46.462041 ip-10-0-141-238 kubenswrapper[2563]: W0722 04:24:46.293380    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7cbc186c127cef111ab8584862a4a734.slice/crio-e41acafeb0d8b6d747c231898686b5726810a7aab4915d37f455fa577de2bb15 WatchSource:0}: Error finding container e41acafeb0d8b6d747c231898686b5726810a7aab4915d37f455fa577de2bb15: Status 404 returned error can't find the container with id e41acafeb0d8b6d747c231898686b5726810a7aab4915d37f455fa577de2bb15
Jul 22 04:24:46.462041 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:24:46.303556    2563 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 22 04:24:46.462041 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:24:46.305609    2563 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 22 04:24:46.462041 ip-10-0-141-238 kubenswrapper[2563]: W0722 04:24:46.309929    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6eb34c1251007ab488f516cf74fa28ca.slice/crio-d82c3142c8d8b37439ec8fae7ddccdb3671eac40586b434f1c6cec6b366f6cb5 WatchSource:0}: Error finding container d82c3142c8d8b37439ec8fae7ddccdb3671eac40586b434f1c6cec6b366f6cb5: Status 404 returned error can't find the container with id d82c3142c8d8b37439ec8fae7ddccdb3671eac40586b434f1c6cec6b366f6cb5
Jul 22 04:24:46.893139 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:24:46.862163    2563 apiserver.go:52] "Watching apiserver"
Jul 22 04:24:46.893139 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:24:46.871237    2563 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66"
Jul 22 04:24:46.893139 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:24:46.872367    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/node-resolver-56sw9","openshift-multus/multus-22ss9","openshift-multus/multus-additional-cni-plugins-qldhd","openshift-ovn-kubernetes/ovnkube-node-gjvc2","kube-system/kube-apiserver-proxy-ip-10-0-141-238.ec2.internal","openshift-cluster-node-tuning-operator/tuned-ttgt2","openshift-image-registry/node-ca-wn74g","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-238.ec2.internal","openshift-multus/network-metrics-daemon-2k7fd","openshift-network-diagnostics/network-check-target-7x8hk","openshift-network-operator/iptables-alerter-nnl9g","kube-system/global-pull-secret-syncer-k2znt","kube-system/konnectivity-agent-j9gvx","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-t5nr2"]
Jul 22 04:24:46.893139 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:24:46.875130    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-wn74g"
Jul 22 04:24:46.893139 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:24:46.877589    2563 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving"
Jul 22 04:24:46.893139 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:24:46.877790    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-nnl9g"
Jul 22 04:24:46.893139 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:24:46.878023    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\""
Jul 22 04:24:46.893139 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:24:46.878305    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-659m8\""
Jul 22 04:24:46.893139 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:24:46.878354    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\""
Jul 22 04:24:46.893139 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:24:46.878426    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\""
Jul 22 04:24:46.893139 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:24:46.880156    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-qldhd"
Jul 22 04:24:46.893139 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:24:46.881081    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\""
Jul 22 04:24:46.893139 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:24:46.881199    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\""
Jul 22 04:24:46.893139 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:24:46.881311    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-l4qb5\""
Jul 22 04:24:46.893139 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:24:46.881403    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\""
Jul 22 04:24:46.893139 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:24:46.882297    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\""
Jul 22 04:24:46.893139 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:24:46.882921    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-4xh8h\""
Jul 22 04:24:46.893139 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:24:46.883172    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\""
Jul 22 04:24:46.893139 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:24:46.883516    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\""
Jul 22 04:24:46.893139 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:24:46.883742    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\""
Jul 22 04:24:46.893139 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:24:46.883939    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\""
Jul 22 04:24:46.893139 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:24:46.884030    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-gjvc2"
Jul 22 04:24:46.893139 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:24:46.886367    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\""
Jul 22 04:24:46.893139 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:24:46.886395    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\""
Jul 22 04:24:46.893139 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:24:46.886545    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/082d9f5d-e4ad-4288-a071-f9f6902393e1-system-cni-dir\") pod \"multus-additional-cni-plugins-qldhd\" (UID: \"082d9f5d-e4ad-4288-a071-f9f6902393e1\") " pod="openshift-multus/multus-additional-cni-plugins-qldhd"
Jul 22 04:24:46.893139 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:24:46.886578    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/082d9f5d-e4ad-4288-a071-f9f6902393e1-os-release\") pod \"multus-additional-cni-plugins-qldhd\" (UID: \"082d9f5d-e4ad-4288-a071-f9f6902393e1\") " pod="openshift-multus/multus-additional-cni-plugins-qldhd"
Jul 22 04:24:46.893139 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:24:46.886608    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/082d9f5d-e4ad-4288-a071-f9f6902393e1-cni-binary-copy\") pod \"multus-additional-cni-plugins-qldhd\" (UID: \"082d9f5d-e4ad-4288-a071-f9f6902393e1\") " pod="openshift-multus/multus-additional-cni-plugins-qldhd"
Jul 22 04:24:46.893139 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:24:46.886633    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-knf6l\" (UniqueName: \"kubernetes.io/projected/17e66222-28be-4adb-b389-ba6aa170ed73-kube-api-access-knf6l\") pod \"iptables-alerter-nnl9g\" (UID: \"17e66222-28be-4adb-b389-ba6aa170ed73\") " pod="openshift-network-operator/iptables-alerter-nnl9g"
Jul 22 04:24:46.893139 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:24:46.886647    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\""
Jul 22 04:24:46.895024 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:24:46.886661    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/082d9f5d-e4ad-4288-a071-f9f6902393e1-cnibin\") pod \"multus-additional-cni-plugins-qldhd\" (UID: \"082d9f5d-e4ad-4288-a071-f9f6902393e1\") " pod="openshift-multus/multus-additional-cni-plugins-qldhd"
Jul 22 04:24:46.895024 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:24:46.886685    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/ea39afdc-f191-458e-acc9-1ad9ff78c9da-host\") pod \"node-ca-wn74g\" (UID: \"ea39afdc-f191-458e-acc9-1ad9ff78c9da\") " pod="openshift-image-registry/node-ca-wn74g"
Jul 22 04:24:46.895024 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:24:46.886773    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/082d9f5d-e4ad-4288-a071-f9f6902393e1-tuning-conf-dir\") pod \"multus-additional-cni-plugins-qldhd\" (UID: \"082d9f5d-e4ad-4288-a071-f9f6902393e1\") " pod="openshift-multus/multus-additional-cni-plugins-qldhd"
Jul 22 04:24:46.895024 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:24:46.886821    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/082d9f5d-e4ad-4288-a071-f9f6902393e1-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-qldhd\" (UID: \"082d9f5d-e4ad-4288-a071-f9f6902393e1\") " pod="openshift-multus/multus-additional-cni-plugins-qldhd"
Jul 22 04:24:46.895024 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:24:46.886855    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/082d9f5d-e4ad-4288-a071-f9f6902393e1-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-qldhd\" (UID: \"082d9f5d-e4ad-4288-a071-f9f6902393e1\") " pod="openshift-multus/multus-additional-cni-plugins-qldhd"
Jul 22 04:24:46.895024 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:24:46.886883    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gk6f4\" (UniqueName: \"kubernetes.io/projected/082d9f5d-e4ad-4288-a071-f9f6902393e1-kube-api-access-gk6f4\") pod \"multus-additional-cni-plugins-qldhd\" (UID: \"082d9f5d-e4ad-4288-a071-f9f6902393e1\") " pod="openshift-multus/multus-additional-cni-plugins-qldhd"
Jul 22 04:24:46.895024 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:24:46.886908    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/ea39afdc-f191-458e-acc9-1ad9ff78c9da-serviceca\") pod \"node-ca-wn74g\" (UID: \"ea39afdc-f191-458e-acc9-1ad9ff78c9da\") " pod="openshift-image-registry/node-ca-wn74g"
Jul 22 04:24:46.895024 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:24:46.886931    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-85tl8\" (UniqueName: \"kubernetes.io/projected/ea39afdc-f191-458e-acc9-1ad9ff78c9da-kube-api-access-85tl8\") pod \"node-ca-wn74g\" (UID: \"ea39afdc-f191-458e-acc9-1ad9ff78c9da\") " pod="openshift-image-registry/node-ca-wn74g"
Jul 22 04:24:46.895024 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:24:46.886980    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/17e66222-28be-4adb-b389-ba6aa170ed73-iptables-alerter-script\") pod \"iptables-alerter-nnl9g\" (UID: \"17e66222-28be-4adb-b389-ba6aa170ed73\") " pod="openshift-network-operator/iptables-alerter-nnl9g"
Jul 22 04:24:46.895024 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:24:46.887007    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/17e66222-28be-4adb-b389-ba6aa170ed73-host-slash\") pod \"iptables-alerter-nnl9g\" (UID: \"17e66222-28be-4adb-b389-ba6aa170ed73\") " pod="openshift-network-operator/iptables-alerter-nnl9g"
Jul 22 04:24:46.895024 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:24:46.887108    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\""
Jul 22 04:24:46.895024 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:24:46.887133    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\""
Jul 22 04:24:46.895024 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:24:46.887141    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-2cdrx\""
Jul 22 04:24:46.895024 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:24:46.887194    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\""
Jul 22 04:24:46.895024 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:24:46.889477    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-t5nr2"
Jul 22 04:24:46.895024 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:24:46.891063    2563 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Jul 22 04:24:46.895024 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:24:46.892031    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\""
Jul 22 04:24:46.895024 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:24:46.892233    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\""
Jul 22 04:24:46.895024 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:24:46.892421    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\""
Jul 22 04:24:46.895024 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:24:46.894811    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-jjx4g\""
Jul 22 04:24:46.897489 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:24:46.897148    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-ttgt2"
Jul 22 04:24:46.901867 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:24:46.899762    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-gfz2j\""
Jul 22 04:24:46.901867 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:24:46.900080    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\""
Jul 22 04:24:46.901867 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:24:46.900309    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\""
Jul 22 04:24:46.901867 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:24:46.900872    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2k7fd"
Jul 22 04:24:46.901867 ip-10-0-141-238 kubenswrapper[2563]: E0722 04:24:46.900945    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-2k7fd" podUID="3e22b9bf-95f2-4186-a5a7-2f1d21feb8b1"
Jul 22 04:24:46.904569 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:24:46.904367    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-j9gvx"
Jul 22 04:24:46.907857 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:24:46.906633    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\""
Jul 22 04:24:46.907857 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:24:46.907079    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\""
Jul 22 04:24:46.907857 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:24:46.907248    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-9l5d2\""
Jul 22 04:24:46.907857 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:24:46.907306    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-22ss9"
Jul 22 04:24:46.910155 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:24:46.909581    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\""
Jul 22 04:24:46.910155 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:24:46.909789    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-z8td5\""
Jul 22 04:24:46.910155 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:24:46.909941    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7x8hk"
Jul 22 04:24:46.910155 ip-10-0-141-238 kubenswrapper[2563]: E0722 04:24:46.909993    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-7x8hk" podUID="ca6c339f-ddd5-4c9b-801a-e0323cbc2f0e"
Jul 22 04:24:46.912020 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:24:46.912002    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-56sw9"
Jul 22 04:24:46.914305 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:24:46.914286    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\""
Jul 22 04:24:46.914639 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:24:46.914444    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\""
Jul 22 04:24:46.914639 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:24:46.914472    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-ds8pj\""
Jul 22 04:24:46.914639 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:24:46.914630    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-k2znt"
Jul 22 04:24:46.914798 ip-10-0-141-238 kubenswrapper[2563]: E0722 04:24:46.914695    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-k2znt" podUID="bc2f671d-2057-4b94-8e5c-e6d3cdcdd74e"
Jul 22 04:24:46.918838 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:24:46.918765    2563 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-4cg9g"
Jul 22 04:24:46.928329 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:24:46.928270    2563 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-4cg9g"
Jul 22 04:24:46.978353 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:24:46.978327    2563 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world"
Jul 22 04:24:46.989338 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:24:46.989299    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/fe3e5ab3-5e5a-48d6-80bd-1d55ae5b06db-etc-modprobe-d\") pod \"tuned-ttgt2\" (UID: \"fe3e5ab3-5e5a-48d6-80bd-1d55ae5b06db\") " pod="openshift-cluster-node-tuning-operator/tuned-ttgt2"
Jul 22 04:24:46.989489 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:24:46.989349    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/fe3e5ab3-5e5a-48d6-80bd-1d55ae5b06db-var-lib-kubelet\") pod \"tuned-ttgt2\" (UID: \"fe3e5ab3-5e5a-48d6-80bd-1d55ae5b06db\") " pod="openshift-cluster-node-tuning-operator/tuned-ttgt2"
Jul 22 04:24:46.990557 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:24:46.990528    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-knf6l\" (UniqueName: \"kubernetes.io/projected/17e66222-28be-4adb-b389-ba6aa170ed73-kube-api-access-knf6l\") pod \"iptables-alerter-nnl9g\" (UID: \"17e66222-28be-4adb-b389-ba6aa170ed73\") " pod="openshift-network-operator/iptables-alerter-nnl9g"
Jul 22 04:24:46.990649 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:24:46.990572    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/b4af3ae5-fa65-4358-8399-6ed11b68616e-konnectivity-ca\") pod \"konnectivity-agent-j9gvx\" (UID: \"b4af3ae5-fa65-4358-8399-6ed11b68616e\") " pod="kube-system/konnectivity-agent-j9gvx"
Jul 22 04:24:46.990649 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:24:46.990598    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/79ad9242-2544-40bf-a872-7cbab7ab0b23-host-cni-netd\") pod \"ovnkube-node-gjvc2\" (UID: \"79ad9242-2544-40bf-a872-7cbab7ab0b23\") " pod="openshift-ovn-kubernetes/ovnkube-node-gjvc2"
Jul 22 04:24:46.990649 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:24:46.990622    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/fe3e5ab3-5e5a-48d6-80bd-1d55ae5b06db-etc-systemd\") pod \"tuned-ttgt2\" (UID: \"fe3e5ab3-5e5a-48d6-80bd-1d55ae5b06db\") " pod="openshift-cluster-node-tuning-operator/tuned-ttgt2"
Jul 22 04:24:46.990823 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:24:46.990647    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/ea39afdc-f191-458e-acc9-1ad9ff78c9da-host\") pod \"node-ca-wn74g\" (UID: \"ea39afdc-f191-458e-acc9-1ad9ff78c9da\") " pod="openshift-image-registry/node-ca-wn74g"
Jul 22 04:24:46.990823 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:24:46.990671    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/959d426a-6437-4684-8afa-d0fcd4f5dc5a-os-release\") pod \"multus-22ss9\" (UID: \"959d426a-6437-4684-8afa-d0fcd4f5dc5a\") " pod="openshift-multus/multus-22ss9"
Jul 22 04:24:46.990823 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:24:46.990695    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/959d426a-6437-4684-8afa-d0fcd4f5dc5a-host-var-lib-kubelet\") pod \"multus-22ss9\" (UID: \"959d426a-6437-4684-8afa-d0fcd4f5dc5a\") " pod="openshift-multus/multus-22ss9"
Jul 22 04:24:46.990823 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:24:46.990720    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rvm2s\" (UniqueName: \"kubernetes.io/projected/6e24b2d2-e7a1-4be2-b35b-9dfd42e74727-kube-api-access-rvm2s\") pod \"aws-ebs-csi-driver-node-t5nr2\" (UID: \"6e24b2d2-e7a1-4be2-b35b-9dfd42e74727\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-t5nr2"
Jul 22 04:24:46.990823 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:24:46.990749    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/79ad9242-2544-40bf-a872-7cbab7ab0b23-env-overrides\") pod \"ovnkube-node-gjvc2\" (UID: \"79ad9242-2544-40bf-a872-7cbab7ab0b23\") " pod="openshift-ovn-kubernetes/ovnkube-node-gjvc2"
Jul 22 04:24:46.990823 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:24:46.990774    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/fe3e5ab3-5e5a-48d6-80bd-1d55ae5b06db-etc-tuned\") pod \"tuned-ttgt2\" (UID: \"fe3e5ab3-5e5a-48d6-80bd-1d55ae5b06db\") " pod="openshift-cluster-node-tuning-operator/tuned-ttgt2"
Jul 22 04:24:46.990823 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:24:46.990801    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/082d9f5d-e4ad-4288-a071-f9f6902393e1-tuning-conf-dir\") pod \"multus-additional-cni-plugins-qldhd\" (UID: \"082d9f5d-e4ad-4288-a071-f9f6902393e1\") " pod="openshift-multus/multus-additional-cni-plugins-qldhd"
Jul 22 04:24:46.991195 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:24:46.990830    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/082d9f5d-e4ad-4288-a071-f9f6902393e1-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-qldhd\" (UID: \"082d9f5d-e4ad-4288-a071-f9f6902393e1\") " pod="openshift-multus/multus-additional-cni-plugins-qldhd"
Jul 22 04:24:46.991195 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:24:46.990856    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/082d9f5d-e4ad-4288-a071-f9f6902393e1-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-qldhd\" (UID: \"082d9f5d-e4ad-4288-a071-f9f6902393e1\") " pod="openshift-multus/multus-additional-cni-plugins-qldhd"
Jul 22 04:24:46.991195 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:24:46.990884    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/17e66222-28be-4adb-b389-ba6aa170ed73-host-slash\") pod \"iptables-alerter-nnl9g\" (UID: \"17e66222-28be-4adb-b389-ba6aa170ed73\") " pod="openshift-network-operator/iptables-alerter-nnl9g"
Jul 22 04:24:46.991195 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:24:46.990911    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/959d426a-6437-4684-8afa-d0fcd4f5dc5a-multus-daemon-config\") pod \"multus-22ss9\" (UID: \"959d426a-6437-4684-8afa-d0fcd4f5dc5a\") " pod="openshift-multus/multus-22ss9"
Jul 22 04:24:46.991195 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:24:46.990922    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/ea39afdc-f191-458e-acc9-1ad9ff78c9da-host\") pod \"node-ca-wn74g\" (UID: \"ea39afdc-f191-458e-acc9-1ad9ff78c9da\") " pod="openshift-image-registry/node-ca-wn74g"
Jul 22 04:24:46.991195 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:24:46.990937    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/79ad9242-2544-40bf-a872-7cbab7ab0b23-host-run-netns\") pod \"ovnkube-node-gjvc2\" (UID: \"79ad9242-2544-40bf-a872-7cbab7ab0b23\") " pod="openshift-ovn-kubernetes/ovnkube-node-gjvc2"
Jul 22 04:24:46.991195 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:24:46.990975    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/79ad9242-2544-40bf-a872-7cbab7ab0b23-ovnkube-config\") pod \"ovnkube-node-gjvc2\" (UID: \"79ad9242-2544-40bf-a872-7cbab7ab0b23\") " pod="openshift-ovn-kubernetes/ovnkube-node-gjvc2"
Jul 22 04:24:46.991195 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:24:46.991006    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/fe3e5ab3-5e5a-48d6-80bd-1d55ae5b06db-etc-kubernetes\") pod \"tuned-ttgt2\" (UID: \"fe3e5ab3-5e5a-48d6-80bd-1d55ae5b06db\") " pod="openshift-cluster-node-tuning-operator/tuned-ttgt2"
Jul 22 04:24:46.991195 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:24:46.991031    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/959d426a-6437-4684-8afa-d0fcd4f5dc5a-host-run-multus-certs\") pod \"multus-22ss9\" (UID: \"959d426a-6437-4684-8afa-d0fcd4f5dc5a\") " pod="openshift-multus/multus-22ss9"
Jul 22 04:24:46.991195 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:24:46.991056    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/b4af3ae5-fa65-4358-8399-6ed11b68616e-agent-certs\") pod \"konnectivity-agent-j9gvx\" (UID: \"b4af3ae5-fa65-4358-8399-6ed11b68616e\") " pod="kube-system/konnectivity-agent-j9gvx"
Jul 22 04:24:46.991195 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:24:46.991096    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/79ad9242-2544-40bf-a872-7cbab7ab0b23-host-kubelet\") pod \"ovnkube-node-gjvc2\" (UID: \"79ad9242-2544-40bf-a872-7cbab7ab0b23\") " pod="openshift-ovn-kubernetes/ovnkube-node-gjvc2"
Jul 22 04:24:46.991195 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:24:46.991121    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/79ad9242-2544-40bf-a872-7cbab7ab0b23-run-openvswitch\") pod \"ovnkube-node-gjvc2\" (UID: \"79ad9242-2544-40bf-a872-7cbab7ab0b23\") " pod="openshift-ovn-kubernetes/ovnkube-node-gjvc2"
Jul 22 04:24:46.991195 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:24:46.991145    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/79ad9242-2544-40bf-a872-7cbab7ab0b23-log-socket\") pod \"ovnkube-node-gjvc2\" (UID: \"79ad9242-2544-40bf-a872-7cbab7ab0b23\") " pod="openshift-ovn-kubernetes/ovnkube-node-gjvc2"
Jul 22 04:24:46.991195 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:24:46.991172    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/fe3e5ab3-5e5a-48d6-80bd-1d55ae5b06db-tmp\") pod \"tuned-ttgt2\" (UID: \"fe3e5ab3-5e5a-48d6-80bd-1d55ae5b06db\") " pod="openshift-cluster-node-tuning-operator/tuned-ttgt2"
Jul 22 04:24:46.991195 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:24:46.991174    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/082d9f5d-e4ad-4288-a071-f9f6902393e1-tuning-conf-dir\") pod \"multus-additional-cni-plugins-qldhd\" (UID: \"082d9f5d-e4ad-4288-a071-f9f6902393e1\") " pod="openshift-multus/multus-additional-cni-plugins-qldhd"
Jul 22 04:24:46.991195 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:24:46.991202    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/082d9f5d-e4ad-4288-a071-f9f6902393e1-os-release\") pod \"multus-additional-cni-plugins-qldhd\" (UID: \"082d9f5d-e4ad-4288-a071-f9f6902393e1\") " pod="openshift-multus/multus-additional-cni-plugins-qldhd"
Jul 22 04:24:46.992068 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:24:46.991229    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/79ad9242-2544-40bf-a872-7cbab7ab0b23-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-gjvc2\" (UID: \"79ad9242-2544-40bf-a872-7cbab7ab0b23\") " pod="openshift-ovn-kubernetes/ovnkube-node-gjvc2"
Jul 22 04:24:46.992068 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:24:46.991256    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/79ad9242-2544-40bf-a872-7cbab7ab0b23-ovn-node-metrics-cert\") pod \"ovnkube-node-gjvc2\" (UID: \"79ad9242-2544-40bf-a872-7cbab7ab0b23\") " pod="openshift-ovn-kubernetes/ovnkube-node-gjvc2"
Jul 22 04:24:46.992068 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:24:46.991281    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/fe3e5ab3-5e5a-48d6-80bd-1d55ae5b06db-host\") pod \"tuned-ttgt2\" (UID: \"fe3e5ab3-5e5a-48d6-80bd-1d55ae5b06db\") " pod="openshift-cluster-node-tuning-operator/tuned-ttgt2"
Jul 22 04:24:46.992068 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:24:46.991304    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/959d426a-6437-4684-8afa-d0fcd4f5dc5a-hostroot\") pod \"multus-22ss9\" (UID: \"959d426a-6437-4684-8afa-d0fcd4f5dc5a\") " pod="openshift-multus/multus-22ss9"
Jul 22 04:24:46.992068 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:24:46.991328    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/79ad9242-2544-40bf-a872-7cbab7ab0b23-run-systemd\") pod \"ovnkube-node-gjvc2\" (UID: \"79ad9242-2544-40bf-a872-7cbab7ab0b23\") " pod="openshift-ovn-kubernetes/ovnkube-node-gjvc2"
Jul 22 04:24:46.992068 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:24:46.991350    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/fe3e5ab3-5e5a-48d6-80bd-1d55ae5b06db-etc-sysctl-d\") pod \"tuned-ttgt2\" (UID: \"fe3e5ab3-5e5a-48d6-80bd-1d55ae5b06db\") " pod="openshift-cluster-node-tuning-operator/tuned-ttgt2"
Jul 22 04:24:46.992068 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:24:46.991375    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/bc2f671d-2057-4b94-8e5c-e6d3cdcdd74e-original-pull-secret\") pod \"global-pull-secret-syncer-k2znt\" (UID: \"bc2f671d-2057-4b94-8e5c-e6d3cdcdd74e\") " pod="kube-system/global-pull-secret-syncer-k2znt"
Jul 22 04:24:46.992068 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:24:46.991426    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/ea39afdc-f191-458e-acc9-1ad9ff78c9da-serviceca\") pod \"node-ca-wn74g\" (UID: \"ea39afdc-f191-458e-acc9-1ad9ff78c9da\") " pod="openshift-image-registry/node-ca-wn74g"
Jul 22 04:24:46.992068 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:24:46.991448    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-85tl8\" (UniqueName: \"kubernetes.io/projected/ea39afdc-f191-458e-acc9-1ad9ff78c9da-kube-api-access-85tl8\") pod \"node-ca-wn74g\" (UID: \"ea39afdc-f191-458e-acc9-1ad9ff78c9da\") " pod="openshift-image-registry/node-ca-wn74g"
Jul 22 04:24:46.992068 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:24:46.991474    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/959d426a-6437-4684-8afa-d0fcd4f5dc5a-system-cni-dir\") pod \"multus-22ss9\" (UID: \"959d426a-6437-4684-8afa-d0fcd4f5dc5a\") " pod="openshift-multus/multus-22ss9"
Jul 22 04:24:46.992068 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:24:46.991499    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/959d426a-6437-4684-8afa-d0fcd4f5dc5a-etc-kubernetes\") pod \"multus-22ss9\" (UID: \"959d426a-6437-4684-8afa-d0fcd4f5dc5a\") " pod="openshift-multus/multus-22ss9"
Jul 22 04:24:46.992068 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:24:46.991524    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/79ad9242-2544-40bf-a872-7cbab7ab0b23-var-lib-openvswitch\") pod \"ovnkube-node-gjvc2\" (UID: \"79ad9242-2544-40bf-a872-7cbab7ab0b23\") " pod="openshift-ovn-kubernetes/ovnkube-node-gjvc2"
Jul 22 04:24:46.992068 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:24:46.991548    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/bc2f671d-2057-4b94-8e5c-e6d3cdcdd74e-dbus\") pod \"global-pull-secret-syncer-k2znt\" (UID: \"bc2f671d-2057-4b94-8e5c-e6d3cdcdd74e\") " pod="kube-system/global-pull-secret-syncer-k2znt"
Jul 22 04:24:46.992068 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:24:46.991571    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/959d426a-6437-4684-8afa-d0fcd4f5dc5a-cni-binary-copy\") pod \"multus-22ss9\" (UID: \"959d426a-6437-4684-8afa-d0fcd4f5dc5a\") " pod="openshift-multus/multus-22ss9"
Jul 22 04:24:46.992068 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:24:46.991597    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/6e24b2d2-e7a1-4be2-b35b-9dfd42e74727-registration-dir\") pod \"aws-ebs-csi-driver-node-t5nr2\" (UID: \"6e24b2d2-e7a1-4be2-b35b-9dfd42e74727\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-t5nr2"
Jul 22 04:24:46.992068 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:24:46.991622    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/6e24b2d2-e7a1-4be2-b35b-9dfd42e74727-etc-selinux\") pod \"aws-ebs-csi-driver-node-t5nr2\" (UID: \"6e24b2d2-e7a1-4be2-b35b-9dfd42e74727\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-t5nr2"
Jul 22 04:24:46.992890 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:24:46.991647    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/6e24b2d2-e7a1-4be2-b35b-9dfd42e74727-socket-dir\") pod \"aws-ebs-csi-driver-node-t5nr2\" (UID: \"6e24b2d2-e7a1-4be2-b35b-9dfd42e74727\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-t5nr2"
Jul 22 04:24:46.992890 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:24:46.991674    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/79ad9242-2544-40bf-a872-7cbab7ab0b23-host-run-ovn-kubernetes\") pod \"ovnkube-node-gjvc2\" (UID: \"79ad9242-2544-40bf-a872-7cbab7ab0b23\") " pod="openshift-ovn-kubernetes/ovnkube-node-gjvc2"
Jul 22 04:24:46.992890 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:24:46.991698    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/79ad9242-2544-40bf-a872-7cbab7ab0b23-host-cni-bin\") pod \"ovnkube-node-gjvc2\" (UID: \"79ad9242-2544-40bf-a872-7cbab7ab0b23\") " pod="openshift-ovn-kubernetes/ovnkube-node-gjvc2"
Jul 22 04:24:46.992890 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:24:46.991734    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/082d9f5d-e4ad-4288-a071-f9f6902393e1-cnibin\") pod \"multus-additional-cni-plugins-qldhd\" (UID: \"082d9f5d-e4ad-4288-a071-f9f6902393e1\") " pod="openshift-multus/multus-additional-cni-plugins-qldhd"
Jul 22 04:24:46.992890 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:24:46.991761    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-f9lqs\" (UniqueName: \"kubernetes.io/projected/0d66df01-3af3-4a5c-8fe2-6e10517bbcf5-kube-api-access-f9lqs\") pod \"node-resolver-56sw9\" (UID: \"0d66df01-3af3-4a5c-8fe2-6e10517bbcf5\") " pod="openshift-dns/node-resolver-56sw9"
Jul 22 04:24:46.992890 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:24:46.991775    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/082d9f5d-e4ad-4288-a071-f9f6902393e1-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-qldhd\" (UID: \"082d9f5d-e4ad-4288-a071-f9f6902393e1\") " pod="openshift-multus/multus-additional-cni-plugins-qldhd"
Jul 22 04:24:46.992890 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:24:46.991786    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/959d426a-6437-4684-8afa-d0fcd4f5dc5a-host-run-netns\") pod \"multus-22ss9\" (UID: \"959d426a-6437-4684-8afa-d0fcd4f5dc5a\") " pod="openshift-multus/multus-22ss9"
Jul 22 04:24:46.992890 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:24:46.991821    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gk6f4\" (UniqueName: \"kubernetes.io/projected/082d9f5d-e4ad-4288-a071-f9f6902393e1-kube-api-access-gk6f4\") pod \"multus-additional-cni-plugins-qldhd\" (UID: \"082d9f5d-e4ad-4288-a071-f9f6902393e1\") " pod="openshift-multus/multus-additional-cni-plugins-qldhd"
Jul 22 04:24:46.992890 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:24:46.991850    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3e22b9bf-95f2-4186-a5a7-2f1d21feb8b1-metrics-certs\") pod \"network-metrics-daemon-2k7fd\" (UID: \"3e22b9bf-95f2-4186-a5a7-2f1d21feb8b1\") " pod="openshift-multus/network-metrics-daemon-2k7fd"
Jul 22 04:24:46.992890 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:24:46.991876    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/79ad9242-2544-40bf-a872-7cbab7ab0b23-etc-openvswitch\") pod \"ovnkube-node-gjvc2\" (UID: \"79ad9242-2544-40bf-a872-7cbab7ab0b23\") " pod="openshift-ovn-kubernetes/ovnkube-node-gjvc2"
Jul 22 04:24:46.992890 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:24:46.991901    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/79ad9242-2544-40bf-a872-7cbab7ab0b23-run-ovn\") pod \"ovnkube-node-gjvc2\" (UID: \"79ad9242-2544-40bf-a872-7cbab7ab0b23\") " pod="openshift-ovn-kubernetes/ovnkube-node-gjvc2"
Jul 22 04:24:46.992890 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:24:46.991928    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/17e66222-28be-4adb-b389-ba6aa170ed73-iptables-alerter-script\") pod \"iptables-alerter-nnl9g\" (UID: \"17e66222-28be-4adb-b389-ba6aa170ed73\") " pod="openshift-network-operator/iptables-alerter-nnl9g"
Jul 22 04:24:46.992890 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:24:46.991956    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/959d426a-6437-4684-8afa-d0fcd4f5dc5a-multus-socket-dir-parent\") pod \"multus-22ss9\" (UID: \"959d426a-6437-4684-8afa-d0fcd4f5dc5a\") " pod="openshift-multus/multus-22ss9"
Jul 22 04:24:46.992890 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:24:46.991981    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/6e24b2d2-e7a1-4be2-b35b-9dfd42e74727-device-dir\") pod \"aws-ebs-csi-driver-node-t5nr2\" (UID: \"6e24b2d2-e7a1-4be2-b35b-9dfd42e74727\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-t5nr2"
Jul 22 04:24:46.992890 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:24:46.992006    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/79ad9242-2544-40bf-a872-7cbab7ab0b23-host-slash\") pod \"ovnkube-node-gjvc2\" (UID: \"79ad9242-2544-40bf-a872-7cbab7ab0b23\") " pod="openshift-ovn-kubernetes/ovnkube-node-gjvc2"
Jul 22 04:24:46.992890 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:24:46.992028    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lczxw\" (UniqueName: \"kubernetes.io/projected/79ad9242-2544-40bf-a872-7cbab7ab0b23-kube-api-access-lczxw\") pod \"ovnkube-node-gjvc2\" (UID: \"79ad9242-2544-40bf-a872-7cbab7ab0b23\") " pod="openshift-ovn-kubernetes/ovnkube-node-gjvc2"
Jul 22 04:24:46.993801 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:24:46.992055    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/fe3e5ab3-5e5a-48d6-80bd-1d55ae5b06db-etc-sysconfig\") pod \"tuned-ttgt2\" (UID: \"fe3e5ab3-5e5a-48d6-80bd-1d55ae5b06db\") " pod="openshift-cluster-node-tuning-operator/tuned-ttgt2"
Jul 22 04:24:46.993801 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:24:46.992085    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/fe3e5ab3-5e5a-48d6-80bd-1d55ae5b06db-sys\") pod \"tuned-ttgt2\" (UID: \"fe3e5ab3-5e5a-48d6-80bd-1d55ae5b06db\") " pod="openshift-cluster-node-tuning-operator/tuned-ttgt2"
Jul 22 04:24:46.993801 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:24:46.992109    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/fe3e5ab3-5e5a-48d6-80bd-1d55ae5b06db-lib-modules\") pod \"tuned-ttgt2\" (UID: \"fe3e5ab3-5e5a-48d6-80bd-1d55ae5b06db\") " pod="openshift-cluster-node-tuning-operator/tuned-ttgt2"
Jul 22 04:24:46.993801 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:24:46.992153    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/082d9f5d-e4ad-4288-a071-f9f6902393e1-system-cni-dir\") pod \"multus-additional-cni-plugins-qldhd\" (UID: \"082d9f5d-e4ad-4288-a071-f9f6902393e1\") " pod="openshift-multus/multus-additional-cni-plugins-qldhd"
Jul 22 04:24:46.993801 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:24:46.992180    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/082d9f5d-e4ad-4288-a071-f9f6902393e1-cni-binary-copy\") pod \"multus-additional-cni-plugins-qldhd\" (UID: \"082d9f5d-e4ad-4288-a071-f9f6902393e1\") " pod="openshift-multus/multus-additional-cni-plugins-qldhd"
Jul 22 04:24:46.993801 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:24:46.992212    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/959d426a-6437-4684-8afa-d0fcd4f5dc5a-host-var-lib-cni-bin\") pod \"multus-22ss9\" (UID: \"959d426a-6437-4684-8afa-d0fcd4f5dc5a\") " pod="openshift-multus/multus-22ss9"
Jul 22 04:24:46.993801 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:24:46.992238    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7zr22\" (UniqueName: \"kubernetes.io/projected/959d426a-6437-4684-8afa-d0fcd4f5dc5a-kube-api-access-7zr22\") pod \"multus-22ss9\" (UID: \"959d426a-6437-4684-8afa-d0fcd4f5dc5a\") " pod="openshift-multus/multus-22ss9"
Jul 22 04:24:46.993801 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:24:46.992264    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/0d66df01-3af3-4a5c-8fe2-6e10517bbcf5-tmp-dir\") pod \"node-resolver-56sw9\" (UID: \"0d66df01-3af3-4a5c-8fe2-6e10517bbcf5\") " pod="openshift-dns/node-resolver-56sw9"
Jul 22 04:24:46.993801 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:24:46.992287    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/082d9f5d-e4ad-4288-a071-f9f6902393e1-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-qldhd\" (UID: \"082d9f5d-e4ad-4288-a071-f9f6902393e1\") " pod="openshift-multus/multus-additional-cni-plugins-qldhd"
Jul 22 04:24:46.993801 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:24:46.992368    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/17e66222-28be-4adb-b389-ba6aa170ed73-host-slash\") pod \"iptables-alerter-nnl9g\" (UID: \"17e66222-28be-4adb-b389-ba6aa170ed73\") " pod="openshift-network-operator/iptables-alerter-nnl9g"
Jul 22 04:24:46.993801 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:24:46.992293    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/6e24b2d2-e7a1-4be2-b35b-9dfd42e74727-kubelet-dir\") pod \"aws-ebs-csi-driver-node-t5nr2\" (UID: \"6e24b2d2-e7a1-4be2-b35b-9dfd42e74727\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-t5nr2"
Jul 22 04:24:46.993801 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:24:46.992409    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/082d9f5d-e4ad-4288-a071-f9f6902393e1-os-release\") pod \"multus-additional-cni-plugins-qldhd\" (UID: \"082d9f5d-e4ad-4288-a071-f9f6902393e1\") " pod="openshift-multus/multus-additional-cni-plugins-qldhd"
Jul 22 04:24:46.993801 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:24:46.993204    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/ea39afdc-f191-458e-acc9-1ad9ff78c9da-serviceca\") pod \"node-ca-wn74g\" (UID: \"ea39afdc-f191-458e-acc9-1ad9ff78c9da\") " pod="openshift-image-registry/node-ca-wn74g"
Jul 22 04:24:46.993801 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:24:46.993242    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/17e66222-28be-4adb-b389-ba6aa170ed73-iptables-alerter-script\") pod \"iptables-alerter-nnl9g\" (UID: \"17e66222-28be-4adb-b389-ba6aa170ed73\") " pod="openshift-network-operator/iptables-alerter-nnl9g"
Jul 22 04:24:46.993801 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:24:46.993288    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/082d9f5d-e4ad-4288-a071-f9f6902393e1-system-cni-dir\") pod \"multus-additional-cni-plugins-qldhd\" (UID: \"082d9f5d-e4ad-4288-a071-f9f6902393e1\") " pod="openshift-multus/multus-additional-cni-plugins-qldhd"
Jul 22 04:24:46.993801 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:24:46.993348    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/082d9f5d-e4ad-4288-a071-f9f6902393e1-cnibin\") pod \"multus-additional-cni-plugins-qldhd\" (UID: \"082d9f5d-e4ad-4288-a071-f9f6902393e1\") " pod="openshift-multus/multus-additional-cni-plugins-qldhd"
Jul 22 04:24:46.993801 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:24:46.993391    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4jwxl\" (UniqueName: \"kubernetes.io/projected/ca6c339f-ddd5-4c9b-801a-e0323cbc2f0e-kube-api-access-4jwxl\") pod \"network-check-target-7x8hk\" (UID: \"ca6c339f-ddd5-4c9b-801a-e0323cbc2f0e\") " pod="openshift-network-diagnostics/network-check-target-7x8hk"
Jul 22 04:24:46.994671 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:24:46.993422    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/79ad9242-2544-40bf-a872-7cbab7ab0b23-systemd-units\") pod \"ovnkube-node-gjvc2\" (UID: \"79ad9242-2544-40bf-a872-7cbab7ab0b23\") " pod="openshift-ovn-kubernetes/ovnkube-node-gjvc2"
Jul 22 04:24:46.994671 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:24:46.993457    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/6e24b2d2-e7a1-4be2-b35b-9dfd42e74727-sys-fs\") pod \"aws-ebs-csi-driver-node-t5nr2\" (UID: \"6e24b2d2-e7a1-4be2-b35b-9dfd42e74727\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-t5nr2"
Jul 22 04:24:46.994671 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:24:46.993484    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/79ad9242-2544-40bf-a872-7cbab7ab0b23-ovnkube-script-lib\") pod \"ovnkube-node-gjvc2\" (UID: \"79ad9242-2544-40bf-a872-7cbab7ab0b23\") " pod="openshift-ovn-kubernetes/ovnkube-node-gjvc2"
Jul 22 04:24:46.994671 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:24:46.993511    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dwtw2\" (UniqueName: \"kubernetes.io/projected/fe3e5ab3-5e5a-48d6-80bd-1d55ae5b06db-kube-api-access-dwtw2\") pod \"tuned-ttgt2\" (UID: \"fe3e5ab3-5e5a-48d6-80bd-1d55ae5b06db\") " pod="openshift-cluster-node-tuning-operator/tuned-ttgt2"
Jul 22 04:24:46.994671 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:24:46.993539    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/959d426a-6437-4684-8afa-d0fcd4f5dc5a-host-var-lib-cni-multus\") pod \"multus-22ss9\" (UID: \"959d426a-6437-4684-8afa-d0fcd4f5dc5a\") " pod="openshift-multus/multus-22ss9"
Jul 22 04:24:46.994671 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:24:46.993583    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/959d426a-6437-4684-8afa-d0fcd4f5dc5a-multus-cni-dir\") pod \"multus-22ss9\" (UID: \"959d426a-6437-4684-8afa-d0fcd4f5dc5a\") " pod="openshift-multus/multus-22ss9"
Jul 22 04:24:46.994671 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:24:46.993610    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/959d426a-6437-4684-8afa-d0fcd4f5dc5a-cnibin\") pod \"multus-22ss9\" (UID: \"959d426a-6437-4684-8afa-d0fcd4f5dc5a\") " pod="openshift-multus/multus-22ss9"
Jul 22 04:24:46.994671 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:24:46.993635    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/959d426a-6437-4684-8afa-d0fcd4f5dc5a-host-run-k8s-cni-cncf-io\") pod \"multus-22ss9\" (UID: \"959d426a-6437-4684-8afa-d0fcd4f5dc5a\") " pod="openshift-multus/multus-22ss9"
Jul 22 04:24:46.994671 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:24:46.993661    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/959d426a-6437-4684-8afa-d0fcd4f5dc5a-multus-conf-dir\") pod \"multus-22ss9\" (UID: \"959d426a-6437-4684-8afa-d0fcd4f5dc5a\") " pod="openshift-multus/multus-22ss9"
Jul 22 04:24:46.994671 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:24:46.993689    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/0d66df01-3af3-4a5c-8fe2-6e10517bbcf5-hosts-file\") pod \"node-resolver-56sw9\" (UID: \"0d66df01-3af3-4a5c-8fe2-6e10517bbcf5\") " pod="openshift-dns/node-resolver-56sw9"
Jul 22 04:24:46.994671 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:24:46.993714    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/082d9f5d-e4ad-4288-a071-f9f6902393e1-cni-binary-copy\") pod \"multus-additional-cni-plugins-qldhd\" (UID: \"082d9f5d-e4ad-4288-a071-f9f6902393e1\") " pod="openshift-multus/multus-additional-cni-plugins-qldhd"
Jul 22 04:24:46.994671 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:24:46.993732    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/fe3e5ab3-5e5a-48d6-80bd-1d55ae5b06db-etc-sysctl-conf\") pod \"tuned-ttgt2\" (UID: \"fe3e5ab3-5e5a-48d6-80bd-1d55ae5b06db\") " pod="openshift-cluster-node-tuning-operator/tuned-ttgt2"
Jul 22 04:24:46.994671 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:24:46.993759    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/fe3e5ab3-5e5a-48d6-80bd-1d55ae5b06db-run\") pod \"tuned-ttgt2\" (UID: \"fe3e5ab3-5e5a-48d6-80bd-1d55ae5b06db\") " pod="openshift-cluster-node-tuning-operator/tuned-ttgt2"
Jul 22 04:24:46.994671 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:24:46.993825    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bzx2r\" (UniqueName: \"kubernetes.io/projected/3e22b9bf-95f2-4186-a5a7-2f1d21feb8b1-kube-api-access-bzx2r\") pod \"network-metrics-daemon-2k7fd\" (UID: \"3e22b9bf-95f2-4186-a5a7-2f1d21feb8b1\") " pod="openshift-multus/network-metrics-daemon-2k7fd"
Jul 22 04:24:46.994671 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:24:46.993855    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/bc2f671d-2057-4b94-8e5c-e6d3cdcdd74e-kubelet-config\") pod \"global-pull-secret-syncer-k2znt\" (UID: \"bc2f671d-2057-4b94-8e5c-e6d3cdcdd74e\") " pod="kube-system/global-pull-secret-syncer-k2znt"
Jul 22 04:24:46.994671 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:24:46.993878    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/79ad9242-2544-40bf-a872-7cbab7ab0b23-node-log\") pod \"ovnkube-node-gjvc2\" (UID: \"79ad9242-2544-40bf-a872-7cbab7ab0b23\") " pod="openshift-ovn-kubernetes/ovnkube-node-gjvc2"
Jul 22 04:24:46.998338 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:24:46.998036    2563 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory"
Jul 22 04:24:47.003097 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:24:47.003042    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-knf6l\" (UniqueName: \"kubernetes.io/projected/17e66222-28be-4adb-b389-ba6aa170ed73-kube-api-access-knf6l\") pod \"iptables-alerter-nnl9g\" (UID: \"17e66222-28be-4adb-b389-ba6aa170ed73\") " pod="openshift-network-operator/iptables-alerter-nnl9g"
Jul 22 04:24:47.004272 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:24:47.004245    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-85tl8\" (UniqueName: \"kubernetes.io/projected/ea39afdc-f191-458e-acc9-1ad9ff78c9da-kube-api-access-85tl8\") pod \"node-ca-wn74g\" (UID: \"ea39afdc-f191-458e-acc9-1ad9ff78c9da\") " pod="openshift-image-registry/node-ca-wn74g"
Jul 22 04:24:47.005489 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:24:47.005462    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gk6f4\" (UniqueName: \"kubernetes.io/projected/082d9f5d-e4ad-4288-a071-f9f6902393e1-kube-api-access-gk6f4\") pod \"multus-additional-cni-plugins-qldhd\" (UID: \"082d9f5d-e4ad-4288-a071-f9f6902393e1\") " pod="openshift-multus/multus-additional-cni-plugins-qldhd"
Jul 22 04:24:47.065483 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:24:47.065421    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-238.ec2.internal" event={"ID":"6eb34c1251007ab488f516cf74fa28ca","Type":"ContainerStarted","Data":"d82c3142c8d8b37439ec8fae7ddccdb3671eac40586b434f1c6cec6b366f6cb5"}
Jul 22 04:24:47.067862 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:24:47.067829    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-141-238.ec2.internal" event={"ID":"7cbc186c127cef111ab8584862a4a734","Type":"ContainerStarted","Data":"e41acafeb0d8b6d747c231898686b5726810a7aab4915d37f455fa577de2bb15"}
Jul 22 04:24:47.095054 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:24:47.094974    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-f9lqs\" (UniqueName: \"kubernetes.io/projected/0d66df01-3af3-4a5c-8fe2-6e10517bbcf5-kube-api-access-f9lqs\") pod \"node-resolver-56sw9\" (UID: \"0d66df01-3af3-4a5c-8fe2-6e10517bbcf5\") " pod="openshift-dns/node-resolver-56sw9"
Jul 22 04:24:47.095054 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:24:47.095012    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/959d426a-6437-4684-8afa-d0fcd4f5dc5a-host-run-netns\") pod \"multus-22ss9\" (UID: \"959d426a-6437-4684-8afa-d0fcd4f5dc5a\") " pod="openshift-multus/multus-22ss9"
Jul 22 04:24:47.095054 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:24:47.095041    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3e22b9bf-95f2-4186-a5a7-2f1d21feb8b1-metrics-certs\") pod \"network-metrics-daemon-2k7fd\" (UID: \"3e22b9bf-95f2-4186-a5a7-2f1d21feb8b1\") " pod="openshift-multus/network-metrics-daemon-2k7fd"
Jul 22 04:24:47.095332 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:24:47.095082    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/79ad9242-2544-40bf-a872-7cbab7ab0b23-etc-openvswitch\") pod \"ovnkube-node-gjvc2\" (UID: \"79ad9242-2544-40bf-a872-7cbab7ab0b23\") " pod="openshift-ovn-kubernetes/ovnkube-node-gjvc2"
Jul 22 04:24:47.095332 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:24:47.095107    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/79ad9242-2544-40bf-a872-7cbab7ab0b23-run-ovn\") pod \"ovnkube-node-gjvc2\" (UID: \"79ad9242-2544-40bf-a872-7cbab7ab0b23\") " pod="openshift-ovn-kubernetes/ovnkube-node-gjvc2"
Jul 22 04:24:47.095332 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:24:47.095135    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/959d426a-6437-4684-8afa-d0fcd4f5dc5a-multus-socket-dir-parent\") pod \"multus-22ss9\" (UID: \"959d426a-6437-4684-8afa-d0fcd4f5dc5a\") " pod="openshift-multus/multus-22ss9"
Jul 22 04:24:47.095332 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:24:47.095161    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/6e24b2d2-e7a1-4be2-b35b-9dfd42e74727-device-dir\") pod \"aws-ebs-csi-driver-node-t5nr2\" (UID: \"6e24b2d2-e7a1-4be2-b35b-9dfd42e74727\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-t5nr2"
Jul 22 04:24:47.095332 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:24:47.095187    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/79ad9242-2544-40bf-a872-7cbab7ab0b23-host-slash\") pod \"ovnkube-node-gjvc2\" (UID: \"79ad9242-2544-40bf-a872-7cbab7ab0b23\") " pod="openshift-ovn-kubernetes/ovnkube-node-gjvc2"
Jul 22 04:24:47.095332 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:24:47.095213    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lczxw\" (UniqueName: \"kubernetes.io/projected/79ad9242-2544-40bf-a872-7cbab7ab0b23-kube-api-access-lczxw\") pod \"ovnkube-node-gjvc2\" (UID: \"79ad9242-2544-40bf-a872-7cbab7ab0b23\") " pod="openshift-ovn-kubernetes/ovnkube-node-gjvc2"
Jul 22 04:24:47.095332 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:24:47.095240    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/fe3e5ab3-5e5a-48d6-80bd-1d55ae5b06db-etc-sysconfig\") pod \"tuned-ttgt2\" (UID: \"fe3e5ab3-5e5a-48d6-80bd-1d55ae5b06db\") " pod="openshift-cluster-node-tuning-operator/tuned-ttgt2"
Jul 22 04:24:47.095332 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:24:47.095267    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/fe3e5ab3-5e5a-48d6-80bd-1d55ae5b06db-sys\") pod \"tuned-ttgt2\" (UID: \"fe3e5ab3-5e5a-48d6-80bd-1d55ae5b06db\") " pod="openshift-cluster-node-tuning-operator/tuned-ttgt2"
Jul 22 04:24:47.095332 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:24:47.095301    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/fe3e5ab3-5e5a-48d6-80bd-1d55ae5b06db-lib-modules\") pod \"tuned-ttgt2\" (UID: \"fe3e5ab3-5e5a-48d6-80bd-1d55ae5b06db\") " pod="openshift-cluster-node-tuning-operator/tuned-ttgt2"
Jul 22 04:24:47.095332 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:24:47.095328    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/959d426a-6437-4684-8afa-d0fcd4f5dc5a-host-var-lib-cni-bin\") pod \"multus-22ss9\" (UID: \"959d426a-6437-4684-8afa-d0fcd4f5dc5a\") " pod="openshift-multus/multus-22ss9"
Jul 22 04:24:47.095332 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:24:47.095354    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7zr22\" (UniqueName: \"kubernetes.io/projected/959d426a-6437-4684-8afa-d0fcd4f5dc5a-kube-api-access-7zr22\") pod \"multus-22ss9\" (UID: \"959d426a-6437-4684-8afa-d0fcd4f5dc5a\") " pod="openshift-multus/multus-22ss9"
Jul 22 04:24:47.095794 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:24:47.095358    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/79ad9242-2544-40bf-a872-7cbab7ab0b23-run-ovn\") pod \"ovnkube-node-gjvc2\" (UID: \"79ad9242-2544-40bf-a872-7cbab7ab0b23\") " pod="openshift-ovn-kubernetes/ovnkube-node-gjvc2"
Jul 22 04:24:47.095794 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:24:47.095378    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/0d66df01-3af3-4a5c-8fe2-6e10517bbcf5-tmp-dir\") pod \"node-resolver-56sw9\" (UID: \"0d66df01-3af3-4a5c-8fe2-6e10517bbcf5\") " pod="openshift-dns/node-resolver-56sw9"
Jul 22 04:24:47.095794 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:24:47.095461    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/6e24b2d2-e7a1-4be2-b35b-9dfd42e74727-kubelet-dir\") pod \"aws-ebs-csi-driver-node-t5nr2\" (UID: \"6e24b2d2-e7a1-4be2-b35b-9dfd42e74727\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-t5nr2"
Jul 22 04:24:47.095794 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:24:47.095524    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4jwxl\" (UniqueName: \"kubernetes.io/projected/ca6c339f-ddd5-4c9b-801a-e0323cbc2f0e-kube-api-access-4jwxl\") pod \"network-check-target-7x8hk\" (UID: \"ca6c339f-ddd5-4c9b-801a-e0323cbc2f0e\") " pod="openshift-network-diagnostics/network-check-target-7x8hk"
Jul 22 04:24:47.095794 ip-10-0-141-238 kubenswrapper[2563]: E0722 04:24:47.095568    2563 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 22 04:24:47.095794 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:24:47.095613    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/79ad9242-2544-40bf-a872-7cbab7ab0b23-systemd-units\") pod \"ovnkube-node-gjvc2\" (UID: \"79ad9242-2544-40bf-a872-7cbab7ab0b23\") " pod="openshift-ovn-kubernetes/ovnkube-node-gjvc2"
Jul 22 04:24:47.095794 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:24:47.095643    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/959d426a-6437-4684-8afa-d0fcd4f5dc5a-multus-socket-dir-parent\") pod \"multus-22ss9\" (UID: \"959d426a-6437-4684-8afa-d0fcd4f5dc5a\") " pod="openshift-multus/multus-22ss9"
Jul 22 04:24:47.095794 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:24:47.095643    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/fe3e5ab3-5e5a-48d6-80bd-1d55ae5b06db-etc-sysconfig\") pod \"tuned-ttgt2\" (UID: \"fe3e5ab3-5e5a-48d6-80bd-1d55ae5b06db\") " pod="openshift-cluster-node-tuning-operator/tuned-ttgt2"
Jul 22 04:24:47.095794 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:24:47.095663    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/79ad9242-2544-40bf-a872-7cbab7ab0b23-etc-openvswitch\") pod \"ovnkube-node-gjvc2\" (UID: \"79ad9242-2544-40bf-a872-7cbab7ab0b23\") " pod="openshift-ovn-kubernetes/ovnkube-node-gjvc2"
Jul 22 04:24:47.095794 ip-10-0-141-238 kubenswrapper[2563]: E0722 04:24:47.095652    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3e22b9bf-95f2-4186-a5a7-2f1d21feb8b1-metrics-certs podName:3e22b9bf-95f2-4186-a5a7-2f1d21feb8b1 nodeName:}" failed. No retries permitted until 2026-07-22 04:24:47.595627963 +0000 UTC m=+3.014636718 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/3e22b9bf-95f2-4186-a5a7-2f1d21feb8b1-metrics-certs") pod "network-metrics-daemon-2k7fd" (UID: "3e22b9bf-95f2-4186-a5a7-2f1d21feb8b1") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 22 04:24:47.095794 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:24:47.095705    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/6e24b2d2-e7a1-4be2-b35b-9dfd42e74727-kubelet-dir\") pod \"aws-ebs-csi-driver-node-t5nr2\" (UID: \"6e24b2d2-e7a1-4be2-b35b-9dfd42e74727\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-t5nr2"
Jul 22 04:24:47.095794 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:24:47.095714    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/6e24b2d2-e7a1-4be2-b35b-9dfd42e74727-device-dir\") pod \"aws-ebs-csi-driver-node-t5nr2\" (UID: \"6e24b2d2-e7a1-4be2-b35b-9dfd42e74727\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-t5nr2"
Jul 22 04:24:47.095794 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:24:47.095713    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/0d66df01-3af3-4a5c-8fe2-6e10517bbcf5-tmp-dir\") pod \"node-resolver-56sw9\" (UID: \"0d66df01-3af3-4a5c-8fe2-6e10517bbcf5\") " pod="openshift-dns/node-resolver-56sw9"
Jul 22 04:24:47.095794 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:24:47.095568    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/79ad9242-2544-40bf-a872-7cbab7ab0b23-systemd-units\") pod \"ovnkube-node-gjvc2\" (UID: \"79ad9242-2544-40bf-a872-7cbab7ab0b23\") " pod="openshift-ovn-kubernetes/ovnkube-node-gjvc2"
Jul 22 04:24:47.095794 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:24:47.095763    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/fe3e5ab3-5e5a-48d6-80bd-1d55ae5b06db-sys\") pod \"tuned-ttgt2\" (UID: \"fe3e5ab3-5e5a-48d6-80bd-1d55ae5b06db\") " pod="openshift-cluster-node-tuning-operator/tuned-ttgt2"
Jul 22 04:24:47.096489 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:24:47.095797    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/6e24b2d2-e7a1-4be2-b35b-9dfd42e74727-sys-fs\") pod \"aws-ebs-csi-driver-node-t5nr2\" (UID: \"6e24b2d2-e7a1-4be2-b35b-9dfd42e74727\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-t5nr2"
Jul 22 04:24:47.096489 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:24:47.095764    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/79ad9242-2544-40bf-a872-7cbab7ab0b23-host-slash\") pod \"ovnkube-node-gjvc2\" (UID: \"79ad9242-2544-40bf-a872-7cbab7ab0b23\") " pod="openshift-ovn-kubernetes/ovnkube-node-gjvc2"
Jul 22 04:24:47.096489 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:24:47.095861    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/79ad9242-2544-40bf-a872-7cbab7ab0b23-ovnkube-script-lib\") pod \"ovnkube-node-gjvc2\" (UID: \"79ad9242-2544-40bf-a872-7cbab7ab0b23\") " pod="openshift-ovn-kubernetes/ovnkube-node-gjvc2"
Jul 22 04:24:47.096489 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:24:47.095901    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/959d426a-6437-4684-8afa-d0fcd4f5dc5a-host-run-netns\") pod \"multus-22ss9\" (UID: \"959d426a-6437-4684-8afa-d0fcd4f5dc5a\") " pod="openshift-multus/multus-22ss9"
Jul 22 04:24:47.096489 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:24:47.095927    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dwtw2\" (UniqueName: \"kubernetes.io/projected/fe3e5ab3-5e5a-48d6-80bd-1d55ae5b06db-kube-api-access-dwtw2\") pod \"tuned-ttgt2\" (UID: \"fe3e5ab3-5e5a-48d6-80bd-1d55ae5b06db\") " pod="openshift-cluster-node-tuning-operator/tuned-ttgt2"
Jul 22 04:24:47.096489 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:24:47.095957    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/959d426a-6437-4684-8afa-d0fcd4f5dc5a-host-var-lib-cni-multus\") pod \"multus-22ss9\" (UID: \"959d426a-6437-4684-8afa-d0fcd4f5dc5a\") " pod="openshift-multus/multus-22ss9"
Jul 22 04:24:47.096489 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:24:47.095969    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/6e24b2d2-e7a1-4be2-b35b-9dfd42e74727-sys-fs\") pod \"aws-ebs-csi-driver-node-t5nr2\" (UID: \"6e24b2d2-e7a1-4be2-b35b-9dfd42e74727\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-t5nr2"
Jul 22 04:24:47.096489 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:24:47.095987    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/959d426a-6437-4684-8afa-d0fcd4f5dc5a-multus-cni-dir\") pod \"multus-22ss9\" (UID: \"959d426a-6437-4684-8afa-d0fcd4f5dc5a\") " pod="openshift-multus/multus-22ss9"
Jul 22 04:24:47.096489 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:24:47.095994    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/959d426a-6437-4684-8afa-d0fcd4f5dc5a-host-var-lib-cni-bin\") pod \"multus-22ss9\" (UID: \"959d426a-6437-4684-8afa-d0fcd4f5dc5a\") " pod="openshift-multus/multus-22ss9"
Jul 22 04:24:47.096489 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:24:47.096016    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/959d426a-6437-4684-8afa-d0fcd4f5dc5a-cnibin\") pod \"multus-22ss9\" (UID: \"959d426a-6437-4684-8afa-d0fcd4f5dc5a\") " pod="openshift-multus/multus-22ss9"
Jul 22 04:24:47.096489 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:24:47.096044    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/959d426a-6437-4684-8afa-d0fcd4f5dc5a-host-run-k8s-cni-cncf-io\") pod \"multus-22ss9\" (UID: \"959d426a-6437-4684-8afa-d0fcd4f5dc5a\") " pod="openshift-multus/multus-22ss9"
Jul 22 04:24:47.096489 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:24:47.096066    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/959d426a-6437-4684-8afa-d0fcd4f5dc5a-multus-conf-dir\") pod \"multus-22ss9\" (UID: \"959d426a-6437-4684-8afa-d0fcd4f5dc5a\") " pod="openshift-multus/multus-22ss9"
Jul 22 04:24:47.096489 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:24:47.096016    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/959d426a-6437-4684-8afa-d0fcd4f5dc5a-host-var-lib-cni-multus\") pod \"multus-22ss9\" (UID: \"959d426a-6437-4684-8afa-d0fcd4f5dc5a\") " pod="openshift-multus/multus-22ss9"
Jul 22 04:24:47.096489 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:24:47.096088    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/0d66df01-3af3-4a5c-8fe2-6e10517bbcf5-hosts-file\") pod \"node-resolver-56sw9\" (UID: \"0d66df01-3af3-4a5c-8fe2-6e10517bbcf5\") " pod="openshift-dns/node-resolver-56sw9"
Jul 22 04:24:47.096489 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:24:47.096131    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/fe3e5ab3-5e5a-48d6-80bd-1d55ae5b06db-etc-sysctl-conf\") pod \"tuned-ttgt2\" (UID: \"fe3e5ab3-5e5a-48d6-80bd-1d55ae5b06db\") " pod="openshift-cluster-node-tuning-operator/tuned-ttgt2"
Jul 22 04:24:47.096489 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:24:47.096155    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/fe3e5ab3-5e5a-48d6-80bd-1d55ae5b06db-run\") pod \"tuned-ttgt2\" (UID: \"fe3e5ab3-5e5a-48d6-80bd-1d55ae5b06db\") " pod="openshift-cluster-node-tuning-operator/tuned-ttgt2"
Jul 22 04:24:47.096489 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:24:47.096175    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/959d426a-6437-4684-8afa-d0fcd4f5dc5a-cnibin\") pod \"multus-22ss9\" (UID: \"959d426a-6437-4684-8afa-d0fcd4f5dc5a\") " pod="openshift-multus/multus-22ss9"
Jul 22 04:24:47.096489 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:24:47.095958    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/fe3e5ab3-5e5a-48d6-80bd-1d55ae5b06db-lib-modules\") pod \"tuned-ttgt2\" (UID: \"fe3e5ab3-5e5a-48d6-80bd-1d55ae5b06db\") " pod="openshift-cluster-node-tuning-operator/tuned-ttgt2"
Jul 22 04:24:47.097429 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:24:47.096193    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/959d426a-6437-4684-8afa-d0fcd4f5dc5a-multus-cni-dir\") pod \"multus-22ss9\" (UID: \"959d426a-6437-4684-8afa-d0fcd4f5dc5a\") " pod="openshift-multus/multus-22ss9"
Jul 22 04:24:47.097429 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:24:47.096215    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/fe3e5ab3-5e5a-48d6-80bd-1d55ae5b06db-run\") pod \"tuned-ttgt2\" (UID: \"fe3e5ab3-5e5a-48d6-80bd-1d55ae5b06db\") " pod="openshift-cluster-node-tuning-operator/tuned-ttgt2"
Jul 22 04:24:47.097429 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:24:47.096235    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/959d426a-6437-4684-8afa-d0fcd4f5dc5a-multus-conf-dir\") pod \"multus-22ss9\" (UID: \"959d426a-6437-4684-8afa-d0fcd4f5dc5a\") " pod="openshift-multus/multus-22ss9"
Jul 22 04:24:47.097429 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:24:47.096266    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/959d426a-6437-4684-8afa-d0fcd4f5dc5a-host-run-k8s-cni-cncf-io\") pod \"multus-22ss9\" (UID: \"959d426a-6437-4684-8afa-d0fcd4f5dc5a\") " pod="openshift-multus/multus-22ss9"
Jul 22 04:24:47.097429 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:24:47.096279    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/0d66df01-3af3-4a5c-8fe2-6e10517bbcf5-hosts-file\") pod \"node-resolver-56sw9\" (UID: \"0d66df01-3af3-4a5c-8fe2-6e10517bbcf5\") " pod="openshift-dns/node-resolver-56sw9"
Jul 22 04:24:47.097429 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:24:47.096320    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bzx2r\" (UniqueName: \"kubernetes.io/projected/3e22b9bf-95f2-4186-a5a7-2f1d21feb8b1-kube-api-access-bzx2r\") pod \"network-metrics-daemon-2k7fd\" (UID: \"3e22b9bf-95f2-4186-a5a7-2f1d21feb8b1\") " pod="openshift-multus/network-metrics-daemon-2k7fd"
Jul 22 04:24:47.097429 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:24:47.096356    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/bc2f671d-2057-4b94-8e5c-e6d3cdcdd74e-kubelet-config\") pod \"global-pull-secret-syncer-k2znt\" (UID: \"bc2f671d-2057-4b94-8e5c-e6d3cdcdd74e\") " pod="kube-system/global-pull-secret-syncer-k2znt"
Jul 22 04:24:47.097429 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:24:47.096387    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/79ad9242-2544-40bf-a872-7cbab7ab0b23-node-log\") pod \"ovnkube-node-gjvc2\" (UID: \"79ad9242-2544-40bf-a872-7cbab7ab0b23\") " pod="openshift-ovn-kubernetes/ovnkube-node-gjvc2"
Jul 22 04:24:47.097429 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:24:47.096395    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/bc2f671d-2057-4b94-8e5c-e6d3cdcdd74e-kubelet-config\") pod \"global-pull-secret-syncer-k2znt\" (UID: \"bc2f671d-2057-4b94-8e5c-e6d3cdcdd74e\") " pod="kube-system/global-pull-secret-syncer-k2znt"
Jul 22 04:24:47.097429 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:24:47.096359    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/fe3e5ab3-5e5a-48d6-80bd-1d55ae5b06db-etc-sysctl-conf\") pod \"tuned-ttgt2\" (UID: \"fe3e5ab3-5e5a-48d6-80bd-1d55ae5b06db\") " pod="openshift-cluster-node-tuning-operator/tuned-ttgt2"
Jul 22 04:24:47.097429 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:24:47.096414    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/fe3e5ab3-5e5a-48d6-80bd-1d55ae5b06db-etc-modprobe-d\") pod \"tuned-ttgt2\" (UID: \"fe3e5ab3-5e5a-48d6-80bd-1d55ae5b06db\") " pod="openshift-cluster-node-tuning-operator/tuned-ttgt2"
Jul 22 04:24:47.097429 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:24:47.096443    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/79ad9242-2544-40bf-a872-7cbab7ab0b23-node-log\") pod \"ovnkube-node-gjvc2\" (UID: \"79ad9242-2544-40bf-a872-7cbab7ab0b23\") " pod="openshift-ovn-kubernetes/ovnkube-node-gjvc2"
Jul 22 04:24:47.097429 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:24:47.096442    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/fe3e5ab3-5e5a-48d6-80bd-1d55ae5b06db-var-lib-kubelet\") pod \"tuned-ttgt2\" (UID: \"fe3e5ab3-5e5a-48d6-80bd-1d55ae5b06db\") " pod="openshift-cluster-node-tuning-operator/tuned-ttgt2"
Jul 22 04:24:47.097429 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:24:47.096499    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/b4af3ae5-fa65-4358-8399-6ed11b68616e-konnectivity-ca\") pod \"konnectivity-agent-j9gvx\" (UID: \"b4af3ae5-fa65-4358-8399-6ed11b68616e\") " pod="kube-system/konnectivity-agent-j9gvx"
Jul 22 04:24:47.097429 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:24:47.096527    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/79ad9242-2544-40bf-a872-7cbab7ab0b23-host-cni-netd\") pod \"ovnkube-node-gjvc2\" (UID: \"79ad9242-2544-40bf-a872-7cbab7ab0b23\") " pod="openshift-ovn-kubernetes/ovnkube-node-gjvc2"
Jul 22 04:24:47.097429 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:24:47.096539    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/79ad9242-2544-40bf-a872-7cbab7ab0b23-ovnkube-script-lib\") pod \"ovnkube-node-gjvc2\" (UID: \"79ad9242-2544-40bf-a872-7cbab7ab0b23\") " pod="openshift-ovn-kubernetes/ovnkube-node-gjvc2"
Jul 22 04:24:47.097429 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:24:47.096554    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/fe3e5ab3-5e5a-48d6-80bd-1d55ae5b06db-etc-systemd\") pod \"tuned-ttgt2\" (UID: \"fe3e5ab3-5e5a-48d6-80bd-1d55ae5b06db\") " pod="openshift-cluster-node-tuning-operator/tuned-ttgt2"
Jul 22 04:24:47.097429 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:24:47.096552    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/fe3e5ab3-5e5a-48d6-80bd-1d55ae5b06db-etc-modprobe-d\") pod \"tuned-ttgt2\" (UID: \"fe3e5ab3-5e5a-48d6-80bd-1d55ae5b06db\") " pod="openshift-cluster-node-tuning-operator/tuned-ttgt2"
Jul 22 04:24:47.098326 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:24:47.096572    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/fe3e5ab3-5e5a-48d6-80bd-1d55ae5b06db-var-lib-kubelet\") pod \"tuned-ttgt2\" (UID: \"fe3e5ab3-5e5a-48d6-80bd-1d55ae5b06db\") " pod="openshift-cluster-node-tuning-operator/tuned-ttgt2"
Jul 22 04:24:47.098326 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:24:47.096598    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/959d426a-6437-4684-8afa-d0fcd4f5dc5a-os-release\") pod \"multus-22ss9\" (UID: \"959d426a-6437-4684-8afa-d0fcd4f5dc5a\") " pod="openshift-multus/multus-22ss9"
Jul 22 04:24:47.098326 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:24:47.096591    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/79ad9242-2544-40bf-a872-7cbab7ab0b23-host-cni-netd\") pod \"ovnkube-node-gjvc2\" (UID: \"79ad9242-2544-40bf-a872-7cbab7ab0b23\") " pod="openshift-ovn-kubernetes/ovnkube-node-gjvc2"
Jul 22 04:24:47.098326 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:24:47.096612    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/fe3e5ab3-5e5a-48d6-80bd-1d55ae5b06db-etc-systemd\") pod \"tuned-ttgt2\" (UID: \"fe3e5ab3-5e5a-48d6-80bd-1d55ae5b06db\") " pod="openshift-cluster-node-tuning-operator/tuned-ttgt2"
Jul 22 04:24:47.098326 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:24:47.096630    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/959d426a-6437-4684-8afa-d0fcd4f5dc5a-host-var-lib-kubelet\") pod \"multus-22ss9\" (UID: \"959d426a-6437-4684-8afa-d0fcd4f5dc5a\") " pod="openshift-multus/multus-22ss9"
Jul 22 04:24:47.098326 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:24:47.096660    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rvm2s\" (UniqueName: \"kubernetes.io/projected/6e24b2d2-e7a1-4be2-b35b-9dfd42e74727-kube-api-access-rvm2s\") pod \"aws-ebs-csi-driver-node-t5nr2\" (UID: \"6e24b2d2-e7a1-4be2-b35b-9dfd42e74727\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-t5nr2"
Jul 22 04:24:47.098326 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:24:47.096677    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/959d426a-6437-4684-8afa-d0fcd4f5dc5a-os-release\") pod \"multus-22ss9\" (UID: \"959d426a-6437-4684-8afa-d0fcd4f5dc5a\") " pod="openshift-multus/multus-22ss9"
Jul 22 04:24:47.098326 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:24:47.096688    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/79ad9242-2544-40bf-a872-7cbab7ab0b23-env-overrides\") pod \"ovnkube-node-gjvc2\" (UID: \"79ad9242-2544-40bf-a872-7cbab7ab0b23\") " pod="openshift-ovn-kubernetes/ovnkube-node-gjvc2"
Jul 22 04:24:47.098326 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:24:47.096725    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/959d426a-6437-4684-8afa-d0fcd4f5dc5a-host-var-lib-kubelet\") pod \"multus-22ss9\" (UID: \"959d426a-6437-4684-8afa-d0fcd4f5dc5a\") " pod="openshift-multus/multus-22ss9"
Jul 22 04:24:47.098326 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:24:47.096833    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/fe3e5ab3-5e5a-48d6-80bd-1d55ae5b06db-etc-tuned\") pod \"tuned-ttgt2\" (UID: \"fe3e5ab3-5e5a-48d6-80bd-1d55ae5b06db\") " pod="openshift-cluster-node-tuning-operator/tuned-ttgt2"
Jul 22 04:24:47.098326 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:24:47.096871    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/959d426a-6437-4684-8afa-d0fcd4f5dc5a-multus-daemon-config\") pod \"multus-22ss9\" (UID: \"959d426a-6437-4684-8afa-d0fcd4f5dc5a\") " pod="openshift-multus/multus-22ss9"
Jul 22 04:24:47.098326 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:24:47.096904    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/79ad9242-2544-40bf-a872-7cbab7ab0b23-host-run-netns\") pod \"ovnkube-node-gjvc2\" (UID: \"79ad9242-2544-40bf-a872-7cbab7ab0b23\") " pod="openshift-ovn-kubernetes/ovnkube-node-gjvc2"
Jul 22 04:24:47.098326 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:24:47.096932    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/79ad9242-2544-40bf-a872-7cbab7ab0b23-ovnkube-config\") pod \"ovnkube-node-gjvc2\" (UID: \"79ad9242-2544-40bf-a872-7cbab7ab0b23\") " pod="openshift-ovn-kubernetes/ovnkube-node-gjvc2"
Jul 22 04:24:47.098326 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:24:47.096974    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/fe3e5ab3-5e5a-48d6-80bd-1d55ae5b06db-etc-kubernetes\") pod \"tuned-ttgt2\" (UID: \"fe3e5ab3-5e5a-48d6-80bd-1d55ae5b06db\") " pod="openshift-cluster-node-tuning-operator/tuned-ttgt2"
Jul 22 04:24:47.098326 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:24:47.097002    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/959d426a-6437-4684-8afa-d0fcd4f5dc5a-host-run-multus-certs\") pod \"multus-22ss9\" (UID: \"959d426a-6437-4684-8afa-d0fcd4f5dc5a\") " pod="openshift-multus/multus-22ss9"
Jul 22 04:24:47.098326 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:24:47.097041    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/b4af3ae5-fa65-4358-8399-6ed11b68616e-agent-certs\") pod \"konnectivity-agent-j9gvx\" (UID: \"b4af3ae5-fa65-4358-8399-6ed11b68616e\") " pod="kube-system/konnectivity-agent-j9gvx"
Jul 22 04:24:47.098326 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:24:47.097081    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/79ad9242-2544-40bf-a872-7cbab7ab0b23-host-kubelet\") pod \"ovnkube-node-gjvc2\" (UID: \"79ad9242-2544-40bf-a872-7cbab7ab0b23\") " pod="openshift-ovn-kubernetes/ovnkube-node-gjvc2"
Jul 22 04:24:47.098326 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:24:47.097085    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/79ad9242-2544-40bf-a872-7cbab7ab0b23-env-overrides\") pod \"ovnkube-node-gjvc2\" (UID: \"79ad9242-2544-40bf-a872-7cbab7ab0b23\") " pod="openshift-ovn-kubernetes/ovnkube-node-gjvc2"
Jul 22 04:24:47.099316 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:24:47.097111    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/79ad9242-2544-40bf-a872-7cbab7ab0b23-run-openvswitch\") pod \"ovnkube-node-gjvc2\" (UID: \"79ad9242-2544-40bf-a872-7cbab7ab0b23\") " pod="openshift-ovn-kubernetes/ovnkube-node-gjvc2"
Jul 22 04:24:47.099316 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:24:47.097138    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/79ad9242-2544-40bf-a872-7cbab7ab0b23-log-socket\") pod \"ovnkube-node-gjvc2\" (UID: \"79ad9242-2544-40bf-a872-7cbab7ab0b23\") " pod="openshift-ovn-kubernetes/ovnkube-node-gjvc2"
Jul 22 04:24:47.099316 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:24:47.097163    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/fe3e5ab3-5e5a-48d6-80bd-1d55ae5b06db-tmp\") pod \"tuned-ttgt2\" (UID: \"fe3e5ab3-5e5a-48d6-80bd-1d55ae5b06db\") " pod="openshift-cluster-node-tuning-operator/tuned-ttgt2"
Jul 22 04:24:47.099316 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:24:47.097193    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/79ad9242-2544-40bf-a872-7cbab7ab0b23-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-gjvc2\" (UID: \"79ad9242-2544-40bf-a872-7cbab7ab0b23\") " pod="openshift-ovn-kubernetes/ovnkube-node-gjvc2"
Jul 22 04:24:47.099316 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:24:47.097201    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/b4af3ae5-fa65-4358-8399-6ed11b68616e-konnectivity-ca\") pod \"konnectivity-agent-j9gvx\" (UID: \"b4af3ae5-fa65-4358-8399-6ed11b68616e\") " pod="kube-system/konnectivity-agent-j9gvx"
Jul 22 04:24:47.099316 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:24:47.097198    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/79ad9242-2544-40bf-a872-7cbab7ab0b23-host-run-netns\") pod \"ovnkube-node-gjvc2\" (UID: \"79ad9242-2544-40bf-a872-7cbab7ab0b23\") " pod="openshift-ovn-kubernetes/ovnkube-node-gjvc2"
Jul 22 04:24:47.099316 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:24:47.097297    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/79ad9242-2544-40bf-a872-7cbab7ab0b23-log-socket\") pod \"ovnkube-node-gjvc2\" (UID: \"79ad9242-2544-40bf-a872-7cbab7ab0b23\") " pod="openshift-ovn-kubernetes/ovnkube-node-gjvc2"
Jul 22 04:24:47.099316 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:24:47.097165    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/fe3e5ab3-5e5a-48d6-80bd-1d55ae5b06db-etc-kubernetes\") pod \"tuned-ttgt2\" (UID: \"fe3e5ab3-5e5a-48d6-80bd-1d55ae5b06db\") " pod="openshift-cluster-node-tuning-operator/tuned-ttgt2"
Jul 22 04:24:47.099316 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:24:47.097359    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/79ad9242-2544-40bf-a872-7cbab7ab0b23-host-kubelet\") pod \"ovnkube-node-gjvc2\" (UID: \"79ad9242-2544-40bf-a872-7cbab7ab0b23\") " pod="openshift-ovn-kubernetes/ovnkube-node-gjvc2"
Jul 22 04:24:47.099316 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:24:47.097363    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/79ad9242-2544-40bf-a872-7cbab7ab0b23-run-openvswitch\") pod \"ovnkube-node-gjvc2\" (UID: \"79ad9242-2544-40bf-a872-7cbab7ab0b23\") " pod="openshift-ovn-kubernetes/ovnkube-node-gjvc2"
Jul 22 04:24:47.099316 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:24:47.097407    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/79ad9242-2544-40bf-a872-7cbab7ab0b23-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-gjvc2\" (UID: \"79ad9242-2544-40bf-a872-7cbab7ab0b23\") " pod="openshift-ovn-kubernetes/ovnkube-node-gjvc2"
Jul 22 04:24:47.099316 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:24:47.097411    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/959d426a-6437-4684-8afa-d0fcd4f5dc5a-host-run-multus-certs\") pod \"multus-22ss9\" (UID: \"959d426a-6437-4684-8afa-d0fcd4f5dc5a\") " pod="openshift-multus/multus-22ss9"
Jul 22 04:24:47.099316 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:24:47.097521    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/79ad9242-2544-40bf-a872-7cbab7ab0b23-ovn-node-metrics-cert\") pod \"ovnkube-node-gjvc2\" (UID: \"79ad9242-2544-40bf-a872-7cbab7ab0b23\") " pod="openshift-ovn-kubernetes/ovnkube-node-gjvc2"
Jul 22 04:24:47.099316 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:24:47.097545    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/959d426a-6437-4684-8afa-d0fcd4f5dc5a-multus-daemon-config\") pod \"multus-22ss9\" (UID: \"959d426a-6437-4684-8afa-d0fcd4f5dc5a\") " pod="openshift-multus/multus-22ss9"
Jul 22 04:24:47.099316 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:24:47.097552    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/fe3e5ab3-5e5a-48d6-80bd-1d55ae5b06db-host\") pod \"tuned-ttgt2\" (UID: \"fe3e5ab3-5e5a-48d6-80bd-1d55ae5b06db\") " pod="openshift-cluster-node-tuning-operator/tuned-ttgt2"
Jul 22 04:24:47.099316 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:24:47.097595    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/fe3e5ab3-5e5a-48d6-80bd-1d55ae5b06db-host\") pod \"tuned-ttgt2\" (UID: \"fe3e5ab3-5e5a-48d6-80bd-1d55ae5b06db\") " pod="openshift-cluster-node-tuning-operator/tuned-ttgt2"
Jul 22 04:24:47.099316 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:24:47.097602    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/959d426a-6437-4684-8afa-d0fcd4f5dc5a-hostroot\") pod \"multus-22ss9\" (UID: \"959d426a-6437-4684-8afa-d0fcd4f5dc5a\") " pod="openshift-multus/multus-22ss9"
Jul 22 04:24:47.099316 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:24:47.097643    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/959d426a-6437-4684-8afa-d0fcd4f5dc5a-hostroot\") pod \"multus-22ss9\" (UID: \"959d426a-6437-4684-8afa-d0fcd4f5dc5a\") " pod="openshift-multus/multus-22ss9"
Jul 22 04:24:47.100209 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:24:47.097644    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/79ad9242-2544-40bf-a872-7cbab7ab0b23-run-systemd\") pod \"ovnkube-node-gjvc2\" (UID: \"79ad9242-2544-40bf-a872-7cbab7ab0b23\") " pod="openshift-ovn-kubernetes/ovnkube-node-gjvc2"
Jul 22 04:24:47.100209 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:24:47.097676    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/fe3e5ab3-5e5a-48d6-80bd-1d55ae5b06db-etc-sysctl-d\") pod \"tuned-ttgt2\" (UID: \"fe3e5ab3-5e5a-48d6-80bd-1d55ae5b06db\") " pod="openshift-cluster-node-tuning-operator/tuned-ttgt2"
Jul 22 04:24:47.100209 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:24:47.097680    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/79ad9242-2544-40bf-a872-7cbab7ab0b23-run-systemd\") pod \"ovnkube-node-gjvc2\" (UID: \"79ad9242-2544-40bf-a872-7cbab7ab0b23\") " pod="openshift-ovn-kubernetes/ovnkube-node-gjvc2"
Jul 22 04:24:47.100209 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:24:47.097690    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/79ad9242-2544-40bf-a872-7cbab7ab0b23-ovnkube-config\") pod \"ovnkube-node-gjvc2\" (UID: \"79ad9242-2544-40bf-a872-7cbab7ab0b23\") " pod="openshift-ovn-kubernetes/ovnkube-node-gjvc2"
Jul 22 04:24:47.100209 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:24:47.097717    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/bc2f671d-2057-4b94-8e5c-e6d3cdcdd74e-original-pull-secret\") pod \"global-pull-secret-syncer-k2znt\" (UID: \"bc2f671d-2057-4b94-8e5c-e6d3cdcdd74e\") " pod="kube-system/global-pull-secret-syncer-k2znt"
Jul 22 04:24:47.100209 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:24:47.097747    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/959d426a-6437-4684-8afa-d0fcd4f5dc5a-system-cni-dir\") pod \"multus-22ss9\" (UID: \"959d426a-6437-4684-8afa-d0fcd4f5dc5a\") " pod="openshift-multus/multus-22ss9"
Jul 22 04:24:47.100209 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:24:47.097769    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/959d426a-6437-4684-8afa-d0fcd4f5dc5a-etc-kubernetes\") pod \"multus-22ss9\" (UID: \"959d426a-6437-4684-8afa-d0fcd4f5dc5a\") " pod="openshift-multus/multus-22ss9"
Jul 22 04:24:47.100209 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:24:47.097795    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/fe3e5ab3-5e5a-48d6-80bd-1d55ae5b06db-etc-sysctl-d\") pod \"tuned-ttgt2\" (UID: \"fe3e5ab3-5e5a-48d6-80bd-1d55ae5b06db\") " pod="openshift-cluster-node-tuning-operator/tuned-ttgt2"
Jul 22 04:24:47.100209 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:24:47.097796    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/79ad9242-2544-40bf-a872-7cbab7ab0b23-var-lib-openvswitch\") pod \"ovnkube-node-gjvc2\" (UID: \"79ad9242-2544-40bf-a872-7cbab7ab0b23\") " pod="openshift-ovn-kubernetes/ovnkube-node-gjvc2"
Jul 22 04:24:47.100209 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:24:47.097825    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/959d426a-6437-4684-8afa-d0fcd4f5dc5a-system-cni-dir\") pod \"multus-22ss9\" (UID: \"959d426a-6437-4684-8afa-d0fcd4f5dc5a\") " pod="openshift-multus/multus-22ss9"
Jul 22 04:24:47.100209 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:24:47.097830    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/bc2f671d-2057-4b94-8e5c-e6d3cdcdd74e-dbus\") pod \"global-pull-secret-syncer-k2znt\" (UID: \"bc2f671d-2057-4b94-8e5c-e6d3cdcdd74e\") " pod="kube-system/global-pull-secret-syncer-k2znt"
Jul 22 04:24:47.100209 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:24:47.097828    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/79ad9242-2544-40bf-a872-7cbab7ab0b23-var-lib-openvswitch\") pod \"ovnkube-node-gjvc2\" (UID: \"79ad9242-2544-40bf-a872-7cbab7ab0b23\") " pod="openshift-ovn-kubernetes/ovnkube-node-gjvc2"
Jul 22 04:24:47.100209 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:24:47.097859    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/959d426a-6437-4684-8afa-d0fcd4f5dc5a-cni-binary-copy\") pod \"multus-22ss9\" (UID: \"959d426a-6437-4684-8afa-d0fcd4f5dc5a\") " pod="openshift-multus/multus-22ss9"
Jul 22 04:24:47.100209 ip-10-0-141-238 kubenswrapper[2563]: E0722 04:24:47.097871    2563 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 22 04:24:47.100209 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:24:47.097887    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/bc2f671d-2057-4b94-8e5c-e6d3cdcdd74e-dbus\") pod \"global-pull-secret-syncer-k2znt\" (UID: \"bc2f671d-2057-4b94-8e5c-e6d3cdcdd74e\") " pod="kube-system/global-pull-secret-syncer-k2znt"
Jul 22 04:24:47.100209 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:24:47.097934    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/6e24b2d2-e7a1-4be2-b35b-9dfd42e74727-registration-dir\") pod \"aws-ebs-csi-driver-node-t5nr2\" (UID: \"6e24b2d2-e7a1-4be2-b35b-9dfd42e74727\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-t5nr2"
Jul 22 04:24:47.100209 ip-10-0-141-238 kubenswrapper[2563]: E0722 04:24:47.097944    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/bc2f671d-2057-4b94-8e5c-e6d3cdcdd74e-original-pull-secret podName:bc2f671d-2057-4b94-8e5c-e6d3cdcdd74e nodeName:}" failed. No retries permitted until 2026-07-22 04:24:47.597925185 +0000 UTC m=+3.016933926 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/bc2f671d-2057-4b94-8e5c-e6d3cdcdd74e-original-pull-secret") pod "global-pull-secret-syncer-k2znt" (UID: "bc2f671d-2057-4b94-8e5c-e6d3cdcdd74e") : object "kube-system"/"original-pull-secret" not registered
Jul 22 04:24:47.101318 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:24:47.097887    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/6e24b2d2-e7a1-4be2-b35b-9dfd42e74727-registration-dir\") pod \"aws-ebs-csi-driver-node-t5nr2\" (UID: \"6e24b2d2-e7a1-4be2-b35b-9dfd42e74727\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-t5nr2"
Jul 22 04:24:47.101318 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:24:47.097966    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/959d426a-6437-4684-8afa-d0fcd4f5dc5a-etc-kubernetes\") pod \"multus-22ss9\" (UID: \"959d426a-6437-4684-8afa-d0fcd4f5dc5a\") " pod="openshift-multus/multus-22ss9"
Jul 22 04:24:47.101318 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:24:47.097990    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/6e24b2d2-e7a1-4be2-b35b-9dfd42e74727-etc-selinux\") pod \"aws-ebs-csi-driver-node-t5nr2\" (UID: \"6e24b2d2-e7a1-4be2-b35b-9dfd42e74727\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-t5nr2"
Jul 22 04:24:47.101318 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:24:47.098019    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/6e24b2d2-e7a1-4be2-b35b-9dfd42e74727-socket-dir\") pod \"aws-ebs-csi-driver-node-t5nr2\" (UID: \"6e24b2d2-e7a1-4be2-b35b-9dfd42e74727\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-t5nr2"
Jul 22 04:24:47.101318 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:24:47.098047    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/79ad9242-2544-40bf-a872-7cbab7ab0b23-host-run-ovn-kubernetes\") pod \"ovnkube-node-gjvc2\" (UID: \"79ad9242-2544-40bf-a872-7cbab7ab0b23\") " pod="openshift-ovn-kubernetes/ovnkube-node-gjvc2"
Jul 22 04:24:47.101318 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:24:47.098094    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/79ad9242-2544-40bf-a872-7cbab7ab0b23-host-cni-bin\") pod \"ovnkube-node-gjvc2\" (UID: \"79ad9242-2544-40bf-a872-7cbab7ab0b23\") " pod="openshift-ovn-kubernetes/ovnkube-node-gjvc2"
Jul 22 04:24:47.101318 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:24:47.098140    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/6e24b2d2-e7a1-4be2-b35b-9dfd42e74727-etc-selinux\") pod \"aws-ebs-csi-driver-node-t5nr2\" (UID: \"6e24b2d2-e7a1-4be2-b35b-9dfd42e74727\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-t5nr2"
Jul 22 04:24:47.101318 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:24:47.098189    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/79ad9242-2544-40bf-a872-7cbab7ab0b23-host-run-ovn-kubernetes\") pod \"ovnkube-node-gjvc2\" (UID: \"79ad9242-2544-40bf-a872-7cbab7ab0b23\") " pod="openshift-ovn-kubernetes/ovnkube-node-gjvc2"
Jul 22 04:24:47.101318 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:24:47.098254    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/6e24b2d2-e7a1-4be2-b35b-9dfd42e74727-socket-dir\") pod \"aws-ebs-csi-driver-node-t5nr2\" (UID: \"6e24b2d2-e7a1-4be2-b35b-9dfd42e74727\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-t5nr2"
Jul 22 04:24:47.101318 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:24:47.098313    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/79ad9242-2544-40bf-a872-7cbab7ab0b23-host-cni-bin\") pod \"ovnkube-node-gjvc2\" (UID: \"79ad9242-2544-40bf-a872-7cbab7ab0b23\") " pod="openshift-ovn-kubernetes/ovnkube-node-gjvc2"
Jul 22 04:24:47.101318 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:24:47.098369    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/959d426a-6437-4684-8afa-d0fcd4f5dc5a-cni-binary-copy\") pod \"multus-22ss9\" (UID: \"959d426a-6437-4684-8afa-d0fcd4f5dc5a\") " pod="openshift-multus/multus-22ss9"
Jul 22 04:24:47.101878 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:24:47.101387    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/79ad9242-2544-40bf-a872-7cbab7ab0b23-ovn-node-metrics-cert\") pod \"ovnkube-node-gjvc2\" (UID: \"79ad9242-2544-40bf-a872-7cbab7ab0b23\") " pod="openshift-ovn-kubernetes/ovnkube-node-gjvc2"
Jul 22 04:24:47.102465 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:24:47.102433    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/fe3e5ab3-5e5a-48d6-80bd-1d55ae5b06db-tmp\") pod \"tuned-ttgt2\" (UID: \"fe3e5ab3-5e5a-48d6-80bd-1d55ae5b06db\") " pod="openshift-cluster-node-tuning-operator/tuned-ttgt2"
Jul 22 04:24:47.104173 ip-10-0-141-238 kubenswrapper[2563]: E0722 04:24:47.103677    2563 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 22 04:24:47.104173 ip-10-0-141-238 kubenswrapper[2563]: E0722 04:24:47.103699    2563 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 22 04:24:47.104173 ip-10-0-141-238 kubenswrapper[2563]: E0722 04:24:47.103713    2563 projected.go:196] Error preparing data for projected volume kube-api-access-4jwxl for pod openshift-network-diagnostics/network-check-target-7x8hk: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 22 04:24:47.104173 ip-10-0-141-238 kubenswrapper[2563]: E0722 04:24:47.103767    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/ca6c339f-ddd5-4c9b-801a-e0323cbc2f0e-kube-api-access-4jwxl podName:ca6c339f-ddd5-4c9b-801a-e0323cbc2f0e nodeName:}" failed. No retries permitted until 2026-07-22 04:24:47.603749536 +0000 UTC m=+3.022758283 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-4jwxl" (UniqueName: "kubernetes.io/projected/ca6c339f-ddd5-4c9b-801a-e0323cbc2f0e-kube-api-access-4jwxl") pod "network-check-target-7x8hk" (UID: "ca6c339f-ddd5-4c9b-801a-e0323cbc2f0e") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 22 04:24:47.104173 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:24:47.104066    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/fe3e5ab3-5e5a-48d6-80bd-1d55ae5b06db-etc-tuned\") pod \"tuned-ttgt2\" (UID: \"fe3e5ab3-5e5a-48d6-80bd-1d55ae5b06db\") " pod="openshift-cluster-node-tuning-operator/tuned-ttgt2"
Jul 22 04:24:47.104676 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:24:47.104648    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/b4af3ae5-fa65-4358-8399-6ed11b68616e-agent-certs\") pod \"konnectivity-agent-j9gvx\" (UID: \"b4af3ae5-fa65-4358-8399-6ed11b68616e\") " pod="kube-system/konnectivity-agent-j9gvx"
Jul 22 04:24:47.114147 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:24:47.114104    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rvm2s\" (UniqueName: \"kubernetes.io/projected/6e24b2d2-e7a1-4be2-b35b-9dfd42e74727-kube-api-access-rvm2s\") pod \"aws-ebs-csi-driver-node-t5nr2\" (UID: \"6e24b2d2-e7a1-4be2-b35b-9dfd42e74727\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-t5nr2"
Jul 22 04:24:47.114705 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:24:47.114678    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bzx2r\" (UniqueName: \"kubernetes.io/projected/3e22b9bf-95f2-4186-a5a7-2f1d21feb8b1-kube-api-access-bzx2r\") pod \"network-metrics-daemon-2k7fd\" (UID: \"3e22b9bf-95f2-4186-a5a7-2f1d21feb8b1\") " pod="openshift-multus/network-metrics-daemon-2k7fd"
Jul 22 04:24:47.115106 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:24:47.115073    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-f9lqs\" (UniqueName: \"kubernetes.io/projected/0d66df01-3af3-4a5c-8fe2-6e10517bbcf5-kube-api-access-f9lqs\") pod \"node-resolver-56sw9\" (UID: \"0d66df01-3af3-4a5c-8fe2-6e10517bbcf5\") " pod="openshift-dns/node-resolver-56sw9"
Jul 22 04:24:47.115970 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:24:47.115946    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lczxw\" (UniqueName: \"kubernetes.io/projected/79ad9242-2544-40bf-a872-7cbab7ab0b23-kube-api-access-lczxw\") pod \"ovnkube-node-gjvc2\" (UID: \"79ad9242-2544-40bf-a872-7cbab7ab0b23\") " pod="openshift-ovn-kubernetes/ovnkube-node-gjvc2"
Jul 22 04:24:47.117644 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:24:47.117622    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7zr22\" (UniqueName: \"kubernetes.io/projected/959d426a-6437-4684-8afa-d0fcd4f5dc5a-kube-api-access-7zr22\") pod \"multus-22ss9\" (UID: \"959d426a-6437-4684-8afa-d0fcd4f5dc5a\") " pod="openshift-multus/multus-22ss9"
Jul 22 04:24:47.118930 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:24:47.118903    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dwtw2\" (UniqueName: \"kubernetes.io/projected/fe3e5ab3-5e5a-48d6-80bd-1d55ae5b06db-kube-api-access-dwtw2\") pod \"tuned-ttgt2\" (UID: \"fe3e5ab3-5e5a-48d6-80bd-1d55ae5b06db\") " pod="openshift-cluster-node-tuning-operator/tuned-ttgt2"
Jul 22 04:24:47.191458 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:24:47.191429    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-wn74g"
Jul 22 04:24:47.202528 ip-10-0-141-238 kubenswrapper[2563]: W0722 04:24:47.202506    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podea39afdc_f191_458e_acc9_1ad9ff78c9da.slice/crio-c1b06f25e00365f6ec43e2767b6f8413b232112fcabb76ef23442fb0453fad2b WatchSource:0}: Error finding container c1b06f25e00365f6ec43e2767b6f8413b232112fcabb76ef23442fb0453fad2b: Status 404 returned error can't find the container with id c1b06f25e00365f6ec43e2767b6f8413b232112fcabb76ef23442fb0453fad2b
Jul 22 04:24:47.206318 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:24:47.205326    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-nnl9g"
Jul 22 04:24:47.216151 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:24:47.215644    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-qldhd"
Jul 22 04:24:47.216151 ip-10-0-141-238 kubenswrapper[2563]: W0722 04:24:47.216043    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod17e66222_28be_4adb_b389_ba6aa170ed73.slice/crio-618e2e790fb75c223e0baeeace0b084cc09d68032428badb4decdc6db26997be WatchSource:0}: Error finding container 618e2e790fb75c223e0baeeace0b084cc09d68032428badb4decdc6db26997be: Status 404 returned error can't find the container with id 618e2e790fb75c223e0baeeace0b084cc09d68032428badb4decdc6db26997be
Jul 22 04:24:47.222797 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:24:47.222773    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-gjvc2"
Jul 22 04:24:47.226183 ip-10-0-141-238 kubenswrapper[2563]: W0722 04:24:47.226161    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod082d9f5d_e4ad_4288_a071_f9f6902393e1.slice/crio-19185c8a4ca4b86ed6b1f3c4f598d8dc5038fc71247cdef7c4be8ab57d70f434 WatchSource:0}: Error finding container 19185c8a4ca4b86ed6b1f3c4f598d8dc5038fc71247cdef7c4be8ab57d70f434: Status 404 returned error can't find the container with id 19185c8a4ca4b86ed6b1f3c4f598d8dc5038fc71247cdef7c4be8ab57d70f434
Jul 22 04:24:47.231948 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:24:47.231927    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-t5nr2"
Jul 22 04:24:47.241410 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:24:47.241239    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-ttgt2"
Jul 22 04:24:47.243545 ip-10-0-141-238 kubenswrapper[2563]: W0722 04:24:47.243474    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6e24b2d2_e7a1_4be2_b35b_9dfd42e74727.slice/crio-e9810f74de6f154de4656a3e4eb8cfe38305bd9802355c68f4d34c53ec1b497f WatchSource:0}: Error finding container e9810f74de6f154de4656a3e4eb8cfe38305bd9802355c68f4d34c53ec1b497f: Status 404 returned error can't find the container with id e9810f74de6f154de4656a3e4eb8cfe38305bd9802355c68f4d34c53ec1b497f
Jul 22 04:24:47.251658 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:24:47.251484    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-j9gvx"
Jul 22 04:24:47.252215 ip-10-0-141-238 kubenswrapper[2563]: W0722 04:24:47.252183    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfe3e5ab3_5e5a_48d6_80bd_1d55ae5b06db.slice/crio-b9fbd11e13fa8256a8fbbded1e103d9ac61fa0fde7ab4c6ab688e18be9fb3acc WatchSource:0}: Error finding container b9fbd11e13fa8256a8fbbded1e103d9ac61fa0fde7ab4c6ab688e18be9fb3acc: Status 404 returned error can't find the container with id b9fbd11e13fa8256a8fbbded1e103d9ac61fa0fde7ab4c6ab688e18be9fb3acc
Jul 22 04:24:47.262231 ip-10-0-141-238 kubenswrapper[2563]: W0722 04:24:47.262208    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb4af3ae5_fa65_4358_8399_6ed11b68616e.slice/crio-5b5a19e087a377e166e20b5f172b1f602cbed3612c3b2adb518ebff2aac0300e WatchSource:0}: Error finding container 5b5a19e087a377e166e20b5f172b1f602cbed3612c3b2adb518ebff2aac0300e: Status 404 returned error can't find the container with id 5b5a19e087a377e166e20b5f172b1f602cbed3612c3b2adb518ebff2aac0300e
Jul 22 04:24:47.269149 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:24:47.269127    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-22ss9"
Jul 22 04:24:47.276189 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:24:47.276137    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-56sw9"
Jul 22 04:24:47.280076 ip-10-0-141-238 kubenswrapper[2563]: W0722 04:24:47.280038    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod959d426a_6437_4684_8afa_d0fcd4f5dc5a.slice/crio-483f8d422e6163b4e665ccb24447cf97b426f7bc2679749a386599dc24da812d WatchSource:0}: Error finding container 483f8d422e6163b4e665ccb24447cf97b426f7bc2679749a386599dc24da812d: Status 404 returned error can't find the container with id 483f8d422e6163b4e665ccb24447cf97b426f7bc2679749a386599dc24da812d
Jul 22 04:24:47.287907 ip-10-0-141-238 kubenswrapper[2563]: W0722 04:24:47.287884    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0d66df01_3af3_4a5c_8fe2_6e10517bbcf5.slice/crio-f3fe7fb45a8379ce6366fb51e5aa4dce28478fbf42733d7f9d34d8481b2ace1b WatchSource:0}: Error finding container f3fe7fb45a8379ce6366fb51e5aa4dce28478fbf42733d7f9d34d8481b2ace1b: Status 404 returned error can't find the container with id f3fe7fb45a8379ce6366fb51e5aa4dce28478fbf42733d7f9d34d8481b2ace1b
Jul 22 04:24:47.369244 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:24:47.369150    2563 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 22 04:24:47.602101 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:24:47.602050    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/bc2f671d-2057-4b94-8e5c-e6d3cdcdd74e-original-pull-secret\") pod \"global-pull-secret-syncer-k2znt\" (UID: \"bc2f671d-2057-4b94-8e5c-e6d3cdcdd74e\") " pod="kube-system/global-pull-secret-syncer-k2znt"
Jul 22 04:24:47.602288 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:24:47.602123    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3e22b9bf-95f2-4186-a5a7-2f1d21feb8b1-metrics-certs\") pod \"network-metrics-daemon-2k7fd\" (UID: \"3e22b9bf-95f2-4186-a5a7-2f1d21feb8b1\") " pod="openshift-multus/network-metrics-daemon-2k7fd"
Jul 22 04:24:47.602288 ip-10-0-141-238 kubenswrapper[2563]: E0722 04:24:47.602237    2563 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 22 04:24:47.602288 ip-10-0-141-238 kubenswrapper[2563]: E0722 04:24:47.602242    2563 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 22 04:24:47.602505 ip-10-0-141-238 kubenswrapper[2563]: E0722 04:24:47.602307    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3e22b9bf-95f2-4186-a5a7-2f1d21feb8b1-metrics-certs podName:3e22b9bf-95f2-4186-a5a7-2f1d21feb8b1 nodeName:}" failed. No retries permitted until 2026-07-22 04:24:48.6022871 +0000 UTC m=+4.021295843 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/3e22b9bf-95f2-4186-a5a7-2f1d21feb8b1-metrics-certs") pod "network-metrics-daemon-2k7fd" (UID: "3e22b9bf-95f2-4186-a5a7-2f1d21feb8b1") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 22 04:24:47.602505 ip-10-0-141-238 kubenswrapper[2563]: E0722 04:24:47.602328    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/bc2f671d-2057-4b94-8e5c-e6d3cdcdd74e-original-pull-secret podName:bc2f671d-2057-4b94-8e5c-e6d3cdcdd74e nodeName:}" failed. No retries permitted until 2026-07-22 04:24:48.602316975 +0000 UTC m=+4.021325715 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/bc2f671d-2057-4b94-8e5c-e6d3cdcdd74e-original-pull-secret") pod "global-pull-secret-syncer-k2znt" (UID: "bc2f671d-2057-4b94-8e5c-e6d3cdcdd74e") : object "kube-system"/"original-pull-secret" not registered
Jul 22 04:24:47.702831 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:24:47.702760    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4jwxl\" (UniqueName: \"kubernetes.io/projected/ca6c339f-ddd5-4c9b-801a-e0323cbc2f0e-kube-api-access-4jwxl\") pod \"network-check-target-7x8hk\" (UID: \"ca6c339f-ddd5-4c9b-801a-e0323cbc2f0e\") " pod="openshift-network-diagnostics/network-check-target-7x8hk"
Jul 22 04:24:47.702986 ip-10-0-141-238 kubenswrapper[2563]: E0722 04:24:47.702941    2563 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 22 04:24:47.702986 ip-10-0-141-238 kubenswrapper[2563]: E0722 04:24:47.702957    2563 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 22 04:24:47.702986 ip-10-0-141-238 kubenswrapper[2563]: E0722 04:24:47.702967    2563 projected.go:196] Error preparing data for projected volume kube-api-access-4jwxl for pod openshift-network-diagnostics/network-check-target-7x8hk: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 22 04:24:47.703144 ip-10-0-141-238 kubenswrapper[2563]: E0722 04:24:47.703027    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/ca6c339f-ddd5-4c9b-801a-e0323cbc2f0e-kube-api-access-4jwxl podName:ca6c339f-ddd5-4c9b-801a-e0323cbc2f0e nodeName:}" failed. No retries permitted until 2026-07-22 04:24:48.703008684 +0000 UTC m=+4.122017442 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-4jwxl" (UniqueName: "kubernetes.io/projected/ca6c339f-ddd5-4c9b-801a-e0323cbc2f0e-kube-api-access-4jwxl") pod "network-check-target-7x8hk" (UID: "ca6c339f-ddd5-4c9b-801a-e0323cbc2f0e") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 22 04:24:47.933244 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:24:47.933178    2563 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-21 04:19:47 +0000 UTC" deadline="2027-12-17 04:46:10.120102846 +0000 UTC"
Jul 22 04:24:47.933244 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:24:47.933238    2563 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="12312h21m22.186868987s"
Jul 22 04:24:48.059786 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:24:48.059699    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7x8hk"
Jul 22 04:24:48.059957 ip-10-0-141-238 kubenswrapper[2563]: E0722 04:24:48.059857    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-7x8hk" podUID="ca6c339f-ddd5-4c9b-801a-e0323cbc2f0e"
Jul 22 04:24:48.060028 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:24:48.059965    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2k7fd"
Jul 22 04:24:48.060143 ip-10-0-141-238 kubenswrapper[2563]: E0722 04:24:48.060116    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-2k7fd" podUID="3e22b9bf-95f2-4186-a5a7-2f1d21feb8b1"
Jul 22 04:24:48.072095 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:24:48.072041    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-gjvc2" event={"ID":"79ad9242-2544-40bf-a872-7cbab7ab0b23","Type":"ContainerStarted","Data":"beeb1365ccd69b231c056d8689d9ed7f2c0b03d4e4f8a0b670816c198288c1dd"}
Jul 22 04:24:48.073961 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:24:48.073930    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-qldhd" event={"ID":"082d9f5d-e4ad-4288-a071-f9f6902393e1","Type":"ContainerStarted","Data":"19185c8a4ca4b86ed6b1f3c4f598d8dc5038fc71247cdef7c4be8ab57d70f434"}
Jul 22 04:24:48.076655 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:24:48.076060    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-56sw9" event={"ID":"0d66df01-3af3-4a5c-8fe2-6e10517bbcf5","Type":"ContainerStarted","Data":"f3fe7fb45a8379ce6366fb51e5aa4dce28478fbf42733d7f9d34d8481b2ace1b"}
Jul 22 04:24:48.077532 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:24:48.077499    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-t5nr2" event={"ID":"6e24b2d2-e7a1-4be2-b35b-9dfd42e74727","Type":"ContainerStarted","Data":"e9810f74de6f154de4656a3e4eb8cfe38305bd9802355c68f4d34c53ec1b497f"}
Jul 22 04:24:48.079198 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:24:48.079169    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-nnl9g" event={"ID":"17e66222-28be-4adb-b389-ba6aa170ed73","Type":"ContainerStarted","Data":"618e2e790fb75c223e0baeeace0b084cc09d68032428badb4decdc6db26997be"}
Jul 22 04:24:48.080740 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:24:48.080706    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-wn74g" event={"ID":"ea39afdc-f191-458e-acc9-1ad9ff78c9da","Type":"ContainerStarted","Data":"c1b06f25e00365f6ec43e2767b6f8413b232112fcabb76ef23442fb0453fad2b"}
Jul 22 04:24:48.082362 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:24:48.082339    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-22ss9" event={"ID":"959d426a-6437-4684-8afa-d0fcd4f5dc5a","Type":"ContainerStarted","Data":"483f8d422e6163b4e665ccb24447cf97b426f7bc2679749a386599dc24da812d"}
Jul 22 04:24:48.083653 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:24:48.083619    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-j9gvx" event={"ID":"b4af3ae5-fa65-4358-8399-6ed11b68616e","Type":"ContainerStarted","Data":"5b5a19e087a377e166e20b5f172b1f602cbed3612c3b2adb518ebff2aac0300e"}
Jul 22 04:24:48.085368 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:24:48.085335    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-ttgt2" event={"ID":"fe3e5ab3-5e5a-48d6-80bd-1d55ae5b06db","Type":"ContainerStarted","Data":"b9fbd11e13fa8256a8fbbded1e103d9ac61fa0fde7ab4c6ab688e18be9fb3acc"}
Jul 22 04:24:48.610780 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:24:48.610739    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3e22b9bf-95f2-4186-a5a7-2f1d21feb8b1-metrics-certs\") pod \"network-metrics-daemon-2k7fd\" (UID: \"3e22b9bf-95f2-4186-a5a7-2f1d21feb8b1\") " pod="openshift-multus/network-metrics-daemon-2k7fd"
Jul 22 04:24:48.610980 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:24:48.610844    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/bc2f671d-2057-4b94-8e5c-e6d3cdcdd74e-original-pull-secret\") pod \"global-pull-secret-syncer-k2znt\" (UID: \"bc2f671d-2057-4b94-8e5c-e6d3cdcdd74e\") " pod="kube-system/global-pull-secret-syncer-k2znt"
Jul 22 04:24:48.610980 ip-10-0-141-238 kubenswrapper[2563]: E0722 04:24:48.610936    2563 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 22 04:24:48.610980 ip-10-0-141-238 kubenswrapper[2563]: E0722 04:24:48.610958    2563 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 22 04:24:48.611183 ip-10-0-141-238 kubenswrapper[2563]: E0722 04:24:48.611019    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3e22b9bf-95f2-4186-a5a7-2f1d21feb8b1-metrics-certs podName:3e22b9bf-95f2-4186-a5a7-2f1d21feb8b1 nodeName:}" failed. No retries permitted until 2026-07-22 04:24:50.610994015 +0000 UTC m=+6.030002755 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/3e22b9bf-95f2-4186-a5a7-2f1d21feb8b1-metrics-certs") pod "network-metrics-daemon-2k7fd" (UID: "3e22b9bf-95f2-4186-a5a7-2f1d21feb8b1") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 22 04:24:48.611183 ip-10-0-141-238 kubenswrapper[2563]: E0722 04:24:48.611041    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/bc2f671d-2057-4b94-8e5c-e6d3cdcdd74e-original-pull-secret podName:bc2f671d-2057-4b94-8e5c-e6d3cdcdd74e nodeName:}" failed. No retries permitted until 2026-07-22 04:24:50.61103075 +0000 UTC m=+6.030039495 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/bc2f671d-2057-4b94-8e5c-e6d3cdcdd74e-original-pull-secret") pod "global-pull-secret-syncer-k2znt" (UID: "bc2f671d-2057-4b94-8e5c-e6d3cdcdd74e") : object "kube-system"/"original-pull-secret" not registered
Jul 22 04:24:48.711865 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:24:48.711809    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4jwxl\" (UniqueName: \"kubernetes.io/projected/ca6c339f-ddd5-4c9b-801a-e0323cbc2f0e-kube-api-access-4jwxl\") pod \"network-check-target-7x8hk\" (UID: \"ca6c339f-ddd5-4c9b-801a-e0323cbc2f0e\") " pod="openshift-network-diagnostics/network-check-target-7x8hk"
Jul 22 04:24:48.712056 ip-10-0-141-238 kubenswrapper[2563]: E0722 04:24:48.712045    2563 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 22 04:24:48.712137 ip-10-0-141-238 kubenswrapper[2563]: E0722 04:24:48.712074    2563 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 22 04:24:48.712137 ip-10-0-141-238 kubenswrapper[2563]: E0722 04:24:48.712088    2563 projected.go:196] Error preparing data for projected volume kube-api-access-4jwxl for pod openshift-network-diagnostics/network-check-target-7x8hk: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 22 04:24:48.712255 ip-10-0-141-238 kubenswrapper[2563]: E0722 04:24:48.712231    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/ca6c339f-ddd5-4c9b-801a-e0323cbc2f0e-kube-api-access-4jwxl podName:ca6c339f-ddd5-4c9b-801a-e0323cbc2f0e nodeName:}" failed. No retries permitted until 2026-07-22 04:24:50.712197351 +0000 UTC m=+6.131206112 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-4jwxl" (UniqueName: "kubernetes.io/projected/ca6c339f-ddd5-4c9b-801a-e0323cbc2f0e-kube-api-access-4jwxl") pod "network-check-target-7x8hk" (UID: "ca6c339f-ddd5-4c9b-801a-e0323cbc2f0e") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 22 04:24:48.934391 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:24:48.934245    2563 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-21 04:19:47 +0000 UTC" deadline="2028-03-15 20:07:39.817655908 +0000 UTC"
Jul 22 04:24:48.934391 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:24:48.934305    2563 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="14463h42m50.88335577s"
Jul 22 04:24:49.063919 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:24:49.062285    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-k2znt"
Jul 22 04:24:49.063919 ip-10-0-141-238 kubenswrapper[2563]: E0722 04:24:49.062428    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-k2znt" podUID="bc2f671d-2057-4b94-8e5c-e6d3cdcdd74e"
Jul 22 04:24:50.060432 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:24:50.060395    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7x8hk"
Jul 22 04:24:50.061225 ip-10-0-141-238 kubenswrapper[2563]: E0722 04:24:50.060540    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-7x8hk" podUID="ca6c339f-ddd5-4c9b-801a-e0323cbc2f0e"
Jul 22 04:24:50.061225 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:24:50.061043    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2k7fd"
Jul 22 04:24:50.061225 ip-10-0-141-238 kubenswrapper[2563]: E0722 04:24:50.061180    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-2k7fd" podUID="3e22b9bf-95f2-4186-a5a7-2f1d21feb8b1"
Jul 22 04:24:50.631712 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:24:50.630758    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/bc2f671d-2057-4b94-8e5c-e6d3cdcdd74e-original-pull-secret\") pod \"global-pull-secret-syncer-k2znt\" (UID: \"bc2f671d-2057-4b94-8e5c-e6d3cdcdd74e\") " pod="kube-system/global-pull-secret-syncer-k2znt"
Jul 22 04:24:50.631712 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:24:50.630830    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3e22b9bf-95f2-4186-a5a7-2f1d21feb8b1-metrics-certs\") pod \"network-metrics-daemon-2k7fd\" (UID: \"3e22b9bf-95f2-4186-a5a7-2f1d21feb8b1\") " pod="openshift-multus/network-metrics-daemon-2k7fd"
Jul 22 04:24:50.631712 ip-10-0-141-238 kubenswrapper[2563]: E0722 04:24:50.631027    2563 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 22 04:24:50.631712 ip-10-0-141-238 kubenswrapper[2563]: E0722 04:24:50.631120    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3e22b9bf-95f2-4186-a5a7-2f1d21feb8b1-metrics-certs podName:3e22b9bf-95f2-4186-a5a7-2f1d21feb8b1 nodeName:}" failed. No retries permitted until 2026-07-22 04:24:54.631098327 +0000 UTC m=+10.050107080 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/3e22b9bf-95f2-4186-a5a7-2f1d21feb8b1-metrics-certs") pod "network-metrics-daemon-2k7fd" (UID: "3e22b9bf-95f2-4186-a5a7-2f1d21feb8b1") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 22 04:24:50.631712 ip-10-0-141-238 kubenswrapper[2563]: E0722 04:24:50.631202    2563 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 22 04:24:50.631712 ip-10-0-141-238 kubenswrapper[2563]: E0722 04:24:50.631286    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/bc2f671d-2057-4b94-8e5c-e6d3cdcdd74e-original-pull-secret podName:bc2f671d-2057-4b94-8e5c-e6d3cdcdd74e nodeName:}" failed. No retries permitted until 2026-07-22 04:24:54.63122927 +0000 UTC m=+10.050238023 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/bc2f671d-2057-4b94-8e5c-e6d3cdcdd74e-original-pull-secret") pod "global-pull-secret-syncer-k2znt" (UID: "bc2f671d-2057-4b94-8e5c-e6d3cdcdd74e") : object "kube-system"/"original-pull-secret" not registered
Jul 22 04:24:50.731549 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:24:50.731507    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4jwxl\" (UniqueName: \"kubernetes.io/projected/ca6c339f-ddd5-4c9b-801a-e0323cbc2f0e-kube-api-access-4jwxl\") pod \"network-check-target-7x8hk\" (UID: \"ca6c339f-ddd5-4c9b-801a-e0323cbc2f0e\") " pod="openshift-network-diagnostics/network-check-target-7x8hk"
Jul 22 04:24:50.731837 ip-10-0-141-238 kubenswrapper[2563]: E0722 04:24:50.731723    2563 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 22 04:24:50.731837 ip-10-0-141-238 kubenswrapper[2563]: E0722 04:24:50.731754    2563 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 22 04:24:50.731837 ip-10-0-141-238 kubenswrapper[2563]: E0722 04:24:50.731770    2563 projected.go:196] Error preparing data for projected volume kube-api-access-4jwxl for pod openshift-network-diagnostics/network-check-target-7x8hk: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 22 04:24:50.731837 ip-10-0-141-238 kubenswrapper[2563]: E0722 04:24:50.731839    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/ca6c339f-ddd5-4c9b-801a-e0323cbc2f0e-kube-api-access-4jwxl podName:ca6c339f-ddd5-4c9b-801a-e0323cbc2f0e nodeName:}" failed. No retries permitted until 2026-07-22 04:24:54.731818663 +0000 UTC m=+10.150827400 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-4jwxl" (UniqueName: "kubernetes.io/projected/ca6c339f-ddd5-4c9b-801a-e0323cbc2f0e-kube-api-access-4jwxl") pod "network-check-target-7x8hk" (UID: "ca6c339f-ddd5-4c9b-801a-e0323cbc2f0e") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 22 04:24:51.063183 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:24:51.062626    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-k2znt"
Jul 22 04:24:51.063183 ip-10-0-141-238 kubenswrapper[2563]: E0722 04:24:51.062749    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-k2znt" podUID="bc2f671d-2057-4b94-8e5c-e6d3cdcdd74e"
Jul 22 04:24:52.060912 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:24:52.060256    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7x8hk"
Jul 22 04:24:52.060912 ip-10-0-141-238 kubenswrapper[2563]: E0722 04:24:52.060382    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-7x8hk" podUID="ca6c339f-ddd5-4c9b-801a-e0323cbc2f0e"
Jul 22 04:24:52.060912 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:24:52.060766    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2k7fd"
Jul 22 04:24:52.060912 ip-10-0-141-238 kubenswrapper[2563]: E0722 04:24:52.060866    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-2k7fd" podUID="3e22b9bf-95f2-4186-a5a7-2f1d21feb8b1"
Jul 22 04:24:53.059773 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:24:53.059707    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-k2znt"
Jul 22 04:24:53.060119 ip-10-0-141-238 kubenswrapper[2563]: E0722 04:24:53.059845    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-k2znt" podUID="bc2f671d-2057-4b94-8e5c-e6d3cdcdd74e"
Jul 22 04:24:54.060231 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:24:54.060194    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7x8hk"
Jul 22 04:24:54.060636 ip-10-0-141-238 kubenswrapper[2563]: E0722 04:24:54.060334    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-7x8hk" podUID="ca6c339f-ddd5-4c9b-801a-e0323cbc2f0e"
Jul 22 04:24:54.060636 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:24:54.060574    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2k7fd"
Jul 22 04:24:54.060744 ip-10-0-141-238 kubenswrapper[2563]: E0722 04:24:54.060659    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-2k7fd" podUID="3e22b9bf-95f2-4186-a5a7-2f1d21feb8b1"
Jul 22 04:24:54.666743 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:24:54.666683    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/bc2f671d-2057-4b94-8e5c-e6d3cdcdd74e-original-pull-secret\") pod \"global-pull-secret-syncer-k2znt\" (UID: \"bc2f671d-2057-4b94-8e5c-e6d3cdcdd74e\") " pod="kube-system/global-pull-secret-syncer-k2znt"
Jul 22 04:24:54.666743 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:24:54.666743    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3e22b9bf-95f2-4186-a5a7-2f1d21feb8b1-metrics-certs\") pod \"network-metrics-daemon-2k7fd\" (UID: \"3e22b9bf-95f2-4186-a5a7-2f1d21feb8b1\") " pod="openshift-multus/network-metrics-daemon-2k7fd"
Jul 22 04:24:54.667029 ip-10-0-141-238 kubenswrapper[2563]: E0722 04:24:54.666918    2563 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 22 04:24:54.667029 ip-10-0-141-238 kubenswrapper[2563]: E0722 04:24:54.666982    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3e22b9bf-95f2-4186-a5a7-2f1d21feb8b1-metrics-certs podName:3e22b9bf-95f2-4186-a5a7-2f1d21feb8b1 nodeName:}" failed. No retries permitted until 2026-07-22 04:25:02.666963316 +0000 UTC m=+18.085972056 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/3e22b9bf-95f2-4186-a5a7-2f1d21feb8b1-metrics-certs") pod "network-metrics-daemon-2k7fd" (UID: "3e22b9bf-95f2-4186-a5a7-2f1d21feb8b1") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 22 04:24:54.667604 ip-10-0-141-238 kubenswrapper[2563]: E0722 04:24:54.667478    2563 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 22 04:24:54.667604 ip-10-0-141-238 kubenswrapper[2563]: E0722 04:24:54.667539    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/bc2f671d-2057-4b94-8e5c-e6d3cdcdd74e-original-pull-secret podName:bc2f671d-2057-4b94-8e5c-e6d3cdcdd74e nodeName:}" failed. No retries permitted until 2026-07-22 04:25:02.66752224 +0000 UTC m=+18.086530977 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/bc2f671d-2057-4b94-8e5c-e6d3cdcdd74e-original-pull-secret") pod "global-pull-secret-syncer-k2znt" (UID: "bc2f671d-2057-4b94-8e5c-e6d3cdcdd74e") : object "kube-system"/"original-pull-secret" not registered
Jul 22 04:24:54.767550 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:24:54.767507    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4jwxl\" (UniqueName: \"kubernetes.io/projected/ca6c339f-ddd5-4c9b-801a-e0323cbc2f0e-kube-api-access-4jwxl\") pod \"network-check-target-7x8hk\" (UID: \"ca6c339f-ddd5-4c9b-801a-e0323cbc2f0e\") " pod="openshift-network-diagnostics/network-check-target-7x8hk"
Jul 22 04:24:54.767739 ip-10-0-141-238 kubenswrapper[2563]: E0722 04:24:54.767681    2563 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 22 04:24:54.767739 ip-10-0-141-238 kubenswrapper[2563]: E0722 04:24:54.767713    2563 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 22 04:24:54.767739 ip-10-0-141-238 kubenswrapper[2563]: E0722 04:24:54.767729    2563 projected.go:196] Error preparing data for projected volume kube-api-access-4jwxl for pod openshift-network-diagnostics/network-check-target-7x8hk: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 22 04:24:54.767885 ip-10-0-141-238 kubenswrapper[2563]: E0722 04:24:54.767800    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/ca6c339f-ddd5-4c9b-801a-e0323cbc2f0e-kube-api-access-4jwxl podName:ca6c339f-ddd5-4c9b-801a-e0323cbc2f0e nodeName:}" failed. No retries permitted until 2026-07-22 04:25:02.76777684 +0000 UTC m=+18.186785577 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-4jwxl" (UniqueName: "kubernetes.io/projected/ca6c339f-ddd5-4c9b-801a-e0323cbc2f0e-kube-api-access-4jwxl") pod "network-check-target-7x8hk" (UID: "ca6c339f-ddd5-4c9b-801a-e0323cbc2f0e") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 22 04:24:55.061832 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:24:55.061279    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-k2znt"
Jul 22 04:24:55.061832 ip-10-0-141-238 kubenswrapper[2563]: E0722 04:24:55.061396    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-k2znt" podUID="bc2f671d-2057-4b94-8e5c-e6d3cdcdd74e"
Jul 22 04:24:56.060006 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:24:56.059970    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7x8hk"
Jul 22 04:24:56.060195 ip-10-0-141-238 kubenswrapper[2563]: E0722 04:24:56.060112    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-7x8hk" podUID="ca6c339f-ddd5-4c9b-801a-e0323cbc2f0e"
Jul 22 04:24:56.060564 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:24:56.060545    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2k7fd"
Jul 22 04:24:56.060666 ip-10-0-141-238 kubenswrapper[2563]: E0722 04:24:56.060646    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-2k7fd" podUID="3e22b9bf-95f2-4186-a5a7-2f1d21feb8b1"
Jul 22 04:24:57.059563 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:24:57.059326    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-k2znt"
Jul 22 04:24:57.059991 ip-10-0-141-238 kubenswrapper[2563]: E0722 04:24:57.059600    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-k2znt" podUID="bc2f671d-2057-4b94-8e5c-e6d3cdcdd74e"
Jul 22 04:24:58.059899 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:24:58.059865    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7x8hk"
Jul 22 04:24:58.059899 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:24:58.059865    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2k7fd"
Jul 22 04:24:58.060332 ip-10-0-141-238 kubenswrapper[2563]: E0722 04:24:58.060008    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-2k7fd" podUID="3e22b9bf-95f2-4186-a5a7-2f1d21feb8b1"
Jul 22 04:24:58.060332 ip-10-0-141-238 kubenswrapper[2563]: E0722 04:24:58.060142    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-7x8hk" podUID="ca6c339f-ddd5-4c9b-801a-e0323cbc2f0e"
Jul 22 04:24:59.059676 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:24:59.059644    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-k2znt"
Jul 22 04:24:59.059849 ip-10-0-141-238 kubenswrapper[2563]: E0722 04:24:59.059763    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-k2znt" podUID="bc2f671d-2057-4b94-8e5c-e6d3cdcdd74e"
Jul 22 04:25:00.059872 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:25:00.059835    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7x8hk"
Jul 22 04:25:00.060344 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:25:00.059836    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2k7fd"
Jul 22 04:25:00.060344 ip-10-0-141-238 kubenswrapper[2563]: E0722 04:25:00.059943    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-7x8hk" podUID="ca6c339f-ddd5-4c9b-801a-e0323cbc2f0e"
Jul 22 04:25:00.060344 ip-10-0-141-238 kubenswrapper[2563]: E0722 04:25:00.060084    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-2k7fd" podUID="3e22b9bf-95f2-4186-a5a7-2f1d21feb8b1"
Jul 22 04:25:01.059644 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:25:01.059613    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-k2znt"
Jul 22 04:25:01.059798 ip-10-0-141-238 kubenswrapper[2563]: E0722 04:25:01.059716    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-k2znt" podUID="bc2f671d-2057-4b94-8e5c-e6d3cdcdd74e"
Jul 22 04:25:02.059968 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:25:02.059933    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7x8hk"
Jul 22 04:25:02.060464 ip-10-0-141-238 kubenswrapper[2563]: E0722 04:25:02.060074    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-7x8hk" podUID="ca6c339f-ddd5-4c9b-801a-e0323cbc2f0e"
Jul 22 04:25:02.060464 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:25:02.060129    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2k7fd"
Jul 22 04:25:02.060464 ip-10-0-141-238 kubenswrapper[2563]: E0722 04:25:02.060261    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-2k7fd" podUID="3e22b9bf-95f2-4186-a5a7-2f1d21feb8b1"
Jul 22 04:25:02.725441 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:25:02.725399    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/bc2f671d-2057-4b94-8e5c-e6d3cdcdd74e-original-pull-secret\") pod \"global-pull-secret-syncer-k2znt\" (UID: \"bc2f671d-2057-4b94-8e5c-e6d3cdcdd74e\") " pod="kube-system/global-pull-secret-syncer-k2znt"
Jul 22 04:25:02.725610 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:25:02.725462    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3e22b9bf-95f2-4186-a5a7-2f1d21feb8b1-metrics-certs\") pod \"network-metrics-daemon-2k7fd\" (UID: \"3e22b9bf-95f2-4186-a5a7-2f1d21feb8b1\") " pod="openshift-multus/network-metrics-daemon-2k7fd"
Jul 22 04:25:02.725610 ip-10-0-141-238 kubenswrapper[2563]: E0722 04:25:02.725572    2563 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 22 04:25:02.725716 ip-10-0-141-238 kubenswrapper[2563]: E0722 04:25:02.725574    2563 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 22 04:25:02.725716 ip-10-0-141-238 kubenswrapper[2563]: E0722 04:25:02.725635    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3e22b9bf-95f2-4186-a5a7-2f1d21feb8b1-metrics-certs podName:3e22b9bf-95f2-4186-a5a7-2f1d21feb8b1 nodeName:}" failed. No retries permitted until 2026-07-22 04:25:18.725615725 +0000 UTC m=+34.144624481 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/3e22b9bf-95f2-4186-a5a7-2f1d21feb8b1-metrics-certs") pod "network-metrics-daemon-2k7fd" (UID: "3e22b9bf-95f2-4186-a5a7-2f1d21feb8b1") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 22 04:25:02.725716 ip-10-0-141-238 kubenswrapper[2563]: E0722 04:25:02.725706    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/bc2f671d-2057-4b94-8e5c-e6d3cdcdd74e-original-pull-secret podName:bc2f671d-2057-4b94-8e5c-e6d3cdcdd74e nodeName:}" failed. No retries permitted until 2026-07-22 04:25:18.725684567 +0000 UTC m=+34.144693305 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/bc2f671d-2057-4b94-8e5c-e6d3cdcdd74e-original-pull-secret") pod "global-pull-secret-syncer-k2znt" (UID: "bc2f671d-2057-4b94-8e5c-e6d3cdcdd74e") : object "kube-system"/"original-pull-secret" not registered
Jul 22 04:25:02.825959 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:25:02.825927    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4jwxl\" (UniqueName: \"kubernetes.io/projected/ca6c339f-ddd5-4c9b-801a-e0323cbc2f0e-kube-api-access-4jwxl\") pod \"network-check-target-7x8hk\" (UID: \"ca6c339f-ddd5-4c9b-801a-e0323cbc2f0e\") " pod="openshift-network-diagnostics/network-check-target-7x8hk"
Jul 22 04:25:02.826129 ip-10-0-141-238 kubenswrapper[2563]: E0722 04:25:02.826066    2563 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 22 04:25:02.826129 ip-10-0-141-238 kubenswrapper[2563]: E0722 04:25:02.826083    2563 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 22 04:25:02.826129 ip-10-0-141-238 kubenswrapper[2563]: E0722 04:25:02.826091    2563 projected.go:196] Error preparing data for projected volume kube-api-access-4jwxl for pod openshift-network-diagnostics/network-check-target-7x8hk: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 22 04:25:02.826241 ip-10-0-141-238 kubenswrapper[2563]: E0722 04:25:02.826143    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/ca6c339f-ddd5-4c9b-801a-e0323cbc2f0e-kube-api-access-4jwxl podName:ca6c339f-ddd5-4c9b-801a-e0323cbc2f0e nodeName:}" failed. No retries permitted until 2026-07-22 04:25:18.82612674 +0000 UTC m=+34.245135489 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-4jwxl" (UniqueName: "kubernetes.io/projected/ca6c339f-ddd5-4c9b-801a-e0323cbc2f0e-kube-api-access-4jwxl") pod "network-check-target-7x8hk" (UID: "ca6c339f-ddd5-4c9b-801a-e0323cbc2f0e") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 22 04:25:03.060326 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:25:03.060247    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-k2znt"
Jul 22 04:25:03.060722 ip-10-0-141-238 kubenswrapper[2563]: E0722 04:25:03.060377    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-k2znt" podUID="bc2f671d-2057-4b94-8e5c-e6d3cdcdd74e"
Jul 22 04:25:04.060160 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:25:04.060118    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2k7fd"
Jul 22 04:25:04.060341 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:25:04.060175    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7x8hk"
Jul 22 04:25:04.060341 ip-10-0-141-238 kubenswrapper[2563]: E0722 04:25:04.060271    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-2k7fd" podUID="3e22b9bf-95f2-4186-a5a7-2f1d21feb8b1"
Jul 22 04:25:04.060788 ip-10-0-141-238 kubenswrapper[2563]: E0722 04:25:04.060404    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-7x8hk" podUID="ca6c339f-ddd5-4c9b-801a-e0323cbc2f0e"
Jul 22 04:25:05.060723 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:25:05.060680    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-k2znt"
Jul 22 04:25:05.061177 ip-10-0-141-238 kubenswrapper[2563]: E0722 04:25:05.060778    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-k2znt" podUID="bc2f671d-2057-4b94-8e5c-e6d3cdcdd74e"
Jul 22 04:25:06.059720 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:25:06.059688    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7x8hk"
Jul 22 04:25:06.059858 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:25:06.059726    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2k7fd"
Jul 22 04:25:06.059858 ip-10-0-141-238 kubenswrapper[2563]: E0722 04:25:06.059789    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-7x8hk" podUID="ca6c339f-ddd5-4c9b-801a-e0323cbc2f0e"
Jul 22 04:25:06.059943 ip-10-0-141-238 kubenswrapper[2563]: E0722 04:25:06.059909    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-2k7fd" podUID="3e22b9bf-95f2-4186-a5a7-2f1d21feb8b1"
Jul 22 04:25:07.059884 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:25:07.059604    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-k2znt"
Jul 22 04:25:07.060399 ip-10-0-141-238 kubenswrapper[2563]: E0722 04:25:07.059964    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-k2znt" podUID="bc2f671d-2057-4b94-8e5c-e6d3cdcdd74e"
Jul 22 04:25:07.125276 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:25:07.125245    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-56sw9" event={"ID":"0d66df01-3af3-4a5c-8fe2-6e10517bbcf5","Type":"ContainerStarted","Data":"6820bb7446fd523a6028ad55bbfe7bc9d87093db71a1fde8bf28e3ccb7924875"}
Jul 22 04:25:07.126840 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:25:07.126812    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-t5nr2" event={"ID":"6e24b2d2-e7a1-4be2-b35b-9dfd42e74727","Type":"ContainerStarted","Data":"42edcc45e2ac04aad6002dfebdb73b99066d0d0aed0bec0136e1cc4310b17178"}
Jul 22 04:25:07.128215 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:25:07.128186    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-wn74g" event={"ID":"ea39afdc-f191-458e-acc9-1ad9ff78c9da","Type":"ContainerStarted","Data":"dd8383df4859f0c91c51c6a382beadce7e2a28c41f496f13446cd13418e1cb44"}
Jul 22 04:25:07.129682 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:25:07.129658    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-141-238.ec2.internal" event={"ID":"7cbc186c127cef111ab8584862a4a734","Type":"ContainerStarted","Data":"a5d7a5dd7845c3d876c61982d0c9b409f315acce8259386f04b8c4cba475f4bf"}
Jul 22 04:25:07.131058 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:25:07.131017    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-22ss9" event={"ID":"959d426a-6437-4684-8afa-d0fcd4f5dc5a","Type":"ContainerStarted","Data":"7cd85e0d1a7c266c288bc2842cd420cd65ba89eae04cedd1213d51d6b44f2f72"}
Jul 22 04:25:07.132334 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:25:07.132316    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-j9gvx" event={"ID":"b4af3ae5-fa65-4358-8399-6ed11b68616e","Type":"ContainerStarted","Data":"2a606c398adcd1cb6eda9cb29acd2ceccae8b0477cfbcad5eeb8f0204d3298d2"}
Jul 22 04:25:07.133587 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:25:07.133563    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-ttgt2" event={"ID":"fe3e5ab3-5e5a-48d6-80bd-1d55ae5b06db","Type":"ContainerStarted","Data":"3e33e2c6daf853dfad35deee31c5ec9933798e3a9717e1e8018264802f073b30"}
Jul 22 04:25:07.136244 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:25:07.136226    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-gjvc2" event={"ID":"79ad9242-2544-40bf-a872-7cbab7ab0b23","Type":"ContainerStarted","Data":"758bba182e6275ac05cfb8cf38ff9687b48d9c0c95e566131256f3aa33d648f4"}
Jul 22 04:25:07.136321 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:25:07.136279    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-gjvc2" event={"ID":"79ad9242-2544-40bf-a872-7cbab7ab0b23","Type":"ContainerStarted","Data":"de4188a015768245ded33da5aa0d17c12c25995cb8b24699ad68ce83dda64f81"}
Jul 22 04:25:07.136321 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:25:07.136310    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-gjvc2" event={"ID":"79ad9242-2544-40bf-a872-7cbab7ab0b23","Type":"ContainerStarted","Data":"8a7c465b53b8874490dfc9fbdfca5fa755f23e38814d9aec22d7825bebf386f8"}
Jul 22 04:25:07.136408 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:25:07.136336    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-gjvc2" event={"ID":"79ad9242-2544-40bf-a872-7cbab7ab0b23","Type":"ContainerStarted","Data":"763666ae3f8d43aec51d908982395f7aaeaeb8d9135a962ef47dcf5772f504eb"}
Jul 22 04:25:07.136408 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:25:07.136370    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-gjvc2" event={"ID":"79ad9242-2544-40bf-a872-7cbab7ab0b23","Type":"ContainerStarted","Data":"2bd83cd19a4c99b128fec8ca060098bd33ee69c646d83a2592d8ebb12f95b29c"}
Jul 22 04:25:07.136408 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:25:07.136396    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-gjvc2" event={"ID":"79ad9242-2544-40bf-a872-7cbab7ab0b23","Type":"ContainerStarted","Data":"2c98fd28c838d8efa60f132df574e35edafd6fe2746476611ae7c71a625e5588"}
Jul 22 04:25:07.137600 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:25:07.137580    2563 generic.go:356] "Generic (PLEG): container finished" podID="082d9f5d-e4ad-4288-a071-f9f6902393e1" containerID="c7951b67fd840cdbd7959da0b68445ba6c24affac447f20fe39bc600b776237d" exitCode=0
Jul 22 04:25:07.137704 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:25:07.137645    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-qldhd" event={"ID":"082d9f5d-e4ad-4288-a071-f9f6902393e1","Type":"ContainerDied","Data":"c7951b67fd840cdbd7959da0b68445ba6c24affac447f20fe39bc600b776237d"}
Jul 22 04:25:07.139122 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:25:07.139100    2563 generic.go:356] "Generic (PLEG): container finished" podID="6eb34c1251007ab488f516cf74fa28ca" containerID="e2f0015e0ae5e02878392141d05696841ae238b9d8552a26c2395d1b3d163b78" exitCode=0
Jul 22 04:25:07.139190 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:25:07.139134    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-238.ec2.internal" event={"ID":"6eb34c1251007ab488f516cf74fa28ca","Type":"ContainerDied","Data":"e2f0015e0ae5e02878392141d05696841ae238b9d8552a26c2395d1b3d163b78"}
Jul 22 04:25:07.152491 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:25:07.152451    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-56sw9" podStartSLOduration=3.1619404 podStartE2EDuration="22.152439773s" totalImagesPullingTime="18.990499373s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-22 04:24:45 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 04:25:07.138978802 +0000 UTC m=+22.557987562" watchObservedRunningTime="2026-07-22 04:25:07.152439773 +0000 UTC m=+22.571448526"
Jul 22 04:25:07.152893 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:25:07.152864    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-wn74g" podStartSLOduration=3.42608242 podStartE2EDuration="22.152856187s" totalImagesPullingTime="18.726773767s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-22 04:24:45 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 04:25:07.152316772 +0000 UTC m=+22.571325530" watchObservedRunningTime="2026-07-22 04:25:07.152856187 +0000 UTC m=+22.571864978"
Jul 22 04:25:07.167672 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:25:07.167637    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-ttgt2" podStartSLOduration=3.141439448 podStartE2EDuration="22.16762209s" totalImagesPullingTime="19.026182642s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-22 04:24:45 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 04:25:07.167337012 +0000 UTC m=+22.586345771" watchObservedRunningTime="2026-07-22 04:25:07.16762209 +0000 UTC m=+22.586630848"
Jul 22 04:25:07.182270 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:25:07.182228    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-j9gvx" podStartSLOduration=11.56176598 podStartE2EDuration="22.182212584s" totalImagesPullingTime="10.620446604s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 04:24:45 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 04:25:07.18172792 +0000 UTC m=+22.600736678" watchObservedRunningTime="2026-07-22 04:25:07.182212584 +0000 UTC m=+22.601221344"
Jul 22 04:25:07.201664 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:25:07.201629    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-22ss9" podStartSLOduration=3.072740276 podStartE2EDuration="22.201616944s" totalImagesPullingTime="19.128876668s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-22 04:24:45 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 04:25:07.201116736 +0000 UTC m=+22.620125493" watchObservedRunningTime="2026-07-22 04:25:07.201616944 +0000 UTC m=+22.620625700"
Jul 22 04:25:07.219403 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:25:07.219367    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-141-238.ec2.internal" podStartSLOduration=21.219349776 podStartE2EDuration="21.219349776s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-22 04:24:46 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 04:25:07.217952239 +0000 UTC m=+22.636960996" watchObservedRunningTime="2026-07-22 04:25:07.219349776 +0000 UTC m=+22.638358533"
Jul 22 04:25:08.059490 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:25:08.059469    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7x8hk"
Jul 22 04:25:08.059597 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:25:08.059472    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2k7fd"
Jul 22 04:25:08.059597 ip-10-0-141-238 kubenswrapper[2563]: E0722 04:25:08.059563    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-7x8hk" podUID="ca6c339f-ddd5-4c9b-801a-e0323cbc2f0e"
Jul 22 04:25:08.059721 ip-10-0-141-238 kubenswrapper[2563]: E0722 04:25:08.059652    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-2k7fd" podUID="3e22b9bf-95f2-4186-a5a7-2f1d21feb8b1"
Jul 22 04:25:08.142501 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:25:08.142470    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-nnl9g" event={"ID":"17e66222-28be-4adb-b389-ba6aa170ed73","Type":"ContainerStarted","Data":"edaf12a1dd98a10eb8095116869449b54bb5cee14062f320c17391c87dab121d"}
Jul 22 04:25:08.144437 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:25:08.144407    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-238.ec2.internal" event={"ID":"6eb34c1251007ab488f516cf74fa28ca","Type":"ContainerStarted","Data":"d9898027b3c37671569bbec5771d0da72c79b65582c0ea4f15042ed167e9c87a"}
Jul 22 04:25:08.157461 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:25:08.157418    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-nnl9g" podStartSLOduration=4.117283822 podStartE2EDuration="23.157404943s" totalImagesPullingTime="19.040121121s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-22 04:24:45 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 04:25:08.157209148 +0000 UTC m=+23.576217907" watchObservedRunningTime="2026-07-22 04:25:08.157404943 +0000 UTC m=+23.576413700"
Jul 22 04:25:08.167091 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:25:08.167025    2563 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock"
Jul 22 04:25:08.171327 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:25:08.171291    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-238.ec2.internal" podStartSLOduration=22.171278978 podStartE2EDuration="22.171278978s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-22 04:24:46 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 04:25:08.171162357 +0000 UTC m=+23.590171113" watchObservedRunningTime="2026-07-22 04:25:08.171278978 +0000 UTC m=+23.590287734"
Jul 22 04:25:08.967385 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:25:08.967275    2563 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-07-22T04:25:08.167087635Z","UUID":"c8837b19-c063-4234-9293-64061dbe4b14","Handler":null,"Name":"","Endpoint":""}
Jul 22 04:25:08.969032 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:25:08.969008    2563 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0
Jul 22 04:25:08.969167 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:25:08.969056    2563 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock
Jul 22 04:25:09.059517 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:25:09.059490    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-k2znt"
Jul 22 04:25:09.059711 ip-10-0-141-238 kubenswrapper[2563]: E0722 04:25:09.059607    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-k2znt" podUID="bc2f671d-2057-4b94-8e5c-e6d3cdcdd74e"
Jul 22 04:25:09.148339 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:25:09.148295    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-t5nr2" event={"ID":"6e24b2d2-e7a1-4be2-b35b-9dfd42e74727","Type":"ContainerStarted","Data":"b5081d1f7507da7db7d3b28116e2cd2da42a73530296bc9ba69c44ccb9615721"}
Jul 22 04:25:10.059723 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:25:10.059689    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7x8hk"
Jul 22 04:25:10.059723 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:25:10.059714    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2k7fd"
Jul 22 04:25:10.059926 ip-10-0-141-238 kubenswrapper[2563]: E0722 04:25:10.059801    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-7x8hk" podUID="ca6c339f-ddd5-4c9b-801a-e0323cbc2f0e"
Jul 22 04:25:10.059926 ip-10-0-141-238 kubenswrapper[2563]: E0722 04:25:10.059910    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-2k7fd" podUID="3e22b9bf-95f2-4186-a5a7-2f1d21feb8b1"
Jul 22 04:25:10.154155 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:25:10.154122    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-gjvc2" event={"ID":"79ad9242-2544-40bf-a872-7cbab7ab0b23","Type":"ContainerStarted","Data":"6ad027b40d2e78cf4cd8d242f6f4734349b42e34334127ccb1f34afe4c571483"}
Jul 22 04:25:10.156348 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:25:10.156321    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-t5nr2" event={"ID":"6e24b2d2-e7a1-4be2-b35b-9dfd42e74727","Type":"ContainerStarted","Data":"764c6561ff7f01496b3c8a10677e6994d4378474f73fd62f16635585cb711b99"}
Jul 22 04:25:10.177741 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:25:10.177687    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-t5nr2" podStartSLOduration=8.090899926 podStartE2EDuration="25.177670849s" totalImagesPullingTime="17.086770923s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-22 04:24:45 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 04:25:10.177268662 +0000 UTC m=+25.596277420" watchObservedRunningTime="2026-07-22 04:25:10.177670849 +0000 UTC m=+25.596679610"
Jul 22 04:25:11.060128 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:25:11.060092    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-k2znt"
Jul 22 04:25:11.060311 ip-10-0-141-238 kubenswrapper[2563]: E0722 04:25:11.060226    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-k2znt" podUID="bc2f671d-2057-4b94-8e5c-e6d3cdcdd74e"
Jul 22 04:25:11.846556 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:25:11.846320    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-j9gvx"
Jul 22 04:25:11.847382 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:25:11.846884    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-j9gvx"
Jul 22 04:25:12.059781 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:25:12.059754    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7x8hk"
Jul 22 04:25:12.059781 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:25:12.059769    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2k7fd"
Jul 22 04:25:12.059984 ip-10-0-141-238 kubenswrapper[2563]: E0722 04:25:12.059849    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-7x8hk" podUID="ca6c339f-ddd5-4c9b-801a-e0323cbc2f0e"
Jul 22 04:25:12.060026 ip-10-0-141-238 kubenswrapper[2563]: E0722 04:25:12.060003    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-2k7fd" podUID="3e22b9bf-95f2-4186-a5a7-2f1d21feb8b1"
Jul 22 04:25:12.164252 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:25:12.164216    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-gjvc2" event={"ID":"79ad9242-2544-40bf-a872-7cbab7ab0b23","Type":"ContainerStarted","Data":"e4420984265bfa46f2e25dbf2d032fab4981eac3f81d23d63c2a3f21c9193a26"}
Jul 22 04:25:12.164477 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:25:12.164458    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-gjvc2"
Jul 22 04:25:12.164557 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:25:12.164522    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-gjvc2"
Jul 22 04:25:12.166098 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:25:12.166073    2563 generic.go:356] "Generic (PLEG): container finished" podID="082d9f5d-e4ad-4288-a071-f9f6902393e1" containerID="45fe04f595f57672f13ff5b9724123c43f14354ed4fc11d19d85218d05e0478c" exitCode=0
Jul 22 04:25:12.166225 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:25:12.166139    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-qldhd" event={"ID":"082d9f5d-e4ad-4288-a071-f9f6902393e1","Type":"ContainerDied","Data":"45fe04f595f57672f13ff5b9724123c43f14354ed4fc11d19d85218d05e0478c"}
Jul 22 04:25:12.166225 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:25:12.166212    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-j9gvx"
Jul 22 04:25:12.166951 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:25:12.166925    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-j9gvx"
Jul 22 04:25:12.180187 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:25:12.180164    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-gjvc2"
Jul 22 04:25:12.223809 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:25:12.223759    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-gjvc2" podStartSLOduration=8.101808705 podStartE2EDuration="27.223744108s" totalImagesPullingTime="19.121935403s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-22 04:24:45 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 04:25:12.192925881 +0000 UTC m=+27.611934638" watchObservedRunningTime="2026-07-22 04:25:12.223744108 +0000 UTC m=+27.642752865"
Jul 22 04:25:12.329169 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:25:12.329134    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j9gvx_b4af3ae5-fa65-4358-8399-6ed11b68616e/konnectivity-agent/0.log" limit=1024
Jul 22 04:25:12.417562 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:25:12.417483    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j9gvx_b4af3ae5-fa65-4358-8399-6ed11b68616e/konnectivity-agent/0.log" limit=1024
Jul 22 04:25:13.060339 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:25:13.060312    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-k2znt"
Jul 22 04:25:13.060723 ip-10-0-141-238 kubenswrapper[2563]: E0722 04:25:13.060436    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-k2znt" podUID="bc2f671d-2057-4b94-8e5c-e6d3cdcdd74e"
Jul 22 04:25:13.168371 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:25:13.168169    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-gjvc2"
Jul 22 04:25:13.182514 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:25:13.182493    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-gjvc2"
Jul 22 04:25:13.605235 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:25:13.605168    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-7x8hk"]
Jul 22 04:25:13.605416 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:25:13.605284    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7x8hk"
Jul 22 04:25:13.605416 ip-10-0-141-238 kubenswrapper[2563]: E0722 04:25:13.605369    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-7x8hk" podUID="ca6c339f-ddd5-4c9b-801a-e0323cbc2f0e"
Jul 22 04:25:13.605726 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:25:13.605695    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-2k7fd"]
Jul 22 04:25:13.605836 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:25:13.605824    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2k7fd"
Jul 22 04:25:13.605946 ip-10-0-141-238 kubenswrapper[2563]: E0722 04:25:13.605929    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-2k7fd" podUID="3e22b9bf-95f2-4186-a5a7-2f1d21feb8b1"
Jul 22 04:25:13.606837 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:25:13.606815    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-k2znt"]
Jul 22 04:25:13.606932 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:25:13.606886    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-k2znt"
Jul 22 04:25:13.606980 ip-10-0-141-238 kubenswrapper[2563]: E0722 04:25:13.606944    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-k2znt" podUID="bc2f671d-2057-4b94-8e5c-e6d3cdcdd74e"
Jul 22 04:25:14.171748 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:25:14.171711    2563 generic.go:356] "Generic (PLEG): container finished" podID="082d9f5d-e4ad-4288-a071-f9f6902393e1" containerID="82f24333cddc7f8f02b5ebe8bcae5e053b491e36a43f3ba1c760c5a72ee00916" exitCode=0
Jul 22 04:25:14.172174 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:25:14.171790    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-qldhd" event={"ID":"082d9f5d-e4ad-4288-a071-f9f6902393e1","Type":"ContainerDied","Data":"82f24333cddc7f8f02b5ebe8bcae5e053b491e36a43f3ba1c760c5a72ee00916"}
Jul 22 04:25:15.060370 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:25:15.060338    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2k7fd"
Jul 22 04:25:15.060538 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:25:15.060407    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7x8hk"
Jul 22 04:25:15.060538 ip-10-0-141-238 kubenswrapper[2563]: E0722 04:25:15.060419    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-2k7fd" podUID="3e22b9bf-95f2-4186-a5a7-2f1d21feb8b1"
Jul 22 04:25:15.060538 ip-10-0-141-238 kubenswrapper[2563]: E0722 04:25:15.060497    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-7x8hk" podUID="ca6c339f-ddd5-4c9b-801a-e0323cbc2f0e"
Jul 22 04:25:15.060651 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:25:15.060538    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-k2znt"
Jul 22 04:25:15.060651 ip-10-0-141-238 kubenswrapper[2563]: E0722 04:25:15.060610    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-k2znt" podUID="bc2f671d-2057-4b94-8e5c-e6d3cdcdd74e"
Jul 22 04:25:15.262971 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:25:15.262939    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j9gvx_b4af3ae5-fa65-4358-8399-6ed11b68616e/konnectivity-agent/0.log" limit=1024
Jul 22 04:25:15.335354 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:25:15.335272    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j9gvx_b4af3ae5-fa65-4358-8399-6ed11b68616e/konnectivity-agent/0.log" limit=1024
Jul 22 04:25:16.038380 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:25:16.038295    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j9gvx_b4af3ae5-fa65-4358-8399-6ed11b68616e/konnectivity-agent/0.log" limit=1024
Jul 22 04:25:16.093084 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:25:16.093019    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j9gvx_b4af3ae5-fa65-4358-8399-6ed11b68616e/konnectivity-agent/0.log" limit=1024
Jul 22 04:25:16.178735 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:25:16.178705    2563 generic.go:356] "Generic (PLEG): container finished" podID="082d9f5d-e4ad-4288-a071-f9f6902393e1" containerID="8c37643320238b83f363e2ebf91c3fed3e553158ce48fec6763f169a3c5239c9" exitCode=0
Jul 22 04:25:16.178886 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:25:16.178751    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-qldhd" event={"ID":"082d9f5d-e4ad-4288-a071-f9f6902393e1","Type":"ContainerDied","Data":"8c37643320238b83f363e2ebf91c3fed3e553158ce48fec6763f169a3c5239c9"}
Jul 22 04:25:17.060272 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:25:17.060011    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2k7fd"
Jul 22 04:25:17.060697 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:25:17.060012    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7x8hk"
Jul 22 04:25:17.060697 ip-10-0-141-238 kubenswrapper[2563]: E0722 04:25:17.060387    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-2k7fd" podUID="3e22b9bf-95f2-4186-a5a7-2f1d21feb8b1"
Jul 22 04:25:17.060697 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:25:17.060086    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-k2znt"
Jul 22 04:25:17.060697 ip-10-0-141-238 kubenswrapper[2563]: E0722 04:25:17.060471    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-7x8hk" podUID="ca6c339f-ddd5-4c9b-801a-e0323cbc2f0e"
Jul 22 04:25:17.060697 ip-10-0-141-238 kubenswrapper[2563]: E0722 04:25:17.060541    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-k2znt" podUID="bc2f671d-2057-4b94-8e5c-e6d3cdcdd74e"
Jul 22 04:25:18.745203 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:25:18.745171    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/bc2f671d-2057-4b94-8e5c-e6d3cdcdd74e-original-pull-secret\") pod \"global-pull-secret-syncer-k2znt\" (UID: \"bc2f671d-2057-4b94-8e5c-e6d3cdcdd74e\") " pod="kube-system/global-pull-secret-syncer-k2znt"
Jul 22 04:25:18.745590 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:25:18.745215    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3e22b9bf-95f2-4186-a5a7-2f1d21feb8b1-metrics-certs\") pod \"network-metrics-daemon-2k7fd\" (UID: \"3e22b9bf-95f2-4186-a5a7-2f1d21feb8b1\") " pod="openshift-multus/network-metrics-daemon-2k7fd"
Jul 22 04:25:18.745590 ip-10-0-141-238 kubenswrapper[2563]: E0722 04:25:18.745337    2563 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 22 04:25:18.745590 ip-10-0-141-238 kubenswrapper[2563]: E0722 04:25:18.745337    2563 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 22 04:25:18.745590 ip-10-0-141-238 kubenswrapper[2563]: E0722 04:25:18.745399    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3e22b9bf-95f2-4186-a5a7-2f1d21feb8b1-metrics-certs podName:3e22b9bf-95f2-4186-a5a7-2f1d21feb8b1 nodeName:}" failed. No retries permitted until 2026-07-22 04:25:50.745379311 +0000 UTC m=+66.164388048 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/3e22b9bf-95f2-4186-a5a7-2f1d21feb8b1-metrics-certs") pod "network-metrics-daemon-2k7fd" (UID: "3e22b9bf-95f2-4186-a5a7-2f1d21feb8b1") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 22 04:25:18.745590 ip-10-0-141-238 kubenswrapper[2563]: E0722 04:25:18.745413    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/bc2f671d-2057-4b94-8e5c-e6d3cdcdd74e-original-pull-secret podName:bc2f671d-2057-4b94-8e5c-e6d3cdcdd74e nodeName:}" failed. No retries permitted until 2026-07-22 04:25:50.745407208 +0000 UTC m=+66.164415943 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/bc2f671d-2057-4b94-8e5c-e6d3cdcdd74e-original-pull-secret") pod "global-pull-secret-syncer-k2znt" (UID: "bc2f671d-2057-4b94-8e5c-e6d3cdcdd74e") : object "kube-system"/"original-pull-secret" not registered
Jul 22 04:25:18.846004 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:25:18.845969    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4jwxl\" (UniqueName: \"kubernetes.io/projected/ca6c339f-ddd5-4c9b-801a-e0323cbc2f0e-kube-api-access-4jwxl\") pod \"network-check-target-7x8hk\" (UID: \"ca6c339f-ddd5-4c9b-801a-e0323cbc2f0e\") " pod="openshift-network-diagnostics/network-check-target-7x8hk"
Jul 22 04:25:18.846212 ip-10-0-141-238 kubenswrapper[2563]: E0722 04:25:18.846172    2563 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 22 04:25:18.846212 ip-10-0-141-238 kubenswrapper[2563]: E0722 04:25:18.846199    2563 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 22 04:25:18.846212 ip-10-0-141-238 kubenswrapper[2563]: E0722 04:25:18.846210    2563 projected.go:196] Error preparing data for projected volume kube-api-access-4jwxl for pod openshift-network-diagnostics/network-check-target-7x8hk: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 22 04:25:18.846331 ip-10-0-141-238 kubenswrapper[2563]: E0722 04:25:18.846265    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/ca6c339f-ddd5-4c9b-801a-e0323cbc2f0e-kube-api-access-4jwxl podName:ca6c339f-ddd5-4c9b-801a-e0323cbc2f0e nodeName:}" failed. No retries permitted until 2026-07-22 04:25:50.846250634 +0000 UTC m=+66.265259369 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-4jwxl" (UniqueName: "kubernetes.io/projected/ca6c339f-ddd5-4c9b-801a-e0323cbc2f0e-kube-api-access-4jwxl") pod "network-check-target-7x8hk" (UID: "ca6c339f-ddd5-4c9b-801a-e0323cbc2f0e") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 22 04:25:19.059500 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:25:19.059423    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2k7fd"
Jul 22 04:25:19.059500 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:25:19.059465    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7x8hk"
Jul 22 04:25:19.059729 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:25:19.059562    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-k2znt"
Jul 22 04:25:19.059729 ip-10-0-141-238 kubenswrapper[2563]: E0722 04:25:19.059578    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-2k7fd" podUID="3e22b9bf-95f2-4186-a5a7-2f1d21feb8b1"
Jul 22 04:25:19.059729 ip-10-0-141-238 kubenswrapper[2563]: E0722 04:25:19.059653    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-k2znt" podUID="bc2f671d-2057-4b94-8e5c-e6d3cdcdd74e"
Jul 22 04:25:19.059843 ip-10-0-141-238 kubenswrapper[2563]: E0722 04:25:19.059740    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-7x8hk" podUID="ca6c339f-ddd5-4c9b-801a-e0323cbc2f0e"
Jul 22 04:25:19.415356 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:25:19.415322    2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-238.ec2.internal" event="NodeReady"
Jul 22 04:25:19.415518 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:25:19.415478    2563 kubelet_node_status.go:489] "Fast updating node status as it just became ready"
Jul 22 04:25:19.463696 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:25:19.463663    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-rs8lw"]
Jul 22 04:25:19.468961 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:25:19.468937    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-prmpz"]
Jul 22 04:25:19.469107 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:25:19.469088    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-rs8lw"
Jul 22 04:25:19.471760 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:25:19.471735    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\""
Jul 22 04:25:19.471851 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:25:19.471762    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-cjpdb\""
Jul 22 04:25:19.471851 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:25:19.471742    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\""
Jul 22 04:25:19.472615 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:25:19.472594    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-prmpz"
Jul 22 04:25:19.474483 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:25:19.474463    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-prmpz"]
Jul 22 04:25:19.475217 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:25:19.474970    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-rp4tt\""
Jul 22 04:25:19.475217 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:25:19.475006    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\""
Jul 22 04:25:19.475217 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:25:19.475063    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\""
Jul 22 04:25:19.475523 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:25:19.475433    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\""
Jul 22 04:25:19.477660 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:25:19.477638    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-rs8lw"]
Jul 22 04:25:19.552623 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:25:19.552583    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/28a48c54-711d-4dc7-9b41-9773dc665ffb-tmp-dir\") pod \"dns-default-rs8lw\" (UID: \"28a48c54-711d-4dc7-9b41-9773dc665ffb\") " pod="openshift-dns/dns-default-rs8lw"
Jul 22 04:25:19.552791 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:25:19.552638    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pxhlw\" (UniqueName: \"kubernetes.io/projected/28a48c54-711d-4dc7-9b41-9773dc665ffb-kube-api-access-pxhlw\") pod \"dns-default-rs8lw\" (UID: \"28a48c54-711d-4dc7-9b41-9773dc665ffb\") " pod="openshift-dns/dns-default-rs8lw"
Jul 22 04:25:19.552791 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:25:19.552708    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/28a48c54-711d-4dc7-9b41-9773dc665ffb-config-volume\") pod \"dns-default-rs8lw\" (UID: \"28a48c54-711d-4dc7-9b41-9773dc665ffb\") " pod="openshift-dns/dns-default-rs8lw"
Jul 22 04:25:19.552791 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:25:19.552759    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-stk8q\" (UniqueName: \"kubernetes.io/projected/42ae31bf-835d-4bd7-9e7c-92457d47b9d5-kube-api-access-stk8q\") pod \"ingress-canary-prmpz\" (UID: \"42ae31bf-835d-4bd7-9e7c-92457d47b9d5\") " pod="openshift-ingress-canary/ingress-canary-prmpz"
Jul 22 04:25:19.552943 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:25:19.552822    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/28a48c54-711d-4dc7-9b41-9773dc665ffb-metrics-tls\") pod \"dns-default-rs8lw\" (UID: \"28a48c54-711d-4dc7-9b41-9773dc665ffb\") " pod="openshift-dns/dns-default-rs8lw"
Jul 22 04:25:19.552943 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:25:19.552838    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/42ae31bf-835d-4bd7-9e7c-92457d47b9d5-cert\") pod \"ingress-canary-prmpz\" (UID: \"42ae31bf-835d-4bd7-9e7c-92457d47b9d5\") " pod="openshift-ingress-canary/ingress-canary-prmpz"
Jul 22 04:25:19.653524 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:25:19.653482    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/28a48c54-711d-4dc7-9b41-9773dc665ffb-tmp-dir\") pod \"dns-default-rs8lw\" (UID: \"28a48c54-711d-4dc7-9b41-9773dc665ffb\") " pod="openshift-dns/dns-default-rs8lw"
Jul 22 04:25:19.653697 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:25:19.653540    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pxhlw\" (UniqueName: \"kubernetes.io/projected/28a48c54-711d-4dc7-9b41-9773dc665ffb-kube-api-access-pxhlw\") pod \"dns-default-rs8lw\" (UID: \"28a48c54-711d-4dc7-9b41-9773dc665ffb\") " pod="openshift-dns/dns-default-rs8lw"
Jul 22 04:25:19.653697 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:25:19.653589    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/28a48c54-711d-4dc7-9b41-9773dc665ffb-config-volume\") pod \"dns-default-rs8lw\" (UID: \"28a48c54-711d-4dc7-9b41-9773dc665ffb\") " pod="openshift-dns/dns-default-rs8lw"
Jul 22 04:25:19.653697 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:25:19.653620    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-stk8q\" (UniqueName: \"kubernetes.io/projected/42ae31bf-835d-4bd7-9e7c-92457d47b9d5-kube-api-access-stk8q\") pod \"ingress-canary-prmpz\" (UID: \"42ae31bf-835d-4bd7-9e7c-92457d47b9d5\") " pod="openshift-ingress-canary/ingress-canary-prmpz"
Jul 22 04:25:19.653697 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:25:19.653681    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/28a48c54-711d-4dc7-9b41-9773dc665ffb-metrics-tls\") pod \"dns-default-rs8lw\" (UID: \"28a48c54-711d-4dc7-9b41-9773dc665ffb\") " pod="openshift-dns/dns-default-rs8lw"
Jul 22 04:25:19.653889 ip-10-0-141-238 kubenswrapper[2563]: E0722 04:25:19.653777    2563 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 22 04:25:19.653889 ip-10-0-141-238 kubenswrapper[2563]: E0722 04:25:19.653832    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/28a48c54-711d-4dc7-9b41-9773dc665ffb-metrics-tls podName:28a48c54-711d-4dc7-9b41-9773dc665ffb nodeName:}" failed. No retries permitted until 2026-07-22 04:25:20.153814541 +0000 UTC m=+35.572823279 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/28a48c54-711d-4dc7-9b41-9773dc665ffb-metrics-tls") pod "dns-default-rs8lw" (UID: "28a48c54-711d-4dc7-9b41-9773dc665ffb") : secret "dns-default-metrics-tls" not found
Jul 22 04:25:19.653889 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:25:19.653857    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/28a48c54-711d-4dc7-9b41-9773dc665ffb-tmp-dir\") pod \"dns-default-rs8lw\" (UID: \"28a48c54-711d-4dc7-9b41-9773dc665ffb\") " pod="openshift-dns/dns-default-rs8lw"
Jul 22 04:25:19.653984 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:25:19.653917    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/42ae31bf-835d-4bd7-9e7c-92457d47b9d5-cert\") pod \"ingress-canary-prmpz\" (UID: \"42ae31bf-835d-4bd7-9e7c-92457d47b9d5\") " pod="openshift-ingress-canary/ingress-canary-prmpz"
Jul 22 04:25:19.654360 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:25:19.654339    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/28a48c54-711d-4dc7-9b41-9773dc665ffb-config-volume\") pod \"dns-default-rs8lw\" (UID: \"28a48c54-711d-4dc7-9b41-9773dc665ffb\") " pod="openshift-dns/dns-default-rs8lw"
Jul 22 04:25:19.658487 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:25:19.658466    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/42ae31bf-835d-4bd7-9e7c-92457d47b9d5-cert\") pod \"ingress-canary-prmpz\" (UID: \"42ae31bf-835d-4bd7-9e7c-92457d47b9d5\") " pod="openshift-ingress-canary/ingress-canary-prmpz"
Jul 22 04:25:19.664684 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:25:19.664662    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pxhlw\" (UniqueName: \"kubernetes.io/projected/28a48c54-711d-4dc7-9b41-9773dc665ffb-kube-api-access-pxhlw\") pod \"dns-default-rs8lw\" (UID: \"28a48c54-711d-4dc7-9b41-9773dc665ffb\") " pod="openshift-dns/dns-default-rs8lw"
Jul 22 04:25:19.665113 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:25:19.665092    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-stk8q\" (UniqueName: \"kubernetes.io/projected/42ae31bf-835d-4bd7-9e7c-92457d47b9d5-kube-api-access-stk8q\") pod \"ingress-canary-prmpz\" (UID: \"42ae31bf-835d-4bd7-9e7c-92457d47b9d5\") " pod="openshift-ingress-canary/ingress-canary-prmpz"
Jul 22 04:25:19.789439 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:25:19.789357    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-prmpz"
Jul 22 04:25:20.158437 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:25:20.158392    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/28a48c54-711d-4dc7-9b41-9773dc665ffb-metrics-tls\") pod \"dns-default-rs8lw\" (UID: \"28a48c54-711d-4dc7-9b41-9773dc665ffb\") " pod="openshift-dns/dns-default-rs8lw"
Jul 22 04:25:20.158626 ip-10-0-141-238 kubenswrapper[2563]: E0722 04:25:20.158609    2563 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 22 04:25:20.158703 ip-10-0-141-238 kubenswrapper[2563]: E0722 04:25:20.158688    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/28a48c54-711d-4dc7-9b41-9773dc665ffb-metrics-tls podName:28a48c54-711d-4dc7-9b41-9773dc665ffb nodeName:}" failed. No retries permitted until 2026-07-22 04:25:21.158665894 +0000 UTC m=+36.577674648 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/28a48c54-711d-4dc7-9b41-9773dc665ffb-metrics-tls") pod "dns-default-rs8lw" (UID: "28a48c54-711d-4dc7-9b41-9773dc665ffb") : secret "dns-default-metrics-tls" not found
Jul 22 04:25:20.318570 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:25:20.318540    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-prmpz"]
Jul 22 04:25:20.326276 ip-10-0-141-238 kubenswrapper[2563]: W0722 04:25:20.326255    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod42ae31bf_835d_4bd7_9e7c_92457d47b9d5.slice/crio-bc9cc7e12f83039d777b516ea8fa142a88ac9d7fa27c91cdd81c69fd6c2a3d03 WatchSource:0}: Error finding container bc9cc7e12f83039d777b516ea8fa142a88ac9d7fa27c91cdd81c69fd6c2a3d03: Status 404 returned error can't find the container with id bc9cc7e12f83039d777b516ea8fa142a88ac9d7fa27c91cdd81c69fd6c2a3d03
Jul 22 04:25:21.059678 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:25:21.059633    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2k7fd"
Jul 22 04:25:21.060511 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:25:21.059640    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-k2znt"
Jul 22 04:25:21.060511 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:25:21.059640    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7x8hk"
Jul 22 04:25:21.063891 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:25:21.063742    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Jul 22 04:25:21.063891 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:25:21.063756    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Jul 22 04:25:21.063891 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:25:21.063769    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Jul 22 04:25:21.063891 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:25:21.063774    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Jul 22 04:25:21.063891 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:25:21.063745    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-s9hfn\""
Jul 22 04:25:21.063891 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:25:21.063780    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-h8l96\""
Jul 22 04:25:21.164602 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:25:21.164562    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/28a48c54-711d-4dc7-9b41-9773dc665ffb-metrics-tls\") pod \"dns-default-rs8lw\" (UID: \"28a48c54-711d-4dc7-9b41-9773dc665ffb\") " pod="openshift-dns/dns-default-rs8lw"
Jul 22 04:25:21.164768 ip-10-0-141-238 kubenswrapper[2563]: E0722 04:25:21.164747    2563 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 22 04:25:21.164851 ip-10-0-141-238 kubenswrapper[2563]: E0722 04:25:21.164828    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/28a48c54-711d-4dc7-9b41-9773dc665ffb-metrics-tls podName:28a48c54-711d-4dc7-9b41-9773dc665ffb nodeName:}" failed. No retries permitted until 2026-07-22 04:25:23.164807428 +0000 UTC m=+38.583816168 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/28a48c54-711d-4dc7-9b41-9773dc665ffb-metrics-tls") pod "dns-default-rs8lw" (UID: "28a48c54-711d-4dc7-9b41-9773dc665ffb") : secret "dns-default-metrics-tls" not found
Jul 22 04:25:21.191543 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:25:21.191513    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-prmpz" event={"ID":"42ae31bf-835d-4bd7-9e7c-92457d47b9d5","Type":"ContainerStarted","Data":"bc9cc7e12f83039d777b516ea8fa142a88ac9d7fa27c91cdd81c69fd6c2a3d03"}
Jul 22 04:25:21.194719 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:25:21.194690    2563 generic.go:356] "Generic (PLEG): container finished" podID="082d9f5d-e4ad-4288-a071-f9f6902393e1" containerID="520dc77e8c698abec243427c19f4207093908b2339db8bcb4689d3450a980805" exitCode=0
Jul 22 04:25:21.194840 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:25:21.194731    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-qldhd" event={"ID":"082d9f5d-e4ad-4288-a071-f9f6902393e1","Type":"ContainerDied","Data":"520dc77e8c698abec243427c19f4207093908b2339db8bcb4689d3450a980805"}
Jul 22 04:25:22.200830 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:25:22.200796    2563 generic.go:356] "Generic (PLEG): container finished" podID="082d9f5d-e4ad-4288-a071-f9f6902393e1" containerID="73e5d788d8fdc5ad882969ced45455f30e3b85547a6ab53fb5e7824e6bbaffae" exitCode=0
Jul 22 04:25:22.201251 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:25:22.200839    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-qldhd" event={"ID":"082d9f5d-e4ad-4288-a071-f9f6902393e1","Type":"ContainerDied","Data":"73e5d788d8fdc5ad882969ced45455f30e3b85547a6ab53fb5e7824e6bbaffae"}
Jul 22 04:25:23.181268 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:25:23.181237    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/28a48c54-711d-4dc7-9b41-9773dc665ffb-metrics-tls\") pod \"dns-default-rs8lw\" (UID: \"28a48c54-711d-4dc7-9b41-9773dc665ffb\") " pod="openshift-dns/dns-default-rs8lw"
Jul 22 04:25:23.181441 ip-10-0-141-238 kubenswrapper[2563]: E0722 04:25:23.181420    2563 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 22 04:25:23.181516 ip-10-0-141-238 kubenswrapper[2563]: E0722 04:25:23.181503    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/28a48c54-711d-4dc7-9b41-9773dc665ffb-metrics-tls podName:28a48c54-711d-4dc7-9b41-9773dc665ffb nodeName:}" failed. No retries permitted until 2026-07-22 04:25:27.181480688 +0000 UTC m=+42.600489424 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/28a48c54-711d-4dc7-9b41-9773dc665ffb-metrics-tls") pod "dns-default-rs8lw" (UID: "28a48c54-711d-4dc7-9b41-9773dc665ffb") : secret "dns-default-metrics-tls" not found
Jul 22 04:25:23.206219 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:25:23.206191    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-qldhd" event={"ID":"082d9f5d-e4ad-4288-a071-f9f6902393e1","Type":"ContainerStarted","Data":"a4550fd1c0c654d12d10d45042efa3e340a50ed1e75737bfd81659dc80c82988"}
Jul 22 04:25:23.207512 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:25:23.207489    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-prmpz" event={"ID":"42ae31bf-835d-4bd7-9e7c-92457d47b9d5","Type":"ContainerStarted","Data":"7a9bfe7f14a07788376485cce9ebef72bd8985081804708e479438e217da4b27"}
Jul 22 04:25:23.228033 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:25:23.227990    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-qldhd" podStartSLOduration=8.234292443 podStartE2EDuration="38.227976333s" totalImagesPullingTime="29.99368389s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-22 04:24:45 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 04:25:23.226170212 +0000 UTC m=+38.645178968" watchObservedRunningTime="2026-07-22 04:25:23.227976333 +0000 UTC m=+38.646985089"
Jul 22 04:25:23.240121 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:25:23.240082    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-prmpz" podStartSLOduration=1.70403059 podStartE2EDuration="4.240068397s" totalImagesPullingTime="2.536037807s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 04:25:19 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 04:25:23.239289195 +0000 UTC m=+38.658297952" watchObservedRunningTime="2026-07-22 04:25:23.240068397 +0000 UTC m=+38.659077151"
Jul 22 04:25:23.351592 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:25:23.351553    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j9gvx_b4af3ae5-fa65-4358-8399-6ed11b68616e/konnectivity-agent/0.log" limit=1024
Jul 22 04:25:23.452292 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:25:23.452262    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j9gvx_b4af3ae5-fa65-4358-8399-6ed11b68616e/konnectivity-agent/0.log" limit=1024
Jul 22 04:25:23.552283 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:25:23.552248    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j9gvx_b4af3ae5-fa65-4358-8399-6ed11b68616e/konnectivity-agent/0.log" limit=1024
Jul 22 04:25:23.603854 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:25:23.603819    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j9gvx_b4af3ae5-fa65-4358-8399-6ed11b68616e/konnectivity-agent/0.log" limit=1024
Jul 22 04:25:25.118345 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:25:25.118307    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j9gvx_b4af3ae5-fa65-4358-8399-6ed11b68616e/konnectivity-agent/0.log" limit=1024
Jul 22 04:25:25.167881 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:25:25.167830    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j9gvx_b4af3ae5-fa65-4358-8399-6ed11b68616e/konnectivity-agent/0.log" limit=1024
Jul 22 04:25:27.209614 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:25:27.209576    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/28a48c54-711d-4dc7-9b41-9773dc665ffb-metrics-tls\") pod \"dns-default-rs8lw\" (UID: \"28a48c54-711d-4dc7-9b41-9773dc665ffb\") " pod="openshift-dns/dns-default-rs8lw"
Jul 22 04:25:27.209992 ip-10-0-141-238 kubenswrapper[2563]: E0722 04:25:27.209708    2563 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 22 04:25:27.209992 ip-10-0-141-238 kubenswrapper[2563]: E0722 04:25:27.209759    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/28a48c54-711d-4dc7-9b41-9773dc665ffb-metrics-tls podName:28a48c54-711d-4dc7-9b41-9773dc665ffb nodeName:}" failed. No retries permitted until 2026-07-22 04:25:35.209744473 +0000 UTC m=+50.628753211 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/28a48c54-711d-4dc7-9b41-9773dc665ffb-metrics-tls") pod "dns-default-rs8lw" (UID: "28a48c54-711d-4dc7-9b41-9773dc665ffb") : secret "dns-default-metrics-tls" not found
Jul 22 04:25:35.263440 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:25:35.263406    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/28a48c54-711d-4dc7-9b41-9773dc665ffb-metrics-tls\") pod \"dns-default-rs8lw\" (UID: \"28a48c54-711d-4dc7-9b41-9773dc665ffb\") " pod="openshift-dns/dns-default-rs8lw"
Jul 22 04:25:35.263884 ip-10-0-141-238 kubenswrapper[2563]: E0722 04:25:35.263509    2563 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 22 04:25:35.263884 ip-10-0-141-238 kubenswrapper[2563]: E0722 04:25:35.263593    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/28a48c54-711d-4dc7-9b41-9773dc665ffb-metrics-tls podName:28a48c54-711d-4dc7-9b41-9773dc665ffb nodeName:}" failed. No retries permitted until 2026-07-22 04:25:51.263579473 +0000 UTC m=+66.682588208 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/28a48c54-711d-4dc7-9b41-9773dc665ffb-metrics-tls") pod "dns-default-rs8lw" (UID: "28a48c54-711d-4dc7-9b41-9773dc665ffb") : secret "dns-default-metrics-tls" not found
Jul 22 04:25:37.262135 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:25:37.262105    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j9gvx_b4af3ae5-fa65-4358-8399-6ed11b68616e/konnectivity-agent/0.log" limit=1024
Jul 22 04:25:37.315717 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:25:37.315692    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j9gvx_b4af3ae5-fa65-4358-8399-6ed11b68616e/konnectivity-agent/0.log" limit=1024
Jul 22 04:25:45.194127 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:25:45.194099    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-gjvc2"
Jul 22 04:25:45.372782 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:25:45.372751    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j9gvx_b4af3ae5-fa65-4358-8399-6ed11b68616e/konnectivity-agent/0.log" limit=1024
Jul 22 04:25:45.472153 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:25:45.472071    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j9gvx_b4af3ae5-fa65-4358-8399-6ed11b68616e/konnectivity-agent/0.log" limit=1024
Jul 22 04:25:47.442648 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:25:47.442602    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j9gvx_b4af3ae5-fa65-4358-8399-6ed11b68616e/konnectivity-agent/0.log" limit=1024
Jul 22 04:25:47.500722 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:25:47.500692    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j9gvx_b4af3ae5-fa65-4358-8399-6ed11b68616e/konnectivity-agent/0.log" limit=1024
Jul 22 04:25:50.771706 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:25:50.771655    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/bc2f671d-2057-4b94-8e5c-e6d3cdcdd74e-original-pull-secret\") pod \"global-pull-secret-syncer-k2znt\" (UID: \"bc2f671d-2057-4b94-8e5c-e6d3cdcdd74e\") " pod="kube-system/global-pull-secret-syncer-k2znt"
Jul 22 04:25:50.771706 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:25:50.771713    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3e22b9bf-95f2-4186-a5a7-2f1d21feb8b1-metrics-certs\") pod \"network-metrics-daemon-2k7fd\" (UID: \"3e22b9bf-95f2-4186-a5a7-2f1d21feb8b1\") " pod="openshift-multus/network-metrics-daemon-2k7fd"
Jul 22 04:25:50.774513 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:25:50.774494    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Jul 22 04:25:50.774588 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:25:50.774546    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Jul 22 04:25:50.781867 ip-10-0-141-238 kubenswrapper[2563]: E0722 04:25:50.781839    2563 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found
Jul 22 04:25:50.781991 ip-10-0-141-238 kubenswrapper[2563]: E0722 04:25:50.781925    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3e22b9bf-95f2-4186-a5a7-2f1d21feb8b1-metrics-certs podName:3e22b9bf-95f2-4186-a5a7-2f1d21feb8b1 nodeName:}" failed. No retries permitted until 2026-07-22 04:26:54.781893489 +0000 UTC m=+130.200902224 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/3e22b9bf-95f2-4186-a5a7-2f1d21feb8b1-metrics-certs") pod "network-metrics-daemon-2k7fd" (UID: "3e22b9bf-95f2-4186-a5a7-2f1d21feb8b1") : secret "metrics-daemon-secret" not found
Jul 22 04:25:50.785294 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:25:50.785274    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/bc2f671d-2057-4b94-8e5c-e6d3cdcdd74e-original-pull-secret\") pod \"global-pull-secret-syncer-k2znt\" (UID: \"bc2f671d-2057-4b94-8e5c-e6d3cdcdd74e\") " pod="kube-system/global-pull-secret-syncer-k2znt"
Jul 22 04:25:50.872590 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:25:50.872556    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4jwxl\" (UniqueName: \"kubernetes.io/projected/ca6c339f-ddd5-4c9b-801a-e0323cbc2f0e-kube-api-access-4jwxl\") pod \"network-check-target-7x8hk\" (UID: \"ca6c339f-ddd5-4c9b-801a-e0323cbc2f0e\") " pod="openshift-network-diagnostics/network-check-target-7x8hk"
Jul 22 04:25:50.875233 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:25:50.875215    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Jul 22 04:25:50.885272 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:25:50.885251    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Jul 22 04:25:50.896487 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:25:50.896466    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4jwxl\" (UniqueName: \"kubernetes.io/projected/ca6c339f-ddd5-4c9b-801a-e0323cbc2f0e-kube-api-access-4jwxl\") pod \"network-check-target-7x8hk\" (UID: \"ca6c339f-ddd5-4c9b-801a-e0323cbc2f0e\") " pod="openshift-network-diagnostics/network-check-target-7x8hk"
Jul 22 04:25:51.079403 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:25:51.079336    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-k2znt"
Jul 22 04:25:51.089151 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:25:51.089130    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-h8l96\""
Jul 22 04:25:51.097114 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:25:51.097090    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7x8hk"
Jul 22 04:25:51.222021 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:25:51.221994    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-k2znt"]
Jul 22 04:25:51.225883 ip-10-0-141-238 kubenswrapper[2563]: W0722 04:25:51.225842    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbc2f671d_2057_4b94_8e5c_e6d3cdcdd74e.slice/crio-98defaf2244971d00598753d9d586f0275b1fbcf1ac5f7f88f611af9444c5fe8 WatchSource:0}: Error finding container 98defaf2244971d00598753d9d586f0275b1fbcf1ac5f7f88f611af9444c5fe8: Status 404 returned error can't find the container with id 98defaf2244971d00598753d9d586f0275b1fbcf1ac5f7f88f611af9444c5fe8
Jul 22 04:25:51.240483 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:25:51.240455    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-7x8hk"]
Jul 22 04:25:51.243280 ip-10-0-141-238 kubenswrapper[2563]: W0722 04:25:51.243254    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podca6c339f_ddd5_4c9b_801a_e0323cbc2f0e.slice/crio-212901058b8054e7ce6a557f873c0de69925a65113ed780cac819fb31b2f86ec WatchSource:0}: Error finding container 212901058b8054e7ce6a557f873c0de69925a65113ed780cac819fb31b2f86ec: Status 404 returned error can't find the container with id 212901058b8054e7ce6a557f873c0de69925a65113ed780cac819fb31b2f86ec
Jul 22 04:25:51.271407 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:25:51.271375    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-7x8hk" event={"ID":"ca6c339f-ddd5-4c9b-801a-e0323cbc2f0e","Type":"ContainerStarted","Data":"212901058b8054e7ce6a557f873c0de69925a65113ed780cac819fb31b2f86ec"}
Jul 22 04:25:51.272408 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:25:51.272390    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-k2znt" event={"ID":"bc2f671d-2057-4b94-8e5c-e6d3cdcdd74e","Type":"ContainerStarted","Data":"98defaf2244971d00598753d9d586f0275b1fbcf1ac5f7f88f611af9444c5fe8"}
Jul 22 04:25:51.275743 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:25:51.275725    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/28a48c54-711d-4dc7-9b41-9773dc665ffb-metrics-tls\") pod \"dns-default-rs8lw\" (UID: \"28a48c54-711d-4dc7-9b41-9773dc665ffb\") " pod="openshift-dns/dns-default-rs8lw"
Jul 22 04:25:51.275832 ip-10-0-141-238 kubenswrapper[2563]: E0722 04:25:51.275824    2563 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 22 04:25:51.275887 ip-10-0-141-238 kubenswrapper[2563]: E0722 04:25:51.275877    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/28a48c54-711d-4dc7-9b41-9773dc665ffb-metrics-tls podName:28a48c54-711d-4dc7-9b41-9773dc665ffb nodeName:}" failed. No retries permitted until 2026-07-22 04:26:23.275864478 +0000 UTC m=+98.694873357 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/28a48c54-711d-4dc7-9b41-9773dc665ffb-metrics-tls") pod "dns-default-rs8lw" (UID: "28a48c54-711d-4dc7-9b41-9773dc665ffb") : secret "dns-default-metrics-tls" not found
Jul 22 04:25:51.437313 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:25:51.437255    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j9gvx_b4af3ae5-fa65-4358-8399-6ed11b68616e/konnectivity-agent/0.log" limit=1024
Jul 22 04:25:51.493302 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:25:51.493267    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j9gvx_b4af3ae5-fa65-4358-8399-6ed11b68616e/konnectivity-agent/0.log" limit=1024
Jul 22 04:25:56.287514 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:25:56.287477    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-7x8hk" event={"ID":"ca6c339f-ddd5-4c9b-801a-e0323cbc2f0e","Type":"ContainerStarted","Data":"a26eac9a8259d42d71c0ea564c1d5866336f4788226db67885d585573568c5e3"}
Jul 22 04:25:56.287983 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:25:56.287551    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-7x8hk"
Jul 22 04:25:56.288926 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:25:56.288902    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-k2znt" event={"ID":"bc2f671d-2057-4b94-8e5c-e6d3cdcdd74e","Type":"ContainerStarted","Data":"1da186806d8def32532d335537e327efb5a53c4b5b1649b149319d003f926ee7"}
Jul 22 04:25:56.302879 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:25:56.302836    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-7x8hk" podStartSLOduration=66.708976446 podStartE2EDuration="1m11.302825851s" totalImagesPullingTime="4.593849405s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 04:24:45 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 04:25:56.30263493 +0000 UTC m=+71.721643687" watchObservedRunningTime="2026-07-22 04:25:56.302825851 +0000 UTC m=+71.721834652"
Jul 22 04:26:14.711320 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:26:14.711186    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j9gvx_b4af3ae5-fa65-4358-8399-6ed11b68616e/konnectivity-agent/0.log" limit=1024
Jul 22 04:26:14.758388 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:26:14.758355    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j9gvx_b4af3ae5-fa65-4358-8399-6ed11b68616e/konnectivity-agent/0.log" limit=1024
Jul 22 04:26:18.432266 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:26:18.432211    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-k2znt" podStartSLOduration=88.817794792 podStartE2EDuration="1m33.432195533s" totalImagesPullingTime="4.614400741s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-22 04:24:45 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 04:25:56.316520507 +0000 UTC m=+71.735529263" watchObservedRunningTime="2026-07-22 04:26:18.432195533 +0000 UTC m=+93.851204290"
Jul 22 04:26:18.432665 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:26:18.432652    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-cf7dc84bb-8ggqh"]
Jul 22 04:26:18.436693 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:26:18.436674    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-cf7dc84bb-8ggqh"
Jul 22 04:26:18.439874 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:26:18.439847    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"kube-root-ca.crt\""
Jul 22 04:26:18.440882 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:26:18.440857    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"managed-serviceaccount-dockercfg-h89fl\""
Jul 22 04:26:18.446846 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:26:18.446821    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"openshift-service-ca.crt\""
Jul 22 04:26:18.446947 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:26:18.446853    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"open-cluster-management-image-pull-credentials\""
Jul 22 04:26:18.446947 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:26:18.446926    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"managed-serviceaccount-hub-kubeconfig\""
Jul 22 04:26:18.454165 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:26:18.454146    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-cf7dc84bb-8ggqh"]
Jul 22 04:26:18.561826 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:26:18.561789    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-z6fvq\" (UniqueName: \"kubernetes.io/projected/4cfd323a-1d21-475d-b110-0449e9b8092a-kube-api-access-z6fvq\") pod \"managed-serviceaccount-addon-agent-cf7dc84bb-8ggqh\" (UID: \"4cfd323a-1d21-475d-b110-0449e9b8092a\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-cf7dc84bb-8ggqh"
Jul 22 04:26:18.562002 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:26:18.561886    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/4cfd323a-1d21-475d-b110-0449e9b8092a-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-cf7dc84bb-8ggqh\" (UID: \"4cfd323a-1d21-475d-b110-0449e9b8092a\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-cf7dc84bb-8ggqh"
Jul 22 04:26:18.662301 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:26:18.662267    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/4cfd323a-1d21-475d-b110-0449e9b8092a-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-cf7dc84bb-8ggqh\" (UID: \"4cfd323a-1d21-475d-b110-0449e9b8092a\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-cf7dc84bb-8ggqh"
Jul 22 04:26:18.662428 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:26:18.662320    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-z6fvq\" (UniqueName: \"kubernetes.io/projected/4cfd323a-1d21-475d-b110-0449e9b8092a-kube-api-access-z6fvq\") pod \"managed-serviceaccount-addon-agent-cf7dc84bb-8ggqh\" (UID: \"4cfd323a-1d21-475d-b110-0449e9b8092a\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-cf7dc84bb-8ggqh"
Jul 22 04:26:18.664762 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:26:18.664736    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/4cfd323a-1d21-475d-b110-0449e9b8092a-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-cf7dc84bb-8ggqh\" (UID: \"4cfd323a-1d21-475d-b110-0449e9b8092a\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-cf7dc84bb-8ggqh"
Jul 22 04:26:18.670525 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:26:18.670496    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-z6fvq\" (UniqueName: \"kubernetes.io/projected/4cfd323a-1d21-475d-b110-0449e9b8092a-kube-api-access-z6fvq\") pod \"managed-serviceaccount-addon-agent-cf7dc84bb-8ggqh\" (UID: \"4cfd323a-1d21-475d-b110-0449e9b8092a\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-cf7dc84bb-8ggqh"
Jul 22 04:26:18.756471 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:26:18.756397    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-cf7dc84bb-8ggqh"
Jul 22 04:26:18.876177 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:26:18.876148    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-cf7dc84bb-8ggqh"]
Jul 22 04:26:18.879197 ip-10-0-141-238 kubenswrapper[2563]: W0722 04:26:18.879164    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod4cfd323a_1d21_475d_b110_0449e9b8092a.slice/crio-28c2483d6a82267c6d9c729ce81af3d2d60afa72467a1636adc89c685955541b WatchSource:0}: Error finding container 28c2483d6a82267c6d9c729ce81af3d2d60afa72467a1636adc89c685955541b: Status 404 returned error can't find the container with id 28c2483d6a82267c6d9c729ce81af3d2d60afa72467a1636adc89c685955541b
Jul 22 04:26:19.344145 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:26:19.344103    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-cf7dc84bb-8ggqh" event={"ID":"4cfd323a-1d21-475d-b110-0449e9b8092a","Type":"ContainerStarted","Data":"28c2483d6a82267c6d9c729ce81af3d2d60afa72467a1636adc89c685955541b"}
Jul 22 04:26:22.352459 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:26:22.352422    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-cf7dc84bb-8ggqh" event={"ID":"4cfd323a-1d21-475d-b110-0449e9b8092a","Type":"ContainerStarted","Data":"49c5b027a9d46ed432cf780e275b87b2443cc43763813a2bc30acc62bbe313eb"}
Jul 22 04:26:22.368216 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:26:22.368167    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-cf7dc84bb-8ggqh" podStartSLOduration=1.846720846 podStartE2EDuration="4.368152103s" totalImagesPullingTime="2.521431257s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 04:26:18 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 04:26:22.367689377 +0000 UTC m=+97.786698135" watchObservedRunningTime="2026-07-22 04:26:22.368152103 +0000 UTC m=+97.787160861"
Jul 22 04:26:23.294001 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:26:23.293966    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/28a48c54-711d-4dc7-9b41-9773dc665ffb-metrics-tls\") pod \"dns-default-rs8lw\" (UID: \"28a48c54-711d-4dc7-9b41-9773dc665ffb\") " pod="openshift-dns/dns-default-rs8lw"
Jul 22 04:26:23.294183 ip-10-0-141-238 kubenswrapper[2563]: E0722 04:26:23.294097    2563 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 22 04:26:23.294183 ip-10-0-141-238 kubenswrapper[2563]: E0722 04:26:23.294149    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/28a48c54-711d-4dc7-9b41-9773dc665ffb-metrics-tls podName:28a48c54-711d-4dc7-9b41-9773dc665ffb nodeName:}" failed. No retries permitted until 2026-07-22 04:27:27.29413659 +0000 UTC m=+162.713145324 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/28a48c54-711d-4dc7-9b41-9773dc665ffb-metrics-tls") pod "dns-default-rs8lw" (UID: "28a48c54-711d-4dc7-9b41-9773dc665ffb") : secret "dns-default-metrics-tls" not found
Jul 22 04:26:27.294086 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:26:27.294053    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-7x8hk"
Jul 22 04:26:54.803056 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:26:54.802994    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3e22b9bf-95f2-4186-a5a7-2f1d21feb8b1-metrics-certs\") pod \"network-metrics-daemon-2k7fd\" (UID: \"3e22b9bf-95f2-4186-a5a7-2f1d21feb8b1\") " pod="openshift-multus/network-metrics-daemon-2k7fd"
Jul 22 04:26:54.803544 ip-10-0-141-238 kubenswrapper[2563]: E0722 04:26:54.803149    2563 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found
Jul 22 04:26:54.803544 ip-10-0-141-238 kubenswrapper[2563]: E0722 04:26:54.803214    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3e22b9bf-95f2-4186-a5a7-2f1d21feb8b1-metrics-certs podName:3e22b9bf-95f2-4186-a5a7-2f1d21feb8b1 nodeName:}" failed. No retries permitted until 2026-07-22 04:28:56.803197592 +0000 UTC m=+252.222206328 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/3e22b9bf-95f2-4186-a5a7-2f1d21feb8b1-metrics-certs") pod "network-metrics-daemon-2k7fd" (UID: "3e22b9bf-95f2-4186-a5a7-2f1d21feb8b1") : secret "metrics-daemon-secret" not found
Jul 22 04:27:22.482514 ip-10-0-141-238 kubenswrapper[2563]: E0722 04:27:22.482453    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-rs8lw" podUID="28a48c54-711d-4dc7-9b41-9773dc665ffb"
Jul 22 04:27:22.492305 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:27:22.492280    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-rs8lw"
Jul 22 04:27:24.071783 ip-10-0-141-238 kubenswrapper[2563]: E0722 04:27:24.071738    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-certs], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-multus/network-metrics-daemon-2k7fd" podUID="3e22b9bf-95f2-4186-a5a7-2f1d21feb8b1"
Jul 22 04:27:27.320119 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:27:27.320080    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/28a48c54-711d-4dc7-9b41-9773dc665ffb-metrics-tls\") pod \"dns-default-rs8lw\" (UID: \"28a48c54-711d-4dc7-9b41-9773dc665ffb\") " pod="openshift-dns/dns-default-rs8lw"
Jul 22 04:27:27.320521 ip-10-0-141-238 kubenswrapper[2563]: E0722 04:27:27.320220    2563 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 22 04:27:27.320521 ip-10-0-141-238 kubenswrapper[2563]: E0722 04:27:27.320291    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/28a48c54-711d-4dc7-9b41-9773dc665ffb-metrics-tls podName:28a48c54-711d-4dc7-9b41-9773dc665ffb nodeName:}" failed. No retries permitted until 2026-07-22 04:29:29.320275328 +0000 UTC m=+284.739284064 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/28a48c54-711d-4dc7-9b41-9773dc665ffb-metrics-tls") pod "dns-default-rs8lw" (UID: "28a48c54-711d-4dc7-9b41-9773dc665ffb") : secret "dns-default-metrics-tls" not found
Jul 22 04:27:35.060932 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:27:35.060898    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2k7fd"
Jul 22 04:28:17.524977 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:28:17.524921    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j9gvx_b4af3ae5-fa65-4358-8399-6ed11b68616e/konnectivity-agent/0.log" limit=1024
Jul 22 04:28:21.633519 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:28:21.633483    2563 generic.go:356] "Generic (PLEG): container finished" podID="4cfd323a-1d21-475d-b110-0449e9b8092a" containerID="49c5b027a9d46ed432cf780e275b87b2443cc43763813a2bc30acc62bbe313eb" exitCode=255
Jul 22 04:28:21.633909 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:28:21.633541    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-cf7dc84bb-8ggqh" event={"ID":"4cfd323a-1d21-475d-b110-0449e9b8092a","Type":"ContainerDied","Data":"49c5b027a9d46ed432cf780e275b87b2443cc43763813a2bc30acc62bbe313eb"}
Jul 22 04:28:21.639131 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:28:21.639110    2563 scope.go:117] "RemoveContainer" containerID="49c5b027a9d46ed432cf780e275b87b2443cc43763813a2bc30acc62bbe313eb"
Jul 22 04:28:22.637351 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:28:22.637311    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-cf7dc84bb-8ggqh" event={"ID":"4cfd323a-1d21-475d-b110-0449e9b8092a","Type":"ContainerStarted","Data":"1d850f482d927d4c3ba7f0192a77cfe3e343e1886d453f7452f25b8765852669"}
Jul 22 04:28:45.205707 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:28:45.205678    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/router-default-5fc6f998d6-njv7d"]
Jul 22 04:28:45.208371 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:28:45.208349    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-5fc6f998d6-njv7d"
Jul 22 04:28:45.212501 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:28:45.212477    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"service-ca-bundle\""
Jul 22 04:28:45.212745 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:28:45.212729    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\""
Jul 22 04:28:45.212804 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:28:45.212757    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-metrics-certs-default\""
Jul 22 04:28:45.212804 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:28:45.212786    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-dockercfg-fd4kz\""
Jul 22 04:28:45.212932 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:28:45.212905    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-stats-default\""
Jul 22 04:28:45.213107 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:28:45.213090    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"default-ingress-cert\""
Jul 22 04:28:45.213675 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:28:45.213656    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\""
Jul 22 04:28:45.215173 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:28:45.215149    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-5fc6f998d6-njv7d"]
Jul 22 04:28:45.279780 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:28:45.279744    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-6tkm8"]
Jul 22 04:28:45.282721 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:28:45.282703    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console-operator/console-operator-565b7b569d-gw4km"]
Jul 22 04:28:45.282837 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:28:45.282821    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-6tkm8"
Jul 22 04:28:45.285297 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:28:45.285277    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-operator-555d9d7885-kmxdh"]
Jul 22 04:28:45.285412 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:28:45.285385    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-565b7b569d-gw4km"
Jul 22 04:28:45.285483 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:28:45.285462    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"openshift-service-ca.crt\""
Jul 22 04:28:45.286290 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:28:45.286274    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"serving-cert\""
Jul 22 04:28:45.286387 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:28:45.286289    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-storage-version-migrator-operator-dockercfg-6ght2\""
Jul 22 04:28:45.286387 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:28:45.286362    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"config\""
Jul 22 04:28:45.286644 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:28:45.286628    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-root-ca.crt\""
Jul 22 04:28:45.287370 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:28:45.287357    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"serving-cert\""
Jul 22 04:28:45.287963 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:28:45.287928    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-57d6d8f867-t2t9g"]
Jul 22 04:28:45.288147 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:28:45.288127    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"console-operator-config\""
Jul 22 04:28:45.288218 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:28:45.288154    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"console-operator-dockercfg-6dphg\""
Jul 22 04:28:45.288663 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:28:45.288425    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-555d9d7885-kmxdh"
Jul 22 04:28:45.288663 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:28:45.288497    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"kube-root-ca.crt\""
Jul 22 04:28:45.289231 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:28:45.289202    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"openshift-service-ca.crt\""
Jul 22 04:28:45.291592 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:28:45.291571    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-57d6d8f867-t2t9g"
Jul 22 04:28:45.294903 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:28:45.294885    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"service-ca-bundle\""
Jul 22 04:28:45.295940 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:28:45.295871    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\""
Jul 22 04:28:45.296695 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:28:45.296642    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\""
Jul 22 04:28:45.297060 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:28:45.297004    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-6tkm8"]
Jul 22 04:28:45.297173 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:28:45.297159    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\""
Jul 22 04:28:45.297353 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:28:45.297335    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"operator-dockercfg-77pk6\""
Jul 22 04:28:45.297608 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:28:45.297590    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"openshift-insights-serving-cert\""
Jul 22 04:28:45.298168 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:28:45.298150    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-555d9d7885-kmxdh"]
Jul 22 04:28:45.300580 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:28:45.299175    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-565b7b569d-gw4km"]
Jul 22 04:28:45.300580 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:28:45.300279    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\""
Jul 22 04:28:45.300580 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:28:45.300505    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\""
Jul 22 04:28:45.300723 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:28:45.300619    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-57d6d8f867-t2t9g"]
Jul 22 04:28:45.301360 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:28:45.301339    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-xk8gb\""
Jul 22 04:28:45.303787 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:28:45.303766    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"trusted-ca-bundle\""
Jul 22 04:28:45.303875 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:28:45.303811    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"trusted-ca\""
Jul 22 04:28:45.305214 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:28:45.305193    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\""
Jul 22 04:28:45.340088 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:28:45.340058    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/925dc370-cd0b-4447-85b7-a2c4068dab6b-metrics-certs\") pod \"router-default-5fc6f998d6-njv7d\" (UID: \"925dc370-cd0b-4447-85b7-a2c4068dab6b\") " pod="openshift-ingress/router-default-5fc6f998d6-njv7d"
Jul 22 04:28:45.340088 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:28:45.340089    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-x97rp\" (UniqueName: \"kubernetes.io/projected/925dc370-cd0b-4447-85b7-a2c4068dab6b-kube-api-access-x97rp\") pod \"router-default-5fc6f998d6-njv7d\" (UID: \"925dc370-cd0b-4447-85b7-a2c4068dab6b\") " pod="openshift-ingress/router-default-5fc6f998d6-njv7d"
Jul 22 04:28:45.340288 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:28:45.340108    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5b58e75a-c8cd-4d8b-bfba-e2e9810b994b-trusted-ca-bundle\") pod \"insights-operator-555d9d7885-kmxdh\" (UID: \"5b58e75a-c8cd-4d8b-bfba-e2e9810b994b\") " pod="openshift-insights/insights-operator-555d9d7885-kmxdh"
Jul 22 04:28:45.340288 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:28:45.340127    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-d6g5c\" (UniqueName: \"kubernetes.io/projected/6f3fb07b-006b-4a37-8f24-e1be8c89eeb1-kube-api-access-d6g5c\") pod \"kube-storage-version-migrator-operator-7658d9b749-6tkm8\" (UID: \"6f3fb07b-006b-4a37-8f24-e1be8c89eeb1\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-6tkm8"
Jul 22 04:28:45.340288 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:28:45.340215    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/6f3fb07b-006b-4a37-8f24-e1be8c89eeb1-config\") pod \"kube-storage-version-migrator-operator-7658d9b749-6tkm8\" (UID: \"6f3fb07b-006b-4a37-8f24-e1be8c89eeb1\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-6tkm8"
Jul 22 04:28:45.340288 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:28:45.340240    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/67c7210c-7cfa-4865-bce3-777fbb6f3cea-serving-cert\") pod \"console-operator-565b7b569d-gw4km\" (UID: \"67c7210c-7cfa-4865-bce3-777fbb6f3cea\") " pod="openshift-console-operator/console-operator-565b7b569d-gw4km"
Jul 22 04:28:45.340288 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:28:45.340262    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/67c7210c-7cfa-4865-bce3-777fbb6f3cea-trusted-ca\") pod \"console-operator-565b7b569d-gw4km\" (UID: \"67c7210c-7cfa-4865-bce3-777fbb6f3cea\") " pod="openshift-console-operator/console-operator-565b7b569d-gw4km"
Jul 22 04:28:45.340516 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:28:45.340305    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/925dc370-cd0b-4447-85b7-a2c4068dab6b-default-certificate\") pod \"router-default-5fc6f998d6-njv7d\" (UID: \"925dc370-cd0b-4447-85b7-a2c4068dab6b\") " pod="openshift-ingress/router-default-5fc6f998d6-njv7d"
Jul 22 04:28:45.340516 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:28:45.340338    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xnbrb\" (UniqueName: \"kubernetes.io/projected/67c7210c-7cfa-4865-bce3-777fbb6f3cea-kube-api-access-xnbrb\") pod \"console-operator-565b7b569d-gw4km\" (UID: \"67c7210c-7cfa-4865-bce3-777fbb6f3cea\") " pod="openshift-console-operator/console-operator-565b7b569d-gw4km"
Jul 22 04:28:45.340516 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:28:45.340356    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/5b58e75a-c8cd-4d8b-bfba-e2e9810b994b-snapshots\") pod \"insights-operator-555d9d7885-kmxdh\" (UID: \"5b58e75a-c8cd-4d8b-bfba-e2e9810b994b\") " pod="openshift-insights/insights-operator-555d9d7885-kmxdh"
Jul 22 04:28:45.340516 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:28:45.340372    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sqlbc\" (UniqueName: \"kubernetes.io/projected/5b58e75a-c8cd-4d8b-bfba-e2e9810b994b-kube-api-access-sqlbc\") pod \"insights-operator-555d9d7885-kmxdh\" (UID: \"5b58e75a-c8cd-4d8b-bfba-e2e9810b994b\") " pod="openshift-insights/insights-operator-555d9d7885-kmxdh"
Jul 22 04:28:45.340516 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:28:45.340416    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/5b58e75a-c8cd-4d8b-bfba-e2e9810b994b-tmp\") pod \"insights-operator-555d9d7885-kmxdh\" (UID: \"5b58e75a-c8cd-4d8b-bfba-e2e9810b994b\") " pod="openshift-insights/insights-operator-555d9d7885-kmxdh"
Jul 22 04:28:45.340516 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:28:45.340451    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/5b58e75a-c8cd-4d8b-bfba-e2e9810b994b-serving-cert\") pod \"insights-operator-555d9d7885-kmxdh\" (UID: \"5b58e75a-c8cd-4d8b-bfba-e2e9810b994b\") " pod="openshift-insights/insights-operator-555d9d7885-kmxdh"
Jul 22 04:28:45.340516 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:28:45.340484    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/6f3fb07b-006b-4a37-8f24-e1be8c89eeb1-serving-cert\") pod \"kube-storage-version-migrator-operator-7658d9b749-6tkm8\" (UID: \"6f3fb07b-006b-4a37-8f24-e1be8c89eeb1\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-6tkm8"
Jul 22 04:28:45.340516 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:28:45.340510    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/67c7210c-7cfa-4865-bce3-777fbb6f3cea-config\") pod \"console-operator-565b7b569d-gw4km\" (UID: \"67c7210c-7cfa-4865-bce3-777fbb6f3cea\") " pod="openshift-console-operator/console-operator-565b7b569d-gw4km"
Jul 22 04:28:45.340817 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:28:45.340533    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5b58e75a-c8cd-4d8b-bfba-e2e9810b994b-service-ca-bundle\") pod \"insights-operator-555d9d7885-kmxdh\" (UID: \"5b58e75a-c8cd-4d8b-bfba-e2e9810b994b\") " pod="openshift-insights/insights-operator-555d9d7885-kmxdh"
Jul 22 04:28:45.340817 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:28:45.340584    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/925dc370-cd0b-4447-85b7-a2c4068dab6b-stats-auth\") pod \"router-default-5fc6f998d6-njv7d\" (UID: \"925dc370-cd0b-4447-85b7-a2c4068dab6b\") " pod="openshift-ingress/router-default-5fc6f998d6-njv7d"
Jul 22 04:28:45.340817 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:28:45.340631    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/925dc370-cd0b-4447-85b7-a2c4068dab6b-service-ca-bundle\") pod \"router-default-5fc6f998d6-njv7d\" (UID: \"925dc370-cd0b-4447-85b7-a2c4068dab6b\") " pod="openshift-ingress/router-default-5fc6f998d6-njv7d"
Jul 22 04:28:45.423076 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:28:45.423031    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j9gvx_b4af3ae5-fa65-4358-8399-6ed11b68616e/konnectivity-agent/0.log" limit=1024
Jul 22 04:28:45.441629 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:28:45.441603    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/67c7210c-7cfa-4865-bce3-777fbb6f3cea-config\") pod \"console-operator-565b7b569d-gw4km\" (UID: \"67c7210c-7cfa-4865-bce3-777fbb6f3cea\") " pod="openshift-console-operator/console-operator-565b7b569d-gw4km"
Jul 22 04:28:45.441745 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:28:45.441638    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/925dc370-cd0b-4447-85b7-a2c4068dab6b-stats-auth\") pod \"router-default-5fc6f998d6-njv7d\" (UID: \"925dc370-cd0b-4447-85b7-a2c4068dab6b\") " pod="openshift-ingress/router-default-5fc6f998d6-njv7d"
Jul 22 04:28:45.441745 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:28:45.441657    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/d51e1b57-de0a-425b-8a3f-ad8449c0845c-trusted-ca\") pod \"image-registry-57d6d8f867-t2t9g\" (UID: \"d51e1b57-de0a-425b-8a3f-ad8449c0845c\") " pod="openshift-image-registry/image-registry-57d6d8f867-t2t9g"
Jul 22 04:28:45.441745 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:28:45.441674    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xnbrb\" (UniqueName: \"kubernetes.io/projected/67c7210c-7cfa-4865-bce3-777fbb6f3cea-kube-api-access-xnbrb\") pod \"console-operator-565b7b569d-gw4km\" (UID: \"67c7210c-7cfa-4865-bce3-777fbb6f3cea\") " pod="openshift-console-operator/console-operator-565b7b569d-gw4km"
Jul 22 04:28:45.441745 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:28:45.441698    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/d51e1b57-de0a-425b-8a3f-ad8449c0845c-image-registry-private-configuration\") pod \"image-registry-57d6d8f867-t2t9g\" (UID: \"d51e1b57-de0a-425b-8a3f-ad8449c0845c\") " pod="openshift-image-registry/image-registry-57d6d8f867-t2t9g"
Jul 22 04:28:45.441863 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:28:45.441830    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/925dc370-cd0b-4447-85b7-a2c4068dab6b-metrics-certs\") pod \"router-default-5fc6f998d6-njv7d\" (UID: \"925dc370-cd0b-4447-85b7-a2c4068dab6b\") " pod="openshift-ingress/router-default-5fc6f998d6-njv7d"
Jul 22 04:28:45.441895 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:28:45.441865    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-x97rp\" (UniqueName: \"kubernetes.io/projected/925dc370-cd0b-4447-85b7-a2c4068dab6b-kube-api-access-x97rp\") pod \"router-default-5fc6f998d6-njv7d\" (UID: \"925dc370-cd0b-4447-85b7-a2c4068dab6b\") " pod="openshift-ingress/router-default-5fc6f998d6-njv7d"
Jul 22 04:28:45.441936 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:28:45.441898    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5b58e75a-c8cd-4d8b-bfba-e2e9810b994b-trusted-ca-bundle\") pod \"insights-operator-555d9d7885-kmxdh\" (UID: \"5b58e75a-c8cd-4d8b-bfba-e2e9810b994b\") " pod="openshift-insights/insights-operator-555d9d7885-kmxdh"
Jul 22 04:28:45.441975 ip-10-0-141-238 kubenswrapper[2563]: E0722 04:28:45.441954    2563 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Jul 22 04:28:45.442027 ip-10-0-141-238 kubenswrapper[2563]: E0722 04:28:45.442017    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/925dc370-cd0b-4447-85b7-a2c4068dab6b-metrics-certs podName:925dc370-cd0b-4447-85b7-a2c4068dab6b nodeName:}" failed. No retries permitted until 2026-07-22 04:28:45.941999915 +0000 UTC m=+241.361008660 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/925dc370-cd0b-4447-85b7-a2c4068dab6b-metrics-certs") pod "router-default-5fc6f998d6-njv7d" (UID: "925dc370-cd0b-4447-85b7-a2c4068dab6b") : secret "router-metrics-certs-default" not found
Jul 22 04:28:45.442112 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:28:45.442053    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/d51e1b57-de0a-425b-8a3f-ad8449c0845c-ca-trust-extracted\") pod \"image-registry-57d6d8f867-t2t9g\" (UID: \"d51e1b57-de0a-425b-8a3f-ad8449c0845c\") " pod="openshift-image-registry/image-registry-57d6d8f867-t2t9g"
Jul 22 04:28:45.442112 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:28:45.442086    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/67c7210c-7cfa-4865-bce3-777fbb6f3cea-serving-cert\") pod \"console-operator-565b7b569d-gw4km\" (UID: \"67c7210c-7cfa-4865-bce3-777fbb6f3cea\") " pod="openshift-console-operator/console-operator-565b7b569d-gw4km"
Jul 22 04:28:45.442112 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:28:45.442104    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-h9q2j\" (UniqueName: \"kubernetes.io/projected/d51e1b57-de0a-425b-8a3f-ad8449c0845c-kube-api-access-h9q2j\") pod \"image-registry-57d6d8f867-t2t9g\" (UID: \"d51e1b57-de0a-425b-8a3f-ad8449c0845c\") " pod="openshift-image-registry/image-registry-57d6d8f867-t2t9g"
Jul 22 04:28:45.442259 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:28:45.442123    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/925dc370-cd0b-4447-85b7-a2c4068dab6b-default-certificate\") pod \"router-default-5fc6f998d6-njv7d\" (UID: \"925dc370-cd0b-4447-85b7-a2c4068dab6b\") " pod="openshift-ingress/router-default-5fc6f998d6-njv7d"
Jul 22 04:28:45.442259 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:28:45.442148    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/d51e1b57-de0a-425b-8a3f-ad8449c0845c-registry-tls\") pod \"image-registry-57d6d8f867-t2t9g\" (UID: \"d51e1b57-de0a-425b-8a3f-ad8449c0845c\") " pod="openshift-image-registry/image-registry-57d6d8f867-t2t9g"
Jul 22 04:28:45.442259 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:28:45.442175    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/d51e1b57-de0a-425b-8a3f-ad8449c0845c-registry-certificates\") pod \"image-registry-57d6d8f867-t2t9g\" (UID: \"d51e1b57-de0a-425b-8a3f-ad8449c0845c\") " pod="openshift-image-registry/image-registry-57d6d8f867-t2t9g"
Jul 22 04:28:45.442259 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:28:45.442202    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/5b58e75a-c8cd-4d8b-bfba-e2e9810b994b-snapshots\") pod \"insights-operator-555d9d7885-kmxdh\" (UID: \"5b58e75a-c8cd-4d8b-bfba-e2e9810b994b\") " pod="openshift-insights/insights-operator-555d9d7885-kmxdh"
Jul 22 04:28:45.442259 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:28:45.442231    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/5b58e75a-c8cd-4d8b-bfba-e2e9810b994b-tmp\") pod \"insights-operator-555d9d7885-kmxdh\" (UID: \"5b58e75a-c8cd-4d8b-bfba-e2e9810b994b\") " pod="openshift-insights/insights-operator-555d9d7885-kmxdh"
Jul 22 04:28:45.442259 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:28:45.442256    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/5b58e75a-c8cd-4d8b-bfba-e2e9810b994b-serving-cert\") pod \"insights-operator-555d9d7885-kmxdh\" (UID: \"5b58e75a-c8cd-4d8b-bfba-e2e9810b994b\") " pod="openshift-insights/insights-operator-555d9d7885-kmxdh"
Jul 22 04:28:45.442522 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:28:45.442288    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/6f3fb07b-006b-4a37-8f24-e1be8c89eeb1-serving-cert\") pod \"kube-storage-version-migrator-operator-7658d9b749-6tkm8\" (UID: \"6f3fb07b-006b-4a37-8f24-e1be8c89eeb1\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-6tkm8"
Jul 22 04:28:45.442522 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:28:45.442312    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5b58e75a-c8cd-4d8b-bfba-e2e9810b994b-service-ca-bundle\") pod \"insights-operator-555d9d7885-kmxdh\" (UID: \"5b58e75a-c8cd-4d8b-bfba-e2e9810b994b\") " pod="openshift-insights/insights-operator-555d9d7885-kmxdh"
Jul 22 04:28:45.442522 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:28:45.442342    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sqlbc\" (UniqueName: \"kubernetes.io/projected/5b58e75a-c8cd-4d8b-bfba-e2e9810b994b-kube-api-access-sqlbc\") pod \"insights-operator-555d9d7885-kmxdh\" (UID: \"5b58e75a-c8cd-4d8b-bfba-e2e9810b994b\") " pod="openshift-insights/insights-operator-555d9d7885-kmxdh"
Jul 22 04:28:45.442522 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:28:45.442373    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/925dc370-cd0b-4447-85b7-a2c4068dab6b-service-ca-bundle\") pod \"router-default-5fc6f998d6-njv7d\" (UID: \"925dc370-cd0b-4447-85b7-a2c4068dab6b\") " pod="openshift-ingress/router-default-5fc6f998d6-njv7d"
Jul 22 04:28:45.442522 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:28:45.442397    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/d51e1b57-de0a-425b-8a3f-ad8449c0845c-installation-pull-secrets\") pod \"image-registry-57d6d8f867-t2t9g\" (UID: \"d51e1b57-de0a-425b-8a3f-ad8449c0845c\") " pod="openshift-image-registry/image-registry-57d6d8f867-t2t9g"
Jul 22 04:28:45.442522 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:28:45.442417    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/67c7210c-7cfa-4865-bce3-777fbb6f3cea-config\") pod \"console-operator-565b7b569d-gw4km\" (UID: \"67c7210c-7cfa-4865-bce3-777fbb6f3cea\") " pod="openshift-console-operator/console-operator-565b7b569d-gw4km"
Jul 22 04:28:45.442522 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:28:45.442429    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/d51e1b57-de0a-425b-8a3f-ad8449c0845c-bound-sa-token\") pod \"image-registry-57d6d8f867-t2t9g\" (UID: \"d51e1b57-de0a-425b-8a3f-ad8449c0845c\") " pod="openshift-image-registry/image-registry-57d6d8f867-t2t9g"
Jul 22 04:28:45.442522 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:28:45.442456    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-d6g5c\" (UniqueName: \"kubernetes.io/projected/6f3fb07b-006b-4a37-8f24-e1be8c89eeb1-kube-api-access-d6g5c\") pod \"kube-storage-version-migrator-operator-7658d9b749-6tkm8\" (UID: \"6f3fb07b-006b-4a37-8f24-e1be8c89eeb1\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-6tkm8"
Jul 22 04:28:45.442522 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:28:45.442485    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/67c7210c-7cfa-4865-bce3-777fbb6f3cea-trusted-ca\") pod \"console-operator-565b7b569d-gw4km\" (UID: \"67c7210c-7cfa-4865-bce3-777fbb6f3cea\") " pod="openshift-console-operator/console-operator-565b7b569d-gw4km"
Jul 22 04:28:45.442522 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:28:45.442519    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/6f3fb07b-006b-4a37-8f24-e1be8c89eeb1-config\") pod \"kube-storage-version-migrator-operator-7658d9b749-6tkm8\" (UID: \"6f3fb07b-006b-4a37-8f24-e1be8c89eeb1\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-6tkm8"
Jul 22 04:28:45.442974 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:28:45.442754    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5b58e75a-c8cd-4d8b-bfba-e2e9810b994b-trusted-ca-bundle\") pod \"insights-operator-555d9d7885-kmxdh\" (UID: \"5b58e75a-c8cd-4d8b-bfba-e2e9810b994b\") " pod="openshift-insights/insights-operator-555d9d7885-kmxdh"
Jul 22 04:28:45.442974 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:28:45.442874    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5b58e75a-c8cd-4d8b-bfba-e2e9810b994b-service-ca-bundle\") pod \"insights-operator-555d9d7885-kmxdh\" (UID: \"5b58e75a-c8cd-4d8b-bfba-e2e9810b994b\") " pod="openshift-insights/insights-operator-555d9d7885-kmxdh"
Jul 22 04:28:45.442974 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:28:45.442905    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/5b58e75a-c8cd-4d8b-bfba-e2e9810b994b-snapshots\") pod \"insights-operator-555d9d7885-kmxdh\" (UID: \"5b58e75a-c8cd-4d8b-bfba-e2e9810b994b\") " pod="openshift-insights/insights-operator-555d9d7885-kmxdh"
Jul 22 04:28:45.443150 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:28:45.443094    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/6f3fb07b-006b-4a37-8f24-e1be8c89eeb1-config\") pod \"kube-storage-version-migrator-operator-7658d9b749-6tkm8\" (UID: \"6f3fb07b-006b-4a37-8f24-e1be8c89eeb1\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-6tkm8"
Jul 22 04:28:45.443150 ip-10-0-141-238 kubenswrapper[2563]: E0722 04:28:45.443118    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/925dc370-cd0b-4447-85b7-a2c4068dab6b-service-ca-bundle podName:925dc370-cd0b-4447-85b7-a2c4068dab6b nodeName:}" failed. No retries permitted until 2026-07-22 04:28:45.943101599 +0000 UTC m=+241.362110365 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/925dc370-cd0b-4447-85b7-a2c4068dab6b-service-ca-bundle") pod "router-default-5fc6f998d6-njv7d" (UID: "925dc370-cd0b-4447-85b7-a2c4068dab6b") : configmap references non-existent config key: service-ca.crt
Jul 22 04:28:45.443150 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:28:45.443142    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/5b58e75a-c8cd-4d8b-bfba-e2e9810b994b-tmp\") pod \"insights-operator-555d9d7885-kmxdh\" (UID: \"5b58e75a-c8cd-4d8b-bfba-e2e9810b994b\") " pod="openshift-insights/insights-operator-555d9d7885-kmxdh"
Jul 22 04:28:45.443904 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:28:45.443878    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/67c7210c-7cfa-4865-bce3-777fbb6f3cea-trusted-ca\") pod \"console-operator-565b7b569d-gw4km\" (UID: \"67c7210c-7cfa-4865-bce3-777fbb6f3cea\") " pod="openshift-console-operator/console-operator-565b7b569d-gw4km"
Jul 22 04:28:45.444600 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:28:45.444579    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/925dc370-cd0b-4447-85b7-a2c4068dab6b-stats-auth\") pod \"router-default-5fc6f998d6-njv7d\" (UID: \"925dc370-cd0b-4447-85b7-a2c4068dab6b\") " pod="openshift-ingress/router-default-5fc6f998d6-njv7d"
Jul 22 04:28:45.444747 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:28:45.444722    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/925dc370-cd0b-4447-85b7-a2c4068dab6b-default-certificate\") pod \"router-default-5fc6f998d6-njv7d\" (UID: \"925dc370-cd0b-4447-85b7-a2c4068dab6b\") " pod="openshift-ingress/router-default-5fc6f998d6-njv7d"
Jul 22 04:28:45.444989 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:28:45.444967    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/67c7210c-7cfa-4865-bce3-777fbb6f3cea-serving-cert\") pod \"console-operator-565b7b569d-gw4km\" (UID: \"67c7210c-7cfa-4865-bce3-777fbb6f3cea\") " pod="openshift-console-operator/console-operator-565b7b569d-gw4km"
Jul 22 04:28:45.445118 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:28:45.445101    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/6f3fb07b-006b-4a37-8f24-e1be8c89eeb1-serving-cert\") pod \"kube-storage-version-migrator-operator-7658d9b749-6tkm8\" (UID: \"6f3fb07b-006b-4a37-8f24-e1be8c89eeb1\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-6tkm8"
Jul 22 04:28:45.445185 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:28:45.445168    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/5b58e75a-c8cd-4d8b-bfba-e2e9810b994b-serving-cert\") pod \"insights-operator-555d9d7885-kmxdh\" (UID: \"5b58e75a-c8cd-4d8b-bfba-e2e9810b994b\") " pod="openshift-insights/insights-operator-555d9d7885-kmxdh"
Jul 22 04:28:45.450288 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:28:45.450265    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xnbrb\" (UniqueName: \"kubernetes.io/projected/67c7210c-7cfa-4865-bce3-777fbb6f3cea-kube-api-access-xnbrb\") pod \"console-operator-565b7b569d-gw4km\" (UID: \"67c7210c-7cfa-4865-bce3-777fbb6f3cea\") " pod="openshift-console-operator/console-operator-565b7b569d-gw4km"
Jul 22 04:28:45.450934 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:28:45.450907    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-d6g5c\" (UniqueName: \"kubernetes.io/projected/6f3fb07b-006b-4a37-8f24-e1be8c89eeb1-kube-api-access-d6g5c\") pod \"kube-storage-version-migrator-operator-7658d9b749-6tkm8\" (UID: \"6f3fb07b-006b-4a37-8f24-e1be8c89eeb1\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-6tkm8"
Jul 22 04:28:45.451025 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:28:45.450973    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-x97rp\" (UniqueName: \"kubernetes.io/projected/925dc370-cd0b-4447-85b7-a2c4068dab6b-kube-api-access-x97rp\") pod \"router-default-5fc6f998d6-njv7d\" (UID: \"925dc370-cd0b-4447-85b7-a2c4068dab6b\") " pod="openshift-ingress/router-default-5fc6f998d6-njv7d"
Jul 22 04:28:45.451025 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:28:45.451005    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-sqlbc\" (UniqueName: \"kubernetes.io/projected/5b58e75a-c8cd-4d8b-bfba-e2e9810b994b-kube-api-access-sqlbc\") pod \"insights-operator-555d9d7885-kmxdh\" (UID: \"5b58e75a-c8cd-4d8b-bfba-e2e9810b994b\") " pod="openshift-insights/insights-operator-555d9d7885-kmxdh"
Jul 22 04:28:45.523255 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:28:45.523192    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j9gvx_b4af3ae5-fa65-4358-8399-6ed11b68616e/konnectivity-agent/0.log" limit=1024
Jul 22 04:28:45.543138 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:28:45.543113    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/d51e1b57-de0a-425b-8a3f-ad8449c0845c-trusted-ca\") pod \"image-registry-57d6d8f867-t2t9g\" (UID: \"d51e1b57-de0a-425b-8a3f-ad8449c0845c\") " pod="openshift-image-registry/image-registry-57d6d8f867-t2t9g"
Jul 22 04:28:45.543228 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:28:45.543155    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/d51e1b57-de0a-425b-8a3f-ad8449c0845c-image-registry-private-configuration\") pod \"image-registry-57d6d8f867-t2t9g\" (UID: \"d51e1b57-de0a-425b-8a3f-ad8449c0845c\") " pod="openshift-image-registry/image-registry-57d6d8f867-t2t9g"
Jul 22 04:28:45.543228 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:28:45.543212    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/d51e1b57-de0a-425b-8a3f-ad8449c0845c-ca-trust-extracted\") pod \"image-registry-57d6d8f867-t2t9g\" (UID: \"d51e1b57-de0a-425b-8a3f-ad8449c0845c\") " pod="openshift-image-registry/image-registry-57d6d8f867-t2t9g"
Jul 22 04:28:45.543475 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:28:45.543244    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-h9q2j\" (UniqueName: \"kubernetes.io/projected/d51e1b57-de0a-425b-8a3f-ad8449c0845c-kube-api-access-h9q2j\") pod \"image-registry-57d6d8f867-t2t9g\" (UID: \"d51e1b57-de0a-425b-8a3f-ad8449c0845c\") " pod="openshift-image-registry/image-registry-57d6d8f867-t2t9g"
Jul 22 04:28:45.543475 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:28:45.543271    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/d51e1b57-de0a-425b-8a3f-ad8449c0845c-registry-tls\") pod \"image-registry-57d6d8f867-t2t9g\" (UID: \"d51e1b57-de0a-425b-8a3f-ad8449c0845c\") " pod="openshift-image-registry/image-registry-57d6d8f867-t2t9g"
Jul 22 04:28:45.543475 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:28:45.543299    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/d51e1b57-de0a-425b-8a3f-ad8449c0845c-registry-certificates\") pod \"image-registry-57d6d8f867-t2t9g\" (UID: \"d51e1b57-de0a-425b-8a3f-ad8449c0845c\") " pod="openshift-image-registry/image-registry-57d6d8f867-t2t9g"
Jul 22 04:28:45.543475 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:28:45.543354    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/d51e1b57-de0a-425b-8a3f-ad8449c0845c-installation-pull-secrets\") pod \"image-registry-57d6d8f867-t2t9g\" (UID: \"d51e1b57-de0a-425b-8a3f-ad8449c0845c\") " pod="openshift-image-registry/image-registry-57d6d8f867-t2t9g"
Jul 22 04:28:45.543475 ip-10-0-141-238 kubenswrapper[2563]: E0722 04:28:45.543360    2563 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 22 04:28:45.543475 ip-10-0-141-238 kubenswrapper[2563]: E0722 04:28:45.543378    2563 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-57d6d8f867-t2t9g: secret "image-registry-tls" not found
Jul 22 04:28:45.543475 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:28:45.543382    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/d51e1b57-de0a-425b-8a3f-ad8449c0845c-bound-sa-token\") pod \"image-registry-57d6d8f867-t2t9g\" (UID: \"d51e1b57-de0a-425b-8a3f-ad8449c0845c\") " pod="openshift-image-registry/image-registry-57d6d8f867-t2t9g"
Jul 22 04:28:45.543475 ip-10-0-141-238 kubenswrapper[2563]: E0722 04:28:45.543427    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/d51e1b57-de0a-425b-8a3f-ad8449c0845c-registry-tls podName:d51e1b57-de0a-425b-8a3f-ad8449c0845c nodeName:}" failed. No retries permitted until 2026-07-22 04:28:46.04341106 +0000 UTC m=+241.462419799 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/d51e1b57-de0a-425b-8a3f-ad8449c0845c-registry-tls") pod "image-registry-57d6d8f867-t2t9g" (UID: "d51e1b57-de0a-425b-8a3f-ad8449c0845c") : secret "image-registry-tls" not found
Jul 22 04:28:45.543895 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:28:45.543614    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/d51e1b57-de0a-425b-8a3f-ad8449c0845c-ca-trust-extracted\") pod \"image-registry-57d6d8f867-t2t9g\" (UID: \"d51e1b57-de0a-425b-8a3f-ad8449c0845c\") " pod="openshift-image-registry/image-registry-57d6d8f867-t2t9g"
Jul 22 04:28:45.543895 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:28:45.543874    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/d51e1b57-de0a-425b-8a3f-ad8449c0845c-registry-certificates\") pod \"image-registry-57d6d8f867-t2t9g\" (UID: \"d51e1b57-de0a-425b-8a3f-ad8449c0845c\") " pod="openshift-image-registry/image-registry-57d6d8f867-t2t9g"
Jul 22 04:28:45.544012 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:28:45.543996    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/d51e1b57-de0a-425b-8a3f-ad8449c0845c-trusted-ca\") pod \"image-registry-57d6d8f867-t2t9g\" (UID: \"d51e1b57-de0a-425b-8a3f-ad8449c0845c\") " pod="openshift-image-registry/image-registry-57d6d8f867-t2t9g"
Jul 22 04:28:45.545449 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:28:45.545432    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/d51e1b57-de0a-425b-8a3f-ad8449c0845c-installation-pull-secrets\") pod \"image-registry-57d6d8f867-t2t9g\" (UID: \"d51e1b57-de0a-425b-8a3f-ad8449c0845c\") " pod="openshift-image-registry/image-registry-57d6d8f867-t2t9g"
Jul 22 04:28:45.545522 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:28:45.545506    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/d51e1b57-de0a-425b-8a3f-ad8449c0845c-image-registry-private-configuration\") pod \"image-registry-57d6d8f867-t2t9g\" (UID: \"d51e1b57-de0a-425b-8a3f-ad8449c0845c\") " pod="openshift-image-registry/image-registry-57d6d8f867-t2t9g"
Jul 22 04:28:45.551406 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:28:45.551383    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-h9q2j\" (UniqueName: \"kubernetes.io/projected/d51e1b57-de0a-425b-8a3f-ad8449c0845c-kube-api-access-h9q2j\") pod \"image-registry-57d6d8f867-t2t9g\" (UID: \"d51e1b57-de0a-425b-8a3f-ad8449c0845c\") " pod="openshift-image-registry/image-registry-57d6d8f867-t2t9g"
Jul 22 04:28:45.551483 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:28:45.551428    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/d51e1b57-de0a-425b-8a3f-ad8449c0845c-bound-sa-token\") pod \"image-registry-57d6d8f867-t2t9g\" (UID: \"d51e1b57-de0a-425b-8a3f-ad8449c0845c\") " pod="openshift-image-registry/image-registry-57d6d8f867-t2t9g"
Jul 22 04:28:45.595804 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:28:45.595785    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-6tkm8"
Jul 22 04:28:45.605781 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:28:45.605764    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-565b7b569d-gw4km"
Jul 22 04:28:45.612074 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:28:45.612055    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-555d9d7885-kmxdh"
Jul 22 04:28:45.746555 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:28:45.746525    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-6tkm8"]
Jul 22 04:28:45.750518 ip-10-0-141-238 kubenswrapper[2563]: W0722 04:28:45.750494    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6f3fb07b_006b_4a37_8f24_e1be8c89eeb1.slice/crio-88bef12d934b958b9e9430c6976f63ad0669fd9703f0bdfda6fb072f3e9f1670 WatchSource:0}: Error finding container 88bef12d934b958b9e9430c6976f63ad0669fd9703f0bdfda6fb072f3e9f1670: Status 404 returned error can't find the container with id 88bef12d934b958b9e9430c6976f63ad0669fd9703f0bdfda6fb072f3e9f1670
Jul 22 04:28:45.946896 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:28:45.946859    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/925dc370-cd0b-4447-85b7-a2c4068dab6b-service-ca-bundle\") pod \"router-default-5fc6f998d6-njv7d\" (UID: \"925dc370-cd0b-4447-85b7-a2c4068dab6b\") " pod="openshift-ingress/router-default-5fc6f998d6-njv7d"
Jul 22 04:28:45.947052 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:28:45.947007    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/925dc370-cd0b-4447-85b7-a2c4068dab6b-metrics-certs\") pod \"router-default-5fc6f998d6-njv7d\" (UID: \"925dc370-cd0b-4447-85b7-a2c4068dab6b\") " pod="openshift-ingress/router-default-5fc6f998d6-njv7d"
Jul 22 04:28:45.947052 ip-10-0-141-238 kubenswrapper[2563]: E0722 04:28:45.947026    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/925dc370-cd0b-4447-85b7-a2c4068dab6b-service-ca-bundle podName:925dc370-cd0b-4447-85b7-a2c4068dab6b nodeName:}" failed. No retries permitted until 2026-07-22 04:28:46.94700822 +0000 UTC m=+242.366016954 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/925dc370-cd0b-4447-85b7-a2c4068dab6b-service-ca-bundle") pod "router-default-5fc6f998d6-njv7d" (UID: "925dc370-cd0b-4447-85b7-a2c4068dab6b") : configmap references non-existent config key: service-ca.crt
Jul 22 04:28:45.947159 ip-10-0-141-238 kubenswrapper[2563]: E0722 04:28:45.947135    2563 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Jul 22 04:28:45.947195 ip-10-0-141-238 kubenswrapper[2563]: E0722 04:28:45.947180    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/925dc370-cd0b-4447-85b7-a2c4068dab6b-metrics-certs podName:925dc370-cd0b-4447-85b7-a2c4068dab6b nodeName:}" failed. No retries permitted until 2026-07-22 04:28:46.947167752 +0000 UTC m=+242.366176486 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/925dc370-cd0b-4447-85b7-a2c4068dab6b-metrics-certs") pod "router-default-5fc6f998d6-njv7d" (UID: "925dc370-cd0b-4447-85b7-a2c4068dab6b") : secret "router-metrics-certs-default" not found
Jul 22 04:28:45.958344 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:28:45.958310    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-555d9d7885-kmxdh"]
Jul 22 04:28:45.959174 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:28:45.959151    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-565b7b569d-gw4km"]
Jul 22 04:28:45.961971 ip-10-0-141-238 kubenswrapper[2563]: W0722 04:28:45.961950    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod67c7210c_7cfa_4865_bce3_777fbb6f3cea.slice/crio-c6ae42d75500c77559031351681c6d448726e056254aabb83f2a8c276ea4e784 WatchSource:0}: Error finding container c6ae42d75500c77559031351681c6d448726e056254aabb83f2a8c276ea4e784: Status 404 returned error can't find the container with id c6ae42d75500c77559031351681c6d448726e056254aabb83f2a8c276ea4e784
Jul 22 04:28:45.962651 ip-10-0-141-238 kubenswrapper[2563]: W0722 04:28:45.962631    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5b58e75a_c8cd_4d8b_bfba_e2e9810b994b.slice/crio-3056a0586b4f6b94103765c41ff647c0d87b06fb4aef1b2e0d7987ebe112453b WatchSource:0}: Error finding container 3056a0586b4f6b94103765c41ff647c0d87b06fb4aef1b2e0d7987ebe112453b: Status 404 returned error can't find the container with id 3056a0586b4f6b94103765c41ff647c0d87b06fb4aef1b2e0d7987ebe112453b
Jul 22 04:28:46.047869 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:28:46.047843    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/d51e1b57-de0a-425b-8a3f-ad8449c0845c-registry-tls\") pod \"image-registry-57d6d8f867-t2t9g\" (UID: \"d51e1b57-de0a-425b-8a3f-ad8449c0845c\") " pod="openshift-image-registry/image-registry-57d6d8f867-t2t9g"
Jul 22 04:28:46.047968 ip-10-0-141-238 kubenswrapper[2563]: E0722 04:28:46.047955    2563 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 22 04:28:46.047968 ip-10-0-141-238 kubenswrapper[2563]: E0722 04:28:46.047966    2563 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-57d6d8f867-t2t9g: secret "image-registry-tls" not found
Jul 22 04:28:46.048032 ip-10-0-141-238 kubenswrapper[2563]: E0722 04:28:46.048006    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/d51e1b57-de0a-425b-8a3f-ad8449c0845c-registry-tls podName:d51e1b57-de0a-425b-8a3f-ad8449c0845c nodeName:}" failed. No retries permitted until 2026-07-22 04:28:47.047993328 +0000 UTC m=+242.467002063 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/d51e1b57-de0a-425b-8a3f-ad8449c0845c-registry-tls") pod "image-registry-57d6d8f867-t2t9g" (UID: "d51e1b57-de0a-425b-8a3f-ad8449c0845c") : secret "image-registry-tls" not found
Jul 22 04:28:46.696623 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:28:46.696578    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-565b7b569d-gw4km" event={"ID":"67c7210c-7cfa-4865-bce3-777fbb6f3cea","Type":"ContainerStarted","Data":"c6ae42d75500c77559031351681c6d448726e056254aabb83f2a8c276ea4e784"}
Jul 22 04:28:46.698077 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:28:46.698032    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-555d9d7885-kmxdh" event={"ID":"5b58e75a-c8cd-4d8b-bfba-e2e9810b994b","Type":"ContainerStarted","Data":"3056a0586b4f6b94103765c41ff647c0d87b06fb4aef1b2e0d7987ebe112453b"}
Jul 22 04:28:46.700051 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:28:46.700007    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-6tkm8" event={"ID":"6f3fb07b-006b-4a37-8f24-e1be8c89eeb1","Type":"ContainerStarted","Data":"88bef12d934b958b9e9430c6976f63ad0669fd9703f0bdfda6fb072f3e9f1670"}
Jul 22 04:28:46.955521 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:28:46.955441    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/925dc370-cd0b-4447-85b7-a2c4068dab6b-service-ca-bundle\") pod \"router-default-5fc6f998d6-njv7d\" (UID: \"925dc370-cd0b-4447-85b7-a2c4068dab6b\") " pod="openshift-ingress/router-default-5fc6f998d6-njv7d"
Jul 22 04:28:46.955684 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:28:46.955536    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/925dc370-cd0b-4447-85b7-a2c4068dab6b-metrics-certs\") pod \"router-default-5fc6f998d6-njv7d\" (UID: \"925dc370-cd0b-4447-85b7-a2c4068dab6b\") " pod="openshift-ingress/router-default-5fc6f998d6-njv7d"
Jul 22 04:28:46.955684 ip-10-0-141-238 kubenswrapper[2563]: E0722 04:28:46.955660    2563 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Jul 22 04:28:46.955785 ip-10-0-141-238 kubenswrapper[2563]: E0722 04:28:46.955727    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/925dc370-cd0b-4447-85b7-a2c4068dab6b-metrics-certs podName:925dc370-cd0b-4447-85b7-a2c4068dab6b nodeName:}" failed. No retries permitted until 2026-07-22 04:28:48.955708229 +0000 UTC m=+244.374716968 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/925dc370-cd0b-4447-85b7-a2c4068dab6b-metrics-certs") pod "router-default-5fc6f998d6-njv7d" (UID: "925dc370-cd0b-4447-85b7-a2c4068dab6b") : secret "router-metrics-certs-default" not found
Jul 22 04:28:46.955854 ip-10-0-141-238 kubenswrapper[2563]: E0722 04:28:46.955788    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/925dc370-cd0b-4447-85b7-a2c4068dab6b-service-ca-bundle podName:925dc370-cd0b-4447-85b7-a2c4068dab6b nodeName:}" failed. No retries permitted until 2026-07-22 04:28:48.955766224 +0000 UTC m=+244.374774965 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/925dc370-cd0b-4447-85b7-a2c4068dab6b-service-ca-bundle") pod "router-default-5fc6f998d6-njv7d" (UID: "925dc370-cd0b-4447-85b7-a2c4068dab6b") : configmap references non-existent config key: service-ca.crt
Jul 22 04:28:47.056955 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:28:47.056916    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/d51e1b57-de0a-425b-8a3f-ad8449c0845c-registry-tls\") pod \"image-registry-57d6d8f867-t2t9g\" (UID: \"d51e1b57-de0a-425b-8a3f-ad8449c0845c\") " pod="openshift-image-registry/image-registry-57d6d8f867-t2t9g"
Jul 22 04:28:47.057158 ip-10-0-141-238 kubenswrapper[2563]: E0722 04:28:47.057092    2563 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 22 04:28:47.057158 ip-10-0-141-238 kubenswrapper[2563]: E0722 04:28:47.057113    2563 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-57d6d8f867-t2t9g: secret "image-registry-tls" not found
Jul 22 04:28:47.057268 ip-10-0-141-238 kubenswrapper[2563]: E0722 04:28:47.057181    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/d51e1b57-de0a-425b-8a3f-ad8449c0845c-registry-tls podName:d51e1b57-de0a-425b-8a3f-ad8449c0845c nodeName:}" failed. No retries permitted until 2026-07-22 04:28:49.057161064 +0000 UTC m=+244.476169800 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/d51e1b57-de0a-425b-8a3f-ad8449c0845c-registry-tls") pod "image-registry-57d6d8f867-t2t9g" (UID: "d51e1b57-de0a-425b-8a3f-ad8449c0845c") : secret "image-registry-tls" not found
Jul 22 04:28:47.715550 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:28:47.715507    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j9gvx_b4af3ae5-fa65-4358-8399-6ed11b68616e/konnectivity-agent/0.log" limit=1024
Jul 22 04:28:47.768181 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:28:47.768134    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j9gvx_b4af3ae5-fa65-4358-8399-6ed11b68616e/konnectivity-agent/0.log" limit=1024
Jul 22 04:28:48.756857 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:28:48.756788    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j9gvx_b4af3ae5-fa65-4358-8399-6ed11b68616e/konnectivity-agent/0.log" limit=1024
Jul 22 04:28:48.972021 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:28:48.971988    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/925dc370-cd0b-4447-85b7-a2c4068dab6b-service-ca-bundle\") pod \"router-default-5fc6f998d6-njv7d\" (UID: \"925dc370-cd0b-4447-85b7-a2c4068dab6b\") " pod="openshift-ingress/router-default-5fc6f998d6-njv7d"
Jul 22 04:28:48.972194 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:28:48.972089    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/925dc370-cd0b-4447-85b7-a2c4068dab6b-metrics-certs\") pod \"router-default-5fc6f998d6-njv7d\" (UID: \"925dc370-cd0b-4447-85b7-a2c4068dab6b\") " pod="openshift-ingress/router-default-5fc6f998d6-njv7d"
Jul 22 04:28:48.972194 ip-10-0-141-238 kubenswrapper[2563]: E0722 04:28:48.972179    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/925dc370-cd0b-4447-85b7-a2c4068dab6b-service-ca-bundle podName:925dc370-cd0b-4447-85b7-a2c4068dab6b nodeName:}" failed. No retries permitted until 2026-07-22 04:28:52.972155769 +0000 UTC m=+248.391164513 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/925dc370-cd0b-4447-85b7-a2c4068dab6b-service-ca-bundle") pod "router-default-5fc6f998d6-njv7d" (UID: "925dc370-cd0b-4447-85b7-a2c4068dab6b") : configmap references non-existent config key: service-ca.crt
Jul 22 04:28:48.972282 ip-10-0-141-238 kubenswrapper[2563]: E0722 04:28:48.972195    2563 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Jul 22 04:28:48.972282 ip-10-0-141-238 kubenswrapper[2563]: E0722 04:28:48.972240    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/925dc370-cd0b-4447-85b7-a2c4068dab6b-metrics-certs podName:925dc370-cd0b-4447-85b7-a2c4068dab6b nodeName:}" failed. No retries permitted until 2026-07-22 04:28:52.97222694 +0000 UTC m=+248.391235678 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/925dc370-cd0b-4447-85b7-a2c4068dab6b-metrics-certs") pod "router-default-5fc6f998d6-njv7d" (UID: "925dc370-cd0b-4447-85b7-a2c4068dab6b") : secret "router-metrics-certs-default" not found
Jul 22 04:28:49.073102 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:28:49.073066    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/d51e1b57-de0a-425b-8a3f-ad8449c0845c-registry-tls\") pod \"image-registry-57d6d8f867-t2t9g\" (UID: \"d51e1b57-de0a-425b-8a3f-ad8449c0845c\") " pod="openshift-image-registry/image-registry-57d6d8f867-t2t9g"
Jul 22 04:28:49.073238 ip-10-0-141-238 kubenswrapper[2563]: E0722 04:28:49.073199    2563 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 22 04:28:49.073238 ip-10-0-141-238 kubenswrapper[2563]: E0722 04:28:49.073218    2563 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-57d6d8f867-t2t9g: secret "image-registry-tls" not found
Jul 22 04:28:49.073313 ip-10-0-141-238 kubenswrapper[2563]: E0722 04:28:49.073275    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/d51e1b57-de0a-425b-8a3f-ad8449c0845c-registry-tls podName:d51e1b57-de0a-425b-8a3f-ad8449c0845c nodeName:}" failed. No retries permitted until 2026-07-22 04:28:53.073256851 +0000 UTC m=+248.492265591 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/d51e1b57-de0a-425b-8a3f-ad8449c0845c-registry-tls") pod "image-registry-57d6d8f867-t2t9g" (UID: "d51e1b57-de0a-425b-8a3f-ad8449c0845c") : secret "image-registry-tls" not found
Jul 22 04:28:49.184965 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:28:49.184931    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j9gvx_b4af3ae5-fa65-4358-8399-6ed11b68616e/konnectivity-agent/0.log" limit=1024
Jul 22 04:28:49.260104 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:28:49.260012    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j9gvx_b4af3ae5-fa65-4358-8399-6ed11b68616e/konnectivity-agent/0.log" limit=1024
Jul 22 04:28:49.467409 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:28:49.467374    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j9gvx_b4af3ae5-fa65-4358-8399-6ed11b68616e/konnectivity-agent/0.log" limit=1024
Jul 22 04:28:49.541394 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:28:49.541315    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-pffnk"]
Jul 22 04:28:49.544558 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:28:49.544536    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-pffnk"
Jul 22 04:28:49.547064 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:28:49.547025    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-qzd8f\""
Jul 22 04:28:49.547191 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:28:49.547122    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\""
Jul 22 04:28:49.547191 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:28:49.547158    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\""
Jul 22 04:28:49.554952 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:28:49.554933    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-pffnk"]
Jul 22 04:28:49.566334 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:28:49.566311    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j9gvx_b4af3ae5-fa65-4358-8399-6ed11b68616e/konnectivity-agent/0.log" limit=1024
Jul 22 04:28:49.626869 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:28:49.626839    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j9gvx_b4af3ae5-fa65-4358-8399-6ed11b68616e/konnectivity-agent/0.log" limit=1024
Jul 22 04:28:49.679843 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:28:49.679805    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/247d4f4c-1e4a-4a2c-bad0-12a4c7e0c7ab-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-pffnk\" (UID: \"247d4f4c-1e4a-4a2c-bad0-12a4c7e0c7ab\") " pod="openshift-insights/insights-runtime-extractor-pffnk"
Jul 22 04:28:49.679987 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:28:49.679930    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-24q8m\" (UniqueName: \"kubernetes.io/projected/247d4f4c-1e4a-4a2c-bad0-12a4c7e0c7ab-kube-api-access-24q8m\") pod \"insights-runtime-extractor-pffnk\" (UID: \"247d4f4c-1e4a-4a2c-bad0-12a4c7e0c7ab\") " pod="openshift-insights/insights-runtime-extractor-pffnk"
Jul 22 04:28:49.679987 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:28:49.679958    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/247d4f4c-1e4a-4a2c-bad0-12a4c7e0c7ab-data-volume\") pod \"insights-runtime-extractor-pffnk\" (UID: \"247d4f4c-1e4a-4a2c-bad0-12a4c7e0c7ab\") " pod="openshift-insights/insights-runtime-extractor-pffnk"
Jul 22 04:28:49.680080 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:28:49.679989    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/247d4f4c-1e4a-4a2c-bad0-12a4c7e0c7ab-crio-socket\") pod \"insights-runtime-extractor-pffnk\" (UID: \"247d4f4c-1e4a-4a2c-bad0-12a4c7e0c7ab\") " pod="openshift-insights/insights-runtime-extractor-pffnk"
Jul 22 04:28:49.680080 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:28:49.680006    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/247d4f4c-1e4a-4a2c-bad0-12a4c7e0c7ab-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-pffnk\" (UID: \"247d4f4c-1e4a-4a2c-bad0-12a4c7e0c7ab\") " pod="openshift-insights/insights-runtime-extractor-pffnk"
Jul 22 04:28:49.709604 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:28:49.709570    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-6tkm8" event={"ID":"6f3fb07b-006b-4a37-8f24-e1be8c89eeb1","Type":"ContainerStarted","Data":"48c4ecb337419a97fd4b3437cb6979d868b587fb5c6736b17f47e5a48ee0d70e"}
Jul 22 04:28:49.711165 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:28:49.711145    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-gw4km_67c7210c-7cfa-4865-bce3-777fbb6f3cea/console-operator/0.log"
Jul 22 04:28:49.711269 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:28:49.711183    2563 generic.go:356] "Generic (PLEG): container finished" podID="67c7210c-7cfa-4865-bce3-777fbb6f3cea" containerID="4e97a02a0c13b7dc4aa99128f883a5bc1fa27d5f7165073e5e75b5fbfb0c2301" exitCode=255
Jul 22 04:28:49.711343 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:28:49.711278    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-565b7b569d-gw4km" event={"ID":"67c7210c-7cfa-4865-bce3-777fbb6f3cea","Type":"ContainerDied","Data":"4e97a02a0c13b7dc4aa99128f883a5bc1fa27d5f7165073e5e75b5fbfb0c2301"}
Jul 22 04:28:49.711471 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:28:49.711452    2563 scope.go:117] "RemoveContainer" containerID="4e97a02a0c13b7dc4aa99128f883a5bc1fa27d5f7165073e5e75b5fbfb0c2301"
Jul 22 04:28:49.712769 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:28:49.712747    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-555d9d7885-kmxdh" event={"ID":"5b58e75a-c8cd-4d8b-bfba-e2e9810b994b","Type":"ContainerStarted","Data":"e7a3ce19ae938e7d6043b2096078cb65071f1e2272b58501b204e6d7a55978ab"}
Jul 22 04:28:49.746165 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:28:49.746115    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-6tkm8" podStartSLOduration=1.844361817 podStartE2EDuration="4.746101108s" totalImagesPullingTime="2.901739291s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 04:28:45 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 04:28:49.729950682 +0000 UTC m=+245.148959440" watchObservedRunningTime="2026-07-22 04:28:49.746101108 +0000 UTC m=+245.165109864"
Jul 22 04:28:49.761049 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:28:49.760985    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-operator-555d9d7885-kmxdh" podStartSLOduration=2.065931961 podStartE2EDuration="4.760968638s" totalImagesPullingTime="2.695036677s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 04:28:45 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 04:28:49.760417284 +0000 UTC m=+245.179426034" watchObservedRunningTime="2026-07-22 04:28:49.760968638 +0000 UTC m=+245.179977395"
Jul 22 04:28:49.780394 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:28:49.780367    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-24q8m\" (UniqueName: \"kubernetes.io/projected/247d4f4c-1e4a-4a2c-bad0-12a4c7e0c7ab-kube-api-access-24q8m\") pod \"insights-runtime-extractor-pffnk\" (UID: \"247d4f4c-1e4a-4a2c-bad0-12a4c7e0c7ab\") " pod="openshift-insights/insights-runtime-extractor-pffnk"
Jul 22 04:28:49.780493 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:28:49.780415    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/247d4f4c-1e4a-4a2c-bad0-12a4c7e0c7ab-data-volume\") pod \"insights-runtime-extractor-pffnk\" (UID: \"247d4f4c-1e4a-4a2c-bad0-12a4c7e0c7ab\") " pod="openshift-insights/insights-runtime-extractor-pffnk"
Jul 22 04:28:49.780493 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:28:49.780456    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/247d4f4c-1e4a-4a2c-bad0-12a4c7e0c7ab-crio-socket\") pod \"insights-runtime-extractor-pffnk\" (UID: \"247d4f4c-1e4a-4a2c-bad0-12a4c7e0c7ab\") " pod="openshift-insights/insights-runtime-extractor-pffnk"
Jul 22 04:28:49.780493 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:28:49.780479    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/247d4f4c-1e4a-4a2c-bad0-12a4c7e0c7ab-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-pffnk\" (UID: \"247d4f4c-1e4a-4a2c-bad0-12a4c7e0c7ab\") " pod="openshift-insights/insights-runtime-extractor-pffnk"
Jul 22 04:28:49.780647 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:28:49.780561    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/247d4f4c-1e4a-4a2c-bad0-12a4c7e0c7ab-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-pffnk\" (UID: \"247d4f4c-1e4a-4a2c-bad0-12a4c7e0c7ab\") " pod="openshift-insights/insights-runtime-extractor-pffnk"
Jul 22 04:28:49.780647 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:28:49.780577    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/247d4f4c-1e4a-4a2c-bad0-12a4c7e0c7ab-crio-socket\") pod \"insights-runtime-extractor-pffnk\" (UID: \"247d4f4c-1e4a-4a2c-bad0-12a4c7e0c7ab\") " pod="openshift-insights/insights-runtime-extractor-pffnk"
Jul 22 04:28:49.780976 ip-10-0-141-238 kubenswrapper[2563]: E0722 04:28:49.780916    2563 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 22 04:28:49.780976 ip-10-0-141-238 kubenswrapper[2563]: E0722 04:28:49.780975    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/247d4f4c-1e4a-4a2c-bad0-12a4c7e0c7ab-insights-runtime-extractor-tls podName:247d4f4c-1e4a-4a2c-bad0-12a4c7e0c7ab nodeName:}" failed. No retries permitted until 2026-07-22 04:28:50.280956031 +0000 UTC m=+245.699964770 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/247d4f4c-1e4a-4a2c-bad0-12a4c7e0c7ab-insights-runtime-extractor-tls") pod "insights-runtime-extractor-pffnk" (UID: "247d4f4c-1e4a-4a2c-bad0-12a4c7e0c7ab") : secret "insights-runtime-extractor-tls" not found
Jul 22 04:28:49.781325 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:28:49.780920    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/247d4f4c-1e4a-4a2c-bad0-12a4c7e0c7ab-data-volume\") pod \"insights-runtime-extractor-pffnk\" (UID: \"247d4f4c-1e4a-4a2c-bad0-12a4c7e0c7ab\") " pod="openshift-insights/insights-runtime-extractor-pffnk"
Jul 22 04:28:49.781325 ip-10-0-141-238 kubenswrapper[2563]: E0722 04:28:49.781260    2563 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 22 04:28:49.781325 ip-10-0-141-238 kubenswrapper[2563]: E0722 04:28:49.781319    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/247d4f4c-1e4a-4a2c-bad0-12a4c7e0c7ab-kube-rbac-proxy-cm podName:247d4f4c-1e4a-4a2c-bad0-12a4c7e0c7ab nodeName:}" failed. No retries permitted until 2026-07-22 04:28:50.281302009 +0000 UTC m=+245.700310759 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/247d4f4c-1e4a-4a2c-bad0-12a4c7e0c7ab-kube-rbac-proxy-cm") pod "insights-runtime-extractor-pffnk" (UID: "247d4f4c-1e4a-4a2c-bad0-12a4c7e0c7ab") : configmap "kube-rbac-proxy" not found
Jul 22 04:28:49.790485 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:28:49.790453    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-24q8m\" (UniqueName: \"kubernetes.io/projected/247d4f4c-1e4a-4a2c-bad0-12a4c7e0c7ab-kube-api-access-24q8m\") pod \"insights-runtime-extractor-pffnk\" (UID: \"247d4f4c-1e4a-4a2c-bad0-12a4c7e0c7ab\") " pod="openshift-insights/insights-runtime-extractor-pffnk"
Jul 22 04:28:50.285981 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:28:50.285950    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/247d4f4c-1e4a-4a2c-bad0-12a4c7e0c7ab-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-pffnk\" (UID: \"247d4f4c-1e4a-4a2c-bad0-12a4c7e0c7ab\") " pod="openshift-insights/insights-runtime-extractor-pffnk"
Jul 22 04:28:50.286178 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:28:50.285995    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/247d4f4c-1e4a-4a2c-bad0-12a4c7e0c7ab-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-pffnk\" (UID: \"247d4f4c-1e4a-4a2c-bad0-12a4c7e0c7ab\") " pod="openshift-insights/insights-runtime-extractor-pffnk"
Jul 22 04:28:50.286178 ip-10-0-141-238 kubenswrapper[2563]: E0722 04:28:50.286113    2563 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 22 04:28:50.286178 ip-10-0-141-238 kubenswrapper[2563]: E0722 04:28:50.286135    2563 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 22 04:28:50.286297 ip-10-0-141-238 kubenswrapper[2563]: E0722 04:28:50.286185    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/247d4f4c-1e4a-4a2c-bad0-12a4c7e0c7ab-insights-runtime-extractor-tls podName:247d4f4c-1e4a-4a2c-bad0-12a4c7e0c7ab nodeName:}" failed. No retries permitted until 2026-07-22 04:28:51.286171259 +0000 UTC m=+246.705179994 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/247d4f4c-1e4a-4a2c-bad0-12a4c7e0c7ab-insights-runtime-extractor-tls") pod "insights-runtime-extractor-pffnk" (UID: "247d4f4c-1e4a-4a2c-bad0-12a4c7e0c7ab") : secret "insights-runtime-extractor-tls" not found
Jul 22 04:28:50.286297 ip-10-0-141-238 kubenswrapper[2563]: E0722 04:28:50.286197    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/247d4f4c-1e4a-4a2c-bad0-12a4c7e0c7ab-kube-rbac-proxy-cm podName:247d4f4c-1e4a-4a2c-bad0-12a4c7e0c7ab nodeName:}" failed. No retries permitted until 2026-07-22 04:28:51.286191175 +0000 UTC m=+246.705199910 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/247d4f4c-1e4a-4a2c-bad0-12a4c7e0c7ab-kube-rbac-proxy-cm") pod "insights-runtime-extractor-pffnk" (UID: "247d4f4c-1e4a-4a2c-bad0-12a4c7e0c7ab") : configmap "kube-rbac-proxy" not found
Jul 22 04:28:50.668357 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:28:50.668325    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j9gvx_b4af3ae5-fa65-4358-8399-6ed11b68616e/konnectivity-agent/0.log" limit=1024
Jul 22 04:28:50.717449 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:28:50.717415    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-gw4km_67c7210c-7cfa-4865-bce3-777fbb6f3cea/console-operator/1.log"
Jul 22 04:28:50.717988 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:28:50.717966    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-gw4km_67c7210c-7cfa-4865-bce3-777fbb6f3cea/console-operator/0.log"
Jul 22 04:28:50.718132 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:28:50.718086    2563 generic.go:356] "Generic (PLEG): container finished" podID="67c7210c-7cfa-4865-bce3-777fbb6f3cea" containerID="5391a0e52193db0be6d23b6eb73ddfa38a25cd7cbf9ced3cfb400a071b9c9aae" exitCode=255
Jul 22 04:28:50.718196 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:28:50.718169    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-565b7b569d-gw4km" event={"ID":"67c7210c-7cfa-4865-bce3-777fbb6f3cea","Type":"ContainerDied","Data":"5391a0e52193db0be6d23b6eb73ddfa38a25cd7cbf9ced3cfb400a071b9c9aae"}
Jul 22 04:28:50.718272 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:28:50.718257    2563 scope.go:117] "RemoveContainer" containerID="4e97a02a0c13b7dc4aa99128f883a5bc1fa27d5f7165073e5e75b5fbfb0c2301"
Jul 22 04:28:50.718513 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:28:50.718489    2563 scope.go:117] "RemoveContainer" containerID="5391a0e52193db0be6d23b6eb73ddfa38a25cd7cbf9ced3cfb400a071b9c9aae"
Jul 22 04:28:50.718698 ip-10-0-141-238 kubenswrapper[2563]: E0722 04:28:50.718676    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-565b7b569d-gw4km_openshift-console-operator(67c7210c-7cfa-4865-bce3-777fbb6f3cea)\"" pod="openshift-console-operator/console-operator-565b7b569d-gw4km" podUID="67c7210c-7cfa-4865-bce3-777fbb6f3cea"
Jul 22 04:28:50.739291 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:28:50.739262    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j9gvx_b4af3ae5-fa65-4358-8399-6ed11b68616e/konnectivity-agent/0.log" limit=1024
Jul 22 04:28:50.790988 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:28:50.790958    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j9gvx_b4af3ae5-fa65-4358-8399-6ed11b68616e/konnectivity-agent/0.log" limit=1024
Jul 22 04:28:51.096317 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:28:51.096223    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j9gvx_b4af3ae5-fa65-4358-8399-6ed11b68616e/konnectivity-agent/0.log" limit=1024
Jul 22 04:28:51.152754 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:28:51.152718    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j9gvx_b4af3ae5-fa65-4358-8399-6ed11b68616e/konnectivity-agent/0.log" limit=1024
Jul 22 04:28:51.293265 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:28:51.293228    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/247d4f4c-1e4a-4a2c-bad0-12a4c7e0c7ab-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-pffnk\" (UID: \"247d4f4c-1e4a-4a2c-bad0-12a4c7e0c7ab\") " pod="openshift-insights/insights-runtime-extractor-pffnk"
Jul 22 04:28:51.293442 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:28:51.293280    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/247d4f4c-1e4a-4a2c-bad0-12a4c7e0c7ab-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-pffnk\" (UID: \"247d4f4c-1e4a-4a2c-bad0-12a4c7e0c7ab\") " pod="openshift-insights/insights-runtime-extractor-pffnk"
Jul 22 04:28:51.293442 ip-10-0-141-238 kubenswrapper[2563]: E0722 04:28:51.293338    2563 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 22 04:28:51.293442 ip-10-0-141-238 kubenswrapper[2563]: E0722 04:28:51.293407    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/247d4f4c-1e4a-4a2c-bad0-12a4c7e0c7ab-kube-rbac-proxy-cm podName:247d4f4c-1e4a-4a2c-bad0-12a4c7e0c7ab nodeName:}" failed. No retries permitted until 2026-07-22 04:28:53.29339008 +0000 UTC m=+248.712398838 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/247d4f4c-1e4a-4a2c-bad0-12a4c7e0c7ab-kube-rbac-proxy-cm") pod "insights-runtime-extractor-pffnk" (UID: "247d4f4c-1e4a-4a2c-bad0-12a4c7e0c7ab") : configmap "kube-rbac-proxy" not found
Jul 22 04:28:51.293593 ip-10-0-141-238 kubenswrapper[2563]: E0722 04:28:51.293441    2563 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 22 04:28:51.293593 ip-10-0-141-238 kubenswrapper[2563]: E0722 04:28:51.293495    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/247d4f4c-1e4a-4a2c-bad0-12a4c7e0c7ab-insights-runtime-extractor-tls podName:247d4f4c-1e4a-4a2c-bad0-12a4c7e0c7ab nodeName:}" failed. No retries permitted until 2026-07-22 04:28:53.293478723 +0000 UTC m=+248.712487461 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/247d4f4c-1e4a-4a2c-bad0-12a4c7e0c7ab-insights-runtime-extractor-tls") pod "insights-runtime-extractor-pffnk" (UID: "247d4f4c-1e4a-4a2c-bad0-12a4c7e0c7ab") : secret "insights-runtime-extractor-tls" not found
Jul 22 04:28:51.318735 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:28:51.318707    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-56sw9_0d66df01-3af3-4a5c-8fe2-6e10517bbcf5/dns-node-resolver/0.log"
Jul 22 04:28:51.722721 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:28:51.722694    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-gw4km_67c7210c-7cfa-4865-bce3-777fbb6f3cea/console-operator/1.log"
Jul 22 04:28:51.723087 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:28:51.723069    2563 scope.go:117] "RemoveContainer" containerID="5391a0e52193db0be6d23b6eb73ddfa38a25cd7cbf9ced3cfb400a071b9c9aae"
Jul 22 04:28:51.723269 ip-10-0-141-238 kubenswrapper[2563]: E0722 04:28:51.723245    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-565b7b569d-gw4km_openshift-console-operator(67c7210c-7cfa-4865-bce3-777fbb6f3cea)\"" pod="openshift-console-operator/console-operator-565b7b569d-gw4km" podUID="67c7210c-7cfa-4865-bce3-777fbb6f3cea"
Jul 22 04:28:51.941808 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:28:51.941770    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j9gvx_b4af3ae5-fa65-4358-8399-6ed11b68616e/konnectivity-agent/0.log" limit=1024
Jul 22 04:28:52.440027 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:28:52.439999    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j9gvx_b4af3ae5-fa65-4358-8399-6ed11b68616e/konnectivity-agent/0.log" limit=1024
Jul 22 04:28:52.561337 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:28:52.561302    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j9gvx_b4af3ae5-fa65-4358-8399-6ed11b68616e/konnectivity-agent/0.log" limit=1024
Jul 22 04:28:52.692923 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:28:52.692841    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j9gvx_b4af3ae5-fa65-4358-8399-6ed11b68616e/konnectivity-agent/0.log" limit=1024
Jul 22 04:28:52.716892 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:28:52.716868    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-wn74g_ea39afdc-f191-458e-acc9-1ad9ff78c9da/node-ca/0.log"
Jul 22 04:28:52.758742 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:28:52.758711    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j9gvx_b4af3ae5-fa65-4358-8399-6ed11b68616e/konnectivity-agent/0.log" limit=1024
Jul 22 04:28:52.822418 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:28:52.822386    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j9gvx_b4af3ae5-fa65-4358-8399-6ed11b68616e/konnectivity-agent/0.log" limit=1024
Jul 22 04:28:52.926612 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:28:52.926589    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j9gvx_b4af3ae5-fa65-4358-8399-6ed11b68616e/konnectivity-agent/0.log" limit=1024
Jul 22 04:28:53.008385 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:28:53.008292    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/925dc370-cd0b-4447-85b7-a2c4068dab6b-metrics-certs\") pod \"router-default-5fc6f998d6-njv7d\" (UID: \"925dc370-cd0b-4447-85b7-a2c4068dab6b\") " pod="openshift-ingress/router-default-5fc6f998d6-njv7d"
Jul 22 04:28:53.008964 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:28:53.008935    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/925dc370-cd0b-4447-85b7-a2c4068dab6b-service-ca-bundle\") pod \"router-default-5fc6f998d6-njv7d\" (UID: \"925dc370-cd0b-4447-85b7-a2c4068dab6b\") " pod="openshift-ingress/router-default-5fc6f998d6-njv7d"
Jul 22 04:28:53.009587 ip-10-0-141-238 kubenswrapper[2563]: E0722 04:28:53.008565    2563 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Jul 22 04:28:53.009696 ip-10-0-141-238 kubenswrapper[2563]: E0722 04:28:53.009183    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/925dc370-cd0b-4447-85b7-a2c4068dab6b-service-ca-bundle podName:925dc370-cd0b-4447-85b7-a2c4068dab6b nodeName:}" failed. No retries permitted until 2026-07-22 04:29:01.009164908 +0000 UTC m=+256.428173644 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/925dc370-cd0b-4447-85b7-a2c4068dab6b-service-ca-bundle") pod "router-default-5fc6f998d6-njv7d" (UID: "925dc370-cd0b-4447-85b7-a2c4068dab6b") : configmap references non-existent config key: service-ca.crt
Jul 22 04:28:53.009696 ip-10-0-141-238 kubenswrapper[2563]: E0722 04:28:53.009660    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/925dc370-cd0b-4447-85b7-a2c4068dab6b-metrics-certs podName:925dc370-cd0b-4447-85b7-a2c4068dab6b nodeName:}" failed. No retries permitted until 2026-07-22 04:29:01.009635393 +0000 UTC m=+256.428644135 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/925dc370-cd0b-4447-85b7-a2c4068dab6b-metrics-certs") pod "router-default-5fc6f998d6-njv7d" (UID: "925dc370-cd0b-4447-85b7-a2c4068dab6b") : secret "router-metrics-certs-default" not found
Jul 22 04:28:53.110259 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:28:53.110221    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/d51e1b57-de0a-425b-8a3f-ad8449c0845c-registry-tls\") pod \"image-registry-57d6d8f867-t2t9g\" (UID: \"d51e1b57-de0a-425b-8a3f-ad8449c0845c\") " pod="openshift-image-registry/image-registry-57d6d8f867-t2t9g"
Jul 22 04:28:53.110420 ip-10-0-141-238 kubenswrapper[2563]: E0722 04:28:53.110358    2563 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 22 04:28:53.110420 ip-10-0-141-238 kubenswrapper[2563]: E0722 04:28:53.110377    2563 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-57d6d8f867-t2t9g: secret "image-registry-tls" not found
Jul 22 04:28:53.110488 ip-10-0-141-238 kubenswrapper[2563]: E0722 04:28:53.110439    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/d51e1b57-de0a-425b-8a3f-ad8449c0845c-registry-tls podName:d51e1b57-de0a-425b-8a3f-ad8449c0845c nodeName:}" failed. No retries permitted until 2026-07-22 04:29:01.110423725 +0000 UTC m=+256.529432464 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/d51e1b57-de0a-425b-8a3f-ad8449c0845c-registry-tls") pod "image-registry-57d6d8f867-t2t9g" (UID: "d51e1b57-de0a-425b-8a3f-ad8449c0845c") : secret "image-registry-tls" not found
Jul 22 04:28:53.195051 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:28:53.195002    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j9gvx_b4af3ae5-fa65-4358-8399-6ed11b68616e/konnectivity-agent/0.log" limit=1024
Jul 22 04:28:53.312203 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:28:53.312125    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/247d4f4c-1e4a-4a2c-bad0-12a4c7e0c7ab-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-pffnk\" (UID: \"247d4f4c-1e4a-4a2c-bad0-12a4c7e0c7ab\") " pod="openshift-insights/insights-runtime-extractor-pffnk"
Jul 22 04:28:53.312203 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:28:53.312167    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/247d4f4c-1e4a-4a2c-bad0-12a4c7e0c7ab-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-pffnk\" (UID: \"247d4f4c-1e4a-4a2c-bad0-12a4c7e0c7ab\") " pod="openshift-insights/insights-runtime-extractor-pffnk"
Jul 22 04:28:53.312384 ip-10-0-141-238 kubenswrapper[2563]: E0722 04:28:53.312262    2563 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 22 04:28:53.312384 ip-10-0-141-238 kubenswrapper[2563]: E0722 04:28:53.312296    2563 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 22 04:28:53.312384 ip-10-0-141-238 kubenswrapper[2563]: E0722 04:28:53.312334    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/247d4f4c-1e4a-4a2c-bad0-12a4c7e0c7ab-kube-rbac-proxy-cm podName:247d4f4c-1e4a-4a2c-bad0-12a4c7e0c7ab nodeName:}" failed. No retries permitted until 2026-07-22 04:28:57.312320006 +0000 UTC m=+252.731328741 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/247d4f4c-1e4a-4a2c-bad0-12a4c7e0c7ab-kube-rbac-proxy-cm") pod "insights-runtime-extractor-pffnk" (UID: "247d4f4c-1e4a-4a2c-bad0-12a4c7e0c7ab") : configmap "kube-rbac-proxy" not found
Jul 22 04:28:53.312384 ip-10-0-141-238 kubenswrapper[2563]: E0722 04:28:53.312358    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/247d4f4c-1e4a-4a2c-bad0-12a4c7e0c7ab-insights-runtime-extractor-tls podName:247d4f4c-1e4a-4a2c-bad0-12a4c7e0c7ab nodeName:}" failed. No retries permitted until 2026-07-22 04:28:57.312346725 +0000 UTC m=+252.731355465 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/247d4f4c-1e4a-4a2c-bad0-12a4c7e0c7ab-insights-runtime-extractor-tls") pod "insights-runtime-extractor-pffnk" (UID: "247d4f4c-1e4a-4a2c-bad0-12a4c7e0c7ab") : secret "insights-runtime-extractor-tls" not found
Jul 22 04:28:53.517325 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:28:53.517291    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-prmpz_42ae31bf-835d-4bd7-9e7c-92457d47b9d5/serve-healthcheck-canary/0.log"
Jul 22 04:28:54.129250 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:28:54.129218    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j9gvx_b4af3ae5-fa65-4358-8399-6ed11b68616e/konnectivity-agent/0.log" limit=1024
Jul 22 04:28:54.342611 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:28:54.342576    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j9gvx_b4af3ae5-fa65-4358-8399-6ed11b68616e/konnectivity-agent/0.log" limit=1024
Jul 22 04:28:54.737791 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:28:54.737760    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j9gvx_b4af3ae5-fa65-4358-8399-6ed11b68616e/konnectivity-agent/0.log" limit=1024
Jul 22 04:28:54.938389 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:28:54.938359    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j9gvx_b4af3ae5-fa65-4358-8399-6ed11b68616e/konnectivity-agent/0.log" limit=1024
Jul 22 04:28:55.053258 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:28:55.053168    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j9gvx_b4af3ae5-fa65-4358-8399-6ed11b68616e/konnectivity-agent/0.log" limit=1024
Jul 22 04:28:55.335438 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:28:55.335350    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j9gvx_b4af3ae5-fa65-4358-8399-6ed11b68616e/konnectivity-agent/0.log" limit=1024
Jul 22 04:28:55.605948 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:28:55.605873    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-565b7b569d-gw4km"
Jul 22 04:28:55.605948 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:28:55.605929    2563 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="openshift-console-operator/console-operator-565b7b569d-gw4km"
Jul 22 04:28:55.606230 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:28:55.606218    2563 scope.go:117] "RemoveContainer" containerID="5391a0e52193db0be6d23b6eb73ddfa38a25cd7cbf9ced3cfb400a071b9c9aae"
Jul 22 04:28:55.606371 ip-10-0-141-238 kubenswrapper[2563]: E0722 04:28:55.606353    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-565b7b569d-gw4km_openshift-console-operator(67c7210c-7cfa-4865-bce3-777fbb6f3cea)\"" pod="openshift-console-operator/console-operator-565b7b569d-gw4km" podUID="67c7210c-7cfa-4865-bce3-777fbb6f3cea"
Jul 22 04:28:56.137333 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:28:56.137300    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j9gvx_b4af3ae5-fa65-4358-8399-6ed11b68616e/konnectivity-agent/0.log" limit=1024
Jul 22 04:28:56.196147 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:28:56.196119    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j9gvx_b4af3ae5-fa65-4358-8399-6ed11b68616e/konnectivity-agent/0.log" limit=1024
Jul 22 04:28:56.326608 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:28:56.326568    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j9gvx_b4af3ae5-fa65-4358-8399-6ed11b68616e/konnectivity-agent/0.log" limit=1024
Jul 22 04:28:56.382092 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:28:56.382032    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j9gvx_b4af3ae5-fa65-4358-8399-6ed11b68616e/konnectivity-agent/0.log" limit=1024
Jul 22 04:28:56.532789 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:28:56.532760    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j9gvx_b4af3ae5-fa65-4358-8399-6ed11b68616e/konnectivity-agent/0.log" limit=1024
Jul 22 04:28:56.840393 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:28:56.840295    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3e22b9bf-95f2-4186-a5a7-2f1d21feb8b1-metrics-certs\") pod \"network-metrics-daemon-2k7fd\" (UID: \"3e22b9bf-95f2-4186-a5a7-2f1d21feb8b1\") " pod="openshift-multus/network-metrics-daemon-2k7fd"
Jul 22 04:28:56.840539 ip-10-0-141-238 kubenswrapper[2563]: E0722 04:28:56.840420    2563 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found
Jul 22 04:28:56.840539 ip-10-0-141-238 kubenswrapper[2563]: E0722 04:28:56.840481    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3e22b9bf-95f2-4186-a5a7-2f1d21feb8b1-metrics-certs podName:3e22b9bf-95f2-4186-a5a7-2f1d21feb8b1 nodeName:}" failed. No retries permitted until 2026-07-22 04:30:58.840467435 +0000 UTC m=+374.259476171 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/3e22b9bf-95f2-4186-a5a7-2f1d21feb8b1-metrics-certs") pod "network-metrics-daemon-2k7fd" (UID: "3e22b9bf-95f2-4186-a5a7-2f1d21feb8b1") : secret "metrics-daemon-secret" not found
Jul 22 04:28:56.929128 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:28:56.929090    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j9gvx_b4af3ae5-fa65-4358-8399-6ed11b68616e/konnectivity-agent/0.log" limit=1024
Jul 22 04:28:57.344209 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:28:57.344176    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/247d4f4c-1e4a-4a2c-bad0-12a4c7e0c7ab-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-pffnk\" (UID: \"247d4f4c-1e4a-4a2c-bad0-12a4c7e0c7ab\") " pod="openshift-insights/insights-runtime-extractor-pffnk"
Jul 22 04:28:57.344413 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:28:57.344220    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/247d4f4c-1e4a-4a2c-bad0-12a4c7e0c7ab-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-pffnk\" (UID: \"247d4f4c-1e4a-4a2c-bad0-12a4c7e0c7ab\") " pod="openshift-insights/insights-runtime-extractor-pffnk"
Jul 22 04:28:57.344413 ip-10-0-141-238 kubenswrapper[2563]: E0722 04:28:57.344332    2563 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 22 04:28:57.344413 ip-10-0-141-238 kubenswrapper[2563]: E0722 04:28:57.344348    2563 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 22 04:28:57.344413 ip-10-0-141-238 kubenswrapper[2563]: E0722 04:28:57.344399    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/247d4f4c-1e4a-4a2c-bad0-12a4c7e0c7ab-insights-runtime-extractor-tls podName:247d4f4c-1e4a-4a2c-bad0-12a4c7e0c7ab nodeName:}" failed. No retries permitted until 2026-07-22 04:29:05.344384822 +0000 UTC m=+260.763393557 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/247d4f4c-1e4a-4a2c-bad0-12a4c7e0c7ab-insights-runtime-extractor-tls") pod "insights-runtime-extractor-pffnk" (UID: "247d4f4c-1e4a-4a2c-bad0-12a4c7e0c7ab") : secret "insights-runtime-extractor-tls" not found
Jul 22 04:28:57.344413 ip-10-0-141-238 kubenswrapper[2563]: E0722 04:28:57.344413    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/247d4f4c-1e4a-4a2c-bad0-12a4c7e0c7ab-kube-rbac-proxy-cm podName:247d4f4c-1e4a-4a2c-bad0-12a4c7e0c7ab nodeName:}" failed. No retries permitted until 2026-07-22 04:29:05.344406175 +0000 UTC m=+260.763414911 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/247d4f4c-1e4a-4a2c-bad0-12a4c7e0c7ab-kube-rbac-proxy-cm") pod "insights-runtime-extractor-pffnk" (UID: "247d4f4c-1e4a-4a2c-bad0-12a4c7e0c7ab") : configmap "kube-rbac-proxy" not found
Jul 22 04:28:57.532050 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:28:57.532002    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j9gvx_b4af3ae5-fa65-4358-8399-6ed11b68616e/konnectivity-agent/0.log" limit=1024
Jul 22 04:28:57.934557 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:28:57.934519    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j9gvx_b4af3ae5-fa65-4358-8399-6ed11b68616e/konnectivity-agent/0.log" limit=1024
Jul 22 04:28:58.183103 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:28:58.183065    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j9gvx_b4af3ae5-fa65-4358-8399-6ed11b68616e/konnectivity-agent/0.log" limit=1024
Jul 22 04:28:58.332825 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:28:58.332738    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j9gvx_b4af3ae5-fa65-4358-8399-6ed11b68616e/konnectivity-agent/0.log" limit=1024
Jul 22 04:28:58.390908 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:28:58.390876    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j9gvx_b4af3ae5-fa65-4358-8399-6ed11b68616e/konnectivity-agent/0.log" limit=1024
Jul 22 04:28:58.538967 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:28:58.538930    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j9gvx_b4af3ae5-fa65-4358-8399-6ed11b68616e/konnectivity-agent/0.log" limit=1024
Jul 22 04:28:58.933192 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:28:58.933157    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j9gvx_b4af3ae5-fa65-4358-8399-6ed11b68616e/konnectivity-agent/0.log" limit=1024
Jul 22 04:28:58.985694 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:28:58.985662    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j9gvx_b4af3ae5-fa65-4358-8399-6ed11b68616e/konnectivity-agent/0.log" limit=1024
Jul 22 04:28:59.530547 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:28:59.530513    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j9gvx_b4af3ae5-fa65-4358-8399-6ed11b68616e/konnectivity-agent/0.log" limit=1024
Jul 22 04:29:00.133155 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:29:00.133123    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j9gvx_b4af3ae5-fa65-4358-8399-6ed11b68616e/konnectivity-agent/0.log" limit=1024
Jul 22 04:29:00.329372 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:29:00.329338    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j9gvx_b4af3ae5-fa65-4358-8399-6ed11b68616e/konnectivity-agent/0.log" limit=1024
Jul 22 04:29:00.531402 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:29:00.531365    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j9gvx_b4af3ae5-fa65-4358-8399-6ed11b68616e/konnectivity-agent/0.log" limit=1024
Jul 22 04:29:00.934799 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:29:00.934761    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j9gvx_b4af3ae5-fa65-4358-8399-6ed11b68616e/konnectivity-agent/0.log" limit=1024
Jul 22 04:29:01.077012 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:29:01.076980    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/925dc370-cd0b-4447-85b7-a2c4068dab6b-service-ca-bundle\") pod \"router-default-5fc6f998d6-njv7d\" (UID: \"925dc370-cd0b-4447-85b7-a2c4068dab6b\") " pod="openshift-ingress/router-default-5fc6f998d6-njv7d"
Jul 22 04:29:01.077192 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:29:01.077143    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/925dc370-cd0b-4447-85b7-a2c4068dab6b-metrics-certs\") pod \"router-default-5fc6f998d6-njv7d\" (UID: \"925dc370-cd0b-4447-85b7-a2c4068dab6b\") " pod="openshift-ingress/router-default-5fc6f998d6-njv7d"
Jul 22 04:29:01.077682 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:29:01.077664    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/925dc370-cd0b-4447-85b7-a2c4068dab6b-service-ca-bundle\") pod \"router-default-5fc6f998d6-njv7d\" (UID: \"925dc370-cd0b-4447-85b7-a2c4068dab6b\") " pod="openshift-ingress/router-default-5fc6f998d6-njv7d"
Jul 22 04:29:01.079530 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:29:01.079509    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/925dc370-cd0b-4447-85b7-a2c4068dab6b-metrics-certs\") pod \"router-default-5fc6f998d6-njv7d\" (UID: \"925dc370-cd0b-4447-85b7-a2c4068dab6b\") " pod="openshift-ingress/router-default-5fc6f998d6-njv7d"
Jul 22 04:29:01.117867 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:29:01.117827    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-5fc6f998d6-njv7d"
Jul 22 04:29:01.178390 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:29:01.178358    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/d51e1b57-de0a-425b-8a3f-ad8449c0845c-registry-tls\") pod \"image-registry-57d6d8f867-t2t9g\" (UID: \"d51e1b57-de0a-425b-8a3f-ad8449c0845c\") " pod="openshift-image-registry/image-registry-57d6d8f867-t2t9g"
Jul 22 04:29:01.181546 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:29:01.181516    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/d51e1b57-de0a-425b-8a3f-ad8449c0845c-registry-tls\") pod \"image-registry-57d6d8f867-t2t9g\" (UID: \"d51e1b57-de0a-425b-8a3f-ad8449c0845c\") " pod="openshift-image-registry/image-registry-57d6d8f867-t2t9g"
Jul 22 04:29:01.216409 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:29:01.216386    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-57d6d8f867-t2t9g"
Jul 22 04:29:01.239830 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:29:01.239746    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-5fc6f998d6-njv7d"]
Jul 22 04:29:01.242019 ip-10-0-141-238 kubenswrapper[2563]: W0722 04:29:01.241992    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod925dc370_cd0b_4447_85b7_a2c4068dab6b.slice/crio-db0b216498360e69a94458d4a609be25d10955b9b0650f71fd543ea81dbd65b1 WatchSource:0}: Error finding container db0b216498360e69a94458d4a609be25d10955b9b0650f71fd543ea81dbd65b1: Status 404 returned error can't find the container with id db0b216498360e69a94458d4a609be25d10955b9b0650f71fd543ea81dbd65b1
Jul 22 04:29:01.345616 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:29:01.345579    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-57d6d8f867-t2t9g"]
Jul 22 04:29:01.348699 ip-10-0-141-238 kubenswrapper[2563]: W0722 04:29:01.348671    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd51e1b57_de0a_425b_8a3f_ad8449c0845c.slice/crio-0465a62da5040a70523fb3333b9fbcf7e02d55e05f1b1c915bd5d057d03d657a WatchSource:0}: Error finding container 0465a62da5040a70523fb3333b9fbcf7e02d55e05f1b1c915bd5d057d03d657a: Status 404 returned error can't find the container with id 0465a62da5040a70523fb3333b9fbcf7e02d55e05f1b1c915bd5d057d03d657a
Jul 22 04:29:01.531933 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:29:01.531856    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j9gvx_b4af3ae5-fa65-4358-8399-6ed11b68616e/konnectivity-agent/0.log" limit=1024
Jul 22 04:29:01.753775 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:29:01.753734    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-57d6d8f867-t2t9g" event={"ID":"d51e1b57-de0a-425b-8a3f-ad8449c0845c","Type":"ContainerStarted","Data":"367837aedb0f895a4236a40f0057605906b0da1d22ea8b9c0425fd9c79b7795b"}
Jul 22 04:29:01.753948 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:29:01.753800    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-57d6d8f867-t2t9g" event={"ID":"d51e1b57-de0a-425b-8a3f-ad8449c0845c","Type":"ContainerStarted","Data":"0465a62da5040a70523fb3333b9fbcf7e02d55e05f1b1c915bd5d057d03d657a"}
Jul 22 04:29:01.753948 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:29:01.753826    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-57d6d8f867-t2t9g"
Jul 22 04:29:01.755620 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:29:01.755588    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-5fc6f998d6-njv7d" event={"ID":"925dc370-cd0b-4447-85b7-a2c4068dab6b","Type":"ContainerStarted","Data":"894066cb296e89703964718238c7219caaa3806c7175c69cbafd5de720fd812f"}
Jul 22 04:29:01.755746 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:29:01.755640    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-5fc6f998d6-njv7d" event={"ID":"925dc370-cd0b-4447-85b7-a2c4068dab6b","Type":"ContainerStarted","Data":"db0b216498360e69a94458d4a609be25d10955b9b0650f71fd543ea81dbd65b1"}
Jul 22 04:29:01.771577 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:29:01.771515    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-57d6d8f867-t2t9g" podStartSLOduration=16.771492923 podStartE2EDuration="16.771492923s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 04:28:45 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 04:29:01.770317778 +0000 UTC m=+257.189326535" watchObservedRunningTime="2026-07-22 04:29:01.771492923 +0000 UTC m=+257.190501683"
Jul 22 04:29:01.786348 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:29:01.786256    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/router-default-5fc6f998d6-njv7d" podStartSLOduration=16.786241333 podStartE2EDuration="16.786241333s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 04:28:45 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 04:29:01.785554285 +0000 UTC m=+257.204563041" watchObservedRunningTime="2026-07-22 04:29:01.786241333 +0000 UTC m=+257.205250090"
Jul 22 04:29:02.118921 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:29:02.118849    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/router-default-5fc6f998d6-njv7d"
Jul 22 04:29:02.121312 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:29:02.121289    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/router-default-5fc6f998d6-njv7d"
Jul 22 04:29:02.127370 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:29:02.127349    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j9gvx_b4af3ae5-fa65-4358-8399-6ed11b68616e/konnectivity-agent/0.log" limit=1024
Jul 22 04:29:02.329005 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:29:02.328969    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j9gvx_b4af3ae5-fa65-4358-8399-6ed11b68616e/konnectivity-agent/0.log" limit=1024
Jul 22 04:29:02.730557 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:29:02.730523    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j9gvx_b4af3ae5-fa65-4358-8399-6ed11b68616e/konnectivity-agent/0.log" limit=1024
Jul 22 04:29:02.758996 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:29:02.758972    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/router-default-5fc6f998d6-njv7d"
Jul 22 04:29:02.760134 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:29:02.760109    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/router-default-5fc6f998d6-njv7d"
Jul 22 04:29:02.929824 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:29:02.929783    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j9gvx_b4af3ae5-fa65-4358-8399-6ed11b68616e/konnectivity-agent/0.log" limit=1024
Jul 22 04:29:03.130893 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:29:03.130788    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j9gvx_b4af3ae5-fa65-4358-8399-6ed11b68616e/konnectivity-agent/0.log" limit=1024
Jul 22 04:29:03.715701 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:29:03.715666    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j9gvx_b4af3ae5-fa65-4358-8399-6ed11b68616e/konnectivity-agent/0.log" limit=1024
Jul 22 04:29:03.769388 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:29:03.769354    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j9gvx_b4af3ae5-fa65-4358-8399-6ed11b68616e/konnectivity-agent/0.log" limit=1024
Jul 22 04:29:03.870941 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:29:03.870909    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j9gvx_b4af3ae5-fa65-4358-8399-6ed11b68616e/konnectivity-agent/0.log" limit=1024
Jul 22 04:29:04.201138 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:29:04.201087    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j9gvx_b4af3ae5-fa65-4358-8399-6ed11b68616e/konnectivity-agent/0.log" limit=1024
Jul 22 04:29:05.410657 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:29:05.410608    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/247d4f4c-1e4a-4a2c-bad0-12a4c7e0c7ab-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-pffnk\" (UID: \"247d4f4c-1e4a-4a2c-bad0-12a4c7e0c7ab\") " pod="openshift-insights/insights-runtime-extractor-pffnk"
Jul 22 04:29:05.410657 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:29:05.410665    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/247d4f4c-1e4a-4a2c-bad0-12a4c7e0c7ab-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-pffnk\" (UID: \"247d4f4c-1e4a-4a2c-bad0-12a4c7e0c7ab\") " pod="openshift-insights/insights-runtime-extractor-pffnk"
Jul 22 04:29:05.411200 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:29:05.411182    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/247d4f4c-1e4a-4a2c-bad0-12a4c7e0c7ab-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-pffnk\" (UID: \"247d4f4c-1e4a-4a2c-bad0-12a4c7e0c7ab\") " pod="openshift-insights/insights-runtime-extractor-pffnk"
Jul 22 04:29:05.413009 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:29:05.412992    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/247d4f4c-1e4a-4a2c-bad0-12a4c7e0c7ab-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-pffnk\" (UID: \"247d4f4c-1e4a-4a2c-bad0-12a4c7e0c7ab\") " pod="openshift-insights/insights-runtime-extractor-pffnk"
Jul 22 04:29:05.452624 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:29:05.452605    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-pffnk"
Jul 22 04:29:05.582598 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:29:05.582569    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-pffnk"]
Jul 22 04:29:05.586236 ip-10-0-141-238 kubenswrapper[2563]: W0722 04:29:05.586208    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod247d4f4c_1e4a_4a2c_bad0_12a4c7e0c7ab.slice/crio-55b2990f992e5f9c13fd1363a911fa6a27a8040a57aaefc27f8daf17f416a594 WatchSource:0}: Error finding container 55b2990f992e5f9c13fd1363a911fa6a27a8040a57aaefc27f8daf17f416a594: Status 404 returned error can't find the container with id 55b2990f992e5f9c13fd1363a911fa6a27a8040a57aaefc27f8daf17f416a594
Jul 22 04:29:05.771155 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:29:05.771068    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-pffnk" event={"ID":"247d4f4c-1e4a-4a2c-bad0-12a4c7e0c7ab","Type":"ContainerStarted","Data":"55b2990f992e5f9c13fd1363a911fa6a27a8040a57aaefc27f8daf17f416a594"}
Jul 22 04:29:06.060591 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:29:06.060516    2563 scope.go:117] "RemoveContainer" containerID="5391a0e52193db0be6d23b6eb73ddfa38a25cd7cbf9ced3cfb400a071b9c9aae"
Jul 22 04:29:06.777335 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:29:06.777305    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-gw4km_67c7210c-7cfa-4865-bce3-777fbb6f3cea/console-operator/1.log"
Jul 22 04:29:06.777817 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:29:06.777359    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-565b7b569d-gw4km" event={"ID":"67c7210c-7cfa-4865-bce3-777fbb6f3cea","Type":"ContainerStarted","Data":"42e33d847945c073a6a141ed681c0b52807f0106b4afe2b86ad94f8afdfb7ebd"}
Jul 22 04:29:06.777817 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:29:06.777777    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-565b7b569d-gw4km"
Jul 22 04:29:06.793444 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:29:06.793386    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console-operator/console-operator-565b7b569d-gw4km" podStartSLOduration=19.094754773 podStartE2EDuration="21.793351731s" totalImagesPullingTime="2.698596958s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 04:28:45 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 04:29:06.793031605 +0000 UTC m=+262.212040364" watchObservedRunningTime="2026-07-22 04:29:06.793351731 +0000 UTC m=+262.212360490"
Jul 22 04:29:07.302802 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:29:07.302718    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console-operator/console-operator-565b7b569d-gw4km"
Jul 22 04:29:07.480906 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:29:07.480870    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j9gvx_b4af3ae5-fa65-4358-8399-6ed11b68616e/konnectivity-agent/0.log" limit=1024
Jul 22 04:29:07.584718 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:29:07.584633    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j9gvx_b4af3ae5-fa65-4358-8399-6ed11b68616e/konnectivity-agent/0.log" limit=1024
Jul 22 04:29:07.779915 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:29:07.779838    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j9gvx_b4af3ae5-fa65-4358-8399-6ed11b68616e/konnectivity-agent/0.log" limit=1024
Jul 22 04:29:07.959193 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:29:07.959153    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j9gvx_b4af3ae5-fa65-4358-8399-6ed11b68616e/konnectivity-agent/0.log" limit=1024
Jul 22 04:29:08.569064 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:29:08.569016    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j9gvx_b4af3ae5-fa65-4358-8399-6ed11b68616e/konnectivity-agent/0.log" limit=1024
Jul 22 04:29:08.617923 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:29:08.617889    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j9gvx_b4af3ae5-fa65-4358-8399-6ed11b68616e/konnectivity-agent/0.log" limit=1024
Jul 22 04:29:08.785257 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:29:08.785200    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j9gvx_b4af3ae5-fa65-4358-8399-6ed11b68616e/konnectivity-agent/0.log" limit=1024
Jul 22 04:29:08.838432 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:29:08.838318    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j9gvx_b4af3ae5-fa65-4358-8399-6ed11b68616e/konnectivity-agent/0.log" limit=1024
Jul 22 04:29:08.973025 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:29:08.972983    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j9gvx_b4af3ae5-fa65-4358-8399-6ed11b68616e/konnectivity-agent/0.log" limit=1024
Jul 22 04:29:09.170058 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:29:09.170012    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j9gvx_b4af3ae5-fa65-4358-8399-6ed11b68616e/konnectivity-agent/0.log" limit=1024
Jul 22 04:29:09.395098 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:29:09.395030    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j9gvx_b4af3ae5-fa65-4358-8399-6ed11b68616e/konnectivity-agent/0.log" limit=1024
Jul 22 04:29:10.119223 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:29:10.119184    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j9gvx_b4af3ae5-fa65-4358-8399-6ed11b68616e/konnectivity-agent/0.log" limit=1024
Jul 22 04:29:10.170723 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:29:10.170686    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j9gvx_b4af3ae5-fa65-4358-8399-6ed11b68616e/konnectivity-agent/0.log" limit=1024
Jul 22 04:29:10.790828 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:29:10.790748    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-pffnk" event={"ID":"247d4f4c-1e4a-4a2c-bad0-12a4c7e0c7ab","Type":"ContainerStarted","Data":"69471b2847478c5976ba3229ff7c1a10dc5431df2a55467ecfd918c760df4c16"}
Jul 22 04:29:10.986779 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:29:10.986744    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j9gvx_b4af3ae5-fa65-4358-8399-6ed11b68616e/konnectivity-agent/0.log" limit=1024
Jul 22 04:29:11.085678 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:29:11.085594    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j9gvx_b4af3ae5-fa65-4358-8399-6ed11b68616e/konnectivity-agent/0.log" limit=1024
Jul 22 04:29:14.609653 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:29:14.609090    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-85574b5f49-j25qb"]
Jul 22 04:29:14.612467 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:29:14.612434    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-85574b5f49-j25qb"
Jul 22 04:29:14.616385 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:29:14.616359    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-dockercfg-99xtv\""
Jul 22 04:29:14.616490 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:29:14.616392    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-tls\""
Jul 22 04:29:14.625704 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:29:14.625682    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-85574b5f49-j25qb"]
Jul 22 04:29:14.628721 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:29:14.628699    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-57d6d8f867-t2t9g"]
Jul 22 04:29:14.680291 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:29:14.680252    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/10f2d671-43fd-4c9a-a4b7-1ef76f5f4dff-tls-certificates\") pod \"prometheus-operator-admission-webhook-85574b5f49-j25qb\" (UID: \"10f2d671-43fd-4c9a-a4b7-1ef76f5f4dff\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-85574b5f49-j25qb"
Jul 22 04:29:14.712392 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:29:14.712345    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j9gvx_b4af3ae5-fa65-4358-8399-6ed11b68616e/konnectivity-agent/0.log" limit=1024
Jul 22 04:29:14.781126 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:29:14.781088    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/10f2d671-43fd-4c9a-a4b7-1ef76f5f4dff-tls-certificates\") pod \"prometheus-operator-admission-webhook-85574b5f49-j25qb\" (UID: \"10f2d671-43fd-4c9a-a4b7-1ef76f5f4dff\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-85574b5f49-j25qb"
Jul 22 04:29:14.783754 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:29:14.783729    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/10f2d671-43fd-4c9a-a4b7-1ef76f5f4dff-tls-certificates\") pod \"prometheus-operator-admission-webhook-85574b5f49-j25qb\" (UID: \"10f2d671-43fd-4c9a-a4b7-1ef76f5f4dff\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-85574b5f49-j25qb"
Jul 22 04:29:14.807864 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:29:14.807832    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j9gvx_b4af3ae5-fa65-4358-8399-6ed11b68616e/konnectivity-agent/0.log" limit=1024
Jul 22 04:29:14.809162 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:29:14.809133    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-pffnk" event={"ID":"247d4f4c-1e4a-4a2c-bad0-12a4c7e0c7ab","Type":"ContainerStarted","Data":"0a0cf3b55a7920c011ce9bba826a13689b730f894c0d01e2e670ef440d847fd2"}
Jul 22 04:29:14.925008 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:29:14.924975    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-85574b5f49-j25qb"
Jul 22 04:29:15.071976 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:29:15.071945    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-85574b5f49-j25qb"]
Jul 22 04:29:15.075223 ip-10-0-141-238 kubenswrapper[2563]: W0722 04:29:15.075183    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod10f2d671_43fd_4c9a_a4b7_1ef76f5f4dff.slice/crio-e5fd8dd5e1a8ef29e73d4b635aebbb234755de9547ebe95d635dc21a4c4c5269 WatchSource:0}: Error finding container e5fd8dd5e1a8ef29e73d4b635aebbb234755de9547ebe95d635dc21a4c4c5269: Status 404 returned error can't find the container with id e5fd8dd5e1a8ef29e73d4b635aebbb234755de9547ebe95d635dc21a4c4c5269
Jul 22 04:29:15.814426 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:29:15.814379    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-85574b5f49-j25qb" event={"ID":"10f2d671-43fd-4c9a-a4b7-1ef76f5f4dff","Type":"ContainerStarted","Data":"e5fd8dd5e1a8ef29e73d4b635aebbb234755de9547ebe95d635dc21a4c4c5269"}
Jul 22 04:29:17.823094 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:29:17.823055    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-pffnk" event={"ID":"247d4f4c-1e4a-4a2c-bad0-12a4c7e0c7ab","Type":"ContainerStarted","Data":"e7ab9065bab7e8cf3422492cf8692fc90b8a05eca3f2c587af275a9e6d38f1db"}
Jul 22 04:29:17.824477 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:29:17.824449    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-85574b5f49-j25qb" event={"ID":"10f2d671-43fd-4c9a-a4b7-1ef76f5f4dff","Type":"ContainerStarted","Data":"0bc1ed2e7eb3d433f4a195b36119f0ec3fea83db608434c8c8c52dad196de66b"}
Jul 22 04:29:17.824611 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:29:17.824553    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-85574b5f49-j25qb"
Jul 22 04:29:17.829033 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:29:17.829014    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-85574b5f49-j25qb"
Jul 22 04:29:17.840420 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:29:17.840382    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-pffnk" podStartSLOduration=16.870527916 podStartE2EDuration="28.840368741s" totalImagesPullingTime="11.969840825s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-22 04:28:49 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 04:29:17.838800133 +0000 UTC m=+273.257808904" watchObservedRunningTime="2026-07-22 04:29:17.840368741 +0000 UTC m=+273.259377495"
Jul 22 04:29:17.853125 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:29:17.853091    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-admission-webhook-85574b5f49-j25qb" podStartSLOduration=1.2592859220000001 podStartE2EDuration="3.853078268s" totalImagesPullingTime="2.593792346s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 04:29:14 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 04:29:17.85227133 +0000 UTC m=+273.271280086" watchObservedRunningTime="2026-07-22 04:29:17.853078268 +0000 UTC m=+273.272087021"
Jul 22 04:29:18.395361 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:29:18.395323    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-59b59cdd78-6rgw5"]
Jul 22 04:29:18.398283 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:29:18.398256    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-59b59cdd78-6rgw5"
Jul 22 04:29:18.400785 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:29:18.400758    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\""
Jul 22 04:29:18.400785 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:29:18.400758    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\""
Jul 22 04:29:18.401554 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:29:18.401540    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\""
Jul 22 04:29:18.401629 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:29:18.401563    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\""
Jul 22 04:29:18.401629 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:29:18.401602    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\""
Jul 22 04:29:18.401841 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:29:18.401822    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\""
Jul 22 04:29:18.401841 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:29:18.401838    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\""
Jul 22 04:29:18.401970 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:29:18.401863    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-r5m4w\""
Jul 22 04:29:18.408202 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:29:18.408179    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-59b59cdd78-6rgw5"]
Jul 22 04:29:18.411491 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:29:18.411466    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/3d096334-e219-40c4-8a7f-316cd0b51127-oauth-serving-cert\") pod \"console-59b59cdd78-6rgw5\" (UID: \"3d096334-e219-40c4-8a7f-316cd0b51127\") " pod="openshift-console/console-59b59cdd78-6rgw5"
Jul 22 04:29:18.411594 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:29:18.411506    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gfnbz\" (UniqueName: \"kubernetes.io/projected/3d096334-e219-40c4-8a7f-316cd0b51127-kube-api-access-gfnbz\") pod \"console-59b59cdd78-6rgw5\" (UID: \"3d096334-e219-40c4-8a7f-316cd0b51127\") " pod="openshift-console/console-59b59cdd78-6rgw5"
Jul 22 04:29:18.411594 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:29:18.411539    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/3d096334-e219-40c4-8a7f-316cd0b51127-console-oauth-config\") pod \"console-59b59cdd78-6rgw5\" (UID: \"3d096334-e219-40c4-8a7f-316cd0b51127\") " pod="openshift-console/console-59b59cdd78-6rgw5"
Jul 22 04:29:18.411709 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:29:18.411647    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/3d096334-e219-40c4-8a7f-316cd0b51127-console-serving-cert\") pod \"console-59b59cdd78-6rgw5\" (UID: \"3d096334-e219-40c4-8a7f-316cd0b51127\") " pod="openshift-console/console-59b59cdd78-6rgw5"
Jul 22 04:29:18.411766 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:29:18.411701    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/3d096334-e219-40c4-8a7f-316cd0b51127-console-config\") pod \"console-59b59cdd78-6rgw5\" (UID: \"3d096334-e219-40c4-8a7f-316cd0b51127\") " pod="openshift-console/console-59b59cdd78-6rgw5"
Jul 22 04:29:18.411766 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:29:18.411732    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/3d096334-e219-40c4-8a7f-316cd0b51127-service-ca\") pod \"console-59b59cdd78-6rgw5\" (UID: \"3d096334-e219-40c4-8a7f-316cd0b51127\") " pod="openshift-console/console-59b59cdd78-6rgw5"
Jul 22 04:29:18.512922 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:29:18.512894    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/3d096334-e219-40c4-8a7f-316cd0b51127-oauth-serving-cert\") pod \"console-59b59cdd78-6rgw5\" (UID: \"3d096334-e219-40c4-8a7f-316cd0b51127\") " pod="openshift-console/console-59b59cdd78-6rgw5"
Jul 22 04:29:18.512922 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:29:18.512926    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gfnbz\" (UniqueName: \"kubernetes.io/projected/3d096334-e219-40c4-8a7f-316cd0b51127-kube-api-access-gfnbz\") pod \"console-59b59cdd78-6rgw5\" (UID: \"3d096334-e219-40c4-8a7f-316cd0b51127\") " pod="openshift-console/console-59b59cdd78-6rgw5"
Jul 22 04:29:18.513167 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:29:18.512951    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/3d096334-e219-40c4-8a7f-316cd0b51127-console-oauth-config\") pod \"console-59b59cdd78-6rgw5\" (UID: \"3d096334-e219-40c4-8a7f-316cd0b51127\") " pod="openshift-console/console-59b59cdd78-6rgw5"
Jul 22 04:29:18.513167 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:29:18.513025    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/3d096334-e219-40c4-8a7f-316cd0b51127-console-serving-cert\") pod \"console-59b59cdd78-6rgw5\" (UID: \"3d096334-e219-40c4-8a7f-316cd0b51127\") " pod="openshift-console/console-59b59cdd78-6rgw5"
Jul 22 04:29:18.513167 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:29:18.513089    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/3d096334-e219-40c4-8a7f-316cd0b51127-console-config\") pod \"console-59b59cdd78-6rgw5\" (UID: \"3d096334-e219-40c4-8a7f-316cd0b51127\") " pod="openshift-console/console-59b59cdd78-6rgw5"
Jul 22 04:29:18.513167 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:29:18.513141    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/3d096334-e219-40c4-8a7f-316cd0b51127-service-ca\") pod \"console-59b59cdd78-6rgw5\" (UID: \"3d096334-e219-40c4-8a7f-316cd0b51127\") " pod="openshift-console/console-59b59cdd78-6rgw5"
Jul 22 04:29:18.513651 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:29:18.513629    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/3d096334-e219-40c4-8a7f-316cd0b51127-oauth-serving-cert\") pod \"console-59b59cdd78-6rgw5\" (UID: \"3d096334-e219-40c4-8a7f-316cd0b51127\") " pod="openshift-console/console-59b59cdd78-6rgw5"
Jul 22 04:29:18.513761 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:29:18.513734    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/3d096334-e219-40c4-8a7f-316cd0b51127-console-config\") pod \"console-59b59cdd78-6rgw5\" (UID: \"3d096334-e219-40c4-8a7f-316cd0b51127\") " pod="openshift-console/console-59b59cdd78-6rgw5"
Jul 22 04:29:18.513849 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:29:18.513827    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/3d096334-e219-40c4-8a7f-316cd0b51127-service-ca\") pod \"console-59b59cdd78-6rgw5\" (UID: \"3d096334-e219-40c4-8a7f-316cd0b51127\") " pod="openshift-console/console-59b59cdd78-6rgw5"
Jul 22 04:29:18.515495 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:29:18.515472    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/3d096334-e219-40c4-8a7f-316cd0b51127-console-serving-cert\") pod \"console-59b59cdd78-6rgw5\" (UID: \"3d096334-e219-40c4-8a7f-316cd0b51127\") " pod="openshift-console/console-59b59cdd78-6rgw5"
Jul 22 04:29:18.515495 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:29:18.515486    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/3d096334-e219-40c4-8a7f-316cd0b51127-console-oauth-config\") pod \"console-59b59cdd78-6rgw5\" (UID: \"3d096334-e219-40c4-8a7f-316cd0b51127\") " pod="openshift-console/console-59b59cdd78-6rgw5"
Jul 22 04:29:18.521080 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:29:18.521033    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gfnbz\" (UniqueName: \"kubernetes.io/projected/3d096334-e219-40c4-8a7f-316cd0b51127-kube-api-access-gfnbz\") pod \"console-59b59cdd78-6rgw5\" (UID: \"3d096334-e219-40c4-8a7f-316cd0b51127\") " pod="openshift-console/console-59b59cdd78-6rgw5"
Jul 22 04:29:18.707197 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:29:18.707145    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-59b59cdd78-6rgw5"
Jul 22 04:29:18.856058 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:29:18.856013    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-59b59cdd78-6rgw5"]
Jul 22 04:29:18.859141 ip-10-0-141-238 kubenswrapper[2563]: W0722 04:29:18.859105    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3d096334_e219_40c4_8a7f_316cd0b51127.slice/crio-ef7cc56ff0a051e3df85916d94a34df452781904c493f01b0972496a08a030f5 WatchSource:0}: Error finding container ef7cc56ff0a051e3df85916d94a34df452781904c493f01b0972496a08a030f5: Status 404 returned error can't find the container with id ef7cc56ff0a051e3df85916d94a34df452781904c493f01b0972496a08a030f5
Jul 22 04:29:18.893865 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:29:18.893830    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j9gvx_b4af3ae5-fa65-4358-8399-6ed11b68616e/konnectivity-agent/0.log" limit=1024
Jul 22 04:29:18.930981 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:29:18.930947    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-5945b5cfd-hh6s9"]
Jul 22 04:29:18.935356 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:29:18.935340    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-5945b5cfd-hh6s9"
Jul 22 04:29:18.937993 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:29:18.937970    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-kube-rbac-proxy-config\""
Jul 22 04:29:18.938147 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:29:18.937973    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\""
Jul 22 04:29:18.938147 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:29:18.938052    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-dockercfg-67dwv\""
Jul 22 04:29:18.938147 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:29:18.938114    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\""
Jul 22 04:29:18.938879 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:29:18.938866    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-tls\""
Jul 22 04:29:18.938923 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:29:18.938909    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\""
Jul 22 04:29:18.942379 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:29:18.942328    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-5945b5cfd-hh6s9"]
Jul 22 04:29:18.962230 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:29:18.962162    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j9gvx_b4af3ae5-fa65-4358-8399-6ed11b68616e/konnectivity-agent/0.log" limit=1024
Jul 22 04:29:19.019661 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:29:19.019635    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/d3e7e1d2-1e1d-4d5d-8284-cb4b3b12322d-prometheus-operator-tls\") pod \"prometheus-operator-5945b5cfd-hh6s9\" (UID: \"d3e7e1d2-1e1d-4d5d-8284-cb4b3b12322d\") " pod="openshift-monitoring/prometheus-operator-5945b5cfd-hh6s9"
Jul 22 04:29:19.019754 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:29:19.019665    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6wwd7\" (UniqueName: \"kubernetes.io/projected/d3e7e1d2-1e1d-4d5d-8284-cb4b3b12322d-kube-api-access-6wwd7\") pod \"prometheus-operator-5945b5cfd-hh6s9\" (UID: \"d3e7e1d2-1e1d-4d5d-8284-cb4b3b12322d\") " pod="openshift-monitoring/prometheus-operator-5945b5cfd-hh6s9"
Jul 22 04:29:19.019754 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:29:19.019742    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/d3e7e1d2-1e1d-4d5d-8284-cb4b3b12322d-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-5945b5cfd-hh6s9\" (UID: \"d3e7e1d2-1e1d-4d5d-8284-cb4b3b12322d\") " pod="openshift-monitoring/prometheus-operator-5945b5cfd-hh6s9"
Jul 22 04:29:19.019839 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:29:19.019774    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/d3e7e1d2-1e1d-4d5d-8284-cb4b3b12322d-metrics-client-ca\") pod \"prometheus-operator-5945b5cfd-hh6s9\" (UID: \"d3e7e1d2-1e1d-4d5d-8284-cb4b3b12322d\") " pod="openshift-monitoring/prometheus-operator-5945b5cfd-hh6s9"
Jul 22 04:29:19.046395 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:29:19.046368    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j9gvx_b4af3ae5-fa65-4358-8399-6ed11b68616e/konnectivity-agent/0.log" limit=1024
Jul 22 04:29:19.120859 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:29:19.120825    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/d3e7e1d2-1e1d-4d5d-8284-cb4b3b12322d-prometheus-operator-tls\") pod \"prometheus-operator-5945b5cfd-hh6s9\" (UID: \"d3e7e1d2-1e1d-4d5d-8284-cb4b3b12322d\") " pod="openshift-monitoring/prometheus-operator-5945b5cfd-hh6s9"
Jul 22 04:29:19.120859 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:29:19.120863    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6wwd7\" (UniqueName: \"kubernetes.io/projected/d3e7e1d2-1e1d-4d5d-8284-cb4b3b12322d-kube-api-access-6wwd7\") pod \"prometheus-operator-5945b5cfd-hh6s9\" (UID: \"d3e7e1d2-1e1d-4d5d-8284-cb4b3b12322d\") " pod="openshift-monitoring/prometheus-operator-5945b5cfd-hh6s9"
Jul 22 04:29:19.121090 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:29:19.120984    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/d3e7e1d2-1e1d-4d5d-8284-cb4b3b12322d-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-5945b5cfd-hh6s9\" (UID: \"d3e7e1d2-1e1d-4d5d-8284-cb4b3b12322d\") " pod="openshift-monitoring/prometheus-operator-5945b5cfd-hh6s9"
Jul 22 04:29:19.121090 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:29:19.121016    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/d3e7e1d2-1e1d-4d5d-8284-cb4b3b12322d-metrics-client-ca\") pod \"prometheus-operator-5945b5cfd-hh6s9\" (UID: \"d3e7e1d2-1e1d-4d5d-8284-cb4b3b12322d\") " pod="openshift-monitoring/prometheus-operator-5945b5cfd-hh6s9"
Jul 22 04:29:19.121639 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:29:19.121615    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/d3e7e1d2-1e1d-4d5d-8284-cb4b3b12322d-metrics-client-ca\") pod \"prometheus-operator-5945b5cfd-hh6s9\" (UID: \"d3e7e1d2-1e1d-4d5d-8284-cb4b3b12322d\") " pod="openshift-monitoring/prometheus-operator-5945b5cfd-hh6s9"
Jul 22 04:29:19.123279 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:29:19.123245    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/d3e7e1d2-1e1d-4d5d-8284-cb4b3b12322d-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-5945b5cfd-hh6s9\" (UID: \"d3e7e1d2-1e1d-4d5d-8284-cb4b3b12322d\") " pod="openshift-monitoring/prometheus-operator-5945b5cfd-hh6s9"
Jul 22 04:29:19.123412 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:29:19.123393    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/d3e7e1d2-1e1d-4d5d-8284-cb4b3b12322d-prometheus-operator-tls\") pod \"prometheus-operator-5945b5cfd-hh6s9\" (UID: \"d3e7e1d2-1e1d-4d5d-8284-cb4b3b12322d\") " pod="openshift-monitoring/prometheus-operator-5945b5cfd-hh6s9"
Jul 22 04:29:19.128710 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:29:19.128682    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6wwd7\" (UniqueName: \"kubernetes.io/projected/d3e7e1d2-1e1d-4d5d-8284-cb4b3b12322d-kube-api-access-6wwd7\") pod \"prometheus-operator-5945b5cfd-hh6s9\" (UID: \"d3e7e1d2-1e1d-4d5d-8284-cb4b3b12322d\") " pod="openshift-monitoring/prometheus-operator-5945b5cfd-hh6s9"
Jul 22 04:29:19.244745 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:29:19.244676    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-5945b5cfd-hh6s9"
Jul 22 04:29:19.383006 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:29:19.382976    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-5945b5cfd-hh6s9"]
Jul 22 04:29:19.385609 ip-10-0-141-238 kubenswrapper[2563]: W0722 04:29:19.385582    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd3e7e1d2_1e1d_4d5d_8284_cb4b3b12322d.slice/crio-7051ecfb19a5289d3bfd7410c6e2823bf147b73b859de4b034ad2eb205cf0890 WatchSource:0}: Error finding container 7051ecfb19a5289d3bfd7410c6e2823bf147b73b859de4b034ad2eb205cf0890: Status 404 returned error can't find the container with id 7051ecfb19a5289d3bfd7410c6e2823bf147b73b859de4b034ad2eb205cf0890
Jul 22 04:29:19.838696 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:29:19.838659    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-5945b5cfd-hh6s9" event={"ID":"d3e7e1d2-1e1d-4d5d-8284-cb4b3b12322d","Type":"ContainerStarted","Data":"7051ecfb19a5289d3bfd7410c6e2823bf147b73b859de4b034ad2eb205cf0890"}
Jul 22 04:29:19.840087 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:29:19.840056    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-59b59cdd78-6rgw5" event={"ID":"3d096334-e219-40c4-8a7f-316cd0b51127","Type":"ContainerStarted","Data":"ef7cc56ff0a051e3df85916d94a34df452781904c493f01b0972496a08a030f5"}
Jul 22 04:29:21.849626 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:29:21.849595    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-5945b5cfd-hh6s9" event={"ID":"d3e7e1d2-1e1d-4d5d-8284-cb4b3b12322d","Type":"ContainerStarted","Data":"21f54a667fe2ce759febf19143b716fe28a26310b387568dce1e16cb4b9fc4ca"}
Jul 22 04:29:21.850063 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:29:21.849646    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-5945b5cfd-hh6s9" event={"ID":"d3e7e1d2-1e1d-4d5d-8284-cb4b3b12322d","Type":"ContainerStarted","Data":"256a0b7f24c6c99249c730afa6f389ba70aef257830cce6541cbb88137725434"}
Jul 22 04:29:21.851289 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:29:21.851262    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-59b59cdd78-6rgw5" event={"ID":"3d096334-e219-40c4-8a7f-316cd0b51127","Type":"ContainerStarted","Data":"fb145321c02cb3e255e57b3e93287de519122b1f893b03a8111c0c94ec219217"}
Jul 22 04:29:21.866542 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:29:21.865430    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-5945b5cfd-hh6s9" podStartSLOduration=1.601816591 podStartE2EDuration="3.865412167s" totalImagesPullingTime="2.263595576s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 04:29:18 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 04:29:21.864111264 +0000 UTC m=+277.283120021" watchObservedRunningTime="2026-07-22 04:29:21.865412167 +0000 UTC m=+277.284420926"
Jul 22 04:29:21.885932 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:29:21.885876    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-59b59cdd78-6rgw5" podStartSLOduration=1.088671739 podStartE2EDuration="3.885861471s" totalImagesPullingTime="2.797189732s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 04:29:18 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 04:29:21.885323255 +0000 UTC m=+277.304332013" watchObservedRunningTime="2026-07-22 04:29:21.885861471 +0000 UTC m=+277.304870228"
Jul 22 04:29:21.936191 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:29:21.936166    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j9gvx_b4af3ae5-fa65-4358-8399-6ed11b68616e/konnectivity-agent/0.log" limit=1024
Jul 22 04:29:23.038369 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:29:23.038327    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j9gvx_b4af3ae5-fa65-4358-8399-6ed11b68616e/konnectivity-agent/0.log" limit=1024
Jul 22 04:29:23.250054 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:29:23.249999    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j9gvx_b4af3ae5-fa65-4358-8399-6ed11b68616e/konnectivity-agent/0.log" limit=1024
Jul 22 04:29:23.304357 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:29:23.304277    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-4fgx2"]
Jul 22 04:29:23.319780 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:29:23.319753    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-4fgx2"
Jul 22 04:29:23.322096 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:29:23.322076    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\""
Jul 22 04:29:23.322304 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:29:23.322288    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-svvf9\""
Jul 22 04:29:23.322615 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:29:23.322595    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\""
Jul 22 04:29:23.322896 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:29:23.322879    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\""
Jul 22 04:29:23.362161 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:29:23.362138    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/447bc26b-8e08-4a69-ba5b-de7392bb41d3-sys\") pod \"node-exporter-4fgx2\" (UID: \"447bc26b-8e08-4a69-ba5b-de7392bb41d3\") " pod="openshift-monitoring/node-exporter-4fgx2"
Jul 22 04:29:23.362256 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:29:23.362171    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/447bc26b-8e08-4a69-ba5b-de7392bb41d3-metrics-client-ca\") pod \"node-exporter-4fgx2\" (UID: \"447bc26b-8e08-4a69-ba5b-de7392bb41d3\") " pod="openshift-monitoring/node-exporter-4fgx2"
Jul 22 04:29:23.362256 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:29:23.362195    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-85spm\" (UniqueName: \"kubernetes.io/projected/447bc26b-8e08-4a69-ba5b-de7392bb41d3-kube-api-access-85spm\") pod \"node-exporter-4fgx2\" (UID: \"447bc26b-8e08-4a69-ba5b-de7392bb41d3\") " pod="openshift-monitoring/node-exporter-4fgx2"
Jul 22 04:29:23.362256 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:29:23.362222    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/447bc26b-8e08-4a69-ba5b-de7392bb41d3-root\") pod \"node-exporter-4fgx2\" (UID: \"447bc26b-8e08-4a69-ba5b-de7392bb41d3\") " pod="openshift-monitoring/node-exporter-4fgx2"
Jul 22 04:29:23.362352 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:29:23.362258    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/447bc26b-8e08-4a69-ba5b-de7392bb41d3-node-exporter-wtmp\") pod \"node-exporter-4fgx2\" (UID: \"447bc26b-8e08-4a69-ba5b-de7392bb41d3\") " pod="openshift-monitoring/node-exporter-4fgx2"
Jul 22 04:29:23.362352 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:29:23.362277    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/447bc26b-8e08-4a69-ba5b-de7392bb41d3-node-exporter-textfile\") pod \"node-exporter-4fgx2\" (UID: \"447bc26b-8e08-4a69-ba5b-de7392bb41d3\") " pod="openshift-monitoring/node-exporter-4fgx2"
Jul 22 04:29:23.362352 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:29:23.362323    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/447bc26b-8e08-4a69-ba5b-de7392bb41d3-node-exporter-tls\") pod \"node-exporter-4fgx2\" (UID: \"447bc26b-8e08-4a69-ba5b-de7392bb41d3\") " pod="openshift-monitoring/node-exporter-4fgx2"
Jul 22 04:29:23.362442 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:29:23.362394    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/447bc26b-8e08-4a69-ba5b-de7392bb41d3-node-exporter-accelerators-collector-config\") pod \"node-exporter-4fgx2\" (UID: \"447bc26b-8e08-4a69-ba5b-de7392bb41d3\") " pod="openshift-monitoring/node-exporter-4fgx2"
Jul 22 04:29:23.362442 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:29:23.362434    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/447bc26b-8e08-4a69-ba5b-de7392bb41d3-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-4fgx2\" (UID: \"447bc26b-8e08-4a69-ba5b-de7392bb41d3\") " pod="openshift-monitoring/node-exporter-4fgx2"
Jul 22 04:29:23.375173 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:29:23.375145    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j9gvx_b4af3ae5-fa65-4358-8399-6ed11b68616e/konnectivity-agent/0.log" limit=1024
Jul 22 04:29:23.462917 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:29:23.462896    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/447bc26b-8e08-4a69-ba5b-de7392bb41d3-root\") pod \"node-exporter-4fgx2\" (UID: \"447bc26b-8e08-4a69-ba5b-de7392bb41d3\") " pod="openshift-monitoring/node-exporter-4fgx2"
Jul 22 04:29:23.463080 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:29:23.462924    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/447bc26b-8e08-4a69-ba5b-de7392bb41d3-node-exporter-wtmp\") pod \"node-exporter-4fgx2\" (UID: \"447bc26b-8e08-4a69-ba5b-de7392bb41d3\") " pod="openshift-monitoring/node-exporter-4fgx2"
Jul 22 04:29:23.463080 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:29:23.462944    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/447bc26b-8e08-4a69-ba5b-de7392bb41d3-node-exporter-textfile\") pod \"node-exporter-4fgx2\" (UID: \"447bc26b-8e08-4a69-ba5b-de7392bb41d3\") " pod="openshift-monitoring/node-exporter-4fgx2"
Jul 22 04:29:23.463080 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:29:23.462961    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/447bc26b-8e08-4a69-ba5b-de7392bb41d3-node-exporter-tls\") pod \"node-exporter-4fgx2\" (UID: \"447bc26b-8e08-4a69-ba5b-de7392bb41d3\") " pod="openshift-monitoring/node-exporter-4fgx2"
Jul 22 04:29:23.463080 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:29:23.463020    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/447bc26b-8e08-4a69-ba5b-de7392bb41d3-root\") pod \"node-exporter-4fgx2\" (UID: \"447bc26b-8e08-4a69-ba5b-de7392bb41d3\") " pod="openshift-monitoring/node-exporter-4fgx2"
Jul 22 04:29:23.463080 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:29:23.463072    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/447bc26b-8e08-4a69-ba5b-de7392bb41d3-node-exporter-accelerators-collector-config\") pod \"node-exporter-4fgx2\" (UID: \"447bc26b-8e08-4a69-ba5b-de7392bb41d3\") " pod="openshift-monitoring/node-exporter-4fgx2"
Jul 22 04:29:23.463080 ip-10-0-141-238 kubenswrapper[2563]: E0722 04:29:23.463080    2563 secret.go:189] Couldn't get secret openshift-monitoring/node-exporter-tls: secret "node-exporter-tls" not found
Jul 22 04:29:23.463381 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:29:23.463088    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/447bc26b-8e08-4a69-ba5b-de7392bb41d3-node-exporter-wtmp\") pod \"node-exporter-4fgx2\" (UID: \"447bc26b-8e08-4a69-ba5b-de7392bb41d3\") " pod="openshift-monitoring/node-exporter-4fgx2"
Jul 22 04:29:23.463381 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:29:23.463114    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/447bc26b-8e08-4a69-ba5b-de7392bb41d3-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-4fgx2\" (UID: \"447bc26b-8e08-4a69-ba5b-de7392bb41d3\") " pod="openshift-monitoring/node-exporter-4fgx2"
Jul 22 04:29:23.463381 ip-10-0-141-238 kubenswrapper[2563]: E0722 04:29:23.463124    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/447bc26b-8e08-4a69-ba5b-de7392bb41d3-node-exporter-tls podName:447bc26b-8e08-4a69-ba5b-de7392bb41d3 nodeName:}" failed. No retries permitted until 2026-07-22 04:29:23.963111655 +0000 UTC m=+279.382120391 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "node-exporter-tls" (UniqueName: "kubernetes.io/secret/447bc26b-8e08-4a69-ba5b-de7392bb41d3-node-exporter-tls") pod "node-exporter-4fgx2" (UID: "447bc26b-8e08-4a69-ba5b-de7392bb41d3") : secret "node-exporter-tls" not found
Jul 22 04:29:23.463381 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:29:23.463154    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/447bc26b-8e08-4a69-ba5b-de7392bb41d3-sys\") pod \"node-exporter-4fgx2\" (UID: \"447bc26b-8e08-4a69-ba5b-de7392bb41d3\") " pod="openshift-monitoring/node-exporter-4fgx2"
Jul 22 04:29:23.463381 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:29:23.463192    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/447bc26b-8e08-4a69-ba5b-de7392bb41d3-metrics-client-ca\") pod \"node-exporter-4fgx2\" (UID: \"447bc26b-8e08-4a69-ba5b-de7392bb41d3\") " pod="openshift-monitoring/node-exporter-4fgx2"
Jul 22 04:29:23.463381 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:29:23.463219    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-85spm\" (UniqueName: \"kubernetes.io/projected/447bc26b-8e08-4a69-ba5b-de7392bb41d3-kube-api-access-85spm\") pod \"node-exporter-4fgx2\" (UID: \"447bc26b-8e08-4a69-ba5b-de7392bb41d3\") " pod="openshift-monitoring/node-exporter-4fgx2"
Jul 22 04:29:23.463381 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:29:23.463266    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/447bc26b-8e08-4a69-ba5b-de7392bb41d3-sys\") pod \"node-exporter-4fgx2\" (UID: \"447bc26b-8e08-4a69-ba5b-de7392bb41d3\") " pod="openshift-monitoring/node-exporter-4fgx2"
Jul 22 04:29:23.463381 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:29:23.463330    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/447bc26b-8e08-4a69-ba5b-de7392bb41d3-node-exporter-textfile\") pod \"node-exporter-4fgx2\" (UID: \"447bc26b-8e08-4a69-ba5b-de7392bb41d3\") " pod="openshift-monitoring/node-exporter-4fgx2"
Jul 22 04:29:23.463632 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:29:23.463622    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/447bc26b-8e08-4a69-ba5b-de7392bb41d3-node-exporter-accelerators-collector-config\") pod \"node-exporter-4fgx2\" (UID: \"447bc26b-8e08-4a69-ba5b-de7392bb41d3\") " pod="openshift-monitoring/node-exporter-4fgx2"
Jul 22 04:29:23.463700 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:29:23.463682    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/447bc26b-8e08-4a69-ba5b-de7392bb41d3-metrics-client-ca\") pod \"node-exporter-4fgx2\" (UID: \"447bc26b-8e08-4a69-ba5b-de7392bb41d3\") " pod="openshift-monitoring/node-exporter-4fgx2"
Jul 22 04:29:23.465387 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:29:23.465370    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/447bc26b-8e08-4a69-ba5b-de7392bb41d3-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-4fgx2\" (UID: \"447bc26b-8e08-4a69-ba5b-de7392bb41d3\") " pod="openshift-monitoring/node-exporter-4fgx2"
Jul 22 04:29:23.471380 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:29:23.471363    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-85spm\" (UniqueName: \"kubernetes.io/projected/447bc26b-8e08-4a69-ba5b-de7392bb41d3-kube-api-access-85spm\") pod \"node-exporter-4fgx2\" (UID: \"447bc26b-8e08-4a69-ba5b-de7392bb41d3\") " pod="openshift-monitoring/node-exporter-4fgx2"
Jul 22 04:29:23.605244 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:29:23.605164    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j9gvx_b4af3ae5-fa65-4358-8399-6ed11b68616e/konnectivity-agent/0.log" limit=1024
Jul 22 04:29:23.705817 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:29:23.705780    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j9gvx_b4af3ae5-fa65-4358-8399-6ed11b68616e/konnectivity-agent/0.log" limit=1024
Jul 22 04:29:23.802119 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:29:23.802082    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j9gvx_b4af3ae5-fa65-4358-8399-6ed11b68616e/konnectivity-agent/0.log" limit=1024
Jul 22 04:29:23.891555 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:29:23.891471    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j9gvx_b4af3ae5-fa65-4358-8399-6ed11b68616e/konnectivity-agent/0.log" limit=1024
Jul 22 04:29:23.968433 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:29:23.968399    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/447bc26b-8e08-4a69-ba5b-de7392bb41d3-node-exporter-tls\") pod \"node-exporter-4fgx2\" (UID: \"447bc26b-8e08-4a69-ba5b-de7392bb41d3\") " pod="openshift-monitoring/node-exporter-4fgx2"
Jul 22 04:29:23.968606 ip-10-0-141-238 kubenswrapper[2563]: E0722 04:29:23.968549    2563 secret.go:189] Couldn't get secret openshift-monitoring/node-exporter-tls: secret "node-exporter-tls" not found
Jul 22 04:29:23.968664 ip-10-0-141-238 kubenswrapper[2563]: E0722 04:29:23.968613    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/447bc26b-8e08-4a69-ba5b-de7392bb41d3-node-exporter-tls podName:447bc26b-8e08-4a69-ba5b-de7392bb41d3 nodeName:}" failed. No retries permitted until 2026-07-22 04:29:24.968597111 +0000 UTC m=+280.387605846 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "node-exporter-tls" (UniqueName: "kubernetes.io/secret/447bc26b-8e08-4a69-ba5b-de7392bb41d3-node-exporter-tls") pod "node-exporter-4fgx2" (UID: "447bc26b-8e08-4a69-ba5b-de7392bb41d3") : secret "node-exporter-tls" not found
Jul 22 04:29:23.991751 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:29:23.991717    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j9gvx_b4af3ae5-fa65-4358-8399-6ed11b68616e/konnectivity-agent/0.log" limit=1024
Jul 22 04:29:24.145611 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:29:24.145526    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j9gvx_b4af3ae5-fa65-4358-8399-6ed11b68616e/konnectivity-agent/0.log" limit=1024
Jul 22 04:29:24.264897 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:29:24.264869    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j9gvx_b4af3ae5-fa65-4358-8399-6ed11b68616e/konnectivity-agent/0.log" limit=1024
Jul 22 04:29:24.363977 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:29:24.363938    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j9gvx_b4af3ae5-fa65-4358-8399-6ed11b68616e/konnectivity-agent/0.log" limit=1024
Jul 22 04:29:24.383208 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:29:24.383182    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Jul 22 04:29:24.386171 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:29:24.386155    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Jul 22 04:29:24.389925 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:29:24.389895    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\""
Jul 22 04:29:24.390057 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:29:24.389957    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\""
Jul 22 04:29:24.390057 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:29:24.389899    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\""
Jul 22 04:29:24.390057 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:29:24.389898    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\""
Jul 22 04:29:24.390313 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:29:24.390294    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\""
Jul 22 04:29:24.390406 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:29:24.390363    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\""
Jul 22 04:29:24.390406 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:29:24.390379    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\""
Jul 22 04:29:24.390535 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:29:24.390402    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\""
Jul 22 04:29:24.390535 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:29:24.390412    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\""
Jul 22 04:29:24.390535 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:29:24.390402    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-hnnhh\""
Jul 22 04:29:24.401136 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:29:24.401083    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Jul 22 04:29:24.435418 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:29:24.435389    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j9gvx_b4af3ae5-fa65-4358-8399-6ed11b68616e/konnectivity-agent/0.log" limit=1024
Jul 22 04:29:24.474014 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:29:24.473986    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sjhw6\" (UniqueName: \"kubernetes.io/projected/9dcd1a9e-6c89-49c7-b2df-375e7e373b49-kube-api-access-sjhw6\") pod \"alertmanager-main-0\" (UID: \"9dcd1a9e-6c89-49c7-b2df-375e7e373b49\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 22 04:29:24.474164 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:29:24.474031    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/9dcd1a9e-6c89-49c7-b2df-375e7e373b49-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"9dcd1a9e-6c89-49c7-b2df-375e7e373b49\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 22 04:29:24.474164 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:29:24.474077    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9dcd1a9e-6c89-49c7-b2df-375e7e373b49-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"9dcd1a9e-6c89-49c7-b2df-375e7e373b49\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 22 04:29:24.474164 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:29:24.474101    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/9dcd1a9e-6c89-49c7-b2df-375e7e373b49-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"9dcd1a9e-6c89-49c7-b2df-375e7e373b49\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 22 04:29:24.474164 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:29:24.474120    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/9dcd1a9e-6c89-49c7-b2df-375e7e373b49-tls-assets\") pod \"alertmanager-main-0\" (UID: \"9dcd1a9e-6c89-49c7-b2df-375e7e373b49\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 22 04:29:24.474164 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:29:24.474150    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/9dcd1a9e-6c89-49c7-b2df-375e7e373b49-config-out\") pod \"alertmanager-main-0\" (UID: \"9dcd1a9e-6c89-49c7-b2df-375e7e373b49\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 22 04:29:24.474317 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:29:24.474223    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/9dcd1a9e-6c89-49c7-b2df-375e7e373b49-config-volume\") pod \"alertmanager-main-0\" (UID: \"9dcd1a9e-6c89-49c7-b2df-375e7e373b49\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 22 04:29:24.474317 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:29:24.474255    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/9dcd1a9e-6c89-49c7-b2df-375e7e373b49-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"9dcd1a9e-6c89-49c7-b2df-375e7e373b49\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 22 04:29:24.474317 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:29:24.474274    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/9dcd1a9e-6c89-49c7-b2df-375e7e373b49-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"9dcd1a9e-6c89-49c7-b2df-375e7e373b49\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 22 04:29:24.474317 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:29:24.474300    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/9dcd1a9e-6c89-49c7-b2df-375e7e373b49-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"9dcd1a9e-6c89-49c7-b2df-375e7e373b49\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 22 04:29:24.474438 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:29:24.474326    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/9dcd1a9e-6c89-49c7-b2df-375e7e373b49-web-config\") pod \"alertmanager-main-0\" (UID: \"9dcd1a9e-6c89-49c7-b2df-375e7e373b49\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 22 04:29:24.474438 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:29:24.474351    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/9dcd1a9e-6c89-49c7-b2df-375e7e373b49-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"9dcd1a9e-6c89-49c7-b2df-375e7e373b49\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 22 04:29:24.474438 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:29:24.474372    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/9dcd1a9e-6c89-49c7-b2df-375e7e373b49-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"9dcd1a9e-6c89-49c7-b2df-375e7e373b49\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 22 04:29:24.575019 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:29:24.574983    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/9dcd1a9e-6c89-49c7-b2df-375e7e373b49-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"9dcd1a9e-6c89-49c7-b2df-375e7e373b49\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 22 04:29:24.575227 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:29:24.575178    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/9dcd1a9e-6c89-49c7-b2df-375e7e373b49-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"9dcd1a9e-6c89-49c7-b2df-375e7e373b49\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 22 04:29:24.575345 ip-10-0-141-238 kubenswrapper[2563]: E0722 04:29:24.575325    2563 secret.go:189] Couldn't get secret openshift-monitoring/alertmanager-main-tls: secret "alertmanager-main-tls" not found
Jul 22 04:29:24.575457 ip-10-0-141-238 kubenswrapper[2563]: E0722 04:29:24.575391    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9dcd1a9e-6c89-49c7-b2df-375e7e373b49-secret-alertmanager-main-tls podName:9dcd1a9e-6c89-49c7-b2df-375e7e373b49 nodeName:}" failed. No retries permitted until 2026-07-22 04:29:25.075372012 +0000 UTC m=+280.494380765 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "secret-alertmanager-main-tls" (UniqueName: "kubernetes.io/secret/9dcd1a9e-6c89-49c7-b2df-375e7e373b49-secret-alertmanager-main-tls") pod "alertmanager-main-0" (UID: "9dcd1a9e-6c89-49c7-b2df-375e7e373b49") : secret "alertmanager-main-tls" not found
Jul 22 04:29:24.575596 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:29:24.575569    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sjhw6\" (UniqueName: \"kubernetes.io/projected/9dcd1a9e-6c89-49c7-b2df-375e7e373b49-kube-api-access-sjhw6\") pod \"alertmanager-main-0\" (UID: \"9dcd1a9e-6c89-49c7-b2df-375e7e373b49\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 22 04:29:24.575728 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:29:24.575652    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/9dcd1a9e-6c89-49c7-b2df-375e7e373b49-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"9dcd1a9e-6c89-49c7-b2df-375e7e373b49\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 22 04:29:24.575728 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:29:24.575693    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9dcd1a9e-6c89-49c7-b2df-375e7e373b49-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"9dcd1a9e-6c89-49c7-b2df-375e7e373b49\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 22 04:29:24.575728 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:29:24.575727    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/9dcd1a9e-6c89-49c7-b2df-375e7e373b49-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"9dcd1a9e-6c89-49c7-b2df-375e7e373b49\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 22 04:29:24.575892 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:29:24.575757    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/9dcd1a9e-6c89-49c7-b2df-375e7e373b49-tls-assets\") pod \"alertmanager-main-0\" (UID: \"9dcd1a9e-6c89-49c7-b2df-375e7e373b49\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 22 04:29:24.575892 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:29:24.575786    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/9dcd1a9e-6c89-49c7-b2df-375e7e373b49-config-out\") pod \"alertmanager-main-0\" (UID: \"9dcd1a9e-6c89-49c7-b2df-375e7e373b49\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 22 04:29:24.575892 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:29:24.575834    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/9dcd1a9e-6c89-49c7-b2df-375e7e373b49-config-volume\") pod \"alertmanager-main-0\" (UID: \"9dcd1a9e-6c89-49c7-b2df-375e7e373b49\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 22 04:29:24.575892 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:29:24.575859    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/9dcd1a9e-6c89-49c7-b2df-375e7e373b49-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"9dcd1a9e-6c89-49c7-b2df-375e7e373b49\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 22 04:29:24.575892 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:29:24.575884    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/9dcd1a9e-6c89-49c7-b2df-375e7e373b49-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"9dcd1a9e-6c89-49c7-b2df-375e7e373b49\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 22 04:29:24.576189 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:29:24.575913    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/9dcd1a9e-6c89-49c7-b2df-375e7e373b49-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"9dcd1a9e-6c89-49c7-b2df-375e7e373b49\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 22 04:29:24.576189 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:29:24.575943    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/9dcd1a9e-6c89-49c7-b2df-375e7e373b49-web-config\") pod \"alertmanager-main-0\" (UID: \"9dcd1a9e-6c89-49c7-b2df-375e7e373b49\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 22 04:29:24.576913 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:29:24.576889    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/9dcd1a9e-6c89-49c7-b2df-375e7e373b49-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"9dcd1a9e-6c89-49c7-b2df-375e7e373b49\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 22 04:29:24.577062 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:29:24.576899    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9dcd1a9e-6c89-49c7-b2df-375e7e373b49-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"9dcd1a9e-6c89-49c7-b2df-375e7e373b49\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 22 04:29:24.577561 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:29:24.577539    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/9dcd1a9e-6c89-49c7-b2df-375e7e373b49-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"9dcd1a9e-6c89-49c7-b2df-375e7e373b49\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 22 04:29:24.578603 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:29:24.578577    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/9dcd1a9e-6c89-49c7-b2df-375e7e373b49-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"9dcd1a9e-6c89-49c7-b2df-375e7e373b49\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 22 04:29:24.578766 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:29:24.578663    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/9dcd1a9e-6c89-49c7-b2df-375e7e373b49-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"9dcd1a9e-6c89-49c7-b2df-375e7e373b49\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 22 04:29:24.579077 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:29:24.579030    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/9dcd1a9e-6c89-49c7-b2df-375e7e373b49-config-volume\") pod \"alertmanager-main-0\" (UID: \"9dcd1a9e-6c89-49c7-b2df-375e7e373b49\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 22 04:29:24.579410 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:29:24.579240    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/9dcd1a9e-6c89-49c7-b2df-375e7e373b49-tls-assets\") pod \"alertmanager-main-0\" (UID: \"9dcd1a9e-6c89-49c7-b2df-375e7e373b49\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 22 04:29:24.579410 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:29:24.579249    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/9dcd1a9e-6c89-49c7-b2df-375e7e373b49-web-config\") pod \"alertmanager-main-0\" (UID: \"9dcd1a9e-6c89-49c7-b2df-375e7e373b49\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 22 04:29:24.579594 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:29:24.579571    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/9dcd1a9e-6c89-49c7-b2df-375e7e373b49-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"9dcd1a9e-6c89-49c7-b2df-375e7e373b49\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 22 04:29:24.579788 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:29:24.579769    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/9dcd1a9e-6c89-49c7-b2df-375e7e373b49-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"9dcd1a9e-6c89-49c7-b2df-375e7e373b49\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 22 04:29:24.579983 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:29:24.579967    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/9dcd1a9e-6c89-49c7-b2df-375e7e373b49-config-out\") pod \"alertmanager-main-0\" (UID: \"9dcd1a9e-6c89-49c7-b2df-375e7e373b49\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 22 04:29:24.583156 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:29:24.583134    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-sjhw6\" (UniqueName: \"kubernetes.io/projected/9dcd1a9e-6c89-49c7-b2df-375e7e373b49-kube-api-access-sjhw6\") pod \"alertmanager-main-0\" (UID: \"9dcd1a9e-6c89-49c7-b2df-375e7e373b49\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 22 04:29:24.634292 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:29:24.634248    2563 patch_prober.go:28] interesting pod/image-registry-57d6d8f867-t2t9g container/registry namespace/openshift-image-registry: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]}
Jul 22 04:29:24.634446 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:29:24.634301    2563 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-image-registry/image-registry-57d6d8f867-t2t9g" podUID="d51e1b57-de0a-425b-8a3f-ad8449c0845c" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 22 04:29:24.664781 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:29:24.664747    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j9gvx_b4af3ae5-fa65-4358-8399-6ed11b68616e/konnectivity-agent/0.log" limit=1024
Jul 22 04:29:24.715498 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:29:24.715443    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j9gvx_b4af3ae5-fa65-4358-8399-6ed11b68616e/konnectivity-agent/0.log" limit=1024
Jul 22 04:29:24.914559 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:29:24.914516    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j9gvx_b4af3ae5-fa65-4358-8399-6ed11b68616e/konnectivity-agent/0.log" limit=1024
Jul 22 04:29:24.979438 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:29:24.979362    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/447bc26b-8e08-4a69-ba5b-de7392bb41d3-node-exporter-tls\") pod \"node-exporter-4fgx2\" (UID: \"447bc26b-8e08-4a69-ba5b-de7392bb41d3\") " pod="openshift-monitoring/node-exporter-4fgx2"
Jul 22 04:29:24.981578 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:29:24.981560    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/447bc26b-8e08-4a69-ba5b-de7392bb41d3-node-exporter-tls\") pod \"node-exporter-4fgx2\" (UID: \"447bc26b-8e08-4a69-ba5b-de7392bb41d3\") " pod="openshift-monitoring/node-exporter-4fgx2"
Jul 22 04:29:25.080552 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:29:25.080519    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/9dcd1a9e-6c89-49c7-b2df-375e7e373b49-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"9dcd1a9e-6c89-49c7-b2df-375e7e373b49\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 22 04:29:25.082879 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:29:25.082849    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/9dcd1a9e-6c89-49c7-b2df-375e7e373b49-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"9dcd1a9e-6c89-49c7-b2df-375e7e373b49\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 22 04:29:25.128831 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:29:25.128798    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-4fgx2"
Jul 22 04:29:25.138335 ip-10-0-141-238 kubenswrapper[2563]: W0722 04:29:25.138309    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod447bc26b_8e08_4a69_ba5b_de7392bb41d3.slice/crio-32d254764e87240ce75404d45f92e18c2de3884d563051c07a2f41e5ae9b22ad WatchSource:0}: Error finding container 32d254764e87240ce75404d45f92e18c2de3884d563051c07a2f41e5ae9b22ad: Status 404 returned error can't find the container with id 32d254764e87240ce75404d45f92e18c2de3884d563051c07a2f41e5ae9b22ad
Jul 22 04:29:25.296335 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:29:25.296252    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Jul 22 04:29:25.423011 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:29:25.422987    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Jul 22 04:29:25.424719 ip-10-0-141-238 kubenswrapper[2563]: W0722 04:29:25.424694    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9dcd1a9e_6c89_49c7_b2df_375e7e373b49.slice/crio-3aa137f038f297b06e78d7d87dee26cb564e83da4c2fe8a3ba16a6a7d5d786d7 WatchSource:0}: Error finding container 3aa137f038f297b06e78d7d87dee26cb564e83da4c2fe8a3ba16a6a7d5d786d7: Status 404 returned error can't find the container with id 3aa137f038f297b06e78d7d87dee26cb564e83da4c2fe8a3ba16a6a7d5d786d7
Jul 22 04:29:25.493081 ip-10-0-141-238 kubenswrapper[2563]: E0722 04:29:25.493022    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-rs8lw" podUID="28a48c54-711d-4dc7-9b41-9773dc665ffb"
Jul 22 04:29:25.867119 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:29:25.867076    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"9dcd1a9e-6c89-49c7-b2df-375e7e373b49","Type":"ContainerStarted","Data":"3aa137f038f297b06e78d7d87dee26cb564e83da4c2fe8a3ba16a6a7d5d786d7"}
Jul 22 04:29:25.868630 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:29:25.868541    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-rs8lw"
Jul 22 04:29:25.868630 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:29:25.868561    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-4fgx2" event={"ID":"447bc26b-8e08-4a69-ba5b-de7392bb41d3","Type":"ContainerStarted","Data":"32d254764e87240ce75404d45f92e18c2de3884d563051c07a2f41e5ae9b22ad"}
Jul 22 04:29:26.210774 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:29:26.210739    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j9gvx_b4af3ae5-fa65-4358-8399-6ed11b68616e/konnectivity-agent/0.log" limit=1024
Jul 22 04:29:26.280692 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:29:26.280641    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j9gvx_b4af3ae5-fa65-4358-8399-6ed11b68616e/konnectivity-agent/0.log" limit=1024
Jul 22 04:29:26.557899 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:29:26.557841    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j9gvx_b4af3ae5-fa65-4358-8399-6ed11b68616e/konnectivity-agent/0.log" limit=1024
Jul 22 04:29:26.666776 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:29:26.666743    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j9gvx_b4af3ae5-fa65-4358-8399-6ed11b68616e/konnectivity-agent/0.log" limit=1024
Jul 22 04:29:26.873458 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:29:26.873378    2563 generic.go:356] "Generic (PLEG): container finished" podID="447bc26b-8e08-4a69-ba5b-de7392bb41d3" containerID="bf57da96293ac82e994f8b714b94b28af3d624798f5a5c433186380101369cd0" exitCode=0
Jul 22 04:29:26.873617 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:29:26.873466    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-4fgx2" event={"ID":"447bc26b-8e08-4a69-ba5b-de7392bb41d3","Type":"ContainerDied","Data":"bf57da96293ac82e994f8b714b94b28af3d624798f5a5c433186380101369cd0"}
Jul 22 04:29:26.874880 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:29:26.874860    2563 generic.go:356] "Generic (PLEG): container finished" podID="9dcd1a9e-6c89-49c7-b2df-375e7e373b49" containerID="cfcc0f6a8afb8f9cc68ee6ef3fa46b68f8cc1af78fb8509480e9a59f923190f9" exitCode=0
Jul 22 04:29:26.874992 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:29:26.874891    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"9dcd1a9e-6c89-49c7-b2df-375e7e373b49","Type":"ContainerDied","Data":"cfcc0f6a8afb8f9cc68ee6ef3fa46b68f8cc1af78fb8509480e9a59f923190f9"}
Jul 22 04:29:27.881446 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:29:27.881408    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-4fgx2" event={"ID":"447bc26b-8e08-4a69-ba5b-de7392bb41d3","Type":"ContainerStarted","Data":"947219d3e263c77b08ca983c2524b7a7b662cc628e59ad5feebd55ed6b4bc936"}
Jul 22 04:29:27.881849 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:29:27.881473    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-4fgx2" event={"ID":"447bc26b-8e08-4a69-ba5b-de7392bb41d3","Type":"ContainerStarted","Data":"f05f56cacf757e034d6751bc0c100e958887c1cf780c193aa74d510571193ffe"}
Jul 22 04:29:27.900774 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:29:27.900720    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-4fgx2" podStartSLOduration=3.5208843610000002 podStartE2EDuration="4.900704876s" totalImagesPullingTime="1.313137798s" totalInitContainerRuntime="66.682717ms" isStatefulPod=true podCreationTimestamp="2026-07-22 04:29:23 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 04:29:27.898341611 +0000 UTC m=+283.317350361" watchObservedRunningTime="2026-07-22 04:29:27.900704876 +0000 UTC m=+283.319713634"
Jul 22 04:29:28.098391 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:29:28.098350    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j9gvx_b4af3ae5-fa65-4358-8399-6ed11b68616e/konnectivity-agent/0.log" limit=1024
Jul 22 04:29:28.153633 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:29:28.153598    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j9gvx_b4af3ae5-fa65-4358-8399-6ed11b68616e/konnectivity-agent/0.log" limit=1024
Jul 22 04:29:28.559578 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:29:28.559533    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j9gvx_b4af3ae5-fa65-4358-8399-6ed11b68616e/konnectivity-agent/0.log" limit=1024
Jul 22 04:29:28.613761 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:29:28.613724    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j9gvx_b4af3ae5-fa65-4358-8399-6ed11b68616e/konnectivity-agent/0.log" limit=1024
Jul 22 04:29:28.707544 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:29:28.707463    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-59b59cdd78-6rgw5"
Jul 22 04:29:28.707798 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:29:28.707775    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-59b59cdd78-6rgw5"
Jul 22 04:29:28.708874 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:29:28.708853    2563 patch_prober.go:28] interesting pod/console-59b59cdd78-6rgw5 container/console namespace/openshift-console: Startup probe status=failure output="Get \"https://10.134.0.16:8443/health\": dial tcp 10.134.0.16:8443: connect: connection refused" start-of-body=
Jul 22 04:29:28.708926 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:29:28.708898    2563 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-console/console-59b59cdd78-6rgw5" podUID="3d096334-e219-40c4-8a7f-316cd0b51127" containerName="console" probeResult="failure" output="Get \"https://10.134.0.16:8443/health\": dial tcp 10.134.0.16:8443: connect: connection refused"
Jul 22 04:29:28.888007 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:29:28.887973    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"9dcd1a9e-6c89-49c7-b2df-375e7e373b49","Type":"ContainerStarted","Data":"c423a9e09ae5be47abe5b92bfe6818161aa937728a31a2debc802cfc051892c7"}
Jul 22 04:29:28.888399 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:29:28.888060    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"9dcd1a9e-6c89-49c7-b2df-375e7e373b49","Type":"ContainerStarted","Data":"a486ac66a34ba9bcd79f965bdb101e4a889636d3f9960beb01006ea5399b4401"}
Jul 22 04:29:28.888399 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:29:28.888086    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"9dcd1a9e-6c89-49c7-b2df-375e7e373b49","Type":"ContainerStarted","Data":"5e077e4456595a4b49f0a4b75cbefe8c44083445555165a160290ab1a8d7af6c"}
Jul 22 04:29:28.888399 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:29:28.888109    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"9dcd1a9e-6c89-49c7-b2df-375e7e373b49","Type":"ContainerStarted","Data":"4f213ee20039982a3fe9d5989db4b8dddeeba8a8288043e1bdc8de279cdf2bf4"}
Jul 22 04:29:28.888399 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:29:28.888133    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"9dcd1a9e-6c89-49c7-b2df-375e7e373b49","Type":"ContainerStarted","Data":"fc86eca96e36bee4326aad5dd8659a1ff24b8068756021b3038b6720e67bfbf7"}
Jul 22 04:29:29.322743 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:29:29.322702    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/28a48c54-711d-4dc7-9b41-9773dc665ffb-metrics-tls\") pod \"dns-default-rs8lw\" (UID: \"28a48c54-711d-4dc7-9b41-9773dc665ffb\") " pod="openshift-dns/dns-default-rs8lw"
Jul 22 04:29:29.324997 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:29:29.324971    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/28a48c54-711d-4dc7-9b41-9773dc665ffb-metrics-tls\") pod \"dns-default-rs8lw\" (UID: \"28a48c54-711d-4dc7-9b41-9773dc665ffb\") " pod="openshift-dns/dns-default-rs8lw"
Jul 22 04:29:29.454759 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:29:29.454701    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j9gvx_b4af3ae5-fa65-4358-8399-6ed11b68616e/konnectivity-agent/0.log" limit=1024
Jul 22 04:29:29.471919 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:29:29.471886    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-cjpdb\""
Jul 22 04:29:29.480069 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:29:29.479975    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-rs8lw"
Jul 22 04:29:29.620083 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:29:29.619804    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-rs8lw"]
Jul 22 04:29:29.625682 ip-10-0-141-238 kubenswrapper[2563]: W0722 04:29:29.623945    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod28a48c54_711d_4dc7_9b41_9773dc665ffb.slice/crio-1cdeca4d4db9c8b86630e82b5e6e26ac324dfb1c991e3431fc02e2076cb44937 WatchSource:0}: Error finding container 1cdeca4d4db9c8b86630e82b5e6e26ac324dfb1c991e3431fc02e2076cb44937: Status 404 returned error can't find the container with id 1cdeca4d4db9c8b86630e82b5e6e26ac324dfb1c991e3431fc02e2076cb44937
Jul 22 04:29:29.894625 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:29:29.894519    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"9dcd1a9e-6c89-49c7-b2df-375e7e373b49","Type":"ContainerStarted","Data":"ab1d0e7f89fb39d357c1d83331892932cdd6bc196cb8d3f737ba77f0ffb183b1"}
Jul 22 04:29:29.895669 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:29:29.895645    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-rs8lw" event={"ID":"28a48c54-711d-4dc7-9b41-9773dc665ffb","Type":"ContainerStarted","Data":"1cdeca4d4db9c8b86630e82b5e6e26ac324dfb1c991e3431fc02e2076cb44937"}
Jul 22 04:29:29.920588 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:29:29.920535    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=2.835137671 podStartE2EDuration="5.920520022s" totalImagesPullingTime="3.068509903s" totalInitContainerRuntime="16.872448ms" isStatefulPod=false podCreationTimestamp="2026-07-22 04:29:24 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 04:29:29.918467648 +0000 UTC m=+285.337476405" watchObservedRunningTime="2026-07-22 04:29:29.920520022 +0000 UTC m=+285.339528780"
Jul 22 04:29:31.906200 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:29:31.906161    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-rs8lw" event={"ID":"28a48c54-711d-4dc7-9b41-9773dc665ffb","Type":"ContainerStarted","Data":"b5b26285d08bd28005a70409de80d08e2832cfc99b5b7624754b0406c587525d"}
Jul 22 04:29:31.906572 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:29:31.906224    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-rs8lw" event={"ID":"28a48c54-711d-4dc7-9b41-9773dc665ffb","Type":"ContainerStarted","Data":"09fa489a772403e7fa8c60a7fd143d1f674e6951f491c762c4bafbd93717d425"}
Jul 22 04:29:31.906572 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:29:31.906278    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-rs8lw"
Jul 22 04:29:31.923148 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:29:31.923106    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-rs8lw" podStartSLOduration=251.562716215 podStartE2EDuration="4m12.923092934s" totalImagesPullingTime="1.360376719s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 04:25:19 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 04:29:31.921305041 +0000 UTC m=+287.340313797" watchObservedRunningTime="2026-07-22 04:29:31.923092934 +0000 UTC m=+287.342101691"
Jul 22 04:29:32.114283 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:29:32.114249    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j9gvx_b4af3ae5-fa65-4358-8399-6ed11b68616e/konnectivity-agent/0.log" limit=1024
Jul 22 04:29:32.169652 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:29:32.169576    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j9gvx_b4af3ae5-fa65-4358-8399-6ed11b68616e/konnectivity-agent/0.log" limit=1024
Jul 22 04:29:33.598315 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:29:33.598279    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-59b59cdd78-6rgw5"]
Jul 22 04:29:33.658334 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:29:33.658306    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-864456df47-qjd4f"]
Jul 22 04:29:33.661573 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:29:33.661556    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-864456df47-qjd4f"
Jul 22 04:29:33.670345 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:29:33.670310    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\""
Jul 22 04:29:33.678202 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:29:33.678180    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-864456df47-qjd4f"]
Jul 22 04:29:33.763124 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:29:33.763088    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/98b94e3b-ba94-4d1f-925c-3aaeefe1a4dd-console-config\") pod \"console-864456df47-qjd4f\" (UID: \"98b94e3b-ba94-4d1f-925c-3aaeefe1a4dd\") " pod="openshift-console/console-864456df47-qjd4f"
Jul 22 04:29:33.763264 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:29:33.763130    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/98b94e3b-ba94-4d1f-925c-3aaeefe1a4dd-oauth-serving-cert\") pod \"console-864456df47-qjd4f\" (UID: \"98b94e3b-ba94-4d1f-925c-3aaeefe1a4dd\") " pod="openshift-console/console-864456df47-qjd4f"
Jul 22 04:29:33.763264 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:29:33.763157    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/98b94e3b-ba94-4d1f-925c-3aaeefe1a4dd-console-oauth-config\") pod \"console-864456df47-qjd4f\" (UID: \"98b94e3b-ba94-4d1f-925c-3aaeefe1a4dd\") " pod="openshift-console/console-864456df47-qjd4f"
Jul 22 04:29:33.763264 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:29:33.763219    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/98b94e3b-ba94-4d1f-925c-3aaeefe1a4dd-trusted-ca-bundle\") pod \"console-864456df47-qjd4f\" (UID: \"98b94e3b-ba94-4d1f-925c-3aaeefe1a4dd\") " pod="openshift-console/console-864456df47-qjd4f"
Jul 22 04:29:33.763379 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:29:33.763265    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/98b94e3b-ba94-4d1f-925c-3aaeefe1a4dd-service-ca\") pod \"console-864456df47-qjd4f\" (UID: \"98b94e3b-ba94-4d1f-925c-3aaeefe1a4dd\") " pod="openshift-console/console-864456df47-qjd4f"
Jul 22 04:29:33.763379 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:29:33.763286    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/98b94e3b-ba94-4d1f-925c-3aaeefe1a4dd-console-serving-cert\") pod \"console-864456df47-qjd4f\" (UID: \"98b94e3b-ba94-4d1f-925c-3aaeefe1a4dd\") " pod="openshift-console/console-864456df47-qjd4f"
Jul 22 04:29:33.763379 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:29:33.763315    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-w2dl6\" (UniqueName: \"kubernetes.io/projected/98b94e3b-ba94-4d1f-925c-3aaeefe1a4dd-kube-api-access-w2dl6\") pod \"console-864456df47-qjd4f\" (UID: \"98b94e3b-ba94-4d1f-925c-3aaeefe1a4dd\") " pod="openshift-console/console-864456df47-qjd4f"
Jul 22 04:29:33.863726 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:29:33.863632    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/98b94e3b-ba94-4d1f-925c-3aaeefe1a4dd-oauth-serving-cert\") pod \"console-864456df47-qjd4f\" (UID: \"98b94e3b-ba94-4d1f-925c-3aaeefe1a4dd\") " pod="openshift-console/console-864456df47-qjd4f"
Jul 22 04:29:33.863726 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:29:33.863683    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/98b94e3b-ba94-4d1f-925c-3aaeefe1a4dd-console-oauth-config\") pod \"console-864456df47-qjd4f\" (UID: \"98b94e3b-ba94-4d1f-925c-3aaeefe1a4dd\") " pod="openshift-console/console-864456df47-qjd4f"
Jul 22 04:29:33.863924 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:29:33.863793    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/98b94e3b-ba94-4d1f-925c-3aaeefe1a4dd-trusted-ca-bundle\") pod \"console-864456df47-qjd4f\" (UID: \"98b94e3b-ba94-4d1f-925c-3aaeefe1a4dd\") " pod="openshift-console/console-864456df47-qjd4f"
Jul 22 04:29:33.863924 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:29:33.863838    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/98b94e3b-ba94-4d1f-925c-3aaeefe1a4dd-service-ca\") pod \"console-864456df47-qjd4f\" (UID: \"98b94e3b-ba94-4d1f-925c-3aaeefe1a4dd\") " pod="openshift-console/console-864456df47-qjd4f"
Jul 22 04:29:33.863924 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:29:33.863855    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/98b94e3b-ba94-4d1f-925c-3aaeefe1a4dd-console-serving-cert\") pod \"console-864456df47-qjd4f\" (UID: \"98b94e3b-ba94-4d1f-925c-3aaeefe1a4dd\") " pod="openshift-console/console-864456df47-qjd4f"
Jul 22 04:29:33.863924 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:29:33.863880    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-w2dl6\" (UniqueName: \"kubernetes.io/projected/98b94e3b-ba94-4d1f-925c-3aaeefe1a4dd-kube-api-access-w2dl6\") pod \"console-864456df47-qjd4f\" (UID: \"98b94e3b-ba94-4d1f-925c-3aaeefe1a4dd\") " pod="openshift-console/console-864456df47-qjd4f"
Jul 22 04:29:33.864157 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:29:33.863935    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/98b94e3b-ba94-4d1f-925c-3aaeefe1a4dd-console-config\") pod \"console-864456df47-qjd4f\" (UID: \"98b94e3b-ba94-4d1f-925c-3aaeefe1a4dd\") " pod="openshift-console/console-864456df47-qjd4f"
Jul 22 04:29:33.864462 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:29:33.864437    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/98b94e3b-ba94-4d1f-925c-3aaeefe1a4dd-oauth-serving-cert\") pod \"console-864456df47-qjd4f\" (UID: \"98b94e3b-ba94-4d1f-925c-3aaeefe1a4dd\") " pod="openshift-console/console-864456df47-qjd4f"
Jul 22 04:29:33.864619 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:29:33.864597    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/98b94e3b-ba94-4d1f-925c-3aaeefe1a4dd-service-ca\") pod \"console-864456df47-qjd4f\" (UID: \"98b94e3b-ba94-4d1f-925c-3aaeefe1a4dd\") " pod="openshift-console/console-864456df47-qjd4f"
Jul 22 04:29:33.864668 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:29:33.864603    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/98b94e3b-ba94-4d1f-925c-3aaeefe1a4dd-console-config\") pod \"console-864456df47-qjd4f\" (UID: \"98b94e3b-ba94-4d1f-925c-3aaeefe1a4dd\") " pod="openshift-console/console-864456df47-qjd4f"
Jul 22 04:29:33.864702 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:29:33.864673    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/98b94e3b-ba94-4d1f-925c-3aaeefe1a4dd-trusted-ca-bundle\") pod \"console-864456df47-qjd4f\" (UID: \"98b94e3b-ba94-4d1f-925c-3aaeefe1a4dd\") " pod="openshift-console/console-864456df47-qjd4f"
Jul 22 04:29:33.866247 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:29:33.866225    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/98b94e3b-ba94-4d1f-925c-3aaeefe1a4dd-console-serving-cert\") pod \"console-864456df47-qjd4f\" (UID: \"98b94e3b-ba94-4d1f-925c-3aaeefe1a4dd\") " pod="openshift-console/console-864456df47-qjd4f"
Jul 22 04:29:33.866324 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:29:33.866257    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/98b94e3b-ba94-4d1f-925c-3aaeefe1a4dd-console-oauth-config\") pod \"console-864456df47-qjd4f\" (UID: \"98b94e3b-ba94-4d1f-925c-3aaeefe1a4dd\") " pod="openshift-console/console-864456df47-qjd4f"
Jul 22 04:29:33.872748 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:29:33.872725    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-w2dl6\" (UniqueName: \"kubernetes.io/projected/98b94e3b-ba94-4d1f-925c-3aaeefe1a4dd-kube-api-access-w2dl6\") pod \"console-864456df47-qjd4f\" (UID: \"98b94e3b-ba94-4d1f-925c-3aaeefe1a4dd\") " pod="openshift-console/console-864456df47-qjd4f"
Jul 22 04:29:33.970434 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:29:33.970400    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-864456df47-qjd4f"
Jul 22 04:29:34.099704 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:29:34.099670    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-864456df47-qjd4f"]
Jul 22 04:29:34.102388 ip-10-0-141-238 kubenswrapper[2563]: W0722 04:29:34.102362    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod98b94e3b_ba94_4d1f_925c_3aaeefe1a4dd.slice/crio-53119a251cc9958fabde1f883faf35759b6d1ced8c310eb4975d65fbda8825e2 WatchSource:0}: Error finding container 53119a251cc9958fabde1f883faf35759b6d1ced8c310eb4975d65fbda8825e2: Status 404 returned error can't find the container with id 53119a251cc9958fabde1f883faf35759b6d1ced8c310eb4975d65fbda8825e2
Jul 22 04:29:34.634652 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:29:34.634615    2563 patch_prober.go:28] interesting pod/image-registry-57d6d8f867-t2t9g container/registry namespace/openshift-image-registry: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]}
Jul 22 04:29:34.635082 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:29:34.634675    2563 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-image-registry/image-registry-57d6d8f867-t2t9g" podUID="d51e1b57-de0a-425b-8a3f-ad8449c0845c" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 22 04:29:34.919334 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:29:34.919294    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-864456df47-qjd4f" event={"ID":"98b94e3b-ba94-4d1f-925c-3aaeefe1a4dd","Type":"ContainerStarted","Data":"41142e41453f603d5759ce8470eb0a6565d6c8d4f9d02fe65837d35b8c0f928d"}
Jul 22 04:29:34.919540 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:29:34.919359    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-864456df47-qjd4f" event={"ID":"98b94e3b-ba94-4d1f-925c-3aaeefe1a4dd","Type":"ContainerStarted","Data":"53119a251cc9958fabde1f883faf35759b6d1ced8c310eb4975d65fbda8825e2"}
Jul 22 04:29:34.936912 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:29:34.936863    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-864456df47-qjd4f" podStartSLOduration=1.936848388 podStartE2EDuration="1.936848388s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 04:29:33 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 04:29:34.935704757 +0000 UTC m=+290.354713713" watchObservedRunningTime="2026-07-22 04:29:34.936848388 +0000 UTC m=+290.355857146"
Jul 22 04:29:35.483962 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:29:35.483919    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j9gvx_b4af3ae5-fa65-4358-8399-6ed11b68616e/konnectivity-agent/0.log" limit=1024
Jul 22 04:29:35.584823 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:29:35.584790    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j9gvx_b4af3ae5-fa65-4358-8399-6ed11b68616e/konnectivity-agent/0.log" limit=1024
Jul 22 04:29:35.686175 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:29:35.686107    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j9gvx_b4af3ae5-fa65-4358-8399-6ed11b68616e/konnectivity-agent/0.log" limit=1024
Jul 22 04:29:35.787086 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:29:35.786973    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j9gvx_b4af3ae5-fa65-4358-8399-6ed11b68616e/konnectivity-agent/0.log" limit=1024
Jul 22 04:29:36.038285 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:29:36.038199    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j9gvx_b4af3ae5-fa65-4358-8399-6ed11b68616e/konnectivity-agent/0.log" limit=1024
Jul 22 04:29:36.095412 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:29:36.095373    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j9gvx_b4af3ae5-fa65-4358-8399-6ed11b68616e/konnectivity-agent/0.log" limit=1024
Jul 22 04:29:37.133052 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:29:37.133015    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j9gvx_b4af3ae5-fa65-4358-8399-6ed11b68616e/konnectivity-agent/0.log" limit=1024
Jul 22 04:29:37.185505 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:29:37.185471    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j9gvx_b4af3ae5-fa65-4358-8399-6ed11b68616e/konnectivity-agent/0.log" limit=1024
Jul 22 04:29:37.278703 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:29:37.278660    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j9gvx_b4af3ae5-fa65-4358-8399-6ed11b68616e/konnectivity-agent/0.log" limit=1024
Jul 22 04:29:37.329283 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:29:37.329246    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j9gvx_b4af3ae5-fa65-4358-8399-6ed11b68616e/konnectivity-agent/0.log" limit=1024
Jul 22 04:29:38.061902 ip-10-0-141-238 kubenswrapper[2563]: E0722 04:29:38.061863    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-certs], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-multus/network-metrics-daemon-2k7fd" podUID="3e22b9bf-95f2-4186-a5a7-2f1d21feb8b1"
Jul 22 04:29:39.654871 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:29:39.654828    2563 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-image-registry/image-registry-57d6d8f867-t2t9g" podUID="d51e1b57-de0a-425b-8a3f-ad8449c0845c" containerName="registry" containerID="cri-o://367837aedb0f895a4236a40f0057605906b0da1d22ea8b9c0425fd9c79b7795b" gracePeriod=30
Jul 22 04:29:39.937774 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:29:39.937695    2563 generic.go:356] "Generic (PLEG): container finished" podID="d51e1b57-de0a-425b-8a3f-ad8449c0845c" containerID="367837aedb0f895a4236a40f0057605906b0da1d22ea8b9c0425fd9c79b7795b" exitCode=0
Jul 22 04:29:39.937903 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:29:39.937772    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-57d6d8f867-t2t9g" event={"ID":"d51e1b57-de0a-425b-8a3f-ad8449c0845c","Type":"ContainerDied","Data":"367837aedb0f895a4236a40f0057605906b0da1d22ea8b9c0425fd9c79b7795b"}
Jul 22 04:29:39.937903 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:29:39.937821    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-57d6d8f867-t2t9g" event={"ID":"d51e1b57-de0a-425b-8a3f-ad8449c0845c","Type":"ContainerDied","Data":"0465a62da5040a70523fb3333b9fbcf7e02d55e05f1b1c915bd5d057d03d657a"}
Jul 22 04:29:39.937903 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:29:39.937836    2563 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="0465a62da5040a70523fb3333b9fbcf7e02d55e05f1b1c915bd5d057d03d657a"
Jul 22 04:29:39.940647 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:29:39.940626    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-57d6d8f867-t2t9g"
Jul 22 04:29:40.018946 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:29:40.018915    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/d51e1b57-de0a-425b-8a3f-ad8449c0845c-trusted-ca\") pod \"d51e1b57-de0a-425b-8a3f-ad8449c0845c\" (UID: \"d51e1b57-de0a-425b-8a3f-ad8449c0845c\") "
Jul 22 04:29:40.019146 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:29:40.018966    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/d51e1b57-de0a-425b-8a3f-ad8449c0845c-image-registry-private-configuration\") pod \"d51e1b57-de0a-425b-8a3f-ad8449c0845c\" (UID: \"d51e1b57-de0a-425b-8a3f-ad8449c0845c\") "
Jul 22 04:29:40.019146 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:29:40.018985    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-h9q2j\" (UniqueName: \"kubernetes.io/projected/d51e1b57-de0a-425b-8a3f-ad8449c0845c-kube-api-access-h9q2j\") pod \"d51e1b57-de0a-425b-8a3f-ad8449c0845c\" (UID: \"d51e1b57-de0a-425b-8a3f-ad8449c0845c\") "
Jul 22 04:29:40.019146 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:29:40.019024    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/d51e1b57-de0a-425b-8a3f-ad8449c0845c-registry-tls\") pod \"d51e1b57-de0a-425b-8a3f-ad8449c0845c\" (UID: \"d51e1b57-de0a-425b-8a3f-ad8449c0845c\") "
Jul 22 04:29:40.019146 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:29:40.019081    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/d51e1b57-de0a-425b-8a3f-ad8449c0845c-ca-trust-extracted\") pod \"d51e1b57-de0a-425b-8a3f-ad8449c0845c\" (UID: \"d51e1b57-de0a-425b-8a3f-ad8449c0845c\") "
Jul 22 04:29:40.019146 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:29:40.019104    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/d51e1b57-de0a-425b-8a3f-ad8449c0845c-bound-sa-token\") pod \"d51e1b57-de0a-425b-8a3f-ad8449c0845c\" (UID: \"d51e1b57-de0a-425b-8a3f-ad8449c0845c\") "
Jul 22 04:29:40.019394 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:29:40.019154    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/d51e1b57-de0a-425b-8a3f-ad8449c0845c-installation-pull-secrets\") pod \"d51e1b57-de0a-425b-8a3f-ad8449c0845c\" (UID: \"d51e1b57-de0a-425b-8a3f-ad8449c0845c\") "
Jul 22 04:29:40.019394 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:29:40.019181    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/d51e1b57-de0a-425b-8a3f-ad8449c0845c-registry-certificates\") pod \"d51e1b57-de0a-425b-8a3f-ad8449c0845c\" (UID: \"d51e1b57-de0a-425b-8a3f-ad8449c0845c\") "
Jul 22 04:29:40.019560 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:29:40.019513    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d51e1b57-de0a-425b-8a3f-ad8449c0845c-trusted-ca" (OuterVolumeSpecName: "trusted-ca") pod "d51e1b57-de0a-425b-8a3f-ad8449c0845c" (UID: "d51e1b57-de0a-425b-8a3f-ad8449c0845c"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 22 04:29:40.019814 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:29:40.019793    2563 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/d51e1b57-de0a-425b-8a3f-ad8449c0845c-trusted-ca\") on node \"ip-10-0-141-238.ec2.internal\" DevicePath \"\""
Jul 22 04:29:40.020075 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:29:40.020031    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d51e1b57-de0a-425b-8a3f-ad8449c0845c-registry-certificates" (OuterVolumeSpecName: "registry-certificates") pod "d51e1b57-de0a-425b-8a3f-ad8449c0845c" (UID: "d51e1b57-de0a-425b-8a3f-ad8449c0845c"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 22 04:29:40.021612 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:29:40.021572    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d51e1b57-de0a-425b-8a3f-ad8449c0845c-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "d51e1b57-de0a-425b-8a3f-ad8449c0845c" (UID: "d51e1b57-de0a-425b-8a3f-ad8449c0845c"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 22 04:29:40.021612 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:29:40.021598    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d51e1b57-de0a-425b-8a3f-ad8449c0845c-kube-api-access-h9q2j" (OuterVolumeSpecName: "kube-api-access-h9q2j") pod "d51e1b57-de0a-425b-8a3f-ad8449c0845c" (UID: "d51e1b57-de0a-425b-8a3f-ad8449c0845c"). InnerVolumeSpecName "kube-api-access-h9q2j". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 22 04:29:40.021760 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:29:40.021692    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d51e1b57-de0a-425b-8a3f-ad8449c0845c-bound-sa-token" (OuterVolumeSpecName: "bound-sa-token") pod "d51e1b57-de0a-425b-8a3f-ad8449c0845c" (UID: "d51e1b57-de0a-425b-8a3f-ad8449c0845c"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 22 04:29:40.021760 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:29:40.021748    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d51e1b57-de0a-425b-8a3f-ad8449c0845c-image-registry-private-configuration" (OuterVolumeSpecName: "image-registry-private-configuration") pod "d51e1b57-de0a-425b-8a3f-ad8449c0845c" (UID: "d51e1b57-de0a-425b-8a3f-ad8449c0845c"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 22 04:29:40.022201 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:29:40.022177    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d51e1b57-de0a-425b-8a3f-ad8449c0845c-installation-pull-secrets" (OuterVolumeSpecName: "installation-pull-secrets") pod "d51e1b57-de0a-425b-8a3f-ad8449c0845c" (UID: "d51e1b57-de0a-425b-8a3f-ad8449c0845c"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 22 04:29:40.028271 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:29:40.028244    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d51e1b57-de0a-425b-8a3f-ad8449c0845c-ca-trust-extracted" (OuterVolumeSpecName: "ca-trust-extracted") pod "d51e1b57-de0a-425b-8a3f-ad8449c0845c" (UID: "d51e1b57-de0a-425b-8a3f-ad8449c0845c"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 22 04:29:40.121247 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:29:40.121211    2563 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/d51e1b57-de0a-425b-8a3f-ad8449c0845c-image-registry-private-configuration\") on node \"ip-10-0-141-238.ec2.internal\" DevicePath \"\""
Jul 22 04:29:40.121247 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:29:40.121244    2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-h9q2j\" (UniqueName: \"kubernetes.io/projected/d51e1b57-de0a-425b-8a3f-ad8449c0845c-kube-api-access-h9q2j\") on node \"ip-10-0-141-238.ec2.internal\" DevicePath \"\""
Jul 22 04:29:40.121247 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:29:40.121256    2563 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/d51e1b57-de0a-425b-8a3f-ad8449c0845c-registry-tls\") on node \"ip-10-0-141-238.ec2.internal\" DevicePath \"\""
Jul 22 04:29:40.121533 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:29:40.121266    2563 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/d51e1b57-de0a-425b-8a3f-ad8449c0845c-ca-trust-extracted\") on node \"ip-10-0-141-238.ec2.internal\" DevicePath \"\""
Jul 22 04:29:40.121533 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:29:40.121275    2563 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/d51e1b57-de0a-425b-8a3f-ad8449c0845c-bound-sa-token\") on node \"ip-10-0-141-238.ec2.internal\" DevicePath \"\""
Jul 22 04:29:40.121533 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:29:40.121284    2563 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/d51e1b57-de0a-425b-8a3f-ad8449c0845c-installation-pull-secrets\") on node \"ip-10-0-141-238.ec2.internal\" DevicePath \"\""
Jul 22 04:29:40.121533 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:29:40.121293    2563 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/d51e1b57-de0a-425b-8a3f-ad8449c0845c-registry-certificates\") on node \"ip-10-0-141-238.ec2.internal\" DevicePath \"\""
Jul 22 04:29:40.122434 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:29:40.122408    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j9gvx_b4af3ae5-fa65-4358-8399-6ed11b68616e/konnectivity-agent/0.log" limit=1024
Jul 22 04:29:40.941588 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:29:40.941557    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-57d6d8f867-t2t9g"
Jul 22 04:29:40.964176 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:29:40.964149    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-57d6d8f867-t2t9g"]
Jul 22 04:29:40.972275 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:29:40.972246    2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-57d6d8f867-t2t9g"]
Jul 22 04:29:41.066742 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:29:41.066709    2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d51e1b57-de0a-425b-8a3f-ad8449c0845c" path="/var/lib/kubelet/pods/d51e1b57-de0a-425b-8a3f-ad8449c0845c/volumes"
Jul 22 04:29:41.234284 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:29:41.234199    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j9gvx_b4af3ae5-fa65-4358-8399-6ed11b68616e/konnectivity-agent/0.log" limit=1024
Jul 22 04:29:41.912292 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:29:41.912264    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-rs8lw"
Jul 22 04:29:43.194874 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:29:43.194840    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j9gvx_b4af3ae5-fa65-4358-8399-6ed11b68616e/konnectivity-agent/0.log" limit=1024
Jul 22 04:29:43.970900 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:29:43.970865    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-864456df47-qjd4f"
Jul 22 04:29:43.971183 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:29:43.970920    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-864456df47-qjd4f"
Jul 22 04:29:43.975510 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:29:43.975488    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-864456df47-qjd4f"
Jul 22 04:29:44.900892 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:29:44.900860    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-gw4km_67c7210c-7cfa-4865-bce3-777fbb6f3cea/console-operator/1.log"
Jul 22 04:29:44.901967 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:29:44.901941    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-gw4km_67c7210c-7cfa-4865-bce3-777fbb6f3cea/console-operator/1.log"
Jul 22 04:29:44.912102 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:29:44.912082    2563 kubelet.go:1648] "Image garbage collection succeeded"
Jul 22 04:29:44.963213 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:29:44.963180    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-864456df47-qjd4f"
Jul 22 04:29:45.107399 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:29:45.107362    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j9gvx_b4af3ae5-fa65-4358-8399-6ed11b68616e/konnectivity-agent/0.log" limit=1024
Jul 22 04:29:45.163671 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:29:45.163638    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j9gvx_b4af3ae5-fa65-4358-8399-6ed11b68616e/konnectivity-agent/0.log" limit=1024
Jul 22 04:29:45.768496 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:29:45.768459    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j9gvx_b4af3ae5-fa65-4358-8399-6ed11b68616e/konnectivity-agent/0.log" limit=1024
Jul 22 04:29:45.870057 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:29:45.870007    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j9gvx_b4af3ae5-fa65-4358-8399-6ed11b68616e/konnectivity-agent/0.log" limit=1024
Jul 22 04:29:46.771351 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:29:46.771320    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j9gvx_b4af3ae5-fa65-4358-8399-6ed11b68616e/konnectivity-agent/0.log" limit=1024
Jul 22 04:29:46.826499 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:29:46.826463    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j9gvx_b4af3ae5-fa65-4358-8399-6ed11b68616e/konnectivity-agent/0.log" limit=1024
Jul 22 04:29:51.059620 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:29:51.059585    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2k7fd"
Jul 22 04:29:52.940621 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:29:52.940583    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j9gvx_b4af3ae5-fa65-4358-8399-6ed11b68616e/konnectivity-agent/0.log" limit=1024
Jul 22 04:29:53.040419 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:29:53.040375    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j9gvx_b4af3ae5-fa65-4358-8399-6ed11b68616e/konnectivity-agent/0.log" limit=1024
Jul 22 04:29:55.118468 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:29:55.118433    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j9gvx_b4af3ae5-fa65-4358-8399-6ed11b68616e/konnectivity-agent/0.log" limit=1024
Jul 22 04:29:55.170941 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:29:55.170910    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j9gvx_b4af3ae5-fa65-4358-8399-6ed11b68616e/konnectivity-agent/0.log" limit=1024
Jul 22 04:29:55.845907 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:29:55.845872    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j9gvx_b4af3ae5-fa65-4358-8399-6ed11b68616e/konnectivity-agent/0.log" limit=1024
Jul 22 04:29:55.947120 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:29:55.947085    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j9gvx_b4af3ae5-fa65-4358-8399-6ed11b68616e/konnectivity-agent/0.log" limit=1024
Jul 22 04:29:58.617936 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:29:58.617888    2563 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-59b59cdd78-6rgw5" podUID="3d096334-e219-40c4-8a7f-316cd0b51127" containerName="console" containerID="cri-o://fb145321c02cb3e255e57b3e93287de519122b1f893b03a8111c0c94ec219217" gracePeriod=15
Jul 22 04:29:58.863055 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:29:58.863017    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-59b59cdd78-6rgw5"
Jul 22 04:29:58.874494 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:29:58.874448    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/3d096334-e219-40c4-8a7f-316cd0b51127-console-serving-cert\") pod \"3d096334-e219-40c4-8a7f-316cd0b51127\" (UID: \"3d096334-e219-40c4-8a7f-316cd0b51127\") "
Jul 22 04:29:58.874584 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:29:58.874498    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-gfnbz\" (UniqueName: \"kubernetes.io/projected/3d096334-e219-40c4-8a7f-316cd0b51127-kube-api-access-gfnbz\") pod \"3d096334-e219-40c4-8a7f-316cd0b51127\" (UID: \"3d096334-e219-40c4-8a7f-316cd0b51127\") "
Jul 22 04:29:58.874584 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:29:58.874557    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/3d096334-e219-40c4-8a7f-316cd0b51127-oauth-serving-cert\") pod \"3d096334-e219-40c4-8a7f-316cd0b51127\" (UID: \"3d096334-e219-40c4-8a7f-316cd0b51127\") "
Jul 22 04:29:58.874584 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:29:58.874575    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/3d096334-e219-40c4-8a7f-316cd0b51127-console-oauth-config\") pod \"3d096334-e219-40c4-8a7f-316cd0b51127\" (UID: \"3d096334-e219-40c4-8a7f-316cd0b51127\") "
Jul 22 04:29:58.874727 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:29:58.874595    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/3d096334-e219-40c4-8a7f-316cd0b51127-service-ca\") pod \"3d096334-e219-40c4-8a7f-316cd0b51127\" (UID: \"3d096334-e219-40c4-8a7f-316cd0b51127\") "
Jul 22 04:29:58.874727 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:29:58.874618    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/3d096334-e219-40c4-8a7f-316cd0b51127-console-config\") pod \"3d096334-e219-40c4-8a7f-316cd0b51127\" (UID: \"3d096334-e219-40c4-8a7f-316cd0b51127\") "
Jul 22 04:29:58.875023 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:29:58.874994    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3d096334-e219-40c4-8a7f-316cd0b51127-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "3d096334-e219-40c4-8a7f-316cd0b51127" (UID: "3d096334-e219-40c4-8a7f-316cd0b51127"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 22 04:29:58.875143 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:29:58.875023    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3d096334-e219-40c4-8a7f-316cd0b51127-service-ca" (OuterVolumeSpecName: "service-ca") pod "3d096334-e219-40c4-8a7f-316cd0b51127" (UID: "3d096334-e219-40c4-8a7f-316cd0b51127"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 22 04:29:58.875198 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:29:58.875149    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3d096334-e219-40c4-8a7f-316cd0b51127-console-config" (OuterVolumeSpecName: "console-config") pod "3d096334-e219-40c4-8a7f-316cd0b51127" (UID: "3d096334-e219-40c4-8a7f-316cd0b51127"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 22 04:29:58.876726 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:29:58.876698    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3d096334-e219-40c4-8a7f-316cd0b51127-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "3d096334-e219-40c4-8a7f-316cd0b51127" (UID: "3d096334-e219-40c4-8a7f-316cd0b51127"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 22 04:29:58.876768 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:29:58.876747    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3d096334-e219-40c4-8a7f-316cd0b51127-kube-api-access-gfnbz" (OuterVolumeSpecName: "kube-api-access-gfnbz") pod "3d096334-e219-40c4-8a7f-316cd0b51127" (UID: "3d096334-e219-40c4-8a7f-316cd0b51127"). InnerVolumeSpecName "kube-api-access-gfnbz". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 22 04:29:58.876768 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:29:58.876745    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3d096334-e219-40c4-8a7f-316cd0b51127-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "3d096334-e219-40c4-8a7f-316cd0b51127" (UID: "3d096334-e219-40c4-8a7f-316cd0b51127"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 22 04:29:58.975287 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:29:58.975237    2563 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/3d096334-e219-40c4-8a7f-316cd0b51127-oauth-serving-cert\") on node \"ip-10-0-141-238.ec2.internal\" DevicePath \"\""
Jul 22 04:29:58.975287 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:29:58.975279    2563 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/3d096334-e219-40c4-8a7f-316cd0b51127-console-oauth-config\") on node \"ip-10-0-141-238.ec2.internal\" DevicePath \"\""
Jul 22 04:29:58.975287 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:29:58.975289    2563 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/3d096334-e219-40c4-8a7f-316cd0b51127-service-ca\") on node \"ip-10-0-141-238.ec2.internal\" DevicePath \"\""
Jul 22 04:29:58.975287 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:29:58.975298    2563 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/3d096334-e219-40c4-8a7f-316cd0b51127-console-config\") on node \"ip-10-0-141-238.ec2.internal\" DevicePath \"\""
Jul 22 04:29:58.975287 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:29:58.975306    2563 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/3d096334-e219-40c4-8a7f-316cd0b51127-console-serving-cert\") on node \"ip-10-0-141-238.ec2.internal\" DevicePath \"\""
Jul 22 04:29:58.975579 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:29:58.975315    2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-gfnbz\" (UniqueName: \"kubernetes.io/projected/3d096334-e219-40c4-8a7f-316cd0b51127-kube-api-access-gfnbz\") on node \"ip-10-0-141-238.ec2.internal\" DevicePath \"\""
Jul 22 04:29:59.010358 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:29:59.010328    2563 generic.go:356] "Generic (PLEG): container finished" podID="3d096334-e219-40c4-8a7f-316cd0b51127" containerID="fb145321c02cb3e255e57b3e93287de519122b1f893b03a8111c0c94ec219217" exitCode=0
Jul 22 04:29:59.010498 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:29:59.010373    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-59b59cdd78-6rgw5"
Jul 22 04:29:59.010498 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:29:59.010373    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-59b59cdd78-6rgw5" event={"ID":"3d096334-e219-40c4-8a7f-316cd0b51127","Type":"ContainerDied","Data":"fb145321c02cb3e255e57b3e93287de519122b1f893b03a8111c0c94ec219217"}
Jul 22 04:29:59.010577 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:29:59.010502    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-59b59cdd78-6rgw5" event={"ID":"3d096334-e219-40c4-8a7f-316cd0b51127","Type":"ContainerDied","Data":"ef7cc56ff0a051e3df85916d94a34df452781904c493f01b0972496a08a030f5"}
Jul 22 04:29:59.010577 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:29:59.010530    2563 scope.go:117] "RemoveContainer" containerID="fb145321c02cb3e255e57b3e93287de519122b1f893b03a8111c0c94ec219217"
Jul 22 04:29:59.018795 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:29:59.018780    2563 scope.go:117] "RemoveContainer" containerID="fb145321c02cb3e255e57b3e93287de519122b1f893b03a8111c0c94ec219217"
Jul 22 04:29:59.019032 ip-10-0-141-238 kubenswrapper[2563]: E0722 04:29:59.019011    2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"fb145321c02cb3e255e57b3e93287de519122b1f893b03a8111c0c94ec219217\": container with ID starting with fb145321c02cb3e255e57b3e93287de519122b1f893b03a8111c0c94ec219217 not found: ID does not exist" containerID="fb145321c02cb3e255e57b3e93287de519122b1f893b03a8111c0c94ec219217"
Jul 22 04:29:59.019106 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:29:59.019058    2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"fb145321c02cb3e255e57b3e93287de519122b1f893b03a8111c0c94ec219217"} err="failed to get container status \"fb145321c02cb3e255e57b3e93287de519122b1f893b03a8111c0c94ec219217\": rpc error: code = NotFound desc = could not find container \"fb145321c02cb3e255e57b3e93287de519122b1f893b03a8111c0c94ec219217\": container with ID starting with fb145321c02cb3e255e57b3e93287de519122b1f893b03a8111c0c94ec219217 not found: ID does not exist"
Jul 22 04:29:59.030083 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:29:59.030058    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-59b59cdd78-6rgw5"]
Jul 22 04:29:59.037245 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:29:59.037223    2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-59b59cdd78-6rgw5"]
Jul 22 04:29:59.064547 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:29:59.064523    2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="3d096334-e219-40c4-8a7f-316cd0b51127" path="/var/lib/kubelet/pods/3d096334-e219-40c4-8a7f-316cd0b51127/volumes"
Jul 22 04:30:10.121726 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:30:10.121685    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j9gvx_b4af3ae5-fa65-4358-8399-6ed11b68616e/konnectivity-agent/0.log" limit=1024
Jul 22 04:30:10.175220 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:30:10.175189    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j9gvx_b4af3ae5-fa65-4358-8399-6ed11b68616e/konnectivity-agent/0.log" limit=1024
Jul 22 04:30:15.078011 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:30:15.077974    2563 generic.go:356] "Generic (PLEG): container finished" podID="5b58e75a-c8cd-4d8b-bfba-e2e9810b994b" containerID="e7a3ce19ae938e7d6043b2096078cb65071f1e2272b58501b204e6d7a55978ab" exitCode=0
Jul 22 04:30:15.078396 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:30:15.078065    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-555d9d7885-kmxdh" event={"ID":"5b58e75a-c8cd-4d8b-bfba-e2e9810b994b","Type":"ContainerDied","Data":"e7a3ce19ae938e7d6043b2096078cb65071f1e2272b58501b204e6d7a55978ab"}
Jul 22 04:30:15.078396 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:30:15.078364    2563 scope.go:117] "RemoveContainer" containerID="e7a3ce19ae938e7d6043b2096078cb65071f1e2272b58501b204e6d7a55978ab"
Jul 22 04:30:16.082798 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:30:16.082765    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-555d9d7885-kmxdh" event={"ID":"5b58e75a-c8cd-4d8b-bfba-e2e9810b994b","Type":"ContainerStarted","Data":"a9344dbefeb2b62fd3a82bf4ed2afd8f007c182b6cefb7a17fe7c2694b7488bf"}
Jul 22 04:30:25.121427 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:30:25.121392    2563 generic.go:356] "Generic (PLEG): container finished" podID="6f3fb07b-006b-4a37-8f24-e1be8c89eeb1" containerID="48c4ecb337419a97fd4b3437cb6979d868b587fb5c6736b17f47e5a48ee0d70e" exitCode=0
Jul 22 04:30:25.121862 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:30:25.121464    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-6tkm8" event={"ID":"6f3fb07b-006b-4a37-8f24-e1be8c89eeb1","Type":"ContainerDied","Data":"48c4ecb337419a97fd4b3437cb6979d868b587fb5c6736b17f47e5a48ee0d70e"}
Jul 22 04:30:25.121862 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:30:25.121783    2563 scope.go:117] "RemoveContainer" containerID="48c4ecb337419a97fd4b3437cb6979d868b587fb5c6736b17f47e5a48ee0d70e"
Jul 22 04:30:26.127718 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:30:26.127686    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-6tkm8" event={"ID":"6f3fb07b-006b-4a37-8f24-e1be8c89eeb1","Type":"ContainerStarted","Data":"683e98e23a77b57ef748eee1706e8e34a157e525bdf2566a91bceee3b5350699"}
Jul 22 04:30:42.447810 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:30:42.447709    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j9gvx_b4af3ae5-fa65-4358-8399-6ed11b68616e/konnectivity-agent/0.log" limit=1024
Jul 22 04:30:42.750343 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:30:42.750251    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j9gvx_b4af3ae5-fa65-4358-8399-6ed11b68616e/konnectivity-agent/0.log" limit=1024
Jul 22 04:30:43.558483 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:30:43.558450    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Jul 22 04:30:43.558883 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:30:43.558722    2563 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="9dcd1a9e-6c89-49c7-b2df-375e7e373b49" containerName="alertmanager" containerID="cri-o://fc86eca96e36bee4326aad5dd8659a1ff24b8068756021b3038b6720e67bfbf7" gracePeriod=120
Jul 22 04:30:43.558883 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:30:43.558801    2563 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="9dcd1a9e-6c89-49c7-b2df-375e7e373b49" containerName="kube-rbac-proxy-web" containerID="cri-o://5e077e4456595a4b49f0a4b75cbefe8c44083445555165a160290ab1a8d7af6c" gracePeriod=120
Jul 22 04:30:43.558883 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:30:43.558814    2563 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="9dcd1a9e-6c89-49c7-b2df-375e7e373b49" containerName="kube-rbac-proxy-metric" containerID="cri-o://c423a9e09ae5be47abe5b92bfe6818161aa937728a31a2debc802cfc051892c7" gracePeriod=120
Jul 22 04:30:43.559078 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:30:43.558864    2563 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="9dcd1a9e-6c89-49c7-b2df-375e7e373b49" containerName="config-reloader" containerID="cri-o://4f213ee20039982a3fe9d5989db4b8dddeeba8a8288043e1bdc8de279cdf2bf4" gracePeriod=120
Jul 22 04:30:43.559078 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:30:43.558887    2563 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="9dcd1a9e-6c89-49c7-b2df-375e7e373b49" containerName="prom-label-proxy" containerID="cri-o://ab1d0e7f89fb39d357c1d83331892932cdd6bc196cb8d3f737ba77f0ffb183b1" gracePeriod=120
Jul 22 04:30:43.559078 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:30:43.558919    2563 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="9dcd1a9e-6c89-49c7-b2df-375e7e373b49" containerName="kube-rbac-proxy" containerID="cri-o://a486ac66a34ba9bcd79f965bdb101e4a889636d3f9960beb01006ea5399b4401" gracePeriod=120
Jul 22 04:30:44.196544 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:30:44.196513    2563 generic.go:356] "Generic (PLEG): container finished" podID="9dcd1a9e-6c89-49c7-b2df-375e7e373b49" containerID="ab1d0e7f89fb39d357c1d83331892932cdd6bc196cb8d3f737ba77f0ffb183b1" exitCode=0
Jul 22 04:30:44.196544 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:30:44.196537    2563 generic.go:356] "Generic (PLEG): container finished" podID="9dcd1a9e-6c89-49c7-b2df-375e7e373b49" containerID="a486ac66a34ba9bcd79f965bdb101e4a889636d3f9960beb01006ea5399b4401" exitCode=0
Jul 22 04:30:44.196544 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:30:44.196545    2563 generic.go:356] "Generic (PLEG): container finished" podID="9dcd1a9e-6c89-49c7-b2df-375e7e373b49" containerID="4f213ee20039982a3fe9d5989db4b8dddeeba8a8288043e1bdc8de279cdf2bf4" exitCode=0
Jul 22 04:30:44.196544 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:30:44.196552    2563 generic.go:356] "Generic (PLEG): container finished" podID="9dcd1a9e-6c89-49c7-b2df-375e7e373b49" containerID="fc86eca96e36bee4326aad5dd8659a1ff24b8068756021b3038b6720e67bfbf7" exitCode=0
Jul 22 04:30:44.196802 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:30:44.196577    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"9dcd1a9e-6c89-49c7-b2df-375e7e373b49","Type":"ContainerDied","Data":"ab1d0e7f89fb39d357c1d83331892932cdd6bc196cb8d3f737ba77f0ffb183b1"}
Jul 22 04:30:44.196802 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:30:44.196626    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"9dcd1a9e-6c89-49c7-b2df-375e7e373b49","Type":"ContainerDied","Data":"a486ac66a34ba9bcd79f965bdb101e4a889636d3f9960beb01006ea5399b4401"}
Jul 22 04:30:44.196802 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:30:44.196652    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"9dcd1a9e-6c89-49c7-b2df-375e7e373b49","Type":"ContainerDied","Data":"4f213ee20039982a3fe9d5989db4b8dddeeba8a8288043e1bdc8de279cdf2bf4"}
Jul 22 04:30:44.196802 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:30:44.196676    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"9dcd1a9e-6c89-49c7-b2df-375e7e373b49","Type":"ContainerDied","Data":"fc86eca96e36bee4326aad5dd8659a1ff24b8068756021b3038b6720e67bfbf7"}
Jul 22 04:30:44.803454 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:30:44.803431    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Jul 22 04:30:44.865631 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:30:44.865553    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9dcd1a9e-6c89-49c7-b2df-375e7e373b49-alertmanager-trusted-ca-bundle\") pod \"9dcd1a9e-6c89-49c7-b2df-375e7e373b49\" (UID: \"9dcd1a9e-6c89-49c7-b2df-375e7e373b49\") "
Jul 22 04:30:44.865631 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:30:44.865587    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/9dcd1a9e-6c89-49c7-b2df-375e7e373b49-cluster-tls-config\") pod \"9dcd1a9e-6c89-49c7-b2df-375e7e373b49\" (UID: \"9dcd1a9e-6c89-49c7-b2df-375e7e373b49\") "
Jul 22 04:30:44.865631 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:30:44.865603    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/9dcd1a9e-6c89-49c7-b2df-375e7e373b49-secret-alertmanager-kube-rbac-proxy-metric\") pod \"9dcd1a9e-6c89-49c7-b2df-375e7e373b49\" (UID: \"9dcd1a9e-6c89-49c7-b2df-375e7e373b49\") "
Jul 22 04:30:44.865881 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:30:44.865642    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/9dcd1a9e-6c89-49c7-b2df-375e7e373b49-secret-alertmanager-main-tls\") pod \"9dcd1a9e-6c89-49c7-b2df-375e7e373b49\" (UID: \"9dcd1a9e-6c89-49c7-b2df-375e7e373b49\") "
Jul 22 04:30:44.865881 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:30:44.865669    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/9dcd1a9e-6c89-49c7-b2df-375e7e373b49-secret-alertmanager-kube-rbac-proxy\") pod \"9dcd1a9e-6c89-49c7-b2df-375e7e373b49\" (UID: \"9dcd1a9e-6c89-49c7-b2df-375e7e373b49\") "
Jul 22 04:30:44.865881 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:30:44.865695    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/9dcd1a9e-6c89-49c7-b2df-375e7e373b49-tls-assets\") pod \"9dcd1a9e-6c89-49c7-b2df-375e7e373b49\" (UID: \"9dcd1a9e-6c89-49c7-b2df-375e7e373b49\") "
Jul 22 04:30:44.865881 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:30:44.865727    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/9dcd1a9e-6c89-49c7-b2df-375e7e373b49-config-volume\") pod \"9dcd1a9e-6c89-49c7-b2df-375e7e373b49\" (UID: \"9dcd1a9e-6c89-49c7-b2df-375e7e373b49\") "
Jul 22 04:30:44.865881 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:30:44.865755    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/9dcd1a9e-6c89-49c7-b2df-375e7e373b49-secret-alertmanager-kube-rbac-proxy-web\") pod \"9dcd1a9e-6c89-49c7-b2df-375e7e373b49\" (UID: \"9dcd1a9e-6c89-49c7-b2df-375e7e373b49\") "
Jul 22 04:30:44.865881 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:30:44.865804    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/9dcd1a9e-6c89-49c7-b2df-375e7e373b49-config-out\") pod \"9dcd1a9e-6c89-49c7-b2df-375e7e373b49\" (UID: \"9dcd1a9e-6c89-49c7-b2df-375e7e373b49\") "
Jul 22 04:30:44.865881 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:30:44.865833    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/9dcd1a9e-6c89-49c7-b2df-375e7e373b49-alertmanager-main-db\") pod \"9dcd1a9e-6c89-49c7-b2df-375e7e373b49\" (UID: \"9dcd1a9e-6c89-49c7-b2df-375e7e373b49\") "
Jul 22 04:30:44.865881 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:30:44.865870    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-sjhw6\" (UniqueName: \"kubernetes.io/projected/9dcd1a9e-6c89-49c7-b2df-375e7e373b49-kube-api-access-sjhw6\") pod \"9dcd1a9e-6c89-49c7-b2df-375e7e373b49\" (UID: \"9dcd1a9e-6c89-49c7-b2df-375e7e373b49\") "
Jul 22 04:30:44.866317 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:30:44.865918    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/9dcd1a9e-6c89-49c7-b2df-375e7e373b49-web-config\") pod \"9dcd1a9e-6c89-49c7-b2df-375e7e373b49\" (UID: \"9dcd1a9e-6c89-49c7-b2df-375e7e373b49\") "
Jul 22 04:30:44.866317 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:30:44.865981    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9dcd1a9e-6c89-49c7-b2df-375e7e373b49-alertmanager-trusted-ca-bundle" (OuterVolumeSpecName: "alertmanager-trusted-ca-bundle") pod "9dcd1a9e-6c89-49c7-b2df-375e7e373b49" (UID: "9dcd1a9e-6c89-49c7-b2df-375e7e373b49"). InnerVolumeSpecName "alertmanager-trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 22 04:30:44.866317 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:30:44.866192    2563 reconciler_common.go:299] "Volume detached for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9dcd1a9e-6c89-49c7-b2df-375e7e373b49-alertmanager-trusted-ca-bundle\") on node \"ip-10-0-141-238.ec2.internal\" DevicePath \"\""
Jul 22 04:30:44.866811 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:30:44.866553    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9dcd1a9e-6c89-49c7-b2df-375e7e373b49-alertmanager-main-db" (OuterVolumeSpecName: "alertmanager-main-db") pod "9dcd1a9e-6c89-49c7-b2df-375e7e373b49" (UID: "9dcd1a9e-6c89-49c7-b2df-375e7e373b49"). InnerVolumeSpecName "alertmanager-main-db". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 22 04:30:44.868796 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:30:44.868540    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9dcd1a9e-6c89-49c7-b2df-375e7e373b49-secret-alertmanager-kube-rbac-proxy-metric" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy-metric") pod "9dcd1a9e-6c89-49c7-b2df-375e7e373b49" (UID: "9dcd1a9e-6c89-49c7-b2df-375e7e373b49"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy-metric". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 22 04:30:44.868796 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:30:44.868775    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9dcd1a9e-6c89-49c7-b2df-375e7e373b49-secret-alertmanager-main-tls" (OuterVolumeSpecName: "secret-alertmanager-main-tls") pod "9dcd1a9e-6c89-49c7-b2df-375e7e373b49" (UID: "9dcd1a9e-6c89-49c7-b2df-375e7e373b49"). InnerVolumeSpecName "secret-alertmanager-main-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 22 04:30:44.869019 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:30:44.868987    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9dcd1a9e-6c89-49c7-b2df-375e7e373b49-secret-alertmanager-kube-rbac-proxy-web" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy-web") pod "9dcd1a9e-6c89-49c7-b2df-375e7e373b49" (UID: "9dcd1a9e-6c89-49c7-b2df-375e7e373b49"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy-web". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 22 04:30:44.869191 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:30:44.869166    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9dcd1a9e-6c89-49c7-b2df-375e7e373b49-secret-alertmanager-kube-rbac-proxy" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy") pod "9dcd1a9e-6c89-49c7-b2df-375e7e373b49" (UID: "9dcd1a9e-6c89-49c7-b2df-375e7e373b49"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 22 04:30:44.869430 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:30:44.869405    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9dcd1a9e-6c89-49c7-b2df-375e7e373b49-config-out" (OuterVolumeSpecName: "config-out") pod "9dcd1a9e-6c89-49c7-b2df-375e7e373b49" (UID: "9dcd1a9e-6c89-49c7-b2df-375e7e373b49"). InnerVolumeSpecName "config-out". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 22 04:30:44.870018 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:30:44.869992    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9dcd1a9e-6c89-49c7-b2df-375e7e373b49-tls-assets" (OuterVolumeSpecName: "tls-assets") pod "9dcd1a9e-6c89-49c7-b2df-375e7e373b49" (UID: "9dcd1a9e-6c89-49c7-b2df-375e7e373b49"). InnerVolumeSpecName "tls-assets". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 22 04:30:44.870807 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:30:44.870781    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9dcd1a9e-6c89-49c7-b2df-375e7e373b49-config-volume" (OuterVolumeSpecName: "config-volume") pod "9dcd1a9e-6c89-49c7-b2df-375e7e373b49" (UID: "9dcd1a9e-6c89-49c7-b2df-375e7e373b49"). InnerVolumeSpecName "config-volume". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 22 04:30:44.871182 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:30:44.871158    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9dcd1a9e-6c89-49c7-b2df-375e7e373b49-kube-api-access-sjhw6" (OuterVolumeSpecName: "kube-api-access-sjhw6") pod "9dcd1a9e-6c89-49c7-b2df-375e7e373b49" (UID: "9dcd1a9e-6c89-49c7-b2df-375e7e373b49"). InnerVolumeSpecName "kube-api-access-sjhw6". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 22 04:30:44.872448 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:30:44.872420    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9dcd1a9e-6c89-49c7-b2df-375e7e373b49-cluster-tls-config" (OuterVolumeSpecName: "cluster-tls-config") pod "9dcd1a9e-6c89-49c7-b2df-375e7e373b49" (UID: "9dcd1a9e-6c89-49c7-b2df-375e7e373b49"). InnerVolumeSpecName "cluster-tls-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 22 04:30:44.879464 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:30:44.879441    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9dcd1a9e-6c89-49c7-b2df-375e7e373b49-web-config" (OuterVolumeSpecName: "web-config") pod "9dcd1a9e-6c89-49c7-b2df-375e7e373b49" (UID: "9dcd1a9e-6c89-49c7-b2df-375e7e373b49"). InnerVolumeSpecName "web-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 22 04:30:44.966585 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:30:44.966548    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/9dcd1a9e-6c89-49c7-b2df-375e7e373b49-metrics-client-ca\") pod \"9dcd1a9e-6c89-49c7-b2df-375e7e373b49\" (UID: \"9dcd1a9e-6c89-49c7-b2df-375e7e373b49\") "
Jul 22 04:30:44.966757 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:30:44.966735    2563 reconciler_common.go:299] "Volume detached for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/9dcd1a9e-6c89-49c7-b2df-375e7e373b49-config-volume\") on node \"ip-10-0-141-238.ec2.internal\" DevicePath \"\""
Jul 22 04:30:44.966757 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:30:44.966749    2563 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/9dcd1a9e-6c89-49c7-b2df-375e7e373b49-secret-alertmanager-kube-rbac-proxy-web\") on node \"ip-10-0-141-238.ec2.internal\" DevicePath \"\""
Jul 22 04:30:44.966824 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:30:44.966760    2563 reconciler_common.go:299] "Volume detached for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/9dcd1a9e-6c89-49c7-b2df-375e7e373b49-config-out\") on node \"ip-10-0-141-238.ec2.internal\" DevicePath \"\""
Jul 22 04:30:44.966824 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:30:44.966769    2563 reconciler_common.go:299] "Volume detached for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/9dcd1a9e-6c89-49c7-b2df-375e7e373b49-alertmanager-main-db\") on node \"ip-10-0-141-238.ec2.internal\" DevicePath \"\""
Jul 22 04:30:44.966824 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:30:44.966779    2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-sjhw6\" (UniqueName: \"kubernetes.io/projected/9dcd1a9e-6c89-49c7-b2df-375e7e373b49-kube-api-access-sjhw6\") on node \"ip-10-0-141-238.ec2.internal\" DevicePath \"\""
Jul 22 04:30:44.966824 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:30:44.966787    2563 reconciler_common.go:299] "Volume detached for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/9dcd1a9e-6c89-49c7-b2df-375e7e373b49-web-config\") on node \"ip-10-0-141-238.ec2.internal\" DevicePath \"\""
Jul 22 04:30:44.966824 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:30:44.966795    2563 reconciler_common.go:299] "Volume detached for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/9dcd1a9e-6c89-49c7-b2df-375e7e373b49-cluster-tls-config\") on node \"ip-10-0-141-238.ec2.internal\" DevicePath \"\""
Jul 22 04:30:44.966824 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:30:44.966803    2563 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/9dcd1a9e-6c89-49c7-b2df-375e7e373b49-secret-alertmanager-kube-rbac-proxy-metric\") on node \"ip-10-0-141-238.ec2.internal\" DevicePath \"\""
Jul 22 04:30:44.966824 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:30:44.966812    2563 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/9dcd1a9e-6c89-49c7-b2df-375e7e373b49-secret-alertmanager-main-tls\") on node \"ip-10-0-141-238.ec2.internal\" DevicePath \"\""
Jul 22 04:30:44.966824 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:30:44.966820    2563 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/9dcd1a9e-6c89-49c7-b2df-375e7e373b49-secret-alertmanager-kube-rbac-proxy\") on node \"ip-10-0-141-238.ec2.internal\" DevicePath \"\""
Jul 22 04:30:44.967057 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:30:44.966828    2563 reconciler_common.go:299] "Volume detached for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/9dcd1a9e-6c89-49c7-b2df-375e7e373b49-tls-assets\") on node \"ip-10-0-141-238.ec2.internal\" DevicePath \"\""
Jul 22 04:30:44.967057 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:30:44.966878    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9dcd1a9e-6c89-49c7-b2df-375e7e373b49-metrics-client-ca" (OuterVolumeSpecName: "metrics-client-ca") pod "9dcd1a9e-6c89-49c7-b2df-375e7e373b49" (UID: "9dcd1a9e-6c89-49c7-b2df-375e7e373b49"). InnerVolumeSpecName "metrics-client-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 22 04:30:45.067203 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:30:45.067174    2563 reconciler_common.go:299] "Volume detached for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/9dcd1a9e-6c89-49c7-b2df-375e7e373b49-metrics-client-ca\") on node \"ip-10-0-141-238.ec2.internal\" DevicePath \"\""
Jul 22 04:30:45.203073 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:30:45.203017    2563 generic.go:356] "Generic (PLEG): container finished" podID="9dcd1a9e-6c89-49c7-b2df-375e7e373b49" containerID="c423a9e09ae5be47abe5b92bfe6818161aa937728a31a2debc802cfc051892c7" exitCode=0
Jul 22 04:30:45.203073 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:30:45.203070    2563 generic.go:356] "Generic (PLEG): container finished" podID="9dcd1a9e-6c89-49c7-b2df-375e7e373b49" containerID="5e077e4456595a4b49f0a4b75cbefe8c44083445555165a160290ab1a8d7af6c" exitCode=0
Jul 22 04:30:45.203284 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:30:45.203076    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"9dcd1a9e-6c89-49c7-b2df-375e7e373b49","Type":"ContainerDied","Data":"c423a9e09ae5be47abe5b92bfe6818161aa937728a31a2debc802cfc051892c7"}
Jul 22 04:30:45.203284 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:30:45.203128    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Jul 22 04:30:45.203284 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:30:45.203142    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"9dcd1a9e-6c89-49c7-b2df-375e7e373b49","Type":"ContainerDied","Data":"5e077e4456595a4b49f0a4b75cbefe8c44083445555165a160290ab1a8d7af6c"}
Jul 22 04:30:45.203284 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:30:45.203169    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"9dcd1a9e-6c89-49c7-b2df-375e7e373b49","Type":"ContainerDied","Data":"3aa137f038f297b06e78d7d87dee26cb564e83da4c2fe8a3ba16a6a7d5d786d7"}
Jul 22 04:30:45.203284 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:30:45.203204    2563 scope.go:117] "RemoveContainer" containerID="ab1d0e7f89fb39d357c1d83331892932cdd6bc196cb8d3f737ba77f0ffb183b1"
Jul 22 04:30:45.212256 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:30:45.211550    2563 scope.go:117] "RemoveContainer" containerID="c423a9e09ae5be47abe5b92bfe6818161aa937728a31a2debc802cfc051892c7"
Jul 22 04:30:45.219324 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:30:45.219301    2563 scope.go:117] "RemoveContainer" containerID="a486ac66a34ba9bcd79f965bdb101e4a889636d3f9960beb01006ea5399b4401"
Jul 22 04:30:45.222828 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:30:45.222802    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Jul 22 04:30:45.226462 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:30:45.226440    2563 scope.go:117] "RemoveContainer" containerID="5e077e4456595a4b49f0a4b75cbefe8c44083445555165a160290ab1a8d7af6c"
Jul 22 04:30:45.226621 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:30:45.226599    2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Jul 22 04:30:45.233084 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:30:45.233064    2563 scope.go:117] "RemoveContainer" containerID="4f213ee20039982a3fe9d5989db4b8dddeeba8a8288043e1bdc8de279cdf2bf4"
Jul 22 04:30:45.239653 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:30:45.239635    2563 scope.go:117] "RemoveContainer" containerID="fc86eca96e36bee4326aad5dd8659a1ff24b8068756021b3038b6720e67bfbf7"
Jul 22 04:30:45.246135 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:30:45.246120    2563 scope.go:117] "RemoveContainer" containerID="cfcc0f6a8afb8f9cc68ee6ef3fa46b68f8cc1af78fb8509480e9a59f923190f9"
Jul 22 04:30:45.248974 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:30:45.248954    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Jul 22 04:30:45.249254 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:30:45.249241    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3d096334-e219-40c4-8a7f-316cd0b51127" containerName="console"
Jul 22 04:30:45.249298 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:30:45.249257    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="3d096334-e219-40c4-8a7f-316cd0b51127" containerName="console"
Jul 22 04:30:45.249298 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:30:45.249270    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9dcd1a9e-6c89-49c7-b2df-375e7e373b49" containerName="init-config-reloader"
Jul 22 04:30:45.249298 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:30:45.249278    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="9dcd1a9e-6c89-49c7-b2df-375e7e373b49" containerName="init-config-reloader"
Jul 22 04:30:45.249298 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:30:45.249291    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d51e1b57-de0a-425b-8a3f-ad8449c0845c" containerName="registry"
Jul 22 04:30:45.249298 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:30:45.249299    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="d51e1b57-de0a-425b-8a3f-ad8449c0845c" containerName="registry"
Jul 22 04:30:45.249474 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:30:45.249310    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9dcd1a9e-6c89-49c7-b2df-375e7e373b49" containerName="prom-label-proxy"
Jul 22 04:30:45.249474 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:30:45.249318    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="9dcd1a9e-6c89-49c7-b2df-375e7e373b49" containerName="prom-label-proxy"
Jul 22 04:30:45.249474 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:30:45.249326    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9dcd1a9e-6c89-49c7-b2df-375e7e373b49" containerName="kube-rbac-proxy"
Jul 22 04:30:45.249474 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:30:45.249336    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="9dcd1a9e-6c89-49c7-b2df-375e7e373b49" containerName="kube-rbac-proxy"
Jul 22 04:30:45.249474 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:30:45.249346    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9dcd1a9e-6c89-49c7-b2df-375e7e373b49" containerName="kube-rbac-proxy-web"
Jul 22 04:30:45.249474 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:30:45.249354    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="9dcd1a9e-6c89-49c7-b2df-375e7e373b49" containerName="kube-rbac-proxy-web"
Jul 22 04:30:45.249474 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:30:45.249366    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9dcd1a9e-6c89-49c7-b2df-375e7e373b49" containerName="config-reloader"
Jul 22 04:30:45.249474 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:30:45.249374    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="9dcd1a9e-6c89-49c7-b2df-375e7e373b49" containerName="config-reloader"
Jul 22 04:30:45.249474 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:30:45.249394    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9dcd1a9e-6c89-49c7-b2df-375e7e373b49" containerName="alertmanager"
Jul 22 04:30:45.249474 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:30:45.249402    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="9dcd1a9e-6c89-49c7-b2df-375e7e373b49" containerName="alertmanager"
Jul 22 04:30:45.249474 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:30:45.249413    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9dcd1a9e-6c89-49c7-b2df-375e7e373b49" containerName="kube-rbac-proxy-metric"
Jul 22 04:30:45.249474 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:30:45.249423    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="9dcd1a9e-6c89-49c7-b2df-375e7e373b49" containerName="kube-rbac-proxy-metric"
Jul 22 04:30:45.249804 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:30:45.249521    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="9dcd1a9e-6c89-49c7-b2df-375e7e373b49" containerName="config-reloader"
Jul 22 04:30:45.249804 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:30:45.249533    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="d51e1b57-de0a-425b-8a3f-ad8449c0845c" containerName="registry"
Jul 22 04:30:45.249804 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:30:45.249544    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="9dcd1a9e-6c89-49c7-b2df-375e7e373b49" containerName="kube-rbac-proxy"
Jul 22 04:30:45.249804 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:30:45.249553    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="9dcd1a9e-6c89-49c7-b2df-375e7e373b49" containerName="prom-label-proxy"
Jul 22 04:30:45.249804 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:30:45.249562    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="3d096334-e219-40c4-8a7f-316cd0b51127" containerName="console"
Jul 22 04:30:45.249804 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:30:45.249570    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="9dcd1a9e-6c89-49c7-b2df-375e7e373b49" containerName="kube-rbac-proxy-web"
Jul 22 04:30:45.249804 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:30:45.249580    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="9dcd1a9e-6c89-49c7-b2df-375e7e373b49" containerName="alertmanager"
Jul 22 04:30:45.249804 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:30:45.249588    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="9dcd1a9e-6c89-49c7-b2df-375e7e373b49" containerName="kube-rbac-proxy-metric"
Jul 22 04:30:45.253395 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:30:45.253380    2563 scope.go:117] "RemoveContainer" containerID="ab1d0e7f89fb39d357c1d83331892932cdd6bc196cb8d3f737ba77f0ffb183b1"
Jul 22 04:30:45.253658 ip-10-0-141-238 kubenswrapper[2563]: E0722 04:30:45.253639    2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ab1d0e7f89fb39d357c1d83331892932cdd6bc196cb8d3f737ba77f0ffb183b1\": container with ID starting with ab1d0e7f89fb39d357c1d83331892932cdd6bc196cb8d3f737ba77f0ffb183b1 not found: ID does not exist" containerID="ab1d0e7f89fb39d357c1d83331892932cdd6bc196cb8d3f737ba77f0ffb183b1"
Jul 22 04:30:45.253717 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:30:45.253666    2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ab1d0e7f89fb39d357c1d83331892932cdd6bc196cb8d3f737ba77f0ffb183b1"} err="failed to get container status \"ab1d0e7f89fb39d357c1d83331892932cdd6bc196cb8d3f737ba77f0ffb183b1\": rpc error: code = NotFound desc = could not find container \"ab1d0e7f89fb39d357c1d83331892932cdd6bc196cb8d3f737ba77f0ffb183b1\": container with ID starting with ab1d0e7f89fb39d357c1d83331892932cdd6bc196cb8d3f737ba77f0ffb183b1 not found: ID does not exist"
Jul 22 04:30:45.253717 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:30:45.253684    2563 scope.go:117] "RemoveContainer" containerID="c423a9e09ae5be47abe5b92bfe6818161aa937728a31a2debc802cfc051892c7"
Jul 22 04:30:45.253964 ip-10-0-141-238 kubenswrapper[2563]: E0722 04:30:45.253946    2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c423a9e09ae5be47abe5b92bfe6818161aa937728a31a2debc802cfc051892c7\": container with ID starting with c423a9e09ae5be47abe5b92bfe6818161aa937728a31a2debc802cfc051892c7 not found: ID does not exist" containerID="c423a9e09ae5be47abe5b92bfe6818161aa937728a31a2debc802cfc051892c7"
Jul 22 04:30:45.254005 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:30:45.253970    2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c423a9e09ae5be47abe5b92bfe6818161aa937728a31a2debc802cfc051892c7"} err="failed to get container status \"c423a9e09ae5be47abe5b92bfe6818161aa937728a31a2debc802cfc051892c7\": rpc error: code = NotFound desc = could not find container \"c423a9e09ae5be47abe5b92bfe6818161aa937728a31a2debc802cfc051892c7\": container with ID starting with c423a9e09ae5be47abe5b92bfe6818161aa937728a31a2debc802cfc051892c7 not found: ID does not exist"
Jul 22 04:30:45.254005 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:30:45.253986    2563 scope.go:117] "RemoveContainer" containerID="a486ac66a34ba9bcd79f965bdb101e4a889636d3f9960beb01006ea5399b4401"
Jul 22 04:30:45.254214 ip-10-0-141-238 kubenswrapper[2563]: E0722 04:30:45.254199    2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a486ac66a34ba9bcd79f965bdb101e4a889636d3f9960beb01006ea5399b4401\": container with ID starting with a486ac66a34ba9bcd79f965bdb101e4a889636d3f9960beb01006ea5399b4401 not found: ID does not exist" containerID="a486ac66a34ba9bcd79f965bdb101e4a889636d3f9960beb01006ea5399b4401"
Jul 22 04:30:45.254255 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:30:45.254215    2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a486ac66a34ba9bcd79f965bdb101e4a889636d3f9960beb01006ea5399b4401"} err="failed to get container status \"a486ac66a34ba9bcd79f965bdb101e4a889636d3f9960beb01006ea5399b4401\": rpc error: code = NotFound desc = could not find container \"a486ac66a34ba9bcd79f965bdb101e4a889636d3f9960beb01006ea5399b4401\": container with ID starting with a486ac66a34ba9bcd79f965bdb101e4a889636d3f9960beb01006ea5399b4401 not found: ID does not exist"
Jul 22 04:30:45.254255 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:30:45.254227    2563 scope.go:117] "RemoveContainer" containerID="5e077e4456595a4b49f0a4b75cbefe8c44083445555165a160290ab1a8d7af6c"
Jul 22 04:30:45.254445 ip-10-0-141-238 kubenswrapper[2563]: E0722 04:30:45.254430    2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5e077e4456595a4b49f0a4b75cbefe8c44083445555165a160290ab1a8d7af6c\": container with ID starting with 5e077e4456595a4b49f0a4b75cbefe8c44083445555165a160290ab1a8d7af6c not found: ID does not exist" containerID="5e077e4456595a4b49f0a4b75cbefe8c44083445555165a160290ab1a8d7af6c"
Jul 22 04:30:45.254486 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:30:45.254448    2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5e077e4456595a4b49f0a4b75cbefe8c44083445555165a160290ab1a8d7af6c"} err="failed to get container status \"5e077e4456595a4b49f0a4b75cbefe8c44083445555165a160290ab1a8d7af6c\": rpc error: code = NotFound desc = could not find container \"5e077e4456595a4b49f0a4b75cbefe8c44083445555165a160290ab1a8d7af6c\": container with ID starting with 5e077e4456595a4b49f0a4b75cbefe8c44083445555165a160290ab1a8d7af6c not found: ID does not exist"
Jul 22 04:30:45.254486 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:30:45.254459    2563 scope.go:117] "RemoveContainer" containerID="4f213ee20039982a3fe9d5989db4b8dddeeba8a8288043e1bdc8de279cdf2bf4"
Jul 22 04:30:45.254630 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:30:45.254614    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Jul 22 04:30:45.254718 ip-10-0-141-238 kubenswrapper[2563]: E0722 04:30:45.254693    2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4f213ee20039982a3fe9d5989db4b8dddeeba8a8288043e1bdc8de279cdf2bf4\": container with ID starting with 4f213ee20039982a3fe9d5989db4b8dddeeba8a8288043e1bdc8de279cdf2bf4 not found: ID does not exist" containerID="4f213ee20039982a3fe9d5989db4b8dddeeba8a8288043e1bdc8de279cdf2bf4"
Jul 22 04:30:45.254788 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:30:45.254754    2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4f213ee20039982a3fe9d5989db4b8dddeeba8a8288043e1bdc8de279cdf2bf4"} err="failed to get container status \"4f213ee20039982a3fe9d5989db4b8dddeeba8a8288043e1bdc8de279cdf2bf4\": rpc error: code = NotFound desc = could not find container \"4f213ee20039982a3fe9d5989db4b8dddeeba8a8288043e1bdc8de279cdf2bf4\": container with ID starting with 4f213ee20039982a3fe9d5989db4b8dddeeba8a8288043e1bdc8de279cdf2bf4 not found: ID does not exist"
Jul 22 04:30:45.254788 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:30:45.254787    2563 scope.go:117] "RemoveContainer" containerID="fc86eca96e36bee4326aad5dd8659a1ff24b8068756021b3038b6720e67bfbf7"
Jul 22 04:30:45.255121 ip-10-0-141-238 kubenswrapper[2563]: E0722 04:30:45.255094    2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"fc86eca96e36bee4326aad5dd8659a1ff24b8068756021b3038b6720e67bfbf7\": container with ID starting with fc86eca96e36bee4326aad5dd8659a1ff24b8068756021b3038b6720e67bfbf7 not found: ID does not exist" containerID="fc86eca96e36bee4326aad5dd8659a1ff24b8068756021b3038b6720e67bfbf7"
Jul 22 04:30:45.255200 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:30:45.255130    2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"fc86eca96e36bee4326aad5dd8659a1ff24b8068756021b3038b6720e67bfbf7"} err="failed to get container status \"fc86eca96e36bee4326aad5dd8659a1ff24b8068756021b3038b6720e67bfbf7\": rpc error: code = NotFound desc = could not find container \"fc86eca96e36bee4326aad5dd8659a1ff24b8068756021b3038b6720e67bfbf7\": container with ID starting with fc86eca96e36bee4326aad5dd8659a1ff24b8068756021b3038b6720e67bfbf7 not found: ID does not exist"
Jul 22 04:30:45.255200 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:30:45.255151    2563 scope.go:117] "RemoveContainer" containerID="cfcc0f6a8afb8f9cc68ee6ef3fa46b68f8cc1af78fb8509480e9a59f923190f9"
Jul 22 04:30:45.255443 ip-10-0-141-238 kubenswrapper[2563]: E0722 04:30:45.255415    2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"cfcc0f6a8afb8f9cc68ee6ef3fa46b68f8cc1af78fb8509480e9a59f923190f9\": container with ID starting with cfcc0f6a8afb8f9cc68ee6ef3fa46b68f8cc1af78fb8509480e9a59f923190f9 not found: ID does not exist" containerID="cfcc0f6a8afb8f9cc68ee6ef3fa46b68f8cc1af78fb8509480e9a59f923190f9"
Jul 22 04:30:45.255524 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:30:45.255445    2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"cfcc0f6a8afb8f9cc68ee6ef3fa46b68f8cc1af78fb8509480e9a59f923190f9"} err="failed to get container status \"cfcc0f6a8afb8f9cc68ee6ef3fa46b68f8cc1af78fb8509480e9a59f923190f9\": rpc error: code = NotFound desc = could not find container \"cfcc0f6a8afb8f9cc68ee6ef3fa46b68f8cc1af78fb8509480e9a59f923190f9\": container with ID starting with cfcc0f6a8afb8f9cc68ee6ef3fa46b68f8cc1af78fb8509480e9a59f923190f9 not found: ID does not exist"
Jul 22 04:30:45.255524 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:30:45.255464    2563 scope.go:117] "RemoveContainer" containerID="ab1d0e7f89fb39d357c1d83331892932cdd6bc196cb8d3f737ba77f0ffb183b1"
Jul 22 04:30:45.255720 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:30:45.255701    2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ab1d0e7f89fb39d357c1d83331892932cdd6bc196cb8d3f737ba77f0ffb183b1"} err="failed to get container status \"ab1d0e7f89fb39d357c1d83331892932cdd6bc196cb8d3f737ba77f0ffb183b1\": rpc error: code = NotFound desc = could not find container \"ab1d0e7f89fb39d357c1d83331892932cdd6bc196cb8d3f737ba77f0ffb183b1\": container with ID starting with ab1d0e7f89fb39d357c1d83331892932cdd6bc196cb8d3f737ba77f0ffb183b1 not found: ID does not exist"
Jul 22 04:30:45.255764 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:30:45.255720    2563 scope.go:117] "RemoveContainer" containerID="c423a9e09ae5be47abe5b92bfe6818161aa937728a31a2debc802cfc051892c7"
Jul 22 04:30:45.255946 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:30:45.255925    2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c423a9e09ae5be47abe5b92bfe6818161aa937728a31a2debc802cfc051892c7"} err="failed to get container status \"c423a9e09ae5be47abe5b92bfe6818161aa937728a31a2debc802cfc051892c7\": rpc error: code = NotFound desc = could not find container \"c423a9e09ae5be47abe5b92bfe6818161aa937728a31a2debc802cfc051892c7\": container with ID starting with c423a9e09ae5be47abe5b92bfe6818161aa937728a31a2debc802cfc051892c7 not found: ID does not exist"
Jul 22 04:30:45.256029 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:30:45.255948    2563 scope.go:117] "RemoveContainer" containerID="a486ac66a34ba9bcd79f965bdb101e4a889636d3f9960beb01006ea5399b4401"
Jul 22 04:30:45.256265 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:30:45.256240    2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a486ac66a34ba9bcd79f965bdb101e4a889636d3f9960beb01006ea5399b4401"} err="failed to get container status \"a486ac66a34ba9bcd79f965bdb101e4a889636d3f9960beb01006ea5399b4401\": rpc error: code = NotFound desc = could not find container \"a486ac66a34ba9bcd79f965bdb101e4a889636d3f9960beb01006ea5399b4401\": container with ID starting with a486ac66a34ba9bcd79f965bdb101e4a889636d3f9960beb01006ea5399b4401 not found: ID does not exist"
Jul 22 04:30:45.256345 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:30:45.256268    2563 scope.go:117] "RemoveContainer" containerID="5e077e4456595a4b49f0a4b75cbefe8c44083445555165a160290ab1a8d7af6c"
Jul 22 04:30:45.256497 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:30:45.256480    2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5e077e4456595a4b49f0a4b75cbefe8c44083445555165a160290ab1a8d7af6c"} err="failed to get container status \"5e077e4456595a4b49f0a4b75cbefe8c44083445555165a160290ab1a8d7af6c\": rpc error: code = NotFound desc = could not find container \"5e077e4456595a4b49f0a4b75cbefe8c44083445555165a160290ab1a8d7af6c\": container with ID starting with 5e077e4456595a4b49f0a4b75cbefe8c44083445555165a160290ab1a8d7af6c not found: ID does not exist"
Jul 22 04:30:45.256540 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:30:45.256498    2563 scope.go:117] "RemoveContainer" containerID="4f213ee20039982a3fe9d5989db4b8dddeeba8a8288043e1bdc8de279cdf2bf4"
Jul 22 04:30:45.256685 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:30:45.256667    2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4f213ee20039982a3fe9d5989db4b8dddeeba8a8288043e1bdc8de279cdf2bf4"} err="failed to get container status \"4f213ee20039982a3fe9d5989db4b8dddeeba8a8288043e1bdc8de279cdf2bf4\": rpc error: code = NotFound desc = could not find container \"4f213ee20039982a3fe9d5989db4b8dddeeba8a8288043e1bdc8de279cdf2bf4\": container with ID starting with 4f213ee20039982a3fe9d5989db4b8dddeeba8a8288043e1bdc8de279cdf2bf4 not found: ID does not exist"
Jul 22 04:30:45.256751 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:30:45.256686    2563 scope.go:117] "RemoveContainer" containerID="fc86eca96e36bee4326aad5dd8659a1ff24b8068756021b3038b6720e67bfbf7"
Jul 22 04:30:45.256879 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:30:45.256856    2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"fc86eca96e36bee4326aad5dd8659a1ff24b8068756021b3038b6720e67bfbf7"} err="failed to get container status \"fc86eca96e36bee4326aad5dd8659a1ff24b8068756021b3038b6720e67bfbf7\": rpc error: code = NotFound desc = could not find container \"fc86eca96e36bee4326aad5dd8659a1ff24b8068756021b3038b6720e67bfbf7\": container with ID starting with fc86eca96e36bee4326aad5dd8659a1ff24b8068756021b3038b6720e67bfbf7 not found: ID does not exist"
Jul 22 04:30:45.256939 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:30:45.256881    2563 scope.go:117] "RemoveContainer" containerID="cfcc0f6a8afb8f9cc68ee6ef3fa46b68f8cc1af78fb8509480e9a59f923190f9"
Jul 22 04:30:45.257192 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:30:45.257064    2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"cfcc0f6a8afb8f9cc68ee6ef3fa46b68f8cc1af78fb8509480e9a59f923190f9"} err="failed to get container status \"cfcc0f6a8afb8f9cc68ee6ef3fa46b68f8cc1af78fb8509480e9a59f923190f9\": rpc error: code = NotFound desc = could not find container \"cfcc0f6a8afb8f9cc68ee6ef3fa46b68f8cc1af78fb8509480e9a59f923190f9\": container with ID starting with cfcc0f6a8afb8f9cc68ee6ef3fa46b68f8cc1af78fb8509480e9a59f923190f9 not found: ID does not exist"
Jul 22 04:30:45.257192 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:30:45.257133    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\""
Jul 22 04:30:45.257324 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:30:45.257214    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\""
Jul 22 04:30:45.257324 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:30:45.257233    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\""
Jul 22 04:30:45.257324 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:30:45.257243    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\""
Jul 22 04:30:45.257324 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:30:45.257271    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\""
Jul 22 04:30:45.257324 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:30:45.257291    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\""
Jul 22 04:30:45.257524 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:30:45.257394    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-hnnhh\""
Jul 22 04:30:45.257524 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:30:45.257413    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\""
Jul 22 04:30:45.257776 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:30:45.257760    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\""
Jul 22 04:30:45.263149 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:30:45.263130    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\""
Jul 22 04:30:45.264756 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:30:45.264734    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Jul 22 04:30:45.269539 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:30:45.269517    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/93175b29-47eb-4526-99e3-42499c3517bb-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"93175b29-47eb-4526-99e3-42499c3517bb\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 22 04:30:45.269636 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:30:45.269556    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/93175b29-47eb-4526-99e3-42499c3517bb-web-config\") pod \"alertmanager-main-0\" (UID: \"93175b29-47eb-4526-99e3-42499c3517bb\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 22 04:30:45.269636 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:30:45.269591    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/93175b29-47eb-4526-99e3-42499c3517bb-tls-assets\") pod \"alertmanager-main-0\" (UID: \"93175b29-47eb-4526-99e3-42499c3517bb\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 22 04:30:45.269742 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:30:45.269657    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/93175b29-47eb-4526-99e3-42499c3517bb-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"93175b29-47eb-4526-99e3-42499c3517bb\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 22 04:30:45.269742 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:30:45.269726    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/93175b29-47eb-4526-99e3-42499c3517bb-config-volume\") pod \"alertmanager-main-0\" (UID: \"93175b29-47eb-4526-99e3-42499c3517bb\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 22 04:30:45.269834 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:30:45.269743    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/93175b29-47eb-4526-99e3-42499c3517bb-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"93175b29-47eb-4526-99e3-42499c3517bb\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 22 04:30:45.269834 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:30:45.269759    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/93175b29-47eb-4526-99e3-42499c3517bb-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"93175b29-47eb-4526-99e3-42499c3517bb\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 22 04:30:45.269936 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:30:45.269837    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/93175b29-47eb-4526-99e3-42499c3517bb-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"93175b29-47eb-4526-99e3-42499c3517bb\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 22 04:30:45.269936 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:30:45.269874    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/93175b29-47eb-4526-99e3-42499c3517bb-config-out\") pod \"alertmanager-main-0\" (UID: \"93175b29-47eb-4526-99e3-42499c3517bb\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 22 04:30:45.269936 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:30:45.269899    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/93175b29-47eb-4526-99e3-42499c3517bb-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"93175b29-47eb-4526-99e3-42499c3517bb\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 22 04:30:45.270113 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:30:45.269924    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/93175b29-47eb-4526-99e3-42499c3517bb-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"93175b29-47eb-4526-99e3-42499c3517bb\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 22 04:30:45.270113 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:30:45.269961    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lfg2x\" (UniqueName: \"kubernetes.io/projected/93175b29-47eb-4526-99e3-42499c3517bb-kube-api-access-lfg2x\") pod \"alertmanager-main-0\" (UID: \"93175b29-47eb-4526-99e3-42499c3517bb\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 22 04:30:45.270113 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:30:45.270065    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/93175b29-47eb-4526-99e3-42499c3517bb-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"93175b29-47eb-4526-99e3-42499c3517bb\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 22 04:30:45.360575 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:30:45.360528    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j9gvx_b4af3ae5-fa65-4358-8399-6ed11b68616e/konnectivity-agent/0.log" limit=1024
Jul 22 04:30:45.370371 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:30:45.370344    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/93175b29-47eb-4526-99e3-42499c3517bb-web-config\") pod \"alertmanager-main-0\" (UID: \"93175b29-47eb-4526-99e3-42499c3517bb\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 22 04:30:45.370507 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:30:45.370381    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/93175b29-47eb-4526-99e3-42499c3517bb-tls-assets\") pod \"alertmanager-main-0\" (UID: \"93175b29-47eb-4526-99e3-42499c3517bb\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 22 04:30:45.370507 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:30:45.370409    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/93175b29-47eb-4526-99e3-42499c3517bb-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"93175b29-47eb-4526-99e3-42499c3517bb\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 22 04:30:45.370507 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:30:45.370442    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/93175b29-47eb-4526-99e3-42499c3517bb-config-volume\") pod \"alertmanager-main-0\" (UID: \"93175b29-47eb-4526-99e3-42499c3517bb\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 22 04:30:45.370507 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:30:45.370465    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/93175b29-47eb-4526-99e3-42499c3517bb-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"93175b29-47eb-4526-99e3-42499c3517bb\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 22 04:30:45.370507 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:30:45.370488    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/93175b29-47eb-4526-99e3-42499c3517bb-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"93175b29-47eb-4526-99e3-42499c3517bb\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 22 04:30:45.370748 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:30:45.370544    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/93175b29-47eb-4526-99e3-42499c3517bb-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"93175b29-47eb-4526-99e3-42499c3517bb\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 22 04:30:45.370748 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:30:45.370574    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/93175b29-47eb-4526-99e3-42499c3517bb-config-out\") pod \"alertmanager-main-0\" (UID: \"93175b29-47eb-4526-99e3-42499c3517bb\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 22 04:30:45.370748 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:30:45.370600    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/93175b29-47eb-4526-99e3-42499c3517bb-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"93175b29-47eb-4526-99e3-42499c3517bb\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 22 04:30:45.370748 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:30:45.370624    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/93175b29-47eb-4526-99e3-42499c3517bb-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"93175b29-47eb-4526-99e3-42499c3517bb\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 22 04:30:45.370748 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:30:45.370650    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lfg2x\" (UniqueName: \"kubernetes.io/projected/93175b29-47eb-4526-99e3-42499c3517bb-kube-api-access-lfg2x\") pod \"alertmanager-main-0\" (UID: \"93175b29-47eb-4526-99e3-42499c3517bb\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 22 04:30:45.370748 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:30:45.370702    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/93175b29-47eb-4526-99e3-42499c3517bb-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"93175b29-47eb-4526-99e3-42499c3517bb\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 22 04:30:45.371026 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:30:45.370752    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/93175b29-47eb-4526-99e3-42499c3517bb-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"93175b29-47eb-4526-99e3-42499c3517bb\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 22 04:30:45.371975 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:30:45.371138    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/93175b29-47eb-4526-99e3-42499c3517bb-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"93175b29-47eb-4526-99e3-42499c3517bb\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 22 04:30:45.371975 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:30:45.371413    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/93175b29-47eb-4526-99e3-42499c3517bb-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"93175b29-47eb-4526-99e3-42499c3517bb\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 22 04:30:45.371975 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:30:45.371914    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/93175b29-47eb-4526-99e3-42499c3517bb-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"93175b29-47eb-4526-99e3-42499c3517bb\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 22 04:30:45.373595 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:30:45.373569    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/93175b29-47eb-4526-99e3-42499c3517bb-tls-assets\") pod \"alertmanager-main-0\" (UID: \"93175b29-47eb-4526-99e3-42499c3517bb\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 22 04:30:45.373707 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:30:45.373577    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/93175b29-47eb-4526-99e3-42499c3517bb-web-config\") pod \"alertmanager-main-0\" (UID: \"93175b29-47eb-4526-99e3-42499c3517bb\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 22 04:30:45.373707 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:30:45.373685    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/93175b29-47eb-4526-99e3-42499c3517bb-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"93175b29-47eb-4526-99e3-42499c3517bb\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 22 04:30:45.373707 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:30:45.373703    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/93175b29-47eb-4526-99e3-42499c3517bb-config-volume\") pod \"alertmanager-main-0\" (UID: \"93175b29-47eb-4526-99e3-42499c3517bb\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 22 04:30:45.373909 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:30:45.373883    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/93175b29-47eb-4526-99e3-42499c3517bb-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"93175b29-47eb-4526-99e3-42499c3517bb\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 22 04:30:45.374089 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:30:45.374074    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/93175b29-47eb-4526-99e3-42499c3517bb-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"93175b29-47eb-4526-99e3-42499c3517bb\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 22 04:30:45.374170 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:30:45.374149    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/93175b29-47eb-4526-99e3-42499c3517bb-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"93175b29-47eb-4526-99e3-42499c3517bb\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 22 04:30:45.374717 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:30:45.374696    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/93175b29-47eb-4526-99e3-42499c3517bb-config-out\") pod \"alertmanager-main-0\" (UID: \"93175b29-47eb-4526-99e3-42499c3517bb\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 22 04:30:45.375231 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:30:45.375215    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/93175b29-47eb-4526-99e3-42499c3517bb-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"93175b29-47eb-4526-99e3-42499c3517bb\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 22 04:30:45.378663 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:30:45.378647    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lfg2x\" (UniqueName: \"kubernetes.io/projected/93175b29-47eb-4526-99e3-42499c3517bb-kube-api-access-lfg2x\") pod \"alertmanager-main-0\" (UID: \"93175b29-47eb-4526-99e3-42499c3517bb\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 22 04:30:45.566151 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:30:45.566069    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Jul 22 04:30:45.700210 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:30:45.700166    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Jul 22 04:30:45.704207 ip-10-0-141-238 kubenswrapper[2563]: W0722 04:30:45.704179    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod93175b29_47eb_4526_99e3_42499c3517bb.slice/crio-561df9f98970f72e892be8b3c41bfe35ea843132054d15e3ea301b2536ab243f WatchSource:0}: Error finding container 561df9f98970f72e892be8b3c41bfe35ea843132054d15e3ea301b2536ab243f: Status 404 returned error can't find the container with id 561df9f98970f72e892be8b3c41bfe35ea843132054d15e3ea301b2536ab243f
Jul 22 04:30:46.208530 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:30:46.208496    2563 generic.go:356] "Generic (PLEG): container finished" podID="93175b29-47eb-4526-99e3-42499c3517bb" containerID="6f6b24a6d25a2891d6f47dda7a0dbb2dff3ec43394cbfcfa65fda77aaa30c634" exitCode=0
Jul 22 04:30:46.208896 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:30:46.208559    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"93175b29-47eb-4526-99e3-42499c3517bb","Type":"ContainerDied","Data":"6f6b24a6d25a2891d6f47dda7a0dbb2dff3ec43394cbfcfa65fda77aaa30c634"}
Jul 22 04:30:46.208896 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:30:46.208611    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"93175b29-47eb-4526-99e3-42499c3517bb","Type":"ContainerStarted","Data":"561df9f98970f72e892be8b3c41bfe35ea843132054d15e3ea301b2536ab243f"}
Jul 22 04:30:47.066017 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:30:47.065981    2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="9dcd1a9e-6c89-49c7-b2df-375e7e373b49" path="/var/lib/kubelet/pods/9dcd1a9e-6c89-49c7-b2df-375e7e373b49/volumes"
Jul 22 04:30:47.215491 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:30:47.215457    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"93175b29-47eb-4526-99e3-42499c3517bb","Type":"ContainerStarted","Data":"0e5540a43d6b756daeb3c6e3ca4cd7d91c78ada65ed2b590fcc224de119bda04"}
Jul 22 04:30:47.215839 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:30:47.215536    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"93175b29-47eb-4526-99e3-42499c3517bb","Type":"ContainerStarted","Data":"7ea919e9f381a6453227418fe728bf1e55ad5ec4ab10ebb761a8b97cc9c60161"}
Jul 22 04:30:47.215839 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:30:47.215583    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"93175b29-47eb-4526-99e3-42499c3517bb","Type":"ContainerStarted","Data":"a5e308cf6f3f0908ea413a28d1cb40a6477257ae04db1dd2c63a2bd309f353ca"}
Jul 22 04:30:47.215839 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:30:47.215619    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"93175b29-47eb-4526-99e3-42499c3517bb","Type":"ContainerStarted","Data":"e9c3f522ddfa179afd8f041b88e5bbda245a24aded2d6450443046b2df68e330"}
Jul 22 04:30:47.215839 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:30:47.215655    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"93175b29-47eb-4526-99e3-42499c3517bb","Type":"ContainerStarted","Data":"f4966d9887c58da3d8220724578aa4e7a529c6566dff658932ced6dfdeb46104"}
Jul 22 04:30:47.215839 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:30:47.215691    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"93175b29-47eb-4526-99e3-42499c3517bb","Type":"ContainerStarted","Data":"93937525b8dd13aed01153adaa302597c4b2dfe67fd45f7cd62e7157bacac049"}
Jul 22 04:30:47.244225 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:30:47.244173    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=2.227767366 podStartE2EDuration="2.2441561s" totalImagesPullingTime="0s" totalInitContainerRuntime="16.388734ms" isStatefulPod=false podCreationTimestamp="2026-07-22 04:30:45 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 04:30:47.242799071 +0000 UTC m=+362.661807841" watchObservedRunningTime="2026-07-22 04:30:47.2441561 +0000 UTC m=+362.663164858"
Jul 22 04:30:47.528340 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:30:47.528301    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/telemeter-client-64f8c4cd96-clkks"]
Jul 22 04:30:47.533264 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:30:47.533240    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-64f8c4cd96-clkks"
Jul 22 04:30:47.535772 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:30:47.535750    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client\""
Jul 22 04:30:47.535984 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:30:47.535961    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"federate-client-certs\""
Jul 22 04:30:47.536099 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:30:47.536010    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-tls\""
Jul 22 04:30:47.536172 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:30:47.536013    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-kube-rbac-proxy-config\""
Jul 22 04:30:47.536255 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:30:47.536232    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-client-serving-certs-ca-bundle\""
Jul 22 04:30:47.536579 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:30:47.536561    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-dockercfg-cxc7h\""
Jul 22 04:30:47.540658 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:30:47.540640    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-trusted-ca-bundle-8i12ta5c71j38\""
Jul 22 04:30:47.544928 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:30:47.544889    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-64f8c4cd96-clkks"]
Jul 22 04:30:47.587024 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:30:47.586982    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/bf338bfd-b9df-4542-a623-6be10c75e8bd-serving-certs-ca-bundle\") pod \"telemeter-client-64f8c4cd96-clkks\" (UID: \"bf338bfd-b9df-4542-a623-6be10c75e8bd\") " pod="openshift-monitoring/telemeter-client-64f8c4cd96-clkks"
Jul 22 04:30:47.587234 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:30:47.587090    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/bf338bfd-b9df-4542-a623-6be10c75e8bd-telemeter-client-tls\") pod \"telemeter-client-64f8c4cd96-clkks\" (UID: \"bf338bfd-b9df-4542-a623-6be10c75e8bd\") " pod="openshift-monitoring/telemeter-client-64f8c4cd96-clkks"
Jul 22 04:30:47.587234 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:30:47.587121    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/bf338bfd-b9df-4542-a623-6be10c75e8bd-federate-client-tls\") pod \"telemeter-client-64f8c4cd96-clkks\" (UID: \"bf338bfd-b9df-4542-a623-6be10c75e8bd\") " pod="openshift-monitoring/telemeter-client-64f8c4cd96-clkks"
Jul 22 04:30:47.587234 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:30:47.587151    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/bf338bfd-b9df-4542-a623-6be10c75e8bd-secret-telemeter-client\") pod \"telemeter-client-64f8c4cd96-clkks\" (UID: \"bf338bfd-b9df-4542-a623-6be10c75e8bd\") " pod="openshift-monitoring/telemeter-client-64f8c4cd96-clkks"
Jul 22 04:30:47.587234 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:30:47.587207    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/bf338bfd-b9df-4542-a623-6be10c75e8bd-telemeter-trusted-ca-bundle\") pod \"telemeter-client-64f8c4cd96-clkks\" (UID: \"bf338bfd-b9df-4542-a623-6be10c75e8bd\") " pod="openshift-monitoring/telemeter-client-64f8c4cd96-clkks"
Jul 22 04:30:47.587234 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:30:47.587234    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/bf338bfd-b9df-4542-a623-6be10c75e8bd-metrics-client-ca\") pod \"telemeter-client-64f8c4cd96-clkks\" (UID: \"bf338bfd-b9df-4542-a623-6be10c75e8bd\") " pod="openshift-monitoring/telemeter-client-64f8c4cd96-clkks"
Jul 22 04:30:47.587478 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:30:47.587276    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-466q7\" (UniqueName: \"kubernetes.io/projected/bf338bfd-b9df-4542-a623-6be10c75e8bd-kube-api-access-466q7\") pod \"telemeter-client-64f8c4cd96-clkks\" (UID: \"bf338bfd-b9df-4542-a623-6be10c75e8bd\") " pod="openshift-monitoring/telemeter-client-64f8c4cd96-clkks"
Jul 22 04:30:47.587478 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:30:47.587309    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/bf338bfd-b9df-4542-a623-6be10c75e8bd-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-64f8c4cd96-clkks\" (UID: \"bf338bfd-b9df-4542-a623-6be10c75e8bd\") " pod="openshift-monitoring/telemeter-client-64f8c4cd96-clkks"
Jul 22 04:30:47.687709 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:30:47.687669    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/bf338bfd-b9df-4542-a623-6be10c75e8bd-telemeter-client-tls\") pod \"telemeter-client-64f8c4cd96-clkks\" (UID: \"bf338bfd-b9df-4542-a623-6be10c75e8bd\") " pod="openshift-monitoring/telemeter-client-64f8c4cd96-clkks"
Jul 22 04:30:47.687892 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:30:47.687741    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/bf338bfd-b9df-4542-a623-6be10c75e8bd-federate-client-tls\") pod \"telemeter-client-64f8c4cd96-clkks\" (UID: \"bf338bfd-b9df-4542-a623-6be10c75e8bd\") " pod="openshift-monitoring/telemeter-client-64f8c4cd96-clkks"
Jul 22 04:30:47.687892 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:30:47.687769    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/bf338bfd-b9df-4542-a623-6be10c75e8bd-secret-telemeter-client\") pod \"telemeter-client-64f8c4cd96-clkks\" (UID: \"bf338bfd-b9df-4542-a623-6be10c75e8bd\") " pod="openshift-monitoring/telemeter-client-64f8c4cd96-clkks"
Jul 22 04:30:47.687892 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:30:47.687819    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/bf338bfd-b9df-4542-a623-6be10c75e8bd-telemeter-trusted-ca-bundle\") pod \"telemeter-client-64f8c4cd96-clkks\" (UID: \"bf338bfd-b9df-4542-a623-6be10c75e8bd\") " pod="openshift-monitoring/telemeter-client-64f8c4cd96-clkks"
Jul 22 04:30:47.687892 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:30:47.687843    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/bf338bfd-b9df-4542-a623-6be10c75e8bd-metrics-client-ca\") pod \"telemeter-client-64f8c4cd96-clkks\" (UID: \"bf338bfd-b9df-4542-a623-6be10c75e8bd\") " pod="openshift-monitoring/telemeter-client-64f8c4cd96-clkks"
Jul 22 04:30:47.687892 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:30:47.687887    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-466q7\" (UniqueName: \"kubernetes.io/projected/bf338bfd-b9df-4542-a623-6be10c75e8bd-kube-api-access-466q7\") pod \"telemeter-client-64f8c4cd96-clkks\" (UID: \"bf338bfd-b9df-4542-a623-6be10c75e8bd\") " pod="openshift-monitoring/telemeter-client-64f8c4cd96-clkks"
Jul 22 04:30:47.688184 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:30:47.687932    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/bf338bfd-b9df-4542-a623-6be10c75e8bd-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-64f8c4cd96-clkks\" (UID: \"bf338bfd-b9df-4542-a623-6be10c75e8bd\") " pod="openshift-monitoring/telemeter-client-64f8c4cd96-clkks"
Jul 22 04:30:47.688184 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:30:47.687966    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/bf338bfd-b9df-4542-a623-6be10c75e8bd-serving-certs-ca-bundle\") pod \"telemeter-client-64f8c4cd96-clkks\" (UID: \"bf338bfd-b9df-4542-a623-6be10c75e8bd\") " pod="openshift-monitoring/telemeter-client-64f8c4cd96-clkks"
Jul 22 04:30:47.688688 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:30:47.688656    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/bf338bfd-b9df-4542-a623-6be10c75e8bd-metrics-client-ca\") pod \"telemeter-client-64f8c4cd96-clkks\" (UID: \"bf338bfd-b9df-4542-a623-6be10c75e8bd\") " pod="openshift-monitoring/telemeter-client-64f8c4cd96-clkks"
Jul 22 04:30:47.688816 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:30:47.688710    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/bf338bfd-b9df-4542-a623-6be10c75e8bd-telemeter-trusted-ca-bundle\") pod \"telemeter-client-64f8c4cd96-clkks\" (UID: \"bf338bfd-b9df-4542-a623-6be10c75e8bd\") " pod="openshift-monitoring/telemeter-client-64f8c4cd96-clkks"
Jul 22 04:30:47.688904 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:30:47.688886    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/bf338bfd-b9df-4542-a623-6be10c75e8bd-serving-certs-ca-bundle\") pod \"telemeter-client-64f8c4cd96-clkks\" (UID: \"bf338bfd-b9df-4542-a623-6be10c75e8bd\") " pod="openshift-monitoring/telemeter-client-64f8c4cd96-clkks"
Jul 22 04:30:47.690343 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:30:47.690313    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/bf338bfd-b9df-4542-a623-6be10c75e8bd-federate-client-tls\") pod \"telemeter-client-64f8c4cd96-clkks\" (UID: \"bf338bfd-b9df-4542-a623-6be10c75e8bd\") " pod="openshift-monitoring/telemeter-client-64f8c4cd96-clkks"
Jul 22 04:30:47.690621 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:30:47.690599    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/bf338bfd-b9df-4542-a623-6be10c75e8bd-secret-telemeter-client\") pod \"telemeter-client-64f8c4cd96-clkks\" (UID: \"bf338bfd-b9df-4542-a623-6be10c75e8bd\") " pod="openshift-monitoring/telemeter-client-64f8c4cd96-clkks"
Jul 22 04:30:47.690766 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:30:47.690745    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/bf338bfd-b9df-4542-a623-6be10c75e8bd-telemeter-client-tls\") pod \"telemeter-client-64f8c4cd96-clkks\" (UID: \"bf338bfd-b9df-4542-a623-6be10c75e8bd\") " pod="openshift-monitoring/telemeter-client-64f8c4cd96-clkks"
Jul 22 04:30:47.690949 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:30:47.690928    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/bf338bfd-b9df-4542-a623-6be10c75e8bd-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-64f8c4cd96-clkks\" (UID: \"bf338bfd-b9df-4542-a623-6be10c75e8bd\") " pod="openshift-monitoring/telemeter-client-64f8c4cd96-clkks"
Jul 22 04:30:47.695847 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:30:47.695819    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-466q7\" (UniqueName: \"kubernetes.io/projected/bf338bfd-b9df-4542-a623-6be10c75e8bd-kube-api-access-466q7\") pod \"telemeter-client-64f8c4cd96-clkks\" (UID: \"bf338bfd-b9df-4542-a623-6be10c75e8bd\") " pod="openshift-monitoring/telemeter-client-64f8c4cd96-clkks"
Jul 22 04:30:47.846049 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:30:47.845946    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-64f8c4cd96-clkks"
Jul 22 04:30:47.984944 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:30:47.984909    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-64f8c4cd96-clkks"]
Jul 22 04:30:47.987722 ip-10-0-141-238 kubenswrapper[2563]: W0722 04:30:47.987691    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbf338bfd_b9df_4542_a623_6be10c75e8bd.slice/crio-aa4f63aa491b3bcdb7616e2f2819f5c63f150a5febada70b93a12868e300cb7b WatchSource:0}: Error finding container aa4f63aa491b3bcdb7616e2f2819f5c63f150a5febada70b93a12868e300cb7b: Status 404 returned error can't find the container with id aa4f63aa491b3bcdb7616e2f2819f5c63f150a5febada70b93a12868e300cb7b
Jul 22 04:30:47.989924 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:30:47.989904    2563 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 22 04:30:48.220255 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:30:48.220221    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-64f8c4cd96-clkks" event={"ID":"bf338bfd-b9df-4542-a623-6be10c75e8bd","Type":"ContainerStarted","Data":"aa4f63aa491b3bcdb7616e2f2819f5c63f150a5febada70b93a12868e300cb7b"}
Jul 22 04:30:50.231116 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:30:50.231076    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-64f8c4cd96-clkks" event={"ID":"bf338bfd-b9df-4542-a623-6be10c75e8bd","Type":"ContainerStarted","Data":"57b4a9029195768b82f78d9da2fa79162f75356e1e78650311983abb8125b984"}
Jul 22 04:30:50.231579 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:30:50.231130    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-64f8c4cd96-clkks" event={"ID":"bf338bfd-b9df-4542-a623-6be10c75e8bd","Type":"ContainerStarted","Data":"da328535031402200c385e9db10ba6dd7eaa62d2432d73c1a28dd1f704b135ad"}
Jul 22 04:30:50.231579 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:30:50.231151    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-64f8c4cd96-clkks" event={"ID":"bf338bfd-b9df-4542-a623-6be10c75e8bd","Type":"ContainerStarted","Data":"453c51f99633b31f273fe9cfbbfec87f29be2a232a0e69e54758ff98a44baccf"}
Jul 22 04:30:50.253813 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:30:50.253756    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/telemeter-client-64f8c4cd96-clkks" podStartSLOduration=1.646346694 podStartE2EDuration="3.253737177s" totalImagesPullingTime="1.607390483s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 04:30:47 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 04:30:50.252384783 +0000 UTC m=+365.671393535" watchObservedRunningTime="2026-07-22 04:30:50.253737177 +0000 UTC m=+365.672745937"
Jul 22 04:30:51.189794 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:30:51.189764    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j9gvx_b4af3ae5-fa65-4358-8399-6ed11b68616e/konnectivity-agent/0.log" limit=1024
Jul 22 04:30:51.355705 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:30:51.355670    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j9gvx_b4af3ae5-fa65-4358-8399-6ed11b68616e/konnectivity-agent/0.log" limit=1024
Jul 22 04:30:51.416204 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:30:51.416176    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j9gvx_b4af3ae5-fa65-4358-8399-6ed11b68616e/konnectivity-agent/0.log" limit=1024
Jul 22 04:30:51.935107 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:30:51.935075    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j9gvx_b4af3ae5-fa65-4358-8399-6ed11b68616e/konnectivity-agent/0.log" limit=1024
Jul 22 04:30:51.997981 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:30:51.997957    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j9gvx_b4af3ae5-fa65-4358-8399-6ed11b68616e/konnectivity-agent/0.log" limit=1024
Jul 22 04:30:53.315820 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:30:53.315784    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j9gvx_b4af3ae5-fa65-4358-8399-6ed11b68616e/konnectivity-agent/0.log" limit=1024
Jul 22 04:30:53.376872 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:30:53.376843    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j9gvx_b4af3ae5-fa65-4358-8399-6ed11b68616e/konnectivity-agent/0.log" limit=1024
Jul 22 04:30:58.877309 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:30:58.877274    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3e22b9bf-95f2-4186-a5a7-2f1d21feb8b1-metrics-certs\") pod \"network-metrics-daemon-2k7fd\" (UID: \"3e22b9bf-95f2-4186-a5a7-2f1d21feb8b1\") " pod="openshift-multus/network-metrics-daemon-2k7fd"
Jul 22 04:30:58.879649 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:30:58.879614    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3e22b9bf-95f2-4186-a5a7-2f1d21feb8b1-metrics-certs\") pod \"network-metrics-daemon-2k7fd\" (UID: \"3e22b9bf-95f2-4186-a5a7-2f1d21feb8b1\") " pod="openshift-multus/network-metrics-daemon-2k7fd"
Jul 22 04:30:59.162590 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:30:59.162565    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-s9hfn\""
Jul 22 04:30:59.170393 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:30:59.170371    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2k7fd"
Jul 22 04:30:59.293101 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:30:59.293077    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-2k7fd"]
Jul 22 04:30:59.295529 ip-10-0-141-238 kubenswrapper[2563]: W0722 04:30:59.295498    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3e22b9bf_95f2_4186_a5a7_2f1d21feb8b1.slice/crio-3239994a95599c86f80949d677bee87cc9af51b5b78551dec898c34d19063431 WatchSource:0}: Error finding container 3239994a95599c86f80949d677bee87cc9af51b5b78551dec898c34d19063431: Status 404 returned error can't find the container with id 3239994a95599c86f80949d677bee87cc9af51b5b78551dec898c34d19063431
Jul 22 04:31:00.275128 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:31:00.275091    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-2k7fd" event={"ID":"3e22b9bf-95f2-4186-a5a7-2f1d21feb8b1","Type":"ContainerStarted","Data":"e76ed1a878f709c1dc0d4df9896afb8ea7a06becd5ed9fc07a405d6a66ff96bb"}
Jul 22 04:31:00.275516 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:31:00.275163    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-2k7fd" event={"ID":"3e22b9bf-95f2-4186-a5a7-2f1d21feb8b1","Type":"ContainerStarted","Data":"3239994a95599c86f80949d677bee87cc9af51b5b78551dec898c34d19063431"}
Jul 22 04:31:01.281020 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:31:01.280984    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-2k7fd" event={"ID":"3e22b9bf-95f2-4186-a5a7-2f1d21feb8b1","Type":"ContainerStarted","Data":"4b77d7442e860274a391421acfed24a56aae3274530810f6f57ed475bc5326b5"}
Jul 22 04:31:01.296469 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:31:01.296420    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-2k7fd" podStartSLOduration=375.415857106 podStartE2EDuration="6m16.296404954s" totalImagesPullingTime="880.547848ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 04:24:45 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 04:31:01.293991084 +0000 UTC m=+376.712999837" watchObservedRunningTime="2026-07-22 04:31:01.296404954 +0000 UTC m=+376.715413768"
Jul 22 04:31:01.388463 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:31:01.388431    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j9gvx_b4af3ae5-fa65-4358-8399-6ed11b68616e/konnectivity-agent/0.log" limit=1024
Jul 22 04:31:01.497799 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:31:01.497760    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j9gvx_b4af3ae5-fa65-4358-8399-6ed11b68616e/konnectivity-agent/0.log" limit=1024
Jul 22 04:31:01.597867 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:31:01.597780    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j9gvx_b4af3ae5-fa65-4358-8399-6ed11b68616e/konnectivity-agent/0.log" limit=1024
Jul 22 04:31:01.755636 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:31:01.755603    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j9gvx_b4af3ae5-fa65-4358-8399-6ed11b68616e/konnectivity-agent/0.log" limit=1024
Jul 22 04:31:01.813699 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:31:01.813666    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j9gvx_b4af3ae5-fa65-4358-8399-6ed11b68616e/konnectivity-agent/0.log" limit=1024
Jul 22 04:31:02.292007 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:31:02.291974    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-864456df47-qjd4f"]
Jul 22 04:31:02.385149 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:31:02.385112    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j9gvx_b4af3ae5-fa65-4358-8399-6ed11b68616e/konnectivity-agent/0.log" limit=1024
Jul 22 04:31:27.006965 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:31:27.006930    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j9gvx_b4af3ae5-fa65-4358-8399-6ed11b68616e/konnectivity-agent/0.log" limit=1024
Jul 22 04:31:27.314425 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:31:27.314332    2563 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-864456df47-qjd4f" podUID="98b94e3b-ba94-4d1f-925c-3aaeefe1a4dd" containerName="console" containerID="cri-o://41142e41453f603d5759ce8470eb0a6565d6c8d4f9d02fe65837d35b8c0f928d" gracePeriod=15
Jul 22 04:31:27.543925 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:31:27.543902    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-864456df47-qjd4f"
Jul 22 04:31:27.623152 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:31:27.623071    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/98b94e3b-ba94-4d1f-925c-3aaeefe1a4dd-oauth-serving-cert\") pod \"98b94e3b-ba94-4d1f-925c-3aaeefe1a4dd\" (UID: \"98b94e3b-ba94-4d1f-925c-3aaeefe1a4dd\") "
Jul 22 04:31:27.623152 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:31:27.623113    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/98b94e3b-ba94-4d1f-925c-3aaeefe1a4dd-service-ca\") pod \"98b94e3b-ba94-4d1f-925c-3aaeefe1a4dd\" (UID: \"98b94e3b-ba94-4d1f-925c-3aaeefe1a4dd\") "
Jul 22 04:31:27.623152 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:31:27.623142    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/98b94e3b-ba94-4d1f-925c-3aaeefe1a4dd-console-config\") pod \"98b94e3b-ba94-4d1f-925c-3aaeefe1a4dd\" (UID: \"98b94e3b-ba94-4d1f-925c-3aaeefe1a4dd\") "
Jul 22 04:31:27.623363 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:31:27.623315    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/98b94e3b-ba94-4d1f-925c-3aaeefe1a4dd-console-oauth-config\") pod \"98b94e3b-ba94-4d1f-925c-3aaeefe1a4dd\" (UID: \"98b94e3b-ba94-4d1f-925c-3aaeefe1a4dd\") "
Jul 22 04:31:27.623413 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:31:27.623362    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-w2dl6\" (UniqueName: \"kubernetes.io/projected/98b94e3b-ba94-4d1f-925c-3aaeefe1a4dd-kube-api-access-w2dl6\") pod \"98b94e3b-ba94-4d1f-925c-3aaeefe1a4dd\" (UID: \"98b94e3b-ba94-4d1f-925c-3aaeefe1a4dd\") "
Jul 22 04:31:27.623413 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:31:27.623382    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/98b94e3b-ba94-4d1f-925c-3aaeefe1a4dd-console-serving-cert\") pod \"98b94e3b-ba94-4d1f-925c-3aaeefe1a4dd\" (UID: \"98b94e3b-ba94-4d1f-925c-3aaeefe1a4dd\") "
Jul 22 04:31:27.623512 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:31:27.623422    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/98b94e3b-ba94-4d1f-925c-3aaeefe1a4dd-trusted-ca-bundle\") pod \"98b94e3b-ba94-4d1f-925c-3aaeefe1a4dd\" (UID: \"98b94e3b-ba94-4d1f-925c-3aaeefe1a4dd\") "
Jul 22 04:31:27.623512 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:31:27.623487    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/98b94e3b-ba94-4d1f-925c-3aaeefe1a4dd-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "98b94e3b-ba94-4d1f-925c-3aaeefe1a4dd" (UID: "98b94e3b-ba94-4d1f-925c-3aaeefe1a4dd"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 22 04:31:27.623512 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:31:27.623496    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/98b94e3b-ba94-4d1f-925c-3aaeefe1a4dd-service-ca" (OuterVolumeSpecName: "service-ca") pod "98b94e3b-ba94-4d1f-925c-3aaeefe1a4dd" (UID: "98b94e3b-ba94-4d1f-925c-3aaeefe1a4dd"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 22 04:31:27.623667 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:31:27.623504    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/98b94e3b-ba94-4d1f-925c-3aaeefe1a4dd-console-config" (OuterVolumeSpecName: "console-config") pod "98b94e3b-ba94-4d1f-925c-3aaeefe1a4dd" (UID: "98b94e3b-ba94-4d1f-925c-3aaeefe1a4dd"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 22 04:31:27.623667 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:31:27.623647    2563 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/98b94e3b-ba94-4d1f-925c-3aaeefe1a4dd-console-config\") on node \"ip-10-0-141-238.ec2.internal\" DevicePath \"\""
Jul 22 04:31:27.623667 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:31:27.623661    2563 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/98b94e3b-ba94-4d1f-925c-3aaeefe1a4dd-oauth-serving-cert\") on node \"ip-10-0-141-238.ec2.internal\" DevicePath \"\""
Jul 22 04:31:27.623812 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:31:27.623670    2563 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/98b94e3b-ba94-4d1f-925c-3aaeefe1a4dd-service-ca\") on node \"ip-10-0-141-238.ec2.internal\" DevicePath \"\""
Jul 22 04:31:27.623892 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:31:27.623870    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/98b94e3b-ba94-4d1f-925c-3aaeefe1a4dd-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "98b94e3b-ba94-4d1f-925c-3aaeefe1a4dd" (UID: "98b94e3b-ba94-4d1f-925c-3aaeefe1a4dd"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 22 04:31:27.625413 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:31:27.625390    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/98b94e3b-ba94-4d1f-925c-3aaeefe1a4dd-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "98b94e3b-ba94-4d1f-925c-3aaeefe1a4dd" (UID: "98b94e3b-ba94-4d1f-925c-3aaeefe1a4dd"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 22 04:31:27.625507 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:31:27.625408    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/98b94e3b-ba94-4d1f-925c-3aaeefe1a4dd-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "98b94e3b-ba94-4d1f-925c-3aaeefe1a4dd" (UID: "98b94e3b-ba94-4d1f-925c-3aaeefe1a4dd"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 22 04:31:27.625543 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:31:27.625501    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/98b94e3b-ba94-4d1f-925c-3aaeefe1a4dd-kube-api-access-w2dl6" (OuterVolumeSpecName: "kube-api-access-w2dl6") pod "98b94e3b-ba94-4d1f-925c-3aaeefe1a4dd" (UID: "98b94e3b-ba94-4d1f-925c-3aaeefe1a4dd"). InnerVolumeSpecName "kube-api-access-w2dl6". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 22 04:31:27.725073 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:31:27.725016    2563 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/98b94e3b-ba94-4d1f-925c-3aaeefe1a4dd-console-serving-cert\") on node \"ip-10-0-141-238.ec2.internal\" DevicePath \"\""
Jul 22 04:31:27.725073 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:31:27.725065    2563 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/98b94e3b-ba94-4d1f-925c-3aaeefe1a4dd-trusted-ca-bundle\") on node \"ip-10-0-141-238.ec2.internal\" DevicePath \"\""
Jul 22 04:31:27.725073 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:31:27.725076    2563 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/98b94e3b-ba94-4d1f-925c-3aaeefe1a4dd-console-oauth-config\") on node \"ip-10-0-141-238.ec2.internal\" DevicePath \"\""
Jul 22 04:31:27.725073 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:31:27.725085    2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-w2dl6\" (UniqueName: \"kubernetes.io/projected/98b94e3b-ba94-4d1f-925c-3aaeefe1a4dd-kube-api-access-w2dl6\") on node \"ip-10-0-141-238.ec2.internal\" DevicePath \"\""
Jul 22 04:31:28.397023 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:31:28.396988    2563 generic.go:356] "Generic (PLEG): container finished" podID="98b94e3b-ba94-4d1f-925c-3aaeefe1a4dd" containerID="41142e41453f603d5759ce8470eb0a6565d6c8d4f9d02fe65837d35b8c0f928d" exitCode=0
Jul 22 04:31:28.397444 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:31:28.397074    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-864456df47-qjd4f"
Jul 22 04:31:28.397444 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:31:28.397082    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-864456df47-qjd4f" event={"ID":"98b94e3b-ba94-4d1f-925c-3aaeefe1a4dd","Type":"ContainerDied","Data":"41142e41453f603d5759ce8470eb0a6565d6c8d4f9d02fe65837d35b8c0f928d"}
Jul 22 04:31:28.397444 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:31:28.397157    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-864456df47-qjd4f" event={"ID":"98b94e3b-ba94-4d1f-925c-3aaeefe1a4dd","Type":"ContainerDied","Data":"53119a251cc9958fabde1f883faf35759b6d1ced8c310eb4975d65fbda8825e2"}
Jul 22 04:31:28.397444 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:31:28.397178    2563 scope.go:117] "RemoveContainer" containerID="41142e41453f603d5759ce8470eb0a6565d6c8d4f9d02fe65837d35b8c0f928d"
Jul 22 04:31:28.406135 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:31:28.406119    2563 scope.go:117] "RemoveContainer" containerID="41142e41453f603d5759ce8470eb0a6565d6c8d4f9d02fe65837d35b8c0f928d"
Jul 22 04:31:28.406361 ip-10-0-141-238 kubenswrapper[2563]: E0722 04:31:28.406344    2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"41142e41453f603d5759ce8470eb0a6565d6c8d4f9d02fe65837d35b8c0f928d\": container with ID starting with 41142e41453f603d5759ce8470eb0a6565d6c8d4f9d02fe65837d35b8c0f928d not found: ID does not exist" containerID="41142e41453f603d5759ce8470eb0a6565d6c8d4f9d02fe65837d35b8c0f928d"
Jul 22 04:31:28.406418 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:31:28.406373    2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"41142e41453f603d5759ce8470eb0a6565d6c8d4f9d02fe65837d35b8c0f928d"} err="failed to get container status \"41142e41453f603d5759ce8470eb0a6565d6c8d4f9d02fe65837d35b8c0f928d\": rpc error: code = NotFound desc = could not find container \"41142e41453f603d5759ce8470eb0a6565d6c8d4f9d02fe65837d35b8c0f928d\": container with ID starting with 41142e41453f603d5759ce8470eb0a6565d6c8d4f9d02fe65837d35b8c0f928d not found: ID does not exist"
Jul 22 04:31:28.417884 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:31:28.417860    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-864456df47-qjd4f"]
Jul 22 04:31:28.420422 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:31:28.420396    2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-864456df47-qjd4f"]
Jul 22 04:31:29.064663 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:31:29.064628    2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="98b94e3b-ba94-4d1f-925c-3aaeefe1a4dd" path="/var/lib/kubelet/pods/98b94e3b-ba94-4d1f-925c-3aaeefe1a4dd/volumes"
Jul 22 04:31:45.691985 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:31:45.691940    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j9gvx_b4af3ae5-fa65-4358-8399-6ed11b68616e/konnectivity-agent/0.log" limit=1024
Jul 22 04:31:45.742911 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:31:45.742873    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j9gvx_b4af3ae5-fa65-4358-8399-6ed11b68616e/konnectivity-agent/0.log" limit=1024
Jul 22 04:31:57.660885 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:31:57.660841    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j9gvx_b4af3ae5-fa65-4358-8399-6ed11b68616e/konnectivity-agent/0.log" limit=1024
Jul 22 04:31:57.720814 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:31:57.720782    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j9gvx_b4af3ae5-fa65-4358-8399-6ed11b68616e/konnectivity-agent/0.log" limit=1024
Jul 22 04:32:07.750327 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:32:07.750236    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j9gvx_b4af3ae5-fa65-4358-8399-6ed11b68616e/konnectivity-agent/0.log" limit=1024
Jul 22 04:32:09.521579 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:32:09.521538    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j9gvx_b4af3ae5-fa65-4358-8399-6ed11b68616e/konnectivity-agent/0.log" limit=1024
Jul 22 04:32:09.622134 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:32:09.622097    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j9gvx_b4af3ae5-fa65-4358-8399-6ed11b68616e/konnectivity-agent/0.log" limit=1024
Jul 22 04:32:18.698919 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:32:18.698882    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j9gvx_b4af3ae5-fa65-4358-8399-6ed11b68616e/konnectivity-agent/0.log" limit=1024
Jul 22 04:32:18.746738 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:32:18.746708    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j9gvx_b4af3ae5-fa65-4358-8399-6ed11b68616e/konnectivity-agent/0.log" limit=1024
Jul 22 04:32:19.979108 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:32:19.979071    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j9gvx_b4af3ae5-fa65-4358-8399-6ed11b68616e/konnectivity-agent/0.log" limit=1024
Jul 22 04:32:20.079672 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:32:20.079628    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j9gvx_b4af3ae5-fa65-4358-8399-6ed11b68616e/konnectivity-agent/0.log" limit=1024
Jul 22 04:32:20.505759 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:32:20.505725    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j9gvx_b4af3ae5-fa65-4358-8399-6ed11b68616e/konnectivity-agent/0.log" limit=1024
Jul 22 04:32:53.965753 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:32:53.965715    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j9gvx_b4af3ae5-fa65-4358-8399-6ed11b68616e/konnectivity-agent/0.log" limit=1024
Jul 22 04:32:54.062573 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:32:54.062538    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j9gvx_b4af3ae5-fa65-4358-8399-6ed11b68616e/konnectivity-agent/0.log" limit=1024
Jul 22 04:33:02.461823 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:33:02.461786    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j9gvx_b4af3ae5-fa65-4358-8399-6ed11b68616e/konnectivity-agent/0.log" limit=1024
Jul 22 04:33:15.872662 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:33:15.872624    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j9gvx_b4af3ae5-fa65-4358-8399-6ed11b68616e/konnectivity-agent/0.log" limit=1024
Jul 22 04:33:16.736327 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:33:16.736295    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j9gvx_b4af3ae5-fa65-4358-8399-6ed11b68616e/konnectivity-agent/0.log" limit=1024
Jul 22 04:33:19.492015 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:33:19.491971    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j9gvx_b4af3ae5-fa65-4358-8399-6ed11b68616e/konnectivity-agent/0.log" limit=1024
Jul 22 04:33:19.603076 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:33:19.603003    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j9gvx_b4af3ae5-fa65-4358-8399-6ed11b68616e/konnectivity-agent/0.log" limit=1024
Jul 22 04:33:21.176328 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:33:21.176297    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j9gvx_b4af3ae5-fa65-4358-8399-6ed11b68616e/konnectivity-agent/0.log" limit=1024
Jul 22 04:33:21.280796 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:33:21.280760    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j9gvx_b4af3ae5-fa65-4358-8399-6ed11b68616e/konnectivity-agent/0.log" limit=1024
Jul 22 04:33:21.566634 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:33:21.566553    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j9gvx_b4af3ae5-fa65-4358-8399-6ed11b68616e/konnectivity-agent/0.log" limit=1024
Jul 22 04:33:21.662667 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:33:21.662633    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j9gvx_b4af3ae5-fa65-4358-8399-6ed11b68616e/konnectivity-agent/0.log" limit=1024
Jul 22 04:33:23.976504 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:33:23.976468    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j9gvx_b4af3ae5-fa65-4358-8399-6ed11b68616e/konnectivity-agent/0.log" limit=1024
Jul 22 04:33:24.161621 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:33:24.161586    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j9gvx_b4af3ae5-fa65-4358-8399-6ed11b68616e/konnectivity-agent/0.log" limit=1024
Jul 22 04:33:24.227084 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:33:24.226998    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-cainjector-559cdd8c87-scclb"]
Jul 22 04:33:24.227299 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:33:24.227287    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="98b94e3b-ba94-4d1f-925c-3aaeefe1a4dd" containerName="console"
Jul 22 04:33:24.227352 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:33:24.227301    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="98b94e3b-ba94-4d1f-925c-3aaeefe1a4dd" containerName="console"
Jul 22 04:33:24.227352 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:33:24.227346    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="98b94e3b-ba94-4d1f-925c-3aaeefe1a4dd" containerName="console"
Jul 22 04:33:24.229754 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:33:24.229737    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-cainjector-559cdd8c87-scclb"
Jul 22 04:33:24.232141 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:33:24.232121    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"openshift-service-ca.crt\""
Jul 22 04:33:24.233113 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:33:24.233098    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-cainjector-dockercfg-zpbng\""
Jul 22 04:33:24.233185 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:33:24.233131    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"kube-root-ca.crt\""
Jul 22 04:33:24.239376 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:33:24.239355    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-cainjector-559cdd8c87-scclb"]
Jul 22 04:33:24.336836 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:33:24.336797    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/c72ad103-92ba-4560-bc62-9d462b429a76-bound-sa-token\") pod \"cert-manager-cainjector-559cdd8c87-scclb\" (UID: \"c72ad103-92ba-4560-bc62-9d462b429a76\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-scclb"
Jul 22 04:33:24.336969 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:33:24.336902    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xcft5\" (UniqueName: \"kubernetes.io/projected/c72ad103-92ba-4560-bc62-9d462b429a76-kube-api-access-xcft5\") pod \"cert-manager-cainjector-559cdd8c87-scclb\" (UID: \"c72ad103-92ba-4560-bc62-9d462b429a76\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-scclb"
Jul 22 04:33:24.437421 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:33:24.437388    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xcft5\" (UniqueName: \"kubernetes.io/projected/c72ad103-92ba-4560-bc62-9d462b429a76-kube-api-access-xcft5\") pod \"cert-manager-cainjector-559cdd8c87-scclb\" (UID: \"c72ad103-92ba-4560-bc62-9d462b429a76\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-scclb"
Jul 22 04:33:24.437568 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:33:24.437448    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/c72ad103-92ba-4560-bc62-9d462b429a76-bound-sa-token\") pod \"cert-manager-cainjector-559cdd8c87-scclb\" (UID: \"c72ad103-92ba-4560-bc62-9d462b429a76\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-scclb"
Jul 22 04:33:24.445295 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:33:24.445268    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/c72ad103-92ba-4560-bc62-9d462b429a76-bound-sa-token\") pod \"cert-manager-cainjector-559cdd8c87-scclb\" (UID: \"c72ad103-92ba-4560-bc62-9d462b429a76\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-scclb"
Jul 22 04:33:24.445396 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:33:24.445339    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xcft5\" (UniqueName: \"kubernetes.io/projected/c72ad103-92ba-4560-bc62-9d462b429a76-kube-api-access-xcft5\") pod \"cert-manager-cainjector-559cdd8c87-scclb\" (UID: \"c72ad103-92ba-4560-bc62-9d462b429a76\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-scclb"
Jul 22 04:33:24.539280 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:33:24.539196    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-cainjector-559cdd8c87-scclb"
Jul 22 04:33:24.659368 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:33:24.659339    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-cainjector-559cdd8c87-scclb"]
Jul 22 04:33:24.662594 ip-10-0-141-238 kubenswrapper[2563]: W0722 04:33:24.662564    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podc72ad103_92ba_4560_bc62_9d462b429a76.slice/crio-50a365499c3b976cfa36f87d74998a55da00116bf1873dae41f95e4b35695da7 WatchSource:0}: Error finding container 50a365499c3b976cfa36f87d74998a55da00116bf1873dae41f95e4b35695da7: Status 404 returned error can't find the container with id 50a365499c3b976cfa36f87d74998a55da00116bf1873dae41f95e4b35695da7
Jul 22 04:33:24.828095 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:33:24.828014    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-cainjector-559cdd8c87-scclb" event={"ID":"c72ad103-92ba-4560-bc62-9d462b429a76","Type":"ContainerStarted","Data":"50a365499c3b976cfa36f87d74998a55da00116bf1873dae41f95e4b35695da7"}
Jul 22 04:33:26.283535 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:33:26.283464    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j9gvx_b4af3ae5-fa65-4358-8399-6ed11b68616e/konnectivity-agent/0.log" limit=1024
Jul 22 04:33:26.339122 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:33:26.339082    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j9gvx_b4af3ae5-fa65-4358-8399-6ed11b68616e/konnectivity-agent/0.log" limit=1024
Jul 22 04:33:27.843306 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:33:27.843268    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-cainjector-559cdd8c87-scclb" event={"ID":"c72ad103-92ba-4560-bc62-9d462b429a76","Type":"ContainerStarted","Data":"c52f652756c7fb6e136489e71aeca9dcf9691304db7792a9f1f430659763215f"}
Jul 22 04:33:27.859456 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:33:27.859409    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-cainjector-559cdd8c87-scclb" podStartSLOduration=0.901940529 podStartE2EDuration="3.859390086s" totalImagesPullingTime="2.957449557s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 04:33:24 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 04:33:27.859137913 +0000 UTC m=+523.278146680" watchObservedRunningTime="2026-07-22 04:33:27.859390086 +0000 UTC m=+523.278398843"
Jul 22 04:33:31.562136 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:33:31.562099    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j9gvx_b4af3ae5-fa65-4358-8399-6ed11b68616e/konnectivity-agent/0.log" limit=1024
Jul 22 04:33:34.616489 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:33:34.616452    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-55b4d954d5-v4qcd"]
Jul 22 04:33:34.619574 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:33:34.619556    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-55b4d954d5-v4qcd"
Jul 22 04:33:34.622661 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:33:34.622638    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-dockercfg-c7x76\""
Jul 22 04:33:34.628632 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:33:34.628608    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-55b4d954d5-v4qcd"]
Jul 22 04:33:34.725373 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:33:34.725337    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-x86wm\" (UniqueName: \"kubernetes.io/projected/47833262-e1e4-48a7-9bfb-a56f56ef0216-kube-api-access-x86wm\") pod \"cert-manager-55b4d954d5-v4qcd\" (UID: \"47833262-e1e4-48a7-9bfb-a56f56ef0216\") " pod="cert-manager/cert-manager-55b4d954d5-v4qcd"
Jul 22 04:33:34.725373 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:33:34.725386    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/47833262-e1e4-48a7-9bfb-a56f56ef0216-bound-sa-token\") pod \"cert-manager-55b4d954d5-v4qcd\" (UID: \"47833262-e1e4-48a7-9bfb-a56f56ef0216\") " pod="cert-manager/cert-manager-55b4d954d5-v4qcd"
Jul 22 04:33:34.826371 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:33:34.826336    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-x86wm\" (UniqueName: \"kubernetes.io/projected/47833262-e1e4-48a7-9bfb-a56f56ef0216-kube-api-access-x86wm\") pod \"cert-manager-55b4d954d5-v4qcd\" (UID: \"47833262-e1e4-48a7-9bfb-a56f56ef0216\") " pod="cert-manager/cert-manager-55b4d954d5-v4qcd"
Jul 22 04:33:34.826519 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:33:34.826386    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/47833262-e1e4-48a7-9bfb-a56f56ef0216-bound-sa-token\") pod \"cert-manager-55b4d954d5-v4qcd\" (UID: \"47833262-e1e4-48a7-9bfb-a56f56ef0216\") " pod="cert-manager/cert-manager-55b4d954d5-v4qcd"
Jul 22 04:33:34.834143 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:33:34.834107    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/47833262-e1e4-48a7-9bfb-a56f56ef0216-bound-sa-token\") pod \"cert-manager-55b4d954d5-v4qcd\" (UID: \"47833262-e1e4-48a7-9bfb-a56f56ef0216\") " pod="cert-manager/cert-manager-55b4d954d5-v4qcd"
Jul 22 04:33:34.834249 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:33:34.834234    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-x86wm\" (UniqueName: \"kubernetes.io/projected/47833262-e1e4-48a7-9bfb-a56f56ef0216-kube-api-access-x86wm\") pod \"cert-manager-55b4d954d5-v4qcd\" (UID: \"47833262-e1e4-48a7-9bfb-a56f56ef0216\") " pod="cert-manager/cert-manager-55b4d954d5-v4qcd"
Jul 22 04:33:34.928513 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:33:34.928479    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-55b4d954d5-v4qcd"
Jul 22 04:33:35.058879 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:33:35.058787    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-55b4d954d5-v4qcd"]
Jul 22 04:33:35.062144 ip-10-0-141-238 kubenswrapper[2563]: W0722 04:33:35.062114    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod47833262_e1e4_48a7_9bfb_a56f56ef0216.slice/crio-be592e3db7a385481e8def6b327daa60239bce084f9b4adaa17b8ec5c0fee88b WatchSource:0}: Error finding container be592e3db7a385481e8def6b327daa60239bce084f9b4adaa17b8ec5c0fee88b: Status 404 returned error can't find the container with id be592e3db7a385481e8def6b327daa60239bce084f9b4adaa17b8ec5c0fee88b
Jul 22 04:33:35.873814 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:33:35.873779    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-55b4d954d5-v4qcd" event={"ID":"47833262-e1e4-48a7-9bfb-a56f56ef0216","Type":"ContainerStarted","Data":"2909dbf24110a9b431821727c76afaadd1dc85eb94ca86fe4070af51e2677f0d"}
Jul 22 04:33:35.874266 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:33:35.873821    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-55b4d954d5-v4qcd" event={"ID":"47833262-e1e4-48a7-9bfb-a56f56ef0216","Type":"ContainerStarted","Data":"be592e3db7a385481e8def6b327daa60239bce084f9b4adaa17b8ec5c0fee88b"}
Jul 22 04:33:43.704646 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:33:43.704552    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j9gvx_b4af3ae5-fa65-4358-8399-6ed11b68616e/konnectivity-agent/0.log" limit=1024
Jul 22 04:33:43.789307 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:33:43.789278    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j9gvx_b4af3ae5-fa65-4358-8399-6ed11b68616e/konnectivity-agent/0.log" limit=1024
Jul 22 04:33:49.678470 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:33:49.678437    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j9gvx_b4af3ae5-fa65-4358-8399-6ed11b68616e/konnectivity-agent/0.log" limit=1024
Jul 22 04:33:49.781016 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:33:49.780978    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j9gvx_b4af3ae5-fa65-4358-8399-6ed11b68616e/konnectivity-agent/0.log" limit=1024
Jul 22 04:33:51.571561 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:33:51.571506    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j9gvx_b4af3ae5-fa65-4358-8399-6ed11b68616e/konnectivity-agent/0.log" limit=1024
Jul 22 04:33:58.600353 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:33:58.600312    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j9gvx_b4af3ae5-fa65-4358-8399-6ed11b68616e/konnectivity-agent/0.log" limit=1024
Jul 22 04:33:58.700992 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:33:58.700956    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j9gvx_b4af3ae5-fa65-4358-8399-6ed11b68616e/konnectivity-agent/0.log" limit=1024
Jul 22 04:34:03.708285 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:34:03.708228    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j9gvx_b4af3ae5-fa65-4358-8399-6ed11b68616e/konnectivity-agent/0.log" limit=1024
Jul 22 04:34:03.819460 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:34:03.819427    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j9gvx_b4af3ae5-fa65-4358-8399-6ed11b68616e/konnectivity-agent/0.log" limit=1024
Jul 22 04:34:03.922383 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:34:03.922322    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-55b4d954d5-v4qcd" podStartSLOduration=29.922305649 podStartE2EDuration="29.922305649s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 04:33:34 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 04:33:35.908720273 +0000 UTC m=+531.327729030" watchObservedRunningTime="2026-07-22 04:34:03.922305649 +0000 UTC m=+559.341314405"
Jul 22 04:34:03.923148 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:34:03.923130    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/lws-controller-manager-596745447d-24fvs"]
Jul 22 04:34:03.927202 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:34:03.927182    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-596745447d-24fvs"
Jul 22 04:34:03.930062 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:34:03.930028    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"openshift-service-ca.crt\""
Jul 22 04:34:03.931281 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:34:03.931260    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"kube-root-ca.crt\""
Jul 22 04:34:03.931415 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:34:03.931291    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"webhook-server-cert\""
Jul 22 04:34:03.931415 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:34:03.931292    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"lws-manager-config\""
Jul 22 04:34:03.931415 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:34:03.931355    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"metrics-server-cert\""
Jul 22 04:34:03.931415 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:34:03.931366    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"lws-controller-manager-dockercfg-wdtv9\""
Jul 22 04:34:03.944322 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:34:03.944283    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j9gvx_b4af3ae5-fa65-4358-8399-6ed11b68616e/konnectivity-agent/0.log" limit=1024
Jul 22 04:34:03.947960 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:34:03.947940    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-596745447d-24fvs"]
Jul 22 04:34:03.957551 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:34:03.957529    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4pntz\" (UniqueName: \"kubernetes.io/projected/4f8bd0f3-ed4c-4d86-bc73-eea4713b335a-kube-api-access-4pntz\") pod \"lws-controller-manager-596745447d-24fvs\" (UID: \"4f8bd0f3-ed4c-4d86-bc73-eea4713b335a\") " pod="openshift-lws-operator/lws-controller-manager-596745447d-24fvs"
Jul 22 04:34:03.957645 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:34:03.957569    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/4f8bd0f3-ed4c-4d86-bc73-eea4713b335a-cert\") pod \"lws-controller-manager-596745447d-24fvs\" (UID: \"4f8bd0f3-ed4c-4d86-bc73-eea4713b335a\") " pod="openshift-lws-operator/lws-controller-manager-596745447d-24fvs"
Jul 22 04:34:03.957687 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:34:03.957646    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/4f8bd0f3-ed4c-4d86-bc73-eea4713b335a-manager-config\") pod \"lws-controller-manager-596745447d-24fvs\" (UID: \"4f8bd0f3-ed4c-4d86-bc73-eea4713b335a\") " pod="openshift-lws-operator/lws-controller-manager-596745447d-24fvs"
Jul 22 04:34:03.957739 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:34:03.957721    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/4f8bd0f3-ed4c-4d86-bc73-eea4713b335a-metrics-cert\") pod \"lws-controller-manager-596745447d-24fvs\" (UID: \"4f8bd0f3-ed4c-4d86-bc73-eea4713b335a\") " pod="openshift-lws-operator/lws-controller-manager-596745447d-24fvs"
Jul 22 04:34:04.058757 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:34:04.058678    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/4f8bd0f3-ed4c-4d86-bc73-eea4713b335a-manager-config\") pod \"lws-controller-manager-596745447d-24fvs\" (UID: \"4f8bd0f3-ed4c-4d86-bc73-eea4713b335a\") " pod="openshift-lws-operator/lws-controller-manager-596745447d-24fvs"
Jul 22 04:34:04.058757 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:34:04.058725    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/4f8bd0f3-ed4c-4d86-bc73-eea4713b335a-metrics-cert\") pod \"lws-controller-manager-596745447d-24fvs\" (UID: \"4f8bd0f3-ed4c-4d86-bc73-eea4713b335a\") " pod="openshift-lws-operator/lws-controller-manager-596745447d-24fvs"
Jul 22 04:34:04.058955 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:34:04.058765    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4pntz\" (UniqueName: \"kubernetes.io/projected/4f8bd0f3-ed4c-4d86-bc73-eea4713b335a-kube-api-access-4pntz\") pod \"lws-controller-manager-596745447d-24fvs\" (UID: \"4f8bd0f3-ed4c-4d86-bc73-eea4713b335a\") " pod="openshift-lws-operator/lws-controller-manager-596745447d-24fvs"
Jul 22 04:34:04.058955 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:34:04.058793    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/4f8bd0f3-ed4c-4d86-bc73-eea4713b335a-cert\") pod \"lws-controller-manager-596745447d-24fvs\" (UID: \"4f8bd0f3-ed4c-4d86-bc73-eea4713b335a\") " pod="openshift-lws-operator/lws-controller-manager-596745447d-24fvs"
Jul 22 04:34:04.059537 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:34:04.059505    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/4f8bd0f3-ed4c-4d86-bc73-eea4713b335a-manager-config\") pod \"lws-controller-manager-596745447d-24fvs\" (UID: \"4f8bd0f3-ed4c-4d86-bc73-eea4713b335a\") " pod="openshift-lws-operator/lws-controller-manager-596745447d-24fvs"
Jul 22 04:34:04.061420 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:34:04.061391    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/4f8bd0f3-ed4c-4d86-bc73-eea4713b335a-metrics-cert\") pod \"lws-controller-manager-596745447d-24fvs\" (UID: \"4f8bd0f3-ed4c-4d86-bc73-eea4713b335a\") " pod="openshift-lws-operator/lws-controller-manager-596745447d-24fvs"
Jul 22 04:34:04.061513 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:34:04.061439    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/4f8bd0f3-ed4c-4d86-bc73-eea4713b335a-cert\") pod \"lws-controller-manager-596745447d-24fvs\" (UID: \"4f8bd0f3-ed4c-4d86-bc73-eea4713b335a\") " pod="openshift-lws-operator/lws-controller-manager-596745447d-24fvs"
Jul 22 04:34:04.067592 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:34:04.067571    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4pntz\" (UniqueName: \"kubernetes.io/projected/4f8bd0f3-ed4c-4d86-bc73-eea4713b335a-kube-api-access-4pntz\") pod \"lws-controller-manager-596745447d-24fvs\" (UID: \"4f8bd0f3-ed4c-4d86-bc73-eea4713b335a\") " pod="openshift-lws-operator/lws-controller-manager-596745447d-24fvs"
Jul 22 04:34:04.236614 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:34:04.236581    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-596745447d-24fvs"
Jul 22 04:34:04.320877 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:34:04.320837    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j9gvx_b4af3ae5-fa65-4358-8399-6ed11b68616e/konnectivity-agent/0.log" limit=1024
Jul 22 04:34:04.370657 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:34:04.370625    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-596745447d-24fvs"]
Jul 22 04:34:04.373489 ip-10-0-141-238 kubenswrapper[2563]: W0722 04:34:04.373454    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4f8bd0f3_ed4c_4d86_bc73_eea4713b335a.slice/crio-c23a90cae54c98910fcfb38edb7ea56d2445baec4b3e0e00cf4cc1f40dbc0083 WatchSource:0}: Error finding container c23a90cae54c98910fcfb38edb7ea56d2445baec4b3e0e00cf4cc1f40dbc0083: Status 404 returned error can't find the container with id c23a90cae54c98910fcfb38edb7ea56d2445baec4b3e0e00cf4cc1f40dbc0083
Jul 22 04:34:04.739027 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:34:04.738991    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j9gvx_b4af3ae5-fa65-4358-8399-6ed11b68616e/konnectivity-agent/0.log" limit=1024
Jul 22 04:34:04.843184 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:34:04.843147    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j9gvx_b4af3ae5-fa65-4358-8399-6ed11b68616e/konnectivity-agent/0.log" limit=1024
Jul 22 04:34:04.888110 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:34:04.888075    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-5676cbf8df-57gh8"]
Jul 22 04:34:04.890445 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:34:04.890429    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-5676cbf8df-57gh8"
Jul 22 04:34:04.894168 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:34:04.894122    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\""
Jul 22 04:34:04.894318 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:34:04.894190    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\""
Jul 22 04:34:04.894318 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:34:04.894200    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-vs5b6\""
Jul 22 04:34:04.894318 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:34:04.894196    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\""
Jul 22 04:34:04.894318 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:34:04.894206    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\""
Jul 22 04:34:04.904366 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:34:04.904344    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-5676cbf8df-57gh8"]
Jul 22 04:34:04.967507 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:34:04.967476    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/e311b344-da67-4d9b-800b-7cd3f9040ea0-tmp\") pod \"opendatahub-operator-controller-manager-5676cbf8df-57gh8\" (UID: \"e311b344-da67-4d9b-800b-7cd3f9040ea0\") " pod="opendatahub/opendatahub-operator-controller-manager-5676cbf8df-57gh8"
Jul 22 04:34:04.967650 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:34:04.967510    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/e311b344-da67-4d9b-800b-7cd3f9040ea0-webhook-cert\") pod \"opendatahub-operator-controller-manager-5676cbf8df-57gh8\" (UID: \"e311b344-da67-4d9b-800b-7cd3f9040ea0\") " pod="opendatahub/opendatahub-operator-controller-manager-5676cbf8df-57gh8"
Jul 22 04:34:04.967650 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:34:04.967532    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/e311b344-da67-4d9b-800b-7cd3f9040ea0-manifests\") pod \"opendatahub-operator-controller-manager-5676cbf8df-57gh8\" (UID: \"e311b344-da67-4d9b-800b-7cd3f9040ea0\") " pod="opendatahub/opendatahub-operator-controller-manager-5676cbf8df-57gh8"
Jul 22 04:34:04.967650 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:34:04.967602    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/e311b344-da67-4d9b-800b-7cd3f9040ea0-apiservice-cert\") pod \"opendatahub-operator-controller-manager-5676cbf8df-57gh8\" (UID: \"e311b344-da67-4d9b-800b-7cd3f9040ea0\") " pod="opendatahub/opendatahub-operator-controller-manager-5676cbf8df-57gh8"
Jul 22 04:34:04.967650 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:34:04.967631    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kljzn\" (UniqueName: \"kubernetes.io/projected/e311b344-da67-4d9b-800b-7cd3f9040ea0-kube-api-access-kljzn\") pod \"opendatahub-operator-controller-manager-5676cbf8df-57gh8\" (UID: \"e311b344-da67-4d9b-800b-7cd3f9040ea0\") " pod="opendatahub/opendatahub-operator-controller-manager-5676cbf8df-57gh8"
Jul 22 04:34:04.980687 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:34:04.980661    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-596745447d-24fvs" event={"ID":"4f8bd0f3-ed4c-4d86-bc73-eea4713b335a","Type":"ContainerStarted","Data":"c23a90cae54c98910fcfb38edb7ea56d2445baec4b3e0e00cf4cc1f40dbc0083"}
Jul 22 04:34:05.014234 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:34:05.014143    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j9gvx_b4af3ae5-fa65-4358-8399-6ed11b68616e/konnectivity-agent/0.log" limit=1024
Jul 22 04:34:05.068135 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:34:05.068097    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/e311b344-da67-4d9b-800b-7cd3f9040ea0-tmp\") pod \"opendatahub-operator-controller-manager-5676cbf8df-57gh8\" (UID: \"e311b344-da67-4d9b-800b-7cd3f9040ea0\") " pod="opendatahub/opendatahub-operator-controller-manager-5676cbf8df-57gh8"
Jul 22 04:34:05.068314 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:34:05.068149    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/e311b344-da67-4d9b-800b-7cd3f9040ea0-webhook-cert\") pod \"opendatahub-operator-controller-manager-5676cbf8df-57gh8\" (UID: \"e311b344-da67-4d9b-800b-7cd3f9040ea0\") " pod="opendatahub/opendatahub-operator-controller-manager-5676cbf8df-57gh8"
Jul 22 04:34:05.068314 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:34:05.068185    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/e311b344-da67-4d9b-800b-7cd3f9040ea0-manifests\") pod \"opendatahub-operator-controller-manager-5676cbf8df-57gh8\" (UID: \"e311b344-da67-4d9b-800b-7cd3f9040ea0\") " pod="opendatahub/opendatahub-operator-controller-manager-5676cbf8df-57gh8"
Jul 22 04:34:05.068314 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:34:05.068243    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/e311b344-da67-4d9b-800b-7cd3f9040ea0-apiservice-cert\") pod \"opendatahub-operator-controller-manager-5676cbf8df-57gh8\" (UID: \"e311b344-da67-4d9b-800b-7cd3f9040ea0\") " pod="opendatahub/opendatahub-operator-controller-manager-5676cbf8df-57gh8"
Jul 22 04:34:05.068314 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:34:05.068288    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kljzn\" (UniqueName: \"kubernetes.io/projected/e311b344-da67-4d9b-800b-7cd3f9040ea0-kube-api-access-kljzn\") pod \"opendatahub-operator-controller-manager-5676cbf8df-57gh8\" (UID: \"e311b344-da67-4d9b-800b-7cd3f9040ea0\") " pod="opendatahub/opendatahub-operator-controller-manager-5676cbf8df-57gh8"
Jul 22 04:34:05.068715 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:34:05.068663    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/e311b344-da67-4d9b-800b-7cd3f9040ea0-manifests\") pod \"opendatahub-operator-controller-manager-5676cbf8df-57gh8\" (UID: \"e311b344-da67-4d9b-800b-7cd3f9040ea0\") " pod="opendatahub/opendatahub-operator-controller-manager-5676cbf8df-57gh8"
Jul 22 04:34:05.070976 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:34:05.070949    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/e311b344-da67-4d9b-800b-7cd3f9040ea0-tmp\") pod \"opendatahub-operator-controller-manager-5676cbf8df-57gh8\" (UID: \"e311b344-da67-4d9b-800b-7cd3f9040ea0\") " pod="opendatahub/opendatahub-operator-controller-manager-5676cbf8df-57gh8"
Jul 22 04:34:05.071214 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:34:05.071192    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/e311b344-da67-4d9b-800b-7cd3f9040ea0-apiservice-cert\") pod \"opendatahub-operator-controller-manager-5676cbf8df-57gh8\" (UID: \"e311b344-da67-4d9b-800b-7cd3f9040ea0\") " pod="opendatahub/opendatahub-operator-controller-manager-5676cbf8df-57gh8"
Jul 22 04:34:05.071315 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:34:05.071293    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/e311b344-da67-4d9b-800b-7cd3f9040ea0-webhook-cert\") pod \"opendatahub-operator-controller-manager-5676cbf8df-57gh8\" (UID: \"e311b344-da67-4d9b-800b-7cd3f9040ea0\") " pod="opendatahub/opendatahub-operator-controller-manager-5676cbf8df-57gh8"
Jul 22 04:34:05.090317 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:34:05.090292    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kljzn\" (UniqueName: \"kubernetes.io/projected/e311b344-da67-4d9b-800b-7cd3f9040ea0-kube-api-access-kljzn\") pod \"opendatahub-operator-controller-manager-5676cbf8df-57gh8\" (UID: \"e311b344-da67-4d9b-800b-7cd3f9040ea0\") " pod="opendatahub/opendatahub-operator-controller-manager-5676cbf8df-57gh8"
Jul 22 04:34:05.123982 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:34:05.123946    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j9gvx_b4af3ae5-fa65-4358-8399-6ed11b68616e/konnectivity-agent/0.log" limit=1024
Jul 22 04:34:05.201199 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:34:05.201167    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-5676cbf8df-57gh8"
Jul 22 04:34:05.227983 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:34:05.227950    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j9gvx_b4af3ae5-fa65-4358-8399-6ed11b68616e/konnectivity-agent/0.log" limit=1024
Jul 22 04:34:05.326179 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:34:05.325105    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j9gvx_b4af3ae5-fa65-4358-8399-6ed11b68616e/konnectivity-agent/0.log" limit=1024
Jul 22 04:34:05.374981 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:34:05.374351    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-5676cbf8df-57gh8"]
Jul 22 04:34:05.377247 ip-10-0-141-238 kubenswrapper[2563]: W0722 04:34:05.377213    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode311b344_da67_4d9b_800b_7cd3f9040ea0.slice/crio-155a017f1ab21c0f0445457b8058bff96fcfbec16a21ad31dad6af8d27b3a309 WatchSource:0}: Error finding container 155a017f1ab21c0f0445457b8058bff96fcfbec16a21ad31dad6af8d27b3a309: Status 404 returned error can't find the container with id 155a017f1ab21c0f0445457b8058bff96fcfbec16a21ad31dad6af8d27b3a309
Jul 22 04:34:05.425084 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:34:05.424973    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j9gvx_b4af3ae5-fa65-4358-8399-6ed11b68616e/konnectivity-agent/0.log" limit=1024
Jul 22 04:34:05.986615 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:34:05.986578    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-5676cbf8df-57gh8" event={"ID":"e311b344-da67-4d9b-800b-7cd3f9040ea0","Type":"ContainerStarted","Data":"155a017f1ab21c0f0445457b8058bff96fcfbec16a21ad31dad6af8d27b3a309"}
Jul 22 04:34:06.995004 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:34:06.994961    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-596745447d-24fvs" event={"ID":"4f8bd0f3-ed4c-4d86-bc73-eea4713b335a","Type":"ContainerStarted","Data":"45d0bb512c2778cfc356db90353eb52e723dab6a01a53e06897e6bc2bf64dd62"}
Jul 22 04:34:06.995669 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:34:06.995558    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-lws-operator/lws-controller-manager-596745447d-24fvs"
Jul 22 04:34:07.013438 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:34:07.013380    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/lws-controller-manager-596745447d-24fvs" podStartSLOduration=1.5540048359999998 podStartE2EDuration="4.013360573s" totalImagesPullingTime="2.459355737s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 04:34:03 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 04:34:07.012396234 +0000 UTC m=+562.431404994" watchObservedRunningTime="2026-07-22 04:34:07.013360573 +0000 UTC m=+562.432369321"
Jul 22 04:34:10.009489 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:34:10.009454    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-5676cbf8df-57gh8" event={"ID":"e311b344-da67-4d9b-800b-7cd3f9040ea0","Type":"ContainerStarted","Data":"db396952916c048f12e0236491d8c655dcfff2e92b19f1bfd3bebc7bec50eb5b"}
Jul 22 04:34:11.015197 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:34:11.015157    2563 generic.go:356] "Generic (PLEG): container finished" podID="e311b344-da67-4d9b-800b-7cd3f9040ea0" containerID="db396952916c048f12e0236491d8c655dcfff2e92b19f1bfd3bebc7bec50eb5b" exitCode=0
Jul 22 04:34:11.015564 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:34:11.015235    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-5676cbf8df-57gh8" event={"ID":"e311b344-da67-4d9b-800b-7cd3f9040ea0","Type":"ContainerDied","Data":"db396952916c048f12e0236491d8c655dcfff2e92b19f1bfd3bebc7bec50eb5b"}
Jul 22 04:34:12.027651 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:34:12.027607    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-5676cbf8df-57gh8" event={"ID":"e311b344-da67-4d9b-800b-7cd3f9040ea0","Type":"ContainerStarted","Data":"728e2dae9ac2c3219506daf34a22c1b266877a18bcf35e1d4c48563385b040b2"}
Jul 22 04:34:12.028101 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:34:12.027744    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-5676cbf8df-57gh8"
Jul 22 04:34:12.049484 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:34:12.049428    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-5676cbf8df-57gh8" podStartSLOduration=2.786952268 podStartE2EDuration="8.049411951s" totalImagesPullingTime="4.220476278s" totalInitContainerRuntime="1.041983405s" isStatefulPod=false podCreationTimestamp="2026-07-22 04:34:04 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 04:34:12.047883359 +0000 UTC m=+567.466892115" watchObservedRunningTime="2026-07-22 04:34:12.049411951 +0000 UTC m=+567.468420708"
Jul 22 04:34:16.541819 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:34:16.541785    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j9gvx_b4af3ae5-fa65-4358-8399-6ed11b68616e/konnectivity-agent/0.log" limit=1024
Jul 22 04:34:16.592252 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:34:16.592219    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j9gvx_b4af3ae5-fa65-4358-8399-6ed11b68616e/konnectivity-agent/0.log" limit=1024
Jul 22 04:34:16.971769 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:34:16.971733    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j9gvx_b4af3ae5-fa65-4358-8399-6ed11b68616e/konnectivity-agent/0.log" limit=1024
Jul 22 04:34:17.073553 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:34:17.073514    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j9gvx_b4af3ae5-fa65-4358-8399-6ed11b68616e/konnectivity-agent/0.log" limit=1024
Jul 22 04:34:19.006876 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:34:19.006840    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-lws-operator/lws-controller-manager-596745447d-24fvs"
Jul 22 04:34:23.035302 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:34:23.035274    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-5676cbf8df-57gh8"
Jul 22 04:34:24.599487 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:34:24.599447    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j9gvx_b4af3ae5-fa65-4358-8399-6ed11b68616e/konnectivity-agent/0.log" limit=1024
Jul 22 04:34:24.763844 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:34:24.763809    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j9gvx_b4af3ae5-fa65-4358-8399-6ed11b68616e/konnectivity-agent/0.log" limit=1024
Jul 22 04:34:25.017381 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:34:25.017346    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j9gvx_b4af3ae5-fa65-4358-8399-6ed11b68616e/konnectivity-agent/0.log" limit=1024
Jul 22 04:34:25.312339 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:34:25.312259    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j9gvx_b4af3ae5-fa65-4358-8399-6ed11b68616e/konnectivity-agent/0.log" limit=1024
Jul 22 04:34:25.417507 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:34:25.417478    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j9gvx_b4af3ae5-fa65-4358-8399-6ed11b68616e/konnectivity-agent/0.log" limit=1024
Jul 22 04:34:25.617840 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:34:25.617756    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j9gvx_b4af3ae5-fa65-4358-8399-6ed11b68616e/konnectivity-agent/0.log" limit=1024
Jul 22 04:34:25.792296 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:34:25.792259    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j9gvx_b4af3ae5-fa65-4358-8399-6ed11b68616e/konnectivity-agent/0.log" limit=1024
Jul 22 04:34:25.896579 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:34:25.896491    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j9gvx_b4af3ae5-fa65-4358-8399-6ed11b68616e/konnectivity-agent/0.log" limit=1024
Jul 22 04:34:26.149271 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:34:26.149187    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j9gvx_b4af3ae5-fa65-4358-8399-6ed11b68616e/konnectivity-agent/0.log" limit=1024
Jul 22 04:34:26.456997 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:34:26.456954    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j9gvx_b4af3ae5-fa65-4358-8399-6ed11b68616e/konnectivity-agent/0.log" limit=1024
Jul 22 04:34:26.523393 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:34:26.523354    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j9gvx_b4af3ae5-fa65-4358-8399-6ed11b68616e/konnectivity-agent/0.log" limit=1024
Jul 22 04:34:27.420642 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:34:27.420601    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j9gvx_b4af3ae5-fa65-4358-8399-6ed11b68616e/konnectivity-agent/0.log" limit=1024
Jul 22 04:34:32.573329 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:34:32.573291    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j9gvx_b4af3ae5-fa65-4358-8399-6ed11b68616e/konnectivity-agent/0.log" limit=1024
Jul 22 04:34:32.677339 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:34:32.677291    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j9gvx_b4af3ae5-fa65-4358-8399-6ed11b68616e/konnectivity-agent/0.log" limit=1024
Jul 22 04:34:33.303739 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:34:33.303707    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf45tzwz"]
Jul 22 04:34:33.314033 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:34:33.314011    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf45tzwz"
Jul 22 04:34:33.317125 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:34:33.317099    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"data-science-gateway-data-science-gateway-class-dockercfg-5r4gw\""
Jul 22 04:34:33.317125 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:34:33.317127    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\""
Jul 22 04:34:33.323845 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:34:33.323810    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf45tzwz"]
Jul 22 04:34:33.346213 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:34:33.346181    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j9gvx_b4af3ae5-fa65-4358-8399-6ed11b68616e/konnectivity-agent/0.log" limit=1024
Jul 22 04:34:33.405303 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:34:33.405266    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b700f458-54be-4c31-b4ac-51e1485596fd-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-6576859cf45tzwz\" (UID: \"b700f458-54be-4c31-b4ac-51e1485596fd\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf45tzwz"
Jul 22 04:34:33.405462 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:34:33.405339    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b700f458-54be-4c31-b4ac-51e1485596fd-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-6576859cf45tzwz\" (UID: \"b700f458-54be-4c31-b4ac-51e1485596fd\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf45tzwz"
Jul 22 04:34:33.405462 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:34:33.405371    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xlhhk\" (UniqueName: \"kubernetes.io/projected/b700f458-54be-4c31-b4ac-51e1485596fd-kube-api-access-xlhhk\") pod \"data-science-gateway-data-science-gateway-class-6576859cf45tzwz\" (UID: \"b700f458-54be-4c31-b4ac-51e1485596fd\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf45tzwz"
Jul 22 04:34:33.405462 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:34:33.405411    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b700f458-54be-4c31-b4ac-51e1485596fd-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-6576859cf45tzwz\" (UID: \"b700f458-54be-4c31-b4ac-51e1485596fd\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf45tzwz"
Jul 22 04:34:33.405462 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:34:33.405447    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b700f458-54be-4c31-b4ac-51e1485596fd-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-6576859cf45tzwz\" (UID: \"b700f458-54be-4c31-b4ac-51e1485596fd\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf45tzwz"
Jul 22 04:34:33.405604 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:34:33.405493    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b700f458-54be-4c31-b4ac-51e1485596fd-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-6576859cf45tzwz\" (UID: \"b700f458-54be-4c31-b4ac-51e1485596fd\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf45tzwz"
Jul 22 04:34:33.405604 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:34:33.405521    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b700f458-54be-4c31-b4ac-51e1485596fd-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-6576859cf45tzwz\" (UID: \"b700f458-54be-4c31-b4ac-51e1485596fd\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf45tzwz"
Jul 22 04:34:33.405604 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:34:33.405545    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b700f458-54be-4c31-b4ac-51e1485596fd-istio-data\") pod \"data-science-gateway-data-science-gateway-class-6576859cf45tzwz\" (UID: \"b700f458-54be-4c31-b4ac-51e1485596fd\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf45tzwz"
Jul 22 04:34:33.405604 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:34:33.405577    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b700f458-54be-4c31-b4ac-51e1485596fd-istio-token\") pod \"data-science-gateway-data-science-gateway-class-6576859cf45tzwz\" (UID: \"b700f458-54be-4c31-b4ac-51e1485596fd\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf45tzwz"
Jul 22 04:34:33.506704 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:34:33.506667    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b700f458-54be-4c31-b4ac-51e1485596fd-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-6576859cf45tzwz\" (UID: \"b700f458-54be-4c31-b4ac-51e1485596fd\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf45tzwz"
Jul 22 04:34:33.506704 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:34:33.506703    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b700f458-54be-4c31-b4ac-51e1485596fd-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-6576859cf45tzwz\" (UID: \"b700f458-54be-4c31-b4ac-51e1485596fd\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf45tzwz"
Jul 22 04:34:33.506915 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:34:33.506725    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xlhhk\" (UniqueName: \"kubernetes.io/projected/b700f458-54be-4c31-b4ac-51e1485596fd-kube-api-access-xlhhk\") pod \"data-science-gateway-data-science-gateway-class-6576859cf45tzwz\" (UID: \"b700f458-54be-4c31-b4ac-51e1485596fd\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf45tzwz"
Jul 22 04:34:33.506915 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:34:33.506849    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b700f458-54be-4c31-b4ac-51e1485596fd-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-6576859cf45tzwz\" (UID: \"b700f458-54be-4c31-b4ac-51e1485596fd\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf45tzwz"
Jul 22 04:34:33.506915 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:34:33.506912    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b700f458-54be-4c31-b4ac-51e1485596fd-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-6576859cf45tzwz\" (UID: \"b700f458-54be-4c31-b4ac-51e1485596fd\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf45tzwz"
Jul 22 04:34:33.507101 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:34:33.506946    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b700f458-54be-4c31-b4ac-51e1485596fd-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-6576859cf45tzwz\" (UID: \"b700f458-54be-4c31-b4ac-51e1485596fd\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf45tzwz"
Jul 22 04:34:33.507101 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:34:33.506978    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b700f458-54be-4c31-b4ac-51e1485596fd-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-6576859cf45tzwz\" (UID: \"b700f458-54be-4c31-b4ac-51e1485596fd\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf45tzwz"
Jul 22 04:34:33.507101 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:34:33.506994    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b700f458-54be-4c31-b4ac-51e1485596fd-istio-data\") pod \"data-science-gateway-data-science-gateway-class-6576859cf45tzwz\" (UID: \"b700f458-54be-4c31-b4ac-51e1485596fd\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf45tzwz"
Jul 22 04:34:33.507257 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:34:33.507099    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b700f458-54be-4c31-b4ac-51e1485596fd-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-6576859cf45tzwz\" (UID: \"b700f458-54be-4c31-b4ac-51e1485596fd\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf45tzwz"
Jul 22 04:34:33.507257 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:34:33.507142    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b700f458-54be-4c31-b4ac-51e1485596fd-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-6576859cf45tzwz\" (UID: \"b700f458-54be-4c31-b4ac-51e1485596fd\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf45tzwz"
Jul 22 04:34:33.507257 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:34:33.507149    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b700f458-54be-4c31-b4ac-51e1485596fd-istio-token\") pod \"data-science-gateway-data-science-gateway-class-6576859cf45tzwz\" (UID: \"b700f458-54be-4c31-b4ac-51e1485596fd\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf45tzwz"
Jul 22 04:34:33.507418 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:34:33.507297    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b700f458-54be-4c31-b4ac-51e1485596fd-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-6576859cf45tzwz\" (UID: \"b700f458-54be-4c31-b4ac-51e1485596fd\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf45tzwz"
Jul 22 04:34:33.507418 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:34:33.507377    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b700f458-54be-4c31-b4ac-51e1485596fd-istio-data\") pod \"data-science-gateway-data-science-gateway-class-6576859cf45tzwz\" (UID: \"b700f458-54be-4c31-b4ac-51e1485596fd\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf45tzwz"
Jul 22 04:34:33.507662 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:34:33.507634    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b700f458-54be-4c31-b4ac-51e1485596fd-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-6576859cf45tzwz\" (UID: \"b700f458-54be-4c31-b4ac-51e1485596fd\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf45tzwz"
Jul 22 04:34:33.509274 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:34:33.509255    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b700f458-54be-4c31-b4ac-51e1485596fd-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-6576859cf45tzwz\" (UID: \"b700f458-54be-4c31-b4ac-51e1485596fd\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf45tzwz"
Jul 22 04:34:33.509441 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:34:33.509422    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b700f458-54be-4c31-b4ac-51e1485596fd-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-6576859cf45tzwz\" (UID: \"b700f458-54be-4c31-b4ac-51e1485596fd\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf45tzwz"
Jul 22 04:34:33.521440 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:34:33.521413    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xlhhk\" (UniqueName: \"kubernetes.io/projected/b700f458-54be-4c31-b4ac-51e1485596fd-kube-api-access-xlhhk\") pod \"data-science-gateway-data-science-gateway-class-6576859cf45tzwz\" (UID: \"b700f458-54be-4c31-b4ac-51e1485596fd\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf45tzwz"
Jul 22 04:34:33.521664 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:34:33.521647    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b700f458-54be-4c31-b4ac-51e1485596fd-istio-token\") pod \"data-science-gateway-data-science-gateway-class-6576859cf45tzwz\" (UID: \"b700f458-54be-4c31-b4ac-51e1485596fd\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf45tzwz"
Jul 22 04:34:33.616074 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:34:33.615966    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j9gvx_b4af3ae5-fa65-4358-8399-6ed11b68616e/konnectivity-agent/0.log" limit=1024
Jul 22 04:34:33.625115 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:34:33.625097    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf45tzwz"
Jul 22 04:34:33.756624 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:34:33.756545    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf45tzwz"]
Jul 22 04:34:33.759257 ip-10-0-141-238 kubenswrapper[2563]: W0722 04:34:33.759232    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb700f458_54be_4c31_b4ac_51e1485596fd.slice/crio-dedbf2d1419a6610a8e3f958ff10ec5e888040c5c1b3504f774108533ba51455 WatchSource:0}: Error finding container dedbf2d1419a6610a8e3f958ff10ec5e888040c5c1b3504f774108533ba51455: Status 404 returned error can't find the container with id dedbf2d1419a6610a8e3f958ff10ec5e888040c5c1b3504f774108533ba51455
Jul 22 04:34:33.807168 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:34:33.807136    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j9gvx_b4af3ae5-fa65-4358-8399-6ed11b68616e/konnectivity-agent/0.log" limit=1024
Jul 22 04:34:33.904643 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:34:33.904610    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/istiod-openshift-gateway-94bb8fbfd-gxjkj"]
Jul 22 04:34:33.907439 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:34:33.907418    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-gxjkj"
Jul 22 04:34:33.909678 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:34:33.909659    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istio-kubeconfig\""
Jul 22 04:34:33.909803 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:34:33.909678    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-openshift-gateway-dockercfg-7j8lf\""
Jul 22 04:34:33.909803 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:34:33.909663    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-tls\""
Jul 22 04:34:33.909919 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:34:33.909898    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"cacerts\""
Jul 22 04:34:33.918684 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:34:33.918665    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-94bb8fbfd-gxjkj"]
Jul 22 04:34:34.011357 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:34:34.011326    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/2b0a5325-d9c8-4435-b47f-f4fe759969b3-local-certs\") pod \"istiod-openshift-gateway-94bb8fbfd-gxjkj\" (UID: \"2b0a5325-d9c8-4435-b47f-f4fe759969b3\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-gxjkj"
Jul 22 04:34:34.011499 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:34:34.011383    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/2b0a5325-d9c8-4435-b47f-f4fe759969b3-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-94bb8fbfd-gxjkj\" (UID: \"2b0a5325-d9c8-4435-b47f-f4fe759969b3\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-gxjkj"
Jul 22 04:34:34.011499 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:34:34.011428    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/2b0a5325-d9c8-4435-b47f-f4fe759969b3-istio-kubeconfig\") pod \"istiod-openshift-gateway-94bb8fbfd-gxjkj\" (UID: \"2b0a5325-d9c8-4435-b47f-f4fe759969b3\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-gxjkj"
Jul 22 04:34:34.011499 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:34:34.011477    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/2b0a5325-d9c8-4435-b47f-f4fe759969b3-istio-token\") pod \"istiod-openshift-gateway-94bb8fbfd-gxjkj\" (UID: \"2b0a5325-d9c8-4435-b47f-f4fe759969b3\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-gxjkj"
Jul 22 04:34:34.011499 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:34:34.011497    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nwxvf\" (UniqueName: \"kubernetes.io/projected/2b0a5325-d9c8-4435-b47f-f4fe759969b3-kube-api-access-nwxvf\") pod \"istiod-openshift-gateway-94bb8fbfd-gxjkj\" (UID: \"2b0a5325-d9c8-4435-b47f-f4fe759969b3\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-gxjkj"
Jul 22 04:34:34.011650 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:34:34.011527    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/2b0a5325-d9c8-4435-b47f-f4fe759969b3-cacerts\") pod \"istiod-openshift-gateway-94bb8fbfd-gxjkj\" (UID: \"2b0a5325-d9c8-4435-b47f-f4fe759969b3\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-gxjkj"
Jul 22 04:34:34.011650 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:34:34.011558    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/2b0a5325-d9c8-4435-b47f-f4fe759969b3-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-94bb8fbfd-gxjkj\" (UID: \"2b0a5325-d9c8-4435-b47f-f4fe759969b3\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-gxjkj"
Jul 22 04:34:34.112187 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:34:34.112156    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/2b0a5325-d9c8-4435-b47f-f4fe759969b3-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-94bb8fbfd-gxjkj\" (UID: \"2b0a5325-d9c8-4435-b47f-f4fe759969b3\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-gxjkj"
Jul 22 04:34:34.112187 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:34:34.112188    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/2b0a5325-d9c8-4435-b47f-f4fe759969b3-istio-kubeconfig\") pod \"istiod-openshift-gateway-94bb8fbfd-gxjkj\" (UID: \"2b0a5325-d9c8-4435-b47f-f4fe759969b3\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-gxjkj"
Jul 22 04:34:34.112403 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:34:34.112217    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/2b0a5325-d9c8-4435-b47f-f4fe759969b3-istio-token\") pod \"istiod-openshift-gateway-94bb8fbfd-gxjkj\" (UID: \"2b0a5325-d9c8-4435-b47f-f4fe759969b3\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-gxjkj"
Jul 22 04:34:34.112403 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:34:34.112232    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nwxvf\" (UniqueName: \"kubernetes.io/projected/2b0a5325-d9c8-4435-b47f-f4fe759969b3-kube-api-access-nwxvf\") pod \"istiod-openshift-gateway-94bb8fbfd-gxjkj\" (UID: \"2b0a5325-d9c8-4435-b47f-f4fe759969b3\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-gxjkj"
Jul 22 04:34:34.112403 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:34:34.112259    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/2b0a5325-d9c8-4435-b47f-f4fe759969b3-cacerts\") pod \"istiod-openshift-gateway-94bb8fbfd-gxjkj\" (UID: \"2b0a5325-d9c8-4435-b47f-f4fe759969b3\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-gxjkj"
Jul 22 04:34:34.112403 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:34:34.112277    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/2b0a5325-d9c8-4435-b47f-f4fe759969b3-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-94bb8fbfd-gxjkj\" (UID: \"2b0a5325-d9c8-4435-b47f-f4fe759969b3\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-gxjkj"
Jul 22 04:34:34.112403 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:34:34.112306    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/2b0a5325-d9c8-4435-b47f-f4fe759969b3-local-certs\") pod \"istiod-openshift-gateway-94bb8fbfd-gxjkj\" (UID: \"2b0a5325-d9c8-4435-b47f-f4fe759969b3\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-gxjkj"
Jul 22 04:34:34.113181 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:34:34.113154    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/2b0a5325-d9c8-4435-b47f-f4fe759969b3-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-94bb8fbfd-gxjkj\" (UID: \"2b0a5325-d9c8-4435-b47f-f4fe759969b3\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-gxjkj"
Jul 22 04:34:34.114604 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:34:34.114574    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/2b0a5325-d9c8-4435-b47f-f4fe759969b3-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-94bb8fbfd-gxjkj\" (UID: \"2b0a5325-d9c8-4435-b47f-f4fe759969b3\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-gxjkj"
Jul 22 04:34:34.114723 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:34:34.114616    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/2b0a5325-d9c8-4435-b47f-f4fe759969b3-istio-kubeconfig\") pod \"istiod-openshift-gateway-94bb8fbfd-gxjkj\" (UID: \"2b0a5325-d9c8-4435-b47f-f4fe759969b3\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-gxjkj"
Jul 22 04:34:34.114723 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:34:34.114672    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/2b0a5325-d9c8-4435-b47f-f4fe759969b3-cacerts\") pod \"istiod-openshift-gateway-94bb8fbfd-gxjkj\" (UID: \"2b0a5325-d9c8-4435-b47f-f4fe759969b3\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-gxjkj"
Jul 22 04:34:34.114847 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:34:34.114827    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/2b0a5325-d9c8-4435-b47f-f4fe759969b3-local-certs\") pod \"istiod-openshift-gateway-94bb8fbfd-gxjkj\" (UID: \"2b0a5325-d9c8-4435-b47f-f4fe759969b3\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-gxjkj"
Jul 22 04:34:34.119871 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:34:34.119851    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/2b0a5325-d9c8-4435-b47f-f4fe759969b3-istio-token\") pod \"istiod-openshift-gateway-94bb8fbfd-gxjkj\" (UID: \"2b0a5325-d9c8-4435-b47f-f4fe759969b3\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-gxjkj"
Jul 22 04:34:34.120132 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:34:34.120115    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-nwxvf\" (UniqueName: \"kubernetes.io/projected/2b0a5325-d9c8-4435-b47f-f4fe759969b3-kube-api-access-nwxvf\") pod \"istiod-openshift-gateway-94bb8fbfd-gxjkj\" (UID: \"2b0a5325-d9c8-4435-b47f-f4fe759969b3\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-gxjkj"
Jul 22 04:34:34.124963 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:34:34.124938    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf45tzwz" event={"ID":"b700f458-54be-4c31-b4ac-51e1485596fd","Type":"ContainerStarted","Data":"dedbf2d1419a6610a8e3f958ff10ec5e888040c5c1b3504f774108533ba51455"}
Jul 22 04:34:34.216581 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:34:34.216497    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-gxjkj"
Jul 22 04:34:34.370366 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:34:34.370343    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-94bb8fbfd-gxjkj"]
Jul 22 04:34:34.371521 ip-10-0-141-238 kubenswrapper[2563]: W0722 04:34:34.371500    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2b0a5325_d9c8_4435_b47f_f4fe759969b3.slice/crio-7b171573a6cd014046a77e7ac8f4deb565f1e6d04e790e7d42ebbaf50277c162 WatchSource:0}: Error finding container 7b171573a6cd014046a77e7ac8f4deb565f1e6d04e790e7d42ebbaf50277c162: Status 404 returned error can't find the container with id 7b171573a6cd014046a77e7ac8f4deb565f1e6d04e790e7d42ebbaf50277c162
Jul 22 04:34:35.131357 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:34:35.131323    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-gxjkj" event={"ID":"2b0a5325-d9c8-4435-b47f-f4fe759969b3","Type":"ContainerStarted","Data":"7b171573a6cd014046a77e7ac8f4deb565f1e6d04e790e7d42ebbaf50277c162"}
Jul 22 04:34:36.361334 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:34:36.361299    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j9gvx_b4af3ae5-fa65-4358-8399-6ed11b68616e/konnectivity-agent/0.log" limit=1024
Jul 22 04:34:36.460635 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:34:36.460598    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j9gvx_b4af3ae5-fa65-4358-8399-6ed11b68616e/konnectivity-agent/0.log" limit=1024
Jul 22 04:34:36.884009 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:34:36.883973    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j9gvx_b4af3ae5-fa65-4358-8399-6ed11b68616e/konnectivity-agent/0.log" limit=1024
Jul 22 04:34:37.014348 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:34:37.014301    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j9gvx_b4af3ae5-fa65-4358-8399-6ed11b68616e/konnectivity-agent/0.log" limit=1024
Jul 22 04:34:37.493839 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:34:37.493784    2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 22 04:34:37.494204 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:34:37.493900    2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 22 04:34:37.494204 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:34:37.493929    2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 22 04:34:37.495238 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:34:37.495211    2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 22 04:34:37.495312 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:34:37.495261    2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 22 04:34:37.631292 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:34:37.631260    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j9gvx_b4af3ae5-fa65-4358-8399-6ed11b68616e/konnectivity-agent/0.log" limit=1024
Jul 22 04:34:37.732142 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:34:37.732108    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j9gvx_b4af3ae5-fa65-4358-8399-6ed11b68616e/konnectivity-agent/0.log" limit=1024
Jul 22 04:34:37.866107 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:34:37.865978    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j9gvx_b4af3ae5-fa65-4358-8399-6ed11b68616e/konnectivity-agent/0.log" limit=1024
Jul 22 04:34:38.147542 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:34:38.147454    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf45tzwz" event={"ID":"b700f458-54be-4c31-b4ac-51e1485596fd","Type":"ContainerStarted","Data":"ba55f83e08fca876708c57424799000c9eb3ff23e8dff400eef5c3b8ac5159cc"}
Jul 22 04:34:38.149145 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:34:38.149119    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-gxjkj" event={"ID":"2b0a5325-d9c8-4435-b47f-f4fe759969b3","Type":"ContainerStarted","Data":"37b77a82024683798bd668194640a3c1fab97d90870f590e22f8627446ae49ff"}
Jul 22 04:34:38.149273 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:34:38.149170    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-gxjkj"
Jul 22 04:34:38.151010 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:34:38.150983    2563 patch_prober.go:28] interesting pod/istiod-openshift-gateway-94bb8fbfd-gxjkj container/discovery namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Jul 22 04:34:38.151136 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:34:38.151050    2563 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-gxjkj" podUID="2b0a5325-d9c8-4435-b47f-f4fe759969b3" containerName="discovery" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 22 04:34:38.172243 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:34:38.172202    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf45tzwz" podStartSLOduration=1.439921757 podStartE2EDuration="5.172189185s" totalImagesPullingTime="3.732267428s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 04:34:33 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 04:34:38.171702049 +0000 UTC m=+593.590710820" watchObservedRunningTime="2026-07-22 04:34:38.172189185 +0000 UTC m=+593.591197943"
Jul 22 04:34:38.191558 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:34:38.191503    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-gxjkj" podStartSLOduration=2.070039819 podStartE2EDuration="5.191484705s" totalImagesPullingTime="3.121444886s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 04:34:33 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 04:34:38.190327704 +0000 UTC m=+593.609336462" watchObservedRunningTime="2026-07-22 04:34:38.191484705 +0000 UTC m=+593.610493464"
Jul 22 04:34:38.626217 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:34:38.626183    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf45tzwz"
Jul 22 04:34:38.631326 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:34:38.631298    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf45tzwz"
Jul 22 04:34:39.154085 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:34:39.154030    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf45tzwz"
Jul 22 04:34:39.154568 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:34:39.154547    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-gxjkj"
Jul 22 04:34:39.155034 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:34:39.155019    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf45tzwz"
Jul 22 04:34:39.369585 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:34:39.369554    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j9gvx_b4af3ae5-fa65-4358-8399-6ed11b68616e/konnectivity-agent/0.log" limit=1024
Jul 22 04:34:39.470216 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:34:39.470126    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j9gvx_b4af3ae5-fa65-4358-8399-6ed11b68616e/konnectivity-agent/0.log" limit=1024
Jul 22 04:34:44.557490 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:34:44.557456    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j9gvx_b4af3ae5-fa65-4358-8399-6ed11b68616e/konnectivity-agent/0.log" limit=1024
Jul 22 04:34:44.930460 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:34:44.930431    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-gw4km_67c7210c-7cfa-4865-bce3-777fbb6f3cea/console-operator/1.log"
Jul 22 04:34:44.930864 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:34:44.930838    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-gw4km_67c7210c-7cfa-4865-bce3-777fbb6f3cea/console-operator/1.log"
Jul 22 04:34:45.888139 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:34:45.888018    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j9gvx_b4af3ae5-fa65-4358-8399-6ed11b68616e/konnectivity-agent/0.log" limit=1024
Jul 22 04:35:25.908337 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:35:25.908254    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j9gvx_b4af3ae5-fa65-4358-8399-6ed11b68616e/konnectivity-agent/0.log" limit=1024
Jul 22 04:35:26.020075 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:35:26.020020    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j9gvx_b4af3ae5-fa65-4358-8399-6ed11b68616e/konnectivity-agent/0.log" limit=1024
Jul 22 04:35:26.150855 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:35:26.150813    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j9gvx_b4af3ae5-fa65-4358-8399-6ed11b68616e/konnectivity-agent/0.log" limit=1024
Jul 22 04:35:26.841068 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:35:26.841020    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j9gvx_b4af3ae5-fa65-4358-8399-6ed11b68616e/konnectivity-agent/0.log" limit=1024
Jul 22 04:35:27.050308 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:35:27.050266    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j9gvx_b4af3ae5-fa65-4358-8399-6ed11b68616e/konnectivity-agent/0.log" limit=1024
Jul 22 04:35:44.938142 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:35:44.938113    2563 scope.go:117] "RemoveContainer" containerID="367837aedb0f895a4236a40f0057605906b0da1d22ea8b9c0425fd9c79b7795b"
Jul 22 04:35:51.628709 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:35:51.628673    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j9gvx_b4af3ae5-fa65-4358-8399-6ed11b68616e/konnectivity-agent/0.log" limit=1024
Jul 22 04:35:51.678648 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:35:51.678614    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j9gvx_b4af3ae5-fa65-4358-8399-6ed11b68616e/konnectivity-agent/0.log" limit=1024
Jul 22 04:35:54.636609 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:35:54.636574    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j9gvx_b4af3ae5-fa65-4358-8399-6ed11b68616e/konnectivity-agent/0.log" limit=1024
Jul 22 04:35:55.240523 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:35:55.240484    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j9gvx_b4af3ae5-fa65-4358-8399-6ed11b68616e/konnectivity-agent/0.log" limit=1024
Jul 22 04:36:00.054811 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:36:00.054776    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j9gvx_b4af3ae5-fa65-4358-8399-6ed11b68616e/konnectivity-agent/0.log" limit=1024
Jul 22 04:36:02.083137 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:36:02.083098    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j9gvx_b4af3ae5-fa65-4358-8399-6ed11b68616e/konnectivity-agent/0.log" limit=1024
Jul 22 04:36:02.185336 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:36:02.185303    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j9gvx_b4af3ae5-fa65-4358-8399-6ed11b68616e/konnectivity-agent/0.log" limit=1024
Jul 22 04:36:02.854372 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:36:02.854341    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j9gvx_b4af3ae5-fa65-4358-8399-6ed11b68616e/konnectivity-agent/0.log" limit=1024
Jul 22 04:36:02.954839 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:36:02.954804    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j9gvx_b4af3ae5-fa65-4358-8399-6ed11b68616e/konnectivity-agent/0.log" limit=1024
Jul 22 04:36:03.055866 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:36:03.055837    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j9gvx_b4af3ae5-fa65-4358-8399-6ed11b68616e/konnectivity-agent/0.log" limit=1024
Jul 22 04:36:03.156233 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:36:03.156202    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j9gvx_b4af3ae5-fa65-4358-8399-6ed11b68616e/konnectivity-agent/0.log" limit=1024
Jul 22 04:36:03.877679 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:36:03.877633    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j9gvx_b4af3ae5-fa65-4358-8399-6ed11b68616e/konnectivity-agent/0.log" limit=1024
Jul 22 04:36:06.040767 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:36:06.040728    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j9gvx_b4af3ae5-fa65-4358-8399-6ed11b68616e/konnectivity-agent/0.log" limit=1024
Jul 22 04:36:06.509814 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:36:06.509780    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j9gvx_b4af3ae5-fa65-4358-8399-6ed11b68616e/konnectivity-agent/0.log" limit=1024
Jul 22 04:36:09.693993 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:36:09.693953    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j9gvx_b4af3ae5-fa65-4358-8399-6ed11b68616e/konnectivity-agent/0.log" limit=1024
Jul 22 04:36:11.705474 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:36:11.705439    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j9gvx_b4af3ae5-fa65-4358-8399-6ed11b68616e/konnectivity-agent/0.log" limit=1024
Jul 22 04:36:11.804700 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:36:11.804662    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j9gvx_b4af3ae5-fa65-4358-8399-6ed11b68616e/konnectivity-agent/0.log" limit=1024
Jul 22 04:36:12.058954 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:36:12.058871    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j9gvx_b4af3ae5-fa65-4358-8399-6ed11b68616e/konnectivity-agent/0.log" limit=1024
Jul 22 04:36:12.157392 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:36:12.157352    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j9gvx_b4af3ae5-fa65-4358-8399-6ed11b68616e/konnectivity-agent/0.log" limit=1024
Jul 22 04:36:15.445564 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:36:15.445529    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j9gvx_b4af3ae5-fa65-4358-8399-6ed11b68616e/konnectivity-agent/0.log" limit=1024
Jul 22 04:36:15.538355 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:36:15.538312    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j9gvx_b4af3ae5-fa65-4358-8399-6ed11b68616e/konnectivity-agent/0.log" limit=1024
Jul 22 04:36:18.771997 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:36:18.771957    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j9gvx_b4af3ae5-fa65-4358-8399-6ed11b68616e/konnectivity-agent/0.log" limit=1024
Jul 22 04:36:19.267769 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:36:19.267730    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j9gvx_b4af3ae5-fa65-4358-8399-6ed11b68616e/konnectivity-agent/0.log" limit=1024
Jul 22 04:36:19.367724 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:36:19.367674    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j9gvx_b4af3ae5-fa65-4358-8399-6ed11b68616e/konnectivity-agent/0.log" limit=1024
Jul 22 04:36:22.772670 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:36:22.772638    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j9gvx_b4af3ae5-fa65-4358-8399-6ed11b68616e/konnectivity-agent/0.log" limit=1024
Jul 22 04:36:22.872708 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:36:22.872666    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j9gvx_b4af3ae5-fa65-4358-8399-6ed11b68616e/konnectivity-agent/0.log" limit=1024
Jul 22 04:36:30.627445 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:36:30.627413    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j9gvx_b4af3ae5-fa65-4358-8399-6ed11b68616e/konnectivity-agent/0.log" limit=1024
Jul 22 04:36:30.701794 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:36:30.701757    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j9gvx_b4af3ae5-fa65-4358-8399-6ed11b68616e/konnectivity-agent/0.log" limit=1024
Jul 22 04:36:31.020261 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:36:31.020226    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j9gvx_b4af3ae5-fa65-4358-8399-6ed11b68616e/konnectivity-agent/0.log" limit=1024
Jul 22 04:36:31.120784 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:36:31.120744    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j9gvx_b4af3ae5-fa65-4358-8399-6ed11b68616e/konnectivity-agent/0.log" limit=1024
Jul 22 04:36:33.423495 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:36:33.423454    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j9gvx_b4af3ae5-fa65-4358-8399-6ed11b68616e/konnectivity-agent/0.log" limit=1024
Jul 22 04:36:33.523138 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:36:33.523104    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j9gvx_b4af3ae5-fa65-4358-8399-6ed11b68616e/konnectivity-agent/0.log" limit=1024
Jul 22 04:36:34.193852 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:36:34.193815    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j9gvx_b4af3ae5-fa65-4358-8399-6ed11b68616e/konnectivity-agent/0.log" limit=1024
Jul 22 04:36:34.295432 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:36:34.295396    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j9gvx_b4af3ae5-fa65-4358-8399-6ed11b68616e/konnectivity-agent/0.log" limit=1024
Jul 22 04:36:37.631484 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:36:37.631391    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j9gvx_b4af3ae5-fa65-4358-8399-6ed11b68616e/konnectivity-agent/0.log" limit=1024
Jul 22 04:36:37.736755 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:36:37.736721    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j9gvx_b4af3ae5-fa65-4358-8399-6ed11b68616e/konnectivity-agent/0.log" limit=1024
Jul 22 04:36:41.174792 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:36:41.174763    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j9gvx_b4af3ae5-fa65-4358-8399-6ed11b68616e/konnectivity-agent/0.log" limit=1024
Jul 22 04:36:41.275328 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:36:41.275294    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j9gvx_b4af3ae5-fa65-4358-8399-6ed11b68616e/konnectivity-agent/0.log" limit=1024
Jul 22 04:37:07.506255 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:37:07.506216    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j9gvx_b4af3ae5-fa65-4358-8399-6ed11b68616e/konnectivity-agent/0.log" limit=1024
Jul 22 04:37:07.567156 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:37:07.567121    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j9gvx_b4af3ae5-fa65-4358-8399-6ed11b68616e/konnectivity-agent/0.log" limit=1024
Jul 22 04:37:12.316507 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:37:12.316469    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j9gvx_b4af3ae5-fa65-4358-8399-6ed11b68616e/konnectivity-agent/0.log" limit=1024
Jul 22 04:37:12.932842 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:37:12.932788    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j9gvx_b4af3ae5-fa65-4358-8399-6ed11b68616e/konnectivity-agent/0.log" limit=1024
Jul 22 04:37:16.920610 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:37:16.920573    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j9gvx_b4af3ae5-fa65-4358-8399-6ed11b68616e/konnectivity-agent/0.log" limit=1024
Jul 22 04:37:17.030984 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:37:17.030947    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j9gvx_b4af3ae5-fa65-4358-8399-6ed11b68616e/konnectivity-agent/0.log" limit=1024
Jul 22 04:37:17.091544 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:37:17.091511    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j9gvx_b4af3ae5-fa65-4358-8399-6ed11b68616e/konnectivity-agent/0.log" limit=1024
Jul 22 04:37:17.249100 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:37:17.249008    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-wsdd9"]
Jul 22 04:37:17.252168 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:37:17.252152    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-54d6d988d5-wsdd9"
Jul 22 04:37:17.255573 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:37:17.255549    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\""
Jul 22 04:37:17.256215 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:37:17.256199    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\""
Jul 22 04:37:17.256312 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:37:17.256199    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-vrt4d\""
Jul 22 04:37:17.256312 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:37:17.256203    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"limitador-limits-config-limitador\""
Jul 22 04:37:17.267663 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:37:17.267637    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-wsdd9"]
Jul 22 04:37:17.304354 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:37:17.304323    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-wsdd9"]
Jul 22 04:37:17.400411 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:37:17.400378    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/e51355c4-9521-400d-8845-22bceab97ffc-config-file\") pod \"limitador-limitador-54d6d988d5-wsdd9\" (UID: \"e51355c4-9521-400d-8845-22bceab97ffc\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-wsdd9"
Jul 22 04:37:17.400567 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:37:17.400420    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-r2k4n\" (UniqueName: \"kubernetes.io/projected/e51355c4-9521-400d-8845-22bceab97ffc-kube-api-access-r2k4n\") pod \"limitador-limitador-54d6d988d5-wsdd9\" (UID: \"e51355c4-9521-400d-8845-22bceab97ffc\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-wsdd9"
Jul 22 04:37:17.501318 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:37:17.501240    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-r2k4n\" (UniqueName: \"kubernetes.io/projected/e51355c4-9521-400d-8845-22bceab97ffc-kube-api-access-r2k4n\") pod \"limitador-limitador-54d6d988d5-wsdd9\" (UID: \"e51355c4-9521-400d-8845-22bceab97ffc\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-wsdd9"
Jul 22 04:37:17.501318 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:37:17.501317    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/e51355c4-9521-400d-8845-22bceab97ffc-config-file\") pod \"limitador-limitador-54d6d988d5-wsdd9\" (UID: \"e51355c4-9521-400d-8845-22bceab97ffc\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-wsdd9"
Jul 22 04:37:17.501864 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:37:17.501846    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/e51355c4-9521-400d-8845-22bceab97ffc-config-file\") pod \"limitador-limitador-54d6d988d5-wsdd9\" (UID: \"e51355c4-9521-400d-8845-22bceab97ffc\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-wsdd9"
Jul 22 04:37:17.509420 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:37:17.509394    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-r2k4n\" (UniqueName: \"kubernetes.io/projected/e51355c4-9521-400d-8845-22bceab97ffc-kube-api-access-r2k4n\") pod \"limitador-limitador-54d6d988d5-wsdd9\" (UID: \"e51355c4-9521-400d-8845-22bceab97ffc\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-wsdd9"
Jul 22 04:37:17.562117 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:37:17.562084    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-54d6d988d5-wsdd9"
Jul 22 04:37:17.690433 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:37:17.690410    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-wsdd9"]
Jul 22 04:37:17.693139 ip-10-0-141-238 kubenswrapper[2563]: W0722 04:37:17.693111    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode51355c4_9521_400d_8845_22bceab97ffc.slice/crio-b0ac3c4f6beb76af3cdfdeddebddd5230a2b6acb4b7a2575196250a52b228d3f WatchSource:0}: Error finding container b0ac3c4f6beb76af3cdfdeddebddd5230a2b6acb4b7a2575196250a52b228d3f: Status 404 returned error can't find the container with id b0ac3c4f6beb76af3cdfdeddebddd5230a2b6acb4b7a2575196250a52b228d3f
Jul 22 04:37:17.695053 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:37:17.695024    2563 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 22 04:37:17.750533 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:37:17.750503    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j9gvx_b4af3ae5-fa65-4358-8399-6ed11b68616e/konnectivity-agent/0.log" limit=1024
Jul 22 04:37:17.806154 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:37:17.806074    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j9gvx_b4af3ae5-fa65-4358-8399-6ed11b68616e/konnectivity-agent/0.log" limit=1024
Jul 22 04:37:17.821679 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:37:17.821648    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-54d6d988d5-wsdd9" event={"ID":"e51355c4-9521-400d-8845-22bceab97ffc","Type":"ContainerStarted","Data":"b0ac3c4f6beb76af3cdfdeddebddd5230a2b6acb4b7a2575196250a52b228d3f"}
Jul 22 04:37:20.837447 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:37:20.837409    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-54d6d988d5-wsdd9" event={"ID":"e51355c4-9521-400d-8845-22bceab97ffc","Type":"ContainerStarted","Data":"01974bb60bf8a89c78364ba182b66d2ad728d7f47fe1e1b3171d84f67faada9d"}
Jul 22 04:37:20.837844 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:37:20.837587    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-limitador-54d6d988d5-wsdd9"
Jul 22 04:37:20.852094 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:37:20.852018    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-limitador-54d6d988d5-wsdd9" podStartSLOduration=1.374630098 podStartE2EDuration="3.852003665s" totalImagesPullingTime="2.477373567s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 04:37:17 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 04:37:20.850621387 +0000 UTC m=+756.269630144" watchObservedRunningTime="2026-07-22 04:37:20.852003665 +0000 UTC m=+756.271012422"
Jul 22 04:37:31.842911 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:37:31.842880    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-limitador-54d6d988d5-wsdd9"
Jul 22 04:37:32.901772 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:37:32.901733    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j9gvx_b4af3ae5-fa65-4358-8399-6ed11b68616e/konnectivity-agent/0.log" limit=1024
Jul 22 04:37:33.003886 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:37:33.003852    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j9gvx_b4af3ae5-fa65-4358-8399-6ed11b68616e/konnectivity-agent/0.log" limit=1024
Jul 22 04:37:33.385271 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:37:33.385220    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j9gvx_b4af3ae5-fa65-4358-8399-6ed11b68616e/konnectivity-agent/0.log" limit=1024
Jul 22 04:37:45.331534 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:37:45.331497    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j9gvx_b4af3ae5-fa65-4358-8399-6ed11b68616e/konnectivity-agent/0.log" limit=1024
Jul 22 04:37:45.685252 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:37:45.685195    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j9gvx_b4af3ae5-fa65-4358-8399-6ed11b68616e/konnectivity-agent/0.log" limit=1024
Jul 22 04:37:51.751264 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:37:51.751226    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j9gvx_b4af3ae5-fa65-4358-8399-6ed11b68616e/konnectivity-agent/0.log" limit=1024
Jul 22 04:37:51.847654 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:37:51.847619    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j9gvx_b4af3ae5-fa65-4358-8399-6ed11b68616e/konnectivity-agent/0.log" limit=1024
Jul 22 04:37:51.925420 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:37:51.925381    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j9gvx_b4af3ae5-fa65-4358-8399-6ed11b68616e/konnectivity-agent/0.log" limit=1024
Jul 22 04:37:54.664835 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:37:54.664796    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j9gvx_b4af3ae5-fa65-4358-8399-6ed11b68616e/konnectivity-agent/0.log" limit=1024
Jul 22 04:37:54.764028 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:37:54.763990    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j9gvx_b4af3ae5-fa65-4358-8399-6ed11b68616e/konnectivity-agent/0.log" limit=1024
Jul 22 04:38:07.762732 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:38:07.762632    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j9gvx_b4af3ae5-fa65-4358-8399-6ed11b68616e/konnectivity-agent/0.log" limit=1024
Jul 22 04:38:25.140441 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:38:25.140387    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j9gvx_b4af3ae5-fa65-4358-8399-6ed11b68616e/konnectivity-agent/0.log" limit=1024
Jul 22 04:38:25.236986 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:38:25.236940    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j9gvx_b4af3ae5-fa65-4358-8399-6ed11b68616e/konnectivity-agent/0.log" limit=1024
Jul 22 04:38:25.627921 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:38:25.627883    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j9gvx_b4af3ae5-fa65-4358-8399-6ed11b68616e/konnectivity-agent/0.log" limit=1024
Jul 22 04:38:25.984929 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:38:25.984894    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j9gvx_b4af3ae5-fa65-4358-8399-6ed11b68616e/konnectivity-agent/0.log" limit=1024
Jul 22 04:38:26.318783 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:38:26.318704    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j9gvx_b4af3ae5-fa65-4358-8399-6ed11b68616e/konnectivity-agent/0.log" limit=1024
Jul 22 04:38:26.401801 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:38:26.401765    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j9gvx_b4af3ae5-fa65-4358-8399-6ed11b68616e/konnectivity-agent/0.log" limit=1024
Jul 22 04:38:26.838883 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:38:26.838843    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-wsdd9"]
Jul 22 04:38:35.536593 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:38:35.536560    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j9gvx_b4af3ae5-fa65-4358-8399-6ed11b68616e/konnectivity-agent/0.log" limit=1024
Jul 22 04:38:35.637607 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:38:35.637566    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j9gvx_b4af3ae5-fa65-4358-8399-6ed11b68616e/konnectivity-agent/0.log" limit=1024
Jul 22 04:38:40.896898 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:38:40.896862    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j9gvx_b4af3ae5-fa65-4358-8399-6ed11b68616e/konnectivity-agent/0.log" limit=1024
Jul 22 04:38:41.363159 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:38:41.363128    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-wsdd9"]
Jul 22 04:38:45.187422 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:38:45.187382    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j9gvx_b4af3ae5-fa65-4358-8399-6ed11b68616e/konnectivity-agent/0.log" limit=1024
Jul 22 04:38:46.169861 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:38:46.169827    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-wsdd9"]
Jul 22 04:38:51.998827 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:38:51.998787    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j9gvx_b4af3ae5-fa65-4358-8399-6ed11b68616e/konnectivity-agent/0.log" limit=1024
Jul 22 04:38:53.164776 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:38:53.164739    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-wsdd9"]
Jul 22 04:38:56.210593 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:38:56.210552    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j9gvx_b4af3ae5-fa65-4358-8399-6ed11b68616e/konnectivity-agent/0.log" limit=1024
Jul 22 04:38:57.671942 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:38:57.671898    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-wsdd9"]
Jul 22 04:39:01.151220 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:39:01.151175    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j9gvx_b4af3ae5-fa65-4358-8399-6ed11b68616e/konnectivity-agent/0.log" limit=1024
Jul 22 04:39:01.366630 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:39:01.366597    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-74b68447df-6kdxl"]
Jul 22 04:39:01.369999 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:39:01.369975    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-6kdxl"
Jul 22 04:39:01.372533 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:39:01.372513    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\""
Jul 22 04:39:01.373448 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:39:01.373429    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"facebook-opt-125m-simulated-kserve-self-signed-certs\""
Jul 22 04:39:01.373621 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:39:01.373549    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-qkdmg\""
Jul 22 04:39:01.373692 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:39:01.373665    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\""
Jul 22 04:39:01.380898 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:39:01.380871    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-74b68447df-6kdxl"]
Jul 22 04:39:01.391913 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:39:01.391874    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/454414e8-c01b-476b-abc6-c11552c2ddfe-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-6kdxl\" (UID: \"454414e8-c01b-476b-abc6-c11552c2ddfe\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-6kdxl"
Jul 22 04:39:01.392122 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:39:01.391994    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/454414e8-c01b-476b-abc6-c11552c2ddfe-tmp-dir\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-6kdxl\" (UID: \"454414e8-c01b-476b-abc6-c11552c2ddfe\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-6kdxl"
Jul 22 04:39:01.392122 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:39:01.392027    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-p4l52\" (UniqueName: \"kubernetes.io/projected/454414e8-c01b-476b-abc6-c11552c2ddfe-kube-api-access-p4l52\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-6kdxl\" (UID: \"454414e8-c01b-476b-abc6-c11552c2ddfe\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-6kdxl"
Jul 22 04:39:01.392122 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:39:01.392111    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/454414e8-c01b-476b-abc6-c11552c2ddfe-home\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-6kdxl\" (UID: \"454414e8-c01b-476b-abc6-c11552c2ddfe\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-6kdxl"
Jul 22 04:39:01.392299 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:39:01.392134    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/454414e8-c01b-476b-abc6-c11552c2ddfe-model-cache\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-6kdxl\" (UID: \"454414e8-c01b-476b-abc6-c11552c2ddfe\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-6kdxl"
Jul 22 04:39:01.392299 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:39:01.392188    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/454414e8-c01b-476b-abc6-c11552c2ddfe-dshm\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-6kdxl\" (UID: \"454414e8-c01b-476b-abc6-c11552c2ddfe\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-6kdxl"
Jul 22 04:39:01.405663 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:39:01.405623    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j9gvx_b4af3ae5-fa65-4358-8399-6ed11b68616e/konnectivity-agent/0.log" limit=1024
Jul 22 04:39:01.492673 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:39:01.492637    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/454414e8-c01b-476b-abc6-c11552c2ddfe-dshm\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-6kdxl\" (UID: \"454414e8-c01b-476b-abc6-c11552c2ddfe\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-6kdxl"
Jul 22 04:39:01.492847 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:39:01.492680    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/454414e8-c01b-476b-abc6-c11552c2ddfe-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-6kdxl\" (UID: \"454414e8-c01b-476b-abc6-c11552c2ddfe\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-6kdxl"
Jul 22 04:39:01.492847 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:39:01.492733    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/454414e8-c01b-476b-abc6-c11552c2ddfe-tmp-dir\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-6kdxl\" (UID: \"454414e8-c01b-476b-abc6-c11552c2ddfe\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-6kdxl"
Jul 22 04:39:01.492847 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:39:01.492751    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-p4l52\" (UniqueName: \"kubernetes.io/projected/454414e8-c01b-476b-abc6-c11552c2ddfe-kube-api-access-p4l52\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-6kdxl\" (UID: \"454414e8-c01b-476b-abc6-c11552c2ddfe\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-6kdxl"
Jul 22 04:39:01.492847 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:39:01.492779    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/454414e8-c01b-476b-abc6-c11552c2ddfe-home\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-6kdxl\" (UID: \"454414e8-c01b-476b-abc6-c11552c2ddfe\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-6kdxl"
Jul 22 04:39:01.492847 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:39:01.492794    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/454414e8-c01b-476b-abc6-c11552c2ddfe-model-cache\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-6kdxl\" (UID: \"454414e8-c01b-476b-abc6-c11552c2ddfe\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-6kdxl"
Jul 22 04:39:01.493236 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:39:01.493207    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/454414e8-c01b-476b-abc6-c11552c2ddfe-home\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-6kdxl\" (UID: \"454414e8-c01b-476b-abc6-c11552c2ddfe\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-6kdxl"
Jul 22 04:39:01.493236 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:39:01.493223    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/454414e8-c01b-476b-abc6-c11552c2ddfe-model-cache\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-6kdxl\" (UID: \"454414e8-c01b-476b-abc6-c11552c2ddfe\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-6kdxl"
Jul 22 04:39:01.493403 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:39:01.493287    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/454414e8-c01b-476b-abc6-c11552c2ddfe-tmp-dir\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-6kdxl\" (UID: \"454414e8-c01b-476b-abc6-c11552c2ddfe\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-6kdxl"
Jul 22 04:39:01.495030 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:39:01.495010    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/454414e8-c01b-476b-abc6-c11552c2ddfe-dshm\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-6kdxl\" (UID: \"454414e8-c01b-476b-abc6-c11552c2ddfe\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-6kdxl"
Jul 22 04:39:01.495341 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:39:01.495321    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/454414e8-c01b-476b-abc6-c11552c2ddfe-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-6kdxl\" (UID: \"454414e8-c01b-476b-abc6-c11552c2ddfe\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-6kdxl"
Jul 22 04:39:01.500180 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:39:01.500156    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-p4l52\" (UniqueName: \"kubernetes.io/projected/454414e8-c01b-476b-abc6-c11552c2ddfe-kube-api-access-p4l52\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-6kdxl\" (UID: \"454414e8-c01b-476b-abc6-c11552c2ddfe\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-6kdxl"
Jul 22 04:39:01.681073 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:39:01.680963    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-6kdxl"
Jul 22 04:39:01.811095 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:39:01.811069    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-74b68447df-6kdxl"]
Jul 22 04:39:01.813718 ip-10-0-141-238 kubenswrapper[2563]: W0722 04:39:01.813693    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod454414e8_c01b_476b_abc6_c11552c2ddfe.slice/crio-f9617278926f422f702be69c64494f1d886ee2cd79ac8141454e9d6cc26a951a WatchSource:0}: Error finding container f9617278926f422f702be69c64494f1d886ee2cd79ac8141454e9d6cc26a951a: Status 404 returned error can't find the container with id f9617278926f422f702be69c64494f1d886ee2cd79ac8141454e9d6cc26a951a
Jul 22 04:39:02.268697 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:39:02.268606    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-6kdxl" event={"ID":"454414e8-c01b-476b-abc6-c11552c2ddfe","Type":"ContainerStarted","Data":"f9617278926f422f702be69c64494f1d886ee2cd79ac8141454e9d6cc26a951a"}
Jul 22 04:39:03.273945 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:39:03.273901    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-6kdxl" event={"ID":"454414e8-c01b-476b-abc6-c11552c2ddfe","Type":"ContainerStarted","Data":"a1b1e4b965c99304519a400be88adba436112d54e6f690dde7f656664310d5f8"}
Jul 22 04:39:03.291961 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:39:03.291907    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-6kdxl" podStartSLOduration=1.307310851 podStartE2EDuration="2.291890778s" totalImagesPullingTime="984.579927ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 04:39:01 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 04:39:03.290955579 +0000 UTC m=+858.709964336" watchObservedRunningTime="2026-07-22 04:39:03.291890778 +0000 UTC m=+858.710899512"
Jul 22 04:39:03.774944 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:39:03.774912    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-wsdd9"]
Jul 22 04:39:11.681946 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:39:11.681900    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-6kdxl"
Jul 22 04:39:11.682431 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:39:11.681970    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-6kdxl"
Jul 22 04:39:11.694505 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:39:11.694478    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-6kdxl"
Jul 22 04:39:12.323997 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:39:12.323966    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-6kdxl"
Jul 22 04:39:19.296235 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:39:19.296189    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j9gvx_b4af3ae5-fa65-4358-8399-6ed11b68616e/konnectivity-agent/0.log" limit=1024
Jul 22 04:39:21.964321 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:39:21.964281    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-wsdd9"]
Jul 22 04:39:44.960585 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:39:44.960548    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-gw4km_67c7210c-7cfa-4865-bce3-777fbb6f3cea/console-operator/1.log"
Jul 22 04:39:44.961810 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:39:44.961782    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-gw4km_67c7210c-7cfa-4865-bce3-777fbb6f3cea/console-operator/1.log"
Jul 22 04:39:50.170653 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:39:50.170619    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j9gvx_b4af3ae5-fa65-4358-8399-6ed11b68616e/konnectivity-agent/0.log" limit=1024
Jul 22 04:40:07.397875 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:40:07.397828    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j9gvx_b4af3ae5-fa65-4358-8399-6ed11b68616e/konnectivity-agent/0.log" limit=1024
Jul 22 04:40:07.496091 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:40:07.496018    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j9gvx_b4af3ae5-fa65-4358-8399-6ed11b68616e/konnectivity-agent/0.log" limit=1024
Jul 22 04:40:08.476662 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:40:08.476612    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j9gvx_b4af3ae5-fa65-4358-8399-6ed11b68616e/konnectivity-agent/0.log" limit=1024
Jul 22 04:40:08.573818 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:40:08.573778    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j9gvx_b4af3ae5-fa65-4358-8399-6ed11b68616e/konnectivity-agent/0.log" limit=1024
Jul 22 04:40:36.873416 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:40:36.873374    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-wsdd9"]
Jul 22 04:40:46.369643 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:40:46.369605    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-wsdd9"]
Jul 22 04:40:56.767261 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:40:56.767230    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-wsdd9"]
Jul 22 04:41:28.141200 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:41:28.141118    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j9gvx_b4af3ae5-fa65-4358-8399-6ed11b68616e/konnectivity-agent/0.log" limit=1024
Jul 22 04:42:12.767627 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:42:12.767586    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j9gvx_b4af3ae5-fa65-4358-8399-6ed11b68616e/konnectivity-agent/0.log" limit=1024
Jul 22 04:42:13.967927 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:42:13.967887    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j9gvx_b4af3ae5-fa65-4358-8399-6ed11b68616e/konnectivity-agent/0.log" limit=1024
Jul 22 04:42:23.364474 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:42:23.364438    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j9gvx_b4af3ae5-fa65-4358-8399-6ed11b68616e/konnectivity-agent/0.log" limit=1024
Jul 22 04:42:39.838330 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:42:39.838247    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-wsdd9"]
Jul 22 04:42:52.863161 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:42:52.863129    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-wsdd9"]
Jul 22 04:42:58.556782 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:42:58.556746    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j9gvx_b4af3ae5-fa65-4358-8399-6ed11b68616e/konnectivity-agent/0.log" limit=1024
Jul 22 04:42:58.656542 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:42:58.656510    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j9gvx_b4af3ae5-fa65-4358-8399-6ed11b68616e/konnectivity-agent/0.log" limit=1024
Jul 22 04:42:58.768019 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:42:58.767983    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j9gvx_b4af3ae5-fa65-4358-8399-6ed11b68616e/konnectivity-agent/0.log" limit=1024
Jul 22 04:43:04.496690 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:43:04.496660    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j9gvx_b4af3ae5-fa65-4358-8399-6ed11b68616e/konnectivity-agent/0.log" limit=1024
Jul 22 04:43:04.556118 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:43:04.556087    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j9gvx_b4af3ae5-fa65-4358-8399-6ed11b68616e/konnectivity-agent/0.log" limit=1024
Jul 22 04:43:04.636530 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:43:04.636498    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j9gvx_b4af3ae5-fa65-4358-8399-6ed11b68616e/konnectivity-agent/0.log" limit=1024
Jul 22 04:43:04.822643 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:43:04.822559    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j9gvx_b4af3ae5-fa65-4358-8399-6ed11b68616e/konnectivity-agent/0.log" limit=1024
Jul 22 04:43:10.582833 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:43:10.582799    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j9gvx_b4af3ae5-fa65-4358-8399-6ed11b68616e/konnectivity-agent/0.log" limit=1024
Jul 22 04:43:10.684455 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:43:10.684418    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j9gvx_b4af3ae5-fa65-4358-8399-6ed11b68616e/konnectivity-agent/0.log" limit=1024
Jul 22 04:43:27.470525 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:43:27.470494    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-wsdd9"]
Jul 22 04:43:36.975020 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:43:36.974983    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-wsdd9"]
Jul 22 04:43:47.666920 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:43:47.666885    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-wsdd9"]
Jul 22 04:43:53.665911 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:43:53.665874    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-wsdd9"]
Jul 22 04:44:03.973088 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:44:03.973052    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-wsdd9"]
Jul 22 04:44:13.370951 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:44:13.370865    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-wsdd9"]
Jul 22 04:44:20.433500 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:44:20.433464    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j9gvx_b4af3ae5-fa65-4358-8399-6ed11b68616e/konnectivity-agent/0.log" limit=1024
Jul 22 04:44:24.765772 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:44:24.765731    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-wsdd9"]
Jul 22 04:44:34.573114 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:44:34.573081    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-wsdd9"]
Jul 22 04:44:36.095116 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:44:36.095078    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j9gvx_b4af3ae5-fa65-4358-8399-6ed11b68616e/konnectivity-agent/0.log" limit=1024
Jul 22 04:44:36.195715 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:44:36.195684    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j9gvx_b4af3ae5-fa65-4358-8399-6ed11b68616e/konnectivity-agent/0.log" limit=1024
Jul 22 04:44:44.992642 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:44:44.992614    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-gw4km_67c7210c-7cfa-4865-bce3-777fbb6f3cea/console-operator/1.log"
Jul 22 04:44:44.994882 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:44:44.994854    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-gw4km_67c7210c-7cfa-4865-bce3-777fbb6f3cea/console-operator/1.log"
Jul 22 04:44:51.309363 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:44:51.309324    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j9gvx_b4af3ae5-fa65-4358-8399-6ed11b68616e/konnectivity-agent/0.log" limit=1024
Jul 22 04:44:56.776139 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:44:56.776105    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-wsdd9"]
Jul 22 04:45:05.973828 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:45:05.973792    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-wsdd9"]
Jul 22 04:45:28.276067 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:45:28.276020    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-wsdd9"]
Jul 22 04:45:40.169433 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:45:40.169358    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-wsdd9"]
Jul 22 04:45:40.911913 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:45:40.911870    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j9gvx_b4af3ae5-fa65-4358-8399-6ed11b68616e/konnectivity-agent/0.log" limit=1024
Jul 22 04:45:55.375416 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:45:55.375381    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-wsdd9"]
Jul 22 04:46:04.675634 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:46:04.675595    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-wsdd9"]
Jul 22 04:46:14.765716 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:46:14.765680    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-wsdd9"]
Jul 22 04:46:24.489169 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:46:24.489129    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-wsdd9"]
Jul 22 04:46:33.072137 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:46:33.072096    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-wsdd9"]
Jul 22 04:48:20.167692 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:48:20.167652    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-wsdd9"]
Jul 22 04:48:31.769516 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:48:31.769478    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-wsdd9"]
Jul 22 04:48:40.771741 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:48:40.771665    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-wsdd9"]
Jul 22 04:48:51.480588 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:48:51.480555    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-wsdd9"]
Jul 22 04:49:02.669246 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:49:02.669202    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-wsdd9"]
Jul 22 04:49:13.377500 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:49:13.377464    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-wsdd9"]
Jul 22 04:49:22.071486 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:49:22.071441    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-wsdd9"]
Jul 22 04:49:33.366111 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:49:33.366073    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-wsdd9"]
Jul 22 04:49:44.274325 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:49:44.274294    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-wsdd9"]
Jul 22 04:49:45.018942 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:49:45.018910    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-gw4km_67c7210c-7cfa-4865-bce3-777fbb6f3cea/console-operator/1.log"
Jul 22 04:49:45.021033 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:49:45.021010    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-gw4km_67c7210c-7cfa-4865-bce3-777fbb6f3cea/console-operator/1.log"
Jul 22 04:49:52.870874 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:49:52.870837    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-wsdd9"]
Jul 22 04:50:03.567076 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:50:03.567025    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-wsdd9"]
Jul 22 04:50:25.077194 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:50:25.077113    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-wsdd9"]
Jul 22 04:50:34.362596 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:50:34.362556    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-wsdd9"]
Jul 22 04:50:39.869627 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:50:39.869594    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-same-id-a-4f9fb706-kserve-6c69bc4bb7-dn58z"]
Jul 22 04:50:39.872833 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:50:39.872817    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-same-id-a-4f9fb706-kserve-6c69bc4bb7-dn58z"
Jul 22 04:50:39.875229 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:50:39.875205    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-same-id-a-4f9fb706-kserve-self-signed-certs\""
Jul 22 04:50:39.887604 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:50:39.887576    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-same-id-a-4f9fb706-kserve-6c69bc4bb7-dn58z"]
Jul 22 04:50:39.976439 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:50:39.976404    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2b9tv\" (UniqueName: \"kubernetes.io/projected/aeeeb408-b32f-455d-b6ff-ff3588cbc4d7-kube-api-access-2b9tv\") pod \"e2e-same-id-a-4f9fb706-kserve-6c69bc4bb7-dn58z\" (UID: \"aeeeb408-b32f-455d-b6ff-ff3588cbc4d7\") " pod="llm/e2e-same-id-a-4f9fb706-kserve-6c69bc4bb7-dn58z"
Jul 22 04:50:39.976609 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:50:39.976449    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/aeeeb408-b32f-455d-b6ff-ff3588cbc4d7-tls-certs\") pod \"e2e-same-id-a-4f9fb706-kserve-6c69bc4bb7-dn58z\" (UID: \"aeeeb408-b32f-455d-b6ff-ff3588cbc4d7\") " pod="llm/e2e-same-id-a-4f9fb706-kserve-6c69bc4bb7-dn58z"
Jul 22 04:50:39.976609 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:50:39.976470    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/aeeeb408-b32f-455d-b6ff-ff3588cbc4d7-dshm\") pod \"e2e-same-id-a-4f9fb706-kserve-6c69bc4bb7-dn58z\" (UID: \"aeeeb408-b32f-455d-b6ff-ff3588cbc4d7\") " pod="llm/e2e-same-id-a-4f9fb706-kserve-6c69bc4bb7-dn58z"
Jul 22 04:50:39.976609 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:50:39.976545    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/aeeeb408-b32f-455d-b6ff-ff3588cbc4d7-home\") pod \"e2e-same-id-a-4f9fb706-kserve-6c69bc4bb7-dn58z\" (UID: \"aeeeb408-b32f-455d-b6ff-ff3588cbc4d7\") " pod="llm/e2e-same-id-a-4f9fb706-kserve-6c69bc4bb7-dn58z"
Jul 22 04:50:39.976609 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:50:39.976571    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/aeeeb408-b32f-455d-b6ff-ff3588cbc4d7-model-cache\") pod \"e2e-same-id-a-4f9fb706-kserve-6c69bc4bb7-dn58z\" (UID: \"aeeeb408-b32f-455d-b6ff-ff3588cbc4d7\") " pod="llm/e2e-same-id-a-4f9fb706-kserve-6c69bc4bb7-dn58z"
Jul 22 04:50:39.976741 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:50:39.976700    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/aeeeb408-b32f-455d-b6ff-ff3588cbc4d7-tmp-dir\") pod \"e2e-same-id-a-4f9fb706-kserve-6c69bc4bb7-dn58z\" (UID: \"aeeeb408-b32f-455d-b6ff-ff3588cbc4d7\") " pod="llm/e2e-same-id-a-4f9fb706-kserve-6c69bc4bb7-dn58z"
Jul 22 04:50:40.077574 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:50:40.077532    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2b9tv\" (UniqueName: \"kubernetes.io/projected/aeeeb408-b32f-455d-b6ff-ff3588cbc4d7-kube-api-access-2b9tv\") pod \"e2e-same-id-a-4f9fb706-kserve-6c69bc4bb7-dn58z\" (UID: \"aeeeb408-b32f-455d-b6ff-ff3588cbc4d7\") " pod="llm/e2e-same-id-a-4f9fb706-kserve-6c69bc4bb7-dn58z"
Jul 22 04:50:40.077738 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:50:40.077584    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/aeeeb408-b32f-455d-b6ff-ff3588cbc4d7-tls-certs\") pod \"e2e-same-id-a-4f9fb706-kserve-6c69bc4bb7-dn58z\" (UID: \"aeeeb408-b32f-455d-b6ff-ff3588cbc4d7\") " pod="llm/e2e-same-id-a-4f9fb706-kserve-6c69bc4bb7-dn58z"
Jul 22 04:50:40.077738 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:50:40.077605    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/aeeeb408-b32f-455d-b6ff-ff3588cbc4d7-dshm\") pod \"e2e-same-id-a-4f9fb706-kserve-6c69bc4bb7-dn58z\" (UID: \"aeeeb408-b32f-455d-b6ff-ff3588cbc4d7\") " pod="llm/e2e-same-id-a-4f9fb706-kserve-6c69bc4bb7-dn58z"
Jul 22 04:50:40.077738 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:50:40.077656    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/aeeeb408-b32f-455d-b6ff-ff3588cbc4d7-home\") pod \"e2e-same-id-a-4f9fb706-kserve-6c69bc4bb7-dn58z\" (UID: \"aeeeb408-b32f-455d-b6ff-ff3588cbc4d7\") " pod="llm/e2e-same-id-a-4f9fb706-kserve-6c69bc4bb7-dn58z"
Jul 22 04:50:40.077738 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:50:40.077678    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/aeeeb408-b32f-455d-b6ff-ff3588cbc4d7-model-cache\") pod \"e2e-same-id-a-4f9fb706-kserve-6c69bc4bb7-dn58z\" (UID: \"aeeeb408-b32f-455d-b6ff-ff3588cbc4d7\") " pod="llm/e2e-same-id-a-4f9fb706-kserve-6c69bc4bb7-dn58z"
Jul 22 04:50:40.077738 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:50:40.077720    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/aeeeb408-b32f-455d-b6ff-ff3588cbc4d7-tmp-dir\") pod \"e2e-same-id-a-4f9fb706-kserve-6c69bc4bb7-dn58z\" (UID: \"aeeeb408-b32f-455d-b6ff-ff3588cbc4d7\") " pod="llm/e2e-same-id-a-4f9fb706-kserve-6c69bc4bb7-dn58z"
Jul 22 04:50:40.078147 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:50:40.078127    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/aeeeb408-b32f-455d-b6ff-ff3588cbc4d7-tmp-dir\") pod \"e2e-same-id-a-4f9fb706-kserve-6c69bc4bb7-dn58z\" (UID: \"aeeeb408-b32f-455d-b6ff-ff3588cbc4d7\") " pod="llm/e2e-same-id-a-4f9fb706-kserve-6c69bc4bb7-dn58z"
Jul 22 04:50:40.078223 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:50:40.078164    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/aeeeb408-b32f-455d-b6ff-ff3588cbc4d7-model-cache\") pod \"e2e-same-id-a-4f9fb706-kserve-6c69bc4bb7-dn58z\" (UID: \"aeeeb408-b32f-455d-b6ff-ff3588cbc4d7\") " pod="llm/e2e-same-id-a-4f9fb706-kserve-6c69bc4bb7-dn58z"
Jul 22 04:50:40.078223 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:50:40.078200    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/aeeeb408-b32f-455d-b6ff-ff3588cbc4d7-home\") pod \"e2e-same-id-a-4f9fb706-kserve-6c69bc4bb7-dn58z\" (UID: \"aeeeb408-b32f-455d-b6ff-ff3588cbc4d7\") " pod="llm/e2e-same-id-a-4f9fb706-kserve-6c69bc4bb7-dn58z"
Jul 22 04:50:40.079950 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:50:40.079932    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/aeeeb408-b32f-455d-b6ff-ff3588cbc4d7-dshm\") pod \"e2e-same-id-a-4f9fb706-kserve-6c69bc4bb7-dn58z\" (UID: \"aeeeb408-b32f-455d-b6ff-ff3588cbc4d7\") " pod="llm/e2e-same-id-a-4f9fb706-kserve-6c69bc4bb7-dn58z"
Jul 22 04:50:40.080298 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:50:40.080278    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/aeeeb408-b32f-455d-b6ff-ff3588cbc4d7-tls-certs\") pod \"e2e-same-id-a-4f9fb706-kserve-6c69bc4bb7-dn58z\" (UID: \"aeeeb408-b32f-455d-b6ff-ff3588cbc4d7\") " pod="llm/e2e-same-id-a-4f9fb706-kserve-6c69bc4bb7-dn58z"
Jul 22 04:50:40.084872 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:50:40.084851    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2b9tv\" (UniqueName: \"kubernetes.io/projected/aeeeb408-b32f-455d-b6ff-ff3588cbc4d7-kube-api-access-2b9tv\") pod \"e2e-same-id-a-4f9fb706-kserve-6c69bc4bb7-dn58z\" (UID: \"aeeeb408-b32f-455d-b6ff-ff3588cbc4d7\") " pod="llm/e2e-same-id-a-4f9fb706-kserve-6c69bc4bb7-dn58z"
Jul 22 04:50:40.181794 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:50:40.181737    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-same-id-a-4f9fb706-kserve-6c69bc4bb7-dn58z"
Jul 22 04:50:40.308911 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:50:40.308888    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-same-id-a-4f9fb706-kserve-6c69bc4bb7-dn58z"]
Jul 22 04:50:40.311502 ip-10-0-141-238 kubenswrapper[2563]: W0722 04:50:40.311470    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podaeeeb408_b32f_455d_b6ff_ff3588cbc4d7.slice/crio-93b58debc7396663314b8db61dcda85dd199593d80e117c8cbd95981d79b7dd4 WatchSource:0}: Error finding container 93b58debc7396663314b8db61dcda85dd199593d80e117c8cbd95981d79b7dd4: Status 404 returned error can't find the container with id 93b58debc7396663314b8db61dcda85dd199593d80e117c8cbd95981d79b7dd4
Jul 22 04:50:40.728488 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:50:40.728444    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j9gvx_b4af3ae5-fa65-4358-8399-6ed11b68616e/konnectivity-agent/0.log" limit=1024
Jul 22 04:50:41.278468 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:50:41.278430    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-same-id-a-4f9fb706-kserve-6c69bc4bb7-dn58z" event={"ID":"aeeeb408-b32f-455d-b6ff-ff3588cbc4d7","Type":"ContainerStarted","Data":"d97ca8b0e1ad51c24a83a69862b745342af90e64f98d52b48f45da71c057d055"}
Jul 22 04:50:41.278945 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:50:41.278479    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-same-id-a-4f9fb706-kserve-6c69bc4bb7-dn58z" event={"ID":"aeeeb408-b32f-455d-b6ff-ff3588cbc4d7","Type":"ContainerStarted","Data":"93b58debc7396663314b8db61dcda85dd199593d80e117c8cbd95981d79b7dd4"}
Jul 22 04:50:41.294463 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:50:41.294405    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-same-id-a-4f9fb706-kserve-6c69bc4bb7-dn58z" podStartSLOduration=2.294368314 podStartE2EDuration="2.294368314s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 04:50:39 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 04:50:41.29392279 +0000 UTC m=+1556.712931546" watchObservedRunningTime="2026-07-22 04:50:41.294368314 +0000 UTC m=+1556.713377072"
Jul 22 04:50:47.424096 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:50:47.424031    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j9gvx_b4af3ae5-fa65-4358-8399-6ed11b68616e/konnectivity-agent/0.log" limit=1024
Jul 22 04:50:50.182843 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:50:50.182809    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-same-id-a-4f9fb706-kserve-6c69bc4bb7-dn58z"
Jul 22 04:50:50.183282 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:50:50.182902    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-same-id-a-4f9fb706-kserve-6c69bc4bb7-dn58z"
Jul 22 04:50:50.195357 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:50:50.195334    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-same-id-a-4f9fb706-kserve-6c69bc4bb7-dn58z"
Jul 22 04:50:50.328707 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:50:50.328676    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-same-id-a-4f9fb706-kserve-6c69bc4bb7-dn58z"
Jul 22 04:50:52.669085 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:50:52.669052    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-wsdd9"]
Jul 22 04:51:24.176702 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:51:24.176654    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["llm/e2e-same-id-a-4f9fb706-kserve-6c69bc4bb7-dn58z"]
Jul 22 04:51:24.204549 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:51:24.204519    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j9gvx_b4af3ae5-fa65-4358-8399-6ed11b68616e/konnectivity-agent/0.log" limit=1024
Jul 22 04:51:24.858755 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:51:24.858722    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j9gvx_b4af3ae5-fa65-4358-8399-6ed11b68616e/konnectivity-agent/0.log" limit=1024
Jul 22 04:51:28.269432 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:51:28.269390    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-wsdd9"]
Jul 22 04:51:39.197200 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:51:39.197108    2563 kuberuntime_container.go:873] "Killing container with a grace period" pod="llm/e2e-same-id-a-4f9fb706-kserve-6c69bc4bb7-dn58z" podUID="aeeeb408-b32f-455d-b6ff-ff3588cbc4d7" containerName="main" containerID="cri-o://d97ca8b0e1ad51c24a83a69862b745342af90e64f98d52b48f45da71c057d055" gracePeriod=45
Jul 22 04:51:39.445492 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:51:39.445468    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="llm/e2e-same-id-a-4f9fb706-kserve-6c69bc4bb7-dn58z"
Jul 22 04:51:39.501679 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:51:39.501618    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/aeeeb408-b32f-455d-b6ff-ff3588cbc4d7-model-cache\") pod \"aeeeb408-b32f-455d-b6ff-ff3588cbc4d7\" (UID: \"aeeeb408-b32f-455d-b6ff-ff3588cbc4d7\") "
Jul 22 04:51:39.501810 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:51:39.501699    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-2b9tv\" (UniqueName: \"kubernetes.io/projected/aeeeb408-b32f-455d-b6ff-ff3588cbc4d7-kube-api-access-2b9tv\") pod \"aeeeb408-b32f-455d-b6ff-ff3588cbc4d7\" (UID: \"aeeeb408-b32f-455d-b6ff-ff3588cbc4d7\") "
Jul 22 04:51:39.501810 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:51:39.501722    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/aeeeb408-b32f-455d-b6ff-ff3588cbc4d7-tmp-dir\") pod \"aeeeb408-b32f-455d-b6ff-ff3588cbc4d7\" (UID: \"aeeeb408-b32f-455d-b6ff-ff3588cbc4d7\") "
Jul 22 04:51:39.501810 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:51:39.501748    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/aeeeb408-b32f-455d-b6ff-ff3588cbc4d7-home\") pod \"aeeeb408-b32f-455d-b6ff-ff3588cbc4d7\" (UID: \"aeeeb408-b32f-455d-b6ff-ff3588cbc4d7\") "
Jul 22 04:51:39.501810 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:51:39.501765    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/aeeeb408-b32f-455d-b6ff-ff3588cbc4d7-tls-certs\") pod \"aeeeb408-b32f-455d-b6ff-ff3588cbc4d7\" (UID: \"aeeeb408-b32f-455d-b6ff-ff3588cbc4d7\") "
Jul 22 04:51:39.501810 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:51:39.501799    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/aeeeb408-b32f-455d-b6ff-ff3588cbc4d7-dshm\") pod \"aeeeb408-b32f-455d-b6ff-ff3588cbc4d7\" (UID: \"aeeeb408-b32f-455d-b6ff-ff3588cbc4d7\") "
Jul 22 04:51:39.502103 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:51:39.501917    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/aeeeb408-b32f-455d-b6ff-ff3588cbc4d7-model-cache" (OuterVolumeSpecName: "model-cache") pod "aeeeb408-b32f-455d-b6ff-ff3588cbc4d7" (UID: "aeeeb408-b32f-455d-b6ff-ff3588cbc4d7"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 22 04:51:39.502103 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:51:39.501998    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/aeeeb408-b32f-455d-b6ff-ff3588cbc4d7-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "aeeeb408-b32f-455d-b6ff-ff3588cbc4d7" (UID: "aeeeb408-b32f-455d-b6ff-ff3588cbc4d7"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 22 04:51:39.502103 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:51:39.502006    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/aeeeb408-b32f-455d-b6ff-ff3588cbc4d7-home" (OuterVolumeSpecName: "home") pod "aeeeb408-b32f-455d-b6ff-ff3588cbc4d7" (UID: "aeeeb408-b32f-455d-b6ff-ff3588cbc4d7"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 22 04:51:39.502103 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:51:39.502023    2563 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/aeeeb408-b32f-455d-b6ff-ff3588cbc4d7-model-cache\") on node \"ip-10-0-141-238.ec2.internal\" DevicePath \"\""
Jul 22 04:51:39.503880 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:51:39.503858    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/aeeeb408-b32f-455d-b6ff-ff3588cbc4d7-dshm" (OuterVolumeSpecName: "dshm") pod "aeeeb408-b32f-455d-b6ff-ff3588cbc4d7" (UID: "aeeeb408-b32f-455d-b6ff-ff3588cbc4d7"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 22 04:51:39.503972 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:51:39.503910    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/aeeeb408-b32f-455d-b6ff-ff3588cbc4d7-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "aeeeb408-b32f-455d-b6ff-ff3588cbc4d7" (UID: "aeeeb408-b32f-455d-b6ff-ff3588cbc4d7"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 22 04:51:39.503972 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:51:39.503946    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/aeeeb408-b32f-455d-b6ff-ff3588cbc4d7-kube-api-access-2b9tv" (OuterVolumeSpecName: "kube-api-access-2b9tv") pod "aeeeb408-b32f-455d-b6ff-ff3588cbc4d7" (UID: "aeeeb408-b32f-455d-b6ff-ff3588cbc4d7"). InnerVolumeSpecName "kube-api-access-2b9tv". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 22 04:51:39.537200 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:51:39.537171    2563 generic.go:356] "Generic (PLEG): container finished" podID="aeeeb408-b32f-455d-b6ff-ff3588cbc4d7" containerID="d97ca8b0e1ad51c24a83a69862b745342af90e64f98d52b48f45da71c057d055" exitCode=0
Jul 22 04:51:39.537312 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:51:39.537221    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="llm/e2e-same-id-a-4f9fb706-kserve-6c69bc4bb7-dn58z"
Jul 22 04:51:39.537312 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:51:39.537259    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-same-id-a-4f9fb706-kserve-6c69bc4bb7-dn58z" event={"ID":"aeeeb408-b32f-455d-b6ff-ff3588cbc4d7","Type":"ContainerDied","Data":"d97ca8b0e1ad51c24a83a69862b745342af90e64f98d52b48f45da71c057d055"}
Jul 22 04:51:39.537312 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:51:39.537300    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-same-id-a-4f9fb706-kserve-6c69bc4bb7-dn58z" event={"ID":"aeeeb408-b32f-455d-b6ff-ff3588cbc4d7","Type":"ContainerDied","Data":"93b58debc7396663314b8db61dcda85dd199593d80e117c8cbd95981d79b7dd4"}
Jul 22 04:51:39.537471 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:51:39.537317    2563 scope.go:117] "RemoveContainer" containerID="d97ca8b0e1ad51c24a83a69862b745342af90e64f98d52b48f45da71c057d055"
Jul 22 04:51:39.546340 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:51:39.546327    2563 scope.go:117] "RemoveContainer" containerID="d97ca8b0e1ad51c24a83a69862b745342af90e64f98d52b48f45da71c057d055"
Jul 22 04:51:39.546582 ip-10-0-141-238 kubenswrapper[2563]: E0722 04:51:39.546565    2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d97ca8b0e1ad51c24a83a69862b745342af90e64f98d52b48f45da71c057d055\": container with ID starting with d97ca8b0e1ad51c24a83a69862b745342af90e64f98d52b48f45da71c057d055 not found: ID does not exist" containerID="d97ca8b0e1ad51c24a83a69862b745342af90e64f98d52b48f45da71c057d055"
Jul 22 04:51:39.546627 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:51:39.546589    2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d97ca8b0e1ad51c24a83a69862b745342af90e64f98d52b48f45da71c057d055"} err="failed to get container status \"d97ca8b0e1ad51c24a83a69862b745342af90e64f98d52b48f45da71c057d055\": rpc error: code = NotFound desc = could not find container \"d97ca8b0e1ad51c24a83a69862b745342af90e64f98d52b48f45da71c057d055\": container with ID starting with d97ca8b0e1ad51c24a83a69862b745342af90e64f98d52b48f45da71c057d055 not found: ID does not exist"
Jul 22 04:51:39.556811 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:51:39.556793    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["llm/e2e-same-id-a-4f9fb706-kserve-6c69bc4bb7-dn58z"]
Jul 22 04:51:39.558963 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:51:39.558943    2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["llm/e2e-same-id-a-4f9fb706-kserve-6c69bc4bb7-dn58z"]
Jul 22 04:51:39.602833 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:51:39.602811    2563 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/aeeeb408-b32f-455d-b6ff-ff3588cbc4d7-tls-certs\") on node \"ip-10-0-141-238.ec2.internal\" DevicePath \"\""
Jul 22 04:51:39.602833 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:51:39.602832    2563 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/aeeeb408-b32f-455d-b6ff-ff3588cbc4d7-dshm\") on node \"ip-10-0-141-238.ec2.internal\" DevicePath \"\""
Jul 22 04:51:39.602964 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:51:39.602845    2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-2b9tv\" (UniqueName: \"kubernetes.io/projected/aeeeb408-b32f-455d-b6ff-ff3588cbc4d7-kube-api-access-2b9tv\") on node \"ip-10-0-141-238.ec2.internal\" DevicePath \"\""
Jul 22 04:51:39.602964 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:51:39.602857    2563 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/aeeeb408-b32f-455d-b6ff-ff3588cbc4d7-tmp-dir\") on node \"ip-10-0-141-238.ec2.internal\" DevicePath \"\""
Jul 22 04:51:39.602964 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:51:39.602872    2563 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/aeeeb408-b32f-455d-b6ff-ff3588cbc4d7-home\") on node \"ip-10-0-141-238.ec2.internal\" DevicePath \"\""
Jul 22 04:51:41.069824 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:51:41.069787    2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="aeeeb408-b32f-455d-b6ff-ff3588cbc4d7" path="/var/lib/kubelet/pods/aeeeb408-b32f-455d-b6ff-ff3588cbc4d7/volumes"
Jul 22 04:51:42.367649 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:51:42.367603    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-wsdd9"]
Jul 22 04:51:49.170429 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:51:49.170396    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-wsdd9"]
Jul 22 04:52:05.269087 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:52:05.269049    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-wsdd9"]
Jul 22 04:52:14.468286 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:52:14.468250    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-wsdd9"]
Jul 22 04:52:23.674528 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:52:23.674499    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-wsdd9"]
Jul 22 04:52:34.866453 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:52:34.866416    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-wsdd9"]
Jul 22 04:52:43.876116 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:52:43.876079    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-wsdd9"]
Jul 22 04:52:53.472025 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:52:53.471986    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-wsdd9"]
Jul 22 04:53:06.969569 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:53:06.969533    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-wsdd9"]
Jul 22 04:53:16.178789 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:53:16.178754    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-wsdd9"]
Jul 22 04:53:31.163747 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:53:31.163715    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-wsdd9"]
Jul 22 04:53:39.673647 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:53:39.673615    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-wsdd9"]
Jul 22 04:53:51.967954 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:53:51.967914    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-wsdd9"]
Jul 22 04:53:58.506893 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:53:58.506844    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j9gvx_b4af3ae5-fa65-4358-8399-6ed11b68616e/konnectivity-agent/0.log" limit=1024
Jul 22 04:54:08.677143 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:54:08.677101    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-wsdd9"]
Jul 22 04:54:19.885003 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:54:19.884967    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-wsdd9"]
Jul 22 04:54:29.263876 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:54:29.263844    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-wsdd9"]
Jul 22 04:54:31.581195 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:54:31.581159    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j9gvx_b4af3ae5-fa65-4358-8399-6ed11b68616e/konnectivity-agent/0.log" limit=1024
Jul 22 04:54:43.864281 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:54:43.864247    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-wsdd9"]
Jul 22 04:54:45.046442 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:54:45.046410    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-gw4km_67c7210c-7cfa-4865-bce3-777fbb6f3cea/console-operator/1.log"
Jul 22 04:54:45.048852 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:54:45.048824    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-gw4km_67c7210c-7cfa-4865-bce3-777fbb6f3cea/console-operator/1.log"
Jul 22 04:54:52.876561 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:54:52.876446    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j9gvx_b4af3ae5-fa65-4358-8399-6ed11b68616e/konnectivity-agent/0.log" limit=1024
Jul 22 04:54:55.684263 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:54:55.684225    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j9gvx_b4af3ae5-fa65-4358-8399-6ed11b68616e/konnectivity-agent/0.log" limit=1024
Jul 22 04:54:55.786564 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:54:55.786531    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j9gvx_b4af3ae5-fa65-4358-8399-6ed11b68616e/konnectivity-agent/0.log" limit=1024
Jul 22 04:54:56.086107 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:54:56.086020    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j9gvx_b4af3ae5-fa65-4358-8399-6ed11b68616e/konnectivity-agent/0.log" limit=1024
Jul 22 04:54:57.270846 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:54:57.270811    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-wsdd9"]
Jul 22 04:55:01.611791 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:55:01.611752    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j9gvx_b4af3ae5-fa65-4358-8399-6ed11b68616e/konnectivity-agent/0.log" limit=1024
Jul 22 04:55:01.671179 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:55:01.671124    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j9gvx_b4af3ae5-fa65-4358-8399-6ed11b68616e/konnectivity-agent/0.log" limit=1024
Jul 22 04:55:01.831900 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:55:01.831852    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j9gvx_b4af3ae5-fa65-4358-8399-6ed11b68616e/konnectivity-agent/0.log" limit=1024
Jul 22 04:55:02.126023 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:55:02.125995    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j9gvx_b4af3ae5-fa65-4358-8399-6ed11b68616e/konnectivity-agent/0.log" limit=1024
Jul 22 04:55:02.292686 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:55:02.292650    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j9gvx_b4af3ae5-fa65-4358-8399-6ed11b68616e/konnectivity-agent/0.log" limit=1024
Jul 22 04:55:04.325018 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:55:04.324987    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j9gvx_b4af3ae5-fa65-4358-8399-6ed11b68616e/konnectivity-agent/0.log" limit=1024
Jul 22 04:55:04.417462 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:55:04.417428    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j9gvx_b4af3ae5-fa65-4358-8399-6ed11b68616e/konnectivity-agent/0.log" limit=1024
Jul 22 04:55:04.481843 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:55:04.481810    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j9gvx_b4af3ae5-fa65-4358-8399-6ed11b68616e/konnectivity-agent/0.log" limit=1024
Jul 22 04:55:04.758323 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:55:04.758292    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j9gvx_b4af3ae5-fa65-4358-8399-6ed11b68616e/konnectivity-agent/0.log" limit=1024
Jul 22 04:55:04.974415 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:55:04.974366    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j9gvx_b4af3ae5-fa65-4358-8399-6ed11b68616e/konnectivity-agent/0.log" limit=1024
Jul 22 04:55:05.074720 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:55:05.074611    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j9gvx_b4af3ae5-fa65-4358-8399-6ed11b68616e/konnectivity-agent/0.log" limit=1024
Jul 22 04:55:07.868449 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:55:07.868414    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-wsdd9"]
Jul 22 04:55:29.784270 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:55:29.784235    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-e1453556-hxnn8"]
Jul 22 04:55:29.784739 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:55:29.784592    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="aeeeb408-b32f-455d-b6ff-ff3588cbc4d7" containerName="main"
Jul 22 04:55:29.784739 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:55:29.784604    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="aeeeb408-b32f-455d-b6ff-ff3588cbc4d7" containerName="main"
Jul 22 04:55:29.784739 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:55:29.784672    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="aeeeb408-b32f-455d-b6ff-ff3588cbc4d7" containerName="main"
Jul 22 04:55:29.787417 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:55:29.787401    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-e1453556-hxnn8"
Jul 22 04:55:29.790238 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:55:29.790217    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 22 04:55:29.790376 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:55:29.790219    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-65v9v\""
Jul 22 04:55:29.794220 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:55:29.794190    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-e1453556-hxnn8"]
Jul 22 04:55:29.953638 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:55:29.953603    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/c9771ded-6aa9-43bc-91dc-dec0049ae608-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-e1453556-hxnn8\" (UID: \"c9771ded-6aa9-43bc-91dc-dec0049ae608\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-e1453556-hxnn8"
Jul 22 04:55:30.054177 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:55:30.054091    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/c9771ded-6aa9-43bc-91dc-dec0049ae608-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-e1453556-hxnn8\" (UID: \"c9771ded-6aa9-43bc-91dc-dec0049ae608\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-e1453556-hxnn8"
Jul 22 04:55:30.054733 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:55:30.054710    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/c9771ded-6aa9-43bc-91dc-dec0049ae608-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-e1453556-hxnn8\" (UID: \"c9771ded-6aa9-43bc-91dc-dec0049ae608\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-e1453556-hxnn8"
Jul 22 04:55:30.099295 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:55:30.099261    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-e1453556-hxnn8"
Jul 22 04:55:30.231434 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:55:30.231302    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-e1453556-hxnn8"]
Jul 22 04:55:30.234503 ip-10-0-141-238 kubenswrapper[2563]: W0722 04:55:30.234476    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc9771ded_6aa9_43bc_91dc_dec0049ae608.slice/crio-cb7c4cfa5eb5118ac2a069044c2ae95238ed4c6fd866e3c703293f0259c338fe WatchSource:0}: Error finding container cb7c4cfa5eb5118ac2a069044c2ae95238ed4c6fd866e3c703293f0259c338fe: Status 404 returned error can't find the container with id cb7c4cfa5eb5118ac2a069044c2ae95238ed4c6fd866e3c703293f0259c338fe
Jul 22 04:55:30.236458 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:55:30.236440    2563 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 22 04:55:30.538190 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:55:30.538147    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-e1453556-hxnn8" event={"ID":"c9771ded-6aa9-43bc-91dc-dec0049ae608","Type":"ContainerStarted","Data":"cb7c4cfa5eb5118ac2a069044c2ae95238ed4c6fd866e3c703293f0259c338fe"}
Jul 22 04:55:33.554936 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:55:33.554903    2563 generic.go:356] "Generic (PLEG): container finished" podID="c9771ded-6aa9-43bc-91dc-dec0049ae608" containerID="97e129c7331f16b2666b60f4f7e8b6f6a5bed4f1c9c15c5eba84b5efa978609b" exitCode=0
Jul 22 04:55:33.555348 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:55:33.554953    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-e1453556-hxnn8" event={"ID":"c9771ded-6aa9-43bc-91dc-dec0049ae608","Type":"ContainerDied","Data":"97e129c7331f16b2666b60f4f7e8b6f6a5bed4f1c9c15c5eba84b5efa978609b"}
Jul 22 04:55:34.685656 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:55:34.685630    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-e1453556-hxnn8"
Jul 22 04:55:34.795809 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:55:34.795773    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/c9771ded-6aa9-43bc-91dc-dec0049ae608-maas-api-service-ca\") pod \"c9771ded-6aa9-43bc-91dc-dec0049ae608\" (UID: \"c9771ded-6aa9-43bc-91dc-dec0049ae608\") "
Jul 22 04:55:34.796183 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:55:34.796153    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c9771ded-6aa9-43bc-91dc-dec0049ae608-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "c9771ded-6aa9-43bc-91dc-dec0049ae608" (UID: "c9771ded-6aa9-43bc-91dc-dec0049ae608"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 22 04:55:34.896767 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:55:34.896692    2563 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/c9771ded-6aa9-43bc-91dc-dec0049ae608-maas-api-service-ca\") on node \"ip-10-0-141-238.ec2.internal\" DevicePath \"\""
Jul 22 04:55:35.565511 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:55:35.565469    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-e1453556-hxnn8" event={"ID":"c9771ded-6aa9-43bc-91dc-dec0049ae608","Type":"ContainerDied","Data":"cb7c4cfa5eb5118ac2a069044c2ae95238ed4c6fd866e3c703293f0259c338fe"}
Jul 22 04:55:35.565511 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:55:35.565508    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-e1453556-hxnn8"
Jul 22 04:55:35.565737 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:55:35.565526    2563 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="cb7c4cfa5eb5118ac2a069044c2ae95238ed4c6fd866e3c703293f0259c338fe"
Jul 22 04:55:38.556427 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:55:38.556387    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j9gvx_b4af3ae5-fa65-4358-8399-6ed11b68616e/konnectivity-agent/0.log" limit=1024
Jul 22 04:55:40.287178 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:55:40.287145    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j9gvx_b4af3ae5-fa65-4358-8399-6ed11b68616e/konnectivity-agent/0.log" limit=1024
Jul 22 04:55:43.065608 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:55:43.065570    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-wsdd9"]
Jul 22 04:55:44.861136 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:55:44.861089    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j9gvx_b4af3ae5-fa65-4358-8399-6ed11b68616e/konnectivity-agent/0.log" limit=1024
Jul 22 04:55:44.869863 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:55:44.869836    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-e1453556-hxnn8"]
Jul 22 04:55:44.872235 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:55:44.872212    2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-e1453556-hxnn8"]
Jul 22 04:55:45.021981 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:55:45.021950    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j9gvx_b4af3ae5-fa65-4358-8399-6ed11b68616e/konnectivity-agent/0.log" limit=1024
Jul 22 04:55:45.066023 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:55:45.065986    2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c9771ded-6aa9-43bc-91dc-dec0049ae608" path="/var/lib/kubelet/pods/c9771ded-6aa9-43bc-91dc-dec0049ae608/volumes"
Jul 22 04:55:45.244811 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:55:45.244778    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j9gvx_b4af3ae5-fa65-4358-8399-6ed11b68616e/konnectivity-agent/0.log" limit=1024
Jul 22 04:55:45.543106 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:55:45.543009    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j9gvx_b4af3ae5-fa65-4358-8399-6ed11b68616e/konnectivity-agent/0.log" limit=1024
Jul 22 04:55:45.640780 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:55:45.640752    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j9gvx_b4af3ae5-fa65-4358-8399-6ed11b68616e/konnectivity-agent/0.log" limit=1024
Jul 22 04:55:45.740980 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:55:45.740949    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j9gvx_b4af3ae5-fa65-4358-8399-6ed11b68616e/konnectivity-agent/0.log" limit=1024
Jul 22 04:55:45.975950 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:55:45.975919    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-migrate-90fa15ea-gw-openshift-default-8c57c585f-zkqqb"]
Jul 22 04:55:45.976350 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:55:45.976274    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c9771ded-6aa9-43bc-91dc-dec0049ae608" containerName="revoke-keys"
Jul 22 04:55:45.976350 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:55:45.976288    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="c9771ded-6aa9-43bc-91dc-dec0049ae608" containerName="revoke-keys"
Jul 22 04:55:45.976350 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:55:45.976344    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="c9771ded-6aa9-43bc-91dc-dec0049ae608" containerName="revoke-keys"
Jul 22 04:55:45.980518 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:55:45.980499    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-migrate-90fa15ea-gw-openshift-default-8c57c585f-zkqqb"
Jul 22 04:55:45.982989 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:55:45.982968    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-migrate-90fa15ea-gw-openshift-default-dockercfg-bw4ql\""
Jul 22 04:55:45.990987 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:55:45.990965    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-migrate-90fa15ea-gw-openshift-default-8c57c585f-zkqqb"]
Jul 22 04:55:46.014391 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:55:46.014354    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j9gvx_b4af3ae5-fa65-4358-8399-6ed11b68616e/konnectivity-agent/0.log" limit=1024
Jul 22 04:55:46.081164 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:55:46.081122    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/aa1e5842-39c1-4724-b0d3-1fbed7228b4c-credential-socket\") pod \"e2e-migrate-90fa15ea-gw-openshift-default-8c57c585f-zkqqb\" (UID: \"aa1e5842-39c1-4724-b0d3-1fbed7228b4c\") " pod="openshift-ingress/e2e-migrate-90fa15ea-gw-openshift-default-8c57c585f-zkqqb"
Jul 22 04:55:46.081164 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:55:46.081157    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/aa1e5842-39c1-4724-b0d3-1fbed7228b4c-istio-data\") pod \"e2e-migrate-90fa15ea-gw-openshift-default-8c57c585f-zkqqb\" (UID: \"aa1e5842-39c1-4724-b0d3-1fbed7228b4c\") " pod="openshift-ingress/e2e-migrate-90fa15ea-gw-openshift-default-8c57c585f-zkqqb"
Jul 22 04:55:46.081422 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:55:46.081191    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/aa1e5842-39c1-4724-b0d3-1fbed7228b4c-istio-envoy\") pod \"e2e-migrate-90fa15ea-gw-openshift-default-8c57c585f-zkqqb\" (UID: \"aa1e5842-39c1-4724-b0d3-1fbed7228b4c\") " pod="openshift-ingress/e2e-migrate-90fa15ea-gw-openshift-default-8c57c585f-zkqqb"
Jul 22 04:55:46.081422 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:55:46.081224    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/aa1e5842-39c1-4724-b0d3-1fbed7228b4c-istiod-ca-cert\") pod \"e2e-migrate-90fa15ea-gw-openshift-default-8c57c585f-zkqqb\" (UID: \"aa1e5842-39c1-4724-b0d3-1fbed7228b4c\") " pod="openshift-ingress/e2e-migrate-90fa15ea-gw-openshift-default-8c57c585f-zkqqb"
Jul 22 04:55:46.081422 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:55:46.081243    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/aa1e5842-39c1-4724-b0d3-1fbed7228b4c-istio-podinfo\") pod \"e2e-migrate-90fa15ea-gw-openshift-default-8c57c585f-zkqqb\" (UID: \"aa1e5842-39c1-4724-b0d3-1fbed7228b4c\") " pod="openshift-ingress/e2e-migrate-90fa15ea-gw-openshift-default-8c57c585f-zkqqb"
Jul 22 04:55:46.081422 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:55:46.081260    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/aa1e5842-39c1-4724-b0d3-1fbed7228b4c-istio-token\") pod \"e2e-migrate-90fa15ea-gw-openshift-default-8c57c585f-zkqqb\" (UID: \"aa1e5842-39c1-4724-b0d3-1fbed7228b4c\") " pod="openshift-ingress/e2e-migrate-90fa15ea-gw-openshift-default-8c57c585f-zkqqb"
Jul 22 04:55:46.081422 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:55:46.081321    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/aa1e5842-39c1-4724-b0d3-1fbed7228b4c-workload-certs\") pod \"e2e-migrate-90fa15ea-gw-openshift-default-8c57c585f-zkqqb\" (UID: \"aa1e5842-39c1-4724-b0d3-1fbed7228b4c\") " pod="openshift-ingress/e2e-migrate-90fa15ea-gw-openshift-default-8c57c585f-zkqqb"
Jul 22 04:55:46.081422 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:55:46.081341    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gmlsr\" (UniqueName: \"kubernetes.io/projected/aa1e5842-39c1-4724-b0d3-1fbed7228b4c-kube-api-access-gmlsr\") pod \"e2e-migrate-90fa15ea-gw-openshift-default-8c57c585f-zkqqb\" (UID: \"aa1e5842-39c1-4724-b0d3-1fbed7228b4c\") " pod="openshift-ingress/e2e-migrate-90fa15ea-gw-openshift-default-8c57c585f-zkqqb"
Jul 22 04:55:46.081422 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:55:46.081411    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/aa1e5842-39c1-4724-b0d3-1fbed7228b4c-workload-socket\") pod \"e2e-migrate-90fa15ea-gw-openshift-default-8c57c585f-zkqqb\" (UID: \"aa1e5842-39c1-4724-b0d3-1fbed7228b4c\") " pod="openshift-ingress/e2e-migrate-90fa15ea-gw-openshift-default-8c57c585f-zkqqb"
Jul 22 04:55:46.107237 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:55:46.107200    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j9gvx_b4af3ae5-fa65-4358-8399-6ed11b68616e/konnectivity-agent/0.log" limit=1024
Jul 22 04:55:46.182637 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:55:46.182591    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/aa1e5842-39c1-4724-b0d3-1fbed7228b4c-credential-socket\") pod \"e2e-migrate-90fa15ea-gw-openshift-default-8c57c585f-zkqqb\" (UID: \"aa1e5842-39c1-4724-b0d3-1fbed7228b4c\") " pod="openshift-ingress/e2e-migrate-90fa15ea-gw-openshift-default-8c57c585f-zkqqb"
Jul 22 04:55:46.182637 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:55:46.182639    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/aa1e5842-39c1-4724-b0d3-1fbed7228b4c-istio-data\") pod \"e2e-migrate-90fa15ea-gw-openshift-default-8c57c585f-zkqqb\" (UID: \"aa1e5842-39c1-4724-b0d3-1fbed7228b4c\") " pod="openshift-ingress/e2e-migrate-90fa15ea-gw-openshift-default-8c57c585f-zkqqb"
Jul 22 04:55:46.182895 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:55:46.182767    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/aa1e5842-39c1-4724-b0d3-1fbed7228b4c-istio-envoy\") pod \"e2e-migrate-90fa15ea-gw-openshift-default-8c57c585f-zkqqb\" (UID: \"aa1e5842-39c1-4724-b0d3-1fbed7228b4c\") " pod="openshift-ingress/e2e-migrate-90fa15ea-gw-openshift-default-8c57c585f-zkqqb"
Jul 22 04:55:46.182895 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:55:46.182809    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/aa1e5842-39c1-4724-b0d3-1fbed7228b4c-istiod-ca-cert\") pod \"e2e-migrate-90fa15ea-gw-openshift-default-8c57c585f-zkqqb\" (UID: \"aa1e5842-39c1-4724-b0d3-1fbed7228b4c\") " pod="openshift-ingress/e2e-migrate-90fa15ea-gw-openshift-default-8c57c585f-zkqqb"
Jul 22 04:55:46.182895 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:55:46.182840    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/aa1e5842-39c1-4724-b0d3-1fbed7228b4c-istio-podinfo\") pod \"e2e-migrate-90fa15ea-gw-openshift-default-8c57c585f-zkqqb\" (UID: \"aa1e5842-39c1-4724-b0d3-1fbed7228b4c\") " pod="openshift-ingress/e2e-migrate-90fa15ea-gw-openshift-default-8c57c585f-zkqqb"
Jul 22 04:55:46.182895 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:55:46.182861    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/aa1e5842-39c1-4724-b0d3-1fbed7228b4c-istio-token\") pod \"e2e-migrate-90fa15ea-gw-openshift-default-8c57c585f-zkqqb\" (UID: \"aa1e5842-39c1-4724-b0d3-1fbed7228b4c\") " pod="openshift-ingress/e2e-migrate-90fa15ea-gw-openshift-default-8c57c585f-zkqqb"
Jul 22 04:55:46.183147 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:55:46.182903    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/aa1e5842-39c1-4724-b0d3-1fbed7228b4c-workload-certs\") pod \"e2e-migrate-90fa15ea-gw-openshift-default-8c57c585f-zkqqb\" (UID: \"aa1e5842-39c1-4724-b0d3-1fbed7228b4c\") " pod="openshift-ingress/e2e-migrate-90fa15ea-gw-openshift-default-8c57c585f-zkqqb"
Jul 22 04:55:46.183147 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:55:46.182925    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gmlsr\" (UniqueName: \"kubernetes.io/projected/aa1e5842-39c1-4724-b0d3-1fbed7228b4c-kube-api-access-gmlsr\") pod \"e2e-migrate-90fa15ea-gw-openshift-default-8c57c585f-zkqqb\" (UID: \"aa1e5842-39c1-4724-b0d3-1fbed7228b4c\") " pod="openshift-ingress/e2e-migrate-90fa15ea-gw-openshift-default-8c57c585f-zkqqb"
Jul 22 04:55:46.183147 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:55:46.182967    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/aa1e5842-39c1-4724-b0d3-1fbed7228b4c-workload-socket\") pod \"e2e-migrate-90fa15ea-gw-openshift-default-8c57c585f-zkqqb\" (UID: \"aa1e5842-39c1-4724-b0d3-1fbed7228b4c\") " pod="openshift-ingress/e2e-migrate-90fa15ea-gw-openshift-default-8c57c585f-zkqqb"
Jul 22 04:55:46.183147 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:55:46.183106    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/aa1e5842-39c1-4724-b0d3-1fbed7228b4c-istio-data\") pod \"e2e-migrate-90fa15ea-gw-openshift-default-8c57c585f-zkqqb\" (UID: \"aa1e5842-39c1-4724-b0d3-1fbed7228b4c\") " pod="openshift-ingress/e2e-migrate-90fa15ea-gw-openshift-default-8c57c585f-zkqqb"
Jul 22 04:55:46.183349 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:55:46.183141    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/aa1e5842-39c1-4724-b0d3-1fbed7228b4c-credential-socket\") pod \"e2e-migrate-90fa15ea-gw-openshift-default-8c57c585f-zkqqb\" (UID: \"aa1e5842-39c1-4724-b0d3-1fbed7228b4c\") " pod="openshift-ingress/e2e-migrate-90fa15ea-gw-openshift-default-8c57c585f-zkqqb"
Jul 22 04:55:46.183403 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:55:46.183378    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/aa1e5842-39c1-4724-b0d3-1fbed7228b4c-workload-socket\") pod \"e2e-migrate-90fa15ea-gw-openshift-default-8c57c585f-zkqqb\" (UID: \"aa1e5842-39c1-4724-b0d3-1fbed7228b4c\") " pod="openshift-ingress/e2e-migrate-90fa15ea-gw-openshift-default-8c57c585f-zkqqb"
Jul 22 04:55:46.183459 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:55:46.183427    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/aa1e5842-39c1-4724-b0d3-1fbed7228b4c-workload-certs\") pod \"e2e-migrate-90fa15ea-gw-openshift-default-8c57c585f-zkqqb\" (UID: \"aa1e5842-39c1-4724-b0d3-1fbed7228b4c\") " pod="openshift-ingress/e2e-migrate-90fa15ea-gw-openshift-default-8c57c585f-zkqqb"
Jul 22 04:55:46.183532 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:55:46.183514    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/aa1e5842-39c1-4724-b0d3-1fbed7228b4c-istiod-ca-cert\") pod \"e2e-migrate-90fa15ea-gw-openshift-default-8c57c585f-zkqqb\" (UID: \"aa1e5842-39c1-4724-b0d3-1fbed7228b4c\") " pod="openshift-ingress/e2e-migrate-90fa15ea-gw-openshift-default-8c57c585f-zkqqb"
Jul 22 04:55:46.185121 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:55:46.185099    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/aa1e5842-39c1-4724-b0d3-1fbed7228b4c-istio-envoy\") pod \"e2e-migrate-90fa15ea-gw-openshift-default-8c57c585f-zkqqb\" (UID: \"aa1e5842-39c1-4724-b0d3-1fbed7228b4c\") " pod="openshift-ingress/e2e-migrate-90fa15ea-gw-openshift-default-8c57c585f-zkqqb"
Jul 22 04:55:46.185384 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:55:46.185366    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/aa1e5842-39c1-4724-b0d3-1fbed7228b4c-istio-podinfo\") pod \"e2e-migrate-90fa15ea-gw-openshift-default-8c57c585f-zkqqb\" (UID: \"aa1e5842-39c1-4724-b0d3-1fbed7228b4c\") " pod="openshift-ingress/e2e-migrate-90fa15ea-gw-openshift-default-8c57c585f-zkqqb"
Jul 22 04:55:46.190328 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:55:46.190297    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/aa1e5842-39c1-4724-b0d3-1fbed7228b4c-istio-token\") pod \"e2e-migrate-90fa15ea-gw-openshift-default-8c57c585f-zkqqb\" (UID: \"aa1e5842-39c1-4724-b0d3-1fbed7228b4c\") " pod="openshift-ingress/e2e-migrate-90fa15ea-gw-openshift-default-8c57c585f-zkqqb"
Jul 22 04:55:46.190434 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:55:46.190413    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gmlsr\" (UniqueName: \"kubernetes.io/projected/aa1e5842-39c1-4724-b0d3-1fbed7228b4c-kube-api-access-gmlsr\") pod \"e2e-migrate-90fa15ea-gw-openshift-default-8c57c585f-zkqqb\" (UID: \"aa1e5842-39c1-4724-b0d3-1fbed7228b4c\") " pod="openshift-ingress/e2e-migrate-90fa15ea-gw-openshift-default-8c57c585f-zkqqb"
Jul 22 04:55:46.290453 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:55:46.290363    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-migrate-90fa15ea-gw-openshift-default-8c57c585f-zkqqb"
Jul 22 04:55:46.426965 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:55:46.426933    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-migrate-90fa15ea-gw-openshift-default-8c57c585f-zkqqb"]
Jul 22 04:55:46.428887 ip-10-0-141-238 kubenswrapper[2563]: W0722 04:55:46.428856    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podaa1e5842_39c1_4724_b0d3_1fbed7228b4c.slice/crio-6f9e51c112ac6b2c516bc82492e751cee86b6dcf09f6a621c954ca93141c71ee WatchSource:0}: Error finding container 6f9e51c112ac6b2c516bc82492e751cee86b6dcf09f6a621c954ca93141c71ee: Status 404 returned error can't find the container with id 6f9e51c112ac6b2c516bc82492e751cee86b6dcf09f6a621c954ca93141c71ee
Jul 22 04:55:46.431007 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:55:46.430952    2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 22 04:55:46.431102 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:55:46.431068    2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 22 04:55:46.431145 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:55:46.431101    2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 22 04:55:46.616928 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:55:46.616835    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-90fa15ea-gw-openshift-default-8c57c585f-zkqqb" event={"ID":"aa1e5842-39c1-4724-b0d3-1fbed7228b4c","Type":"ContainerStarted","Data":"d97b5d788e7b581bb6a7e87d4856afce2f4594feacbf20597bbe25323d31496f"}
Jul 22 04:55:46.616928 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:55:46.616916    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-90fa15ea-gw-openshift-default-8c57c585f-zkqqb" event={"ID":"aa1e5842-39c1-4724-b0d3-1fbed7228b4c","Type":"ContainerStarted","Data":"6f9e51c112ac6b2c516bc82492e751cee86b6dcf09f6a621c954ca93141c71ee"}
Jul 22 04:55:46.635345 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:55:46.635284    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-migrate-90fa15ea-gw-openshift-default-8c57c585f-zkqqb" podStartSLOduration=1.635263277 podStartE2EDuration="1.635263277s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 04:55:45 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 04:55:46.634747252 +0000 UTC m=+1862.053756009" watchObservedRunningTime="2026-07-22 04:55:46.635263277 +0000 UTC m=+1862.054272039"
Jul 22 04:55:47.291387 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:55:47.291343    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-migrate-90fa15ea-gw-openshift-default-8c57c585f-zkqqb"
Jul 22 04:55:47.296460 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:55:47.296432    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-migrate-90fa15ea-gw-openshift-default-8c57c585f-zkqqb"
Jul 22 04:55:47.621156 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:55:47.621067    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-migrate-90fa15ea-gw-openshift-default-8c57c585f-zkqqb"
Jul 22 04:55:47.622146 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:55:47.622127    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-migrate-90fa15ea-gw-openshift-default-8c57c585f-zkqqb"
Jul 22 04:55:48.082441 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:55:48.082405    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j9gvx_b4af3ae5-fa65-4358-8399-6ed11b68616e/konnectivity-agent/0.log" limit=1024
Jul 22 04:55:48.195205 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:55:48.195173    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j9gvx_b4af3ae5-fa65-4358-8399-6ed11b68616e/konnectivity-agent/0.log" limit=1024
Jul 22 04:55:48.664412 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:55:48.664367    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j9gvx_b4af3ae5-fa65-4358-8399-6ed11b68616e/konnectivity-agent/0.log" limit=1024
Jul 22 04:55:49.857902 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:55:49.857858    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j9gvx_b4af3ae5-fa65-4358-8399-6ed11b68616e/konnectivity-agent/0.log" limit=1024
Jul 22 04:55:51.388887 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:55:51.388851    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j9gvx_b4af3ae5-fa65-4358-8399-6ed11b68616e/konnectivity-agent/0.log" limit=1024
Jul 22 04:55:54.969112 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:55:54.969071    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-wsdd9"]
Jul 22 04:56:02.622699 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:56:02.622673    2563 patch_prober.go:28] interesting pod/e2e-migrate-90fa15ea-gw-openshift-default-8c57c585f-zkqqb container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.134.0.32:15021/healthz/ready\": dial tcp 10.134.0.32:15021: connect: connection refused" start-of-body=
Jul 22 04:56:02.623109 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:56:02.622724    2563 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-migrate-90fa15ea-gw-openshift-default-8c57c585f-zkqqb" podUID="aa1e5842-39c1-4724-b0d3-1fbed7228b4c" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.32:15021/healthz/ready\": dial tcp 10.134.0.32:15021: connect: connection refused"
Jul 22 04:56:02.694259 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:56:02.694228    2563 generic.go:356] "Generic (PLEG): container finished" podID="aa1e5842-39c1-4724-b0d3-1fbed7228b4c" containerID="d97b5d788e7b581bb6a7e87d4856afce2f4594feacbf20597bbe25323d31496f" exitCode=0
Jul 22 04:56:02.694409 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:56:02.694270    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-90fa15ea-gw-openshift-default-8c57c585f-zkqqb" event={"ID":"aa1e5842-39c1-4724-b0d3-1fbed7228b4c","Type":"ContainerDied","Data":"d97b5d788e7b581bb6a7e87d4856afce2f4594feacbf20597bbe25323d31496f"}
Jul 22 04:56:02.694639 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:56:02.694624    2563 scope.go:117] "RemoveContainer" containerID="d97b5d788e7b581bb6a7e87d4856afce2f4594feacbf20597bbe25323d31496f"
Jul 22 04:56:02.695608 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:56:02.695572    2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 22 04:56:02.695665 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:56:02.695638    2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 22 04:56:02.695709 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:56:02.695675    2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 22 04:56:03.700810 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:56:03.700775    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-90fa15ea-gw-openshift-default-8c57c585f-zkqqb" event={"ID":"aa1e5842-39c1-4724-b0d3-1fbed7228b4c","Type":"ContainerStarted","Data":"396676b6e4751efed51ddf909e5c482bce0d302bc107fcfda63c0f50b385447c"}
Jul 22 04:56:04.291508 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:56:04.291474    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-migrate-90fa15ea-gw-openshift-default-8c57c585f-zkqqb"
Jul 22 04:56:04.291688 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:56:04.291665    2563 patch_prober.go:28] interesting pod/e2e-migrate-90fa15ea-gw-openshift-default-8c57c585f-zkqqb container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.32:15021/healthz/ready\": dial tcp 10.134.0.32:15021: connect: connection refused" start-of-body=
Jul 22 04:56:04.291760 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:56:04.291713    2563 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-migrate-90fa15ea-gw-openshift-default-8c57c585f-zkqqb" podUID="aa1e5842-39c1-4724-b0d3-1fbed7228b4c" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.32:15021/healthz/ready\": dial tcp 10.134.0.32:15021: connect: connection refused"
Jul 22 04:56:05.291746 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:56:05.291705    2563 patch_prober.go:28] interesting pod/e2e-migrate-90fa15ea-gw-openshift-default-8c57c585f-zkqqb container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.32:15021/healthz/ready\": dial tcp 10.134.0.32:15021: connect: connection refused" start-of-body=
Jul 22 04:56:05.292168 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:56:05.291768    2563 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-migrate-90fa15ea-gw-openshift-default-8c57c585f-zkqqb" podUID="aa1e5842-39c1-4724-b0d3-1fbed7228b4c" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.32:15021/healthz/ready\": dial tcp 10.134.0.32:15021: connect: connection refused"
Jul 22 04:56:06.290769 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:56:06.290730    2563 patch_prober.go:28] interesting pod/e2e-migrate-90fa15ea-gw-openshift-default-8c57c585f-zkqqb container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.32:15021/healthz/ready\": dial tcp 10.134.0.32:15021: connect: connection refused" start-of-body=
Jul 22 04:56:06.290955 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:56:06.290793    2563 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-migrate-90fa15ea-gw-openshift-default-8c57c585f-zkqqb" podUID="aa1e5842-39c1-4724-b0d3-1fbed7228b4c" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.32:15021/healthz/ready\": dial tcp 10.134.0.32:15021: connect: connection refused"
Jul 22 04:56:07.291401 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:56:07.291311    2563 patch_prober.go:28] interesting pod/e2e-migrate-90fa15ea-gw-openshift-default-8c57c585f-zkqqb container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.32:15021/healthz/ready\": dial tcp 10.134.0.32:15021: connect: connection refused" start-of-body=
Jul 22 04:56:07.291401 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:56:07.291381    2563 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-migrate-90fa15ea-gw-openshift-default-8c57c585f-zkqqb" podUID="aa1e5842-39c1-4724-b0d3-1fbed7228b4c" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.32:15021/healthz/ready\": dial tcp 10.134.0.32:15021: connect: connection refused"
Jul 22 04:56:08.295832 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:56:08.295800    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-migrate-90fa15ea-gw-openshift-default-8c57c585f-zkqqb"
Jul 22 04:56:08.296340 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:56:08.296151    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-migrate-90fa15ea-gw-openshift-default-8c57c585f-zkqqb"
Jul 22 04:56:08.296853 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:56:08.296833    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-migrate-90fa15ea-gw-openshift-default-8c57c585f-zkqqb"
Jul 22 04:56:23.629626 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:56:23.629592    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j9gvx_b4af3ae5-fa65-4358-8399-6ed11b68616e/konnectivity-agent/0.log" limit=1024
Jul 22 04:56:26.472131 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:56:26.472096    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-wsdd9"]
Jul 22 04:56:28.120161 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:56:28.120125    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j9gvx_b4af3ae5-fa65-4358-8399-6ed11b68616e/konnectivity-agent/0.log" limit=1024
Jul 22 04:56:28.262896 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:56:28.262862    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-migrate-90fa15ea-gw-openshift-default-8c57c585f-zkqqb"]
Jul 22 04:56:28.263174 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:56:28.263136    2563 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-migrate-90fa15ea-gw-openshift-default-8c57c585f-zkqqb" podUID="aa1e5842-39c1-4724-b0d3-1fbed7228b4c" containerName="istio-proxy" containerID="cri-o://396676b6e4751efed51ddf909e5c482bce0d302bc107fcfda63c0f50b385447c" gracePeriod=30
Jul 22 04:56:28.269866 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:56:28.269835    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j9gvx_b4af3ae5-fa65-4358-8399-6ed11b68616e/konnectivity-agent/0.log" limit=1024
Jul 22 04:56:28.497992 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:56:28.497933    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j9gvx_b4af3ae5-fa65-4358-8399-6ed11b68616e/konnectivity-agent/0.log" limit=1024
Jul 22 04:56:28.715732 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:56:28.715701    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j9gvx_b4af3ae5-fa65-4358-8399-6ed11b68616e/konnectivity-agent/0.log" limit=1024
Jul 22 04:56:29.012011 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:56:29.011983    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j9gvx_b4af3ae5-fa65-4358-8399-6ed11b68616e/konnectivity-agent/0.log" limit=1024
Jul 22 04:56:29.112219 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:56:29.112188    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j9gvx_b4af3ae5-fa65-4358-8399-6ed11b68616e/konnectivity-agent/0.log" limit=1024
Jul 22 04:56:31.806655 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:56:31.806609    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j9gvx_b4af3ae5-fa65-4358-8399-6ed11b68616e/konnectivity-agent/0.log" limit=1024
Jul 22 04:56:31.890169 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:56:31.890138    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j9gvx_b4af3ae5-fa65-4358-8399-6ed11b68616e/konnectivity-agent/0.log" limit=1024
Jul 22 04:56:31.964849 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:56:31.964809    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j9gvx_b4af3ae5-fa65-4358-8399-6ed11b68616e/konnectivity-agent/0.log" limit=1024
Jul 22 04:56:32.463171 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:56:32.463137    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j9gvx_b4af3ae5-fa65-4358-8399-6ed11b68616e/konnectivity-agent/0.log" limit=1024
Jul 22 04:56:32.561601 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:56:32.561568    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j9gvx_b4af3ae5-fa65-4358-8399-6ed11b68616e/konnectivity-agent/0.log" limit=1024
Jul 22 04:56:32.815640 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:56:32.815558    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j9gvx_b4af3ae5-fa65-4358-8399-6ed11b68616e/konnectivity-agent/0.log" limit=1024
Jul 22 04:56:33.523378 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:56:33.523313    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-migrate-90fa15ea-gw-openshift-default-8c57c585f-zkqqb"
Jul 22 04:56:33.609532 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:56:33.609494    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/aa1e5842-39c1-4724-b0d3-1fbed7228b4c-istiod-ca-cert\") pod \"aa1e5842-39c1-4724-b0d3-1fbed7228b4c\" (UID: \"aa1e5842-39c1-4724-b0d3-1fbed7228b4c\") "
Jul 22 04:56:33.609732 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:56:33.609551    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/aa1e5842-39c1-4724-b0d3-1fbed7228b4c-istio-data\") pod \"aa1e5842-39c1-4724-b0d3-1fbed7228b4c\" (UID: \"aa1e5842-39c1-4724-b0d3-1fbed7228b4c\") "
Jul 22 04:56:33.609732 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:56:33.609579    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/aa1e5842-39c1-4724-b0d3-1fbed7228b4c-workload-socket\") pod \"aa1e5842-39c1-4724-b0d3-1fbed7228b4c\" (UID: \"aa1e5842-39c1-4724-b0d3-1fbed7228b4c\") "
Jul 22 04:56:33.609732 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:56:33.609614    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/aa1e5842-39c1-4724-b0d3-1fbed7228b4c-workload-certs\") pod \"aa1e5842-39c1-4724-b0d3-1fbed7228b4c\" (UID: \"aa1e5842-39c1-4724-b0d3-1fbed7228b4c\") "
Jul 22 04:56:33.609732 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:56:33.609670    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/aa1e5842-39c1-4724-b0d3-1fbed7228b4c-istio-podinfo\") pod \"aa1e5842-39c1-4724-b0d3-1fbed7228b4c\" (UID: \"aa1e5842-39c1-4724-b0d3-1fbed7228b4c\") "
Jul 22 04:56:33.609732 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:56:33.609710    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-gmlsr\" (UniqueName: \"kubernetes.io/projected/aa1e5842-39c1-4724-b0d3-1fbed7228b4c-kube-api-access-gmlsr\") pod \"aa1e5842-39c1-4724-b0d3-1fbed7228b4c\" (UID: \"aa1e5842-39c1-4724-b0d3-1fbed7228b4c\") "
Jul 22 04:56:33.609991 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:56:33.609812    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/aa1e5842-39c1-4724-b0d3-1fbed7228b4c-istio-token\") pod \"aa1e5842-39c1-4724-b0d3-1fbed7228b4c\" (UID: \"aa1e5842-39c1-4724-b0d3-1fbed7228b4c\") "
Jul 22 04:56:33.609991 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:56:33.609964    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/aa1e5842-39c1-4724-b0d3-1fbed7228b4c-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "aa1e5842-39c1-4724-b0d3-1fbed7228b4c" (UID: "aa1e5842-39c1-4724-b0d3-1fbed7228b4c"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 22 04:56:33.609991 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:56:33.609977    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/aa1e5842-39c1-4724-b0d3-1fbed7228b4c-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "aa1e5842-39c1-4724-b0d3-1fbed7228b4c" (UID: "aa1e5842-39c1-4724-b0d3-1fbed7228b4c"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 22 04:56:33.610148 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:56:33.609958    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/aa1e5842-39c1-4724-b0d3-1fbed7228b4c-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "aa1e5842-39c1-4724-b0d3-1fbed7228b4c" (UID: "aa1e5842-39c1-4724-b0d3-1fbed7228b4c"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 22 04:56:33.610148 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:56:33.610107    2563 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/aa1e5842-39c1-4724-b0d3-1fbed7228b4c-istiod-ca-cert\") on node \"ip-10-0-141-238.ec2.internal\" DevicePath \"\""
Jul 22 04:56:33.610148 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:56:33.610121    2563 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/aa1e5842-39c1-4724-b0d3-1fbed7228b4c-workload-socket\") on node \"ip-10-0-141-238.ec2.internal\" DevicePath \"\""
Jul 22 04:56:33.610148 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:56:33.610130    2563 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/aa1e5842-39c1-4724-b0d3-1fbed7228b4c-workload-certs\") on node \"ip-10-0-141-238.ec2.internal\" DevicePath \"\""
Jul 22 04:56:33.610470 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:56:33.610435    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/aa1e5842-39c1-4724-b0d3-1fbed7228b4c-istio-data" (OuterVolumeSpecName: "istio-data") pod "aa1e5842-39c1-4724-b0d3-1fbed7228b4c" (UID: "aa1e5842-39c1-4724-b0d3-1fbed7228b4c"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 22 04:56:33.612196 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:56:33.612171    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/aa1e5842-39c1-4724-b0d3-1fbed7228b4c-kube-api-access-gmlsr" (OuterVolumeSpecName: "kube-api-access-gmlsr") pod "aa1e5842-39c1-4724-b0d3-1fbed7228b4c" (UID: "aa1e5842-39c1-4724-b0d3-1fbed7228b4c"). InnerVolumeSpecName "kube-api-access-gmlsr". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 22 04:56:33.612285 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:56:33.612203    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/aa1e5842-39c1-4724-b0d3-1fbed7228b4c-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "aa1e5842-39c1-4724-b0d3-1fbed7228b4c" (UID: "aa1e5842-39c1-4724-b0d3-1fbed7228b4c"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 22 04:56:33.612285 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:56:33.612233    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/aa1e5842-39c1-4724-b0d3-1fbed7228b4c-istio-token" (OuterVolumeSpecName: "istio-token") pod "aa1e5842-39c1-4724-b0d3-1fbed7228b4c" (UID: "aa1e5842-39c1-4724-b0d3-1fbed7228b4c"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 22 04:56:33.710994 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:56:33.710956    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/aa1e5842-39c1-4724-b0d3-1fbed7228b4c-credential-socket\") pod \"aa1e5842-39c1-4724-b0d3-1fbed7228b4c\" (UID: \"aa1e5842-39c1-4724-b0d3-1fbed7228b4c\") "
Jul 22 04:56:33.710994 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:56:33.710992    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/aa1e5842-39c1-4724-b0d3-1fbed7228b4c-istio-envoy\") pod \"aa1e5842-39c1-4724-b0d3-1fbed7228b4c\" (UID: \"aa1e5842-39c1-4724-b0d3-1fbed7228b4c\") "
Jul 22 04:56:33.711249 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:56:33.711215    2563 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/aa1e5842-39c1-4724-b0d3-1fbed7228b4c-istio-data\") on node \"ip-10-0-141-238.ec2.internal\" DevicePath \"\""
Jul 22 04:56:33.711249 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:56:33.711220    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/aa1e5842-39c1-4724-b0d3-1fbed7228b4c-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "aa1e5842-39c1-4724-b0d3-1fbed7228b4c" (UID: "aa1e5842-39c1-4724-b0d3-1fbed7228b4c"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 22 04:56:33.711249 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:56:33.711229    2563 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/aa1e5842-39c1-4724-b0d3-1fbed7228b4c-istio-podinfo\") on node \"ip-10-0-141-238.ec2.internal\" DevicePath \"\""
Jul 22 04:56:33.711406 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:56:33.711265    2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-gmlsr\" (UniqueName: \"kubernetes.io/projected/aa1e5842-39c1-4724-b0d3-1fbed7228b4c-kube-api-access-gmlsr\") on node \"ip-10-0-141-238.ec2.internal\" DevicePath \"\""
Jul 22 04:56:33.711406 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:56:33.711279    2563 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/aa1e5842-39c1-4724-b0d3-1fbed7228b4c-istio-token\") on node \"ip-10-0-141-238.ec2.internal\" DevicePath \"\""
Jul 22 04:56:33.712983 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:56:33.712962    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/aa1e5842-39c1-4724-b0d3-1fbed7228b4c-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "aa1e5842-39c1-4724-b0d3-1fbed7228b4c" (UID: "aa1e5842-39c1-4724-b0d3-1fbed7228b4c"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 22 04:56:33.811710 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:56:33.811627    2563 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/aa1e5842-39c1-4724-b0d3-1fbed7228b4c-credential-socket\") on node \"ip-10-0-141-238.ec2.internal\" DevicePath \"\""
Jul 22 04:56:33.811710 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:56:33.811660    2563 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/aa1e5842-39c1-4724-b0d3-1fbed7228b4c-istio-envoy\") on node \"ip-10-0-141-238.ec2.internal\" DevicePath \"\""
Jul 22 04:56:33.844870 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:56:33.844832    2563 generic.go:356] "Generic (PLEG): container finished" podID="aa1e5842-39c1-4724-b0d3-1fbed7228b4c" containerID="396676b6e4751efed51ddf909e5c482bce0d302bc107fcfda63c0f50b385447c" exitCode=0
Jul 22 04:56:33.845355 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:56:33.844886    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-migrate-90fa15ea-gw-openshift-default-8c57c585f-zkqqb"
Jul 22 04:56:33.845355 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:56:33.844905    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-90fa15ea-gw-openshift-default-8c57c585f-zkqqb" event={"ID":"aa1e5842-39c1-4724-b0d3-1fbed7228b4c","Type":"ContainerDied","Data":"396676b6e4751efed51ddf909e5c482bce0d302bc107fcfda63c0f50b385447c"}
Jul 22 04:56:33.845355 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:56:33.844955    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-90fa15ea-gw-openshift-default-8c57c585f-zkqqb" event={"ID":"aa1e5842-39c1-4724-b0d3-1fbed7228b4c","Type":"ContainerDied","Data":"6f9e51c112ac6b2c516bc82492e751cee86b6dcf09f6a621c954ca93141c71ee"}
Jul 22 04:56:33.845355 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:56:33.844978    2563 scope.go:117] "RemoveContainer" containerID="396676b6e4751efed51ddf909e5c482bce0d302bc107fcfda63c0f50b385447c"
Jul 22 04:56:33.853958 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:56:33.853934    2563 scope.go:117] "RemoveContainer" containerID="d97b5d788e7b581bb6a7e87d4856afce2f4594feacbf20597bbe25323d31496f"
Jul 22 04:56:33.861940 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:56:33.861921    2563 scope.go:117] "RemoveContainer" containerID="396676b6e4751efed51ddf909e5c482bce0d302bc107fcfda63c0f50b385447c"
Jul 22 04:56:33.862258 ip-10-0-141-238 kubenswrapper[2563]: E0722 04:56:33.862238    2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"396676b6e4751efed51ddf909e5c482bce0d302bc107fcfda63c0f50b385447c\": container with ID starting with 396676b6e4751efed51ddf909e5c482bce0d302bc107fcfda63c0f50b385447c not found: ID does not exist" containerID="396676b6e4751efed51ddf909e5c482bce0d302bc107fcfda63c0f50b385447c"
Jul 22 04:56:33.862326 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:56:33.862266    2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"396676b6e4751efed51ddf909e5c482bce0d302bc107fcfda63c0f50b385447c"} err="failed to get container status \"396676b6e4751efed51ddf909e5c482bce0d302bc107fcfda63c0f50b385447c\": rpc error: code = NotFound desc = could not find container \"396676b6e4751efed51ddf909e5c482bce0d302bc107fcfda63c0f50b385447c\": container with ID starting with 396676b6e4751efed51ddf909e5c482bce0d302bc107fcfda63c0f50b385447c not found: ID does not exist"
Jul 22 04:56:33.862326 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:56:33.862286    2563 scope.go:117] "RemoveContainer" containerID="d97b5d788e7b581bb6a7e87d4856afce2f4594feacbf20597bbe25323d31496f"
Jul 22 04:56:33.862510 ip-10-0-141-238 kubenswrapper[2563]: E0722 04:56:33.862495    2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d97b5d788e7b581bb6a7e87d4856afce2f4594feacbf20597bbe25323d31496f\": container with ID starting with d97b5d788e7b581bb6a7e87d4856afce2f4594feacbf20597bbe25323d31496f not found: ID does not exist" containerID="d97b5d788e7b581bb6a7e87d4856afce2f4594feacbf20597bbe25323d31496f"
Jul 22 04:56:33.862556 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:56:33.862514    2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d97b5d788e7b581bb6a7e87d4856afce2f4594feacbf20597bbe25323d31496f"} err="failed to get container status \"d97b5d788e7b581bb6a7e87d4856afce2f4594feacbf20597bbe25323d31496f\": rpc error: code = NotFound desc = could not find container \"d97b5d788e7b581bb6a7e87d4856afce2f4594feacbf20597bbe25323d31496f\": container with ID starting with d97b5d788e7b581bb6a7e87d4856afce2f4594feacbf20597bbe25323d31496f not found: ID does not exist"
Jul 22 04:56:33.867475 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:56:33.867453    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-migrate-90fa15ea-gw-openshift-default-8c57c585f-zkqqb"]
Jul 22 04:56:33.870997 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:56:33.870978    2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-migrate-90fa15ea-gw-openshift-default-8c57c585f-zkqqb"]
Jul 22 04:56:35.066356 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:56:35.066323    2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="aa1e5842-39c1-4724-b0d3-1fbed7228b4c" path="/var/lib/kubelet/pods/aa1e5842-39c1-4724-b0d3-1fbed7228b4c/volumes"
Jul 22 04:56:38.262421 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:56:38.262382    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-wsdd9"]
Jul 22 04:56:57.498790 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:56:57.498758    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-e7529972-8l22j"]
Jul 22 04:56:57.499198 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:56:57.499138    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="aa1e5842-39c1-4724-b0d3-1fbed7228b4c" containerName="istio-proxy"
Jul 22 04:56:57.499198 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:56:57.499152    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="aa1e5842-39c1-4724-b0d3-1fbed7228b4c" containerName="istio-proxy"
Jul 22 04:56:57.499198 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:56:57.499167    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="aa1e5842-39c1-4724-b0d3-1fbed7228b4c" containerName="istio-proxy"
Jul 22 04:56:57.499198 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:56:57.499173    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="aa1e5842-39c1-4724-b0d3-1fbed7228b4c" containerName="istio-proxy"
Jul 22 04:56:57.499326 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:56:57.499225    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="aa1e5842-39c1-4724-b0d3-1fbed7228b4c" containerName="istio-proxy"
Jul 22 04:56:57.499326 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:56:57.499235    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="aa1e5842-39c1-4724-b0d3-1fbed7228b4c" containerName="istio-proxy"
Jul 22 04:56:57.501907 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:56:57.501892    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-e7529972-8l22j"
Jul 22 04:56:57.504385 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:56:57.504363    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 22 04:56:57.504512 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:56:57.504398    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-65v9v\""
Jul 22 04:56:57.508003 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:56:57.507975    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-e7529972-8l22j"]
Jul 22 04:56:57.610199 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:56:57.610162    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/1b04c0c0-9cf4-4c9a-bdfe-d484ea295663-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-e7529972-8l22j\" (UID: \"1b04c0c0-9cf4-4c9a-bdfe-d484ea295663\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-e7529972-8l22j"
Jul 22 04:56:57.711028 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:56:57.710981    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/1b04c0c0-9cf4-4c9a-bdfe-d484ea295663-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-e7529972-8l22j\" (UID: \"1b04c0c0-9cf4-4c9a-bdfe-d484ea295663\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-e7529972-8l22j"
Jul 22 04:56:57.711646 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:56:57.711619    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/1b04c0c0-9cf4-4c9a-bdfe-d484ea295663-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-e7529972-8l22j\" (UID: \"1b04c0c0-9cf4-4c9a-bdfe-d484ea295663\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-e7529972-8l22j"
Jul 22 04:56:57.814090 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:56:57.813985    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-e7529972-8l22j"
Jul 22 04:56:57.940491 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:56:57.940463    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-e7529972-8l22j"]
Jul 22 04:56:57.942976 ip-10-0-141-238 kubenswrapper[2563]: W0722 04:56:57.942950    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1b04c0c0_9cf4_4c9a_bdfe_d484ea295663.slice/crio-185ba49c4648ac35d9fb4252b1f8e45f9a190af358ba461b8c4f2e39e80a9685 WatchSource:0}: Error finding container 185ba49c4648ac35d9fb4252b1f8e45f9a190af358ba461b8c4f2e39e80a9685: Status 404 returned error can't find the container with id 185ba49c4648ac35d9fb4252b1f8e45f9a190af358ba461b8c4f2e39e80a9685
Jul 22 04:56:57.952760 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:56:57.952736    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-e7529972-8l22j" event={"ID":"1b04c0c0-9cf4-4c9a-bdfe-d484ea295663","Type":"ContainerStarted","Data":"185ba49c4648ac35d9fb4252b1f8e45f9a190af358ba461b8c4f2e39e80a9685"}
Jul 22 04:56:58.958948 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:56:58.958918    2563 generic.go:356] "Generic (PLEG): container finished" podID="1b04c0c0-9cf4-4c9a-bdfe-d484ea295663" containerID="c2a61f159e618261c8fec44c291d4f01b8dcf80416ef235697a48daaa05fbd58" exitCode=0
Jul 22 04:56:58.959357 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:56:58.958981    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-e7529972-8l22j" event={"ID":"1b04c0c0-9cf4-4c9a-bdfe-d484ea295663","Type":"ContainerDied","Data":"c2a61f159e618261c8fec44c291d4f01b8dcf80416ef235697a48daaa05fbd58"}
Jul 22 04:57:00.096412 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:57:00.096384    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-e7529972-8l22j"
Jul 22 04:57:00.234244 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:57:00.234156    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/1b04c0c0-9cf4-4c9a-bdfe-d484ea295663-maas-api-service-ca\") pod \"1b04c0c0-9cf4-4c9a-bdfe-d484ea295663\" (UID: \"1b04c0c0-9cf4-4c9a-bdfe-d484ea295663\") "
Jul 22 04:57:00.234532 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:57:00.234512    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1b04c0c0-9cf4-4c9a-bdfe-d484ea295663-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "1b04c0c0-9cf4-4c9a-bdfe-d484ea295663" (UID: "1b04c0c0-9cf4-4c9a-bdfe-d484ea295663"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 22 04:57:00.334759 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:57:00.334732    2563 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/1b04c0c0-9cf4-4c9a-bdfe-d484ea295663-maas-api-service-ca\") on node \"ip-10-0-141-238.ec2.internal\" DevicePath \"\""
Jul 22 04:57:00.968981 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:57:00.968952    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-e7529972-8l22j"
Jul 22 04:57:00.969170 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:57:00.968998    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-e7529972-8l22j" event={"ID":"1b04c0c0-9cf4-4c9a-bdfe-d484ea295663","Type":"ContainerDied","Data":"185ba49c4648ac35d9fb4252b1f8e45f9a190af358ba461b8c4f2e39e80a9685"}
Jul 22 04:57:00.969170 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:57:00.969057    2563 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="185ba49c4648ac35d9fb4252b1f8e45f9a190af358ba461b8c4f2e39e80a9685"
Jul 22 04:57:07.932485 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:57:07.932441    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j9gvx_b4af3ae5-fa65-4358-8399-6ed11b68616e/konnectivity-agent/0.log" limit=1024
Jul 22 04:57:11.065779 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:57:11.065749    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-wsdd9"]
Jul 22 04:57:12.573090 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:57:12.573058    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-e7529972-8l22j"]
Jul 22 04:57:12.573534 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:57:12.573453    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j9gvx_b4af3ae5-fa65-4358-8399-6ed11b68616e/konnectivity-agent/0.log" limit=1024
Jul 22 04:57:12.577112 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:57:12.577092    2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-e7529972-8l22j"]
Jul 22 04:57:13.065053 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:57:13.065007    2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="1b04c0c0-9cf4-4c9a-bdfe-d484ea295663" path="/var/lib/kubelet/pods/1b04c0c0-9cf4-4c9a-bdfe-d484ea295663/volumes"
Jul 22 04:57:13.753168 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:57:13.753137    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j9gvx_b4af3ae5-fa65-4358-8399-6ed11b68616e/konnectivity-agent/0.log" limit=1024
Jul 22 04:57:13.971270 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:57:13.971238    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j9gvx_b4af3ae5-fa65-4358-8399-6ed11b68616e/konnectivity-agent/0.log" limit=1024
Jul 22 04:57:14.197409 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:57:14.197379    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j9gvx_b4af3ae5-fa65-4358-8399-6ed11b68616e/konnectivity-agent/0.log" limit=1024
Jul 22 04:57:14.458672 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:57:14.458594    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-derive-7a6c5591-openshift-default-6d97887c7f-h79gf"]
Jul 22 04:57:14.458926 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:57:14.458915    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1b04c0c0-9cf4-4c9a-bdfe-d484ea295663" containerName="revoke-keys"
Jul 22 04:57:14.458969 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:57:14.458927    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="1b04c0c0-9cf4-4c9a-bdfe-d484ea295663" containerName="revoke-keys"
Jul 22 04:57:14.459025 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:57:14.459015    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="1b04c0c0-9cf4-4c9a-bdfe-d484ea295663" containerName="revoke-keys"
Jul 22 04:57:14.462338 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:57:14.462312    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-7a6c5591-openshift-default-6d97887c7f-h79gf"
Jul 22 04:57:14.465009 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:57:14.464990    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-derive-7a6c5591-openshift-default-dockercfg-kg7c8\""
Jul 22 04:57:14.474742 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:57:14.474723    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-derive-7a6c5591-openshift-default-6d97887c7f-h79gf"]
Jul 22 04:57:14.488722 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:57:14.488703    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j9gvx_b4af3ae5-fa65-4358-8399-6ed11b68616e/konnectivity-agent/0.log" limit=1024
Jul 22 04:57:14.555796 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:57:14.555762    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/51abe71f-0ce8-4271-aeea-311aba3200a5-istio-token\") pod \"e2e-derive-7a6c5591-openshift-default-6d97887c7f-h79gf\" (UID: \"51abe71f-0ce8-4271-aeea-311aba3200a5\") " pod="openshift-ingress/e2e-derive-7a6c5591-openshift-default-6d97887c7f-h79gf"
Jul 22 04:57:14.555966 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:57:14.555829    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/51abe71f-0ce8-4271-aeea-311aba3200a5-istio-data\") pod \"e2e-derive-7a6c5591-openshift-default-6d97887c7f-h79gf\" (UID: \"51abe71f-0ce8-4271-aeea-311aba3200a5\") " pod="openshift-ingress/e2e-derive-7a6c5591-openshift-default-6d97887c7f-h79gf"
Jul 22 04:57:14.555966 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:57:14.555907    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/51abe71f-0ce8-4271-aeea-311aba3200a5-workload-socket\") pod \"e2e-derive-7a6c5591-openshift-default-6d97887c7f-h79gf\" (UID: \"51abe71f-0ce8-4271-aeea-311aba3200a5\") " pod="openshift-ingress/e2e-derive-7a6c5591-openshift-default-6d97887c7f-h79gf"
Jul 22 04:57:14.555966 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:57:14.555953    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/51abe71f-0ce8-4271-aeea-311aba3200a5-workload-certs\") pod \"e2e-derive-7a6c5591-openshift-default-6d97887c7f-h79gf\" (UID: \"51abe71f-0ce8-4271-aeea-311aba3200a5\") " pod="openshift-ingress/e2e-derive-7a6c5591-openshift-default-6d97887c7f-h79gf"
Jul 22 04:57:14.556166 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:57:14.556006    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/51abe71f-0ce8-4271-aeea-311aba3200a5-istio-envoy\") pod \"e2e-derive-7a6c5591-openshift-default-6d97887c7f-h79gf\" (UID: \"51abe71f-0ce8-4271-aeea-311aba3200a5\") " pod="openshift-ingress/e2e-derive-7a6c5591-openshift-default-6d97887c7f-h79gf"
Jul 22 04:57:14.556166 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:57:14.556054    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/51abe71f-0ce8-4271-aeea-311aba3200a5-istio-podinfo\") pod \"e2e-derive-7a6c5591-openshift-default-6d97887c7f-h79gf\" (UID: \"51abe71f-0ce8-4271-aeea-311aba3200a5\") " pod="openshift-ingress/e2e-derive-7a6c5591-openshift-default-6d97887c7f-h79gf"
Jul 22 04:57:14.556166 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:57:14.556100    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/51abe71f-0ce8-4271-aeea-311aba3200a5-credential-socket\") pod \"e2e-derive-7a6c5591-openshift-default-6d97887c7f-h79gf\" (UID: \"51abe71f-0ce8-4271-aeea-311aba3200a5\") " pod="openshift-ingress/e2e-derive-7a6c5591-openshift-default-6d97887c7f-h79gf"
Jul 22 04:57:14.556166 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:57:14.556134    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/51abe71f-0ce8-4271-aeea-311aba3200a5-istiod-ca-cert\") pod \"e2e-derive-7a6c5591-openshift-default-6d97887c7f-h79gf\" (UID: \"51abe71f-0ce8-4271-aeea-311aba3200a5\") " pod="openshift-ingress/e2e-derive-7a6c5591-openshift-default-6d97887c7f-h79gf"
Jul 22 04:57:14.556328 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:57:14.556168    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-65gl9\" (UniqueName: \"kubernetes.io/projected/51abe71f-0ce8-4271-aeea-311aba3200a5-kube-api-access-65gl9\") pod \"e2e-derive-7a6c5591-openshift-default-6d97887c7f-h79gf\" (UID: \"51abe71f-0ce8-4271-aeea-311aba3200a5\") " pod="openshift-ingress/e2e-derive-7a6c5591-openshift-default-6d97887c7f-h79gf"
Jul 22 04:57:14.656770 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:57:14.656724    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/51abe71f-0ce8-4271-aeea-311aba3200a5-istio-token\") pod \"e2e-derive-7a6c5591-openshift-default-6d97887c7f-h79gf\" (UID: \"51abe71f-0ce8-4271-aeea-311aba3200a5\") " pod="openshift-ingress/e2e-derive-7a6c5591-openshift-default-6d97887c7f-h79gf"
Jul 22 04:57:14.656770 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:57:14.656783    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/51abe71f-0ce8-4271-aeea-311aba3200a5-istio-data\") pod \"e2e-derive-7a6c5591-openshift-default-6d97887c7f-h79gf\" (UID: \"51abe71f-0ce8-4271-aeea-311aba3200a5\") " pod="openshift-ingress/e2e-derive-7a6c5591-openshift-default-6d97887c7f-h79gf"
Jul 22 04:57:14.657018 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:57:14.656808    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/51abe71f-0ce8-4271-aeea-311aba3200a5-workload-socket\") pod \"e2e-derive-7a6c5591-openshift-default-6d97887c7f-h79gf\" (UID: \"51abe71f-0ce8-4271-aeea-311aba3200a5\") " pod="openshift-ingress/e2e-derive-7a6c5591-openshift-default-6d97887c7f-h79gf"
Jul 22 04:57:14.657018 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:57:14.656829    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/51abe71f-0ce8-4271-aeea-311aba3200a5-workload-certs\") pod \"e2e-derive-7a6c5591-openshift-default-6d97887c7f-h79gf\" (UID: \"51abe71f-0ce8-4271-aeea-311aba3200a5\") " pod="openshift-ingress/e2e-derive-7a6c5591-openshift-default-6d97887c7f-h79gf"
Jul 22 04:57:14.657018 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:57:14.656851    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/51abe71f-0ce8-4271-aeea-311aba3200a5-istio-envoy\") pod \"e2e-derive-7a6c5591-openshift-default-6d97887c7f-h79gf\" (UID: \"51abe71f-0ce8-4271-aeea-311aba3200a5\") " pod="openshift-ingress/e2e-derive-7a6c5591-openshift-default-6d97887c7f-h79gf"
Jul 22 04:57:14.657018 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:57:14.656871    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/51abe71f-0ce8-4271-aeea-311aba3200a5-istio-podinfo\") pod \"e2e-derive-7a6c5591-openshift-default-6d97887c7f-h79gf\" (UID: \"51abe71f-0ce8-4271-aeea-311aba3200a5\") " pod="openshift-ingress/e2e-derive-7a6c5591-openshift-default-6d97887c7f-h79gf"
Jul 22 04:57:14.657018 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:57:14.656910    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/51abe71f-0ce8-4271-aeea-311aba3200a5-credential-socket\") pod \"e2e-derive-7a6c5591-openshift-default-6d97887c7f-h79gf\" (UID: \"51abe71f-0ce8-4271-aeea-311aba3200a5\") " pod="openshift-ingress/e2e-derive-7a6c5591-openshift-default-6d97887c7f-h79gf"
Jul 22 04:57:14.657018 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:57:14.656933    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/51abe71f-0ce8-4271-aeea-311aba3200a5-istiod-ca-cert\") pod \"e2e-derive-7a6c5591-openshift-default-6d97887c7f-h79gf\" (UID: \"51abe71f-0ce8-4271-aeea-311aba3200a5\") " pod="openshift-ingress/e2e-derive-7a6c5591-openshift-default-6d97887c7f-h79gf"
Jul 22 04:57:14.657018 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:57:14.656976    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-65gl9\" (UniqueName: \"kubernetes.io/projected/51abe71f-0ce8-4271-aeea-311aba3200a5-kube-api-access-65gl9\") pod \"e2e-derive-7a6c5591-openshift-default-6d97887c7f-h79gf\" (UID: \"51abe71f-0ce8-4271-aeea-311aba3200a5\") " pod="openshift-ingress/e2e-derive-7a6c5591-openshift-default-6d97887c7f-h79gf"
Jul 22 04:57:14.657443 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:57:14.657270    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/51abe71f-0ce8-4271-aeea-311aba3200a5-workload-socket\") pod \"e2e-derive-7a6c5591-openshift-default-6d97887c7f-h79gf\" (UID: \"51abe71f-0ce8-4271-aeea-311aba3200a5\") " pod="openshift-ingress/e2e-derive-7a6c5591-openshift-default-6d97887c7f-h79gf"
Jul 22 04:57:14.657443 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:57:14.657284    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/51abe71f-0ce8-4271-aeea-311aba3200a5-workload-certs\") pod \"e2e-derive-7a6c5591-openshift-default-6d97887c7f-h79gf\" (UID: \"51abe71f-0ce8-4271-aeea-311aba3200a5\") " pod="openshift-ingress/e2e-derive-7a6c5591-openshift-default-6d97887c7f-h79gf"
Jul 22 04:57:14.657443 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:57:14.657396    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/51abe71f-0ce8-4271-aeea-311aba3200a5-istio-data\") pod \"e2e-derive-7a6c5591-openshift-default-6d97887c7f-h79gf\" (UID: \"51abe71f-0ce8-4271-aeea-311aba3200a5\") " pod="openshift-ingress/e2e-derive-7a6c5591-openshift-default-6d97887c7f-h79gf"
Jul 22 04:57:14.657601 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:57:14.657474    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/51abe71f-0ce8-4271-aeea-311aba3200a5-credential-socket\") pod \"e2e-derive-7a6c5591-openshift-default-6d97887c7f-h79gf\" (UID: \"51abe71f-0ce8-4271-aeea-311aba3200a5\") " pod="openshift-ingress/e2e-derive-7a6c5591-openshift-default-6d97887c7f-h79gf"
Jul 22 04:57:14.657815 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:57:14.657791    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/51abe71f-0ce8-4271-aeea-311aba3200a5-istiod-ca-cert\") pod \"e2e-derive-7a6c5591-openshift-default-6d97887c7f-h79gf\" (UID: \"51abe71f-0ce8-4271-aeea-311aba3200a5\") " pod="openshift-ingress/e2e-derive-7a6c5591-openshift-default-6d97887c7f-h79gf"
Jul 22 04:57:14.659228 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:57:14.659208    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/51abe71f-0ce8-4271-aeea-311aba3200a5-istio-envoy\") pod \"e2e-derive-7a6c5591-openshift-default-6d97887c7f-h79gf\" (UID: \"51abe71f-0ce8-4271-aeea-311aba3200a5\") " pod="openshift-ingress/e2e-derive-7a6c5591-openshift-default-6d97887c7f-h79gf"
Jul 22 04:57:14.659455 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:57:14.659436    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/51abe71f-0ce8-4271-aeea-311aba3200a5-istio-podinfo\") pod \"e2e-derive-7a6c5591-openshift-default-6d97887c7f-h79gf\" (UID: \"51abe71f-0ce8-4271-aeea-311aba3200a5\") " pod="openshift-ingress/e2e-derive-7a6c5591-openshift-default-6d97887c7f-h79gf"
Jul 22 04:57:14.664390 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:57:14.664367    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/51abe71f-0ce8-4271-aeea-311aba3200a5-istio-token\") pod \"e2e-derive-7a6c5591-openshift-default-6d97887c7f-h79gf\" (UID: \"51abe71f-0ce8-4271-aeea-311aba3200a5\") " pod="openshift-ingress/e2e-derive-7a6c5591-openshift-default-6d97887c7f-h79gf"
Jul 22 04:57:14.664599 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:57:14.664578    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-65gl9\" (UniqueName: \"kubernetes.io/projected/51abe71f-0ce8-4271-aeea-311aba3200a5-kube-api-access-65gl9\") pod \"e2e-derive-7a6c5591-openshift-default-6d97887c7f-h79gf\" (UID: \"51abe71f-0ce8-4271-aeea-311aba3200a5\") " pod="openshift-ingress/e2e-derive-7a6c5591-openshift-default-6d97887c7f-h79gf"
Jul 22 04:57:14.755080 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:57:14.754911    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j9gvx_b4af3ae5-fa65-4358-8399-6ed11b68616e/konnectivity-agent/0.log" limit=1024
Jul 22 04:57:14.773020 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:57:14.772991    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-7a6c5591-openshift-default-6d97887c7f-h79gf"
Jul 22 04:57:14.903240 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:57:14.903163    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-derive-7a6c5591-openshift-default-6d97887c7f-h79gf"]
Jul 22 04:57:14.905380 ip-10-0-141-238 kubenswrapper[2563]: W0722 04:57:14.905356    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod51abe71f_0ce8_4271_aeea_311aba3200a5.slice/crio-a239c1fafb71e3ce6a9d0c7d4527262f67e9bee1945dffc4cd31010837dd8acd WatchSource:0}: Error finding container a239c1fafb71e3ce6a9d0c7d4527262f67e9bee1945dffc4cd31010837dd8acd: Status 404 returned error can't find the container with id a239c1fafb71e3ce6a9d0c7d4527262f67e9bee1945dffc4cd31010837dd8acd
Jul 22 04:57:14.907545 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:57:14.907513    2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 22 04:57:14.907614 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:57:14.907584    2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 22 04:57:14.907651 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:57:14.907612    2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 22 04:57:15.033840 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:57:15.033747    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-7a6c5591-openshift-default-6d97887c7f-h79gf" event={"ID":"51abe71f-0ce8-4271-aeea-311aba3200a5","Type":"ContainerStarted","Data":"bbdf2165280176c41b2539f2402b67a38d8b69d7c20b799ea97beccda3c40b08"}
Jul 22 04:57:15.033840 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:57:15.033809    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-7a6c5591-openshift-default-6d97887c7f-h79gf" event={"ID":"51abe71f-0ce8-4271-aeea-311aba3200a5","Type":"ContainerStarted","Data":"a239c1fafb71e3ce6a9d0c7d4527262f67e9bee1945dffc4cd31010837dd8acd"}
Jul 22 04:57:15.051120 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:57:15.051009    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-derive-7a6c5591-openshift-default-6d97887c7f-h79gf" podStartSLOduration=1.050984742 podStartE2EDuration="1.050984742s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 04:57:14 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 04:57:15.050720822 +0000 UTC m=+1950.469729579" watchObservedRunningTime="2026-07-22 04:57:15.050984742 +0000 UTC m=+1950.469993501"
Jul 22 04:57:15.773713 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:57:15.773680    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-derive-7a6c5591-openshift-default-6d97887c7f-h79gf"
Jul 22 04:57:15.778565 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:57:15.778542    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-derive-7a6c5591-openshift-default-6d97887c7f-h79gf"
Jul 22 04:57:16.039027 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:57:16.038930    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-derive-7a6c5591-openshift-default-6d97887c7f-h79gf"
Jul 22 04:57:16.039802 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:57:16.039783    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-derive-7a6c5591-openshift-default-6d97887c7f-h79gf"
Jul 22 04:57:16.390384 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:57:16.390298    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j9gvx_b4af3ae5-fa65-4358-8399-6ed11b68616e/konnectivity-agent/0.log" limit=1024
Jul 22 04:57:16.479198 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:57:16.479167    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j9gvx_b4af3ae5-fa65-4358-8399-6ed11b68616e/konnectivity-agent/0.log" limit=1024
Jul 22 04:57:16.555993 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:57:16.555961    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j9gvx_b4af3ae5-fa65-4358-8399-6ed11b68616e/konnectivity-agent/0.log" limit=1024
Jul 22 04:57:16.733303 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:57:16.733267    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j9gvx_b4af3ae5-fa65-4358-8399-6ed11b68616e/konnectivity-agent/0.log" limit=1024
Jul 22 04:57:17.054309 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:57:17.054196    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j9gvx_b4af3ae5-fa65-4358-8399-6ed11b68616e/konnectivity-agent/0.log" limit=1024
Jul 22 04:57:17.157380 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:57:17.157342    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j9gvx_b4af3ae5-fa65-4358-8399-6ed11b68616e/konnectivity-agent/0.log" limit=1024
Jul 22 04:57:22.069974 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:57:22.069942    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-wsdd9"]
Jul 22 04:57:30.101699 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:57:30.101603    2563 generic.go:356] "Generic (PLEG): container finished" podID="51abe71f-0ce8-4271-aeea-311aba3200a5" containerID="bbdf2165280176c41b2539f2402b67a38d8b69d7c20b799ea97beccda3c40b08" exitCode=0
Jul 22 04:57:30.101699 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:57:30.101679    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-7a6c5591-openshift-default-6d97887c7f-h79gf" event={"ID":"51abe71f-0ce8-4271-aeea-311aba3200a5","Type":"ContainerDied","Data":"bbdf2165280176c41b2539f2402b67a38d8b69d7c20b799ea97beccda3c40b08"}
Jul 22 04:57:30.102144 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:57:30.102073    2563 scope.go:117] "RemoveContainer" containerID="bbdf2165280176c41b2539f2402b67a38d8b69d7c20b799ea97beccda3c40b08"
Jul 22 04:57:30.103175 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:57:30.103146    2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 22 04:57:30.103254 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:57:30.103229    2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 22 04:57:30.103305 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:57:30.103276    2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 22 04:57:31.039086 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:57:31.039048    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-derive-7a6c5591-openshift-default-6d97887c7f-h79gf"
Jul 22 04:57:31.107301 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:57:31.107266    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-7a6c5591-openshift-default-6d97887c7f-h79gf" event={"ID":"51abe71f-0ce8-4271-aeea-311aba3200a5","Type":"ContainerStarted","Data":"bbea68b004bbe3488a6c7b2383b92226d2e285fb52531f48bd6e4ea6ea14ad94"}
Jul 22 04:57:31.773288 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:57:31.773257    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-derive-7a6c5591-openshift-default-6d97887c7f-h79gf"
Jul 22 04:57:31.774195 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:57:31.774169    2563 patch_prober.go:28] interesting pod/e2e-derive-7a6c5591-openshift-default-6d97887c7f-h79gf container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.34:15021/healthz/ready\": dial tcp 10.134.0.34:15021: connect: connection refused" start-of-body=
Jul 22 04:57:31.774293 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:57:31.774226    2563 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-derive-7a6c5591-openshift-default-6d97887c7f-h79gf" podUID="51abe71f-0ce8-4271-aeea-311aba3200a5" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.34:15021/healthz/ready\": dial tcp 10.134.0.34:15021: connect: connection refused"
Jul 22 04:57:32.774087 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:57:32.774033    2563 patch_prober.go:28] interesting pod/e2e-derive-7a6c5591-openshift-default-6d97887c7f-h79gf container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.34:15021/healthz/ready\": dial tcp 10.134.0.34:15021: connect: connection refused" start-of-body=
Jul 22 04:57:32.774478 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:57:32.774120    2563 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-derive-7a6c5591-openshift-default-6d97887c7f-h79gf" podUID="51abe71f-0ce8-4271-aeea-311aba3200a5" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.34:15021/healthz/ready\": dial tcp 10.134.0.34:15021: connect: connection refused"
Jul 22 04:57:33.773432 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:57:33.773391    2563 patch_prober.go:28] interesting pod/e2e-derive-7a6c5591-openshift-default-6d97887c7f-h79gf container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.34:15021/healthz/ready\": dial tcp 10.134.0.34:15021: connect: connection refused" start-of-body=
Jul 22 04:57:33.773624 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:57:33.773461    2563 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-derive-7a6c5591-openshift-default-6d97887c7f-h79gf" podUID="51abe71f-0ce8-4271-aeea-311aba3200a5" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.34:15021/healthz/ready\": dial tcp 10.134.0.34:15021: connect: connection refused"
Jul 22 04:57:34.773477 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:57:34.773441    2563 patch_prober.go:28] interesting pod/e2e-derive-7a6c5591-openshift-default-6d97887c7f-h79gf container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.34:15021/healthz/ready\": dial tcp 10.134.0.34:15021: connect: connection refused" start-of-body=
Jul 22 04:57:34.773859 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:57:34.773496    2563 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-derive-7a6c5591-openshift-default-6d97887c7f-h79gf" podUID="51abe71f-0ce8-4271-aeea-311aba3200a5" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.34:15021/healthz/ready\": dial tcp 10.134.0.34:15021: connect: connection refused"
Jul 22 04:57:35.777310 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:57:35.777280    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-derive-7a6c5591-openshift-default-6d97887c7f-h79gf"
Jul 22 04:57:35.777711 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:57:35.777554    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-derive-7a6c5591-openshift-default-6d97887c7f-h79gf"
Jul 22 04:57:35.778141 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:57:35.778119    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-derive-7a6c5591-openshift-default-6d97887c7f-h79gf"
Jul 22 04:57:37.374233 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:57:37.374147    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j9gvx_b4af3ae5-fa65-4358-8399-6ed11b68616e/konnectivity-agent/0.log" limit=1024
Jul 22 04:57:37.471738 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:57:37.471696    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j9gvx_b4af3ae5-fa65-4358-8399-6ed11b68616e/konnectivity-agent/0.log" limit=1024
Jul 22 04:57:38.101707 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:57:38.101678    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j9gvx_b4af3ae5-fa65-4358-8399-6ed11b68616e/konnectivity-agent/0.log" limit=1024
Jul 22 04:57:38.202143 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:57:38.202097    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j9gvx_b4af3ae5-fa65-4358-8399-6ed11b68616e/konnectivity-agent/0.log" limit=1024
Jul 22 04:57:51.618839 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:57:51.618787    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j9gvx_b4af3ae5-fa65-4358-8399-6ed11b68616e/konnectivity-agent/0.log" limit=1024
Jul 22 04:57:51.716219 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:57:51.716167    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j9gvx_b4af3ae5-fa65-4358-8399-6ed11b68616e/konnectivity-agent/0.log" limit=1024
Jul 22 04:57:54.670791 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:57:54.670755    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-wsdd9"]
Jul 22 04:57:56.291349 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:57:56.291315    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j9gvx_b4af3ae5-fa65-4358-8399-6ed11b68616e/konnectivity-agent/0.log" limit=1024
Jul 22 04:57:56.423271 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:57:56.423234    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-derive-7a6c5591-openshift-default-6d97887c7f-h79gf"]
Jul 22 04:57:56.423489 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:57:56.423466    2563 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-derive-7a6c5591-openshift-default-6d97887c7f-h79gf" podUID="51abe71f-0ce8-4271-aeea-311aba3200a5" containerName="istio-proxy" containerID="cri-o://bbea68b004bbe3488a6c7b2383b92226d2e285fb52531f48bd6e4ea6ea14ad94" gracePeriod=30
Jul 22 04:57:56.443482 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:57:56.443454    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j9gvx_b4af3ae5-fa65-4358-8399-6ed11b68616e/konnectivity-agent/0.log" limit=1024
Jul 22 04:57:56.676720 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:57:56.676689    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j9gvx_b4af3ae5-fa65-4358-8399-6ed11b68616e/konnectivity-agent/0.log" limit=1024
Jul 22 04:57:57.127727 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:57:57.127643    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j9gvx_b4af3ae5-fa65-4358-8399-6ed11b68616e/konnectivity-agent/0.log" limit=1024
Jul 22 04:57:57.229514 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:57:57.229482    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j9gvx_b4af3ae5-fa65-4358-8399-6ed11b68616e/konnectivity-agent/0.log" limit=1024
Jul 22 04:57:57.325075 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:57:57.325022    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j9gvx_b4af3ae5-fa65-4358-8399-6ed11b68616e/konnectivity-agent/0.log" limit=1024
Jul 22 04:57:58.712421 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:57:58.712394    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j9gvx_b4af3ae5-fa65-4358-8399-6ed11b68616e/konnectivity-agent/0.log" limit=1024
Jul 22 04:58:01.664948 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:58:01.664925    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-7a6c5591-openshift-default-6d97887c7f-h79gf"
Jul 22 04:58:01.693852 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:58:01.693780    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/51abe71f-0ce8-4271-aeea-311aba3200a5-istio-podinfo\") pod \"51abe71f-0ce8-4271-aeea-311aba3200a5\" (UID: \"51abe71f-0ce8-4271-aeea-311aba3200a5\") "
Jul 22 04:58:01.693852 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:58:01.693842    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/51abe71f-0ce8-4271-aeea-311aba3200a5-istiod-ca-cert\") pod \"51abe71f-0ce8-4271-aeea-311aba3200a5\" (UID: \"51abe71f-0ce8-4271-aeea-311aba3200a5\") "
Jul 22 04:58:01.694010 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:58:01.693888    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/51abe71f-0ce8-4271-aeea-311aba3200a5-istio-data\") pod \"51abe71f-0ce8-4271-aeea-311aba3200a5\" (UID: \"51abe71f-0ce8-4271-aeea-311aba3200a5\") "
Jul 22 04:58:01.694010 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:58:01.693912    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/51abe71f-0ce8-4271-aeea-311aba3200a5-workload-socket\") pod \"51abe71f-0ce8-4271-aeea-311aba3200a5\" (UID: \"51abe71f-0ce8-4271-aeea-311aba3200a5\") "
Jul 22 04:58:01.694135 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:58:01.694013    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/51abe71f-0ce8-4271-aeea-311aba3200a5-istio-token\") pod \"51abe71f-0ce8-4271-aeea-311aba3200a5\" (UID: \"51abe71f-0ce8-4271-aeea-311aba3200a5\") "
Jul 22 04:58:01.694135 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:58:01.694064    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-65gl9\" (UniqueName: \"kubernetes.io/projected/51abe71f-0ce8-4271-aeea-311aba3200a5-kube-api-access-65gl9\") pod \"51abe71f-0ce8-4271-aeea-311aba3200a5\" (UID: \"51abe71f-0ce8-4271-aeea-311aba3200a5\") "
Jul 22 04:58:01.694135 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:58:01.694093    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/51abe71f-0ce8-4271-aeea-311aba3200a5-istio-envoy\") pod \"51abe71f-0ce8-4271-aeea-311aba3200a5\" (UID: \"51abe71f-0ce8-4271-aeea-311aba3200a5\") "
Jul 22 04:58:01.694135 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:58:01.694120    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/51abe71f-0ce8-4271-aeea-311aba3200a5-credential-socket\") pod \"51abe71f-0ce8-4271-aeea-311aba3200a5\" (UID: \"51abe71f-0ce8-4271-aeea-311aba3200a5\") "
Jul 22 04:58:01.694337 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:58:01.694263    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/51abe71f-0ce8-4271-aeea-311aba3200a5-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "51abe71f-0ce8-4271-aeea-311aba3200a5" (UID: "51abe71f-0ce8-4271-aeea-311aba3200a5"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 22 04:58:01.694509 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:58:01.694484    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/51abe71f-0ce8-4271-aeea-311aba3200a5-workload-certs\") pod \"51abe71f-0ce8-4271-aeea-311aba3200a5\" (UID: \"51abe71f-0ce8-4271-aeea-311aba3200a5\") "
Jul 22 04:58:01.694638 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:58:01.694494    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/51abe71f-0ce8-4271-aeea-311aba3200a5-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "51abe71f-0ce8-4271-aeea-311aba3200a5" (UID: "51abe71f-0ce8-4271-aeea-311aba3200a5"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 22 04:58:01.694698 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:58:01.694530    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/51abe71f-0ce8-4271-aeea-311aba3200a5-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "51abe71f-0ce8-4271-aeea-311aba3200a5" (UID: "51abe71f-0ce8-4271-aeea-311aba3200a5"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 22 04:58:01.694698 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:58:01.694684    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/51abe71f-0ce8-4271-aeea-311aba3200a5-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "51abe71f-0ce8-4271-aeea-311aba3200a5" (UID: "51abe71f-0ce8-4271-aeea-311aba3200a5"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 22 04:58:01.694802 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:58:01.694775    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/51abe71f-0ce8-4271-aeea-311aba3200a5-istio-data" (OuterVolumeSpecName: "istio-data") pod "51abe71f-0ce8-4271-aeea-311aba3200a5" (UID: "51abe71f-0ce8-4271-aeea-311aba3200a5"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 22 04:58:01.694861 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:58:01.694845    2563 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/51abe71f-0ce8-4271-aeea-311aba3200a5-workload-certs\") on node \"ip-10-0-141-238.ec2.internal\" DevicePath \"\""
Jul 22 04:58:01.694921 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:58:01.694864    2563 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/51abe71f-0ce8-4271-aeea-311aba3200a5-istiod-ca-cert\") on node \"ip-10-0-141-238.ec2.internal\" DevicePath \"\""
Jul 22 04:58:01.694921 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:58:01.694877    2563 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/51abe71f-0ce8-4271-aeea-311aba3200a5-workload-socket\") on node \"ip-10-0-141-238.ec2.internal\" DevicePath \"\""
Jul 22 04:58:01.694921 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:58:01.694891    2563 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/51abe71f-0ce8-4271-aeea-311aba3200a5-credential-socket\") on node \"ip-10-0-141-238.ec2.internal\" DevicePath \"\""
Jul 22 04:58:01.696080 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:58:01.696029    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/51abe71f-0ce8-4271-aeea-311aba3200a5-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "51abe71f-0ce8-4271-aeea-311aba3200a5" (UID: "51abe71f-0ce8-4271-aeea-311aba3200a5"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 22 04:58:01.696547 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:58:01.696520    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/51abe71f-0ce8-4271-aeea-311aba3200a5-kube-api-access-65gl9" (OuterVolumeSpecName: "kube-api-access-65gl9") pod "51abe71f-0ce8-4271-aeea-311aba3200a5" (UID: "51abe71f-0ce8-4271-aeea-311aba3200a5"). InnerVolumeSpecName "kube-api-access-65gl9". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 22 04:58:01.696547 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:58:01.696531    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/51abe71f-0ce8-4271-aeea-311aba3200a5-istio-token" (OuterVolumeSpecName: "istio-token") pod "51abe71f-0ce8-4271-aeea-311aba3200a5" (UID: "51abe71f-0ce8-4271-aeea-311aba3200a5"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 22 04:58:01.696752 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:58:01.696730    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/51abe71f-0ce8-4271-aeea-311aba3200a5-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "51abe71f-0ce8-4271-aeea-311aba3200a5" (UID: "51abe71f-0ce8-4271-aeea-311aba3200a5"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 22 04:58:01.795363 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:58:01.795324    2563 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/51abe71f-0ce8-4271-aeea-311aba3200a5-istio-data\") on node \"ip-10-0-141-238.ec2.internal\" DevicePath \"\""
Jul 22 04:58:01.795363 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:58:01.795357    2563 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/51abe71f-0ce8-4271-aeea-311aba3200a5-istio-token\") on node \"ip-10-0-141-238.ec2.internal\" DevicePath \"\""
Jul 22 04:58:01.795363 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:58:01.795370    2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-65gl9\" (UniqueName: \"kubernetes.io/projected/51abe71f-0ce8-4271-aeea-311aba3200a5-kube-api-access-65gl9\") on node \"ip-10-0-141-238.ec2.internal\" DevicePath \"\""
Jul 22 04:58:01.795599 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:58:01.795382    2563 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/51abe71f-0ce8-4271-aeea-311aba3200a5-istio-envoy\") on node \"ip-10-0-141-238.ec2.internal\" DevicePath \"\""
Jul 22 04:58:01.795599 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:58:01.795394    2563 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/51abe71f-0ce8-4271-aeea-311aba3200a5-istio-podinfo\") on node \"ip-10-0-141-238.ec2.internal\" DevicePath \"\""
Jul 22 04:58:02.255618 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:58:02.255579    2563 generic.go:356] "Generic (PLEG): container finished" podID="51abe71f-0ce8-4271-aeea-311aba3200a5" containerID="bbea68b004bbe3488a6c7b2383b92226d2e285fb52531f48bd6e4ea6ea14ad94" exitCode=0
Jul 22 04:58:02.255795 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:58:02.255626    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-7a6c5591-openshift-default-6d97887c7f-h79gf" event={"ID":"51abe71f-0ce8-4271-aeea-311aba3200a5","Type":"ContainerDied","Data":"bbea68b004bbe3488a6c7b2383b92226d2e285fb52531f48bd6e4ea6ea14ad94"}
Jul 22 04:58:02.255795 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:58:02.255646    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-7a6c5591-openshift-default-6d97887c7f-h79gf"
Jul 22 04:58:02.255795 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:58:02.255685    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-7a6c5591-openshift-default-6d97887c7f-h79gf" event={"ID":"51abe71f-0ce8-4271-aeea-311aba3200a5","Type":"ContainerDied","Data":"a239c1fafb71e3ce6a9d0c7d4527262f67e9bee1945dffc4cd31010837dd8acd"}
Jul 22 04:58:02.255795 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:58:02.255708    2563 scope.go:117] "RemoveContainer" containerID="bbea68b004bbe3488a6c7b2383b92226d2e285fb52531f48bd6e4ea6ea14ad94"
Jul 22 04:58:02.264909 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:58:02.264890    2563 scope.go:117] "RemoveContainer" containerID="bbdf2165280176c41b2539f2402b67a38d8b69d7c20b799ea97beccda3c40b08"
Jul 22 04:58:02.272483 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:58:02.272467    2563 scope.go:117] "RemoveContainer" containerID="bbea68b004bbe3488a6c7b2383b92226d2e285fb52531f48bd6e4ea6ea14ad94"
Jul 22 04:58:02.272721 ip-10-0-141-238 kubenswrapper[2563]: E0722 04:58:02.272704    2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"bbea68b004bbe3488a6c7b2383b92226d2e285fb52531f48bd6e4ea6ea14ad94\": container with ID starting with bbea68b004bbe3488a6c7b2383b92226d2e285fb52531f48bd6e4ea6ea14ad94 not found: ID does not exist" containerID="bbea68b004bbe3488a6c7b2383b92226d2e285fb52531f48bd6e4ea6ea14ad94"
Jul 22 04:58:02.272767 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:58:02.272729    2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"bbea68b004bbe3488a6c7b2383b92226d2e285fb52531f48bd6e4ea6ea14ad94"} err="failed to get container status \"bbea68b004bbe3488a6c7b2383b92226d2e285fb52531f48bd6e4ea6ea14ad94\": rpc error: code = NotFound desc = could not find container \"bbea68b004bbe3488a6c7b2383b92226d2e285fb52531f48bd6e4ea6ea14ad94\": container with ID starting with bbea68b004bbe3488a6c7b2383b92226d2e285fb52531f48bd6e4ea6ea14ad94 not found: ID does not exist"
Jul 22 04:58:02.272767 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:58:02.272744    2563 scope.go:117] "RemoveContainer" containerID="bbdf2165280176c41b2539f2402b67a38d8b69d7c20b799ea97beccda3c40b08"
Jul 22 04:58:02.272937 ip-10-0-141-238 kubenswrapper[2563]: E0722 04:58:02.272923    2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"bbdf2165280176c41b2539f2402b67a38d8b69d7c20b799ea97beccda3c40b08\": container with ID starting with bbdf2165280176c41b2539f2402b67a38d8b69d7c20b799ea97beccda3c40b08 not found: ID does not exist" containerID="bbdf2165280176c41b2539f2402b67a38d8b69d7c20b799ea97beccda3c40b08"
Jul 22 04:58:02.272976 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:58:02.272940    2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"bbdf2165280176c41b2539f2402b67a38d8b69d7c20b799ea97beccda3c40b08"} err="failed to get container status \"bbdf2165280176c41b2539f2402b67a38d8b69d7c20b799ea97beccda3c40b08\": rpc error: code = NotFound desc = could not find container \"bbdf2165280176c41b2539f2402b67a38d8b69d7c20b799ea97beccda3c40b08\": container with ID starting with bbdf2165280176c41b2539f2402b67a38d8b69d7c20b799ea97beccda3c40b08 not found: ID does not exist"
Jul 22 04:58:02.282524 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:58:02.282490    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-derive-7a6c5591-openshift-default-6d97887c7f-h79gf"]
Jul 22 04:58:02.287610 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:58:02.287591    2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-derive-7a6c5591-openshift-default-6d97887c7f-h79gf"]
Jul 22 04:58:03.065640 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:58:03.065606    2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="51abe71f-0ce8-4271-aeea-311aba3200a5" path="/var/lib/kubelet/pods/51abe71f-0ce8-4271-aeea-311aba3200a5/volumes"
Jul 22 04:58:04.382780 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:58:04.382746    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j9gvx_b4af3ae5-fa65-4358-8399-6ed11b68616e/konnectivity-agent/0.log" limit=1024
Jul 22 04:58:04.493950 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:58:04.493917    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j9gvx_b4af3ae5-fa65-4358-8399-6ed11b68616e/konnectivity-agent/0.log" limit=1024
Jul 22 04:58:04.583214 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:58:04.583180    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j9gvx_b4af3ae5-fa65-4358-8399-6ed11b68616e/konnectivity-agent/0.log" limit=1024
Jul 22 04:58:04.683253 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:58:04.683200    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j9gvx_b4af3ae5-fa65-4358-8399-6ed11b68616e/konnectivity-agent/0.log" limit=1024
Jul 22 04:58:05.062837 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:58:05.062754    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j9gvx_b4af3ae5-fa65-4358-8399-6ed11b68616e/konnectivity-agent/0.log" limit=1024
Jul 22 04:58:30.978530 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:58:30.978494    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j9gvx_b4af3ae5-fa65-4358-8399-6ed11b68616e/konnectivity-agent/0.log" limit=1024
Jul 22 04:58:36.879132 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:58:36.879094    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j9gvx_b4af3ae5-fa65-4358-8399-6ed11b68616e/konnectivity-agent/0.log" limit=1024
Jul 22 04:58:36.984273 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:58:36.984239    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j9gvx_b4af3ae5-fa65-4358-8399-6ed11b68616e/konnectivity-agent/0.log" limit=1024
Jul 22 04:58:37.083897 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:58:37.083865    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j9gvx_b4af3ae5-fa65-4358-8399-6ed11b68616e/konnectivity-agent/0.log" limit=1024
Jul 22 04:58:52.947309 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:58:52.947271    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j9gvx_b4af3ae5-fa65-4358-8399-6ed11b68616e/konnectivity-agent/0.log" limit=1024
Jul 22 04:58:58.608081 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:58:58.608026    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j9gvx_b4af3ae5-fa65-4358-8399-6ed11b68616e/konnectivity-agent/0.log" limit=1024
Jul 22 04:58:58.708857 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:58:58.708823    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j9gvx_b4af3ae5-fa65-4358-8399-6ed11b68616e/konnectivity-agent/0.log" limit=1024
Jul 22 04:58:58.807400 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:58:58.807367    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j9gvx_b4af3ae5-fa65-4358-8399-6ed11b68616e/konnectivity-agent/0.log" limit=1024
Jul 22 04:59:09.288803 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:59:09.288718    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j9gvx_b4af3ae5-fa65-4358-8399-6ed11b68616e/konnectivity-agent/0.log" limit=1024
Jul 22 04:59:10.016191 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:59:10.016160    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j9gvx_b4af3ae5-fa65-4358-8399-6ed11b68616e/konnectivity-agent/0.log" limit=1024
Jul 22 04:59:15.845315 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:59:15.845279    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j9gvx_b4af3ae5-fa65-4358-8399-6ed11b68616e/konnectivity-agent/0.log" limit=1024
Jul 22 04:59:15.904474 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:59:15.904443    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j9gvx_b4af3ae5-fa65-4358-8399-6ed11b68616e/konnectivity-agent/0.log" limit=1024
Jul 22 04:59:15.989726 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:59:15.989691    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j9gvx_b4af3ae5-fa65-4358-8399-6ed11b68616e/konnectivity-agent/0.log" limit=1024
Jul 22 04:59:16.087508 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:59:16.087472    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j9gvx_b4af3ae5-fa65-4358-8399-6ed11b68616e/konnectivity-agent/0.log" limit=1024
Jul 22 04:59:16.187740 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:59:16.187709    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j9gvx_b4af3ae5-fa65-4358-8399-6ed11b68616e/konnectivity-agent/0.log" limit=1024
Jul 22 04:59:16.909391 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:59:16.909358    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j9gvx_b4af3ae5-fa65-4358-8399-6ed11b68616e/konnectivity-agent/0.log" limit=1024
Jul 22 04:59:16.988831 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:59:16.988801    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j9gvx_b4af3ae5-fa65-4358-8399-6ed11b68616e/konnectivity-agent/0.log" limit=1024
Jul 22 04:59:18.588517 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:59:18.588460    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j9gvx_b4af3ae5-fa65-4358-8399-6ed11b68616e/konnectivity-agent/0.log" limit=1024
Jul 22 04:59:21.476143 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:59:21.476106    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-wsdd9"]
Jul 22 04:59:24.267824 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:59:24.267788    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j9gvx_b4af3ae5-fa65-4358-8399-6ed11b68616e/konnectivity-agent/0.log" limit=1024
Jul 22 04:59:24.342107 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:59:24.342078    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j9gvx_b4af3ae5-fa65-4358-8399-6ed11b68616e/konnectivity-agent/0.log" limit=1024
Jul 22 04:59:24.916120 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:59:24.916088    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j9gvx_b4af3ae5-fa65-4358-8399-6ed11b68616e/konnectivity-agent/0.log" limit=1024
Jul 22 04:59:26.476667 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:59:26.476637    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-wsdd9"]
Jul 22 04:59:30.590695 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:59:30.590660    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j9gvx_b4af3ae5-fa65-4358-8399-6ed11b68616e/konnectivity-agent/0.log" limit=1024
Jul 22 04:59:30.690887 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:59:30.690853    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j9gvx_b4af3ae5-fa65-4358-8399-6ed11b68616e/konnectivity-agent/0.log" limit=1024
Jul 22 04:59:30.818646 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:59:30.818617    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j9gvx_b4af3ae5-fa65-4358-8399-6ed11b68616e/konnectivity-agent/0.log" limit=1024
Jul 22 04:59:31.172282 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:59:31.172253    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j9gvx_b4af3ae5-fa65-4358-8399-6ed11b68616e/konnectivity-agent/0.log" limit=1024
Jul 22 04:59:31.691192 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:59:31.691157    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j9gvx_b4af3ae5-fa65-4358-8399-6ed11b68616e/konnectivity-agent/0.log" limit=1024
Jul 22 04:59:34.150739 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:59:34.150706    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j9gvx_b4af3ae5-fa65-4358-8399-6ed11b68616e/konnectivity-agent/0.log" limit=1024
Jul 22 04:59:34.221458 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:59:34.221412    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j9gvx_b4af3ae5-fa65-4358-8399-6ed11b68616e/konnectivity-agent/0.log" limit=1024
Jul 22 04:59:34.300558 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:59:34.300524    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j9gvx_b4af3ae5-fa65-4358-8399-6ed11b68616e/konnectivity-agent/0.log" limit=1024
Jul 22 04:59:34.466837 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:59:34.466784    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j9gvx_b4af3ae5-fa65-4358-8399-6ed11b68616e/konnectivity-agent/0.log" limit=1024
Jul 22 04:59:34.717531 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:59:34.717443    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j9gvx_b4af3ae5-fa65-4358-8399-6ed11b68616e/konnectivity-agent/0.log" limit=1024
Jul 22 04:59:34.818371 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:59:34.818333    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j9gvx_b4af3ae5-fa65-4358-8399-6ed11b68616e/konnectivity-agent/0.log" limit=1024
Jul 22 04:59:35.663193 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:59:35.663161    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-wsdd9"]
Jul 22 04:59:38.611869 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:59:38.611829    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j9gvx_b4af3ae5-fa65-4358-8399-6ed11b68616e/konnectivity-agent/0.log" limit=1024
Jul 22 04:59:39.210236 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:59:39.210205    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j9gvx_b4af3ae5-fa65-4358-8399-6ed11b68616e/konnectivity-agent/0.log" limit=1024
Jul 22 04:59:39.311411 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:59:39.311347    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j9gvx_b4af3ae5-fa65-4358-8399-6ed11b68616e/konnectivity-agent/0.log" limit=1024
Jul 22 04:59:39.608383 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:59:39.608298    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j9gvx_b4af3ae5-fa65-4358-8399-6ed11b68616e/konnectivity-agent/0.log" limit=1024
Jul 22 04:59:44.006228 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:59:44.006194    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j9gvx_b4af3ae5-fa65-4358-8399-6ed11b68616e/konnectivity-agent/0.log" limit=1024
Jul 22 04:59:45.076949 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:59:45.076920    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-gw4km_67c7210c-7cfa-4865-bce3-777fbb6f3cea/console-operator/1.log"
Jul 22 04:59:45.078870 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:59:45.078844    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-gw4km_67c7210c-7cfa-4865-bce3-777fbb6f3cea/console-operator/1.log"
Jul 22 04:59:45.430637 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:59:45.430605    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j9gvx_b4af3ae5-fa65-4358-8399-6ed11b68616e/konnectivity-agent/0.log" limit=1024
Jul 22 04:59:45.529632 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:59:45.529604    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j9gvx_b4af3ae5-fa65-4358-8399-6ed11b68616e/konnectivity-agent/0.log" limit=1024
Jul 22 04:59:45.770962 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:59:45.770884    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-0c0adb03-6lwmf"]
Jul 22 04:59:45.771224 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:59:45.771212    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="51abe71f-0ce8-4271-aeea-311aba3200a5" containerName="istio-proxy"
Jul 22 04:59:45.771272 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:59:45.771225    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="51abe71f-0ce8-4271-aeea-311aba3200a5" containerName="istio-proxy"
Jul 22 04:59:45.771272 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:59:45.771238    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="51abe71f-0ce8-4271-aeea-311aba3200a5" containerName="istio-proxy"
Jul 22 04:59:45.771272 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:59:45.771244    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="51abe71f-0ce8-4271-aeea-311aba3200a5" containerName="istio-proxy"
Jul 22 04:59:45.771363 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:59:45.771310    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="51abe71f-0ce8-4271-aeea-311aba3200a5" containerName="istio-proxy"
Jul 22 04:59:45.771363 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:59:45.771319    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="51abe71f-0ce8-4271-aeea-311aba3200a5" containerName="istio-proxy"
Jul 22 04:59:45.774336 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:59:45.774320    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-0c0adb03-6lwmf"
Jul 22 04:59:45.776590 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:59:45.776565    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-65v9v\""
Jul 22 04:59:45.776715 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:59:45.776592    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 22 04:59:45.781637 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:59:45.781469    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-0c0adb03-6lwmf"]
Jul 22 04:59:45.804437 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:59:45.804410    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/394bc9ea-eeaf-4f5e-a3ef-b97568df2eca-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-mt-0c0adb03-6lwmf\" (UID: \"394bc9ea-eeaf-4f5e-a3ef-b97568df2eca\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-0c0adb03-6lwmf"
Jul 22 04:59:45.905653 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:59:45.905616    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/394bc9ea-eeaf-4f5e-a3ef-b97568df2eca-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-mt-0c0adb03-6lwmf\" (UID: \"394bc9ea-eeaf-4f5e-a3ef-b97568df2eca\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-0c0adb03-6lwmf"
Jul 22 04:59:45.906271 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:59:45.906254    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/394bc9ea-eeaf-4f5e-a3ef-b97568df2eca-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-mt-0c0adb03-6lwmf\" (UID: \"394bc9ea-eeaf-4f5e-a3ef-b97568df2eca\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-0c0adb03-6lwmf"
Jul 22 04:59:46.085357 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:59:46.085266    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-0c0adb03-6lwmf"
Jul 22 04:59:46.210084 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:59:46.210009    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-0c0adb03-6lwmf"]
Jul 22 04:59:46.212457 ip-10-0-141-238 kubenswrapper[2563]: W0722 04:59:46.212430    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod394bc9ea_eeaf_4f5e_a3ef_b97568df2eca.slice/crio-90d0c9ae3e4bebb5f82c4a9f469a61371050305949efc6a834e1429a3c5814da WatchSource:0}: Error finding container 90d0c9ae3e4bebb5f82c4a9f469a61371050305949efc6a834e1429a3c5814da: Status 404 returned error can't find the container with id 90d0c9ae3e4bebb5f82c4a9f469a61371050305949efc6a834e1429a3c5814da
Jul 22 04:59:46.725922 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:59:46.725888    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-0c0adb03-6lwmf" event={"ID":"394bc9ea-eeaf-4f5e-a3ef-b97568df2eca","Type":"ContainerStarted","Data":"59ff6ab33c28a7883b7b09e87391637e4bff87d1f27de4ee59c0a54e44190d63"}
Jul 22 04:59:46.726118 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:59:46.725941    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-0c0adb03-6lwmf" event={"ID":"394bc9ea-eeaf-4f5e-a3ef-b97568df2eca","Type":"ContainerStarted","Data":"90d0c9ae3e4bebb5f82c4a9f469a61371050305949efc6a834e1429a3c5814da"}
Jul 22 04:59:46.741634 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:59:46.741591    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-0c0adb03-6lwmf" podStartSLOduration=1.7415775660000001 podStartE2EDuration="1.741577566s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 04:59:45 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 04:59:46.740471569 +0000 UTC m=+2102.159480328" watchObservedRunningTime="2026-07-22 04:59:46.741577566 +0000 UTC m=+2102.160586323"
Jul 22 04:59:47.732110 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:59:47.732072    2563 generic.go:356] "Generic (PLEG): container finished" podID="394bc9ea-eeaf-4f5e-a3ef-b97568df2eca" containerID="59ff6ab33c28a7883b7b09e87391637e4bff87d1f27de4ee59c0a54e44190d63" exitCode=0
Jul 22 04:59:47.732586 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:59:47.732160    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-0c0adb03-6lwmf" event={"ID":"394bc9ea-eeaf-4f5e-a3ef-b97568df2eca","Type":"ContainerDied","Data":"59ff6ab33c28a7883b7b09e87391637e4bff87d1f27de4ee59c0a54e44190d63"}
Jul 22 04:59:48.863362 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:59:48.863340    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-0c0adb03-6lwmf"
Jul 22 04:59:48.933508 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:59:48.933482    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/394bc9ea-eeaf-4f5e-a3ef-b97568df2eca-maas-api-service-ca\") pod \"394bc9ea-eeaf-4f5e-a3ef-b97568df2eca\" (UID: \"394bc9ea-eeaf-4f5e-a3ef-b97568df2eca\") "
Jul 22 04:59:48.933808 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:59:48.933785    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/394bc9ea-eeaf-4f5e-a3ef-b97568df2eca-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "394bc9ea-eeaf-4f5e-a3ef-b97568df2eca" (UID: "394bc9ea-eeaf-4f5e-a3ef-b97568df2eca"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 22 04:59:49.034908 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:59:49.034836    2563 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/394bc9ea-eeaf-4f5e-a3ef-b97568df2eca-maas-api-service-ca\") on node \"ip-10-0-141-238.ec2.internal\" DevicePath \"\""
Jul 22 04:59:49.742022 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:59:49.741992    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-0c0adb03-6lwmf" event={"ID":"394bc9ea-eeaf-4f5e-a3ef-b97568df2eca","Type":"ContainerDied","Data":"90d0c9ae3e4bebb5f82c4a9f469a61371050305949efc6a834e1429a3c5814da"}
Jul 22 04:59:49.742022 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:59:49.742013    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-0c0adb03-6lwmf"
Jul 22 04:59:49.742262 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:59:49.742053    2563 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="90d0c9ae3e4bebb5f82c4a9f469a61371050305949efc6a834e1429a3c5814da"
Jul 22 04:59:56.367126 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:59:56.367082    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j9gvx_b4af3ae5-fa65-4358-8399-6ed11b68616e/konnectivity-agent/0.log" limit=1024
Jul 22 04:59:57.367235 ip-10-0-141-238 kubenswrapper[2563]: I0722 04:59:57.367203    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-wsdd9"]
Jul 22 05:00:00.133579 ip-10-0-141-238 kubenswrapper[2563]: I0722 05:00:00.133546    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29744940-jbczr"]
Jul 22 05:00:00.133940 ip-10-0-141-238 kubenswrapper[2563]: I0722 05:00:00.133870    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="394bc9ea-eeaf-4f5e-a3ef-b97568df2eca" containerName="revoke-keys"
Jul 22 05:00:00.133940 ip-10-0-141-238 kubenswrapper[2563]: I0722 05:00:00.133881    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="394bc9ea-eeaf-4f5e-a3ef-b97568df2eca" containerName="revoke-keys"
Jul 22 05:00:00.133940 ip-10-0-141-238 kubenswrapper[2563]: I0722 05:00:00.133931    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="394bc9ea-eeaf-4f5e-a3ef-b97568df2eca" containerName="revoke-keys"
Jul 22 05:00:00.136961 ip-10-0-141-238 kubenswrapper[2563]: I0722 05:00:00.136946    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29744940-jbczr"
Jul 22 05:00:00.139169 ip-10-0-141-238 kubenswrapper[2563]: I0722 05:00:00.139143    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-65v9v\""
Jul 22 05:00:00.143292 ip-10-0-141-238 kubenswrapper[2563]: I0722 05:00:00.143259    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29744940-jbczr"]
Jul 22 05:00:00.148304 ip-10-0-141-238 kubenswrapper[2563]: I0722 05:00:00.148282    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29744940-jbczr"
Jul 22 05:00:00.275628 ip-10-0-141-238 kubenswrapper[2563]: I0722 05:00:00.275598    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29744940-jbczr"]
Jul 22 05:00:00.278416 ip-10-0-141-238 kubenswrapper[2563]: W0722 05:00:00.278388    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9182042d_169e_47df_9acf_1e7b365c7369.slice/crio-e1c9679906bedbc69959e7f8229f64be991d68b2fa6b9cf1c86808b583f097c3 WatchSource:0}: Error finding container e1c9679906bedbc69959e7f8229f64be991d68b2fa6b9cf1c86808b583f097c3: Status 404 returned error can't find the container with id e1c9679906bedbc69959e7f8229f64be991d68b2fa6b9cf1c86808b583f097c3
Jul 22 05:00:00.790380 ip-10-0-141-238 kubenswrapper[2563]: I0722 05:00:00.790287    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29744940-jbczr" event={"ID":"9182042d-169e-47df-9acf-1e7b365c7369","Type":"ContainerStarted","Data":"136838a51c8395eb55985313ac052afef903ea62cfd492a8319484f201bbe5a9"}
Jul 22 05:00:00.790380 ip-10-0-141-238 kubenswrapper[2563]: I0722 05:00:00.790347    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29744940-jbczr" event={"ID":"9182042d-169e-47df-9acf-1e7b365c7369","Type":"ContainerStarted","Data":"e1c9679906bedbc69959e7f8229f64be991d68b2fa6b9cf1c86808b583f097c3"}
Jul 22 05:00:00.806131 ip-10-0-141-238 kubenswrapper[2563]: I0722 05:00:00.806076    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29744940-jbczr" podStartSLOduration=0.806057442 podStartE2EDuration="806.057442ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 05:00:00 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 05:00:00.804463835 +0000 UTC m=+2116.223472593" watchObservedRunningTime="2026-07-22 05:00:00.806057442 +0000 UTC m=+2116.225066199"
Jul 22 05:00:00.843573 ip-10-0-141-238 kubenswrapper[2563]: I0722 05:00:00.843549    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-0c0adb03-6lwmf"]
Jul 22 05:00:00.846462 ip-10-0-141-238 kubenswrapper[2563]: I0722 05:00:00.846439    2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-0c0adb03-6lwmf"]
Jul 22 05:00:00.846802 ip-10-0-141-238 kubenswrapper[2563]: I0722 05:00:00.846781    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j9gvx_b4af3ae5-fa65-4358-8399-6ed11b68616e/konnectivity-agent/0.log" limit=1024
Jul 22 05:00:01.064665 ip-10-0-141-238 kubenswrapper[2563]: I0722 05:00:01.064587    2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="394bc9ea-eeaf-4f5e-a3ef-b97568df2eca" path="/var/lib/kubelet/pods/394bc9ea-eeaf-4f5e-a3ef-b97568df2eca/volumes"
Jul 22 05:00:01.270906 ip-10-0-141-238 kubenswrapper[2563]: I0722 05:00:01.270876    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j9gvx_b4af3ae5-fa65-4358-8399-6ed11b68616e/konnectivity-agent/0.log" limit=1024
Jul 22 05:00:01.802663 ip-10-0-141-238 kubenswrapper[2563]: I0722 05:00:01.802617    2563 generic.go:356] "Generic (PLEG): container finished" podID="9182042d-169e-47df-9acf-1e7b365c7369" containerID="136838a51c8395eb55985313ac052afef903ea62cfd492a8319484f201bbe5a9" exitCode=0
Jul 22 05:00:01.802845 ip-10-0-141-238 kubenswrapper[2563]: I0722 05:00:01.802698    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29744940-jbczr" event={"ID":"9182042d-169e-47df-9acf-1e7b365c7369","Type":"ContainerDied","Data":"136838a51c8395eb55985313ac052afef903ea62cfd492a8319484f201bbe5a9"}
Jul 22 05:00:02.949641 ip-10-0-141-238 kubenswrapper[2563]: I0722 05:00:02.949616    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29744940-jbczr"
Jul 22 05:00:03.813489 ip-10-0-141-238 kubenswrapper[2563]: I0722 05:00:03.813459    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29744940-jbczr"
Jul 22 05:00:03.813681 ip-10-0-141-238 kubenswrapper[2563]: I0722 05:00:03.813509    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29744940-jbczr" event={"ID":"9182042d-169e-47df-9acf-1e7b365c7369","Type":"ContainerDied","Data":"e1c9679906bedbc69959e7f8229f64be991d68b2fa6b9cf1c86808b583f097c3"}
Jul 22 05:00:03.813681 ip-10-0-141-238 kubenswrapper[2563]: I0722 05:00:03.813566    2563 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="e1c9679906bedbc69959e7f8229f64be991d68b2fa6b9cf1c86808b583f097c3"
Jul 22 05:00:07.085261 ip-10-0-141-238 kubenswrapper[2563]: I0722 05:00:07.085229    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j9gvx_b4af3ae5-fa65-4358-8399-6ed11b68616e/konnectivity-agent/0.log" limit=1024
Jul 22 05:00:07.263083 ip-10-0-141-238 kubenswrapper[2563]: I0722 05:00:07.263030    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j9gvx_b4af3ae5-fa65-4358-8399-6ed11b68616e/konnectivity-agent/0.log" limit=1024
Jul 22 05:00:07.347478 ip-10-0-141-238 kubenswrapper[2563]: I0722 05:00:07.347395    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j9gvx_b4af3ae5-fa65-4358-8399-6ed11b68616e/konnectivity-agent/0.log" limit=1024
Jul 22 05:00:07.554125 ip-10-0-141-238 kubenswrapper[2563]: I0722 05:00:07.554095    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j9gvx_b4af3ae5-fa65-4358-8399-6ed11b68616e/konnectivity-agent/0.log" limit=1024
Jul 22 05:00:07.718586 ip-10-0-141-238 kubenswrapper[2563]: I0722 05:00:07.718555    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j9gvx_b4af3ae5-fa65-4358-8399-6ed11b68616e/konnectivity-agent/0.log" limit=1024
Jul 22 05:00:07.777698 ip-10-0-141-238 kubenswrapper[2563]: I0722 05:00:07.777668    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j9gvx_b4af3ae5-fa65-4358-8399-6ed11b68616e/konnectivity-agent/0.log" limit=1024
Jul 22 05:00:07.891732 ip-10-0-141-238 kubenswrapper[2563]: I0722 05:00:07.891698    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j9gvx_b4af3ae5-fa65-4358-8399-6ed11b68616e/konnectivity-agent/0.log" limit=1024
Jul 22 05:00:13.892302 ip-10-0-141-238 kubenswrapper[2563]: I0722 05:00:13.892264    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j9gvx_b4af3ae5-fa65-4358-8399-6ed11b68616e/konnectivity-agent/0.log" limit=1024
Jul 22 05:00:13.963700 ip-10-0-141-238 kubenswrapper[2563]: I0722 05:00:13.963669    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j9gvx_b4af3ae5-fa65-4358-8399-6ed11b68616e/konnectivity-agent/0.log" limit=1024
Jul 22 05:00:14.035045 ip-10-0-141-238 kubenswrapper[2563]: I0722 05:00:14.035004    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j9gvx_b4af3ae5-fa65-4358-8399-6ed11b68616e/konnectivity-agent/0.log" limit=1024
Jul 22 05:00:14.227425 ip-10-0-141-238 kubenswrapper[2563]: I0722 05:00:14.227394    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j9gvx_b4af3ae5-fa65-4358-8399-6ed11b68616e/konnectivity-agent/0.log" limit=1024
Jul 22 05:00:19.931118 ip-10-0-141-238 kubenswrapper[2563]: I0722 05:00:19.931075    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j9gvx_b4af3ae5-fa65-4358-8399-6ed11b68616e/konnectivity-agent/0.log" limit=1024
Jul 22 05:00:19.990690 ip-10-0-141-238 kubenswrapper[2563]: I0722 05:00:19.990655    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j9gvx_b4af3ae5-fa65-4358-8399-6ed11b68616e/konnectivity-agent/0.log" limit=1024
Jul 22 05:00:26.614400 ip-10-0-141-238 kubenswrapper[2563]: I0722 05:00:26.614336    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j9gvx_b4af3ae5-fa65-4358-8399-6ed11b68616e/konnectivity-agent/0.log" limit=1024
Jul 22 05:00:26.911794 ip-10-0-141-238 kubenswrapper[2563]: I0722 05:00:26.911769    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j9gvx_b4af3ae5-fa65-4358-8399-6ed11b68616e/konnectivity-agent/0.log" limit=1024
Jul 22 05:00:27.096820 ip-10-0-141-238 kubenswrapper[2563]: I0722 05:00:27.096791    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j9gvx_b4af3ae5-fa65-4358-8399-6ed11b68616e/konnectivity-agent/0.log" limit=1024
Jul 22 05:00:29.413974 ip-10-0-141-238 kubenswrapper[2563]: I0722 05:00:29.413934    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j9gvx_b4af3ae5-fa65-4358-8399-6ed11b68616e/konnectivity-agent/0.log" limit=1024
Jul 22 05:00:29.499341 ip-10-0-141-238 kubenswrapper[2563]: I0722 05:00:29.499308    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j9gvx_b4af3ae5-fa65-4358-8399-6ed11b68616e/konnectivity-agent/0.log" limit=1024
Jul 22 05:00:29.570421 ip-10-0-141-238 kubenswrapper[2563]: I0722 05:00:29.570383    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j9gvx_b4af3ae5-fa65-4358-8399-6ed11b68616e/konnectivity-agent/0.log" limit=1024
Jul 22 05:00:29.964644 ip-10-0-141-238 kubenswrapper[2563]: I0722 05:00:29.964606    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j9gvx_b4af3ae5-fa65-4358-8399-6ed11b68616e/konnectivity-agent/0.log" limit=1024
Jul 22 05:00:30.065647 ip-10-0-141-238 kubenswrapper[2563]: I0722 05:00:30.065610    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j9gvx_b4af3ae5-fa65-4358-8399-6ed11b68616e/konnectivity-agent/0.log" limit=1024
Jul 22 05:00:30.970548 ip-10-0-141-238 kubenswrapper[2563]: I0722 05:00:30.970513    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-wsdd9"]
Jul 22 05:00:33.871398 ip-10-0-141-238 kubenswrapper[2563]: I0722 05:00:33.871364    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j9gvx_b4af3ae5-fa65-4358-8399-6ed11b68616e/konnectivity-agent/0.log" limit=1024
Jul 22 05:00:37.509188 ip-10-0-141-238 kubenswrapper[2563]: I0722 05:00:37.509103    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j9gvx_b4af3ae5-fa65-4358-8399-6ed11b68616e/konnectivity-agent/0.log" limit=1024
Jul 22 05:00:46.169200 ip-10-0-141-238 kubenswrapper[2563]: I0722 05:00:46.169167    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-mt-d559fe69/e2e-lifecycle-model-d559fe69-kserve-84fdd7786c-xl2vn"]
Jul 22 05:00:46.169649 ip-10-0-141-238 kubenswrapper[2563]: I0722 05:00:46.169523    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9182042d-169e-47df-9acf-1e7b365c7369" containerName="cleanup"
Jul 22 05:00:46.169649 ip-10-0-141-238 kubenswrapper[2563]: I0722 05:00:46.169540    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="9182042d-169e-47df-9acf-1e7b365c7369" containerName="cleanup"
Jul 22 05:00:46.169649 ip-10-0-141-238 kubenswrapper[2563]: I0722 05:00:46.169610    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="9182042d-169e-47df-9acf-1e7b365c7369" containerName="cleanup"
Jul 22 05:00:46.172794 ip-10-0-141-238 kubenswrapper[2563]: I0722 05:00:46.172776    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-mt-d559fe69/e2e-lifecycle-model-d559fe69-kserve-84fdd7786c-xl2vn"
Jul 22 05:00:46.176172 ip-10-0-141-238 kubenswrapper[2563]: I0722 05:00:46.176144    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-mt-d559fe69\"/\"kube-root-ca.crt\""
Jul 22 05:00:46.176289 ip-10-0-141-238 kubenswrapper[2563]: I0722 05:00:46.176201    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-mt-d559fe69\"/\"e2e-lifecycle-model-d559fe69-kserve-self-signed-certs\""
Jul 22 05:00:46.176289 ip-10-0-141-238 kubenswrapper[2563]: I0722 05:00:46.176203    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-mt-d559fe69\"/\"default-dockercfg-92h98\""
Jul 22 05:00:46.176289 ip-10-0-141-238 kubenswrapper[2563]: I0722 05:00:46.176209    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-mt-d559fe69\"/\"openshift-service-ca.crt\""
Jul 22 05:00:46.182873 ip-10-0-141-238 kubenswrapper[2563]: I0722 05:00:46.182852    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-mt-d559fe69/e2e-lifecycle-model-d559fe69-kserve-84fdd7786c-xl2vn"]
Jul 22 05:00:46.222808 ip-10-0-141-238 kubenswrapper[2563]: I0722 05:00:46.222783    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/b1bc97b6-d8fc-4aeb-b0af-96951d0fdb02-model-cache\") pod \"e2e-lifecycle-model-d559fe69-kserve-84fdd7786c-xl2vn\" (UID: \"b1bc97b6-d8fc-4aeb-b0af-96951d0fdb02\") " pod="ai-tenant-e2e-mt-d559fe69/e2e-lifecycle-model-d559fe69-kserve-84fdd7786c-xl2vn"
Jul 22 05:00:46.222943 ip-10-0-141-238 kubenswrapper[2563]: I0722 05:00:46.222816    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b1bc97b6-d8fc-4aeb-b0af-96951d0fdb02-tmp-dir\") pod \"e2e-lifecycle-model-d559fe69-kserve-84fdd7786c-xl2vn\" (UID: \"b1bc97b6-d8fc-4aeb-b0af-96951d0fdb02\") " pod="ai-tenant-e2e-mt-d559fe69/e2e-lifecycle-model-d559fe69-kserve-84fdd7786c-xl2vn"
Jul 22 05:00:46.222943 ip-10-0-141-238 kubenswrapper[2563]: I0722 05:00:46.222850    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-m8lmj\" (UniqueName: \"kubernetes.io/projected/b1bc97b6-d8fc-4aeb-b0af-96951d0fdb02-kube-api-access-m8lmj\") pod \"e2e-lifecycle-model-d559fe69-kserve-84fdd7786c-xl2vn\" (UID: \"b1bc97b6-d8fc-4aeb-b0af-96951d0fdb02\") " pod="ai-tenant-e2e-mt-d559fe69/e2e-lifecycle-model-d559fe69-kserve-84fdd7786c-xl2vn"
Jul 22 05:00:46.223072 ip-10-0-141-238 kubenswrapper[2563]: I0722 05:00:46.222960    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/b1bc97b6-d8fc-4aeb-b0af-96951d0fdb02-dshm\") pod \"e2e-lifecycle-model-d559fe69-kserve-84fdd7786c-xl2vn\" (UID: \"b1bc97b6-d8fc-4aeb-b0af-96951d0fdb02\") " pod="ai-tenant-e2e-mt-d559fe69/e2e-lifecycle-model-d559fe69-kserve-84fdd7786c-xl2vn"
Jul 22 05:00:46.223072 ip-10-0-141-238 kubenswrapper[2563]: I0722 05:00:46.222990    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/b1bc97b6-d8fc-4aeb-b0af-96951d0fdb02-tls-certs\") pod \"e2e-lifecycle-model-d559fe69-kserve-84fdd7786c-xl2vn\" (UID: \"b1bc97b6-d8fc-4aeb-b0af-96951d0fdb02\") " pod="ai-tenant-e2e-mt-d559fe69/e2e-lifecycle-model-d559fe69-kserve-84fdd7786c-xl2vn"
Jul 22 05:00:46.223072 ip-10-0-141-238 kubenswrapper[2563]: I0722 05:00:46.223014    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/b1bc97b6-d8fc-4aeb-b0af-96951d0fdb02-home\") pod \"e2e-lifecycle-model-d559fe69-kserve-84fdd7786c-xl2vn\" (UID: \"b1bc97b6-d8fc-4aeb-b0af-96951d0fdb02\") " pod="ai-tenant-e2e-mt-d559fe69/e2e-lifecycle-model-d559fe69-kserve-84fdd7786c-xl2vn"
Jul 22 05:00:46.278581 ip-10-0-141-238 kubenswrapper[2563]: I0722 05:00:46.278533    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j9gvx_b4af3ae5-fa65-4358-8399-6ed11b68616e/konnectivity-agent/0.log" limit=1024
Jul 22 05:00:46.323850 ip-10-0-141-238 kubenswrapper[2563]: I0722 05:00:46.323816    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/b1bc97b6-d8fc-4aeb-b0af-96951d0fdb02-dshm\") pod \"e2e-lifecycle-model-d559fe69-kserve-84fdd7786c-xl2vn\" (UID: \"b1bc97b6-d8fc-4aeb-b0af-96951d0fdb02\") " pod="ai-tenant-e2e-mt-d559fe69/e2e-lifecycle-model-d559fe69-kserve-84fdd7786c-xl2vn"
Jul 22 05:00:46.323850 ip-10-0-141-238 kubenswrapper[2563]: I0722 05:00:46.323854    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/b1bc97b6-d8fc-4aeb-b0af-96951d0fdb02-tls-certs\") pod \"e2e-lifecycle-model-d559fe69-kserve-84fdd7786c-xl2vn\" (UID: \"b1bc97b6-d8fc-4aeb-b0af-96951d0fdb02\") " pod="ai-tenant-e2e-mt-d559fe69/e2e-lifecycle-model-d559fe69-kserve-84fdd7786c-xl2vn"
Jul 22 05:00:46.324118 ip-10-0-141-238 kubenswrapper[2563]: I0722 05:00:46.323885    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/b1bc97b6-d8fc-4aeb-b0af-96951d0fdb02-home\") pod \"e2e-lifecycle-model-d559fe69-kserve-84fdd7786c-xl2vn\" (UID: \"b1bc97b6-d8fc-4aeb-b0af-96951d0fdb02\") " pod="ai-tenant-e2e-mt-d559fe69/e2e-lifecycle-model-d559fe69-kserve-84fdd7786c-xl2vn"
Jul 22 05:00:46.324118 ip-10-0-141-238 kubenswrapper[2563]: I0722 05:00:46.324013    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/b1bc97b6-d8fc-4aeb-b0af-96951d0fdb02-model-cache\") pod \"e2e-lifecycle-model-d559fe69-kserve-84fdd7786c-xl2vn\" (UID: \"b1bc97b6-d8fc-4aeb-b0af-96951d0fdb02\") " pod="ai-tenant-e2e-mt-d559fe69/e2e-lifecycle-model-d559fe69-kserve-84fdd7786c-xl2vn"
Jul 22 05:00:46.324118 ip-10-0-141-238 kubenswrapper[2563]: I0722 05:00:46.324082    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b1bc97b6-d8fc-4aeb-b0af-96951d0fdb02-tmp-dir\") pod \"e2e-lifecycle-model-d559fe69-kserve-84fdd7786c-xl2vn\" (UID: \"b1bc97b6-d8fc-4aeb-b0af-96951d0fdb02\") " pod="ai-tenant-e2e-mt-d559fe69/e2e-lifecycle-model-d559fe69-kserve-84fdd7786c-xl2vn"
Jul 22 05:00:46.324279 ip-10-0-141-238 kubenswrapper[2563]: I0722 05:00:46.324120    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-m8lmj\" (UniqueName: \"kubernetes.io/projected/b1bc97b6-d8fc-4aeb-b0af-96951d0fdb02-kube-api-access-m8lmj\") pod \"e2e-lifecycle-model-d559fe69-kserve-84fdd7786c-xl2vn\" (UID: \"b1bc97b6-d8fc-4aeb-b0af-96951d0fdb02\") " pod="ai-tenant-e2e-mt-d559fe69/e2e-lifecycle-model-d559fe69-kserve-84fdd7786c-xl2vn"
Jul 22 05:00:46.324384 ip-10-0-141-238 kubenswrapper[2563]: I0722 05:00:46.324360    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/b1bc97b6-d8fc-4aeb-b0af-96951d0fdb02-home\") pod \"e2e-lifecycle-model-d559fe69-kserve-84fdd7786c-xl2vn\" (UID: \"b1bc97b6-d8fc-4aeb-b0af-96951d0fdb02\") " pod="ai-tenant-e2e-mt-d559fe69/e2e-lifecycle-model-d559fe69-kserve-84fdd7786c-xl2vn"
Jul 22 05:00:46.324521 ip-10-0-141-238 kubenswrapper[2563]: I0722 05:00:46.324388    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/b1bc97b6-d8fc-4aeb-b0af-96951d0fdb02-model-cache\") pod \"e2e-lifecycle-model-d559fe69-kserve-84fdd7786c-xl2vn\" (UID: \"b1bc97b6-d8fc-4aeb-b0af-96951d0fdb02\") " pod="ai-tenant-e2e-mt-d559fe69/e2e-lifecycle-model-d559fe69-kserve-84fdd7786c-xl2vn"
Jul 22 05:00:46.324521 ip-10-0-141-238 kubenswrapper[2563]: I0722 05:00:46.324437    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b1bc97b6-d8fc-4aeb-b0af-96951d0fdb02-tmp-dir\") pod \"e2e-lifecycle-model-d559fe69-kserve-84fdd7786c-xl2vn\" (UID: \"b1bc97b6-d8fc-4aeb-b0af-96951d0fdb02\") " pod="ai-tenant-e2e-mt-d559fe69/e2e-lifecycle-model-d559fe69-kserve-84fdd7786c-xl2vn"
Jul 22 05:00:46.326785 ip-10-0-141-238 kubenswrapper[2563]: I0722 05:00:46.326757    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/b1bc97b6-d8fc-4aeb-b0af-96951d0fdb02-dshm\") pod \"e2e-lifecycle-model-d559fe69-kserve-84fdd7786c-xl2vn\" (UID: \"b1bc97b6-d8fc-4aeb-b0af-96951d0fdb02\") " pod="ai-tenant-e2e-mt-d559fe69/e2e-lifecycle-model-d559fe69-kserve-84fdd7786c-xl2vn"
Jul 22 05:00:46.326923 ip-10-0-141-238 kubenswrapper[2563]: I0722 05:00:46.326907    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/b1bc97b6-d8fc-4aeb-b0af-96951d0fdb02-tls-certs\") pod \"e2e-lifecycle-model-d559fe69-kserve-84fdd7786c-xl2vn\" (UID: \"b1bc97b6-d8fc-4aeb-b0af-96951d0fdb02\") " pod="ai-tenant-e2e-mt-d559fe69/e2e-lifecycle-model-d559fe69-kserve-84fdd7786c-xl2vn"
Jul 22 05:00:46.332287 ip-10-0-141-238 kubenswrapper[2563]: I0722 05:00:46.332266    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-m8lmj\" (UniqueName: \"kubernetes.io/projected/b1bc97b6-d8fc-4aeb-b0af-96951d0fdb02-kube-api-access-m8lmj\") pod \"e2e-lifecycle-model-d559fe69-kserve-84fdd7786c-xl2vn\" (UID: \"b1bc97b6-d8fc-4aeb-b0af-96951d0fdb02\") " pod="ai-tenant-e2e-mt-d559fe69/e2e-lifecycle-model-d559fe69-kserve-84fdd7786c-xl2vn"
Jul 22 05:00:46.482513 ip-10-0-141-238 kubenswrapper[2563]: I0722 05:00:46.482428    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-mt-d559fe69/e2e-lifecycle-model-d559fe69-kserve-84fdd7786c-xl2vn"
Jul 22 05:00:46.609253 ip-10-0-141-238 kubenswrapper[2563]: I0722 05:00:46.609228    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-mt-d559fe69/e2e-lifecycle-model-d559fe69-kserve-84fdd7786c-xl2vn"]
Jul 22 05:00:46.611326 ip-10-0-141-238 kubenswrapper[2563]: W0722 05:00:46.611297    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podb1bc97b6_d8fc_4aeb_b0af_96951d0fdb02.slice/crio-af78f36cf5a80945201c4e311903bcd136011102a8193b5a7cd882375e9ab61f WatchSource:0}: Error finding container af78f36cf5a80945201c4e311903bcd136011102a8193b5a7cd882375e9ab61f: Status 404 returned error can't find the container with id af78f36cf5a80945201c4e311903bcd136011102a8193b5a7cd882375e9ab61f
Jul 22 05:00:47.018106 ip-10-0-141-238 kubenswrapper[2563]: I0722 05:00:47.018068    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-mt-d559fe69/e2e-lifecycle-model-d559fe69-kserve-84fdd7786c-xl2vn" event={"ID":"b1bc97b6-d8fc-4aeb-b0af-96951d0fdb02","Type":"ContainerStarted","Data":"2394b3d421f030eb2c67e5ab7d2f4181f2ecd3a72d68a5f3235a13754e378214"}
Jul 22 05:00:47.018292 ip-10-0-141-238 kubenswrapper[2563]: I0722 05:00:47.018115    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-mt-d559fe69/e2e-lifecycle-model-d559fe69-kserve-84fdd7786c-xl2vn" event={"ID":"b1bc97b6-d8fc-4aeb-b0af-96951d0fdb02","Type":"ContainerStarted","Data":"af78f36cf5a80945201c4e311903bcd136011102a8193b5a7cd882375e9ab61f"}
Jul 22 05:00:47.036908 ip-10-0-141-238 kubenswrapper[2563]: I0722 05:00:47.036848    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-mt-d559fe69/e2e-lifecycle-model-d559fe69-kserve-84fdd7786c-xl2vn" podStartSLOduration=1.03683029 podStartE2EDuration="1.03683029s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 05:00:46 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 05:00:47.03491961 +0000 UTC m=+2162.453928366" watchObservedRunningTime="2026-07-22 05:00:47.03683029 +0000 UTC m=+2162.455839041"
Jul 22 05:00:49.464518 ip-10-0-141-238 kubenswrapper[2563]: I0722 05:00:49.464484    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-wsdd9"]
Jul 22 05:00:56.483271 ip-10-0-141-238 kubenswrapper[2563]: I0722 05:00:56.483226    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-mt-d559fe69/e2e-lifecycle-model-d559fe69-kserve-84fdd7786c-xl2vn"
Jul 22 05:00:56.483812 ip-10-0-141-238 kubenswrapper[2563]: I0722 05:00:56.483346    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-mt-d559fe69/e2e-lifecycle-model-d559fe69-kserve-84fdd7786c-xl2vn"
Jul 22 05:00:56.495703 ip-10-0-141-238 kubenswrapper[2563]: I0722 05:00:56.495679    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-mt-d559fe69/e2e-lifecycle-model-d559fe69-kserve-84fdd7786c-xl2vn"
Jul 22 05:00:57.073659 ip-10-0-141-238 kubenswrapper[2563]: I0722 05:00:57.073628    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-mt-d559fe69/e2e-lifecycle-model-d559fe69-kserve-84fdd7786c-xl2vn"
Jul 22 05:01:03.474939 ip-10-0-141-238 kubenswrapper[2563]: I0722 05:01:03.474902    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-wsdd9"]
Jul 22 05:01:21.570588 ip-10-0-141-238 kubenswrapper[2563]: I0722 05:01:21.570552    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-wsdd9"]
Jul 22 05:01:22.511525 ip-10-0-141-238 kubenswrapper[2563]: I0722 05:01:22.511490    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j9gvx_b4af3ae5-fa65-4358-8399-6ed11b68616e/konnectivity-agent/0.log" limit=1024
Jul 22 05:01:27.123573 ip-10-0-141-238 kubenswrapper[2563]: I0722 05:01:27.123538    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j9gvx_b4af3ae5-fa65-4358-8399-6ed11b68616e/konnectivity-agent/0.log" limit=1024
Jul 22 05:01:29.250436 ip-10-0-141-238 kubenswrapper[2563]: I0722 05:01:29.250401    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j9gvx_b4af3ae5-fa65-4358-8399-6ed11b68616e/konnectivity-agent/0.log" limit=1024
Jul 22 05:01:31.670830 ip-10-0-141-238 kubenswrapper[2563]: I0722 05:01:31.670799    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-wsdd9"]
Jul 22 05:01:34.238296 ip-10-0-141-238 kubenswrapper[2563]: I0722 05:01:34.238261    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-mt-d559fe69/e2e-lifecycle-model-d559fe69-kserve-84fdd7786c-xl2vn"]
Jul 22 05:01:34.330082 ip-10-0-141-238 kubenswrapper[2563]: I0722 05:01:34.330035    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j9gvx_b4af3ae5-fa65-4358-8399-6ed11b68616e/konnectivity-agent/0.log" limit=1024
Jul 22 05:01:45.132961 ip-10-0-141-238 kubenswrapper[2563]: I0722 05:01:45.132929    2563 scope.go:117] "RemoveContainer" containerID="97e129c7331f16b2666b60f4f7e8b6f6a5bed4f1c9c15c5eba84b5efa978609b"
Jul 22 05:01:49.259625 ip-10-0-141-238 kubenswrapper[2563]: I0722 05:01:49.259576    2563 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-mt-d559fe69/e2e-lifecycle-model-d559fe69-kserve-84fdd7786c-xl2vn" podUID="b1bc97b6-d8fc-4aeb-b0af-96951d0fdb02" containerName="main" containerID="cri-o://2394b3d421f030eb2c67e5ab7d2f4181f2ecd3a72d68a5f3235a13754e378214" gracePeriod=45
Jul 22 05:01:49.507786 ip-10-0-141-238 kubenswrapper[2563]: I0722 05:01:49.507763    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-mt-d559fe69/e2e-lifecycle-model-d559fe69-kserve-84fdd7786c-xl2vn"
Jul 22 05:01:49.560827 ip-10-0-141-238 kubenswrapper[2563]: I0722 05:01:49.560748    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-m8lmj\" (UniqueName: \"kubernetes.io/projected/b1bc97b6-d8fc-4aeb-b0af-96951d0fdb02-kube-api-access-m8lmj\") pod \"b1bc97b6-d8fc-4aeb-b0af-96951d0fdb02\" (UID: \"b1bc97b6-d8fc-4aeb-b0af-96951d0fdb02\") "
Jul 22 05:01:49.560827 ip-10-0-141-238 kubenswrapper[2563]: I0722 05:01:49.560781    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b1bc97b6-d8fc-4aeb-b0af-96951d0fdb02-tmp-dir\") pod \"b1bc97b6-d8fc-4aeb-b0af-96951d0fdb02\" (UID: \"b1bc97b6-d8fc-4aeb-b0af-96951d0fdb02\") "
Jul 22 05:01:49.560827 ip-10-0-141-238 kubenswrapper[2563]: I0722 05:01:49.560814    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/b1bc97b6-d8fc-4aeb-b0af-96951d0fdb02-model-cache\") pod \"b1bc97b6-d8fc-4aeb-b0af-96951d0fdb02\" (UID: \"b1bc97b6-d8fc-4aeb-b0af-96951d0fdb02\") "
Jul 22 05:01:49.561100 ip-10-0-141-238 kubenswrapper[2563]: I0722 05:01:49.560864    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/b1bc97b6-d8fc-4aeb-b0af-96951d0fdb02-dshm\") pod \"b1bc97b6-d8fc-4aeb-b0af-96951d0fdb02\" (UID: \"b1bc97b6-d8fc-4aeb-b0af-96951d0fdb02\") "
Jul 22 05:01:49.561100 ip-10-0-141-238 kubenswrapper[2563]: I0722 05:01:49.560884    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/b1bc97b6-d8fc-4aeb-b0af-96951d0fdb02-tls-certs\") pod \"b1bc97b6-d8fc-4aeb-b0af-96951d0fdb02\" (UID: \"b1bc97b6-d8fc-4aeb-b0af-96951d0fdb02\") "
Jul 22 05:01:49.561100 ip-10-0-141-238 kubenswrapper[2563]: I0722 05:01:49.560903    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/b1bc97b6-d8fc-4aeb-b0af-96951d0fdb02-home\") pod \"b1bc97b6-d8fc-4aeb-b0af-96951d0fdb02\" (UID: \"b1bc97b6-d8fc-4aeb-b0af-96951d0fdb02\") "
Jul 22 05:01:49.561100 ip-10-0-141-238 kubenswrapper[2563]: I0722 05:01:49.561075    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b1bc97b6-d8fc-4aeb-b0af-96951d0fdb02-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "b1bc97b6-d8fc-4aeb-b0af-96951d0fdb02" (UID: "b1bc97b6-d8fc-4aeb-b0af-96951d0fdb02"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 22 05:01:49.561321 ip-10-0-141-238 kubenswrapper[2563]: I0722 05:01:49.561106    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b1bc97b6-d8fc-4aeb-b0af-96951d0fdb02-model-cache" (OuterVolumeSpecName: "model-cache") pod "b1bc97b6-d8fc-4aeb-b0af-96951d0fdb02" (UID: "b1bc97b6-d8fc-4aeb-b0af-96951d0fdb02"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 22 05:01:49.561321 ip-10-0-141-238 kubenswrapper[2563]: I0722 05:01:49.561246    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b1bc97b6-d8fc-4aeb-b0af-96951d0fdb02-home" (OuterVolumeSpecName: "home") pod "b1bc97b6-d8fc-4aeb-b0af-96951d0fdb02" (UID: "b1bc97b6-d8fc-4aeb-b0af-96951d0fdb02"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 22 05:01:49.561583 ip-10-0-141-238 kubenswrapper[2563]: I0722 05:01:49.561549    2563 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/b1bc97b6-d8fc-4aeb-b0af-96951d0fdb02-home\") on node \"ip-10-0-141-238.ec2.internal\" DevicePath \"\""
Jul 22 05:01:49.561583 ip-10-0-141-238 kubenswrapper[2563]: I0722 05:01:49.561575    2563 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b1bc97b6-d8fc-4aeb-b0af-96951d0fdb02-tmp-dir\") on node \"ip-10-0-141-238.ec2.internal\" DevicePath \"\""
Jul 22 05:01:49.561708 ip-10-0-141-238 kubenswrapper[2563]: I0722 05:01:49.561589    2563 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/b1bc97b6-d8fc-4aeb-b0af-96951d0fdb02-model-cache\") on node \"ip-10-0-141-238.ec2.internal\" DevicePath \"\""
Jul 22 05:01:49.563097 ip-10-0-141-238 kubenswrapper[2563]: I0722 05:01:49.563068    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b1bc97b6-d8fc-4aeb-b0af-96951d0fdb02-dshm" (OuterVolumeSpecName: "dshm") pod "b1bc97b6-d8fc-4aeb-b0af-96951d0fdb02" (UID: "b1bc97b6-d8fc-4aeb-b0af-96951d0fdb02"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 22 05:01:49.563198 ip-10-0-141-238 kubenswrapper[2563]: I0722 05:01:49.563112    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b1bc97b6-d8fc-4aeb-b0af-96951d0fdb02-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "b1bc97b6-d8fc-4aeb-b0af-96951d0fdb02" (UID: "b1bc97b6-d8fc-4aeb-b0af-96951d0fdb02"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 22 05:01:49.563198 ip-10-0-141-238 kubenswrapper[2563]: I0722 05:01:49.563131    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b1bc97b6-d8fc-4aeb-b0af-96951d0fdb02-kube-api-access-m8lmj" (OuterVolumeSpecName: "kube-api-access-m8lmj") pod "b1bc97b6-d8fc-4aeb-b0af-96951d0fdb02" (UID: "b1bc97b6-d8fc-4aeb-b0af-96951d0fdb02"). InnerVolumeSpecName "kube-api-access-m8lmj". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 22 05:01:49.662537 ip-10-0-141-238 kubenswrapper[2563]: I0722 05:01:49.662505    2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-m8lmj\" (UniqueName: \"kubernetes.io/projected/b1bc97b6-d8fc-4aeb-b0af-96951d0fdb02-kube-api-access-m8lmj\") on node \"ip-10-0-141-238.ec2.internal\" DevicePath \"\""
Jul 22 05:01:49.662537 ip-10-0-141-238 kubenswrapper[2563]: I0722 05:01:49.662533    2563 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/b1bc97b6-d8fc-4aeb-b0af-96951d0fdb02-dshm\") on node \"ip-10-0-141-238.ec2.internal\" DevicePath \"\""
Jul 22 05:01:49.662726 ip-10-0-141-238 kubenswrapper[2563]: I0722 05:01:49.662548    2563 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/b1bc97b6-d8fc-4aeb-b0af-96951d0fdb02-tls-certs\") on node \"ip-10-0-141-238.ec2.internal\" DevicePath \"\""
Jul 22 05:01:50.301817 ip-10-0-141-238 kubenswrapper[2563]: I0722 05:01:50.301783    2563 generic.go:356] "Generic (PLEG): container finished" podID="b1bc97b6-d8fc-4aeb-b0af-96951d0fdb02" containerID="2394b3d421f030eb2c67e5ab7d2f4181f2ecd3a72d68a5f3235a13754e378214" exitCode=0
Jul 22 05:01:50.302235 ip-10-0-141-238 kubenswrapper[2563]: I0722 05:01:50.301825    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-mt-d559fe69/e2e-lifecycle-model-d559fe69-kserve-84fdd7786c-xl2vn"
Jul 22 05:01:50.302235 ip-10-0-141-238 kubenswrapper[2563]: I0722 05:01:50.301867    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-mt-d559fe69/e2e-lifecycle-model-d559fe69-kserve-84fdd7786c-xl2vn" event={"ID":"b1bc97b6-d8fc-4aeb-b0af-96951d0fdb02","Type":"ContainerDied","Data":"2394b3d421f030eb2c67e5ab7d2f4181f2ecd3a72d68a5f3235a13754e378214"}
Jul 22 05:01:50.302235 ip-10-0-141-238 kubenswrapper[2563]: I0722 05:01:50.301906    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-mt-d559fe69/e2e-lifecycle-model-d559fe69-kserve-84fdd7786c-xl2vn" event={"ID":"b1bc97b6-d8fc-4aeb-b0af-96951d0fdb02","Type":"ContainerDied","Data":"af78f36cf5a80945201c4e311903bcd136011102a8193b5a7cd882375e9ab61f"}
Jul 22 05:01:50.302235 ip-10-0-141-238 kubenswrapper[2563]: I0722 05:01:50.301922    2563 scope.go:117] "RemoveContainer" containerID="2394b3d421f030eb2c67e5ab7d2f4181f2ecd3a72d68a5f3235a13754e378214"
Jul 22 05:01:50.311257 ip-10-0-141-238 kubenswrapper[2563]: I0722 05:01:50.311241    2563 scope.go:117] "RemoveContainer" containerID="2394b3d421f030eb2c67e5ab7d2f4181f2ecd3a72d68a5f3235a13754e378214"
Jul 22 05:01:50.311522 ip-10-0-141-238 kubenswrapper[2563]: E0722 05:01:50.311503    2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2394b3d421f030eb2c67e5ab7d2f4181f2ecd3a72d68a5f3235a13754e378214\": container with ID starting with 2394b3d421f030eb2c67e5ab7d2f4181f2ecd3a72d68a5f3235a13754e378214 not found: ID does not exist" containerID="2394b3d421f030eb2c67e5ab7d2f4181f2ecd3a72d68a5f3235a13754e378214"
Jul 22 05:01:50.311591 ip-10-0-141-238 kubenswrapper[2563]: I0722 05:01:50.311534    2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2394b3d421f030eb2c67e5ab7d2f4181f2ecd3a72d68a5f3235a13754e378214"} err="failed to get container status \"2394b3d421f030eb2c67e5ab7d2f4181f2ecd3a72d68a5f3235a13754e378214\": rpc error: code = NotFound desc = could not find container \"2394b3d421f030eb2c67e5ab7d2f4181f2ecd3a72d68a5f3235a13754e378214\": container with ID starting with 2394b3d421f030eb2c67e5ab7d2f4181f2ecd3a72d68a5f3235a13754e378214 not found: ID does not exist"
Jul 22 05:01:50.322427 ip-10-0-141-238 kubenswrapper[2563]: I0722 05:01:50.322408    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-mt-d559fe69/e2e-lifecycle-model-d559fe69-kserve-84fdd7786c-xl2vn"]
Jul 22 05:01:50.328139 ip-10-0-141-238 kubenswrapper[2563]: I0722 05:01:50.328120    2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-mt-d559fe69/e2e-lifecycle-model-d559fe69-kserve-84fdd7786c-xl2vn"]
Jul 22 05:01:51.064865 ip-10-0-141-238 kubenswrapper[2563]: I0722 05:01:51.064831    2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b1bc97b6-d8fc-4aeb-b0af-96951d0fdb02" path="/var/lib/kubelet/pods/b1bc97b6-d8fc-4aeb-b0af-96951d0fdb02/volumes"
Jul 22 05:02:10.866029 ip-10-0-141-238 kubenswrapper[2563]: I0722 05:02:10.865953    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j9gvx_b4af3ae5-fa65-4358-8399-6ed11b68616e/konnectivity-agent/0.log" limit=1024
Jul 22 05:02:11.110527 ip-10-0-141-238 kubenswrapper[2563]: I0722 05:02:11.110494    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j9gvx_b4af3ae5-fa65-4358-8399-6ed11b68616e/konnectivity-agent/0.log" limit=1024
Jul 22 05:02:16.584573 ip-10-0-141-238 kubenswrapper[2563]: I0722 05:02:16.584538    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j9gvx_b4af3ae5-fa65-4358-8399-6ed11b68616e/konnectivity-agent/0.log" limit=1024
Jul 22 05:02:24.920541 ip-10-0-141-238 kubenswrapper[2563]: I0722 05:02:24.920502    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j9gvx_b4af3ae5-fa65-4358-8399-6ed11b68616e/konnectivity-agent/0.log" limit=1024
Jul 22 05:02:30.678373 ip-10-0-141-238 kubenswrapper[2563]: I0722 05:02:30.678336    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j9gvx_b4af3ae5-fa65-4358-8399-6ed11b68616e/konnectivity-agent/0.log" limit=1024
Jul 22 05:02:30.749420 ip-10-0-141-238 kubenswrapper[2563]: I0722 05:02:30.749383    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j9gvx_b4af3ae5-fa65-4358-8399-6ed11b68616e/konnectivity-agent/0.log" limit=1024
Jul 22 05:02:30.991160 ip-10-0-141-238 kubenswrapper[2563]: I0722 05:02:30.991066    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j9gvx_b4af3ae5-fa65-4358-8399-6ed11b68616e/konnectivity-agent/0.log" limit=1024
Jul 22 05:02:31.201912 ip-10-0-141-238 kubenswrapper[2563]: I0722 05:02:31.201870    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j9gvx_b4af3ae5-fa65-4358-8399-6ed11b68616e/konnectivity-agent/0.log" limit=1024
Jul 22 05:02:32.260787 ip-10-0-141-238 kubenswrapper[2563]: I0722 05:02:32.260735    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j9gvx_b4af3ae5-fa65-4358-8399-6ed11b68616e/konnectivity-agent/0.log" limit=1024
Jul 22 05:02:32.359014 ip-10-0-141-238 kubenswrapper[2563]: I0722 05:02:32.358979    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j9gvx_b4af3ae5-fa65-4358-8399-6ed11b68616e/konnectivity-agent/0.log" limit=1024
Jul 22 05:02:32.459665 ip-10-0-141-238 kubenswrapper[2563]: I0722 05:02:32.459631    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j9gvx_b4af3ae5-fa65-4358-8399-6ed11b68616e/konnectivity-agent/0.log" limit=1024
Jul 22 05:02:33.151813 ip-10-0-141-238 kubenswrapper[2563]: I0722 05:02:33.151771    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j9gvx_b4af3ae5-fa65-4358-8399-6ed11b68616e/konnectivity-agent/0.log" limit=1024
Jul 22 05:02:33.255530 ip-10-0-141-238 kubenswrapper[2563]: I0722 05:02:33.255498    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j9gvx_b4af3ae5-fa65-4358-8399-6ed11b68616e/konnectivity-agent/0.log" limit=1024
Jul 22 05:02:33.352802 ip-10-0-141-238 kubenswrapper[2563]: I0722 05:02:33.352768    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j9gvx_b4af3ae5-fa65-4358-8399-6ed11b68616e/konnectivity-agent/0.log" limit=1024
Jul 22 05:02:34.711675 ip-10-0-141-238 kubenswrapper[2563]: I0722 05:02:34.711642    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j9gvx_b4af3ae5-fa65-4358-8399-6ed11b68616e/konnectivity-agent/0.log" limit=1024
Jul 22 05:02:35.039332 ip-10-0-141-238 kubenswrapper[2563]: I0722 05:02:35.039245    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-wsdd9"]
Jul 22 05:02:38.205893 ip-10-0-141-238 kubenswrapper[2563]: I0722 05:02:38.205858    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j9gvx_b4af3ae5-fa65-4358-8399-6ed11b68616e/konnectivity-agent/0.log" limit=1024
Jul 22 05:02:38.305499 ip-10-0-141-238 kubenswrapper[2563]: I0722 05:02:38.305445    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j9gvx_b4af3ae5-fa65-4358-8399-6ed11b68616e/konnectivity-agent/0.log" limit=1024
Jul 22 05:02:40.440841 ip-10-0-141-238 kubenswrapper[2563]: I0722 05:02:40.440799    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j9gvx_b4af3ae5-fa65-4358-8399-6ed11b68616e/konnectivity-agent/0.log" limit=1024
Jul 22 05:02:40.540808 ip-10-0-141-238 kubenswrapper[2563]: I0722 05:02:40.540772    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j9gvx_b4af3ae5-fa65-4358-8399-6ed11b68616e/konnectivity-agent/0.log" limit=1024
Jul 22 05:02:41.076375 ip-10-0-141-238 kubenswrapper[2563]: I0722 05:02:41.076346    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j9gvx_b4af3ae5-fa65-4358-8399-6ed11b68616e/konnectivity-agent/0.log" limit=1024
Jul 22 05:02:47.051823 ip-10-0-141-238 kubenswrapper[2563]: I0722 05:02:47.051740    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j9gvx_b4af3ae5-fa65-4358-8399-6ed11b68616e/konnectivity-agent/0.log" limit=1024
Jul 22 05:02:47.125550 ip-10-0-141-238 kubenswrapper[2563]: I0722 05:02:47.125517    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j9gvx_b4af3ae5-fa65-4358-8399-6ed11b68616e/konnectivity-agent/0.log" limit=1024
Jul 22 05:02:47.208183 ip-10-0-141-238 kubenswrapper[2563]: I0722 05:02:47.208153    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j9gvx_b4af3ae5-fa65-4358-8399-6ed11b68616e/konnectivity-agent/0.log" limit=1024
Jul 22 05:02:47.486839 ip-10-0-141-238 kubenswrapper[2563]: I0722 05:02:47.486809    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-wsdd9"]
Jul 22 05:02:47.587335 ip-10-0-141-238 kubenswrapper[2563]: I0722 05:02:47.587303    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j9gvx_b4af3ae5-fa65-4358-8399-6ed11b68616e/konnectivity-agent/0.log" limit=1024
Jul 22 05:02:57.741662 ip-10-0-141-238 kubenswrapper[2563]: I0722 05:02:57.741629    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j9gvx_b4af3ae5-fa65-4358-8399-6ed11b68616e/konnectivity-agent/0.log" limit=1024
Jul 22 05:02:58.066794 ip-10-0-141-238 kubenswrapper[2563]: I0722 05:02:58.066685    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j9gvx_b4af3ae5-fa65-4358-8399-6ed11b68616e/konnectivity-agent/0.log" limit=1024
Jul 22 05:03:18.998557 ip-10-0-141-238 kubenswrapper[2563]: I0722 05:03:18.998488    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j9gvx_b4af3ae5-fa65-4358-8399-6ed11b68616e/konnectivity-agent/0.log" limit=1024
Jul 22 05:03:25.302992 ip-10-0-141-238 kubenswrapper[2563]: I0722 05:03:25.302960    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j9gvx_b4af3ae5-fa65-4358-8399-6ed11b68616e/konnectivity-agent/0.log" limit=1024
Jul 22 05:03:25.403111 ip-10-0-141-238 kubenswrapper[2563]: I0722 05:03:25.403080    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j9gvx_b4af3ae5-fa65-4358-8399-6ed11b68616e/konnectivity-agent/0.log" limit=1024
Jul 22 05:03:25.749368 ip-10-0-141-238 kubenswrapper[2563]: I0722 05:03:25.749335    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j9gvx_b4af3ae5-fa65-4358-8399-6ed11b68616e/konnectivity-agent/0.log" limit=1024
Jul 22 05:03:25.976854 ip-10-0-141-238 kubenswrapper[2563]: I0722 05:03:25.976825    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j9gvx_b4af3ae5-fa65-4358-8399-6ed11b68616e/konnectivity-agent/0.log" limit=1024
Jul 22 05:03:26.214940 ip-10-0-141-238 kubenswrapper[2563]: I0722 05:03:26.214901    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j9gvx_b4af3ae5-fa65-4358-8399-6ed11b68616e/konnectivity-agent/0.log" limit=1024
Jul 22 05:03:29.360684 ip-10-0-141-238 kubenswrapper[2563]: I0722 05:03:29.360621    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j9gvx_b4af3ae5-fa65-4358-8399-6ed11b68616e/konnectivity-agent/0.log" limit=1024
Jul 22 05:03:29.441372 ip-10-0-141-238 kubenswrapper[2563]: I0722 05:03:29.441341    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j9gvx_b4af3ae5-fa65-4358-8399-6ed11b68616e/konnectivity-agent/0.log" limit=1024
Jul 22 05:03:29.504926 ip-10-0-141-238 kubenswrapper[2563]: I0722 05:03:29.504883    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j9gvx_b4af3ae5-fa65-4358-8399-6ed11b68616e/konnectivity-agent/0.log" limit=1024
Jul 22 05:03:29.687828 ip-10-0-141-238 kubenswrapper[2563]: I0722 05:03:29.687789    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j9gvx_b4af3ae5-fa65-4358-8399-6ed11b68616e/konnectivity-agent/0.log" limit=1024
Jul 22 05:03:29.940568 ip-10-0-141-238 kubenswrapper[2563]: I0722 05:03:29.940479    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j9gvx_b4af3ae5-fa65-4358-8399-6ed11b68616e/konnectivity-agent/0.log" limit=1024
Jul 22 05:03:30.040981 ip-10-0-141-238 kubenswrapper[2563]: I0722 05:03:30.040945    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j9gvx_b4af3ae5-fa65-4358-8399-6ed11b68616e/konnectivity-agent/0.log" limit=1024
Jul 22 05:03:33.818794 ip-10-0-141-238 kubenswrapper[2563]: I0722 05:03:33.818765    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j9gvx_b4af3ae5-fa65-4358-8399-6ed11b68616e/konnectivity-agent/0.log" limit=1024
Jul 22 05:03:34.131454 ip-10-0-141-238 kubenswrapper[2563]: I0722 05:03:34.131372    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j9gvx_b4af3ae5-fa65-4358-8399-6ed11b68616e/konnectivity-agent/0.log" limit=1024
Jul 22 05:03:34.399300 ip-10-0-141-238 kubenswrapper[2563]: I0722 05:03:34.399223    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-inf-b-33bb6b-openshift-default-68d6d98b7f-zpv6j"]
Jul 22 05:03:34.399653 ip-10-0-141-238 kubenswrapper[2563]: I0722 05:03:34.399635    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b1bc97b6-d8fc-4aeb-b0af-96951d0fdb02" containerName="main"
Jul 22 05:03:34.399749 ip-10-0-141-238 kubenswrapper[2563]: I0722 05:03:34.399656    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="b1bc97b6-d8fc-4aeb-b0af-96951d0fdb02" containerName="main"
Jul 22 05:03:34.399749 ip-10-0-141-238 kubenswrapper[2563]: I0722 05:03:34.399743    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="b1bc97b6-d8fc-4aeb-b0af-96951d0fdb02" containerName="main"
Jul 22 05:03:34.402950 ip-10-0-141-238 kubenswrapper[2563]: I0722 05:03:34.402929    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-33bb6b-openshift-default-68d6d98b7f-zpv6j"
Jul 22 05:03:34.405251 ip-10-0-141-238 kubenswrapper[2563]: I0722 05:03:34.405231    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-inf-b-33bb6b-openshift-default-dockercfg-c4tgv\""
Jul 22 05:03:34.415388 ip-10-0-141-238 kubenswrapper[2563]: I0722 05:03:34.415360    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-b-33bb6b-openshift-default-68d6d98b7f-zpv6j"]
Jul 22 05:03:34.432132 ip-10-0-141-238 kubenswrapper[2563]: I0722 05:03:34.432109    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j9gvx_b4af3ae5-fa65-4358-8399-6ed11b68616e/konnectivity-agent/0.log" limit=1024
Jul 22 05:03:34.493384 ip-10-0-141-238 kubenswrapper[2563]: I0722 05:03:34.493352    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j9gvx_b4af3ae5-fa65-4358-8399-6ed11b68616e/konnectivity-agent/0.log" limit=1024
Jul 22 05:03:34.555530 ip-10-0-141-238 kubenswrapper[2563]: I0722 05:03:34.555488    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/32bea398-c3f5-4d3b-86a0-85a016f7fbfe-istio-token\") pod \"e2e-inf-b-33bb6b-openshift-default-68d6d98b7f-zpv6j\" (UID: \"32bea398-c3f5-4d3b-86a0-85a016f7fbfe\") " pod="openshift-ingress/e2e-inf-b-33bb6b-openshift-default-68d6d98b7f-zpv6j"
Jul 22 05:03:34.555698 ip-10-0-141-238 kubenswrapper[2563]: I0722 05:03:34.555539    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4bp6l\" (UniqueName: \"kubernetes.io/projected/32bea398-c3f5-4d3b-86a0-85a016f7fbfe-kube-api-access-4bp6l\") pod \"e2e-inf-b-33bb6b-openshift-default-68d6d98b7f-zpv6j\" (UID: \"32bea398-c3f5-4d3b-86a0-85a016f7fbfe\") " pod="openshift-ingress/e2e-inf-b-33bb6b-openshift-default-68d6d98b7f-zpv6j"
Jul 22 05:03:34.555698 ip-10-0-141-238 kubenswrapper[2563]: I0722 05:03:34.555566    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/32bea398-c3f5-4d3b-86a0-85a016f7fbfe-istiod-ca-cert\") pod \"e2e-inf-b-33bb6b-openshift-default-68d6d98b7f-zpv6j\" (UID: \"32bea398-c3f5-4d3b-86a0-85a016f7fbfe\") " pod="openshift-ingress/e2e-inf-b-33bb6b-openshift-default-68d6d98b7f-zpv6j"
Jul 22 05:03:34.555698 ip-10-0-141-238 kubenswrapper[2563]: I0722 05:03:34.555593    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/32bea398-c3f5-4d3b-86a0-85a016f7fbfe-istio-podinfo\") pod \"e2e-inf-b-33bb6b-openshift-default-68d6d98b7f-zpv6j\" (UID: \"32bea398-c3f5-4d3b-86a0-85a016f7fbfe\") " pod="openshift-ingress/e2e-inf-b-33bb6b-openshift-default-68d6d98b7f-zpv6j"
Jul 22 05:03:34.555698 ip-10-0-141-238 kubenswrapper[2563]: I0722 05:03:34.555676    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/32bea398-c3f5-4d3b-86a0-85a016f7fbfe-istio-data\") pod \"e2e-inf-b-33bb6b-openshift-default-68d6d98b7f-zpv6j\" (UID: \"32bea398-c3f5-4d3b-86a0-85a016f7fbfe\") " pod="openshift-ingress/e2e-inf-b-33bb6b-openshift-default-68d6d98b7f-zpv6j"
Jul 22 05:03:34.555857 ip-10-0-141-238 kubenswrapper[2563]: I0722 05:03:34.555764    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/32bea398-c3f5-4d3b-86a0-85a016f7fbfe-workload-socket\") pod \"e2e-inf-b-33bb6b-openshift-default-68d6d98b7f-zpv6j\" (UID: \"32bea398-c3f5-4d3b-86a0-85a016f7fbfe\") " pod="openshift-ingress/e2e-inf-b-33bb6b-openshift-default-68d6d98b7f-zpv6j"
Jul 22 05:03:34.555857 ip-10-0-141-238 kubenswrapper[2563]: I0722 05:03:34.555798    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/32bea398-c3f5-4d3b-86a0-85a016f7fbfe-credential-socket\") pod \"e2e-inf-b-33bb6b-openshift-default-68d6d98b7f-zpv6j\" (UID: \"32bea398-c3f5-4d3b-86a0-85a016f7fbfe\") " pod="openshift-ingress/e2e-inf-b-33bb6b-openshift-default-68d6d98b7f-zpv6j"
Jul 22 05:03:34.555857 ip-10-0-141-238 kubenswrapper[2563]: I0722 05:03:34.555832    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/32bea398-c3f5-4d3b-86a0-85a016f7fbfe-workload-certs\") pod \"e2e-inf-b-33bb6b-openshift-default-68d6d98b7f-zpv6j\" (UID: \"32bea398-c3f5-4d3b-86a0-85a016f7fbfe\") " pod="openshift-ingress/e2e-inf-b-33bb6b-openshift-default-68d6d98b7f-zpv6j"
Jul 22 05:03:34.555960 ip-10-0-141-238 kubenswrapper[2563]: I0722 05:03:34.555856    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/32bea398-c3f5-4d3b-86a0-85a016f7fbfe-istio-envoy\") pod \"e2e-inf-b-33bb6b-openshift-default-68d6d98b7f-zpv6j\" (UID: \"32bea398-c3f5-4d3b-86a0-85a016f7fbfe\") " pod="openshift-ingress/e2e-inf-b-33bb6b-openshift-default-68d6d98b7f-zpv6j"
Jul 22 05:03:34.656634 ip-10-0-141-238 kubenswrapper[2563]: I0722 05:03:34.656604    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/32bea398-c3f5-4d3b-86a0-85a016f7fbfe-istio-podinfo\") pod \"e2e-inf-b-33bb6b-openshift-default-68d6d98b7f-zpv6j\" (UID: \"32bea398-c3f5-4d3b-86a0-85a016f7fbfe\") " pod="openshift-ingress/e2e-inf-b-33bb6b-openshift-default-68d6d98b7f-zpv6j"
Jul 22 05:03:34.656809 ip-10-0-141-238 kubenswrapper[2563]: I0722 05:03:34.656657    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/32bea398-c3f5-4d3b-86a0-85a016f7fbfe-istio-data\") pod \"e2e-inf-b-33bb6b-openshift-default-68d6d98b7f-zpv6j\" (UID: \"32bea398-c3f5-4d3b-86a0-85a016f7fbfe\") " pod="openshift-ingress/e2e-inf-b-33bb6b-openshift-default-68d6d98b7f-zpv6j"
Jul 22 05:03:34.656809 ip-10-0-141-238 kubenswrapper[2563]: I0722 05:03:34.656699    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/32bea398-c3f5-4d3b-86a0-85a016f7fbfe-workload-socket\") pod \"e2e-inf-b-33bb6b-openshift-default-68d6d98b7f-zpv6j\" (UID: \"32bea398-c3f5-4d3b-86a0-85a016f7fbfe\") " pod="openshift-ingress/e2e-inf-b-33bb6b-openshift-default-68d6d98b7f-zpv6j"
Jul 22 05:03:34.656809 ip-10-0-141-238 kubenswrapper[2563]: I0722 05:03:34.656720    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/32bea398-c3f5-4d3b-86a0-85a016f7fbfe-credential-socket\") pod \"e2e-inf-b-33bb6b-openshift-default-68d6d98b7f-zpv6j\" (UID: \"32bea398-c3f5-4d3b-86a0-85a016f7fbfe\") " pod="openshift-ingress/e2e-inf-b-33bb6b-openshift-default-68d6d98b7f-zpv6j"
Jul 22 05:03:34.656809 ip-10-0-141-238 kubenswrapper[2563]: I0722 05:03:34.656745    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/32bea398-c3f5-4d3b-86a0-85a016f7fbfe-workload-certs\") pod \"e2e-inf-b-33bb6b-openshift-default-68d6d98b7f-zpv6j\" (UID: \"32bea398-c3f5-4d3b-86a0-85a016f7fbfe\") " pod="openshift-ingress/e2e-inf-b-33bb6b-openshift-default-68d6d98b7f-zpv6j"
Jul 22 05:03:34.657014 ip-10-0-141-238 kubenswrapper[2563]: I0722 05:03:34.656821    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/32bea398-c3f5-4d3b-86a0-85a016f7fbfe-istio-envoy\") pod \"e2e-inf-b-33bb6b-openshift-default-68d6d98b7f-zpv6j\" (UID: \"32bea398-c3f5-4d3b-86a0-85a016f7fbfe\") " pod="openshift-ingress/e2e-inf-b-33bb6b-openshift-default-68d6d98b7f-zpv6j"
Jul 22 05:03:34.657014 ip-10-0-141-238 kubenswrapper[2563]: I0722 05:03:34.656928    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/32bea398-c3f5-4d3b-86a0-85a016f7fbfe-istio-token\") pod \"e2e-inf-b-33bb6b-openshift-default-68d6d98b7f-zpv6j\" (UID: \"32bea398-c3f5-4d3b-86a0-85a016f7fbfe\") " pod="openshift-ingress/e2e-inf-b-33bb6b-openshift-default-68d6d98b7f-zpv6j"
Jul 22 05:03:34.657014 ip-10-0-141-238 kubenswrapper[2563]: I0722 05:03:34.656956    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4bp6l\" (UniqueName: \"kubernetes.io/projected/32bea398-c3f5-4d3b-86a0-85a016f7fbfe-kube-api-access-4bp6l\") pod \"e2e-inf-b-33bb6b-openshift-default-68d6d98b7f-zpv6j\" (UID: \"32bea398-c3f5-4d3b-86a0-85a016f7fbfe\") " pod="openshift-ingress/e2e-inf-b-33bb6b-openshift-default-68d6d98b7f-zpv6j"
Jul 22 05:03:34.657014 ip-10-0-141-238 kubenswrapper[2563]: I0722 05:03:34.656981    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/32bea398-c3f5-4d3b-86a0-85a016f7fbfe-istiod-ca-cert\") pod \"e2e-inf-b-33bb6b-openshift-default-68d6d98b7f-zpv6j\" (UID: \"32bea398-c3f5-4d3b-86a0-85a016f7fbfe\") " pod="openshift-ingress/e2e-inf-b-33bb6b-openshift-default-68d6d98b7f-zpv6j"
Jul 22 05:03:34.657265 ip-10-0-141-238 kubenswrapper[2563]: I0722 05:03:34.657191    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/32bea398-c3f5-4d3b-86a0-85a016f7fbfe-credential-socket\") pod \"e2e-inf-b-33bb6b-openshift-default-68d6d98b7f-zpv6j\" (UID: \"32bea398-c3f5-4d3b-86a0-85a016f7fbfe\") " pod="openshift-ingress/e2e-inf-b-33bb6b-openshift-default-68d6d98b7f-zpv6j"
Jul 22 05:03:34.657265 ip-10-0-141-238 kubenswrapper[2563]: I0722 05:03:34.657224    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/32bea398-c3f5-4d3b-86a0-85a016f7fbfe-istio-data\") pod \"e2e-inf-b-33bb6b-openshift-default-68d6d98b7f-zpv6j\" (UID: \"32bea398-c3f5-4d3b-86a0-85a016f7fbfe\") " pod="openshift-ingress/e2e-inf-b-33bb6b-openshift-default-68d6d98b7f-zpv6j"
Jul 22 05:03:34.657359 ip-10-0-141-238 kubenswrapper[2563]: I0722 05:03:34.657265    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/32bea398-c3f5-4d3b-86a0-85a016f7fbfe-workload-certs\") pod \"e2e-inf-b-33bb6b-openshift-default-68d6d98b7f-zpv6j\" (UID: \"32bea398-c3f5-4d3b-86a0-85a016f7fbfe\") " pod="openshift-ingress/e2e-inf-b-33bb6b-openshift-default-68d6d98b7f-zpv6j"
Jul 22 05:03:34.657359 ip-10-0-141-238 kubenswrapper[2563]: I0722 05:03:34.657295    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/32bea398-c3f5-4d3b-86a0-85a016f7fbfe-workload-socket\") pod \"e2e-inf-b-33bb6b-openshift-default-68d6d98b7f-zpv6j\" (UID: \"32bea398-c3f5-4d3b-86a0-85a016f7fbfe\") " pod="openshift-ingress/e2e-inf-b-33bb6b-openshift-default-68d6d98b7f-zpv6j"
Jul 22 05:03:34.657861 ip-10-0-141-238 kubenswrapper[2563]: I0722 05:03:34.657838    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/32bea398-c3f5-4d3b-86a0-85a016f7fbfe-istiod-ca-cert\") pod \"e2e-inf-b-33bb6b-openshift-default-68d6d98b7f-zpv6j\" (UID: \"32bea398-c3f5-4d3b-86a0-85a016f7fbfe\") " pod="openshift-ingress/e2e-inf-b-33bb6b-openshift-default-68d6d98b7f-zpv6j"
Jul 22 05:03:34.659617 ip-10-0-141-238 kubenswrapper[2563]: I0722 05:03:34.659594    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/32bea398-c3f5-4d3b-86a0-85a016f7fbfe-istio-podinfo\") pod \"e2e-inf-b-33bb6b-openshift-default-68d6d98b7f-zpv6j\" (UID: \"32bea398-c3f5-4d3b-86a0-85a016f7fbfe\") " pod="openshift-ingress/e2e-inf-b-33bb6b-openshift-default-68d6d98b7f-zpv6j"
Jul 22 05:03:34.659924 ip-10-0-141-238 kubenswrapper[2563]: I0722 05:03:34.659907    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/32bea398-c3f5-4d3b-86a0-85a016f7fbfe-istio-envoy\") pod \"e2e-inf-b-33bb6b-openshift-default-68d6d98b7f-zpv6j\" (UID: \"32bea398-c3f5-4d3b-86a0-85a016f7fbfe\") " pod="openshift-ingress/e2e-inf-b-33bb6b-openshift-default-68d6d98b7f-zpv6j"
Jul 22 05:03:34.664616 ip-10-0-141-238 kubenswrapper[2563]: I0722 05:03:34.664589    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/32bea398-c3f5-4d3b-86a0-85a016f7fbfe-istio-token\") pod \"e2e-inf-b-33bb6b-openshift-default-68d6d98b7f-zpv6j\" (UID: \"32bea398-c3f5-4d3b-86a0-85a016f7fbfe\") " pod="openshift-ingress/e2e-inf-b-33bb6b-openshift-default-68d6d98b7f-zpv6j"
Jul 22 05:03:34.664712 ip-10-0-141-238 kubenswrapper[2563]: I0722 05:03:34.664627    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4bp6l\" (UniqueName: \"kubernetes.io/projected/32bea398-c3f5-4d3b-86a0-85a016f7fbfe-kube-api-access-4bp6l\") pod \"e2e-inf-b-33bb6b-openshift-default-68d6d98b7f-zpv6j\" (UID: \"32bea398-c3f5-4d3b-86a0-85a016f7fbfe\") " pod="openshift-ingress/e2e-inf-b-33bb6b-openshift-default-68d6d98b7f-zpv6j"
Jul 22 05:03:34.716730 ip-10-0-141-238 kubenswrapper[2563]: I0722 05:03:34.716709    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-33bb6b-openshift-default-68d6d98b7f-zpv6j"
Jul 22 05:03:34.853627 ip-10-0-141-238 kubenswrapper[2563]: I0722 05:03:34.853440    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-b-33bb6b-openshift-default-68d6d98b7f-zpv6j"]
Jul 22 05:03:34.856417 ip-10-0-141-238 kubenswrapper[2563]: W0722 05:03:34.856387    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod32bea398_c3f5_4d3b_86a0_85a016f7fbfe.slice/crio-4274377b562edb1c1e23620b94ff6f35ede2ff1766105acb28e1d0e8d68c0d2b WatchSource:0}: Error finding container 4274377b562edb1c1e23620b94ff6f35ede2ff1766105acb28e1d0e8d68c0d2b: Status 404 returned error can't find the container with id 4274377b562edb1c1e23620b94ff6f35ede2ff1766105acb28e1d0e8d68c0d2b
Jul 22 05:03:34.858323 ip-10-0-141-238 kubenswrapper[2563]: I0722 05:03:34.858292    2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 22 05:03:34.858385 ip-10-0-141-238 kubenswrapper[2563]: I0722 05:03:34.858356    2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 22 05:03:34.858427 ip-10-0-141-238 kubenswrapper[2563]: I0722 05:03:34.858402    2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 22 05:03:35.469390 ip-10-0-141-238 kubenswrapper[2563]: I0722 05:03:35.469360    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-wsdd9"]
Jul 22 05:03:35.779082 ip-10-0-141-238 kubenswrapper[2563]: I0722 05:03:35.778983    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-33bb6b-openshift-default-68d6d98b7f-zpv6j" event={"ID":"32bea398-c3f5-4d3b-86a0-85a016f7fbfe","Type":"ContainerStarted","Data":"65cf5d9c62f2fad61096418bb5952e590657cd8a086a151d98c7a31715e41872"}
Jul 22 05:03:35.779082 ip-10-0-141-238 kubenswrapper[2563]: I0722 05:03:35.779068    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-33bb6b-openshift-default-68d6d98b7f-zpv6j" event={"ID":"32bea398-c3f5-4d3b-86a0-85a016f7fbfe","Type":"ContainerStarted","Data":"4274377b562edb1c1e23620b94ff6f35ede2ff1766105acb28e1d0e8d68c0d2b"}
Jul 22 05:03:35.802901 ip-10-0-141-238 kubenswrapper[2563]: I0722 05:03:35.802855    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-inf-b-33bb6b-openshift-default-68d6d98b7f-zpv6j" podStartSLOduration=1.80283937 podStartE2EDuration="1.80283937s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 05:03:34 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 05:03:35.801618016 +0000 UTC m=+2331.220626807" watchObservedRunningTime="2026-07-22 05:03:35.80283937 +0000 UTC m=+2331.221848120"
Jul 22 05:03:36.717619 ip-10-0-141-238 kubenswrapper[2563]: I0722 05:03:36.717585    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-b-33bb6b-openshift-default-68d6d98b7f-zpv6j"
Jul 22 05:03:36.722376 ip-10-0-141-238 kubenswrapper[2563]: I0722 05:03:36.722351    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-b-33bb6b-openshift-default-68d6d98b7f-zpv6j"
Jul 22 05:03:36.783807 ip-10-0-141-238 kubenswrapper[2563]: I0722 05:03:36.783781    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-b-33bb6b-openshift-default-68d6d98b7f-zpv6j"
Jul 22 05:03:36.784682 ip-10-0-141-238 kubenswrapper[2563]: I0722 05:03:36.784661    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-b-33bb6b-openshift-default-68d6d98b7f-zpv6j"
Jul 22 05:03:37.704451 ip-10-0-141-238 kubenswrapper[2563]: I0722 05:03:37.704366    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j9gvx_b4af3ae5-fa65-4358-8399-6ed11b68616e/konnectivity-agent/0.log" limit=1024
Jul 22 05:03:37.803508 ip-10-0-141-238 kubenswrapper[2563]: I0722 05:03:37.803479    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j9gvx_b4af3ae5-fa65-4358-8399-6ed11b68616e/konnectivity-agent/0.log" limit=1024
Jul 22 05:03:37.943321 ip-10-0-141-238 kubenswrapper[2563]: I0722 05:03:37.943293    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j9gvx_b4af3ae5-fa65-4358-8399-6ed11b68616e/konnectivity-agent/0.log" limit=1024
Jul 22 05:03:38.354423 ip-10-0-141-238 kubenswrapper[2563]: I0722 05:03:38.354396    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j9gvx_b4af3ae5-fa65-4358-8399-6ed11b68616e/konnectivity-agent/0.log" limit=1024
Jul 22 05:03:38.535559 ip-10-0-141-238 kubenswrapper[2563]: I0722 05:03:38.535515    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j9gvx_b4af3ae5-fa65-4358-8399-6ed11b68616e/konnectivity-agent/0.log" limit=1024
Jul 22 05:03:38.635747 ip-10-0-141-238 kubenswrapper[2563]: I0722 05:03:38.635664    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j9gvx_b4af3ae5-fa65-4358-8399-6ed11b68616e/konnectivity-agent/0.log" limit=1024
Jul 22 05:03:42.168939 ip-10-0-141-238 kubenswrapper[2563]: I0722 05:03:42.168904    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j9gvx_b4af3ae5-fa65-4358-8399-6ed11b68616e/konnectivity-agent/0.log" limit=1024
Jul 22 05:03:45.164769 ip-10-0-141-238 kubenswrapper[2563]: I0722 05:03:45.164731    2563 scope.go:117] "RemoveContainer" containerID="c2a61f159e618261c8fec44c291d4f01b8dcf80416ef235697a48daaa05fbd58"
Jul 22 05:03:50.685920 ip-10-0-141-238 kubenswrapper[2563]: I0722 05:03:50.685887    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j9gvx_b4af3ae5-fa65-4358-8399-6ed11b68616e/konnectivity-agent/0.log" limit=1024
Jul 22 05:03:50.786886 ip-10-0-141-238 kubenswrapper[2563]: I0722 05:03:50.786849    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j9gvx_b4af3ae5-fa65-4358-8399-6ed11b68616e/konnectivity-agent/0.log" limit=1024
Jul 22 05:03:50.848158 ip-10-0-141-238 kubenswrapper[2563]: I0722 05:03:50.848130    2563 generic.go:356] "Generic (PLEG): container finished" podID="32bea398-c3f5-4d3b-86a0-85a016f7fbfe" containerID="65cf5d9c62f2fad61096418bb5952e590657cd8a086a151d98c7a31715e41872" exitCode=0
Jul 22 05:03:50.848334 ip-10-0-141-238 kubenswrapper[2563]: I0722 05:03:50.848182    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-33bb6b-openshift-default-68d6d98b7f-zpv6j" event={"ID":"32bea398-c3f5-4d3b-86a0-85a016f7fbfe","Type":"ContainerDied","Data":"65cf5d9c62f2fad61096418bb5952e590657cd8a086a151d98c7a31715e41872"}
Jul 22 05:03:50.848635 ip-10-0-141-238 kubenswrapper[2563]: I0722 05:03:50.848602    2563 scope.go:117] "RemoveContainer" containerID="65cf5d9c62f2fad61096418bb5952e590657cd8a086a151d98c7a31715e41872"
Jul 22 05:03:50.849726 ip-10-0-141-238 kubenswrapper[2563]: I0722 05:03:50.849691    2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 22 05:03:50.849820 ip-10-0-141-238 kubenswrapper[2563]: I0722 05:03:50.849766    2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 22 05:03:50.849820 ip-10-0-141-238 kubenswrapper[2563]: I0722 05:03:50.849801    2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 22 05:03:51.167852 ip-10-0-141-238 kubenswrapper[2563]: I0722 05:03:51.167822    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-wsdd9"]
Jul 22 05:03:51.784557 ip-10-0-141-238 kubenswrapper[2563]: I0722 05:03:51.784500    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-b-33bb6b-openshift-default-68d6d98b7f-zpv6j"
Jul 22 05:03:51.858073 ip-10-0-141-238 kubenswrapper[2563]: I0722 05:03:51.858010    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-33bb6b-openshift-default-68d6d98b7f-zpv6j" event={"ID":"32bea398-c3f5-4d3b-86a0-85a016f7fbfe","Type":"ContainerStarted","Data":"2ae1cad54fb1f95664eb135bc3c0195a4983ec1e26f816a120c20cde9606091e"}
Jul 22 05:03:52.717454 ip-10-0-141-238 kubenswrapper[2563]: I0722 05:03:52.717417    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-b-33bb6b-openshift-default-68d6d98b7f-zpv6j"
Jul 22 05:03:52.718546 ip-10-0-141-238 kubenswrapper[2563]: I0722 05:03:52.718522    2563 patch_prober.go:28] interesting pod/e2e-inf-b-33bb6b-openshift-default-68d6d98b7f-zpv6j container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.38:15021/healthz/ready\": dial tcp 10.134.0.38:15021: connect: connection refused" start-of-body=
Jul 22 05:03:52.718602 ip-10-0-141-238 kubenswrapper[2563]: I0722 05:03:52.718572    2563 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-33bb6b-openshift-default-68d6d98b7f-zpv6j" podUID="32bea398-c3f5-4d3b-86a0-85a016f7fbfe" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.38:15021/healthz/ready\": dial tcp 10.134.0.38:15021: connect: connection refused"
Jul 22 05:03:53.717194 ip-10-0-141-238 kubenswrapper[2563]: I0722 05:03:53.717155    2563 patch_prober.go:28] interesting pod/e2e-inf-b-33bb6b-openshift-default-68d6d98b7f-zpv6j container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.38:15021/healthz/ready\": dial tcp 10.134.0.38:15021: connect: connection refused" start-of-body=
Jul 22 05:03:53.717620 ip-10-0-141-238 kubenswrapper[2563]: I0722 05:03:53.717210    2563 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-33bb6b-openshift-default-68d6d98b7f-zpv6j" podUID="32bea398-c3f5-4d3b-86a0-85a016f7fbfe" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.38:15021/healthz/ready\": dial tcp 10.134.0.38:15021: connect: connection refused"
Jul 22 05:03:54.717444 ip-10-0-141-238 kubenswrapper[2563]: I0722 05:03:54.717406    2563 patch_prober.go:28] interesting pod/e2e-inf-b-33bb6b-openshift-default-68d6d98b7f-zpv6j container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.38:15021/healthz/ready\": dial tcp 10.134.0.38:15021: connect: connection refused" start-of-body=
Jul 22 05:03:54.717852 ip-10-0-141-238 kubenswrapper[2563]: I0722 05:03:54.717464    2563 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-33bb6b-openshift-default-68d6d98b7f-zpv6j" podUID="32bea398-c3f5-4d3b-86a0-85a016f7fbfe" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.38:15021/healthz/ready\": dial tcp 10.134.0.38:15021: connect: connection refused"
Jul 22 05:03:55.717972 ip-10-0-141-238 kubenswrapper[2563]: I0722 05:03:55.717939    2563 patch_prober.go:28] interesting pod/e2e-inf-b-33bb6b-openshift-default-68d6d98b7f-zpv6j container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.38:15021/healthz/ready\": dial tcp 10.134.0.38:15021: connect: connection refused" start-of-body=
Jul 22 05:03:55.718377 ip-10-0-141-238 kubenswrapper[2563]: I0722 05:03:55.717991    2563 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-33bb6b-openshift-default-68d6d98b7f-zpv6j" podUID="32bea398-c3f5-4d3b-86a0-85a016f7fbfe" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.38:15021/healthz/ready\": dial tcp 10.134.0.38:15021: connect: connection refused"
Jul 22 05:03:56.177781 ip-10-0-141-238 kubenswrapper[2563]: I0722 05:03:56.177751    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-inf-a-e9e018/test-model-e9e018-kserve-774ff4cddf-h5ppd"]
Jul 22 05:03:56.185368 ip-10-0-141-238 kubenswrapper[2563]: I0722 05:03:56.185327    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-a-e9e018/test-model-e9e018-kserve-774ff4cddf-h5ppd"
Jul 22 05:03:56.189336 ip-10-0-141-238 kubenswrapper[2563]: I0722 05:03:56.189310    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-inf-a-e9e018\"/\"kube-root-ca.crt\""
Jul 22 05:03:56.189509 ip-10-0-141-238 kubenswrapper[2563]: I0722 05:03:56.189310    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-inf-a-e9e018\"/\"test-model-e9e018-kserve-self-signed-certs\""
Jul 22 05:03:56.189509 ip-10-0-141-238 kubenswrapper[2563]: I0722 05:03:56.189454    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-inf-a-e9e018\"/\"default-dockercfg-2hp8p\""
Jul 22 05:03:56.189678 ip-10-0-141-238 kubenswrapper[2563]: I0722 05:03:56.189661    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-inf-a-e9e018\"/\"openshift-service-ca.crt\""
Jul 22 05:03:56.192313 ip-10-0-141-238 kubenswrapper[2563]: I0722 05:03:56.192289    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-inf-a-e9e018/test-model-e9e018-kserve-774ff4cddf-h5ppd"]
Jul 22 05:03:56.208802 ip-10-0-141-238 kubenswrapper[2563]: I0722 05:03:56.208779    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j9gvx_b4af3ae5-fa65-4358-8399-6ed11b68616e/konnectivity-agent/0.log" limit=1024
Jul 22 05:03:56.252769 ip-10-0-141-238 kubenswrapper[2563]: I0722 05:03:56.252738    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/ac2b13ef-2c4f-43b4-bd4e-d5ea28d4aeef-model-cache\") pod \"test-model-e9e018-kserve-774ff4cddf-h5ppd\" (UID: \"ac2b13ef-2c4f-43b4-bd4e-d5ea28d4aeef\") " pod="ai-tenant-e2e-inf-a-e9e018/test-model-e9e018-kserve-774ff4cddf-h5ppd"
Jul 22 05:03:56.252876 ip-10-0-141-238 kubenswrapper[2563]: I0722 05:03:56.252783    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/ac2b13ef-2c4f-43b4-bd4e-d5ea28d4aeef-home\") pod \"test-model-e9e018-kserve-774ff4cddf-h5ppd\" (UID: \"ac2b13ef-2c4f-43b4-bd4e-d5ea28d4aeef\") " pod="ai-tenant-e2e-inf-a-e9e018/test-model-e9e018-kserve-774ff4cddf-h5ppd"
Jul 22 05:03:56.252876 ip-10-0-141-238 kubenswrapper[2563]: I0722 05:03:56.252835    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/ac2b13ef-2c4f-43b4-bd4e-d5ea28d4aeef-dshm\") pod \"test-model-e9e018-kserve-774ff4cddf-h5ppd\" (UID: \"ac2b13ef-2c4f-43b4-bd4e-d5ea28d4aeef\") " pod="ai-tenant-e2e-inf-a-e9e018/test-model-e9e018-kserve-774ff4cddf-h5ppd"
Jul 22 05:03:56.252968 ip-10-0-141-238 kubenswrapper[2563]: I0722 05:03:56.252888    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ac2b13ef-2c4f-43b4-bd4e-d5ea28d4aeef-tmp-dir\") pod \"test-model-e9e018-kserve-774ff4cddf-h5ppd\" (UID: \"ac2b13ef-2c4f-43b4-bd4e-d5ea28d4aeef\") " pod="ai-tenant-e2e-inf-a-e9e018/test-model-e9e018-kserve-774ff4cddf-h5ppd"
Jul 22 05:03:56.252968 ip-10-0-141-238 kubenswrapper[2563]: I0722 05:03:56.252939    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dc65v\" (UniqueName: \"kubernetes.io/projected/ac2b13ef-2c4f-43b4-bd4e-d5ea28d4aeef-kube-api-access-dc65v\") pod \"test-model-e9e018-kserve-774ff4cddf-h5ppd\" (UID: \"ac2b13ef-2c4f-43b4-bd4e-d5ea28d4aeef\") " pod="ai-tenant-e2e-inf-a-e9e018/test-model-e9e018-kserve-774ff4cddf-h5ppd"
Jul 22 05:03:56.252968 ip-10-0-141-238 kubenswrapper[2563]: I0722 05:03:56.252959    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/ac2b13ef-2c4f-43b4-bd4e-d5ea28d4aeef-tls-certs\") pod \"test-model-e9e018-kserve-774ff4cddf-h5ppd\" (UID: \"ac2b13ef-2c4f-43b4-bd4e-d5ea28d4aeef\") " pod="ai-tenant-e2e-inf-a-e9e018/test-model-e9e018-kserve-774ff4cddf-h5ppd"
Jul 22 05:03:56.353886 ip-10-0-141-238 kubenswrapper[2563]: I0722 05:03:56.353854    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ac2b13ef-2c4f-43b4-bd4e-d5ea28d4aeef-tmp-dir\") pod \"test-model-e9e018-kserve-774ff4cddf-h5ppd\" (UID: \"ac2b13ef-2c4f-43b4-bd4e-d5ea28d4aeef\") " pod="ai-tenant-e2e-inf-a-e9e018/test-model-e9e018-kserve-774ff4cddf-h5ppd"
Jul 22 05:03:56.354110 ip-10-0-141-238 kubenswrapper[2563]: I0722 05:03:56.353897    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dc65v\" (UniqueName: \"kubernetes.io/projected/ac2b13ef-2c4f-43b4-bd4e-d5ea28d4aeef-kube-api-access-dc65v\") pod \"test-model-e9e018-kserve-774ff4cddf-h5ppd\" (UID: \"ac2b13ef-2c4f-43b4-bd4e-d5ea28d4aeef\") " pod="ai-tenant-e2e-inf-a-e9e018/test-model-e9e018-kserve-774ff4cddf-h5ppd"
Jul 22 05:03:56.354110 ip-10-0-141-238 kubenswrapper[2563]: I0722 05:03:56.353918    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/ac2b13ef-2c4f-43b4-bd4e-d5ea28d4aeef-tls-certs\") pod \"test-model-e9e018-kserve-774ff4cddf-h5ppd\" (UID: \"ac2b13ef-2c4f-43b4-bd4e-d5ea28d4aeef\") " pod="ai-tenant-e2e-inf-a-e9e018/test-model-e9e018-kserve-774ff4cddf-h5ppd"
Jul 22 05:03:56.354110 ip-10-0-141-238 kubenswrapper[2563]: I0722 05:03:56.353965    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/ac2b13ef-2c4f-43b4-bd4e-d5ea28d4aeef-model-cache\") pod \"test-model-e9e018-kserve-774ff4cddf-h5ppd\" (UID: \"ac2b13ef-2c4f-43b4-bd4e-d5ea28d4aeef\") " pod="ai-tenant-e2e-inf-a-e9e018/test-model-e9e018-kserve-774ff4cddf-h5ppd"
Jul 22 05:03:56.354110 ip-10-0-141-238 kubenswrapper[2563]: I0722 05:03:56.353989    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/ac2b13ef-2c4f-43b4-bd4e-d5ea28d4aeef-home\") pod \"test-model-e9e018-kserve-774ff4cddf-h5ppd\" (UID: \"ac2b13ef-2c4f-43b4-bd4e-d5ea28d4aeef\") " pod="ai-tenant-e2e-inf-a-e9e018/test-model-e9e018-kserve-774ff4cddf-h5ppd"
Jul 22 05:03:56.354110 ip-10-0-141-238 kubenswrapper[2563]: I0722 05:03:56.354010    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/ac2b13ef-2c4f-43b4-bd4e-d5ea28d4aeef-dshm\") pod \"test-model-e9e018-kserve-774ff4cddf-h5ppd\" (UID: \"ac2b13ef-2c4f-43b4-bd4e-d5ea28d4aeef\") " pod="ai-tenant-e2e-inf-a-e9e018/test-model-e9e018-kserve-774ff4cddf-h5ppd"
Jul 22 05:03:56.354358 ip-10-0-141-238 kubenswrapper[2563]: I0722 05:03:56.354285    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ac2b13ef-2c4f-43b4-bd4e-d5ea28d4aeef-tmp-dir\") pod \"test-model-e9e018-kserve-774ff4cddf-h5ppd\" (UID: \"ac2b13ef-2c4f-43b4-bd4e-d5ea28d4aeef\") " pod="ai-tenant-e2e-inf-a-e9e018/test-model-e9e018-kserve-774ff4cddf-h5ppd"
Jul 22 05:03:56.354358 ip-10-0-141-238 kubenswrapper[2563]: I0722 05:03:56.354345    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/ac2b13ef-2c4f-43b4-bd4e-d5ea28d4aeef-model-cache\") pod \"test-model-e9e018-kserve-774ff4cddf-h5ppd\" (UID: \"ac2b13ef-2c4f-43b4-bd4e-d5ea28d4aeef\") " pod="ai-tenant-e2e-inf-a-e9e018/test-model-e9e018-kserve-774ff4cddf-h5ppd"
Jul 22 05:03:56.354424 ip-10-0-141-238 kubenswrapper[2563]: I0722 05:03:56.354400    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/ac2b13ef-2c4f-43b4-bd4e-d5ea28d4aeef-home\") pod \"test-model-e9e018-kserve-774ff4cddf-h5ppd\" (UID: \"ac2b13ef-2c4f-43b4-bd4e-d5ea28d4aeef\") " pod="ai-tenant-e2e-inf-a-e9e018/test-model-e9e018-kserve-774ff4cddf-h5ppd"
Jul 22 05:03:56.356452 ip-10-0-141-238 kubenswrapper[2563]: I0722 05:03:56.356425    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/ac2b13ef-2c4f-43b4-bd4e-d5ea28d4aeef-dshm\") pod \"test-model-e9e018-kserve-774ff4cddf-h5ppd\" (UID: \"ac2b13ef-2c4f-43b4-bd4e-d5ea28d4aeef\") " pod="ai-tenant-e2e-inf-a-e9e018/test-model-e9e018-kserve-774ff4cddf-h5ppd"
Jul 22 05:03:56.356609 ip-10-0-141-238 kubenswrapper[2563]: I0722 05:03:56.356587    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/ac2b13ef-2c4f-43b4-bd4e-d5ea28d4aeef-tls-certs\") pod \"test-model-e9e018-kserve-774ff4cddf-h5ppd\" (UID: \"ac2b13ef-2c4f-43b4-bd4e-d5ea28d4aeef\") " pod="ai-tenant-e2e-inf-a-e9e018/test-model-e9e018-kserve-774ff4cddf-h5ppd"
Jul 22 05:03:56.362177 ip-10-0-141-238 kubenswrapper[2563]: I0722 05:03:56.362154    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dc65v\" (UniqueName: \"kubernetes.io/projected/ac2b13ef-2c4f-43b4-bd4e-d5ea28d4aeef-kube-api-access-dc65v\") pod \"test-model-e9e018-kserve-774ff4cddf-h5ppd\" (UID: \"ac2b13ef-2c4f-43b4-bd4e-d5ea28d4aeef\") " pod="ai-tenant-e2e-inf-a-e9e018/test-model-e9e018-kserve-774ff4cddf-h5ppd"
Jul 22 05:03:56.497273 ip-10-0-141-238 kubenswrapper[2563]: I0722 05:03:56.497185    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-a-e9e018/test-model-e9e018-kserve-774ff4cddf-h5ppd"
Jul 22 05:03:56.623156 ip-10-0-141-238 kubenswrapper[2563]: I0722 05:03:56.623133    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-inf-a-e9e018/test-model-e9e018-kserve-774ff4cddf-h5ppd"]
Jul 22 05:03:56.625131 ip-10-0-141-238 kubenswrapper[2563]: W0722 05:03:56.625100    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podac2b13ef_2c4f_43b4_bd4e_d5ea28d4aeef.slice/crio-86b672ea5ad196bc8228c0b1f89758dfce7016b66e8d865e84039077057b4cd0 WatchSource:0}: Error finding container 86b672ea5ad196bc8228c0b1f89758dfce7016b66e8d865e84039077057b4cd0: Status 404 returned error can't find the container with id 86b672ea5ad196bc8228c0b1f89758dfce7016b66e8d865e84039077057b4cd0
Jul 22 05:03:56.723489 ip-10-0-141-238 kubenswrapper[2563]: I0722 05:03:56.723459    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-b-33bb6b-openshift-default-68d6d98b7f-zpv6j"
Jul 22 05:03:56.723868 ip-10-0-141-238 kubenswrapper[2563]: I0722 05:03:56.723705    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-b-33bb6b-openshift-default-68d6d98b7f-zpv6j"
Jul 22 05:03:56.724288 ip-10-0-141-238 kubenswrapper[2563]: I0722 05:03:56.724274    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-b-33bb6b-openshift-default-68d6d98b7f-zpv6j"
Jul 22 05:03:56.883799 ip-10-0-141-238 kubenswrapper[2563]: I0722 05:03:56.883707    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-a-e9e018/test-model-e9e018-kserve-774ff4cddf-h5ppd" event={"ID":"ac2b13ef-2c4f-43b4-bd4e-d5ea28d4aeef","Type":"ContainerStarted","Data":"e27fc8027922ea2e53b0289a240342b56b20753262529f7d1e30f75169183088"}
Jul 22 05:03:56.883799 ip-10-0-141-238 kubenswrapper[2563]: I0722 05:03:56.883752    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-a-e9e018/test-model-e9e018-kserve-774ff4cddf-h5ppd" event={"ID":"ac2b13ef-2c4f-43b4-bd4e-d5ea28d4aeef","Type":"ContainerStarted","Data":"86b672ea5ad196bc8228c0b1f89758dfce7016b66e8d865e84039077057b4cd0"}
Jul 22 05:03:56.901014 ip-10-0-141-238 kubenswrapper[2563]: I0722 05:03:56.900971    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-inf-a-e9e018/test-model-e9e018-kserve-774ff4cddf-h5ppd" podStartSLOduration=0.90095631 podStartE2EDuration="900.95631ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 05:03:56 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 05:03:56.899836711 +0000 UTC m=+2352.318845493" watchObservedRunningTime="2026-07-22 05:03:56.90095631 +0000 UTC m=+2352.319965101"
Jul 22 05:03:59.251781 ip-10-0-141-238 kubenswrapper[2563]: I0722 05:03:59.251747    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j9gvx_b4af3ae5-fa65-4358-8399-6ed11b68616e/konnectivity-agent/0.log" limit=1024
Jul 22 05:03:59.352554 ip-10-0-141-238 kubenswrapper[2563]: I0722 05:03:59.352518    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j9gvx_b4af3ae5-fa65-4358-8399-6ed11b68616e/konnectivity-agent/0.log" limit=1024
Jul 22 05:03:59.368121 ip-10-0-141-238 kubenswrapper[2563]: I0722 05:03:59.368093    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-wsdd9"]
Jul 22 05:04:06.498276 ip-10-0-141-238 kubenswrapper[2563]: I0722 05:04:06.498243    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-inf-a-e9e018/test-model-e9e018-kserve-774ff4cddf-h5ppd"
Jul 22 05:04:06.498712 ip-10-0-141-238 kubenswrapper[2563]: I0722 05:04:06.498296    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-inf-a-e9e018/test-model-e9e018-kserve-774ff4cddf-h5ppd"
Jul 22 05:04:06.510633 ip-10-0-141-238 kubenswrapper[2563]: I0722 05:04:06.510604    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-inf-a-e9e018/test-model-e9e018-kserve-774ff4cddf-h5ppd"
Jul 22 05:04:06.941027 ip-10-0-141-238 kubenswrapper[2563]: I0722 05:04:06.940999    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-inf-a-e9e018/test-model-e9e018-kserve-774ff4cddf-h5ppd"
Jul 22 05:04:13.669680 ip-10-0-141-238 kubenswrapper[2563]: I0722 05:04:13.669642    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-wsdd9"]
Jul 22 05:04:25.706832 ip-10-0-141-238 kubenswrapper[2563]: I0722 05:04:25.706798    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j9gvx_b4af3ae5-fa65-4358-8399-6ed11b68616e/konnectivity-agent/0.log" limit=1024
Jul 22 05:04:30.068076 ip-10-0-141-238 kubenswrapper[2563]: I0722 05:04:30.068019    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-wsdd9"]
Jul 22 05:04:43.773287 ip-10-0-141-238 kubenswrapper[2563]: I0722 05:04:43.773252    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-wsdd9"]
Jul 22 05:04:45.110535 ip-10-0-141-238 kubenswrapper[2563]: I0722 05:04:45.110502    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-gw4km_67c7210c-7cfa-4865-bce3-777fbb6f3cea/console-operator/1.log"
Jul 22 05:04:45.113946 ip-10-0-141-238 kubenswrapper[2563]: I0722 05:04:45.113922    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-gw4km_67c7210c-7cfa-4865-bce3-777fbb6f3cea/console-operator/1.log"
Jul 22 05:05:11.812434 ip-10-0-141-238 kubenswrapper[2563]: I0722 05:05:11.812345    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-inf-a-e9e018/test-model-e9e018-kserve-774ff4cddf-h5ppd"]
Jul 22 05:05:11.834729 ip-10-0-141-238 kubenswrapper[2563]: I0722 05:05:11.834699    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j9gvx_b4af3ae5-fa65-4358-8399-6ed11b68616e/konnectivity-agent/0.log" limit=1024
Jul 22 05:05:12.905836 ip-10-0-141-238 kubenswrapper[2563]: I0722 05:05:12.905805    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j9gvx_b4af3ae5-fa65-4358-8399-6ed11b68616e/konnectivity-agent/0.log" limit=1024
Jul 22 05:05:13.000395 ip-10-0-141-238 kubenswrapper[2563]: I0722 05:05:13.000358    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-e9e018-srnpz"]
Jul 22 05:05:13.003860 ip-10-0-141-238 kubenswrapper[2563]: I0722 05:05:13.003841    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-e9e018-srnpz"
Jul 22 05:05:13.006198 ip-10-0-141-238 kubenswrapper[2563]: I0722 05:05:13.006180    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-65v9v\""
Jul 22 05:05:13.006285 ip-10-0-141-238 kubenswrapper[2563]: I0722 05:05:13.006181    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 22 05:05:13.009867 ip-10-0-141-238 kubenswrapper[2563]: I0722 05:05:13.009843    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-e9e018-srnpz"]
Jul 22 05:05:13.134097 ip-10-0-141-238 kubenswrapper[2563]: I0722 05:05:13.134030    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/d07dd0ba-3535-4b4a-a4bd-89c3cc4b125f-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-inf-a-e9e018-srnpz\" (UID: \"d07dd0ba-3535-4b4a-a4bd-89c3cc4b125f\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-e9e018-srnpz"
Jul 22 05:05:13.234643 ip-10-0-141-238 kubenswrapper[2563]: I0722 05:05:13.234555    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/d07dd0ba-3535-4b4a-a4bd-89c3cc4b125f-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-inf-a-e9e018-srnpz\" (UID: \"d07dd0ba-3535-4b4a-a4bd-89c3cc4b125f\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-e9e018-srnpz"
Jul 22 05:05:13.235190 ip-10-0-141-238 kubenswrapper[2563]: I0722 05:05:13.235171    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/d07dd0ba-3535-4b4a-a4bd-89c3cc4b125f-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-inf-a-e9e018-srnpz\" (UID: \"d07dd0ba-3535-4b4a-a4bd-89c3cc4b125f\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-e9e018-srnpz"
Jul 22 05:05:13.315917 ip-10-0-141-238 kubenswrapper[2563]: I0722 05:05:13.315883    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-e9e018-srnpz"
Jul 22 05:05:13.446939 ip-10-0-141-238 kubenswrapper[2563]: I0722 05:05:13.446912    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-e9e018-srnpz"]
Jul 22 05:05:13.449544 ip-10-0-141-238 kubenswrapper[2563]: W0722 05:05:13.449512    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd07dd0ba_3535_4b4a_a4bd_89c3cc4b125f.slice/crio-cfa2d93e180d780e009cba73abdf05038964cbc4c05dea71e05f0320b495bf38 WatchSource:0}: Error finding container cfa2d93e180d780e009cba73abdf05038964cbc4c05dea71e05f0320b495bf38: Status 404 returned error can't find the container with id cfa2d93e180d780e009cba73abdf05038964cbc4c05dea71e05f0320b495bf38
Jul 22 05:05:13.590030 ip-10-0-141-238 kubenswrapper[2563]: I0722 05:05:13.589995    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j9gvx_b4af3ae5-fa65-4358-8399-6ed11b68616e/konnectivity-agent/0.log" limit=1024
Jul 22 05:05:13.690131 ip-10-0-141-238 kubenswrapper[2563]: I0722 05:05:13.690099    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j9gvx_b4af3ae5-fa65-4358-8399-6ed11b68616e/konnectivity-agent/0.log" limit=1024
Jul 22 05:05:14.233929 ip-10-0-141-238 kubenswrapper[2563]: I0722 05:05:14.233894    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-e9e018-srnpz" event={"ID":"d07dd0ba-3535-4b4a-a4bd-89c3cc4b125f","Type":"ContainerStarted","Data":"309b5bebde4eed944c07db86a4718d02024d949a68544bca221a9110b21e8b8a"}
Jul 22 05:05:14.234404 ip-10-0-141-238 kubenswrapper[2563]: I0722 05:05:14.233951    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-e9e018-srnpz" event={"ID":"d07dd0ba-3535-4b4a-a4bd-89c3cc4b125f","Type":"ContainerStarted","Data":"cfa2d93e180d780e009cba73abdf05038964cbc4c05dea71e05f0320b495bf38"}
Jul 22 05:05:14.251070 ip-10-0-141-238 kubenswrapper[2563]: I0722 05:05:14.251004    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-e9e018-srnpz" podStartSLOduration=2.250990155 podStartE2EDuration="2.250990155s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 05:05:12 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 05:05:14.248870648 +0000 UTC m=+2429.667879406" watchObservedRunningTime="2026-07-22 05:05:14.250990155 +0000 UTC m=+2429.669998911"
Jul 22 05:05:15.240308 ip-10-0-141-238 kubenswrapper[2563]: I0722 05:05:15.240274    2563 generic.go:356] "Generic (PLEG): container finished" podID="d07dd0ba-3535-4b4a-a4bd-89c3cc4b125f" containerID="309b5bebde4eed944c07db86a4718d02024d949a68544bca221a9110b21e8b8a" exitCode=0
Jul 22 05:05:15.240784 ip-10-0-141-238 kubenswrapper[2563]: I0722 05:05:15.240331    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-e9e018-srnpz" event={"ID":"d07dd0ba-3535-4b4a-a4bd-89c3cc4b125f","Type":"ContainerDied","Data":"309b5bebde4eed944c07db86a4718d02024d949a68544bca221a9110b21e8b8a"}
Jul 22 05:05:16.374434 ip-10-0-141-238 kubenswrapper[2563]: I0722 05:05:16.374408    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-e9e018-srnpz"
Jul 22 05:05:16.463726 ip-10-0-141-238 kubenswrapper[2563]: I0722 05:05:16.463689    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/d07dd0ba-3535-4b4a-a4bd-89c3cc4b125f-maas-api-service-ca\") pod \"d07dd0ba-3535-4b4a-a4bd-89c3cc4b125f\" (UID: \"d07dd0ba-3535-4b4a-a4bd-89c3cc4b125f\") "
Jul 22 05:05:16.463905 ip-10-0-141-238 kubenswrapper[2563]: I0722 05:05:16.463873    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d07dd0ba-3535-4b4a-a4bd-89c3cc4b125f-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "d07dd0ba-3535-4b4a-a4bd-89c3cc4b125f" (UID: "d07dd0ba-3535-4b4a-a4bd-89c3cc4b125f"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 22 05:05:16.463989 ip-10-0-141-238 kubenswrapper[2563]: I0722 05:05:16.463976    2563 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/d07dd0ba-3535-4b4a-a4bd-89c3cc4b125f-maas-api-service-ca\") on node \"ip-10-0-141-238.ec2.internal\" DevicePath \"\""
Jul 22 05:05:16.679713 ip-10-0-141-238 kubenswrapper[2563]: I0722 05:05:16.679678    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-wsdd9"]
Jul 22 05:05:17.250759 ip-10-0-141-238 kubenswrapper[2563]: I0722 05:05:17.250732    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-e9e018-srnpz"
Jul 22 05:05:17.250971 ip-10-0-141-238 kubenswrapper[2563]: I0722 05:05:17.250728    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-e9e018-srnpz" event={"ID":"d07dd0ba-3535-4b4a-a4bd-89c3cc4b125f","Type":"ContainerDied","Data":"cfa2d93e180d780e009cba73abdf05038964cbc4c05dea71e05f0320b495bf38"}
Jul 22 05:05:17.250971 ip-10-0-141-238 kubenswrapper[2563]: I0722 05:05:17.250857    2563 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="cfa2d93e180d780e009cba73abdf05038964cbc4c05dea71e05f0320b495bf38"
Jul 22 05:05:23.433461 ip-10-0-141-238 kubenswrapper[2563]: I0722 05:05:23.433430    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j9gvx_b4af3ae5-fa65-4358-8399-6ed11b68616e/konnectivity-agent/0.log" limit=1024
Jul 22 05:05:26.832797 ip-10-0-141-238 kubenswrapper[2563]: I0722 05:05:26.832726    2563 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-inf-a-e9e018/test-model-e9e018-kserve-774ff4cddf-h5ppd" podUID="ac2b13ef-2c4f-43b4-bd4e-d5ea28d4aeef" containerName="main" containerID="cri-o://e27fc8027922ea2e53b0289a240342b56b20753262529f7d1e30f75169183088" gracePeriod=45
Jul 22 05:05:26.930028 ip-10-0-141-238 kubenswrapper[2563]: I0722 05:05:26.929991    2563 prober.go:120] "Probe failed" probeType="Readiness" pod="ai-tenant-e2e-inf-a-e9e018/test-model-e9e018-kserve-774ff4cddf-h5ppd" podUID="ac2b13ef-2c4f-43b4-bd4e-d5ea28d4aeef" containerName="main" probeResult="failure" output="Get \"https://10.134.0.39:8000/ready\": dial tcp 10.134.0.39:8000: connect: connection refused"
Jul 22 05:05:27.079658 ip-10-0-141-238 kubenswrapper[2563]: I0722 05:05:27.079634    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-a-e9e018/test-model-e9e018-kserve-774ff4cddf-h5ppd"
Jul 22 05:05:27.159794 ip-10-0-141-238 kubenswrapper[2563]: I0722 05:05:27.159766    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/ac2b13ef-2c4f-43b4-bd4e-d5ea28d4aeef-home\") pod \"ac2b13ef-2c4f-43b4-bd4e-d5ea28d4aeef\" (UID: \"ac2b13ef-2c4f-43b4-bd4e-d5ea28d4aeef\") "
Jul 22 05:05:27.159794 ip-10-0-141-238 kubenswrapper[2563]: I0722 05:05:27.159795    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/ac2b13ef-2c4f-43b4-bd4e-d5ea28d4aeef-dshm\") pod \"ac2b13ef-2c4f-43b4-bd4e-d5ea28d4aeef\" (UID: \"ac2b13ef-2c4f-43b4-bd4e-d5ea28d4aeef\") "
Jul 22 05:05:27.160006 ip-10-0-141-238 kubenswrapper[2563]: I0722 05:05:27.159861    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/ac2b13ef-2c4f-43b4-bd4e-d5ea28d4aeef-tls-certs\") pod \"ac2b13ef-2c4f-43b4-bd4e-d5ea28d4aeef\" (UID: \"ac2b13ef-2c4f-43b4-bd4e-d5ea28d4aeef\") "
Jul 22 05:05:27.160006 ip-10-0-141-238 kubenswrapper[2563]: I0722 05:05:27.159924    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ac2b13ef-2c4f-43b4-bd4e-d5ea28d4aeef-tmp-dir\") pod \"ac2b13ef-2c4f-43b4-bd4e-d5ea28d4aeef\" (UID: \"ac2b13ef-2c4f-43b4-bd4e-d5ea28d4aeef\") "
Jul 22 05:05:27.160006 ip-10-0-141-238 kubenswrapper[2563]: I0722 05:05:27.159951    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-dc65v\" (UniqueName: \"kubernetes.io/projected/ac2b13ef-2c4f-43b4-bd4e-d5ea28d4aeef-kube-api-access-dc65v\") pod \"ac2b13ef-2c4f-43b4-bd4e-d5ea28d4aeef\" (UID: \"ac2b13ef-2c4f-43b4-bd4e-d5ea28d4aeef\") "
Jul 22 05:05:27.160006 ip-10-0-141-238 kubenswrapper[2563]: I0722 05:05:27.159995    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/ac2b13ef-2c4f-43b4-bd4e-d5ea28d4aeef-model-cache\") pod \"ac2b13ef-2c4f-43b4-bd4e-d5ea28d4aeef\" (UID: \"ac2b13ef-2c4f-43b4-bd4e-d5ea28d4aeef\") "
Jul 22 05:05:27.160222 ip-10-0-141-238 kubenswrapper[2563]: I0722 05:05:27.160124    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ac2b13ef-2c4f-43b4-bd4e-d5ea28d4aeef-home" (OuterVolumeSpecName: "home") pod "ac2b13ef-2c4f-43b4-bd4e-d5ea28d4aeef" (UID: "ac2b13ef-2c4f-43b4-bd4e-d5ea28d4aeef"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 22 05:05:27.160301 ip-10-0-141-238 kubenswrapper[2563]: I0722 05:05:27.160268    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ac2b13ef-2c4f-43b4-bd4e-d5ea28d4aeef-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "ac2b13ef-2c4f-43b4-bd4e-d5ea28d4aeef" (UID: "ac2b13ef-2c4f-43b4-bd4e-d5ea28d4aeef"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 22 05:05:27.160358 ip-10-0-141-238 kubenswrapper[2563]: I0722 05:05:27.160284    2563 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/ac2b13ef-2c4f-43b4-bd4e-d5ea28d4aeef-home\") on node \"ip-10-0-141-238.ec2.internal\" DevicePath \"\""
Jul 22 05:05:27.160358 ip-10-0-141-238 kubenswrapper[2563]: I0722 05:05:27.160300    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ac2b13ef-2c4f-43b4-bd4e-d5ea28d4aeef-model-cache" (OuterVolumeSpecName: "model-cache") pod "ac2b13ef-2c4f-43b4-bd4e-d5ea28d4aeef" (UID: "ac2b13ef-2c4f-43b4-bd4e-d5ea28d4aeef"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 22 05:05:27.162186 ip-10-0-141-238 kubenswrapper[2563]: I0722 05:05:27.162164    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ac2b13ef-2c4f-43b4-bd4e-d5ea28d4aeef-dshm" (OuterVolumeSpecName: "dshm") pod "ac2b13ef-2c4f-43b4-bd4e-d5ea28d4aeef" (UID: "ac2b13ef-2c4f-43b4-bd4e-d5ea28d4aeef"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 22 05:05:27.162283 ip-10-0-141-238 kubenswrapper[2563]: I0722 05:05:27.162204    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ac2b13ef-2c4f-43b4-bd4e-d5ea28d4aeef-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "ac2b13ef-2c4f-43b4-bd4e-d5ea28d4aeef" (UID: "ac2b13ef-2c4f-43b4-bd4e-d5ea28d4aeef"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 22 05:05:27.162335 ip-10-0-141-238 kubenswrapper[2563]: I0722 05:05:27.162268    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ac2b13ef-2c4f-43b4-bd4e-d5ea28d4aeef-kube-api-access-dc65v" (OuterVolumeSpecName: "kube-api-access-dc65v") pod "ac2b13ef-2c4f-43b4-bd4e-d5ea28d4aeef" (UID: "ac2b13ef-2c4f-43b4-bd4e-d5ea28d4aeef"). InnerVolumeSpecName "kube-api-access-dc65v". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 22 05:05:27.260783 ip-10-0-141-238 kubenswrapper[2563]: I0722 05:05:27.260745    2563 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/ac2b13ef-2c4f-43b4-bd4e-d5ea28d4aeef-model-cache\") on node \"ip-10-0-141-238.ec2.internal\" DevicePath \"\""
Jul 22 05:05:27.260783 ip-10-0-141-238 kubenswrapper[2563]: I0722 05:05:27.260775    2563 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/ac2b13ef-2c4f-43b4-bd4e-d5ea28d4aeef-dshm\") on node \"ip-10-0-141-238.ec2.internal\" DevicePath \"\""
Jul 22 05:05:27.260783 ip-10-0-141-238 kubenswrapper[2563]: I0722 05:05:27.260787    2563 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/ac2b13ef-2c4f-43b4-bd4e-d5ea28d4aeef-tls-certs\") on node \"ip-10-0-141-238.ec2.internal\" DevicePath \"\""
Jul 22 05:05:27.261014 ip-10-0-141-238 kubenswrapper[2563]: I0722 05:05:27.260800    2563 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ac2b13ef-2c4f-43b4-bd4e-d5ea28d4aeef-tmp-dir\") on node \"ip-10-0-141-238.ec2.internal\" DevicePath \"\""
Jul 22 05:05:27.261014 ip-10-0-141-238 kubenswrapper[2563]: I0722 05:05:27.260811    2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-dc65v\" (UniqueName: \"kubernetes.io/projected/ac2b13ef-2c4f-43b4-bd4e-d5ea28d4aeef-kube-api-access-dc65v\") on node \"ip-10-0-141-238.ec2.internal\" DevicePath \"\""
Jul 22 05:05:27.297463 ip-10-0-141-238 kubenswrapper[2563]: I0722 05:05:27.297427    2563 generic.go:356] "Generic (PLEG): container finished" podID="ac2b13ef-2c4f-43b4-bd4e-d5ea28d4aeef" containerID="e27fc8027922ea2e53b0289a240342b56b20753262529f7d1e30f75169183088" exitCode=0
Jul 22 05:05:27.297605 ip-10-0-141-238 kubenswrapper[2563]: I0722 05:05:27.297470    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-a-e9e018/test-model-e9e018-kserve-774ff4cddf-h5ppd"
Jul 22 05:05:27.297605 ip-10-0-141-238 kubenswrapper[2563]: I0722 05:05:27.297507    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-a-e9e018/test-model-e9e018-kserve-774ff4cddf-h5ppd" event={"ID":"ac2b13ef-2c4f-43b4-bd4e-d5ea28d4aeef","Type":"ContainerDied","Data":"e27fc8027922ea2e53b0289a240342b56b20753262529f7d1e30f75169183088"}
Jul 22 05:05:27.297605 ip-10-0-141-238 kubenswrapper[2563]: I0722 05:05:27.297553    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-a-e9e018/test-model-e9e018-kserve-774ff4cddf-h5ppd" event={"ID":"ac2b13ef-2c4f-43b4-bd4e-d5ea28d4aeef","Type":"ContainerDied","Data":"86b672ea5ad196bc8228c0b1f89758dfce7016b66e8d865e84039077057b4cd0"}
Jul 22 05:05:27.297605 ip-10-0-141-238 kubenswrapper[2563]: I0722 05:05:27.297569    2563 scope.go:117] "RemoveContainer" containerID="e27fc8027922ea2e53b0289a240342b56b20753262529f7d1e30f75169183088"
Jul 22 05:05:27.306715 ip-10-0-141-238 kubenswrapper[2563]: I0722 05:05:27.306695    2563 scope.go:117] "RemoveContainer" containerID="e27fc8027922ea2e53b0289a240342b56b20753262529f7d1e30f75169183088"
Jul 22 05:05:27.306940 ip-10-0-141-238 kubenswrapper[2563]: E0722 05:05:27.306924    2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e27fc8027922ea2e53b0289a240342b56b20753262529f7d1e30f75169183088\": container with ID starting with e27fc8027922ea2e53b0289a240342b56b20753262529f7d1e30f75169183088 not found: ID does not exist" containerID="e27fc8027922ea2e53b0289a240342b56b20753262529f7d1e30f75169183088"
Jul 22 05:05:27.306987 ip-10-0-141-238 kubenswrapper[2563]: I0722 05:05:27.306949    2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e27fc8027922ea2e53b0289a240342b56b20753262529f7d1e30f75169183088"} err="failed to get container status \"e27fc8027922ea2e53b0289a240342b56b20753262529f7d1e30f75169183088\": rpc error: code = NotFound desc = could not find container \"e27fc8027922ea2e53b0289a240342b56b20753262529f7d1e30f75169183088\": container with ID starting with e27fc8027922ea2e53b0289a240342b56b20753262529f7d1e30f75169183088 not found: ID does not exist"
Jul 22 05:05:27.334197 ip-10-0-141-238 kubenswrapper[2563]: I0722 05:05:27.334167    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-inf-a-e9e018/test-model-e9e018-kserve-774ff4cddf-h5ppd"]
Jul 22 05:05:27.343623 ip-10-0-141-238 kubenswrapper[2563]: I0722 05:05:27.343602    2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-inf-a-e9e018/test-model-e9e018-kserve-774ff4cddf-h5ppd"]
Jul 22 05:05:28.067868 ip-10-0-141-238 kubenswrapper[2563]: I0722 05:05:28.067836    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j9gvx_b4af3ae5-fa65-4358-8399-6ed11b68616e/konnectivity-agent/0.log" limit=1024
Jul 22 05:05:28.089609 ip-10-0-141-238 kubenswrapper[2563]: I0722 05:05:28.089562    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-e9e018-srnpz"]
Jul 22 05:05:28.092173 ip-10-0-141-238 kubenswrapper[2563]: I0722 05:05:28.092117    2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-e9e018-srnpz"]
Jul 22 05:05:28.453228 ip-10-0-141-238 kubenswrapper[2563]: I0722 05:05:28.453197    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j9gvx_b4af3ae5-fa65-4358-8399-6ed11b68616e/konnectivity-agent/0.log" limit=1024
Jul 22 05:05:29.066340 ip-10-0-141-238 kubenswrapper[2563]: I0722 05:05:29.066309    2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ac2b13ef-2c4f-43b4-bd4e-d5ea28d4aeef" path="/var/lib/kubelet/pods/ac2b13ef-2c4f-43b4-bd4e-d5ea28d4aeef/volumes"
Jul 22 05:05:29.066683 ip-10-0-141-238 kubenswrapper[2563]: I0722 05:05:29.066669    2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d07dd0ba-3535-4b4a-a4bd-89c3cc4b125f" path="/var/lib/kubelet/pods/d07dd0ba-3535-4b4a-a4bd-89c3cc4b125f/volumes"
Jul 22 05:05:32.328386 ip-10-0-141-238 kubenswrapper[2563]: I0722 05:05:32.328354    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-wsdd9"]
Jul 22 05:05:34.339684 ip-10-0-141-238 kubenswrapper[2563]: I0722 05:05:34.339648    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j9gvx_b4af3ae5-fa65-4358-8399-6ed11b68616e/konnectivity-agent/0.log" limit=1024
Jul 22 05:05:34.401514 ip-10-0-141-238 kubenswrapper[2563]: I0722 05:05:34.401480    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j9gvx_b4af3ae5-fa65-4358-8399-6ed11b68616e/konnectivity-agent/0.log" limit=1024
Jul 22 05:05:34.582803 ip-10-0-141-238 kubenswrapper[2563]: I0722 05:05:34.582768    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j9gvx_b4af3ae5-fa65-4358-8399-6ed11b68616e/konnectivity-agent/0.log" limit=1024
Jul 22 05:05:34.815380 ip-10-0-141-238 kubenswrapper[2563]: I0722 05:05:34.815345    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j9gvx_b4af3ae5-fa65-4358-8399-6ed11b68616e/konnectivity-agent/0.log" limit=1024
Jul 22 05:05:35.624176 ip-10-0-141-238 kubenswrapper[2563]: I0722 05:05:35.624148    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j9gvx_b4af3ae5-fa65-4358-8399-6ed11b68616e/konnectivity-agent/0.log" limit=1024
Jul 22 05:05:35.729172 ip-10-0-141-238 kubenswrapper[2563]: I0722 05:05:35.729137    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j9gvx_b4af3ae5-fa65-4358-8399-6ed11b68616e/konnectivity-agent/0.log" limit=1024
Jul 22 05:05:45.499154 ip-10-0-141-238 kubenswrapper[2563]: I0722 05:05:45.499048    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j9gvx_b4af3ae5-fa65-4358-8399-6ed11b68616e/konnectivity-agent/0.log" limit=1024
Jul 22 05:05:48.470884 ip-10-0-141-238 kubenswrapper[2563]: I0722 05:05:48.470854    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-wsdd9"]
Jul 22 05:05:50.007387 ip-10-0-141-238 kubenswrapper[2563]: I0722 05:05:50.007351    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j9gvx_b4af3ae5-fa65-4358-8399-6ed11b68616e/konnectivity-agent/0.log" limit=1024
Jul 22 05:05:50.390929 ip-10-0-141-238 kubenswrapper[2563]: I0722 05:05:50.390821    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j9gvx_b4af3ae5-fa65-4358-8399-6ed11b68616e/konnectivity-agent/0.log" limit=1024
Jul 22 05:05:56.174999 ip-10-0-141-238 kubenswrapper[2563]: I0722 05:05:56.174961    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j9gvx_b4af3ae5-fa65-4358-8399-6ed11b68616e/konnectivity-agent/0.log" limit=1024
Jul 22 05:05:56.281614 ip-10-0-141-238 kubenswrapper[2563]: I0722 05:05:56.281583    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j9gvx_b4af3ae5-fa65-4358-8399-6ed11b68616e/konnectivity-agent/0.log" limit=1024
Jul 22 05:05:56.414569 ip-10-0-141-238 kubenswrapper[2563]: I0722 05:05:56.414535    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-b-33bb6b-openshift-default-68d6d98b7f-zpv6j"]
Jul 22 05:05:56.414837 ip-10-0-141-238 kubenswrapper[2563]: I0722 05:05:56.414811    2563 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-inf-b-33bb6b-openshift-default-68d6d98b7f-zpv6j" podUID="32bea398-c3f5-4d3b-86a0-85a016f7fbfe" containerName="istio-proxy" containerID="cri-o://2ae1cad54fb1f95664eb135bc3c0195a4983ec1e26f816a120c20cde9606091e" gracePeriod=30
Jul 22 05:05:56.437698 ip-10-0-141-238 kubenswrapper[2563]: I0722 05:05:56.437639    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j9gvx_b4af3ae5-fa65-4358-8399-6ed11b68616e/konnectivity-agent/0.log" limit=1024
Jul 22 05:05:56.682923 ip-10-0-141-238 kubenswrapper[2563]: I0722 05:05:56.682891    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j9gvx_b4af3ae5-fa65-4358-8399-6ed11b68616e/konnectivity-agent/0.log" limit=1024
Jul 22 05:05:56.725744 ip-10-0-141-238 kubenswrapper[2563]: I0722 05:05:56.725676    2563 patch_prober.go:28] interesting pod/e2e-inf-b-33bb6b-openshift-default-68d6d98b7f-zpv6j container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Jul 22 05:05:56.725855 ip-10-0-141-238 kubenswrapper[2563]: I0722 05:05:56.725740    2563 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-inf-b-33bb6b-openshift-default-68d6d98b7f-zpv6j" podUID="32bea398-c3f5-4d3b-86a0-85a016f7fbfe" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 22 05:05:56.977640 ip-10-0-141-238 kubenswrapper[2563]: I0722 05:05:56.977535    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j9gvx_b4af3ae5-fa65-4358-8399-6ed11b68616e/konnectivity-agent/0.log" limit=1024
Jul 22 05:05:57.289034 ip-10-0-141-238 kubenswrapper[2563]: I0722 05:05:57.288942    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j9gvx_b4af3ae5-fa65-4358-8399-6ed11b68616e/konnectivity-agent/0.log" limit=1024
Jul 22 05:05:57.443292 ip-10-0-141-238 kubenswrapper[2563]: I0722 05:05:57.443243    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j9gvx_b4af3ae5-fa65-4358-8399-6ed11b68616e/konnectivity-agent/0.log" limit=1024
Jul 22 05:06:00.161497 ip-10-0-141-238 kubenswrapper[2563]: I0722 05:06:00.161467    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j9gvx_b4af3ae5-fa65-4358-8399-6ed11b68616e/konnectivity-agent/0.log" limit=1024
Jul 22 05:06:00.240061 ip-10-0-141-238 kubenswrapper[2563]: I0722 05:06:00.239996    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j9gvx_b4af3ae5-fa65-4358-8399-6ed11b68616e/konnectivity-agent/0.log" limit=1024
Jul 22 05:06:00.318501 ip-10-0-141-238 kubenswrapper[2563]: I0722 05:06:00.318454    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j9gvx_b4af3ae5-fa65-4358-8399-6ed11b68616e/konnectivity-agent/0.log" limit=1024
Jul 22 05:06:00.899703 ip-10-0-141-238 kubenswrapper[2563]: I0722 05:06:00.899668    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j9gvx_b4af3ae5-fa65-4358-8399-6ed11b68616e/konnectivity-agent/0.log" limit=1024
Jul 22 05:06:01.001446 ip-10-0-141-238 kubenswrapper[2563]: I0722 05:06:01.001418    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j9gvx_b4af3ae5-fa65-4358-8399-6ed11b68616e/konnectivity-agent/0.log" limit=1024
Jul 22 05:06:01.112318 ip-10-0-141-238 kubenswrapper[2563]: I0722 05:06:01.112284    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j9gvx_b4af3ae5-fa65-4358-8399-6ed11b68616e/konnectivity-agent/0.log" limit=1024
Jul 22 05:06:01.661892 ip-10-0-141-238 kubenswrapper[2563]: I0722 05:06:01.661868    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-33bb6b-openshift-default-68d6d98b7f-zpv6j"
Jul 22 05:06:01.757645 ip-10-0-141-238 kubenswrapper[2563]: I0722 05:06:01.757583    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/32bea398-c3f5-4d3b-86a0-85a016f7fbfe-workload-certs\") pod \"32bea398-c3f5-4d3b-86a0-85a016f7fbfe\" (UID: \"32bea398-c3f5-4d3b-86a0-85a016f7fbfe\") "
Jul 22 05:06:01.757645 ip-10-0-141-238 kubenswrapper[2563]: I0722 05:06:01.757620    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/32bea398-c3f5-4d3b-86a0-85a016f7fbfe-workload-socket\") pod \"32bea398-c3f5-4d3b-86a0-85a016f7fbfe\" (UID: \"32bea398-c3f5-4d3b-86a0-85a016f7fbfe\") "
Jul 22 05:06:01.757846 ip-10-0-141-238 kubenswrapper[2563]: I0722 05:06:01.757657    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/32bea398-c3f5-4d3b-86a0-85a016f7fbfe-istio-data\") pod \"32bea398-c3f5-4d3b-86a0-85a016f7fbfe\" (UID: \"32bea398-c3f5-4d3b-86a0-85a016f7fbfe\") "
Jul 22 05:06:01.757846 ip-10-0-141-238 kubenswrapper[2563]: I0722 05:06:01.757691    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/32bea398-c3f5-4d3b-86a0-85a016f7fbfe-istio-token\") pod \"32bea398-c3f5-4d3b-86a0-85a016f7fbfe\" (UID: \"32bea398-c3f5-4d3b-86a0-85a016f7fbfe\") "
Jul 22 05:06:01.757846 ip-10-0-141-238 kubenswrapper[2563]: I0722 05:06:01.757706    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/32bea398-c3f5-4d3b-86a0-85a016f7fbfe-istiod-ca-cert\") pod \"32bea398-c3f5-4d3b-86a0-85a016f7fbfe\" (UID: \"32bea398-c3f5-4d3b-86a0-85a016f7fbfe\") "
Jul 22 05:06:01.757846 ip-10-0-141-238 kubenswrapper[2563]: I0722 05:06:01.757756    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-4bp6l\" (UniqueName: \"kubernetes.io/projected/32bea398-c3f5-4d3b-86a0-85a016f7fbfe-kube-api-access-4bp6l\") pod \"32bea398-c3f5-4d3b-86a0-85a016f7fbfe\" (UID: \"32bea398-c3f5-4d3b-86a0-85a016f7fbfe\") "
Jul 22 05:06:01.757846 ip-10-0-141-238 kubenswrapper[2563]: I0722 05:06:01.757779    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/32bea398-c3f5-4d3b-86a0-85a016f7fbfe-istio-envoy\") pod \"32bea398-c3f5-4d3b-86a0-85a016f7fbfe\" (UID: \"32bea398-c3f5-4d3b-86a0-85a016f7fbfe\") "
Jul 22 05:06:01.757846 ip-10-0-141-238 kubenswrapper[2563]: I0722 05:06:01.757805    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/32bea398-c3f5-4d3b-86a0-85a016f7fbfe-istio-podinfo\") pod \"32bea398-c3f5-4d3b-86a0-85a016f7fbfe\" (UID: \"32bea398-c3f5-4d3b-86a0-85a016f7fbfe\") "
Jul 22 05:06:01.757846 ip-10-0-141-238 kubenswrapper[2563]: I0722 05:06:01.757811    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/32bea398-c3f5-4d3b-86a0-85a016f7fbfe-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "32bea398-c3f5-4d3b-86a0-85a016f7fbfe" (UID: "32bea398-c3f5-4d3b-86a0-85a016f7fbfe"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 22 05:06:01.758238 ip-10-0-141-238 kubenswrapper[2563]: I0722 05:06:01.757869    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/32bea398-c3f5-4d3b-86a0-85a016f7fbfe-credential-socket\") pod \"32bea398-c3f5-4d3b-86a0-85a016f7fbfe\" (UID: \"32bea398-c3f5-4d3b-86a0-85a016f7fbfe\") "
Jul 22 05:06:01.758238 ip-10-0-141-238 kubenswrapper[2563]: I0722 05:06:01.757983    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/32bea398-c3f5-4d3b-86a0-85a016f7fbfe-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "32bea398-c3f5-4d3b-86a0-85a016f7fbfe" (UID: "32bea398-c3f5-4d3b-86a0-85a016f7fbfe"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 22 05:06:01.758238 ip-10-0-141-238 kubenswrapper[2563]: I0722 05:06:01.758189    2563 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/32bea398-c3f5-4d3b-86a0-85a016f7fbfe-workload-certs\") on node \"ip-10-0-141-238.ec2.internal\" DevicePath \"\""
Jul 22 05:06:01.758238 ip-10-0-141-238 kubenswrapper[2563]: I0722 05:06:01.758209    2563 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/32bea398-c3f5-4d3b-86a0-85a016f7fbfe-workload-socket\") on node \"ip-10-0-141-238.ec2.internal\" DevicePath \"\""
Jul 22 05:06:01.758238 ip-10-0-141-238 kubenswrapper[2563]: I0722 05:06:01.758219    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/32bea398-c3f5-4d3b-86a0-85a016f7fbfe-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "32bea398-c3f5-4d3b-86a0-85a016f7fbfe" (UID: "32bea398-c3f5-4d3b-86a0-85a016f7fbfe"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 22 05:06:01.758448 ip-10-0-141-238 kubenswrapper[2563]: I0722 05:06:01.758237    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/32bea398-c3f5-4d3b-86a0-85a016f7fbfe-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "32bea398-c3f5-4d3b-86a0-85a016f7fbfe" (UID: "32bea398-c3f5-4d3b-86a0-85a016f7fbfe"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 22 05:06:01.758589 ip-10-0-141-238 kubenswrapper[2563]: I0722 05:06:01.758568    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/32bea398-c3f5-4d3b-86a0-85a016f7fbfe-istio-data" (OuterVolumeSpecName: "istio-data") pod "32bea398-c3f5-4d3b-86a0-85a016f7fbfe" (UID: "32bea398-c3f5-4d3b-86a0-85a016f7fbfe"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 22 05:06:01.760008 ip-10-0-141-238 kubenswrapper[2563]: I0722 05:06:01.759982    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/32bea398-c3f5-4d3b-86a0-85a016f7fbfe-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "32bea398-c3f5-4d3b-86a0-85a016f7fbfe" (UID: "32bea398-c3f5-4d3b-86a0-85a016f7fbfe"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 22 05:06:01.760145 ip-10-0-141-238 kubenswrapper[2563]: I0722 05:06:01.760100    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/32bea398-c3f5-4d3b-86a0-85a016f7fbfe-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "32bea398-c3f5-4d3b-86a0-85a016f7fbfe" (UID: "32bea398-c3f5-4d3b-86a0-85a016f7fbfe"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 22 05:06:01.760381 ip-10-0-141-238 kubenswrapper[2563]: I0722 05:06:01.760362    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/32bea398-c3f5-4d3b-86a0-85a016f7fbfe-kube-api-access-4bp6l" (OuterVolumeSpecName: "kube-api-access-4bp6l") pod "32bea398-c3f5-4d3b-86a0-85a016f7fbfe" (UID: "32bea398-c3f5-4d3b-86a0-85a016f7fbfe"). InnerVolumeSpecName "kube-api-access-4bp6l". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 22 05:06:01.760446 ip-10-0-141-238 kubenswrapper[2563]: I0722 05:06:01.760378    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/32bea398-c3f5-4d3b-86a0-85a016f7fbfe-istio-token" (OuterVolumeSpecName: "istio-token") pod "32bea398-c3f5-4d3b-86a0-85a016f7fbfe" (UID: "32bea398-c3f5-4d3b-86a0-85a016f7fbfe"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 22 05:06:01.859435 ip-10-0-141-238 kubenswrapper[2563]: I0722 05:06:01.859405    2563 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/32bea398-c3f5-4d3b-86a0-85a016f7fbfe-istio-data\") on node \"ip-10-0-141-238.ec2.internal\" DevicePath \"\""
Jul 22 05:06:01.859435 ip-10-0-141-238 kubenswrapper[2563]: I0722 05:06:01.859431    2563 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/32bea398-c3f5-4d3b-86a0-85a016f7fbfe-istio-token\") on node \"ip-10-0-141-238.ec2.internal\" DevicePath \"\""
Jul 22 05:06:01.859435 ip-10-0-141-238 kubenswrapper[2563]: I0722 05:06:01.859443    2563 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/32bea398-c3f5-4d3b-86a0-85a016f7fbfe-istiod-ca-cert\") on node \"ip-10-0-141-238.ec2.internal\" DevicePath \"\""
Jul 22 05:06:01.859647 ip-10-0-141-238 kubenswrapper[2563]: I0722 05:06:01.859455    2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-4bp6l\" (UniqueName: \"kubernetes.io/projected/32bea398-c3f5-4d3b-86a0-85a016f7fbfe-kube-api-access-4bp6l\") on node \"ip-10-0-141-238.ec2.internal\" DevicePath \"\""
Jul 22 05:06:01.859647 ip-10-0-141-238 kubenswrapper[2563]: I0722 05:06:01.859467    2563 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/32bea398-c3f5-4d3b-86a0-85a016f7fbfe-istio-envoy\") on node \"ip-10-0-141-238.ec2.internal\" DevicePath \"\""
Jul 22 05:06:01.859647 ip-10-0-141-238 kubenswrapper[2563]: I0722 05:06:01.859478    2563 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/32bea398-c3f5-4d3b-86a0-85a016f7fbfe-istio-podinfo\") on node \"ip-10-0-141-238.ec2.internal\" DevicePath \"\""
Jul 22 05:06:01.859647 ip-10-0-141-238 kubenswrapper[2563]: I0722 05:06:01.859491    2563 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/32bea398-c3f5-4d3b-86a0-85a016f7fbfe-credential-socket\") on node \"ip-10-0-141-238.ec2.internal\" DevicePath \"\""
Jul 22 05:06:02.465448 ip-10-0-141-238 kubenswrapper[2563]: I0722 05:06:02.465413    2563 generic.go:356] "Generic (PLEG): container finished" podID="32bea398-c3f5-4d3b-86a0-85a016f7fbfe" containerID="2ae1cad54fb1f95664eb135bc3c0195a4983ec1e26f816a120c20cde9606091e" exitCode=0
Jul 22 05:06:02.465633 ip-10-0-141-238 kubenswrapper[2563]: I0722 05:06:02.465475    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-33bb6b-openshift-default-68d6d98b7f-zpv6j"
Jul 22 05:06:02.465633 ip-10-0-141-238 kubenswrapper[2563]: I0722 05:06:02.465503    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-33bb6b-openshift-default-68d6d98b7f-zpv6j" event={"ID":"32bea398-c3f5-4d3b-86a0-85a016f7fbfe","Type":"ContainerDied","Data":"2ae1cad54fb1f95664eb135bc3c0195a4983ec1e26f816a120c20cde9606091e"}
Jul 22 05:06:02.465633 ip-10-0-141-238 kubenswrapper[2563]: I0722 05:06:02.465592    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-33bb6b-openshift-default-68d6d98b7f-zpv6j" event={"ID":"32bea398-c3f5-4d3b-86a0-85a016f7fbfe","Type":"ContainerDied","Data":"4274377b562edb1c1e23620b94ff6f35ede2ff1766105acb28e1d0e8d68c0d2b"}
Jul 22 05:06:02.465633 ip-10-0-141-238 kubenswrapper[2563]: I0722 05:06:02.465614    2563 scope.go:117] "RemoveContainer" containerID="2ae1cad54fb1f95664eb135bc3c0195a4983ec1e26f816a120c20cde9606091e"
Jul 22 05:06:02.474814 ip-10-0-141-238 kubenswrapper[2563]: I0722 05:06:02.474798    2563 scope.go:117] "RemoveContainer" containerID="65cf5d9c62f2fad61096418bb5952e590657cd8a086a151d98c7a31715e41872"
Jul 22 05:06:02.482523 ip-10-0-141-238 kubenswrapper[2563]: I0722 05:06:02.482504    2563 scope.go:117] "RemoveContainer" containerID="2ae1cad54fb1f95664eb135bc3c0195a4983ec1e26f816a120c20cde9606091e"
Jul 22 05:06:02.482768 ip-10-0-141-238 kubenswrapper[2563]: E0722 05:06:02.482749    2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2ae1cad54fb1f95664eb135bc3c0195a4983ec1e26f816a120c20cde9606091e\": container with ID starting with 2ae1cad54fb1f95664eb135bc3c0195a4983ec1e26f816a120c20cde9606091e not found: ID does not exist" containerID="2ae1cad54fb1f95664eb135bc3c0195a4983ec1e26f816a120c20cde9606091e"
Jul 22 05:06:02.482840 ip-10-0-141-238 kubenswrapper[2563]: I0722 05:06:02.482782    2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2ae1cad54fb1f95664eb135bc3c0195a4983ec1e26f816a120c20cde9606091e"} err="failed to get container status \"2ae1cad54fb1f95664eb135bc3c0195a4983ec1e26f816a120c20cde9606091e\": rpc error: code = NotFound desc = could not find container \"2ae1cad54fb1f95664eb135bc3c0195a4983ec1e26f816a120c20cde9606091e\": container with ID starting with 2ae1cad54fb1f95664eb135bc3c0195a4983ec1e26f816a120c20cde9606091e not found: ID does not exist"
Jul 22 05:06:02.482840 ip-10-0-141-238 kubenswrapper[2563]: I0722 05:06:02.482807    2563 scope.go:117] "RemoveContainer" containerID="65cf5d9c62f2fad61096418bb5952e590657cd8a086a151d98c7a31715e41872"
Jul 22 05:06:02.483110 ip-10-0-141-238 kubenswrapper[2563]: E0722 05:06:02.483077    2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"65cf5d9c62f2fad61096418bb5952e590657cd8a086a151d98c7a31715e41872\": container with ID starting with 65cf5d9c62f2fad61096418bb5952e590657cd8a086a151d98c7a31715e41872 not found: ID does not exist" containerID="65cf5d9c62f2fad61096418bb5952e590657cd8a086a151d98c7a31715e41872"
Jul 22 05:06:02.483164 ip-10-0-141-238 kubenswrapper[2563]: I0722 05:06:02.483114    2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"65cf5d9c62f2fad61096418bb5952e590657cd8a086a151d98c7a31715e41872"} err="failed to get container status \"65cf5d9c62f2fad61096418bb5952e590657cd8a086a151d98c7a31715e41872\": rpc error: code = NotFound desc = could not find container \"65cf5d9c62f2fad61096418bb5952e590657cd8a086a151d98c7a31715e41872\": container with ID starting with 65cf5d9c62f2fad61096418bb5952e590657cd8a086a151d98c7a31715e41872 not found: ID does not exist"
Jul 22 05:06:02.487269 ip-10-0-141-238 kubenswrapper[2563]: I0722 05:06:02.487248    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-b-33bb6b-openshift-default-68d6d98b7f-zpv6j"]
Jul 22 05:06:02.491241 ip-10-0-141-238 kubenswrapper[2563]: I0722 05:06:02.491222    2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-inf-b-33bb6b-openshift-default-68d6d98b7f-zpv6j"]
Jul 22 05:06:03.065704 ip-10-0-141-238 kubenswrapper[2563]: I0722 05:06:03.065664    2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="32bea398-c3f5-4d3b-86a0-85a016f7fbfe" path="/var/lib/kubelet/pods/32bea398-c3f5-4d3b-86a0-85a016f7fbfe/volumes"
Jul 22 05:06:04.620379 ip-10-0-141-238 kubenswrapper[2563]: I0722 05:06:04.620346    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j9gvx_b4af3ae5-fa65-4358-8399-6ed11b68616e/konnectivity-agent/0.log" limit=1024
Jul 22 05:06:05.081091 ip-10-0-141-238 kubenswrapper[2563]: I0722 05:06:05.081057    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j9gvx_b4af3ae5-fa65-4358-8399-6ed11b68616e/konnectivity-agent/0.log" limit=1024
Jul 22 05:06:05.349979 ip-10-0-141-238 kubenswrapper[2563]: I0722 05:06:05.349906    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-api-b-db800e-openshift-default-5dfb7c4fff-r9gfw"]
Jul 22 05:06:05.350252 ip-10-0-141-238 kubenswrapper[2563]: I0722 05:06:05.350240    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ac2b13ef-2c4f-43b4-bd4e-d5ea28d4aeef" containerName="main"
Jul 22 05:06:05.350306 ip-10-0-141-238 kubenswrapper[2563]: I0722 05:06:05.350254    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="ac2b13ef-2c4f-43b4-bd4e-d5ea28d4aeef" containerName="main"
Jul 22 05:06:05.350306 ip-10-0-141-238 kubenswrapper[2563]: I0722 05:06:05.350267    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="32bea398-c3f5-4d3b-86a0-85a016f7fbfe" containerName="istio-proxy"
Jul 22 05:06:05.350306 ip-10-0-141-238 kubenswrapper[2563]: I0722 05:06:05.350275    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="32bea398-c3f5-4d3b-86a0-85a016f7fbfe" containerName="istio-proxy"
Jul 22 05:06:05.350306 ip-10-0-141-238 kubenswrapper[2563]: I0722 05:06:05.350282    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d07dd0ba-3535-4b4a-a4bd-89c3cc4b125f" containerName="revoke-keys"
Jul 22 05:06:05.350306 ip-10-0-141-238 kubenswrapper[2563]: I0722 05:06:05.350287    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="d07dd0ba-3535-4b4a-a4bd-89c3cc4b125f" containerName="revoke-keys"
Jul 22 05:06:05.350479 ip-10-0-141-238 kubenswrapper[2563]: I0722 05:06:05.350344    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="32bea398-c3f5-4d3b-86a0-85a016f7fbfe" containerName="istio-proxy"
Jul 22 05:06:05.350479 ip-10-0-141-238 kubenswrapper[2563]: I0722 05:06:05.350352    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="32bea398-c3f5-4d3b-86a0-85a016f7fbfe" containerName="istio-proxy"
Jul 22 05:06:05.350479 ip-10-0-141-238 kubenswrapper[2563]: I0722 05:06:05.350360    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="d07dd0ba-3535-4b4a-a4bd-89c3cc4b125f" containerName="revoke-keys"
Jul 22 05:06:05.350479 ip-10-0-141-238 kubenswrapper[2563]: I0722 05:06:05.350366    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="ac2b13ef-2c4f-43b4-bd4e-d5ea28d4aeef" containerName="main"
Jul 22 05:06:05.354785 ip-10-0-141-238 kubenswrapper[2563]: I0722 05:06:05.354763    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-db800e-openshift-default-5dfb7c4fff-r9gfw"
Jul 22 05:06:05.357192 ip-10-0-141-238 kubenswrapper[2563]: I0722 05:06:05.357169    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-api-b-db800e-openshift-default-dockercfg-2hgzx\""
Jul 22 05:06:05.365190 ip-10-0-141-238 kubenswrapper[2563]: I0722 05:06:05.365168    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-b-db800e-openshift-default-5dfb7c4fff-r9gfw"]
Jul 22 05:06:05.386892 ip-10-0-141-238 kubenswrapper[2563]: I0722 05:06:05.386860    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j9gvx_b4af3ae5-fa65-4358-8399-6ed11b68616e/konnectivity-agent/0.log" limit=1024
Jul 22 05:06:05.484427 ip-10-0-141-238 kubenswrapper[2563]: I0722 05:06:05.484397    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j9gvx_b4af3ae5-fa65-4358-8399-6ed11b68616e/konnectivity-agent/0.log" limit=1024
Jul 22 05:06:05.490970 ip-10-0-141-238 kubenswrapper[2563]: I0722 05:06:05.490948    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/dde7caa1-31e8-4bb2-bf9f-46e17e5ae1fb-workload-socket\") pod \"e2e-api-b-db800e-openshift-default-5dfb7c4fff-r9gfw\" (UID: \"dde7caa1-31e8-4bb2-bf9f-46e17e5ae1fb\") " pod="openshift-ingress/e2e-api-b-db800e-openshift-default-5dfb7c4fff-r9gfw"
Jul 22 05:06:05.491098 ip-10-0-141-238 kubenswrapper[2563]: I0722 05:06:05.490992    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/dde7caa1-31e8-4bb2-bf9f-46e17e5ae1fb-istio-envoy\") pod \"e2e-api-b-db800e-openshift-default-5dfb7c4fff-r9gfw\" (UID: \"dde7caa1-31e8-4bb2-bf9f-46e17e5ae1fb\") " pod="openshift-ingress/e2e-api-b-db800e-openshift-default-5dfb7c4fff-r9gfw"
Jul 22 05:06:05.491098 ip-10-0-141-238 kubenswrapper[2563]: I0722 05:06:05.491012    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-j58d2\" (UniqueName: \"kubernetes.io/projected/dde7caa1-31e8-4bb2-bf9f-46e17e5ae1fb-kube-api-access-j58d2\") pod \"e2e-api-b-db800e-openshift-default-5dfb7c4fff-r9gfw\" (UID: \"dde7caa1-31e8-4bb2-bf9f-46e17e5ae1fb\") " pod="openshift-ingress/e2e-api-b-db800e-openshift-default-5dfb7c4fff-r9gfw"
Jul 22 05:06:05.491192 ip-10-0-141-238 kubenswrapper[2563]: I0722 05:06:05.491107    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/dde7caa1-31e8-4bb2-bf9f-46e17e5ae1fb-istio-token\") pod \"e2e-api-b-db800e-openshift-default-5dfb7c4fff-r9gfw\" (UID: \"dde7caa1-31e8-4bb2-bf9f-46e17e5ae1fb\") " pod="openshift-ingress/e2e-api-b-db800e-openshift-default-5dfb7c4fff-r9gfw"
Jul 22 05:06:05.491192 ip-10-0-141-238 kubenswrapper[2563]: I0722 05:06:05.491125    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/dde7caa1-31e8-4bb2-bf9f-46e17e5ae1fb-istiod-ca-cert\") pod \"e2e-api-b-db800e-openshift-default-5dfb7c4fff-r9gfw\" (UID: \"dde7caa1-31e8-4bb2-bf9f-46e17e5ae1fb\") " pod="openshift-ingress/e2e-api-b-db800e-openshift-default-5dfb7c4fff-r9gfw"
Jul 22 05:06:05.491192 ip-10-0-141-238 kubenswrapper[2563]: I0722 05:06:05.491148    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/dde7caa1-31e8-4bb2-bf9f-46e17e5ae1fb-credential-socket\") pod \"e2e-api-b-db800e-openshift-default-5dfb7c4fff-r9gfw\" (UID: \"dde7caa1-31e8-4bb2-bf9f-46e17e5ae1fb\") " pod="openshift-ingress/e2e-api-b-db800e-openshift-default-5dfb7c4fff-r9gfw"
Jul 22 05:06:05.491192 ip-10-0-141-238 kubenswrapper[2563]: I0722 05:06:05.491171    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/dde7caa1-31e8-4bb2-bf9f-46e17e5ae1fb-istio-data\") pod \"e2e-api-b-db800e-openshift-default-5dfb7c4fff-r9gfw\" (UID: \"dde7caa1-31e8-4bb2-bf9f-46e17e5ae1fb\") " pod="openshift-ingress/e2e-api-b-db800e-openshift-default-5dfb7c4fff-r9gfw"
Jul 22 05:06:05.491192 ip-10-0-141-238 kubenswrapper[2563]: I0722 05:06:05.491188    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/dde7caa1-31e8-4bb2-bf9f-46e17e5ae1fb-istio-podinfo\") pod \"e2e-api-b-db800e-openshift-default-5dfb7c4fff-r9gfw\" (UID: \"dde7caa1-31e8-4bb2-bf9f-46e17e5ae1fb\") " pod="openshift-ingress/e2e-api-b-db800e-openshift-default-5dfb7c4fff-r9gfw"
Jul 22 05:06:05.491352 ip-10-0-141-238 kubenswrapper[2563]: I0722 05:06:05.491244    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/dde7caa1-31e8-4bb2-bf9f-46e17e5ae1fb-workload-certs\") pod \"e2e-api-b-db800e-openshift-default-5dfb7c4fff-r9gfw\" (UID: \"dde7caa1-31e8-4bb2-bf9f-46e17e5ae1fb\") " pod="openshift-ingress/e2e-api-b-db800e-openshift-default-5dfb7c4fff-r9gfw"
Jul 22 05:06:05.591656 ip-10-0-141-238 kubenswrapper[2563]: I0722 05:06:05.591621    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/dde7caa1-31e8-4bb2-bf9f-46e17e5ae1fb-istio-envoy\") pod \"e2e-api-b-db800e-openshift-default-5dfb7c4fff-r9gfw\" (UID: \"dde7caa1-31e8-4bb2-bf9f-46e17e5ae1fb\") " pod="openshift-ingress/e2e-api-b-db800e-openshift-default-5dfb7c4fff-r9gfw"
Jul 22 05:06:05.591830 ip-10-0-141-238 kubenswrapper[2563]: I0722 05:06:05.591665    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-j58d2\" (UniqueName: \"kubernetes.io/projected/dde7caa1-31e8-4bb2-bf9f-46e17e5ae1fb-kube-api-access-j58d2\") pod \"e2e-api-b-db800e-openshift-default-5dfb7c4fff-r9gfw\" (UID: \"dde7caa1-31e8-4bb2-bf9f-46e17e5ae1fb\") " pod="openshift-ingress/e2e-api-b-db800e-openshift-default-5dfb7c4fff-r9gfw"
Jul 22 05:06:05.591830 ip-10-0-141-238 kubenswrapper[2563]: I0722 05:06:05.591726    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/dde7caa1-31e8-4bb2-bf9f-46e17e5ae1fb-istio-token\") pod \"e2e-api-b-db800e-openshift-default-5dfb7c4fff-r9gfw\" (UID: \"dde7caa1-31e8-4bb2-bf9f-46e17e5ae1fb\") " pod="openshift-ingress/e2e-api-b-db800e-openshift-default-5dfb7c4fff-r9gfw"
Jul 22 05:06:05.591830 ip-10-0-141-238 kubenswrapper[2563]: I0722 05:06:05.591750    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/dde7caa1-31e8-4bb2-bf9f-46e17e5ae1fb-istiod-ca-cert\") pod \"e2e-api-b-db800e-openshift-default-5dfb7c4fff-r9gfw\" (UID: \"dde7caa1-31e8-4bb2-bf9f-46e17e5ae1fb\") " pod="openshift-ingress/e2e-api-b-db800e-openshift-default-5dfb7c4fff-r9gfw"
Jul 22 05:06:05.591830 ip-10-0-141-238 kubenswrapper[2563]: I0722 05:06:05.591803    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/dde7caa1-31e8-4bb2-bf9f-46e17e5ae1fb-credential-socket\") pod \"e2e-api-b-db800e-openshift-default-5dfb7c4fff-r9gfw\" (UID: \"dde7caa1-31e8-4bb2-bf9f-46e17e5ae1fb\") " pod="openshift-ingress/e2e-api-b-db800e-openshift-default-5dfb7c4fff-r9gfw"
Jul 22 05:06:05.592091 ip-10-0-141-238 kubenswrapper[2563]: I0722 05:06:05.591851    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/dde7caa1-31e8-4bb2-bf9f-46e17e5ae1fb-istio-data\") pod \"e2e-api-b-db800e-openshift-default-5dfb7c4fff-r9gfw\" (UID: \"dde7caa1-31e8-4bb2-bf9f-46e17e5ae1fb\") " pod="openshift-ingress/e2e-api-b-db800e-openshift-default-5dfb7c4fff-r9gfw"
Jul 22 05:06:05.592091 ip-10-0-141-238 kubenswrapper[2563]: I0722 05:06:05.591882    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/dde7caa1-31e8-4bb2-bf9f-46e17e5ae1fb-istio-podinfo\") pod \"e2e-api-b-db800e-openshift-default-5dfb7c4fff-r9gfw\" (UID: \"dde7caa1-31e8-4bb2-bf9f-46e17e5ae1fb\") " pod="openshift-ingress/e2e-api-b-db800e-openshift-default-5dfb7c4fff-r9gfw"
Jul 22 05:06:05.592091 ip-10-0-141-238 kubenswrapper[2563]: I0722 05:06:05.591940    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/dde7caa1-31e8-4bb2-bf9f-46e17e5ae1fb-workload-certs\") pod \"e2e-api-b-db800e-openshift-default-5dfb7c4fff-r9gfw\" (UID: \"dde7caa1-31e8-4bb2-bf9f-46e17e5ae1fb\") " pod="openshift-ingress/e2e-api-b-db800e-openshift-default-5dfb7c4fff-r9gfw"
Jul 22 05:06:05.592091 ip-10-0-141-238 kubenswrapper[2563]: I0722 05:06:05.591985    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/dde7caa1-31e8-4bb2-bf9f-46e17e5ae1fb-workload-socket\") pod \"e2e-api-b-db800e-openshift-default-5dfb7c4fff-r9gfw\" (UID: \"dde7caa1-31e8-4bb2-bf9f-46e17e5ae1fb\") " pod="openshift-ingress/e2e-api-b-db800e-openshift-default-5dfb7c4fff-r9gfw"
Jul 22 05:06:05.592440 ip-10-0-141-238 kubenswrapper[2563]: I0722 05:06:05.592409    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/dde7caa1-31e8-4bb2-bf9f-46e17e5ae1fb-istio-data\") pod \"e2e-api-b-db800e-openshift-default-5dfb7c4fff-r9gfw\" (UID: \"dde7caa1-31e8-4bb2-bf9f-46e17e5ae1fb\") " pod="openshift-ingress/e2e-api-b-db800e-openshift-default-5dfb7c4fff-r9gfw"
Jul 22 05:06:05.592572 ip-10-0-141-238 kubenswrapper[2563]: I0722 05:06:05.592522    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/dde7caa1-31e8-4bb2-bf9f-46e17e5ae1fb-workload-certs\") pod \"e2e-api-b-db800e-openshift-default-5dfb7c4fff-r9gfw\" (UID: \"dde7caa1-31e8-4bb2-bf9f-46e17e5ae1fb\") " pod="openshift-ingress/e2e-api-b-db800e-openshift-default-5dfb7c4fff-r9gfw"
Jul 22 05:06:05.592572 ip-10-0-141-238 kubenswrapper[2563]: I0722 05:06:05.592560    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/dde7caa1-31e8-4bb2-bf9f-46e17e5ae1fb-credential-socket\") pod \"e2e-api-b-db800e-openshift-default-5dfb7c4fff-r9gfw\" (UID: \"dde7caa1-31e8-4bb2-bf9f-46e17e5ae1fb\") " pod="openshift-ingress/e2e-api-b-db800e-openshift-default-5dfb7c4fff-r9gfw"
Jul 22 05:06:05.592693 ip-10-0-141-238 kubenswrapper[2563]: I0722 05:06:05.592588    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/dde7caa1-31e8-4bb2-bf9f-46e17e5ae1fb-workload-socket\") pod \"e2e-api-b-db800e-openshift-default-5dfb7c4fff-r9gfw\" (UID: \"dde7caa1-31e8-4bb2-bf9f-46e17e5ae1fb\") " pod="openshift-ingress/e2e-api-b-db800e-openshift-default-5dfb7c4fff-r9gfw"
Jul 22 05:06:05.592693 ip-10-0-141-238 kubenswrapper[2563]: I0722 05:06:05.592650    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/dde7caa1-31e8-4bb2-bf9f-46e17e5ae1fb-istiod-ca-cert\") pod \"e2e-api-b-db800e-openshift-default-5dfb7c4fff-r9gfw\" (UID: \"dde7caa1-31e8-4bb2-bf9f-46e17e5ae1fb\") " pod="openshift-ingress/e2e-api-b-db800e-openshift-default-5dfb7c4fff-r9gfw"
Jul 22 05:06:05.594251 ip-10-0-141-238 kubenswrapper[2563]: I0722 05:06:05.594230    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/dde7caa1-31e8-4bb2-bf9f-46e17e5ae1fb-istio-envoy\") pod \"e2e-api-b-db800e-openshift-default-5dfb7c4fff-r9gfw\" (UID: \"dde7caa1-31e8-4bb2-bf9f-46e17e5ae1fb\") " pod="openshift-ingress/e2e-api-b-db800e-openshift-default-5dfb7c4fff-r9gfw"
Jul 22 05:06:05.594635 ip-10-0-141-238 kubenswrapper[2563]: I0722 05:06:05.594614    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/dde7caa1-31e8-4bb2-bf9f-46e17e5ae1fb-istio-podinfo\") pod \"e2e-api-b-db800e-openshift-default-5dfb7c4fff-r9gfw\" (UID: \"dde7caa1-31e8-4bb2-bf9f-46e17e5ae1fb\") " pod="openshift-ingress/e2e-api-b-db800e-openshift-default-5dfb7c4fff-r9gfw"
Jul 22 05:06:05.599875 ip-10-0-141-238 kubenswrapper[2563]: I0722 05:06:05.599853    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-j58d2\" (UniqueName: \"kubernetes.io/projected/dde7caa1-31e8-4bb2-bf9f-46e17e5ae1fb-kube-api-access-j58d2\") pod \"e2e-api-b-db800e-openshift-default-5dfb7c4fff-r9gfw\" (UID: \"dde7caa1-31e8-4bb2-bf9f-46e17e5ae1fb\") " pod="openshift-ingress/e2e-api-b-db800e-openshift-default-5dfb7c4fff-r9gfw"
Jul 22 05:06:05.600260 ip-10-0-141-238 kubenswrapper[2563]: I0722 05:06:05.600217    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/dde7caa1-31e8-4bb2-bf9f-46e17e5ae1fb-istio-token\") pod \"e2e-api-b-db800e-openshift-default-5dfb7c4fff-r9gfw\" (UID: \"dde7caa1-31e8-4bb2-bf9f-46e17e5ae1fb\") " pod="openshift-ingress/e2e-api-b-db800e-openshift-default-5dfb7c4fff-r9gfw"
Jul 22 05:06:05.666096 ip-10-0-141-238 kubenswrapper[2563]: I0722 05:06:05.666069    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-db800e-openshift-default-5dfb7c4fff-r9gfw"
Jul 22 05:06:05.801166 ip-10-0-141-238 kubenswrapper[2563]: I0722 05:06:05.801139    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-b-db800e-openshift-default-5dfb7c4fff-r9gfw"]
Jul 22 05:06:05.802768 ip-10-0-141-238 kubenswrapper[2563]: W0722 05:06:05.802739    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddde7caa1_31e8_4bb2_bf9f_46e17e5ae1fb.slice/crio-02aa362ca7c097816568ce4716c04c8957c9ae59c9450cadb3b6c09245832eaa WatchSource:0}: Error finding container 02aa362ca7c097816568ce4716c04c8957c9ae59c9450cadb3b6c09245832eaa: Status 404 returned error can't find the container with id 02aa362ca7c097816568ce4716c04c8957c9ae59c9450cadb3b6c09245832eaa
Jul 22 05:06:05.804811 ip-10-0-141-238 kubenswrapper[2563]: I0722 05:06:05.804773    2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 22 05:06:05.804892 ip-10-0-141-238 kubenswrapper[2563]: I0722 05:06:05.804843    2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 22 05:06:05.804892 ip-10-0-141-238 kubenswrapper[2563]: I0722 05:06:05.804869    2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 22 05:06:06.490269 ip-10-0-141-238 kubenswrapper[2563]: I0722 05:06:06.490231    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-db800e-openshift-default-5dfb7c4fff-r9gfw" event={"ID":"dde7caa1-31e8-4bb2-bf9f-46e17e5ae1fb","Type":"ContainerStarted","Data":"2100a29741ca566b5ba684559695c9bda99b3e48eaca9e3e66330615ae7b0efb"}
Jul 22 05:06:06.490473 ip-10-0-141-238 kubenswrapper[2563]: I0722 05:06:06.490299    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-db800e-openshift-default-5dfb7c4fff-r9gfw" event={"ID":"dde7caa1-31e8-4bb2-bf9f-46e17e5ae1fb","Type":"ContainerStarted","Data":"02aa362ca7c097816568ce4716c04c8957c9ae59c9450cadb3b6c09245832eaa"}
Jul 22 05:06:06.513475 ip-10-0-141-238 kubenswrapper[2563]: I0722 05:06:06.513426    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-api-b-db800e-openshift-default-5dfb7c4fff-r9gfw" podStartSLOduration=1.513410859 podStartE2EDuration="1.513410859s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 05:06:05 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 05:06:06.511877452 +0000 UTC m=+2481.930886221" watchObservedRunningTime="2026-07-22 05:06:06.513410859 +0000 UTC m=+2481.932419616"
Jul 22 05:06:06.666695 ip-10-0-141-238 kubenswrapper[2563]: I0722 05:06:06.666658    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-b-db800e-openshift-default-5dfb7c4fff-r9gfw"
Jul 22 05:06:06.671375 ip-10-0-141-238 kubenswrapper[2563]: I0722 05:06:06.671353    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-b-db800e-openshift-default-5dfb7c4fff-r9gfw"
Jul 22 05:06:07.494951 ip-10-0-141-238 kubenswrapper[2563]: I0722 05:06:07.494917    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-b-db800e-openshift-default-5dfb7c4fff-r9gfw"
Jul 22 05:06:07.495759 ip-10-0-141-238 kubenswrapper[2563]: I0722 05:06:07.495739    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-b-db800e-openshift-default-5dfb7c4fff-r9gfw"
Jul 22 05:06:07.668556 ip-10-0-141-238 kubenswrapper[2563]: I0722 05:06:07.668515    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-wsdd9"]
Jul 22 05:06:08.463085 ip-10-0-141-238 kubenswrapper[2563]: I0722 05:06:08.463049    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j9gvx_b4af3ae5-fa65-4358-8399-6ed11b68616e/konnectivity-agent/0.log" limit=1024
Jul 22 05:06:08.559146 ip-10-0-141-238 kubenswrapper[2563]: I0722 05:06:08.559116    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j9gvx_b4af3ae5-fa65-4358-8399-6ed11b68616e/konnectivity-agent/0.log" limit=1024
Jul 22 05:06:08.625424 ip-10-0-141-238 kubenswrapper[2563]: I0722 05:06:08.625393    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j9gvx_b4af3ae5-fa65-4358-8399-6ed11b68616e/konnectivity-agent/0.log" limit=1024
Jul 22 05:06:08.778228 ip-10-0-141-238 kubenswrapper[2563]: I0722 05:06:08.778149    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j9gvx_b4af3ae5-fa65-4358-8399-6ed11b68616e/konnectivity-agent/0.log" limit=1024
Jul 22 05:06:09.239570 ip-10-0-141-238 kubenswrapper[2563]: I0722 05:06:09.239537    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j9gvx_b4af3ae5-fa65-4358-8399-6ed11b68616e/konnectivity-agent/0.log" limit=1024
Jul 22 05:06:09.337739 ip-10-0-141-238 kubenswrapper[2563]: I0722 05:06:09.337706    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j9gvx_b4af3ae5-fa65-4358-8399-6ed11b68616e/konnectivity-agent/0.log" limit=1024
Jul 22 05:06:12.879385 ip-10-0-141-238 kubenswrapper[2563]: I0722 05:06:12.879353    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j9gvx_b4af3ae5-fa65-4358-8399-6ed11b68616e/konnectivity-agent/0.log" limit=1024
Jul 22 05:06:20.876994 ip-10-0-141-238 kubenswrapper[2563]: I0722 05:06:20.876959    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-e75fa2-lczq6"]
Jul 22 05:06:20.877497 ip-10-0-141-238 kubenswrapper[2563]: I0722 05:06:20.877355    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="32bea398-c3f5-4d3b-86a0-85a016f7fbfe" containerName="istio-proxy"
Jul 22 05:06:20.877497 ip-10-0-141-238 kubenswrapper[2563]: I0722 05:06:20.877368    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="32bea398-c3f5-4d3b-86a0-85a016f7fbfe" containerName="istio-proxy"
Jul 22 05:06:20.881529 ip-10-0-141-238 kubenswrapper[2563]: I0722 05:06:20.881512    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-e75fa2-lczq6"
Jul 22 05:06:20.884089 ip-10-0-141-238 kubenswrapper[2563]: I0722 05:06:20.884058    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 22 05:06:20.884229 ip-10-0-141-238 kubenswrapper[2563]: I0722 05:06:20.884184    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-65v9v\""
Jul 22 05:06:20.885809 ip-10-0-141-238 kubenswrapper[2563]: I0722 05:06:20.885782    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-e75fa2-lczq6"]
Jul 22 05:06:20.951466 ip-10-0-141-238 kubenswrapper[2563]: I0722 05:06:20.951427    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/132ef70a-26e2-409b-906e-1ceef37b7dcb-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-api-a-e75fa2-lczq6\" (UID: \"132ef70a-26e2-409b-906e-1ceef37b7dcb\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-e75fa2-lczq6"
Jul 22 05:06:21.052779 ip-10-0-141-238 kubenswrapper[2563]: I0722 05:06:21.052731    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/132ef70a-26e2-409b-906e-1ceef37b7dcb-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-api-a-e75fa2-lczq6\" (UID: \"132ef70a-26e2-409b-906e-1ceef37b7dcb\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-e75fa2-lczq6"
Jul 22 05:06:21.053607 ip-10-0-141-238 kubenswrapper[2563]: I0722 05:06:21.053573    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/132ef70a-26e2-409b-906e-1ceef37b7dcb-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-api-a-e75fa2-lczq6\" (UID: \"132ef70a-26e2-409b-906e-1ceef37b7dcb\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-e75fa2-lczq6"
Jul 22 05:06:21.195317 ip-10-0-141-238 kubenswrapper[2563]: I0722 05:06:21.195287    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-e75fa2-lczq6"
Jul 22 05:06:21.359070 ip-10-0-141-238 kubenswrapper[2563]: I0722 05:06:21.353545    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-e75fa2-lczq6"]
Jul 22 05:06:21.365924 ip-10-0-141-238 kubenswrapper[2563]: W0722 05:06:21.365897    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod132ef70a_26e2_409b_906e_1ceef37b7dcb.slice/crio-53f28a32647e1778947efb47b421453aa72603c1632758a88123b62ec4e0f5cb WatchSource:0}: Error finding container 53f28a32647e1778947efb47b421453aa72603c1632758a88123b62ec4e0f5cb: Status 404 returned error can't find the container with id 53f28a32647e1778947efb47b421453aa72603c1632758a88123b62ec4e0f5cb
Jul 22 05:06:21.408805 ip-10-0-141-238 kubenswrapper[2563]: I0722 05:06:21.408784    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j9gvx_b4af3ae5-fa65-4358-8399-6ed11b68616e/konnectivity-agent/0.log" limit=1024
Jul 22 05:06:21.509944 ip-10-0-141-238 kubenswrapper[2563]: I0722 05:06:21.509857    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j9gvx_b4af3ae5-fa65-4358-8399-6ed11b68616e/konnectivity-agent/0.log" limit=1024
Jul 22 05:06:21.569589 ip-10-0-141-238 kubenswrapper[2563]: I0722 05:06:21.569546    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-e75fa2-lczq6" event={"ID":"132ef70a-26e2-409b-906e-1ceef37b7dcb","Type":"ContainerStarted","Data":"53f28a32647e1778947efb47b421453aa72603c1632758a88123b62ec4e0f5cb"}
Jul 22 05:06:22.576570 ip-10-0-141-238 kubenswrapper[2563]: I0722 05:06:22.576488    2563 generic.go:356] "Generic (PLEG): container finished" podID="132ef70a-26e2-409b-906e-1ceef37b7dcb" containerID="4c14d28d8705e6efaac10b696080b5544e73f8f393a6dcd912b65e127009488c" exitCode=0
Jul 22 05:06:22.576929 ip-10-0-141-238 kubenswrapper[2563]: I0722 05:06:22.576572    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-e75fa2-lczq6" event={"ID":"132ef70a-26e2-409b-906e-1ceef37b7dcb","Type":"ContainerDied","Data":"4c14d28d8705e6efaac10b696080b5544e73f8f393a6dcd912b65e127009488c"}
Jul 22 05:06:23.537227 ip-10-0-141-238 kubenswrapper[2563]: I0722 05:06:23.537178    2563 patch_prober.go:28] interesting pod/e2e-api-b-db800e-openshift-default-5dfb7c4fff-r9gfw container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.134.0.41:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Jul 22 05:06:23.537443 ip-10-0-141-238 kubenswrapper[2563]: I0722 05:06:23.537254    2563 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-api-b-db800e-openshift-default-5dfb7c4fff-r9gfw" podUID="dde7caa1-31e8-4bb2-bf9f-46e17e5ae1fb" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.41:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Jul 22 05:06:23.722637 ip-10-0-141-238 kubenswrapper[2563]: I0722 05:06:23.722608    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-e75fa2-lczq6"
Jul 22 05:06:23.783796 ip-10-0-141-238 kubenswrapper[2563]: I0722 05:06:23.783768    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/132ef70a-26e2-409b-906e-1ceef37b7dcb-maas-api-service-ca\") pod \"132ef70a-26e2-409b-906e-1ceef37b7dcb\" (UID: \"132ef70a-26e2-409b-906e-1ceef37b7dcb\") "
Jul 22 05:06:23.784169 ip-10-0-141-238 kubenswrapper[2563]: I0722 05:06:23.784149    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/132ef70a-26e2-409b-906e-1ceef37b7dcb-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "132ef70a-26e2-409b-906e-1ceef37b7dcb" (UID: "132ef70a-26e2-409b-906e-1ceef37b7dcb"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 22 05:06:23.884426 ip-10-0-141-238 kubenswrapper[2563]: I0722 05:06:23.884356    2563 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/132ef70a-26e2-409b-906e-1ceef37b7dcb-maas-api-service-ca\") on node \"ip-10-0-141-238.ec2.internal\" DevicePath \"\""
Jul 22 05:06:24.069909 ip-10-0-141-238 kubenswrapper[2563]: I0722 05:06:24.069878    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-wsdd9"]
Jul 22 05:06:24.586482 ip-10-0-141-238 kubenswrapper[2563]: I0722 05:06:24.586451    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-e75fa2-lczq6"
Jul 22 05:06:24.586651 ip-10-0-141-238 kubenswrapper[2563]: I0722 05:06:24.586453    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-e75fa2-lczq6" event={"ID":"132ef70a-26e2-409b-906e-1ceef37b7dcb","Type":"ContainerDied","Data":"53f28a32647e1778947efb47b421453aa72603c1632758a88123b62ec4e0f5cb"}
Jul 22 05:06:24.586651 ip-10-0-141-238 kubenswrapper[2563]: I0722 05:06:24.586575    2563 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="53f28a32647e1778947efb47b421453aa72603c1632758a88123b62ec4e0f5cb"
Jul 22 05:06:25.592731 ip-10-0-141-238 kubenswrapper[2563]: I0722 05:06:25.592690    2563 generic.go:356] "Generic (PLEG): container finished" podID="dde7caa1-31e8-4bb2-bf9f-46e17e5ae1fb" containerID="2100a29741ca566b5ba684559695c9bda99b3e48eaca9e3e66330615ae7b0efb" exitCode=0
Jul 22 05:06:25.593253 ip-10-0-141-238 kubenswrapper[2563]: I0722 05:06:25.592779    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-db800e-openshift-default-5dfb7c4fff-r9gfw" event={"ID":"dde7caa1-31e8-4bb2-bf9f-46e17e5ae1fb","Type":"ContainerDied","Data":"2100a29741ca566b5ba684559695c9bda99b3e48eaca9e3e66330615ae7b0efb"}
Jul 22 05:06:25.593316 ip-10-0-141-238 kubenswrapper[2563]: I0722 05:06:25.593286    2563 scope.go:117] "RemoveContainer" containerID="2100a29741ca566b5ba684559695c9bda99b3e48eaca9e3e66330615ae7b0efb"
Jul 22 05:06:25.594364 ip-10-0-141-238 kubenswrapper[2563]: I0722 05:06:25.594330    2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 22 05:06:25.594476 ip-10-0-141-238 kubenswrapper[2563]: I0722 05:06:25.594426    2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 22 05:06:25.594542 ip-10-0-141-238 kubenswrapper[2563]: I0722 05:06:25.594474    2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 22 05:06:26.599935 ip-10-0-141-238 kubenswrapper[2563]: I0722 05:06:26.599904    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-db800e-openshift-default-5dfb7c4fff-r9gfw" event={"ID":"dde7caa1-31e8-4bb2-bf9f-46e17e5ae1fb","Type":"ContainerStarted","Data":"e6ebf350f74e88b8efbb5ae33363938d8a992a058d1933385b5410bb973ea2df"}
Jul 22 05:06:26.666746 ip-10-0-141-238 kubenswrapper[2563]: I0722 05:06:26.666710    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-b-db800e-openshift-default-5dfb7c4fff-r9gfw"
Jul 22 05:06:26.667108 ip-10-0-141-238 kubenswrapper[2563]: I0722 05:06:26.667078    2563 patch_prober.go:28] interesting pod/e2e-api-b-db800e-openshift-default-5dfb7c4fff-r9gfw container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.41:15021/healthz/ready\": dial tcp 10.134.0.41:15021: connect: connection refused" start-of-body=
Jul 22 05:06:26.667238 ip-10-0-141-238 kubenswrapper[2563]: I0722 05:06:26.667129    2563 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-db800e-openshift-default-5dfb7c4fff-r9gfw" podUID="dde7caa1-31e8-4bb2-bf9f-46e17e5ae1fb" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.41:15021/healthz/ready\": dial tcp 10.134.0.41:15021: connect: connection refused"
Jul 22 05:06:27.667456 ip-10-0-141-238 kubenswrapper[2563]: I0722 05:06:27.667398    2563 patch_prober.go:28] interesting pod/e2e-api-b-db800e-openshift-default-5dfb7c4fff-r9gfw container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.41:15021/healthz/ready\": dial tcp 10.134.0.41:15021: connect: connection refused" start-of-body=
Jul 22 05:06:27.667858 ip-10-0-141-238 kubenswrapper[2563]: I0722 05:06:27.667478    2563 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-db800e-openshift-default-5dfb7c4fff-r9gfw" podUID="dde7caa1-31e8-4bb2-bf9f-46e17e5ae1fb" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.41:15021/healthz/ready\": dial tcp 10.134.0.41:15021: connect: connection refused"
Jul 22 05:06:28.666616 ip-10-0-141-238 kubenswrapper[2563]: I0722 05:06:28.666575    2563 patch_prober.go:28] interesting pod/e2e-api-b-db800e-openshift-default-5dfb7c4fff-r9gfw container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.41:15021/healthz/ready\": dial tcp 10.134.0.41:15021: connect: connection refused" start-of-body=
Jul 22 05:06:28.666794 ip-10-0-141-238 kubenswrapper[2563]: I0722 05:06:28.666633    2563 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-db800e-openshift-default-5dfb7c4fff-r9gfw" podUID="dde7caa1-31e8-4bb2-bf9f-46e17e5ae1fb" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.41:15021/healthz/ready\": dial tcp 10.134.0.41:15021: connect: connection refused"
Jul 22 05:06:29.666661 ip-10-0-141-238 kubenswrapper[2563]: I0722 05:06:29.666620    2563 patch_prober.go:28] interesting pod/e2e-api-b-db800e-openshift-default-5dfb7c4fff-r9gfw container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.41:15021/healthz/ready\": dial tcp 10.134.0.41:15021: connect: connection refused" start-of-body=
Jul 22 05:06:29.667098 ip-10-0-141-238 kubenswrapper[2563]: I0722 05:06:29.666678    2563 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-db800e-openshift-default-5dfb7c4fff-r9gfw" podUID="dde7caa1-31e8-4bb2-bf9f-46e17e5ae1fb" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.41:15021/healthz/ready\": dial tcp 10.134.0.41:15021: connect: connection refused"
Jul 22 05:06:29.994902 ip-10-0-141-238 kubenswrapper[2563]: I0722 05:06:29.994799    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j9gvx_b4af3ae5-fa65-4358-8399-6ed11b68616e/konnectivity-agent/0.log" limit=1024
Jul 22 05:06:30.679833 ip-10-0-141-238 kubenswrapper[2563]: I0722 05:06:30.679802    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-b-db800e-openshift-default-5dfb7c4fff-r9gfw"
Jul 22 05:06:30.680244 ip-10-0-141-238 kubenswrapper[2563]: I0722 05:06:30.680075    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-b-db800e-openshift-default-5dfb7c4fff-r9gfw"
Jul 22 05:06:30.680761 ip-10-0-141-238 kubenswrapper[2563]: I0722 05:06:30.680745    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-b-db800e-openshift-default-5dfb7c4fff-r9gfw"
Jul 22 05:06:31.414137 ip-10-0-141-238 kubenswrapper[2563]: I0722 05:06:31.414106    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j9gvx_b4af3ae5-fa65-4358-8399-6ed11b68616e/konnectivity-agent/0.log" limit=1024
Jul 22 05:06:31.708962 ip-10-0-141-238 kubenswrapper[2563]: I0722 05:06:31.708874    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j9gvx_b4af3ae5-fa65-4358-8399-6ed11b68616e/konnectivity-agent/0.log" limit=1024
Jul 22 05:06:31.808527 ip-10-0-141-238 kubenswrapper[2563]: I0722 05:06:31.808494    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j9gvx_b4af3ae5-fa65-4358-8399-6ed11b68616e/konnectivity-agent/0.log" limit=1024
Jul 22 05:06:36.956727 ip-10-0-141-238 kubenswrapper[2563]: I0722 05:06:36.956687    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j9gvx_b4af3ae5-fa65-4358-8399-6ed11b68616e/konnectivity-agent/0.log" limit=1024
Jul 22 05:06:39.869442 ip-10-0-141-238 kubenswrapper[2563]: I0722 05:06:39.869406    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-wsdd9"]
Jul 22 05:06:40.957699 ip-10-0-141-238 kubenswrapper[2563]: I0722 05:06:40.957664    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-e75fa2-lczq6"]
Jul 22 05:06:40.960050 ip-10-0-141-238 kubenswrapper[2563]: I0722 05:06:40.960017    2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-e75fa2-lczq6"]
Jul 22 05:06:40.961936 ip-10-0-141-238 kubenswrapper[2563]: I0722 05:06:40.961914    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j9gvx_b4af3ae5-fa65-4358-8399-6ed11b68616e/konnectivity-agent/0.log" limit=1024
Jul 22 05:06:41.065819 ip-10-0-141-238 kubenswrapper[2563]: I0722 05:06:41.065789    2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="132ef70a-26e2-409b-906e-1ceef37b7dcb" path="/var/lib/kubelet/pods/132ef70a-26e2-409b-906e-1ceef37b7dcb/volumes"
Jul 22 05:06:41.328709 ip-10-0-141-238 kubenswrapper[2563]: I0722 05:06:41.328620    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j9gvx_b4af3ae5-fa65-4358-8399-6ed11b68616e/konnectivity-agent/0.log" limit=1024
Jul 22 05:06:45.203599 ip-10-0-141-238 kubenswrapper[2563]: I0722 05:06:45.203567    2563 scope.go:117] "RemoveContainer" containerID="59ff6ab33c28a7883b7b09e87391637e4bff87d1f27de4ee59c0a54e44190d63"
Jul 22 05:06:47.051155 ip-10-0-141-238 kubenswrapper[2563]: I0722 05:06:47.051121    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j9gvx_b4af3ae5-fa65-4358-8399-6ed11b68616e/konnectivity-agent/0.log" limit=1024
Jul 22 05:06:47.122560 ip-10-0-141-238 kubenswrapper[2563]: I0722 05:06:47.122531    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j9gvx_b4af3ae5-fa65-4358-8399-6ed11b68616e/konnectivity-agent/0.log" limit=1024
Jul 22 05:06:47.297882 ip-10-0-141-238 kubenswrapper[2563]: I0722 05:06:47.297852    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j9gvx_b4af3ae5-fa65-4358-8399-6ed11b68616e/konnectivity-agent/0.log" limit=1024
Jul 22 05:06:47.529305 ip-10-0-141-238 kubenswrapper[2563]: I0722 05:06:47.529248    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j9gvx_b4af3ae5-fa65-4358-8399-6ed11b68616e/konnectivity-agent/0.log" limit=1024
Jul 22 05:06:48.179605 ip-10-0-141-238 kubenswrapper[2563]: I0722 05:06:48.179551    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j9gvx_b4af3ae5-fa65-4358-8399-6ed11b68616e/konnectivity-agent/0.log" limit=1024
Jul 22 05:06:48.280671 ip-10-0-141-238 kubenswrapper[2563]: I0722 05:06:48.280622    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j9gvx_b4af3ae5-fa65-4358-8399-6ed11b68616e/konnectivity-agent/0.log" limit=1024
Jul 22 05:06:58.715855 ip-10-0-141-238 kubenswrapper[2563]: I0722 05:06:58.715780    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j9gvx_b4af3ae5-fa65-4358-8399-6ed11b68616e/konnectivity-agent/0.log" limit=1024
Jul 22 05:06:58.816379 ip-10-0-141-238 kubenswrapper[2563]: I0722 05:06:58.816348    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j9gvx_b4af3ae5-fa65-4358-8399-6ed11b68616e/konnectivity-agent/0.log" limit=1024
Jul 22 05:07:03.061853 ip-10-0-141-238 kubenswrapper[2563]: I0722 05:07:03.061817    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j9gvx_b4af3ae5-fa65-4358-8399-6ed11b68616e/konnectivity-agent/0.log" limit=1024
Jul 22 05:07:07.715909 ip-10-0-141-238 kubenswrapper[2563]: I0722 05:07:07.715873    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j9gvx_b4af3ae5-fa65-4358-8399-6ed11b68616e/konnectivity-agent/0.log" limit=1024
Jul 22 05:07:08.089441 ip-10-0-141-238 kubenswrapper[2563]: I0722 05:07:08.089359    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j9gvx_b4af3ae5-fa65-4358-8399-6ed11b68616e/konnectivity-agent/0.log" limit=1024
Jul 22 05:07:08.270425 ip-10-0-141-238 kubenswrapper[2563]: I0722 05:07:08.270391    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-wsdd9"]
Jul 22 05:07:13.879271 ip-10-0-141-238 kubenswrapper[2563]: I0722 05:07:13.879240    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j9gvx_b4af3ae5-fa65-4358-8399-6ed11b68616e/konnectivity-agent/0.log" limit=1024
Jul 22 05:07:13.980907 ip-10-0-141-238 kubenswrapper[2563]: I0722 05:07:13.980866    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j9gvx_b4af3ae5-fa65-4358-8399-6ed11b68616e/konnectivity-agent/0.log" limit=1024
Jul 22 05:07:14.119336 ip-10-0-141-238 kubenswrapper[2563]: I0722 05:07:14.119301    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-b-db800e-openshift-default-5dfb7c4fff-r9gfw"]
Jul 22 05:07:14.120162 ip-10-0-141-238 kubenswrapper[2563]: I0722 05:07:14.119975    2563 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-api-b-db800e-openshift-default-5dfb7c4fff-r9gfw" podUID="dde7caa1-31e8-4bb2-bf9f-46e17e5ae1fb" containerName="istio-proxy" containerID="cri-o://e6ebf350f74e88b8efbb5ae33363938d8a992a058d1933385b5410bb973ea2df" gracePeriod=30
Jul 22 05:07:14.145971 ip-10-0-141-238 kubenswrapper[2563]: I0722 05:07:14.145902    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j9gvx_b4af3ae5-fa65-4358-8399-6ed11b68616e/konnectivity-agent/0.log" limit=1024
Jul 22 05:07:14.366031 ip-10-0-141-238 kubenswrapper[2563]: I0722 05:07:14.365993    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j9gvx_b4af3ae5-fa65-4358-8399-6ed11b68616e/konnectivity-agent/0.log" limit=1024
Jul 22 05:07:14.712761 ip-10-0-141-238 kubenswrapper[2563]: I0722 05:07:14.712719    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j9gvx_b4af3ae5-fa65-4358-8399-6ed11b68616e/konnectivity-agent/0.log" limit=1024
Jul 22 05:07:15.006580 ip-10-0-141-238 kubenswrapper[2563]: I0722 05:07:15.006485    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j9gvx_b4af3ae5-fa65-4358-8399-6ed11b68616e/konnectivity-agent/0.log" limit=1024
Jul 22 05:07:15.294147 ip-10-0-141-238 kubenswrapper[2563]: I0722 05:07:15.294058    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j9gvx_b4af3ae5-fa65-4358-8399-6ed11b68616e/konnectivity-agent/0.log" limit=1024
Jul 22 05:07:15.682719 ip-10-0-141-238 kubenswrapper[2563]: I0722 05:07:15.682683    2563 patch_prober.go:28] interesting pod/e2e-api-b-db800e-openshift-default-5dfb7c4fff-r9gfw container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Jul 22 05:07:15.682892 ip-10-0-141-238 kubenswrapper[2563]: I0722 05:07:15.682749    2563 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-api-b-db800e-openshift-default-5dfb7c4fff-r9gfw" podUID="dde7caa1-31e8-4bb2-bf9f-46e17e5ae1fb" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 22 05:07:17.511439 ip-10-0-141-238 kubenswrapper[2563]: I0722 05:07:17.511408    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j9gvx_b4af3ae5-fa65-4358-8399-6ed11b68616e/konnectivity-agent/0.log" limit=1024
Jul 22 05:07:17.611561 ip-10-0-141-238 kubenswrapper[2563]: I0722 05:07:17.611503    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j9gvx_b4af3ae5-fa65-4358-8399-6ed11b68616e/konnectivity-agent/0.log" limit=1024
Jul 22 05:07:17.722348 ip-10-0-141-238 kubenswrapper[2563]: I0722 05:07:17.722317    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j9gvx_b4af3ae5-fa65-4358-8399-6ed11b68616e/konnectivity-agent/0.log" limit=1024
Jul 22 05:07:18.183925 ip-10-0-141-238 kubenswrapper[2563]: I0722 05:07:18.183892    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j9gvx_b4af3ae5-fa65-4358-8399-6ed11b68616e/konnectivity-agent/0.log" limit=1024
Jul 22 05:07:18.293742 ip-10-0-141-238 kubenswrapper[2563]: I0722 05:07:18.293714    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j9gvx_b4af3ae5-fa65-4358-8399-6ed11b68616e/konnectivity-agent/0.log" limit=1024
Jul 22 05:07:18.395335 ip-10-0-141-238 kubenswrapper[2563]: I0722 05:07:18.395303    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j9gvx_b4af3ae5-fa65-4358-8399-6ed11b68616e/konnectivity-agent/0.log" limit=1024
Jul 22 05:07:19.384564 ip-10-0-141-238 kubenswrapper[2563]: I0722 05:07:19.384540    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-db800e-openshift-default-5dfb7c4fff-r9gfw"
Jul 22 05:07:19.474741 ip-10-0-141-238 kubenswrapper[2563]: I0722 05:07:19.474708    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/dde7caa1-31e8-4bb2-bf9f-46e17e5ae1fb-workload-certs\") pod \"dde7caa1-31e8-4bb2-bf9f-46e17e5ae1fb\" (UID: \"dde7caa1-31e8-4bb2-bf9f-46e17e5ae1fb\") "
Jul 22 05:07:19.474933 ip-10-0-141-238 kubenswrapper[2563]: I0722 05:07:19.474764    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-j58d2\" (UniqueName: \"kubernetes.io/projected/dde7caa1-31e8-4bb2-bf9f-46e17e5ae1fb-kube-api-access-j58d2\") pod \"dde7caa1-31e8-4bb2-bf9f-46e17e5ae1fb\" (UID: \"dde7caa1-31e8-4bb2-bf9f-46e17e5ae1fb\") "
Jul 22 05:07:19.474933 ip-10-0-141-238 kubenswrapper[2563]: I0722 05:07:19.474782    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/dde7caa1-31e8-4bb2-bf9f-46e17e5ae1fb-istio-token\") pod \"dde7caa1-31e8-4bb2-bf9f-46e17e5ae1fb\" (UID: \"dde7caa1-31e8-4bb2-bf9f-46e17e5ae1fb\") "
Jul 22 05:07:19.474933 ip-10-0-141-238 kubenswrapper[2563]: I0722 05:07:19.474808    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/dde7caa1-31e8-4bb2-bf9f-46e17e5ae1fb-istio-data\") pod \"dde7caa1-31e8-4bb2-bf9f-46e17e5ae1fb\" (UID: \"dde7caa1-31e8-4bb2-bf9f-46e17e5ae1fb\") "
Jul 22 05:07:19.474933 ip-10-0-141-238 kubenswrapper[2563]: I0722 05:07:19.474838    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/dde7caa1-31e8-4bb2-bf9f-46e17e5ae1fb-workload-socket\") pod \"dde7caa1-31e8-4bb2-bf9f-46e17e5ae1fb\" (UID: \"dde7caa1-31e8-4bb2-bf9f-46e17e5ae1fb\") "
Jul 22 05:07:19.474933 ip-10-0-141-238 kubenswrapper[2563]: I0722 05:07:19.474901    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/dde7caa1-31e8-4bb2-bf9f-46e17e5ae1fb-credential-socket\") pod \"dde7caa1-31e8-4bb2-bf9f-46e17e5ae1fb\" (UID: \"dde7caa1-31e8-4bb2-bf9f-46e17e5ae1fb\") "
Jul 22 05:07:19.474933 ip-10-0-141-238 kubenswrapper[2563]: I0722 05:07:19.474925    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/dde7caa1-31e8-4bb2-bf9f-46e17e5ae1fb-istiod-ca-cert\") pod \"dde7caa1-31e8-4bb2-bf9f-46e17e5ae1fb\" (UID: \"dde7caa1-31e8-4bb2-bf9f-46e17e5ae1fb\") "
Jul 22 05:07:19.475266 ip-10-0-141-238 kubenswrapper[2563]: I0722 05:07:19.474952    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/dde7caa1-31e8-4bb2-bf9f-46e17e5ae1fb-istio-podinfo\") pod \"dde7caa1-31e8-4bb2-bf9f-46e17e5ae1fb\" (UID: \"dde7caa1-31e8-4bb2-bf9f-46e17e5ae1fb\") "
Jul 22 05:07:19.475266 ip-10-0-141-238 kubenswrapper[2563]: I0722 05:07:19.474978    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/dde7caa1-31e8-4bb2-bf9f-46e17e5ae1fb-istio-envoy\") pod \"dde7caa1-31e8-4bb2-bf9f-46e17e5ae1fb\" (UID: \"dde7caa1-31e8-4bb2-bf9f-46e17e5ae1fb\") "
Jul 22 05:07:19.475266 ip-10-0-141-238 kubenswrapper[2563]: I0722 05:07:19.475005    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/dde7caa1-31e8-4bb2-bf9f-46e17e5ae1fb-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "dde7caa1-31e8-4bb2-bf9f-46e17e5ae1fb" (UID: "dde7caa1-31e8-4bb2-bf9f-46e17e5ae1fb"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 22 05:07:19.475266 ip-10-0-141-238 kubenswrapper[2563]: I0722 05:07:19.475238    2563 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/dde7caa1-31e8-4bb2-bf9f-46e17e5ae1fb-workload-certs\") on node \"ip-10-0-141-238.ec2.internal\" DevicePath \"\""
Jul 22 05:07:19.475537 ip-10-0-141-238 kubenswrapper[2563]: I0722 05:07:19.475501    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/dde7caa1-31e8-4bb2-bf9f-46e17e5ae1fb-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "dde7caa1-31e8-4bb2-bf9f-46e17e5ae1fb" (UID: "dde7caa1-31e8-4bb2-bf9f-46e17e5ae1fb"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 22 05:07:19.475842 ip-10-0-141-238 kubenswrapper[2563]: I0722 05:07:19.475805    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/dde7caa1-31e8-4bb2-bf9f-46e17e5ae1fb-istio-data" (OuterVolumeSpecName: "istio-data") pod "dde7caa1-31e8-4bb2-bf9f-46e17e5ae1fb" (UID: "dde7caa1-31e8-4bb2-bf9f-46e17e5ae1fb"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 22 05:07:19.475842 ip-10-0-141-238 kubenswrapper[2563]: I0722 05:07:19.475819    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/dde7caa1-31e8-4bb2-bf9f-46e17e5ae1fb-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "dde7caa1-31e8-4bb2-bf9f-46e17e5ae1fb" (UID: "dde7caa1-31e8-4bb2-bf9f-46e17e5ae1fb"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 22 05:07:19.476075 ip-10-0-141-238 kubenswrapper[2563]: I0722 05:07:19.476053    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/dde7caa1-31e8-4bb2-bf9f-46e17e5ae1fb-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "dde7caa1-31e8-4bb2-bf9f-46e17e5ae1fb" (UID: "dde7caa1-31e8-4bb2-bf9f-46e17e5ae1fb"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 22 05:07:19.477402 ip-10-0-141-238 kubenswrapper[2563]: I0722 05:07:19.477382    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/dde7caa1-31e8-4bb2-bf9f-46e17e5ae1fb-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "dde7caa1-31e8-4bb2-bf9f-46e17e5ae1fb" (UID: "dde7caa1-31e8-4bb2-bf9f-46e17e5ae1fb"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 22 05:07:19.477561 ip-10-0-141-238 kubenswrapper[2563]: I0722 05:07:19.477542    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/dde7caa1-31e8-4bb2-bf9f-46e17e5ae1fb-istio-token" (OuterVolumeSpecName: "istio-token") pod "dde7caa1-31e8-4bb2-bf9f-46e17e5ae1fb" (UID: "dde7caa1-31e8-4bb2-bf9f-46e17e5ae1fb"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 22 05:07:19.477714 ip-10-0-141-238 kubenswrapper[2563]: I0722 05:07:19.477689    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/dde7caa1-31e8-4bb2-bf9f-46e17e5ae1fb-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "dde7caa1-31e8-4bb2-bf9f-46e17e5ae1fb" (UID: "dde7caa1-31e8-4bb2-bf9f-46e17e5ae1fb"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 22 05:07:19.478052 ip-10-0-141-238 kubenswrapper[2563]: I0722 05:07:19.478015    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/dde7caa1-31e8-4bb2-bf9f-46e17e5ae1fb-kube-api-access-j58d2" (OuterVolumeSpecName: "kube-api-access-j58d2") pod "dde7caa1-31e8-4bb2-bf9f-46e17e5ae1fb" (UID: "dde7caa1-31e8-4bb2-bf9f-46e17e5ae1fb"). InnerVolumeSpecName "kube-api-access-j58d2". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 22 05:07:19.576003 ip-10-0-141-238 kubenswrapper[2563]: I0722 05:07:19.575970    2563 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/dde7caa1-31e8-4bb2-bf9f-46e17e5ae1fb-workload-socket\") on node \"ip-10-0-141-238.ec2.internal\" DevicePath \"\""
Jul 22 05:07:19.576003 ip-10-0-141-238 kubenswrapper[2563]: I0722 05:07:19.575997    2563 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/dde7caa1-31e8-4bb2-bf9f-46e17e5ae1fb-credential-socket\") on node \"ip-10-0-141-238.ec2.internal\" DevicePath \"\""
Jul 22 05:07:19.576003 ip-10-0-141-238 kubenswrapper[2563]: I0722 05:07:19.576011    2563 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/dde7caa1-31e8-4bb2-bf9f-46e17e5ae1fb-istiod-ca-cert\") on node \"ip-10-0-141-238.ec2.internal\" DevicePath \"\""
Jul 22 05:07:19.576257 ip-10-0-141-238 kubenswrapper[2563]: I0722 05:07:19.576023    2563 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/dde7caa1-31e8-4bb2-bf9f-46e17e5ae1fb-istio-podinfo\") on node \"ip-10-0-141-238.ec2.internal\" DevicePath \"\""
Jul 22 05:07:19.576257 ip-10-0-141-238 kubenswrapper[2563]: I0722 05:07:19.576033    2563 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/dde7caa1-31e8-4bb2-bf9f-46e17e5ae1fb-istio-envoy\") on node \"ip-10-0-141-238.ec2.internal\" DevicePath \"\""
Jul 22 05:07:19.576257 ip-10-0-141-238 kubenswrapper[2563]: I0722 05:07:19.576069    2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-j58d2\" (UniqueName: \"kubernetes.io/projected/dde7caa1-31e8-4bb2-bf9f-46e17e5ae1fb-kube-api-access-j58d2\") on node \"ip-10-0-141-238.ec2.internal\" DevicePath \"\""
Jul 22 05:07:19.576257 ip-10-0-141-238 kubenswrapper[2563]: I0722 05:07:19.576080    2563 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/dde7caa1-31e8-4bb2-bf9f-46e17e5ae1fb-istio-token\") on node \"ip-10-0-141-238.ec2.internal\" DevicePath \"\""
Jul 22 05:07:19.576257 ip-10-0-141-238 kubenswrapper[2563]: I0722 05:07:19.576091    2563 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/dde7caa1-31e8-4bb2-bf9f-46e17e5ae1fb-istio-data\") on node \"ip-10-0-141-238.ec2.internal\" DevicePath \"\""
Jul 22 05:07:19.844708 ip-10-0-141-238 kubenswrapper[2563]: I0722 05:07:19.844614    2563 generic.go:356] "Generic (PLEG): container finished" podID="dde7caa1-31e8-4bb2-bf9f-46e17e5ae1fb" containerID="e6ebf350f74e88b8efbb5ae33363938d8a992a058d1933385b5410bb973ea2df" exitCode=0
Jul 22 05:07:19.844708 ip-10-0-141-238 kubenswrapper[2563]: I0722 05:07:19.844655    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-db800e-openshift-default-5dfb7c4fff-r9gfw" event={"ID":"dde7caa1-31e8-4bb2-bf9f-46e17e5ae1fb","Type":"ContainerDied","Data":"e6ebf350f74e88b8efbb5ae33363938d8a992a058d1933385b5410bb973ea2df"}
Jul 22 05:07:19.844708 ip-10-0-141-238 kubenswrapper[2563]: I0722 05:07:19.844683    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-db800e-openshift-default-5dfb7c4fff-r9gfw"
Jul 22 05:07:19.844992 ip-10-0-141-238 kubenswrapper[2563]: I0722 05:07:19.844720    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-db800e-openshift-default-5dfb7c4fff-r9gfw" event={"ID":"dde7caa1-31e8-4bb2-bf9f-46e17e5ae1fb","Type":"ContainerDied","Data":"02aa362ca7c097816568ce4716c04c8957c9ae59c9450cadb3b6c09245832eaa"}
Jul 22 05:07:19.844992 ip-10-0-141-238 kubenswrapper[2563]: I0722 05:07:19.844743    2563 scope.go:117] "RemoveContainer" containerID="e6ebf350f74e88b8efbb5ae33363938d8a992a058d1933385b5410bb973ea2df"
Jul 22 05:07:19.853668 ip-10-0-141-238 kubenswrapper[2563]: I0722 05:07:19.853651    2563 scope.go:117] "RemoveContainer" containerID="2100a29741ca566b5ba684559695c9bda99b3e48eaca9e3e66330615ae7b0efb"
Jul 22 05:07:19.861291 ip-10-0-141-238 kubenswrapper[2563]: I0722 05:07:19.861274    2563 scope.go:117] "RemoveContainer" containerID="e6ebf350f74e88b8efbb5ae33363938d8a992a058d1933385b5410bb973ea2df"
Jul 22 05:07:19.861517 ip-10-0-141-238 kubenswrapper[2563]: E0722 05:07:19.861500    2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e6ebf350f74e88b8efbb5ae33363938d8a992a058d1933385b5410bb973ea2df\": container with ID starting with e6ebf350f74e88b8efbb5ae33363938d8a992a058d1933385b5410bb973ea2df not found: ID does not exist" containerID="e6ebf350f74e88b8efbb5ae33363938d8a992a058d1933385b5410bb973ea2df"
Jul 22 05:07:19.861559 ip-10-0-141-238 kubenswrapper[2563]: I0722 05:07:19.861524    2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e6ebf350f74e88b8efbb5ae33363938d8a992a058d1933385b5410bb973ea2df"} err="failed to get container status \"e6ebf350f74e88b8efbb5ae33363938d8a992a058d1933385b5410bb973ea2df\": rpc error: code = NotFound desc = could not find container \"e6ebf350f74e88b8efbb5ae33363938d8a992a058d1933385b5410bb973ea2df\": container with ID starting with e6ebf350f74e88b8efbb5ae33363938d8a992a058d1933385b5410bb973ea2df not found: ID does not exist"
Jul 22 05:07:19.861559 ip-10-0-141-238 kubenswrapper[2563]: I0722 05:07:19.861545    2563 scope.go:117] "RemoveContainer" containerID="2100a29741ca566b5ba684559695c9bda99b3e48eaca9e3e66330615ae7b0efb"
Jul 22 05:07:19.861785 ip-10-0-141-238 kubenswrapper[2563]: E0722 05:07:19.861767    2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2100a29741ca566b5ba684559695c9bda99b3e48eaca9e3e66330615ae7b0efb\": container with ID starting with 2100a29741ca566b5ba684559695c9bda99b3e48eaca9e3e66330615ae7b0efb not found: ID does not exist" containerID="2100a29741ca566b5ba684559695c9bda99b3e48eaca9e3e66330615ae7b0efb"
Jul 22 05:07:19.861824 ip-10-0-141-238 kubenswrapper[2563]: I0722 05:07:19.861792    2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2100a29741ca566b5ba684559695c9bda99b3e48eaca9e3e66330615ae7b0efb"} err="failed to get container status \"2100a29741ca566b5ba684559695c9bda99b3e48eaca9e3e66330615ae7b0efb\": rpc error: code = NotFound desc = could not find container \"2100a29741ca566b5ba684559695c9bda99b3e48eaca9e3e66330615ae7b0efb\": container with ID starting with 2100a29741ca566b5ba684559695c9bda99b3e48eaca9e3e66330615ae7b0efb not found: ID does not exist"
Jul 22 05:07:19.867944 ip-10-0-141-238 kubenswrapper[2563]: I0722 05:07:19.867924    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-b-db800e-openshift-default-5dfb7c4fff-r9gfw"]
Jul 22 05:07:19.874005 ip-10-0-141-238 kubenswrapper[2563]: I0722 05:07:19.873984    2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-api-b-db800e-openshift-default-5dfb7c4fff-r9gfw"]
Jul 22 05:07:21.069665 ip-10-0-141-238 kubenswrapper[2563]: I0722 05:07:21.069629    2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="dde7caa1-31e8-4bb2-bf9f-46e17e5ae1fb" path="/var/lib/kubelet/pods/dde7caa1-31e8-4bb2-bf9f-46e17e5ae1fb/volumes"
Jul 22 05:07:21.974350 ip-10-0-141-238 kubenswrapper[2563]: I0722 05:07:21.974318    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j9gvx_b4af3ae5-fa65-4358-8399-6ed11b68616e/konnectivity-agent/0.log" limit=1024
Jul 22 05:07:22.297788 ip-10-0-141-238 kubenswrapper[2563]: I0722 05:07:22.297703    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j9gvx_b4af3ae5-fa65-4358-8399-6ed11b68616e/konnectivity-agent/0.log" limit=1024
Jul 22 05:07:22.563125 ip-10-0-141-238 kubenswrapper[2563]: I0722 05:07:22.563050    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-shared-b-0c4b46-openshift-default-79d674695f-9fqkl"]
Jul 22 05:07:22.563391 ip-10-0-141-238 kubenswrapper[2563]: I0722 05:07:22.563370    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="dde7caa1-31e8-4bb2-bf9f-46e17e5ae1fb" containerName="istio-proxy"
Jul 22 05:07:22.563391 ip-10-0-141-238 kubenswrapper[2563]: I0722 05:07:22.563385    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="dde7caa1-31e8-4bb2-bf9f-46e17e5ae1fb" containerName="istio-proxy"
Jul 22 05:07:22.563555 ip-10-0-141-238 kubenswrapper[2563]: I0722 05:07:22.563403    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="dde7caa1-31e8-4bb2-bf9f-46e17e5ae1fb" containerName="istio-proxy"
Jul 22 05:07:22.563555 ip-10-0-141-238 kubenswrapper[2563]: I0722 05:07:22.563410    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="dde7caa1-31e8-4bb2-bf9f-46e17e5ae1fb" containerName="istio-proxy"
Jul 22 05:07:22.563555 ip-10-0-141-238 kubenswrapper[2563]: I0722 05:07:22.563417    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="132ef70a-26e2-409b-906e-1ceef37b7dcb" containerName="revoke-keys"
Jul 22 05:07:22.563555 ip-10-0-141-238 kubenswrapper[2563]: I0722 05:07:22.563423    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="132ef70a-26e2-409b-906e-1ceef37b7dcb" containerName="revoke-keys"
Jul 22 05:07:22.563555 ip-10-0-141-238 kubenswrapper[2563]: I0722 05:07:22.563474    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="dde7caa1-31e8-4bb2-bf9f-46e17e5ae1fb" containerName="istio-proxy"
Jul 22 05:07:22.563555 ip-10-0-141-238 kubenswrapper[2563]: I0722 05:07:22.563484    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="132ef70a-26e2-409b-906e-1ceef37b7dcb" containerName="revoke-keys"
Jul 22 05:07:22.566226 ip-10-0-141-238 kubenswrapper[2563]: I0722 05:07:22.566209    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-0c4b46-openshift-default-79d674695f-9fqkl"
Jul 22 05:07:22.568797 ip-10-0-141-238 kubenswrapper[2563]: I0722 05:07:22.568773    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-shared-b-0c4b46-openshift-default-dockercfg-c8mhq\""
Jul 22 05:07:22.580265 ip-10-0-141-238 kubenswrapper[2563]: I0722 05:07:22.580242    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-b-0c4b46-openshift-default-79d674695f-9fqkl"]
Jul 22 05:07:22.603167 ip-10-0-141-238 kubenswrapper[2563]: I0722 05:07:22.603138    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j9gvx_b4af3ae5-fa65-4358-8399-6ed11b68616e/konnectivity-agent/0.log" limit=1024
Jul 22 05:07:22.702937 ip-10-0-141-238 kubenswrapper[2563]: I0722 05:07:22.702901    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d20629aa-181c-42c8-a9ad-4e2c1fb649d4-credential-socket\") pod \"e2e-shared-b-0c4b46-openshift-default-79d674695f-9fqkl\" (UID: \"d20629aa-181c-42c8-a9ad-4e2c1fb649d4\") " pod="openshift-ingress/e2e-shared-b-0c4b46-openshift-default-79d674695f-9fqkl"
Jul 22 05:07:22.703155 ip-10-0-141-238 kubenswrapper[2563]: I0722 05:07:22.702987    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d20629aa-181c-42c8-a9ad-4e2c1fb649d4-istio-data\") pod \"e2e-shared-b-0c4b46-openshift-default-79d674695f-9fqkl\" (UID: \"d20629aa-181c-42c8-a9ad-4e2c1fb649d4\") " pod="openshift-ingress/e2e-shared-b-0c4b46-openshift-default-79d674695f-9fqkl"
Jul 22 05:07:22.703155 ip-10-0-141-238 kubenswrapper[2563]: I0722 05:07:22.703053    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-t4r5r\" (UniqueName: \"kubernetes.io/projected/d20629aa-181c-42c8-a9ad-4e2c1fb649d4-kube-api-access-t4r5r\") pod \"e2e-shared-b-0c4b46-openshift-default-79d674695f-9fqkl\" (UID: \"d20629aa-181c-42c8-a9ad-4e2c1fb649d4\") " pod="openshift-ingress/e2e-shared-b-0c4b46-openshift-default-79d674695f-9fqkl"
Jul 22 05:07:22.703155 ip-10-0-141-238 kubenswrapper[2563]: I0722 05:07:22.703084    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d20629aa-181c-42c8-a9ad-4e2c1fb649d4-workload-socket\") pod \"e2e-shared-b-0c4b46-openshift-default-79d674695f-9fqkl\" (UID: \"d20629aa-181c-42c8-a9ad-4e2c1fb649d4\") " pod="openshift-ingress/e2e-shared-b-0c4b46-openshift-default-79d674695f-9fqkl"
Jul 22 05:07:22.703155 ip-10-0-141-238 kubenswrapper[2563]: I0722 05:07:22.703106    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d20629aa-181c-42c8-a9ad-4e2c1fb649d4-istiod-ca-cert\") pod \"e2e-shared-b-0c4b46-openshift-default-79d674695f-9fqkl\" (UID: \"d20629aa-181c-42c8-a9ad-4e2c1fb649d4\") " pod="openshift-ingress/e2e-shared-b-0c4b46-openshift-default-79d674695f-9fqkl"
Jul 22 05:07:22.703358 ip-10-0-141-238 kubenswrapper[2563]: I0722 05:07:22.703151    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d20629aa-181c-42c8-a9ad-4e2c1fb649d4-istio-token\") pod \"e2e-shared-b-0c4b46-openshift-default-79d674695f-9fqkl\" (UID: \"d20629aa-181c-42c8-a9ad-4e2c1fb649d4\") " pod="openshift-ingress/e2e-shared-b-0c4b46-openshift-default-79d674695f-9fqkl"
Jul 22 05:07:22.703358 ip-10-0-141-238 kubenswrapper[2563]: I0722 05:07:22.703184    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d20629aa-181c-42c8-a9ad-4e2c1fb649d4-istio-envoy\") pod \"e2e-shared-b-0c4b46-openshift-default-79d674695f-9fqkl\" (UID: \"d20629aa-181c-42c8-a9ad-4e2c1fb649d4\") " pod="openshift-ingress/e2e-shared-b-0c4b46-openshift-default-79d674695f-9fqkl"
Jul 22 05:07:22.703358 ip-10-0-141-238 kubenswrapper[2563]: I0722 05:07:22.703207    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d20629aa-181c-42c8-a9ad-4e2c1fb649d4-workload-certs\") pod \"e2e-shared-b-0c4b46-openshift-default-79d674695f-9fqkl\" (UID: \"d20629aa-181c-42c8-a9ad-4e2c1fb649d4\") " pod="openshift-ingress/e2e-shared-b-0c4b46-openshift-default-79d674695f-9fqkl"
Jul 22 05:07:22.703358 ip-10-0-141-238 kubenswrapper[2563]: I0722 05:07:22.703263    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d20629aa-181c-42c8-a9ad-4e2c1fb649d4-istio-podinfo\") pod \"e2e-shared-b-0c4b46-openshift-default-79d674695f-9fqkl\" (UID: \"d20629aa-181c-42c8-a9ad-4e2c1fb649d4\") " pod="openshift-ingress/e2e-shared-b-0c4b46-openshift-default-79d674695f-9fqkl"
Jul 22 05:07:22.712067 ip-10-0-141-238 kubenswrapper[2563]: I0722 05:07:22.712027    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j9gvx_b4af3ae5-fa65-4358-8399-6ed11b68616e/konnectivity-agent/0.log" limit=1024
Jul 22 05:07:22.804237 ip-10-0-141-238 kubenswrapper[2563]: I0722 05:07:22.804206    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d20629aa-181c-42c8-a9ad-4e2c1fb649d4-istiod-ca-cert\") pod \"e2e-shared-b-0c4b46-openshift-default-79d674695f-9fqkl\" (UID: \"d20629aa-181c-42c8-a9ad-4e2c1fb649d4\") " pod="openshift-ingress/e2e-shared-b-0c4b46-openshift-default-79d674695f-9fqkl"
Jul 22 05:07:22.804237 ip-10-0-141-238 kubenswrapper[2563]: I0722 05:07:22.804245    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d20629aa-181c-42c8-a9ad-4e2c1fb649d4-istio-token\") pod \"e2e-shared-b-0c4b46-openshift-default-79d674695f-9fqkl\" (UID: \"d20629aa-181c-42c8-a9ad-4e2c1fb649d4\") " pod="openshift-ingress/e2e-shared-b-0c4b46-openshift-default-79d674695f-9fqkl"
Jul 22 05:07:22.804461 ip-10-0-141-238 kubenswrapper[2563]: I0722 05:07:22.804268    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d20629aa-181c-42c8-a9ad-4e2c1fb649d4-istio-envoy\") pod \"e2e-shared-b-0c4b46-openshift-default-79d674695f-9fqkl\" (UID: \"d20629aa-181c-42c8-a9ad-4e2c1fb649d4\") " pod="openshift-ingress/e2e-shared-b-0c4b46-openshift-default-79d674695f-9fqkl"
Jul 22 05:07:22.804461 ip-10-0-141-238 kubenswrapper[2563]: I0722 05:07:22.804299    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d20629aa-181c-42c8-a9ad-4e2c1fb649d4-workload-certs\") pod \"e2e-shared-b-0c4b46-openshift-default-79d674695f-9fqkl\" (UID: \"d20629aa-181c-42c8-a9ad-4e2c1fb649d4\") " pod="openshift-ingress/e2e-shared-b-0c4b46-openshift-default-79d674695f-9fqkl"
Jul 22 05:07:22.804461 ip-10-0-141-238 kubenswrapper[2563]: I0722 05:07:22.804325    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d20629aa-181c-42c8-a9ad-4e2c1fb649d4-istio-podinfo\") pod \"e2e-shared-b-0c4b46-openshift-default-79d674695f-9fqkl\" (UID: \"d20629aa-181c-42c8-a9ad-4e2c1fb649d4\") " pod="openshift-ingress/e2e-shared-b-0c4b46-openshift-default-79d674695f-9fqkl"
Jul 22 05:07:22.804461 ip-10-0-141-238 kubenswrapper[2563]: I0722 05:07:22.804364    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d20629aa-181c-42c8-a9ad-4e2c1fb649d4-credential-socket\") pod \"e2e-shared-b-0c4b46-openshift-default-79d674695f-9fqkl\" (UID: \"d20629aa-181c-42c8-a9ad-4e2c1fb649d4\") " pod="openshift-ingress/e2e-shared-b-0c4b46-openshift-default-79d674695f-9fqkl"
Jul 22 05:07:22.804461 ip-10-0-141-238 kubenswrapper[2563]: I0722 05:07:22.804451    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d20629aa-181c-42c8-a9ad-4e2c1fb649d4-istio-data\") pod \"e2e-shared-b-0c4b46-openshift-default-79d674695f-9fqkl\" (UID: \"d20629aa-181c-42c8-a9ad-4e2c1fb649d4\") " pod="openshift-ingress/e2e-shared-b-0c4b46-openshift-default-79d674695f-9fqkl"
Jul 22 05:07:22.804705 ip-10-0-141-238 kubenswrapper[2563]: I0722 05:07:22.804513    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-t4r5r\" (UniqueName: \"kubernetes.io/projected/d20629aa-181c-42c8-a9ad-4e2c1fb649d4-kube-api-access-t4r5r\") pod \"e2e-shared-b-0c4b46-openshift-default-79d674695f-9fqkl\" (UID: \"d20629aa-181c-42c8-a9ad-4e2c1fb649d4\") " pod="openshift-ingress/e2e-shared-b-0c4b46-openshift-default-79d674695f-9fqkl"
Jul 22 05:07:22.804705 ip-10-0-141-238 kubenswrapper[2563]: I0722 05:07:22.804541    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d20629aa-181c-42c8-a9ad-4e2c1fb649d4-workload-socket\") pod \"e2e-shared-b-0c4b46-openshift-default-79d674695f-9fqkl\" (UID: \"d20629aa-181c-42c8-a9ad-4e2c1fb649d4\") " pod="openshift-ingress/e2e-shared-b-0c4b46-openshift-default-79d674695f-9fqkl"
Jul 22 05:07:22.804815 ip-10-0-141-238 kubenswrapper[2563]: I0722 05:07:22.804765    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d20629aa-181c-42c8-a9ad-4e2c1fb649d4-workload-certs\") pod \"e2e-shared-b-0c4b46-openshift-default-79d674695f-9fqkl\" (UID: \"d20629aa-181c-42c8-a9ad-4e2c1fb649d4\") " pod="openshift-ingress/e2e-shared-b-0c4b46-openshift-default-79d674695f-9fqkl"
Jul 22 05:07:22.804958 ip-10-0-141-238 kubenswrapper[2563]: I0722 05:07:22.804937    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d20629aa-181c-42c8-a9ad-4e2c1fb649d4-istio-data\") pod \"e2e-shared-b-0c4b46-openshift-default-79d674695f-9fqkl\" (UID: \"d20629aa-181c-42c8-a9ad-4e2c1fb649d4\") " pod="openshift-ingress/e2e-shared-b-0c4b46-openshift-default-79d674695f-9fqkl"
Jul 22 05:07:22.805069 ip-10-0-141-238 kubenswrapper[2563]: I0722 05:07:22.804971    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d20629aa-181c-42c8-a9ad-4e2c1fb649d4-credential-socket\") pod \"e2e-shared-b-0c4b46-openshift-default-79d674695f-9fqkl\" (UID: \"d20629aa-181c-42c8-a9ad-4e2c1fb649d4\") " pod="openshift-ingress/e2e-shared-b-0c4b46-openshift-default-79d674695f-9fqkl"
Jul 22 05:07:22.805069 ip-10-0-141-238 kubenswrapper[2563]: I0722 05:07:22.805033    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d20629aa-181c-42c8-a9ad-4e2c1fb649d4-istiod-ca-cert\") pod \"e2e-shared-b-0c4b46-openshift-default-79d674695f-9fqkl\" (UID: \"d20629aa-181c-42c8-a9ad-4e2c1fb649d4\") " pod="openshift-ingress/e2e-shared-b-0c4b46-openshift-default-79d674695f-9fqkl"
Jul 22 05:07:22.805156 ip-10-0-141-238 kubenswrapper[2563]: I0722 05:07:22.805063    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d20629aa-181c-42c8-a9ad-4e2c1fb649d4-workload-socket\") pod \"e2e-shared-b-0c4b46-openshift-default-79d674695f-9fqkl\" (UID: \"d20629aa-181c-42c8-a9ad-4e2c1fb649d4\") " pod="openshift-ingress/e2e-shared-b-0c4b46-openshift-default-79d674695f-9fqkl"
Jul 22 05:07:22.806650 ip-10-0-141-238 kubenswrapper[2563]: I0722 05:07:22.806625    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d20629aa-181c-42c8-a9ad-4e2c1fb649d4-istio-envoy\") pod \"e2e-shared-b-0c4b46-openshift-default-79d674695f-9fqkl\" (UID: \"d20629aa-181c-42c8-a9ad-4e2c1fb649d4\") " pod="openshift-ingress/e2e-shared-b-0c4b46-openshift-default-79d674695f-9fqkl"
Jul 22 05:07:22.806779 ip-10-0-141-238 kubenswrapper[2563]: I0722 05:07:22.806761    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d20629aa-181c-42c8-a9ad-4e2c1fb649d4-istio-podinfo\") pod \"e2e-shared-b-0c4b46-openshift-default-79d674695f-9fqkl\" (UID: \"d20629aa-181c-42c8-a9ad-4e2c1fb649d4\") " pod="openshift-ingress/e2e-shared-b-0c4b46-openshift-default-79d674695f-9fqkl"
Jul 22 05:07:22.812417 ip-10-0-141-238 kubenswrapper[2563]: I0722 05:07:22.812396    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d20629aa-181c-42c8-a9ad-4e2c1fb649d4-istio-token\") pod \"e2e-shared-b-0c4b46-openshift-default-79d674695f-9fqkl\" (UID: \"d20629aa-181c-42c8-a9ad-4e2c1fb649d4\") " pod="openshift-ingress/e2e-shared-b-0c4b46-openshift-default-79d674695f-9fqkl"
Jul 22 05:07:22.812517 ip-10-0-141-238 kubenswrapper[2563]: I0722 05:07:22.812438    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-t4r5r\" (UniqueName: \"kubernetes.io/projected/d20629aa-181c-42c8-a9ad-4e2c1fb649d4-kube-api-access-t4r5r\") pod \"e2e-shared-b-0c4b46-openshift-default-79d674695f-9fqkl\" (UID: \"d20629aa-181c-42c8-a9ad-4e2c1fb649d4\") " pod="openshift-ingress/e2e-shared-b-0c4b46-openshift-default-79d674695f-9fqkl"
Jul 22 05:07:22.876652 ip-10-0-141-238 kubenswrapper[2563]: I0722 05:07:22.876580    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-0c4b46-openshift-default-79d674695f-9fqkl"
Jul 22 05:07:23.013390 ip-10-0-141-238 kubenswrapper[2563]: I0722 05:07:23.013360    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-b-0c4b46-openshift-default-79d674695f-9fqkl"]
Jul 22 05:07:23.016732 ip-10-0-141-238 kubenswrapper[2563]: W0722 05:07:23.016704    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd20629aa_181c_42c8_a9ad_4e2c1fb649d4.slice/crio-502b4ebbc676374f7349e6379e6ccec713aace31babea58927f5d778a23d46db WatchSource:0}: Error finding container 502b4ebbc676374f7349e6379e6ccec713aace31babea58927f5d778a23d46db: Status 404 returned error can't find the container with id 502b4ebbc676374f7349e6379e6ccec713aace31babea58927f5d778a23d46db
Jul 22 05:07:23.019368 ip-10-0-141-238 kubenswrapper[2563]: I0722 05:07:23.019328    2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 22 05:07:23.019468 ip-10-0-141-238 kubenswrapper[2563]: I0722 05:07:23.019402    2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 22 05:07:23.019468 ip-10-0-141-238 kubenswrapper[2563]: I0722 05:07:23.019430    2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 22 05:07:23.864826 ip-10-0-141-238 kubenswrapper[2563]: I0722 05:07:23.864792    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-0c4b46-openshift-default-79d674695f-9fqkl" event={"ID":"d20629aa-181c-42c8-a9ad-4e2c1fb649d4","Type":"ContainerStarted","Data":"4d00a05c4d2c1ee3c0b7d4a6e190e53ee89c326c7acfe04bf76db7379aa9931c"}
Jul 22 05:07:23.865252 ip-10-0-141-238 kubenswrapper[2563]: I0722 05:07:23.864842    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-0c4b46-openshift-default-79d674695f-9fqkl" event={"ID":"d20629aa-181c-42c8-a9ad-4e2c1fb649d4","Type":"ContainerStarted","Data":"502b4ebbc676374f7349e6379e6ccec713aace31babea58927f5d778a23d46db"}
Jul 22 05:07:23.876835 ip-10-0-141-238 kubenswrapper[2563]: I0722 05:07:23.876811    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-b-0c4b46-openshift-default-79d674695f-9fqkl"
Jul 22 05:07:23.885313 ip-10-0-141-238 kubenswrapper[2563]: I0722 05:07:23.885265    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-shared-b-0c4b46-openshift-default-79d674695f-9fqkl" podStartSLOduration=1.885250731 podStartE2EDuration="1.885250731s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 05:07:22 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 05:07:23.884165164 +0000 UTC m=+2559.303173922" watchObservedRunningTime="2026-07-22 05:07:23.885250731 +0000 UTC m=+2559.304259488"
Jul 22 05:07:24.565353 ip-10-0-141-238 kubenswrapper[2563]: I0722 05:07:24.565320    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-wsdd9"]
Jul 22 05:07:24.882020 ip-10-0-141-238 kubenswrapper[2563]: I0722 05:07:24.881946    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-b-0c4b46-openshift-default-79d674695f-9fqkl"
Jul 22 05:07:25.747845 ip-10-0-141-238 kubenswrapper[2563]: I0722 05:07:25.747803    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j9gvx_b4af3ae5-fa65-4358-8399-6ed11b68616e/konnectivity-agent/0.log" limit=1024
Jul 22 05:07:25.838263 ip-10-0-141-238 kubenswrapper[2563]: I0722 05:07:25.838231    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j9gvx_b4af3ae5-fa65-4358-8399-6ed11b68616e/konnectivity-agent/0.log" limit=1024
Jul 22 05:07:25.874879 ip-10-0-141-238 kubenswrapper[2563]: I0722 05:07:25.874850    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-b-0c4b46-openshift-default-79d674695f-9fqkl"
Jul 22 05:07:25.875828 ip-10-0-141-238 kubenswrapper[2563]: I0722 05:07:25.875803    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-b-0c4b46-openshift-default-79d674695f-9fqkl"
Jul 22 05:07:25.938804 ip-10-0-141-238 kubenswrapper[2563]: I0722 05:07:25.938778    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j9gvx_b4af3ae5-fa65-4358-8399-6ed11b68616e/konnectivity-agent/0.log" limit=1024
Jul 22 05:07:26.240298 ip-10-0-141-238 kubenswrapper[2563]: I0722 05:07:26.240262    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j9gvx_b4af3ae5-fa65-4358-8399-6ed11b68616e/konnectivity-agent/0.log" limit=1024
Jul 22 05:07:26.516325 ip-10-0-141-238 kubenswrapper[2563]: I0722 05:07:26.516236    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j9gvx_b4af3ae5-fa65-4358-8399-6ed11b68616e/konnectivity-agent/0.log" limit=1024
Jul 22 05:07:26.615437 ip-10-0-141-238 kubenswrapper[2563]: I0722 05:07:26.615407    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j9gvx_b4af3ae5-fa65-4358-8399-6ed11b68616e/konnectivity-agent/0.log" limit=1024
Jul 22 05:07:30.211791 ip-10-0-141-238 kubenswrapper[2563]: I0722 05:07:30.211740    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j9gvx_b4af3ae5-fa65-4358-8399-6ed11b68616e/konnectivity-agent/0.log" limit=1024
Jul 22 05:07:37.570433 ip-10-0-141-238 kubenswrapper[2563]: I0722 05:07:37.570398    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-wsdd9"]
Jul 22 05:07:38.929662 ip-10-0-141-238 kubenswrapper[2563]: I0722 05:07:38.929621    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j9gvx_b4af3ae5-fa65-4358-8399-6ed11b68616e/konnectivity-agent/0.log" limit=1024
Jul 22 05:07:39.032404 ip-10-0-141-238 kubenswrapper[2563]: I0722 05:07:39.032366    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j9gvx_b4af3ae5-fa65-4358-8399-6ed11b68616e/konnectivity-agent/0.log" limit=1024
Jul 22 05:07:39.662914 ip-10-0-141-238 kubenswrapper[2563]: I0722 05:07:39.662882    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j9gvx_b4af3ae5-fa65-4358-8399-6ed11b68616e/konnectivity-agent/0.log" limit=1024
Jul 22 05:07:39.765654 ip-10-0-141-238 kubenswrapper[2563]: I0722 05:07:39.765615    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j9gvx_b4af3ae5-fa65-4358-8399-6ed11b68616e/konnectivity-agent/0.log" limit=1024
Jul 22 05:07:40.876553 ip-10-0-141-238 kubenswrapper[2563]: I0722 05:07:40.876452    2563 patch_prober.go:28] interesting pod/e2e-shared-b-0c4b46-openshift-default-79d674695f-9fqkl container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.134.0.43:15021/healthz/ready\": dial tcp 10.134.0.43:15021: connect: connection refused" start-of-body=
Jul 22 05:07:40.876553 ip-10-0-141-238 kubenswrapper[2563]: I0722 05:07:40.876519    2563 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-shared-b-0c4b46-openshift-default-79d674695f-9fqkl" podUID="d20629aa-181c-42c8-a9ad-4e2c1fb649d4" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.43:15021/healthz/ready\": dial tcp 10.134.0.43:15021: connect: connection refused"
Jul 22 05:07:40.950448 ip-10-0-141-238 kubenswrapper[2563]: I0722 05:07:40.950418    2563 generic.go:356] "Generic (PLEG): container finished" podID="d20629aa-181c-42c8-a9ad-4e2c1fb649d4" containerID="4d00a05c4d2c1ee3c0b7d4a6e190e53ee89c326c7acfe04bf76db7379aa9931c" exitCode=0
Jul 22 05:07:40.950614 ip-10-0-141-238 kubenswrapper[2563]: I0722 05:07:40.950497    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-0c4b46-openshift-default-79d674695f-9fqkl" event={"ID":"d20629aa-181c-42c8-a9ad-4e2c1fb649d4","Type":"ContainerDied","Data":"4d00a05c4d2c1ee3c0b7d4a6e190e53ee89c326c7acfe04bf76db7379aa9931c"}
Jul 22 05:07:40.950897 ip-10-0-141-238 kubenswrapper[2563]: I0722 05:07:40.950880    2563 scope.go:117] "RemoveContainer" containerID="4d00a05c4d2c1ee3c0b7d4a6e190e53ee89c326c7acfe04bf76db7379aa9931c"
Jul 22 05:07:40.951846 ip-10-0-141-238 kubenswrapper[2563]: I0722 05:07:40.951815    2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 22 05:07:40.951951 ip-10-0-141-238 kubenswrapper[2563]: I0722 05:07:40.951882    2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 22 05:07:40.951951 ip-10-0-141-238 kubenswrapper[2563]: I0722 05:07:40.951918    2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 22 05:07:41.960584 ip-10-0-141-238 kubenswrapper[2563]: I0722 05:07:41.960548    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-0c4b46-openshift-default-79d674695f-9fqkl" event={"ID":"d20629aa-181c-42c8-a9ad-4e2c1fb649d4","Type":"ContainerStarted","Data":"5076a3440c01f598f7d31781f950dbef4f1851bca8bb99d708f5a9d6a76b4806"}
Jul 22 05:07:42.877679 ip-10-0-141-238 kubenswrapper[2563]: I0722 05:07:42.877639    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-b-0c4b46-openshift-default-79d674695f-9fqkl"
Jul 22 05:07:42.877883 ip-10-0-141-238 kubenswrapper[2563]: I0722 05:07:42.877852    2563 patch_prober.go:28] interesting pod/e2e-shared-b-0c4b46-openshift-default-79d674695f-9fqkl container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.43:15021/healthz/ready\": dial tcp 10.134.0.43:15021: connect: connection refused" start-of-body=
Jul 22 05:07:42.877968 ip-10-0-141-238 kubenswrapper[2563]: I0722 05:07:42.877912    2563 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-0c4b46-openshift-default-79d674695f-9fqkl" podUID="d20629aa-181c-42c8-a9ad-4e2c1fb649d4" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.43:15021/healthz/ready\": dial tcp 10.134.0.43:15021: connect: connection refused"
Jul 22 05:07:43.877532 ip-10-0-141-238 kubenswrapper[2563]: I0722 05:07:43.877487    2563 patch_prober.go:28] interesting pod/e2e-shared-b-0c4b46-openshift-default-79d674695f-9fqkl container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.43:15021/healthz/ready\": dial tcp 10.134.0.43:15021: connect: connection refused" start-of-body=
Jul 22 05:07:43.877944 ip-10-0-141-238 kubenswrapper[2563]: I0722 05:07:43.877552    2563 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-0c4b46-openshift-default-79d674695f-9fqkl" podUID="d20629aa-181c-42c8-a9ad-4e2c1fb649d4" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.43:15021/healthz/ready\": dial tcp 10.134.0.43:15021: connect: connection refused"
Jul 22 05:07:44.877211 ip-10-0-141-238 kubenswrapper[2563]: I0722 05:07:44.877172    2563 patch_prober.go:28] interesting pod/e2e-shared-b-0c4b46-openshift-default-79d674695f-9fqkl container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.43:15021/healthz/ready\": dial tcp 10.134.0.43:15021: connect: connection refused" start-of-body=
Jul 22 05:07:44.877398 ip-10-0-141-238 kubenswrapper[2563]: I0722 05:07:44.877220    2563 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-0c4b46-openshift-default-79d674695f-9fqkl" podUID="d20629aa-181c-42c8-a9ad-4e2c1fb649d4" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.43:15021/healthz/ready\": dial tcp 10.134.0.43:15021: connect: connection refused"
Jul 22 05:07:45.881574 ip-10-0-141-238 kubenswrapper[2563]: I0722 05:07:45.881546    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-b-0c4b46-openshift-default-79d674695f-9fqkl"
Jul 22 05:07:45.881964 ip-10-0-141-238 kubenswrapper[2563]: I0722 05:07:45.881883    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-b-0c4b46-openshift-default-79d674695f-9fqkl"
Jul 22 05:07:45.882525 ip-10-0-141-238 kubenswrapper[2563]: I0722 05:07:45.882502    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-b-0c4b46-openshift-default-79d674695f-9fqkl"
Jul 22 05:07:47.076063 ip-10-0-141-238 kubenswrapper[2563]: I0722 05:07:47.074978    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-a-81d7ca/auth-test-model-81d7ca-kserve-5d476fff5f-wkvhr"]
Jul 22 05:07:47.076063 ip-10-0-141-238 kubenswrapper[2563]: I0722 05:07:47.075961    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="dde7caa1-31e8-4bb2-bf9f-46e17e5ae1fb" containerName="istio-proxy"
Jul 22 05:07:47.081906 ip-10-0-141-238 kubenswrapper[2563]: I0722 05:07:47.081878    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-81d7ca/auth-test-model-81d7ca-kserve-5d476fff5f-wkvhr"
Jul 22 05:07:47.085855 ip-10-0-141-238 kubenswrapper[2563]: I0722 05:07:47.085634    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-a-81d7ca\"/\"kube-root-ca.crt\""
Jul 22 05:07:47.085855 ip-10-0-141-238 kubenswrapper[2563]: I0722 05:07:47.085700    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-a-81d7ca\"/\"auth-test-model-81d7ca-kserve-self-signed-certs\""
Jul 22 05:07:47.085855 ip-10-0-141-238 kubenswrapper[2563]: I0722 05:07:47.085635    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-a-81d7ca\"/\"openshift-service-ca.crt\""
Jul 22 05:07:47.086135 ip-10-0-141-238 kubenswrapper[2563]: I0722 05:07:47.085992    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-a-81d7ca\"/\"default-dockercfg-srvf4\""
Jul 22 05:07:47.088404 ip-10-0-141-238 kubenswrapper[2563]: I0722 05:07:47.088371    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-81d7ca/auth-test-model-81d7ca-kserve-5d476fff5f-wkvhr"]
Jul 22 05:07:47.117322 ip-10-0-141-238 kubenswrapper[2563]: I0722 05:07:47.117301    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j9gvx_b4af3ae5-fa65-4358-8399-6ed11b68616e/konnectivity-agent/0.log" limit=1024
Jul 22 05:07:47.221466 ip-10-0-141-238 kubenswrapper[2563]: I0722 05:07:47.221438    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/49633d8f-de5a-45b0-82ee-c89d909abb42-tls-certs\") pod \"auth-test-model-81d7ca-kserve-5d476fff5f-wkvhr\" (UID: \"49633d8f-de5a-45b0-82ee-c89d909abb42\") " pod="ai-tenant-e2e-shared-a-81d7ca/auth-test-model-81d7ca-kserve-5d476fff5f-wkvhr"
Jul 22 05:07:47.221617 ip-10-0-141-238 kubenswrapper[2563]: I0722 05:07:47.221483    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/49633d8f-de5a-45b0-82ee-c89d909abb42-dshm\") pod \"auth-test-model-81d7ca-kserve-5d476fff5f-wkvhr\" (UID: \"49633d8f-de5a-45b0-82ee-c89d909abb42\") " pod="ai-tenant-e2e-shared-a-81d7ca/auth-test-model-81d7ca-kserve-5d476fff5f-wkvhr"
Jul 22 05:07:47.221617 ip-10-0-141-238 kubenswrapper[2563]: I0722 05:07:47.221576    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/49633d8f-de5a-45b0-82ee-c89d909abb42-home\") pod \"auth-test-model-81d7ca-kserve-5d476fff5f-wkvhr\" (UID: \"49633d8f-de5a-45b0-82ee-c89d909abb42\") " pod="ai-tenant-e2e-shared-a-81d7ca/auth-test-model-81d7ca-kserve-5d476fff5f-wkvhr"
Jul 22 05:07:47.221691 ip-10-0-141-238 kubenswrapper[2563]: I0722 05:07:47.221616    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/49633d8f-de5a-45b0-82ee-c89d909abb42-model-cache\") pod \"auth-test-model-81d7ca-kserve-5d476fff5f-wkvhr\" (UID: \"49633d8f-de5a-45b0-82ee-c89d909abb42\") " pod="ai-tenant-e2e-shared-a-81d7ca/auth-test-model-81d7ca-kserve-5d476fff5f-wkvhr"
Jul 22 05:07:47.221691 ip-10-0-141-238 kubenswrapper[2563]: I0722 05:07:47.221637    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/49633d8f-de5a-45b0-82ee-c89d909abb42-tmp-dir\") pod \"auth-test-model-81d7ca-kserve-5d476fff5f-wkvhr\" (UID: \"49633d8f-de5a-45b0-82ee-c89d909abb42\") " pod="ai-tenant-e2e-shared-a-81d7ca/auth-test-model-81d7ca-kserve-5d476fff5f-wkvhr"
Jul 22 05:07:47.221691 ip-10-0-141-238 kubenswrapper[2563]: I0722 05:07:47.221662    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xcjnr\" (UniqueName: \"kubernetes.io/projected/49633d8f-de5a-45b0-82ee-c89d909abb42-kube-api-access-xcjnr\") pod \"auth-test-model-81d7ca-kserve-5d476fff5f-wkvhr\" (UID: \"49633d8f-de5a-45b0-82ee-c89d909abb42\") " pod="ai-tenant-e2e-shared-a-81d7ca/auth-test-model-81d7ca-kserve-5d476fff5f-wkvhr"
Jul 22 05:07:47.296143 ip-10-0-141-238 kubenswrapper[2563]: I0722 05:07:47.296111    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j9gvx_b4af3ae5-fa65-4358-8399-6ed11b68616e/konnectivity-agent/0.log" limit=1024
Jul 22 05:07:47.322376 ip-10-0-141-238 kubenswrapper[2563]: I0722 05:07:47.322343    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/49633d8f-de5a-45b0-82ee-c89d909abb42-home\") pod \"auth-test-model-81d7ca-kserve-5d476fff5f-wkvhr\" (UID: \"49633d8f-de5a-45b0-82ee-c89d909abb42\") " pod="ai-tenant-e2e-shared-a-81d7ca/auth-test-model-81d7ca-kserve-5d476fff5f-wkvhr"
Jul 22 05:07:47.322550 ip-10-0-141-238 kubenswrapper[2563]: I0722 05:07:47.322381    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/49633d8f-de5a-45b0-82ee-c89d909abb42-model-cache\") pod \"auth-test-model-81d7ca-kserve-5d476fff5f-wkvhr\" (UID: \"49633d8f-de5a-45b0-82ee-c89d909abb42\") " pod="ai-tenant-e2e-shared-a-81d7ca/auth-test-model-81d7ca-kserve-5d476fff5f-wkvhr"
Jul 22 05:07:47.322550 ip-10-0-141-238 kubenswrapper[2563]: I0722 05:07:47.322404    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/49633d8f-de5a-45b0-82ee-c89d909abb42-tmp-dir\") pod \"auth-test-model-81d7ca-kserve-5d476fff5f-wkvhr\" (UID: \"49633d8f-de5a-45b0-82ee-c89d909abb42\") " pod="ai-tenant-e2e-shared-a-81d7ca/auth-test-model-81d7ca-kserve-5d476fff5f-wkvhr"
Jul 22 05:07:47.322550 ip-10-0-141-238 kubenswrapper[2563]: I0722 05:07:47.322434    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xcjnr\" (UniqueName: \"kubernetes.io/projected/49633d8f-de5a-45b0-82ee-c89d909abb42-kube-api-access-xcjnr\") pod \"auth-test-model-81d7ca-kserve-5d476fff5f-wkvhr\" (UID: \"49633d8f-de5a-45b0-82ee-c89d909abb42\") " pod="ai-tenant-e2e-shared-a-81d7ca/auth-test-model-81d7ca-kserve-5d476fff5f-wkvhr"
Jul 22 05:07:47.322550 ip-10-0-141-238 kubenswrapper[2563]: I0722 05:07:47.322485    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/49633d8f-de5a-45b0-82ee-c89d909abb42-tls-certs\") pod \"auth-test-model-81d7ca-kserve-5d476fff5f-wkvhr\" (UID: \"49633d8f-de5a-45b0-82ee-c89d909abb42\") " pod="ai-tenant-e2e-shared-a-81d7ca/auth-test-model-81d7ca-kserve-5d476fff5f-wkvhr"
Jul 22 05:07:47.322550 ip-10-0-141-238 kubenswrapper[2563]: I0722 05:07:47.322536    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/49633d8f-de5a-45b0-82ee-c89d909abb42-dshm\") pod \"auth-test-model-81d7ca-kserve-5d476fff5f-wkvhr\" (UID: \"49633d8f-de5a-45b0-82ee-c89d909abb42\") " pod="ai-tenant-e2e-shared-a-81d7ca/auth-test-model-81d7ca-kserve-5d476fff5f-wkvhr"
Jul 22 05:07:47.322832 ip-10-0-141-238 kubenswrapper[2563]: I0722 05:07:47.322811    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/49633d8f-de5a-45b0-82ee-c89d909abb42-home\") pod \"auth-test-model-81d7ca-kserve-5d476fff5f-wkvhr\" (UID: \"49633d8f-de5a-45b0-82ee-c89d909abb42\") " pod="ai-tenant-e2e-shared-a-81d7ca/auth-test-model-81d7ca-kserve-5d476fff5f-wkvhr"
Jul 22 05:07:47.322900 ip-10-0-141-238 kubenswrapper[2563]: I0722 05:07:47.322846    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/49633d8f-de5a-45b0-82ee-c89d909abb42-model-cache\") pod \"auth-test-model-81d7ca-kserve-5d476fff5f-wkvhr\" (UID: \"49633d8f-de5a-45b0-82ee-c89d909abb42\") " pod="ai-tenant-e2e-shared-a-81d7ca/auth-test-model-81d7ca-kserve-5d476fff5f-wkvhr"
Jul 22 05:07:47.322900 ip-10-0-141-238 kubenswrapper[2563]: I0722 05:07:47.322879    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/49633d8f-de5a-45b0-82ee-c89d909abb42-tmp-dir\") pod \"auth-test-model-81d7ca-kserve-5d476fff5f-wkvhr\" (UID: \"49633d8f-de5a-45b0-82ee-c89d909abb42\") " pod="ai-tenant-e2e-shared-a-81d7ca/auth-test-model-81d7ca-kserve-5d476fff5f-wkvhr"
Jul 22 05:07:47.324791 ip-10-0-141-238 kubenswrapper[2563]: I0722 05:07:47.324775    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/49633d8f-de5a-45b0-82ee-c89d909abb42-dshm\") pod \"auth-test-model-81d7ca-kserve-5d476fff5f-wkvhr\" (UID: \"49633d8f-de5a-45b0-82ee-c89d909abb42\") " pod="ai-tenant-e2e-shared-a-81d7ca/auth-test-model-81d7ca-kserve-5d476fff5f-wkvhr"
Jul 22 05:07:47.324913 ip-10-0-141-238 kubenswrapper[2563]: I0722 05:07:47.324897    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/49633d8f-de5a-45b0-82ee-c89d909abb42-tls-certs\") pod \"auth-test-model-81d7ca-kserve-5d476fff5f-wkvhr\" (UID: \"49633d8f-de5a-45b0-82ee-c89d909abb42\") " pod="ai-tenant-e2e-shared-a-81d7ca/auth-test-model-81d7ca-kserve-5d476fff5f-wkvhr"
Jul 22 05:07:47.330011 ip-10-0-141-238 kubenswrapper[2563]: I0722 05:07:47.329952    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xcjnr\" (UniqueName: \"kubernetes.io/projected/49633d8f-de5a-45b0-82ee-c89d909abb42-kube-api-access-xcjnr\") pod \"auth-test-model-81d7ca-kserve-5d476fff5f-wkvhr\" (UID: \"49633d8f-de5a-45b0-82ee-c89d909abb42\") " pod="ai-tenant-e2e-shared-a-81d7ca/auth-test-model-81d7ca-kserve-5d476fff5f-wkvhr"
Jul 22 05:07:47.392274 ip-10-0-141-238 kubenswrapper[2563]: I0722 05:07:47.392245    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-81d7ca/auth-test-model-81d7ca-kserve-5d476fff5f-wkvhr"
Jul 22 05:07:47.395854 ip-10-0-141-238 kubenswrapper[2563]: I0722 05:07:47.395831    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j9gvx_b4af3ae5-fa65-4358-8399-6ed11b68616e/konnectivity-agent/0.log" limit=1024
Jul 22 05:07:47.520628 ip-10-0-141-238 kubenswrapper[2563]: I0722 05:07:47.520602    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-81d7ca/auth-test-model-81d7ca-kserve-5d476fff5f-wkvhr"]
Jul 22 05:07:47.522862 ip-10-0-141-238 kubenswrapper[2563]: W0722 05:07:47.522838    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod49633d8f_de5a_45b0_82ee_c89d909abb42.slice/crio-268cca880d76326fad2008e617cdabe101b84e1777c89ab07c7c12a8658f7e31 WatchSource:0}: Error finding container 268cca880d76326fad2008e617cdabe101b84e1777c89ab07c7c12a8658f7e31: Status 404 returned error can't find the container with id 268cca880d76326fad2008e617cdabe101b84e1777c89ab07c7c12a8658f7e31
Jul 22 05:07:47.988204 ip-10-0-141-238 kubenswrapper[2563]: I0722 05:07:47.988164    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-81d7ca/auth-test-model-81d7ca-kserve-5d476fff5f-wkvhr" event={"ID":"49633d8f-de5a-45b0-82ee-c89d909abb42","Type":"ContainerStarted","Data":"b84134ca5f21433ff4d4d6b16540a4aff0c2d605956c64f5726a2540dc9a6ea5"}
Jul 22 05:07:47.988365 ip-10-0-141-238 kubenswrapper[2563]: I0722 05:07:47.988216    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-81d7ca/auth-test-model-81d7ca-kserve-5d476fff5f-wkvhr" event={"ID":"49633d8f-de5a-45b0-82ee-c89d909abb42","Type":"ContainerStarted","Data":"268cca880d76326fad2008e617cdabe101b84e1777c89ab07c7c12a8658f7e31"}
Jul 22 05:07:48.005253 ip-10-0-141-238 kubenswrapper[2563]: I0722 05:07:48.005202    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-a-81d7ca/auth-test-model-81d7ca-kserve-5d476fff5f-wkvhr" podStartSLOduration=1.005187722 podStartE2EDuration="1.005187722s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 05:07:47 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 05:07:48.004014232 +0000 UTC m=+2583.423022989" watchObservedRunningTime="2026-07-22 05:07:48.005187722 +0000 UTC m=+2583.424196479"
Jul 22 05:07:50.389240 ip-10-0-141-238 kubenswrapper[2563]: I0722 05:07:50.389191    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j9gvx_b4af3ae5-fa65-4358-8399-6ed11b68616e/konnectivity-agent/0.log" limit=1024
Jul 22 05:07:50.569180 ip-10-0-141-238 kubenswrapper[2563]: I0722 05:07:50.569142    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-wsdd9"]
Jul 22 05:07:57.393140 ip-10-0-141-238 kubenswrapper[2563]: I0722 05:07:57.393094    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-a-81d7ca/auth-test-model-81d7ca-kserve-5d476fff5f-wkvhr"
Jul 22 05:07:57.393140 ip-10-0-141-238 kubenswrapper[2563]: I0722 05:07:57.393147    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-a-81d7ca/auth-test-model-81d7ca-kserve-5d476fff5f-wkvhr"
Jul 22 05:07:57.405513 ip-10-0-141-238 kubenswrapper[2563]: I0722 05:07:57.405486    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-a-81d7ca/auth-test-model-81d7ca-kserve-5d476fff5f-wkvhr"
Jul 22 05:07:58.044771 ip-10-0-141-238 kubenswrapper[2563]: I0722 05:07:58.044736    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-a-81d7ca/auth-test-model-81d7ca-kserve-5d476fff5f-wkvhr"
Jul 22 05:08:09.409201 ip-10-0-141-238 kubenswrapper[2563]: I0722 05:08:09.409119    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j9gvx_b4af3ae5-fa65-4358-8399-6ed11b68616e/konnectivity-agent/0.log" limit=1024
Jul 22 05:08:13.263415 ip-10-0-141-238 kubenswrapper[2563]: I0722 05:08:13.263374    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-wsdd9"]
Jul 22 05:08:37.166262 ip-10-0-141-238 kubenswrapper[2563]: I0722 05:08:37.166232    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-wsdd9"]
Jul 22 05:08:52.866171 ip-10-0-141-238 kubenswrapper[2563]: I0722 05:08:52.866136    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-wsdd9"]
Jul 22 05:09:07.264434 ip-10-0-141-238 kubenswrapper[2563]: I0722 05:09:07.264392    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-wsdd9"]
Jul 22 05:09:26.368535 ip-10-0-141-238 kubenswrapper[2563]: I0722 05:09:26.368493    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-wsdd9"]
Jul 22 05:09:44.168142 ip-10-0-141-238 kubenswrapper[2563]: I0722 05:09:44.168057    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-wsdd9"]
Jul 22 05:09:45.138667 ip-10-0-141-238 kubenswrapper[2563]: I0722 05:09:45.138638    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-gw4km_67c7210c-7cfa-4865-bce3-777fbb6f3cea/console-operator/1.log"
Jul 22 05:09:45.143018 ip-10-0-141-238 kubenswrapper[2563]: I0722 05:09:45.142997    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-gw4km_67c7210c-7cfa-4865-bce3-777fbb6f3cea/console-operator/1.log"
Jul 22 05:10:00.669472 ip-10-0-141-238 kubenswrapper[2563]: I0722 05:10:00.669435    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-wsdd9"]
Jul 22 05:10:11.912673 ip-10-0-141-238 kubenswrapper[2563]: I0722 05:10:11.912642    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-81d7ca/auth-test-model-81d7ca-kserve-5d476fff5f-wkvhr"]
Jul 22 05:10:11.958465 ip-10-0-141-238 kubenswrapper[2563]: I0722 05:10:11.958407    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j9gvx_b4af3ae5-fa65-4358-8399-6ed11b68616e/konnectivity-agent/0.log" limit=1024
Jul 22 05:10:12.530992 ip-10-0-141-238 kubenswrapper[2563]: I0722 05:10:12.530957    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j9gvx_b4af3ae5-fa65-4358-8399-6ed11b68616e/konnectivity-agent/0.log" limit=1024
Jul 22 05:10:12.892654 ip-10-0-141-238 kubenswrapper[2563]: I0722 05:10:12.892576    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j9gvx_b4af3ae5-fa65-4358-8399-6ed11b68616e/konnectivity-agent/0.log" limit=1024
Jul 22 05:10:17.760595 ip-10-0-141-238 kubenswrapper[2563]: I0722 05:10:17.760561    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-wsdd9"]
Jul 22 05:10:23.274275 ip-10-0-141-238 kubenswrapper[2563]: I0722 05:10:23.274242    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-a-81d7ca/sub-test-model-81d7ca-kserve-865c9d444c-fsr6g"]
Jul 22 05:10:23.277575 ip-10-0-141-238 kubenswrapper[2563]: I0722 05:10:23.277558    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-81d7ca/sub-test-model-81d7ca-kserve-865c9d444c-fsr6g"
Jul 22 05:10:23.280030 ip-10-0-141-238 kubenswrapper[2563]: I0722 05:10:23.280002    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-a-81d7ca\"/\"sub-test-model-81d7ca-kserve-self-signed-certs\""
Jul 22 05:10:23.289465 ip-10-0-141-238 kubenswrapper[2563]: I0722 05:10:23.289439    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-81d7ca/sub-test-model-81d7ca-kserve-865c9d444c-fsr6g"]
Jul 22 05:10:23.300761 ip-10-0-141-238 kubenswrapper[2563]: I0722 05:10:23.300717    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j9gvx_b4af3ae5-fa65-4358-8399-6ed11b68616e/konnectivity-agent/0.log" limit=1024
Jul 22 05:10:23.311772 ip-10-0-141-238 kubenswrapper[2563]: I0722 05:10:23.311747    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/fc3bda30-104d-4512-bc02-f1dd0a44b674-model-cache\") pod \"sub-test-model-81d7ca-kserve-865c9d444c-fsr6g\" (UID: \"fc3bda30-104d-4512-bc02-f1dd0a44b674\") " pod="ai-tenant-e2e-shared-a-81d7ca/sub-test-model-81d7ca-kserve-865c9d444c-fsr6g"
Jul 22 05:10:23.311908 ip-10-0-141-238 kubenswrapper[2563]: I0722 05:10:23.311783    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/fc3bda30-104d-4512-bc02-f1dd0a44b674-tls-certs\") pod \"sub-test-model-81d7ca-kserve-865c9d444c-fsr6g\" (UID: \"fc3bda30-104d-4512-bc02-f1dd0a44b674\") " pod="ai-tenant-e2e-shared-a-81d7ca/sub-test-model-81d7ca-kserve-865c9d444c-fsr6g"
Jul 22 05:10:23.311908 ip-10-0-141-238 kubenswrapper[2563]: I0722 05:10:23.311809    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/fc3bda30-104d-4512-bc02-f1dd0a44b674-tmp-dir\") pod \"sub-test-model-81d7ca-kserve-865c9d444c-fsr6g\" (UID: \"fc3bda30-104d-4512-bc02-f1dd0a44b674\") " pod="ai-tenant-e2e-shared-a-81d7ca/sub-test-model-81d7ca-kserve-865c9d444c-fsr6g"
Jul 22 05:10:23.311908 ip-10-0-141-238 kubenswrapper[2563]: I0722 05:10:23.311835    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pr7fd\" (UniqueName: \"kubernetes.io/projected/fc3bda30-104d-4512-bc02-f1dd0a44b674-kube-api-access-pr7fd\") pod \"sub-test-model-81d7ca-kserve-865c9d444c-fsr6g\" (UID: \"fc3bda30-104d-4512-bc02-f1dd0a44b674\") " pod="ai-tenant-e2e-shared-a-81d7ca/sub-test-model-81d7ca-kserve-865c9d444c-fsr6g"
Jul 22 05:10:23.311908 ip-10-0-141-238 kubenswrapper[2563]: I0722 05:10:23.311861    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/fc3bda30-104d-4512-bc02-f1dd0a44b674-home\") pod \"sub-test-model-81d7ca-kserve-865c9d444c-fsr6g\" (UID: \"fc3bda30-104d-4512-bc02-f1dd0a44b674\") " pod="ai-tenant-e2e-shared-a-81d7ca/sub-test-model-81d7ca-kserve-865c9d444c-fsr6g"
Jul 22 05:10:23.312083 ip-10-0-141-238 kubenswrapper[2563]: I0722 05:10:23.311948    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/fc3bda30-104d-4512-bc02-f1dd0a44b674-dshm\") pod \"sub-test-model-81d7ca-kserve-865c9d444c-fsr6g\" (UID: \"fc3bda30-104d-4512-bc02-f1dd0a44b674\") " pod="ai-tenant-e2e-shared-a-81d7ca/sub-test-model-81d7ca-kserve-865c9d444c-fsr6g"
Jul 22 05:10:23.413415 ip-10-0-141-238 kubenswrapper[2563]: I0722 05:10:23.413378    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/fc3bda30-104d-4512-bc02-f1dd0a44b674-dshm\") pod \"sub-test-model-81d7ca-kserve-865c9d444c-fsr6g\" (UID: \"fc3bda30-104d-4512-bc02-f1dd0a44b674\") " pod="ai-tenant-e2e-shared-a-81d7ca/sub-test-model-81d7ca-kserve-865c9d444c-fsr6g"
Jul 22 05:10:23.413601 ip-10-0-141-238 kubenswrapper[2563]: I0722 05:10:23.413454    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/fc3bda30-104d-4512-bc02-f1dd0a44b674-model-cache\") pod \"sub-test-model-81d7ca-kserve-865c9d444c-fsr6g\" (UID: \"fc3bda30-104d-4512-bc02-f1dd0a44b674\") " pod="ai-tenant-e2e-shared-a-81d7ca/sub-test-model-81d7ca-kserve-865c9d444c-fsr6g"
Jul 22 05:10:23.413601 ip-10-0-141-238 kubenswrapper[2563]: I0722 05:10:23.413479    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/fc3bda30-104d-4512-bc02-f1dd0a44b674-tls-certs\") pod \"sub-test-model-81d7ca-kserve-865c9d444c-fsr6g\" (UID: \"fc3bda30-104d-4512-bc02-f1dd0a44b674\") " pod="ai-tenant-e2e-shared-a-81d7ca/sub-test-model-81d7ca-kserve-865c9d444c-fsr6g"
Jul 22 05:10:23.413601 ip-10-0-141-238 kubenswrapper[2563]: I0722 05:10:23.413505    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/fc3bda30-104d-4512-bc02-f1dd0a44b674-tmp-dir\") pod \"sub-test-model-81d7ca-kserve-865c9d444c-fsr6g\" (UID: \"fc3bda30-104d-4512-bc02-f1dd0a44b674\") " pod="ai-tenant-e2e-shared-a-81d7ca/sub-test-model-81d7ca-kserve-865c9d444c-fsr6g"
Jul 22 05:10:23.413601 ip-10-0-141-238 kubenswrapper[2563]: I0722 05:10:23.413531    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pr7fd\" (UniqueName: \"kubernetes.io/projected/fc3bda30-104d-4512-bc02-f1dd0a44b674-kube-api-access-pr7fd\") pod \"sub-test-model-81d7ca-kserve-865c9d444c-fsr6g\" (UID: \"fc3bda30-104d-4512-bc02-f1dd0a44b674\") " pod="ai-tenant-e2e-shared-a-81d7ca/sub-test-model-81d7ca-kserve-865c9d444c-fsr6g"
Jul 22 05:10:23.413601 ip-10-0-141-238 kubenswrapper[2563]: I0722 05:10:23.413569    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/fc3bda30-104d-4512-bc02-f1dd0a44b674-home\") pod \"sub-test-model-81d7ca-kserve-865c9d444c-fsr6g\" (UID: \"fc3bda30-104d-4512-bc02-f1dd0a44b674\") " pod="ai-tenant-e2e-shared-a-81d7ca/sub-test-model-81d7ca-kserve-865c9d444c-fsr6g"
Jul 22 05:10:23.413943 ip-10-0-141-238 kubenswrapper[2563]: I0722 05:10:23.413907    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/fc3bda30-104d-4512-bc02-f1dd0a44b674-model-cache\") pod \"sub-test-model-81d7ca-kserve-865c9d444c-fsr6g\" (UID: \"fc3bda30-104d-4512-bc02-f1dd0a44b674\") " pod="ai-tenant-e2e-shared-a-81d7ca/sub-test-model-81d7ca-kserve-865c9d444c-fsr6g"
Jul 22 05:10:23.413943 ip-10-0-141-238 kubenswrapper[2563]: I0722 05:10:23.413933    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/fc3bda30-104d-4512-bc02-f1dd0a44b674-home\") pod \"sub-test-model-81d7ca-kserve-865c9d444c-fsr6g\" (UID: \"fc3bda30-104d-4512-bc02-f1dd0a44b674\") " pod="ai-tenant-e2e-shared-a-81d7ca/sub-test-model-81d7ca-kserve-865c9d444c-fsr6g"
Jul 22 05:10:23.414153 ip-10-0-141-238 kubenswrapper[2563]: I0722 05:10:23.413976    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/fc3bda30-104d-4512-bc02-f1dd0a44b674-tmp-dir\") pod \"sub-test-model-81d7ca-kserve-865c9d444c-fsr6g\" (UID: \"fc3bda30-104d-4512-bc02-f1dd0a44b674\") " pod="ai-tenant-e2e-shared-a-81d7ca/sub-test-model-81d7ca-kserve-865c9d444c-fsr6g"
Jul 22 05:10:23.415779 ip-10-0-141-238 kubenswrapper[2563]: I0722 05:10:23.415755    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/fc3bda30-104d-4512-bc02-f1dd0a44b674-dshm\") pod \"sub-test-model-81d7ca-kserve-865c9d444c-fsr6g\" (UID: \"fc3bda30-104d-4512-bc02-f1dd0a44b674\") " pod="ai-tenant-e2e-shared-a-81d7ca/sub-test-model-81d7ca-kserve-865c9d444c-fsr6g"
Jul 22 05:10:23.416064 ip-10-0-141-238 kubenswrapper[2563]: I0722 05:10:23.416030    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/fc3bda30-104d-4512-bc02-f1dd0a44b674-tls-certs\") pod \"sub-test-model-81d7ca-kserve-865c9d444c-fsr6g\" (UID: \"fc3bda30-104d-4512-bc02-f1dd0a44b674\") " pod="ai-tenant-e2e-shared-a-81d7ca/sub-test-model-81d7ca-kserve-865c9d444c-fsr6g"
Jul 22 05:10:23.423521 ip-10-0-141-238 kubenswrapper[2563]: I0722 05:10:23.423480    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pr7fd\" (UniqueName: \"kubernetes.io/projected/fc3bda30-104d-4512-bc02-f1dd0a44b674-kube-api-access-pr7fd\") pod \"sub-test-model-81d7ca-kserve-865c9d444c-fsr6g\" (UID: \"fc3bda30-104d-4512-bc02-f1dd0a44b674\") " pod="ai-tenant-e2e-shared-a-81d7ca/sub-test-model-81d7ca-kserve-865c9d444c-fsr6g"
Jul 22 05:10:23.587463 ip-10-0-141-238 kubenswrapper[2563]: I0722 05:10:23.587371    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-81d7ca/sub-test-model-81d7ca-kserve-865c9d444c-fsr6g"
Jul 22 05:10:23.719103 ip-10-0-141-238 kubenswrapper[2563]: I0722 05:10:23.719073    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-81d7ca/sub-test-model-81d7ca-kserve-865c9d444c-fsr6g"]
Jul 22 05:10:23.721019 ip-10-0-141-238 kubenswrapper[2563]: W0722 05:10:23.720992    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podfc3bda30_104d_4512_bc02_f1dd0a44b674.slice/crio-439277db5788c75f5c0e785383652732ae3983b28eb5799ecd70445b75ffc3aa WatchSource:0}: Error finding container 439277db5788c75f5c0e785383652732ae3983b28eb5799ecd70445b75ffc3aa: Status 404 returned error can't find the container with id 439277db5788c75f5c0e785383652732ae3983b28eb5799ecd70445b75ffc3aa
Jul 22 05:10:24.705889 ip-10-0-141-238 kubenswrapper[2563]: I0722 05:10:24.705842    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-81d7ca/sub-test-model-81d7ca-kserve-865c9d444c-fsr6g" event={"ID":"fc3bda30-104d-4512-bc02-f1dd0a44b674","Type":"ContainerStarted","Data":"00fee388866928a9057fa3e9e5a8b0d0ad2e92fcdb56c8b574e4c91d6ecac017"}
Jul 22 05:10:24.706315 ip-10-0-141-238 kubenswrapper[2563]: I0722 05:10:24.705897    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-81d7ca/sub-test-model-81d7ca-kserve-865c9d444c-fsr6g" event={"ID":"fc3bda30-104d-4512-bc02-f1dd0a44b674","Type":"ContainerStarted","Data":"439277db5788c75f5c0e785383652732ae3983b28eb5799ecd70445b75ffc3aa"}
Jul 22 05:10:24.723085 ip-10-0-141-238 kubenswrapper[2563]: I0722 05:10:24.723012    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-a-81d7ca/sub-test-model-81d7ca-kserve-865c9d444c-fsr6g" podStartSLOduration=1.722995099 podStartE2EDuration="1.722995099s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 05:10:23 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 05:10:24.721560726 +0000 UTC m=+2740.140569486" watchObservedRunningTime="2026-07-22 05:10:24.722995099 +0000 UTC m=+2740.142003856"
Jul 22 05:10:26.932190 ip-10-0-141-238 kubenswrapper[2563]: I0722 05:10:26.932140    2563 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-shared-a-81d7ca/auth-test-model-81d7ca-kserve-5d476fff5f-wkvhr" podUID="49633d8f-de5a-45b0-82ee-c89d909abb42" containerName="main" containerID="cri-o://b84134ca5f21433ff4d4d6b16540a4aff0c2d605956c64f5726a2540dc9a6ea5" gracePeriod=45
Jul 22 05:10:27.175985 ip-10-0-141-238 kubenswrapper[2563]: I0722 05:10:27.175959    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-81d7ca/auth-test-model-81d7ca-kserve-5d476fff5f-wkvhr"
Jul 22 05:10:27.245585 ip-10-0-141-238 kubenswrapper[2563]: I0722 05:10:27.245511    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/49633d8f-de5a-45b0-82ee-c89d909abb42-tls-certs\") pod \"49633d8f-de5a-45b0-82ee-c89d909abb42\" (UID: \"49633d8f-de5a-45b0-82ee-c89d909abb42\") "
Jul 22 05:10:27.245585 ip-10-0-141-238 kubenswrapper[2563]: I0722 05:10:27.245563    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-xcjnr\" (UniqueName: \"kubernetes.io/projected/49633d8f-de5a-45b0-82ee-c89d909abb42-kube-api-access-xcjnr\") pod \"49633d8f-de5a-45b0-82ee-c89d909abb42\" (UID: \"49633d8f-de5a-45b0-82ee-c89d909abb42\") "
Jul 22 05:10:27.245801 ip-10-0-141-238 kubenswrapper[2563]: I0722 05:10:27.245606    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/49633d8f-de5a-45b0-82ee-c89d909abb42-model-cache\") pod \"49633d8f-de5a-45b0-82ee-c89d909abb42\" (UID: \"49633d8f-de5a-45b0-82ee-c89d909abb42\") "
Jul 22 05:10:27.245801 ip-10-0-141-238 kubenswrapper[2563]: I0722 05:10:27.245621    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/49633d8f-de5a-45b0-82ee-c89d909abb42-tmp-dir\") pod \"49633d8f-de5a-45b0-82ee-c89d909abb42\" (UID: \"49633d8f-de5a-45b0-82ee-c89d909abb42\") "
Jul 22 05:10:27.245801 ip-10-0-141-238 kubenswrapper[2563]: I0722 05:10:27.245637    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/49633d8f-de5a-45b0-82ee-c89d909abb42-dshm\") pod \"49633d8f-de5a-45b0-82ee-c89d909abb42\" (UID: \"49633d8f-de5a-45b0-82ee-c89d909abb42\") "
Jul 22 05:10:27.245801 ip-10-0-141-238 kubenswrapper[2563]: I0722 05:10:27.245679    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/49633d8f-de5a-45b0-82ee-c89d909abb42-home\") pod \"49633d8f-de5a-45b0-82ee-c89d909abb42\" (UID: \"49633d8f-de5a-45b0-82ee-c89d909abb42\") "
Jul 22 05:10:27.246016 ip-10-0-141-238 kubenswrapper[2563]: I0722 05:10:27.245913    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/49633d8f-de5a-45b0-82ee-c89d909abb42-model-cache" (OuterVolumeSpecName: "model-cache") pod "49633d8f-de5a-45b0-82ee-c89d909abb42" (UID: "49633d8f-de5a-45b0-82ee-c89d909abb42"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 22 05:10:27.246016 ip-10-0-141-238 kubenswrapper[2563]: I0722 05:10:27.245933    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/49633d8f-de5a-45b0-82ee-c89d909abb42-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "49633d8f-de5a-45b0-82ee-c89d909abb42" (UID: "49633d8f-de5a-45b0-82ee-c89d909abb42"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 22 05:10:27.246016 ip-10-0-141-238 kubenswrapper[2563]: I0722 05:10:27.245964    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/49633d8f-de5a-45b0-82ee-c89d909abb42-home" (OuterVolumeSpecName: "home") pod "49633d8f-de5a-45b0-82ee-c89d909abb42" (UID: "49633d8f-de5a-45b0-82ee-c89d909abb42"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 22 05:10:27.247859 ip-10-0-141-238 kubenswrapper[2563]: I0722 05:10:27.247837    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/49633d8f-de5a-45b0-82ee-c89d909abb42-dshm" (OuterVolumeSpecName: "dshm") pod "49633d8f-de5a-45b0-82ee-c89d909abb42" (UID: "49633d8f-de5a-45b0-82ee-c89d909abb42"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 22 05:10:27.247937 ip-10-0-141-238 kubenswrapper[2563]: I0722 05:10:27.247844    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/49633d8f-de5a-45b0-82ee-c89d909abb42-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "49633d8f-de5a-45b0-82ee-c89d909abb42" (UID: "49633d8f-de5a-45b0-82ee-c89d909abb42"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 22 05:10:27.247937 ip-10-0-141-238 kubenswrapper[2563]: I0722 05:10:27.247883    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/49633d8f-de5a-45b0-82ee-c89d909abb42-kube-api-access-xcjnr" (OuterVolumeSpecName: "kube-api-access-xcjnr") pod "49633d8f-de5a-45b0-82ee-c89d909abb42" (UID: "49633d8f-de5a-45b0-82ee-c89d909abb42"). InnerVolumeSpecName "kube-api-access-xcjnr". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 22 05:10:27.346654 ip-10-0-141-238 kubenswrapper[2563]: I0722 05:10:27.346608    2563 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/49633d8f-de5a-45b0-82ee-c89d909abb42-model-cache\") on node \"ip-10-0-141-238.ec2.internal\" DevicePath \"\""
Jul 22 05:10:27.346818 ip-10-0-141-238 kubenswrapper[2563]: I0722 05:10:27.346672    2563 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/49633d8f-de5a-45b0-82ee-c89d909abb42-tmp-dir\") on node \"ip-10-0-141-238.ec2.internal\" DevicePath \"\""
Jul 22 05:10:27.346818 ip-10-0-141-238 kubenswrapper[2563]: I0722 05:10:27.346685    2563 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/49633d8f-de5a-45b0-82ee-c89d909abb42-dshm\") on node \"ip-10-0-141-238.ec2.internal\" DevicePath \"\""
Jul 22 05:10:27.346818 ip-10-0-141-238 kubenswrapper[2563]: I0722 05:10:27.346696    2563 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/49633d8f-de5a-45b0-82ee-c89d909abb42-home\") on node \"ip-10-0-141-238.ec2.internal\" DevicePath \"\""
Jul 22 05:10:27.346818 ip-10-0-141-238 kubenswrapper[2563]: I0722 05:10:27.346706    2563 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/49633d8f-de5a-45b0-82ee-c89d909abb42-tls-certs\") on node \"ip-10-0-141-238.ec2.internal\" DevicePath \"\""
Jul 22 05:10:27.346818 ip-10-0-141-238 kubenswrapper[2563]: I0722 05:10:27.346717    2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-xcjnr\" (UniqueName: \"kubernetes.io/projected/49633d8f-de5a-45b0-82ee-c89d909abb42-kube-api-access-xcjnr\") on node \"ip-10-0-141-238.ec2.internal\" DevicePath \"\""
Jul 22 05:10:27.474475 ip-10-0-141-238 kubenswrapper[2563]: I0722 05:10:27.474439    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-wsdd9"]
Jul 22 05:10:27.726301 ip-10-0-141-238 kubenswrapper[2563]: I0722 05:10:27.726263    2563 generic.go:356] "Generic (PLEG): container finished" podID="49633d8f-de5a-45b0-82ee-c89d909abb42" containerID="b84134ca5f21433ff4d4d6b16540a4aff0c2d605956c64f5726a2540dc9a6ea5" exitCode=0
Jul 22 05:10:27.726507 ip-10-0-141-238 kubenswrapper[2563]: I0722 05:10:27.726305    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-81d7ca/auth-test-model-81d7ca-kserve-5d476fff5f-wkvhr"
Jul 22 05:10:27.726507 ip-10-0-141-238 kubenswrapper[2563]: I0722 05:10:27.726350    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-81d7ca/auth-test-model-81d7ca-kserve-5d476fff5f-wkvhr" event={"ID":"49633d8f-de5a-45b0-82ee-c89d909abb42","Type":"ContainerDied","Data":"b84134ca5f21433ff4d4d6b16540a4aff0c2d605956c64f5726a2540dc9a6ea5"}
Jul 22 05:10:27.726507 ip-10-0-141-238 kubenswrapper[2563]: I0722 05:10:27.726396    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-81d7ca/auth-test-model-81d7ca-kserve-5d476fff5f-wkvhr" event={"ID":"49633d8f-de5a-45b0-82ee-c89d909abb42","Type":"ContainerDied","Data":"268cca880d76326fad2008e617cdabe101b84e1777c89ab07c7c12a8658f7e31"}
Jul 22 05:10:27.726507 ip-10-0-141-238 kubenswrapper[2563]: I0722 05:10:27.726414    2563 scope.go:117] "RemoveContainer" containerID="b84134ca5f21433ff4d4d6b16540a4aff0c2d605956c64f5726a2540dc9a6ea5"
Jul 22 05:10:27.735569 ip-10-0-141-238 kubenswrapper[2563]: I0722 05:10:27.735553    2563 scope.go:117] "RemoveContainer" containerID="b84134ca5f21433ff4d4d6b16540a4aff0c2d605956c64f5726a2540dc9a6ea5"
Jul 22 05:10:27.735806 ip-10-0-141-238 kubenswrapper[2563]: E0722 05:10:27.735790    2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b84134ca5f21433ff4d4d6b16540a4aff0c2d605956c64f5726a2540dc9a6ea5\": container with ID starting with b84134ca5f21433ff4d4d6b16540a4aff0c2d605956c64f5726a2540dc9a6ea5 not found: ID does not exist" containerID="b84134ca5f21433ff4d4d6b16540a4aff0c2d605956c64f5726a2540dc9a6ea5"
Jul 22 05:10:27.735850 ip-10-0-141-238 kubenswrapper[2563]: I0722 05:10:27.735822    2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b84134ca5f21433ff4d4d6b16540a4aff0c2d605956c64f5726a2540dc9a6ea5"} err="failed to get container status \"b84134ca5f21433ff4d4d6b16540a4aff0c2d605956c64f5726a2540dc9a6ea5\": rpc error: code = NotFound desc = could not find container \"b84134ca5f21433ff4d4d6b16540a4aff0c2d605956c64f5726a2540dc9a6ea5\": container with ID starting with b84134ca5f21433ff4d4d6b16540a4aff0c2d605956c64f5726a2540dc9a6ea5 not found: ID does not exist"
Jul 22 05:10:27.747399 ip-10-0-141-238 kubenswrapper[2563]: I0722 05:10:27.747376    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-81d7ca/auth-test-model-81d7ca-kserve-5d476fff5f-wkvhr"]
Jul 22 05:10:27.750410 ip-10-0-141-238 kubenswrapper[2563]: I0722 05:10:27.750388    2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-a-81d7ca/auth-test-model-81d7ca-kserve-5d476fff5f-wkvhr"]
Jul 22 05:10:29.067466 ip-10-0-141-238 kubenswrapper[2563]: I0722 05:10:29.067434    2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="49633d8f-de5a-45b0-82ee-c89d909abb42" path="/var/lib/kubelet/pods/49633d8f-de5a-45b0-82ee-c89d909abb42/volumes"
Jul 22 05:10:33.588402 ip-10-0-141-238 kubenswrapper[2563]: I0722 05:10:33.588349    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-a-81d7ca/sub-test-model-81d7ca-kserve-865c9d444c-fsr6g"
Jul 22 05:10:33.588402 ip-10-0-141-238 kubenswrapper[2563]: I0722 05:10:33.588415    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-a-81d7ca/sub-test-model-81d7ca-kserve-865c9d444c-fsr6g"
Jul 22 05:10:33.600933 ip-10-0-141-238 kubenswrapper[2563]: I0722 05:10:33.600909    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-a-81d7ca/sub-test-model-81d7ca-kserve-865c9d444c-fsr6g"
Jul 22 05:10:33.767903 ip-10-0-141-238 kubenswrapper[2563]: I0722 05:10:33.767876    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-a-81d7ca/sub-test-model-81d7ca-kserve-865c9d444c-fsr6g"
Jul 22 05:10:49.291337 ip-10-0-141-238 kubenswrapper[2563]: I0722 05:10:49.291304    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j9gvx_b4af3ae5-fa65-4358-8399-6ed11b68616e/konnectivity-agent/0.log" limit=1024
Jul 22 05:10:57.839565 ip-10-0-141-238 kubenswrapper[2563]: I0722 05:10:57.839526    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-b-0c4b46/sub-test-model-0c4b46-kserve-6b8b9fb5c-kgp6k"]
Jul 22 05:10:57.839950 ip-10-0-141-238 kubenswrapper[2563]: I0722 05:10:57.839857    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="49633d8f-de5a-45b0-82ee-c89d909abb42" containerName="main"
Jul 22 05:10:57.839950 ip-10-0-141-238 kubenswrapper[2563]: I0722 05:10:57.839867    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="49633d8f-de5a-45b0-82ee-c89d909abb42" containerName="main"
Jul 22 05:10:57.839950 ip-10-0-141-238 kubenswrapper[2563]: I0722 05:10:57.839928    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="49633d8f-de5a-45b0-82ee-c89d909abb42" containerName="main"
Jul 22 05:10:57.842675 ip-10-0-141-238 kubenswrapper[2563]: I0722 05:10:57.842658    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-0c4b46/sub-test-model-0c4b46-kserve-6b8b9fb5c-kgp6k"
Jul 22 05:10:57.845069 ip-10-0-141-238 kubenswrapper[2563]: I0722 05:10:57.845024    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-0c4b46\"/\"openshift-service-ca.crt\""
Jul 22 05:10:57.845932 ip-10-0-141-238 kubenswrapper[2563]: I0722 05:10:57.845907    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-0c4b46\"/\"sub-test-model-0c4b46-kserve-self-signed-certs\""
Jul 22 05:10:57.845932 ip-10-0-141-238 kubenswrapper[2563]: I0722 05:10:57.845929    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-0c4b46\"/\"kube-root-ca.crt\""
Jul 22 05:10:57.846157 ip-10-0-141-238 kubenswrapper[2563]: I0722 05:10:57.846142    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-0c4b46\"/\"default-dockercfg-bgrpg\""
Jul 22 05:10:57.852088 ip-10-0-141-238 kubenswrapper[2563]: I0722 05:10:57.852068    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-0c4b46/sub-test-model-0c4b46-kserve-6b8b9fb5c-kgp6k"]
Jul 22 05:10:57.867196 ip-10-0-141-238 kubenswrapper[2563]: I0722 05:10:57.867158    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j9gvx_b4af3ae5-fa65-4358-8399-6ed11b68616e/konnectivity-agent/0.log" limit=1024
Jul 22 05:10:58.023568 ip-10-0-141-238 kubenswrapper[2563]: I0722 05:10:58.023510    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/9df1bb66-b0f6-4fec-96fe-b74f5bb0c9ef-home\") pod \"sub-test-model-0c4b46-kserve-6b8b9fb5c-kgp6k\" (UID: \"9df1bb66-b0f6-4fec-96fe-b74f5bb0c9ef\") " pod="ai-tenant-e2e-shared-b-0c4b46/sub-test-model-0c4b46-kserve-6b8b9fb5c-kgp6k"
Jul 22 05:10:58.023568 ip-10-0-141-238 kubenswrapper[2563]: I0722 05:10:58.023564    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/9df1bb66-b0f6-4fec-96fe-b74f5bb0c9ef-tls-certs\") pod \"sub-test-model-0c4b46-kserve-6b8b9fb5c-kgp6k\" (UID: \"9df1bb66-b0f6-4fec-96fe-b74f5bb0c9ef\") " pod="ai-tenant-e2e-shared-b-0c4b46/sub-test-model-0c4b46-kserve-6b8b9fb5c-kgp6k"
Jul 22 05:10:58.023852 ip-10-0-141-238 kubenswrapper[2563]: I0722 05:10:58.023608    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-x45md\" (UniqueName: \"kubernetes.io/projected/9df1bb66-b0f6-4fec-96fe-b74f5bb0c9ef-kube-api-access-x45md\") pod \"sub-test-model-0c4b46-kserve-6b8b9fb5c-kgp6k\" (UID: \"9df1bb66-b0f6-4fec-96fe-b74f5bb0c9ef\") " pod="ai-tenant-e2e-shared-b-0c4b46/sub-test-model-0c4b46-kserve-6b8b9fb5c-kgp6k"
Jul 22 05:10:58.023852 ip-10-0-141-238 kubenswrapper[2563]: I0722 05:10:58.023660    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/9df1bb66-b0f6-4fec-96fe-b74f5bb0c9ef-tmp-dir\") pod \"sub-test-model-0c4b46-kserve-6b8b9fb5c-kgp6k\" (UID: \"9df1bb66-b0f6-4fec-96fe-b74f5bb0c9ef\") " pod="ai-tenant-e2e-shared-b-0c4b46/sub-test-model-0c4b46-kserve-6b8b9fb5c-kgp6k"
Jul 22 05:10:58.023852 ip-10-0-141-238 kubenswrapper[2563]: I0722 05:10:58.023692    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/9df1bb66-b0f6-4fec-96fe-b74f5bb0c9ef-dshm\") pod \"sub-test-model-0c4b46-kserve-6b8b9fb5c-kgp6k\" (UID: \"9df1bb66-b0f6-4fec-96fe-b74f5bb0c9ef\") " pod="ai-tenant-e2e-shared-b-0c4b46/sub-test-model-0c4b46-kserve-6b8b9fb5c-kgp6k"
Jul 22 05:10:58.023852 ip-10-0-141-238 kubenswrapper[2563]: I0722 05:10:58.023788    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/9df1bb66-b0f6-4fec-96fe-b74f5bb0c9ef-model-cache\") pod \"sub-test-model-0c4b46-kserve-6b8b9fb5c-kgp6k\" (UID: \"9df1bb66-b0f6-4fec-96fe-b74f5bb0c9ef\") " pod="ai-tenant-e2e-shared-b-0c4b46/sub-test-model-0c4b46-kserve-6b8b9fb5c-kgp6k"
Jul 22 05:10:58.124560 ip-10-0-141-238 kubenswrapper[2563]: I0722 05:10:58.124462    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/9df1bb66-b0f6-4fec-96fe-b74f5bb0c9ef-model-cache\") pod \"sub-test-model-0c4b46-kserve-6b8b9fb5c-kgp6k\" (UID: \"9df1bb66-b0f6-4fec-96fe-b74f5bb0c9ef\") " pod="ai-tenant-e2e-shared-b-0c4b46/sub-test-model-0c4b46-kserve-6b8b9fb5c-kgp6k"
Jul 22 05:10:58.124560 ip-10-0-141-238 kubenswrapper[2563]: I0722 05:10:58.124511    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/9df1bb66-b0f6-4fec-96fe-b74f5bb0c9ef-home\") pod \"sub-test-model-0c4b46-kserve-6b8b9fb5c-kgp6k\" (UID: \"9df1bb66-b0f6-4fec-96fe-b74f5bb0c9ef\") " pod="ai-tenant-e2e-shared-b-0c4b46/sub-test-model-0c4b46-kserve-6b8b9fb5c-kgp6k"
Jul 22 05:10:58.124560 ip-10-0-141-238 kubenswrapper[2563]: I0722 05:10:58.124527    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/9df1bb66-b0f6-4fec-96fe-b74f5bb0c9ef-tls-certs\") pod \"sub-test-model-0c4b46-kserve-6b8b9fb5c-kgp6k\" (UID: \"9df1bb66-b0f6-4fec-96fe-b74f5bb0c9ef\") " pod="ai-tenant-e2e-shared-b-0c4b46/sub-test-model-0c4b46-kserve-6b8b9fb5c-kgp6k"
Jul 22 05:10:58.124560 ip-10-0-141-238 kubenswrapper[2563]: I0722 05:10:58.124554    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-x45md\" (UniqueName: \"kubernetes.io/projected/9df1bb66-b0f6-4fec-96fe-b74f5bb0c9ef-kube-api-access-x45md\") pod \"sub-test-model-0c4b46-kserve-6b8b9fb5c-kgp6k\" (UID: \"9df1bb66-b0f6-4fec-96fe-b74f5bb0c9ef\") " pod="ai-tenant-e2e-shared-b-0c4b46/sub-test-model-0c4b46-kserve-6b8b9fb5c-kgp6k"
Jul 22 05:10:58.124912 ip-10-0-141-238 kubenswrapper[2563]: I0722 05:10:58.124738    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/9df1bb66-b0f6-4fec-96fe-b74f5bb0c9ef-tmp-dir\") pod \"sub-test-model-0c4b46-kserve-6b8b9fb5c-kgp6k\" (UID: \"9df1bb66-b0f6-4fec-96fe-b74f5bb0c9ef\") " pod="ai-tenant-e2e-shared-b-0c4b46/sub-test-model-0c4b46-kserve-6b8b9fb5c-kgp6k"
Jul 22 05:10:58.124912 ip-10-0-141-238 kubenswrapper[2563]: I0722 05:10:58.124819    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/9df1bb66-b0f6-4fec-96fe-b74f5bb0c9ef-dshm\") pod \"sub-test-model-0c4b46-kserve-6b8b9fb5c-kgp6k\" (UID: \"9df1bb66-b0f6-4fec-96fe-b74f5bb0c9ef\") " pod="ai-tenant-e2e-shared-b-0c4b46/sub-test-model-0c4b46-kserve-6b8b9fb5c-kgp6k"
Jul 22 05:10:58.124912 ip-10-0-141-238 kubenswrapper[2563]: I0722 05:10:58.124855    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/9df1bb66-b0f6-4fec-96fe-b74f5bb0c9ef-model-cache\") pod \"sub-test-model-0c4b46-kserve-6b8b9fb5c-kgp6k\" (UID: \"9df1bb66-b0f6-4fec-96fe-b74f5bb0c9ef\") " pod="ai-tenant-e2e-shared-b-0c4b46/sub-test-model-0c4b46-kserve-6b8b9fb5c-kgp6k"
Jul 22 05:10:58.125028 ip-10-0-141-238 kubenswrapper[2563]: I0722 05:10:58.124912    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/9df1bb66-b0f6-4fec-96fe-b74f5bb0c9ef-home\") pod \"sub-test-model-0c4b46-kserve-6b8b9fb5c-kgp6k\" (UID: \"9df1bb66-b0f6-4fec-96fe-b74f5bb0c9ef\") " pod="ai-tenant-e2e-shared-b-0c4b46/sub-test-model-0c4b46-kserve-6b8b9fb5c-kgp6k"
Jul 22 05:10:58.125028 ip-10-0-141-238 kubenswrapper[2563]: I0722 05:10:58.125016    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/9df1bb66-b0f6-4fec-96fe-b74f5bb0c9ef-tmp-dir\") pod \"sub-test-model-0c4b46-kserve-6b8b9fb5c-kgp6k\" (UID: \"9df1bb66-b0f6-4fec-96fe-b74f5bb0c9ef\") " pod="ai-tenant-e2e-shared-b-0c4b46/sub-test-model-0c4b46-kserve-6b8b9fb5c-kgp6k"
Jul 22 05:10:58.126858 ip-10-0-141-238 kubenswrapper[2563]: I0722 05:10:58.126834    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/9df1bb66-b0f6-4fec-96fe-b74f5bb0c9ef-dshm\") pod \"sub-test-model-0c4b46-kserve-6b8b9fb5c-kgp6k\" (UID: \"9df1bb66-b0f6-4fec-96fe-b74f5bb0c9ef\") " pod="ai-tenant-e2e-shared-b-0c4b46/sub-test-model-0c4b46-kserve-6b8b9fb5c-kgp6k"
Jul 22 05:10:58.126974 ip-10-0-141-238 kubenswrapper[2563]: I0722 05:10:58.126955    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/9df1bb66-b0f6-4fec-96fe-b74f5bb0c9ef-tls-certs\") pod \"sub-test-model-0c4b46-kserve-6b8b9fb5c-kgp6k\" (UID: \"9df1bb66-b0f6-4fec-96fe-b74f5bb0c9ef\") " pod="ai-tenant-e2e-shared-b-0c4b46/sub-test-model-0c4b46-kserve-6b8b9fb5c-kgp6k"
Jul 22 05:10:58.132366 ip-10-0-141-238 kubenswrapper[2563]: I0722 05:10:58.132343    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-x45md\" (UniqueName: \"kubernetes.io/projected/9df1bb66-b0f6-4fec-96fe-b74f5bb0c9ef-kube-api-access-x45md\") pod \"sub-test-model-0c4b46-kserve-6b8b9fb5c-kgp6k\" (UID: \"9df1bb66-b0f6-4fec-96fe-b74f5bb0c9ef\") " pod="ai-tenant-e2e-shared-b-0c4b46/sub-test-model-0c4b46-kserve-6b8b9fb5c-kgp6k"
Jul 22 05:10:58.153229 ip-10-0-141-238 kubenswrapper[2563]: I0722 05:10:58.153205    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-0c4b46/sub-test-model-0c4b46-kserve-6b8b9fb5c-kgp6k"
Jul 22 05:10:58.285485 ip-10-0-141-238 kubenswrapper[2563]: I0722 05:10:58.285459    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-0c4b46/sub-test-model-0c4b46-kserve-6b8b9fb5c-kgp6k"]
Jul 22 05:10:58.288239 ip-10-0-141-238 kubenswrapper[2563]: W0722 05:10:58.288210    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod9df1bb66_b0f6_4fec_96fe_b74f5bb0c9ef.slice/crio-30dfd37869a23e15ca59e5b8ee83636876324e5e75aadefdc2465b5ea1d1285d WatchSource:0}: Error finding container 30dfd37869a23e15ca59e5b8ee83636876324e5e75aadefdc2465b5ea1d1285d: Status 404 returned error can't find the container with id 30dfd37869a23e15ca59e5b8ee83636876324e5e75aadefdc2465b5ea1d1285d
Jul 22 05:10:58.872077 ip-10-0-141-238 kubenswrapper[2563]: I0722 05:10:58.872030    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-0c4b46/sub-test-model-0c4b46-kserve-6b8b9fb5c-kgp6k" event={"ID":"9df1bb66-b0f6-4fec-96fe-b74f5bb0c9ef","Type":"ContainerStarted","Data":"78aa3bc2c7f970a8b8a71bd5695125e8b2b52a9a913dd45300b85e3a7fc08714"}
Jul 22 05:10:58.872077 ip-10-0-141-238 kubenswrapper[2563]: I0722 05:10:58.872082    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-0c4b46/sub-test-model-0c4b46-kserve-6b8b9fb5c-kgp6k" event={"ID":"9df1bb66-b0f6-4fec-96fe-b74f5bb0c9ef","Type":"ContainerStarted","Data":"30dfd37869a23e15ca59e5b8ee83636876324e5e75aadefdc2465b5ea1d1285d"}
Jul 22 05:10:58.887792 ip-10-0-141-238 kubenswrapper[2563]: I0722 05:10:58.887744    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-b-0c4b46/sub-test-model-0c4b46-kserve-6b8b9fb5c-kgp6k" podStartSLOduration=1.887732641 podStartE2EDuration="1.887732641s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 05:10:57 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 05:10:58.886912037 +0000 UTC m=+2774.305920808" watchObservedRunningTime="2026-07-22 05:10:58.887732641 +0000 UTC m=+2774.306741398"
Jul 22 05:11:01.267110 ip-10-0-141-238 kubenswrapper[2563]: I0722 05:11:01.267071    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-wsdd9"]
Jul 22 05:11:08.154344 ip-10-0-141-238 kubenswrapper[2563]: I0722 05:11:08.154260    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-b-0c4b46/sub-test-model-0c4b46-kserve-6b8b9fb5c-kgp6k"
Jul 22 05:11:08.154823 ip-10-0-141-238 kubenswrapper[2563]: I0722 05:11:08.154545    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-b-0c4b46/sub-test-model-0c4b46-kserve-6b8b9fb5c-kgp6k"
Jul 22 05:11:08.167349 ip-10-0-141-238 kubenswrapper[2563]: I0722 05:11:08.167317    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-b-0c4b46/sub-test-model-0c4b46-kserve-6b8b9fb5c-kgp6k"
Jul 22 05:11:08.927697 ip-10-0-141-238 kubenswrapper[2563]: I0722 05:11:08.927660    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-b-0c4b46/sub-test-model-0c4b46-kserve-6b8b9fb5c-kgp6k"
Jul 22 05:11:24.972592 ip-10-0-141-238 kubenswrapper[2563]: I0722 05:11:24.972550    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-wsdd9"]
Jul 22 05:11:41.400740 ip-10-0-141-238 kubenswrapper[2563]: I0722 05:11:41.400706    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-81d7ca/sub-test-model-81d7ca-kserve-865c9d444c-fsr6g"]
Jul 22 05:11:41.422449 ip-10-0-141-238 kubenswrapper[2563]: I0722 05:11:41.422422    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j9gvx_b4af3ae5-fa65-4358-8399-6ed11b68616e/konnectivity-agent/0.log" limit=1024
Jul 22 05:11:42.377641 ip-10-0-141-238 kubenswrapper[2563]: I0722 05:11:42.377611    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-0c4b46/sub-test-model-0c4b46-kserve-6b8b9fb5c-kgp6k"]
Jul 22 05:11:42.628229 ip-10-0-141-238 kubenswrapper[2563]: I0722 05:11:42.628148    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j9gvx_b4af3ae5-fa65-4358-8399-6ed11b68616e/konnectivity-agent/0.log" limit=1024
Jul 22 05:11:45.261323 ip-10-0-141-238 kubenswrapper[2563]: I0722 05:11:45.261292    2563 scope.go:117] "RemoveContainer" containerID="309b5bebde4eed944c07db86a4718d02024d949a68544bca221a9110b21e8b8a"
Jul 22 05:11:45.971226 ip-10-0-141-238 kubenswrapper[2563]: I0722 05:11:45.971190    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-wsdd9"]
Jul 22 05:11:48.676238 ip-10-0-141-238 kubenswrapper[2563]: I0722 05:11:48.676207    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j9gvx_b4af3ae5-fa65-4358-8399-6ed11b68616e/konnectivity-agent/0.log" limit=1024
Jul 22 05:11:56.420584 ip-10-0-141-238 kubenswrapper[2563]: I0722 05:11:56.420537    2563 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-shared-a-81d7ca/sub-test-model-81d7ca-kserve-865c9d444c-fsr6g" podUID="fc3bda30-104d-4512-bc02-f1dd0a44b674" containerName="main" containerID="cri-o://00fee388866928a9057fa3e9e5a8b0d0ad2e92fcdb56c8b574e4c91d6ecac017" gracePeriod=45
Jul 22 05:11:56.673722 ip-10-0-141-238 kubenswrapper[2563]: I0722 05:11:56.673662    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-81d7ca/sub-test-model-81d7ca-kserve-865c9d444c-fsr6g"
Jul 22 05:11:56.739185 ip-10-0-141-238 kubenswrapper[2563]: I0722 05:11:56.739157    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/fc3bda30-104d-4512-bc02-f1dd0a44b674-home\") pod \"fc3bda30-104d-4512-bc02-f1dd0a44b674\" (UID: \"fc3bda30-104d-4512-bc02-f1dd0a44b674\") "
Jul 22 05:11:56.739185 ip-10-0-141-238 kubenswrapper[2563]: I0722 05:11:56.739188    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/fc3bda30-104d-4512-bc02-f1dd0a44b674-dshm\") pod \"fc3bda30-104d-4512-bc02-f1dd0a44b674\" (UID: \"fc3bda30-104d-4512-bc02-f1dd0a44b674\") "
Jul 22 05:11:56.739377 ip-10-0-141-238 kubenswrapper[2563]: I0722 05:11:56.739218    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/fc3bda30-104d-4512-bc02-f1dd0a44b674-model-cache\") pod \"fc3bda30-104d-4512-bc02-f1dd0a44b674\" (UID: \"fc3bda30-104d-4512-bc02-f1dd0a44b674\") "
Jul 22 05:11:56.739377 ip-10-0-141-238 kubenswrapper[2563]: I0722 05:11:56.739264    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-pr7fd\" (UniqueName: \"kubernetes.io/projected/fc3bda30-104d-4512-bc02-f1dd0a44b674-kube-api-access-pr7fd\") pod \"fc3bda30-104d-4512-bc02-f1dd0a44b674\" (UID: \"fc3bda30-104d-4512-bc02-f1dd0a44b674\") "
Jul 22 05:11:56.739377 ip-10-0-141-238 kubenswrapper[2563]: I0722 05:11:56.739300    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/fc3bda30-104d-4512-bc02-f1dd0a44b674-tls-certs\") pod \"fc3bda30-104d-4512-bc02-f1dd0a44b674\" (UID: \"fc3bda30-104d-4512-bc02-f1dd0a44b674\") "
Jul 22 05:11:56.739377 ip-10-0-141-238 kubenswrapper[2563]: I0722 05:11:56.739351    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/fc3bda30-104d-4512-bc02-f1dd0a44b674-tmp-dir\") pod \"fc3bda30-104d-4512-bc02-f1dd0a44b674\" (UID: \"fc3bda30-104d-4512-bc02-f1dd0a44b674\") "
Jul 22 05:11:56.739549 ip-10-0-141-238 kubenswrapper[2563]: I0722 05:11:56.739420    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/fc3bda30-104d-4512-bc02-f1dd0a44b674-home" (OuterVolumeSpecName: "home") pod "fc3bda30-104d-4512-bc02-f1dd0a44b674" (UID: "fc3bda30-104d-4512-bc02-f1dd0a44b674"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 22 05:11:56.739549 ip-10-0-141-238 kubenswrapper[2563]: I0722 05:11:56.739498    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/fc3bda30-104d-4512-bc02-f1dd0a44b674-model-cache" (OuterVolumeSpecName: "model-cache") pod "fc3bda30-104d-4512-bc02-f1dd0a44b674" (UID: "fc3bda30-104d-4512-bc02-f1dd0a44b674"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 22 05:11:56.739661 ip-10-0-141-238 kubenswrapper[2563]: I0722 05:11:56.739587    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/fc3bda30-104d-4512-bc02-f1dd0a44b674-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "fc3bda30-104d-4512-bc02-f1dd0a44b674" (UID: "fc3bda30-104d-4512-bc02-f1dd0a44b674"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 22 05:11:56.739769 ip-10-0-141-238 kubenswrapper[2563]: I0722 05:11:56.739690    2563 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/fc3bda30-104d-4512-bc02-f1dd0a44b674-tmp-dir\") on node \"ip-10-0-141-238.ec2.internal\" DevicePath \"\""
Jul 22 05:11:56.739769 ip-10-0-141-238 kubenswrapper[2563]: I0722 05:11:56.739704    2563 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/fc3bda30-104d-4512-bc02-f1dd0a44b674-home\") on node \"ip-10-0-141-238.ec2.internal\" DevicePath \"\""
Jul 22 05:11:56.739769 ip-10-0-141-238 kubenswrapper[2563]: I0722 05:11:56.739713    2563 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/fc3bda30-104d-4512-bc02-f1dd0a44b674-model-cache\") on node \"ip-10-0-141-238.ec2.internal\" DevicePath \"\""
Jul 22 05:11:56.741356 ip-10-0-141-238 kubenswrapper[2563]: I0722 05:11:56.741334    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/fc3bda30-104d-4512-bc02-f1dd0a44b674-dshm" (OuterVolumeSpecName: "dshm") pod "fc3bda30-104d-4512-bc02-f1dd0a44b674" (UID: "fc3bda30-104d-4512-bc02-f1dd0a44b674"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 22 05:11:56.741453 ip-10-0-141-238 kubenswrapper[2563]: I0722 05:11:56.741395    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/fc3bda30-104d-4512-bc02-f1dd0a44b674-kube-api-access-pr7fd" (OuterVolumeSpecName: "kube-api-access-pr7fd") pod "fc3bda30-104d-4512-bc02-f1dd0a44b674" (UID: "fc3bda30-104d-4512-bc02-f1dd0a44b674"). InnerVolumeSpecName "kube-api-access-pr7fd". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 22 05:11:56.741494 ip-10-0-141-238 kubenswrapper[2563]: I0722 05:11:56.741459    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/fc3bda30-104d-4512-bc02-f1dd0a44b674-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "fc3bda30-104d-4512-bc02-f1dd0a44b674" (UID: "fc3bda30-104d-4512-bc02-f1dd0a44b674"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 22 05:11:56.840715 ip-10-0-141-238 kubenswrapper[2563]: I0722 05:11:56.840676    2563 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/fc3bda30-104d-4512-bc02-f1dd0a44b674-dshm\") on node \"ip-10-0-141-238.ec2.internal\" DevicePath \"\""
Jul 22 05:11:56.840715 ip-10-0-141-238 kubenswrapper[2563]: I0722 05:11:56.840712    2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-pr7fd\" (UniqueName: \"kubernetes.io/projected/fc3bda30-104d-4512-bc02-f1dd0a44b674-kube-api-access-pr7fd\") on node \"ip-10-0-141-238.ec2.internal\" DevicePath \"\""
Jul 22 05:11:56.840715 ip-10-0-141-238 kubenswrapper[2563]: I0722 05:11:56.840723    2563 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/fc3bda30-104d-4512-bc02-f1dd0a44b674-tls-certs\") on node \"ip-10-0-141-238.ec2.internal\" DevicePath \"\""
Jul 22 05:11:57.142322 ip-10-0-141-238 kubenswrapper[2563]: I0722 05:11:57.142290    2563 generic.go:356] "Generic (PLEG): container finished" podID="fc3bda30-104d-4512-bc02-f1dd0a44b674" containerID="00fee388866928a9057fa3e9e5a8b0d0ad2e92fcdb56c8b574e4c91d6ecac017" exitCode=0
Jul 22 05:11:57.142494 ip-10-0-141-238 kubenswrapper[2563]: I0722 05:11:57.142327    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-81d7ca/sub-test-model-81d7ca-kserve-865c9d444c-fsr6g"
Jul 22 05:11:57.142494 ip-10-0-141-238 kubenswrapper[2563]: I0722 05:11:57.142344    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-81d7ca/sub-test-model-81d7ca-kserve-865c9d444c-fsr6g" event={"ID":"fc3bda30-104d-4512-bc02-f1dd0a44b674","Type":"ContainerDied","Data":"00fee388866928a9057fa3e9e5a8b0d0ad2e92fcdb56c8b574e4c91d6ecac017"}
Jul 22 05:11:57.142494 ip-10-0-141-238 kubenswrapper[2563]: I0722 05:11:57.142380    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-81d7ca/sub-test-model-81d7ca-kserve-865c9d444c-fsr6g" event={"ID":"fc3bda30-104d-4512-bc02-f1dd0a44b674","Type":"ContainerDied","Data":"439277db5788c75f5c0e785383652732ae3983b28eb5799ecd70445b75ffc3aa"}
Jul 22 05:11:57.142494 ip-10-0-141-238 kubenswrapper[2563]: I0722 05:11:57.142396    2563 scope.go:117] "RemoveContainer" containerID="00fee388866928a9057fa3e9e5a8b0d0ad2e92fcdb56c8b574e4c91d6ecac017"
Jul 22 05:11:57.152589 ip-10-0-141-238 kubenswrapper[2563]: I0722 05:11:57.152570    2563 scope.go:117] "RemoveContainer" containerID="00fee388866928a9057fa3e9e5a8b0d0ad2e92fcdb56c8b574e4c91d6ecac017"
Jul 22 05:11:57.152885 ip-10-0-141-238 kubenswrapper[2563]: E0722 05:11:57.152859    2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"00fee388866928a9057fa3e9e5a8b0d0ad2e92fcdb56c8b574e4c91d6ecac017\": container with ID starting with 00fee388866928a9057fa3e9e5a8b0d0ad2e92fcdb56c8b574e4c91d6ecac017 not found: ID does not exist" containerID="00fee388866928a9057fa3e9e5a8b0d0ad2e92fcdb56c8b574e4c91d6ecac017"
Jul 22 05:11:57.152985 ip-10-0-141-238 kubenswrapper[2563]: I0722 05:11:57.152892    2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"00fee388866928a9057fa3e9e5a8b0d0ad2e92fcdb56c8b574e4c91d6ecac017"} err="failed to get container status \"00fee388866928a9057fa3e9e5a8b0d0ad2e92fcdb56c8b574e4c91d6ecac017\": rpc error: code = NotFound desc = could not find container \"00fee388866928a9057fa3e9e5a8b0d0ad2e92fcdb56c8b574e4c91d6ecac017\": container with ID starting with 00fee388866928a9057fa3e9e5a8b0d0ad2e92fcdb56c8b574e4c91d6ecac017 not found: ID does not exist"
Jul 22 05:11:57.160215 ip-10-0-141-238 kubenswrapper[2563]: I0722 05:11:57.160190    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-81d7ca/sub-test-model-81d7ca-kserve-865c9d444c-fsr6g"]
Jul 22 05:11:57.164558 ip-10-0-141-238 kubenswrapper[2563]: I0722 05:11:57.164534    2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-a-81d7ca/sub-test-model-81d7ca-kserve-865c9d444c-fsr6g"]
Jul 22 05:11:57.398417 ip-10-0-141-238 kubenswrapper[2563]: I0722 05:11:57.398322    2563 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-shared-b-0c4b46/sub-test-model-0c4b46-kserve-6b8b9fb5c-kgp6k" podUID="9df1bb66-b0f6-4fec-96fe-b74f5bb0c9ef" containerName="main" containerID="cri-o://78aa3bc2c7f970a8b8a71bd5695125e8b2b52a9a913dd45300b85e3a7fc08714" gracePeriod=45
Jul 22 05:11:57.653645 ip-10-0-141-238 kubenswrapper[2563]: I0722 05:11:57.653621    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-0c4b46/sub-test-model-0c4b46-kserve-6b8b9fb5c-kgp6k"
Jul 22 05:11:57.749269 ip-10-0-141-238 kubenswrapper[2563]: I0722 05:11:57.749238    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-x45md\" (UniqueName: \"kubernetes.io/projected/9df1bb66-b0f6-4fec-96fe-b74f5bb0c9ef-kube-api-access-x45md\") pod \"9df1bb66-b0f6-4fec-96fe-b74f5bb0c9ef\" (UID: \"9df1bb66-b0f6-4fec-96fe-b74f5bb0c9ef\") "
Jul 22 05:11:57.749269 ip-10-0-141-238 kubenswrapper[2563]: I0722 05:11:57.749277    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/9df1bb66-b0f6-4fec-96fe-b74f5bb0c9ef-dshm\") pod \"9df1bb66-b0f6-4fec-96fe-b74f5bb0c9ef\" (UID: \"9df1bb66-b0f6-4fec-96fe-b74f5bb0c9ef\") "
Jul 22 05:11:57.749527 ip-10-0-141-238 kubenswrapper[2563]: I0722 05:11:57.749310    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/9df1bb66-b0f6-4fec-96fe-b74f5bb0c9ef-tmp-dir\") pod \"9df1bb66-b0f6-4fec-96fe-b74f5bb0c9ef\" (UID: \"9df1bb66-b0f6-4fec-96fe-b74f5bb0c9ef\") "
Jul 22 05:11:57.749527 ip-10-0-141-238 kubenswrapper[2563]: I0722 05:11:57.749380    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/9df1bb66-b0f6-4fec-96fe-b74f5bb0c9ef-home\") pod \"9df1bb66-b0f6-4fec-96fe-b74f5bb0c9ef\" (UID: \"9df1bb66-b0f6-4fec-96fe-b74f5bb0c9ef\") "
Jul 22 05:11:57.749527 ip-10-0-141-238 kubenswrapper[2563]: I0722 05:11:57.749396    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/9df1bb66-b0f6-4fec-96fe-b74f5bb0c9ef-tls-certs\") pod \"9df1bb66-b0f6-4fec-96fe-b74f5bb0c9ef\" (UID: \"9df1bb66-b0f6-4fec-96fe-b74f5bb0c9ef\") "
Jul 22 05:11:57.749527 ip-10-0-141-238 kubenswrapper[2563]: I0722 05:11:57.749416    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/9df1bb66-b0f6-4fec-96fe-b74f5bb0c9ef-model-cache\") pod \"9df1bb66-b0f6-4fec-96fe-b74f5bb0c9ef\" (UID: \"9df1bb66-b0f6-4fec-96fe-b74f5bb0c9ef\") "
Jul 22 05:11:57.749728 ip-10-0-141-238 kubenswrapper[2563]: I0722 05:11:57.749643    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9df1bb66-b0f6-4fec-96fe-b74f5bb0c9ef-home" (OuterVolumeSpecName: "home") pod "9df1bb66-b0f6-4fec-96fe-b74f5bb0c9ef" (UID: "9df1bb66-b0f6-4fec-96fe-b74f5bb0c9ef"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 22 05:11:57.749728 ip-10-0-141-238 kubenswrapper[2563]: I0722 05:11:57.749658    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9df1bb66-b0f6-4fec-96fe-b74f5bb0c9ef-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "9df1bb66-b0f6-4fec-96fe-b74f5bb0c9ef" (UID: "9df1bb66-b0f6-4fec-96fe-b74f5bb0c9ef"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 22 05:11:57.749866 ip-10-0-141-238 kubenswrapper[2563]: I0722 05:11:57.749841    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9df1bb66-b0f6-4fec-96fe-b74f5bb0c9ef-model-cache" (OuterVolumeSpecName: "model-cache") pod "9df1bb66-b0f6-4fec-96fe-b74f5bb0c9ef" (UID: "9df1bb66-b0f6-4fec-96fe-b74f5bb0c9ef"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 22 05:11:57.751575 ip-10-0-141-238 kubenswrapper[2563]: I0722 05:11:57.751541    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9df1bb66-b0f6-4fec-96fe-b74f5bb0c9ef-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "9df1bb66-b0f6-4fec-96fe-b74f5bb0c9ef" (UID: "9df1bb66-b0f6-4fec-96fe-b74f5bb0c9ef"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 22 05:11:57.751699 ip-10-0-141-238 kubenswrapper[2563]: I0722 05:11:57.751575    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9df1bb66-b0f6-4fec-96fe-b74f5bb0c9ef-dshm" (OuterVolumeSpecName: "dshm") pod "9df1bb66-b0f6-4fec-96fe-b74f5bb0c9ef" (UID: "9df1bb66-b0f6-4fec-96fe-b74f5bb0c9ef"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 22 05:11:57.751699 ip-10-0-141-238 kubenswrapper[2563]: I0722 05:11:57.751656    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9df1bb66-b0f6-4fec-96fe-b74f5bb0c9ef-kube-api-access-x45md" (OuterVolumeSpecName: "kube-api-access-x45md") pod "9df1bb66-b0f6-4fec-96fe-b74f5bb0c9ef" (UID: "9df1bb66-b0f6-4fec-96fe-b74f5bb0c9ef"). InnerVolumeSpecName "kube-api-access-x45md". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 22 05:11:57.851067 ip-10-0-141-238 kubenswrapper[2563]: I0722 05:11:57.851010    2563 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/9df1bb66-b0f6-4fec-96fe-b74f5bb0c9ef-home\") on node \"ip-10-0-141-238.ec2.internal\" DevicePath \"\""
Jul 22 05:11:57.851067 ip-10-0-141-238 kubenswrapper[2563]: I0722 05:11:57.851063    2563 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/9df1bb66-b0f6-4fec-96fe-b74f5bb0c9ef-tls-certs\") on node \"ip-10-0-141-238.ec2.internal\" DevicePath \"\""
Jul 22 05:11:57.851067 ip-10-0-141-238 kubenswrapper[2563]: I0722 05:11:57.851077    2563 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/9df1bb66-b0f6-4fec-96fe-b74f5bb0c9ef-model-cache\") on node \"ip-10-0-141-238.ec2.internal\" DevicePath \"\""
Jul 22 05:11:57.851317 ip-10-0-141-238 kubenswrapper[2563]: I0722 05:11:57.851089    2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-x45md\" (UniqueName: \"kubernetes.io/projected/9df1bb66-b0f6-4fec-96fe-b74f5bb0c9ef-kube-api-access-x45md\") on node \"ip-10-0-141-238.ec2.internal\" DevicePath \"\""
Jul 22 05:11:57.851317 ip-10-0-141-238 kubenswrapper[2563]: I0722 05:11:57.851102    2563 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/9df1bb66-b0f6-4fec-96fe-b74f5bb0c9ef-dshm\") on node \"ip-10-0-141-238.ec2.internal\" DevicePath \"\""
Jul 22 05:11:57.851317 ip-10-0-141-238 kubenswrapper[2563]: I0722 05:11:57.851113    2563 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/9df1bb66-b0f6-4fec-96fe-b74f5bb0c9ef-tmp-dir\") on node \"ip-10-0-141-238.ec2.internal\" DevicePath \"\""
Jul 22 05:11:58.148445 ip-10-0-141-238 kubenswrapper[2563]: I0722 05:11:58.148350    2563 generic.go:356] "Generic (PLEG): container finished" podID="9df1bb66-b0f6-4fec-96fe-b74f5bb0c9ef" containerID="78aa3bc2c7f970a8b8a71bd5695125e8b2b52a9a913dd45300b85e3a7fc08714" exitCode=0
Jul 22 05:11:58.148445 ip-10-0-141-238 kubenswrapper[2563]: I0722 05:11:58.148400    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-0c4b46/sub-test-model-0c4b46-kserve-6b8b9fb5c-kgp6k"
Jul 22 05:11:58.148445 ip-10-0-141-238 kubenswrapper[2563]: I0722 05:11:58.148433    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-0c4b46/sub-test-model-0c4b46-kserve-6b8b9fb5c-kgp6k" event={"ID":"9df1bb66-b0f6-4fec-96fe-b74f5bb0c9ef","Type":"ContainerDied","Data":"78aa3bc2c7f970a8b8a71bd5695125e8b2b52a9a913dd45300b85e3a7fc08714"}
Jul 22 05:11:58.148738 ip-10-0-141-238 kubenswrapper[2563]: I0722 05:11:58.148471    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-0c4b46/sub-test-model-0c4b46-kserve-6b8b9fb5c-kgp6k" event={"ID":"9df1bb66-b0f6-4fec-96fe-b74f5bb0c9ef","Type":"ContainerDied","Data":"30dfd37869a23e15ca59e5b8ee83636876324e5e75aadefdc2465b5ea1d1285d"}
Jul 22 05:11:58.148738 ip-10-0-141-238 kubenswrapper[2563]: I0722 05:11:58.148501    2563 scope.go:117] "RemoveContainer" containerID="78aa3bc2c7f970a8b8a71bd5695125e8b2b52a9a913dd45300b85e3a7fc08714"
Jul 22 05:11:58.157491 ip-10-0-141-238 kubenswrapper[2563]: I0722 05:11:58.157471    2563 scope.go:117] "RemoveContainer" containerID="78aa3bc2c7f970a8b8a71bd5695125e8b2b52a9a913dd45300b85e3a7fc08714"
Jul 22 05:11:58.157720 ip-10-0-141-238 kubenswrapper[2563]: E0722 05:11:58.157702    2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"78aa3bc2c7f970a8b8a71bd5695125e8b2b52a9a913dd45300b85e3a7fc08714\": container with ID starting with 78aa3bc2c7f970a8b8a71bd5695125e8b2b52a9a913dd45300b85e3a7fc08714 not found: ID does not exist" containerID="78aa3bc2c7f970a8b8a71bd5695125e8b2b52a9a913dd45300b85e3a7fc08714"
Jul 22 05:11:58.157769 ip-10-0-141-238 kubenswrapper[2563]: I0722 05:11:58.157729    2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"78aa3bc2c7f970a8b8a71bd5695125e8b2b52a9a913dd45300b85e3a7fc08714"} err="failed to get container status \"78aa3bc2c7f970a8b8a71bd5695125e8b2b52a9a913dd45300b85e3a7fc08714\": rpc error: code = NotFound desc = could not find container \"78aa3bc2c7f970a8b8a71bd5695125e8b2b52a9a913dd45300b85e3a7fc08714\": container with ID starting with 78aa3bc2c7f970a8b8a71bd5695125e8b2b52a9a913dd45300b85e3a7fc08714 not found: ID does not exist"
Jul 22 05:11:58.168858 ip-10-0-141-238 kubenswrapper[2563]: I0722 05:11:58.168831    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-0c4b46/sub-test-model-0c4b46-kserve-6b8b9fb5c-kgp6k"]
Jul 22 05:11:58.173305 ip-10-0-141-238 kubenswrapper[2563]: I0722 05:11:58.173284    2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-b-0c4b46/sub-test-model-0c4b46-kserve-6b8b9fb5c-kgp6k"]
Jul 22 05:11:59.065907 ip-10-0-141-238 kubenswrapper[2563]: I0722 05:11:59.065865    2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="9df1bb66-b0f6-4fec-96fe-b74f5bb0c9ef" path="/var/lib/kubelet/pods/9df1bb66-b0f6-4fec-96fe-b74f5bb0c9ef/volumes"
Jul 22 05:11:59.066468 ip-10-0-141-238 kubenswrapper[2563]: I0722 05:11:59.066447    2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="fc3bda30-104d-4512-bc02-f1dd0a44b674" path="/var/lib/kubelet/pods/fc3bda30-104d-4512-bc02-f1dd0a44b674/volumes"
Jul 22 05:11:59.369654 ip-10-0-141-238 kubenswrapper[2563]: I0722 05:11:59.369574    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-wsdd9"]
Jul 22 05:12:20.473632 ip-10-0-141-238 kubenswrapper[2563]: I0722 05:12:20.473601    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-b-0c4b46/rate-test-model-0c4b46-kserve-5c4cfbb7ff-6hzjb"]
Jul 22 05:12:20.474243 ip-10-0-141-238 kubenswrapper[2563]: I0722 05:12:20.474173    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9df1bb66-b0f6-4fec-96fe-b74f5bb0c9ef" containerName="main"
Jul 22 05:12:20.474243 ip-10-0-141-238 kubenswrapper[2563]: I0722 05:12:20.474195    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="9df1bb66-b0f6-4fec-96fe-b74f5bb0c9ef" containerName="main"
Jul 22 05:12:20.474243 ip-10-0-141-238 kubenswrapper[2563]: I0722 05:12:20.474212    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="fc3bda30-104d-4512-bc02-f1dd0a44b674" containerName="main"
Jul 22 05:12:20.474243 ip-10-0-141-238 kubenswrapper[2563]: I0722 05:12:20.474220    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="fc3bda30-104d-4512-bc02-f1dd0a44b674" containerName="main"
Jul 22 05:12:20.474461 ip-10-0-141-238 kubenswrapper[2563]: I0722 05:12:20.474339    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="fc3bda30-104d-4512-bc02-f1dd0a44b674" containerName="main"
Jul 22 05:12:20.474461 ip-10-0-141-238 kubenswrapper[2563]: I0722 05:12:20.474354    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="9df1bb66-b0f6-4fec-96fe-b74f5bb0c9ef" containerName="main"
Jul 22 05:12:20.478801 ip-10-0-141-238 kubenswrapper[2563]: I0722 05:12:20.478778    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-0c4b46/rate-test-model-0c4b46-kserve-5c4cfbb7ff-6hzjb"
Jul 22 05:12:20.481139 ip-10-0-141-238 kubenswrapper[2563]: I0722 05:12:20.481116    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-0c4b46\"/\"openshift-service-ca.crt\""
Jul 22 05:12:20.482264 ip-10-0-141-238 kubenswrapper[2563]: I0722 05:12:20.482240    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-0c4b46\"/\"kube-root-ca.crt\""
Jul 22 05:12:20.482375 ip-10-0-141-238 kubenswrapper[2563]: I0722 05:12:20.482241    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-0c4b46\"/\"rate-test-model-0c4b46-kserve-self-signed-certs\""
Jul 22 05:12:20.482375 ip-10-0-141-238 kubenswrapper[2563]: I0722 05:12:20.482281    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-0c4b46\"/\"default-dockercfg-bgrpg\""
Jul 22 05:12:20.487171 ip-10-0-141-238 kubenswrapper[2563]: I0722 05:12:20.487152    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-0c4b46/rate-test-model-0c4b46-kserve-5c4cfbb7ff-6hzjb"]
Jul 22 05:12:20.501895 ip-10-0-141-238 kubenswrapper[2563]: I0722 05:12:20.501875    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j9gvx_b4af3ae5-fa65-4358-8399-6ed11b68616e/konnectivity-agent/0.log" limit=1024
Jul 22 05:12:20.555883 ip-10-0-141-238 kubenswrapper[2563]: I0722 05:12:20.555858    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/cf34776e-56af-49fc-951b-dae3c5647606-model-cache\") pod \"rate-test-model-0c4b46-kserve-5c4cfbb7ff-6hzjb\" (UID: \"cf34776e-56af-49fc-951b-dae3c5647606\") " pod="ai-tenant-e2e-shared-b-0c4b46/rate-test-model-0c4b46-kserve-5c4cfbb7ff-6hzjb"
Jul 22 05:12:20.555988 ip-10-0-141-238 kubenswrapper[2563]: I0722 05:12:20.555914    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/cf34776e-56af-49fc-951b-dae3c5647606-dshm\") pod \"rate-test-model-0c4b46-kserve-5c4cfbb7ff-6hzjb\" (UID: \"cf34776e-56af-49fc-951b-dae3c5647606\") " pod="ai-tenant-e2e-shared-b-0c4b46/rate-test-model-0c4b46-kserve-5c4cfbb7ff-6hzjb"
Jul 22 05:12:20.555988 ip-10-0-141-238 kubenswrapper[2563]: I0722 05:12:20.555978    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/cf34776e-56af-49fc-951b-dae3c5647606-tmp-dir\") pod \"rate-test-model-0c4b46-kserve-5c4cfbb7ff-6hzjb\" (UID: \"cf34776e-56af-49fc-951b-dae3c5647606\") " pod="ai-tenant-e2e-shared-b-0c4b46/rate-test-model-0c4b46-kserve-5c4cfbb7ff-6hzjb"
Jul 22 05:12:20.556093 ip-10-0-141-238 kubenswrapper[2563]: I0722 05:12:20.556011    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/cf34776e-56af-49fc-951b-dae3c5647606-home\") pod \"rate-test-model-0c4b46-kserve-5c4cfbb7ff-6hzjb\" (UID: \"cf34776e-56af-49fc-951b-dae3c5647606\") " pod="ai-tenant-e2e-shared-b-0c4b46/rate-test-model-0c4b46-kserve-5c4cfbb7ff-6hzjb"
Jul 22 05:12:20.556093 ip-10-0-141-238 kubenswrapper[2563]: I0722 05:12:20.556067    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/cf34776e-56af-49fc-951b-dae3c5647606-tls-certs\") pod \"rate-test-model-0c4b46-kserve-5c4cfbb7ff-6hzjb\" (UID: \"cf34776e-56af-49fc-951b-dae3c5647606\") " pod="ai-tenant-e2e-shared-b-0c4b46/rate-test-model-0c4b46-kserve-5c4cfbb7ff-6hzjb"
Jul 22 05:12:20.556162 ip-10-0-141-238 kubenswrapper[2563]: I0722 05:12:20.556112    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pz7r8\" (UniqueName: \"kubernetes.io/projected/cf34776e-56af-49fc-951b-dae3c5647606-kube-api-access-pz7r8\") pod \"rate-test-model-0c4b46-kserve-5c4cfbb7ff-6hzjb\" (UID: \"cf34776e-56af-49fc-951b-dae3c5647606\") " pod="ai-tenant-e2e-shared-b-0c4b46/rate-test-model-0c4b46-kserve-5c4cfbb7ff-6hzjb"
Jul 22 05:12:20.657243 ip-10-0-141-238 kubenswrapper[2563]: I0722 05:12:20.657204    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/cf34776e-56af-49fc-951b-dae3c5647606-tmp-dir\") pod \"rate-test-model-0c4b46-kserve-5c4cfbb7ff-6hzjb\" (UID: \"cf34776e-56af-49fc-951b-dae3c5647606\") " pod="ai-tenant-e2e-shared-b-0c4b46/rate-test-model-0c4b46-kserve-5c4cfbb7ff-6hzjb"
Jul 22 05:12:20.657243 ip-10-0-141-238 kubenswrapper[2563]: I0722 05:12:20.657240    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/cf34776e-56af-49fc-951b-dae3c5647606-home\") pod \"rate-test-model-0c4b46-kserve-5c4cfbb7ff-6hzjb\" (UID: \"cf34776e-56af-49fc-951b-dae3c5647606\") " pod="ai-tenant-e2e-shared-b-0c4b46/rate-test-model-0c4b46-kserve-5c4cfbb7ff-6hzjb"
Jul 22 05:12:20.657455 ip-10-0-141-238 kubenswrapper[2563]: I0722 05:12:20.657265    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/cf34776e-56af-49fc-951b-dae3c5647606-tls-certs\") pod \"rate-test-model-0c4b46-kserve-5c4cfbb7ff-6hzjb\" (UID: \"cf34776e-56af-49fc-951b-dae3c5647606\") " pod="ai-tenant-e2e-shared-b-0c4b46/rate-test-model-0c4b46-kserve-5c4cfbb7ff-6hzjb"
Jul 22 05:12:20.657455 ip-10-0-141-238 kubenswrapper[2563]: I0722 05:12:20.657299    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pz7r8\" (UniqueName: \"kubernetes.io/projected/cf34776e-56af-49fc-951b-dae3c5647606-kube-api-access-pz7r8\") pod \"rate-test-model-0c4b46-kserve-5c4cfbb7ff-6hzjb\" (UID: \"cf34776e-56af-49fc-951b-dae3c5647606\") " pod="ai-tenant-e2e-shared-b-0c4b46/rate-test-model-0c4b46-kserve-5c4cfbb7ff-6hzjb"
Jul 22 05:12:20.657455 ip-10-0-141-238 kubenswrapper[2563]: I0722 05:12:20.657326    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/cf34776e-56af-49fc-951b-dae3c5647606-model-cache\") pod \"rate-test-model-0c4b46-kserve-5c4cfbb7ff-6hzjb\" (UID: \"cf34776e-56af-49fc-951b-dae3c5647606\") " pod="ai-tenant-e2e-shared-b-0c4b46/rate-test-model-0c4b46-kserve-5c4cfbb7ff-6hzjb"
Jul 22 05:12:20.657455 ip-10-0-141-238 kubenswrapper[2563]: I0722 05:12:20.657369    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/cf34776e-56af-49fc-951b-dae3c5647606-dshm\") pod \"rate-test-model-0c4b46-kserve-5c4cfbb7ff-6hzjb\" (UID: \"cf34776e-56af-49fc-951b-dae3c5647606\") " pod="ai-tenant-e2e-shared-b-0c4b46/rate-test-model-0c4b46-kserve-5c4cfbb7ff-6hzjb"
Jul 22 05:12:20.657675 ip-10-0-141-238 kubenswrapper[2563]: I0722 05:12:20.657656    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/cf34776e-56af-49fc-951b-dae3c5647606-home\") pod \"rate-test-model-0c4b46-kserve-5c4cfbb7ff-6hzjb\" (UID: \"cf34776e-56af-49fc-951b-dae3c5647606\") " pod="ai-tenant-e2e-shared-b-0c4b46/rate-test-model-0c4b46-kserve-5c4cfbb7ff-6hzjb"
Jul 22 05:12:20.657744 ip-10-0-141-238 kubenswrapper[2563]: I0722 05:12:20.657698    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/cf34776e-56af-49fc-951b-dae3c5647606-model-cache\") pod \"rate-test-model-0c4b46-kserve-5c4cfbb7ff-6hzjb\" (UID: \"cf34776e-56af-49fc-951b-dae3c5647606\") " pod="ai-tenant-e2e-shared-b-0c4b46/rate-test-model-0c4b46-kserve-5c4cfbb7ff-6hzjb"
Jul 22 05:12:20.657849 ip-10-0-141-238 kubenswrapper[2563]: I0722 05:12:20.657827    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/cf34776e-56af-49fc-951b-dae3c5647606-tmp-dir\") pod \"rate-test-model-0c4b46-kserve-5c4cfbb7ff-6hzjb\" (UID: \"cf34776e-56af-49fc-951b-dae3c5647606\") " pod="ai-tenant-e2e-shared-b-0c4b46/rate-test-model-0c4b46-kserve-5c4cfbb7ff-6hzjb"
Jul 22 05:12:20.659483 ip-10-0-141-238 kubenswrapper[2563]: I0722 05:12:20.659456    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/cf34776e-56af-49fc-951b-dae3c5647606-dshm\") pod \"rate-test-model-0c4b46-kserve-5c4cfbb7ff-6hzjb\" (UID: \"cf34776e-56af-49fc-951b-dae3c5647606\") " pod="ai-tenant-e2e-shared-b-0c4b46/rate-test-model-0c4b46-kserve-5c4cfbb7ff-6hzjb"
Jul 22 05:12:20.659749 ip-10-0-141-238 kubenswrapper[2563]: I0722 05:12:20.659731    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/cf34776e-56af-49fc-951b-dae3c5647606-tls-certs\") pod \"rate-test-model-0c4b46-kserve-5c4cfbb7ff-6hzjb\" (UID: \"cf34776e-56af-49fc-951b-dae3c5647606\") " pod="ai-tenant-e2e-shared-b-0c4b46/rate-test-model-0c4b46-kserve-5c4cfbb7ff-6hzjb"
Jul 22 05:12:20.666085 ip-10-0-141-238 kubenswrapper[2563]: I0722 05:12:20.666066    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pz7r8\" (UniqueName: \"kubernetes.io/projected/cf34776e-56af-49fc-951b-dae3c5647606-kube-api-access-pz7r8\") pod \"rate-test-model-0c4b46-kserve-5c4cfbb7ff-6hzjb\" (UID: \"cf34776e-56af-49fc-951b-dae3c5647606\") " pod="ai-tenant-e2e-shared-b-0c4b46/rate-test-model-0c4b46-kserve-5c4cfbb7ff-6hzjb"
Jul 22 05:12:20.788917 ip-10-0-141-238 kubenswrapper[2563]: I0722 05:12:20.788829    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-0c4b46/rate-test-model-0c4b46-kserve-5c4cfbb7ff-6hzjb"
Jul 22 05:12:20.920346 ip-10-0-141-238 kubenswrapper[2563]: I0722 05:12:20.920299    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-0c4b46/rate-test-model-0c4b46-kserve-5c4cfbb7ff-6hzjb"]
Jul 22 05:12:20.922671 ip-10-0-141-238 kubenswrapper[2563]: W0722 05:12:20.922641    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podcf34776e_56af_49fc_951b_dae3c5647606.slice/crio-f92f833e78fb55ce46136c76ad008959c31496e44f1d1924617e39809dc0e244 WatchSource:0}: Error finding container f92f833e78fb55ce46136c76ad008959c31496e44f1d1924617e39809dc0e244: Status 404 returned error can't find the container with id f92f833e78fb55ce46136c76ad008959c31496e44f1d1924617e39809dc0e244
Jul 22 05:12:21.254413 ip-10-0-141-238 kubenswrapper[2563]: I0722 05:12:21.254376    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-0c4b46/rate-test-model-0c4b46-kserve-5c4cfbb7ff-6hzjb" event={"ID":"cf34776e-56af-49fc-951b-dae3c5647606","Type":"ContainerStarted","Data":"1ea5403c14a4ca01712d81b7aba31e56469ab244626ed8928dd4362a3984a5a2"}
Jul 22 05:12:21.254413 ip-10-0-141-238 kubenswrapper[2563]: I0722 05:12:21.254425    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-0c4b46/rate-test-model-0c4b46-kserve-5c4cfbb7ff-6hzjb" event={"ID":"cf34776e-56af-49fc-951b-dae3c5647606","Type":"ContainerStarted","Data":"f92f833e78fb55ce46136c76ad008959c31496e44f1d1924617e39809dc0e244"}
Jul 22 05:12:24.369525 ip-10-0-141-238 kubenswrapper[2563]: I0722 05:12:24.369471    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-b-0c4b46/rate-test-model-0c4b46-kserve-5c4cfbb7ff-6hzjb" podStartSLOduration=4.369456625 podStartE2EDuration="4.369456625s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 05:12:20 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 05:12:21.270239331 +0000 UTC m=+2856.689248088" watchObservedRunningTime="2026-07-22 05:12:24.369456625 +0000 UTC m=+2859.788465380"
Jul 22 05:12:24.371139 ip-10-0-141-238 kubenswrapper[2563]: I0722 05:12:24.371114    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-wsdd9"]
Jul 22 05:12:30.789889 ip-10-0-141-238 kubenswrapper[2563]: I0722 05:12:30.789851    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-b-0c4b46/rate-test-model-0c4b46-kserve-5c4cfbb7ff-6hzjb"
Jul 22 05:12:30.790320 ip-10-0-141-238 kubenswrapper[2563]: I0722 05:12:30.789904    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-b-0c4b46/rate-test-model-0c4b46-kserve-5c4cfbb7ff-6hzjb"
Jul 22 05:12:30.802394 ip-10-0-141-238 kubenswrapper[2563]: I0722 05:12:30.802368    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-b-0c4b46/rate-test-model-0c4b46-kserve-5c4cfbb7ff-6hzjb"
Jul 22 05:12:31.312634 ip-10-0-141-238 kubenswrapper[2563]: I0722 05:12:31.312605    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-b-0c4b46/rate-test-model-0c4b46-kserve-5c4cfbb7ff-6hzjb"
Jul 22 05:12:38.973454 ip-10-0-141-238 kubenswrapper[2563]: I0722 05:12:38.973366    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-wsdd9"]
Jul 22 05:12:39.670911 ip-10-0-141-238 kubenswrapper[2563]: I0722 05:12:39.670881    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j9gvx_b4af3ae5-fa65-4358-8399-6ed11b68616e/konnectivity-agent/0.log" limit=1024
Jul 22 05:12:39.772590 ip-10-0-141-238 kubenswrapper[2563]: I0722 05:12:39.772558    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j9gvx_b4af3ae5-fa65-4358-8399-6ed11b68616e/konnectivity-agent/0.log" limit=1024
Jul 22 05:12:40.772278 ip-10-0-141-238 kubenswrapper[2563]: I0722 05:12:40.772233    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j9gvx_b4af3ae5-fa65-4358-8399-6ed11b68616e/konnectivity-agent/0.log" limit=1024
Jul 22 05:12:40.880034 ip-10-0-141-238 kubenswrapper[2563]: I0722 05:12:40.880002    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j9gvx_b4af3ae5-fa65-4358-8399-6ed11b68616e/konnectivity-agent/0.log" limit=1024
Jul 22 05:12:45.280357 ip-10-0-141-238 kubenswrapper[2563]: I0722 05:12:45.280326    2563 scope.go:117] "RemoveContainer" containerID="4c14d28d8705e6efaac10b696080b5544e73f8f393a6dcd912b65e127009488c"
Jul 22 05:12:48.016836 ip-10-0-141-238 kubenswrapper[2563]: I0722 05:12:48.016800    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j9gvx_b4af3ae5-fa65-4358-8399-6ed11b68616e/konnectivity-agent/0.log" limit=1024
Jul 22 05:12:48.120218 ip-10-0-141-238 kubenswrapper[2563]: I0722 05:12:48.120182    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j9gvx_b4af3ae5-fa65-4358-8399-6ed11b68616e/konnectivity-agent/0.log" limit=1024
Jul 22 05:12:54.567801 ip-10-0-141-238 kubenswrapper[2563]: I0722 05:12:54.567766    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-wsdd9"]
Jul 22 05:13:01.537426 ip-10-0-141-238 kubenswrapper[2563]: I0722 05:13:01.537389    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j9gvx_b4af3ae5-fa65-4358-8399-6ed11b68616e/konnectivity-agent/0.log" limit=1024
Jul 22 05:13:02.465885 ip-10-0-141-238 kubenswrapper[2563]: I0722 05:13:02.465853    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-0c4b46/rate-test-model-0c4b46-kserve-5c4cfbb7ff-6hzjb"]
Jul 22 05:13:02.484312 ip-10-0-141-238 kubenswrapper[2563]: I0722 05:13:02.484286    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j9gvx_b4af3ae5-fa65-4358-8399-6ed11b68616e/konnectivity-agent/0.log" limit=1024
Jul 22 05:13:09.075940 ip-10-0-141-238 kubenswrapper[2563]: I0722 05:13:09.075910    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-wsdd9"]
Jul 22 05:13:17.485169 ip-10-0-141-238 kubenswrapper[2563]: I0722 05:13:17.485119    2563 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-shared-b-0c4b46/rate-test-model-0c4b46-kserve-5c4cfbb7ff-6hzjb" podUID="cf34776e-56af-49fc-951b-dae3c5647606" containerName="main" containerID="cri-o://1ea5403c14a4ca01712d81b7aba31e56469ab244626ed8928dd4362a3984a5a2" gracePeriod=45
Jul 22 05:13:17.738373 ip-10-0-141-238 kubenswrapper[2563]: I0722 05:13:17.738314    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-0c4b46/rate-test-model-0c4b46-kserve-5c4cfbb7ff-6hzjb"
Jul 22 05:13:17.840260 ip-10-0-141-238 kubenswrapper[2563]: I0722 05:13:17.840231    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/cf34776e-56af-49fc-951b-dae3c5647606-tls-certs\") pod \"cf34776e-56af-49fc-951b-dae3c5647606\" (UID: \"cf34776e-56af-49fc-951b-dae3c5647606\") "
Jul 22 05:13:17.840434 ip-10-0-141-238 kubenswrapper[2563]: I0722 05:13:17.840272    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/cf34776e-56af-49fc-951b-dae3c5647606-tmp-dir\") pod \"cf34776e-56af-49fc-951b-dae3c5647606\" (UID: \"cf34776e-56af-49fc-951b-dae3c5647606\") "
Jul 22 05:13:17.840434 ip-10-0-141-238 kubenswrapper[2563]: I0722 05:13:17.840297    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-pz7r8\" (UniqueName: \"kubernetes.io/projected/cf34776e-56af-49fc-951b-dae3c5647606-kube-api-access-pz7r8\") pod \"cf34776e-56af-49fc-951b-dae3c5647606\" (UID: \"cf34776e-56af-49fc-951b-dae3c5647606\") "
Jul 22 05:13:17.840434 ip-10-0-141-238 kubenswrapper[2563]: I0722 05:13:17.840336    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/cf34776e-56af-49fc-951b-dae3c5647606-model-cache\") pod \"cf34776e-56af-49fc-951b-dae3c5647606\" (UID: \"cf34776e-56af-49fc-951b-dae3c5647606\") "
Jul 22 05:13:17.840434 ip-10-0-141-238 kubenswrapper[2563]: I0722 05:13:17.840376    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/cf34776e-56af-49fc-951b-dae3c5647606-home\") pod \"cf34776e-56af-49fc-951b-dae3c5647606\" (UID: \"cf34776e-56af-49fc-951b-dae3c5647606\") "
Jul 22 05:13:17.840674 ip-10-0-141-238 kubenswrapper[2563]: I0722 05:13:17.840457    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/cf34776e-56af-49fc-951b-dae3c5647606-dshm\") pod \"cf34776e-56af-49fc-951b-dae3c5647606\" (UID: \"cf34776e-56af-49fc-951b-dae3c5647606\") "
Jul 22 05:13:17.840674 ip-10-0-141-238 kubenswrapper[2563]: I0722 05:13:17.840524    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/cf34776e-56af-49fc-951b-dae3c5647606-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "cf34776e-56af-49fc-951b-dae3c5647606" (UID: "cf34776e-56af-49fc-951b-dae3c5647606"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 22 05:13:17.840674 ip-10-0-141-238 kubenswrapper[2563]: I0722 05:13:17.840638    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/cf34776e-56af-49fc-951b-dae3c5647606-model-cache" (OuterVolumeSpecName: "model-cache") pod "cf34776e-56af-49fc-951b-dae3c5647606" (UID: "cf34776e-56af-49fc-951b-dae3c5647606"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 22 05:13:17.840827 ip-10-0-141-238 kubenswrapper[2563]: I0722 05:13:17.840681    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/cf34776e-56af-49fc-951b-dae3c5647606-home" (OuterVolumeSpecName: "home") pod "cf34776e-56af-49fc-951b-dae3c5647606" (UID: "cf34776e-56af-49fc-951b-dae3c5647606"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 22 05:13:17.840827 ip-10-0-141-238 kubenswrapper[2563]: I0722 05:13:17.840777    2563 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/cf34776e-56af-49fc-951b-dae3c5647606-tmp-dir\") on node \"ip-10-0-141-238.ec2.internal\" DevicePath \"\""
Jul 22 05:13:17.840827 ip-10-0-141-238 kubenswrapper[2563]: I0722 05:13:17.840799    2563 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/cf34776e-56af-49fc-951b-dae3c5647606-model-cache\") on node \"ip-10-0-141-238.ec2.internal\" DevicePath \"\""
Jul 22 05:13:17.840827 ip-10-0-141-238 kubenswrapper[2563]: I0722 05:13:17.840812    2563 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/cf34776e-56af-49fc-951b-dae3c5647606-home\") on node \"ip-10-0-141-238.ec2.internal\" DevicePath \"\""
Jul 22 05:13:17.842474 ip-10-0-141-238 kubenswrapper[2563]: I0722 05:13:17.842444    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/cf34776e-56af-49fc-951b-dae3c5647606-dshm" (OuterVolumeSpecName: "dshm") pod "cf34776e-56af-49fc-951b-dae3c5647606" (UID: "cf34776e-56af-49fc-951b-dae3c5647606"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 22 05:13:17.842474 ip-10-0-141-238 kubenswrapper[2563]: I0722 05:13:17.842459    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/cf34776e-56af-49fc-951b-dae3c5647606-kube-api-access-pz7r8" (OuterVolumeSpecName: "kube-api-access-pz7r8") pod "cf34776e-56af-49fc-951b-dae3c5647606" (UID: "cf34776e-56af-49fc-951b-dae3c5647606"). InnerVolumeSpecName "kube-api-access-pz7r8". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 22 05:13:17.842474 ip-10-0-141-238 kubenswrapper[2563]: I0722 05:13:17.842467    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/cf34776e-56af-49fc-951b-dae3c5647606-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "cf34776e-56af-49fc-951b-dae3c5647606" (UID: "cf34776e-56af-49fc-951b-dae3c5647606"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 22 05:13:17.941600 ip-10-0-141-238 kubenswrapper[2563]: I0722 05:13:17.941565    2563 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/cf34776e-56af-49fc-951b-dae3c5647606-dshm\") on node \"ip-10-0-141-238.ec2.internal\" DevicePath \"\""
Jul 22 05:13:17.941600 ip-10-0-141-238 kubenswrapper[2563]: I0722 05:13:17.941593    2563 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/cf34776e-56af-49fc-951b-dae3c5647606-tls-certs\") on node \"ip-10-0-141-238.ec2.internal\" DevicePath \"\""
Jul 22 05:13:17.941600 ip-10-0-141-238 kubenswrapper[2563]: I0722 05:13:17.941604    2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-pz7r8\" (UniqueName: \"kubernetes.io/projected/cf34776e-56af-49fc-951b-dae3c5647606-kube-api-access-pz7r8\") on node \"ip-10-0-141-238.ec2.internal\" DevicePath \"\""
Jul 22 05:13:18.513489 ip-10-0-141-238 kubenswrapper[2563]: I0722 05:13:18.513454    2563 generic.go:356] "Generic (PLEG): container finished" podID="cf34776e-56af-49fc-951b-dae3c5647606" containerID="1ea5403c14a4ca01712d81b7aba31e56469ab244626ed8928dd4362a3984a5a2" exitCode=0
Jul 22 05:13:18.513920 ip-10-0-141-238 kubenswrapper[2563]: I0722 05:13:18.513496    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-0c4b46/rate-test-model-0c4b46-kserve-5c4cfbb7ff-6hzjb"
Jul 22 05:13:18.513920 ip-10-0-141-238 kubenswrapper[2563]: I0722 05:13:18.513499    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-0c4b46/rate-test-model-0c4b46-kserve-5c4cfbb7ff-6hzjb" event={"ID":"cf34776e-56af-49fc-951b-dae3c5647606","Type":"ContainerDied","Data":"1ea5403c14a4ca01712d81b7aba31e56469ab244626ed8928dd4362a3984a5a2"}
Jul 22 05:13:18.513920 ip-10-0-141-238 kubenswrapper[2563]: I0722 05:13:18.513595    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-0c4b46/rate-test-model-0c4b46-kserve-5c4cfbb7ff-6hzjb" event={"ID":"cf34776e-56af-49fc-951b-dae3c5647606","Type":"ContainerDied","Data":"f92f833e78fb55ce46136c76ad008959c31496e44f1d1924617e39809dc0e244"}
Jul 22 05:13:18.513920 ip-10-0-141-238 kubenswrapper[2563]: I0722 05:13:18.513612    2563 scope.go:117] "RemoveContainer" containerID="1ea5403c14a4ca01712d81b7aba31e56469ab244626ed8928dd4362a3984a5a2"
Jul 22 05:13:18.522989 ip-10-0-141-238 kubenswrapper[2563]: I0722 05:13:18.522972    2563 scope.go:117] "RemoveContainer" containerID="1ea5403c14a4ca01712d81b7aba31e56469ab244626ed8928dd4362a3984a5a2"
Jul 22 05:13:18.523285 ip-10-0-141-238 kubenswrapper[2563]: E0722 05:13:18.523265    2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1ea5403c14a4ca01712d81b7aba31e56469ab244626ed8928dd4362a3984a5a2\": container with ID starting with 1ea5403c14a4ca01712d81b7aba31e56469ab244626ed8928dd4362a3984a5a2 not found: ID does not exist" containerID="1ea5403c14a4ca01712d81b7aba31e56469ab244626ed8928dd4362a3984a5a2"
Jul 22 05:13:18.523344 ip-10-0-141-238 kubenswrapper[2563]: I0722 05:13:18.523294    2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1ea5403c14a4ca01712d81b7aba31e56469ab244626ed8928dd4362a3984a5a2"} err="failed to get container status \"1ea5403c14a4ca01712d81b7aba31e56469ab244626ed8928dd4362a3984a5a2\": rpc error: code = NotFound desc = could not find container \"1ea5403c14a4ca01712d81b7aba31e56469ab244626ed8928dd4362a3984a5a2\": container with ID starting with 1ea5403c14a4ca01712d81b7aba31e56469ab244626ed8928dd4362a3984a5a2 not found: ID does not exist"
Jul 22 05:13:18.537063 ip-10-0-141-238 kubenswrapper[2563]: I0722 05:13:18.537026    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-0c4b46/rate-test-model-0c4b46-kserve-5c4cfbb7ff-6hzjb"]
Jul 22 05:13:18.541532 ip-10-0-141-238 kubenswrapper[2563]: I0722 05:13:18.541510    2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-b-0c4b46/rate-test-model-0c4b46-kserve-5c4cfbb7ff-6hzjb"]
Jul 22 05:13:19.065226 ip-10-0-141-238 kubenswrapper[2563]: I0722 05:13:19.065190    2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="cf34776e-56af-49fc-951b-dae3c5647606" path="/var/lib/kubelet/pods/cf34776e-56af-49fc-951b-dae3c5647606/volumes"
Jul 22 05:13:21.589790 ip-10-0-141-238 kubenswrapper[2563]: I0722 05:13:21.589756    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-81d7ca-ghstt"]
Jul 22 05:13:21.590181 ip-10-0-141-238 kubenswrapper[2563]: I0722 05:13:21.590152    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="cf34776e-56af-49fc-951b-dae3c5647606" containerName="main"
Jul 22 05:13:21.590181 ip-10-0-141-238 kubenswrapper[2563]: I0722 05:13:21.590165    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="cf34776e-56af-49fc-951b-dae3c5647606" containerName="main"
Jul 22 05:13:21.590255 ip-10-0-141-238 kubenswrapper[2563]: I0722 05:13:21.590238    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="cf34776e-56af-49fc-951b-dae3c5647606" containerName="main"
Jul 22 05:13:21.594694 ip-10-0-141-238 kubenswrapper[2563]: I0722 05:13:21.594677    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-81d7ca-ghstt"
Jul 22 05:13:21.597233 ip-10-0-141-238 kubenswrapper[2563]: I0722 05:13:21.597214    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 22 05:13:21.597358 ip-10-0-141-238 kubenswrapper[2563]: I0722 05:13:21.597221    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-65v9v\""
Jul 22 05:13:21.601002 ip-10-0-141-238 kubenswrapper[2563]: I0722 05:13:21.600980    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-81d7ca-ghstt"]
Jul 22 05:13:21.672864 ip-10-0-141-238 kubenswrapper[2563]: I0722 05:13:21.672834    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/53a47967-44d9-4a3a-be46-6ae35b8c1965-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-a-81d7ca-ghstt\" (UID: \"53a47967-44d9-4a3a-be46-6ae35b8c1965\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-81d7ca-ghstt"
Jul 22 05:13:21.773765 ip-10-0-141-238 kubenswrapper[2563]: I0722 05:13:21.773735    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/53a47967-44d9-4a3a-be46-6ae35b8c1965-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-a-81d7ca-ghstt\" (UID: \"53a47967-44d9-4a3a-be46-6ae35b8c1965\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-81d7ca-ghstt"
Jul 22 05:13:21.774350 ip-10-0-141-238 kubenswrapper[2563]: I0722 05:13:21.774332    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/53a47967-44d9-4a3a-be46-6ae35b8c1965-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-a-81d7ca-ghstt\" (UID: \"53a47967-44d9-4a3a-be46-6ae35b8c1965\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-81d7ca-ghstt"
Jul 22 05:13:21.905865 ip-10-0-141-238 kubenswrapper[2563]: I0722 05:13:21.905829    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-81d7ca-ghstt"
Jul 22 05:13:22.036217 ip-10-0-141-238 kubenswrapper[2563]: I0722 05:13:22.036195    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-81d7ca-ghstt"]
Jul 22 05:13:22.038901 ip-10-0-141-238 kubenswrapper[2563]: W0722 05:13:22.038872    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod53a47967_44d9_4a3a_be46_6ae35b8c1965.slice/crio-7d209079f86f4884057fccfffa5471d81160d88c7add98c3aa12f3ed1069456d WatchSource:0}: Error finding container 7d209079f86f4884057fccfffa5471d81160d88c7add98c3aa12f3ed1069456d: Status 404 returned error can't find the container with id 7d209079f86f4884057fccfffa5471d81160d88c7add98c3aa12f3ed1069456d
Jul 22 05:13:22.109102 ip-10-0-141-238 kubenswrapper[2563]: I0722 05:13:22.109073    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j9gvx_b4af3ae5-fa65-4358-8399-6ed11b68616e/konnectivity-agent/0.log" limit=1024
Jul 22 05:13:22.210614 ip-10-0-141-238 kubenswrapper[2563]: I0722 05:13:22.210584    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j9gvx_b4af3ae5-fa65-4358-8399-6ed11b68616e/konnectivity-agent/0.log" limit=1024
Jul 22 05:13:22.533393 ip-10-0-141-238 kubenswrapper[2563]: I0722 05:13:22.533303    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-81d7ca-ghstt" event={"ID":"53a47967-44d9-4a3a-be46-6ae35b8c1965","Type":"ContainerStarted","Data":"695841b772dbd92e6385bffbb42800221bafab901269e6e10cc719057ed9a71f"}
Jul 22 05:13:22.533393 ip-10-0-141-238 kubenswrapper[2563]: I0722 05:13:22.533358    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-81d7ca-ghstt" event={"ID":"53a47967-44d9-4a3a-be46-6ae35b8c1965","Type":"ContainerStarted","Data":"7d209079f86f4884057fccfffa5471d81160d88c7add98c3aa12f3ed1069456d"}
Jul 22 05:13:22.550762 ip-10-0-141-238 kubenswrapper[2563]: I0722 05:13:22.550715    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-81d7ca-ghstt" podStartSLOduration=1.550700624 podStartE2EDuration="1.550700624s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 05:13:21 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 05:13:22.549449186 +0000 UTC m=+2917.968457943" watchObservedRunningTime="2026-07-22 05:13:22.550700624 +0000 UTC m=+2917.969709380"
Jul 22 05:13:23.539492 ip-10-0-141-238 kubenswrapper[2563]: I0722 05:13:23.539456    2563 generic.go:356] "Generic (PLEG): container finished" podID="53a47967-44d9-4a3a-be46-6ae35b8c1965" containerID="695841b772dbd92e6385bffbb42800221bafab901269e6e10cc719057ed9a71f" exitCode=0
Jul 22 05:13:23.539878 ip-10-0-141-238 kubenswrapper[2563]: I0722 05:13:23.539509    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-81d7ca-ghstt" event={"ID":"53a47967-44d9-4a3a-be46-6ae35b8c1965","Type":"ContainerDied","Data":"695841b772dbd92e6385bffbb42800221bafab901269e6e10cc719057ed9a71f"}
Jul 22 05:13:24.672837 ip-10-0-141-238 kubenswrapper[2563]: I0722 05:13:24.672811    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-81d7ca-ghstt"
Jul 22 05:13:24.803179 ip-10-0-141-238 kubenswrapper[2563]: I0722 05:13:24.803093    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/53a47967-44d9-4a3a-be46-6ae35b8c1965-maas-api-service-ca\") pod \"53a47967-44d9-4a3a-be46-6ae35b8c1965\" (UID: \"53a47967-44d9-4a3a-be46-6ae35b8c1965\") "
Jul 22 05:13:24.803443 ip-10-0-141-238 kubenswrapper[2563]: I0722 05:13:24.803422    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/53a47967-44d9-4a3a-be46-6ae35b8c1965-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "53a47967-44d9-4a3a-be46-6ae35b8c1965" (UID: "53a47967-44d9-4a3a-be46-6ae35b8c1965"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 22 05:13:24.904647 ip-10-0-141-238 kubenswrapper[2563]: I0722 05:13:24.904614    2563 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/53a47967-44d9-4a3a-be46-6ae35b8c1965-maas-api-service-ca\") on node \"ip-10-0-141-238.ec2.internal\" DevicePath \"\""
Jul 22 05:13:25.550085 ip-10-0-141-238 kubenswrapper[2563]: I0722 05:13:25.550060    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-81d7ca-ghstt"
Jul 22 05:13:25.550338 ip-10-0-141-238 kubenswrapper[2563]: I0722 05:13:25.550086    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-81d7ca-ghstt" event={"ID":"53a47967-44d9-4a3a-be46-6ae35b8c1965","Type":"ContainerDied","Data":"7d209079f86f4884057fccfffa5471d81160d88c7add98c3aa12f3ed1069456d"}
Jul 22 05:13:25.550338 ip-10-0-141-238 kubenswrapper[2563]: I0722 05:13:25.550134    2563 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="7d209079f86f4884057fccfffa5471d81160d88c7add98c3aa12f3ed1069456d"
Jul 22 05:13:32.371142 ip-10-0-141-238 kubenswrapper[2563]: I0722 05:13:32.371105    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j9gvx_b4af3ae5-fa65-4358-8399-6ed11b68616e/konnectivity-agent/0.log" limit=1024
Jul 22 05:13:35.675337 ip-10-0-141-238 kubenswrapper[2563]: I0722 05:13:35.675303    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-wsdd9"]
Jul 22 05:13:36.682687 ip-10-0-141-238 kubenswrapper[2563]: I0722 05:13:36.682654    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j9gvx_b4af3ae5-fa65-4358-8399-6ed11b68616e/konnectivity-agent/0.log" limit=1024
Jul 22 05:13:36.690689 ip-10-0-141-238 kubenswrapper[2563]: I0722 05:13:36.690664    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-81d7ca-ghstt"]
Jul 22 05:13:36.693357 ip-10-0-141-238 kubenswrapper[2563]: I0722 05:13:36.693335    2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-81d7ca-ghstt"]
Jul 22 05:13:37.061773 ip-10-0-141-238 kubenswrapper[2563]: I0722 05:13:37.061686    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j9gvx_b4af3ae5-fa65-4358-8399-6ed11b68616e/konnectivity-agent/0.log" limit=1024
Jul 22 05:13:37.065515 ip-10-0-141-238 kubenswrapper[2563]: I0722 05:13:37.065488    2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="53a47967-44d9-4a3a-be46-6ae35b8c1965" path="/var/lib/kubelet/pods/53a47967-44d9-4a3a-be46-6ae35b8c1965/volumes"
Jul 22 05:13:42.991363 ip-10-0-141-238 kubenswrapper[2563]: I0722 05:13:42.991327    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j9gvx_b4af3ae5-fa65-4358-8399-6ed11b68616e/konnectivity-agent/0.log" limit=1024
Jul 22 05:13:43.091870 ip-10-0-141-238 kubenswrapper[2563]: I0722 05:13:43.091840    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j9gvx_b4af3ae5-fa65-4358-8399-6ed11b68616e/konnectivity-agent/0.log" limit=1024
Jul 22 05:13:43.256673 ip-10-0-141-238 kubenswrapper[2563]: I0722 05:13:43.256589    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j9gvx_b4af3ae5-fa65-4358-8399-6ed11b68616e/konnectivity-agent/0.log" limit=1024
Jul 22 05:13:43.521618 ip-10-0-141-238 kubenswrapper[2563]: I0722 05:13:43.521534    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j9gvx_b4af3ae5-fa65-4358-8399-6ed11b68616e/konnectivity-agent/0.log" limit=1024
Jul 22 05:13:44.167843 ip-10-0-141-238 kubenswrapper[2563]: I0722 05:13:44.167814    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j9gvx_b4af3ae5-fa65-4358-8399-6ed11b68616e/konnectivity-agent/0.log" limit=1024
Jul 22 05:13:44.376112 ip-10-0-141-238 kubenswrapper[2563]: I0722 05:13:44.376082    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j9gvx_b4af3ae5-fa65-4358-8399-6ed11b68616e/konnectivity-agent/0.log" limit=1024
Jul 22 05:13:54.096311 ip-10-0-141-238 kubenswrapper[2563]: I0722 05:13:54.096281    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j9gvx_b4af3ae5-fa65-4358-8399-6ed11b68616e/konnectivity-agent/0.log" limit=1024
Jul 22 05:13:57.169297 ip-10-0-141-238 kubenswrapper[2563]: I0722 05:13:57.169265    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-wsdd9"]
Jul 22 05:13:58.690124 ip-10-0-141-238 kubenswrapper[2563]: I0722 05:13:58.690091    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j9gvx_b4af3ae5-fa65-4358-8399-6ed11b68616e/konnectivity-agent/0.log" limit=1024
Jul 22 05:13:59.060691 ip-10-0-141-238 kubenswrapper[2563]: I0722 05:13:59.060609    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j9gvx_b4af3ae5-fa65-4358-8399-6ed11b68616e/konnectivity-agent/0.log" limit=1024
Jul 22 05:14:03.015964 ip-10-0-141-238 kubenswrapper[2563]: I0722 05:14:03.015927    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j9gvx_b4af3ae5-fa65-4358-8399-6ed11b68616e/konnectivity-agent/0.log" limit=1024
Jul 22 05:14:03.117255 ip-10-0-141-238 kubenswrapper[2563]: I0722 05:14:03.117216    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j9gvx_b4af3ae5-fa65-4358-8399-6ed11b68616e/konnectivity-agent/0.log" limit=1024
Jul 22 05:14:04.904211 ip-10-0-141-238 kubenswrapper[2563]: I0722 05:14:04.904177    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j9gvx_b4af3ae5-fa65-4358-8399-6ed11b68616e/konnectivity-agent/0.log" limit=1024
Jul 22 05:14:04.982604 ip-10-0-141-238 kubenswrapper[2563]: I0722 05:14:04.982570    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j9gvx_b4af3ae5-fa65-4358-8399-6ed11b68616e/konnectivity-agent/0.log" limit=1024
Jul 22 05:14:05.216911 ip-10-0-141-238 kubenswrapper[2563]: I0722 05:14:05.216809    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-b-0c4b46-openshift-default-79d674695f-9fqkl"]
Jul 22 05:14:05.217094 ip-10-0-141-238 kubenswrapper[2563]: I0722 05:14:05.217027    2563 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-shared-b-0c4b46-openshift-default-79d674695f-9fqkl" podUID="d20629aa-181c-42c8-a9ad-4e2c1fb649d4" containerName="istio-proxy" containerID="cri-o://5076a3440c01f598f7d31781f950dbef4f1851bca8bb99d708f5a9d6a76b4806" gracePeriod=30
Jul 22 05:14:05.232430 ip-10-0-141-238 kubenswrapper[2563]: I0722 05:14:05.232397    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j9gvx_b4af3ae5-fa65-4358-8399-6ed11b68616e/konnectivity-agent/0.log" limit=1024
Jul 22 05:14:05.420812 ip-10-0-141-238 kubenswrapper[2563]: I0722 05:14:05.420780    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j9gvx_b4af3ae5-fa65-4358-8399-6ed11b68616e/konnectivity-agent/0.log" limit=1024
Jul 22 05:14:10.471056 ip-10-0-141-238 kubenswrapper[2563]: I0722 05:14:10.471015    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-0c4b46-openshift-default-79d674695f-9fqkl"
Jul 22 05:14:10.602885 ip-10-0-141-238 kubenswrapper[2563]: I0722 05:14:10.602801    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d20629aa-181c-42c8-a9ad-4e2c1fb649d4-workload-socket\") pod \"d20629aa-181c-42c8-a9ad-4e2c1fb649d4\" (UID: \"d20629aa-181c-42c8-a9ad-4e2c1fb649d4\") "
Jul 22 05:14:10.602885 ip-10-0-141-238 kubenswrapper[2563]: I0722 05:14:10.602836    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d20629aa-181c-42c8-a9ad-4e2c1fb649d4-istiod-ca-cert\") pod \"d20629aa-181c-42c8-a9ad-4e2c1fb649d4\" (UID: \"d20629aa-181c-42c8-a9ad-4e2c1fb649d4\") "
Jul 22 05:14:10.602885 ip-10-0-141-238 kubenswrapper[2563]: I0722 05:14:10.602860    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d20629aa-181c-42c8-a9ad-4e2c1fb649d4-credential-socket\") pod \"d20629aa-181c-42c8-a9ad-4e2c1fb649d4\" (UID: \"d20629aa-181c-42c8-a9ad-4e2c1fb649d4\") "
Jul 22 05:14:10.602885 ip-10-0-141-238 kubenswrapper[2563]: I0722 05:14:10.602877    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-t4r5r\" (UniqueName: \"kubernetes.io/projected/d20629aa-181c-42c8-a9ad-4e2c1fb649d4-kube-api-access-t4r5r\") pod \"d20629aa-181c-42c8-a9ad-4e2c1fb649d4\" (UID: \"d20629aa-181c-42c8-a9ad-4e2c1fb649d4\") "
Jul 22 05:14:10.603254 ip-10-0-141-238 kubenswrapper[2563]: I0722 05:14:10.602903    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d20629aa-181c-42c8-a9ad-4e2c1fb649d4-istio-data\") pod \"d20629aa-181c-42c8-a9ad-4e2c1fb649d4\" (UID: \"d20629aa-181c-42c8-a9ad-4e2c1fb649d4\") "
Jul 22 05:14:10.603254 ip-10-0-141-238 kubenswrapper[2563]: I0722 05:14:10.602933    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d20629aa-181c-42c8-a9ad-4e2c1fb649d4-istio-token\") pod \"d20629aa-181c-42c8-a9ad-4e2c1fb649d4\" (UID: \"d20629aa-181c-42c8-a9ad-4e2c1fb649d4\") "
Jul 22 05:14:10.603254 ip-10-0-141-238 kubenswrapper[2563]: I0722 05:14:10.602963    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d20629aa-181c-42c8-a9ad-4e2c1fb649d4-workload-certs\") pod \"d20629aa-181c-42c8-a9ad-4e2c1fb649d4\" (UID: \"d20629aa-181c-42c8-a9ad-4e2c1fb649d4\") "
Jul 22 05:14:10.603254 ip-10-0-141-238 kubenswrapper[2563]: I0722 05:14:10.603033    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d20629aa-181c-42c8-a9ad-4e2c1fb649d4-istio-envoy\") pod \"d20629aa-181c-42c8-a9ad-4e2c1fb649d4\" (UID: \"d20629aa-181c-42c8-a9ad-4e2c1fb649d4\") "
Jul 22 05:14:10.603254 ip-10-0-141-238 kubenswrapper[2563]: I0722 05:14:10.603124    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d20629aa-181c-42c8-a9ad-4e2c1fb649d4-istio-podinfo\") pod \"d20629aa-181c-42c8-a9ad-4e2c1fb649d4\" (UID: \"d20629aa-181c-42c8-a9ad-4e2c1fb649d4\") "
Jul 22 05:14:10.603254 ip-10-0-141-238 kubenswrapper[2563]: I0722 05:14:10.603159    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d20629aa-181c-42c8-a9ad-4e2c1fb649d4-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "d20629aa-181c-42c8-a9ad-4e2c1fb649d4" (UID: "d20629aa-181c-42c8-a9ad-4e2c1fb649d4"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 22 05:14:10.603254 ip-10-0-141-238 kubenswrapper[2563]: I0722 05:14:10.603218    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d20629aa-181c-42c8-a9ad-4e2c1fb649d4-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "d20629aa-181c-42c8-a9ad-4e2c1fb649d4" (UID: "d20629aa-181c-42c8-a9ad-4e2c1fb649d4"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 22 05:14:10.603555 ip-10-0-141-238 kubenswrapper[2563]: I0722 05:14:10.603262    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d20629aa-181c-42c8-a9ad-4e2c1fb649d4-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "d20629aa-181c-42c8-a9ad-4e2c1fb649d4" (UID: "d20629aa-181c-42c8-a9ad-4e2c1fb649d4"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 22 05:14:10.603555 ip-10-0-141-238 kubenswrapper[2563]: I0722 05:14:10.603337    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d20629aa-181c-42c8-a9ad-4e2c1fb649d4-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "d20629aa-181c-42c8-a9ad-4e2c1fb649d4" (UID: "d20629aa-181c-42c8-a9ad-4e2c1fb649d4"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 22 05:14:10.603555 ip-10-0-141-238 kubenswrapper[2563]: I0722 05:14:10.603444    2563 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d20629aa-181c-42c8-a9ad-4e2c1fb649d4-workload-socket\") on node \"ip-10-0-141-238.ec2.internal\" DevicePath \"\""
Jul 22 05:14:10.603555 ip-10-0-141-238 kubenswrapper[2563]: I0722 05:14:10.603466    2563 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d20629aa-181c-42c8-a9ad-4e2c1fb649d4-istiod-ca-cert\") on node \"ip-10-0-141-238.ec2.internal\" DevicePath \"\""
Jul 22 05:14:10.603555 ip-10-0-141-238 kubenswrapper[2563]: I0722 05:14:10.603480    2563 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d20629aa-181c-42c8-a9ad-4e2c1fb649d4-credential-socket\") on node \"ip-10-0-141-238.ec2.internal\" DevicePath \"\""
Jul 22 05:14:10.603555 ip-10-0-141-238 kubenswrapper[2563]: I0722 05:14:10.603492    2563 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d20629aa-181c-42c8-a9ad-4e2c1fb649d4-workload-certs\") on node \"ip-10-0-141-238.ec2.internal\" DevicePath \"\""
Jul 22 05:14:10.603912 ip-10-0-141-238 kubenswrapper[2563]: I0722 05:14:10.603887    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d20629aa-181c-42c8-a9ad-4e2c1fb649d4-istio-data" (OuterVolumeSpecName: "istio-data") pod "d20629aa-181c-42c8-a9ad-4e2c1fb649d4" (UID: "d20629aa-181c-42c8-a9ad-4e2c1fb649d4"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 22 05:14:10.605410 ip-10-0-141-238 kubenswrapper[2563]: I0722 05:14:10.605382    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d20629aa-181c-42c8-a9ad-4e2c1fb649d4-istio-token" (OuterVolumeSpecName: "istio-token") pod "d20629aa-181c-42c8-a9ad-4e2c1fb649d4" (UID: "d20629aa-181c-42c8-a9ad-4e2c1fb649d4"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 22 05:14:10.605410 ip-10-0-141-238 kubenswrapper[2563]: I0722 05:14:10.605385    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d20629aa-181c-42c8-a9ad-4e2c1fb649d4-kube-api-access-t4r5r" (OuterVolumeSpecName: "kube-api-access-t4r5r") pod "d20629aa-181c-42c8-a9ad-4e2c1fb649d4" (UID: "d20629aa-181c-42c8-a9ad-4e2c1fb649d4"). InnerVolumeSpecName "kube-api-access-t4r5r". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 22 05:14:10.605556 ip-10-0-141-238 kubenswrapper[2563]: I0722 05:14:10.605547    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/d20629aa-181c-42c8-a9ad-4e2c1fb649d4-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "d20629aa-181c-42c8-a9ad-4e2c1fb649d4" (UID: "d20629aa-181c-42c8-a9ad-4e2c1fb649d4"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 22 05:14:10.605634 ip-10-0-141-238 kubenswrapper[2563]: I0722 05:14:10.605621    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d20629aa-181c-42c8-a9ad-4e2c1fb649d4-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "d20629aa-181c-42c8-a9ad-4e2c1fb649d4" (UID: "d20629aa-181c-42c8-a9ad-4e2c1fb649d4"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 22 05:14:10.703880 ip-10-0-141-238 kubenswrapper[2563]: I0722 05:14:10.703848    2563 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d20629aa-181c-42c8-a9ad-4e2c1fb649d4-istio-podinfo\") on node \"ip-10-0-141-238.ec2.internal\" DevicePath \"\""
Jul 22 05:14:10.703880 ip-10-0-141-238 kubenswrapper[2563]: I0722 05:14:10.703880    2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-t4r5r\" (UniqueName: \"kubernetes.io/projected/d20629aa-181c-42c8-a9ad-4e2c1fb649d4-kube-api-access-t4r5r\") on node \"ip-10-0-141-238.ec2.internal\" DevicePath \"\""
Jul 22 05:14:10.704095 ip-10-0-141-238 kubenswrapper[2563]: I0722 05:14:10.703896    2563 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d20629aa-181c-42c8-a9ad-4e2c1fb649d4-istio-data\") on node \"ip-10-0-141-238.ec2.internal\" DevicePath \"\""
Jul 22 05:14:10.704095 ip-10-0-141-238 kubenswrapper[2563]: I0722 05:14:10.703908    2563 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d20629aa-181c-42c8-a9ad-4e2c1fb649d4-istio-token\") on node \"ip-10-0-141-238.ec2.internal\" DevicePath \"\""
Jul 22 05:14:10.704095 ip-10-0-141-238 kubenswrapper[2563]: I0722 05:14:10.703918    2563 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d20629aa-181c-42c8-a9ad-4e2c1fb649d4-istio-envoy\") on node \"ip-10-0-141-238.ec2.internal\" DevicePath \"\""
Jul 22 05:14:10.745432 ip-10-0-141-238 kubenswrapper[2563]: I0722 05:14:10.745406    2563 generic.go:356] "Generic (PLEG): container finished" podID="d20629aa-181c-42c8-a9ad-4e2c1fb649d4" containerID="5076a3440c01f598f7d31781f950dbef4f1851bca8bb99d708f5a9d6a76b4806" exitCode=0
Jul 22 05:14:10.745553 ip-10-0-141-238 kubenswrapper[2563]: I0722 05:14:10.745460    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-0c4b46-openshift-default-79d674695f-9fqkl"
Jul 22 05:14:10.745553 ip-10-0-141-238 kubenswrapper[2563]: I0722 05:14:10.745462    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-0c4b46-openshift-default-79d674695f-9fqkl" event={"ID":"d20629aa-181c-42c8-a9ad-4e2c1fb649d4","Type":"ContainerDied","Data":"5076a3440c01f598f7d31781f950dbef4f1851bca8bb99d708f5a9d6a76b4806"}
Jul 22 05:14:10.745659 ip-10-0-141-238 kubenswrapper[2563]: I0722 05:14:10.745607    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-0c4b46-openshift-default-79d674695f-9fqkl" event={"ID":"d20629aa-181c-42c8-a9ad-4e2c1fb649d4","Type":"ContainerDied","Data":"502b4ebbc676374f7349e6379e6ccec713aace31babea58927f5d778a23d46db"}
Jul 22 05:14:10.745659 ip-10-0-141-238 kubenswrapper[2563]: I0722 05:14:10.745637    2563 scope.go:117] "RemoveContainer" containerID="5076a3440c01f598f7d31781f950dbef4f1851bca8bb99d708f5a9d6a76b4806"
Jul 22 05:14:10.755171 ip-10-0-141-238 kubenswrapper[2563]: I0722 05:14:10.755148    2563 scope.go:117] "RemoveContainer" containerID="4d00a05c4d2c1ee3c0b7d4a6e190e53ee89c326c7acfe04bf76db7379aa9931c"
Jul 22 05:14:10.762432 ip-10-0-141-238 kubenswrapper[2563]: I0722 05:14:10.762415    2563 scope.go:117] "RemoveContainer" containerID="5076a3440c01f598f7d31781f950dbef4f1851bca8bb99d708f5a9d6a76b4806"
Jul 22 05:14:10.762666 ip-10-0-141-238 kubenswrapper[2563]: E0722 05:14:10.762647    2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5076a3440c01f598f7d31781f950dbef4f1851bca8bb99d708f5a9d6a76b4806\": container with ID starting with 5076a3440c01f598f7d31781f950dbef4f1851bca8bb99d708f5a9d6a76b4806 not found: ID does not exist" containerID="5076a3440c01f598f7d31781f950dbef4f1851bca8bb99d708f5a9d6a76b4806"
Jul 22 05:14:10.762717 ip-10-0-141-238 kubenswrapper[2563]: I0722 05:14:10.762674    2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5076a3440c01f598f7d31781f950dbef4f1851bca8bb99d708f5a9d6a76b4806"} err="failed to get container status \"5076a3440c01f598f7d31781f950dbef4f1851bca8bb99d708f5a9d6a76b4806\": rpc error: code = NotFound desc = could not find container \"5076a3440c01f598f7d31781f950dbef4f1851bca8bb99d708f5a9d6a76b4806\": container with ID starting with 5076a3440c01f598f7d31781f950dbef4f1851bca8bb99d708f5a9d6a76b4806 not found: ID does not exist"
Jul 22 05:14:10.762717 ip-10-0-141-238 kubenswrapper[2563]: I0722 05:14:10.762694    2563 scope.go:117] "RemoveContainer" containerID="4d00a05c4d2c1ee3c0b7d4a6e190e53ee89c326c7acfe04bf76db7379aa9931c"
Jul 22 05:14:10.762935 ip-10-0-141-238 kubenswrapper[2563]: E0722 05:14:10.762917    2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4d00a05c4d2c1ee3c0b7d4a6e190e53ee89c326c7acfe04bf76db7379aa9931c\": container with ID starting with 4d00a05c4d2c1ee3c0b7d4a6e190e53ee89c326c7acfe04bf76db7379aa9931c not found: ID does not exist" containerID="4d00a05c4d2c1ee3c0b7d4a6e190e53ee89c326c7acfe04bf76db7379aa9931c"
Jul 22 05:14:10.762986 ip-10-0-141-238 kubenswrapper[2563]: I0722 05:14:10.762942    2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4d00a05c4d2c1ee3c0b7d4a6e190e53ee89c326c7acfe04bf76db7379aa9931c"} err="failed to get container status \"4d00a05c4d2c1ee3c0b7d4a6e190e53ee89c326c7acfe04bf76db7379aa9931c\": rpc error: code = NotFound desc = could not find container \"4d00a05c4d2c1ee3c0b7d4a6e190e53ee89c326c7acfe04bf76db7379aa9931c\": container with ID starting with 4d00a05c4d2c1ee3c0b7d4a6e190e53ee89c326c7acfe04bf76db7379aa9931c not found: ID does not exist"
Jul 22 05:14:10.765971 ip-10-0-141-238 kubenswrapper[2563]: I0722 05:14:10.765952    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-b-0c4b46-openshift-default-79d674695f-9fqkl"]
Jul 22 05:14:10.770729 ip-10-0-141-238 kubenswrapper[2563]: I0722 05:14:10.770707    2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-shared-b-0c4b46-openshift-default-79d674695f-9fqkl"]
Jul 22 05:14:11.065384 ip-10-0-141-238 kubenswrapper[2563]: I0722 05:14:11.065348    2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d20629aa-181c-42c8-a9ad-4e2c1fb649d4" path="/var/lib/kubelet/pods/d20629aa-181c-42c8-a9ad-4e2c1fb649d4/volumes"
Jul 22 05:14:11.655814 ip-10-0-141-238 kubenswrapper[2563]: I0722 05:14:11.655786    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-5676cbf8df-57gh8_e311b344-da67-4d9b-800b-7cd3f9040ea0/copy-manifests/0.log"
Jul 22 05:14:11.662139 ip-10-0-141-238 kubenswrapper[2563]: I0722 05:14:11.662119    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-5676cbf8df-57gh8_e311b344-da67-4d9b-800b-7cd3f9040ea0/manager/0.log"
Jul 22 05:14:12.455342 ip-10-0-141-238 kubenswrapper[2563]: I0722 05:14:12.455314    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-key-cleanup-29744940-jbczr_9182042d-169e-47df-9acf-1e7b365c7369/cleanup/0.log"
Jul 22 05:14:14.493245 ip-10-0-141-238 kubenswrapper[2563]: I0722 05:14:14.493219    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-limitador-54d6d988d5-wsdd9_e51355c4-9521-400d-8845-22bceab97ffc/limitador/0.log"
Jul 22 05:14:14.942885 ip-10-0-141-238 kubenswrapper[2563]: I0722 05:14:14.942855    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-6576859cf45tzwz_b700f458-54be-4c31-b4ac-51e1485596fd/istio-proxy/0.log"
Jul 22 05:14:15.057893 ip-10-0-141-238 kubenswrapper[2563]: I0722 05:14:15.057865    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-94bb8fbfd-gxjkj_2b0a5325-d9c8-4435-b47f-f4fe759969b3/discovery/0.log"
Jul 22 05:14:15.721269 ip-10-0-141-238 kubenswrapper[2563]: I0722 05:14:15.721236    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-5fc6f998d6-njv7d_925dc370-cd0b-4447-85b7-a2c4068dab6b/router/0.log"
Jul 22 05:14:16.458465 ip-10-0-141-238 kubenswrapper[2563]: I0722 05:14:16.458436    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_facebook-opt-125m-simulated-kserve-74b68447df-6kdxl_454414e8-c01b-476b-abc6-c11552c2ddfe/main/0.log"
Jul 22 05:14:22.099525 ip-10-0-141-238 kubenswrapper[2563]: I0722 05:14:22.099480    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j9gvx_b4af3ae5-fa65-4358-8399-6ed11b68616e/konnectivity-agent/0.log" limit=1024
Jul 22 05:14:22.197360 ip-10-0-141-238 kubenswrapper[2563]: I0722 05:14:22.197331    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j9gvx_b4af3ae5-fa65-4358-8399-6ed11b68616e/konnectivity-agent/0.log" limit=1024
Jul 22 05:14:25.297511 ip-10-0-141-238 kubenswrapper[2563]: I0722 05:14:25.297478    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-k2znt_bc2f671d-2057-4b94-8e5c-e6d3cdcdd74e/global-pull-secret-syncer/0.log"
Jul 22 05:14:25.344939 ip-10-0-141-238 kubenswrapper[2563]: I0722 05:14:25.344913    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-j9gvx_b4af3ae5-fa65-4358-8399-6ed11b68616e/konnectivity-agent/0.log"
Jul 22 05:14:25.459178 ip-10-0-141-238 kubenswrapper[2563]: I0722 05:14:25.459151    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-141-238.ec2.internal_7cbc186c127cef111ab8584862a4a734/haproxy/0.log"
Jul 22 05:14:27.685667 ip-10-0-141-238 kubenswrapper[2563]: I0722 05:14:27.685635    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j9gvx_b4af3ae5-fa65-4358-8399-6ed11b68616e/konnectivity-agent/0.log" limit=1024
Jul 22 05:14:27.786925 ip-10-0-141-238 kubenswrapper[2563]: I0722 05:14:27.786892    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j9gvx_b4af3ae5-fa65-4358-8399-6ed11b68616e/konnectivity-agent/0.log" limit=1024
Jul 22 05:14:30.775616 ip-10-0-141-238 kubenswrapper[2563]: I0722 05:14:30.775583    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-limitador-54d6d988d5-wsdd9_e51355c4-9521-400d-8845-22bceab97ffc/limitador/0.log"
Jul 22 05:14:32.630855 ip-10-0-141-238 kubenswrapper[2563]: I0722 05:14:32.630776    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_93175b29-47eb-4526-99e3-42499c3517bb/alertmanager/0.log"
Jul 22 05:14:32.651748 ip-10-0-141-238 kubenswrapper[2563]: I0722 05:14:32.651715    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_93175b29-47eb-4526-99e3-42499c3517bb/config-reloader/0.log"
Jul 22 05:14:32.680104 ip-10-0-141-238 kubenswrapper[2563]: I0722 05:14:32.680078    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_93175b29-47eb-4526-99e3-42499c3517bb/kube-rbac-proxy-web/0.log"
Jul 22 05:14:32.702660 ip-10-0-141-238 kubenswrapper[2563]: I0722 05:14:32.702637    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_93175b29-47eb-4526-99e3-42499c3517bb/kube-rbac-proxy/0.log"
Jul 22 05:14:32.723655 ip-10-0-141-238 kubenswrapper[2563]: I0722 05:14:32.723636    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_93175b29-47eb-4526-99e3-42499c3517bb/kube-rbac-proxy-metric/0.log"
Jul 22 05:14:32.743595 ip-10-0-141-238 kubenswrapper[2563]: I0722 05:14:32.743578    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_93175b29-47eb-4526-99e3-42499c3517bb/prom-label-proxy/0.log"
Jul 22 05:14:32.767849 ip-10-0-141-238 kubenswrapper[2563]: I0722 05:14:32.767832    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_93175b29-47eb-4526-99e3-42499c3517bb/init-config-reloader/0.log"
Jul 22 05:14:32.977357 ip-10-0-141-238 kubenswrapper[2563]: I0722 05:14:32.977332    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-4fgx2_447bc26b-8e08-4a69-ba5b-de7392bb41d3/node-exporter/0.log"
Jul 22 05:14:33.003071 ip-10-0-141-238 kubenswrapper[2563]: I0722 05:14:33.003022    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-4fgx2_447bc26b-8e08-4a69-ba5b-de7392bb41d3/kube-rbac-proxy/0.log"
Jul 22 05:14:33.024765 ip-10-0-141-238 kubenswrapper[2563]: I0722 05:14:33.024743    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-4fgx2_447bc26b-8e08-4a69-ba5b-de7392bb41d3/init-textfile/0.log"
Jul 22 05:14:33.480177 ip-10-0-141-238 kubenswrapper[2563]: I0722 05:14:33.480147    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-5945b5cfd-hh6s9_d3e7e1d2-1e1d-4d5d-8284-cb4b3b12322d/prometheus-operator/0.log"
Jul 22 05:14:33.502871 ip-10-0-141-238 kubenswrapper[2563]: I0722 05:14:33.502850    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-5945b5cfd-hh6s9_d3e7e1d2-1e1d-4d5d-8284-cb4b3b12322d/kube-rbac-proxy/0.log"
Jul 22 05:14:33.529318 ip-10-0-141-238 kubenswrapper[2563]: I0722 05:14:33.529300    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-admission-webhook-85574b5f49-j25qb_10f2d671-43fd-4c9a-a4b7-1ef76f5f4dff/prometheus-operator-admission-webhook/0.log"
Jul 22 05:14:33.558667 ip-10-0-141-238 kubenswrapper[2563]: I0722 05:14:33.558645    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-64f8c4cd96-clkks_bf338bfd-b9df-4542-a623-6be10c75e8bd/telemeter-client/0.log"
Jul 22 05:14:33.580182 ip-10-0-141-238 kubenswrapper[2563]: I0722 05:14:33.580156    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-64f8c4cd96-clkks_bf338bfd-b9df-4542-a623-6be10c75e8bd/reload/0.log"
Jul 22 05:14:33.604008 ip-10-0-141-238 kubenswrapper[2563]: I0722 05:14:33.603990    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-64f8c4cd96-clkks_bf338bfd-b9df-4542-a623-6be10c75e8bd/kube-rbac-proxy/0.log"
Jul 22 05:14:35.529799 ip-10-0-141-238 kubenswrapper[2563]: I0722 05:14:35.529770    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-gw4km_67c7210c-7cfa-4865-bce3-777fbb6f3cea/console-operator/1.log"
Jul 22 05:14:35.534854 ip-10-0-141-238 kubenswrapper[2563]: I0722 05:14:35.534831    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-gw4km_67c7210c-7cfa-4865-bce3-777fbb6f3cea/console-operator/2.log"
Jul 22 05:14:35.550412 ip-10-0-141-238 kubenswrapper[2563]: I0722 05:14:35.550381    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-c7bkb/perf-node-gather-daemonset-lbzzv"]
Jul 22 05:14:35.550756 ip-10-0-141-238 kubenswrapper[2563]: I0722 05:14:35.550738    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="53a47967-44d9-4a3a-be46-6ae35b8c1965" containerName="revoke-keys"
Jul 22 05:14:35.550842 ip-10-0-141-238 kubenswrapper[2563]: I0722 05:14:35.550758    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="53a47967-44d9-4a3a-be46-6ae35b8c1965" containerName="revoke-keys"
Jul 22 05:14:35.550842 ip-10-0-141-238 kubenswrapper[2563]: I0722 05:14:35.550782    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d20629aa-181c-42c8-a9ad-4e2c1fb649d4" containerName="istio-proxy"
Jul 22 05:14:35.550842 ip-10-0-141-238 kubenswrapper[2563]: I0722 05:14:35.550792    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="d20629aa-181c-42c8-a9ad-4e2c1fb649d4" containerName="istio-proxy"
Jul 22 05:14:35.550842 ip-10-0-141-238 kubenswrapper[2563]: I0722 05:14:35.550805    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d20629aa-181c-42c8-a9ad-4e2c1fb649d4" containerName="istio-proxy"
Jul 22 05:14:35.550842 ip-10-0-141-238 kubenswrapper[2563]: I0722 05:14:35.550813    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="d20629aa-181c-42c8-a9ad-4e2c1fb649d4" containerName="istio-proxy"
Jul 22 05:14:35.551107 ip-10-0-141-238 kubenswrapper[2563]: I0722 05:14:35.550894    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="d20629aa-181c-42c8-a9ad-4e2c1fb649d4" containerName="istio-proxy"
Jul 22 05:14:35.551107 ip-10-0-141-238 kubenswrapper[2563]: I0722 05:14:35.550905    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="53a47967-44d9-4a3a-be46-6ae35b8c1965" containerName="revoke-keys"
Jul 22 05:14:35.551107 ip-10-0-141-238 kubenswrapper[2563]: I0722 05:14:35.550918    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="d20629aa-181c-42c8-a9ad-4e2c1fb649d4" containerName="istio-proxy"
Jul 22 05:14:35.554233 ip-10-0-141-238 kubenswrapper[2563]: I0722 05:14:35.554213    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-c7bkb/perf-node-gather-daemonset-lbzzv"
Jul 22 05:14:35.556812 ip-10-0-141-238 kubenswrapper[2563]: I0722 05:14:35.556794    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-c7bkb\"/\"kube-root-ca.crt\""
Jul 22 05:14:35.557672 ip-10-0-141-238 kubenswrapper[2563]: I0722 05:14:35.557656    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-c7bkb\"/\"default-dockercfg-c4nsx\""
Jul 22 05:14:35.557746 ip-10-0-141-238 kubenswrapper[2563]: I0722 05:14:35.557662    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-c7bkb\"/\"openshift-service-ca.crt\""
Jul 22 05:14:35.561717 ip-10-0-141-238 kubenswrapper[2563]: I0722 05:14:35.561698    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-c7bkb/perf-node-gather-daemonset-lbzzv"]
Jul 22 05:14:35.627084 ip-10-0-141-238 kubenswrapper[2563]: I0722 05:14:35.627054    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/64725f40-a88a-4990-b6c2-8f1bb399e99c-lib-modules\") pod \"perf-node-gather-daemonset-lbzzv\" (UID: \"64725f40-a88a-4990-b6c2-8f1bb399e99c\") " pod="openshift-must-gather-c7bkb/perf-node-gather-daemonset-lbzzv"
Jul 22 05:14:35.627219 ip-10-0-141-238 kubenswrapper[2563]: I0722 05:14:35.627105    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/64725f40-a88a-4990-b6c2-8f1bb399e99c-podres\") pod \"perf-node-gather-daemonset-lbzzv\" (UID: \"64725f40-a88a-4990-b6c2-8f1bb399e99c\") " pod="openshift-must-gather-c7bkb/perf-node-gather-daemonset-lbzzv"
Jul 22 05:14:35.627219 ip-10-0-141-238 kubenswrapper[2563]: I0722 05:14:35.627156    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-f55n5\" (UniqueName: \"kubernetes.io/projected/64725f40-a88a-4990-b6c2-8f1bb399e99c-kube-api-access-f55n5\") pod \"perf-node-gather-daemonset-lbzzv\" (UID: \"64725f40-a88a-4990-b6c2-8f1bb399e99c\") " pod="openshift-must-gather-c7bkb/perf-node-gather-daemonset-lbzzv"
Jul 22 05:14:35.627219 ip-10-0-141-238 kubenswrapper[2563]: I0722 05:14:35.627201    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/64725f40-a88a-4990-b6c2-8f1bb399e99c-sys\") pod \"perf-node-gather-daemonset-lbzzv\" (UID: \"64725f40-a88a-4990-b6c2-8f1bb399e99c\") " pod="openshift-must-gather-c7bkb/perf-node-gather-daemonset-lbzzv"
Jul 22 05:14:35.627347 ip-10-0-141-238 kubenswrapper[2563]: I0722 05:14:35.627243    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/64725f40-a88a-4990-b6c2-8f1bb399e99c-proc\") pod \"perf-node-gather-daemonset-lbzzv\" (UID: \"64725f40-a88a-4990-b6c2-8f1bb399e99c\") " pod="openshift-must-gather-c7bkb/perf-node-gather-daemonset-lbzzv"
Jul 22 05:14:35.727644 ip-10-0-141-238 kubenswrapper[2563]: I0722 05:14:35.727614    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-f55n5\" (UniqueName: \"kubernetes.io/projected/64725f40-a88a-4990-b6c2-8f1bb399e99c-kube-api-access-f55n5\") pod \"perf-node-gather-daemonset-lbzzv\" (UID: \"64725f40-a88a-4990-b6c2-8f1bb399e99c\") " pod="openshift-must-gather-c7bkb/perf-node-gather-daemonset-lbzzv"
Jul 22 05:14:35.727827 ip-10-0-141-238 kubenswrapper[2563]: I0722 05:14:35.727661    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/64725f40-a88a-4990-b6c2-8f1bb399e99c-sys\") pod \"perf-node-gather-daemonset-lbzzv\" (UID: \"64725f40-a88a-4990-b6c2-8f1bb399e99c\") " pod="openshift-must-gather-c7bkb/perf-node-gather-daemonset-lbzzv"
Jul 22 05:14:35.727827 ip-10-0-141-238 kubenswrapper[2563]: I0722 05:14:35.727698    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/64725f40-a88a-4990-b6c2-8f1bb399e99c-proc\") pod \"perf-node-gather-daemonset-lbzzv\" (UID: \"64725f40-a88a-4990-b6c2-8f1bb399e99c\") " pod="openshift-must-gather-c7bkb/perf-node-gather-daemonset-lbzzv"
Jul 22 05:14:35.727827 ip-10-0-141-238 kubenswrapper[2563]: I0722 05:14:35.727727    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/64725f40-a88a-4990-b6c2-8f1bb399e99c-lib-modules\") pod \"perf-node-gather-daemonset-lbzzv\" (UID: \"64725f40-a88a-4990-b6c2-8f1bb399e99c\") " pod="openshift-must-gather-c7bkb/perf-node-gather-daemonset-lbzzv"
Jul 22 05:14:35.727827 ip-10-0-141-238 kubenswrapper[2563]: I0722 05:14:35.727780    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/64725f40-a88a-4990-b6c2-8f1bb399e99c-podres\") pod \"perf-node-gather-daemonset-lbzzv\" (UID: \"64725f40-a88a-4990-b6c2-8f1bb399e99c\") " pod="openshift-must-gather-c7bkb/perf-node-gather-daemonset-lbzzv"
Jul 22 05:14:35.727827 ip-10-0-141-238 kubenswrapper[2563]: I0722 05:14:35.727811    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/64725f40-a88a-4990-b6c2-8f1bb399e99c-proc\") pod \"perf-node-gather-daemonset-lbzzv\" (UID: \"64725f40-a88a-4990-b6c2-8f1bb399e99c\") " pod="openshift-must-gather-c7bkb/perf-node-gather-daemonset-lbzzv"
Jul 22 05:14:35.728116 ip-10-0-141-238 kubenswrapper[2563]: I0722 05:14:35.727833    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/64725f40-a88a-4990-b6c2-8f1bb399e99c-sys\") pod \"perf-node-gather-daemonset-lbzzv\" (UID: \"64725f40-a88a-4990-b6c2-8f1bb399e99c\") " pod="openshift-must-gather-c7bkb/perf-node-gather-daemonset-lbzzv"
Jul 22 05:14:35.728116 ip-10-0-141-238 kubenswrapper[2563]: I0722 05:14:35.727931    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/64725f40-a88a-4990-b6c2-8f1bb399e99c-lib-modules\") pod \"perf-node-gather-daemonset-lbzzv\" (UID: \"64725f40-a88a-4990-b6c2-8f1bb399e99c\") " pod="openshift-must-gather-c7bkb/perf-node-gather-daemonset-lbzzv"
Jul 22 05:14:35.728116 ip-10-0-141-238 kubenswrapper[2563]: I0722 05:14:35.727938    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/64725f40-a88a-4990-b6c2-8f1bb399e99c-podres\") pod \"perf-node-gather-daemonset-lbzzv\" (UID: \"64725f40-a88a-4990-b6c2-8f1bb399e99c\") " pod="openshift-must-gather-c7bkb/perf-node-gather-daemonset-lbzzv"
Jul 22 05:14:35.737436 ip-10-0-141-238 kubenswrapper[2563]: I0722 05:14:35.737415    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-f55n5\" (UniqueName: \"kubernetes.io/projected/64725f40-a88a-4990-b6c2-8f1bb399e99c-kube-api-access-f55n5\") pod \"perf-node-gather-daemonset-lbzzv\" (UID: \"64725f40-a88a-4990-b6c2-8f1bb399e99c\") " pod="openshift-must-gather-c7bkb/perf-node-gather-daemonset-lbzzv"
Jul 22 05:14:35.865410 ip-10-0-141-238 kubenswrapper[2563]: I0722 05:14:35.865326    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-c7bkb/perf-node-gather-daemonset-lbzzv"
Jul 22 05:14:35.993297 ip-10-0-141-238 kubenswrapper[2563]: I0722 05:14:35.993269    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-c7bkb/perf-node-gather-daemonset-lbzzv"]
Jul 22 05:14:35.996093 ip-10-0-141-238 kubenswrapper[2563]: W0722 05:14:35.996063    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod64725f40_a88a_4990_b6c2_8f1bb399e99c.slice/crio-1085b8ef1cb4fdd442f02574819784d9eed58a9ac90915b09671646a3436508c WatchSource:0}: Error finding container 1085b8ef1cb4fdd442f02574819784d9eed58a9ac90915b09671646a3436508c: Status 404 returned error can't find the container with id 1085b8ef1cb4fdd442f02574819784d9eed58a9ac90915b09671646a3436508c
Jul 22 05:14:36.867681 ip-10-0-141-238 kubenswrapper[2563]: I0722 05:14:36.867644    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-c7bkb/perf-node-gather-daemonset-lbzzv" event={"ID":"64725f40-a88a-4990-b6c2-8f1bb399e99c","Type":"ContainerStarted","Data":"7fe368fb2acb174f75fc9c9c18da2e997cc9f3c2ed806629f84abc7e85959434"}
Jul 22 05:14:36.868143 ip-10-0-141-238 kubenswrapper[2563]: I0722 05:14:36.867699    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-c7bkb/perf-node-gather-daemonset-lbzzv" event={"ID":"64725f40-a88a-4990-b6c2-8f1bb399e99c","Type":"ContainerStarted","Data":"1085b8ef1cb4fdd442f02574819784d9eed58a9ac90915b09671646a3436508c"}
Jul 22 05:14:36.868143 ip-10-0-141-238 kubenswrapper[2563]: I0722 05:14:36.867725    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-c7bkb/perf-node-gather-daemonset-lbzzv"
Jul 22 05:14:36.885096 ip-10-0-141-238 kubenswrapper[2563]: I0722 05:14:36.885049    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-c7bkb/perf-node-gather-daemonset-lbzzv" podStartSLOduration=1.8850140359999998 podStartE2EDuration="1.885014036s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-22 05:14:35 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 05:14:36.883645992 +0000 UTC m=+2992.302654749" watchObservedRunningTime="2026-07-22 05:14:36.885014036 +0000 UTC m=+2992.304022793"
Jul 22 05:14:37.819065 ip-10-0-141-238 kubenswrapper[2563]: I0722 05:14:37.819029    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-rs8lw_28a48c54-711d-4dc7-9b41-9773dc665ffb/dns/0.log"
Jul 22 05:14:37.842199 ip-10-0-141-238 kubenswrapper[2563]: I0722 05:14:37.842172    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-rs8lw_28a48c54-711d-4dc7-9b41-9773dc665ffb/kube-rbac-proxy/0.log"
Jul 22 05:14:37.918229 ip-10-0-141-238 kubenswrapper[2563]: I0722 05:14:37.918186    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-56sw9_0d66df01-3af3-4a5c-8fe2-6e10517bbcf5/dns-node-resolver/0.log"
Jul 22 05:14:38.619660 ip-10-0-141-238 kubenswrapper[2563]: I0722 05:14:38.619622    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-wn74g_ea39afdc-f191-458e-acc9-1ad9ff78c9da/node-ca/0.log"
Jul 22 05:14:39.563094 ip-10-0-141-238 kubenswrapper[2563]: I0722 05:14:39.563066    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-6576859cf45tzwz_b700f458-54be-4c31-b4ac-51e1485596fd/istio-proxy/0.log"
Jul 22 05:14:39.687752 ip-10-0-141-238 kubenswrapper[2563]: I0722 05:14:39.687722    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-94bb8fbfd-gxjkj_2b0a5325-d9c8-4435-b47f-f4fe759969b3/discovery/0.log"
Jul 22 05:14:39.902824 ip-10-0-141-238 kubenswrapper[2563]: I0722 05:14:39.902739    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-5fc6f998d6-njv7d_925dc370-cd0b-4447-85b7-a2c4068dab6b/router/0.log"
Jul 22 05:14:40.646971 ip-10-0-141-238 kubenswrapper[2563]: I0722 05:14:40.646940    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-prmpz_42ae31bf-835d-4bd7-9e7c-92457d47b9d5/serve-healthcheck-canary/0.log"
Jul 22 05:14:41.091090 ip-10-0-141-238 kubenswrapper[2563]: I0722 05:14:41.091057    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-555d9d7885-kmxdh_5b58e75a-c8cd-4d8b-bfba-e2e9810b994b/insights-operator/0.log"
Jul 22 05:14:41.091457 ip-10-0-141-238 kubenswrapper[2563]: I0722 05:14:41.091437    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-555d9d7885-kmxdh_5b58e75a-c8cd-4d8b-bfba-e2e9810b994b/insights-operator/1.log"
Jul 22 05:14:41.178910 ip-10-0-141-238 kubenswrapper[2563]: I0722 05:14:41.178881    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-pffnk_247d4f4c-1e4a-4a2c-bad0-12a4c7e0c7ab/kube-rbac-proxy/0.log"
Jul 22 05:14:41.197142 ip-10-0-141-238 kubenswrapper[2563]: I0722 05:14:41.197117    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-pffnk_247d4f4c-1e4a-4a2c-bad0-12a4c7e0c7ab/exporter/0.log"
Jul 22 05:14:41.215754 ip-10-0-141-238 kubenswrapper[2563]: I0722 05:14:41.215737    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-pffnk_247d4f4c-1e4a-4a2c-bad0-12a4c7e0c7ab/extractor/0.log"
Jul 22 05:14:42.882622 ip-10-0-141-238 kubenswrapper[2563]: I0722 05:14:42.882591    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-c7bkb/perf-node-gather-daemonset-lbzzv"
Jul 22 05:14:43.902884 ip-10-0-141-238 kubenswrapper[2563]: I0722 05:14:43.902852    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-5676cbf8df-57gh8_e311b344-da67-4d9b-800b-7cd3f9040ea0/manager/0.log"
Jul 22 05:14:43.924563 ip-10-0-141-238 kubenswrapper[2563]: I0722 05:14:43.924537    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-5676cbf8df-57gh8_e311b344-da67-4d9b-800b-7cd3f9040ea0/copy-manifests/0.log"
Jul 22 05:14:45.172619 ip-10-0-141-238 kubenswrapper[2563]: I0722 05:14:45.172590    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-gw4km_67c7210c-7cfa-4865-bce3-777fbb6f3cea/console-operator/1.log"
Jul 22 05:14:45.179584 ip-10-0-141-238 kubenswrapper[2563]: I0722 05:14:45.179557    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-gw4km_67c7210c-7cfa-4865-bce3-777fbb6f3cea/console-operator/1.log"
Jul 22 05:14:45.530729 ip-10-0-141-238 kubenswrapper[2563]: I0722 05:14:45.530628    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_lws-controller-manager-596745447d-24fvs_4f8bd0f3-ed4c-4d86-bc73-eea4713b335a/manager/0.log"
Jul 22 05:14:46.060434 ip-10-0-141-238 kubenswrapper[2563]: I0722 05:14:46.060407    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-6576859cf45tzwz_b700f458-54be-4c31-b4ac-51e1485596fd/istio-proxy/0.log"
Jul 22 05:14:46.176139 ip-10-0-141-238 kubenswrapper[2563]: I0722 05:14:46.176105    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-94bb8fbfd-gxjkj_2b0a5325-d9c8-4435-b47f-f4fe759969b3/discovery/0.log"
Jul 22 05:14:46.350067 ip-10-0-141-238 kubenswrapper[2563]: I0722 05:14:46.349971    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-5fc6f998d6-njv7d_925dc370-cd0b-4447-85b7-a2c4068dab6b/router/0.log"
Jul 22 05:14:47.626601 ip-10-0-141-238 kubenswrapper[2563]: I0722 05:14:47.626574    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-6576859cf45tzwz_b700f458-54be-4c31-b4ac-51e1485596fd/istio-proxy/0.log"
Jul 22 05:14:47.749373 ip-10-0-141-238 kubenswrapper[2563]: I0722 05:14:47.749343    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-94bb8fbfd-gxjkj_2b0a5325-d9c8-4435-b47f-f4fe759969b3/discovery/0.log"
Jul 22 05:14:47.921323 ip-10-0-141-238 kubenswrapper[2563]: I0722 05:14:47.921297    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-5fc6f998d6-njv7d_925dc370-cd0b-4447-85b7-a2c4068dab6b/router/0.log"
Jul 22 05:14:51.032800 ip-10-0-141-238 kubenswrapper[2563]: I0722 05:14:51.032771    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-7658d9b749-6tkm8_6f3fb07b-006b-4a37-8f24-e1be8c89eeb1/kube-storage-version-migrator-operator/1.log"
Jul 22 05:14:51.033725 ip-10-0-141-238 kubenswrapper[2563]: I0722 05:14:51.033705    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-7658d9b749-6tkm8_6f3fb07b-006b-4a37-8f24-e1be8c89eeb1/kube-storage-version-migrator-operator/0.log"
Jul 22 05:14:52.115627 ip-10-0-141-238 kubenswrapper[2563]: I0722 05:14:52.115596    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-22ss9_959d426a-6437-4684-8afa-d0fcd4f5dc5a/kube-multus/0.log"
Jul 22 05:14:52.305917 ip-10-0-141-238 kubenswrapper[2563]: I0722 05:14:52.305890    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-qldhd_082d9f5d-e4ad-4288-a071-f9f6902393e1/kube-multus-additional-cni-plugins/0.log"
Jul 22 05:14:52.330568 ip-10-0-141-238 kubenswrapper[2563]: I0722 05:14:52.330543    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-qldhd_082d9f5d-e4ad-4288-a071-f9f6902393e1/egress-router-binary-copy/0.log"
Jul 22 05:14:52.351131 ip-10-0-141-238 kubenswrapper[2563]: I0722 05:14:52.351110    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-qldhd_082d9f5d-e4ad-4288-a071-f9f6902393e1/cni-plugins/0.log"
Jul 22 05:14:52.369378 ip-10-0-141-238 kubenswrapper[2563]: I0722 05:14:52.369312    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-qldhd_082d9f5d-e4ad-4288-a071-f9f6902393e1/bond-cni-plugin/0.log"
Jul 22 05:14:52.386960 ip-10-0-141-238 kubenswrapper[2563]: I0722 05:14:52.386941    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-qldhd_082d9f5d-e4ad-4288-a071-f9f6902393e1/routeoverride-cni/0.log"
Jul 22 05:14:52.405026 ip-10-0-141-238 kubenswrapper[2563]: I0722 05:14:52.405002    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-qldhd_082d9f5d-e4ad-4288-a071-f9f6902393e1/whereabouts-cni-bincopy/0.log"
Jul 22 05:14:52.424120 ip-10-0-141-238 kubenswrapper[2563]: I0722 05:14:52.424092    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-qldhd_082d9f5d-e4ad-4288-a071-f9f6902393e1/whereabouts-cni/0.log"
Jul 22 05:14:52.667605 ip-10-0-141-238 kubenswrapper[2563]: I0722 05:14:52.667577    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-2k7fd_3e22b9bf-95f2-4186-a5a7-2f1d21feb8b1/network-metrics-daemon/0.log"
Jul 22 05:14:52.689108 ip-10-0-141-238 kubenswrapper[2563]: I0722 05:14:52.689086    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-2k7fd_3e22b9bf-95f2-4186-a5a7-2f1d21feb8b1/kube-rbac-proxy/0.log"