Jul 06 19:30:34.673249 ip-10-0-131-168 systemd[1]: kubelet.service: Failed to load environment files: No such file or directory
Jul 06 19:30:34.673261 ip-10-0-131-168 systemd[1]: kubelet.service: Failed to run 'start-pre' task: No such file or directory
Jul 06 19:30:34.673267 ip-10-0-131-168 systemd[1]: kubelet.service: Failed with result 'resources'.
Jul 06 19:30:34.673505 ip-10-0-131-168 systemd[1]: Failed to start Kubernetes Kubelet.
Jul 06 19:30:44.685923 ip-10-0-131-168 systemd[1]: kubelet.service: Failed to schedule restart job: Unit crio.service not found.
Jul 06 19:30:44.685938 ip-10-0-131-168 systemd[1]: kubelet.service: Failed with result 'resources'.
-- Boot 7f409cb33ff34ac797eecb2e18255fd4 --
Jul 06 19:32:43.190894 ip-10-0-131-168 systemd[1]: Starting Kubernetes Kubelet...
Jul 06 19:32:45.238576 ip-10-0-131-168 kubenswrapper[2565]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 06 19:32:45.238576 ip-10-0-131-168 kubenswrapper[2565]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version.
Jul 06 19:32:45.238576 ip-10-0-131-168 kubenswrapper[2565]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 06 19:32:45.238576 ip-10-0-131-168 kubenswrapper[2565]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI.
Jul 06 19:32:45.239187 ip-10-0-131-168 kubenswrapper[2565]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 06 19:32:45.239498 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:32:45.239391    2565 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime"
Jul 06 19:32:45.245986 ip-10-0-131-168 kubenswrapper[2565]: W0706 19:32:45.245969    2565 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 06 19:32:45.245986 ip-10-0-131-168 kubenswrapper[2565]: W0706 19:32:45.245983    2565 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 06 19:32:45.245986 ip-10-0-131-168 kubenswrapper[2565]: W0706 19:32:45.245987    2565 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 06 19:32:45.246069 ip-10-0-131-168 kubenswrapper[2565]: W0706 19:32:45.245991    2565 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 06 19:32:45.246069 ip-10-0-131-168 kubenswrapper[2565]: W0706 19:32:45.245994    2565 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 06 19:32:45.246069 ip-10-0-131-168 kubenswrapper[2565]: W0706 19:32:45.245997    2565 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 06 19:32:45.246069 ip-10-0-131-168 kubenswrapper[2565]: W0706 19:32:45.246000    2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 06 19:32:45.246069 ip-10-0-131-168 kubenswrapper[2565]: W0706 19:32:45.246003    2565 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 06 19:32:45.246069 ip-10-0-131-168 kubenswrapper[2565]: W0706 19:32:45.246006    2565 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 06 19:32:45.246069 ip-10-0-131-168 kubenswrapper[2565]: W0706 19:32:45.246010    2565 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 06 19:32:45.246069 ip-10-0-131-168 kubenswrapper[2565]: W0706 19:32:45.246018    2565 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 06 19:32:45.246069 ip-10-0-131-168 kubenswrapper[2565]: W0706 19:32:45.246020    2565 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 06 19:32:45.246069 ip-10-0-131-168 kubenswrapper[2565]: W0706 19:32:45.246023    2565 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 06 19:32:45.246069 ip-10-0-131-168 kubenswrapper[2565]: W0706 19:32:45.246026    2565 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 06 19:32:45.246069 ip-10-0-131-168 kubenswrapper[2565]: W0706 19:32:45.246029    2565 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 06 19:32:45.246069 ip-10-0-131-168 kubenswrapper[2565]: W0706 19:32:45.246032    2565 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 06 19:32:45.246069 ip-10-0-131-168 kubenswrapper[2565]: W0706 19:32:45.246034    2565 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 06 19:32:45.246069 ip-10-0-131-168 kubenswrapper[2565]: W0706 19:32:45.246037    2565 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 06 19:32:45.246069 ip-10-0-131-168 kubenswrapper[2565]: W0706 19:32:45.246039    2565 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 06 19:32:45.246069 ip-10-0-131-168 kubenswrapper[2565]: W0706 19:32:45.246041    2565 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 06 19:32:45.246069 ip-10-0-131-168 kubenswrapper[2565]: W0706 19:32:45.246044    2565 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 06 19:32:45.246069 ip-10-0-131-168 kubenswrapper[2565]: W0706 19:32:45.246046    2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 06 19:32:45.246069 ip-10-0-131-168 kubenswrapper[2565]: W0706 19:32:45.246049    2565 feature_gate.go:328] unrecognized feature gate: Example
Jul 06 19:32:45.246690 ip-10-0-131-168 kubenswrapper[2565]: W0706 19:32:45.246052    2565 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 06 19:32:45.246690 ip-10-0-131-168 kubenswrapper[2565]: W0706 19:32:45.246054    2565 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 06 19:32:45.246690 ip-10-0-131-168 kubenswrapper[2565]: W0706 19:32:45.246057    2565 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 06 19:32:45.246690 ip-10-0-131-168 kubenswrapper[2565]: W0706 19:32:45.246059    2565 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 06 19:32:45.246690 ip-10-0-131-168 kubenswrapper[2565]: W0706 19:32:45.246062    2565 feature_gate.go:328] unrecognized feature gate: Example2
Jul 06 19:32:45.246690 ip-10-0-131-168 kubenswrapper[2565]: W0706 19:32:45.246064    2565 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 06 19:32:45.246690 ip-10-0-131-168 kubenswrapper[2565]: W0706 19:32:45.246066    2565 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 06 19:32:45.246690 ip-10-0-131-168 kubenswrapper[2565]: W0706 19:32:45.246070    2565 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 06 19:32:45.246690 ip-10-0-131-168 kubenswrapper[2565]: W0706 19:32:45.246072    2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 06 19:32:45.246690 ip-10-0-131-168 kubenswrapper[2565]: W0706 19:32:45.246076    2565 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 06 19:32:45.246690 ip-10-0-131-168 kubenswrapper[2565]: W0706 19:32:45.246078    2565 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 06 19:32:45.246690 ip-10-0-131-168 kubenswrapper[2565]: W0706 19:32:45.246081    2565 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 06 19:32:45.246690 ip-10-0-131-168 kubenswrapper[2565]: W0706 19:32:45.246084    2565 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 06 19:32:45.246690 ip-10-0-131-168 kubenswrapper[2565]: W0706 19:32:45.246086    2565 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 06 19:32:45.246690 ip-10-0-131-168 kubenswrapper[2565]: W0706 19:32:45.246089    2565 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 06 19:32:45.246690 ip-10-0-131-168 kubenswrapper[2565]: W0706 19:32:45.246091    2565 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 06 19:32:45.246690 ip-10-0-131-168 kubenswrapper[2565]: W0706 19:32:45.246094    2565 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 06 19:32:45.246690 ip-10-0-131-168 kubenswrapper[2565]: W0706 19:32:45.246097    2565 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 06 19:32:45.246690 ip-10-0-131-168 kubenswrapper[2565]: W0706 19:32:45.246099    2565 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 06 19:32:45.246690 ip-10-0-131-168 kubenswrapper[2565]: W0706 19:32:45.246103    2565 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 06 19:32:45.247465 ip-10-0-131-168 kubenswrapper[2565]: W0706 19:32:45.246105    2565 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 06 19:32:45.247465 ip-10-0-131-168 kubenswrapper[2565]: W0706 19:32:45.246107    2565 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 06 19:32:45.247465 ip-10-0-131-168 kubenswrapper[2565]: W0706 19:32:45.246110    2565 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 06 19:32:45.247465 ip-10-0-131-168 kubenswrapper[2565]: W0706 19:32:45.246112    2565 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 06 19:32:45.247465 ip-10-0-131-168 kubenswrapper[2565]: W0706 19:32:45.246114    2565 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 06 19:32:45.247465 ip-10-0-131-168 kubenswrapper[2565]: W0706 19:32:45.246117    2565 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 06 19:32:45.247465 ip-10-0-131-168 kubenswrapper[2565]: W0706 19:32:45.246119    2565 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 06 19:32:45.247465 ip-10-0-131-168 kubenswrapper[2565]: W0706 19:32:45.246122    2565 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 06 19:32:45.247465 ip-10-0-131-168 kubenswrapper[2565]: W0706 19:32:45.246124    2565 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 06 19:32:45.247465 ip-10-0-131-168 kubenswrapper[2565]: W0706 19:32:45.246126    2565 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 06 19:32:45.247465 ip-10-0-131-168 kubenswrapper[2565]: W0706 19:32:45.246129    2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 06 19:32:45.247465 ip-10-0-131-168 kubenswrapper[2565]: W0706 19:32:45.246131    2565 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 06 19:32:45.247465 ip-10-0-131-168 kubenswrapper[2565]: W0706 19:32:45.246134    2565 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 06 19:32:45.247465 ip-10-0-131-168 kubenswrapper[2565]: W0706 19:32:45.246137    2565 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 06 19:32:45.247465 ip-10-0-131-168 kubenswrapper[2565]: W0706 19:32:45.246140    2565 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 06 19:32:45.247465 ip-10-0-131-168 kubenswrapper[2565]: W0706 19:32:45.246146    2565 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 06 19:32:45.247465 ip-10-0-131-168 kubenswrapper[2565]: W0706 19:32:45.246149    2565 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 06 19:32:45.247465 ip-10-0-131-168 kubenswrapper[2565]: W0706 19:32:45.246153    2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 06 19:32:45.247465 ip-10-0-131-168 kubenswrapper[2565]: W0706 19:32:45.246156    2565 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 06 19:32:45.247940 ip-10-0-131-168 kubenswrapper[2565]: W0706 19:32:45.246159    2565 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 06 19:32:45.247940 ip-10-0-131-168 kubenswrapper[2565]: W0706 19:32:45.246162    2565 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 06 19:32:45.247940 ip-10-0-131-168 kubenswrapper[2565]: W0706 19:32:45.246166    2565 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 06 19:32:45.247940 ip-10-0-131-168 kubenswrapper[2565]: W0706 19:32:45.246169    2565 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 06 19:32:45.247940 ip-10-0-131-168 kubenswrapper[2565]: W0706 19:32:45.246171    2565 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 06 19:32:45.247940 ip-10-0-131-168 kubenswrapper[2565]: W0706 19:32:45.246174    2565 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 06 19:32:45.247940 ip-10-0-131-168 kubenswrapper[2565]: W0706 19:32:45.246177    2565 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 06 19:32:45.247940 ip-10-0-131-168 kubenswrapper[2565]: W0706 19:32:45.246180    2565 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 06 19:32:45.247940 ip-10-0-131-168 kubenswrapper[2565]: W0706 19:32:45.246183    2565 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 06 19:32:45.247940 ip-10-0-131-168 kubenswrapper[2565]: W0706 19:32:45.246185    2565 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 06 19:32:45.247940 ip-10-0-131-168 kubenswrapper[2565]: W0706 19:32:45.246188    2565 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 06 19:32:45.247940 ip-10-0-131-168 kubenswrapper[2565]: W0706 19:32:45.246190    2565 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 06 19:32:45.247940 ip-10-0-131-168 kubenswrapper[2565]: W0706 19:32:45.246193    2565 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 06 19:32:45.247940 ip-10-0-131-168 kubenswrapper[2565]: W0706 19:32:45.246196    2565 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 06 19:32:45.247940 ip-10-0-131-168 kubenswrapper[2565]: W0706 19:32:45.246199    2565 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 06 19:32:45.247940 ip-10-0-131-168 kubenswrapper[2565]: W0706 19:32:45.246202    2565 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 06 19:32:45.247940 ip-10-0-131-168 kubenswrapper[2565]: W0706 19:32:45.246204    2565 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 06 19:32:45.247940 ip-10-0-131-168 kubenswrapper[2565]: W0706 19:32:45.246206    2565 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 06 19:32:45.247940 ip-10-0-131-168 kubenswrapper[2565]: W0706 19:32:45.246210    2565 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 06 19:32:45.248592 ip-10-0-131-168 kubenswrapper[2565]: W0706 19:32:45.246217    2565 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 06 19:32:45.248592 ip-10-0-131-168 kubenswrapper[2565]: W0706 19:32:45.246221    2565 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 06 19:32:45.248592 ip-10-0-131-168 kubenswrapper[2565]: W0706 19:32:45.246224    2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 06 19:32:45.248592 ip-10-0-131-168 kubenswrapper[2565]: W0706 19:32:45.246226    2565 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 06 19:32:45.248592 ip-10-0-131-168 kubenswrapper[2565]: W0706 19:32:45.246229    2565 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 06 19:32:45.248592 ip-10-0-131-168 kubenswrapper[2565]: W0706 19:32:45.246231    2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 06 19:32:45.248592 ip-10-0-131-168 kubenswrapper[2565]: W0706 19:32:45.246235    2565 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 06 19:32:45.248592 ip-10-0-131-168 kubenswrapper[2565]: W0706 19:32:45.246237    2565 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 06 19:32:45.248592 ip-10-0-131-168 kubenswrapper[2565]: W0706 19:32:45.246240    2565 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 06 19:32:45.248592 ip-10-0-131-168 kubenswrapper[2565]: W0706 19:32:45.246243    2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 06 19:32:45.248592 ip-10-0-131-168 kubenswrapper[2565]: W0706 19:32:45.246245    2565 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 06 19:32:45.248592 ip-10-0-131-168 kubenswrapper[2565]: W0706 19:32:45.246248    2565 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 06 19:32:45.248592 ip-10-0-131-168 kubenswrapper[2565]: W0706 19:32:45.246250    2565 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 06 19:32:45.248592 ip-10-0-131-168 kubenswrapper[2565]: W0706 19:32:45.246254    2565 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 06 19:32:45.248592 ip-10-0-131-168 kubenswrapper[2565]: W0706 19:32:45.246257    2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 06 19:32:45.248592 ip-10-0-131-168 kubenswrapper[2565]: W0706 19:32:45.246260    2565 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 06 19:32:45.248592 ip-10-0-131-168 kubenswrapper[2565]: W0706 19:32:45.246263    2565 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 06 19:32:45.248592 ip-10-0-131-168 kubenswrapper[2565]: W0706 19:32:45.246266    2565 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 06 19:32:45.249383 ip-10-0-131-168 kubenswrapper[2565]: W0706 19:32:45.249359    2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 06 19:32:45.249383 ip-10-0-131-168 kubenswrapper[2565]: W0706 19:32:45.249382    2565 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 06 19:32:45.249481 ip-10-0-131-168 kubenswrapper[2565]: W0706 19:32:45.249388    2565 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 06 19:32:45.249481 ip-10-0-131-168 kubenswrapper[2565]: W0706 19:32:45.249392    2565 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 06 19:32:45.249481 ip-10-0-131-168 kubenswrapper[2565]: W0706 19:32:45.249397    2565 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 06 19:32:45.249481 ip-10-0-131-168 kubenswrapper[2565]: W0706 19:32:45.249402    2565 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 06 19:32:45.249481 ip-10-0-131-168 kubenswrapper[2565]: W0706 19:32:45.249406    2565 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 06 19:32:45.249481 ip-10-0-131-168 kubenswrapper[2565]: W0706 19:32:45.249410    2565 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 06 19:32:45.249481 ip-10-0-131-168 kubenswrapper[2565]: W0706 19:32:45.249416    2565 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 06 19:32:45.249481 ip-10-0-131-168 kubenswrapper[2565]: W0706 19:32:45.249421    2565 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 06 19:32:45.249481 ip-10-0-131-168 kubenswrapper[2565]: W0706 19:32:45.249425    2565 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 06 19:32:45.249481 ip-10-0-131-168 kubenswrapper[2565]: W0706 19:32:45.249432    2565 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 06 19:32:45.249481 ip-10-0-131-168 kubenswrapper[2565]: W0706 19:32:45.249438    2565 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 06 19:32:45.249481 ip-10-0-131-168 kubenswrapper[2565]: W0706 19:32:45.249443    2565 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 06 19:32:45.249481 ip-10-0-131-168 kubenswrapper[2565]: W0706 19:32:45.249448    2565 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 06 19:32:45.249481 ip-10-0-131-168 kubenswrapper[2565]: W0706 19:32:45.249452    2565 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 06 19:32:45.249481 ip-10-0-131-168 kubenswrapper[2565]: W0706 19:32:45.249456    2565 feature_gate.go:328] unrecognized feature gate: Example
Jul 06 19:32:45.249481 ip-10-0-131-168 kubenswrapper[2565]: W0706 19:32:45.249460    2565 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 06 19:32:45.249481 ip-10-0-131-168 kubenswrapper[2565]: W0706 19:32:45.249465    2565 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 06 19:32:45.249481 ip-10-0-131-168 kubenswrapper[2565]: W0706 19:32:45.249469    2565 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 06 19:32:45.249481 ip-10-0-131-168 kubenswrapper[2565]: W0706 19:32:45.249473    2565 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 06 19:32:45.250305 ip-10-0-131-168 kubenswrapper[2565]: W0706 19:32:45.249477    2565 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 06 19:32:45.250305 ip-10-0-131-168 kubenswrapper[2565]: W0706 19:32:45.249483    2565 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 06 19:32:45.250305 ip-10-0-131-168 kubenswrapper[2565]: W0706 19:32:45.249489    2565 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 06 19:32:45.250305 ip-10-0-131-168 kubenswrapper[2565]: W0706 19:32:45.249494    2565 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 06 19:32:45.250305 ip-10-0-131-168 kubenswrapper[2565]: W0706 19:32:45.249498    2565 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 06 19:32:45.250305 ip-10-0-131-168 kubenswrapper[2565]: W0706 19:32:45.249503    2565 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 06 19:32:45.250305 ip-10-0-131-168 kubenswrapper[2565]: W0706 19:32:45.249512    2565 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 06 19:32:45.250305 ip-10-0-131-168 kubenswrapper[2565]: W0706 19:32:45.249517    2565 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 06 19:32:45.250305 ip-10-0-131-168 kubenswrapper[2565]: W0706 19:32:45.249521    2565 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 06 19:32:45.250305 ip-10-0-131-168 kubenswrapper[2565]: W0706 19:32:45.249526    2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 06 19:32:45.250305 ip-10-0-131-168 kubenswrapper[2565]: W0706 19:32:45.249529    2565 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 06 19:32:45.250305 ip-10-0-131-168 kubenswrapper[2565]: W0706 19:32:45.249534    2565 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 06 19:32:45.250305 ip-10-0-131-168 kubenswrapper[2565]: W0706 19:32:45.249538    2565 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 06 19:32:45.250305 ip-10-0-131-168 kubenswrapper[2565]: W0706 19:32:45.249541    2565 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 06 19:32:45.250305 ip-10-0-131-168 kubenswrapper[2565]: W0706 19:32:45.249545    2565 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 06 19:32:45.250305 ip-10-0-131-168 kubenswrapper[2565]: W0706 19:32:45.249550    2565 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 06 19:32:45.250305 ip-10-0-131-168 kubenswrapper[2565]: W0706 19:32:45.249554    2565 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 06 19:32:45.250305 ip-10-0-131-168 kubenswrapper[2565]: W0706 19:32:45.249560    2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 06 19:32:45.250305 ip-10-0-131-168 kubenswrapper[2565]: W0706 19:32:45.249564    2565 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 06 19:32:45.251128 ip-10-0-131-168 kubenswrapper[2565]: W0706 19:32:45.249568    2565 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 06 19:32:45.251128 ip-10-0-131-168 kubenswrapper[2565]: W0706 19:32:45.249572    2565 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 06 19:32:45.251128 ip-10-0-131-168 kubenswrapper[2565]: W0706 19:32:45.249576    2565 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 06 19:32:45.251128 ip-10-0-131-168 kubenswrapper[2565]: W0706 19:32:45.249580    2565 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 06 19:32:45.251128 ip-10-0-131-168 kubenswrapper[2565]: W0706 19:32:45.249586    2565 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 06 19:32:45.251128 ip-10-0-131-168 kubenswrapper[2565]: W0706 19:32:45.249591    2565 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 06 19:32:45.251128 ip-10-0-131-168 kubenswrapper[2565]: W0706 19:32:45.249596    2565 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 06 19:32:45.251128 ip-10-0-131-168 kubenswrapper[2565]: W0706 19:32:45.249600    2565 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 06 19:32:45.251128 ip-10-0-131-168 kubenswrapper[2565]: W0706 19:32:45.249604    2565 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 06 19:32:45.251128 ip-10-0-131-168 kubenswrapper[2565]: W0706 19:32:45.249608    2565 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 06 19:32:45.251128 ip-10-0-131-168 kubenswrapper[2565]: W0706 19:32:45.249611    2565 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 06 19:32:45.251128 ip-10-0-131-168 kubenswrapper[2565]: W0706 19:32:45.249616    2565 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 06 19:32:45.251128 ip-10-0-131-168 kubenswrapper[2565]: W0706 19:32:45.249621    2565 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 06 19:32:45.251128 ip-10-0-131-168 kubenswrapper[2565]: W0706 19:32:45.249624    2565 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 06 19:32:45.251128 ip-10-0-131-168 kubenswrapper[2565]: W0706 19:32:45.249630    2565 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 06 19:32:45.251128 ip-10-0-131-168 kubenswrapper[2565]: W0706 19:32:45.249634    2565 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 06 19:32:45.251128 ip-10-0-131-168 kubenswrapper[2565]: W0706 19:32:45.249638    2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 06 19:32:45.251128 ip-10-0-131-168 kubenswrapper[2565]: W0706 19:32:45.249643    2565 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 06 19:32:45.251128 ip-10-0-131-168 kubenswrapper[2565]: W0706 19:32:45.249647    2565 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 06 19:32:45.251967 ip-10-0-131-168 kubenswrapper[2565]: W0706 19:32:45.249651    2565 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 06 19:32:45.251967 ip-10-0-131-168 kubenswrapper[2565]: W0706 19:32:45.249656    2565 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 06 19:32:45.251967 ip-10-0-131-168 kubenswrapper[2565]: W0706 19:32:45.249660    2565 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 06 19:32:45.251967 ip-10-0-131-168 kubenswrapper[2565]: W0706 19:32:45.249664    2565 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 06 19:32:45.251967 ip-10-0-131-168 kubenswrapper[2565]: W0706 19:32:45.249668    2565 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 06 19:32:45.251967 ip-10-0-131-168 kubenswrapper[2565]: W0706 19:32:45.249672    2565 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 06 19:32:45.251967 ip-10-0-131-168 kubenswrapper[2565]: W0706 19:32:45.249676    2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 06 19:32:45.251967 ip-10-0-131-168 kubenswrapper[2565]: W0706 19:32:45.249680    2565 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 06 19:32:45.251967 ip-10-0-131-168 kubenswrapper[2565]: W0706 19:32:45.249685    2565 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 06 19:32:45.251967 ip-10-0-131-168 kubenswrapper[2565]: W0706 19:32:45.249689    2565 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 06 19:32:45.251967 ip-10-0-131-168 kubenswrapper[2565]: W0706 19:32:45.249693    2565 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 06 19:32:45.251967 ip-10-0-131-168 kubenswrapper[2565]: W0706 19:32:45.249697    2565 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 06 19:32:45.251967 ip-10-0-131-168 kubenswrapper[2565]: W0706 19:32:45.249701    2565 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 06 19:32:45.251967 ip-10-0-131-168 kubenswrapper[2565]: W0706 19:32:45.249705    2565 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 06 19:32:45.251967 ip-10-0-131-168 kubenswrapper[2565]: W0706 19:32:45.249709    2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 06 19:32:45.251967 ip-10-0-131-168 kubenswrapper[2565]: W0706 19:32:45.249714    2565 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 06 19:32:45.251967 ip-10-0-131-168 kubenswrapper[2565]: W0706 19:32:45.249720    2565 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 06 19:32:45.251967 ip-10-0-131-168 kubenswrapper[2565]: W0706 19:32:45.249725    2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 06 19:32:45.251967 ip-10-0-131-168 kubenswrapper[2565]: W0706 19:32:45.249729    2565 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 06 19:32:45.251967 ip-10-0-131-168 kubenswrapper[2565]: W0706 19:32:45.249733    2565 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 06 19:32:45.252720 ip-10-0-131-168 kubenswrapper[2565]: W0706 19:32:45.249737    2565 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 06 19:32:45.252720 ip-10-0-131-168 kubenswrapper[2565]: W0706 19:32:45.249742    2565 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 06 19:32:45.252720 ip-10-0-131-168 kubenswrapper[2565]: W0706 19:32:45.249746    2565 feature_gate.go:328] unrecognized feature gate: Example2
Jul 06 19:32:45.252720 ip-10-0-131-168 kubenswrapper[2565]: W0706 19:32:45.249750    2565 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 06 19:32:45.252720 ip-10-0-131-168 kubenswrapper[2565]: W0706 19:32:45.249755    2565 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 06 19:32:45.252720 ip-10-0-131-168 kubenswrapper[2565]: W0706 19:32:45.249759    2565 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 06 19:32:45.252720 ip-10-0-131-168 kubenswrapper[2565]: W0706 19:32:45.249764    2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 06 19:32:45.252720 ip-10-0-131-168 kubenswrapper[2565]: W0706 19:32:45.249785    2565 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 06 19:32:45.252720 ip-10-0-131-168 kubenswrapper[2565]: W0706 19:32:45.249790    2565 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 06 19:32:45.252720 ip-10-0-131-168 kubenswrapper[2565]: W0706 19:32:45.249795    2565 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 06 19:32:45.252720 ip-10-0-131-168 kubenswrapper[2565]: W0706 19:32:45.249800    2565 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 06 19:32:45.252720 ip-10-0-131-168 kubenswrapper[2565]: W0706 19:32:45.249804    2565 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 06 19:32:45.252720 ip-10-0-131-168 kubenswrapper[2565]: W0706 19:32:45.249808    2565 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 06 19:32:45.252720 ip-10-0-131-168 kubenswrapper[2565]: W0706 19:32:45.249812    2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 06 19:32:45.252720 ip-10-0-131-168 kubenswrapper[2565]: W0706 19:32:45.249816    2565 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 06 19:32:45.252720 ip-10-0-131-168 kubenswrapper[2565]: W0706 19:32:45.249820    2565 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 06 19:32:45.252720 ip-10-0-131-168 kubenswrapper[2565]: W0706 19:32:45.249824    2565 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 06 19:32:45.252720 ip-10-0-131-168 kubenswrapper[2565]: W0706 19:32:45.249828    2565 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 06 19:32:45.252720 ip-10-0-131-168 kubenswrapper[2565]: W0706 19:32:45.249832    2565 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 06 19:32:45.252720 ip-10-0-131-168 kubenswrapper[2565]: W0706 19:32:45.249837    2565 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 06 19:32:45.253325 ip-10-0-131-168 kubenswrapper[2565]: W0706 19:32:45.250456    2565 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 06 19:32:45.253325 ip-10-0-131-168 kubenswrapper[2565]: W0706 19:32:45.250466    2565 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 06 19:32:45.253325 ip-10-0-131-168 kubenswrapper[2565]: W0706 19:32:45.250470    2565 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 06 19:32:45.253325 ip-10-0-131-168 kubenswrapper[2565]: W0706 19:32:45.250475    2565 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 06 19:32:45.253325 ip-10-0-131-168 kubenswrapper[2565]: W0706 19:32:45.250479    2565 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 06 19:32:45.253325 ip-10-0-131-168 kubenswrapper[2565]: W0706 19:32:45.250483    2565 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 06 19:32:45.253325 ip-10-0-131-168 kubenswrapper[2565]: W0706 19:32:45.250488    2565 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 06 19:32:45.253325 ip-10-0-131-168 kubenswrapper[2565]: W0706 19:32:45.250492    2565 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 06 19:32:45.253325 ip-10-0-131-168 kubenswrapper[2565]: W0706 19:32:45.250496    2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 06 19:32:45.253325 ip-10-0-131-168 kubenswrapper[2565]: W0706 19:32:45.250500    2565 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 06 19:32:45.253325 ip-10-0-131-168 kubenswrapper[2565]: W0706 19:32:45.250505    2565 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 06 19:32:45.253325 ip-10-0-131-168 kubenswrapper[2565]: W0706 19:32:45.250509    2565 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 06 19:32:45.253325 ip-10-0-131-168 kubenswrapper[2565]: W0706 19:32:45.250515    2565 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 06 19:32:45.253325 ip-10-0-131-168 kubenswrapper[2565]: W0706 19:32:45.250520    2565 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 06 19:32:45.253325 ip-10-0-131-168 kubenswrapper[2565]: W0706 19:32:45.250524    2565 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 06 19:32:45.253325 ip-10-0-131-168 kubenswrapper[2565]: W0706 19:32:45.250528    2565 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 06 19:32:45.253325 ip-10-0-131-168 kubenswrapper[2565]: W0706 19:32:45.250534    2565 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 06 19:32:45.253325 ip-10-0-131-168 kubenswrapper[2565]: W0706 19:32:45.250538    2565 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 06 19:32:45.253325 ip-10-0-131-168 kubenswrapper[2565]: W0706 19:32:45.250542    2565 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 06 19:32:45.253325 ip-10-0-131-168 kubenswrapper[2565]: W0706 19:32:45.250547    2565 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 06 19:32:45.253976 ip-10-0-131-168 kubenswrapper[2565]: W0706 19:32:45.250552    2565 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 06 19:32:45.253976 ip-10-0-131-168 kubenswrapper[2565]: W0706 19:32:45.250556    2565 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 06 19:32:45.253976 ip-10-0-131-168 kubenswrapper[2565]: W0706 19:32:45.250560    2565 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 06 19:32:45.253976 ip-10-0-131-168 kubenswrapper[2565]: W0706 19:32:45.250564    2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 06 19:32:45.253976 ip-10-0-131-168 kubenswrapper[2565]: W0706 19:32:45.250568    2565 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 06 19:32:45.253976 ip-10-0-131-168 kubenswrapper[2565]: W0706 19:32:45.250573    2565 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 06 19:32:45.253976 ip-10-0-131-168 kubenswrapper[2565]: W0706 19:32:45.250578    2565 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 06 19:32:45.253976 ip-10-0-131-168 kubenswrapper[2565]: W0706 19:32:45.250582    2565 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 06 19:32:45.253976 ip-10-0-131-168 kubenswrapper[2565]: W0706 19:32:45.250586    2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 06 19:32:45.253976 ip-10-0-131-168 kubenswrapper[2565]: W0706 19:32:45.250590    2565 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 06 19:32:45.253976 ip-10-0-131-168 kubenswrapper[2565]: W0706 19:32:45.250594    2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 06 19:32:45.253976 ip-10-0-131-168 kubenswrapper[2565]: W0706 19:32:45.250599    2565 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 06 19:32:45.253976 ip-10-0-131-168 kubenswrapper[2565]: W0706 19:32:45.250603    2565 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 06 19:32:45.253976 ip-10-0-131-168 kubenswrapper[2565]: W0706 19:32:45.250607    2565 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 06 19:32:45.253976 ip-10-0-131-168 kubenswrapper[2565]: W0706 19:32:45.250612    2565 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 06 19:32:45.253976 ip-10-0-131-168 kubenswrapper[2565]: W0706 19:32:45.250616    2565 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 06 19:32:45.253976 ip-10-0-131-168 kubenswrapper[2565]: W0706 19:32:45.250620    2565 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 06 19:32:45.253976 ip-10-0-131-168 kubenswrapper[2565]: W0706 19:32:45.250624    2565 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 06 19:32:45.253976 ip-10-0-131-168 kubenswrapper[2565]: W0706 19:32:45.250629    2565 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 06 19:32:45.253976 ip-10-0-131-168 kubenswrapper[2565]: W0706 19:32:45.250632    2565 feature_gate.go:328] unrecognized feature gate: Example
Jul 06 19:32:45.254587 ip-10-0-131-168 kubenswrapper[2565]: W0706 19:32:45.250637    2565 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 06 19:32:45.254587 ip-10-0-131-168 kubenswrapper[2565]: W0706 19:32:45.250641    2565 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 06 19:32:45.254587 ip-10-0-131-168 kubenswrapper[2565]: W0706 19:32:45.250645    2565 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 06 19:32:45.254587 ip-10-0-131-168 kubenswrapper[2565]: W0706 19:32:45.250650    2565 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 06 19:32:45.254587 ip-10-0-131-168 kubenswrapper[2565]: W0706 19:32:45.250654    2565 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 06 19:32:45.254587 ip-10-0-131-168 kubenswrapper[2565]: W0706 19:32:45.250658    2565 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 06 19:32:45.254587 ip-10-0-131-168 kubenswrapper[2565]: W0706 19:32:45.250664    2565 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 06 19:32:45.254587 ip-10-0-131-168 kubenswrapper[2565]: W0706 19:32:45.250668    2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 06 19:32:45.254587 ip-10-0-131-168 kubenswrapper[2565]: W0706 19:32:45.250672    2565 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 06 19:32:45.254587 ip-10-0-131-168 kubenswrapper[2565]: W0706 19:32:45.250677    2565 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 06 19:32:45.254587 ip-10-0-131-168 kubenswrapper[2565]: W0706 19:32:45.250681    2565 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 06 19:32:45.254587 ip-10-0-131-168 kubenswrapper[2565]: W0706 19:32:45.250686    2565 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 06 19:32:45.254587 ip-10-0-131-168 kubenswrapper[2565]: W0706 19:32:45.250690    2565 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 06 19:32:45.254587 ip-10-0-131-168 kubenswrapper[2565]: W0706 19:32:45.250694    2565 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 06 19:32:45.254587 ip-10-0-131-168 kubenswrapper[2565]: W0706 19:32:45.250698    2565 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 06 19:32:45.254587 ip-10-0-131-168 kubenswrapper[2565]: W0706 19:32:45.250702    2565 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 06 19:32:45.254587 ip-10-0-131-168 kubenswrapper[2565]: W0706 19:32:45.250706    2565 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 06 19:32:45.254587 ip-10-0-131-168 kubenswrapper[2565]: W0706 19:32:45.250711    2565 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 06 19:32:45.254587 ip-10-0-131-168 kubenswrapper[2565]: W0706 19:32:45.250715    2565 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 06 19:32:45.255122 ip-10-0-131-168 kubenswrapper[2565]: W0706 19:32:45.250719    2565 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 06 19:32:45.255122 ip-10-0-131-168 kubenswrapper[2565]: W0706 19:32:45.250723    2565 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 06 19:32:45.255122 ip-10-0-131-168 kubenswrapper[2565]: W0706 19:32:45.250727    2565 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 06 19:32:45.255122 ip-10-0-131-168 kubenswrapper[2565]: W0706 19:32:45.250731    2565 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 06 19:32:45.255122 ip-10-0-131-168 kubenswrapper[2565]: W0706 19:32:45.250735    2565 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 06 19:32:45.255122 ip-10-0-131-168 kubenswrapper[2565]: W0706 19:32:45.250739    2565 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 06 19:32:45.255122 ip-10-0-131-168 kubenswrapper[2565]: W0706 19:32:45.250744    2565 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 06 19:32:45.255122 ip-10-0-131-168 kubenswrapper[2565]: W0706 19:32:45.250748    2565 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 06 19:32:45.255122 ip-10-0-131-168 kubenswrapper[2565]: W0706 19:32:45.250752    2565 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 06 19:32:45.255122 ip-10-0-131-168 kubenswrapper[2565]: W0706 19:32:45.250757    2565 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 06 19:32:45.255122 ip-10-0-131-168 kubenswrapper[2565]: W0706 19:32:45.250761    2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 06 19:32:45.255122 ip-10-0-131-168 kubenswrapper[2565]: W0706 19:32:45.250765    2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 06 19:32:45.255122 ip-10-0-131-168 kubenswrapper[2565]: W0706 19:32:45.250788    2565 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 06 19:32:45.255122 ip-10-0-131-168 kubenswrapper[2565]: W0706 19:32:45.250793    2565 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 06 19:32:45.255122 ip-10-0-131-168 kubenswrapper[2565]: W0706 19:32:45.250797    2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 06 19:32:45.255122 ip-10-0-131-168 kubenswrapper[2565]: W0706 19:32:45.250801    2565 feature_gate.go:328] unrecognized feature gate: Example2
Jul 06 19:32:45.255122 ip-10-0-131-168 kubenswrapper[2565]: W0706 19:32:45.250804    2565 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 06 19:32:45.255122 ip-10-0-131-168 kubenswrapper[2565]: W0706 19:32:45.250808    2565 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 06 19:32:45.255122 ip-10-0-131-168 kubenswrapper[2565]: W0706 19:32:45.250813    2565 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 06 19:32:45.255122 ip-10-0-131-168 kubenswrapper[2565]: W0706 19:32:45.250817    2565 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 06 19:32:45.255656 ip-10-0-131-168 kubenswrapper[2565]: W0706 19:32:45.250821    2565 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 06 19:32:45.255656 ip-10-0-131-168 kubenswrapper[2565]: W0706 19:32:45.250826    2565 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 06 19:32:45.255656 ip-10-0-131-168 kubenswrapper[2565]: W0706 19:32:45.250830    2565 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 06 19:32:45.255656 ip-10-0-131-168 kubenswrapper[2565]: W0706 19:32:45.250835    2565 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 06 19:32:45.255656 ip-10-0-131-168 kubenswrapper[2565]: W0706 19:32:45.250840    2565 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 06 19:32:45.255656 ip-10-0-131-168 kubenswrapper[2565]: W0706 19:32:45.250847    2565 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 06 19:32:45.255656 ip-10-0-131-168 kubenswrapper[2565]: W0706 19:32:45.250852    2565 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 06 19:32:45.255656 ip-10-0-131-168 kubenswrapper[2565]: W0706 19:32:45.250858    2565 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 06 19:32:45.255656 ip-10-0-131-168 kubenswrapper[2565]: W0706 19:32:45.250864    2565 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 06 19:32:45.255656 ip-10-0-131-168 kubenswrapper[2565]: W0706 19:32:45.250870    2565 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 06 19:32:45.255656 ip-10-0-131-168 kubenswrapper[2565]: W0706 19:32:45.250876    2565 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 06 19:32:45.255656 ip-10-0-131-168 kubenswrapper[2565]: W0706 19:32:45.250880    2565 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 06 19:32:45.255656 ip-10-0-131-168 kubenswrapper[2565]: W0706 19:32:45.250885    2565 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 06 19:32:45.255656 ip-10-0-131-168 kubenswrapper[2565]: W0706 19:32:45.250890    2565 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 06 19:32:45.255656 ip-10-0-131-168 kubenswrapper[2565]: W0706 19:32:45.250895    2565 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 06 19:32:45.255656 ip-10-0-131-168 kubenswrapper[2565]: W0706 19:32:45.250899    2565 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 06 19:32:45.255656 ip-10-0-131-168 kubenswrapper[2565]: W0706 19:32:45.250903    2565 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 06 19:32:45.255656 ip-10-0-131-168 kubenswrapper[2565]: W0706 19:32:45.250907    2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 06 19:32:45.255656 ip-10-0-131-168 kubenswrapper[2565]: W0706 19:32:45.250912    2565 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 06 19:32:45.256284 ip-10-0-131-168 kubenswrapper[2565]: W0706 19:32:45.250916    2565 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 06 19:32:45.256284 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:32:45.251013    2565 flags.go:64] FLAG: --address="0.0.0.0"
Jul 06 19:32:45.256284 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:32:45.251030    2565 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]"
Jul 06 19:32:45.256284 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:32:45.251041    2565 flags.go:64] FLAG: --anonymous-auth="true"
Jul 06 19:32:45.256284 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:32:45.251048    2565 flags.go:64] FLAG: --application-metrics-count-limit="100"
Jul 06 19:32:45.256284 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:32:45.251055    2565 flags.go:64] FLAG: --authentication-token-webhook="false"
Jul 06 19:32:45.256284 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:32:45.251060    2565 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s"
Jul 06 19:32:45.256284 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:32:45.251067    2565 flags.go:64] FLAG: --authorization-mode="AlwaysAllow"
Jul 06 19:32:45.256284 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:32:45.251073    2565 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s"
Jul 06 19:32:45.256284 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:32:45.251078    2565 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s"
Jul 06 19:32:45.256284 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:32:45.251083    2565 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id"
Jul 06 19:32:45.256284 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:32:45.251089    2565 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig"
Jul 06 19:32:45.256284 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:32:45.251095    2565 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki"
Jul 06 19:32:45.256284 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:32:45.251100    2565 flags.go:64] FLAG: --cgroup-driver="cgroupfs"
Jul 06 19:32:45.256284 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:32:45.251105    2565 flags.go:64] FLAG: --cgroup-root=""
Jul 06 19:32:45.256284 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:32:45.251109    2565 flags.go:64] FLAG: --cgroups-per-qos="true"
Jul 06 19:32:45.256284 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:32:45.251114    2565 flags.go:64] FLAG: --client-ca-file=""
Jul 06 19:32:45.256284 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:32:45.251122    2565 flags.go:64] FLAG: --cloud-provider="external"
Jul 06 19:32:45.256284 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:32:45.251127    2565 flags.go:64] FLAG: --cluster-dns="[]"
Jul 06 19:32:45.256284 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:32:45.251133    2565 flags.go:64] FLAG: --cluster-domain=""
Jul 06 19:32:45.256284 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:32:45.251137    2565 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf"
Jul 06 19:32:45.256284 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:32:45.251142    2565 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d"
Jul 06 19:32:45.256284 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:32:45.251147    2565 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json"
Jul 06 19:32:45.256284 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:32:45.251152    2565 flags.go:64] FLAG: --container-log-max-files="5"
Jul 06 19:32:45.256875 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:32:45.251158    2565 flags.go:64] FLAG: --container-log-max-size="10Mi"
Jul 06 19:32:45.256875 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:32:45.251163    2565 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock"
Jul 06 19:32:45.256875 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:32:45.251168    2565 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock"
Jul 06 19:32:45.256875 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:32:45.251174    2565 flags.go:64] FLAG: --containerd-namespace="k8s.io"
Jul 06 19:32:45.256875 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:32:45.251179    2565 flags.go:64] FLAG: --contention-profiling="false"
Jul 06 19:32:45.256875 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:32:45.251183    2565 flags.go:64] FLAG: --cpu-cfs-quota="true"
Jul 06 19:32:45.256875 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:32:45.251188    2565 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms"
Jul 06 19:32:45.256875 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:32:45.251193    2565 flags.go:64] FLAG: --cpu-manager-policy="none"
Jul 06 19:32:45.256875 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:32:45.251198    2565 flags.go:64] FLAG: --cpu-manager-policy-options=""
Jul 06 19:32:45.256875 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:32:45.251205    2565 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s"
Jul 06 19:32:45.256875 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:32:45.251210    2565 flags.go:64] FLAG: --enable-controller-attach-detach="true"
Jul 06 19:32:45.256875 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:32:45.251225    2565 flags.go:64] FLAG: --enable-debugging-handlers="true"
Jul 06 19:32:45.256875 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:32:45.251230    2565 flags.go:64] FLAG: --enable-load-reader="false"
Jul 06 19:32:45.256875 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:32:45.251235    2565 flags.go:64] FLAG: --enable-server="true"
Jul 06 19:32:45.256875 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:32:45.251239    2565 flags.go:64] FLAG: --enforce-node-allocatable="[pods]"
Jul 06 19:32:45.256875 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:32:45.251247    2565 flags.go:64] FLAG: --event-burst="100"
Jul 06 19:32:45.256875 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:32:45.251252    2565 flags.go:64] FLAG: --event-qps="50"
Jul 06 19:32:45.256875 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:32:45.251256    2565 flags.go:64] FLAG: --event-storage-age-limit="default=0"
Jul 06 19:32:45.256875 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:32:45.251261    2565 flags.go:64] FLAG: --event-storage-event-limit="default=0"
Jul 06 19:32:45.256875 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:32:45.251266    2565 flags.go:64] FLAG: --eviction-hard=""
Jul 06 19:32:45.256875 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:32:45.251273    2565 flags.go:64] FLAG: --eviction-max-pod-grace-period="0"
Jul 06 19:32:45.256875 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:32:45.251277    2565 flags.go:64] FLAG: --eviction-minimum-reclaim=""
Jul 06 19:32:45.256875 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:32:45.251282    2565 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s"
Jul 06 19:32:45.256875 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:32:45.251287    2565 flags.go:64] FLAG: --eviction-soft=""
Jul 06 19:32:45.256875 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:32:45.251292    2565 flags.go:64] FLAG: --eviction-soft-grace-period=""
Jul 06 19:32:45.257481 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:32:45.251299    2565 flags.go:64] FLAG: --exit-on-lock-contention="false"
Jul 06 19:32:45.257481 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:32:45.251304    2565 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false"
Jul 06 19:32:45.257481 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:32:45.251309    2565 flags.go:64] FLAG: --experimental-mounter-path=""
Jul 06 19:32:45.257481 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:32:45.251314    2565 flags.go:64] FLAG: --fail-cgroupv1="false"
Jul 06 19:32:45.257481 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:32:45.251319    2565 flags.go:64] FLAG: --fail-swap-on="true"
Jul 06 19:32:45.257481 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:32:45.251323    2565 flags.go:64] FLAG: --feature-gates=""
Jul 06 19:32:45.257481 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:32:45.251330    2565 flags.go:64] FLAG: --file-check-frequency="20s"
Jul 06 19:32:45.257481 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:32:45.251334    2565 flags.go:64] FLAG: --global-housekeeping-interval="1m0s"
Jul 06 19:32:45.257481 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:32:45.251339    2565 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge"
Jul 06 19:32:45.257481 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:32:45.251344    2565 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1"
Jul 06 19:32:45.257481 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:32:45.251349    2565 flags.go:64] FLAG: --healthz-port="10248"
Jul 06 19:32:45.257481 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:32:45.251354    2565 flags.go:64] FLAG: --help="false"
Jul 06 19:32:45.257481 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:32:45.251358    2565 flags.go:64] FLAG: --hostname-override="ip-10-0-131-168.ec2.internal"
Jul 06 19:32:45.257481 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:32:45.251363    2565 flags.go:64] FLAG: --housekeeping-interval="10s"
Jul 06 19:32:45.257481 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:32:45.251368    2565 flags.go:64] FLAG: --http-check-frequency="20s"
Jul 06 19:32:45.257481 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:32:45.251373    2565 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins"
Jul 06 19:32:45.257481 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:32:45.251379    2565 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml"
Jul 06 19:32:45.257481 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:32:45.251384    2565 flags.go:64] FLAG: --image-gc-high-threshold="85"
Jul 06 19:32:45.257481 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:32:45.251389    2565 flags.go:64] FLAG: --image-gc-low-threshold="80"
Jul 06 19:32:45.257481 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:32:45.251394    2565 flags.go:64] FLAG: --image-service-endpoint=""
Jul 06 19:32:45.257481 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:32:45.251398    2565 flags.go:64] FLAG: --kernel-memcg-notification="false"
Jul 06 19:32:45.257481 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:32:45.251403    2565 flags.go:64] FLAG: --kube-api-burst="100"
Jul 06 19:32:45.257481 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:32:45.251407    2565 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf"
Jul 06 19:32:45.258146 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:32:45.251413    2565 flags.go:64] FLAG: --kube-api-qps="50"
Jul 06 19:32:45.258146 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:32:45.251417    2565 flags.go:64] FLAG: --kube-reserved=""
Jul 06 19:32:45.258146 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:32:45.251422    2565 flags.go:64] FLAG: --kube-reserved-cgroup=""
Jul 06 19:32:45.258146 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:32:45.251426    2565 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig"
Jul 06 19:32:45.258146 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:32:45.251431    2565 flags.go:64] FLAG: --kubelet-cgroups=""
Jul 06 19:32:45.258146 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:32:45.251436    2565 flags.go:64] FLAG: --local-storage-capacity-isolation="true"
Jul 06 19:32:45.258146 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:32:45.251440    2565 flags.go:64] FLAG: --lock-file=""
Jul 06 19:32:45.258146 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:32:45.251445    2565 flags.go:64] FLAG: --log-cadvisor-usage="false"
Jul 06 19:32:45.258146 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:32:45.251450    2565 flags.go:64] FLAG: --log-flush-frequency="5s"
Jul 06 19:32:45.258146 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:32:45.251456    2565 flags.go:64] FLAG: --log-json-info-buffer-size="0"
Jul 06 19:32:45.258146 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:32:45.251464    2565 flags.go:64] FLAG: --log-json-split-stream="false"
Jul 06 19:32:45.258146 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:32:45.251469    2565 flags.go:64] FLAG: --log-text-info-buffer-size="0"
Jul 06 19:32:45.258146 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:32:45.251475    2565 flags.go:64] FLAG: --log-text-split-stream="false"
Jul 06 19:32:45.258146 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:32:45.251480    2565 flags.go:64] FLAG: --logging-format="text"
Jul 06 19:32:45.258146 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:32:45.251484    2565 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id"
Jul 06 19:32:45.258146 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:32:45.251489    2565 flags.go:64] FLAG: --make-iptables-util-chains="true"
Jul 06 19:32:45.258146 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:32:45.251494    2565 flags.go:64] FLAG: --manifest-url=""
Jul 06 19:32:45.258146 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:32:45.251499    2565 flags.go:64] FLAG: --manifest-url-header=""
Jul 06 19:32:45.258146 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:32:45.251505    2565 flags.go:64] FLAG: --max-housekeeping-interval="15s"
Jul 06 19:32:45.258146 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:32:45.251510    2565 flags.go:64] FLAG: --max-open-files="1000000"
Jul 06 19:32:45.258146 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:32:45.251517    2565 flags.go:64] FLAG: --max-pods="110"
Jul 06 19:32:45.258146 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:32:45.251522    2565 flags.go:64] FLAG: --maximum-dead-containers="-1"
Jul 06 19:32:45.258146 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:32:45.251528    2565 flags.go:64] FLAG: --maximum-dead-containers-per-container="1"
Jul 06 19:32:45.258146 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:32:45.251533    2565 flags.go:64] FLAG: --memory-manager-policy="None"
Jul 06 19:32:45.258146 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:32:45.251538    2565 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s"
Jul 06 19:32:45.258731 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:32:45.251542    2565 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s"
Jul 06 19:32:45.258731 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:32:45.251547    2565 flags.go:64] FLAG: --node-ip="0.0.0.0"
Jul 06 19:32:45.258731 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:32:45.251552    2565 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel"
Jul 06 19:32:45.258731 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:32:45.251564    2565 flags.go:64] FLAG: --node-status-max-images="50"
Jul 06 19:32:45.258731 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:32:45.251569    2565 flags.go:64] FLAG: --node-status-update-frequency="10s"
Jul 06 19:32:45.258731 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:32:45.251574    2565 flags.go:64] FLAG: --oom-score-adj="-999"
Jul 06 19:32:45.258731 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:32:45.251579    2565 flags.go:64] FLAG: --pod-cidr=""
Jul 06 19:32:45.258731 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:32:45.251584    2565 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:ce93f6b4197b9c62a26a3131f8057ffe9c9379c5079a4f62e5919b75151394e5"
Jul 06 19:32:45.258731 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:32:45.251593    2565 flags.go:64] FLAG: --pod-manifest-path=""
Jul 06 19:32:45.258731 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:32:45.251597    2565 flags.go:64] FLAG: --pod-max-pids="-1"
Jul 06 19:32:45.258731 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:32:45.251602    2565 flags.go:64] FLAG: --pods-per-core="0"
Jul 06 19:32:45.258731 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:32:45.251607    2565 flags.go:64] FLAG: --port="10250"
Jul 06 19:32:45.258731 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:32:45.251611    2565 flags.go:64] FLAG: --protect-kernel-defaults="false"
Jul 06 19:32:45.258731 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:32:45.251616    2565 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-0a7f534b90788afc8"
Jul 06 19:32:45.258731 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:32:45.251621    2565 flags.go:64] FLAG: --qos-reserved=""
Jul 06 19:32:45.258731 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:32:45.251626    2565 flags.go:64] FLAG: --read-only-port="10255"
Jul 06 19:32:45.258731 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:32:45.251631    2565 flags.go:64] FLAG: --register-node="true"
Jul 06 19:32:45.258731 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:32:45.251637    2565 flags.go:64] FLAG: --register-with-taints=""
Jul 06 19:32:45.258731 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:32:45.251643    2565 flags.go:64] FLAG: --registry-burst="10"
Jul 06 19:32:45.258731 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:32:45.251648    2565 flags.go:64] FLAG: --registry-qps="5"
Jul 06 19:32:45.258731 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:32:45.251653    2565 flags.go:64] FLAG: --reserved-cpus=""
Jul 06 19:32:45.258731 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:32:45.251657    2565 flags.go:64] FLAG: --reserved-memory=""
Jul 06 19:32:45.258731 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:32:45.251663    2565 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf"
Jul 06 19:32:45.258731 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:32:45.251668    2565 flags.go:64] FLAG: --root-dir="/var/lib/kubelet"
Jul 06 19:32:45.258731 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:32:45.251674    2565 flags.go:64] FLAG: --rotate-certificates="false"
Jul 06 19:32:45.259360 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:32:45.251678    2565 flags.go:64] FLAG: --rotate-server-certificates="false"
Jul 06 19:32:45.259360 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:32:45.251683    2565 flags.go:64] FLAG: --runonce="false"
Jul 06 19:32:45.259360 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:32:45.251687    2565 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service"
Jul 06 19:32:45.259360 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:32:45.251692    2565 flags.go:64] FLAG: --runtime-request-timeout="2m0s"
Jul 06 19:32:45.259360 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:32:45.251698    2565 flags.go:64] FLAG: --seccomp-default="false"
Jul 06 19:32:45.259360 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:32:45.251703    2565 flags.go:64] FLAG: --serialize-image-pulls="true"
Jul 06 19:32:45.259360 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:32:45.251707    2565 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s"
Jul 06 19:32:45.259360 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:32:45.251712    2565 flags.go:64] FLAG: --storage-driver-db="cadvisor"
Jul 06 19:32:45.259360 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:32:45.251717    2565 flags.go:64] FLAG: --storage-driver-host="localhost:8086"
Jul 06 19:32:45.259360 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:32:45.251722    2565 flags.go:64] FLAG: --storage-driver-password="root"
Jul 06 19:32:45.259360 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:32:45.251727    2565 flags.go:64] FLAG: --storage-driver-secure="false"
Jul 06 19:32:45.259360 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:32:45.251731    2565 flags.go:64] FLAG: --storage-driver-table="stats"
Jul 06 19:32:45.259360 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:32:45.251736    2565 flags.go:64] FLAG: --storage-driver-user="root"
Jul 06 19:32:45.259360 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:32:45.251740    2565 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s"
Jul 06 19:32:45.259360 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:32:45.251745    2565 flags.go:64] FLAG: --sync-frequency="1m0s"
Jul 06 19:32:45.259360 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:32:45.251750    2565 flags.go:64] FLAG: --system-cgroups=""
Jul 06 19:32:45.259360 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:32:45.251754    2565 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi"
Jul 06 19:32:45.259360 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:32:45.251763    2565 flags.go:64] FLAG: --system-reserved-cgroup=""
Jul 06 19:32:45.259360 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:32:45.251784    2565 flags.go:64] FLAG: --tls-cert-file=""
Jul 06 19:32:45.259360 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:32:45.251789    2565 flags.go:64] FLAG: --tls-cipher-suites="[]"
Jul 06 19:32:45.259360 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:32:45.251795    2565 flags.go:64] FLAG: --tls-min-version=""
Jul 06 19:32:45.259360 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:32:45.251800    2565 flags.go:64] FLAG: --tls-private-key-file=""
Jul 06 19:32:45.259360 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:32:45.251804    2565 flags.go:64] FLAG: --topology-manager-policy="none"
Jul 06 19:32:45.259360 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:32:45.251808    2565 flags.go:64] FLAG: --topology-manager-policy-options=""
Jul 06 19:32:45.259360 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:32:45.251815    2565 flags.go:64] FLAG: --topology-manager-scope="container"
Jul 06 19:32:45.260013 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:32:45.251820    2565 flags.go:64] FLAG: --v="2"
Jul 06 19:32:45.260013 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:32:45.251827    2565 flags.go:64] FLAG: --version="false"
Jul 06 19:32:45.260013 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:32:45.251835    2565 flags.go:64] FLAG: --vmodule=""
Jul 06 19:32:45.260013 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:32:45.251840    2565 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec"
Jul 06 19:32:45.260013 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:32:45.251846    2565 flags.go:64] FLAG: --volume-stats-agg-period="1m0s"
Jul 06 19:32:45.260013 ip-10-0-131-168 kubenswrapper[2565]: W0706 19:32:45.252031    2565 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 06 19:32:45.260013 ip-10-0-131-168 kubenswrapper[2565]: W0706 19:32:45.252038    2565 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 06 19:32:45.260013 ip-10-0-131-168 kubenswrapper[2565]: W0706 19:32:45.252043    2565 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 06 19:32:45.260013 ip-10-0-131-168 kubenswrapper[2565]: W0706 19:32:45.252048    2565 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 06 19:32:45.260013 ip-10-0-131-168 kubenswrapper[2565]: W0706 19:32:45.252053    2565 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 06 19:32:45.260013 ip-10-0-131-168 kubenswrapper[2565]: W0706 19:32:45.252057    2565 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 06 19:32:45.260013 ip-10-0-131-168 kubenswrapper[2565]: W0706 19:32:45.252064    2565 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 06 19:32:45.260013 ip-10-0-131-168 kubenswrapper[2565]: W0706 19:32:45.252068    2565 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 06 19:32:45.260013 ip-10-0-131-168 kubenswrapper[2565]: W0706 19:32:45.252072    2565 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 06 19:32:45.260013 ip-10-0-131-168 kubenswrapper[2565]: W0706 19:32:45.252077    2565 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 06 19:32:45.260013 ip-10-0-131-168 kubenswrapper[2565]: W0706 19:32:45.252081    2565 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 06 19:32:45.260013 ip-10-0-131-168 kubenswrapper[2565]: W0706 19:32:45.252085    2565 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 06 19:32:45.260013 ip-10-0-131-168 kubenswrapper[2565]: W0706 19:32:45.252090    2565 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 06 19:32:45.260013 ip-10-0-131-168 kubenswrapper[2565]: W0706 19:32:45.252094    2565 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 06 19:32:45.260013 ip-10-0-131-168 kubenswrapper[2565]: W0706 19:32:45.252098    2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 06 19:32:45.260013 ip-10-0-131-168 kubenswrapper[2565]: W0706 19:32:45.252103    2565 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 06 19:32:45.260524 ip-10-0-131-168 kubenswrapper[2565]: W0706 19:32:45.252108    2565 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 06 19:32:45.260524 ip-10-0-131-168 kubenswrapper[2565]: W0706 19:32:45.252112    2565 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 06 19:32:45.260524 ip-10-0-131-168 kubenswrapper[2565]: W0706 19:32:45.252116    2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 06 19:32:45.260524 ip-10-0-131-168 kubenswrapper[2565]: W0706 19:32:45.252120    2565 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 06 19:32:45.260524 ip-10-0-131-168 kubenswrapper[2565]: W0706 19:32:45.252124    2565 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 06 19:32:45.260524 ip-10-0-131-168 kubenswrapper[2565]: W0706 19:32:45.252128    2565 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 06 19:32:45.260524 ip-10-0-131-168 kubenswrapper[2565]: W0706 19:32:45.252133    2565 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 06 19:32:45.260524 ip-10-0-131-168 kubenswrapper[2565]: W0706 19:32:45.252137    2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 06 19:32:45.260524 ip-10-0-131-168 kubenswrapper[2565]: W0706 19:32:45.252141    2565 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 06 19:32:45.260524 ip-10-0-131-168 kubenswrapper[2565]: W0706 19:32:45.252146    2565 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 06 19:32:45.260524 ip-10-0-131-168 kubenswrapper[2565]: W0706 19:32:45.252152    2565 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 06 19:32:45.260524 ip-10-0-131-168 kubenswrapper[2565]: W0706 19:32:45.252156    2565 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 06 19:32:45.260524 ip-10-0-131-168 kubenswrapper[2565]: W0706 19:32:45.252161    2565 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 06 19:32:45.260524 ip-10-0-131-168 kubenswrapper[2565]: W0706 19:32:45.252165    2565 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 06 19:32:45.260524 ip-10-0-131-168 kubenswrapper[2565]: W0706 19:32:45.252171    2565 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 06 19:32:45.260524 ip-10-0-131-168 kubenswrapper[2565]: W0706 19:32:45.252176    2565 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 06 19:32:45.260524 ip-10-0-131-168 kubenswrapper[2565]: W0706 19:32:45.252180    2565 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 06 19:32:45.260524 ip-10-0-131-168 kubenswrapper[2565]: W0706 19:32:45.252184    2565 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 06 19:32:45.260524 ip-10-0-131-168 kubenswrapper[2565]: W0706 19:32:45.252189    2565 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 06 19:32:45.260524 ip-10-0-131-168 kubenswrapper[2565]: W0706 19:32:45.252193    2565 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 06 19:32:45.261032 ip-10-0-131-168 kubenswrapper[2565]: W0706 19:32:45.252197    2565 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 06 19:32:45.261032 ip-10-0-131-168 kubenswrapper[2565]: W0706 19:32:45.252201    2565 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 06 19:32:45.261032 ip-10-0-131-168 kubenswrapper[2565]: W0706 19:32:45.252207    2565 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 06 19:32:45.261032 ip-10-0-131-168 kubenswrapper[2565]: W0706 19:32:45.252212    2565 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 06 19:32:45.261032 ip-10-0-131-168 kubenswrapper[2565]: W0706 19:32:45.252216    2565 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 06 19:32:45.261032 ip-10-0-131-168 kubenswrapper[2565]: W0706 19:32:45.252220    2565 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 06 19:32:45.261032 ip-10-0-131-168 kubenswrapper[2565]: W0706 19:32:45.252225    2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 06 19:32:45.261032 ip-10-0-131-168 kubenswrapper[2565]: W0706 19:32:45.252229    2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 06 19:32:45.261032 ip-10-0-131-168 kubenswrapper[2565]: W0706 19:32:45.252233    2565 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 06 19:32:45.261032 ip-10-0-131-168 kubenswrapper[2565]: W0706 19:32:45.252237    2565 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 06 19:32:45.261032 ip-10-0-131-168 kubenswrapper[2565]: W0706 19:32:45.252244    2565 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 06 19:32:45.261032 ip-10-0-131-168 kubenswrapper[2565]: W0706 19:32:45.252249    2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 06 19:32:45.261032 ip-10-0-131-168 kubenswrapper[2565]: W0706 19:32:45.252254    2565 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 06 19:32:45.261032 ip-10-0-131-168 kubenswrapper[2565]: W0706 19:32:45.252259    2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 06 19:32:45.261032 ip-10-0-131-168 kubenswrapper[2565]: W0706 19:32:45.252264    2565 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 06 19:32:45.261032 ip-10-0-131-168 kubenswrapper[2565]: W0706 19:32:45.252269    2565 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 06 19:32:45.261032 ip-10-0-131-168 kubenswrapper[2565]: W0706 19:32:45.252274    2565 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 06 19:32:45.261032 ip-10-0-131-168 kubenswrapper[2565]: W0706 19:32:45.252279    2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 06 19:32:45.261032 ip-10-0-131-168 kubenswrapper[2565]: W0706 19:32:45.252283    2565 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 06 19:32:45.261032 ip-10-0-131-168 kubenswrapper[2565]: W0706 19:32:45.252288    2565 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 06 19:32:45.261515 ip-10-0-131-168 kubenswrapper[2565]: W0706 19:32:45.252292    2565 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 06 19:32:45.261515 ip-10-0-131-168 kubenswrapper[2565]: W0706 19:32:45.252296    2565 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 06 19:32:45.261515 ip-10-0-131-168 kubenswrapper[2565]: W0706 19:32:45.252302    2565 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 06 19:32:45.261515 ip-10-0-131-168 kubenswrapper[2565]: W0706 19:32:45.252307    2565 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 06 19:32:45.261515 ip-10-0-131-168 kubenswrapper[2565]: W0706 19:32:45.252313    2565 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 06 19:32:45.261515 ip-10-0-131-168 kubenswrapper[2565]: W0706 19:32:45.252319    2565 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 06 19:32:45.261515 ip-10-0-131-168 kubenswrapper[2565]: W0706 19:32:45.252324    2565 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 06 19:32:45.261515 ip-10-0-131-168 kubenswrapper[2565]: W0706 19:32:45.252330    2565 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 06 19:32:45.261515 ip-10-0-131-168 kubenswrapper[2565]: W0706 19:32:45.252335    2565 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 06 19:32:45.261515 ip-10-0-131-168 kubenswrapper[2565]: W0706 19:32:45.252339    2565 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 06 19:32:45.261515 ip-10-0-131-168 kubenswrapper[2565]: W0706 19:32:45.252345    2565 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 06 19:32:45.261515 ip-10-0-131-168 kubenswrapper[2565]: W0706 19:32:45.252349    2565 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 06 19:32:45.261515 ip-10-0-131-168 kubenswrapper[2565]: W0706 19:32:45.252354    2565 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 06 19:32:45.261515 ip-10-0-131-168 kubenswrapper[2565]: W0706 19:32:45.252358    2565 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 06 19:32:45.261515 ip-10-0-131-168 kubenswrapper[2565]: W0706 19:32:45.252365    2565 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 06 19:32:45.261515 ip-10-0-131-168 kubenswrapper[2565]: W0706 19:32:45.252369    2565 feature_gate.go:328] unrecognized feature gate: Example2
Jul 06 19:32:45.261515 ip-10-0-131-168 kubenswrapper[2565]: W0706 19:32:45.252374    2565 feature_gate.go:328] unrecognized feature gate: Example
Jul 06 19:32:45.261515 ip-10-0-131-168 kubenswrapper[2565]: W0706 19:32:45.252378    2565 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 06 19:32:45.261515 ip-10-0-131-168 kubenswrapper[2565]: W0706 19:32:45.252383    2565 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 06 19:32:45.262025 ip-10-0-131-168 kubenswrapper[2565]: W0706 19:32:45.252387    2565 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 06 19:32:45.262025 ip-10-0-131-168 kubenswrapper[2565]: W0706 19:32:45.252391    2565 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 06 19:32:45.262025 ip-10-0-131-168 kubenswrapper[2565]: W0706 19:32:45.252395    2565 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 06 19:32:45.262025 ip-10-0-131-168 kubenswrapper[2565]: W0706 19:32:45.252400    2565 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 06 19:32:45.262025 ip-10-0-131-168 kubenswrapper[2565]: W0706 19:32:45.252404    2565 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 06 19:32:45.262025 ip-10-0-131-168 kubenswrapper[2565]: W0706 19:32:45.252408    2565 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 06 19:32:45.262025 ip-10-0-131-168 kubenswrapper[2565]: W0706 19:32:45.252412    2565 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 06 19:32:45.262025 ip-10-0-131-168 kubenswrapper[2565]: W0706 19:32:45.252416    2565 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 06 19:32:45.262025 ip-10-0-131-168 kubenswrapper[2565]: W0706 19:32:45.252420    2565 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 06 19:32:45.262025 ip-10-0-131-168 kubenswrapper[2565]: W0706 19:32:45.252426    2565 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 06 19:32:45.262025 ip-10-0-131-168 kubenswrapper[2565]: W0706 19:32:45.252432    2565 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 06 19:32:45.262025 ip-10-0-131-168 kubenswrapper[2565]: W0706 19:32:45.252436    2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 06 19:32:45.262025 ip-10-0-131-168 kubenswrapper[2565]: W0706 19:32:45.252440    2565 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 06 19:32:45.262025 ip-10-0-131-168 kubenswrapper[2565]: W0706 19:32:45.252445    2565 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 06 19:32:45.262025 ip-10-0-131-168 kubenswrapper[2565]: W0706 19:32:45.252449    2565 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 06 19:32:45.262025 ip-10-0-131-168 kubenswrapper[2565]: W0706 19:32:45.252457    2565 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 06 19:32:45.262025 ip-10-0-131-168 kubenswrapper[2565]: W0706 19:32:45.252461    2565 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 06 19:32:45.262025 ip-10-0-131-168 kubenswrapper[2565]: W0706 19:32:45.252465    2565 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 06 19:32:45.262025 ip-10-0-131-168 kubenswrapper[2565]: W0706 19:32:45.252469    2565 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 06 19:32:45.262476 ip-10-0-131-168 kubenswrapper[2565]: W0706 19:32:45.252473    2565 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 06 19:32:45.262476 ip-10-0-131-168 kubenswrapper[2565]: W0706 19:32:45.252477    2565 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 06 19:32:45.262476 ip-10-0-131-168 kubenswrapper[2565]: W0706 19:32:45.252482    2565 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 06 19:32:45.262476 ip-10-0-131-168 kubenswrapper[2565]: W0706 19:32:45.252487    2565 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 06 19:32:45.262476 ip-10-0-131-168 kubenswrapper[2565]: W0706 19:32:45.252491    2565 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 06 19:32:45.262476 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:32:45.253055    2565 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 06 19:32:45.262476 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:32:45.259526    2565 server.go:529] "Kubelet version" kubeletVersion="v1.34.8"
Jul 06 19:32:45.262476 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:32:45.259540    2565 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK=""
Jul 06 19:32:45.262476 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:32:45.259560    2565 watchdog_linux.go:95] "Systemd watchdog is not enabled"
Jul 06 19:32:45.262476 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:32:45.259565    2565 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started."
Jul 06 19:32:45.262476 ip-10-0-131-168 kubenswrapper[2565]: W0706 19:32:45.259624    2565 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 06 19:32:45.262476 ip-10-0-131-168 kubenswrapper[2565]: W0706 19:32:45.259629    2565 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 06 19:32:45.262476 ip-10-0-131-168 kubenswrapper[2565]: W0706 19:32:45.259633    2565 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 06 19:32:45.262476 ip-10-0-131-168 kubenswrapper[2565]: W0706 19:32:45.259636    2565 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 06 19:32:45.262848 ip-10-0-131-168 kubenswrapper[2565]: W0706 19:32:45.259638    2565 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 06 19:32:45.262848 ip-10-0-131-168 kubenswrapper[2565]: W0706 19:32:45.259641    2565 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 06 19:32:45.262848 ip-10-0-131-168 kubenswrapper[2565]: W0706 19:32:45.259644    2565 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 06 19:32:45.262848 ip-10-0-131-168 kubenswrapper[2565]: W0706 19:32:45.259646    2565 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 06 19:32:45.262848 ip-10-0-131-168 kubenswrapper[2565]: W0706 19:32:45.259649    2565 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 06 19:32:45.262848 ip-10-0-131-168 kubenswrapper[2565]: W0706 19:32:45.259652    2565 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 06 19:32:45.262848 ip-10-0-131-168 kubenswrapper[2565]: W0706 19:32:45.259655    2565 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 06 19:32:45.262848 ip-10-0-131-168 kubenswrapper[2565]: W0706 19:32:45.259657    2565 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 06 19:32:45.262848 ip-10-0-131-168 kubenswrapper[2565]: W0706 19:32:45.259660    2565 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 06 19:32:45.262848 ip-10-0-131-168 kubenswrapper[2565]: W0706 19:32:45.259663    2565 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 06 19:32:45.262848 ip-10-0-131-168 kubenswrapper[2565]: W0706 19:32:45.259665    2565 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 06 19:32:45.262848 ip-10-0-131-168 kubenswrapper[2565]: W0706 19:32:45.259668    2565 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 06 19:32:45.262848 ip-10-0-131-168 kubenswrapper[2565]: W0706 19:32:45.259671    2565 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 06 19:32:45.262848 ip-10-0-131-168 kubenswrapper[2565]: W0706 19:32:45.259674    2565 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 06 19:32:45.262848 ip-10-0-131-168 kubenswrapper[2565]: W0706 19:32:45.259676    2565 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 06 19:32:45.262848 ip-10-0-131-168 kubenswrapper[2565]: W0706 19:32:45.259678    2565 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 06 19:32:45.262848 ip-10-0-131-168 kubenswrapper[2565]: W0706 19:32:45.259681    2565 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 06 19:32:45.262848 ip-10-0-131-168 kubenswrapper[2565]: W0706 19:32:45.259683    2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 06 19:32:45.262848 ip-10-0-131-168 kubenswrapper[2565]: W0706 19:32:45.259686    2565 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 06 19:32:45.262848 ip-10-0-131-168 kubenswrapper[2565]: W0706 19:32:45.259688    2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 06 19:32:45.263334 ip-10-0-131-168 kubenswrapper[2565]: W0706 19:32:45.259691    2565 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 06 19:32:45.263334 ip-10-0-131-168 kubenswrapper[2565]: W0706 19:32:45.259693    2565 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 06 19:32:45.263334 ip-10-0-131-168 kubenswrapper[2565]: W0706 19:32:45.259696    2565 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 06 19:32:45.263334 ip-10-0-131-168 kubenswrapper[2565]: W0706 19:32:45.259699    2565 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 06 19:32:45.263334 ip-10-0-131-168 kubenswrapper[2565]: W0706 19:32:45.259701    2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 06 19:32:45.263334 ip-10-0-131-168 kubenswrapper[2565]: W0706 19:32:45.259705    2565 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 06 19:32:45.263334 ip-10-0-131-168 kubenswrapper[2565]: W0706 19:32:45.259708    2565 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 06 19:32:45.263334 ip-10-0-131-168 kubenswrapper[2565]: W0706 19:32:45.259711    2565 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 06 19:32:45.263334 ip-10-0-131-168 kubenswrapper[2565]: W0706 19:32:45.259713    2565 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 06 19:32:45.263334 ip-10-0-131-168 kubenswrapper[2565]: W0706 19:32:45.259716    2565 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 06 19:32:45.263334 ip-10-0-131-168 kubenswrapper[2565]: W0706 19:32:45.259718    2565 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 06 19:32:45.263334 ip-10-0-131-168 kubenswrapper[2565]: W0706 19:32:45.259721    2565 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 06 19:32:45.263334 ip-10-0-131-168 kubenswrapper[2565]: W0706 19:32:45.259723    2565 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 06 19:32:45.263334 ip-10-0-131-168 kubenswrapper[2565]: W0706 19:32:45.259726    2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 06 19:32:45.263334 ip-10-0-131-168 kubenswrapper[2565]: W0706 19:32:45.259728    2565 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 06 19:32:45.263334 ip-10-0-131-168 kubenswrapper[2565]: W0706 19:32:45.259731    2565 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 06 19:32:45.263334 ip-10-0-131-168 kubenswrapper[2565]: W0706 19:32:45.259734    2565 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 06 19:32:45.263334 ip-10-0-131-168 kubenswrapper[2565]: W0706 19:32:45.259738    2565 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 06 19:32:45.263334 ip-10-0-131-168 kubenswrapper[2565]: W0706 19:32:45.259741    2565 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 06 19:32:45.263793 ip-10-0-131-168 kubenswrapper[2565]: W0706 19:32:45.259744    2565 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 06 19:32:45.263793 ip-10-0-131-168 kubenswrapper[2565]: W0706 19:32:45.259747    2565 feature_gate.go:328] unrecognized feature gate: Example
Jul 06 19:32:45.263793 ip-10-0-131-168 kubenswrapper[2565]: W0706 19:32:45.259750    2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 06 19:32:45.263793 ip-10-0-131-168 kubenswrapper[2565]: W0706 19:32:45.259753    2565 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 06 19:32:45.263793 ip-10-0-131-168 kubenswrapper[2565]: W0706 19:32:45.259755    2565 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 06 19:32:45.263793 ip-10-0-131-168 kubenswrapper[2565]: W0706 19:32:45.259758    2565 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 06 19:32:45.263793 ip-10-0-131-168 kubenswrapper[2565]: W0706 19:32:45.259761    2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 06 19:32:45.263793 ip-10-0-131-168 kubenswrapper[2565]: W0706 19:32:45.259763    2565 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 06 19:32:45.263793 ip-10-0-131-168 kubenswrapper[2565]: W0706 19:32:45.259766    2565 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 06 19:32:45.263793 ip-10-0-131-168 kubenswrapper[2565]: W0706 19:32:45.259784    2565 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 06 19:32:45.263793 ip-10-0-131-168 kubenswrapper[2565]: W0706 19:32:45.259787    2565 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 06 19:32:45.263793 ip-10-0-131-168 kubenswrapper[2565]: W0706 19:32:45.259789    2565 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 06 19:32:45.263793 ip-10-0-131-168 kubenswrapper[2565]: W0706 19:32:45.259792    2565 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 06 19:32:45.263793 ip-10-0-131-168 kubenswrapper[2565]: W0706 19:32:45.259794    2565 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 06 19:32:45.263793 ip-10-0-131-168 kubenswrapper[2565]: W0706 19:32:45.259797    2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 06 19:32:45.263793 ip-10-0-131-168 kubenswrapper[2565]: W0706 19:32:45.259799    2565 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 06 19:32:45.263793 ip-10-0-131-168 kubenswrapper[2565]: W0706 19:32:45.259802    2565 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 06 19:32:45.263793 ip-10-0-131-168 kubenswrapper[2565]: W0706 19:32:45.259804    2565 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 06 19:32:45.263793 ip-10-0-131-168 kubenswrapper[2565]: W0706 19:32:45.259808    2565 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 06 19:32:45.264245 ip-10-0-131-168 kubenswrapper[2565]: W0706 19:32:45.259811    2565 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 06 19:32:45.264245 ip-10-0-131-168 kubenswrapper[2565]: W0706 19:32:45.259814    2565 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 06 19:32:45.264245 ip-10-0-131-168 kubenswrapper[2565]: W0706 19:32:45.259817    2565 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 06 19:32:45.264245 ip-10-0-131-168 kubenswrapper[2565]: W0706 19:32:45.259819    2565 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 06 19:32:45.264245 ip-10-0-131-168 kubenswrapper[2565]: W0706 19:32:45.259822    2565 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 06 19:32:45.264245 ip-10-0-131-168 kubenswrapper[2565]: W0706 19:32:45.259825    2565 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 06 19:32:45.264245 ip-10-0-131-168 kubenswrapper[2565]: W0706 19:32:45.259827    2565 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 06 19:32:45.264245 ip-10-0-131-168 kubenswrapper[2565]: W0706 19:32:45.259829    2565 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 06 19:32:45.264245 ip-10-0-131-168 kubenswrapper[2565]: W0706 19:32:45.259832    2565 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 06 19:32:45.264245 ip-10-0-131-168 kubenswrapper[2565]: W0706 19:32:45.259834    2565 feature_gate.go:328] unrecognized feature gate: Example2
Jul 06 19:32:45.264245 ip-10-0-131-168 kubenswrapper[2565]: W0706 19:32:45.259837    2565 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 06 19:32:45.264245 ip-10-0-131-168 kubenswrapper[2565]: W0706 19:32:45.259839    2565 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 06 19:32:45.264245 ip-10-0-131-168 kubenswrapper[2565]: W0706 19:32:45.259842    2565 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 06 19:32:45.264245 ip-10-0-131-168 kubenswrapper[2565]: W0706 19:32:45.259844    2565 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 06 19:32:45.264245 ip-10-0-131-168 kubenswrapper[2565]: W0706 19:32:45.259847    2565 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 06 19:32:45.264245 ip-10-0-131-168 kubenswrapper[2565]: W0706 19:32:45.259849    2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 06 19:32:45.264245 ip-10-0-131-168 kubenswrapper[2565]: W0706 19:32:45.259852    2565 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 06 19:32:45.264245 ip-10-0-131-168 kubenswrapper[2565]: W0706 19:32:45.259855    2565 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 06 19:32:45.264245 ip-10-0-131-168 kubenswrapper[2565]: W0706 19:32:45.259857    2565 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 06 19:32:45.264245 ip-10-0-131-168 kubenswrapper[2565]: W0706 19:32:45.259861    2565 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 06 19:32:45.264720 ip-10-0-131-168 kubenswrapper[2565]: W0706 19:32:45.259864    2565 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 06 19:32:45.264720 ip-10-0-131-168 kubenswrapper[2565]: W0706 19:32:45.259867    2565 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 06 19:32:45.264720 ip-10-0-131-168 kubenswrapper[2565]: W0706 19:32:45.259870    2565 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 06 19:32:45.264720 ip-10-0-131-168 kubenswrapper[2565]: W0706 19:32:45.259873    2565 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 06 19:32:45.264720 ip-10-0-131-168 kubenswrapper[2565]: W0706 19:32:45.259876    2565 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 06 19:32:45.264720 ip-10-0-131-168 kubenswrapper[2565]: W0706 19:32:45.259879    2565 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 06 19:32:45.264720 ip-10-0-131-168 kubenswrapper[2565]: W0706 19:32:45.259882    2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 06 19:32:45.264720 ip-10-0-131-168 kubenswrapper[2565]: W0706 19:32:45.259885    2565 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 06 19:32:45.264720 ip-10-0-131-168 kubenswrapper[2565]: W0706 19:32:45.259888    2565 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 06 19:32:45.264720 ip-10-0-131-168 kubenswrapper[2565]: W0706 19:32:45.259890    2565 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 06 19:32:45.264720 ip-10-0-131-168 kubenswrapper[2565]: W0706 19:32:45.259893    2565 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 06 19:32:45.264720 ip-10-0-131-168 kubenswrapper[2565]: W0706 19:32:45.259895    2565 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 06 19:32:45.264720 ip-10-0-131-168 kubenswrapper[2565]: W0706 19:32:45.259898    2565 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 06 19:32:45.264720 ip-10-0-131-168 kubenswrapper[2565]: W0706 19:32:45.259902    2565 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 06 19:32:45.264720 ip-10-0-131-168 kubenswrapper[2565]: W0706 19:32:45.259905    2565 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 06 19:32:45.264720 ip-10-0-131-168 kubenswrapper[2565]: W0706 19:32:45.259908    2565 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 06 19:32:45.264720 ip-10-0-131-168 kubenswrapper[2565]: W0706 19:32:45.259910    2565 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 06 19:32:45.265169 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:32:45.259915    2565 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 06 19:32:45.265169 ip-10-0-131-168 kubenswrapper[2565]: W0706 19:32:45.260028    2565 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 06 19:32:45.265169 ip-10-0-131-168 kubenswrapper[2565]: W0706 19:32:45.260033    2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 06 19:32:45.265169 ip-10-0-131-168 kubenswrapper[2565]: W0706 19:32:45.260036    2565 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 06 19:32:45.265169 ip-10-0-131-168 kubenswrapper[2565]: W0706 19:32:45.260038    2565 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 06 19:32:45.265169 ip-10-0-131-168 kubenswrapper[2565]: W0706 19:32:45.260041    2565 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 06 19:32:45.265169 ip-10-0-131-168 kubenswrapper[2565]: W0706 19:32:45.260044    2565 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 06 19:32:45.265169 ip-10-0-131-168 kubenswrapper[2565]: W0706 19:32:45.260046    2565 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 06 19:32:45.265169 ip-10-0-131-168 kubenswrapper[2565]: W0706 19:32:45.260049    2565 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 06 19:32:45.265169 ip-10-0-131-168 kubenswrapper[2565]: W0706 19:32:45.260051    2565 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 06 19:32:45.265169 ip-10-0-131-168 kubenswrapper[2565]: W0706 19:32:45.260054    2565 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 06 19:32:45.265169 ip-10-0-131-168 kubenswrapper[2565]: W0706 19:32:45.260057    2565 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 06 19:32:45.265169 ip-10-0-131-168 kubenswrapper[2565]: W0706 19:32:45.260059    2565 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 06 19:32:45.265169 ip-10-0-131-168 kubenswrapper[2565]: W0706 19:32:45.260062    2565 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 06 19:32:45.265510 ip-10-0-131-168 kubenswrapper[2565]: W0706 19:32:45.260064    2565 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 06 19:32:45.265510 ip-10-0-131-168 kubenswrapper[2565]: W0706 19:32:45.260067    2565 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 06 19:32:45.265510 ip-10-0-131-168 kubenswrapper[2565]: W0706 19:32:45.260070    2565 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 06 19:32:45.265510 ip-10-0-131-168 kubenswrapper[2565]: W0706 19:32:45.260072    2565 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 06 19:32:45.265510 ip-10-0-131-168 kubenswrapper[2565]: W0706 19:32:45.260075    2565 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 06 19:32:45.265510 ip-10-0-131-168 kubenswrapper[2565]: W0706 19:32:45.260078    2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 06 19:32:45.265510 ip-10-0-131-168 kubenswrapper[2565]: W0706 19:32:45.260080    2565 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 06 19:32:45.265510 ip-10-0-131-168 kubenswrapper[2565]: W0706 19:32:45.260083    2565 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 06 19:32:45.265510 ip-10-0-131-168 kubenswrapper[2565]: W0706 19:32:45.260085    2565 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 06 19:32:45.265510 ip-10-0-131-168 kubenswrapper[2565]: W0706 19:32:45.260088    2565 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 06 19:32:45.265510 ip-10-0-131-168 kubenswrapper[2565]: W0706 19:32:45.260090    2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 06 19:32:45.265510 ip-10-0-131-168 kubenswrapper[2565]: W0706 19:32:45.260093    2565 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 06 19:32:45.265510 ip-10-0-131-168 kubenswrapper[2565]: W0706 19:32:45.260095    2565 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 06 19:32:45.265510 ip-10-0-131-168 kubenswrapper[2565]: W0706 19:32:45.260098    2565 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 06 19:32:45.265510 ip-10-0-131-168 kubenswrapper[2565]: W0706 19:32:45.260100    2565 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 06 19:32:45.265510 ip-10-0-131-168 kubenswrapper[2565]: W0706 19:32:45.260103    2565 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 06 19:32:45.265510 ip-10-0-131-168 kubenswrapper[2565]: W0706 19:32:45.260105    2565 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 06 19:32:45.265510 ip-10-0-131-168 kubenswrapper[2565]: W0706 19:32:45.260108    2565 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 06 19:32:45.265510 ip-10-0-131-168 kubenswrapper[2565]: W0706 19:32:45.260110    2565 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 06 19:32:45.265510 ip-10-0-131-168 kubenswrapper[2565]: W0706 19:32:45.260113    2565 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 06 19:32:45.266013 ip-10-0-131-168 kubenswrapper[2565]: W0706 19:32:45.260115    2565 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 06 19:32:45.266013 ip-10-0-131-168 kubenswrapper[2565]: W0706 19:32:45.260118    2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 06 19:32:45.266013 ip-10-0-131-168 kubenswrapper[2565]: W0706 19:32:45.260121    2565 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 06 19:32:45.266013 ip-10-0-131-168 kubenswrapper[2565]: W0706 19:32:45.260124    2565 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 06 19:32:45.266013 ip-10-0-131-168 kubenswrapper[2565]: W0706 19:32:45.260126    2565 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 06 19:32:45.266013 ip-10-0-131-168 kubenswrapper[2565]: W0706 19:32:45.260129    2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 06 19:32:45.266013 ip-10-0-131-168 kubenswrapper[2565]: W0706 19:32:45.260131    2565 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 06 19:32:45.266013 ip-10-0-131-168 kubenswrapper[2565]: W0706 19:32:45.260134    2565 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 06 19:32:45.266013 ip-10-0-131-168 kubenswrapper[2565]: W0706 19:32:45.260136    2565 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 06 19:32:45.266013 ip-10-0-131-168 kubenswrapper[2565]: W0706 19:32:45.260138    2565 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 06 19:32:45.266013 ip-10-0-131-168 kubenswrapper[2565]: W0706 19:32:45.260141    2565 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 06 19:32:45.266013 ip-10-0-131-168 kubenswrapper[2565]: W0706 19:32:45.260144    2565 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 06 19:32:45.266013 ip-10-0-131-168 kubenswrapper[2565]: W0706 19:32:45.260148    2565 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 06 19:32:45.266013 ip-10-0-131-168 kubenswrapper[2565]: W0706 19:32:45.260150    2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 06 19:32:45.266013 ip-10-0-131-168 kubenswrapper[2565]: W0706 19:32:45.260153    2565 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 06 19:32:45.266013 ip-10-0-131-168 kubenswrapper[2565]: W0706 19:32:45.260155    2565 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 06 19:32:45.266013 ip-10-0-131-168 kubenswrapper[2565]: W0706 19:32:45.260158    2565 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 06 19:32:45.266013 ip-10-0-131-168 kubenswrapper[2565]: W0706 19:32:45.260160    2565 feature_gate.go:328] unrecognized feature gate: Example
Jul 06 19:32:45.266013 ip-10-0-131-168 kubenswrapper[2565]: W0706 19:32:45.260163    2565 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 06 19:32:45.266467 ip-10-0-131-168 kubenswrapper[2565]: W0706 19:32:45.260165    2565 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 06 19:32:45.266467 ip-10-0-131-168 kubenswrapper[2565]: W0706 19:32:45.260168    2565 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 06 19:32:45.266467 ip-10-0-131-168 kubenswrapper[2565]: W0706 19:32:45.260170    2565 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 06 19:32:45.266467 ip-10-0-131-168 kubenswrapper[2565]: W0706 19:32:45.260173    2565 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 06 19:32:45.266467 ip-10-0-131-168 kubenswrapper[2565]: W0706 19:32:45.260175    2565 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 06 19:32:45.266467 ip-10-0-131-168 kubenswrapper[2565]: W0706 19:32:45.260178    2565 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 06 19:32:45.266467 ip-10-0-131-168 kubenswrapper[2565]: W0706 19:32:45.260181    2565 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 06 19:32:45.266467 ip-10-0-131-168 kubenswrapper[2565]: W0706 19:32:45.260183    2565 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 06 19:32:45.266467 ip-10-0-131-168 kubenswrapper[2565]: W0706 19:32:45.260185    2565 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 06 19:32:45.266467 ip-10-0-131-168 kubenswrapper[2565]: W0706 19:32:45.260188    2565 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 06 19:32:45.266467 ip-10-0-131-168 kubenswrapper[2565]: W0706 19:32:45.260191    2565 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 06 19:32:45.266467 ip-10-0-131-168 kubenswrapper[2565]: W0706 19:32:45.260193    2565 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 06 19:32:45.266467 ip-10-0-131-168 kubenswrapper[2565]: W0706 19:32:45.260196    2565 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 06 19:32:45.266467 ip-10-0-131-168 kubenswrapper[2565]: W0706 19:32:45.260198    2565 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 06 19:32:45.266467 ip-10-0-131-168 kubenswrapper[2565]: W0706 19:32:45.260201    2565 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 06 19:32:45.266467 ip-10-0-131-168 kubenswrapper[2565]: W0706 19:32:45.260203    2565 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 06 19:32:45.266467 ip-10-0-131-168 kubenswrapper[2565]: W0706 19:32:45.260205    2565 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 06 19:32:45.266467 ip-10-0-131-168 kubenswrapper[2565]: W0706 19:32:45.260208    2565 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 06 19:32:45.266467 ip-10-0-131-168 kubenswrapper[2565]: W0706 19:32:45.260211    2565 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 06 19:32:45.267022 ip-10-0-131-168 kubenswrapper[2565]: W0706 19:32:45.260215    2565 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 06 19:32:45.267022 ip-10-0-131-168 kubenswrapper[2565]: W0706 19:32:45.260218    2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 06 19:32:45.267022 ip-10-0-131-168 kubenswrapper[2565]: W0706 19:32:45.260220    2565 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 06 19:32:45.267022 ip-10-0-131-168 kubenswrapper[2565]: W0706 19:32:45.260222    2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 06 19:32:45.267022 ip-10-0-131-168 kubenswrapper[2565]: W0706 19:32:45.260225    2565 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 06 19:32:45.267022 ip-10-0-131-168 kubenswrapper[2565]: W0706 19:32:45.260227    2565 feature_gate.go:328] unrecognized feature gate: Example2
Jul 06 19:32:45.267022 ip-10-0-131-168 kubenswrapper[2565]: W0706 19:32:45.260230    2565 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 06 19:32:45.267022 ip-10-0-131-168 kubenswrapper[2565]: W0706 19:32:45.260233    2565 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 06 19:32:45.267022 ip-10-0-131-168 kubenswrapper[2565]: W0706 19:32:45.260235    2565 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 06 19:32:45.267022 ip-10-0-131-168 kubenswrapper[2565]: W0706 19:32:45.260239    2565 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 06 19:32:45.267022 ip-10-0-131-168 kubenswrapper[2565]: W0706 19:32:45.260242    2565 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 06 19:32:45.267022 ip-10-0-131-168 kubenswrapper[2565]: W0706 19:32:45.260246    2565 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 06 19:32:45.267022 ip-10-0-131-168 kubenswrapper[2565]: W0706 19:32:45.260249    2565 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 06 19:32:45.267022 ip-10-0-131-168 kubenswrapper[2565]: W0706 19:32:45.260252    2565 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 06 19:32:45.267022 ip-10-0-131-168 kubenswrapper[2565]: W0706 19:32:45.260255    2565 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 06 19:32:45.267022 ip-10-0-131-168 kubenswrapper[2565]: W0706 19:32:45.260257    2565 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 06 19:32:45.267022 ip-10-0-131-168 kubenswrapper[2565]: W0706 19:32:45.260260    2565 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 06 19:32:45.267022 ip-10-0-131-168 kubenswrapper[2565]: W0706 19:32:45.260263    2565 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 06 19:32:45.267022 ip-10-0-131-168 kubenswrapper[2565]: W0706 19:32:45.260266    2565 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 06 19:32:45.267482 ip-10-0-131-168 kubenswrapper[2565]: W0706 19:32:45.260269    2565 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 06 19:32:45.267482 ip-10-0-131-168 kubenswrapper[2565]: W0706 19:32:45.260271    2565 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 06 19:32:45.267482 ip-10-0-131-168 kubenswrapper[2565]: W0706 19:32:45.260274    2565 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 06 19:32:45.267482 ip-10-0-131-168 kubenswrapper[2565]: W0706 19:32:45.260276    2565 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 06 19:32:45.267482 ip-10-0-131-168 kubenswrapper[2565]: W0706 19:32:45.260280    2565 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 06 19:32:45.267482 ip-10-0-131-168 kubenswrapper[2565]: W0706 19:32:45.260282    2565 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 06 19:32:45.267482 ip-10-0-131-168 kubenswrapper[2565]: W0706 19:32:45.260285    2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 06 19:32:45.267482 ip-10-0-131-168 kubenswrapper[2565]: W0706 19:32:45.260287    2565 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 06 19:32:45.267482 ip-10-0-131-168 kubenswrapper[2565]: W0706 19:32:45.260290    2565 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 06 19:32:45.267482 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:32:45.260294    2565 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 06 19:32:45.267482 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:32:45.260399    2565 server.go:962] "Client rotation is on, will bootstrap in background"
Jul 06 19:32:45.267482 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:32:45.262229    2565 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir"
Jul 06 19:32:45.267482 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:32:45.263352    2565 server.go:1019] "Starting client certificate rotation"
Jul 06 19:32:45.267482 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:32:45.263452    2565 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet"
Jul 06 19:32:45.267845 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:32:45.263488    2565 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet"
Jul 06 19:32:45.267845 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:32:45.265740    2565 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Jul 06 19:32:45.268878 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:32:45.268865    2565 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Jul 06 19:32:45.279583 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:32:45.279567    2565 log.go:25] "Validated CRI v1 runtime API"
Jul 06 19:32:45.281520 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:32:45.281504    2565 log.go:25] "Validated CRI v1 image API"
Jul 06 19:32:45.282833 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:32:45.282807    2565 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd"
Jul 06 19:32:45.285633 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:32:45.285608    2565 fs.go:135] Filesystem UUIDs: map[7B77-95E7:/dev/nvme0n1p2 becf0b00-780b-4732-8bed-22c5e8f7e87a:/dev/nvme0n1p3 d0890b90-e413-4269-95ba-656ed983998a:/dev/nvme0n1p4]
Jul 06 19:32:45.285685 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:32:45.285633    2565 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}]
Jul 06 19:32:45.290840 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:32:45.290712    2565 manager.go:216] Machine: {Timestamp:2026-07-06 19:32:45.290259915 +0000 UTC m=+0.303248595 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3101054 MemoryCapacity:33164492800 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec2719e26a8b195101524a4c7014727c SystemUUID:ec2719e2-6a8b-1951-0152-4a4c7014727c BootID:7f409cb3-3ff3-4ac7-97ee-cb2e18255fd4 Filesystems:[{Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582246400 Type:vfs Inodes:4048400 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632898560 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6107136 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582246400 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:63:8a:73:01:31 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:63:8a:73:01:31 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:a2:ea:7f:f0:0d:09 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164492800 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None}
Jul 06 19:32:45.290840 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:32:45.290832    2565 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available.
Jul 06 19:32:45.290973 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:32:45.290903    2565 manager.go:232] Version: {KernelVersion:5.14.0-570.125.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260630-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:}
Jul 06 19:32:45.292877 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:32:45.292852    2565 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[]
Jul 06 19:32:45.293002 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:32:45.292879    2565 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-131-168.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2}
Jul 06 19:32:45.293980 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:32:45.293967    2565 topology_manager.go:138] "Creating topology manager with none policy"
Jul 06 19:32:45.294022 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:32:45.293983    2565 container_manager_linux.go:309] "Creating device plugin manager"
Jul 06 19:32:45.294022 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:32:45.293990    2565 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock"
Jul 06 19:32:45.294639 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:32:45.294628    2565 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock"
Jul 06 19:32:45.295451 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:32:45.295437    2565 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Jul 06 19:32:45.295760 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:32:45.295749    2565 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager"
Jul 06 19:32:45.298396 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:32:45.298383    2565 state_mem.go:36] "Initialized new in-memory state store"
Jul 06 19:32:45.298505 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:32:45.298496    2565 server.go:1240] "Using root directory" path="/var/lib/kubelet"
Jul 06 19:32:45.298541 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:32:45.298524    2565 kubelet.go:486] "Attempting to sync node with API server"
Jul 06 19:32:45.298541 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:32:45.298534    2565 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests"
Jul 06 19:32:45.298624 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:32:45.298548    2565 file.go:69] "Watching path" path="/etc/kubernetes/manifests"
Jul 06 19:32:45.298624 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:32:45.298558    2565 kubelet.go:398] "Adding apiserver pod source"
Jul 06 19:32:45.298624 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:32:45.298567    2565 apiserver.go:42] "Waiting for node sync before watching apiserver pods"
Jul 06 19:32:45.298914 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:32:45.298901    2565 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Jul 06 19:32:45.298963 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:32:45.298932    2565 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Jul 06 19:32:45.300733 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:32:45.300718    2565 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.8-3.rhaos4.21.git91b4b0b.el9" apiVersion="v1"
Jul 06 19:32:45.302346 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:32:45.302332    2565 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled"
Jul 06 19:32:45.302404 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:32:45.302361    2565 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled"
Jul 06 19:32:45.303358 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:32:45.303346    2565 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume"
Jul 06 19:32:45.303396 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:32:45.303361    2565 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir"
Jul 06 19:32:45.303396 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:32:45.303368    2565 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo"
Jul 06 19:32:45.303396 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:32:45.303373    2565 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path"
Jul 06 19:32:45.303396 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:32:45.303381    2565 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs"
Jul 06 19:32:45.303396 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:32:45.303386    2565 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret"
Jul 06 19:32:45.303396 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:32:45.303398    2565 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi"
Jul 06 19:32:45.303552 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:32:45.303404    2565 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api"
Jul 06 19:32:45.303552 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:32:45.303410    2565 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc"
Jul 06 19:32:45.303552 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:32:45.303415    2565 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap"
Jul 06 19:32:45.303552 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:32:45.303430    2565 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected"
Jul 06 19:32:45.303552 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:32:45.303435    2565 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume"
Jul 06 19:32:45.304050 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:32:45.304034    2565 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi"
Jul 06 19:32:45.304050 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:32:45.304045    2565 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image"
Jul 06 19:32:45.307270 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:32:45.307256    2565 server.go:1268] "Started kubelet"
Jul 06 19:32:45.307402 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:32:45.307355    2565 server.go:180] "Starting to listen" address="0.0.0.0" port=10250
Jul 06 19:32:45.307481 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:32:45.307352    2565 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10
Jul 06 19:32:45.307594 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:32:45.307501    2565 server_v1.go:49] "podresources" method="list" useActivePods=true
Jul 06 19:32:45.308079 ip-10-0-131-168 systemd[1]: Started Kubernetes Kubelet.
Jul 06 19:32:45.308724 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:32:45.308672    2565 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock"
Jul 06 19:32:45.308887 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:32:45.308765    2565 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-131-168.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope
Jul 06 19:32:45.308887 ip-10-0-131-168 kubenswrapper[2565]: E0706 19:32:45.308825    2565 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-131-168.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node"
Jul 06 19:32:45.308887 ip-10-0-131-168 kubenswrapper[2565]: E0706 19:32:45.308864    2565 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service"
Jul 06 19:32:45.309379 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:32:45.309364    2565 server.go:310] "Adding debug handlers to kubelet server"
Jul 06 19:32:45.312069 ip-10-0-131-168 kubenswrapper[2565]: E0706 19:32:45.311273    2565 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-131-168.ec2.internal.18bfca42b4846330  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-131-168.ec2.internal,UID:ip-10-0-131-168.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-131-168.ec2.internal,},FirstTimestamp:2026-07-06 19:32:45.307233072 +0000 UTC m=+0.320221732,LastTimestamp:2026-07-06 19:32:45.307233072 +0000 UTC m=+0.320221732,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-131-168.ec2.internal,}"
Jul 06 19:32:45.312625 ip-10-0-131-168 kubenswrapper[2565]: E0706 19:32:45.312609    2565 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache"
Jul 06 19:32:45.314994 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:32:45.314979    2565 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer"
Jul 06 19:32:45.314994 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:32:45.314991    2565 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving"
Jul 06 19:32:45.315127 ip-10-0-131-168 kubenswrapper[2565]: E0706 19:32:45.315040    2565 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-131-168.ec2.internal\" not found"
Jul 06 19:32:45.316188 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:32:45.316167    2565 desired_state_of_world_populator.go:146] "Desired state populator starts to run"
Jul 06 19:32:45.316188 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:32:45.316168    2565 volume_manager.go:311] "The desired_state_of_world populator starts"
Jul 06 19:32:45.316313 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:32:45.316203    2565 volume_manager.go:313] "Starting Kubelet Volume Manager"
Jul 06 19:32:45.316313 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:32:45.316292    2565 reconstruct.go:97] "Volume reconstruction finished"
Jul 06 19:32:45.316313 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:32:45.316297    2565 reconciler.go:29] "Reconciler: start to sync state"
Jul 06 19:32:45.317413 ip-10-0-131-168 kubenswrapper[2565]: E0706 19:32:45.317390    2565 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-131-168.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms"
Jul 06 19:32:45.317490 ip-10-0-131-168 kubenswrapper[2565]: E0706 19:32:45.317427    2565 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver"
Jul 06 19:32:45.317490 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:32:45.317467    2565 factory.go:55] Registering systemd factory
Jul 06 19:32:45.317490 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:32:45.317478    2565 factory.go:223] Registration of the systemd container factory successfully
Jul 06 19:32:45.317696 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:32:45.317685    2565 factory.go:153] Registering CRI-O factory
Jul 06 19:32:45.317696 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:32:45.317696    2565 factory.go:223] Registration of the crio container factory successfully
Jul 06 19:32:45.317759 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:32:45.317740    2565 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory
Jul 06 19:32:45.317810 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:32:45.317760    2565 factory.go:103] Registering Raw factory
Jul 06 19:32:45.317810 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:32:45.317785    2565 manager.go:1196] Started watching for new ooms in manager
Jul 06 19:32:45.318188 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:32:45.318177    2565 manager.go:349] Starting recovery of all containers
Jul 06 19:32:45.330192 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:32:45.330175    2565 manager.go:354] Recovery completed
Jul 06 19:32:45.332765 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:32:45.332749    2565 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-2bcdk"
Jul 06 19:32:45.334234 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:32:45.334223    2565 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 06 19:32:45.336053 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:32:45.335986    2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-168.ec2.internal" event="NodeHasSufficientMemory"
Jul 06 19:32:45.336053 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:32:45.336022    2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-168.ec2.internal" event="NodeHasNoDiskPressure"
Jul 06 19:32:45.336053 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:32:45.336036    2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-168.ec2.internal" event="NodeHasSufficientPID"
Jul 06 19:32:45.336582 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:32:45.336568    2565 cpu_manager.go:222] "Starting CPU manager" policy="none"
Jul 06 19:32:45.336582 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:32:45.336579    2565 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s"
Jul 06 19:32:45.336669 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:32:45.336593    2565 state_mem.go:36] "Initialized new in-memory state store"
Jul 06 19:32:45.336669 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:32:45.336625    2565 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 06 19:32:45.337325 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:32:45.337310    2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-168.ec2.internal" event="NodeHasSufficientMemory"
Jul 06 19:32:45.337376 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:32:45.337351    2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-168.ec2.internal" event="NodeHasNoDiskPressure"
Jul 06 19:32:45.337376 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:32:45.337366    2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-168.ec2.internal" event="NodeHasSufficientPID"
Jul 06 19:32:45.337886 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:32:45.337821    2565 policy_none.go:49] "None policy: Start"
Jul 06 19:32:45.337886 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:32:45.337836    2565 memory_manager.go:187] "Starting memorymanager" policy="None"
Jul 06 19:32:45.337886 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:32:45.337846    2565 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint"
Jul 06 19:32:45.338840 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:32:45.338830    2565 policy_none.go:47] "Start"
Jul 06 19:32:45.343483 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:32:45.343379    2565 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-2bcdk"
Jul 06 19:32:45.346160 ip-10-0-131-168 kubenswrapper[2565]: E0706 19:32:45.346071    2565 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-131-168.ec2.internal.18bfca42b63b60ce  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-131-168.ec2.internal,UID:ip-10-0-131-168.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-131-168.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-131-168.ec2.internal,},FirstTimestamp:2026-07-06 19:32:45.336002766 +0000 UTC m=+0.348991433,LastTimestamp:2026-07-06 19:32:45.336002766 +0000 UTC m=+0.348991433,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-131-168.ec2.internal,}"
Jul 06 19:32:45.377393 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:32:45.377377    2565 manager.go:337] "Starting Device Plugin manager"
Jul 06 19:32:45.377483 ip-10-0-131-168 kubenswrapper[2565]: E0706 19:32:45.377423    2565 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint"
Jul 06 19:32:45.377483 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:32:45.377437    2565 server.go:87] "Starting device plugin registration server"
Jul 06 19:32:45.377707 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:32:45.377695    2565 eviction_manager.go:189] "Eviction manager: starting control loop"
Jul 06 19:32:45.377751 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:32:45.377719    2565 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s"
Jul 06 19:32:45.377831 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:32:45.377817    2565 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry"
Jul 06 19:32:45.377906 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:32:45.377895    2565 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts"
Jul 06 19:32:45.377952 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:32:45.377920    2565 plugin_manager.go:118] "Starting Kubelet Plugin Manager"
Jul 06 19:32:45.378397 ip-10-0-131-168 kubenswrapper[2565]: E0706 19:32:45.378379    2565 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\""
Jul 06 19:32:45.378456 ip-10-0-131-168 kubenswrapper[2565]: E0706 19:32:45.378433    2565 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-131-168.ec2.internal\" not found"
Jul 06 19:32:45.478333 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:32:45.478260    2565 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 06 19:32:45.479601 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:32:45.479582    2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-168.ec2.internal" event="NodeHasSufficientMemory"
Jul 06 19:32:45.479667 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:32:45.479619    2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-168.ec2.internal" event="NodeHasNoDiskPressure"
Jul 06 19:32:45.479667 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:32:45.479632    2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-168.ec2.internal" event="NodeHasSufficientPID"
Jul 06 19:32:45.479667 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:32:45.479662    2565 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-131-168.ec2.internal"
Jul 06 19:32:45.486970 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:32:45.486930    2565 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4"
Jul 06 19:32:45.487960 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:32:45.487941    2565 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-131-168.ec2.internal"
Jul 06 19:32:45.488042 ip-10-0-131-168 kubenswrapper[2565]: E0706 19:32:45.487972    2565 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-131-168.ec2.internal\": node \"ip-10-0-131-168.ec2.internal\" not found"
Jul 06 19:32:45.488402 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:32:45.488386    2565 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6"
Jul 06 19:32:45.488457 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:32:45.488429    2565 status_manager.go:244] "Starting to sync pod status with apiserver"
Jul 06 19:32:45.488457 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:32:45.488457    2565 kubelet.go:2448] "Starting kubelet main sync loop"
Jul 06 19:32:45.488536 ip-10-0-131-168 kubenswrapper[2565]: E0706 19:32:45.488491    2565 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful"
Jul 06 19:32:45.490532 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:32:45.490509    2565 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 06 19:32:45.538084 ip-10-0-131-168 kubenswrapper[2565]: E0706 19:32:45.538056    2565 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-131-168.ec2.internal\" not found"
Jul 06 19:32:45.589178 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:32:45.589146    2565 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-168.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-131-168.ec2.internal"]
Jul 06 19:32:45.589273 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:32:45.589251    2565 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 06 19:32:45.591452 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:32:45.591439    2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-168.ec2.internal" event="NodeHasSufficientMemory"
Jul 06 19:32:45.591515 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:32:45.591467    2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-168.ec2.internal" event="NodeHasNoDiskPressure"
Jul 06 19:32:45.591515 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:32:45.591477    2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-168.ec2.internal" event="NodeHasSufficientPID"
Jul 06 19:32:45.592710 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:32:45.592697    2565 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 06 19:32:45.592889 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:32:45.592873    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-168.ec2.internal"
Jul 06 19:32:45.592953 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:32:45.592911    2565 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 06 19:32:45.593384 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:32:45.593370    2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-168.ec2.internal" event="NodeHasSufficientMemory"
Jul 06 19:32:45.593453 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:32:45.593395    2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-168.ec2.internal" event="NodeHasNoDiskPressure"
Jul 06 19:32:45.593453 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:32:45.593411    2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-168.ec2.internal" event="NodeHasSufficientPID"
Jul 06 19:32:45.593547 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:32:45.593450    2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-168.ec2.internal" event="NodeHasSufficientMemory"
Jul 06 19:32:45.593547 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:32:45.593475    2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-168.ec2.internal" event="NodeHasNoDiskPressure"
Jul 06 19:32:45.593547 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:32:45.593490    2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-168.ec2.internal" event="NodeHasSufficientPID"
Jul 06 19:32:45.594634 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:32:45.594617    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-131-168.ec2.internal"
Jul 06 19:32:45.594716 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:32:45.594642    2565 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 06 19:32:45.596099 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:32:45.596081    2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-168.ec2.internal" event="NodeHasSufficientMemory"
Jul 06 19:32:45.596184 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:32:45.596113    2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-168.ec2.internal" event="NodeHasNoDiskPressure"
Jul 06 19:32:45.596184 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:32:45.596129    2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-168.ec2.internal" event="NodeHasSufficientPID"
Jul 06 19:32:45.621453 ip-10-0-131-168 kubenswrapper[2565]: E0706 19:32:45.621430    2565 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-131-168.ec2.internal\" not found" node="ip-10-0-131-168.ec2.internal"
Jul 06 19:32:45.625712 ip-10-0-131-168 kubenswrapper[2565]: E0706 19:32:45.625696    2565 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-131-168.ec2.internal\" not found" node="ip-10-0-131-168.ec2.internal"
Jul 06 19:32:45.638284 ip-10-0-131-168 kubenswrapper[2565]: E0706 19:32:45.638267    2565 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-131-168.ec2.internal\" not found"
Jul 06 19:32:45.717728 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:32:45.717698    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/83399c877cd64b0872925a2b56383a00-config\") pod \"kube-apiserver-proxy-ip-10-0-131-168.ec2.internal\" (UID: \"83399c877cd64b0872925a2b56383a00\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-131-168.ec2.internal"
Jul 06 19:32:45.717728 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:32:45.717728    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/a899b324560c7e06c6c5d50af86c2bd8-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-131-168.ec2.internal\" (UID: \"a899b324560c7e06c6c5d50af86c2bd8\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-168.ec2.internal"
Jul 06 19:32:45.717933 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:32:45.717749    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/a899b324560c7e06c6c5d50af86c2bd8-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-131-168.ec2.internal\" (UID: \"a899b324560c7e06c6c5d50af86c2bd8\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-168.ec2.internal"
Jul 06 19:32:45.738901 ip-10-0-131-168 kubenswrapper[2565]: E0706 19:32:45.738830    2565 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-131-168.ec2.internal\" not found"
Jul 06 19:32:45.818562 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:32:45.818518    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/a899b324560c7e06c6c5d50af86c2bd8-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-131-168.ec2.internal\" (UID: \"a899b324560c7e06c6c5d50af86c2bd8\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-168.ec2.internal"
Jul 06 19:32:45.818562 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:32:45.818565    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/83399c877cd64b0872925a2b56383a00-config\") pod \"kube-apiserver-proxy-ip-10-0-131-168.ec2.internal\" (UID: \"83399c877cd64b0872925a2b56383a00\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-131-168.ec2.internal"
Jul 06 19:32:45.818753 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:32:45.818590    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/a899b324560c7e06c6c5d50af86c2bd8-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-131-168.ec2.internal\" (UID: \"a899b324560c7e06c6c5d50af86c2bd8\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-168.ec2.internal"
Jul 06 19:32:45.818753 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:32:45.818630    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/a899b324560c7e06c6c5d50af86c2bd8-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-131-168.ec2.internal\" (UID: \"a899b324560c7e06c6c5d50af86c2bd8\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-168.ec2.internal"
Jul 06 19:32:45.818753 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:32:45.818633    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/83399c877cd64b0872925a2b56383a00-config\") pod \"kube-apiserver-proxy-ip-10-0-131-168.ec2.internal\" (UID: \"83399c877cd64b0872925a2b56383a00\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-131-168.ec2.internal"
Jul 06 19:32:45.818753 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:32:45.818630    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/a899b324560c7e06c6c5d50af86c2bd8-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-131-168.ec2.internal\" (UID: \"a899b324560c7e06c6c5d50af86c2bd8\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-168.ec2.internal"
Jul 06 19:32:45.839632 ip-10-0-131-168 kubenswrapper[2565]: E0706 19:32:45.839609    2565 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-131-168.ec2.internal\" not found"
Jul 06 19:32:45.925174 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:32:45.925142    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-168.ec2.internal"
Jul 06 19:32:45.929588 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:32:45.928830    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-131-168.ec2.internal"
Jul 06 19:32:45.940106 ip-10-0-131-168 kubenswrapper[2565]: E0706 19:32:45.940087    2565 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-131-168.ec2.internal\" not found"
Jul 06 19:32:46.040640 ip-10-0-131-168 kubenswrapper[2565]: E0706 19:32:46.040554    2565 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-131-168.ec2.internal\" not found"
Jul 06 19:32:46.132541 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:32:46.132513    2565 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 06 19:32:46.141620 ip-10-0-131-168 kubenswrapper[2565]: E0706 19:32:46.141593    2565 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-131-168.ec2.internal\" not found"
Jul 06 19:32:46.232933 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:32:46.232902    2565 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 06 19:32:46.262976 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:32:46.262956    2565 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials"
Jul 06 19:32:46.263382 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:32:46.263076    2565 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
Jul 06 19:32:46.263382 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:32:46.263113    2565 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
Jul 06 19:32:46.263382 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:32:46.263120    2565 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
Jul 06 19:32:46.299372 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:32:46.299286    2565 apiserver.go:52] "Watching apiserver"
Jul 06 19:32:46.315753 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:32:46.315730    2565 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-168.ec2.internal"
Jul 06 19:32:46.315881 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:32:46.315760    2565 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving"
Jul 06 19:32:46.317114 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:32:46.317099    2565 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66"
Jul 06 19:32:46.318183 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:32:46.318166    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jrxrv","openshift-image-registry/node-ca-cblv9","openshift-multus/multus-additional-cni-plugins-cjmdl","openshift-multus/multus-sk9vq","openshift-ovn-kubernetes/ovnkube-node-8kjqk","kube-system/global-pull-secret-syncer-2rdm6","kube-system/konnectivity-agent-xjxq2","openshift-cluster-node-tuning-operator/tuned-jf9t9","openshift-dns/node-resolver-kx6hd","openshift-multus/network-metrics-daemon-9lc4r","openshift-network-diagnostics/network-check-target-pc8fq","openshift-network-operator/iptables-alerter-bp6sh"]
Jul 06 19:32:46.319622 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:32:46.319606    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jrxrv"
Jul 06 19:32:46.320811 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:32:46.320790    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-cblv9"
Jul 06 19:32:46.322555 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:32:46.322538    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\""
Jul 06 19:32:46.322814 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:32:46.322800    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-cjmdl"
Jul 06 19:32:46.323082 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:32:46.323054    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\""
Jul 06 19:32:46.323174 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:32:46.323135    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-99zhn\""
Jul 06 19:32:46.323174 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:32:46.323169    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\""
Jul 06 19:32:46.323855 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:32:46.323723    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\""
Jul 06 19:32:46.323855 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:32:46.323744    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\""
Jul 06 19:32:46.323855 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:32:46.323763    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\""
Jul 06 19:32:46.323855 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:32:46.323803    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-p5h58\""
Jul 06 19:32:46.324092 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:32:46.323989    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-sk9vq"
Jul 06 19:32:46.325252 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:32:46.325236    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\""
Jul 06 19:32:46.325536 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:32:46.325514    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\""
Jul 06 19:32:46.325599 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:32:46.325584    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\""
Jul 06 19:32:46.325637 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:32:46.325600    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\""
Jul 06 19:32:46.325686 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:32:46.325644    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-9tzwk\""
Jul 06 19:32:46.325758 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:32:46.325739    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-8kjqk"
Jul 06 19:32:46.326032 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:32:46.325947    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\""
Jul 06 19:32:46.326757 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:32:46.326726    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-658z8\""
Jul 06 19:32:46.326855 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:32:46.326747    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\""
Jul 06 19:32:46.326977 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:32:46.326964    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-2rdm6"
Jul 06 19:32:46.327036 ip-10-0-131-168 kubenswrapper[2565]: E0706 19:32:46.327017    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-2rdm6" podUID="67af2b66-be49-4b61-a200-b711f4d83397"
Jul 06 19:32:46.328416 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:32:46.328401    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-xjxq2"
Jul 06 19:32:46.328907 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:32:46.328893    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\""
Jul 06 19:32:46.329018 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:32:46.328896    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\""
Jul 06 19:32:46.329309 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:32:46.329292    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\""
Jul 06 19:32:46.330025 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:32:46.330010    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-jf9t9"
Jul 06 19:32:46.330672 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:32:46.330357    2565 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Jul 06 19:32:46.330672 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:32:46.330506    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\""
Jul 06 19:32:46.330672 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:32:46.330535    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\""
Jul 06 19:32:46.330672 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:32:46.330535    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-7rn44\""
Jul 06 19:32:46.330672 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:32:46.330572    2565 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-131-168.ec2.internal"
Jul 06 19:32:46.330672 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:32:46.330507    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\""
Jul 06 19:32:46.331878 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:32:46.331839    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\""
Jul 06 19:32:46.332033 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:32:46.332006    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-dx8c6\""
Jul 06 19:32:46.332253 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:32:46.332187    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\""
Jul 06 19:32:46.334188 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:32:46.332961    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-kx6hd"
Jul 06 19:32:46.334188 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:32:46.333510    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\""
Jul 06 19:32:46.334188 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:32:46.333638    2565 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Jul 06 19:32:46.334188 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:32:46.333698    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-ft7qs\""
Jul 06 19:32:46.334923 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:32:46.334592    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\""
Jul 06 19:32:46.335614 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:32:46.335596    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\""
Jul 06 19:32:46.336037 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:32:46.336021    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-9lc4r"
Jul 06 19:32:46.336124 ip-10-0-131-168 kubenswrapper[2565]: E0706 19:32:46.336095    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-9lc4r" podUID="0657d2af-82f5-428a-ba3e-fe3df6d74f8b"
Jul 06 19:32:46.336342 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:32:46.336327    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-7fwsv\""
Jul 06 19:32:46.336764 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:32:46.336744    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\""
Jul 06 19:32:46.337731 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:32:46.337710    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-pc8fq"
Jul 06 19:32:46.337846 ip-10-0-131-168 kubenswrapper[2565]: E0706 19:32:46.337825    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-pc8fq" podUID="1cda8348-291c-4665-99e9-892c67fb326d"
Jul 06 19:32:46.339590 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:32:46.339575    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-168.ec2.internal"]
Jul 06 19:32:46.339708 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:32:46.339640    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-bp6sh"
Jul 06 19:32:46.341107 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:32:46.341092    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kube-system/kube-apiserver-proxy-ip-10-0-131-168.ec2.internal"]
Jul 06 19:32:46.341359 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:32:46.341347    2565 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Jul 06 19:32:46.342460 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:32:46.342447    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-9j9dv\""
Jul 06 19:32:46.342509 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:32:46.342451    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\""
Jul 06 19:32:46.342650 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:32:46.342637    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\""
Jul 06 19:32:46.342710 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:32:46.342694    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\""
Jul 06 19:32:46.346299 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:32:46.346263    2565 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-07-05 19:27:45 +0000 UTC" deadline="2028-01-21 13:49:00.341237297 +0000 UTC"
Jul 06 19:32:46.346299 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:32:46.346297    2565 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="13530h16m13.994942248s"
Jul 06 19:32:46.358763 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:32:46.358745    2565 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-mftvd"
Jul 06 19:32:46.365106 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:32:46.365088    2565 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-mftvd"
Jul 06 19:32:46.417146 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:32:46.417122    2565 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world"
Jul 06 19:32:46.421008 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:32:46.420985    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/c6148c24-bfbd-4b4f-a4a8-774705b763bd-host-slash\") pod \"iptables-alerter-bp6sh\" (UID: \"c6148c24-bfbd-4b4f-a4a8-774705b763bd\") " pod="openshift-network-operator/iptables-alerter-bp6sh"
Jul 06 19:32:46.421112 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:32:46.421022    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4cmz8\" (UniqueName: \"kubernetes.io/projected/9449cdae-9fc6-4f64-a88a-db3f2e08b626-kube-api-access-4cmz8\") pod \"multus-additional-cni-plugins-cjmdl\" (UID: \"9449cdae-9fc6-4f64-a88a-db3f2e08b626\") " pod="openshift-multus/multus-additional-cni-plugins-cjmdl"
Jul 06 19:32:46.421112 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:32:46.421047    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/549d1922-a406-419b-a750-b7344fc1b9b8-etc-sysctl-d\") pod \"tuned-jf9t9\" (UID: \"549d1922-a406-419b-a750-b7344fc1b9b8\") " pod="openshift-cluster-node-tuning-operator/tuned-jf9t9"
Jul 06 19:32:46.421112 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:32:46.421071    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/9f15114d-7494-4f17-8a4d-52185f7a2e35-host-cni-bin\") pod \"ovnkube-node-8kjqk\" (UID: \"9f15114d-7494-4f17-8a4d-52185f7a2e35\") " pod="openshift-ovn-kubernetes/ovnkube-node-8kjqk"
Jul 06 19:32:46.421112 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:32:46.421094    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/9449cdae-9fc6-4f64-a88a-db3f2e08b626-system-cni-dir\") pod \"multus-additional-cni-plugins-cjmdl\" (UID: \"9449cdae-9fc6-4f64-a88a-db3f2e08b626\") " pod="openshift-multus/multus-additional-cni-plugins-cjmdl"
Jul 06 19:32:46.421290 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:32:46.421127    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/9449cdae-9fc6-4f64-a88a-db3f2e08b626-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-cjmdl\" (UID: \"9449cdae-9fc6-4f64-a88a-db3f2e08b626\") " pod="openshift-multus/multus-additional-cni-plugins-cjmdl"
Jul 06 19:32:46.421290 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:32:46.421171    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/48a862e8-66cd-4899-8cd4-9a48ef610bd3-host-var-lib-kubelet\") pod \"multus-sk9vq\" (UID: \"48a862e8-66cd-4899-8cd4-9a48ef610bd3\") " pod="openshift-multus/multus-sk9vq"
Jul 06 19:32:46.421290 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:32:46.421211    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/549d1922-a406-419b-a750-b7344fc1b9b8-var-lib-kubelet\") pod \"tuned-jf9t9\" (UID: \"549d1922-a406-419b-a750-b7344fc1b9b8\") " pod="openshift-cluster-node-tuning-operator/tuned-jf9t9"
Jul 06 19:32:46.421290 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:32:46.421246    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/549d1922-a406-419b-a750-b7344fc1b9b8-host\") pod \"tuned-jf9t9\" (UID: \"549d1922-a406-419b-a750-b7344fc1b9b8\") " pod="openshift-cluster-node-tuning-operator/tuned-jf9t9"
Jul 06 19:32:46.421456 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:32:46.421281    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/ef7753ea-b0a6-45e3-8e20-6a93bc9d1f76-kubelet-dir\") pod \"aws-ebs-csi-driver-node-jrxrv\" (UID: \"ef7753ea-b0a6-45e3-8e20-6a93bc9d1f76\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jrxrv"
Jul 06 19:32:46.421456 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:32:46.421333    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/9f15114d-7494-4f17-8a4d-52185f7a2e35-run-ovn\") pod \"ovnkube-node-8kjqk\" (UID: \"9f15114d-7494-4f17-8a4d-52185f7a2e35\") " pod="openshift-ovn-kubernetes/ovnkube-node-8kjqk"
Jul 06 19:32:46.421456 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:32:46.421359    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/9449cdae-9fc6-4f64-a88a-db3f2e08b626-cni-binary-copy\") pod \"multus-additional-cni-plugins-cjmdl\" (UID: \"9449cdae-9fc6-4f64-a88a-db3f2e08b626\") " pod="openshift-multus/multus-additional-cni-plugins-cjmdl"
Jul 06 19:32:46.421456 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:32:46.421394    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/48a862e8-66cd-4899-8cd4-9a48ef610bd3-host-run-k8s-cni-cncf-io\") pod \"multus-sk9vq\" (UID: \"48a862e8-66cd-4899-8cd4-9a48ef610bd3\") " pod="openshift-multus/multus-sk9vq"
Jul 06 19:32:46.421456 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:32:46.421415    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/549d1922-a406-419b-a750-b7344fc1b9b8-run\") pod \"tuned-jf9t9\" (UID: \"549d1922-a406-419b-a750-b7344fc1b9b8\") " pod="openshift-cluster-node-tuning-operator/tuned-jf9t9"
Jul 06 19:32:46.421456 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:32:46.421431    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6wvnd\" (UniqueName: \"kubernetes.io/projected/549d1922-a406-419b-a750-b7344fc1b9b8-kube-api-access-6wvnd\") pod \"tuned-jf9t9\" (UID: \"549d1922-a406-419b-a750-b7344fc1b9b8\") " pod="openshift-cluster-node-tuning-operator/tuned-jf9t9"
Jul 06 19:32:46.421456 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:32:46.421446    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/0ecbe788-9e2c-446a-b154-7b805f3983dd-hosts-file\") pod \"node-resolver-kx6hd\" (UID: \"0ecbe788-9e2c-446a-b154-7b805f3983dd\") " pod="openshift-dns/node-resolver-kx6hd"
Jul 06 19:32:46.421700 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:32:46.421464    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5bwm6\" (UniqueName: \"kubernetes.io/projected/35683ef3-3b68-4694-acaf-aaee8f598255-kube-api-access-5bwm6\") pod \"node-ca-cblv9\" (UID: \"35683ef3-3b68-4694-acaf-aaee8f598255\") " pod="openshift-image-registry/node-ca-cblv9"
Jul 06 19:32:46.421700 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:32:46.421482    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/9f15114d-7494-4f17-8a4d-52185f7a2e35-env-overrides\") pod \"ovnkube-node-8kjqk\" (UID: \"9f15114d-7494-4f17-8a4d-52185f7a2e35\") " pod="openshift-ovn-kubernetes/ovnkube-node-8kjqk"
Jul 06 19:32:46.421700 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:32:46.421496    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/9449cdae-9fc6-4f64-a88a-db3f2e08b626-tuning-conf-dir\") pod \"multus-additional-cni-plugins-cjmdl\" (UID: \"9449cdae-9fc6-4f64-a88a-db3f2e08b626\") " pod="openshift-multus/multus-additional-cni-plugins-cjmdl"
Jul 06 19:32:46.421700 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:32:46.421516    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/9449cdae-9fc6-4f64-a88a-db3f2e08b626-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-cjmdl\" (UID: \"9449cdae-9fc6-4f64-a88a-db3f2e08b626\") " pod="openshift-multus/multus-additional-cni-plugins-cjmdl"
Jul 06 19:32:46.421700 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:32:46.421541    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/48a862e8-66cd-4899-8cd4-9a48ef610bd3-etc-kubernetes\") pod \"multus-sk9vq\" (UID: \"48a862e8-66cd-4899-8cd4-9a48ef610bd3\") " pod="openshift-multus/multus-sk9vq"
Jul 06 19:32:46.421700 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:32:46.421557    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/549d1922-a406-419b-a750-b7344fc1b9b8-etc-sysconfig\") pod \"tuned-jf9t9\" (UID: \"549d1922-a406-419b-a750-b7344fc1b9b8\") " pod="openshift-cluster-node-tuning-operator/tuned-jf9t9"
Jul 06 19:32:46.421700 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:32:46.421577    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/35683ef3-3b68-4694-acaf-aaee8f598255-serviceca\") pod \"node-ca-cblv9\" (UID: \"35683ef3-3b68-4694-acaf-aaee8f598255\") " pod="openshift-image-registry/node-ca-cblv9"
Jul 06 19:32:46.421700 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:32:46.421599    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/9f15114d-7494-4f17-8a4d-52185f7a2e35-run-openvswitch\") pod \"ovnkube-node-8kjqk\" (UID: \"9f15114d-7494-4f17-8a4d-52185f7a2e35\") " pod="openshift-ovn-kubernetes/ovnkube-node-8kjqk"
Jul 06 19:32:46.421700 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:32:46.421618    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/9f15114d-7494-4f17-8a4d-52185f7a2e35-ovnkube-script-lib\") pod \"ovnkube-node-8kjqk\" (UID: \"9f15114d-7494-4f17-8a4d-52185f7a2e35\") " pod="openshift-ovn-kubernetes/ovnkube-node-8kjqk"
Jul 06 19:32:46.421700 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:32:46.421634    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0657d2af-82f5-428a-ba3e-fe3df6d74f8b-metrics-certs\") pod \"network-metrics-daemon-9lc4r\" (UID: \"0657d2af-82f5-428a-ba3e-fe3df6d74f8b\") " pod="openshift-multus/network-metrics-daemon-9lc4r"
Jul 06 19:32:46.421700 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:32:46.421649    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/549d1922-a406-419b-a750-b7344fc1b9b8-sys\") pod \"tuned-jf9t9\" (UID: \"549d1922-a406-419b-a750-b7344fc1b9b8\") " pod="openshift-cluster-node-tuning-operator/tuned-jf9t9"
Jul 06 19:32:46.421700 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:32:46.421681    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-td4tw\" (UniqueName: \"kubernetes.io/projected/0ecbe788-9e2c-446a-b154-7b805f3983dd-kube-api-access-td4tw\") pod \"node-resolver-kx6hd\" (UID: \"0ecbe788-9e2c-446a-b154-7b805f3983dd\") " pod="openshift-dns/node-resolver-kx6hd"
Jul 06 19:32:46.422235 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:32:46.421720    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/9f15114d-7494-4f17-8a4d-52185f7a2e35-host-kubelet\") pod \"ovnkube-node-8kjqk\" (UID: \"9f15114d-7494-4f17-8a4d-52185f7a2e35\") " pod="openshift-ovn-kubernetes/ovnkube-node-8kjqk"
Jul 06 19:32:46.422235 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:32:46.421757    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/9f15114d-7494-4f17-8a4d-52185f7a2e35-systemd-units\") pod \"ovnkube-node-8kjqk\" (UID: \"9f15114d-7494-4f17-8a4d-52185f7a2e35\") " pod="openshift-ovn-kubernetes/ovnkube-node-8kjqk"
Jul 06 19:32:46.422235 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:32:46.421799    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/48a862e8-66cd-4899-8cd4-9a48ef610bd3-cni-binary-copy\") pod \"multus-sk9vq\" (UID: \"48a862e8-66cd-4899-8cd4-9a48ef610bd3\") " pod="openshift-multus/multus-sk9vq"
Jul 06 19:32:46.422235 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:32:46.421824    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/c7ddad9c-87f6-4618-b060-800e803d39c1-konnectivity-ca\") pod \"konnectivity-agent-xjxq2\" (UID: \"c7ddad9c-87f6-4618-b060-800e803d39c1\") " pod="kube-system/konnectivity-agent-xjxq2"
Jul 06 19:32:46.422235 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:32:46.421851    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/549d1922-a406-419b-a750-b7344fc1b9b8-etc-modprobe-d\") pod \"tuned-jf9t9\" (UID: \"549d1922-a406-419b-a750-b7344fc1b9b8\") " pod="openshift-cluster-node-tuning-operator/tuned-jf9t9"
Jul 06 19:32:46.422235 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:32:46.421876    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/c6148c24-bfbd-4b4f-a4a8-774705b763bd-iptables-alerter-script\") pod \"iptables-alerter-bp6sh\" (UID: \"c6148c24-bfbd-4b4f-a4a8-774705b763bd\") " pod="openshift-network-operator/iptables-alerter-bp6sh"
Jul 06 19:32:46.422235 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:32:46.421892    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/9449cdae-9fc6-4f64-a88a-db3f2e08b626-cnibin\") pod \"multus-additional-cni-plugins-cjmdl\" (UID: \"9449cdae-9fc6-4f64-a88a-db3f2e08b626\") " pod="openshift-multus/multus-additional-cni-plugins-cjmdl"
Jul 06 19:32:46.422235 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:32:46.421923    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/48a862e8-66cd-4899-8cd4-9a48ef610bd3-multus-conf-dir\") pod \"multus-sk9vq\" (UID: \"48a862e8-66cd-4899-8cd4-9a48ef610bd3\") " pod="openshift-multus/multus-sk9vq"
Jul 06 19:32:46.422235 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:32:46.421960    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/c7ddad9c-87f6-4618-b060-800e803d39c1-agent-certs\") pod \"konnectivity-agent-xjxq2\" (UID: \"c7ddad9c-87f6-4618-b060-800e803d39c1\") " pod="kube-system/konnectivity-agent-xjxq2"
Jul 06 19:32:46.422235 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:32:46.422008    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/549d1922-a406-419b-a750-b7344fc1b9b8-etc-tuned\") pod \"tuned-jf9t9\" (UID: \"549d1922-a406-419b-a750-b7344fc1b9b8\") " pod="openshift-cluster-node-tuning-operator/tuned-jf9t9"
Jul 06 19:32:46.422235 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:32:46.422034    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/ef7753ea-b0a6-45e3-8e20-6a93bc9d1f76-socket-dir\") pod \"aws-ebs-csi-driver-node-jrxrv\" (UID: \"ef7753ea-b0a6-45e3-8e20-6a93bc9d1f76\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jrxrv"
Jul 06 19:32:46.422235 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:32:46.422060    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hs6bh\" (UniqueName: \"kubernetes.io/projected/ef7753ea-b0a6-45e3-8e20-6a93bc9d1f76-kube-api-access-hs6bh\") pod \"aws-ebs-csi-driver-node-jrxrv\" (UID: \"ef7753ea-b0a6-45e3-8e20-6a93bc9d1f76\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jrxrv"
Jul 06 19:32:46.422235 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:32:46.422084    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/9f15114d-7494-4f17-8a4d-52185f7a2e35-node-log\") pod \"ovnkube-node-8kjqk\" (UID: \"9f15114d-7494-4f17-8a4d-52185f7a2e35\") " pod="openshift-ovn-kubernetes/ovnkube-node-8kjqk"
Jul 06 19:32:46.422235 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:32:46.422106    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/9f15114d-7494-4f17-8a4d-52185f7a2e35-ovnkube-config\") pod \"ovnkube-node-8kjqk\" (UID: \"9f15114d-7494-4f17-8a4d-52185f7a2e35\") " pod="openshift-ovn-kubernetes/ovnkube-node-8kjqk"
Jul 06 19:32:46.422235 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:32:46.422136    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/48a862e8-66cd-4899-8cd4-9a48ef610bd3-cnibin\") pod \"multus-sk9vq\" (UID: \"48a862e8-66cd-4899-8cd4-9a48ef610bd3\") " pod="openshift-multus/multus-sk9vq"
Jul 06 19:32:46.422235 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:32:46.422157    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/549d1922-a406-419b-a750-b7344fc1b9b8-lib-modules\") pod \"tuned-jf9t9\" (UID: \"549d1922-a406-419b-a750-b7344fc1b9b8\") " pod="openshift-cluster-node-tuning-operator/tuned-jf9t9"
Jul 06 19:32:46.422835 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:32:46.422180    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/9f15114d-7494-4f17-8a4d-52185f7a2e35-var-lib-openvswitch\") pod \"ovnkube-node-8kjqk\" (UID: \"9f15114d-7494-4f17-8a4d-52185f7a2e35\") " pod="openshift-ovn-kubernetes/ovnkube-node-8kjqk"
Jul 06 19:32:46.422835 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:32:46.422205    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/48a862e8-66cd-4899-8cd4-9a48ef610bd3-multus-socket-dir-parent\") pod \"multus-sk9vq\" (UID: \"48a862e8-66cd-4899-8cd4-9a48ef610bd3\") " pod="openshift-multus/multus-sk9vq"
Jul 06 19:32:46.422835 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:32:46.422227    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/48a862e8-66cd-4899-8cd4-9a48ef610bd3-hostroot\") pod \"multus-sk9vq\" (UID: \"48a862e8-66cd-4899-8cd4-9a48ef610bd3\") " pod="openshift-multus/multus-sk9vq"
Jul 06 19:32:46.422835 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:32:46.422247    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/549d1922-a406-419b-a750-b7344fc1b9b8-tmp\") pod \"tuned-jf9t9\" (UID: \"549d1922-a406-419b-a750-b7344fc1b9b8\") " pod="openshift-cluster-node-tuning-operator/tuned-jf9t9"
Jul 06 19:32:46.422835 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:32:46.422272    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/9f15114d-7494-4f17-8a4d-52185f7a2e35-etc-openvswitch\") pod \"ovnkube-node-8kjqk\" (UID: \"9f15114d-7494-4f17-8a4d-52185f7a2e35\") " pod="openshift-ovn-kubernetes/ovnkube-node-8kjqk"
Jul 06 19:32:46.422835 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:32:46.422296    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/9f15114d-7494-4f17-8a4d-52185f7a2e35-ovn-node-metrics-cert\") pod \"ovnkube-node-8kjqk\" (UID: \"9f15114d-7494-4f17-8a4d-52185f7a2e35\") " pod="openshift-ovn-kubernetes/ovnkube-node-8kjqk"
Jul 06 19:32:46.422835 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:32:46.422318    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/9f15114d-7494-4f17-8a4d-52185f7a2e35-host-run-netns\") pod \"ovnkube-node-8kjqk\" (UID: \"9f15114d-7494-4f17-8a4d-52185f7a2e35\") " pod="openshift-ovn-kubernetes/ovnkube-node-8kjqk"
Jul 06 19:32:46.422835 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:32:46.422341    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/9f15114d-7494-4f17-8a4d-52185f7a2e35-host-run-ovn-kubernetes\") pod \"ovnkube-node-8kjqk\" (UID: \"9f15114d-7494-4f17-8a4d-52185f7a2e35\") " pod="openshift-ovn-kubernetes/ovnkube-node-8kjqk"
Jul 06 19:32:46.422835 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:32:46.422378    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/9f15114d-7494-4f17-8a4d-52185f7a2e35-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-8kjqk\" (UID: \"9f15114d-7494-4f17-8a4d-52185f7a2e35\") " pod="openshift-ovn-kubernetes/ovnkube-node-8kjqk"
Jul 06 19:32:46.422835 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:32:46.422404    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gngg2\" (UniqueName: \"kubernetes.io/projected/9f15114d-7494-4f17-8a4d-52185f7a2e35-kube-api-access-gngg2\") pod \"ovnkube-node-8kjqk\" (UID: \"9f15114d-7494-4f17-8a4d-52185f7a2e35\") " pod="openshift-ovn-kubernetes/ovnkube-node-8kjqk"
Jul 06 19:32:46.422835 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:32:46.422434    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/9449cdae-9fc6-4f64-a88a-db3f2e08b626-os-release\") pod \"multus-additional-cni-plugins-cjmdl\" (UID: \"9449cdae-9fc6-4f64-a88a-db3f2e08b626\") " pod="openshift-multus/multus-additional-cni-plugins-cjmdl"
Jul 06 19:32:46.422835 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:32:46.422457    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/549d1922-a406-419b-a750-b7344fc1b9b8-etc-kubernetes\") pod \"tuned-jf9t9\" (UID: \"549d1922-a406-419b-a750-b7344fc1b9b8\") " pod="openshift-cluster-node-tuning-operator/tuned-jf9t9"
Jul 06 19:32:46.422835 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:32:46.422494    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/549d1922-a406-419b-a750-b7344fc1b9b8-etc-sysctl-conf\") pod \"tuned-jf9t9\" (UID: \"549d1922-a406-419b-a750-b7344fc1b9b8\") " pod="openshift-cluster-node-tuning-operator/tuned-jf9t9"
Jul 06 19:32:46.422835 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:32:46.422512    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/9f15114d-7494-4f17-8a4d-52185f7a2e35-host-slash\") pod \"ovnkube-node-8kjqk\" (UID: \"9f15114d-7494-4f17-8a4d-52185f7a2e35\") " pod="openshift-ovn-kubernetes/ovnkube-node-8kjqk"
Jul 06 19:32:46.422835 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:32:46.422539    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bhj6j\" (UniqueName: \"kubernetes.io/projected/1cda8348-291c-4665-99e9-892c67fb326d-kube-api-access-bhj6j\") pod \"network-check-target-pc8fq\" (UID: \"1cda8348-291c-4665-99e9-892c67fb326d\") " pod="openshift-network-diagnostics/network-check-target-pc8fq"
Jul 06 19:32:46.422835 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:32:46.422571    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/48a862e8-66cd-4899-8cd4-9a48ef610bd3-os-release\") pod \"multus-sk9vq\" (UID: \"48a862e8-66cd-4899-8cd4-9a48ef610bd3\") " pod="openshift-multus/multus-sk9vq"
Jul 06 19:32:46.423337 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:32:46.422598    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/67af2b66-be49-4b61-a200-b711f4d83397-dbus\") pod \"global-pull-secret-syncer-2rdm6\" (UID: \"67af2b66-be49-4b61-a200-b711f4d83397\") " pod="kube-system/global-pull-secret-syncer-2rdm6"
Jul 06 19:32:46.423337 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:32:46.422615    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/67af2b66-be49-4b61-a200-b711f4d83397-original-pull-secret\") pod \"global-pull-secret-syncer-2rdm6\" (UID: \"67af2b66-be49-4b61-a200-b711f4d83397\") " pod="kube-system/global-pull-secret-syncer-2rdm6"
Jul 06 19:32:46.423337 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:32:46.422629    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/ef7753ea-b0a6-45e3-8e20-6a93bc9d1f76-sys-fs\") pod \"aws-ebs-csi-driver-node-jrxrv\" (UID: \"ef7753ea-b0a6-45e3-8e20-6a93bc9d1f76\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jrxrv"
Jul 06 19:32:46.423337 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:32:46.422643    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/35683ef3-3b68-4694-acaf-aaee8f598255-host\") pod \"node-ca-cblv9\" (UID: \"35683ef3-3b68-4694-acaf-aaee8f598255\") " pod="openshift-image-registry/node-ca-cblv9"
Jul 06 19:32:46.423337 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:32:46.422656    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/48a862e8-66cd-4899-8cd4-9a48ef610bd3-host-var-lib-cni-multus\") pod \"multus-sk9vq\" (UID: \"48a862e8-66cd-4899-8cd4-9a48ef610bd3\") " pod="openshift-multus/multus-sk9vq"
Jul 06 19:32:46.423337 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:32:46.422687    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fvw7c\" (UniqueName: \"kubernetes.io/projected/48a862e8-66cd-4899-8cd4-9a48ef610bd3-kube-api-access-fvw7c\") pod \"multus-sk9vq\" (UID: \"48a862e8-66cd-4899-8cd4-9a48ef610bd3\") " pod="openshift-multus/multus-sk9vq"
Jul 06 19:32:46.423337 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:32:46.422715    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/9f15114d-7494-4f17-8a4d-52185f7a2e35-run-systemd\") pod \"ovnkube-node-8kjqk\" (UID: \"9f15114d-7494-4f17-8a4d-52185f7a2e35\") " pod="openshift-ovn-kubernetes/ovnkube-node-8kjqk"
Jul 06 19:32:46.423337 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:32:46.422732    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/48a862e8-66cd-4899-8cd4-9a48ef610bd3-host-var-lib-cni-bin\") pod \"multus-sk9vq\" (UID: \"48a862e8-66cd-4899-8cd4-9a48ef610bd3\") " pod="openshift-multus/multus-sk9vq"
Jul 06 19:32:46.423337 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:32:46.422752    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/48a862e8-66cd-4899-8cd4-9a48ef610bd3-multus-daemon-config\") pod \"multus-sk9vq\" (UID: \"48a862e8-66cd-4899-8cd4-9a48ef610bd3\") " pod="openshift-multus/multus-sk9vq"
Jul 06 19:32:46.423337 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:32:46.422785    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/67af2b66-be49-4b61-a200-b711f4d83397-kubelet-config\") pod \"global-pull-secret-syncer-2rdm6\" (UID: \"67af2b66-be49-4b61-a200-b711f4d83397\") " pod="kube-system/global-pull-secret-syncer-2rdm6"
Jul 06 19:32:46.423337 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:32:46.422805    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/9f15114d-7494-4f17-8a4d-52185f7a2e35-log-socket\") pod \"ovnkube-node-8kjqk\" (UID: \"9f15114d-7494-4f17-8a4d-52185f7a2e35\") " pod="openshift-ovn-kubernetes/ovnkube-node-8kjqk"
Jul 06 19:32:46.423337 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:32:46.422830    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kk247\" (UniqueName: \"kubernetes.io/projected/c6148c24-bfbd-4b4f-a4a8-774705b763bd-kube-api-access-kk247\") pod \"iptables-alerter-bp6sh\" (UID: \"c6148c24-bfbd-4b4f-a4a8-774705b763bd\") " pod="openshift-network-operator/iptables-alerter-bp6sh"
Jul 06 19:32:46.423337 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:32:46.422862    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/48a862e8-66cd-4899-8cd4-9a48ef610bd3-system-cni-dir\") pod \"multus-sk9vq\" (UID: \"48a862e8-66cd-4899-8cd4-9a48ef610bd3\") " pod="openshift-multus/multus-sk9vq"
Jul 06 19:32:46.423337 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:32:46.422886    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/48a862e8-66cd-4899-8cd4-9a48ef610bd3-host-run-netns\") pod \"multus-sk9vq\" (UID: \"48a862e8-66cd-4899-8cd4-9a48ef610bd3\") " pod="openshift-multus/multus-sk9vq"
Jul 06 19:32:46.423337 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:32:46.422909    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/0ecbe788-9e2c-446a-b154-7b805f3983dd-tmp-dir\") pod \"node-resolver-kx6hd\" (UID: \"0ecbe788-9e2c-446a-b154-7b805f3983dd\") " pod="openshift-dns/node-resolver-kx6hd"
Jul 06 19:32:46.423337 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:32:46.422932    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/ef7753ea-b0a6-45e3-8e20-6a93bc9d1f76-registration-dir\") pod \"aws-ebs-csi-driver-node-jrxrv\" (UID: \"ef7753ea-b0a6-45e3-8e20-6a93bc9d1f76\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jrxrv"
Jul 06 19:32:46.423844 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:32:46.422953    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/ef7753ea-b0a6-45e3-8e20-6a93bc9d1f76-device-dir\") pod \"aws-ebs-csi-driver-node-jrxrv\" (UID: \"ef7753ea-b0a6-45e3-8e20-6a93bc9d1f76\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jrxrv"
Jul 06 19:32:46.423844 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:32:46.422974    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/ef7753ea-b0a6-45e3-8e20-6a93bc9d1f76-etc-selinux\") pod \"aws-ebs-csi-driver-node-jrxrv\" (UID: \"ef7753ea-b0a6-45e3-8e20-6a93bc9d1f76\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jrxrv"
Jul 06 19:32:46.423844 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:32:46.422994    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/9f15114d-7494-4f17-8a4d-52185f7a2e35-host-cni-netd\") pod \"ovnkube-node-8kjqk\" (UID: \"9f15114d-7494-4f17-8a4d-52185f7a2e35\") " pod="openshift-ovn-kubernetes/ovnkube-node-8kjqk"
Jul 06 19:32:46.423844 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:32:46.423015    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-p692c\" (UniqueName: \"kubernetes.io/projected/0657d2af-82f5-428a-ba3e-fe3df6d74f8b-kube-api-access-p692c\") pod \"network-metrics-daemon-9lc4r\" (UID: \"0657d2af-82f5-428a-ba3e-fe3df6d74f8b\") " pod="openshift-multus/network-metrics-daemon-9lc4r"
Jul 06 19:32:46.423844 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:32:46.423035    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/48a862e8-66cd-4899-8cd4-9a48ef610bd3-multus-cni-dir\") pod \"multus-sk9vq\" (UID: \"48a862e8-66cd-4899-8cd4-9a48ef610bd3\") " pod="openshift-multus/multus-sk9vq"
Jul 06 19:32:46.423844 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:32:46.423058    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/48a862e8-66cd-4899-8cd4-9a48ef610bd3-host-run-multus-certs\") pod \"multus-sk9vq\" (UID: \"48a862e8-66cd-4899-8cd4-9a48ef610bd3\") " pod="openshift-multus/multus-sk9vq"
Jul 06 19:32:46.423844 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:32:46.423087    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/549d1922-a406-419b-a750-b7344fc1b9b8-etc-systemd\") pod \"tuned-jf9t9\" (UID: \"549d1922-a406-419b-a750-b7344fc1b9b8\") " pod="openshift-cluster-node-tuning-operator/tuned-jf9t9"
Jul 06 19:32:46.456102 ip-10-0-131-168 kubenswrapper[2565]: W0706 19:32:46.456066    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod83399c877cd64b0872925a2b56383a00.slice/crio-73b0d0a35a9a67dd3036dcd0f7963905847fa2d74ccfb3dfdc1c1188dd2b89ce WatchSource:0}: Error finding container 73b0d0a35a9a67dd3036dcd0f7963905847fa2d74ccfb3dfdc1c1188dd2b89ce: Status 404 returned error can't find the container with id 73b0d0a35a9a67dd3036dcd0f7963905847fa2d74ccfb3dfdc1c1188dd2b89ce
Jul 06 19:32:46.465816 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:32:46.465755    2565 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 06 19:32:46.475125 ip-10-0-131-168 kubenswrapper[2565]: W0706 19:32:46.475100    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda899b324560c7e06c6c5d50af86c2bd8.slice/crio-bfb4696da29c02637d81469db78996f63b016f93db99bb5c8ac2e02a010178f1 WatchSource:0}: Error finding container bfb4696da29c02637d81469db78996f63b016f93db99bb5c8ac2e02a010178f1: Status 404 returned error can't find the container with id bfb4696da29c02637d81469db78996f63b016f93db99bb5c8ac2e02a010178f1
Jul 06 19:32:46.491325 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:32:46.491284    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-168.ec2.internal" event={"ID":"a899b324560c7e06c6c5d50af86c2bd8","Type":"ContainerStarted","Data":"bfb4696da29c02637d81469db78996f63b016f93db99bb5c8ac2e02a010178f1"}
Jul 06 19:32:46.492273 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:32:46.492253    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-131-168.ec2.internal" event={"ID":"83399c877cd64b0872925a2b56383a00","Type":"ContainerStarted","Data":"73b0d0a35a9a67dd3036dcd0f7963905847fa2d74ccfb3dfdc1c1188dd2b89ce"}
Jul 06 19:32:46.523312 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:32:46.523280    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/9f15114d-7494-4f17-8a4d-52185f7a2e35-host-run-netns\") pod \"ovnkube-node-8kjqk\" (UID: \"9f15114d-7494-4f17-8a4d-52185f7a2e35\") " pod="openshift-ovn-kubernetes/ovnkube-node-8kjqk"
Jul 06 19:32:46.523312 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:32:46.523316    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/9f15114d-7494-4f17-8a4d-52185f7a2e35-host-run-ovn-kubernetes\") pod \"ovnkube-node-8kjqk\" (UID: \"9f15114d-7494-4f17-8a4d-52185f7a2e35\") " pod="openshift-ovn-kubernetes/ovnkube-node-8kjqk"
Jul 06 19:32:46.523532 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:32:46.523335    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/9f15114d-7494-4f17-8a4d-52185f7a2e35-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-8kjqk\" (UID: \"9f15114d-7494-4f17-8a4d-52185f7a2e35\") " pod="openshift-ovn-kubernetes/ovnkube-node-8kjqk"
Jul 06 19:32:46.523532 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:32:46.523350    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gngg2\" (UniqueName: \"kubernetes.io/projected/9f15114d-7494-4f17-8a4d-52185f7a2e35-kube-api-access-gngg2\") pod \"ovnkube-node-8kjqk\" (UID: \"9f15114d-7494-4f17-8a4d-52185f7a2e35\") " pod="openshift-ovn-kubernetes/ovnkube-node-8kjqk"
Jul 06 19:32:46.523532 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:32:46.523366    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/9449cdae-9fc6-4f64-a88a-db3f2e08b626-os-release\") pod \"multus-additional-cni-plugins-cjmdl\" (UID: \"9449cdae-9fc6-4f64-a88a-db3f2e08b626\") " pod="openshift-multus/multus-additional-cni-plugins-cjmdl"
Jul 06 19:32:46.523532 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:32:46.523383    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/549d1922-a406-419b-a750-b7344fc1b9b8-etc-kubernetes\") pod \"tuned-jf9t9\" (UID: \"549d1922-a406-419b-a750-b7344fc1b9b8\") " pod="openshift-cluster-node-tuning-operator/tuned-jf9t9"
Jul 06 19:32:46.523532 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:32:46.523404    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/549d1922-a406-419b-a750-b7344fc1b9b8-etc-sysctl-conf\") pod \"tuned-jf9t9\" (UID: \"549d1922-a406-419b-a750-b7344fc1b9b8\") " pod="openshift-cluster-node-tuning-operator/tuned-jf9t9"
Jul 06 19:32:46.523532 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:32:46.523400    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/9f15114d-7494-4f17-8a4d-52185f7a2e35-host-run-netns\") pod \"ovnkube-node-8kjqk\" (UID: \"9f15114d-7494-4f17-8a4d-52185f7a2e35\") " pod="openshift-ovn-kubernetes/ovnkube-node-8kjqk"
Jul 06 19:32:46.523532 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:32:46.523416    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/9f15114d-7494-4f17-8a4d-52185f7a2e35-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-8kjqk\" (UID: \"9f15114d-7494-4f17-8a4d-52185f7a2e35\") " pod="openshift-ovn-kubernetes/ovnkube-node-8kjqk"
Jul 06 19:32:46.523532 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:32:46.523402    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/9f15114d-7494-4f17-8a4d-52185f7a2e35-host-run-ovn-kubernetes\") pod \"ovnkube-node-8kjqk\" (UID: \"9f15114d-7494-4f17-8a4d-52185f7a2e35\") " pod="openshift-ovn-kubernetes/ovnkube-node-8kjqk"
Jul 06 19:32:46.523532 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:32:46.523453    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/9f15114d-7494-4f17-8a4d-52185f7a2e35-host-slash\") pod \"ovnkube-node-8kjqk\" (UID: \"9f15114d-7494-4f17-8a4d-52185f7a2e35\") " pod="openshift-ovn-kubernetes/ovnkube-node-8kjqk"
Jul 06 19:32:46.523532 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:32:46.523455    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/549d1922-a406-419b-a750-b7344fc1b9b8-etc-kubernetes\") pod \"tuned-jf9t9\" (UID: \"549d1922-a406-419b-a750-b7344fc1b9b8\") " pod="openshift-cluster-node-tuning-operator/tuned-jf9t9"
Jul 06 19:32:46.523532 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:32:46.523486    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/9449cdae-9fc6-4f64-a88a-db3f2e08b626-os-release\") pod \"multus-additional-cni-plugins-cjmdl\" (UID: \"9449cdae-9fc6-4f64-a88a-db3f2e08b626\") " pod="openshift-multus/multus-additional-cni-plugins-cjmdl"
Jul 06 19:32:46.523532 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:32:46.523478    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bhj6j\" (UniqueName: \"kubernetes.io/projected/1cda8348-291c-4665-99e9-892c67fb326d-kube-api-access-bhj6j\") pod \"network-check-target-pc8fq\" (UID: \"1cda8348-291c-4665-99e9-892c67fb326d\") " pod="openshift-network-diagnostics/network-check-target-pc8fq"
Jul 06 19:32:46.523532 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:32:46.523519    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/9f15114d-7494-4f17-8a4d-52185f7a2e35-host-slash\") pod \"ovnkube-node-8kjqk\" (UID: \"9f15114d-7494-4f17-8a4d-52185f7a2e35\") " pod="openshift-ovn-kubernetes/ovnkube-node-8kjqk"
Jul 06 19:32:46.523532 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:32:46.523535    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/48a862e8-66cd-4899-8cd4-9a48ef610bd3-os-release\") pod \"multus-sk9vq\" (UID: \"48a862e8-66cd-4899-8cd4-9a48ef610bd3\") " pod="openshift-multus/multus-sk9vq"
Jul 06 19:32:46.524193 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:32:46.523552    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/67af2b66-be49-4b61-a200-b711f4d83397-dbus\") pod \"global-pull-secret-syncer-2rdm6\" (UID: \"67af2b66-be49-4b61-a200-b711f4d83397\") " pod="kube-system/global-pull-secret-syncer-2rdm6"
Jul 06 19:32:46.524193 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:32:46.523563    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/549d1922-a406-419b-a750-b7344fc1b9b8-etc-sysctl-conf\") pod \"tuned-jf9t9\" (UID: \"549d1922-a406-419b-a750-b7344fc1b9b8\") " pod="openshift-cluster-node-tuning-operator/tuned-jf9t9"
Jul 06 19:32:46.524193 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:32:46.523576    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/67af2b66-be49-4b61-a200-b711f4d83397-original-pull-secret\") pod \"global-pull-secret-syncer-2rdm6\" (UID: \"67af2b66-be49-4b61-a200-b711f4d83397\") " pod="kube-system/global-pull-secret-syncer-2rdm6"
Jul 06 19:32:46.524193 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:32:46.523589    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/48a862e8-66cd-4899-8cd4-9a48ef610bd3-os-release\") pod \"multus-sk9vq\" (UID: \"48a862e8-66cd-4899-8cd4-9a48ef610bd3\") " pod="openshift-multus/multus-sk9vq"
Jul 06 19:32:46.524193 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:32:46.523597    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/ef7753ea-b0a6-45e3-8e20-6a93bc9d1f76-sys-fs\") pod \"aws-ebs-csi-driver-node-jrxrv\" (UID: \"ef7753ea-b0a6-45e3-8e20-6a93bc9d1f76\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jrxrv"
Jul 06 19:32:46.524193 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:32:46.523613    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/35683ef3-3b68-4694-acaf-aaee8f598255-host\") pod \"node-ca-cblv9\" (UID: \"35683ef3-3b68-4694-acaf-aaee8f598255\") " pod="openshift-image-registry/node-ca-cblv9"
Jul 06 19:32:46.524193 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:32:46.523638    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/48a862e8-66cd-4899-8cd4-9a48ef610bd3-host-var-lib-cni-multus\") pod \"multus-sk9vq\" (UID: \"48a862e8-66cd-4899-8cd4-9a48ef610bd3\") " pod="openshift-multus/multus-sk9vq"
Jul 06 19:32:46.524193 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:32:46.523655    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fvw7c\" (UniqueName: \"kubernetes.io/projected/48a862e8-66cd-4899-8cd4-9a48ef610bd3-kube-api-access-fvw7c\") pod \"multus-sk9vq\" (UID: \"48a862e8-66cd-4899-8cd4-9a48ef610bd3\") " pod="openshift-multus/multus-sk9vq"
Jul 06 19:32:46.524193 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:32:46.523666    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/ef7753ea-b0a6-45e3-8e20-6a93bc9d1f76-sys-fs\") pod \"aws-ebs-csi-driver-node-jrxrv\" (UID: \"ef7753ea-b0a6-45e3-8e20-6a93bc9d1f76\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jrxrv"
Jul 06 19:32:46.524193 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:32:46.523672    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/9f15114d-7494-4f17-8a4d-52185f7a2e35-run-systemd\") pod \"ovnkube-node-8kjqk\" (UID: \"9f15114d-7494-4f17-8a4d-52185f7a2e35\") " pod="openshift-ovn-kubernetes/ovnkube-node-8kjqk"
Jul 06 19:32:46.524193 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:32:46.523698    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/9f15114d-7494-4f17-8a4d-52185f7a2e35-run-systemd\") pod \"ovnkube-node-8kjqk\" (UID: \"9f15114d-7494-4f17-8a4d-52185f7a2e35\") " pod="openshift-ovn-kubernetes/ovnkube-node-8kjqk"
Jul 06 19:32:46.524193 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:32:46.523705    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/48a862e8-66cd-4899-8cd4-9a48ef610bd3-host-var-lib-cni-multus\") pod \"multus-sk9vq\" (UID: \"48a862e8-66cd-4899-8cd4-9a48ef610bd3\") " pod="openshift-multus/multus-sk9vq"
Jul 06 19:32:46.524193 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:32:46.523711    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/48a862e8-66cd-4899-8cd4-9a48ef610bd3-host-var-lib-cni-bin\") pod \"multus-sk9vq\" (UID: \"48a862e8-66cd-4899-8cd4-9a48ef610bd3\") " pod="openshift-multus/multus-sk9vq"
Jul 06 19:32:46.524193 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:32:46.523719    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/35683ef3-3b68-4694-acaf-aaee8f598255-host\") pod \"node-ca-cblv9\" (UID: \"35683ef3-3b68-4694-acaf-aaee8f598255\") " pod="openshift-image-registry/node-ca-cblv9"
Jul 06 19:32:46.524193 ip-10-0-131-168 kubenswrapper[2565]: E0706 19:32:46.523672    2565 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 06 19:32:46.524193 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:32:46.523744    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/48a862e8-66cd-4899-8cd4-9a48ef610bd3-multus-daemon-config\") pod \"multus-sk9vq\" (UID: \"48a862e8-66cd-4899-8cd4-9a48ef610bd3\") " pod="openshift-multus/multus-sk9vq"
Jul 06 19:32:46.524193 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:32:46.523759    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/67af2b66-be49-4b61-a200-b711f4d83397-dbus\") pod \"global-pull-secret-syncer-2rdm6\" (UID: \"67af2b66-be49-4b61-a200-b711f4d83397\") " pod="kube-system/global-pull-secret-syncer-2rdm6"
Jul 06 19:32:46.524193 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:32:46.523746    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/48a862e8-66cd-4899-8cd4-9a48ef610bd3-host-var-lib-cni-bin\") pod \"multus-sk9vq\" (UID: \"48a862e8-66cd-4899-8cd4-9a48ef610bd3\") " pod="openshift-multus/multus-sk9vq"
Jul 06 19:32:46.524997 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:32:46.523790    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/67af2b66-be49-4b61-a200-b711f4d83397-kubelet-config\") pod \"global-pull-secret-syncer-2rdm6\" (UID: \"67af2b66-be49-4b61-a200-b711f4d83397\") " pod="kube-system/global-pull-secret-syncer-2rdm6"
Jul 06 19:32:46.524997 ip-10-0-131-168 kubenswrapper[2565]: E0706 19:32:46.523808    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/67af2b66-be49-4b61-a200-b711f4d83397-original-pull-secret podName:67af2b66-be49-4b61-a200-b711f4d83397 nodeName:}" failed. No retries permitted until 2026-07-06 19:32:47.02378983 +0000 UTC m=+2.036778483 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/67af2b66-be49-4b61-a200-b711f4d83397-original-pull-secret") pod "global-pull-secret-syncer-2rdm6" (UID: "67af2b66-be49-4b61-a200-b711f4d83397") : object "kube-system"/"original-pull-secret" not registered
Jul 06 19:32:46.524997 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:32:46.523826    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/67af2b66-be49-4b61-a200-b711f4d83397-kubelet-config\") pod \"global-pull-secret-syncer-2rdm6\" (UID: \"67af2b66-be49-4b61-a200-b711f4d83397\") " pod="kube-system/global-pull-secret-syncer-2rdm6"
Jul 06 19:32:46.524997 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:32:46.523837    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/9f15114d-7494-4f17-8a4d-52185f7a2e35-log-socket\") pod \"ovnkube-node-8kjqk\" (UID: \"9f15114d-7494-4f17-8a4d-52185f7a2e35\") " pod="openshift-ovn-kubernetes/ovnkube-node-8kjqk"
Jul 06 19:32:46.524997 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:32:46.523861    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kk247\" (UniqueName: \"kubernetes.io/projected/c6148c24-bfbd-4b4f-a4a8-774705b763bd-kube-api-access-kk247\") pod \"iptables-alerter-bp6sh\" (UID: \"c6148c24-bfbd-4b4f-a4a8-774705b763bd\") " pod="openshift-network-operator/iptables-alerter-bp6sh"
Jul 06 19:32:46.524997 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:32:46.523884    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/48a862e8-66cd-4899-8cd4-9a48ef610bd3-system-cni-dir\") pod \"multus-sk9vq\" (UID: \"48a862e8-66cd-4899-8cd4-9a48ef610bd3\") " pod="openshift-multus/multus-sk9vq"
Jul 06 19:32:46.524997 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:32:46.523888    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/9f15114d-7494-4f17-8a4d-52185f7a2e35-log-socket\") pod \"ovnkube-node-8kjqk\" (UID: \"9f15114d-7494-4f17-8a4d-52185f7a2e35\") " pod="openshift-ovn-kubernetes/ovnkube-node-8kjqk"
Jul 06 19:32:46.524997 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:32:46.523906    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/48a862e8-66cd-4899-8cd4-9a48ef610bd3-host-run-netns\") pod \"multus-sk9vq\" (UID: \"48a862e8-66cd-4899-8cd4-9a48ef610bd3\") " pod="openshift-multus/multus-sk9vq"
Jul 06 19:32:46.524997 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:32:46.523928    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/0ecbe788-9e2c-446a-b154-7b805f3983dd-tmp-dir\") pod \"node-resolver-kx6hd\" (UID: \"0ecbe788-9e2c-446a-b154-7b805f3983dd\") " pod="openshift-dns/node-resolver-kx6hd"
Jul 06 19:32:46.524997 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:32:46.523946    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/48a862e8-66cd-4899-8cd4-9a48ef610bd3-system-cni-dir\") pod \"multus-sk9vq\" (UID: \"48a862e8-66cd-4899-8cd4-9a48ef610bd3\") " pod="openshift-multus/multus-sk9vq"
Jul 06 19:32:46.524997 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:32:46.523951    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/ef7753ea-b0a6-45e3-8e20-6a93bc9d1f76-registration-dir\") pod \"aws-ebs-csi-driver-node-jrxrv\" (UID: \"ef7753ea-b0a6-45e3-8e20-6a93bc9d1f76\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jrxrv"
Jul 06 19:32:46.524997 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:32:46.523962    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/48a862e8-66cd-4899-8cd4-9a48ef610bd3-host-run-netns\") pod \"multus-sk9vq\" (UID: \"48a862e8-66cd-4899-8cd4-9a48ef610bd3\") " pod="openshift-multus/multus-sk9vq"
Jul 06 19:32:46.524997 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:32:46.523977    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/ef7753ea-b0a6-45e3-8e20-6a93bc9d1f76-device-dir\") pod \"aws-ebs-csi-driver-node-jrxrv\" (UID: \"ef7753ea-b0a6-45e3-8e20-6a93bc9d1f76\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jrxrv"
Jul 06 19:32:46.524997 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:32:46.523993    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/ef7753ea-b0a6-45e3-8e20-6a93bc9d1f76-etc-selinux\") pod \"aws-ebs-csi-driver-node-jrxrv\" (UID: \"ef7753ea-b0a6-45e3-8e20-6a93bc9d1f76\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jrxrv"
Jul 06 19:32:46.524997 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:32:46.524001    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/ef7753ea-b0a6-45e3-8e20-6a93bc9d1f76-registration-dir\") pod \"aws-ebs-csi-driver-node-jrxrv\" (UID: \"ef7753ea-b0a6-45e3-8e20-6a93bc9d1f76\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jrxrv"
Jul 06 19:32:46.524997 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:32:46.524008    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/9f15114d-7494-4f17-8a4d-52185f7a2e35-host-cni-netd\") pod \"ovnkube-node-8kjqk\" (UID: \"9f15114d-7494-4f17-8a4d-52185f7a2e35\") " pod="openshift-ovn-kubernetes/ovnkube-node-8kjqk"
Jul 06 19:32:46.525622 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:32:46.524031    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-p692c\" (UniqueName: \"kubernetes.io/projected/0657d2af-82f5-428a-ba3e-fe3df6d74f8b-kube-api-access-p692c\") pod \"network-metrics-daemon-9lc4r\" (UID: \"0657d2af-82f5-428a-ba3e-fe3df6d74f8b\") " pod="openshift-multus/network-metrics-daemon-9lc4r"
Jul 06 19:32:46.525622 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:32:46.524042    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/ef7753ea-b0a6-45e3-8e20-6a93bc9d1f76-device-dir\") pod \"aws-ebs-csi-driver-node-jrxrv\" (UID: \"ef7753ea-b0a6-45e3-8e20-6a93bc9d1f76\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jrxrv"
Jul 06 19:32:46.525622 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:32:46.524069    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/9f15114d-7494-4f17-8a4d-52185f7a2e35-host-cni-netd\") pod \"ovnkube-node-8kjqk\" (UID: \"9f15114d-7494-4f17-8a4d-52185f7a2e35\") " pod="openshift-ovn-kubernetes/ovnkube-node-8kjqk"
Jul 06 19:32:46.525622 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:32:46.524097    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/ef7753ea-b0a6-45e3-8e20-6a93bc9d1f76-etc-selinux\") pod \"aws-ebs-csi-driver-node-jrxrv\" (UID: \"ef7753ea-b0a6-45e3-8e20-6a93bc9d1f76\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jrxrv"
Jul 06 19:32:46.525622 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:32:46.524109    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/48a862e8-66cd-4899-8cd4-9a48ef610bd3-multus-cni-dir\") pod \"multus-sk9vq\" (UID: \"48a862e8-66cd-4899-8cd4-9a48ef610bd3\") " pod="openshift-multus/multus-sk9vq"
Jul 06 19:32:46.525622 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:32:46.524136    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/48a862e8-66cd-4899-8cd4-9a48ef610bd3-host-run-multus-certs\") pod \"multus-sk9vq\" (UID: \"48a862e8-66cd-4899-8cd4-9a48ef610bd3\") " pod="openshift-multus/multus-sk9vq"
Jul 06 19:32:46.525622 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:32:46.524150    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/48a862e8-66cd-4899-8cd4-9a48ef610bd3-multus-cni-dir\") pod \"multus-sk9vq\" (UID: \"48a862e8-66cd-4899-8cd4-9a48ef610bd3\") " pod="openshift-multus/multus-sk9vq"
Jul 06 19:32:46.525622 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:32:46.524158    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/549d1922-a406-419b-a750-b7344fc1b9b8-etc-systemd\") pod \"tuned-jf9t9\" (UID: \"549d1922-a406-419b-a750-b7344fc1b9b8\") " pod="openshift-cluster-node-tuning-operator/tuned-jf9t9"
Jul 06 19:32:46.525622 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:32:46.524175    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/48a862e8-66cd-4899-8cd4-9a48ef610bd3-host-run-multus-certs\") pod \"multus-sk9vq\" (UID: \"48a862e8-66cd-4899-8cd4-9a48ef610bd3\") " pod="openshift-multus/multus-sk9vq"
Jul 06 19:32:46.525622 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:32:46.524181    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/c6148c24-bfbd-4b4f-a4a8-774705b763bd-host-slash\") pod \"iptables-alerter-bp6sh\" (UID: \"c6148c24-bfbd-4b4f-a4a8-774705b763bd\") " pod="openshift-network-operator/iptables-alerter-bp6sh"
Jul 06 19:32:46.525622 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:32:46.524201    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/0ecbe788-9e2c-446a-b154-7b805f3983dd-tmp-dir\") pod \"node-resolver-kx6hd\" (UID: \"0ecbe788-9e2c-446a-b154-7b805f3983dd\") " pod="openshift-dns/node-resolver-kx6hd"
Jul 06 19:32:46.525622 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:32:46.524209    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/549d1922-a406-419b-a750-b7344fc1b9b8-etc-systemd\") pod \"tuned-jf9t9\" (UID: \"549d1922-a406-419b-a750-b7344fc1b9b8\") " pod="openshift-cluster-node-tuning-operator/tuned-jf9t9"
Jul 06 19:32:46.525622 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:32:46.524206    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4cmz8\" (UniqueName: \"kubernetes.io/projected/9449cdae-9fc6-4f64-a88a-db3f2e08b626-kube-api-access-4cmz8\") pod \"multus-additional-cni-plugins-cjmdl\" (UID: \"9449cdae-9fc6-4f64-a88a-db3f2e08b626\") " pod="openshift-multus/multus-additional-cni-plugins-cjmdl"
Jul 06 19:32:46.525622 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:32:46.524249    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/c6148c24-bfbd-4b4f-a4a8-774705b763bd-host-slash\") pod \"iptables-alerter-bp6sh\" (UID: \"c6148c24-bfbd-4b4f-a4a8-774705b763bd\") " pod="openshift-network-operator/iptables-alerter-bp6sh"
Jul 06 19:32:46.525622 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:32:46.524264    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/549d1922-a406-419b-a750-b7344fc1b9b8-etc-sysctl-d\") pod \"tuned-jf9t9\" (UID: \"549d1922-a406-419b-a750-b7344fc1b9b8\") " pod="openshift-cluster-node-tuning-operator/tuned-jf9t9"
Jul 06 19:32:46.525622 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:32:46.524294    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/9f15114d-7494-4f17-8a4d-52185f7a2e35-host-cni-bin\") pod \"ovnkube-node-8kjqk\" (UID: \"9f15114d-7494-4f17-8a4d-52185f7a2e35\") " pod="openshift-ovn-kubernetes/ovnkube-node-8kjqk"
Jul 06 19:32:46.525622 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:32:46.524323    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/9449cdae-9fc6-4f64-a88a-db3f2e08b626-system-cni-dir\") pod \"multus-additional-cni-plugins-cjmdl\" (UID: \"9449cdae-9fc6-4f64-a88a-db3f2e08b626\") " pod="openshift-multus/multus-additional-cni-plugins-cjmdl"
Jul 06 19:32:46.526436 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:32:46.524344    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/9f15114d-7494-4f17-8a4d-52185f7a2e35-host-cni-bin\") pod \"ovnkube-node-8kjqk\" (UID: \"9f15114d-7494-4f17-8a4d-52185f7a2e35\") " pod="openshift-ovn-kubernetes/ovnkube-node-8kjqk"
Jul 06 19:32:46.526436 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:32:46.524351    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/9449cdae-9fc6-4f64-a88a-db3f2e08b626-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-cjmdl\" (UID: \"9449cdae-9fc6-4f64-a88a-db3f2e08b626\") " pod="openshift-multus/multus-additional-cni-plugins-cjmdl"
Jul 06 19:32:46.526436 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:32:46.524378    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/48a862e8-66cd-4899-8cd4-9a48ef610bd3-multus-daemon-config\") pod \"multus-sk9vq\" (UID: \"48a862e8-66cd-4899-8cd4-9a48ef610bd3\") " pod="openshift-multus/multus-sk9vq"
Jul 06 19:32:46.526436 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:32:46.524388    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/9449cdae-9fc6-4f64-a88a-db3f2e08b626-system-cni-dir\") pod \"multus-additional-cni-plugins-cjmdl\" (UID: \"9449cdae-9fc6-4f64-a88a-db3f2e08b626\") " pod="openshift-multus/multus-additional-cni-plugins-cjmdl"
Jul 06 19:32:46.526436 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:32:46.524389    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/48a862e8-66cd-4899-8cd4-9a48ef610bd3-host-var-lib-kubelet\") pod \"multus-sk9vq\" (UID: \"48a862e8-66cd-4899-8cd4-9a48ef610bd3\") " pod="openshift-multus/multus-sk9vq"
Jul 06 19:32:46.526436 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:32:46.524411    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/549d1922-a406-419b-a750-b7344fc1b9b8-etc-sysctl-d\") pod \"tuned-jf9t9\" (UID: \"549d1922-a406-419b-a750-b7344fc1b9b8\") " pod="openshift-cluster-node-tuning-operator/tuned-jf9t9"
Jul 06 19:32:46.526436 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:32:46.524418    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/549d1922-a406-419b-a750-b7344fc1b9b8-var-lib-kubelet\") pod \"tuned-jf9t9\" (UID: \"549d1922-a406-419b-a750-b7344fc1b9b8\") " pod="openshift-cluster-node-tuning-operator/tuned-jf9t9"
Jul 06 19:32:46.526436 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:32:46.524443    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/549d1922-a406-419b-a750-b7344fc1b9b8-var-lib-kubelet\") pod \"tuned-jf9t9\" (UID: \"549d1922-a406-419b-a750-b7344fc1b9b8\") " pod="openshift-cluster-node-tuning-operator/tuned-jf9t9"
Jul 06 19:32:46.526436 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:32:46.524447    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/48a862e8-66cd-4899-8cd4-9a48ef610bd3-host-var-lib-kubelet\") pod \"multus-sk9vq\" (UID: \"48a862e8-66cd-4899-8cd4-9a48ef610bd3\") " pod="openshift-multus/multus-sk9vq"
Jul 06 19:32:46.526436 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:32:46.524462    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/549d1922-a406-419b-a750-b7344fc1b9b8-host\") pod \"tuned-jf9t9\" (UID: \"549d1922-a406-419b-a750-b7344fc1b9b8\") " pod="openshift-cluster-node-tuning-operator/tuned-jf9t9"
Jul 06 19:32:46.526436 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:32:46.524489    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/ef7753ea-b0a6-45e3-8e20-6a93bc9d1f76-kubelet-dir\") pod \"aws-ebs-csi-driver-node-jrxrv\" (UID: \"ef7753ea-b0a6-45e3-8e20-6a93bc9d1f76\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jrxrv"
Jul 06 19:32:46.526436 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:32:46.524518    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/9f15114d-7494-4f17-8a4d-52185f7a2e35-run-ovn\") pod \"ovnkube-node-8kjqk\" (UID: \"9f15114d-7494-4f17-8a4d-52185f7a2e35\") " pod="openshift-ovn-kubernetes/ovnkube-node-8kjqk"
Jul 06 19:32:46.526436 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:32:46.524545    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/549d1922-a406-419b-a750-b7344fc1b9b8-host\") pod \"tuned-jf9t9\" (UID: \"549d1922-a406-419b-a750-b7344fc1b9b8\") " pod="openshift-cluster-node-tuning-operator/tuned-jf9t9"
Jul 06 19:32:46.526436 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:32:46.524546    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/9449cdae-9fc6-4f64-a88a-db3f2e08b626-cni-binary-copy\") pod \"multus-additional-cni-plugins-cjmdl\" (UID: \"9449cdae-9fc6-4f64-a88a-db3f2e08b626\") " pod="openshift-multus/multus-additional-cni-plugins-cjmdl"
Jul 06 19:32:46.526436 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:32:46.524566    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/ef7753ea-b0a6-45e3-8e20-6a93bc9d1f76-kubelet-dir\") pod \"aws-ebs-csi-driver-node-jrxrv\" (UID: \"ef7753ea-b0a6-45e3-8e20-6a93bc9d1f76\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jrxrv"
Jul 06 19:32:46.526436 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:32:46.524573    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/48a862e8-66cd-4899-8cd4-9a48ef610bd3-host-run-k8s-cni-cncf-io\") pod \"multus-sk9vq\" (UID: \"48a862e8-66cd-4899-8cd4-9a48ef610bd3\") " pod="openshift-multus/multus-sk9vq"
Jul 06 19:32:46.526436 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:32:46.524570    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/9f15114d-7494-4f17-8a4d-52185f7a2e35-run-ovn\") pod \"ovnkube-node-8kjqk\" (UID: \"9f15114d-7494-4f17-8a4d-52185f7a2e35\") " pod="openshift-ovn-kubernetes/ovnkube-node-8kjqk"
Jul 06 19:32:46.527085 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:32:46.524597    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/549d1922-a406-419b-a750-b7344fc1b9b8-run\") pod \"tuned-jf9t9\" (UID: \"549d1922-a406-419b-a750-b7344fc1b9b8\") " pod="openshift-cluster-node-tuning-operator/tuned-jf9t9"
Jul 06 19:32:46.527085 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:32:46.524621    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6wvnd\" (UniqueName: \"kubernetes.io/projected/549d1922-a406-419b-a750-b7344fc1b9b8-kube-api-access-6wvnd\") pod \"tuned-jf9t9\" (UID: \"549d1922-a406-419b-a750-b7344fc1b9b8\") " pod="openshift-cluster-node-tuning-operator/tuned-jf9t9"
Jul 06 19:32:46.527085 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:32:46.524647    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/0ecbe788-9e2c-446a-b154-7b805f3983dd-hosts-file\") pod \"node-resolver-kx6hd\" (UID: \"0ecbe788-9e2c-446a-b154-7b805f3983dd\") " pod="openshift-dns/node-resolver-kx6hd"
Jul 06 19:32:46.527085 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:32:46.524652    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/549d1922-a406-419b-a750-b7344fc1b9b8-run\") pod \"tuned-jf9t9\" (UID: \"549d1922-a406-419b-a750-b7344fc1b9b8\") " pod="openshift-cluster-node-tuning-operator/tuned-jf9t9"
Jul 06 19:32:46.527085 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:32:46.524622    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/48a862e8-66cd-4899-8cd4-9a48ef610bd3-host-run-k8s-cni-cncf-io\") pod \"multus-sk9vq\" (UID: \"48a862e8-66cd-4899-8cd4-9a48ef610bd3\") " pod="openshift-multus/multus-sk9vq"
Jul 06 19:32:46.527085 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:32:46.524672    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5bwm6\" (UniqueName: \"kubernetes.io/projected/35683ef3-3b68-4694-acaf-aaee8f598255-kube-api-access-5bwm6\") pod \"node-ca-cblv9\" (UID: \"35683ef3-3b68-4694-acaf-aaee8f598255\") " pod="openshift-image-registry/node-ca-cblv9"
Jul 06 19:32:46.527085 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:32:46.524698    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/9f15114d-7494-4f17-8a4d-52185f7a2e35-env-overrides\") pod \"ovnkube-node-8kjqk\" (UID: \"9f15114d-7494-4f17-8a4d-52185f7a2e35\") " pod="openshift-ovn-kubernetes/ovnkube-node-8kjqk"
Jul 06 19:32:46.527085 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:32:46.524704    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/0ecbe788-9e2c-446a-b154-7b805f3983dd-hosts-file\") pod \"node-resolver-kx6hd\" (UID: \"0ecbe788-9e2c-446a-b154-7b805f3983dd\") " pod="openshift-dns/node-resolver-kx6hd"
Jul 06 19:32:46.527085 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:32:46.524748    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/9449cdae-9fc6-4f64-a88a-db3f2e08b626-tuning-conf-dir\") pod \"multus-additional-cni-plugins-cjmdl\" (UID: \"9449cdae-9fc6-4f64-a88a-db3f2e08b626\") " pod="openshift-multus/multus-additional-cni-plugins-cjmdl"
Jul 06 19:32:46.527085 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:32:46.524887    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/9449cdae-9fc6-4f64-a88a-db3f2e08b626-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-cjmdl\" (UID: \"9449cdae-9fc6-4f64-a88a-db3f2e08b626\") " pod="openshift-multus/multus-additional-cni-plugins-cjmdl"
Jul 06 19:32:46.527085 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:32:46.524913    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/9449cdae-9fc6-4f64-a88a-db3f2e08b626-tuning-conf-dir\") pod \"multus-additional-cni-plugins-cjmdl\" (UID: \"9449cdae-9fc6-4f64-a88a-db3f2e08b626\") " pod="openshift-multus/multus-additional-cni-plugins-cjmdl"
Jul 06 19:32:46.527085 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:32:46.524915    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/48a862e8-66cd-4899-8cd4-9a48ef610bd3-etc-kubernetes\") pod \"multus-sk9vq\" (UID: \"48a862e8-66cd-4899-8cd4-9a48ef610bd3\") " pod="openshift-multus/multus-sk9vq"
Jul 06 19:32:46.527085 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:32:46.524886    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/9449cdae-9fc6-4f64-a88a-db3f2e08b626-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-cjmdl\" (UID: \"9449cdae-9fc6-4f64-a88a-db3f2e08b626\") " pod="openshift-multus/multus-additional-cni-plugins-cjmdl"
Jul 06 19:32:46.527085 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:32:46.524952    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/48a862e8-66cd-4899-8cd4-9a48ef610bd3-etc-kubernetes\") pod \"multus-sk9vq\" (UID: \"48a862e8-66cd-4899-8cd4-9a48ef610bd3\") " pod="openshift-multus/multus-sk9vq"
Jul 06 19:32:46.527085 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:32:46.524955    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/549d1922-a406-419b-a750-b7344fc1b9b8-etc-sysconfig\") pod \"tuned-jf9t9\" (UID: \"549d1922-a406-419b-a750-b7344fc1b9b8\") " pod="openshift-cluster-node-tuning-operator/tuned-jf9t9"
Jul 06 19:32:46.527085 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:32:46.524984    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/9449cdae-9fc6-4f64-a88a-db3f2e08b626-cni-binary-copy\") pod \"multus-additional-cni-plugins-cjmdl\" (UID: \"9449cdae-9fc6-4f64-a88a-db3f2e08b626\") " pod="openshift-multus/multus-additional-cni-plugins-cjmdl"
Jul 06 19:32:46.527085 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:32:46.524993    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/549d1922-a406-419b-a750-b7344fc1b9b8-etc-sysconfig\") pod \"tuned-jf9t9\" (UID: \"549d1922-a406-419b-a750-b7344fc1b9b8\") " pod="openshift-cluster-node-tuning-operator/tuned-jf9t9"
Jul 06 19:32:46.527788 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:32:46.524999    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/35683ef3-3b68-4694-acaf-aaee8f598255-serviceca\") pod \"node-ca-cblv9\" (UID: \"35683ef3-3b68-4694-acaf-aaee8f598255\") " pod="openshift-image-registry/node-ca-cblv9"
Jul 06 19:32:46.527788 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:32:46.525027    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/9f15114d-7494-4f17-8a4d-52185f7a2e35-run-openvswitch\") pod \"ovnkube-node-8kjqk\" (UID: \"9f15114d-7494-4f17-8a4d-52185f7a2e35\") " pod="openshift-ovn-kubernetes/ovnkube-node-8kjqk"
Jul 06 19:32:46.527788 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:32:46.525053    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/9f15114d-7494-4f17-8a4d-52185f7a2e35-ovnkube-script-lib\") pod \"ovnkube-node-8kjqk\" (UID: \"9f15114d-7494-4f17-8a4d-52185f7a2e35\") " pod="openshift-ovn-kubernetes/ovnkube-node-8kjqk"
Jul 06 19:32:46.527788 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:32:46.525079    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0657d2af-82f5-428a-ba3e-fe3df6d74f8b-metrics-certs\") pod \"network-metrics-daemon-9lc4r\" (UID: \"0657d2af-82f5-428a-ba3e-fe3df6d74f8b\") " pod="openshift-multus/network-metrics-daemon-9lc4r"
Jul 06 19:32:46.527788 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:32:46.525108    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/9f15114d-7494-4f17-8a4d-52185f7a2e35-run-openvswitch\") pod \"ovnkube-node-8kjqk\" (UID: \"9f15114d-7494-4f17-8a4d-52185f7a2e35\") " pod="openshift-ovn-kubernetes/ovnkube-node-8kjqk"
Jul 06 19:32:46.527788 ip-10-0-131-168 kubenswrapper[2565]: E0706 19:32:46.525155    2565 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 06 19:32:46.527788 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:32:46.525194    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/549d1922-a406-419b-a750-b7344fc1b9b8-sys\") pod \"tuned-jf9t9\" (UID: \"549d1922-a406-419b-a750-b7344fc1b9b8\") " pod="openshift-cluster-node-tuning-operator/tuned-jf9t9"
Jul 06 19:32:46.527788 ip-10-0-131-168 kubenswrapper[2565]: E0706 19:32:46.525201    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0657d2af-82f5-428a-ba3e-fe3df6d74f8b-metrics-certs podName:0657d2af-82f5-428a-ba3e-fe3df6d74f8b nodeName:}" failed. No retries permitted until 2026-07-06 19:32:47.025186159 +0000 UTC m=+2.038174825 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/0657d2af-82f5-428a-ba3e-fe3df6d74f8b-metrics-certs") pod "network-metrics-daemon-9lc4r" (UID: "0657d2af-82f5-428a-ba3e-fe3df6d74f8b") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 06 19:32:46.527788 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:32:46.525147    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/549d1922-a406-419b-a750-b7344fc1b9b8-sys\") pod \"tuned-jf9t9\" (UID: \"549d1922-a406-419b-a750-b7344fc1b9b8\") " pod="openshift-cluster-node-tuning-operator/tuned-jf9t9"
Jul 06 19:32:46.527788 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:32:46.525231    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-td4tw\" (UniqueName: \"kubernetes.io/projected/0ecbe788-9e2c-446a-b154-7b805f3983dd-kube-api-access-td4tw\") pod \"node-resolver-kx6hd\" (UID: \"0ecbe788-9e2c-446a-b154-7b805f3983dd\") " pod="openshift-dns/node-resolver-kx6hd"
Jul 06 19:32:46.527788 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:32:46.525248    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/9f15114d-7494-4f17-8a4d-52185f7a2e35-env-overrides\") pod \"ovnkube-node-8kjqk\" (UID: \"9f15114d-7494-4f17-8a4d-52185f7a2e35\") " pod="openshift-ovn-kubernetes/ovnkube-node-8kjqk"
Jul 06 19:32:46.527788 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:32:46.525259    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/9f15114d-7494-4f17-8a4d-52185f7a2e35-host-kubelet\") pod \"ovnkube-node-8kjqk\" (UID: \"9f15114d-7494-4f17-8a4d-52185f7a2e35\") " pod="openshift-ovn-kubernetes/ovnkube-node-8kjqk"
Jul 06 19:32:46.527788 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:32:46.525284    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/9f15114d-7494-4f17-8a4d-52185f7a2e35-systemd-units\") pod \"ovnkube-node-8kjqk\" (UID: \"9f15114d-7494-4f17-8a4d-52185f7a2e35\") " pod="openshift-ovn-kubernetes/ovnkube-node-8kjqk"
Jul 06 19:32:46.527788 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:32:46.525307    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/48a862e8-66cd-4899-8cd4-9a48ef610bd3-cni-binary-copy\") pod \"multus-sk9vq\" (UID: \"48a862e8-66cd-4899-8cd4-9a48ef610bd3\") " pod="openshift-multus/multus-sk9vq"
Jul 06 19:32:46.527788 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:32:46.525334    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/c7ddad9c-87f6-4618-b060-800e803d39c1-konnectivity-ca\") pod \"konnectivity-agent-xjxq2\" (UID: \"c7ddad9c-87f6-4618-b060-800e803d39c1\") " pod="kube-system/konnectivity-agent-xjxq2"
Jul 06 19:32:46.527788 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:32:46.525345    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/9f15114d-7494-4f17-8a4d-52185f7a2e35-systemd-units\") pod \"ovnkube-node-8kjqk\" (UID: \"9f15114d-7494-4f17-8a4d-52185f7a2e35\") " pod="openshift-ovn-kubernetes/ovnkube-node-8kjqk"
Jul 06 19:32:46.527788 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:32:46.525356    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/549d1922-a406-419b-a750-b7344fc1b9b8-etc-modprobe-d\") pod \"tuned-jf9t9\" (UID: \"549d1922-a406-419b-a750-b7344fc1b9b8\") " pod="openshift-cluster-node-tuning-operator/tuned-jf9t9"
Jul 06 19:32:46.528488 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:32:46.525386    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/9449cdae-9fc6-4f64-a88a-db3f2e08b626-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-cjmdl\" (UID: \"9449cdae-9fc6-4f64-a88a-db3f2e08b626\") " pod="openshift-multus/multus-additional-cni-plugins-cjmdl"
Jul 06 19:32:46.528488 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:32:46.525389    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/c6148c24-bfbd-4b4f-a4a8-774705b763bd-iptables-alerter-script\") pod \"iptables-alerter-bp6sh\" (UID: \"c6148c24-bfbd-4b4f-a4a8-774705b763bd\") " pod="openshift-network-operator/iptables-alerter-bp6sh"
Jul 06 19:32:46.528488 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:32:46.525420    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/35683ef3-3b68-4694-acaf-aaee8f598255-serviceca\") pod \"node-ca-cblv9\" (UID: \"35683ef3-3b68-4694-acaf-aaee8f598255\") " pod="openshift-image-registry/node-ca-cblv9"
Jul 06 19:32:46.528488 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:32:46.525429    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/9449cdae-9fc6-4f64-a88a-db3f2e08b626-cnibin\") pod \"multus-additional-cni-plugins-cjmdl\" (UID: \"9449cdae-9fc6-4f64-a88a-db3f2e08b626\") " pod="openshift-multus/multus-additional-cni-plugins-cjmdl"
Jul 06 19:32:46.528488 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:32:46.525437    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/549d1922-a406-419b-a750-b7344fc1b9b8-etc-modprobe-d\") pod \"tuned-jf9t9\" (UID: \"549d1922-a406-419b-a750-b7344fc1b9b8\") " pod="openshift-cluster-node-tuning-operator/tuned-jf9t9"
Jul 06 19:32:46.528488 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:32:46.525466    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/48a862e8-66cd-4899-8cd4-9a48ef610bd3-multus-conf-dir\") pod \"multus-sk9vq\" (UID: \"48a862e8-66cd-4899-8cd4-9a48ef610bd3\") " pod="openshift-multus/multus-sk9vq"
Jul 06 19:32:46.528488 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:32:46.525480    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/9449cdae-9fc6-4f64-a88a-db3f2e08b626-cnibin\") pod \"multus-additional-cni-plugins-cjmdl\" (UID: \"9449cdae-9fc6-4f64-a88a-db3f2e08b626\") " pod="openshift-multus/multus-additional-cni-plugins-cjmdl"
Jul 06 19:32:46.528488 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:32:46.525518    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/c7ddad9c-87f6-4618-b060-800e803d39c1-agent-certs\") pod \"konnectivity-agent-xjxq2\" (UID: \"c7ddad9c-87f6-4618-b060-800e803d39c1\") " pod="kube-system/konnectivity-agent-xjxq2"
Jul 06 19:32:46.528488 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:32:46.525551    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/9f15114d-7494-4f17-8a4d-52185f7a2e35-ovnkube-script-lib\") pod \"ovnkube-node-8kjqk\" (UID: \"9f15114d-7494-4f17-8a4d-52185f7a2e35\") " pod="openshift-ovn-kubernetes/ovnkube-node-8kjqk"
Jul 06 19:32:46.528488 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:32:46.525608    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/549d1922-a406-419b-a750-b7344fc1b9b8-etc-tuned\") pod \"tuned-jf9t9\" (UID: \"549d1922-a406-419b-a750-b7344fc1b9b8\") " pod="openshift-cluster-node-tuning-operator/tuned-jf9t9"
Jul 06 19:32:46.528488 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:32:46.525634    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/48a862e8-66cd-4899-8cd4-9a48ef610bd3-multus-conf-dir\") pod \"multus-sk9vq\" (UID: \"48a862e8-66cd-4899-8cd4-9a48ef610bd3\") " pod="openshift-multus/multus-sk9vq"
Jul 06 19:32:46.528488 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:32:46.525699    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/ef7753ea-b0a6-45e3-8e20-6a93bc9d1f76-socket-dir\") pod \"aws-ebs-csi-driver-node-jrxrv\" (UID: \"ef7753ea-b0a6-45e3-8e20-6a93bc9d1f76\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jrxrv"
Jul 06 19:32:46.528488 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:32:46.525753    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hs6bh\" (UniqueName: \"kubernetes.io/projected/ef7753ea-b0a6-45e3-8e20-6a93bc9d1f76-kube-api-access-hs6bh\") pod \"aws-ebs-csi-driver-node-jrxrv\" (UID: \"ef7753ea-b0a6-45e3-8e20-6a93bc9d1f76\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jrxrv"
Jul 06 19:32:46.528488 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:32:46.525764    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/ef7753ea-b0a6-45e3-8e20-6a93bc9d1f76-socket-dir\") pod \"aws-ebs-csi-driver-node-jrxrv\" (UID: \"ef7753ea-b0a6-45e3-8e20-6a93bc9d1f76\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jrxrv"
Jul 06 19:32:46.528488 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:32:46.525801    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/9f15114d-7494-4f17-8a4d-52185f7a2e35-node-log\") pod \"ovnkube-node-8kjqk\" (UID: \"9f15114d-7494-4f17-8a4d-52185f7a2e35\") " pod="openshift-ovn-kubernetes/ovnkube-node-8kjqk"
Jul 06 19:32:46.528488 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:32:46.525827    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/9f15114d-7494-4f17-8a4d-52185f7a2e35-ovnkube-config\") pod \"ovnkube-node-8kjqk\" (UID: \"9f15114d-7494-4f17-8a4d-52185f7a2e35\") " pod="openshift-ovn-kubernetes/ovnkube-node-8kjqk"
Jul 06 19:32:46.528488 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:32:46.525855    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/48a862e8-66cd-4899-8cd4-9a48ef610bd3-cnibin\") pod \"multus-sk9vq\" (UID: \"48a862e8-66cd-4899-8cd4-9a48ef610bd3\") " pod="openshift-multus/multus-sk9vq"
Jul 06 19:32:46.529119 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:32:46.525880    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/549d1922-a406-419b-a750-b7344fc1b9b8-lib-modules\") pod \"tuned-jf9t9\" (UID: \"549d1922-a406-419b-a750-b7344fc1b9b8\") " pod="openshift-cluster-node-tuning-operator/tuned-jf9t9"
Jul 06 19:32:46.529119 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:32:46.525902    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/9f15114d-7494-4f17-8a4d-52185f7a2e35-var-lib-openvswitch\") pod \"ovnkube-node-8kjqk\" (UID: \"9f15114d-7494-4f17-8a4d-52185f7a2e35\") " pod="openshift-ovn-kubernetes/ovnkube-node-8kjqk"
Jul 06 19:32:46.529119 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:32:46.525915    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/48a862e8-66cd-4899-8cd4-9a48ef610bd3-cni-binary-copy\") pod \"multus-sk9vq\" (UID: \"48a862e8-66cd-4899-8cd4-9a48ef610bd3\") " pod="openshift-multus/multus-sk9vq"
Jul 06 19:32:46.529119 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:32:46.525928    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/48a862e8-66cd-4899-8cd4-9a48ef610bd3-multus-socket-dir-parent\") pod \"multus-sk9vq\" (UID: \"48a862e8-66cd-4899-8cd4-9a48ef610bd3\") " pod="openshift-multus/multus-sk9vq"
Jul 06 19:32:46.529119 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:32:46.525899    2565 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory"
Jul 06 19:32:46.529119 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:32:46.525953    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/48a862e8-66cd-4899-8cd4-9a48ef610bd3-hostroot\") pod \"multus-sk9vq\" (UID: \"48a862e8-66cd-4899-8cd4-9a48ef610bd3\") " pod="openshift-multus/multus-sk9vq"
Jul 06 19:32:46.529119 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:32:46.525970    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/c6148c24-bfbd-4b4f-a4a8-774705b763bd-iptables-alerter-script\") pod \"iptables-alerter-bp6sh\" (UID: \"c6148c24-bfbd-4b4f-a4a8-774705b763bd\") " pod="openshift-network-operator/iptables-alerter-bp6sh"
Jul 06 19:32:46.529119 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:32:46.525976    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/549d1922-a406-419b-a750-b7344fc1b9b8-tmp\") pod \"tuned-jf9t9\" (UID: \"549d1922-a406-419b-a750-b7344fc1b9b8\") " pod="openshift-cluster-node-tuning-operator/tuned-jf9t9"
Jul 06 19:32:46.529119 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:32:46.525980    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/9f15114d-7494-4f17-8a4d-52185f7a2e35-node-log\") pod \"ovnkube-node-8kjqk\" (UID: \"9f15114d-7494-4f17-8a4d-52185f7a2e35\") " pod="openshift-ovn-kubernetes/ovnkube-node-8kjqk"
Jul 06 19:32:46.529119 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:32:46.526005    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/9f15114d-7494-4f17-8a4d-52185f7a2e35-etc-openvswitch\") pod \"ovnkube-node-8kjqk\" (UID: \"9f15114d-7494-4f17-8a4d-52185f7a2e35\") " pod="openshift-ovn-kubernetes/ovnkube-node-8kjqk"
Jul 06 19:32:46.529119 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:32:46.526016    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/c7ddad9c-87f6-4618-b060-800e803d39c1-konnectivity-ca\") pod \"konnectivity-agent-xjxq2\" (UID: \"c7ddad9c-87f6-4618-b060-800e803d39c1\") " pod="kube-system/konnectivity-agent-xjxq2"
Jul 06 19:32:46.529119 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:32:46.526029    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/9f15114d-7494-4f17-8a4d-52185f7a2e35-ovn-node-metrics-cert\") pod \"ovnkube-node-8kjqk\" (UID: \"9f15114d-7494-4f17-8a4d-52185f7a2e35\") " pod="openshift-ovn-kubernetes/ovnkube-node-8kjqk"
Jul 06 19:32:46.529119 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:32:46.526068    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/9f15114d-7494-4f17-8a4d-52185f7a2e35-var-lib-openvswitch\") pod \"ovnkube-node-8kjqk\" (UID: \"9f15114d-7494-4f17-8a4d-52185f7a2e35\") " pod="openshift-ovn-kubernetes/ovnkube-node-8kjqk"
Jul 06 19:32:46.529119 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:32:46.526087    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/48a862e8-66cd-4899-8cd4-9a48ef610bd3-cnibin\") pod \"multus-sk9vq\" (UID: \"48a862e8-66cd-4899-8cd4-9a48ef610bd3\") " pod="openshift-multus/multus-sk9vq"
Jul 06 19:32:46.529119 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:32:46.526117    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/48a862e8-66cd-4899-8cd4-9a48ef610bd3-hostroot\") pod \"multus-sk9vq\" (UID: \"48a862e8-66cd-4899-8cd4-9a48ef610bd3\") " pod="openshift-multus/multus-sk9vq"
Jul 06 19:32:46.529119 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:32:46.526121    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/48a862e8-66cd-4899-8cd4-9a48ef610bd3-multus-socket-dir-parent\") pod \"multus-sk9vq\" (UID: \"48a862e8-66cd-4899-8cd4-9a48ef610bd3\") " pod="openshift-multus/multus-sk9vq"
Jul 06 19:32:46.529119 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:32:46.526124    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/9f15114d-7494-4f17-8a4d-52185f7a2e35-etc-openvswitch\") pod \"ovnkube-node-8kjqk\" (UID: \"9f15114d-7494-4f17-8a4d-52185f7a2e35\") " pod="openshift-ovn-kubernetes/ovnkube-node-8kjqk"
Jul 06 19:32:46.529119 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:32:46.526088    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/549d1922-a406-419b-a750-b7344fc1b9b8-lib-modules\") pod \"tuned-jf9t9\" (UID: \"549d1922-a406-419b-a750-b7344fc1b9b8\") " pod="openshift-cluster-node-tuning-operator/tuned-jf9t9"
Jul 06 19:32:46.529608 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:32:46.526249    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/9f15114d-7494-4f17-8a4d-52185f7a2e35-host-kubelet\") pod \"ovnkube-node-8kjqk\" (UID: \"9f15114d-7494-4f17-8a4d-52185f7a2e35\") " pod="openshift-ovn-kubernetes/ovnkube-node-8kjqk"
Jul 06 19:32:46.529608 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:32:46.526355    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/9f15114d-7494-4f17-8a4d-52185f7a2e35-ovnkube-config\") pod \"ovnkube-node-8kjqk\" (UID: \"9f15114d-7494-4f17-8a4d-52185f7a2e35\") " pod="openshift-ovn-kubernetes/ovnkube-node-8kjqk"
Jul 06 19:32:46.529608 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:32:46.528851    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/549d1922-a406-419b-a750-b7344fc1b9b8-tmp\") pod \"tuned-jf9t9\" (UID: \"549d1922-a406-419b-a750-b7344fc1b9b8\") " pod="openshift-cluster-node-tuning-operator/tuned-jf9t9"
Jul 06 19:32:46.529608 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:32:46.528895    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/549d1922-a406-419b-a750-b7344fc1b9b8-etc-tuned\") pod \"tuned-jf9t9\" (UID: \"549d1922-a406-419b-a750-b7344fc1b9b8\") " pod="openshift-cluster-node-tuning-operator/tuned-jf9t9"
Jul 06 19:32:46.529608 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:32:46.529052    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/9f15114d-7494-4f17-8a4d-52185f7a2e35-ovn-node-metrics-cert\") pod \"ovnkube-node-8kjqk\" (UID: \"9f15114d-7494-4f17-8a4d-52185f7a2e35\") " pod="openshift-ovn-kubernetes/ovnkube-node-8kjqk"
Jul 06 19:32:46.529608 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:32:46.529090    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/c7ddad9c-87f6-4618-b060-800e803d39c1-agent-certs\") pod \"konnectivity-agent-xjxq2\" (UID: \"c7ddad9c-87f6-4618-b060-800e803d39c1\") " pod="kube-system/konnectivity-agent-xjxq2"
Jul 06 19:32:46.533269 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:32:46.533250    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-fvw7c\" (UniqueName: \"kubernetes.io/projected/48a862e8-66cd-4899-8cd4-9a48ef610bd3-kube-api-access-fvw7c\") pod \"multus-sk9vq\" (UID: \"48a862e8-66cd-4899-8cd4-9a48ef610bd3\") " pod="openshift-multus/multus-sk9vq"
Jul 06 19:32:46.535051 ip-10-0-131-168 kubenswrapper[2565]: E0706 19:32:46.535035    2565 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 06 19:32:46.535117 ip-10-0-131-168 kubenswrapper[2565]: E0706 19:32:46.535059    2565 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 06 19:32:46.535117 ip-10-0-131-168 kubenswrapper[2565]: E0706 19:32:46.535073    2565 projected.go:196] Error preparing data for projected volume kube-api-access-bhj6j for pod openshift-network-diagnostics/network-check-target-pc8fq: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 06 19:32:46.535241 ip-10-0-131-168 kubenswrapper[2565]: E0706 19:32:46.535149    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/1cda8348-291c-4665-99e9-892c67fb326d-kube-api-access-bhj6j podName:1cda8348-291c-4665-99e9-892c67fb326d nodeName:}" failed. No retries permitted until 2026-07-06 19:32:47.035131489 +0000 UTC m=+2.048120139 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-bhj6j" (UniqueName: "kubernetes.io/projected/1cda8348-291c-4665-99e9-892c67fb326d-kube-api-access-bhj6j") pod "network-check-target-pc8fq" (UID: "1cda8348-291c-4665-99e9-892c67fb326d") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 06 19:32:46.536572 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:32:46.536547    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5bwm6\" (UniqueName: \"kubernetes.io/projected/35683ef3-3b68-4694-acaf-aaee8f598255-kube-api-access-5bwm6\") pod \"node-ca-cblv9\" (UID: \"35683ef3-3b68-4694-acaf-aaee8f598255\") " pod="openshift-image-registry/node-ca-cblv9"
Jul 06 19:32:46.536834 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:32:46.536761    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-kk247\" (UniqueName: \"kubernetes.io/projected/c6148c24-bfbd-4b4f-a4a8-774705b763bd-kube-api-access-kk247\") pod \"iptables-alerter-bp6sh\" (UID: \"c6148c24-bfbd-4b4f-a4a8-774705b763bd\") " pod="openshift-network-operator/iptables-alerter-bp6sh"
Jul 06 19:32:46.537559 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:32:46.537539    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-td4tw\" (UniqueName: \"kubernetes.io/projected/0ecbe788-9e2c-446a-b154-7b805f3983dd-kube-api-access-td4tw\") pod \"node-resolver-kx6hd\" (UID: \"0ecbe788-9e2c-446a-b154-7b805f3983dd\") " pod="openshift-dns/node-resolver-kx6hd"
Jul 06 19:32:46.537656 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:32:46.537587    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-p692c\" (UniqueName: \"kubernetes.io/projected/0657d2af-82f5-428a-ba3e-fe3df6d74f8b-kube-api-access-p692c\") pod \"network-metrics-daemon-9lc4r\" (UID: \"0657d2af-82f5-428a-ba3e-fe3df6d74f8b\") " pod="openshift-multus/network-metrics-daemon-9lc4r"
Jul 06 19:32:46.537656 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:32:46.537608    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6wvnd\" (UniqueName: \"kubernetes.io/projected/549d1922-a406-419b-a750-b7344fc1b9b8-kube-api-access-6wvnd\") pod \"tuned-jf9t9\" (UID: \"549d1922-a406-419b-a750-b7344fc1b9b8\") " pod="openshift-cluster-node-tuning-operator/tuned-jf9t9"
Jul 06 19:32:46.537888 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:32:46.537870    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gngg2\" (UniqueName: \"kubernetes.io/projected/9f15114d-7494-4f17-8a4d-52185f7a2e35-kube-api-access-gngg2\") pod \"ovnkube-node-8kjqk\" (UID: \"9f15114d-7494-4f17-8a4d-52185f7a2e35\") " pod="openshift-ovn-kubernetes/ovnkube-node-8kjqk"
Jul 06 19:32:46.538332 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:32:46.538313    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4cmz8\" (UniqueName: \"kubernetes.io/projected/9449cdae-9fc6-4f64-a88a-db3f2e08b626-kube-api-access-4cmz8\") pod \"multus-additional-cni-plugins-cjmdl\" (UID: \"9449cdae-9fc6-4f64-a88a-db3f2e08b626\") " pod="openshift-multus/multus-additional-cni-plugins-cjmdl"
Jul 06 19:32:46.542402 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:32:46.542386    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hs6bh\" (UniqueName: \"kubernetes.io/projected/ef7753ea-b0a6-45e3-8e20-6a93bc9d1f76-kube-api-access-hs6bh\") pod \"aws-ebs-csi-driver-node-jrxrv\" (UID: \"ef7753ea-b0a6-45e3-8e20-6a93bc9d1f76\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jrxrv"
Jul 06 19:32:46.544646 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:32:46.544630    2565 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 06 19:32:46.641580 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:32:46.641552    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jrxrv"
Jul 06 19:32:46.651390 ip-10-0-131-168 kubenswrapper[2565]: W0706 19:32:46.651364    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podef7753ea_b0a6_45e3_8e20_6a93bc9d1f76.slice/crio-d0458d1f441479d134e3584a649ac247a31a6f41194f096456f8f546b930acb1 WatchSource:0}: Error finding container d0458d1f441479d134e3584a649ac247a31a6f41194f096456f8f546b930acb1: Status 404 returned error can't find the container with id d0458d1f441479d134e3584a649ac247a31a6f41194f096456f8f546b930acb1
Jul 06 19:32:46.665937 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:32:46.665913    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-cblv9"
Jul 06 19:32:46.674105 ip-10-0-131-168 kubenswrapper[2565]: W0706 19:32:46.674079    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod35683ef3_3b68_4694_acaf_aaee8f598255.slice/crio-a67233a87c634f0654047e892516ce84c0cb12743d49405ab48add839a1d4a8e WatchSource:0}: Error finding container a67233a87c634f0654047e892516ce84c0cb12743d49405ab48add839a1d4a8e: Status 404 returned error can't find the container with id a67233a87c634f0654047e892516ce84c0cb12743d49405ab48add839a1d4a8e
Jul 06 19:32:46.684653 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:32:46.684635    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-cjmdl"
Jul 06 19:32:46.693062 ip-10-0-131-168 kubenswrapper[2565]: W0706 19:32:46.693036    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9449cdae_9fc6_4f64_a88a_db3f2e08b626.slice/crio-7c3264c056c5d2ca268c8d014da836374f9ebd8c118fd97ec893bf3f4481c00e WatchSource:0}: Error finding container 7c3264c056c5d2ca268c8d014da836374f9ebd8c118fd97ec893bf3f4481c00e: Status 404 returned error can't find the container with id 7c3264c056c5d2ca268c8d014da836374f9ebd8c118fd97ec893bf3f4481c00e
Jul 06 19:32:46.701451 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:32:46.701435    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-sk9vq"
Jul 06 19:32:46.709062 ip-10-0-131-168 kubenswrapper[2565]: W0706 19:32:46.709041    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod48a862e8_66cd_4899_8cd4_9a48ef610bd3.slice/crio-f322caed355474a874840cb094464dd2110b82640a0f239110b384332e5d3c4e WatchSource:0}: Error finding container f322caed355474a874840cb094464dd2110b82640a0f239110b384332e5d3c4e: Status 404 returned error can't find the container with id f322caed355474a874840cb094464dd2110b82640a0f239110b384332e5d3c4e
Jul 06 19:32:46.716890 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:32:46.716874    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-8kjqk"
Jul 06 19:32:46.724467 ip-10-0-131-168 kubenswrapper[2565]: W0706 19:32:46.724444    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9f15114d_7494_4f17_8a4d_52185f7a2e35.slice/crio-fa046326ceb263dfd0eea98f9b15b0e8528c6b8140b32c37a9c8f4fe8dcef259 WatchSource:0}: Error finding container fa046326ceb263dfd0eea98f9b15b0e8528c6b8140b32c37a9c8f4fe8dcef259: Status 404 returned error can't find the container with id fa046326ceb263dfd0eea98f9b15b0e8528c6b8140b32c37a9c8f4fe8dcef259
Jul 06 19:32:46.732319 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:32:46.732303    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-xjxq2"
Jul 06 19:32:46.739962 ip-10-0-131-168 kubenswrapper[2565]: W0706 19:32:46.739945    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc7ddad9c_87f6_4618_b060_800e803d39c1.slice/crio-3ebe82ac5b218f0a590a1019c875d349d5bafa9055fbfa6deb34f693a9e738f6 WatchSource:0}: Error finding container 3ebe82ac5b218f0a590a1019c875d349d5bafa9055fbfa6deb34f693a9e738f6: Status 404 returned error can't find the container with id 3ebe82ac5b218f0a590a1019c875d349d5bafa9055fbfa6deb34f693a9e738f6
Jul 06 19:32:46.748654 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:32:46.748639    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-jf9t9"
Jul 06 19:32:46.754886 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:32:46.754870    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-kx6hd"
Jul 06 19:32:46.756318 ip-10-0-131-168 kubenswrapper[2565]: W0706 19:32:46.756289    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod549d1922_a406_419b_a750_b7344fc1b9b8.slice/crio-1eb67039282d89df5fccfd241df3bd8a50347485b65ef6ecd0e6e5bb49f0ab18 WatchSource:0}: Error finding container 1eb67039282d89df5fccfd241df3bd8a50347485b65ef6ecd0e6e5bb49f0ab18: Status 404 returned error can't find the container with id 1eb67039282d89df5fccfd241df3bd8a50347485b65ef6ecd0e6e5bb49f0ab18
Jul 06 19:32:46.763424 ip-10-0-131-168 kubenswrapper[2565]: W0706 19:32:46.763391    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0ecbe788_9e2c_446a_b154_7b805f3983dd.slice/crio-7865dc8978ccac0927ec5673c5e877de0e258f309e0585afa77f69c91d028316 WatchSource:0}: Error finding container 7865dc8978ccac0927ec5673c5e877de0e258f309e0585afa77f69c91d028316: Status 404 returned error can't find the container with id 7865dc8978ccac0927ec5673c5e877de0e258f309e0585afa77f69c91d028316
Jul 06 19:32:46.764031 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:32:46.764016    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-bp6sh"
Jul 06 19:32:46.771977 ip-10-0-131-168 kubenswrapper[2565]: W0706 19:32:46.771959    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc6148c24_bfbd_4b4f_a4a8_774705b763bd.slice/crio-1f07ec04e0ef5003cd6d22af61808079326b7afca2e60d533c5623c8a1b106a8 WatchSource:0}: Error finding container 1f07ec04e0ef5003cd6d22af61808079326b7afca2e60d533c5623c8a1b106a8: Status 404 returned error can't find the container with id 1f07ec04e0ef5003cd6d22af61808079326b7afca2e60d533c5623c8a1b106a8
Jul 06 19:32:47.029904 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:32:47.029819    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/67af2b66-be49-4b61-a200-b711f4d83397-original-pull-secret\") pod \"global-pull-secret-syncer-2rdm6\" (UID: \"67af2b66-be49-4b61-a200-b711f4d83397\") " pod="kube-system/global-pull-secret-syncer-2rdm6"
Jul 06 19:32:47.029904 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:32:47.029893    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0657d2af-82f5-428a-ba3e-fe3df6d74f8b-metrics-certs\") pod \"network-metrics-daemon-9lc4r\" (UID: \"0657d2af-82f5-428a-ba3e-fe3df6d74f8b\") " pod="openshift-multus/network-metrics-daemon-9lc4r"
Jul 06 19:32:47.030109 ip-10-0-131-168 kubenswrapper[2565]: E0706 19:32:47.030025    2565 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 06 19:32:47.030109 ip-10-0-131-168 kubenswrapper[2565]: E0706 19:32:47.030085    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0657d2af-82f5-428a-ba3e-fe3df6d74f8b-metrics-certs podName:0657d2af-82f5-428a-ba3e-fe3df6d74f8b nodeName:}" failed. No retries permitted until 2026-07-06 19:32:48.030067884 +0000 UTC m=+3.043056533 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/0657d2af-82f5-428a-ba3e-fe3df6d74f8b-metrics-certs") pod "network-metrics-daemon-9lc4r" (UID: "0657d2af-82f5-428a-ba3e-fe3df6d74f8b") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 06 19:32:47.030426 ip-10-0-131-168 kubenswrapper[2565]: E0706 19:32:47.030346    2565 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 06 19:32:47.030426 ip-10-0-131-168 kubenswrapper[2565]: E0706 19:32:47.030404    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/67af2b66-be49-4b61-a200-b711f4d83397-original-pull-secret podName:67af2b66-be49-4b61-a200-b711f4d83397 nodeName:}" failed. No retries permitted until 2026-07-06 19:32:48.030387248 +0000 UTC m=+3.043375909 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/67af2b66-be49-4b61-a200-b711f4d83397-original-pull-secret") pod "global-pull-secret-syncer-2rdm6" (UID: "67af2b66-be49-4b61-a200-b711f4d83397") : object "kube-system"/"original-pull-secret" not registered
Jul 06 19:32:47.131003 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:32:47.130961    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bhj6j\" (UniqueName: \"kubernetes.io/projected/1cda8348-291c-4665-99e9-892c67fb326d-kube-api-access-bhj6j\") pod \"network-check-target-pc8fq\" (UID: \"1cda8348-291c-4665-99e9-892c67fb326d\") " pod="openshift-network-diagnostics/network-check-target-pc8fq"
Jul 06 19:32:47.131210 ip-10-0-131-168 kubenswrapper[2565]: E0706 19:32:47.131187    2565 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 06 19:32:47.131303 ip-10-0-131-168 kubenswrapper[2565]: E0706 19:32:47.131230    2565 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 06 19:32:47.131303 ip-10-0-131-168 kubenswrapper[2565]: E0706 19:32:47.131246    2565 projected.go:196] Error preparing data for projected volume kube-api-access-bhj6j for pod openshift-network-diagnostics/network-check-target-pc8fq: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 06 19:32:47.131411 ip-10-0-131-168 kubenswrapper[2565]: E0706 19:32:47.131305    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/1cda8348-291c-4665-99e9-892c67fb326d-kube-api-access-bhj6j podName:1cda8348-291c-4665-99e9-892c67fb326d nodeName:}" failed. No retries permitted until 2026-07-06 19:32:48.131286865 +0000 UTC m=+3.144275529 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-bhj6j" (UniqueName: "kubernetes.io/projected/1cda8348-291c-4665-99e9-892c67fb326d-kube-api-access-bhj6j") pod "network-check-target-pc8fq" (UID: "1cda8348-291c-4665-99e9-892c67fb326d") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 06 19:32:47.369200 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:32:47.368580    2565 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-05 19:27:46 +0000 UTC" deadline="2027-12-22 10:04:11.481002723 +0000 UTC"
Jul 06 19:32:47.369200 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:32:47.368644    2565 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="12806h31m24.112364036s"
Jul 06 19:32:47.451398 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:32:47.451191    2565 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 06 19:32:47.491185 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:32:47.491158    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-pc8fq"
Jul 06 19:32:47.491362 ip-10-0-131-168 kubenswrapper[2565]: E0706 19:32:47.491300    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-pc8fq" podUID="1cda8348-291c-4665-99e9-892c67fb326d"
Jul 06 19:32:47.491689 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:32:47.491670    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-2rdm6"
Jul 06 19:32:47.491804 ip-10-0-131-168 kubenswrapper[2565]: E0706 19:32:47.491784    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-2rdm6" podUID="67af2b66-be49-4b61-a200-b711f4d83397"
Jul 06 19:32:47.525073 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:32:47.525035    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-bp6sh" event={"ID":"c6148c24-bfbd-4b4f-a4a8-774705b763bd","Type":"ContainerStarted","Data":"1f07ec04e0ef5003cd6d22af61808079326b7afca2e60d533c5623c8a1b106a8"}
Jul 06 19:32:47.536565 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:32:47.536508    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-jf9t9" event={"ID":"549d1922-a406-419b-a750-b7344fc1b9b8","Type":"ContainerStarted","Data":"1eb67039282d89df5fccfd241df3bd8a50347485b65ef6ecd0e6e5bb49f0ab18"}
Jul 06 19:32:47.543904 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:32:47.543875    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-8kjqk" event={"ID":"9f15114d-7494-4f17-8a4d-52185f7a2e35","Type":"ContainerStarted","Data":"fa046326ceb263dfd0eea98f9b15b0e8528c6b8140b32c37a9c8f4fe8dcef259"}
Jul 06 19:32:47.550185 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:32:47.550158    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jrxrv" event={"ID":"ef7753ea-b0a6-45e3-8e20-6a93bc9d1f76","Type":"ContainerStarted","Data":"d0458d1f441479d134e3584a649ac247a31a6f41194f096456f8f546b930acb1"}
Jul 06 19:32:47.569228 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:32:47.569187    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-kx6hd" event={"ID":"0ecbe788-9e2c-446a-b154-7b805f3983dd","Type":"ContainerStarted","Data":"7865dc8978ccac0927ec5673c5e877de0e258f309e0585afa77f69c91d028316"}
Jul 06 19:32:47.571279 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:32:47.571251    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-xjxq2" event={"ID":"c7ddad9c-87f6-4618-b060-800e803d39c1","Type":"ContainerStarted","Data":"3ebe82ac5b218f0a590a1019c875d349d5bafa9055fbfa6deb34f693a9e738f6"}
Jul 06 19:32:47.581293 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:32:47.581266    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-sk9vq" event={"ID":"48a862e8-66cd-4899-8cd4-9a48ef610bd3","Type":"ContainerStarted","Data":"f322caed355474a874840cb094464dd2110b82640a0f239110b384332e5d3c4e"}
Jul 06 19:32:47.588154 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:32:47.588127    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-cjmdl" event={"ID":"9449cdae-9fc6-4f64-a88a-db3f2e08b626","Type":"ContainerStarted","Data":"7c3264c056c5d2ca268c8d014da836374f9ebd8c118fd97ec893bf3f4481c00e"}
Jul 06 19:32:47.602842 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:32:47.602811    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-cblv9" event={"ID":"35683ef3-3b68-4694-acaf-aaee8f598255","Type":"ContainerStarted","Data":"a67233a87c634f0654047e892516ce84c0cb12743d49405ab48add839a1d4a8e"}
Jul 06 19:32:48.039399 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:32:48.039364    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0657d2af-82f5-428a-ba3e-fe3df6d74f8b-metrics-certs\") pod \"network-metrics-daemon-9lc4r\" (UID: \"0657d2af-82f5-428a-ba3e-fe3df6d74f8b\") " pod="openshift-multus/network-metrics-daemon-9lc4r"
Jul 06 19:32:48.039586 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:32:48.039444    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/67af2b66-be49-4b61-a200-b711f4d83397-original-pull-secret\") pod \"global-pull-secret-syncer-2rdm6\" (UID: \"67af2b66-be49-4b61-a200-b711f4d83397\") " pod="kube-system/global-pull-secret-syncer-2rdm6"
Jul 06 19:32:48.039586 ip-10-0-131-168 kubenswrapper[2565]: E0706 19:32:48.039581    2565 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 06 19:32:48.039696 ip-10-0-131-168 kubenswrapper[2565]: E0706 19:32:48.039637    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/67af2b66-be49-4b61-a200-b711f4d83397-original-pull-secret podName:67af2b66-be49-4b61-a200-b711f4d83397 nodeName:}" failed. No retries permitted until 2026-07-06 19:32:50.039619544 +0000 UTC m=+5.052608193 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/67af2b66-be49-4b61-a200-b711f4d83397-original-pull-secret") pod "global-pull-secret-syncer-2rdm6" (UID: "67af2b66-be49-4b61-a200-b711f4d83397") : object "kube-system"/"original-pull-secret" not registered
Jul 06 19:32:48.040050 ip-10-0-131-168 kubenswrapper[2565]: E0706 19:32:48.040021    2565 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 06 19:32:48.040134 ip-10-0-131-168 kubenswrapper[2565]: E0706 19:32:48.040073    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0657d2af-82f5-428a-ba3e-fe3df6d74f8b-metrics-certs podName:0657d2af-82f5-428a-ba3e-fe3df6d74f8b nodeName:}" failed. No retries permitted until 2026-07-06 19:32:50.040058091 +0000 UTC m=+5.053046741 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/0657d2af-82f5-428a-ba3e-fe3df6d74f8b-metrics-certs") pod "network-metrics-daemon-9lc4r" (UID: "0657d2af-82f5-428a-ba3e-fe3df6d74f8b") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 06 19:32:48.140885 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:32:48.140260    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bhj6j\" (UniqueName: \"kubernetes.io/projected/1cda8348-291c-4665-99e9-892c67fb326d-kube-api-access-bhj6j\") pod \"network-check-target-pc8fq\" (UID: \"1cda8348-291c-4665-99e9-892c67fb326d\") " pod="openshift-network-diagnostics/network-check-target-pc8fq"
Jul 06 19:32:48.140885 ip-10-0-131-168 kubenswrapper[2565]: E0706 19:32:48.140464    2565 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 06 19:32:48.140885 ip-10-0-131-168 kubenswrapper[2565]: E0706 19:32:48.140483    2565 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 06 19:32:48.140885 ip-10-0-131-168 kubenswrapper[2565]: E0706 19:32:48.140499    2565 projected.go:196] Error preparing data for projected volume kube-api-access-bhj6j for pod openshift-network-diagnostics/network-check-target-pc8fq: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 06 19:32:48.140885 ip-10-0-131-168 kubenswrapper[2565]: E0706 19:32:48.140551    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/1cda8348-291c-4665-99e9-892c67fb326d-kube-api-access-bhj6j podName:1cda8348-291c-4665-99e9-892c67fb326d nodeName:}" failed. No retries permitted until 2026-07-06 19:32:50.140534973 +0000 UTC m=+5.153523640 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-bhj6j" (UniqueName: "kubernetes.io/projected/1cda8348-291c-4665-99e9-892c67fb326d-kube-api-access-bhj6j") pod "network-check-target-pc8fq" (UID: "1cda8348-291c-4665-99e9-892c67fb326d") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 06 19:32:48.270007 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:32:48.269979    2565 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 06 19:32:48.369274 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:32:48.369195    2565 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-05 19:27:46 +0000 UTC" deadline="2028-04-17 03:39:53.911337738 +0000 UTC"
Jul 06 19:32:48.369274 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:32:48.369230    2565 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="15608h7m5.542112059s"
Jul 06 19:32:48.489719 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:32:48.489687    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-9lc4r"
Jul 06 19:32:48.489884 ip-10-0-131-168 kubenswrapper[2565]: E0706 19:32:48.489845    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-9lc4r" podUID="0657d2af-82f5-428a-ba3e-fe3df6d74f8b"
Jul 06 19:32:49.201522 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:32:49.201488    2565 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 06 19:32:49.491436 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:32:49.491361    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-2rdm6"
Jul 06 19:32:49.491996 ip-10-0-131-168 kubenswrapper[2565]: E0706 19:32:49.491488    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-2rdm6" podUID="67af2b66-be49-4b61-a200-b711f4d83397"
Jul 06 19:32:49.491996 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:32:49.491555    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-pc8fq"
Jul 06 19:32:49.491996 ip-10-0-131-168 kubenswrapper[2565]: E0706 19:32:49.491623    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-pc8fq" podUID="1cda8348-291c-4665-99e9-892c67fb326d"
Jul 06 19:32:50.063009 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:32:50.062973    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0657d2af-82f5-428a-ba3e-fe3df6d74f8b-metrics-certs\") pod \"network-metrics-daemon-9lc4r\" (UID: \"0657d2af-82f5-428a-ba3e-fe3df6d74f8b\") " pod="openshift-multus/network-metrics-daemon-9lc4r"
Jul 06 19:32:50.063189 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:32:50.063132    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/67af2b66-be49-4b61-a200-b711f4d83397-original-pull-secret\") pod \"global-pull-secret-syncer-2rdm6\" (UID: \"67af2b66-be49-4b61-a200-b711f4d83397\") " pod="kube-system/global-pull-secret-syncer-2rdm6"
Jul 06 19:32:50.063189 ip-10-0-131-168 kubenswrapper[2565]: E0706 19:32:50.063145    2565 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 06 19:32:50.063328 ip-10-0-131-168 kubenswrapper[2565]: E0706 19:32:50.063225    2565 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 06 19:32:50.063328 ip-10-0-131-168 kubenswrapper[2565]: E0706 19:32:50.063265    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0657d2af-82f5-428a-ba3e-fe3df6d74f8b-metrics-certs podName:0657d2af-82f5-428a-ba3e-fe3df6d74f8b nodeName:}" failed. No retries permitted until 2026-07-06 19:32:54.063245592 +0000 UTC m=+9.076234242 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/0657d2af-82f5-428a-ba3e-fe3df6d74f8b-metrics-certs") pod "network-metrics-daemon-9lc4r" (UID: "0657d2af-82f5-428a-ba3e-fe3df6d74f8b") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 06 19:32:50.063328 ip-10-0-131-168 kubenswrapper[2565]: E0706 19:32:50.063286    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/67af2b66-be49-4b61-a200-b711f4d83397-original-pull-secret podName:67af2b66-be49-4b61-a200-b711f4d83397 nodeName:}" failed. No retries permitted until 2026-07-06 19:32:54.0632754 +0000 UTC m=+9.076264051 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/67af2b66-be49-4b61-a200-b711f4d83397-original-pull-secret") pod "global-pull-secret-syncer-2rdm6" (UID: "67af2b66-be49-4b61-a200-b711f4d83397") : object "kube-system"/"original-pull-secret" not registered
Jul 06 19:32:50.164044 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:32:50.163904    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bhj6j\" (UniqueName: \"kubernetes.io/projected/1cda8348-291c-4665-99e9-892c67fb326d-kube-api-access-bhj6j\") pod \"network-check-target-pc8fq\" (UID: \"1cda8348-291c-4665-99e9-892c67fb326d\") " pod="openshift-network-diagnostics/network-check-target-pc8fq"
Jul 06 19:32:50.164226 ip-10-0-131-168 kubenswrapper[2565]: E0706 19:32:50.164120    2565 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 06 19:32:50.164226 ip-10-0-131-168 kubenswrapper[2565]: E0706 19:32:50.164152    2565 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 06 19:32:50.164226 ip-10-0-131-168 kubenswrapper[2565]: E0706 19:32:50.164166    2565 projected.go:196] Error preparing data for projected volume kube-api-access-bhj6j for pod openshift-network-diagnostics/network-check-target-pc8fq: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 06 19:32:50.164226 ip-10-0-131-168 kubenswrapper[2565]: E0706 19:32:50.164227    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/1cda8348-291c-4665-99e9-892c67fb326d-kube-api-access-bhj6j podName:1cda8348-291c-4665-99e9-892c67fb326d nodeName:}" failed. No retries permitted until 2026-07-06 19:32:54.164207375 +0000 UTC m=+9.177196026 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-bhj6j" (UniqueName: "kubernetes.io/projected/1cda8348-291c-4665-99e9-892c67fb326d-kube-api-access-bhj6j") pod "network-check-target-pc8fq" (UID: "1cda8348-291c-4665-99e9-892c67fb326d") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 06 19:32:50.489336 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:32:50.489302    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-9lc4r"
Jul 06 19:32:50.489509 ip-10-0-131-168 kubenswrapper[2565]: E0706 19:32:50.489453    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-9lc4r" podUID="0657d2af-82f5-428a-ba3e-fe3df6d74f8b"
Jul 06 19:32:51.489287 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:32:51.489260    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-2rdm6"
Jul 06 19:32:51.489726 ip-10-0-131-168 kubenswrapper[2565]: E0706 19:32:51.489392    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-2rdm6" podUID="67af2b66-be49-4b61-a200-b711f4d83397"
Jul 06 19:32:51.489726 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:32:51.489454    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-pc8fq"
Jul 06 19:32:51.489726 ip-10-0-131-168 kubenswrapper[2565]: E0706 19:32:51.489563    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-pc8fq" podUID="1cda8348-291c-4665-99e9-892c67fb326d"
Jul 06 19:32:52.489302 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:32:52.489270    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-9lc4r"
Jul 06 19:32:52.489810 ip-10-0-131-168 kubenswrapper[2565]: E0706 19:32:52.489472    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-9lc4r" podUID="0657d2af-82f5-428a-ba3e-fe3df6d74f8b"
Jul 06 19:32:53.489103 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:32:53.489067    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-2rdm6"
Jul 06 19:32:53.489282 ip-10-0-131-168 kubenswrapper[2565]: E0706 19:32:53.489200    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-2rdm6" podUID="67af2b66-be49-4b61-a200-b711f4d83397"
Jul 06 19:32:53.489592 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:32:53.489571    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-pc8fq"
Jul 06 19:32:53.489964 ip-10-0-131-168 kubenswrapper[2565]: E0706 19:32:53.489688    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-pc8fq" podUID="1cda8348-291c-4665-99e9-892c67fb326d"
Jul 06 19:32:54.098238 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:32:54.098198    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/67af2b66-be49-4b61-a200-b711f4d83397-original-pull-secret\") pod \"global-pull-secret-syncer-2rdm6\" (UID: \"67af2b66-be49-4b61-a200-b711f4d83397\") " pod="kube-system/global-pull-secret-syncer-2rdm6"
Jul 06 19:32:54.098461 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:32:54.098270    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0657d2af-82f5-428a-ba3e-fe3df6d74f8b-metrics-certs\") pod \"network-metrics-daemon-9lc4r\" (UID: \"0657d2af-82f5-428a-ba3e-fe3df6d74f8b\") " pod="openshift-multus/network-metrics-daemon-9lc4r"
Jul 06 19:32:54.098461 ip-10-0-131-168 kubenswrapper[2565]: E0706 19:32:54.098373    2565 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 06 19:32:54.098461 ip-10-0-131-168 kubenswrapper[2565]: E0706 19:32:54.098389    2565 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 06 19:32:54.098461 ip-10-0-131-168 kubenswrapper[2565]: E0706 19:32:54.098456    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/67af2b66-be49-4b61-a200-b711f4d83397-original-pull-secret podName:67af2b66-be49-4b61-a200-b711f4d83397 nodeName:}" failed. No retries permitted until 2026-07-06 19:33:02.098437212 +0000 UTC m=+17.111425873 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/67af2b66-be49-4b61-a200-b711f4d83397-original-pull-secret") pod "global-pull-secret-syncer-2rdm6" (UID: "67af2b66-be49-4b61-a200-b711f4d83397") : object "kube-system"/"original-pull-secret" not registered
Jul 06 19:32:54.098635 ip-10-0-131-168 kubenswrapper[2565]: E0706 19:32:54.098478    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0657d2af-82f5-428a-ba3e-fe3df6d74f8b-metrics-certs podName:0657d2af-82f5-428a-ba3e-fe3df6d74f8b nodeName:}" failed. No retries permitted until 2026-07-06 19:33:02.098467365 +0000 UTC m=+17.111456025 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/0657d2af-82f5-428a-ba3e-fe3df6d74f8b-metrics-certs") pod "network-metrics-daemon-9lc4r" (UID: "0657d2af-82f5-428a-ba3e-fe3df6d74f8b") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 06 19:32:54.199270 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:32:54.199160    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bhj6j\" (UniqueName: \"kubernetes.io/projected/1cda8348-291c-4665-99e9-892c67fb326d-kube-api-access-bhj6j\") pod \"network-check-target-pc8fq\" (UID: \"1cda8348-291c-4665-99e9-892c67fb326d\") " pod="openshift-network-diagnostics/network-check-target-pc8fq"
Jul 06 19:32:54.199470 ip-10-0-131-168 kubenswrapper[2565]: E0706 19:32:54.199376    2565 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 06 19:32:54.199470 ip-10-0-131-168 kubenswrapper[2565]: E0706 19:32:54.199399    2565 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 06 19:32:54.199470 ip-10-0-131-168 kubenswrapper[2565]: E0706 19:32:54.199410    2565 projected.go:196] Error preparing data for projected volume kube-api-access-bhj6j for pod openshift-network-diagnostics/network-check-target-pc8fq: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 06 19:32:54.199470 ip-10-0-131-168 kubenswrapper[2565]: E0706 19:32:54.199466    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/1cda8348-291c-4665-99e9-892c67fb326d-kube-api-access-bhj6j podName:1cda8348-291c-4665-99e9-892c67fb326d nodeName:}" failed. No retries permitted until 2026-07-06 19:33:02.199450341 +0000 UTC m=+17.212439000 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-bhj6j" (UniqueName: "kubernetes.io/projected/1cda8348-291c-4665-99e9-892c67fb326d-kube-api-access-bhj6j") pod "network-check-target-pc8fq" (UID: "1cda8348-291c-4665-99e9-892c67fb326d") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 06 19:32:54.489073 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:32:54.488746    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-9lc4r"
Jul 06 19:32:54.489073 ip-10-0-131-168 kubenswrapper[2565]: E0706 19:32:54.488914    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-9lc4r" podUID="0657d2af-82f5-428a-ba3e-fe3df6d74f8b"
Jul 06 19:32:55.490314 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:32:55.490276    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-2rdm6"
Jul 06 19:32:55.490795 ip-10-0-131-168 kubenswrapper[2565]: E0706 19:32:55.490389    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-2rdm6" podUID="67af2b66-be49-4b61-a200-b711f4d83397"
Jul 06 19:32:55.490795 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:32:55.490414    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-pc8fq"
Jul 06 19:32:55.490795 ip-10-0-131-168 kubenswrapper[2565]: E0706 19:32:55.490516    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-pc8fq" podUID="1cda8348-291c-4665-99e9-892c67fb326d"
Jul 06 19:32:56.488760 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:32:56.488726    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-9lc4r"
Jul 06 19:32:56.488941 ip-10-0-131-168 kubenswrapper[2565]: E0706 19:32:56.488889    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-9lc4r" podUID="0657d2af-82f5-428a-ba3e-fe3df6d74f8b"
Jul 06 19:32:57.489055 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:32:57.489021    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-pc8fq"
Jul 06 19:32:57.489503 ip-10-0-131-168 kubenswrapper[2565]: E0706 19:32:57.489157    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-pc8fq" podUID="1cda8348-291c-4665-99e9-892c67fb326d"
Jul 06 19:32:57.489503 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:32:57.489221    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-2rdm6"
Jul 06 19:32:57.489503 ip-10-0-131-168 kubenswrapper[2565]: E0706 19:32:57.489355    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-2rdm6" podUID="67af2b66-be49-4b61-a200-b711f4d83397"
Jul 06 19:32:58.489264 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:32:58.489231    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-9lc4r"
Jul 06 19:32:58.489702 ip-10-0-131-168 kubenswrapper[2565]: E0706 19:32:58.489374    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-9lc4r" podUID="0657d2af-82f5-428a-ba3e-fe3df6d74f8b"
Jul 06 19:32:59.489124 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:32:59.489084    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-pc8fq"
Jul 06 19:32:59.489292 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:32:59.489273    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-2rdm6"
Jul 06 19:32:59.489643 ip-10-0-131-168 kubenswrapper[2565]: E0706 19:32:59.489220    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-pc8fq" podUID="1cda8348-291c-4665-99e9-892c67fb326d"
Jul 06 19:32:59.489730 ip-10-0-131-168 kubenswrapper[2565]: E0706 19:32:59.489705    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-2rdm6" podUID="67af2b66-be49-4b61-a200-b711f4d83397"
Jul 06 19:33:00.489173 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:33:00.489135    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-9lc4r"
Jul 06 19:33:00.489360 ip-10-0-131-168 kubenswrapper[2565]: E0706 19:33:00.489273    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-9lc4r" podUID="0657d2af-82f5-428a-ba3e-fe3df6d74f8b"
Jul 06 19:33:01.489431 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:33:01.489329    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-pc8fq"
Jul 06 19:33:01.489859 ip-10-0-131-168 kubenswrapper[2565]: E0706 19:33:01.489457    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-pc8fq" podUID="1cda8348-291c-4665-99e9-892c67fb326d"
Jul 06 19:33:01.489859 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:33:01.489563    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-2rdm6"
Jul 06 19:33:01.489859 ip-10-0-131-168 kubenswrapper[2565]: E0706 19:33:01.489657    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-2rdm6" podUID="67af2b66-be49-4b61-a200-b711f4d83397"
Jul 06 19:33:02.156100 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:33:02.155908    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/67af2b66-be49-4b61-a200-b711f4d83397-original-pull-secret\") pod \"global-pull-secret-syncer-2rdm6\" (UID: \"67af2b66-be49-4b61-a200-b711f4d83397\") " pod="kube-system/global-pull-secret-syncer-2rdm6"
Jul 06 19:33:02.156307 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:33:02.156135    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0657d2af-82f5-428a-ba3e-fe3df6d74f8b-metrics-certs\") pod \"network-metrics-daemon-9lc4r\" (UID: \"0657d2af-82f5-428a-ba3e-fe3df6d74f8b\") " pod="openshift-multus/network-metrics-daemon-9lc4r"
Jul 06 19:33:02.156307 ip-10-0-131-168 kubenswrapper[2565]: E0706 19:33:02.156074    2565 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 06 19:33:02.156307 ip-10-0-131-168 kubenswrapper[2565]: E0706 19:33:02.156223    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/67af2b66-be49-4b61-a200-b711f4d83397-original-pull-secret podName:67af2b66-be49-4b61-a200-b711f4d83397 nodeName:}" failed. No retries permitted until 2026-07-06 19:33:18.156200902 +0000 UTC m=+33.169189549 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/67af2b66-be49-4b61-a200-b711f4d83397-original-pull-secret") pod "global-pull-secret-syncer-2rdm6" (UID: "67af2b66-be49-4b61-a200-b711f4d83397") : object "kube-system"/"original-pull-secret" not registered
Jul 06 19:33:02.156307 ip-10-0-131-168 kubenswrapper[2565]: E0706 19:33:02.156239    2565 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 06 19:33:02.156307 ip-10-0-131-168 kubenswrapper[2565]: E0706 19:33:02.156293    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0657d2af-82f5-428a-ba3e-fe3df6d74f8b-metrics-certs podName:0657d2af-82f5-428a-ba3e-fe3df6d74f8b nodeName:}" failed. No retries permitted until 2026-07-06 19:33:18.156277716 +0000 UTC m=+33.169266367 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/0657d2af-82f5-428a-ba3e-fe3df6d74f8b-metrics-certs") pod "network-metrics-daemon-9lc4r" (UID: "0657d2af-82f5-428a-ba3e-fe3df6d74f8b") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 06 19:33:02.257289 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:33:02.257250    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bhj6j\" (UniqueName: \"kubernetes.io/projected/1cda8348-291c-4665-99e9-892c67fb326d-kube-api-access-bhj6j\") pod \"network-check-target-pc8fq\" (UID: \"1cda8348-291c-4665-99e9-892c67fb326d\") " pod="openshift-network-diagnostics/network-check-target-pc8fq"
Jul 06 19:33:02.257454 ip-10-0-131-168 kubenswrapper[2565]: E0706 19:33:02.257387    2565 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 06 19:33:02.257454 ip-10-0-131-168 kubenswrapper[2565]: E0706 19:33:02.257405    2565 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 06 19:33:02.257454 ip-10-0-131-168 kubenswrapper[2565]: E0706 19:33:02.257414    2565 projected.go:196] Error preparing data for projected volume kube-api-access-bhj6j for pod openshift-network-diagnostics/network-check-target-pc8fq: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 06 19:33:02.257556 ip-10-0-131-168 kubenswrapper[2565]: E0706 19:33:02.257465    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/1cda8348-291c-4665-99e9-892c67fb326d-kube-api-access-bhj6j podName:1cda8348-291c-4665-99e9-892c67fb326d nodeName:}" failed. No retries permitted until 2026-07-06 19:33:18.257453066 +0000 UTC m=+33.270441712 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-bhj6j" (UniqueName: "kubernetes.io/projected/1cda8348-291c-4665-99e9-892c67fb326d-kube-api-access-bhj6j") pod "network-check-target-pc8fq" (UID: "1cda8348-291c-4665-99e9-892c67fb326d") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 06 19:33:02.488669 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:33:02.488593    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-9lc4r"
Jul 06 19:33:02.488868 ip-10-0-131-168 kubenswrapper[2565]: E0706 19:33:02.488727    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-9lc4r" podUID="0657d2af-82f5-428a-ba3e-fe3df6d74f8b"
Jul 06 19:33:03.489451 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:33:03.489413    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-pc8fq"
Jul 06 19:33:03.490000 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:33:03.489429    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-2rdm6"
Jul 06 19:33:03.490000 ip-10-0-131-168 kubenswrapper[2565]: E0706 19:33:03.489546    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-pc8fq" podUID="1cda8348-291c-4665-99e9-892c67fb326d"
Jul 06 19:33:03.490000 ip-10-0-131-168 kubenswrapper[2565]: E0706 19:33:03.489627    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-2rdm6" podUID="67af2b66-be49-4b61-a200-b711f4d83397"
Jul 06 19:33:04.489036 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:33:04.489000    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-9lc4r"
Jul 06 19:33:04.489213 ip-10-0-131-168 kubenswrapper[2565]: E0706 19:33:04.489107    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-9lc4r" podUID="0657d2af-82f5-428a-ba3e-fe3df6d74f8b"
Jul 06 19:33:05.490495 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:33:05.490453    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-2rdm6"
Jul 06 19:33:05.490988 ip-10-0-131-168 kubenswrapper[2565]: E0706 19:33:05.490576    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-2rdm6" podUID="67af2b66-be49-4b61-a200-b711f4d83397"
Jul 06 19:33:05.490988 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:33:05.490627    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-pc8fq"
Jul 06 19:33:05.490988 ip-10-0-131-168 kubenswrapper[2565]: E0706 19:33:05.490740    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-pc8fq" podUID="1cda8348-291c-4665-99e9-892c67fb326d"
Jul 06 19:33:06.488927 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:33:06.488905    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-9lc4r"
Jul 06 19:33:06.489058 ip-10-0-131-168 kubenswrapper[2565]: E0706 19:33:06.489037    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-9lc4r" podUID="0657d2af-82f5-428a-ba3e-fe3df6d74f8b"
Jul 06 19:33:06.660363 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:33:06.660195    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-8kjqk_9f15114d-7494-4f17-8a4d-52185f7a2e35/ovn-acl-logging/0.log"
Jul 06 19:33:06.661423 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:33:06.661058    2565 generic.go:356] "Generic (PLEG): container finished" podID="9f15114d-7494-4f17-8a4d-52185f7a2e35" containerID="d3b7676aa71c14dab40f0dbdead1cc94ec8389c5ea3b0711366c562fba1731d0" exitCode=1
Jul 06 19:33:06.661423 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:33:06.661155    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-8kjqk" event={"ID":"9f15114d-7494-4f17-8a4d-52185f7a2e35","Type":"ContainerDied","Data":"d3b7676aa71c14dab40f0dbdead1cc94ec8389c5ea3b0711366c562fba1731d0"}
Jul 06 19:33:06.661423 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:33:06.661274    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-8kjqk" event={"ID":"9f15114d-7494-4f17-8a4d-52185f7a2e35","Type":"ContainerStarted","Data":"444583fafdeaaf138e5e61c762fd64423f05991ace34b389d5411b4258380978"}
Jul 06 19:33:06.665241 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:33:06.665145    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-131-168.ec2.internal" event={"ID":"83399c877cd64b0872925a2b56383a00","Type":"ContainerStarted","Data":"875f26cebc2e6d47d8ef421c4b22738a682926fca5f4d3767a45780095f590a6"}
Jul 06 19:33:06.673221 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:33:06.673191    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-sk9vq" event={"ID":"48a862e8-66cd-4899-8cd4-9a48ef610bd3","Type":"ContainerStarted","Data":"7030f78cfb4c3e9c29b5f2cb452fbad3a29a9e73a353a0b6985182915508f18c"}
Jul 06 19:33:06.674726 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:33:06.674674    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-jf9t9" event={"ID":"549d1922-a406-419b-a750-b7344fc1b9b8","Type":"ContainerStarted","Data":"05a480c1e2ddd35324de1f29e9a8b1cea07a18df33ea52cea125eea6c856b30e"}
Jul 06 19:33:06.683437 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:33:06.683385    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-131-168.ec2.internal" podStartSLOduration=20.683365335 podStartE2EDuration="20.683365335s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-06 19:32:46 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 19:33:06.683061902 +0000 UTC m=+21.696050596" watchObservedRunningTime="2026-07-06 19:33:06.683365335 +0000 UTC m=+21.696354109"
Jul 06 19:33:06.709428 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:33:06.709384    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-sk9vq" podStartSLOduration=1.868340648 podStartE2EDuration="21.709368045s" totalImagesPullingTime="19.841027397s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-06 19:32:45 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 19:33:06.709112943 +0000 UTC m=+21.722101612" watchObservedRunningTime="2026-07-06 19:33:06.709368045 +0000 UTC m=+21.722356714"
Jul 06 19:33:06.730905 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:33:06.730848    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-jf9t9" podStartSLOduration=2.317593227 podStartE2EDuration="21.730829378s" totalImagesPullingTime="19.413236151s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-06 19:32:45 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 19:33:06.730322025 +0000 UTC m=+21.743310695" watchObservedRunningTime="2026-07-06 19:33:06.730829378 +0000 UTC m=+21.743818048"
Jul 06 19:33:07.489545 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:33:07.489464    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-2rdm6"
Jul 06 19:33:07.489731 ip-10-0-131-168 kubenswrapper[2565]: E0706 19:33:07.489579    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-2rdm6" podUID="67af2b66-be49-4b61-a200-b711f4d83397"
Jul 06 19:33:07.489731 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:33:07.489633    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-pc8fq"
Jul 06 19:33:07.489859 ip-10-0-131-168 kubenswrapper[2565]: E0706 19:33:07.489747    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-pc8fq" podUID="1cda8348-291c-4665-99e9-892c67fb326d"
Jul 06 19:33:07.678333 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:33:07.678298    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-kx6hd" event={"ID":"0ecbe788-9e2c-446a-b154-7b805f3983dd","Type":"ContainerStarted","Data":"e2e5f79e4a217ca1ddf988513f129e846b13e155395b6652b2047a86fe9fcd4c"}
Jul 06 19:33:07.679810 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:33:07.679763    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-xjxq2" event={"ID":"c7ddad9c-87f6-4618-b060-800e803d39c1","Type":"ContainerStarted","Data":"8f5d35eb848b85c7a56c1caf66d32d699a77ebc767234410f4aa9c4665d63a17"}
Jul 06 19:33:07.681174 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:33:07.681152    2565 generic.go:356] "Generic (PLEG): container finished" podID="9449cdae-9fc6-4f64-a88a-db3f2e08b626" containerID="7fd68f100c7e3cd55f4b1425b225cfd912b3ee7d1c04689695b535485556eda8" exitCode=0
Jul 06 19:33:07.681278 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:33:07.681217    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-cjmdl" event={"ID":"9449cdae-9fc6-4f64-a88a-db3f2e08b626","Type":"ContainerDied","Data":"7fd68f100c7e3cd55f4b1425b225cfd912b3ee7d1c04689695b535485556eda8"}
Jul 06 19:33:07.682629 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:33:07.682608    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-cblv9" event={"ID":"35683ef3-3b68-4694-acaf-aaee8f598255","Type":"ContainerStarted","Data":"a268136e8b4c1788df7e9b9c93b7fd1aba500b9107360df115de90ef5bd547ed"}
Jul 06 19:33:07.686603 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:33:07.686406    2565 generic.go:356] "Generic (PLEG): container finished" podID="a899b324560c7e06c6c5d50af86c2bd8" containerID="be9036fe63e90d20e35b113b63d6655cff7b16b07cc708c4e01dcdd0c4df7718" exitCode=0
Jul 06 19:33:07.686603 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:33:07.686548    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-168.ec2.internal" event={"ID":"a899b324560c7e06c6c5d50af86c2bd8","Type":"ContainerDied","Data":"be9036fe63e90d20e35b113b63d6655cff7b16b07cc708c4e01dcdd0c4df7718"}
Jul 06 19:33:07.688396 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:33:07.688341    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-bp6sh" event={"ID":"c6148c24-bfbd-4b4f-a4a8-774705b763bd","Type":"ContainerStarted","Data":"f5dab16f182c740cc704a1786a118ab8e1f614d26e7acdd8b7339133235c1989"}
Jul 06 19:33:07.691030 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:33:07.691014    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-8kjqk_9f15114d-7494-4f17-8a4d-52185f7a2e35/ovn-acl-logging/0.log"
Jul 06 19:33:07.691368 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:33:07.691350    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-8kjqk" event={"ID":"9f15114d-7494-4f17-8a4d-52185f7a2e35","Type":"ContainerStarted","Data":"cb997b9234f1f550f44179d8ad8d8c8dbd7268ab08459cfff47e3921ca36acaa"}
Jul 06 19:33:07.691425 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:33:07.691402    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-8kjqk" event={"ID":"9f15114d-7494-4f17-8a4d-52185f7a2e35","Type":"ContainerStarted","Data":"f23aa75f44120193ddf219b350840acaac3a1deb91fe017fff3f931388e1a785"}
Jul 06 19:33:07.691470 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:33:07.691433    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-8kjqk" event={"ID":"9f15114d-7494-4f17-8a4d-52185f7a2e35","Type":"ContainerStarted","Data":"8146de5ea5b6fdf053654adf5f537a96abb5c615237fb44927c310248f010a51"}
Jul 06 19:33:07.691518 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:33:07.691477    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-8kjqk" event={"ID":"9f15114d-7494-4f17-8a4d-52185f7a2e35","Type":"ContainerStarted","Data":"17b59b981aa868551956055ed2fe605211f440e4c1dfc02c78664c5b77dc8dae"}
Jul 06 19:33:07.692673 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:33:07.692650    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jrxrv" event={"ID":"ef7753ea-b0a6-45e3-8e20-6a93bc9d1f76","Type":"ContainerStarted","Data":"e62d2d48958be2370d8320d1d4e852aabe0a3a26d23162fe5526a5f6eba07c35"}
Jul 06 19:33:07.696288 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:33:07.696252    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-kx6hd" podStartSLOduration=3.2914655010000002 podStartE2EDuration="22.696241794s" totalImagesPullingTime="19.404776293s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-06 19:32:45 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 19:33:07.696169795 +0000 UTC m=+22.709158464" watchObservedRunningTime="2026-07-06 19:33:07.696241794 +0000 UTC m=+22.709230463"
Jul 06 19:33:07.712619 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:33:07.712574    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-bp6sh" podStartSLOduration=3.31603099 podStartE2EDuration="22.712560264s" totalImagesPullingTime="19.396529274s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-06 19:32:45 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 19:33:07.712488878 +0000 UTC m=+22.725477546" watchObservedRunningTime="2026-07-06 19:33:07.712560264 +0000 UTC m=+22.725548933"
Jul 06 19:33:07.775849 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:33:07.775605    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-cblv9" podStartSLOduration=11.587936063 podStartE2EDuration="22.775582026s" totalImagesPullingTime="11.187645963s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-06 19:32:45 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 19:33:07.77470933 +0000 UTC m=+22.787698024" watchObservedRunningTime="2026-07-06 19:33:07.775582026 +0000 UTC m=+22.788570715"
Jul 06 19:33:07.792447 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:33:07.792406    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-xjxq2" podStartSLOduration=3.364524016 podStartE2EDuration="22.792393291s" totalImagesPullingTime="19.427869275s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 19:32:45 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 19:33:07.791585569 +0000 UTC m=+22.804574237" watchObservedRunningTime="2026-07-06 19:33:07.792393291 +0000 UTC m=+22.805381975"
Jul 06 19:33:08.489572 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:33:08.489545    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-9lc4r"
Jul 06 19:33:08.489739 ip-10-0-131-168 kubenswrapper[2565]: E0706 19:33:08.489666    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-9lc4r" podUID="0657d2af-82f5-428a-ba3e-fe3df6d74f8b"
Jul 06 19:33:08.524436 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:33:08.524414    2565 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock"
Jul 06 19:33:08.697008 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:33:08.696921    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-168.ec2.internal" event={"ID":"a899b324560c7e06c6c5d50af86c2bd8","Type":"ContainerStarted","Data":"092e042355e06a9afbb490ca5ff2ea9e598a5c91c2db342490932f3b5c6ce307"}
Jul 06 19:33:08.699382 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:33:08.699352    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jrxrv" event={"ID":"ef7753ea-b0a6-45e3-8e20-6a93bc9d1f76","Type":"ContainerStarted","Data":"ed44c03a9723aee21613f9e5e16c2cc2edfc17d31d7a38c782ff567498d9f06f"}
Jul 06 19:33:08.718911 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:33:08.718868    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-168.ec2.internal" podStartSLOduration=22.718854699 podStartE2EDuration="22.718854699s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-06 19:32:46 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 19:33:08.718681224 +0000 UTC m=+23.731669893" watchObservedRunningTime="2026-07-06 19:33:08.718854699 +0000 UTC m=+23.731843368"
Jul 06 19:33:09.387945 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:33:09.387847    2565 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-07-06T19:33:08.524431068Z","UUID":"20e882ed-3bb6-4990-a5eb-0af0f640f278","Handler":null,"Name":"","Endpoint":""}
Jul 06 19:33:09.389169 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:33:09.389151    2565 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0
Jul 06 19:33:09.389271 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:33:09.389184    2565 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock
Jul 06 19:33:09.470050 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:33:09.469960    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-xjxq2"
Jul 06 19:33:09.470845 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:33:09.470816    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-xjxq2"
Jul 06 19:33:09.488742 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:33:09.488715    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-2rdm6"
Jul 06 19:33:09.488945 ip-10-0-131-168 kubenswrapper[2565]: E0706 19:33:09.488876    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-2rdm6" podUID="67af2b66-be49-4b61-a200-b711f4d83397"
Jul 06 19:33:09.489015 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:33:09.488949    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-pc8fq"
Jul 06 19:33:09.489100 ip-10-0-131-168 kubenswrapper[2565]: E0706 19:33:09.489062    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-pc8fq" podUID="1cda8348-291c-4665-99e9-892c67fb326d"
Jul 06 19:33:09.705057 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:33:09.705033    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-8kjqk_9f15114d-7494-4f17-8a4d-52185f7a2e35/ovn-acl-logging/0.log"
Jul 06 19:33:09.705540 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:33:09.705499    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-8kjqk" event={"ID":"9f15114d-7494-4f17-8a4d-52185f7a2e35","Type":"ContainerStarted","Data":"07d3a4fa85bc4be048e06e03cd57e2f99b56ad9fbfdb3c12d711ac86311e4dc2"}
Jul 06 19:33:10.488976 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:33:10.488943    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-9lc4r"
Jul 06 19:33:10.489136 ip-10-0-131-168 kubenswrapper[2565]: E0706 19:33:10.489045    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-9lc4r" podUID="0657d2af-82f5-428a-ba3e-fe3df6d74f8b"
Jul 06 19:33:10.710203 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:33:10.710166    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jrxrv" event={"ID":"ef7753ea-b0a6-45e3-8e20-6a93bc9d1f76","Type":"ContainerStarted","Data":"56317c8ff45f06c640fc34ab3bf4984dc3034e454b64ded280ed9db59ebf540e"}
Jul 06 19:33:10.710203 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:33:10.710195    2565 prober_manager.go:312] "Failed to trigger a manual run" probe="Readiness"
Jul 06 19:33:10.733882 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:33:10.733831    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jrxrv" podStartSLOduration=3.8138849329999998 podStartE2EDuration="25.733810942s" totalImagesPullingTime="21.919926009s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-06 19:32:45 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 19:33:10.733501097 +0000 UTC m=+25.746489771" watchObservedRunningTime="2026-07-06 19:33:10.733810942 +0000 UTC m=+25.746799615"
Jul 06 19:33:11.490170 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:33:11.489980    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-2rdm6"
Jul 06 19:33:11.490363 ip-10-0-131-168 kubenswrapper[2565]: E0706 19:33:11.490295    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-2rdm6" podUID="67af2b66-be49-4b61-a200-b711f4d83397"
Jul 06 19:33:11.490724 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:33:11.489979    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-pc8fq"
Jul 06 19:33:11.490857 ip-10-0-131-168 kubenswrapper[2565]: E0706 19:33:11.490834    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-pc8fq" podUID="1cda8348-291c-4665-99e9-892c67fb326d"
Jul 06 19:33:11.715568 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:33:11.715535    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-8kjqk_9f15114d-7494-4f17-8a4d-52185f7a2e35/ovn-acl-logging/0.log"
Jul 06 19:33:11.716136 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:33:11.716111    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-8kjqk" event={"ID":"9f15114d-7494-4f17-8a4d-52185f7a2e35","Type":"ContainerStarted","Data":"d118bfddfe2c340a505517ef00e03ea2527745505a53f1c8e9eea987ceaa5374"}
Jul 06 19:33:11.718046 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:33:11.717265    2565 scope.go:117] "RemoveContainer" containerID="d3b7676aa71c14dab40f0dbdead1cc94ec8389c5ea3b0711366c562fba1731d0"
Jul 06 19:33:12.489731 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:33:12.489698    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-9lc4r"
Jul 06 19:33:12.489916 ip-10-0-131-168 kubenswrapper[2565]: E0706 19:33:12.489853    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-9lc4r" podUID="0657d2af-82f5-428a-ba3e-fe3df6d74f8b"
Jul 06 19:33:12.722938 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:33:12.722911    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-8kjqk_9f15114d-7494-4f17-8a4d-52185f7a2e35/ovn-acl-logging/0.log"
Jul 06 19:33:12.723565 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:33:12.723307    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-8kjqk" event={"ID":"9f15114d-7494-4f17-8a4d-52185f7a2e35","Type":"ContainerStarted","Data":"bd1d9e2c5171e80a4248ece2fa95d29477cd3869df4eb9d1bd3a08c269bf6d21"}
Jul 06 19:33:12.723676 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:33:12.723646    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-8kjqk"
Jul 06 19:33:12.723800 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:33:12.723727    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-8kjqk"
Jul 06 19:33:12.723800 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:33:12.723785    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-8kjqk"
Jul 06 19:33:12.741463 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:33:12.741387    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-8kjqk"
Jul 06 19:33:12.741617 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:33:12.741597    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-8kjqk"
Jul 06 19:33:12.756125 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:33:12.756079    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-8kjqk" podStartSLOduration=8.016235087 podStartE2EDuration="27.756062804s" totalImagesPullingTime="19.739827717s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-06 19:32:45 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 19:33:12.754051007 +0000 UTC m=+27.767039696" watchObservedRunningTime="2026-07-06 19:33:12.756062804 +0000 UTC m=+27.769051474"
Jul 06 19:33:13.489001 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:33:13.488974    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-pc8fq"
Jul 06 19:33:13.489001 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:33:13.488997    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-2rdm6"
Jul 06 19:33:13.489155 ip-10-0-131-168 kubenswrapper[2565]: E0706 19:33:13.489076    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-pc8fq" podUID="1cda8348-291c-4665-99e9-892c67fb326d"
Jul 06 19:33:13.489205 ip-10-0-131-168 kubenswrapper[2565]: E0706 19:33:13.489188    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-2rdm6" podUID="67af2b66-be49-4b61-a200-b711f4d83397"
Jul 06 19:33:13.698268 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:33:13.698058    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-pc8fq"]
Jul 06 19:33:13.703914 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:33:13.703884    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-2rdm6"]
Jul 06 19:33:13.704460 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:33:13.704430    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-9lc4r"]
Jul 06 19:33:13.704643 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:33:13.704543    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-9lc4r"
Jul 06 19:33:13.704710 ip-10-0-131-168 kubenswrapper[2565]: E0706 19:33:13.704648    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-9lc4r" podUID="0657d2af-82f5-428a-ba3e-fe3df6d74f8b"
Jul 06 19:33:13.726122 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:33:13.726085    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-pc8fq"
Jul 06 19:33:13.726589 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:33:13.726532    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-2rdm6"
Jul 06 19:33:13.726667 ip-10-0-131-168 kubenswrapper[2565]: E0706 19:33:13.726647    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-pc8fq" podUID="1cda8348-291c-4665-99e9-892c67fb326d"
Jul 06 19:33:13.726850 ip-10-0-131-168 kubenswrapper[2565]: E0706 19:33:13.726763    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-2rdm6" podUID="67af2b66-be49-4b61-a200-b711f4d83397"
Jul 06 19:33:14.730014 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:33:14.729979    2565 generic.go:356] "Generic (PLEG): container finished" podID="9449cdae-9fc6-4f64-a88a-db3f2e08b626" containerID="f5928e908b26d77b793ac8b54cc5192837af1e969b7d7ab607bfa4d78f0a057b" exitCode=0
Jul 06 19:33:14.730365 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:33:14.730067    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-cjmdl" event={"ID":"9449cdae-9fc6-4f64-a88a-db3f2e08b626","Type":"ContainerDied","Data":"f5928e908b26d77b793ac8b54cc5192837af1e969b7d7ab607bfa4d78f0a057b"}
Jul 06 19:33:15.490398 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:33:15.490358    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-9lc4r"
Jul 06 19:33:15.490553 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:33:15.490452    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-pc8fq"
Jul 06 19:33:15.490553 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:33:15.490485    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-2rdm6"
Jul 06 19:33:15.490553 ip-10-0-131-168 kubenswrapper[2565]: E0706 19:33:15.490511    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-9lc4r" podUID="0657d2af-82f5-428a-ba3e-fe3df6d74f8b"
Jul 06 19:33:15.490681 ip-10-0-131-168 kubenswrapper[2565]: E0706 19:33:15.490555    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-2rdm6" podUID="67af2b66-be49-4b61-a200-b711f4d83397"
Jul 06 19:33:15.490681 ip-10-0-131-168 kubenswrapper[2565]: E0706 19:33:15.490621    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-pc8fq" podUID="1cda8348-291c-4665-99e9-892c67fb326d"
Jul 06 19:33:16.237183 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:33:16.237151    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-xjxq2"
Jul 06 19:33:16.237562 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:33:16.237291    2565 prober_manager.go:312] "Failed to trigger a manual run" probe="Readiness"
Jul 06 19:33:16.237851 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:33:16.237833    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-xjxq2"
Jul 06 19:33:16.739467 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:33:16.739431    2565 generic.go:356] "Generic (PLEG): container finished" podID="9449cdae-9fc6-4f64-a88a-db3f2e08b626" containerID="3da5713e30f4f13867339a8eea84e583e86b6d0dee3a4eabf1333793460a02e2" exitCode=0
Jul 06 19:33:16.739630 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:33:16.739514    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-cjmdl" event={"ID":"9449cdae-9fc6-4f64-a88a-db3f2e08b626","Type":"ContainerDied","Data":"3da5713e30f4f13867339a8eea84e583e86b6d0dee3a4eabf1333793460a02e2"}
Jul 06 19:33:17.488898 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:33:17.488729    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-2rdm6"
Jul 06 19:33:17.489289 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:33:17.488729    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-9lc4r"
Jul 06 19:33:17.489289 ip-10-0-131-168 kubenswrapper[2565]: E0706 19:33:17.488976    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-2rdm6" podUID="67af2b66-be49-4b61-a200-b711f4d83397"
Jul 06 19:33:17.489289 ip-10-0-131-168 kubenswrapper[2565]: E0706 19:33:17.489074    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-9lc4r" podUID="0657d2af-82f5-428a-ba3e-fe3df6d74f8b"
Jul 06 19:33:17.489289 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:33:17.488821    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-pc8fq"
Jul 06 19:33:17.489289 ip-10-0-131-168 kubenswrapper[2565]: E0706 19:33:17.489168    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-pc8fq" podUID="1cda8348-291c-4665-99e9-892c67fb326d"
Jul 06 19:33:17.744745 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:33:17.744658    2565 generic.go:356] "Generic (PLEG): container finished" podID="9449cdae-9fc6-4f64-a88a-db3f2e08b626" containerID="978b23abf4afd06e2e4192a8205a0b451a3861beb5eeb02571e668b4c5654b63" exitCode=0
Jul 06 19:33:17.744745 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:33:17.744715    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-cjmdl" event={"ID":"9449cdae-9fc6-4f64-a88a-db3f2e08b626","Type":"ContainerDied","Data":"978b23abf4afd06e2e4192a8205a0b451a3861beb5eeb02571e668b4c5654b63"}
Jul 06 19:33:18.185679 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:33:18.185645    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0657d2af-82f5-428a-ba3e-fe3df6d74f8b-metrics-certs\") pod \"network-metrics-daemon-9lc4r\" (UID: \"0657d2af-82f5-428a-ba3e-fe3df6d74f8b\") " pod="openshift-multus/network-metrics-daemon-9lc4r"
Jul 06 19:33:18.185887 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:33:18.185718    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/67af2b66-be49-4b61-a200-b711f4d83397-original-pull-secret\") pod \"global-pull-secret-syncer-2rdm6\" (UID: \"67af2b66-be49-4b61-a200-b711f4d83397\") " pod="kube-system/global-pull-secret-syncer-2rdm6"
Jul 06 19:33:18.185887 ip-10-0-131-168 kubenswrapper[2565]: E0706 19:33:18.185832    2565 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 06 19:33:18.185887 ip-10-0-131-168 kubenswrapper[2565]: E0706 19:33:18.185836    2565 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 06 19:33:18.186038 ip-10-0-131-168 kubenswrapper[2565]: E0706 19:33:18.185894    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/67af2b66-be49-4b61-a200-b711f4d83397-original-pull-secret podName:67af2b66-be49-4b61-a200-b711f4d83397 nodeName:}" failed. No retries permitted until 2026-07-06 19:33:50.185874062 +0000 UTC m=+65.198862723 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/67af2b66-be49-4b61-a200-b711f4d83397-original-pull-secret") pod "global-pull-secret-syncer-2rdm6" (UID: "67af2b66-be49-4b61-a200-b711f4d83397") : object "kube-system"/"original-pull-secret" not registered
Jul 06 19:33:18.186038 ip-10-0-131-168 kubenswrapper[2565]: E0706 19:33:18.185915    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0657d2af-82f5-428a-ba3e-fe3df6d74f8b-metrics-certs podName:0657d2af-82f5-428a-ba3e-fe3df6d74f8b nodeName:}" failed. No retries permitted until 2026-07-06 19:33:50.185903724 +0000 UTC m=+65.198892376 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/0657d2af-82f5-428a-ba3e-fe3df6d74f8b-metrics-certs") pod "network-metrics-daemon-9lc4r" (UID: "0657d2af-82f5-428a-ba3e-fe3df6d74f8b") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 06 19:33:18.286920 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:33:18.286888    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bhj6j\" (UniqueName: \"kubernetes.io/projected/1cda8348-291c-4665-99e9-892c67fb326d-kube-api-access-bhj6j\") pod \"network-check-target-pc8fq\" (UID: \"1cda8348-291c-4665-99e9-892c67fb326d\") " pod="openshift-network-diagnostics/network-check-target-pc8fq"
Jul 06 19:33:18.287103 ip-10-0-131-168 kubenswrapper[2565]: E0706 19:33:18.287082    2565 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 06 19:33:18.287144 ip-10-0-131-168 kubenswrapper[2565]: E0706 19:33:18.287111    2565 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 06 19:33:18.287144 ip-10-0-131-168 kubenswrapper[2565]: E0706 19:33:18.287124    2565 projected.go:196] Error preparing data for projected volume kube-api-access-bhj6j for pod openshift-network-diagnostics/network-check-target-pc8fq: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 06 19:33:18.287272 ip-10-0-131-168 kubenswrapper[2565]: E0706 19:33:18.287248    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/1cda8348-291c-4665-99e9-892c67fb326d-kube-api-access-bhj6j podName:1cda8348-291c-4665-99e9-892c67fb326d nodeName:}" failed. No retries permitted until 2026-07-06 19:33:50.287228814 +0000 UTC m=+65.300217482 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-bhj6j" (UniqueName: "kubernetes.io/projected/1cda8348-291c-4665-99e9-892c67fb326d-kube-api-access-bhj6j") pod "network-check-target-pc8fq" (UID: "1cda8348-291c-4665-99e9-892c67fb326d") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 06 19:33:19.264682 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:33:19.264608    2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-168.ec2.internal" event="NodeReady"
Jul 06 19:33:19.265174 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:33:19.264750    2565 kubelet_node_status.go:489] "Fast updating node status as it just became ready"
Jul 06 19:33:19.330733 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:33:19.330701    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-2gd6k"]
Jul 06 19:33:19.332952 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:33:19.332926    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-sk5qz"]
Jul 06 19:33:19.333088 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:33:19.333042    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-2gd6k"
Jul 06 19:33:19.334720 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:33:19.334700    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-58c8d46f4-scg5r"]
Jul 06 19:33:19.334932 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:33:19.334847    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-sk5qz"
Jul 06 19:33:19.335851 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:33:19.335833    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\""
Jul 06 19:33:19.336870 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:33:19.336853    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-58c8d46f4-scg5r"
Jul 06 19:33:19.337330 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:33:19.337289    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-f2dnr\""
Jul 06 19:33:19.337423 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:33:19.337392    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\""
Jul 06 19:33:19.338301 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:33:19.338281    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\""
Jul 06 19:33:19.338395 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:33:19.338313    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\""
Jul 06 19:33:19.338679 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:33:19.338532    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-kpbzx\""
Jul 06 19:33:19.338679 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:33:19.338595    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\""
Jul 06 19:33:19.339494 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:33:19.339476    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-txspv\""
Jul 06 19:33:19.339765 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:33:19.339668    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\""
Jul 06 19:33:19.339765 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:33:19.339677    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\""
Jul 06 19:33:19.339765 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:33:19.339691    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\""
Jul 06 19:33:19.347203 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:33:19.347170    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\""
Jul 06 19:33:19.347602 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:33:19.347585    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-sk5qz"]
Jul 06 19:33:19.353634 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:33:19.353615    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-2gd6k"]
Jul 06 19:33:19.354287 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:33:19.354270    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-58c8d46f4-scg5r"]
Jul 06 19:33:19.489043 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:33:19.489011    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-2rdm6"
Jul 06 19:33:19.489219 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:33:19.489058    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-9lc4r"
Jul 06 19:33:19.489219 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:33:19.489058    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-pc8fq"
Jul 06 19:33:19.494418 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:33:19.492962    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Jul 06 19:33:19.494418 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:33:19.493006    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-77m84\""
Jul 06 19:33:19.494418 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:33:19.493046    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Jul 06 19:33:19.494418 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:33:19.493317    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Jul 06 19:33:19.494418 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:33:19.493335    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Jul 06 19:33:19.494418 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:33:19.493558    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-965h5\""
Jul 06 19:33:19.496260 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:33:19.496233    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/9d3c699b-09de-4376-b6df-d7200cc1f8bc-image-registry-private-configuration\") pod \"image-registry-58c8d46f4-scg5r\" (UID: \"9d3c699b-09de-4376-b6df-d7200cc1f8bc\") " pod="openshift-image-registry/image-registry-58c8d46f4-scg5r"
Jul 06 19:33:19.496390 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:33:19.496275    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/9d3c699b-09de-4376-b6df-d7200cc1f8bc-ca-trust-extracted\") pod \"image-registry-58c8d46f4-scg5r\" (UID: \"9d3c699b-09de-4376-b6df-d7200cc1f8bc\") " pod="openshift-image-registry/image-registry-58c8d46f4-scg5r"
Jul 06 19:33:19.496390 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:33:19.496298    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/9d3c699b-09de-4376-b6df-d7200cc1f8bc-trusted-ca\") pod \"image-registry-58c8d46f4-scg5r\" (UID: \"9d3c699b-09de-4376-b6df-d7200cc1f8bc\") " pod="openshift-image-registry/image-registry-58c8d46f4-scg5r"
Jul 06 19:33:19.496390 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:33:19.496333    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/5cebd7e7-350b-4360-a9f5-e7ef0889b9c2-cert\") pod \"ingress-canary-sk5qz\" (UID: \"5cebd7e7-350b-4360-a9f5-e7ef0889b9c2\") " pod="openshift-ingress-canary/ingress-canary-sk5qz"
Jul 06 19:33:19.496390 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:33:19.496353    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/9d3c699b-09de-4376-b6df-d7200cc1f8bc-installation-pull-secrets\") pod \"image-registry-58c8d46f4-scg5r\" (UID: \"9d3c699b-09de-4376-b6df-d7200cc1f8bc\") " pod="openshift-image-registry/image-registry-58c8d46f4-scg5r"
Jul 06 19:33:19.496390 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:33:19.496375    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b1f107bd-53cb-4a16-8b28-58ce84f656c0-tmp-dir\") pod \"dns-default-2gd6k\" (UID: \"b1f107bd-53cb-4a16-8b28-58ce84f656c0\") " pod="openshift-dns/dns-default-2gd6k"
Jul 06 19:33:19.496636 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:33:19.496401    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/b1f107bd-53cb-4a16-8b28-58ce84f656c0-metrics-tls\") pod \"dns-default-2gd6k\" (UID: \"b1f107bd-53cb-4a16-8b28-58ce84f656c0\") " pod="openshift-dns/dns-default-2gd6k"
Jul 06 19:33:19.496636 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:33:19.496459    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/9d3c699b-09de-4376-b6df-d7200cc1f8bc-bound-sa-token\") pod \"image-registry-58c8d46f4-scg5r\" (UID: \"9d3c699b-09de-4376-b6df-d7200cc1f8bc\") " pod="openshift-image-registry/image-registry-58c8d46f4-scg5r"
Jul 06 19:33:19.496636 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:33:19.496476    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/b1f107bd-53cb-4a16-8b28-58ce84f656c0-config-volume\") pod \"dns-default-2gd6k\" (UID: \"b1f107bd-53cb-4a16-8b28-58ce84f656c0\") " pod="openshift-dns/dns-default-2gd6k"
Jul 06 19:33:19.496636 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:33:19.496506    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-f5tf4\" (UniqueName: \"kubernetes.io/projected/b1f107bd-53cb-4a16-8b28-58ce84f656c0-kube-api-access-f5tf4\") pod \"dns-default-2gd6k\" (UID: \"b1f107bd-53cb-4a16-8b28-58ce84f656c0\") " pod="openshift-dns/dns-default-2gd6k"
Jul 06 19:33:19.496636 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:33:19.496529    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mjzr2\" (UniqueName: \"kubernetes.io/projected/9d3c699b-09de-4376-b6df-d7200cc1f8bc-kube-api-access-mjzr2\") pod \"image-registry-58c8d46f4-scg5r\" (UID: \"9d3c699b-09de-4376-b6df-d7200cc1f8bc\") " pod="openshift-image-registry/image-registry-58c8d46f4-scg5r"
Jul 06 19:33:19.496636 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:33:19.496552    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-grk6d\" (UniqueName: \"kubernetes.io/projected/5cebd7e7-350b-4360-a9f5-e7ef0889b9c2-kube-api-access-grk6d\") pod \"ingress-canary-sk5qz\" (UID: \"5cebd7e7-350b-4360-a9f5-e7ef0889b9c2\") " pod="openshift-ingress-canary/ingress-canary-sk5qz"
Jul 06 19:33:19.496636 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:33:19.496617    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/9d3c699b-09de-4376-b6df-d7200cc1f8bc-registry-tls\") pod \"image-registry-58c8d46f4-scg5r\" (UID: \"9d3c699b-09de-4376-b6df-d7200cc1f8bc\") " pod="openshift-image-registry/image-registry-58c8d46f4-scg5r"
Jul 06 19:33:19.496989 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:33:19.496654    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/9d3c699b-09de-4376-b6df-d7200cc1f8bc-registry-certificates\") pod \"image-registry-58c8d46f4-scg5r\" (UID: \"9d3c699b-09de-4376-b6df-d7200cc1f8bc\") " pod="openshift-image-registry/image-registry-58c8d46f4-scg5r"
Jul 06 19:33:19.597870 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:33:19.597790    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/9d3c699b-09de-4376-b6df-d7200cc1f8bc-ca-trust-extracted\") pod \"image-registry-58c8d46f4-scg5r\" (UID: \"9d3c699b-09de-4376-b6df-d7200cc1f8bc\") " pod="openshift-image-registry/image-registry-58c8d46f4-scg5r"
Jul 06 19:33:19.597870 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:33:19.597829    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/9d3c699b-09de-4376-b6df-d7200cc1f8bc-trusted-ca\") pod \"image-registry-58c8d46f4-scg5r\" (UID: \"9d3c699b-09de-4376-b6df-d7200cc1f8bc\") " pod="openshift-image-registry/image-registry-58c8d46f4-scg5r"
Jul 06 19:33:19.597870 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:33:19.597871    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/5cebd7e7-350b-4360-a9f5-e7ef0889b9c2-cert\") pod \"ingress-canary-sk5qz\" (UID: \"5cebd7e7-350b-4360-a9f5-e7ef0889b9c2\") " pod="openshift-ingress-canary/ingress-canary-sk5qz"
Jul 06 19:33:19.598138 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:33:19.597889    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/9d3c699b-09de-4376-b6df-d7200cc1f8bc-installation-pull-secrets\") pod \"image-registry-58c8d46f4-scg5r\" (UID: \"9d3c699b-09de-4376-b6df-d7200cc1f8bc\") " pod="openshift-image-registry/image-registry-58c8d46f4-scg5r"
Jul 06 19:33:19.598138 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:33:19.597910    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b1f107bd-53cb-4a16-8b28-58ce84f656c0-tmp-dir\") pod \"dns-default-2gd6k\" (UID: \"b1f107bd-53cb-4a16-8b28-58ce84f656c0\") " pod="openshift-dns/dns-default-2gd6k"
Jul 06 19:33:19.598138 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:33:19.597934    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/b1f107bd-53cb-4a16-8b28-58ce84f656c0-metrics-tls\") pod \"dns-default-2gd6k\" (UID: \"b1f107bd-53cb-4a16-8b28-58ce84f656c0\") " pod="openshift-dns/dns-default-2gd6k"
Jul 06 19:33:19.598138 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:33:19.597980    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/9d3c699b-09de-4376-b6df-d7200cc1f8bc-bound-sa-token\") pod \"image-registry-58c8d46f4-scg5r\" (UID: \"9d3c699b-09de-4376-b6df-d7200cc1f8bc\") " pod="openshift-image-registry/image-registry-58c8d46f4-scg5r"
Jul 06 19:33:19.598138 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:33:19.598002    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/b1f107bd-53cb-4a16-8b28-58ce84f656c0-config-volume\") pod \"dns-default-2gd6k\" (UID: \"b1f107bd-53cb-4a16-8b28-58ce84f656c0\") " pod="openshift-dns/dns-default-2gd6k"
Jul 06 19:33:19.598138 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:33:19.598033    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-f5tf4\" (UniqueName: \"kubernetes.io/projected/b1f107bd-53cb-4a16-8b28-58ce84f656c0-kube-api-access-f5tf4\") pod \"dns-default-2gd6k\" (UID: \"b1f107bd-53cb-4a16-8b28-58ce84f656c0\") " pod="openshift-dns/dns-default-2gd6k"
Jul 06 19:33:19.598138 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:33:19.598068    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mjzr2\" (UniqueName: \"kubernetes.io/projected/9d3c699b-09de-4376-b6df-d7200cc1f8bc-kube-api-access-mjzr2\") pod \"image-registry-58c8d46f4-scg5r\" (UID: \"9d3c699b-09de-4376-b6df-d7200cc1f8bc\") " pod="openshift-image-registry/image-registry-58c8d46f4-scg5r"
Jul 06 19:33:19.598138 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:33:19.598090    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-grk6d\" (UniqueName: \"kubernetes.io/projected/5cebd7e7-350b-4360-a9f5-e7ef0889b9c2-kube-api-access-grk6d\") pod \"ingress-canary-sk5qz\" (UID: \"5cebd7e7-350b-4360-a9f5-e7ef0889b9c2\") " pod="openshift-ingress-canary/ingress-canary-sk5qz"
Jul 06 19:33:19.598138 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:33:19.598127    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/9d3c699b-09de-4376-b6df-d7200cc1f8bc-registry-tls\") pod \"image-registry-58c8d46f4-scg5r\" (UID: \"9d3c699b-09de-4376-b6df-d7200cc1f8bc\") " pod="openshift-image-registry/image-registry-58c8d46f4-scg5r"
Jul 06 19:33:19.598544 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:33:19.598152    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/9d3c699b-09de-4376-b6df-d7200cc1f8bc-registry-certificates\") pod \"image-registry-58c8d46f4-scg5r\" (UID: \"9d3c699b-09de-4376-b6df-d7200cc1f8bc\") " pod="openshift-image-registry/image-registry-58c8d46f4-scg5r"
Jul 06 19:33:19.598544 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:33:19.598190    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/9d3c699b-09de-4376-b6df-d7200cc1f8bc-image-registry-private-configuration\") pod \"image-registry-58c8d46f4-scg5r\" (UID: \"9d3c699b-09de-4376-b6df-d7200cc1f8bc\") " pod="openshift-image-registry/image-registry-58c8d46f4-scg5r"
Jul 06 19:33:19.598544 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:33:19.598280    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/9d3c699b-09de-4376-b6df-d7200cc1f8bc-ca-trust-extracted\") pod \"image-registry-58c8d46f4-scg5r\" (UID: \"9d3c699b-09de-4376-b6df-d7200cc1f8bc\") " pod="openshift-image-registry/image-registry-58c8d46f4-scg5r"
Jul 06 19:33:19.598687 ip-10-0-131-168 kubenswrapper[2565]: E0706 19:33:19.598669    2565 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 06 19:33:19.598910 ip-10-0-131-168 kubenswrapper[2565]: E0706 19:33:19.598753    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b1f107bd-53cb-4a16-8b28-58ce84f656c0-metrics-tls podName:b1f107bd-53cb-4a16-8b28-58ce84f656c0 nodeName:}" failed. No retries permitted until 2026-07-06 19:33:20.098732065 +0000 UTC m=+35.111720729 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/b1f107bd-53cb-4a16-8b28-58ce84f656c0-metrics-tls") pod "dns-default-2gd6k" (UID: "b1f107bd-53cb-4a16-8b28-58ce84f656c0") : secret "dns-default-metrics-tls" not found
Jul 06 19:33:19.599251 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:33:19.599224    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/9d3c699b-09de-4376-b6df-d7200cc1f8bc-trusted-ca\") pod \"image-registry-58c8d46f4-scg5r\" (UID: \"9d3c699b-09de-4376-b6df-d7200cc1f8bc\") " pod="openshift-image-registry/image-registry-58c8d46f4-scg5r"
Jul 06 19:33:19.599360 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:33:19.599277    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b1f107bd-53cb-4a16-8b28-58ce84f656c0-tmp-dir\") pod \"dns-default-2gd6k\" (UID: \"b1f107bd-53cb-4a16-8b28-58ce84f656c0\") " pod="openshift-dns/dns-default-2gd6k"
Jul 06 19:33:19.599360 ip-10-0-131-168 kubenswrapper[2565]: E0706 19:33:19.599315    2565 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 06 19:33:19.599360 ip-10-0-131-168 kubenswrapper[2565]: E0706 19:33:19.599332    2565 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-58c8d46f4-scg5r: secret "image-registry-tls" not found
Jul 06 19:33:19.599505 ip-10-0-131-168 kubenswrapper[2565]: E0706 19:33:19.599466    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/9d3c699b-09de-4376-b6df-d7200cc1f8bc-registry-tls podName:9d3c699b-09de-4376-b6df-d7200cc1f8bc nodeName:}" failed. No retries permitted until 2026-07-06 19:33:20.099448146 +0000 UTC m=+35.112436808 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/9d3c699b-09de-4376-b6df-d7200cc1f8bc-registry-tls") pod "image-registry-58c8d46f4-scg5r" (UID: "9d3c699b-09de-4376-b6df-d7200cc1f8bc") : secret "image-registry-tls" not found
Jul 06 19:33:19.599692 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:33:19.599667    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/9d3c699b-09de-4376-b6df-d7200cc1f8bc-registry-certificates\") pod \"image-registry-58c8d46f4-scg5r\" (UID: \"9d3c699b-09de-4376-b6df-d7200cc1f8bc\") " pod="openshift-image-registry/image-registry-58c8d46f4-scg5r"
Jul 06 19:33:19.599966 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:33:19.599946    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/b1f107bd-53cb-4a16-8b28-58ce84f656c0-config-volume\") pod \"dns-default-2gd6k\" (UID: \"b1f107bd-53cb-4a16-8b28-58ce84f656c0\") " pod="openshift-dns/dns-default-2gd6k"
Jul 06 19:33:19.602631 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:33:19.602605    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/9d3c699b-09de-4376-b6df-d7200cc1f8bc-installation-pull-secrets\") pod \"image-registry-58c8d46f4-scg5r\" (UID: \"9d3c699b-09de-4376-b6df-d7200cc1f8bc\") " pod="openshift-image-registry/image-registry-58c8d46f4-scg5r"
Jul 06 19:33:19.602743 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:33:19.602664    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/9d3c699b-09de-4376-b6df-d7200cc1f8bc-image-registry-private-configuration\") pod \"image-registry-58c8d46f4-scg5r\" (UID: \"9d3c699b-09de-4376-b6df-d7200cc1f8bc\") " pod="openshift-image-registry/image-registry-58c8d46f4-scg5r"
Jul 06 19:33:19.602743 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:33:19.602711    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/5cebd7e7-350b-4360-a9f5-e7ef0889b9c2-cert\") pod \"ingress-canary-sk5qz\" (UID: \"5cebd7e7-350b-4360-a9f5-e7ef0889b9c2\") " pod="openshift-ingress-canary/ingress-canary-sk5qz"
Jul 06 19:33:19.609145 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:33:19.609111    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-f5tf4\" (UniqueName: \"kubernetes.io/projected/b1f107bd-53cb-4a16-8b28-58ce84f656c0-kube-api-access-f5tf4\") pod \"dns-default-2gd6k\" (UID: \"b1f107bd-53cb-4a16-8b28-58ce84f656c0\") " pod="openshift-dns/dns-default-2gd6k"
Jul 06 19:33:19.609980 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:33:19.609926    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/9d3c699b-09de-4376-b6df-d7200cc1f8bc-bound-sa-token\") pod \"image-registry-58c8d46f4-scg5r\" (UID: \"9d3c699b-09de-4376-b6df-d7200cc1f8bc\") " pod="openshift-image-registry/image-registry-58c8d46f4-scg5r"
Jul 06 19:33:19.610073 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:33:19.610041    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-grk6d\" (UniqueName: \"kubernetes.io/projected/5cebd7e7-350b-4360-a9f5-e7ef0889b9c2-kube-api-access-grk6d\") pod \"ingress-canary-sk5qz\" (UID: \"5cebd7e7-350b-4360-a9f5-e7ef0889b9c2\") " pod="openshift-ingress-canary/ingress-canary-sk5qz"
Jul 06 19:33:19.610606 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:33:19.610581    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mjzr2\" (UniqueName: \"kubernetes.io/projected/9d3c699b-09de-4376-b6df-d7200cc1f8bc-kube-api-access-mjzr2\") pod \"image-registry-58c8d46f4-scg5r\" (UID: \"9d3c699b-09de-4376-b6df-d7200cc1f8bc\") " pod="openshift-image-registry/image-registry-58c8d46f4-scg5r"
Jul 06 19:33:19.653918 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:33:19.653880    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-sk5qz"
Jul 06 19:33:19.800391 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:33:19.800359    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-sk5qz"]
Jul 06 19:33:19.804526 ip-10-0-131-168 kubenswrapper[2565]: W0706 19:33:19.804333    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5cebd7e7_350b_4360_a9f5_e7ef0889b9c2.slice/crio-2abac61e5e5bdb52ec2561359e445a5d09aad7d100449ece551605696c86fa2e WatchSource:0}: Error finding container 2abac61e5e5bdb52ec2561359e445a5d09aad7d100449ece551605696c86fa2e: Status 404 returned error can't find the container with id 2abac61e5e5bdb52ec2561359e445a5d09aad7d100449ece551605696c86fa2e
Jul 06 19:33:20.100977 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:33:20.100933    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/9d3c699b-09de-4376-b6df-d7200cc1f8bc-registry-tls\") pod \"image-registry-58c8d46f4-scg5r\" (UID: \"9d3c699b-09de-4376-b6df-d7200cc1f8bc\") " pod="openshift-image-registry/image-registry-58c8d46f4-scg5r"
Jul 06 19:33:20.101168 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:33:20.101023    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/b1f107bd-53cb-4a16-8b28-58ce84f656c0-metrics-tls\") pod \"dns-default-2gd6k\" (UID: \"b1f107bd-53cb-4a16-8b28-58ce84f656c0\") " pod="openshift-dns/dns-default-2gd6k"
Jul 06 19:33:20.101168 ip-10-0-131-168 kubenswrapper[2565]: E0706 19:33:20.101094    2565 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 06 19:33:20.101168 ip-10-0-131-168 kubenswrapper[2565]: E0706 19:33:20.101115    2565 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-58c8d46f4-scg5r: secret "image-registry-tls" not found
Jul 06 19:33:20.101168 ip-10-0-131-168 kubenswrapper[2565]: E0706 19:33:20.101148    2565 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 06 19:33:20.101168 ip-10-0-131-168 kubenswrapper[2565]: E0706 19:33:20.101171    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/9d3c699b-09de-4376-b6df-d7200cc1f8bc-registry-tls podName:9d3c699b-09de-4376-b6df-d7200cc1f8bc nodeName:}" failed. No retries permitted until 2026-07-06 19:33:21.101155271 +0000 UTC m=+36.114143918 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/9d3c699b-09de-4376-b6df-d7200cc1f8bc-registry-tls") pod "image-registry-58c8d46f4-scg5r" (UID: "9d3c699b-09de-4376-b6df-d7200cc1f8bc") : secret "image-registry-tls" not found
Jul 06 19:33:20.101379 ip-10-0-131-168 kubenswrapper[2565]: E0706 19:33:20.101209    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b1f107bd-53cb-4a16-8b28-58ce84f656c0-metrics-tls podName:b1f107bd-53cb-4a16-8b28-58ce84f656c0 nodeName:}" failed. No retries permitted until 2026-07-06 19:33:21.101193847 +0000 UTC m=+36.114182494 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/b1f107bd-53cb-4a16-8b28-58ce84f656c0-metrics-tls") pod "dns-default-2gd6k" (UID: "b1f107bd-53cb-4a16-8b28-58ce84f656c0") : secret "dns-default-metrics-tls" not found
Jul 06 19:33:20.754759 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:33:20.754722    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-sk5qz" event={"ID":"5cebd7e7-350b-4360-a9f5-e7ef0889b9c2","Type":"ContainerStarted","Data":"2abac61e5e5bdb52ec2561359e445a5d09aad7d100449ece551605696c86fa2e"}
Jul 06 19:33:21.108925 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:33:21.108702    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/b1f107bd-53cb-4a16-8b28-58ce84f656c0-metrics-tls\") pod \"dns-default-2gd6k\" (UID: \"b1f107bd-53cb-4a16-8b28-58ce84f656c0\") " pod="openshift-dns/dns-default-2gd6k"
Jul 06 19:33:21.108925 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:33:21.108825    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/9d3c699b-09de-4376-b6df-d7200cc1f8bc-registry-tls\") pod \"image-registry-58c8d46f4-scg5r\" (UID: \"9d3c699b-09de-4376-b6df-d7200cc1f8bc\") " pod="openshift-image-registry/image-registry-58c8d46f4-scg5r"
Jul 06 19:33:21.108925 ip-10-0-131-168 kubenswrapper[2565]: E0706 19:33:21.108912    2565 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 06 19:33:21.109177 ip-10-0-131-168 kubenswrapper[2565]: E0706 19:33:21.108979    2565 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 06 19:33:21.109177 ip-10-0-131-168 kubenswrapper[2565]: E0706 19:33:21.108997    2565 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-58c8d46f4-scg5r: secret "image-registry-tls" not found
Jul 06 19:33:21.109177 ip-10-0-131-168 kubenswrapper[2565]: E0706 19:33:21.109010    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b1f107bd-53cb-4a16-8b28-58ce84f656c0-metrics-tls podName:b1f107bd-53cb-4a16-8b28-58ce84f656c0 nodeName:}" failed. No retries permitted until 2026-07-06 19:33:23.108987302 +0000 UTC m=+38.121975975 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/b1f107bd-53cb-4a16-8b28-58ce84f656c0-metrics-tls") pod "dns-default-2gd6k" (UID: "b1f107bd-53cb-4a16-8b28-58ce84f656c0") : secret "dns-default-metrics-tls" not found
Jul 06 19:33:21.109177 ip-10-0-131-168 kubenswrapper[2565]: E0706 19:33:21.109052    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/9d3c699b-09de-4376-b6df-d7200cc1f8bc-registry-tls podName:9d3c699b-09de-4376-b6df-d7200cc1f8bc nodeName:}" failed. No retries permitted until 2026-07-06 19:33:23.10903371 +0000 UTC m=+38.122022360 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/9d3c699b-09de-4376-b6df-d7200cc1f8bc-registry-tls") pod "image-registry-58c8d46f4-scg5r" (UID: "9d3c699b-09de-4376-b6df-d7200cc1f8bc") : secret "image-registry-tls" not found
Jul 06 19:33:21.575473 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:33:21.575396    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-l5bqv"]
Jul 06 19:33:21.605248 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:33:21.605213    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-l5bqv"]
Jul 06 19:33:21.605401 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:33:21.605359    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-l5bqv"
Jul 06 19:33:21.608802 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:33:21.608719    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\""
Jul 06 19:33:21.608802 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:33:21.608784    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-jsgwd\""
Jul 06 19:33:21.609005 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:33:21.608825    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\""
Jul 06 19:33:21.609005 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:33:21.608858    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\""
Jul 06 19:33:21.610003 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:33:21.609973    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\""
Jul 06 19:33:21.715023 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:33:21.714977    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-f4p68\" (UniqueName: \"kubernetes.io/projected/5777f5a5-bc96-408e-a7c0-0c8ab230121e-kube-api-access-f4p68\") pod \"insights-runtime-extractor-l5bqv\" (UID: \"5777f5a5-bc96-408e-a7c0-0c8ab230121e\") " pod="openshift-insights/insights-runtime-extractor-l5bqv"
Jul 06 19:33:21.715206 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:33:21.715073    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/5777f5a5-bc96-408e-a7c0-0c8ab230121e-crio-socket\") pod \"insights-runtime-extractor-l5bqv\" (UID: \"5777f5a5-bc96-408e-a7c0-0c8ab230121e\") " pod="openshift-insights/insights-runtime-extractor-l5bqv"
Jul 06 19:33:21.715206 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:33:21.715125    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/5777f5a5-bc96-408e-a7c0-0c8ab230121e-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-l5bqv\" (UID: \"5777f5a5-bc96-408e-a7c0-0c8ab230121e\") " pod="openshift-insights/insights-runtime-extractor-l5bqv"
Jul 06 19:33:21.715206 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:33:21.715191    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/5777f5a5-bc96-408e-a7c0-0c8ab230121e-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-l5bqv\" (UID: \"5777f5a5-bc96-408e-a7c0-0c8ab230121e\") " pod="openshift-insights/insights-runtime-extractor-l5bqv"
Jul 06 19:33:21.715367 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:33:21.715316    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/5777f5a5-bc96-408e-a7c0-0c8ab230121e-data-volume\") pod \"insights-runtime-extractor-l5bqv\" (UID: \"5777f5a5-bc96-408e-a7c0-0c8ab230121e\") " pod="openshift-insights/insights-runtime-extractor-l5bqv"
Jul 06 19:33:21.816572 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:33:21.816535    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/5777f5a5-bc96-408e-a7c0-0c8ab230121e-data-volume\") pod \"insights-runtime-extractor-l5bqv\" (UID: \"5777f5a5-bc96-408e-a7c0-0c8ab230121e\") " pod="openshift-insights/insights-runtime-extractor-l5bqv"
Jul 06 19:33:21.817032 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:33:21.816581    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-f4p68\" (UniqueName: \"kubernetes.io/projected/5777f5a5-bc96-408e-a7c0-0c8ab230121e-kube-api-access-f4p68\") pod \"insights-runtime-extractor-l5bqv\" (UID: \"5777f5a5-bc96-408e-a7c0-0c8ab230121e\") " pod="openshift-insights/insights-runtime-extractor-l5bqv"
Jul 06 19:33:21.817032 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:33:21.816634    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/5777f5a5-bc96-408e-a7c0-0c8ab230121e-crio-socket\") pod \"insights-runtime-extractor-l5bqv\" (UID: \"5777f5a5-bc96-408e-a7c0-0c8ab230121e\") " pod="openshift-insights/insights-runtime-extractor-l5bqv"
Jul 06 19:33:21.817032 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:33:21.816680    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/5777f5a5-bc96-408e-a7c0-0c8ab230121e-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-l5bqv\" (UID: \"5777f5a5-bc96-408e-a7c0-0c8ab230121e\") " pod="openshift-insights/insights-runtime-extractor-l5bqv"
Jul 06 19:33:21.817032 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:33:21.816735    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/5777f5a5-bc96-408e-a7c0-0c8ab230121e-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-l5bqv\" (UID: \"5777f5a5-bc96-408e-a7c0-0c8ab230121e\") " pod="openshift-insights/insights-runtime-extractor-l5bqv"
Jul 06 19:33:21.817032 ip-10-0-131-168 kubenswrapper[2565]: E0706 19:33:21.816863    2565 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 06 19:33:21.817032 ip-10-0-131-168 kubenswrapper[2565]: E0706 19:33:21.816885    2565 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 06 19:33:21.817032 ip-10-0-131-168 kubenswrapper[2565]: E0706 19:33:21.816934    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5777f5a5-bc96-408e-a7c0-0c8ab230121e-insights-runtime-extractor-tls podName:5777f5a5-bc96-408e-a7c0-0c8ab230121e nodeName:}" failed. No retries permitted until 2026-07-06 19:33:22.316911822 +0000 UTC m=+37.329900478 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/5777f5a5-bc96-408e-a7c0-0c8ab230121e-insights-runtime-extractor-tls") pod "insights-runtime-extractor-l5bqv" (UID: "5777f5a5-bc96-408e-a7c0-0c8ab230121e") : secret "insights-runtime-extractor-tls" not found
Jul 06 19:33:21.817032 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:33:21.816945    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/5777f5a5-bc96-408e-a7c0-0c8ab230121e-data-volume\") pod \"insights-runtime-extractor-l5bqv\" (UID: \"5777f5a5-bc96-408e-a7c0-0c8ab230121e\") " pod="openshift-insights/insights-runtime-extractor-l5bqv"
Jul 06 19:33:21.817032 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:33:21.816947    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/5777f5a5-bc96-408e-a7c0-0c8ab230121e-crio-socket\") pod \"insights-runtime-extractor-l5bqv\" (UID: \"5777f5a5-bc96-408e-a7c0-0c8ab230121e\") " pod="openshift-insights/insights-runtime-extractor-l5bqv"
Jul 06 19:33:21.817032 ip-10-0-131-168 kubenswrapper[2565]: E0706 19:33:21.816954    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/5777f5a5-bc96-408e-a7c0-0c8ab230121e-kube-rbac-proxy-cm podName:5777f5a5-bc96-408e-a7c0-0c8ab230121e nodeName:}" failed. No retries permitted until 2026-07-06 19:33:22.316944321 +0000 UTC m=+37.329932968 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/5777f5a5-bc96-408e-a7c0-0c8ab230121e-kube-rbac-proxy-cm") pod "insights-runtime-extractor-l5bqv" (UID: "5777f5a5-bc96-408e-a7c0-0c8ab230121e") : configmap "kube-rbac-proxy" not found
Jul 06 19:33:21.827667 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:33:21.827600    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-f4p68\" (UniqueName: \"kubernetes.io/projected/5777f5a5-bc96-408e-a7c0-0c8ab230121e-kube-api-access-f4p68\") pod \"insights-runtime-extractor-l5bqv\" (UID: \"5777f5a5-bc96-408e-a7c0-0c8ab230121e\") " pod="openshift-insights/insights-runtime-extractor-l5bqv"
Jul 06 19:33:22.322151 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:33:22.322113    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/5777f5a5-bc96-408e-a7c0-0c8ab230121e-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-l5bqv\" (UID: \"5777f5a5-bc96-408e-a7c0-0c8ab230121e\") " pod="openshift-insights/insights-runtime-extractor-l5bqv"
Jul 06 19:33:22.322360 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:33:22.322255    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/5777f5a5-bc96-408e-a7c0-0c8ab230121e-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-l5bqv\" (UID: \"5777f5a5-bc96-408e-a7c0-0c8ab230121e\") " pod="openshift-insights/insights-runtime-extractor-l5bqv"
Jul 06 19:33:22.322360 ip-10-0-131-168 kubenswrapper[2565]: E0706 19:33:22.322262    2565 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 06 19:33:22.322360 ip-10-0-131-168 kubenswrapper[2565]: E0706 19:33:22.322341    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/5777f5a5-bc96-408e-a7c0-0c8ab230121e-kube-rbac-proxy-cm podName:5777f5a5-bc96-408e-a7c0-0c8ab230121e nodeName:}" failed. No retries permitted until 2026-07-06 19:33:23.32232025 +0000 UTC m=+38.335308915 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/5777f5a5-bc96-408e-a7c0-0c8ab230121e-kube-rbac-proxy-cm") pod "insights-runtime-extractor-l5bqv" (UID: "5777f5a5-bc96-408e-a7c0-0c8ab230121e") : configmap "kube-rbac-proxy" not found
Jul 06 19:33:22.322520 ip-10-0-131-168 kubenswrapper[2565]: E0706 19:33:22.322371    2565 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 06 19:33:22.322520 ip-10-0-131-168 kubenswrapper[2565]: E0706 19:33:22.322415    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5777f5a5-bc96-408e-a7c0-0c8ab230121e-insights-runtime-extractor-tls podName:5777f5a5-bc96-408e-a7c0-0c8ab230121e nodeName:}" failed. No retries permitted until 2026-07-06 19:33:23.322399518 +0000 UTC m=+38.335388165 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/5777f5a5-bc96-408e-a7c0-0c8ab230121e-insights-runtime-extractor-tls") pod "insights-runtime-extractor-l5bqv" (UID: "5777f5a5-bc96-408e-a7c0-0c8ab230121e") : secret "insights-runtime-extractor-tls" not found
Jul 06 19:33:23.130568 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:33:23.130537    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/9d3c699b-09de-4376-b6df-d7200cc1f8bc-registry-tls\") pod \"image-registry-58c8d46f4-scg5r\" (UID: \"9d3c699b-09de-4376-b6df-d7200cc1f8bc\") " pod="openshift-image-registry/image-registry-58c8d46f4-scg5r"
Jul 06 19:33:23.131046 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:33:23.130638    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/b1f107bd-53cb-4a16-8b28-58ce84f656c0-metrics-tls\") pod \"dns-default-2gd6k\" (UID: \"b1f107bd-53cb-4a16-8b28-58ce84f656c0\") " pod="openshift-dns/dns-default-2gd6k"
Jul 06 19:33:23.131046 ip-10-0-131-168 kubenswrapper[2565]: E0706 19:33:23.130722    2565 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 06 19:33:23.131046 ip-10-0-131-168 kubenswrapper[2565]: E0706 19:33:23.130743    2565 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-58c8d46f4-scg5r: secret "image-registry-tls" not found
Jul 06 19:33:23.131046 ip-10-0-131-168 kubenswrapper[2565]: E0706 19:33:23.130765    2565 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 06 19:33:23.131046 ip-10-0-131-168 kubenswrapper[2565]: E0706 19:33:23.130837    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/9d3c699b-09de-4376-b6df-d7200cc1f8bc-registry-tls podName:9d3c699b-09de-4376-b6df-d7200cc1f8bc nodeName:}" failed. No retries permitted until 2026-07-06 19:33:27.130815501 +0000 UTC m=+42.143804150 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/9d3c699b-09de-4376-b6df-d7200cc1f8bc-registry-tls") pod "image-registry-58c8d46f4-scg5r" (UID: "9d3c699b-09de-4376-b6df-d7200cc1f8bc") : secret "image-registry-tls" not found
Jul 06 19:33:23.131046 ip-10-0-131-168 kubenswrapper[2565]: E0706 19:33:23.130856    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b1f107bd-53cb-4a16-8b28-58ce84f656c0-metrics-tls podName:b1f107bd-53cb-4a16-8b28-58ce84f656c0 nodeName:}" failed. No retries permitted until 2026-07-06 19:33:27.130847491 +0000 UTC m=+42.143836143 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/b1f107bd-53cb-4a16-8b28-58ce84f656c0-metrics-tls") pod "dns-default-2gd6k" (UID: "b1f107bd-53cb-4a16-8b28-58ce84f656c0") : secret "dns-default-metrics-tls" not found
Jul 06 19:33:23.332874 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:33:23.332765    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/5777f5a5-bc96-408e-a7c0-0c8ab230121e-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-l5bqv\" (UID: \"5777f5a5-bc96-408e-a7c0-0c8ab230121e\") " pod="openshift-insights/insights-runtime-extractor-l5bqv"
Jul 06 19:33:23.332874 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:33:23.332850    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/5777f5a5-bc96-408e-a7c0-0c8ab230121e-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-l5bqv\" (UID: \"5777f5a5-bc96-408e-a7c0-0c8ab230121e\") " pod="openshift-insights/insights-runtime-extractor-l5bqv"
Jul 06 19:33:23.333053 ip-10-0-131-168 kubenswrapper[2565]: E0706 19:33:23.332912    2565 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 06 19:33:23.333053 ip-10-0-131-168 kubenswrapper[2565]: E0706 19:33:23.332961    2565 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 06 19:33:23.333053 ip-10-0-131-168 kubenswrapper[2565]: E0706 19:33:23.332984    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5777f5a5-bc96-408e-a7c0-0c8ab230121e-insights-runtime-extractor-tls podName:5777f5a5-bc96-408e-a7c0-0c8ab230121e nodeName:}" failed. No retries permitted until 2026-07-06 19:33:25.332967832 +0000 UTC m=+40.345956481 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/5777f5a5-bc96-408e-a7c0-0c8ab230121e-insights-runtime-extractor-tls") pod "insights-runtime-extractor-l5bqv" (UID: "5777f5a5-bc96-408e-a7c0-0c8ab230121e") : secret "insights-runtime-extractor-tls" not found
Jul 06 19:33:23.333053 ip-10-0-131-168 kubenswrapper[2565]: E0706 19:33:23.333012    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/5777f5a5-bc96-408e-a7c0-0c8ab230121e-kube-rbac-proxy-cm podName:5777f5a5-bc96-408e-a7c0-0c8ab230121e nodeName:}" failed. No retries permitted until 2026-07-06 19:33:25.332999861 +0000 UTC m=+40.345988507 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/5777f5a5-bc96-408e-a7c0-0c8ab230121e-kube-rbac-proxy-cm") pod "insights-runtime-extractor-l5bqv" (UID: "5777f5a5-bc96-408e-a7c0-0c8ab230121e") : configmap "kube-rbac-proxy" not found
Jul 06 19:33:23.769213 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:33:23.769182    2565 generic.go:356] "Generic (PLEG): container finished" podID="9449cdae-9fc6-4f64-a88a-db3f2e08b626" containerID="3aa9d527b03211efc292768a8ad14632fb28327f865655e0c106fa1b3b96dea0" exitCode=0
Jul 06 19:33:23.769391 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:33:23.769252    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-cjmdl" event={"ID":"9449cdae-9fc6-4f64-a88a-db3f2e08b626","Type":"ContainerDied","Data":"3aa9d527b03211efc292768a8ad14632fb28327f865655e0c106fa1b3b96dea0"}
Jul 06 19:33:23.770614 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:33:23.770592    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-sk5qz" event={"ID":"5cebd7e7-350b-4360-a9f5-e7ef0889b9c2","Type":"ContainerStarted","Data":"04de29d2bdc4137a7b10c6fdaa5103b056fc2de119e52667a6fc3881d75de995"}
Jul 06 19:33:23.808319 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:33:23.808276    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-sk5qz" podStartSLOduration=1.612318427 podStartE2EDuration="4.808262274s" totalImagesPullingTime="3.195943847s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 19:33:19 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 19:33:23.807209357 +0000 UTC m=+38.820198047" watchObservedRunningTime="2026-07-06 19:33:23.808262274 +0000 UTC m=+38.821250942"
Jul 06 19:33:24.165895 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:33:24.165870    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-kx6hd_0ecbe788-9e2c-446a-b154-7b805f3983dd/dns-node-resolver/0.log"
Jul 06 19:33:24.503659 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:33:24.503459    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-service-ca/service-ca-758f599c5-xltqk"]
Jul 06 19:33:24.516237 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:33:24.516213    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-758f599c5-xltqk"]
Jul 06 19:33:24.516346 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:33:24.516302    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-758f599c5-xltqk"
Jul 06 19:33:24.519216 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:33:24.519138    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"signing-key\""
Jul 06 19:33:24.519388 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:33:24.519374    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"signing-cabundle\""
Jul 06 19:33:24.519468 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:33:24.519390    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"service-ca-dockercfg-ddnb2\""
Jul 06 19:33:24.519468 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:33:24.519424    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"kube-root-ca.crt\""
Jul 06 19:33:24.520311 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:33:24.520297    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"openshift-service-ca.crt\""
Jul 06 19:33:24.543506 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:33:24.543484    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mpksx\" (UniqueName: \"kubernetes.io/projected/959daa55-f445-47a4-8049-d9e7c6c4729d-kube-api-access-mpksx\") pod \"service-ca-758f599c5-xltqk\" (UID: \"959daa55-f445-47a4-8049-d9e7c6c4729d\") " pod="openshift-service-ca/service-ca-758f599c5-xltqk"
Jul 06 19:33:24.543581 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:33:24.543511    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/959daa55-f445-47a4-8049-d9e7c6c4729d-signing-cabundle\") pod \"service-ca-758f599c5-xltqk\" (UID: \"959daa55-f445-47a4-8049-d9e7c6c4729d\") " pod="openshift-service-ca/service-ca-758f599c5-xltqk"
Jul 06 19:33:24.543615 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:33:24.543579    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/959daa55-f445-47a4-8049-d9e7c6c4729d-signing-key\") pod \"service-ca-758f599c5-xltqk\" (UID: \"959daa55-f445-47a4-8049-d9e7c6c4729d\") " pod="openshift-service-ca/service-ca-758f599c5-xltqk"
Jul 06 19:33:24.643992 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:33:24.643957    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/959daa55-f445-47a4-8049-d9e7c6c4729d-signing-key\") pod \"service-ca-758f599c5-xltqk\" (UID: \"959daa55-f445-47a4-8049-d9e7c6c4729d\") " pod="openshift-service-ca/service-ca-758f599c5-xltqk"
Jul 06 19:33:24.644151 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:33:24.644028    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mpksx\" (UniqueName: \"kubernetes.io/projected/959daa55-f445-47a4-8049-d9e7c6c4729d-kube-api-access-mpksx\") pod \"service-ca-758f599c5-xltqk\" (UID: \"959daa55-f445-47a4-8049-d9e7c6c4729d\") " pod="openshift-service-ca/service-ca-758f599c5-xltqk"
Jul 06 19:33:24.644151 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:33:24.644048    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/959daa55-f445-47a4-8049-d9e7c6c4729d-signing-cabundle\") pod \"service-ca-758f599c5-xltqk\" (UID: \"959daa55-f445-47a4-8049-d9e7c6c4729d\") " pod="openshift-service-ca/service-ca-758f599c5-xltqk"
Jul 06 19:33:24.644595 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:33:24.644578    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/959daa55-f445-47a4-8049-d9e7c6c4729d-signing-cabundle\") pod \"service-ca-758f599c5-xltqk\" (UID: \"959daa55-f445-47a4-8049-d9e7c6c4729d\") " pod="openshift-service-ca/service-ca-758f599c5-xltqk"
Jul 06 19:33:24.647552 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:33:24.647532    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/959daa55-f445-47a4-8049-d9e7c6c4729d-signing-key\") pod \"service-ca-758f599c5-xltqk\" (UID: \"959daa55-f445-47a4-8049-d9e7c6c4729d\") " pod="openshift-service-ca/service-ca-758f599c5-xltqk"
Jul 06 19:33:24.652472 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:33:24.652450    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mpksx\" (UniqueName: \"kubernetes.io/projected/959daa55-f445-47a4-8049-d9e7c6c4729d-kube-api-access-mpksx\") pod \"service-ca-758f599c5-xltqk\" (UID: \"959daa55-f445-47a4-8049-d9e7c6c4729d\") " pod="openshift-service-ca/service-ca-758f599c5-xltqk"
Jul 06 19:33:24.776260 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:33:24.776174    2565 generic.go:356] "Generic (PLEG): container finished" podID="9449cdae-9fc6-4f64-a88a-db3f2e08b626" containerID="657b35eab12651dd4cfc76dec3530bfb7f36c2ec622e2b321b479873e5172478" exitCode=0
Jul 06 19:33:24.776260 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:33:24.776220    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-cjmdl" event={"ID":"9449cdae-9fc6-4f64-a88a-db3f2e08b626","Type":"ContainerDied","Data":"657b35eab12651dd4cfc76dec3530bfb7f36c2ec622e2b321b479873e5172478"}
Jul 06 19:33:24.826046 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:33:24.826014    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-758f599c5-xltqk"
Jul 06 19:33:25.002557 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:33:25.002525    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-758f599c5-xltqk"]
Jul 06 19:33:25.005163 ip-10-0-131-168 kubenswrapper[2565]: W0706 19:33:25.005141    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod959daa55_f445_47a4_8049_d9e7c6c4729d.slice/crio-ce4822eb4d6e44f89086c9d59609f48919dbe59daec74ebede0486ae8f2057a2 WatchSource:0}: Error finding container ce4822eb4d6e44f89086c9d59609f48919dbe59daec74ebede0486ae8f2057a2: Status 404 returned error can't find the container with id ce4822eb4d6e44f89086c9d59609f48919dbe59daec74ebede0486ae8f2057a2
Jul 06 19:33:25.166377 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:33:25.166357    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-cblv9_35683ef3-3b68-4694-acaf-aaee8f598255/node-ca/0.log"
Jul 06 19:33:25.350629 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:33:25.350602    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/5777f5a5-bc96-408e-a7c0-0c8ab230121e-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-l5bqv\" (UID: \"5777f5a5-bc96-408e-a7c0-0c8ab230121e\") " pod="openshift-insights/insights-runtime-extractor-l5bqv"
Jul 06 19:33:25.350825 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:33:25.350803    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/5777f5a5-bc96-408e-a7c0-0c8ab230121e-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-l5bqv\" (UID: \"5777f5a5-bc96-408e-a7c0-0c8ab230121e\") " pod="openshift-insights/insights-runtime-extractor-l5bqv"
Jul 06 19:33:25.350936 ip-10-0-131-168 kubenswrapper[2565]: E0706 19:33:25.350924    2565 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 06 19:33:25.350993 ip-10-0-131-168 kubenswrapper[2565]: E0706 19:33:25.350985    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5777f5a5-bc96-408e-a7c0-0c8ab230121e-insights-runtime-extractor-tls podName:5777f5a5-bc96-408e-a7c0-0c8ab230121e nodeName:}" failed. No retries permitted until 2026-07-06 19:33:29.350972239 +0000 UTC m=+44.363960889 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/5777f5a5-bc96-408e-a7c0-0c8ab230121e-insights-runtime-extractor-tls") pod "insights-runtime-extractor-l5bqv" (UID: "5777f5a5-bc96-408e-a7c0-0c8ab230121e") : secret "insights-runtime-extractor-tls" not found
Jul 06 19:33:25.351110 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:33:25.351093    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/5777f5a5-bc96-408e-a7c0-0c8ab230121e-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-l5bqv\" (UID: \"5777f5a5-bc96-408e-a7c0-0c8ab230121e\") " pod="openshift-insights/insights-runtime-extractor-l5bqv"
Jul 06 19:33:25.782510 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:33:25.782472    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-cjmdl" event={"ID":"9449cdae-9fc6-4f64-a88a-db3f2e08b626","Type":"ContainerStarted","Data":"d2131a0562f92ab540abb118717f3d4d5eb8228472147d53a5e7316abb976854"}
Jul 06 19:33:25.783634 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:33:25.783610    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-758f599c5-xltqk" event={"ID":"959daa55-f445-47a4-8049-d9e7c6c4729d","Type":"ContainerStarted","Data":"ce4822eb4d6e44f89086c9d59609f48919dbe59daec74ebede0486ae8f2057a2"}
Jul 06 19:33:25.817150 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:33:25.817083    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-cjmdl" podStartSLOduration=8.508010649 podStartE2EDuration="40.817063366s" totalImagesPullingTime="32.309052717s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-06 19:32:45 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 19:33:25.81485029 +0000 UTC m=+40.827838984" watchObservedRunningTime="2026-07-06 19:33:25.817063366 +0000 UTC m=+40.830052035"
Jul 06 19:33:25.967403 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:33:25.967371    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-sk5qz_5cebd7e7-350b-4360-a9f5-e7ef0889b9c2/serve-healthcheck-canary/0.log"
Jul 06 19:33:27.164697 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:33:27.164657    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/9d3c699b-09de-4376-b6df-d7200cc1f8bc-registry-tls\") pod \"image-registry-58c8d46f4-scg5r\" (UID: \"9d3c699b-09de-4376-b6df-d7200cc1f8bc\") " pod="openshift-image-registry/image-registry-58c8d46f4-scg5r"
Jul 06 19:33:27.165082 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:33:27.164801    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/b1f107bd-53cb-4a16-8b28-58ce84f656c0-metrics-tls\") pod \"dns-default-2gd6k\" (UID: \"b1f107bd-53cb-4a16-8b28-58ce84f656c0\") " pod="openshift-dns/dns-default-2gd6k"
Jul 06 19:33:27.165082 ip-10-0-131-168 kubenswrapper[2565]: E0706 19:33:27.164822    2565 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 06 19:33:27.165082 ip-10-0-131-168 kubenswrapper[2565]: E0706 19:33:27.164841    2565 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-58c8d46f4-scg5r: secret "image-registry-tls" not found
Jul 06 19:33:27.165082 ip-10-0-131-168 kubenswrapper[2565]: E0706 19:33:27.164893    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/9d3c699b-09de-4376-b6df-d7200cc1f8bc-registry-tls podName:9d3c699b-09de-4376-b6df-d7200cc1f8bc nodeName:}" failed. No retries permitted until 2026-07-06 19:33:35.164879094 +0000 UTC m=+50.177867740 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/9d3c699b-09de-4376-b6df-d7200cc1f8bc-registry-tls") pod "image-registry-58c8d46f4-scg5r" (UID: "9d3c699b-09de-4376-b6df-d7200cc1f8bc") : secret "image-registry-tls" not found
Jul 06 19:33:27.165082 ip-10-0-131-168 kubenswrapper[2565]: E0706 19:33:27.164901    2565 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 06 19:33:27.165082 ip-10-0-131-168 kubenswrapper[2565]: E0706 19:33:27.164942    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b1f107bd-53cb-4a16-8b28-58ce84f656c0-metrics-tls podName:b1f107bd-53cb-4a16-8b28-58ce84f656c0 nodeName:}" failed. No retries permitted until 2026-07-06 19:33:35.164931273 +0000 UTC m=+50.177919921 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/b1f107bd-53cb-4a16-8b28-58ce84f656c0-metrics-tls") pod "dns-default-2gd6k" (UID: "b1f107bd-53cb-4a16-8b28-58ce84f656c0") : secret "dns-default-metrics-tls" not found
Jul 06 19:33:27.793568 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:33:27.793533    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-758f599c5-xltqk" event={"ID":"959daa55-f445-47a4-8049-d9e7c6c4729d","Type":"ContainerStarted","Data":"1eaa126ec5664611923781f93d2aa8491c3c6c4e142798e4da56bed82c7dde5e"}
Jul 06 19:33:27.815986 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:33:27.815941    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-service-ca/service-ca-758f599c5-xltqk" podStartSLOduration=1.5101098849999999 podStartE2EDuration="3.815927145s" totalImagesPullingTime="2.30581726s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 19:33:24 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 19:33:27.814888815 +0000 UTC m=+42.827877484" watchObservedRunningTime="2026-07-06 19:33:27.815927145 +0000 UTC m=+42.828915856"
Jul 06 19:33:29.382142 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:33:29.382085    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/5777f5a5-bc96-408e-a7c0-0c8ab230121e-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-l5bqv\" (UID: \"5777f5a5-bc96-408e-a7c0-0c8ab230121e\") " pod="openshift-insights/insights-runtime-extractor-l5bqv"
Jul 06 19:33:29.382619 ip-10-0-131-168 kubenswrapper[2565]: E0706 19:33:29.382265    2565 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 06 19:33:29.382619 ip-10-0-131-168 kubenswrapper[2565]: E0706 19:33:29.382351    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5777f5a5-bc96-408e-a7c0-0c8ab230121e-insights-runtime-extractor-tls podName:5777f5a5-bc96-408e-a7c0-0c8ab230121e nodeName:}" failed. No retries permitted until 2026-07-06 19:33:37.382331095 +0000 UTC m=+52.395319749 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/5777f5a5-bc96-408e-a7c0-0c8ab230121e-insights-runtime-extractor-tls") pod "insights-runtime-extractor-l5bqv" (UID: "5777f5a5-bc96-408e-a7c0-0c8ab230121e") : secret "insights-runtime-extractor-tls" not found
Jul 06 19:33:35.225675 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:33:35.225637    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/b1f107bd-53cb-4a16-8b28-58ce84f656c0-metrics-tls\") pod \"dns-default-2gd6k\" (UID: \"b1f107bd-53cb-4a16-8b28-58ce84f656c0\") " pod="openshift-dns/dns-default-2gd6k"
Jul 06 19:33:35.226152 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:33:35.225726    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/9d3c699b-09de-4376-b6df-d7200cc1f8bc-registry-tls\") pod \"image-registry-58c8d46f4-scg5r\" (UID: \"9d3c699b-09de-4376-b6df-d7200cc1f8bc\") " pod="openshift-image-registry/image-registry-58c8d46f4-scg5r"
Jul 06 19:33:35.228059 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:33:35.228036    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/b1f107bd-53cb-4a16-8b28-58ce84f656c0-metrics-tls\") pod \"dns-default-2gd6k\" (UID: \"b1f107bd-53cb-4a16-8b28-58ce84f656c0\") " pod="openshift-dns/dns-default-2gd6k"
Jul 06 19:33:35.228162 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:33:35.228077    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/9d3c699b-09de-4376-b6df-d7200cc1f8bc-registry-tls\") pod \"image-registry-58c8d46f4-scg5r\" (UID: \"9d3c699b-09de-4376-b6df-d7200cc1f8bc\") " pod="openshift-image-registry/image-registry-58c8d46f4-scg5r"
Jul 06 19:33:35.246011 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:33:35.245985    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-2gd6k"
Jul 06 19:33:35.260224 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:33:35.260201    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-58c8d46f4-scg5r"
Jul 06 19:33:35.403101 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:33:35.403058    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-2gd6k"]
Jul 06 19:33:35.420439 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:33:35.420414    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-58c8d46f4-scg5r"]
Jul 06 19:33:35.426447 ip-10-0-131-168 kubenswrapper[2565]: W0706 19:33:35.426423    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb1f107bd_53cb_4a16_8b28_58ce84f656c0.slice/crio-c3faf7ac9238ffa121752d1329069b1bbc0a5e0ec818b08d41a270d085112162 WatchSource:0}: Error finding container c3faf7ac9238ffa121752d1329069b1bbc0a5e0ec818b08d41a270d085112162: Status 404 returned error can't find the container with id c3faf7ac9238ffa121752d1329069b1bbc0a5e0ec818b08d41a270d085112162
Jul 06 19:33:35.427293 ip-10-0-131-168 kubenswrapper[2565]: W0706 19:33:35.427256    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9d3c699b_09de_4376_b6df_d7200cc1f8bc.slice/crio-78551e45998c405a6dffecb9bab68f946df3ec5ec9149ab4bae0100e2f50d675 WatchSource:0}: Error finding container 78551e45998c405a6dffecb9bab68f946df3ec5ec9149ab4bae0100e2f50d675: Status 404 returned error can't find the container with id 78551e45998c405a6dffecb9bab68f946df3ec5ec9149ab4bae0100e2f50d675
Jul 06 19:33:35.814752 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:33:35.814671    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-2gd6k" event={"ID":"b1f107bd-53cb-4a16-8b28-58ce84f656c0","Type":"ContainerStarted","Data":"c3faf7ac9238ffa121752d1329069b1bbc0a5e0ec818b08d41a270d085112162"}
Jul 06 19:33:35.816137 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:33:35.816109    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-58c8d46f4-scg5r" event={"ID":"9d3c699b-09de-4376-b6df-d7200cc1f8bc","Type":"ContainerStarted","Data":"4e2380209320b1c4c28faaf02bb86982f5198fe389e21b7caea23093fc0f2185"}
Jul 06 19:33:35.816248 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:33:35.816156    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-58c8d46f4-scg5r" event={"ID":"9d3c699b-09de-4376-b6df-d7200cc1f8bc","Type":"ContainerStarted","Data":"78551e45998c405a6dffecb9bab68f946df3ec5ec9149ab4bae0100e2f50d675"}
Jul 06 19:33:35.816295 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:33:35.816246    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-58c8d46f4-scg5r"
Jul 06 19:33:35.839377 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:33:35.839332    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-58c8d46f4-scg5r" podStartSLOduration=40.839316997 podStartE2EDuration="40.839316997s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 19:32:55 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 19:33:35.838029053 +0000 UTC m=+50.851017722" watchObservedRunningTime="2026-07-06 19:33:35.839316997 +0000 UTC m=+50.852305662"
Jul 06 19:33:37.446824 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:33:37.446786    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/5777f5a5-bc96-408e-a7c0-0c8ab230121e-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-l5bqv\" (UID: \"5777f5a5-bc96-408e-a7c0-0c8ab230121e\") " pod="openshift-insights/insights-runtime-extractor-l5bqv"
Jul 06 19:33:37.449048 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:33:37.449024    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/5777f5a5-bc96-408e-a7c0-0c8ab230121e-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-l5bqv\" (UID: \"5777f5a5-bc96-408e-a7c0-0c8ab230121e\") " pod="openshift-insights/insights-runtime-extractor-l5bqv"
Jul 06 19:33:37.517400 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:33:37.517367    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-l5bqv"
Jul 06 19:33:38.126983 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:33:38.126958    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-l5bqv"]
Jul 06 19:33:38.130007 ip-10-0-131-168 kubenswrapper[2565]: W0706 19:33:38.129970    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5777f5a5_bc96_408e_a7c0_0c8ab230121e.slice/crio-8aaca127e03b9bfbefb8471fb6b7383f9ec725586fcc4725fd5fd2f85d58b551 WatchSource:0}: Error finding container 8aaca127e03b9bfbefb8471fb6b7383f9ec725586fcc4725fd5fd2f85d58b551: Status 404 returned error can't find the container with id 8aaca127e03b9bfbefb8471fb6b7383f9ec725586fcc4725fd5fd2f85d58b551
Jul 06 19:33:38.829301 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:33:38.828917    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-2gd6k" event={"ID":"b1f107bd-53cb-4a16-8b28-58ce84f656c0","Type":"ContainerStarted","Data":"61a7df72fae5664cffd5039c3fcb7a0da84e2c1aaa65fd3315700a95caf3454c"}
Jul 06 19:33:38.829301 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:33:38.828994    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-2gd6k" event={"ID":"b1f107bd-53cb-4a16-8b28-58ce84f656c0","Type":"ContainerStarted","Data":"2bf506a08d150fc2b02741343e96afd692c11a111745d4c4f42dca53cc5b463d"}
Jul 06 19:33:38.829301 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:33:38.829210    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-2gd6k"
Jul 06 19:33:38.830701 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:33:38.830673    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-l5bqv" event={"ID":"5777f5a5-bc96-408e-a7c0-0c8ab230121e","Type":"ContainerStarted","Data":"8aaca127e03b9bfbefb8471fb6b7383f9ec725586fcc4725fd5fd2f85d58b551"}
Jul 06 19:33:38.849404 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:33:38.849346    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-2gd6k" podStartSLOduration=16.914950456 podStartE2EDuration="19.849325594s" totalImagesPullingTime="2.934375138s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 19:33:19 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 19:33:38.848104145 +0000 UTC m=+53.861092840" watchObservedRunningTime="2026-07-06 19:33:38.849325594 +0000 UTC m=+53.862314265"
Jul 06 19:33:42.845805 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:33:42.845707    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-l5bqv" event={"ID":"5777f5a5-bc96-408e-a7c0-0c8ab230121e","Type":"ContainerStarted","Data":"4cf2f9f228cb910cec1cd206e7341bddd55013b00d22a9b43a317bd5f7b0c01e"}
Jul 06 19:33:42.845805 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:33:42.845765    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-l5bqv" event={"ID":"5777f5a5-bc96-408e-a7c0-0c8ab230121e","Type":"ContainerStarted","Data":"591b2ce0fac9614f27c50db7e4d5840b8d12990daa5ed851ba8ed28911efad55"}
Jul 06 19:33:44.741004 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:33:44.740970    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-8kjqk"
Jul 06 19:33:45.858282 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:33:45.858242    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-l5bqv" event={"ID":"5777f5a5-bc96-408e-a7c0-0c8ab230121e","Type":"ContainerStarted","Data":"ecb74b9c8ed455d1f79b2b18eca7dc0f21d0fea85c6e8fc3b402d6620c9e5227"}
Jul 06 19:33:45.883420 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:33:45.883364    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-l5bqv" podStartSLOduration=18.165677889 podStartE2EDuration="24.883348671s" totalImagesPullingTime="6.717670782s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-06 19:33:21 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 19:33:45.882226573 +0000 UTC m=+60.895215242" watchObservedRunningTime="2026-07-06 19:33:45.883348671 +0000 UTC m=+60.896337353"
Jul 06 19:33:47.681549 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:33:47.681514    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-58fb6c47f8-shw2h"]
Jul 06 19:33:47.684055 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:33:47.684038    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-58fb6c47f8-shw2h"
Jul 06 19:33:47.687581 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:33:47.687556    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"kube-root-ca.crt\""
Jul 06 19:33:47.688943 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:33:47.688919    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"openshift-service-ca.crt\""
Jul 06 19:33:47.689070 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:33:47.688948    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"work-manager-hub-kubeconfig\""
Jul 06 19:33:47.689070 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:33:47.689023    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"open-cluster-management-image-pull-credentials\""
Jul 06 19:33:47.700321 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:33:47.700302    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-c9cf5c8db-nw262"]
Jul 06 19:33:47.702030 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:33:47.702016    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-c9cf5c8db-nw262"
Jul 06 19:33:47.705494 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:33:47.705479    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"managed-serviceaccount-dockercfg-8f5gm\""
Jul 06 19:33:47.705761 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:33:47.705746    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"managed-serviceaccount-hub-kubeconfig\""
Jul 06 19:33:47.712144 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:33:47.712125    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-58c8d46f4-scg5r"]
Jul 06 19:33:47.712863 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:33:47.712844    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-58fb6c47f8-shw2h"]
Jul 06 19:33:47.720959 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:33:47.720941    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-c9cf5c8db-nw262"]
Jul 06 19:33:47.736122 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:33:47.736097    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/478269e7-05fe-4f93-a725-7bc92c443f0f-tmp\") pod \"klusterlet-addon-workmgr-58fb6c47f8-shw2h\" (UID: \"478269e7-05fe-4f93-a725-7bc92c443f0f\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-58fb6c47f8-shw2h"
Jul 06 19:33:47.736208 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:33:47.736158    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lwmtp\" (UniqueName: \"kubernetes.io/projected/478269e7-05fe-4f93-a725-7bc92c443f0f-kube-api-access-lwmtp\") pod \"klusterlet-addon-workmgr-58fb6c47f8-shw2h\" (UID: \"478269e7-05fe-4f93-a725-7bc92c443f0f\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-58fb6c47f8-shw2h"
Jul 06 19:33:47.736208 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:33:47.736185    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/478269e7-05fe-4f93-a725-7bc92c443f0f-klusterlet-config\") pod \"klusterlet-addon-workmgr-58fb6c47f8-shw2h\" (UID: \"478269e7-05fe-4f93-a725-7bc92c443f0f\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-58fb6c47f8-shw2h"
Jul 06 19:33:47.795537 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:33:47.795512    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-fb84cd9c9-h7v26"]
Jul 06 19:33:47.797395 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:33:47.797378    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-fb84cd9c9-h7v26"
Jul 06 19:33:47.814627 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:33:47.814609    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-fb84cd9c9-h7v26"]
Jul 06 19:33:47.836693 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:33:47.836667    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/478269e7-05fe-4f93-a725-7bc92c443f0f-klusterlet-config\") pod \"klusterlet-addon-workmgr-58fb6c47f8-shw2h\" (UID: \"478269e7-05fe-4f93-a725-7bc92c443f0f\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-58fb6c47f8-shw2h"
Jul 06 19:33:47.836822 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:33:47.836709    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vlwh6\" (UniqueName: \"kubernetes.io/projected/aad836d1-f78a-4e76-b498-f8b57d729cba-kube-api-access-vlwh6\") pod \"managed-serviceaccount-addon-agent-c9cf5c8db-nw262\" (UID: \"aad836d1-f78a-4e76-b498-f8b57d729cba\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-c9cf5c8db-nw262"
Jul 06 19:33:47.836822 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:33:47.836737    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/aad836d1-f78a-4e76-b498-f8b57d729cba-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-c9cf5c8db-nw262\" (UID: \"aad836d1-f78a-4e76-b498-f8b57d729cba\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-c9cf5c8db-nw262"
Jul 06 19:33:47.836822 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:33:47.836791    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lwmtp\" (UniqueName: \"kubernetes.io/projected/478269e7-05fe-4f93-a725-7bc92c443f0f-kube-api-access-lwmtp\") pod \"klusterlet-addon-workmgr-58fb6c47f8-shw2h\" (UID: \"478269e7-05fe-4f93-a725-7bc92c443f0f\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-58fb6c47f8-shw2h"
Jul 06 19:33:47.836992 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:33:47.836837    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/478269e7-05fe-4f93-a725-7bc92c443f0f-tmp\") pod \"klusterlet-addon-workmgr-58fb6c47f8-shw2h\" (UID: \"478269e7-05fe-4f93-a725-7bc92c443f0f\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-58fb6c47f8-shw2h"
Jul 06 19:33:47.837159 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:33:47.837141    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/478269e7-05fe-4f93-a725-7bc92c443f0f-tmp\") pod \"klusterlet-addon-workmgr-58fb6c47f8-shw2h\" (UID: \"478269e7-05fe-4f93-a725-7bc92c443f0f\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-58fb6c47f8-shw2h"
Jul 06 19:33:47.839125 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:33:47.839105    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/478269e7-05fe-4f93-a725-7bc92c443f0f-klusterlet-config\") pod \"klusterlet-addon-workmgr-58fb6c47f8-shw2h\" (UID: \"478269e7-05fe-4f93-a725-7bc92c443f0f\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-58fb6c47f8-shw2h"
Jul 06 19:33:47.850057 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:33:47.850037    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-lwmtp\" (UniqueName: \"kubernetes.io/projected/478269e7-05fe-4f93-a725-7bc92c443f0f-kube-api-access-lwmtp\") pod \"klusterlet-addon-workmgr-58fb6c47f8-shw2h\" (UID: \"478269e7-05fe-4f93-a725-7bc92c443f0f\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-58fb6c47f8-shw2h"
Jul 06 19:33:47.937993 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:33:47.937911    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/96bae95b-b73f-4387-96db-f55d67b9775c-installation-pull-secrets\") pod \"image-registry-fb84cd9c9-h7v26\" (UID: \"96bae95b-b73f-4387-96db-f55d67b9775c\") " pod="openshift-image-registry/image-registry-fb84cd9c9-h7v26"
Jul 06 19:33:47.937993 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:33:47.937946    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vlwh6\" (UniqueName: \"kubernetes.io/projected/aad836d1-f78a-4e76-b498-f8b57d729cba-kube-api-access-vlwh6\") pod \"managed-serviceaccount-addon-agent-c9cf5c8db-nw262\" (UID: \"aad836d1-f78a-4e76-b498-f8b57d729cba\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-c9cf5c8db-nw262"
Jul 06 19:33:47.937993 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:33:47.937967    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/aad836d1-f78a-4e76-b498-f8b57d729cba-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-c9cf5c8db-nw262\" (UID: \"aad836d1-f78a-4e76-b498-f8b57d729cba\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-c9cf5c8db-nw262"
Jul 06 19:33:47.938265 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:33:47.938034    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-b7wk7\" (UniqueName: \"kubernetes.io/projected/96bae95b-b73f-4387-96db-f55d67b9775c-kube-api-access-b7wk7\") pod \"image-registry-fb84cd9c9-h7v26\" (UID: \"96bae95b-b73f-4387-96db-f55d67b9775c\") " pod="openshift-image-registry/image-registry-fb84cd9c9-h7v26"
Jul 06 19:33:47.938265 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:33:47.938068    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/96bae95b-b73f-4387-96db-f55d67b9775c-registry-certificates\") pod \"image-registry-fb84cd9c9-h7v26\" (UID: \"96bae95b-b73f-4387-96db-f55d67b9775c\") " pod="openshift-image-registry/image-registry-fb84cd9c9-h7v26"
Jul 06 19:33:47.938265 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:33:47.938090    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/96bae95b-b73f-4387-96db-f55d67b9775c-image-registry-private-configuration\") pod \"image-registry-fb84cd9c9-h7v26\" (UID: \"96bae95b-b73f-4387-96db-f55d67b9775c\") " pod="openshift-image-registry/image-registry-fb84cd9c9-h7v26"
Jul 06 19:33:47.938265 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:33:47.938109    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/96bae95b-b73f-4387-96db-f55d67b9775c-trusted-ca\") pod \"image-registry-fb84cd9c9-h7v26\" (UID: \"96bae95b-b73f-4387-96db-f55d67b9775c\") " pod="openshift-image-registry/image-registry-fb84cd9c9-h7v26"
Jul 06 19:33:47.938265 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:33:47.938179    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/96bae95b-b73f-4387-96db-f55d67b9775c-bound-sa-token\") pod \"image-registry-fb84cd9c9-h7v26\" (UID: \"96bae95b-b73f-4387-96db-f55d67b9775c\") " pod="openshift-image-registry/image-registry-fb84cd9c9-h7v26"
Jul 06 19:33:47.938265 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:33:47.938206    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/96bae95b-b73f-4387-96db-f55d67b9775c-ca-trust-extracted\") pod \"image-registry-fb84cd9c9-h7v26\" (UID: \"96bae95b-b73f-4387-96db-f55d67b9775c\") " pod="openshift-image-registry/image-registry-fb84cd9c9-h7v26"
Jul 06 19:33:47.938265 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:33:47.938227    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/96bae95b-b73f-4387-96db-f55d67b9775c-registry-tls\") pod \"image-registry-fb84cd9c9-h7v26\" (UID: \"96bae95b-b73f-4387-96db-f55d67b9775c\") " pod="openshift-image-registry/image-registry-fb84cd9c9-h7v26"
Jul 06 19:33:47.940406 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:33:47.940382    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/aad836d1-f78a-4e76-b498-f8b57d729cba-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-c9cf5c8db-nw262\" (UID: \"aad836d1-f78a-4e76-b498-f8b57d729cba\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-c9cf5c8db-nw262"
Jul 06 19:33:47.949818 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:33:47.949796    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vlwh6\" (UniqueName: \"kubernetes.io/projected/aad836d1-f78a-4e76-b498-f8b57d729cba-kube-api-access-vlwh6\") pod \"managed-serviceaccount-addon-agent-c9cf5c8db-nw262\" (UID: \"aad836d1-f78a-4e76-b498-f8b57d729cba\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-c9cf5c8db-nw262"
Jul 06 19:33:47.996212 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:33:47.996180    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-58fb6c47f8-shw2h"
Jul 06 19:33:48.022474 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:33:48.022449    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-c9cf5c8db-nw262"
Jul 06 19:33:48.039748 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:33:48.039712    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/96bae95b-b73f-4387-96db-f55d67b9775c-bound-sa-token\") pod \"image-registry-fb84cd9c9-h7v26\" (UID: \"96bae95b-b73f-4387-96db-f55d67b9775c\") " pod="openshift-image-registry/image-registry-fb84cd9c9-h7v26"
Jul 06 19:33:48.039904 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:33:48.039760    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/96bae95b-b73f-4387-96db-f55d67b9775c-ca-trust-extracted\") pod \"image-registry-fb84cd9c9-h7v26\" (UID: \"96bae95b-b73f-4387-96db-f55d67b9775c\") " pod="openshift-image-registry/image-registry-fb84cd9c9-h7v26"
Jul 06 19:33:48.039904 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:33:48.039815    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/96bae95b-b73f-4387-96db-f55d67b9775c-registry-tls\") pod \"image-registry-fb84cd9c9-h7v26\" (UID: \"96bae95b-b73f-4387-96db-f55d67b9775c\") " pod="openshift-image-registry/image-registry-fb84cd9c9-h7v26"
Jul 06 19:33:48.039904 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:33:48.039877    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/96bae95b-b73f-4387-96db-f55d67b9775c-installation-pull-secrets\") pod \"image-registry-fb84cd9c9-h7v26\" (UID: \"96bae95b-b73f-4387-96db-f55d67b9775c\") " pod="openshift-image-registry/image-registry-fb84cd9c9-h7v26"
Jul 06 19:33:48.040545 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:33:48.039930    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-b7wk7\" (UniqueName: \"kubernetes.io/projected/96bae95b-b73f-4387-96db-f55d67b9775c-kube-api-access-b7wk7\") pod \"image-registry-fb84cd9c9-h7v26\" (UID: \"96bae95b-b73f-4387-96db-f55d67b9775c\") " pod="openshift-image-registry/image-registry-fb84cd9c9-h7v26"
Jul 06 19:33:48.040545 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:33:48.039964    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/96bae95b-b73f-4387-96db-f55d67b9775c-registry-certificates\") pod \"image-registry-fb84cd9c9-h7v26\" (UID: \"96bae95b-b73f-4387-96db-f55d67b9775c\") " pod="openshift-image-registry/image-registry-fb84cd9c9-h7v26"
Jul 06 19:33:48.040545 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:33:48.039997    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/96bae95b-b73f-4387-96db-f55d67b9775c-image-registry-private-configuration\") pod \"image-registry-fb84cd9c9-h7v26\" (UID: \"96bae95b-b73f-4387-96db-f55d67b9775c\") " pod="openshift-image-registry/image-registry-fb84cd9c9-h7v26"
Jul 06 19:33:48.040545 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:33:48.040020    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/96bae95b-b73f-4387-96db-f55d67b9775c-trusted-ca\") pod \"image-registry-fb84cd9c9-h7v26\" (UID: \"96bae95b-b73f-4387-96db-f55d67b9775c\") " pod="openshift-image-registry/image-registry-fb84cd9c9-h7v26"
Jul 06 19:33:48.040545 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:33:48.040429    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/96bae95b-b73f-4387-96db-f55d67b9775c-ca-trust-extracted\") pod \"image-registry-fb84cd9c9-h7v26\" (UID: \"96bae95b-b73f-4387-96db-f55d67b9775c\") " pod="openshift-image-registry/image-registry-fb84cd9c9-h7v26"
Jul 06 19:33:48.041256 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:33:48.041224    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/96bae95b-b73f-4387-96db-f55d67b9775c-trusted-ca\") pod \"image-registry-fb84cd9c9-h7v26\" (UID: \"96bae95b-b73f-4387-96db-f55d67b9775c\") " pod="openshift-image-registry/image-registry-fb84cd9c9-h7v26"
Jul 06 19:33:48.041821 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:33:48.041758    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/96bae95b-b73f-4387-96db-f55d67b9775c-registry-certificates\") pod \"image-registry-fb84cd9c9-h7v26\" (UID: \"96bae95b-b73f-4387-96db-f55d67b9775c\") " pod="openshift-image-registry/image-registry-fb84cd9c9-h7v26"
Jul 06 19:33:48.045347 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:33:48.044335    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/96bae95b-b73f-4387-96db-f55d67b9775c-image-registry-private-configuration\") pod \"image-registry-fb84cd9c9-h7v26\" (UID: \"96bae95b-b73f-4387-96db-f55d67b9775c\") " pod="openshift-image-registry/image-registry-fb84cd9c9-h7v26"
Jul 06 19:33:48.045347 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:33:48.044392    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/96bae95b-b73f-4387-96db-f55d67b9775c-installation-pull-secrets\") pod \"image-registry-fb84cd9c9-h7v26\" (UID: \"96bae95b-b73f-4387-96db-f55d67b9775c\") " pod="openshift-image-registry/image-registry-fb84cd9c9-h7v26"
Jul 06 19:33:48.046178 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:33:48.046135    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/96bae95b-b73f-4387-96db-f55d67b9775c-registry-tls\") pod \"image-registry-fb84cd9c9-h7v26\" (UID: \"96bae95b-b73f-4387-96db-f55d67b9775c\") " pod="openshift-image-registry/image-registry-fb84cd9c9-h7v26"
Jul 06 19:33:48.051462 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:33:48.051426    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-b7wk7\" (UniqueName: \"kubernetes.io/projected/96bae95b-b73f-4387-96db-f55d67b9775c-kube-api-access-b7wk7\") pod \"image-registry-fb84cd9c9-h7v26\" (UID: \"96bae95b-b73f-4387-96db-f55d67b9775c\") " pod="openshift-image-registry/image-registry-fb84cd9c9-h7v26"
Jul 06 19:33:48.051753 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:33:48.051731    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/96bae95b-b73f-4387-96db-f55d67b9775c-bound-sa-token\") pod \"image-registry-fb84cd9c9-h7v26\" (UID: \"96bae95b-b73f-4387-96db-f55d67b9775c\") " pod="openshift-image-registry/image-registry-fb84cd9c9-h7v26"
Jul 06 19:33:48.106194 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:33:48.106157    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-fb84cd9c9-h7v26"
Jul 06 19:33:48.127833 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:33:48.127786    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-58fb6c47f8-shw2h"]
Jul 06 19:33:48.130869 ip-10-0-131-168 kubenswrapper[2565]: W0706 19:33:48.130845    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod478269e7_05fe_4f93_a725_7bc92c443f0f.slice/crio-88a51f585078377e6403bc6fdaa471baddaff1203663197341f243383d1551ba WatchSource:0}: Error finding container 88a51f585078377e6403bc6fdaa471baddaff1203663197341f243383d1551ba: Status 404 returned error can't find the container with id 88a51f585078377e6403bc6fdaa471baddaff1203663197341f243383d1551ba
Jul 06 19:33:48.156679 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:33:48.156647    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-c9cf5c8db-nw262"]
Jul 06 19:33:48.159598 ip-10-0-131-168 kubenswrapper[2565]: W0706 19:33:48.159572    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podaad836d1_f78a_4e76_b498_f8b57d729cba.slice/crio-38ccdec55f440cf690ac30803a88ecf65d4b3fccf53f4404d0a03d71b05aec14 WatchSource:0}: Error finding container 38ccdec55f440cf690ac30803a88ecf65d4b3fccf53f4404d0a03d71b05aec14: Status 404 returned error can't find the container with id 38ccdec55f440cf690ac30803a88ecf65d4b3fccf53f4404d0a03d71b05aec14
Jul 06 19:33:48.238287 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:33:48.238207    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-fb84cd9c9-h7v26"]
Jul 06 19:33:48.240473 ip-10-0-131-168 kubenswrapper[2565]: W0706 19:33:48.240450    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod96bae95b_b73f_4387_96db_f55d67b9775c.slice/crio-4a617442d8c17c41d1b1e0b4030548c0b07ace15a6c582fd338859b2ee5d44b3 WatchSource:0}: Error finding container 4a617442d8c17c41d1b1e0b4030548c0b07ace15a6c582fd338859b2ee5d44b3: Status 404 returned error can't find the container with id 4a617442d8c17c41d1b1e0b4030548c0b07ace15a6c582fd338859b2ee5d44b3
Jul 06 19:33:48.837416 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:33:48.837384    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-2gd6k"
Jul 06 19:33:48.871283 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:33:48.871181    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-58fb6c47f8-shw2h" event={"ID":"478269e7-05fe-4f93-a725-7bc92c443f0f","Type":"ContainerStarted","Data":"88a51f585078377e6403bc6fdaa471baddaff1203663197341f243383d1551ba"}
Jul 06 19:33:48.875026 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:33:48.874837    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-fb84cd9c9-h7v26" event={"ID":"96bae95b-b73f-4387-96db-f55d67b9775c","Type":"ContainerStarted","Data":"e21726a97890ee45f8c864468e799cf6884238482b7a11c918cda15c0fb2985a"}
Jul 06 19:33:48.875026 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:33:48.874894    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-fb84cd9c9-h7v26" event={"ID":"96bae95b-b73f-4387-96db-f55d67b9775c","Type":"ContainerStarted","Data":"4a617442d8c17c41d1b1e0b4030548c0b07ace15a6c582fd338859b2ee5d44b3"}
Jul 06 19:33:48.875026 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:33:48.874922    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-fb84cd9c9-h7v26"
Jul 06 19:33:48.878353 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:33:48.878327    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-c9cf5c8db-nw262" event={"ID":"aad836d1-f78a-4e76-b498-f8b57d729cba","Type":"ContainerStarted","Data":"38ccdec55f440cf690ac30803a88ecf65d4b3fccf53f4404d0a03d71b05aec14"}
Jul 06 19:33:48.903754 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:33:48.903692    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-fb84cd9c9-h7v26" podStartSLOduration=1.90366996 podStartE2EDuration="1.90366996s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 19:33:47 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 19:33:48.902039504 +0000 UTC m=+63.915028200" watchObservedRunningTime="2026-07-06 19:33:48.90366996 +0000 UTC m=+63.916658628"
Jul 06 19:33:50.262279 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:33:50.262232    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0657d2af-82f5-428a-ba3e-fe3df6d74f8b-metrics-certs\") pod \"network-metrics-daemon-9lc4r\" (UID: \"0657d2af-82f5-428a-ba3e-fe3df6d74f8b\") " pod="openshift-multus/network-metrics-daemon-9lc4r"
Jul 06 19:33:50.262740 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:33:50.262353    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/67af2b66-be49-4b61-a200-b711f4d83397-original-pull-secret\") pod \"global-pull-secret-syncer-2rdm6\" (UID: \"67af2b66-be49-4b61-a200-b711f4d83397\") " pod="kube-system/global-pull-secret-syncer-2rdm6"
Jul 06 19:33:50.264995 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:33:50.264966    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Jul 06 19:33:50.266173 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:33:50.266145    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Jul 06 19:33:50.275988 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:33:50.275964    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/67af2b66-be49-4b61-a200-b711f4d83397-original-pull-secret\") pod \"global-pull-secret-syncer-2rdm6\" (UID: \"67af2b66-be49-4b61-a200-b711f4d83397\") " pod="kube-system/global-pull-secret-syncer-2rdm6"
Jul 06 19:33:50.276080 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:33:50.275992    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0657d2af-82f5-428a-ba3e-fe3df6d74f8b-metrics-certs\") pod \"network-metrics-daemon-9lc4r\" (UID: \"0657d2af-82f5-428a-ba3e-fe3df6d74f8b\") " pod="openshift-multus/network-metrics-daemon-9lc4r"
Jul 06 19:33:50.363555 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:33:50.363521    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bhj6j\" (UniqueName: \"kubernetes.io/projected/1cda8348-291c-4665-99e9-892c67fb326d-kube-api-access-bhj6j\") pod \"network-check-target-pc8fq\" (UID: \"1cda8348-291c-4665-99e9-892c67fb326d\") " pod="openshift-network-diagnostics/network-check-target-pc8fq"
Jul 06 19:33:50.366292 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:33:50.366272    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Jul 06 19:33:50.376991 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:33:50.376975    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Jul 06 19:33:50.388544 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:33:50.388518    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bhj6j\" (UniqueName: \"kubernetes.io/projected/1cda8348-291c-4665-99e9-892c67fb326d-kube-api-access-bhj6j\") pod \"network-check-target-pc8fq\" (UID: \"1cda8348-291c-4665-99e9-892c67fb326d\") " pod="openshift-network-diagnostics/network-check-target-pc8fq"
Jul 06 19:33:50.402935 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:33:50.402913    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-2rdm6"
Jul 06 19:33:50.413043 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:33:50.413020    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-965h5\""
Jul 06 19:33:50.418868 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:33:50.418851    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-77m84\""
Jul 06 19:33:50.420969 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:33:50.420939    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-9lc4r"
Jul 06 19:33:50.426996 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:33:50.426973    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-pc8fq"
Jul 06 19:33:50.554027 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:33:50.553998    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-2rdm6"]
Jul 06 19:33:50.557853 ip-10-0-131-168 kubenswrapper[2565]: W0706 19:33:50.557824    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod67af2b66_be49_4b61_a200_b711f4d83397.slice/crio-5b0fa2b84be3ff34f37d6bd010174aeef074dec27f941c130adc682f0be72ca8 WatchSource:0}: Error finding container 5b0fa2b84be3ff34f37d6bd010174aeef074dec27f941c130adc682f0be72ca8: Status 404 returned error can't find the container with id 5b0fa2b84be3ff34f37d6bd010174aeef074dec27f941c130adc682f0be72ca8
Jul 06 19:33:50.579752 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:33:50.579722    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-9lc4r"]
Jul 06 19:33:50.583687 ip-10-0-131-168 kubenswrapper[2565]: W0706 19:33:50.583659    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0657d2af_82f5_428a_ba3e_fe3df6d74f8b.slice/crio-53f5415cf99b6acd775e6c4ed7a2772d2d67e7329158d71aaa20c192c2fd1414 WatchSource:0}: Error finding container 53f5415cf99b6acd775e6c4ed7a2772d2d67e7329158d71aaa20c192c2fd1414: Status 404 returned error can't find the container with id 53f5415cf99b6acd775e6c4ed7a2772d2d67e7329158d71aaa20c192c2fd1414
Jul 06 19:33:50.598868 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:33:50.598847    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-pc8fq"]
Jul 06 19:33:50.601467 ip-10-0-131-168 kubenswrapper[2565]: W0706 19:33:50.601439    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1cda8348_291c_4665_99e9_892c67fb326d.slice/crio-34301783d9f7f48e6c49ad0e190793d519ab03bc084737ddad8f7a5b3b8cc0a7 WatchSource:0}: Error finding container 34301783d9f7f48e6c49ad0e190793d519ab03bc084737ddad8f7a5b3b8cc0a7: Status 404 returned error can't find the container with id 34301783d9f7f48e6c49ad0e190793d519ab03bc084737ddad8f7a5b3b8cc0a7
Jul 06 19:33:50.889632 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:33:50.889597    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-pc8fq" event={"ID":"1cda8348-291c-4665-99e9-892c67fb326d","Type":"ContainerStarted","Data":"34301783d9f7f48e6c49ad0e190793d519ab03bc084737ddad8f7a5b3b8cc0a7"}
Jul 06 19:33:50.891350 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:33:50.891320    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-9lc4r" event={"ID":"0657d2af-82f5-428a-ba3e-fe3df6d74f8b","Type":"ContainerStarted","Data":"53f5415cf99b6acd775e6c4ed7a2772d2d67e7329158d71aaa20c192c2fd1414"}
Jul 06 19:33:50.892739 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:33:50.892680    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-2rdm6" event={"ID":"67af2b66-be49-4b61-a200-b711f4d83397","Type":"ContainerStarted","Data":"5b0fa2b84be3ff34f37d6bd010174aeef074dec27f941c130adc682f0be72ca8"}
Jul 06 19:33:51.901693 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:33:51.901640    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-c9cf5c8db-nw262" event={"ID":"aad836d1-f78a-4e76-b498-f8b57d729cba","Type":"ContainerStarted","Data":"c5197d857d10f86c4a4ad2bb454c4fb0d0a17448894b5a0dc26e1ee40ca995b3"}
Jul 06 19:33:52.907215 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:33:52.907183    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-9lc4r" event={"ID":"0657d2af-82f5-428a-ba3e-fe3df6d74f8b","Type":"ContainerStarted","Data":"1cd2a3823c974542658e4f566f28c845bdf3181b9172b633eb0f1ae9b79850db"}
Jul 06 19:33:52.907682 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:33:52.907250    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-9lc4r" event={"ID":"0657d2af-82f5-428a-ba3e-fe3df6d74f8b","Type":"ContainerStarted","Data":"d2b41e4879a45dd56cb97e67b92a2e4581c7d01bb373eff6832df1788734854e"}
Jul 06 19:33:52.930392 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:33:52.930336    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-9lc4r" podStartSLOduration=66.533692555 podStartE2EDuration="1m7.93031545s" totalImagesPullingTime="1.396622895s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 19:32:45 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 19:33:52.929878309 +0000 UTC m=+67.942866982" watchObservedRunningTime="2026-07-06 19:33:52.93031545 +0000 UTC m=+67.943304121"
Jul 06 19:33:52.931289 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:33:52.930905    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-c9cf5c8db-nw262" podStartSLOduration=3.013690265 podStartE2EDuration="5.930892692s" totalImagesPullingTime="2.917202427s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 19:33:47 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 19:33:51.941795688 +0000 UTC m=+66.954784354" watchObservedRunningTime="2026-07-06 19:33:52.930892692 +0000 UTC m=+67.943881364"
Jul 06 19:33:57.718055 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:33:57.718026    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-58c8d46f4-scg5r"
Jul 06 19:33:57.924757 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:33:57.924724    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-58fb6c47f8-shw2h" event={"ID":"478269e7-05fe-4f93-a725-7bc92c443f0f","Type":"ContainerStarted","Data":"1ce3ee410d277771c5b4736f26b1d4cf11847939db5d18b255fbdb4118fc2408"}
Jul 06 19:33:57.924975 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:33:57.924892    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-58fb6c47f8-shw2h"
Jul 06 19:33:57.926332 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:33:57.926293    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-pc8fq" event={"ID":"1cda8348-291c-4665-99e9-892c67fb326d","Type":"ContainerStarted","Data":"ba4f8825d0cf02a14ba9c1ff3b74f1cd160a4a91ad526455608d74ec29dd66f8"}
Jul 06 19:33:57.926472 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:33:57.926428    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-pc8fq"
Jul 06 19:33:57.927008 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:33:57.926986    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-58fb6c47f8-shw2h"
Jul 06 19:33:57.927861 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:33:57.927842    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-2rdm6" event={"ID":"67af2b66-be49-4b61-a200-b711f4d83397","Type":"ContainerStarted","Data":"3a06756b1a6012aa1394a976afa8b955f4d8c32fb1681f94f2f98239adaa523d"}
Jul 06 19:33:57.949636 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:33:57.949591    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-58fb6c47f8-shw2h" podStartSLOduration=2.168340318 podStartE2EDuration="10.949576696s" totalImagesPullingTime="8.781236378s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 19:33:47 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 19:33:57.949176158 +0000 UTC m=+72.962164828" watchObservedRunningTime="2026-07-06 19:33:57.949576696 +0000 UTC m=+72.962565359"
Jul 06 19:33:57.996845 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:33:57.994386    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-2rdm6" podStartSLOduration=66.629818346 podStartE2EDuration="1m12.994359707s" totalImagesPullingTime="6.364541361s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-06 19:32:45 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 19:33:57.993433354 +0000 UTC m=+73.006422023" watchObservedRunningTime="2026-07-06 19:33:57.994359707 +0000 UTC m=+73.007348377"
Jul 06 19:33:58.604201 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:33:58.604145    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-pc8fq" podStartSLOduration=67.283138584 podStartE2EDuration="1m13.604127192s" totalImagesPullingTime="6.320988608s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 19:32:45 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 19:33:58.019332781 +0000 UTC m=+73.032321451" watchObservedRunningTime="2026-07-06 19:33:58.604127192 +0000 UTC m=+73.617115860"
Jul 06 19:33:58.605129 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:33:58.605097    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/kube-state-metrics-7c9dbb8b7d-g4s4f"]
Jul 06 19:33:58.607441 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:33:58.607422    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-g4s4f"
Jul 06 19:33:58.610084 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:33:58.610058    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-tls\""
Jul 06 19:33:58.610220 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:33:58.610195    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-kube-rbac-proxy-config\""
Jul 06 19:33:58.610302 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:33:58.610215    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\""
Jul 06 19:33:58.611597 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:33:58.611579    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\""
Jul 06 19:33:58.611879 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:33:58.611859    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-custom-resource-state-configmap\""
Jul 06 19:33:58.611964 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:33:58.611898    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-dockercfg-mbpwv\""
Jul 06 19:33:58.611964 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:33:58.611915    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\""
Jul 06 19:33:58.622596 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:33:58.622576    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-crwt9"]
Jul 06 19:33:58.624565 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:33:58.624546    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-7c9dbb8b7d-g4s4f"]
Jul 06 19:33:58.624687 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:33:58.624664    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-crwt9"
Jul 06 19:33:58.628253 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:33:58.628220    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\""
Jul 06 19:33:58.628442 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:33:58.628425    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-qrzm9\""
Jul 06 19:33:58.628599 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:33:58.628579    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\""
Jul 06 19:33:58.629029 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:33:58.629008    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\""
Jul 06 19:33:58.731802 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:33:58.731755    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/89c50da6-a17a-49d0-b9f3-5bc040961c59-volume-directive-shadow\") pod \"kube-state-metrics-7c9dbb8b7d-g4s4f\" (UID: \"89c50da6-a17a-49d0-b9f3-5bc040961c59\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-g4s4f"
Jul 06 19:33:58.732178 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:33:58.731809    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/b15806af-f7b4-4b86-9b07-222bcbdecd37-metrics-client-ca\") pod \"node-exporter-crwt9\" (UID: \"b15806af-f7b4-4b86-9b07-222bcbdecd37\") " pod="openshift-monitoring/node-exporter-crwt9"
Jul 06 19:33:58.732178 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:33:58.731845    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/b15806af-f7b4-4b86-9b07-222bcbdecd37-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-crwt9\" (UID: \"b15806af-f7b4-4b86-9b07-222bcbdecd37\") " pod="openshift-monitoring/node-exporter-crwt9"
Jul 06 19:33:58.732178 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:33:58.731864    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/b15806af-f7b4-4b86-9b07-222bcbdecd37-node-exporter-textfile\") pod \"node-exporter-crwt9\" (UID: \"b15806af-f7b4-4b86-9b07-222bcbdecd37\") " pod="openshift-monitoring/node-exporter-crwt9"
Jul 06 19:33:58.732178 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:33:58.731881    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/b15806af-f7b4-4b86-9b07-222bcbdecd37-node-exporter-accelerators-collector-config\") pod \"node-exporter-crwt9\" (UID: \"b15806af-f7b4-4b86-9b07-222bcbdecd37\") " pod="openshift-monitoring/node-exporter-crwt9"
Jul 06 19:33:58.732178 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:33:58.731912    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2wh2w\" (UniqueName: \"kubernetes.io/projected/89c50da6-a17a-49d0-b9f3-5bc040961c59-kube-api-access-2wh2w\") pod \"kube-state-metrics-7c9dbb8b7d-g4s4f\" (UID: \"89c50da6-a17a-49d0-b9f3-5bc040961c59\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-g4s4f"
Jul 06 19:33:58.732178 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:33:58.732034    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/89c50da6-a17a-49d0-b9f3-5bc040961c59-metrics-client-ca\") pod \"kube-state-metrics-7c9dbb8b7d-g4s4f\" (UID: \"89c50da6-a17a-49d0-b9f3-5bc040961c59\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-g4s4f"
Jul 06 19:33:58.732178 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:33:58.732077    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/89c50da6-a17a-49d0-b9f3-5bc040961c59-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-7c9dbb8b7d-g4s4f\" (UID: \"89c50da6-a17a-49d0-b9f3-5bc040961c59\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-g4s4f"
Jul 06 19:33:58.732178 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:33:58.732120    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/89c50da6-a17a-49d0-b9f3-5bc040961c59-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-7c9dbb8b7d-g4s4f\" (UID: \"89c50da6-a17a-49d0-b9f3-5bc040961c59\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-g4s4f"
Jul 06 19:33:58.732178 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:33:58.732160    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/b15806af-f7b4-4b86-9b07-222bcbdecd37-root\") pod \"node-exporter-crwt9\" (UID: \"b15806af-f7b4-4b86-9b07-222bcbdecd37\") " pod="openshift-monitoring/node-exporter-crwt9"
Jul 06 19:33:58.732498 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:33:58.732186    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/89c50da6-a17a-49d0-b9f3-5bc040961c59-kube-state-metrics-tls\") pod \"kube-state-metrics-7c9dbb8b7d-g4s4f\" (UID: \"89c50da6-a17a-49d0-b9f3-5bc040961c59\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-g4s4f"
Jul 06 19:33:58.732498 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:33:58.732217    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vngnk\" (UniqueName: \"kubernetes.io/projected/b15806af-f7b4-4b86-9b07-222bcbdecd37-kube-api-access-vngnk\") pod \"node-exporter-crwt9\" (UID: \"b15806af-f7b4-4b86-9b07-222bcbdecd37\") " pod="openshift-monitoring/node-exporter-crwt9"
Jul 06 19:33:58.732498 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:33:58.732258    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/b15806af-f7b4-4b86-9b07-222bcbdecd37-sys\") pod \"node-exporter-crwt9\" (UID: \"b15806af-f7b4-4b86-9b07-222bcbdecd37\") " pod="openshift-monitoring/node-exporter-crwt9"
Jul 06 19:33:58.732498 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:33:58.732283    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/b15806af-f7b4-4b86-9b07-222bcbdecd37-node-exporter-tls\") pod \"node-exporter-crwt9\" (UID: \"b15806af-f7b4-4b86-9b07-222bcbdecd37\") " pod="openshift-monitoring/node-exporter-crwt9"
Jul 06 19:33:58.732498 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:33:58.732329    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/b15806af-f7b4-4b86-9b07-222bcbdecd37-node-exporter-wtmp\") pod \"node-exporter-crwt9\" (UID: \"b15806af-f7b4-4b86-9b07-222bcbdecd37\") " pod="openshift-monitoring/node-exporter-crwt9"
Jul 06 19:33:58.833542 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:33:58.833507    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2wh2w\" (UniqueName: \"kubernetes.io/projected/89c50da6-a17a-49d0-b9f3-5bc040961c59-kube-api-access-2wh2w\") pod \"kube-state-metrics-7c9dbb8b7d-g4s4f\" (UID: \"89c50da6-a17a-49d0-b9f3-5bc040961c59\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-g4s4f"
Jul 06 19:33:58.833542 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:33:58.833549    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/89c50da6-a17a-49d0-b9f3-5bc040961c59-metrics-client-ca\") pod \"kube-state-metrics-7c9dbb8b7d-g4s4f\" (UID: \"89c50da6-a17a-49d0-b9f3-5bc040961c59\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-g4s4f"
Jul 06 19:33:58.833801 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:33:58.833572    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/89c50da6-a17a-49d0-b9f3-5bc040961c59-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-7c9dbb8b7d-g4s4f\" (UID: \"89c50da6-a17a-49d0-b9f3-5bc040961c59\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-g4s4f"
Jul 06 19:33:58.833801 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:33:58.833605    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/89c50da6-a17a-49d0-b9f3-5bc040961c59-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-7c9dbb8b7d-g4s4f\" (UID: \"89c50da6-a17a-49d0-b9f3-5bc040961c59\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-g4s4f"
Jul 06 19:33:58.833801 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:33:58.833632    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/b15806af-f7b4-4b86-9b07-222bcbdecd37-root\") pod \"node-exporter-crwt9\" (UID: \"b15806af-f7b4-4b86-9b07-222bcbdecd37\") " pod="openshift-monitoring/node-exporter-crwt9"
Jul 06 19:33:58.833801 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:33:58.833656    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/89c50da6-a17a-49d0-b9f3-5bc040961c59-kube-state-metrics-tls\") pod \"kube-state-metrics-7c9dbb8b7d-g4s4f\" (UID: \"89c50da6-a17a-49d0-b9f3-5bc040961c59\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-g4s4f"
Jul 06 19:33:58.833801 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:33:58.833678    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vngnk\" (UniqueName: \"kubernetes.io/projected/b15806af-f7b4-4b86-9b07-222bcbdecd37-kube-api-access-vngnk\") pod \"node-exporter-crwt9\" (UID: \"b15806af-f7b4-4b86-9b07-222bcbdecd37\") " pod="openshift-monitoring/node-exporter-crwt9"
Jul 06 19:33:58.833801 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:33:58.833705    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/b15806af-f7b4-4b86-9b07-222bcbdecd37-sys\") pod \"node-exporter-crwt9\" (UID: \"b15806af-f7b4-4b86-9b07-222bcbdecd37\") " pod="openshift-monitoring/node-exporter-crwt9"
Jul 06 19:33:58.833801 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:33:58.833751    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/b15806af-f7b4-4b86-9b07-222bcbdecd37-root\") pod \"node-exporter-crwt9\" (UID: \"b15806af-f7b4-4b86-9b07-222bcbdecd37\") " pod="openshift-monitoring/node-exporter-crwt9"
Jul 06 19:33:58.834175 ip-10-0-131-168 kubenswrapper[2565]: E0706 19:33:58.834066    2565 secret.go:189] Couldn't get secret openshift-monitoring/node-exporter-tls: secret "node-exporter-tls" not found
Jul 06 19:33:58.834175 ip-10-0-131-168 kubenswrapper[2565]: E0706 19:33:58.834142    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b15806af-f7b4-4b86-9b07-222bcbdecd37-node-exporter-tls podName:b15806af-f7b4-4b86-9b07-222bcbdecd37 nodeName:}" failed. No retries permitted until 2026-07-06 19:33:59.334121827 +0000 UTC m=+74.347110482 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "node-exporter-tls" (UniqueName: "kubernetes.io/secret/b15806af-f7b4-4b86-9b07-222bcbdecd37-node-exporter-tls") pod "node-exporter-crwt9" (UID: "b15806af-f7b4-4b86-9b07-222bcbdecd37") : secret "node-exporter-tls" not found
Jul 06 19:33:58.834175 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:33:58.834070    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/b15806af-f7b4-4b86-9b07-222bcbdecd37-sys\") pod \"node-exporter-crwt9\" (UID: \"b15806af-f7b4-4b86-9b07-222bcbdecd37\") " pod="openshift-monitoring/node-exporter-crwt9"
Jul 06 19:33:58.834423 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:33:58.834404    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/89c50da6-a17a-49d0-b9f3-5bc040961c59-metrics-client-ca\") pod \"kube-state-metrics-7c9dbb8b7d-g4s4f\" (UID: \"89c50da6-a17a-49d0-b9f3-5bc040961c59\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-g4s4f"
Jul 06 19:33:58.834468 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:33:58.833820    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/b15806af-f7b4-4b86-9b07-222bcbdecd37-node-exporter-tls\") pod \"node-exporter-crwt9\" (UID: \"b15806af-f7b4-4b86-9b07-222bcbdecd37\") " pod="openshift-monitoring/node-exporter-crwt9"
Jul 06 19:33:58.834501 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:33:58.834480    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/89c50da6-a17a-49d0-b9f3-5bc040961c59-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-7c9dbb8b7d-g4s4f\" (UID: \"89c50da6-a17a-49d0-b9f3-5bc040961c59\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-g4s4f"
Jul 06 19:33:58.834534 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:33:58.834505    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/b15806af-f7b4-4b86-9b07-222bcbdecd37-node-exporter-wtmp\") pod \"node-exporter-crwt9\" (UID: \"b15806af-f7b4-4b86-9b07-222bcbdecd37\") " pod="openshift-monitoring/node-exporter-crwt9"
Jul 06 19:33:58.834600 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:33:58.834581    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/89c50da6-a17a-49d0-b9f3-5bc040961c59-volume-directive-shadow\") pod \"kube-state-metrics-7c9dbb8b7d-g4s4f\" (UID: \"89c50da6-a17a-49d0-b9f3-5bc040961c59\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-g4s4f"
Jul 06 19:33:58.834637 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:33:58.834623    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/b15806af-f7b4-4b86-9b07-222bcbdecd37-node-exporter-wtmp\") pod \"node-exporter-crwt9\" (UID: \"b15806af-f7b4-4b86-9b07-222bcbdecd37\") " pod="openshift-monitoring/node-exporter-crwt9"
Jul 06 19:33:58.834673 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:33:58.834623    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/b15806af-f7b4-4b86-9b07-222bcbdecd37-metrics-client-ca\") pod \"node-exporter-crwt9\" (UID: \"b15806af-f7b4-4b86-9b07-222bcbdecd37\") " pod="openshift-monitoring/node-exporter-crwt9"
Jul 06 19:33:58.834709 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:33:58.834692    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/b15806af-f7b4-4b86-9b07-222bcbdecd37-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-crwt9\" (UID: \"b15806af-f7b4-4b86-9b07-222bcbdecd37\") " pod="openshift-monitoring/node-exporter-crwt9"
Jul 06 19:33:58.834745 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:33:58.834728    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/b15806af-f7b4-4b86-9b07-222bcbdecd37-node-exporter-textfile\") pod \"node-exporter-crwt9\" (UID: \"b15806af-f7b4-4b86-9b07-222bcbdecd37\") " pod="openshift-monitoring/node-exporter-crwt9"
Jul 06 19:33:58.834818 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:33:58.834756    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/b15806af-f7b4-4b86-9b07-222bcbdecd37-node-exporter-accelerators-collector-config\") pod \"node-exporter-crwt9\" (UID: \"b15806af-f7b4-4b86-9b07-222bcbdecd37\") " pod="openshift-monitoring/node-exporter-crwt9"
Jul 06 19:33:58.834992 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:33:58.834970    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/89c50da6-a17a-49d0-b9f3-5bc040961c59-volume-directive-shadow\") pod \"kube-state-metrics-7c9dbb8b7d-g4s4f\" (UID: \"89c50da6-a17a-49d0-b9f3-5bc040961c59\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-g4s4f"
Jul 06 19:33:58.835067 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:33:58.835050    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/b15806af-f7b4-4b86-9b07-222bcbdecd37-node-exporter-textfile\") pod \"node-exporter-crwt9\" (UID: \"b15806af-f7b4-4b86-9b07-222bcbdecd37\") " pod="openshift-monitoring/node-exporter-crwt9"
Jul 06 19:33:58.835220 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:33:58.835198    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/b15806af-f7b4-4b86-9b07-222bcbdecd37-metrics-client-ca\") pod \"node-exporter-crwt9\" (UID: \"b15806af-f7b4-4b86-9b07-222bcbdecd37\") " pod="openshift-monitoring/node-exporter-crwt9"
Jul 06 19:33:58.835490 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:33:58.835464    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/b15806af-f7b4-4b86-9b07-222bcbdecd37-node-exporter-accelerators-collector-config\") pod \"node-exporter-crwt9\" (UID: \"b15806af-f7b4-4b86-9b07-222bcbdecd37\") " pod="openshift-monitoring/node-exporter-crwt9"
Jul 06 19:33:58.836485 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:33:58.836454    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/89c50da6-a17a-49d0-b9f3-5bc040961c59-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-7c9dbb8b7d-g4s4f\" (UID: \"89c50da6-a17a-49d0-b9f3-5bc040961c59\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-g4s4f"
Jul 06 19:33:58.836974 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:33:58.836955    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/89c50da6-a17a-49d0-b9f3-5bc040961c59-kube-state-metrics-tls\") pod \"kube-state-metrics-7c9dbb8b7d-g4s4f\" (UID: \"89c50da6-a17a-49d0-b9f3-5bc040961c59\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-g4s4f"
Jul 06 19:33:58.837211 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:33:58.837195    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/b15806af-f7b4-4b86-9b07-222bcbdecd37-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-crwt9\" (UID: \"b15806af-f7b4-4b86-9b07-222bcbdecd37\") " pod="openshift-monitoring/node-exporter-crwt9"
Jul 06 19:33:58.853005 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:33:58.852979    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2wh2w\" (UniqueName: \"kubernetes.io/projected/89c50da6-a17a-49d0-b9f3-5bc040961c59-kube-api-access-2wh2w\") pod \"kube-state-metrics-7c9dbb8b7d-g4s4f\" (UID: \"89c50da6-a17a-49d0-b9f3-5bc040961c59\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-g4s4f"
Jul 06 19:33:58.855138 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:33:58.855081    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vngnk\" (UniqueName: \"kubernetes.io/projected/b15806af-f7b4-4b86-9b07-222bcbdecd37-kube-api-access-vngnk\") pod \"node-exporter-crwt9\" (UID: \"b15806af-f7b4-4b86-9b07-222bcbdecd37\") " pod="openshift-monitoring/node-exporter-crwt9"
Jul 06 19:33:58.918243 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:33:58.918206    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-g4s4f"
Jul 06 19:33:59.071275 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:33:59.071237    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-7c9dbb8b7d-g4s4f"]
Jul 06 19:33:59.074181 ip-10-0-131-168 kubenswrapper[2565]: W0706 19:33:59.074159    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod89c50da6_a17a_49d0_b9f3_5bc040961c59.slice/crio-8ab58b745566babb9032c9da7e94ba586406e1c67073c988d6884b9bbe9ddc52 WatchSource:0}: Error finding container 8ab58b745566babb9032c9da7e94ba586406e1c67073c988d6884b9bbe9ddc52: Status 404 returned error can't find the container with id 8ab58b745566babb9032c9da7e94ba586406e1c67073c988d6884b9bbe9ddc52
Jul 06 19:33:59.338468 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:33:59.338435    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/b15806af-f7b4-4b86-9b07-222bcbdecd37-node-exporter-tls\") pod \"node-exporter-crwt9\" (UID: \"b15806af-f7b4-4b86-9b07-222bcbdecd37\") " pod="openshift-monitoring/node-exporter-crwt9"
Jul 06 19:33:59.340688 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:33:59.340659    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/b15806af-f7b4-4b86-9b07-222bcbdecd37-node-exporter-tls\") pod \"node-exporter-crwt9\" (UID: \"b15806af-f7b4-4b86-9b07-222bcbdecd37\") " pod="openshift-monitoring/node-exporter-crwt9"
Jul 06 19:33:59.536177 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:33:59.536148    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-crwt9"
Jul 06 19:33:59.546254 ip-10-0-131-168 kubenswrapper[2565]: W0706 19:33:59.546229    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb15806af_f7b4_4b86_9b07_222bcbdecd37.slice/crio-7cdb2cc06c1b7575b8fe4a625b36de77498fe0427ee943d428e1a914f37717d5 WatchSource:0}: Error finding container 7cdb2cc06c1b7575b8fe4a625b36de77498fe0427ee943d428e1a914f37717d5: Status 404 returned error can't find the container with id 7cdb2cc06c1b7575b8fe4a625b36de77498fe0427ee943d428e1a914f37717d5
Jul 06 19:33:59.936581 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:33:59.936546    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-crwt9" event={"ID":"b15806af-f7b4-4b86-9b07-222bcbdecd37","Type":"ContainerStarted","Data":"7cdb2cc06c1b7575b8fe4a625b36de77498fe0427ee943d428e1a914f37717d5"}
Jul 06 19:33:59.937978 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:33:59.937952    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-g4s4f" event={"ID":"89c50da6-a17a-49d0-b9f3-5bc040961c59","Type":"ContainerStarted","Data":"8ab58b745566babb9032c9da7e94ba586406e1c67073c988d6884b9bbe9ddc52"}
Jul 06 19:34:00.945327 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:34:00.945243    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-g4s4f" event={"ID":"89c50da6-a17a-49d0-b9f3-5bc040961c59","Type":"ContainerStarted","Data":"18978a44e2f2949468d6038bf2a99c754ee854edb8ed2a854b3e93e009f5c267"}
Jul 06 19:34:00.945327 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:34:00.945308    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-g4s4f" event={"ID":"89c50da6-a17a-49d0-b9f3-5bc040961c59","Type":"ContainerStarted","Data":"ea668c3087bfcf9ce52d574bb97f5b06bd66d9ca491019ee2dc66e170493f161"}
Jul 06 19:34:00.945819 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:34:00.945328    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-g4s4f" event={"ID":"89c50da6-a17a-49d0-b9f3-5bc040961c59","Type":"ContainerStarted","Data":"cfcc1db2db4ff65aa30bac29558a92c74d6605df1249c9f39614c89b397e723e"}
Jul 06 19:34:00.947184 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:34:00.947159    2565 generic.go:356] "Generic (PLEG): container finished" podID="b15806af-f7b4-4b86-9b07-222bcbdecd37" containerID="cb21d8274d634bf7488f4b5c741c19ce76829f7d792f9269a52c08df3f1a3b8a" exitCode=0
Jul 06 19:34:00.947299 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:34:00.947222    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-crwt9" event={"ID":"b15806af-f7b4-4b86-9b07-222bcbdecd37","Type":"ContainerDied","Data":"cb21d8274d634bf7488f4b5c741c19ce76829f7d792f9269a52c08df3f1a3b8a"}
Jul 06 19:34:00.969149 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:34:00.969105    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-g4s4f" podStartSLOduration=1.359286919 podStartE2EDuration="2.969089551s" totalImagesPullingTime="1.609802632s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 19:33:58 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 19:34:00.968369165 +0000 UTC m=+75.981357830" watchObservedRunningTime="2026-07-06 19:34:00.969089551 +0000 UTC m=+75.982078220"
Jul 06 19:34:01.591401 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:34:01.591368    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/thanos-querier-7f4bd7b5cc-f9ptx"]
Jul 06 19:34:01.595195 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:34:01.595173    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-7f4bd7b5cc-f9ptx"
Jul 06 19:34:01.598061 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:34:01.598038    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-tls\""
Jul 06 19:34:01.598183 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:34:01.598156    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy\""
Jul 06 19:34:01.598259 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:34:01.598193    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-metrics\""
Jul 06 19:34:01.598259 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:34:01.598129    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-rules\""
Jul 06 19:34:01.598259 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:34:01.598144    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-dockercfg-665nd\""
Jul 06 19:34:01.598396 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:34:01.598089    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-grpc-tls-8ivl6436llvph\""
Jul 06 19:34:01.598593 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:34:01.598579    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-web\""
Jul 06 19:34:01.606154 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:34:01.606075    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-7f4bd7b5cc-f9ptx"]
Jul 06 19:34:01.760068 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:34:01.760030    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/41f79c7b-9ad4-4e8a-abb1-c107ee048bed-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-7f4bd7b5cc-f9ptx\" (UID: \"41f79c7b-9ad4-4e8a-abb1-c107ee048bed\") " pod="openshift-monitoring/thanos-querier-7f4bd7b5cc-f9ptx"
Jul 06 19:34:01.760236 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:34:01.760084    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rc2rt\" (UniqueName: \"kubernetes.io/projected/41f79c7b-9ad4-4e8a-abb1-c107ee048bed-kube-api-access-rc2rt\") pod \"thanos-querier-7f4bd7b5cc-f9ptx\" (UID: \"41f79c7b-9ad4-4e8a-abb1-c107ee048bed\") " pod="openshift-monitoring/thanos-querier-7f4bd7b5cc-f9ptx"
Jul 06 19:34:01.760236 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:34:01.760116    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/41f79c7b-9ad4-4e8a-abb1-c107ee048bed-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-7f4bd7b5cc-f9ptx\" (UID: \"41f79c7b-9ad4-4e8a-abb1-c107ee048bed\") " pod="openshift-monitoring/thanos-querier-7f4bd7b5cc-f9ptx"
Jul 06 19:34:01.760236 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:34:01.760147    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/41f79c7b-9ad4-4e8a-abb1-c107ee048bed-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-7f4bd7b5cc-f9ptx\" (UID: \"41f79c7b-9ad4-4e8a-abb1-c107ee048bed\") " pod="openshift-monitoring/thanos-querier-7f4bd7b5cc-f9ptx"
Jul 06 19:34:01.760236 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:34:01.760163    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/41f79c7b-9ad4-4e8a-abb1-c107ee048bed-secret-grpc-tls\") pod \"thanos-querier-7f4bd7b5cc-f9ptx\" (UID: \"41f79c7b-9ad4-4e8a-abb1-c107ee048bed\") " pod="openshift-monitoring/thanos-querier-7f4bd7b5cc-f9ptx"
Jul 06 19:34:01.760236 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:34:01.760206    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/41f79c7b-9ad4-4e8a-abb1-c107ee048bed-metrics-client-ca\") pod \"thanos-querier-7f4bd7b5cc-f9ptx\" (UID: \"41f79c7b-9ad4-4e8a-abb1-c107ee048bed\") " pod="openshift-monitoring/thanos-querier-7f4bd7b5cc-f9ptx"
Jul 06 19:34:01.760236 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:34:01.760231    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/41f79c7b-9ad4-4e8a-abb1-c107ee048bed-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-7f4bd7b5cc-f9ptx\" (UID: \"41f79c7b-9ad4-4e8a-abb1-c107ee048bed\") " pod="openshift-monitoring/thanos-querier-7f4bd7b5cc-f9ptx"
Jul 06 19:34:01.760466 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:34:01.760256    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/41f79c7b-9ad4-4e8a-abb1-c107ee048bed-secret-thanos-querier-tls\") pod \"thanos-querier-7f4bd7b5cc-f9ptx\" (UID: \"41f79c7b-9ad4-4e8a-abb1-c107ee048bed\") " pod="openshift-monitoring/thanos-querier-7f4bd7b5cc-f9ptx"
Jul 06 19:34:01.861355 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:34:01.861327    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/41f79c7b-9ad4-4e8a-abb1-c107ee048bed-metrics-client-ca\") pod \"thanos-querier-7f4bd7b5cc-f9ptx\" (UID: \"41f79c7b-9ad4-4e8a-abb1-c107ee048bed\") " pod="openshift-monitoring/thanos-querier-7f4bd7b5cc-f9ptx"
Jul 06 19:34:01.861510 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:34:01.861364    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/41f79c7b-9ad4-4e8a-abb1-c107ee048bed-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-7f4bd7b5cc-f9ptx\" (UID: \"41f79c7b-9ad4-4e8a-abb1-c107ee048bed\") " pod="openshift-monitoring/thanos-querier-7f4bd7b5cc-f9ptx"
Jul 06 19:34:01.861510 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:34:01.861420    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/41f79c7b-9ad4-4e8a-abb1-c107ee048bed-secret-thanos-querier-tls\") pod \"thanos-querier-7f4bd7b5cc-f9ptx\" (UID: \"41f79c7b-9ad4-4e8a-abb1-c107ee048bed\") " pod="openshift-monitoring/thanos-querier-7f4bd7b5cc-f9ptx"
Jul 06 19:34:01.861510 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:34:01.861460    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/41f79c7b-9ad4-4e8a-abb1-c107ee048bed-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-7f4bd7b5cc-f9ptx\" (UID: \"41f79c7b-9ad4-4e8a-abb1-c107ee048bed\") " pod="openshift-monitoring/thanos-querier-7f4bd7b5cc-f9ptx"
Jul 06 19:34:01.861510 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:34:01.861501    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rc2rt\" (UniqueName: \"kubernetes.io/projected/41f79c7b-9ad4-4e8a-abb1-c107ee048bed-kube-api-access-rc2rt\") pod \"thanos-querier-7f4bd7b5cc-f9ptx\" (UID: \"41f79c7b-9ad4-4e8a-abb1-c107ee048bed\") " pod="openshift-monitoring/thanos-querier-7f4bd7b5cc-f9ptx"
Jul 06 19:34:01.861726 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:34:01.861529    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/41f79c7b-9ad4-4e8a-abb1-c107ee048bed-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-7f4bd7b5cc-f9ptx\" (UID: \"41f79c7b-9ad4-4e8a-abb1-c107ee048bed\") " pod="openshift-monitoring/thanos-querier-7f4bd7b5cc-f9ptx"
Jul 06 19:34:01.861726 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:34:01.861567    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/41f79c7b-9ad4-4e8a-abb1-c107ee048bed-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-7f4bd7b5cc-f9ptx\" (UID: \"41f79c7b-9ad4-4e8a-abb1-c107ee048bed\") " pod="openshift-monitoring/thanos-querier-7f4bd7b5cc-f9ptx"
Jul 06 19:34:01.861726 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:34:01.861690    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/41f79c7b-9ad4-4e8a-abb1-c107ee048bed-secret-grpc-tls\") pod \"thanos-querier-7f4bd7b5cc-f9ptx\" (UID: \"41f79c7b-9ad4-4e8a-abb1-c107ee048bed\") " pod="openshift-monitoring/thanos-querier-7f4bd7b5cc-f9ptx"
Jul 06 19:34:01.862198 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:34:01.862136    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/41f79c7b-9ad4-4e8a-abb1-c107ee048bed-metrics-client-ca\") pod \"thanos-querier-7f4bd7b5cc-f9ptx\" (UID: \"41f79c7b-9ad4-4e8a-abb1-c107ee048bed\") " pod="openshift-monitoring/thanos-querier-7f4bd7b5cc-f9ptx"
Jul 06 19:34:01.864538 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:34:01.864290    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/41f79c7b-9ad4-4e8a-abb1-c107ee048bed-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-7f4bd7b5cc-f9ptx\" (UID: \"41f79c7b-9ad4-4e8a-abb1-c107ee048bed\") " pod="openshift-monitoring/thanos-querier-7f4bd7b5cc-f9ptx"
Jul 06 19:34:01.864538 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:34:01.864390    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/41f79c7b-9ad4-4e8a-abb1-c107ee048bed-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-7f4bd7b5cc-f9ptx\" (UID: \"41f79c7b-9ad4-4e8a-abb1-c107ee048bed\") " pod="openshift-monitoring/thanos-querier-7f4bd7b5cc-f9ptx"
Jul 06 19:34:01.864538 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:34:01.864488    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/41f79c7b-9ad4-4e8a-abb1-c107ee048bed-secret-thanos-querier-tls\") pod \"thanos-querier-7f4bd7b5cc-f9ptx\" (UID: \"41f79c7b-9ad4-4e8a-abb1-c107ee048bed\") " pod="openshift-monitoring/thanos-querier-7f4bd7b5cc-f9ptx"
Jul 06 19:34:01.864799 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:34:01.864657    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/41f79c7b-9ad4-4e8a-abb1-c107ee048bed-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-7f4bd7b5cc-f9ptx\" (UID: \"41f79c7b-9ad4-4e8a-abb1-c107ee048bed\") " pod="openshift-monitoring/thanos-querier-7f4bd7b5cc-f9ptx"
Jul 06 19:34:01.864863 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:34:01.864809    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/41f79c7b-9ad4-4e8a-abb1-c107ee048bed-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-7f4bd7b5cc-f9ptx\" (UID: \"41f79c7b-9ad4-4e8a-abb1-c107ee048bed\") " pod="openshift-monitoring/thanos-querier-7f4bd7b5cc-f9ptx"
Jul 06 19:34:01.864863 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:34:01.864845    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/41f79c7b-9ad4-4e8a-abb1-c107ee048bed-secret-grpc-tls\") pod \"thanos-querier-7f4bd7b5cc-f9ptx\" (UID: \"41f79c7b-9ad4-4e8a-abb1-c107ee048bed\") " pod="openshift-monitoring/thanos-querier-7f4bd7b5cc-f9ptx"
Jul 06 19:34:01.869997 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:34:01.869967    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rc2rt\" (UniqueName: \"kubernetes.io/projected/41f79c7b-9ad4-4e8a-abb1-c107ee048bed-kube-api-access-rc2rt\") pod \"thanos-querier-7f4bd7b5cc-f9ptx\" (UID: \"41f79c7b-9ad4-4e8a-abb1-c107ee048bed\") " pod="openshift-monitoring/thanos-querier-7f4bd7b5cc-f9ptx"
Jul 06 19:34:01.905034 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:34:01.905010    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-7f4bd7b5cc-f9ptx"
Jul 06 19:34:01.952825 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:34:01.952766    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-crwt9" event={"ID":"b15806af-f7b4-4b86-9b07-222bcbdecd37","Type":"ContainerStarted","Data":"a39de8f8c14c83acc0a92cdefbfeb89985ad834a5490c3c41828aa057ca892e6"}
Jul 06 19:34:01.953197 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:34:01.952854    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-crwt9" event={"ID":"b15806af-f7b4-4b86-9b07-222bcbdecd37","Type":"ContainerStarted","Data":"1c794c535d82394ca48d3cea14f12504d8201d5f633139a13fea95543727bcc4"}
Jul 06 19:34:01.974606 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:34:01.974551    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-crwt9" podStartSLOduration=2.754263723 podStartE2EDuration="3.974532476s" totalImagesPullingTime="1.139206295s" totalInitContainerRuntime="81.062458ms" isStatefulPod=true podCreationTimestamp="2026-07-06 19:33:58 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 19:34:01.97400345 +0000 UTC m=+76.986992131" watchObservedRunningTime="2026-07-06 19:34:01.974532476 +0000 UTC m=+76.987521145"
Jul 06 19:34:02.038881 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:34:02.038856    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-7f4bd7b5cc-f9ptx"]
Jul 06 19:34:02.040556 ip-10-0-131-168 kubenswrapper[2565]: W0706 19:34:02.040530    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod41f79c7b_9ad4_4e8a_abb1_c107ee048bed.slice/crio-69d9846a102924f2e707e2da3696db959269e68699718f987e93f8f76c301954 WatchSource:0}: Error finding container 69d9846a102924f2e707e2da3696db959269e68699718f987e93f8f76c301954: Status 404 returned error can't find the container with id 69d9846a102924f2e707e2da3696db959269e68699718f987e93f8f76c301954
Jul 06 19:34:02.958205 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:34:02.958176    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-7f4bd7b5cc-f9ptx" event={"ID":"41f79c7b-9ad4-4e8a-abb1-c107ee048bed","Type":"ContainerStarted","Data":"69d9846a102924f2e707e2da3696db959269e68699718f987e93f8f76c301954"}
Jul 06 19:34:04.968444 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:34:04.968405    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-7f4bd7b5cc-f9ptx" event={"ID":"41f79c7b-9ad4-4e8a-abb1-c107ee048bed","Type":"ContainerStarted","Data":"34091c4e92eb2e70a22ad4ed963cbf800e6a880d12606054613ca73cbf45d549"}
Jul 06 19:34:04.968885 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:34:04.968520    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-7f4bd7b5cc-f9ptx" event={"ID":"41f79c7b-9ad4-4e8a-abb1-c107ee048bed","Type":"ContainerStarted","Data":"08f05fb2534c266174d031cd68dcae8447a10cb502f6ec0eddc5889568768cc7"}
Jul 06 19:34:04.968885 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:34:04.968563    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-7f4bd7b5cc-f9ptx" event={"ID":"41f79c7b-9ad4-4e8a-abb1-c107ee048bed","Type":"ContainerStarted","Data":"9c6e8eaba9fcc614921602e919edf4af271054be8c7765c1b17f2beaf80c9475"}
Jul 06 19:34:05.978651 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:34:05.978615    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-7f4bd7b5cc-f9ptx" event={"ID":"41f79c7b-9ad4-4e8a-abb1-c107ee048bed","Type":"ContainerStarted","Data":"2514748e0601bce7a1a117b5544e9e12d774990603249c3145e1660c256aec3c"}
Jul 06 19:34:05.979160 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:34:05.978703    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-7f4bd7b5cc-f9ptx" event={"ID":"41f79c7b-9ad4-4e8a-abb1-c107ee048bed","Type":"ContainerStarted","Data":"b13ef6e2debd8e05a9a53390289b0a230565057beb79ada2cca34cdaeb91815c"}
Jul 06 19:34:05.979160 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:34:05.978729    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-7f4bd7b5cc-f9ptx" event={"ID":"41f79c7b-9ad4-4e8a-abb1-c107ee048bed","Type":"ContainerStarted","Data":"41c3852b0f5f92740f4d8ad908c0d501f6c7f66aaa5b17f5ebcf07e1264e053c"}
Jul 06 19:34:05.979160 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:34:05.978789    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/thanos-querier-7f4bd7b5cc-f9ptx"
Jul 06 19:34:06.001921 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:34:06.001866    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/thanos-querier-7f4bd7b5cc-f9ptx" podStartSLOduration=1.8425219689999999 podStartE2EDuration="5.001836916s" totalImagesPullingTime="3.159314947s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 19:34:01 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 19:34:06.000587828 +0000 UTC m=+81.013576497" watchObservedRunningTime="2026-07-06 19:34:06.001836916 +0000 UTC m=+81.014825584"
Jul 06 19:34:08.711032 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:34:08.710922    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-646b7cd74f-6rxvw"]
Jul 06 19:34:08.715744 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:34:08.715724    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-646b7cd74f-6rxvw"
Jul 06 19:34:08.718575 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:34:08.718560    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\""
Jul 06 19:34:08.718666 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:34:08.718607    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\""
Jul 06 19:34:08.720116 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:34:08.720097    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\""
Jul 06 19:34:08.720250 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:34:08.720199    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-rf9n9\""
Jul 06 19:34:08.720250 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:34:08.720218    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\""
Jul 06 19:34:08.720250 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:34:08.720220    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\""
Jul 06 19:34:08.720417 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:34:08.720254    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\""
Jul 06 19:34:08.720417 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:34:08.720397    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\""
Jul 06 19:34:08.725176 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:34:08.725155    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\""
Jul 06 19:34:08.726201 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:34:08.726180    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-646b7cd74f-6rxvw"]
Jul 06 19:34:08.817109 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:34:08.817075    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/70789112-afc0-4d48-9e90-9ef19762ae24-trusted-ca-bundle\") pod \"console-646b7cd74f-6rxvw\" (UID: \"70789112-afc0-4d48-9e90-9ef19762ae24\") " pod="openshift-console/console-646b7cd74f-6rxvw"
Jul 06 19:34:08.817296 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:34:08.817121    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/70789112-afc0-4d48-9e90-9ef19762ae24-oauth-serving-cert\") pod \"console-646b7cd74f-6rxvw\" (UID: \"70789112-afc0-4d48-9e90-9ef19762ae24\") " pod="openshift-console/console-646b7cd74f-6rxvw"
Jul 06 19:34:08.817296 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:34:08.817187    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-z7lxx\" (UniqueName: \"kubernetes.io/projected/70789112-afc0-4d48-9e90-9ef19762ae24-kube-api-access-z7lxx\") pod \"console-646b7cd74f-6rxvw\" (UID: \"70789112-afc0-4d48-9e90-9ef19762ae24\") " pod="openshift-console/console-646b7cd74f-6rxvw"
Jul 06 19:34:08.817296 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:34:08.817235    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/70789112-afc0-4d48-9e90-9ef19762ae24-console-oauth-config\") pod \"console-646b7cd74f-6rxvw\" (UID: \"70789112-afc0-4d48-9e90-9ef19762ae24\") " pod="openshift-console/console-646b7cd74f-6rxvw"
Jul 06 19:34:08.817296 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:34:08.817262    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/70789112-afc0-4d48-9e90-9ef19762ae24-console-config\") pod \"console-646b7cd74f-6rxvw\" (UID: \"70789112-afc0-4d48-9e90-9ef19762ae24\") " pod="openshift-console/console-646b7cd74f-6rxvw"
Jul 06 19:34:08.817472 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:34:08.817319    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/70789112-afc0-4d48-9e90-9ef19762ae24-console-serving-cert\") pod \"console-646b7cd74f-6rxvw\" (UID: \"70789112-afc0-4d48-9e90-9ef19762ae24\") " pod="openshift-console/console-646b7cd74f-6rxvw"
Jul 06 19:34:08.817472 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:34:08.817345    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/70789112-afc0-4d48-9e90-9ef19762ae24-service-ca\") pod \"console-646b7cd74f-6rxvw\" (UID: \"70789112-afc0-4d48-9e90-9ef19762ae24\") " pod="openshift-console/console-646b7cd74f-6rxvw"
Jul 06 19:34:08.918435 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:34:08.918400    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/70789112-afc0-4d48-9e90-9ef19762ae24-trusted-ca-bundle\") pod \"console-646b7cd74f-6rxvw\" (UID: \"70789112-afc0-4d48-9e90-9ef19762ae24\") " pod="openshift-console/console-646b7cd74f-6rxvw"
Jul 06 19:34:08.918610 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:34:08.918446    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/70789112-afc0-4d48-9e90-9ef19762ae24-oauth-serving-cert\") pod \"console-646b7cd74f-6rxvw\" (UID: \"70789112-afc0-4d48-9e90-9ef19762ae24\") " pod="openshift-console/console-646b7cd74f-6rxvw"
Jul 06 19:34:08.918610 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:34:08.918464    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-z7lxx\" (UniqueName: \"kubernetes.io/projected/70789112-afc0-4d48-9e90-9ef19762ae24-kube-api-access-z7lxx\") pod \"console-646b7cd74f-6rxvw\" (UID: \"70789112-afc0-4d48-9e90-9ef19762ae24\") " pod="openshift-console/console-646b7cd74f-6rxvw"
Jul 06 19:34:08.918610 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:34:08.918486    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/70789112-afc0-4d48-9e90-9ef19762ae24-console-oauth-config\") pod \"console-646b7cd74f-6rxvw\" (UID: \"70789112-afc0-4d48-9e90-9ef19762ae24\") " pod="openshift-console/console-646b7cd74f-6rxvw"
Jul 06 19:34:08.918610 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:34:08.918501    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/70789112-afc0-4d48-9e90-9ef19762ae24-console-config\") pod \"console-646b7cd74f-6rxvw\" (UID: \"70789112-afc0-4d48-9e90-9ef19762ae24\") " pod="openshift-console/console-646b7cd74f-6rxvw"
Jul 06 19:34:08.918610 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:34:08.918529    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/70789112-afc0-4d48-9e90-9ef19762ae24-console-serving-cert\") pod \"console-646b7cd74f-6rxvw\" (UID: \"70789112-afc0-4d48-9e90-9ef19762ae24\") " pod="openshift-console/console-646b7cd74f-6rxvw"
Jul 06 19:34:08.918610 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:34:08.918545    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/70789112-afc0-4d48-9e90-9ef19762ae24-service-ca\") pod \"console-646b7cd74f-6rxvw\" (UID: \"70789112-afc0-4d48-9e90-9ef19762ae24\") " pod="openshift-console/console-646b7cd74f-6rxvw"
Jul 06 19:34:08.919300 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:34:08.919269    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/70789112-afc0-4d48-9e90-9ef19762ae24-service-ca\") pod \"console-646b7cd74f-6rxvw\" (UID: \"70789112-afc0-4d48-9e90-9ef19762ae24\") " pod="openshift-console/console-646b7cd74f-6rxvw"
Jul 06 19:34:08.919417 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:34:08.919320    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/70789112-afc0-4d48-9e90-9ef19762ae24-console-config\") pod \"console-646b7cd74f-6rxvw\" (UID: \"70789112-afc0-4d48-9e90-9ef19762ae24\") " pod="openshift-console/console-646b7cd74f-6rxvw"
Jul 06 19:34:08.919417 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:34:08.919316    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/70789112-afc0-4d48-9e90-9ef19762ae24-oauth-serving-cert\") pod \"console-646b7cd74f-6rxvw\" (UID: \"70789112-afc0-4d48-9e90-9ef19762ae24\") " pod="openshift-console/console-646b7cd74f-6rxvw"
Jul 06 19:34:08.919570 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:34:08.919549    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/70789112-afc0-4d48-9e90-9ef19762ae24-trusted-ca-bundle\") pod \"console-646b7cd74f-6rxvw\" (UID: \"70789112-afc0-4d48-9e90-9ef19762ae24\") " pod="openshift-console/console-646b7cd74f-6rxvw"
Jul 06 19:34:08.921030 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:34:08.921010    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/70789112-afc0-4d48-9e90-9ef19762ae24-console-oauth-config\") pod \"console-646b7cd74f-6rxvw\" (UID: \"70789112-afc0-4d48-9e90-9ef19762ae24\") " pod="openshift-console/console-646b7cd74f-6rxvw"
Jul 06 19:34:08.921086 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:34:08.921065    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/70789112-afc0-4d48-9e90-9ef19762ae24-console-serving-cert\") pod \"console-646b7cd74f-6rxvw\" (UID: \"70789112-afc0-4d48-9e90-9ef19762ae24\") " pod="openshift-console/console-646b7cd74f-6rxvw"
Jul 06 19:34:08.927354 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:34:08.927331    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-z7lxx\" (UniqueName: \"kubernetes.io/projected/70789112-afc0-4d48-9e90-9ef19762ae24-kube-api-access-z7lxx\") pod \"console-646b7cd74f-6rxvw\" (UID: \"70789112-afc0-4d48-9e90-9ef19762ae24\") " pod="openshift-console/console-646b7cd74f-6rxvw"
Jul 06 19:34:09.025841 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:34:09.025750    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-646b7cd74f-6rxvw"
Jul 06 19:34:09.171629 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:34:09.171594    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-646b7cd74f-6rxvw"]
Jul 06 19:34:09.173914 ip-10-0-131-168 kubenswrapper[2565]: W0706 19:34:09.173890    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod70789112_afc0_4d48_9e90_9ef19762ae24.slice/crio-0655da15ca1542c4fe9ef0d0e7f955e5ffc447ff6f30736191122e4b3c692d71 WatchSource:0}: Error finding container 0655da15ca1542c4fe9ef0d0e7f955e5ffc447ff6f30736191122e4b3c692d71: Status 404 returned error can't find the container with id 0655da15ca1542c4fe9ef0d0e7f955e5ffc447ff6f30736191122e4b3c692d71
Jul 06 19:34:09.888293 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:34:09.888265    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-fb84cd9c9-h7v26"
Jul 06 19:34:09.995139 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:34:09.995102    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-646b7cd74f-6rxvw" event={"ID":"70789112-afc0-4d48-9e90-9ef19762ae24","Type":"ContainerStarted","Data":"0655da15ca1542c4fe9ef0d0e7f955e5ffc447ff6f30736191122e4b3c692d71"}
Jul 06 19:34:11.987543 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:34:11.987516    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/thanos-querier-7f4bd7b5cc-f9ptx"
Jul 06 19:34:12.732847 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:34:12.732754    2565 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-image-registry/image-registry-58c8d46f4-scg5r" podUID="9d3c699b-09de-4376-b6df-d7200cc1f8bc" containerName="registry" containerID="cri-o://4e2380209320b1c4c28faaf02bb86982f5198fe389e21b7caea23093fc0f2185" gracePeriod=30
Jul 06 19:34:13.002058 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:34:13.001996    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-58c8d46f4-scg5r"
Jul 06 19:34:13.010647 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:34:13.010616    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-646b7cd74f-6rxvw" event={"ID":"70789112-afc0-4d48-9e90-9ef19762ae24","Type":"ContainerStarted","Data":"5f1ad48bd33e5e067e8c50a077bb0fd36d56fdfead661c4316d8614fc432af3e"}
Jul 06 19:34:13.012039 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:34:13.012012    2565 generic.go:356] "Generic (PLEG): container finished" podID="9d3c699b-09de-4376-b6df-d7200cc1f8bc" containerID="4e2380209320b1c4c28faaf02bb86982f5198fe389e21b7caea23093fc0f2185" exitCode=0
Jul 06 19:34:13.012177 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:34:13.012054    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-58c8d46f4-scg5r" event={"ID":"9d3c699b-09de-4376-b6df-d7200cc1f8bc","Type":"ContainerDied","Data":"4e2380209320b1c4c28faaf02bb86982f5198fe389e21b7caea23093fc0f2185"}
Jul 06 19:34:13.012177 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:34:13.012092    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-58c8d46f4-scg5r" event={"ID":"9d3c699b-09de-4376-b6df-d7200cc1f8bc","Type":"ContainerDied","Data":"78551e45998c405a6dffecb9bab68f946df3ec5ec9149ab4bae0100e2f50d675"}
Jul 06 19:34:13.012177 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:34:13.012119    2565 scope.go:117] "RemoveContainer" containerID="4e2380209320b1c4c28faaf02bb86982f5198fe389e21b7caea23093fc0f2185"
Jul 06 19:34:13.012323 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:34:13.012275    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-58c8d46f4-scg5r"
Jul 06 19:34:13.020813 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:34:13.020707    2565 scope.go:117] "RemoveContainer" containerID="4e2380209320b1c4c28faaf02bb86982f5198fe389e21b7caea23093fc0f2185"
Jul 06 19:34:13.021076 ip-10-0-131-168 kubenswrapper[2565]: E0706 19:34:13.021052    2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4e2380209320b1c4c28faaf02bb86982f5198fe389e21b7caea23093fc0f2185\": container with ID starting with 4e2380209320b1c4c28faaf02bb86982f5198fe389e21b7caea23093fc0f2185 not found: ID does not exist" containerID="4e2380209320b1c4c28faaf02bb86982f5198fe389e21b7caea23093fc0f2185"
Jul 06 19:34:13.021126 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:34:13.021084    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4e2380209320b1c4c28faaf02bb86982f5198fe389e21b7caea23093fc0f2185"} err="failed to get container status \"4e2380209320b1c4c28faaf02bb86982f5198fe389e21b7caea23093fc0f2185\": rpc error: code = NotFound desc = could not find container \"4e2380209320b1c4c28faaf02bb86982f5198fe389e21b7caea23093fc0f2185\": container with ID starting with 4e2380209320b1c4c28faaf02bb86982f5198fe389e21b7caea23093fc0f2185 not found: ID does not exist"
Jul 06 19:34:13.052239 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:34:13.052192    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-646b7cd74f-6rxvw" podStartSLOduration=2.210800352 podStartE2EDuration="5.052176242s" totalImagesPullingTime="2.84137589s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 19:34:08 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 19:34:13.051316475 +0000 UTC m=+88.064305145" watchObservedRunningTime="2026-07-06 19:34:13.052176242 +0000 UTC m=+88.065164911"
Jul 06 19:34:13.056141 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:34:13.056122    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/9d3c699b-09de-4376-b6df-d7200cc1f8bc-image-registry-private-configuration\") pod \"9d3c699b-09de-4376-b6df-d7200cc1f8bc\" (UID: \"9d3c699b-09de-4376-b6df-d7200cc1f8bc\") "
Jul 06 19:34:13.056236 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:34:13.056155    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/9d3c699b-09de-4376-b6df-d7200cc1f8bc-registry-tls\") pod \"9d3c699b-09de-4376-b6df-d7200cc1f8bc\" (UID: \"9d3c699b-09de-4376-b6df-d7200cc1f8bc\") "
Jul 06 19:34:13.056236 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:34:13.056189    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/9d3c699b-09de-4376-b6df-d7200cc1f8bc-trusted-ca\") pod \"9d3c699b-09de-4376-b6df-d7200cc1f8bc\" (UID: \"9d3c699b-09de-4376-b6df-d7200cc1f8bc\") "
Jul 06 19:34:13.056313 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:34:13.056240    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/9d3c699b-09de-4376-b6df-d7200cc1f8bc-ca-trust-extracted\") pod \"9d3c699b-09de-4376-b6df-d7200cc1f8bc\" (UID: \"9d3c699b-09de-4376-b6df-d7200cc1f8bc\") "
Jul 06 19:34:13.057312 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:34:13.056652    2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9d3c699b-09de-4376-b6df-d7200cc1f8bc-trusted-ca" (OuterVolumeSpecName: "trusted-ca") pod "9d3c699b-09de-4376-b6df-d7200cc1f8bc" (UID: "9d3c699b-09de-4376-b6df-d7200cc1f8bc"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 06 19:34:13.058615 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:34:13.058575    2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9d3c699b-09de-4376-b6df-d7200cc1f8bc-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "9d3c699b-09de-4376-b6df-d7200cc1f8bc" (UID: "9d3c699b-09de-4376-b6df-d7200cc1f8bc"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 06 19:34:13.058698 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:34:13.058576    2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9d3c699b-09de-4376-b6df-d7200cc1f8bc-image-registry-private-configuration" (OuterVolumeSpecName: "image-registry-private-configuration") pod "9d3c699b-09de-4376-b6df-d7200cc1f8bc" (UID: "9d3c699b-09de-4376-b6df-d7200cc1f8bc"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 06 19:34:13.064639 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:34:13.064615    2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9d3c699b-09de-4376-b6df-d7200cc1f8bc-ca-trust-extracted" (OuterVolumeSpecName: "ca-trust-extracted") pod "9d3c699b-09de-4376-b6df-d7200cc1f8bc" (UID: "9d3c699b-09de-4376-b6df-d7200cc1f8bc"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 19:34:13.157386 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:34:13.157353    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/9d3c699b-09de-4376-b6df-d7200cc1f8bc-bound-sa-token\") pod \"9d3c699b-09de-4376-b6df-d7200cc1f8bc\" (UID: \"9d3c699b-09de-4376-b6df-d7200cc1f8bc\") "
Jul 06 19:34:13.157386 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:34:13.157392    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/9d3c699b-09de-4376-b6df-d7200cc1f8bc-installation-pull-secrets\") pod \"9d3c699b-09de-4376-b6df-d7200cc1f8bc\" (UID: \"9d3c699b-09de-4376-b6df-d7200cc1f8bc\") "
Jul 06 19:34:13.157626 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:34:13.157409    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-mjzr2\" (UniqueName: \"kubernetes.io/projected/9d3c699b-09de-4376-b6df-d7200cc1f8bc-kube-api-access-mjzr2\") pod \"9d3c699b-09de-4376-b6df-d7200cc1f8bc\" (UID: \"9d3c699b-09de-4376-b6df-d7200cc1f8bc\") "
Jul 06 19:34:13.157626 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:34:13.157427    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/9d3c699b-09de-4376-b6df-d7200cc1f8bc-registry-certificates\") pod \"9d3c699b-09de-4376-b6df-d7200cc1f8bc\" (UID: \"9d3c699b-09de-4376-b6df-d7200cc1f8bc\") "
Jul 06 19:34:13.157626 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:34:13.157590    2565 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/9d3c699b-09de-4376-b6df-d7200cc1f8bc-image-registry-private-configuration\") on node \"ip-10-0-131-168.ec2.internal\" DevicePath \"\""
Jul 06 19:34:13.157626 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:34:13.157601    2565 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/9d3c699b-09de-4376-b6df-d7200cc1f8bc-registry-tls\") on node \"ip-10-0-131-168.ec2.internal\" DevicePath \"\""
Jul 06 19:34:13.157626 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:34:13.157610    2565 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/9d3c699b-09de-4376-b6df-d7200cc1f8bc-trusted-ca\") on node \"ip-10-0-131-168.ec2.internal\" DevicePath \"\""
Jul 06 19:34:13.157626 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:34:13.157618    2565 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/9d3c699b-09de-4376-b6df-d7200cc1f8bc-ca-trust-extracted\") on node \"ip-10-0-131-168.ec2.internal\" DevicePath \"\""
Jul 06 19:34:13.157941 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:34:13.157884    2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9d3c699b-09de-4376-b6df-d7200cc1f8bc-registry-certificates" (OuterVolumeSpecName: "registry-certificates") pod "9d3c699b-09de-4376-b6df-d7200cc1f8bc" (UID: "9d3c699b-09de-4376-b6df-d7200cc1f8bc"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 06 19:34:13.159568 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:34:13.159544    2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9d3c699b-09de-4376-b6df-d7200cc1f8bc-installation-pull-secrets" (OuterVolumeSpecName: "installation-pull-secrets") pod "9d3c699b-09de-4376-b6df-d7200cc1f8bc" (UID: "9d3c699b-09de-4376-b6df-d7200cc1f8bc"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 06 19:34:13.159658 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:34:13.159564    2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9d3c699b-09de-4376-b6df-d7200cc1f8bc-bound-sa-token" (OuterVolumeSpecName: "bound-sa-token") pod "9d3c699b-09de-4376-b6df-d7200cc1f8bc" (UID: "9d3c699b-09de-4376-b6df-d7200cc1f8bc"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 06 19:34:13.159658 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:34:13.159627    2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9d3c699b-09de-4376-b6df-d7200cc1f8bc-kube-api-access-mjzr2" (OuterVolumeSpecName: "kube-api-access-mjzr2") pod "9d3c699b-09de-4376-b6df-d7200cc1f8bc" (UID: "9d3c699b-09de-4376-b6df-d7200cc1f8bc"). InnerVolumeSpecName "kube-api-access-mjzr2". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 06 19:34:13.258065 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:34:13.257979    2565 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/9d3c699b-09de-4376-b6df-d7200cc1f8bc-bound-sa-token\") on node \"ip-10-0-131-168.ec2.internal\" DevicePath \"\""
Jul 06 19:34:13.258065 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:34:13.258011    2565 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/9d3c699b-09de-4376-b6df-d7200cc1f8bc-installation-pull-secrets\") on node \"ip-10-0-131-168.ec2.internal\" DevicePath \"\""
Jul 06 19:34:13.258065 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:34:13.258023    2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-mjzr2\" (UniqueName: \"kubernetes.io/projected/9d3c699b-09de-4376-b6df-d7200cc1f8bc-kube-api-access-mjzr2\") on node \"ip-10-0-131-168.ec2.internal\" DevicePath \"\""
Jul 06 19:34:13.258065 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:34:13.258032    2565 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/9d3c699b-09de-4376-b6df-d7200cc1f8bc-registry-certificates\") on node \"ip-10-0-131-168.ec2.internal\" DevicePath \"\""
Jul 06 19:34:13.337387 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:34:13.337353    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-58c8d46f4-scg5r"]
Jul 06 19:34:13.341221 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:34:13.341202    2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-58c8d46f4-scg5r"]
Jul 06 19:34:13.498306 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:34:13.498273    2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="9d3c699b-09de-4376-b6df-d7200cc1f8bc" path="/var/lib/kubelet/pods/9d3c699b-09de-4376-b6df-d7200cc1f8bc/volumes"
Jul 06 19:34:19.026271 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:34:19.026236    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-646b7cd74f-6rxvw"
Jul 06 19:34:19.026657 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:34:19.026293    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-646b7cd74f-6rxvw"
Jul 06 19:34:19.030949 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:34:19.030922    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-646b7cd74f-6rxvw"
Jul 06 19:34:19.037289 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:34:19.037271    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-646b7cd74f-6rxvw"
Jul 06 19:34:27.262962 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:34:27.262928    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-sk5qz_5cebd7e7-350b-4360-a9f5-e7ef0889b9c2/serve-healthcheck-canary/0.log"
Jul 06 19:34:28.934621 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:34:28.934592    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-pc8fq"
Jul 06 19:35:27.979790 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:35:27.979735    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-59797d48b4-hcfld"]
Jul 06 19:35:27.980194 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:35:27.980010    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9d3c699b-09de-4376-b6df-d7200cc1f8bc" containerName="registry"
Jul 06 19:35:27.980194 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:35:27.980022    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="9d3c699b-09de-4376-b6df-d7200cc1f8bc" containerName="registry"
Jul 06 19:35:27.980194 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:35:27.980074    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="9d3c699b-09de-4376-b6df-d7200cc1f8bc" containerName="registry"
Jul 06 19:35:27.981891 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:35:27.981875    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-59797d48b4-hcfld"
Jul 06 19:35:27.995098 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:35:27.995074    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-59797d48b4-hcfld"]
Jul 06 19:35:28.047045 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:35:28.047007    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/ad0faf17-58ab-4f28-9c2b-58720994d24d-console-oauth-config\") pod \"console-59797d48b4-hcfld\" (UID: \"ad0faf17-58ab-4f28-9c2b-58720994d24d\") " pod="openshift-console/console-59797d48b4-hcfld"
Jul 06 19:35:28.047200 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:35:28.047058    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/ad0faf17-58ab-4f28-9c2b-58720994d24d-oauth-serving-cert\") pod \"console-59797d48b4-hcfld\" (UID: \"ad0faf17-58ab-4f28-9c2b-58720994d24d\") " pod="openshift-console/console-59797d48b4-hcfld"
Jul 06 19:35:28.047200 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:35:28.047114    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2m9sg\" (UniqueName: \"kubernetes.io/projected/ad0faf17-58ab-4f28-9c2b-58720994d24d-kube-api-access-2m9sg\") pod \"console-59797d48b4-hcfld\" (UID: \"ad0faf17-58ab-4f28-9c2b-58720994d24d\") " pod="openshift-console/console-59797d48b4-hcfld"
Jul 06 19:35:28.047200 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:35:28.047130    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ad0faf17-58ab-4f28-9c2b-58720994d24d-trusted-ca-bundle\") pod \"console-59797d48b4-hcfld\" (UID: \"ad0faf17-58ab-4f28-9c2b-58720994d24d\") " pod="openshift-console/console-59797d48b4-hcfld"
Jul 06 19:35:28.047200 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:35:28.047153    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/ad0faf17-58ab-4f28-9c2b-58720994d24d-console-serving-cert\") pod \"console-59797d48b4-hcfld\" (UID: \"ad0faf17-58ab-4f28-9c2b-58720994d24d\") " pod="openshift-console/console-59797d48b4-hcfld"
Jul 06 19:35:28.047200 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:35:28.047171    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/ad0faf17-58ab-4f28-9c2b-58720994d24d-console-config\") pod \"console-59797d48b4-hcfld\" (UID: \"ad0faf17-58ab-4f28-9c2b-58720994d24d\") " pod="openshift-console/console-59797d48b4-hcfld"
Jul 06 19:35:28.047200 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:35:28.047188    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/ad0faf17-58ab-4f28-9c2b-58720994d24d-service-ca\") pod \"console-59797d48b4-hcfld\" (UID: \"ad0faf17-58ab-4f28-9c2b-58720994d24d\") " pod="openshift-console/console-59797d48b4-hcfld"
Jul 06 19:35:28.148393 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:35:28.148355    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/ad0faf17-58ab-4f28-9c2b-58720994d24d-console-serving-cert\") pod \"console-59797d48b4-hcfld\" (UID: \"ad0faf17-58ab-4f28-9c2b-58720994d24d\") " pod="openshift-console/console-59797d48b4-hcfld"
Jul 06 19:35:28.148393 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:35:28.148394    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/ad0faf17-58ab-4f28-9c2b-58720994d24d-console-config\") pod \"console-59797d48b4-hcfld\" (UID: \"ad0faf17-58ab-4f28-9c2b-58720994d24d\") " pod="openshift-console/console-59797d48b4-hcfld"
Jul 06 19:35:28.148652 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:35:28.148409    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/ad0faf17-58ab-4f28-9c2b-58720994d24d-service-ca\") pod \"console-59797d48b4-hcfld\" (UID: \"ad0faf17-58ab-4f28-9c2b-58720994d24d\") " pod="openshift-console/console-59797d48b4-hcfld"
Jul 06 19:35:28.148652 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:35:28.148442    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/ad0faf17-58ab-4f28-9c2b-58720994d24d-console-oauth-config\") pod \"console-59797d48b4-hcfld\" (UID: \"ad0faf17-58ab-4f28-9c2b-58720994d24d\") " pod="openshift-console/console-59797d48b4-hcfld"
Jul 06 19:35:28.148652 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:35:28.148495    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/ad0faf17-58ab-4f28-9c2b-58720994d24d-oauth-serving-cert\") pod \"console-59797d48b4-hcfld\" (UID: \"ad0faf17-58ab-4f28-9c2b-58720994d24d\") " pod="openshift-console/console-59797d48b4-hcfld"
Jul 06 19:35:28.148652 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:35:28.148553    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2m9sg\" (UniqueName: \"kubernetes.io/projected/ad0faf17-58ab-4f28-9c2b-58720994d24d-kube-api-access-2m9sg\") pod \"console-59797d48b4-hcfld\" (UID: \"ad0faf17-58ab-4f28-9c2b-58720994d24d\") " pod="openshift-console/console-59797d48b4-hcfld"
Jul 06 19:35:28.148652 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:35:28.148580    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ad0faf17-58ab-4f28-9c2b-58720994d24d-trusted-ca-bundle\") pod \"console-59797d48b4-hcfld\" (UID: \"ad0faf17-58ab-4f28-9c2b-58720994d24d\") " pod="openshift-console/console-59797d48b4-hcfld"
Jul 06 19:35:28.149306 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:35:28.149276    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/ad0faf17-58ab-4f28-9c2b-58720994d24d-console-config\") pod \"console-59797d48b4-hcfld\" (UID: \"ad0faf17-58ab-4f28-9c2b-58720994d24d\") " pod="openshift-console/console-59797d48b4-hcfld"
Jul 06 19:35:28.149306 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:35:28.149298    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/ad0faf17-58ab-4f28-9c2b-58720994d24d-oauth-serving-cert\") pod \"console-59797d48b4-hcfld\" (UID: \"ad0faf17-58ab-4f28-9c2b-58720994d24d\") " pod="openshift-console/console-59797d48b4-hcfld"
Jul 06 19:35:28.149466 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:35:28.149305    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/ad0faf17-58ab-4f28-9c2b-58720994d24d-service-ca\") pod \"console-59797d48b4-hcfld\" (UID: \"ad0faf17-58ab-4f28-9c2b-58720994d24d\") " pod="openshift-console/console-59797d48b4-hcfld"
Jul 06 19:35:28.149466 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:35:28.149373    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ad0faf17-58ab-4f28-9c2b-58720994d24d-trusted-ca-bundle\") pod \"console-59797d48b4-hcfld\" (UID: \"ad0faf17-58ab-4f28-9c2b-58720994d24d\") " pod="openshift-console/console-59797d48b4-hcfld"
Jul 06 19:35:28.150972 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:35:28.150948    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/ad0faf17-58ab-4f28-9c2b-58720994d24d-console-serving-cert\") pod \"console-59797d48b4-hcfld\" (UID: \"ad0faf17-58ab-4f28-9c2b-58720994d24d\") " pod="openshift-console/console-59797d48b4-hcfld"
Jul 06 19:35:28.151063 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:35:28.150972    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/ad0faf17-58ab-4f28-9c2b-58720994d24d-console-oauth-config\") pod \"console-59797d48b4-hcfld\" (UID: \"ad0faf17-58ab-4f28-9c2b-58720994d24d\") " pod="openshift-console/console-59797d48b4-hcfld"
Jul 06 19:35:28.160101 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:35:28.160077    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2m9sg\" (UniqueName: \"kubernetes.io/projected/ad0faf17-58ab-4f28-9c2b-58720994d24d-kube-api-access-2m9sg\") pod \"console-59797d48b4-hcfld\" (UID: \"ad0faf17-58ab-4f28-9c2b-58720994d24d\") " pod="openshift-console/console-59797d48b4-hcfld"
Jul 06 19:35:28.296107 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:35:28.296022    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-59797d48b4-hcfld"
Jul 06 19:35:28.459860 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:35:28.459823    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-59797d48b4-hcfld"]
Jul 06 19:35:28.462659 ip-10-0-131-168 kubenswrapper[2565]: W0706 19:35:28.462630    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podad0faf17_58ab_4f28_9c2b_58720994d24d.slice/crio-77c61e299bc913009c296e0881fb92e09f9026437f6b67035a9bcba04a4c399a WatchSource:0}: Error finding container 77c61e299bc913009c296e0881fb92e09f9026437f6b67035a9bcba04a4c399a: Status 404 returned error can't find the container with id 77c61e299bc913009c296e0881fb92e09f9026437f6b67035a9bcba04a4c399a
Jul 06 19:35:29.291850 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:35:29.291811    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-59797d48b4-hcfld" event={"ID":"ad0faf17-58ab-4f28-9c2b-58720994d24d","Type":"ContainerStarted","Data":"f392d51c1a8ffcb5adc0a29f38ed0b421a6b8186f6751abc9169f807d18f5542"}
Jul 06 19:35:29.292272 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:35:29.291861    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-59797d48b4-hcfld" event={"ID":"ad0faf17-58ab-4f28-9c2b-58720994d24d","Type":"ContainerStarted","Data":"77c61e299bc913009c296e0881fb92e09f9026437f6b67035a9bcba04a4c399a"}
Jul 06 19:35:29.319834 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:35:29.319785    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-59797d48b4-hcfld" podStartSLOduration=2.319752604 podStartE2EDuration="2.319752604s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 19:35:27 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 19:35:29.31900476 +0000 UTC m=+164.331993451" watchObservedRunningTime="2026-07-06 19:35:29.319752604 +0000 UTC m=+164.332741272"
Jul 06 19:35:38.296620 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:35:38.296528    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-59797d48b4-hcfld"
Jul 06 19:35:38.296620 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:35:38.296605    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-59797d48b4-hcfld"
Jul 06 19:35:38.301408 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:35:38.301384    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-59797d48b4-hcfld"
Jul 06 19:35:38.328046 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:35:38.328021    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-59797d48b4-hcfld"
Jul 06 19:35:38.393022 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:35:38.392987    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-646b7cd74f-6rxvw"]
Jul 06 19:36:03.412594 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:36:03.412555    2565 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-console/console-646b7cd74f-6rxvw" podUID="70789112-afc0-4d48-9e90-9ef19762ae24" containerName="console" containerID="cri-o://5f1ad48bd33e5e067e8c50a077bb0fd36d56fdfead661c4316d8614fc432af3e" gracePeriod=15
Jul 06 19:36:03.654002 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:36:03.653978    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-646b7cd74f-6rxvw"
Jul 06 19:36:03.850305 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:36:03.850228    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/70789112-afc0-4d48-9e90-9ef19762ae24-console-serving-cert\") pod \"70789112-afc0-4d48-9e90-9ef19762ae24\" (UID: \"70789112-afc0-4d48-9e90-9ef19762ae24\") "
Jul 06 19:36:03.850305 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:36:03.850261    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/70789112-afc0-4d48-9e90-9ef19762ae24-trusted-ca-bundle\") pod \"70789112-afc0-4d48-9e90-9ef19762ae24\" (UID: \"70789112-afc0-4d48-9e90-9ef19762ae24\") "
Jul 06 19:36:03.850305 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:36:03.850304    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/70789112-afc0-4d48-9e90-9ef19762ae24-oauth-serving-cert\") pod \"70789112-afc0-4d48-9e90-9ef19762ae24\" (UID: \"70789112-afc0-4d48-9e90-9ef19762ae24\") "
Jul 06 19:36:03.850574 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:36:03.850323    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/70789112-afc0-4d48-9e90-9ef19762ae24-console-oauth-config\") pod \"70789112-afc0-4d48-9e90-9ef19762ae24\" (UID: \"70789112-afc0-4d48-9e90-9ef19762ae24\") "
Jul 06 19:36:03.850574 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:36:03.850338    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/70789112-afc0-4d48-9e90-9ef19762ae24-service-ca\") pod \"70789112-afc0-4d48-9e90-9ef19762ae24\" (UID: \"70789112-afc0-4d48-9e90-9ef19762ae24\") "
Jul 06 19:36:03.850574 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:36:03.850361    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-z7lxx\" (UniqueName: \"kubernetes.io/projected/70789112-afc0-4d48-9e90-9ef19762ae24-kube-api-access-z7lxx\") pod \"70789112-afc0-4d48-9e90-9ef19762ae24\" (UID: \"70789112-afc0-4d48-9e90-9ef19762ae24\") "
Jul 06 19:36:03.850574 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:36:03.850421    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/70789112-afc0-4d48-9e90-9ef19762ae24-console-config\") pod \"70789112-afc0-4d48-9e90-9ef19762ae24\" (UID: \"70789112-afc0-4d48-9e90-9ef19762ae24\") "
Jul 06 19:36:03.850876 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:36:03.850730    2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/70789112-afc0-4d48-9e90-9ef19762ae24-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "70789112-afc0-4d48-9e90-9ef19762ae24" (UID: "70789112-afc0-4d48-9e90-9ef19762ae24"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 06 19:36:03.850927 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:36:03.850762    2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/70789112-afc0-4d48-9e90-9ef19762ae24-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "70789112-afc0-4d48-9e90-9ef19762ae24" (UID: "70789112-afc0-4d48-9e90-9ef19762ae24"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 06 19:36:03.850927 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:36:03.850823    2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/70789112-afc0-4d48-9e90-9ef19762ae24-service-ca" (OuterVolumeSpecName: "service-ca") pod "70789112-afc0-4d48-9e90-9ef19762ae24" (UID: "70789112-afc0-4d48-9e90-9ef19762ae24"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 06 19:36:03.850994 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:36:03.850927    2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/70789112-afc0-4d48-9e90-9ef19762ae24-console-config" (OuterVolumeSpecName: "console-config") pod "70789112-afc0-4d48-9e90-9ef19762ae24" (UID: "70789112-afc0-4d48-9e90-9ef19762ae24"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 06 19:36:03.852533 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:36:03.852506    2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/70789112-afc0-4d48-9e90-9ef19762ae24-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "70789112-afc0-4d48-9e90-9ef19762ae24" (UID: "70789112-afc0-4d48-9e90-9ef19762ae24"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 06 19:36:03.852533 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:36:03.852525    2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/70789112-afc0-4d48-9e90-9ef19762ae24-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "70789112-afc0-4d48-9e90-9ef19762ae24" (UID: "70789112-afc0-4d48-9e90-9ef19762ae24"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 06 19:36:03.852681 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:36:03.852597    2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/70789112-afc0-4d48-9e90-9ef19762ae24-kube-api-access-z7lxx" (OuterVolumeSpecName: "kube-api-access-z7lxx") pod "70789112-afc0-4d48-9e90-9ef19762ae24" (UID: "70789112-afc0-4d48-9e90-9ef19762ae24"). InnerVolumeSpecName "kube-api-access-z7lxx". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 06 19:36:03.951031 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:36:03.950993    2565 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/70789112-afc0-4d48-9e90-9ef19762ae24-console-serving-cert\") on node \"ip-10-0-131-168.ec2.internal\" DevicePath \"\""
Jul 06 19:36:03.951031 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:36:03.951022    2565 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/70789112-afc0-4d48-9e90-9ef19762ae24-trusted-ca-bundle\") on node \"ip-10-0-131-168.ec2.internal\" DevicePath \"\""
Jul 06 19:36:03.951031 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:36:03.951031    2565 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/70789112-afc0-4d48-9e90-9ef19762ae24-oauth-serving-cert\") on node \"ip-10-0-131-168.ec2.internal\" DevicePath \"\""
Jul 06 19:36:03.951031 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:36:03.951040    2565 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/70789112-afc0-4d48-9e90-9ef19762ae24-console-oauth-config\") on node \"ip-10-0-131-168.ec2.internal\" DevicePath \"\""
Jul 06 19:36:03.951279 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:36:03.951050    2565 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/70789112-afc0-4d48-9e90-9ef19762ae24-service-ca\") on node \"ip-10-0-131-168.ec2.internal\" DevicePath \"\""
Jul 06 19:36:03.951279 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:36:03.951059    2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-z7lxx\" (UniqueName: \"kubernetes.io/projected/70789112-afc0-4d48-9e90-9ef19762ae24-kube-api-access-z7lxx\") on node \"ip-10-0-131-168.ec2.internal\" DevicePath \"\""
Jul 06 19:36:03.951279 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:36:03.951068    2565 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/70789112-afc0-4d48-9e90-9ef19762ae24-console-config\") on node \"ip-10-0-131-168.ec2.internal\" DevicePath \"\""
Jul 06 19:36:04.415477 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:36:04.415443    2565 generic.go:356] "Generic (PLEG): container finished" podID="70789112-afc0-4d48-9e90-9ef19762ae24" containerID="5f1ad48bd33e5e067e8c50a077bb0fd36d56fdfead661c4316d8614fc432af3e" exitCode=0
Jul 06 19:36:04.415933 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:36:04.415487    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-646b7cd74f-6rxvw"
Jul 06 19:36:04.415933 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:36:04.415526    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-646b7cd74f-6rxvw" event={"ID":"70789112-afc0-4d48-9e90-9ef19762ae24","Type":"ContainerDied","Data":"5f1ad48bd33e5e067e8c50a077bb0fd36d56fdfead661c4316d8614fc432af3e"}
Jul 06 19:36:04.415933 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:36:04.415572    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-646b7cd74f-6rxvw" event={"ID":"70789112-afc0-4d48-9e90-9ef19762ae24","Type":"ContainerDied","Data":"0655da15ca1542c4fe9ef0d0e7f955e5ffc447ff6f30736191122e4b3c692d71"}
Jul 06 19:36:04.415933 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:36:04.415593    2565 scope.go:117] "RemoveContainer" containerID="5f1ad48bd33e5e067e8c50a077bb0fd36d56fdfead661c4316d8614fc432af3e"
Jul 06 19:36:04.423977 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:36:04.423959    2565 scope.go:117] "RemoveContainer" containerID="5f1ad48bd33e5e067e8c50a077bb0fd36d56fdfead661c4316d8614fc432af3e"
Jul 06 19:36:04.424251 ip-10-0-131-168 kubenswrapper[2565]: E0706 19:36:04.424235    2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5f1ad48bd33e5e067e8c50a077bb0fd36d56fdfead661c4316d8614fc432af3e\": container with ID starting with 5f1ad48bd33e5e067e8c50a077bb0fd36d56fdfead661c4316d8614fc432af3e not found: ID does not exist" containerID="5f1ad48bd33e5e067e8c50a077bb0fd36d56fdfead661c4316d8614fc432af3e"
Jul 06 19:36:04.424297 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:36:04.424259    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5f1ad48bd33e5e067e8c50a077bb0fd36d56fdfead661c4316d8614fc432af3e"} err="failed to get container status \"5f1ad48bd33e5e067e8c50a077bb0fd36d56fdfead661c4316d8614fc432af3e\": rpc error: code = NotFound desc = could not find container \"5f1ad48bd33e5e067e8c50a077bb0fd36d56fdfead661c4316d8614fc432af3e\": container with ID starting with 5f1ad48bd33e5e067e8c50a077bb0fd36d56fdfead661c4316d8614fc432af3e not found: ID does not exist"
Jul 06 19:36:04.437867 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:36:04.437846    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-646b7cd74f-6rxvw"]
Jul 06 19:36:04.445854 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:36:04.443601    2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-646b7cd74f-6rxvw"]
Jul 06 19:36:05.494549 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:36:05.494514    2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="70789112-afc0-4d48-9e90-9ef19762ae24" path="/var/lib/kubelet/pods/70789112-afc0-4d48-9e90-9ef19762ae24/volumes"
Jul 06 19:36:49.406730 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:36:49.406697    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-6cddd8b544-qqn86"]
Jul 06 19:36:49.407148 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:36:49.406988    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="70789112-afc0-4d48-9e90-9ef19762ae24" containerName="console"
Jul 06 19:36:49.407148 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:36:49.407000    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="70789112-afc0-4d48-9e90-9ef19762ae24" containerName="console"
Jul 06 19:36:49.407148 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:36:49.407047    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="70789112-afc0-4d48-9e90-9ef19762ae24" containerName="console"
Jul 06 19:36:49.409222 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:36:49.409205    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6cddd8b544-qqn86"
Jul 06 19:36:49.419456 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:36:49.419433    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-6cddd8b544-qqn86"]
Jul 06 19:36:49.474966 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:36:49.474929    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7701b72b-f121-4bea-bcd7-01b8f192081f-trusted-ca-bundle\") pod \"console-6cddd8b544-qqn86\" (UID: \"7701b72b-f121-4bea-bcd7-01b8f192081f\") " pod="openshift-console/console-6cddd8b544-qqn86"
Jul 06 19:36:49.475133 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:36:49.475012    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/7701b72b-f121-4bea-bcd7-01b8f192081f-service-ca\") pod \"console-6cddd8b544-qqn86\" (UID: \"7701b72b-f121-4bea-bcd7-01b8f192081f\") " pod="openshift-console/console-6cddd8b544-qqn86"
Jul 06 19:36:49.475133 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:36:49.475046    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/7701b72b-f121-4bea-bcd7-01b8f192081f-console-oauth-config\") pod \"console-6cddd8b544-qqn86\" (UID: \"7701b72b-f121-4bea-bcd7-01b8f192081f\") " pod="openshift-console/console-6cddd8b544-qqn86"
Jul 06 19:36:49.475133 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:36:49.475075    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/7701b72b-f121-4bea-bcd7-01b8f192081f-console-config\") pod \"console-6cddd8b544-qqn86\" (UID: \"7701b72b-f121-4bea-bcd7-01b8f192081f\") " pod="openshift-console/console-6cddd8b544-qqn86"
Jul 06 19:36:49.475257 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:36:49.475152    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/7701b72b-f121-4bea-bcd7-01b8f192081f-console-serving-cert\") pod \"console-6cddd8b544-qqn86\" (UID: \"7701b72b-f121-4bea-bcd7-01b8f192081f\") " pod="openshift-console/console-6cddd8b544-qqn86"
Jul 06 19:36:49.475257 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:36:49.475181    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/7701b72b-f121-4bea-bcd7-01b8f192081f-oauth-serving-cert\") pod \"console-6cddd8b544-qqn86\" (UID: \"7701b72b-f121-4bea-bcd7-01b8f192081f\") " pod="openshift-console/console-6cddd8b544-qqn86"
Jul 06 19:36:49.475257 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:36:49.475206    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-54l97\" (UniqueName: \"kubernetes.io/projected/7701b72b-f121-4bea-bcd7-01b8f192081f-kube-api-access-54l97\") pod \"console-6cddd8b544-qqn86\" (UID: \"7701b72b-f121-4bea-bcd7-01b8f192081f\") " pod="openshift-console/console-6cddd8b544-qqn86"
Jul 06 19:36:49.576267 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:36:49.576239    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7701b72b-f121-4bea-bcd7-01b8f192081f-trusted-ca-bundle\") pod \"console-6cddd8b544-qqn86\" (UID: \"7701b72b-f121-4bea-bcd7-01b8f192081f\") " pod="openshift-console/console-6cddd8b544-qqn86"
Jul 06 19:36:49.576462 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:36:49.576276    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/7701b72b-f121-4bea-bcd7-01b8f192081f-service-ca\") pod \"console-6cddd8b544-qqn86\" (UID: \"7701b72b-f121-4bea-bcd7-01b8f192081f\") " pod="openshift-console/console-6cddd8b544-qqn86"
Jul 06 19:36:49.576462 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:36:49.576292    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/7701b72b-f121-4bea-bcd7-01b8f192081f-console-oauth-config\") pod \"console-6cddd8b544-qqn86\" (UID: \"7701b72b-f121-4bea-bcd7-01b8f192081f\") " pod="openshift-console/console-6cddd8b544-qqn86"
Jul 06 19:36:49.576462 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:36:49.576308    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/7701b72b-f121-4bea-bcd7-01b8f192081f-console-config\") pod \"console-6cddd8b544-qqn86\" (UID: \"7701b72b-f121-4bea-bcd7-01b8f192081f\") " pod="openshift-console/console-6cddd8b544-qqn86"
Jul 06 19:36:49.576462 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:36:49.576331    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/7701b72b-f121-4bea-bcd7-01b8f192081f-console-serving-cert\") pod \"console-6cddd8b544-qqn86\" (UID: \"7701b72b-f121-4bea-bcd7-01b8f192081f\") " pod="openshift-console/console-6cddd8b544-qqn86"
Jul 06 19:36:49.576462 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:36:49.576345    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/7701b72b-f121-4bea-bcd7-01b8f192081f-oauth-serving-cert\") pod \"console-6cddd8b544-qqn86\" (UID: \"7701b72b-f121-4bea-bcd7-01b8f192081f\") " pod="openshift-console/console-6cddd8b544-qqn86"
Jul 06 19:36:49.576462 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:36:49.576364    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-54l97\" (UniqueName: \"kubernetes.io/projected/7701b72b-f121-4bea-bcd7-01b8f192081f-kube-api-access-54l97\") pod \"console-6cddd8b544-qqn86\" (UID: \"7701b72b-f121-4bea-bcd7-01b8f192081f\") " pod="openshift-console/console-6cddd8b544-qqn86"
Jul 06 19:36:49.577074 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:36:49.577049    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/7701b72b-f121-4bea-bcd7-01b8f192081f-console-config\") pod \"console-6cddd8b544-qqn86\" (UID: \"7701b72b-f121-4bea-bcd7-01b8f192081f\") " pod="openshift-console/console-6cddd8b544-qqn86"
Jul 06 19:36:49.577198 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:36:49.577158    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/7701b72b-f121-4bea-bcd7-01b8f192081f-service-ca\") pod \"console-6cddd8b544-qqn86\" (UID: \"7701b72b-f121-4bea-bcd7-01b8f192081f\") " pod="openshift-console/console-6cddd8b544-qqn86"
Jul 06 19:36:49.577198 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:36:49.577182    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/7701b72b-f121-4bea-bcd7-01b8f192081f-oauth-serving-cert\") pod \"console-6cddd8b544-qqn86\" (UID: \"7701b72b-f121-4bea-bcd7-01b8f192081f\") " pod="openshift-console/console-6cddd8b544-qqn86"
Jul 06 19:36:49.577284 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:36:49.577249    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7701b72b-f121-4bea-bcd7-01b8f192081f-trusted-ca-bundle\") pod \"console-6cddd8b544-qqn86\" (UID: \"7701b72b-f121-4bea-bcd7-01b8f192081f\") " pod="openshift-console/console-6cddd8b544-qqn86"
Jul 06 19:36:49.578847 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:36:49.578820    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/7701b72b-f121-4bea-bcd7-01b8f192081f-console-serving-cert\") pod \"console-6cddd8b544-qqn86\" (UID: \"7701b72b-f121-4bea-bcd7-01b8f192081f\") " pod="openshift-console/console-6cddd8b544-qqn86"
Jul 06 19:36:49.578847 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:36:49.578837    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/7701b72b-f121-4bea-bcd7-01b8f192081f-console-oauth-config\") pod \"console-6cddd8b544-qqn86\" (UID: \"7701b72b-f121-4bea-bcd7-01b8f192081f\") " pod="openshift-console/console-6cddd8b544-qqn86"
Jul 06 19:36:49.585379 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:36:49.585359    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-54l97\" (UniqueName: \"kubernetes.io/projected/7701b72b-f121-4bea-bcd7-01b8f192081f-kube-api-access-54l97\") pod \"console-6cddd8b544-qqn86\" (UID: \"7701b72b-f121-4bea-bcd7-01b8f192081f\") " pod="openshift-console/console-6cddd8b544-qqn86"
Jul 06 19:36:49.717946 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:36:49.717861    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6cddd8b544-qqn86"
Jul 06 19:36:49.844448 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:36:49.844421    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-6cddd8b544-qqn86"]
Jul 06 19:36:49.847488 ip-10-0-131-168 kubenswrapper[2565]: W0706 19:36:49.847457    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7701b72b_f121_4bea_bcd7_01b8f192081f.slice/crio-92fd1426dd584de66efe790a9e11c8b0e31753694d5515144710e50330b55093 WatchSource:0}: Error finding container 92fd1426dd584de66efe790a9e11c8b0e31753694d5515144710e50330b55093: Status 404 returned error can't find the container with id 92fd1426dd584de66efe790a9e11c8b0e31753694d5515144710e50330b55093
Jul 06 19:36:50.575500 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:36:50.575463    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6cddd8b544-qqn86" event={"ID":"7701b72b-f121-4bea-bcd7-01b8f192081f","Type":"ContainerStarted","Data":"f1924ea6ee451ebbf6b4cf21c2219e16c0175daa8a9b43b75163937b5aad16d6"}
Jul 06 19:36:50.575917 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:36:50.575555    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6cddd8b544-qqn86" event={"ID":"7701b72b-f121-4bea-bcd7-01b8f192081f","Type":"ContainerStarted","Data":"92fd1426dd584de66efe790a9e11c8b0e31753694d5515144710e50330b55093"}
Jul 06 19:36:50.597971 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:36:50.597921    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-6cddd8b544-qqn86" podStartSLOduration=1.5979048599999999 podStartE2EDuration="1.59790486s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 19:36:49 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 19:36:50.596615933 +0000 UTC m=+245.609604602" watchObservedRunningTime="2026-07-06 19:36:50.59790486 +0000 UTC m=+245.610893562"
Jul 06 19:36:59.718492 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:36:59.718457    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-6cddd8b544-qqn86"
Jul 06 19:36:59.718892 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:36:59.718520    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-6cddd8b544-qqn86"
Jul 06 19:36:59.723284 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:36:59.723260    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-6cddd8b544-qqn86"
Jul 06 19:37:00.614957 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:37:00.614930    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-6cddd8b544-qqn86"
Jul 06 19:37:00.674838 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:37:00.674807    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-59797d48b4-hcfld"]
Jul 06 19:37:25.694450 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:37:25.694389    2565 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-console/console-59797d48b4-hcfld" podUID="ad0faf17-58ab-4f28-9c2b-58720994d24d" containerName="console" containerID="cri-o://f392d51c1a8ffcb5adc0a29f38ed0b421a6b8186f6751abc9169f807d18f5542" gracePeriod=15
Jul 06 19:37:25.924704 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:37:25.924679    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-59797d48b4-hcfld"
Jul 06 19:37:25.976959 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:37:25.976878    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/ad0faf17-58ab-4f28-9c2b-58720994d24d-console-config\") pod \"ad0faf17-58ab-4f28-9c2b-58720994d24d\" (UID: \"ad0faf17-58ab-4f28-9c2b-58720994d24d\") "
Jul 06 19:37:25.976959 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:37:25.976924    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/ad0faf17-58ab-4f28-9c2b-58720994d24d-console-oauth-config\") pod \"ad0faf17-58ab-4f28-9c2b-58720994d24d\" (UID: \"ad0faf17-58ab-4f28-9c2b-58720994d24d\") "
Jul 06 19:37:25.976959 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:37:25.976946    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-2m9sg\" (UniqueName: \"kubernetes.io/projected/ad0faf17-58ab-4f28-9c2b-58720994d24d-kube-api-access-2m9sg\") pod \"ad0faf17-58ab-4f28-9c2b-58720994d24d\" (UID: \"ad0faf17-58ab-4f28-9c2b-58720994d24d\") "
Jul 06 19:37:25.977215 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:37:25.976965    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ad0faf17-58ab-4f28-9c2b-58720994d24d-trusted-ca-bundle\") pod \"ad0faf17-58ab-4f28-9c2b-58720994d24d\" (UID: \"ad0faf17-58ab-4f28-9c2b-58720994d24d\") "
Jul 06 19:37:25.977215 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:37:25.977098    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/ad0faf17-58ab-4f28-9c2b-58720994d24d-console-serving-cert\") pod \"ad0faf17-58ab-4f28-9c2b-58720994d24d\" (UID: \"ad0faf17-58ab-4f28-9c2b-58720994d24d\") "
Jul 06 19:37:25.977215 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:37:25.977138    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/ad0faf17-58ab-4f28-9c2b-58720994d24d-service-ca\") pod \"ad0faf17-58ab-4f28-9c2b-58720994d24d\" (UID: \"ad0faf17-58ab-4f28-9c2b-58720994d24d\") "
Jul 06 19:37:25.977215 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:37:25.977202    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/ad0faf17-58ab-4f28-9c2b-58720994d24d-oauth-serving-cert\") pod \"ad0faf17-58ab-4f28-9c2b-58720994d24d\" (UID: \"ad0faf17-58ab-4f28-9c2b-58720994d24d\") "
Jul 06 19:37:25.977416 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:37:25.977361    2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ad0faf17-58ab-4f28-9c2b-58720994d24d-console-config" (OuterVolumeSpecName: "console-config") pod "ad0faf17-58ab-4f28-9c2b-58720994d24d" (UID: "ad0faf17-58ab-4f28-9c2b-58720994d24d"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 06 19:37:25.977416 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:37:25.977375    2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ad0faf17-58ab-4f28-9c2b-58720994d24d-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "ad0faf17-58ab-4f28-9c2b-58720994d24d" (UID: "ad0faf17-58ab-4f28-9c2b-58720994d24d"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 06 19:37:25.977628 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:37:25.977592    2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ad0faf17-58ab-4f28-9c2b-58720994d24d-service-ca" (OuterVolumeSpecName: "service-ca") pod "ad0faf17-58ab-4f28-9c2b-58720994d24d" (UID: "ad0faf17-58ab-4f28-9c2b-58720994d24d"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 06 19:37:25.977705 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:37:25.977653    2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ad0faf17-58ab-4f28-9c2b-58720994d24d-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "ad0faf17-58ab-4f28-9c2b-58720994d24d" (UID: "ad0faf17-58ab-4f28-9c2b-58720994d24d"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 06 19:37:25.979093 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:37:25.979071    2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ad0faf17-58ab-4f28-9c2b-58720994d24d-kube-api-access-2m9sg" (OuterVolumeSpecName: "kube-api-access-2m9sg") pod "ad0faf17-58ab-4f28-9c2b-58720994d24d" (UID: "ad0faf17-58ab-4f28-9c2b-58720994d24d"). InnerVolumeSpecName "kube-api-access-2m9sg". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 06 19:37:25.979459 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:37:25.979439    2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ad0faf17-58ab-4f28-9c2b-58720994d24d-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "ad0faf17-58ab-4f28-9c2b-58720994d24d" (UID: "ad0faf17-58ab-4f28-9c2b-58720994d24d"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 06 19:37:25.979521 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:37:25.979457    2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ad0faf17-58ab-4f28-9c2b-58720994d24d-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "ad0faf17-58ab-4f28-9c2b-58720994d24d" (UID: "ad0faf17-58ab-4f28-9c2b-58720994d24d"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 06 19:37:26.078578 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:37:26.078529    2565 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ad0faf17-58ab-4f28-9c2b-58720994d24d-trusted-ca-bundle\") on node \"ip-10-0-131-168.ec2.internal\" DevicePath \"\""
Jul 06 19:37:26.078578 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:37:26.078569    2565 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/ad0faf17-58ab-4f28-9c2b-58720994d24d-console-serving-cert\") on node \"ip-10-0-131-168.ec2.internal\" DevicePath \"\""
Jul 06 19:37:26.078578 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:37:26.078579    2565 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/ad0faf17-58ab-4f28-9c2b-58720994d24d-service-ca\") on node \"ip-10-0-131-168.ec2.internal\" DevicePath \"\""
Jul 06 19:37:26.078578 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:37:26.078588    2565 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/ad0faf17-58ab-4f28-9c2b-58720994d24d-oauth-serving-cert\") on node \"ip-10-0-131-168.ec2.internal\" DevicePath \"\""
Jul 06 19:37:26.078578 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:37:26.078598    2565 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/ad0faf17-58ab-4f28-9c2b-58720994d24d-console-config\") on node \"ip-10-0-131-168.ec2.internal\" DevicePath \"\""
Jul 06 19:37:26.078906 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:37:26.078606    2565 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/ad0faf17-58ab-4f28-9c2b-58720994d24d-console-oauth-config\") on node \"ip-10-0-131-168.ec2.internal\" DevicePath \"\""
Jul 06 19:37:26.078906 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:37:26.078614    2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-2m9sg\" (UniqueName: \"kubernetes.io/projected/ad0faf17-58ab-4f28-9c2b-58720994d24d-kube-api-access-2m9sg\") on node \"ip-10-0-131-168.ec2.internal\" DevicePath \"\""
Jul 06 19:37:26.703024 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:37:26.702988    2565 generic.go:356] "Generic (PLEG): container finished" podID="ad0faf17-58ab-4f28-9c2b-58720994d24d" containerID="f392d51c1a8ffcb5adc0a29f38ed0b421a6b8186f6751abc9169f807d18f5542" exitCode=0
Jul 06 19:37:26.703484 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:37:26.703038    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-59797d48b4-hcfld"
Jul 06 19:37:26.703484 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:37:26.703078    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-59797d48b4-hcfld" event={"ID":"ad0faf17-58ab-4f28-9c2b-58720994d24d","Type":"ContainerDied","Data":"f392d51c1a8ffcb5adc0a29f38ed0b421a6b8186f6751abc9169f807d18f5542"}
Jul 06 19:37:26.703484 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:37:26.703143    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-59797d48b4-hcfld" event={"ID":"ad0faf17-58ab-4f28-9c2b-58720994d24d","Type":"ContainerDied","Data":"77c61e299bc913009c296e0881fb92e09f9026437f6b67035a9bcba04a4c399a"}
Jul 06 19:37:26.703484 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:37:26.703175    2565 scope.go:117] "RemoveContainer" containerID="f392d51c1a8ffcb5adc0a29f38ed0b421a6b8186f6751abc9169f807d18f5542"
Jul 06 19:37:26.711474 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:37:26.711453    2565 scope.go:117] "RemoveContainer" containerID="f392d51c1a8ffcb5adc0a29f38ed0b421a6b8186f6751abc9169f807d18f5542"
Jul 06 19:37:26.711738 ip-10-0-131-168 kubenswrapper[2565]: E0706 19:37:26.711719    2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f392d51c1a8ffcb5adc0a29f38ed0b421a6b8186f6751abc9169f807d18f5542\": container with ID starting with f392d51c1a8ffcb5adc0a29f38ed0b421a6b8186f6751abc9169f807d18f5542 not found: ID does not exist" containerID="f392d51c1a8ffcb5adc0a29f38ed0b421a6b8186f6751abc9169f807d18f5542"
Jul 06 19:37:26.711804 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:37:26.711747    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f392d51c1a8ffcb5adc0a29f38ed0b421a6b8186f6751abc9169f807d18f5542"} err="failed to get container status \"f392d51c1a8ffcb5adc0a29f38ed0b421a6b8186f6751abc9169f807d18f5542\": rpc error: code = NotFound desc = could not find container \"f392d51c1a8ffcb5adc0a29f38ed0b421a6b8186f6751abc9169f807d18f5542\": container with ID starting with f392d51c1a8ffcb5adc0a29f38ed0b421a6b8186f6751abc9169f807d18f5542 not found: ID does not exist"
Jul 06 19:37:26.725210 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:37:26.725173    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-59797d48b4-hcfld"]
Jul 06 19:37:26.726668 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:37:26.726646    2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-59797d48b4-hcfld"]
Jul 06 19:37:27.494056 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:37:27.494019    2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ad0faf17-58ab-4f28-9c2b-58720994d24d" path="/var/lib/kubelet/pods/ad0faf17-58ab-4f28-9c2b-58720994d24d/volumes"
Jul 06 19:37:45.328961 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:37:45.328930    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-8kjqk_9f15114d-7494-4f17-8a4d-52185f7a2e35/ovn-acl-logging/0.log"
Jul 06 19:37:45.330926 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:37:45.330905    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-8kjqk_9f15114d-7494-4f17-8a4d-52185f7a2e35/ovn-acl-logging/0.log"
Jul 06 19:37:45.335180 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:37:45.335161    2565 kubelet.go:1648] "Image garbage collection succeeded"
Jul 06 19:38:09.390369 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:38:09.390335    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-cainjector-559cdd8c87-gc45s"]
Jul 06 19:38:09.391707 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:38:09.390750    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ad0faf17-58ab-4f28-9c2b-58720994d24d" containerName="console"
Jul 06 19:38:09.391707 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:38:09.390766    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="ad0faf17-58ab-4f28-9c2b-58720994d24d" containerName="console"
Jul 06 19:38:09.391707 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:38:09.390859    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="ad0faf17-58ab-4f28-9c2b-58720994d24d" containerName="console"
Jul 06 19:38:09.392320 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:38:09.392303    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-cainjector-559cdd8c87-gc45s"
Jul 06 19:38:09.394965 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:38:09.394946    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"kube-root-ca.crt\""
Jul 06 19:38:09.396213 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:38:09.396182    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"openshift-service-ca.crt\""
Jul 06 19:38:09.396311 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:38:09.396212    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-cainjector-dockercfg-5zcbw\""
Jul 06 19:38:09.400572 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:38:09.400549    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-cainjector-559cdd8c87-gc45s"]
Jul 06 19:38:09.527299 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:38:09.527266    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xprjv\" (UniqueName: \"kubernetes.io/projected/293c8fed-cd6d-42bd-a40b-0ff1e8081c22-kube-api-access-xprjv\") pod \"cert-manager-cainjector-559cdd8c87-gc45s\" (UID: \"293c8fed-cd6d-42bd-a40b-0ff1e8081c22\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-gc45s"
Jul 06 19:38:09.527472 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:38:09.527327    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/293c8fed-cd6d-42bd-a40b-0ff1e8081c22-bound-sa-token\") pod \"cert-manager-cainjector-559cdd8c87-gc45s\" (UID: \"293c8fed-cd6d-42bd-a40b-0ff1e8081c22\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-gc45s"
Jul 06 19:38:09.627959 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:38:09.627925    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/293c8fed-cd6d-42bd-a40b-0ff1e8081c22-bound-sa-token\") pod \"cert-manager-cainjector-559cdd8c87-gc45s\" (UID: \"293c8fed-cd6d-42bd-a40b-0ff1e8081c22\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-gc45s"
Jul 06 19:38:09.628141 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:38:09.627993    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xprjv\" (UniqueName: \"kubernetes.io/projected/293c8fed-cd6d-42bd-a40b-0ff1e8081c22-kube-api-access-xprjv\") pod \"cert-manager-cainjector-559cdd8c87-gc45s\" (UID: \"293c8fed-cd6d-42bd-a40b-0ff1e8081c22\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-gc45s"
Jul 06 19:38:09.638246 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:38:09.638211    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xprjv\" (UniqueName: \"kubernetes.io/projected/293c8fed-cd6d-42bd-a40b-0ff1e8081c22-kube-api-access-xprjv\") pod \"cert-manager-cainjector-559cdd8c87-gc45s\" (UID: \"293c8fed-cd6d-42bd-a40b-0ff1e8081c22\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-gc45s"
Jul 06 19:38:09.638362 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:38:09.638347    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/293c8fed-cd6d-42bd-a40b-0ff1e8081c22-bound-sa-token\") pod \"cert-manager-cainjector-559cdd8c87-gc45s\" (UID: \"293c8fed-cd6d-42bd-a40b-0ff1e8081c22\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-gc45s"
Jul 06 19:38:09.702103 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:38:09.702028    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-cainjector-559cdd8c87-gc45s"
Jul 06 19:38:09.827682 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:38:09.827646    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-cainjector-559cdd8c87-gc45s"]
Jul 06 19:38:09.830347 ip-10-0-131-168 kubenswrapper[2565]: W0706 19:38:09.830322    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod293c8fed_cd6d_42bd_a40b_0ff1e8081c22.slice/crio-3fa7cf42f2262a1e4ea4624cc6f2315ac6216b6ab7292cdfbac59318b488fa63 WatchSource:0}: Error finding container 3fa7cf42f2262a1e4ea4624cc6f2315ac6216b6ab7292cdfbac59318b488fa63: Status 404 returned error can't find the container with id 3fa7cf42f2262a1e4ea4624cc6f2315ac6216b6ab7292cdfbac59318b488fa63
Jul 06 19:38:09.832160 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:38:09.832144    2565 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 06 19:38:09.851729 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:38:09.851704    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-cainjector-559cdd8c87-gc45s" event={"ID":"293c8fed-cd6d-42bd-a40b-0ff1e8081c22","Type":"ContainerStarted","Data":"3fa7cf42f2262a1e4ea4624cc6f2315ac6216b6ab7292cdfbac59318b488fa63"}
Jul 06 19:38:12.492248 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:38:12.492214    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-55b4d954d5-v9vz8"]
Jul 06 19:38:12.495297 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:38:12.495278    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-55b4d954d5-v9vz8"
Jul 06 19:38:12.497956 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:38:12.497938    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-dockercfg-5jmlg\""
Jul 06 19:38:12.505982 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:38:12.505937    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-55b4d954d5-v9vz8"]
Jul 06 19:38:12.654216 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:38:12.654163    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mn8tr\" (UniqueName: \"kubernetes.io/projected/68725d9b-dea0-47c7-ad28-2b926f62bc34-kube-api-access-mn8tr\") pod \"cert-manager-55b4d954d5-v9vz8\" (UID: \"68725d9b-dea0-47c7-ad28-2b926f62bc34\") " pod="cert-manager/cert-manager-55b4d954d5-v9vz8"
Jul 06 19:38:12.654398 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:38:12.654318    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/68725d9b-dea0-47c7-ad28-2b926f62bc34-bound-sa-token\") pod \"cert-manager-55b4d954d5-v9vz8\" (UID: \"68725d9b-dea0-47c7-ad28-2b926f62bc34\") " pod="cert-manager/cert-manager-55b4d954d5-v9vz8"
Jul 06 19:38:12.755293 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:38:12.755207    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mn8tr\" (UniqueName: \"kubernetes.io/projected/68725d9b-dea0-47c7-ad28-2b926f62bc34-kube-api-access-mn8tr\") pod \"cert-manager-55b4d954d5-v9vz8\" (UID: \"68725d9b-dea0-47c7-ad28-2b926f62bc34\") " pod="cert-manager/cert-manager-55b4d954d5-v9vz8"
Jul 06 19:38:12.755293 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:38:12.755256    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/68725d9b-dea0-47c7-ad28-2b926f62bc34-bound-sa-token\") pod \"cert-manager-55b4d954d5-v9vz8\" (UID: \"68725d9b-dea0-47c7-ad28-2b926f62bc34\") " pod="cert-manager/cert-manager-55b4d954d5-v9vz8"
Jul 06 19:38:12.765097 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:38:12.765069    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/68725d9b-dea0-47c7-ad28-2b926f62bc34-bound-sa-token\") pod \"cert-manager-55b4d954d5-v9vz8\" (UID: \"68725d9b-dea0-47c7-ad28-2b926f62bc34\") " pod="cert-manager/cert-manager-55b4d954d5-v9vz8"
Jul 06 19:38:12.765270 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:38:12.765229    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mn8tr\" (UniqueName: \"kubernetes.io/projected/68725d9b-dea0-47c7-ad28-2b926f62bc34-kube-api-access-mn8tr\") pod \"cert-manager-55b4d954d5-v9vz8\" (UID: \"68725d9b-dea0-47c7-ad28-2b926f62bc34\") " pod="cert-manager/cert-manager-55b4d954d5-v9vz8"
Jul 06 19:38:12.806935 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:38:12.806908    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-55b4d954d5-v9vz8"
Jul 06 19:38:12.994457 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:38:12.994433    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-55b4d954d5-v9vz8"]
Jul 06 19:38:12.996816 ip-10-0-131-168 kubenswrapper[2565]: W0706 19:38:12.996794    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod68725d9b_dea0_47c7_ad28_2b926f62bc34.slice/crio-f18529cfefe7eadbf94be5c64e3d8450eaf985185eee01c0c3ca599f4c576614 WatchSource:0}: Error finding container f18529cfefe7eadbf94be5c64e3d8450eaf985185eee01c0c3ca599f4c576614: Status 404 returned error can't find the container with id f18529cfefe7eadbf94be5c64e3d8450eaf985185eee01c0c3ca599f4c576614
Jul 06 19:38:13.868322 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:38:13.868287    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-cainjector-559cdd8c87-gc45s" event={"ID":"293c8fed-cd6d-42bd-a40b-0ff1e8081c22","Type":"ContainerStarted","Data":"5e2a5fcc328f8660b8518938db3ba71b5289a42e42a6efd3c792f95b62f9d0fb"}
Jul 06 19:38:13.869652 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:38:13.869631    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-55b4d954d5-v9vz8" event={"ID":"68725d9b-dea0-47c7-ad28-2b926f62bc34","Type":"ContainerStarted","Data":"334b548d703f8e70a511685e78f5cc13d9d3c7e78d3c6f7e3e0f5b73016c1877"}
Jul 06 19:38:13.869719 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:38:13.869661    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-55b4d954d5-v9vz8" event={"ID":"68725d9b-dea0-47c7-ad28-2b926f62bc34","Type":"ContainerStarted","Data":"f18529cfefe7eadbf94be5c64e3d8450eaf985185eee01c0c3ca599f4c576614"}
Jul 06 19:38:13.899693 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:38:13.899640    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-cainjector-559cdd8c87-gc45s" podStartSLOduration=1.7967325459999999 podStartE2EDuration="4.899618228s" totalImagesPullingTime="3.102885682s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 19:38:09 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 19:38:13.899386487 +0000 UTC m=+328.912375155" watchObservedRunningTime="2026-07-06 19:38:13.899618228 +0000 UTC m=+328.912606898"
Jul 06 19:38:13.921658 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:38:13.921602    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-55b4d954d5-v9vz8" podStartSLOduration=1.9215845360000001 podStartE2EDuration="1.921584536s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 19:38:12 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 19:38:13.921105202 +0000 UTC m=+328.934093871" watchObservedRunningTime="2026-07-06 19:38:13.921584536 +0000 UTC m=+328.934573207"
Jul 06 19:38:38.563701 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:38:38.563624    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-5cbdc6848b-wnqd8"]
Jul 06 19:38:38.566621 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:38:38.566603    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-5cbdc6848b-wnqd8"
Jul 06 19:38:38.569910 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:38:38.569891    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\""
Jul 06 19:38:38.570166 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:38:38.570149    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\""
Jul 06 19:38:38.570252 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:38:38.570232    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\""
Jul 06 19:38:38.570311 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:38:38.570295    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-jt7ld\""
Jul 06 19:38:38.574084 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:38:38.574068    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\""
Jul 06 19:38:38.588058 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:38:38.588037    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-5cbdc6848b-wnqd8"]
Jul 06 19:38:38.659124 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:38:38.659094    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/ada0f991-1277-401f-9b9d-5e9819d5e44d-tmp\") pod \"opendatahub-operator-controller-manager-5cbdc6848b-wnqd8\" (UID: \"ada0f991-1277-401f-9b9d-5e9819d5e44d\") " pod="opendatahub/opendatahub-operator-controller-manager-5cbdc6848b-wnqd8"
Jul 06 19:38:38.659277 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:38:38.659147    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/ada0f991-1277-401f-9b9d-5e9819d5e44d-manifests\") pod \"opendatahub-operator-controller-manager-5cbdc6848b-wnqd8\" (UID: \"ada0f991-1277-401f-9b9d-5e9819d5e44d\") " pod="opendatahub/opendatahub-operator-controller-manager-5cbdc6848b-wnqd8"
Jul 06 19:38:38.659277 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:38:38.659172    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/ada0f991-1277-401f-9b9d-5e9819d5e44d-webhook-cert\") pod \"opendatahub-operator-controller-manager-5cbdc6848b-wnqd8\" (UID: \"ada0f991-1277-401f-9b9d-5e9819d5e44d\") " pod="opendatahub/opendatahub-operator-controller-manager-5cbdc6848b-wnqd8"
Jul 06 19:38:38.659277 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:38:38.659243    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/ada0f991-1277-401f-9b9d-5e9819d5e44d-apiservice-cert\") pod \"opendatahub-operator-controller-manager-5cbdc6848b-wnqd8\" (UID: \"ada0f991-1277-401f-9b9d-5e9819d5e44d\") " pod="opendatahub/opendatahub-operator-controller-manager-5cbdc6848b-wnqd8"
Jul 06 19:38:38.659392 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:38:38.659287    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mrbpm\" (UniqueName: \"kubernetes.io/projected/ada0f991-1277-401f-9b9d-5e9819d5e44d-kube-api-access-mrbpm\") pod \"opendatahub-operator-controller-manager-5cbdc6848b-wnqd8\" (UID: \"ada0f991-1277-401f-9b9d-5e9819d5e44d\") " pod="opendatahub/opendatahub-operator-controller-manager-5cbdc6848b-wnqd8"
Jul 06 19:38:38.760495 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:38:38.760446    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/ada0f991-1277-401f-9b9d-5e9819d5e44d-webhook-cert\") pod \"opendatahub-operator-controller-manager-5cbdc6848b-wnqd8\" (UID: \"ada0f991-1277-401f-9b9d-5e9819d5e44d\") " pod="opendatahub/opendatahub-operator-controller-manager-5cbdc6848b-wnqd8"
Jul 06 19:38:38.760677 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:38:38.760517    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/ada0f991-1277-401f-9b9d-5e9819d5e44d-apiservice-cert\") pod \"opendatahub-operator-controller-manager-5cbdc6848b-wnqd8\" (UID: \"ada0f991-1277-401f-9b9d-5e9819d5e44d\") " pod="opendatahub/opendatahub-operator-controller-manager-5cbdc6848b-wnqd8"
Jul 06 19:38:38.760677 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:38:38.760562    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mrbpm\" (UniqueName: \"kubernetes.io/projected/ada0f991-1277-401f-9b9d-5e9819d5e44d-kube-api-access-mrbpm\") pod \"opendatahub-operator-controller-manager-5cbdc6848b-wnqd8\" (UID: \"ada0f991-1277-401f-9b9d-5e9819d5e44d\") " pod="opendatahub/opendatahub-operator-controller-manager-5cbdc6848b-wnqd8"
Jul 06 19:38:38.760677 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:38:38.760594    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/ada0f991-1277-401f-9b9d-5e9819d5e44d-tmp\") pod \"opendatahub-operator-controller-manager-5cbdc6848b-wnqd8\" (UID: \"ada0f991-1277-401f-9b9d-5e9819d5e44d\") " pod="opendatahub/opendatahub-operator-controller-manager-5cbdc6848b-wnqd8"
Jul 06 19:38:38.760677 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:38:38.760661    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/ada0f991-1277-401f-9b9d-5e9819d5e44d-manifests\") pod \"opendatahub-operator-controller-manager-5cbdc6848b-wnqd8\" (UID: \"ada0f991-1277-401f-9b9d-5e9819d5e44d\") " pod="opendatahub/opendatahub-operator-controller-manager-5cbdc6848b-wnqd8"
Jul 06 19:38:38.761078 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:38:38.761049    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/ada0f991-1277-401f-9b9d-5e9819d5e44d-manifests\") pod \"opendatahub-operator-controller-manager-5cbdc6848b-wnqd8\" (UID: \"ada0f991-1277-401f-9b9d-5e9819d5e44d\") " pod="opendatahub/opendatahub-operator-controller-manager-5cbdc6848b-wnqd8"
Jul 06 19:38:38.762792 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:38:38.762740    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/ada0f991-1277-401f-9b9d-5e9819d5e44d-tmp\") pod \"opendatahub-operator-controller-manager-5cbdc6848b-wnqd8\" (UID: \"ada0f991-1277-401f-9b9d-5e9819d5e44d\") " pod="opendatahub/opendatahub-operator-controller-manager-5cbdc6848b-wnqd8"
Jul 06 19:38:38.762979 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:38:38.762962    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/ada0f991-1277-401f-9b9d-5e9819d5e44d-webhook-cert\") pod \"opendatahub-operator-controller-manager-5cbdc6848b-wnqd8\" (UID: \"ada0f991-1277-401f-9b9d-5e9819d5e44d\") " pod="opendatahub/opendatahub-operator-controller-manager-5cbdc6848b-wnqd8"
Jul 06 19:38:38.763021 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:38:38.763006    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/ada0f991-1277-401f-9b9d-5e9819d5e44d-apiservice-cert\") pod \"opendatahub-operator-controller-manager-5cbdc6848b-wnqd8\" (UID: \"ada0f991-1277-401f-9b9d-5e9819d5e44d\") " pod="opendatahub/opendatahub-operator-controller-manager-5cbdc6848b-wnqd8"
Jul 06 19:38:38.773304 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:38:38.773282    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mrbpm\" (UniqueName: \"kubernetes.io/projected/ada0f991-1277-401f-9b9d-5e9819d5e44d-kube-api-access-mrbpm\") pod \"opendatahub-operator-controller-manager-5cbdc6848b-wnqd8\" (UID: \"ada0f991-1277-401f-9b9d-5e9819d5e44d\") " pod="opendatahub/opendatahub-operator-controller-manager-5cbdc6848b-wnqd8"
Jul 06 19:38:38.878375 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:38:38.878346    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-5cbdc6848b-wnqd8"
Jul 06 19:38:39.016424 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:38:39.016401    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-5cbdc6848b-wnqd8"]
Jul 06 19:38:39.018651 ip-10-0-131-168 kubenswrapper[2565]: W0706 19:38:39.018624    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podada0f991_1277_401f_9b9d_5e9819d5e44d.slice/crio-314c7be73475f1e0acf00a510ab7290cc4de165978921885c5c2b0b7ee0463f3 WatchSource:0}: Error finding container 314c7be73475f1e0acf00a510ab7290cc4de165978921885c5c2b0b7ee0463f3: Status 404 returned error can't find the container with id 314c7be73475f1e0acf00a510ab7290cc4de165978921885c5c2b0b7ee0463f3
Jul 06 19:38:39.968137 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:38:39.968091    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-5cbdc6848b-wnqd8" event={"ID":"ada0f991-1277-401f-9b9d-5e9819d5e44d","Type":"ContainerStarted","Data":"314c7be73475f1e0acf00a510ab7290cc4de165978921885c5c2b0b7ee0463f3"}
Jul 06 19:38:42.980642 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:38:42.980599    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-5cbdc6848b-wnqd8" event={"ID":"ada0f991-1277-401f-9b9d-5e9819d5e44d","Type":"ContainerStarted","Data":"4059d19491094242543cea92b07411efbfffcbcf94b828c8a74599835808370d"}
Jul 06 19:38:43.986062 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:38:43.986024    2565 generic.go:356] "Generic (PLEG): container finished" podID="ada0f991-1277-401f-9b9d-5e9819d5e44d" containerID="4059d19491094242543cea92b07411efbfffcbcf94b828c8a74599835808370d" exitCode=0
Jul 06 19:38:43.986411 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:38:43.986072    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-5cbdc6848b-wnqd8" event={"ID":"ada0f991-1277-401f-9b9d-5e9819d5e44d","Type":"ContainerDied","Data":"4059d19491094242543cea92b07411efbfffcbcf94b828c8a74599835808370d"}
Jul 06 19:38:44.991417 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:38:44.991382    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-5cbdc6848b-wnqd8" event={"ID":"ada0f991-1277-401f-9b9d-5e9819d5e44d","Type":"ContainerStarted","Data":"5bba6d71649f208e30adbc7fe0b34479d233802a477f564b3602d3b9e233ce8c"}
Jul 06 19:38:44.991802 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:38:44.991515    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-5cbdc6848b-wnqd8"
Jul 06 19:38:45.021828 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:38:45.021744    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-5cbdc6848b-wnqd8" podStartSLOduration=2.585204994 podStartE2EDuration="7.02171798s" totalImagesPullingTime="3.34703861s" totalInitContainerRuntime="1.089474376s" isStatefulPod=false podCreationTimestamp="2026-07-06 19:38:38 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 19:38:45.01915065 +0000 UTC m=+360.032139329" watchObservedRunningTime="2026-07-06 19:38:45.02171798 +0000 UTC m=+360.034706650"
Jul 06 19:38:55.997521 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:38:55.997491    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-5cbdc6848b-wnqd8"
Jul 06 19:38:58.943299 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:38:58.943269    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/kube-auth-proxy-86f8887d66-cpzt7"]
Jul 06 19:38:58.951910 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:38:58.951884    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-86f8887d66-cpzt7"
Jul 06 19:38:58.956294 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:38:58.956271    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\""
Jul 06 19:38:58.956423 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:38:58.956346    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-tls\""
Jul 06 19:38:58.956487 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:38:58.956276    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\""
Jul 06 19:38:58.956487 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:38:58.956298    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-creds\""
Jul 06 19:38:58.956487 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:38:58.956276    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-dockercfg-wghbn\""
Jul 06 19:38:58.962373 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:38:58.962353    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-86f8887d66-cpzt7"]
Jul 06 19:38:58.971679 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:38:58.971657    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/odh-model-controller-7998c67dc4-spx2c"]
Jul 06 19:38:58.974845 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:38:58.974828    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/odh-model-controller-7998c67dc4-spx2c"
Jul 06 19:38:58.977689 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:38:58.977672    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"odh-model-controller-dockercfg-2q4mg\""
Jul 06 19:38:58.977798 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:38:58.977725    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"odh-model-controller-webhook-cert\""
Jul 06 19:38:58.984088 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:38:58.984067    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/odh-model-controller-7998c67dc4-spx2c"]
Jul 06 19:38:59.031142 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:38:59.031111    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/e88646d7-eecd-467f-bd54-19ba6d28bb33-tls-certs\") pod \"kube-auth-proxy-86f8887d66-cpzt7\" (UID: \"e88646d7-eecd-467f-bd54-19ba6d28bb33\") " pod="openshift-ingress/kube-auth-proxy-86f8887d66-cpzt7"
Jul 06 19:38:59.031142 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:38:59.031139    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/2c6bf875-f3cc-48a2-bfbe-4d2de4db7482-cert\") pod \"odh-model-controller-7998c67dc4-spx2c\" (UID: \"2c6bf875-f3cc-48a2-bfbe-4d2de4db7482\") " pod="opendatahub/odh-model-controller-7998c67dc4-spx2c"
Jul 06 19:38:59.031347 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:38:59.031163    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/e88646d7-eecd-467f-bd54-19ba6d28bb33-tmp\") pod \"kube-auth-proxy-86f8887d66-cpzt7\" (UID: \"e88646d7-eecd-467f-bd54-19ba6d28bb33\") " pod="openshift-ingress/kube-auth-proxy-86f8887d66-cpzt7"
Jul 06 19:38:59.031347 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:38:59.031190    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-c7mwh\" (UniqueName: \"kubernetes.io/projected/2c6bf875-f3cc-48a2-bfbe-4d2de4db7482-kube-api-access-c7mwh\") pod \"odh-model-controller-7998c67dc4-spx2c\" (UID: \"2c6bf875-f3cc-48a2-bfbe-4d2de4db7482\") " pod="opendatahub/odh-model-controller-7998c67dc4-spx2c"
Jul 06 19:38:59.031347 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:38:59.031283    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-95x57\" (UniqueName: \"kubernetes.io/projected/e88646d7-eecd-467f-bd54-19ba6d28bb33-kube-api-access-95x57\") pod \"kube-auth-proxy-86f8887d66-cpzt7\" (UID: \"e88646d7-eecd-467f-bd54-19ba6d28bb33\") " pod="openshift-ingress/kube-auth-proxy-86f8887d66-cpzt7"
Jul 06 19:38:59.132565 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:38:59.132525    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-c7mwh\" (UniqueName: \"kubernetes.io/projected/2c6bf875-f3cc-48a2-bfbe-4d2de4db7482-kube-api-access-c7mwh\") pod \"odh-model-controller-7998c67dc4-spx2c\" (UID: \"2c6bf875-f3cc-48a2-bfbe-4d2de4db7482\") " pod="opendatahub/odh-model-controller-7998c67dc4-spx2c"
Jul 06 19:38:59.132740 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:38:59.132600    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-95x57\" (UniqueName: \"kubernetes.io/projected/e88646d7-eecd-467f-bd54-19ba6d28bb33-kube-api-access-95x57\") pod \"kube-auth-proxy-86f8887d66-cpzt7\" (UID: \"e88646d7-eecd-467f-bd54-19ba6d28bb33\") " pod="openshift-ingress/kube-auth-proxy-86f8887d66-cpzt7"
Jul 06 19:38:59.132740 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:38:59.132666    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/e88646d7-eecd-467f-bd54-19ba6d28bb33-tls-certs\") pod \"kube-auth-proxy-86f8887d66-cpzt7\" (UID: \"e88646d7-eecd-467f-bd54-19ba6d28bb33\") " pod="openshift-ingress/kube-auth-proxy-86f8887d66-cpzt7"
Jul 06 19:38:59.132740 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:38:59.132690    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/2c6bf875-f3cc-48a2-bfbe-4d2de4db7482-cert\") pod \"odh-model-controller-7998c67dc4-spx2c\" (UID: \"2c6bf875-f3cc-48a2-bfbe-4d2de4db7482\") " pod="opendatahub/odh-model-controller-7998c67dc4-spx2c"
Jul 06 19:38:59.132740 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:38:59.132719    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/e88646d7-eecd-467f-bd54-19ba6d28bb33-tmp\") pod \"kube-auth-proxy-86f8887d66-cpzt7\" (UID: \"e88646d7-eecd-467f-bd54-19ba6d28bb33\") " pod="openshift-ingress/kube-auth-proxy-86f8887d66-cpzt7"
Jul 06 19:38:59.132945 ip-10-0-131-168 kubenswrapper[2565]: E0706 19:38:59.132915    2565 secret.go:189] Couldn't get secret opendatahub/odh-model-controller-webhook-cert: secret "odh-model-controller-webhook-cert" not found
Jul 06 19:38:59.133040 ip-10-0-131-168 kubenswrapper[2565]: E0706 19:38:59.133007    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2c6bf875-f3cc-48a2-bfbe-4d2de4db7482-cert podName:2c6bf875-f3cc-48a2-bfbe-4d2de4db7482 nodeName:}" failed. No retries permitted until 2026-07-06 19:38:59.632978591 +0000 UTC m=+374.645967246 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/2c6bf875-f3cc-48a2-bfbe-4d2de4db7482-cert") pod "odh-model-controller-7998c67dc4-spx2c" (UID: "2c6bf875-f3cc-48a2-bfbe-4d2de4db7482") : secret "odh-model-controller-webhook-cert" not found
Jul 06 19:38:59.135446 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:38:59.135413    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/e88646d7-eecd-467f-bd54-19ba6d28bb33-tls-certs\") pod \"kube-auth-proxy-86f8887d66-cpzt7\" (UID: \"e88646d7-eecd-467f-bd54-19ba6d28bb33\") " pod="openshift-ingress/kube-auth-proxy-86f8887d66-cpzt7"
Jul 06 19:38:59.135571 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:38:59.135419    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/e88646d7-eecd-467f-bd54-19ba6d28bb33-tmp\") pod \"kube-auth-proxy-86f8887d66-cpzt7\" (UID: \"e88646d7-eecd-467f-bd54-19ba6d28bb33\") " pod="openshift-ingress/kube-auth-proxy-86f8887d66-cpzt7"
Jul 06 19:38:59.155705 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:38:59.155679    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-c7mwh\" (UniqueName: \"kubernetes.io/projected/2c6bf875-f3cc-48a2-bfbe-4d2de4db7482-kube-api-access-c7mwh\") pod \"odh-model-controller-7998c67dc4-spx2c\" (UID: \"2c6bf875-f3cc-48a2-bfbe-4d2de4db7482\") " pod="opendatahub/odh-model-controller-7998c67dc4-spx2c"
Jul 06 19:38:59.156140 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:38:59.156119    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-95x57\" (UniqueName: \"kubernetes.io/projected/e88646d7-eecd-467f-bd54-19ba6d28bb33-kube-api-access-95x57\") pod \"kube-auth-proxy-86f8887d66-cpzt7\" (UID: \"e88646d7-eecd-467f-bd54-19ba6d28bb33\") " pod="openshift-ingress/kube-auth-proxy-86f8887d66-cpzt7"
Jul 06 19:38:59.262862 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:38:59.262763    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-86f8887d66-cpzt7"
Jul 06 19:38:59.424675 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:38:59.424639    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-86f8887d66-cpzt7"]
Jul 06 19:38:59.426423 ip-10-0-131-168 kubenswrapper[2565]: W0706 19:38:59.426400    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode88646d7_eecd_467f_bd54_19ba6d28bb33.slice/crio-d73464b6c9300520013b09e1646463bb6822188fb84dff6626ba4406b7c13bfa WatchSource:0}: Error finding container d73464b6c9300520013b09e1646463bb6822188fb84dff6626ba4406b7c13bfa: Status 404 returned error can't find the container with id d73464b6c9300520013b09e1646463bb6822188fb84dff6626ba4406b7c13bfa
Jul 06 19:38:59.637886 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:38:59.637856    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/2c6bf875-f3cc-48a2-bfbe-4d2de4db7482-cert\") pod \"odh-model-controller-7998c67dc4-spx2c\" (UID: \"2c6bf875-f3cc-48a2-bfbe-4d2de4db7482\") " pod="opendatahub/odh-model-controller-7998c67dc4-spx2c"
Jul 06 19:38:59.640155 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:38:59.640137    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/2c6bf875-f3cc-48a2-bfbe-4d2de4db7482-cert\") pod \"odh-model-controller-7998c67dc4-spx2c\" (UID: \"2c6bf875-f3cc-48a2-bfbe-4d2de4db7482\") " pod="opendatahub/odh-model-controller-7998c67dc4-spx2c"
Jul 06 19:38:59.885678 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:38:59.885640    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/odh-model-controller-7998c67dc4-spx2c"
Jul 06 19:39:00.030862 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:39:00.030822    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/odh-model-controller-7998c67dc4-spx2c"]
Jul 06 19:39:00.033046 ip-10-0-131-168 kubenswrapper[2565]: W0706 19:39:00.033015    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2c6bf875_f3cc_48a2_bfbe_4d2de4db7482.slice/crio-e8842f25d47ba9554034124253a5132ea8f912383104d001695ff711810aa3f9 WatchSource:0}: Error finding container e8842f25d47ba9554034124253a5132ea8f912383104d001695ff711810aa3f9: Status 404 returned error can't find the container with id e8842f25d47ba9554034124253a5132ea8f912383104d001695ff711810aa3f9
Jul 06 19:39:00.047802 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:39:00.047755    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/odh-model-controller-7998c67dc4-spx2c" event={"ID":"2c6bf875-f3cc-48a2-bfbe-4d2de4db7482","Type":"ContainerStarted","Data":"e8842f25d47ba9554034124253a5132ea8f912383104d001695ff711810aa3f9"}
Jul 06 19:39:00.049426 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:39:00.049383    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-86f8887d66-cpzt7" event={"ID":"e88646d7-eecd-467f-bd54-19ba6d28bb33","Type":"ContainerStarted","Data":"d73464b6c9300520013b09e1646463bb6822188fb84dff6626ba4406b7c13bfa"}
Jul 06 19:39:04.069734 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:39:04.069700    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/odh-model-controller-7998c67dc4-spx2c" event={"ID":"2c6bf875-f3cc-48a2-bfbe-4d2de4db7482","Type":"ContainerStarted","Data":"7f9117c4ff05542242dbfe9b850ce38726408b900372473caa9f932b4078c303"}
Jul 06 19:39:04.070189 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:39:04.069847    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/odh-model-controller-7998c67dc4-spx2c"
Jul 06 19:39:04.071207 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:39:04.071185    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-86f8887d66-cpzt7" event={"ID":"e88646d7-eecd-467f-bd54-19ba6d28bb33","Type":"ContainerStarted","Data":"ecd43074f9e57c83510b27d7b97cd73d621d872e845512583a619b22f982bdc9"}
Jul 06 19:39:04.089847 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:39:04.089804    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/odh-model-controller-7998c67dc4-spx2c" podStartSLOduration=2.5232649499999997 podStartE2EDuration="6.089790509s" totalImagesPullingTime="3.566525559s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 19:38:58 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 19:39:04.08836398 +0000 UTC m=+379.101352650" watchObservedRunningTime="2026-07-06 19:39:04.089790509 +0000 UTC m=+379.102779169"
Jul 06 19:39:04.117035 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:39:04.116982    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/kube-auth-proxy-86f8887d66-cpzt7" podStartSLOduration=1.944297808 podStartE2EDuration="6.116964439s" totalImagesPullingTime="4.172666631s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 19:38:58 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 19:39:04.116060301 +0000 UTC m=+379.129048971" watchObservedRunningTime="2026-07-06 19:39:04.116964439 +0000 UTC m=+379.129953110"
Jul 06 19:39:06.199913 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:39:06.199880    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/istiod-openshift-gateway-94bb8fbfd-2stz5"]
Jul 06 19:39:06.203462 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:39:06.203444    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-2stz5"
Jul 06 19:39:06.207623 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:39:06.207601    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-tls\""
Jul 06 19:39:06.207737 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:39:06.207626    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"cacerts\""
Jul 06 19:39:06.207737 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:39:06.207648    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-openshift-gateway-dockercfg-4q9sk\""
Jul 06 19:39:06.208052 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:39:06.208038    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istio-kubeconfig\""
Jul 06 19:39:06.208569 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:39:06.208552    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\""
Jul 06 19:39:06.224567 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:39:06.224543    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-94bb8fbfd-2stz5"]
Jul 06 19:39:06.291203 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:39:06.291166    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-58qr4\" (UniqueName: \"kubernetes.io/projected/6b6e9a9c-0018-4976-8826-bade8fe5fe25-kube-api-access-58qr4\") pod \"istiod-openshift-gateway-94bb8fbfd-2stz5\" (UID: \"6b6e9a9c-0018-4976-8826-bade8fe5fe25\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-2stz5"
Jul 06 19:39:06.291380 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:39:06.291222    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/6b6e9a9c-0018-4976-8826-bade8fe5fe25-local-certs\") pod \"istiod-openshift-gateway-94bb8fbfd-2stz5\" (UID: \"6b6e9a9c-0018-4976-8826-bade8fe5fe25\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-2stz5"
Jul 06 19:39:06.291467 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:39:06.291397    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/6b6e9a9c-0018-4976-8826-bade8fe5fe25-cacerts\") pod \"istiod-openshift-gateway-94bb8fbfd-2stz5\" (UID: \"6b6e9a9c-0018-4976-8826-bade8fe5fe25\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-2stz5"
Jul 06 19:39:06.291526 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:39:06.291462    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/6b6e9a9c-0018-4976-8826-bade8fe5fe25-istio-kubeconfig\") pod \"istiod-openshift-gateway-94bb8fbfd-2stz5\" (UID: \"6b6e9a9c-0018-4976-8826-bade8fe5fe25\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-2stz5"
Jul 06 19:39:06.291526 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:39:06.291499    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/6b6e9a9c-0018-4976-8826-bade8fe5fe25-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-94bb8fbfd-2stz5\" (UID: \"6b6e9a9c-0018-4976-8826-bade8fe5fe25\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-2stz5"
Jul 06 19:39:06.291618 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:39:06.291528    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/6b6e9a9c-0018-4976-8826-bade8fe5fe25-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-94bb8fbfd-2stz5\" (UID: \"6b6e9a9c-0018-4976-8826-bade8fe5fe25\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-2stz5"
Jul 06 19:39:06.291618 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:39:06.291555    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/6b6e9a9c-0018-4976-8826-bade8fe5fe25-istio-token\") pod \"istiod-openshift-gateway-94bb8fbfd-2stz5\" (UID: \"6b6e9a9c-0018-4976-8826-bade8fe5fe25\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-2stz5"
Jul 06 19:39:06.392346 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:39:06.392307    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/6b6e9a9c-0018-4976-8826-bade8fe5fe25-istio-kubeconfig\") pod \"istiod-openshift-gateway-94bb8fbfd-2stz5\" (UID: \"6b6e9a9c-0018-4976-8826-bade8fe5fe25\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-2stz5"
Jul 06 19:39:06.392346 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:39:06.392347    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/6b6e9a9c-0018-4976-8826-bade8fe5fe25-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-94bb8fbfd-2stz5\" (UID: \"6b6e9a9c-0018-4976-8826-bade8fe5fe25\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-2stz5"
Jul 06 19:39:06.392589 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:39:06.392375    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/6b6e9a9c-0018-4976-8826-bade8fe5fe25-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-94bb8fbfd-2stz5\" (UID: \"6b6e9a9c-0018-4976-8826-bade8fe5fe25\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-2stz5"
Jul 06 19:39:06.392589 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:39:06.392401    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/6b6e9a9c-0018-4976-8826-bade8fe5fe25-istio-token\") pod \"istiod-openshift-gateway-94bb8fbfd-2stz5\" (UID: \"6b6e9a9c-0018-4976-8826-bade8fe5fe25\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-2stz5"
Jul 06 19:39:06.392589 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:39:06.392440    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-58qr4\" (UniqueName: \"kubernetes.io/projected/6b6e9a9c-0018-4976-8826-bade8fe5fe25-kube-api-access-58qr4\") pod \"istiod-openshift-gateway-94bb8fbfd-2stz5\" (UID: \"6b6e9a9c-0018-4976-8826-bade8fe5fe25\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-2stz5"
Jul 06 19:39:06.392589 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:39:06.392478    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/6b6e9a9c-0018-4976-8826-bade8fe5fe25-local-certs\") pod \"istiod-openshift-gateway-94bb8fbfd-2stz5\" (UID: \"6b6e9a9c-0018-4976-8826-bade8fe5fe25\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-2stz5"
Jul 06 19:39:06.392589 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:39:06.392560    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/6b6e9a9c-0018-4976-8826-bade8fe5fe25-cacerts\") pod \"istiod-openshift-gateway-94bb8fbfd-2stz5\" (UID: \"6b6e9a9c-0018-4976-8826-bade8fe5fe25\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-2stz5"
Jul 06 19:39:06.393258 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:39:06.393228    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/6b6e9a9c-0018-4976-8826-bade8fe5fe25-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-94bb8fbfd-2stz5\" (UID: \"6b6e9a9c-0018-4976-8826-bade8fe5fe25\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-2stz5"
Jul 06 19:39:06.394708 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:39:06.394681    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/6b6e9a9c-0018-4976-8826-bade8fe5fe25-istio-kubeconfig\") pod \"istiod-openshift-gateway-94bb8fbfd-2stz5\" (UID: \"6b6e9a9c-0018-4976-8826-bade8fe5fe25\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-2stz5"
Jul 06 19:39:06.394867 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:39:06.394732    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/6b6e9a9c-0018-4976-8826-bade8fe5fe25-local-certs\") pod \"istiod-openshift-gateway-94bb8fbfd-2stz5\" (UID: \"6b6e9a9c-0018-4976-8826-bade8fe5fe25\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-2stz5"
Jul 06 19:39:06.394867 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:39:06.394824    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/6b6e9a9c-0018-4976-8826-bade8fe5fe25-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-94bb8fbfd-2stz5\" (UID: \"6b6e9a9c-0018-4976-8826-bade8fe5fe25\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-2stz5"
Jul 06 19:39:06.394947 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:39:06.394932    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/6b6e9a9c-0018-4976-8826-bade8fe5fe25-cacerts\") pod \"istiod-openshift-gateway-94bb8fbfd-2stz5\" (UID: \"6b6e9a9c-0018-4976-8826-bade8fe5fe25\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-2stz5"
Jul 06 19:39:06.401180 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:39:06.401154    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/6b6e9a9c-0018-4976-8826-bade8fe5fe25-istio-token\") pod \"istiod-openshift-gateway-94bb8fbfd-2stz5\" (UID: \"6b6e9a9c-0018-4976-8826-bade8fe5fe25\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-2stz5"
Jul 06 19:39:06.401645 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:39:06.401624    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-58qr4\" (UniqueName: \"kubernetes.io/projected/6b6e9a9c-0018-4976-8826-bade8fe5fe25-kube-api-access-58qr4\") pod \"istiod-openshift-gateway-94bb8fbfd-2stz5\" (UID: \"6b6e9a9c-0018-4976-8826-bade8fe5fe25\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-2stz5"
Jul 06 19:39:06.513076 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:39:06.512983    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-2stz5"
Jul 06 19:39:06.679149 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:39:06.671698    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-94bb8fbfd-2stz5"]
Jul 06 19:39:07.085092 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:39:07.085060    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-2stz5" event={"ID":"6b6e9a9c-0018-4976-8826-bade8fe5fe25","Type":"ContainerStarted","Data":"8b7dc7592e4526afd33fe63ed4a681382cc0850d4e27d54d69bd37b903b4edde"}
Jul 06 19:39:08.860891 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:39:08.860837    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/llmisvc-controller-manager-777c6bd7d5-2gpk4"]
Jul 06 19:39:08.869594 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:39:08.869563    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-2gpk4"
Jul 06 19:39:08.874609 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:39:08.874521    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"llmisvc-webhook-server-cert\""
Jul 06 19:39:08.876412 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:39:08.876390    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"llmisvc-controller-manager-dockercfg-d2s9q\""
Jul 06 19:39:08.893308 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:39:08.893277    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/llmisvc-controller-manager-777c6bd7d5-2gpk4"]
Jul 06 19:39:09.017875 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:39:09.017838    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/9928c28e-6a6f-4a8a-9d7d-77e356aafc12-cert\") pod \"llmisvc-controller-manager-777c6bd7d5-2gpk4\" (UID: \"9928c28e-6a6f-4a8a-9d7d-77e356aafc12\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-2gpk4"
Jul 06 19:39:09.017875 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:39:09.017876    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4pn2p\" (UniqueName: \"kubernetes.io/projected/9928c28e-6a6f-4a8a-9d7d-77e356aafc12-kube-api-access-4pn2p\") pod \"llmisvc-controller-manager-777c6bd7d5-2gpk4\" (UID: \"9928c28e-6a6f-4a8a-9d7d-77e356aafc12\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-2gpk4"
Jul 06 19:39:09.105173 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:39:09.105130    2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 06 19:39:09.105285 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:39:09.105205    2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 06 19:39:09.131405 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:39:09.121266    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/9928c28e-6a6f-4a8a-9d7d-77e356aafc12-cert\") pod \"llmisvc-controller-manager-777c6bd7d5-2gpk4\" (UID: \"9928c28e-6a6f-4a8a-9d7d-77e356aafc12\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-2gpk4"
Jul 06 19:39:09.131405 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:39:09.121310    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4pn2p\" (UniqueName: \"kubernetes.io/projected/9928c28e-6a6f-4a8a-9d7d-77e356aafc12-kube-api-access-4pn2p\") pod \"llmisvc-controller-manager-777c6bd7d5-2gpk4\" (UID: \"9928c28e-6a6f-4a8a-9d7d-77e356aafc12\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-2gpk4"
Jul 06 19:39:09.131405 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:39:09.124292    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/9928c28e-6a6f-4a8a-9d7d-77e356aafc12-cert\") pod \"llmisvc-controller-manager-777c6bd7d5-2gpk4\" (UID: \"9928c28e-6a6f-4a8a-9d7d-77e356aafc12\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-2gpk4"
Jul 06 19:39:09.137347 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:39:09.137323    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4pn2p\" (UniqueName: \"kubernetes.io/projected/9928c28e-6a6f-4a8a-9d7d-77e356aafc12-kube-api-access-4pn2p\") pod \"llmisvc-controller-manager-777c6bd7d5-2gpk4\" (UID: \"9928c28e-6a6f-4a8a-9d7d-77e356aafc12\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-2gpk4"
Jul 06 19:39:09.183446 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:39:09.183425    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-2gpk4"
Jul 06 19:39:09.338632 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:39:09.338591    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/llmisvc-controller-manager-777c6bd7d5-2gpk4"]
Jul 06 19:39:09.341791 ip-10-0-131-168 kubenswrapper[2565]: W0706 19:39:09.341745    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod9928c28e_6a6f_4a8a_9d7d_77e356aafc12.slice/crio-7062d20a839cd78c0364683477dd19e983f131f22d5c3c5a0906e23b443eae96 WatchSource:0}: Error finding container 7062d20a839cd78c0364683477dd19e983f131f22d5c3c5a0906e23b443eae96: Status 404 returned error can't find the container with id 7062d20a839cd78c0364683477dd19e983f131f22d5c3c5a0906e23b443eae96
Jul 06 19:39:10.100122 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:39:10.100085    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-2gpk4" event={"ID":"9928c28e-6a6f-4a8a-9d7d-77e356aafc12","Type":"ContainerStarted","Data":"7062d20a839cd78c0364683477dd19e983f131f22d5c3c5a0906e23b443eae96"}
Jul 06 19:39:10.102432 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:39:10.102392    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-2stz5" event={"ID":"6b6e9a9c-0018-4976-8826-bade8fe5fe25","Type":"ContainerStarted","Data":"827b26a64128d78bb369409c08d9112d20ce2317e0366e483e7ed559f642125f"}
Jul 06 19:39:10.102752 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:39:10.102721    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-2stz5"
Jul 06 19:39:10.104930 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:39:10.104889    2565 patch_prober.go:28] interesting pod/istiod-openshift-gateway-94bb8fbfd-2stz5 container/discovery namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Jul 06 19:39:10.105033 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:39:10.104940    2565 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-2stz5" podUID="6b6e9a9c-0018-4976-8826-bade8fe5fe25" containerName="discovery" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 06 19:39:10.152414 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:39:10.152351    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-2stz5" podStartSLOduration=1.7421691689999999 podStartE2EDuration="4.152330992s" totalImagesPullingTime="2.410161823s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 19:39:06 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 19:39:10.148312126 +0000 UTC m=+385.161300816" watchObservedRunningTime="2026-07-06 19:39:10.152330992 +0000 UTC m=+385.165319661"
Jul 06 19:39:11.108647 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:39:11.108615    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-2stz5"
Jul 06 19:39:13.118098 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:39:13.118060    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-2gpk4" event={"ID":"9928c28e-6a6f-4a8a-9d7d-77e356aafc12","Type":"ContainerStarted","Data":"5b9c06ede741842a7a6242226c68e2bdbb454c1c6f0ad48b2b66ff576431af62"}
Jul 06 19:39:13.118439 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:39:13.118195    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-2gpk4"
Jul 06 19:39:13.167262 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:39:13.167209    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-2gpk4" podStartSLOduration=1.951535595 podStartE2EDuration="5.167193814s" totalImagesPullingTime="3.215658219s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 19:39:08 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 19:39:13.165704131 +0000 UTC m=+388.178692825" watchObservedRunningTime="2026-07-06 19:39:13.167193814 +0000 UTC m=+388.180182482"
Jul 06 19:39:15.077614 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:39:15.077582    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/odh-model-controller-7998c67dc4-spx2c"
Jul 06 19:39:44.124479 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:39:44.124448    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-2gpk4"
Jul 06 19:40:31.247532 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:40:31.247496    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-operator-75cc8d5cb7-6dp9g"]
Jul 06 19:40:31.249803 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:40:31.249764    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-operator-75cc8d5cb7-6dp9g"
Jul 06 19:40:31.252795 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:40:31.252749    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\""
Jul 06 19:40:31.253994 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:40:31.253974    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\""
Jul 06 19:40:31.254082 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:40:31.253974    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-operator-dockercfg-br97w\""
Jul 06 19:40:31.268315 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:40:31.268291    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-operator-75cc8d5cb7-6dp9g"]
Jul 06 19:40:31.313679 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:40:31.313646    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-g29tg\" (UniqueName: \"kubernetes.io/projected/c488330f-977e-4d67-9e61-1e7d470e0dac-kube-api-access-g29tg\") pod \"authorino-operator-75cc8d5cb7-6dp9g\" (UID: \"c488330f-977e-4d67-9e61-1e7d470e0dac\") " pod="kuadrant-system/authorino-operator-75cc8d5cb7-6dp9g"
Jul 06 19:40:31.414132 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:40:31.414096    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-g29tg\" (UniqueName: \"kubernetes.io/projected/c488330f-977e-4d67-9e61-1e7d470e0dac-kube-api-access-g29tg\") pod \"authorino-operator-75cc8d5cb7-6dp9g\" (UID: \"c488330f-977e-4d67-9e61-1e7d470e0dac\") " pod="kuadrant-system/authorino-operator-75cc8d5cb7-6dp9g"
Jul 06 19:40:31.433255 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:40:31.433223    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-g29tg\" (UniqueName: \"kubernetes.io/projected/c488330f-977e-4d67-9e61-1e7d470e0dac-kube-api-access-g29tg\") pod \"authorino-operator-75cc8d5cb7-6dp9g\" (UID: \"c488330f-977e-4d67-9e61-1e7d470e0dac\") " pod="kuadrant-system/authorino-operator-75cc8d5cb7-6dp9g"
Jul 06 19:40:31.559792 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:40:31.559684    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-operator-75cc8d5cb7-6dp9g"
Jul 06 19:40:31.694108 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:40:31.694081    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-operator-75cc8d5cb7-6dp9g"]
Jul 06 19:40:31.696559 ip-10-0-131-168 kubenswrapper[2565]: W0706 19:40:31.696535    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc488330f_977e_4d67_9e61_1e7d470e0dac.slice/crio-322cd8177baa2c43a3dc79485c48dcef60490fc42d441993ef12a286bbaee1f0 WatchSource:0}: Error finding container 322cd8177baa2c43a3dc79485c48dcef60490fc42d441993ef12a286bbaee1f0: Status 404 returned error can't find the container with id 322cd8177baa2c43a3dc79485c48dcef60490fc42d441993ef12a286bbaee1f0
Jul 06 19:40:32.454439 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:40:32.454400    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-operator-75cc8d5cb7-6dp9g" event={"ID":"c488330f-977e-4d67-9e61-1e7d470e0dac","Type":"ContainerStarted","Data":"322cd8177baa2c43a3dc79485c48dcef60490fc42d441993ef12a286bbaee1f0"}
Jul 06 19:40:34.465229 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:40:34.465196    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-operator-75cc8d5cb7-6dp9g" event={"ID":"c488330f-977e-4d67-9e61-1e7d470e0dac","Type":"ContainerStarted","Data":"58f0d0b229fca086378c376eb9b5f52963031ecbfd2c8cdf2dbef50ca070f2bb"}
Jul 06 19:40:34.465654 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:40:34.465331    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/authorino-operator-75cc8d5cb7-6dp9g"
Jul 06 19:40:34.486445 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:40:34.486394    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-operator-75cc8d5cb7-6dp9g" podStartSLOduration=1.315872461 podStartE2EDuration="3.486378457s" totalImagesPullingTime="2.170505996s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 19:40:31 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 19:40:34.485239089 +0000 UTC m=+469.498227781" watchObservedRunningTime="2026-07-06 19:40:34.486378457 +0000 UTC m=+469.499367126"
Jul 06 19:40:45.471639 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:40:45.471608    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/authorino-operator-75cc8d5cb7-6dp9g"
Jul 06 19:41:08.541078 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:41:08.541047    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-s4gng"]
Jul 06 19:41:08.544217 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:41:08.544202    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-s4gng"
Jul 06 19:41:08.547008 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:41:08.546990    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-htwnp\""
Jul 06 19:41:08.562841 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:41:08.562816    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-s4gng"]
Jul 06 19:41:08.632907 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:41:08.632875    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-55z9l\" (UniqueName: \"kubernetes.io/projected/8ff60c01-a4a3-41a9-aa93-ba0edec9a6f2-kube-api-access-55z9l\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-s4gng\" (UID: \"8ff60c01-a4a3-41a9-aa93-ba0edec9a6f2\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-s4gng"
Jul 06 19:41:08.633072 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:41:08.632936    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/8ff60c01-a4a3-41a9-aa93-ba0edec9a6f2-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-s4gng\" (UID: \"8ff60c01-a4a3-41a9-aa93-ba0edec9a6f2\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-s4gng"
Jul 06 19:41:08.677474 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:41:08.677434    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-s4gng"]
Jul 06 19:41:08.677735 ip-10-0-131-168 kubenswrapper[2565]: E0706 19:41:08.677713    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[extensions-socket-volume kube-api-access-55z9l], unattached volumes=[], failed to process volumes=[]: context canceled" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-s4gng" podUID="8ff60c01-a4a3-41a9-aa93-ba0edec9a6f2"
Jul 06 19:41:08.733404 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:41:08.733356    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-55z9l\" (UniqueName: \"kubernetes.io/projected/8ff60c01-a4a3-41a9-aa93-ba0edec9a6f2-kube-api-access-55z9l\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-s4gng\" (UID: \"8ff60c01-a4a3-41a9-aa93-ba0edec9a6f2\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-s4gng"
Jul 06 19:41:08.733404 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:41:08.733414    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/8ff60c01-a4a3-41a9-aa93-ba0edec9a6f2-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-s4gng\" (UID: \"8ff60c01-a4a3-41a9-aa93-ba0edec9a6f2\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-s4gng"
Jul 06 19:41:08.733747 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:41:08.733731    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/8ff60c01-a4a3-41a9-aa93-ba0edec9a6f2-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-s4gng\" (UID: \"8ff60c01-a4a3-41a9-aa93-ba0edec9a6f2\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-s4gng"
Jul 06 19:41:08.750950 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:41:08.750918    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-55z9l\" (UniqueName: \"kubernetes.io/projected/8ff60c01-a4a3-41a9-aa93-ba0edec9a6f2-kube-api-access-55z9l\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-s4gng\" (UID: \"8ff60c01-a4a3-41a9-aa93-ba0edec9a6f2\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-s4gng"
Jul 06 19:41:09.124144 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:41:09.124113    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-s4gng"]
Jul 06 19:41:09.138754 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:41:09.138718    2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-s4gng"]
Jul 06 19:41:09.236834 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:41:09.236796    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-jg6nw"]
Jul 06 19:41:09.240062 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:41:09.240035    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-jg6nw"
Jul 06 19:41:09.281411 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:41:09.281377    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-jg6nw"]
Jul 06 19:41:09.283289 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:41:09.283265    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-rghgc"]
Jul 06 19:41:09.293930 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:41:09.293905    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-rghgc"]
Jul 06 19:41:09.294063 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:41:09.294023    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-rghgc"
Jul 06 19:41:09.297536 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:41:09.297514    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"limitador-operator-controller-manager-dockercfg-dqjpq\""
Jul 06 19:41:09.337801 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:41:09.337756    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xk2w2\" (UniqueName: \"kubernetes.io/projected/0a0acf9d-3030-4d9d-b6ac-d8bfa454b68f-kube-api-access-xk2w2\") pod \"limitador-operator-controller-manager-859d7b78bd-rghgc\" (UID: \"0a0acf9d-3030-4d9d-b6ac-d8bfa454b68f\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-rghgc"
Jul 06 19:41:09.337940 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:41:09.337833    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/9cc22277-173b-4113-ab29-519b5289a1af-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-jg6nw\" (UID: \"9cc22277-173b-4113-ab29-519b5289a1af\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-jg6nw"
Jul 06 19:41:09.337940 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:41:09.337863    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-s6pmc\" (UniqueName: \"kubernetes.io/projected/9cc22277-173b-4113-ab29-519b5289a1af-kube-api-access-s6pmc\") pod \"kuadrant-operator-controller-manager-8684c9ff49-jg6nw\" (UID: \"9cc22277-173b-4113-ab29-519b5289a1af\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-jg6nw"
Jul 06 19:41:09.438619 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:41:09.438534    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/9cc22277-173b-4113-ab29-519b5289a1af-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-jg6nw\" (UID: \"9cc22277-173b-4113-ab29-519b5289a1af\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-jg6nw"
Jul 06 19:41:09.438619 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:41:09.438572    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-s6pmc\" (UniqueName: \"kubernetes.io/projected/9cc22277-173b-4113-ab29-519b5289a1af-kube-api-access-s6pmc\") pod \"kuadrant-operator-controller-manager-8684c9ff49-jg6nw\" (UID: \"9cc22277-173b-4113-ab29-519b5289a1af\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-jg6nw"
Jul 06 19:41:09.438881 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:41:09.438626    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xk2w2\" (UniqueName: \"kubernetes.io/projected/0a0acf9d-3030-4d9d-b6ac-d8bfa454b68f-kube-api-access-xk2w2\") pod \"limitador-operator-controller-manager-859d7b78bd-rghgc\" (UID: \"0a0acf9d-3030-4d9d-b6ac-d8bfa454b68f\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-rghgc"
Jul 06 19:41:09.439002 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:41:09.438982    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/9cc22277-173b-4113-ab29-519b5289a1af-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-jg6nw\" (UID: \"9cc22277-173b-4113-ab29-519b5289a1af\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-jg6nw"
Jul 06 19:41:09.450492 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:41:09.450460    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xk2w2\" (UniqueName: \"kubernetes.io/projected/0a0acf9d-3030-4d9d-b6ac-d8bfa454b68f-kube-api-access-xk2w2\") pod \"limitador-operator-controller-manager-859d7b78bd-rghgc\" (UID: \"0a0acf9d-3030-4d9d-b6ac-d8bfa454b68f\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-rghgc"
Jul 06 19:41:09.451113 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:41:09.451090    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-s6pmc\" (UniqueName: \"kubernetes.io/projected/9cc22277-173b-4113-ab29-519b5289a1af-kube-api-access-s6pmc\") pod \"kuadrant-operator-controller-manager-8684c9ff49-jg6nw\" (UID: \"9cc22277-173b-4113-ab29-519b5289a1af\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-jg6nw"
Jul 06 19:41:09.549927 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:41:09.549901    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-jg6nw"
Jul 06 19:41:09.606178 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:41:09.605546    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-rghgc"
Jul 06 19:41:09.613244 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:41:09.612913    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-s4gng"
Jul 06 19:41:09.620461 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:41:09.620398    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-s4gng"
Jul 06 19:41:09.624386 ip-10-0-131-168 kubenswrapper[2565]: E0706 19:41:09.624362    2565 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-6fb7879bc9-s4gng\" is forbidden: User \"system:node:ip-10-0-131-168.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-131-168.ec2.internal' and this object" podUID="8ff60c01-a4a3-41a9-aa93-ba0edec9a6f2" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-s4gng"
Jul 06 19:41:09.693246 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:41:09.693221    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-jg6nw"]
Jul 06 19:41:09.695749 ip-10-0-131-168 kubenswrapper[2565]: W0706 19:41:09.695720    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9cc22277_173b_4113_ab29_519b5289a1af.slice/crio-4f01139790b8ebe72fc4871abb7426eee92ee518105bc568a68c37aebb0c0693 WatchSource:0}: Error finding container 4f01139790b8ebe72fc4871abb7426eee92ee518105bc568a68c37aebb0c0693: Status 404 returned error can't find the container with id 4f01139790b8ebe72fc4871abb7426eee92ee518105bc568a68c37aebb0c0693
Jul 06 19:41:09.740953 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:41:09.740916    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-55z9l\" (UniqueName: \"kubernetes.io/projected/8ff60c01-a4a3-41a9-aa93-ba0edec9a6f2-kube-api-access-55z9l\") pod \"8ff60c01-a4a3-41a9-aa93-ba0edec9a6f2\" (UID: \"8ff60c01-a4a3-41a9-aa93-ba0edec9a6f2\") "
Jul 06 19:41:09.740953 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:41:09.740951    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/8ff60c01-a4a3-41a9-aa93-ba0edec9a6f2-extensions-socket-volume\") pod \"8ff60c01-a4a3-41a9-aa93-ba0edec9a6f2\" (UID: \"8ff60c01-a4a3-41a9-aa93-ba0edec9a6f2\") "
Jul 06 19:41:09.741286 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:41:09.741263    2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8ff60c01-a4a3-41a9-aa93-ba0edec9a6f2-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "8ff60c01-a4a3-41a9-aa93-ba0edec9a6f2" (UID: "8ff60c01-a4a3-41a9-aa93-ba0edec9a6f2"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 19:41:09.743168 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:41:09.743141    2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8ff60c01-a4a3-41a9-aa93-ba0edec9a6f2-kube-api-access-55z9l" (OuterVolumeSpecName: "kube-api-access-55z9l") pod "8ff60c01-a4a3-41a9-aa93-ba0edec9a6f2" (UID: "8ff60c01-a4a3-41a9-aa93-ba0edec9a6f2"). InnerVolumeSpecName "kube-api-access-55z9l". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 06 19:41:09.755505 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:41:09.755485    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-rghgc"]
Jul 06 19:41:09.757946 ip-10-0-131-168 kubenswrapper[2565]: W0706 19:41:09.757901    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0a0acf9d_3030_4d9d_b6ac_d8bfa454b68f.slice/crio-15f947d24d9c5807d9c3e646d86b9c9bede677cce8d93493c25fd983d5fe3f02 WatchSource:0}: Error finding container 15f947d24d9c5807d9c3e646d86b9c9bede677cce8d93493c25fd983d5fe3f02: Status 404 returned error can't find the container with id 15f947d24d9c5807d9c3e646d86b9c9bede677cce8d93493c25fd983d5fe3f02
Jul 06 19:41:09.841664 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:41:09.841638    2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-55z9l\" (UniqueName: \"kubernetes.io/projected/8ff60c01-a4a3-41a9-aa93-ba0edec9a6f2-kube-api-access-55z9l\") on node \"ip-10-0-131-168.ec2.internal\" DevicePath \"\""
Jul 06 19:41:09.841664 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:41:09.841662    2565 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/8ff60c01-a4a3-41a9-aa93-ba0edec9a6f2-extensions-socket-volume\") on node \"ip-10-0-131-168.ec2.internal\" DevicePath \"\""
Jul 06 19:41:10.618832 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:41:10.618799    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-rghgc" event={"ID":"0a0acf9d-3030-4d9d-b6ac-d8bfa454b68f","Type":"ContainerStarted","Data":"15f947d24d9c5807d9c3e646d86b9c9bede677cce8d93493c25fd983d5fe3f02"}
Jul 06 19:41:10.620046 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:41:10.620024    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-jg6nw" event={"ID":"9cc22277-173b-4113-ab29-519b5289a1af","Type":"ContainerStarted","Data":"4f01139790b8ebe72fc4871abb7426eee92ee518105bc568a68c37aebb0c0693"}
Jul 06 19:41:10.620046 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:41:10.620045    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-s4gng"
Jul 06 19:41:10.623017 ip-10-0-131-168 kubenswrapper[2565]: E0706 19:41:10.622980    2565 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-6fb7879bc9-s4gng\" is forbidden: User \"system:node:ip-10-0-131-168.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-131-168.ec2.internal' and this object" podUID="8ff60c01-a4a3-41a9-aa93-ba0edec9a6f2" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-s4gng"
Jul 06 19:41:10.629235 ip-10-0-131-168 kubenswrapper[2565]: E0706 19:41:10.629209    2565 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-6fb7879bc9-s4gng\" is forbidden: User \"system:node:ip-10-0-131-168.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-131-168.ec2.internal' and this object" podUID="8ff60c01-a4a3-41a9-aa93-ba0edec9a6f2" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-s4gng"
Jul 06 19:41:11.497850 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:41:11.497812    2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="8ff60c01-a4a3-41a9-aa93-ba0edec9a6f2" path="/var/lib/kubelet/pods/8ff60c01-a4a3-41a9-aa93-ba0edec9a6f2/volumes"
Jul 06 19:41:12.632112 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:41:12.632077    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-rghgc" event={"ID":"0a0acf9d-3030-4d9d-b6ac-d8bfa454b68f","Type":"ContainerStarted","Data":"36c4da7bd85c8c0ac6292613d7c0420ea02a9c3ccc7e3858317f0f24e1ba441e"}
Jul 06 19:41:12.632572 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:41:12.632198    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-rghgc"
Jul 06 19:41:12.652082 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:41:12.652038    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-rghgc" podStartSLOduration=1.6106834939999999 podStartE2EDuration="3.652025194s" totalImagesPullingTime="2.0413417s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 19:41:09 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 19:41:12.65010625 +0000 UTC m=+507.663094918" watchObservedRunningTime="2026-07-06 19:41:12.652025194 +0000 UTC m=+507.665013863"
Jul 06 19:41:15.646328 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:41:15.646286    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-jg6nw" event={"ID":"9cc22277-173b-4113-ab29-519b5289a1af","Type":"ContainerStarted","Data":"4306c84929e176e56f15730f0da845e500724733ddfd10343b6f6f7d86e05c77"}
Jul 06 19:41:15.646731 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:41:15.646441    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-jg6nw"
Jul 06 19:41:23.638915 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:41:23.638886    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-rghgc"
Jul 06 19:41:26.182647 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:41:26.182590    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-jg6nw" podStartSLOduration=11.939309066 podStartE2EDuration="17.182568589s" totalImagesPullingTime="5.243259523s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 19:41:09 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 19:41:26.137173164 +0000 UTC m=+521.150161861" watchObservedRunningTime="2026-07-06 19:41:26.182568589 +0000 UTC m=+521.195557260"
Jul 06 19:41:26.217157 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:41:26.217124    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-jg6nw"]
Jul 06 19:41:26.217422 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:41:26.217376    2565 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-jg6nw" podUID="9cc22277-173b-4113-ab29-519b5289a1af" containerName="manager" containerID="cri-o://4306c84929e176e56f15730f0da845e500724733ddfd10343b6f6f7d86e05c77" gracePeriod=10
Jul 06 19:41:26.219168 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:41:26.219144    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-jg6nw"
Jul 06 19:41:26.481018 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:41:26.480994    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-jg6nw"
Jul 06 19:41:26.573447 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:41:26.573412    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-s6pmc\" (UniqueName: \"kubernetes.io/projected/9cc22277-173b-4113-ab29-519b5289a1af-kube-api-access-s6pmc\") pod \"9cc22277-173b-4113-ab29-519b5289a1af\" (UID: \"9cc22277-173b-4113-ab29-519b5289a1af\") "
Jul 06 19:41:26.573633 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:41:26.573461    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/9cc22277-173b-4113-ab29-519b5289a1af-extensions-socket-volume\") pod \"9cc22277-173b-4113-ab29-519b5289a1af\" (UID: \"9cc22277-173b-4113-ab29-519b5289a1af\") "
Jul 06 19:41:26.573981 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:41:26.573952    2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9cc22277-173b-4113-ab29-519b5289a1af-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "9cc22277-173b-4113-ab29-519b5289a1af" (UID: "9cc22277-173b-4113-ab29-519b5289a1af"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 19:41:26.575595 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:41:26.575575    2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9cc22277-173b-4113-ab29-519b5289a1af-kube-api-access-s6pmc" (OuterVolumeSpecName: "kube-api-access-s6pmc") pod "9cc22277-173b-4113-ab29-519b5289a1af" (UID: "9cc22277-173b-4113-ab29-519b5289a1af"). InnerVolumeSpecName "kube-api-access-s6pmc". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 06 19:41:26.674334 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:41:26.674303    2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-s6pmc\" (UniqueName: \"kubernetes.io/projected/9cc22277-173b-4113-ab29-519b5289a1af-kube-api-access-s6pmc\") on node \"ip-10-0-131-168.ec2.internal\" DevicePath \"\""
Jul 06 19:41:26.674334 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:41:26.674330    2565 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/9cc22277-173b-4113-ab29-519b5289a1af-extensions-socket-volume\") on node \"ip-10-0-131-168.ec2.internal\" DevicePath \"\""
Jul 06 19:41:26.692113 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:41:26.692079    2565 generic.go:356] "Generic (PLEG): container finished" podID="2c6bf875-f3cc-48a2-bfbe-4d2de4db7482" containerID="7f9117c4ff05542242dbfe9b850ce38726408b900372473caa9f932b4078c303" exitCode=1
Jul 06 19:41:26.692265 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:41:26.692156    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/odh-model-controller-7998c67dc4-spx2c" event={"ID":"2c6bf875-f3cc-48a2-bfbe-4d2de4db7482","Type":"ContainerDied","Data":"7f9117c4ff05542242dbfe9b850ce38726408b900372473caa9f932b4078c303"}
Jul 06 19:41:26.692517 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:41:26.692501    2565 scope.go:117] "RemoveContainer" containerID="7f9117c4ff05542242dbfe9b850ce38726408b900372473caa9f932b4078c303"
Jul 06 19:41:26.693705 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:41:26.693685    2565 generic.go:356] "Generic (PLEG): container finished" podID="9928c28e-6a6f-4a8a-9d7d-77e356aafc12" containerID="5b9c06ede741842a7a6242226c68e2bdbb454c1c6f0ad48b2b66ff576431af62" exitCode=1
Jul 06 19:41:26.693825 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:41:26.693759    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-2gpk4" event={"ID":"9928c28e-6a6f-4a8a-9d7d-77e356aafc12","Type":"ContainerDied","Data":"5b9c06ede741842a7a6242226c68e2bdbb454c1c6f0ad48b2b66ff576431af62"}
Jul 06 19:41:26.694081 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:41:26.694067    2565 scope.go:117] "RemoveContainer" containerID="5b9c06ede741842a7a6242226c68e2bdbb454c1c6f0ad48b2b66ff576431af62"
Jul 06 19:41:26.695040 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:41:26.695018    2565 generic.go:356] "Generic (PLEG): container finished" podID="9cc22277-173b-4113-ab29-519b5289a1af" containerID="4306c84929e176e56f15730f0da845e500724733ddfd10343b6f6f7d86e05c77" exitCode=0
Jul 06 19:41:26.695130 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:41:26.695052    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-jg6nw"
Jul 06 19:41:26.695130 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:41:26.695066    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-jg6nw" event={"ID":"9cc22277-173b-4113-ab29-519b5289a1af","Type":"ContainerDied","Data":"4306c84929e176e56f15730f0da845e500724733ddfd10343b6f6f7d86e05c77"}
Jul 06 19:41:26.695130 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:41:26.695103    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-jg6nw" event={"ID":"9cc22277-173b-4113-ab29-519b5289a1af","Type":"ContainerDied","Data":"4f01139790b8ebe72fc4871abb7426eee92ee518105bc568a68c37aebb0c0693"}
Jul 06 19:41:26.695130 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:41:26.695125    2565 scope.go:117] "RemoveContainer" containerID="4306c84929e176e56f15730f0da845e500724733ddfd10343b6f6f7d86e05c77"
Jul 06 19:41:26.703750 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:41:26.703735    2565 scope.go:117] "RemoveContainer" containerID="4306c84929e176e56f15730f0da845e500724733ddfd10343b6f6f7d86e05c77"
Jul 06 19:41:26.704044 ip-10-0-131-168 kubenswrapper[2565]: E0706 19:41:26.704026    2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4306c84929e176e56f15730f0da845e500724733ddfd10343b6f6f7d86e05c77\": container with ID starting with 4306c84929e176e56f15730f0da845e500724733ddfd10343b6f6f7d86e05c77 not found: ID does not exist" containerID="4306c84929e176e56f15730f0da845e500724733ddfd10343b6f6f7d86e05c77"
Jul 06 19:41:26.704090 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:41:26.704055    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4306c84929e176e56f15730f0da845e500724733ddfd10343b6f6f7d86e05c77"} err="failed to get container status \"4306c84929e176e56f15730f0da845e500724733ddfd10343b6f6f7d86e05c77\": rpc error: code = NotFound desc = could not find container \"4306c84929e176e56f15730f0da845e500724733ddfd10343b6f6f7d86e05c77\": container with ID starting with 4306c84929e176e56f15730f0da845e500724733ddfd10343b6f6f7d86e05c77 not found: ID does not exist"
Jul 06 19:41:27.702067 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:41:27.702039    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/odh-model-controller-7998c67dc4-spx2c" event={"ID":"2c6bf875-f3cc-48a2-bfbe-4d2de4db7482","Type":"ContainerStarted","Data":"fb4600ec0aa00b81e0ddf4b2f7153d5f185fe673289d454901c932d81216dd1f"}
Jul 06 19:41:27.702509 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:41:27.702258    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/odh-model-controller-7998c67dc4-spx2c"
Jul 06 19:41:27.703814 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:41:27.703793    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-2gpk4" event={"ID":"9928c28e-6a6f-4a8a-9d7d-77e356aafc12","Type":"ContainerStarted","Data":"3c22e58ead82ce3750b6816b041f83d1f636d0b431853a27597ca2c2608fabc9"}
Jul 06 19:41:27.703991 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:41:27.703976    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-2gpk4"
Jul 06 19:41:28.327673 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:41:28.327637    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-jg6nw"]
Jul 06 19:41:28.342848 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:41:28.342820    2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-jg6nw"]
Jul 06 19:41:29.494323 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:41:29.494290    2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="9cc22277-173b-4113-ab29-519b5289a1af" path="/var/lib/kubelet/pods/9cc22277-173b-4113-ab29-519b5289a1af/volumes"
Jul 06 19:41:38.711427 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:41:38.711356    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/odh-model-controller-7998c67dc4-spx2c"
Jul 06 19:41:58.711543 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:41:58.711510    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-2gpk4"
Jul 06 19:42:01.219883 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:42:01.219847    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-mfwbr"]
Jul 06 19:42:01.220269 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:42:01.220185    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9cc22277-173b-4113-ab29-519b5289a1af" containerName="manager"
Jul 06 19:42:01.220269 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:42:01.220197    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="9cc22277-173b-4113-ab29-519b5289a1af" containerName="manager"
Jul 06 19:42:01.220269 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:42:01.220259    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="9cc22277-173b-4113-ab29-519b5289a1af" containerName="manager"
Jul 06 19:42:01.224113 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:42:01.224097    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-54d6d988d5-mfwbr"
Jul 06 19:42:01.226731 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:42:01.226709    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"limitador-limits-config-limitador\""
Jul 06 19:42:01.226731 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:42:01.226726    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-7887x\""
Jul 06 19:42:01.236391 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:42:01.236371    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-mfwbr"]
Jul 06 19:42:01.274550 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:42:01.274520    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-mfwbr"]
Jul 06 19:42:01.375182 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:42:01.375153    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hz5t7\" (UniqueName: \"kubernetes.io/projected/3d988e98-ea11-4250-8a69-7b358dd48967-kube-api-access-hz5t7\") pod \"limitador-limitador-54d6d988d5-mfwbr\" (UID: \"3d988e98-ea11-4250-8a69-7b358dd48967\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-mfwbr"
Jul 06 19:42:01.375349 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:42:01.375306    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/3d988e98-ea11-4250-8a69-7b358dd48967-config-file\") pod \"limitador-limitador-54d6d988d5-mfwbr\" (UID: \"3d988e98-ea11-4250-8a69-7b358dd48967\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-mfwbr"
Jul 06 19:42:01.476366 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:42:01.476284    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/3d988e98-ea11-4250-8a69-7b358dd48967-config-file\") pod \"limitador-limitador-54d6d988d5-mfwbr\" (UID: \"3d988e98-ea11-4250-8a69-7b358dd48967\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-mfwbr"
Jul 06 19:42:01.476366 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:42:01.476326    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hz5t7\" (UniqueName: \"kubernetes.io/projected/3d988e98-ea11-4250-8a69-7b358dd48967-kube-api-access-hz5t7\") pod \"limitador-limitador-54d6d988d5-mfwbr\" (UID: \"3d988e98-ea11-4250-8a69-7b358dd48967\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-mfwbr"
Jul 06 19:42:01.477024 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:42:01.477007    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/3d988e98-ea11-4250-8a69-7b358dd48967-config-file\") pod \"limitador-limitador-54d6d988d5-mfwbr\" (UID: \"3d988e98-ea11-4250-8a69-7b358dd48967\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-mfwbr"
Jul 06 19:42:01.487300 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:42:01.487266    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hz5t7\" (UniqueName: \"kubernetes.io/projected/3d988e98-ea11-4250-8a69-7b358dd48967-kube-api-access-hz5t7\") pod \"limitador-limitador-54d6d988d5-mfwbr\" (UID: \"3d988e98-ea11-4250-8a69-7b358dd48967\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-mfwbr"
Jul 06 19:42:01.534252 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:42:01.534226    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-54d6d988d5-mfwbr"
Jul 06 19:42:01.666743 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:42:01.666592    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-mfwbr"]
Jul 06 19:42:01.669945 ip-10-0-131-168 kubenswrapper[2565]: W0706 19:42:01.669921    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3d988e98_ea11_4250_8a69_7b358dd48967.slice/crio-ba89f182e11d0f5b3c8b997f50b99dfb1d84389a38886efad04b76dd549da241 WatchSource:0}: Error finding container ba89f182e11d0f5b3c8b997f50b99dfb1d84389a38886efad04b76dd549da241: Status 404 returned error can't find the container with id ba89f182e11d0f5b3c8b997f50b99dfb1d84389a38886efad04b76dd549da241
Jul 06 19:42:01.859048 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:42:01.859019    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-54d6d988d5-mfwbr" event={"ID":"3d988e98-ea11-4250-8a69-7b358dd48967","Type":"ContainerStarted","Data":"ba89f182e11d0f5b3c8b997f50b99dfb1d84389a38886efad04b76dd549da241"}
Jul 06 19:42:04.874650 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:42:04.874614    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-54d6d988d5-mfwbr" event={"ID":"3d988e98-ea11-4250-8a69-7b358dd48967","Type":"ContainerStarted","Data":"5b3238b941be120b4c78f12bff6b78faeb7bffefc8b40344599617b8d96e2650"}
Jul 06 19:42:04.875142 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:42:04.874748    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-limitador-54d6d988d5-mfwbr"
Jul 06 19:42:04.902578 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:42:04.902527    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-limitador-54d6d988d5-mfwbr" podStartSLOduration=1.532296962 podStartE2EDuration="3.902510072s" totalImagesPullingTime="2.37021311s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 19:42:01 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 19:42:04.901983448 +0000 UTC m=+559.914972317" watchObservedRunningTime="2026-07-06 19:42:04.902510072 +0000 UTC m=+559.915498741"
Jul 06 19:42:15.880684 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:42:15.880649    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-limitador-54d6d988d5-mfwbr"
Jul 06 19:42:45.357658 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:42:45.357633    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-8kjqk_9f15114d-7494-4f17-8a4d-52185f7a2e35/ovn-acl-logging/0.log"
Jul 06 19:42:45.358383 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:42:45.358366    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-8kjqk_9f15114d-7494-4f17-8a4d-52185f7a2e35/ovn-acl-logging/0.log"
Jul 06 19:43:14.547795 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:43:14.547741    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-mfwbr"]
Jul 06 19:43:43.653962 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:43:43.653927    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-mfwbr"]
Jul 06 19:43:55.955825 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:43:55.955791    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-mfwbr"]
Jul 06 19:44:16.573043 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:44:16.572996    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-598466548d-hvklv"]
Jul 06 19:44:16.576765 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:44:16.576743    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-hvklv"
Jul 06 19:44:16.579994 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:44:16.579971    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\""
Jul 06 19:44:16.579994 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:44:16.579982    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-g78mn\""
Jul 06 19:44:16.581693 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:44:16.581671    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\""
Jul 06 19:44:16.581817 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:44:16.581720    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-trlp-test-simulated-kserve-self-signed-certs\""
Jul 06 19:44:16.639386 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:44:16.639357    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-598466548d-hvklv"]
Jul 06 19:44:16.644727 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:44:16.644699    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-g4r64\" (UniqueName: \"kubernetes.io/projected/06005080-4d62-431c-8c7e-bd8dd5f5008e-kube-api-access-g4r64\") pod \"e2e-trlp-test-simulated-kserve-598466548d-hvklv\" (UID: \"06005080-4d62-431c-8c7e-bd8dd5f5008e\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-hvklv"
Jul 06 19:44:16.644884 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:44:16.644759    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/06005080-4d62-431c-8c7e-bd8dd5f5008e-dshm\") pod \"e2e-trlp-test-simulated-kserve-598466548d-hvklv\" (UID: \"06005080-4d62-431c-8c7e-bd8dd5f5008e\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-hvklv"
Jul 06 19:44:16.644961 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:44:16.644881    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/06005080-4d62-431c-8c7e-bd8dd5f5008e-home\") pod \"e2e-trlp-test-simulated-kserve-598466548d-hvklv\" (UID: \"06005080-4d62-431c-8c7e-bd8dd5f5008e\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-hvklv"
Jul 06 19:44:16.644961 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:44:16.644933    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/06005080-4d62-431c-8c7e-bd8dd5f5008e-tmp-dir\") pod \"e2e-trlp-test-simulated-kserve-598466548d-hvklv\" (UID: \"06005080-4d62-431c-8c7e-bd8dd5f5008e\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-hvklv"
Jul 06 19:44:16.645141 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:44:16.644983    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/06005080-4d62-431c-8c7e-bd8dd5f5008e-model-cache\") pod \"e2e-trlp-test-simulated-kserve-598466548d-hvklv\" (UID: \"06005080-4d62-431c-8c7e-bd8dd5f5008e\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-hvklv"
Jul 06 19:44:16.645141 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:44:16.645031    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/06005080-4d62-431c-8c7e-bd8dd5f5008e-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-598466548d-hvklv\" (UID: \"06005080-4d62-431c-8c7e-bd8dd5f5008e\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-hvklv"
Jul 06 19:44:16.746300 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:44:16.746269    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/06005080-4d62-431c-8c7e-bd8dd5f5008e-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-598466548d-hvklv\" (UID: \"06005080-4d62-431c-8c7e-bd8dd5f5008e\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-hvklv"
Jul 06 19:44:16.746468 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:44:16.746310    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-g4r64\" (UniqueName: \"kubernetes.io/projected/06005080-4d62-431c-8c7e-bd8dd5f5008e-kube-api-access-g4r64\") pod \"e2e-trlp-test-simulated-kserve-598466548d-hvklv\" (UID: \"06005080-4d62-431c-8c7e-bd8dd5f5008e\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-hvklv"
Jul 06 19:44:16.746468 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:44:16.746348    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/06005080-4d62-431c-8c7e-bd8dd5f5008e-dshm\") pod \"e2e-trlp-test-simulated-kserve-598466548d-hvklv\" (UID: \"06005080-4d62-431c-8c7e-bd8dd5f5008e\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-hvklv"
Jul 06 19:44:16.746468 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:44:16.746374    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/06005080-4d62-431c-8c7e-bd8dd5f5008e-home\") pod \"e2e-trlp-test-simulated-kserve-598466548d-hvklv\" (UID: \"06005080-4d62-431c-8c7e-bd8dd5f5008e\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-hvklv"
Jul 06 19:44:16.746468 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:44:16.746396    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/06005080-4d62-431c-8c7e-bd8dd5f5008e-tmp-dir\") pod \"e2e-trlp-test-simulated-kserve-598466548d-hvklv\" (UID: \"06005080-4d62-431c-8c7e-bd8dd5f5008e\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-hvklv"
Jul 06 19:44:16.746468 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:44:16.746424    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/06005080-4d62-431c-8c7e-bd8dd5f5008e-model-cache\") pod \"e2e-trlp-test-simulated-kserve-598466548d-hvklv\" (UID: \"06005080-4d62-431c-8c7e-bd8dd5f5008e\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-hvklv"
Jul 06 19:44:16.746847 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:44:16.746827    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/06005080-4d62-431c-8c7e-bd8dd5f5008e-home\") pod \"e2e-trlp-test-simulated-kserve-598466548d-hvklv\" (UID: \"06005080-4d62-431c-8c7e-bd8dd5f5008e\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-hvklv"
Jul 06 19:44:16.746951 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:44:16.746891    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/06005080-4d62-431c-8c7e-bd8dd5f5008e-model-cache\") pod \"e2e-trlp-test-simulated-kserve-598466548d-hvklv\" (UID: \"06005080-4d62-431c-8c7e-bd8dd5f5008e\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-hvklv"
Jul 06 19:44:16.746951 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:44:16.746920    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/06005080-4d62-431c-8c7e-bd8dd5f5008e-tmp-dir\") pod \"e2e-trlp-test-simulated-kserve-598466548d-hvklv\" (UID: \"06005080-4d62-431c-8c7e-bd8dd5f5008e\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-hvklv"
Jul 06 19:44:16.748607 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:44:16.748585    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/06005080-4d62-431c-8c7e-bd8dd5f5008e-dshm\") pod \"e2e-trlp-test-simulated-kserve-598466548d-hvklv\" (UID: \"06005080-4d62-431c-8c7e-bd8dd5f5008e\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-hvklv"
Jul 06 19:44:16.748799 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:44:16.748765    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/06005080-4d62-431c-8c7e-bd8dd5f5008e-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-598466548d-hvklv\" (UID: \"06005080-4d62-431c-8c7e-bd8dd5f5008e\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-hvklv"
Jul 06 19:44:16.757591 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:44:16.757571    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-g4r64\" (UniqueName: \"kubernetes.io/projected/06005080-4d62-431c-8c7e-bd8dd5f5008e-kube-api-access-g4r64\") pod \"e2e-trlp-test-simulated-kserve-598466548d-hvklv\" (UID: \"06005080-4d62-431c-8c7e-bd8dd5f5008e\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-hvklv"
Jul 06 19:44:16.886678 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:44:16.886650    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-hvklv"
Jul 06 19:44:17.034276 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:44:17.034143    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-598466548d-hvklv"]
Jul 06 19:44:17.036508 ip-10-0-131-168 kubenswrapper[2565]: W0706 19:44:17.036482    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod06005080_4d62_431c_8c7e_bd8dd5f5008e.slice/crio-15d315acfd57b0c5441404a27967f91bc46f1ba24790404e38d99c0a69c61afb WatchSource:0}: Error finding container 15d315acfd57b0c5441404a27967f91bc46f1ba24790404e38d99c0a69c61afb: Status 404 returned error can't find the container with id 15d315acfd57b0c5441404a27967f91bc46f1ba24790404e38d99c0a69c61afb
Jul 06 19:44:17.037697 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:44:17.037681    2565 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 06 19:44:17.462070 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:44:17.462022    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-hvklv" event={"ID":"06005080-4d62-431c-8c7e-bd8dd5f5008e","Type":"ContainerStarted","Data":"15d315acfd57b0c5441404a27967f91bc46f1ba24790404e38d99c0a69c61afb"}
Jul 06 19:44:17.735444 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:44:17.735359    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-mfwbr"]
Jul 06 19:44:18.467563 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:44:18.467524    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-hvklv" event={"ID":"06005080-4d62-431c-8c7e-bd8dd5f5008e","Type":"ContainerStarted","Data":"3124b9db2ebd863de00b36c30cbcd43b19ab6d275b93131f3fc91c45f212f066"}
Jul 06 19:44:18.489692 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:44:18.489641    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-hvklv" podStartSLOduration=1.478205955 podStartE2EDuration="2.48962616s" totalImagesPullingTime="1.011420205s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 19:44:16 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 19:44:18.487644165 +0000 UTC m=+693.500632881" watchObservedRunningTime="2026-07-06 19:44:18.48962616 +0000 UTC m=+693.502614841"
Jul 06 19:44:22.229183 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:44:22.229141    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-mfwbr"]
Jul 06 19:44:26.887717 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:44:26.887682    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-hvklv"
Jul 06 19:44:26.888120 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:44:26.887742    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-hvklv"
Jul 06 19:44:26.899961 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:44:26.899939    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-hvklv"
Jul 06 19:44:27.516864 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:44:27.516836    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-hvklv"
Jul 06 19:44:28.516093 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:44:28.516064    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-mfwbr"]
Jul 06 19:44:33.423346 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:44:33.423305    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-mfwbr"]
Jul 06 19:46:13.149989 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:46:13.149908    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-mfwbr"]
Jul 06 19:46:24.228325 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:46:24.228290    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-mfwbr"]
Jul 06 19:46:33.918513 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:46:33.918469    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-mfwbr"]
Jul 06 19:46:45.025282 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:46:45.025239    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-mfwbr"]
Jul 06 19:46:55.338279 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:46:55.338244    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-mfwbr"]
Jul 06 19:47:24.426016 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:47:24.425982    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-mfwbr"]
Jul 06 19:47:34.351424 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:47:34.351392    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-mfwbr"]
Jul 06 19:47:45.383513 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:47:45.383441    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-8kjqk_9f15114d-7494-4f17-8a4d-52185f7a2e35/ovn-acl-logging/0.log"
Jul 06 19:47:45.384318 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:47:45.384301    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-8kjqk_9f15114d-7494-4f17-8a4d-52185f7a2e35/ovn-acl-logging/0.log"
Jul 06 19:48:09.624975 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:48:09.624934    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-mfwbr"]
Jul 06 19:48:19.520624 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:48:19.520591    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-mfwbr"]
Jul 06 19:48:27.918179 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:48:27.918134    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-mfwbr"]
Jul 06 19:48:38.119992 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:48:38.119942    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-mfwbr"]
Jul 06 19:48:46.529065 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:48:46.529030    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-mfwbr"]
Jul 06 19:48:58.042421 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:48:58.042388    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-mfwbr"]
Jul 06 19:49:08.521396 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:49:08.521318    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-mfwbr"]
Jul 06 19:49:15.622691 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:49:15.622656    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-mfwbr"]
Jul 06 19:49:23.027380 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:49:23.027344    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-mfwbr"]
Jul 06 19:49:31.919147 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:49:31.919116    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-mfwbr"]
Jul 06 19:49:44.710743 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:49:44.710703    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-mfwbr"]
Jul 06 19:49:54.716157 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:49:54.716126    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-mfwbr"]
Jul 06 19:50:18.730227 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:50:18.730192    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-mfwbr"]
Jul 06 19:50:30.516244 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:50:30.516211    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-mfwbr"]
Jul 06 19:50:51.592937 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:50:51.592859    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-dcfd47f7c-94s56"]
Jul 06 19:50:51.596369 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:50:51.596347    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-dcfd47f7c-94s56"
Jul 06 19:50:51.615923 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:50:51.615893    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-dcfd47f7c-94s56"]
Jul 06 19:50:51.645667 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:50:51.645628    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/120517cb-8a0f-44ff-a76a-a636805b1a8d-oauth-serving-cert\") pod \"console-dcfd47f7c-94s56\" (UID: \"120517cb-8a0f-44ff-a76a-a636805b1a8d\") " pod="openshift-console/console-dcfd47f7c-94s56"
Jul 06 19:50:51.645886 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:50:51.645675    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/120517cb-8a0f-44ff-a76a-a636805b1a8d-console-oauth-config\") pod \"console-dcfd47f7c-94s56\" (UID: \"120517cb-8a0f-44ff-a76a-a636805b1a8d\") " pod="openshift-console/console-dcfd47f7c-94s56"
Jul 06 19:50:51.645886 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:50:51.645703    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/120517cb-8a0f-44ff-a76a-a636805b1a8d-service-ca\") pod \"console-dcfd47f7c-94s56\" (UID: \"120517cb-8a0f-44ff-a76a-a636805b1a8d\") " pod="openshift-console/console-dcfd47f7c-94s56"
Jul 06 19:50:51.645886 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:50:51.645728    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-txp8j\" (UniqueName: \"kubernetes.io/projected/120517cb-8a0f-44ff-a76a-a636805b1a8d-kube-api-access-txp8j\") pod \"console-dcfd47f7c-94s56\" (UID: \"120517cb-8a0f-44ff-a76a-a636805b1a8d\") " pod="openshift-console/console-dcfd47f7c-94s56"
Jul 06 19:50:51.645886 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:50:51.645760    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/120517cb-8a0f-44ff-a76a-a636805b1a8d-trusted-ca-bundle\") pod \"console-dcfd47f7c-94s56\" (UID: \"120517cb-8a0f-44ff-a76a-a636805b1a8d\") " pod="openshift-console/console-dcfd47f7c-94s56"
Jul 06 19:50:51.645886 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:50:51.645820    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/120517cb-8a0f-44ff-a76a-a636805b1a8d-console-config\") pod \"console-dcfd47f7c-94s56\" (UID: \"120517cb-8a0f-44ff-a76a-a636805b1a8d\") " pod="openshift-console/console-dcfd47f7c-94s56"
Jul 06 19:50:51.646087 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:50:51.645894    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/120517cb-8a0f-44ff-a76a-a636805b1a8d-console-serving-cert\") pod \"console-dcfd47f7c-94s56\" (UID: \"120517cb-8a0f-44ff-a76a-a636805b1a8d\") " pod="openshift-console/console-dcfd47f7c-94s56"
Jul 06 19:50:51.746996 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:50:51.746959    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/120517cb-8a0f-44ff-a76a-a636805b1a8d-console-serving-cert\") pod \"console-dcfd47f7c-94s56\" (UID: \"120517cb-8a0f-44ff-a76a-a636805b1a8d\") " pod="openshift-console/console-dcfd47f7c-94s56"
Jul 06 19:50:51.747157 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:50:51.747002    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/120517cb-8a0f-44ff-a76a-a636805b1a8d-oauth-serving-cert\") pod \"console-dcfd47f7c-94s56\" (UID: \"120517cb-8a0f-44ff-a76a-a636805b1a8d\") " pod="openshift-console/console-dcfd47f7c-94s56"
Jul 06 19:50:51.747157 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:50:51.747032    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/120517cb-8a0f-44ff-a76a-a636805b1a8d-console-oauth-config\") pod \"console-dcfd47f7c-94s56\" (UID: \"120517cb-8a0f-44ff-a76a-a636805b1a8d\") " pod="openshift-console/console-dcfd47f7c-94s56"
Jul 06 19:50:51.747157 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:50:51.747064    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/120517cb-8a0f-44ff-a76a-a636805b1a8d-service-ca\") pod \"console-dcfd47f7c-94s56\" (UID: \"120517cb-8a0f-44ff-a76a-a636805b1a8d\") " pod="openshift-console/console-dcfd47f7c-94s56"
Jul 06 19:50:51.747157 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:50:51.747090    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-txp8j\" (UniqueName: \"kubernetes.io/projected/120517cb-8a0f-44ff-a76a-a636805b1a8d-kube-api-access-txp8j\") pod \"console-dcfd47f7c-94s56\" (UID: \"120517cb-8a0f-44ff-a76a-a636805b1a8d\") " pod="openshift-console/console-dcfd47f7c-94s56"
Jul 06 19:50:51.747157 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:50:51.747131    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/120517cb-8a0f-44ff-a76a-a636805b1a8d-trusted-ca-bundle\") pod \"console-dcfd47f7c-94s56\" (UID: \"120517cb-8a0f-44ff-a76a-a636805b1a8d\") " pod="openshift-console/console-dcfd47f7c-94s56"
Jul 06 19:50:51.747424 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:50:51.747165    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/120517cb-8a0f-44ff-a76a-a636805b1a8d-console-config\") pod \"console-dcfd47f7c-94s56\" (UID: \"120517cb-8a0f-44ff-a76a-a636805b1a8d\") " pod="openshift-console/console-dcfd47f7c-94s56"
Jul 06 19:50:51.747830 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:50:51.747802    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/120517cb-8a0f-44ff-a76a-a636805b1a8d-service-ca\") pod \"console-dcfd47f7c-94s56\" (UID: \"120517cb-8a0f-44ff-a76a-a636805b1a8d\") " pod="openshift-console/console-dcfd47f7c-94s56"
Jul 06 19:50:51.747961 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:50:51.747867    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/120517cb-8a0f-44ff-a76a-a636805b1a8d-oauth-serving-cert\") pod \"console-dcfd47f7c-94s56\" (UID: \"120517cb-8a0f-44ff-a76a-a636805b1a8d\") " pod="openshift-console/console-dcfd47f7c-94s56"
Jul 06 19:50:51.748031 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:50:51.747980    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/120517cb-8a0f-44ff-a76a-a636805b1a8d-console-config\") pod \"console-dcfd47f7c-94s56\" (UID: \"120517cb-8a0f-44ff-a76a-a636805b1a8d\") " pod="openshift-console/console-dcfd47f7c-94s56"
Jul 06 19:50:51.748031 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:50:51.748020    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/120517cb-8a0f-44ff-a76a-a636805b1a8d-trusted-ca-bundle\") pod \"console-dcfd47f7c-94s56\" (UID: \"120517cb-8a0f-44ff-a76a-a636805b1a8d\") " pod="openshift-console/console-dcfd47f7c-94s56"
Jul 06 19:50:51.749590 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:50:51.749564    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/120517cb-8a0f-44ff-a76a-a636805b1a8d-console-serving-cert\") pod \"console-dcfd47f7c-94s56\" (UID: \"120517cb-8a0f-44ff-a76a-a636805b1a8d\") " pod="openshift-console/console-dcfd47f7c-94s56"
Jul 06 19:50:51.749590 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:50:51.749579    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/120517cb-8a0f-44ff-a76a-a636805b1a8d-console-oauth-config\") pod \"console-dcfd47f7c-94s56\" (UID: \"120517cb-8a0f-44ff-a76a-a636805b1a8d\") " pod="openshift-console/console-dcfd47f7c-94s56"
Jul 06 19:50:51.757626 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:50:51.757601    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-txp8j\" (UniqueName: \"kubernetes.io/projected/120517cb-8a0f-44ff-a76a-a636805b1a8d-kube-api-access-txp8j\") pod \"console-dcfd47f7c-94s56\" (UID: \"120517cb-8a0f-44ff-a76a-a636805b1a8d\") " pod="openshift-console/console-dcfd47f7c-94s56"
Jul 06 19:50:51.905746 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:50:51.905716    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-dcfd47f7c-94s56"
Jul 06 19:50:52.045985 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:50:52.045959    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-dcfd47f7c-94s56"]
Jul 06 19:50:52.048426 ip-10-0-131-168 kubenswrapper[2565]: W0706 19:50:52.048399    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod120517cb_8a0f_44ff_a76a_a636805b1a8d.slice/crio-91a001a27ccc5b67f7636673cb85e16ac3028802efb1b13e18d4b28350f67a11 WatchSource:0}: Error finding container 91a001a27ccc5b67f7636673cb85e16ac3028802efb1b13e18d4b28350f67a11: Status 404 returned error can't find the container with id 91a001a27ccc5b67f7636673cb85e16ac3028802efb1b13e18d4b28350f67a11
Jul 06 19:50:52.176125 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:50:52.176045    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-dcfd47f7c-94s56" event={"ID":"120517cb-8a0f-44ff-a76a-a636805b1a8d","Type":"ContainerStarted","Data":"310c5d979b4c5083c83d9b5f21cafa2519c0e30c97eebbb1c604419f39307024"}
Jul 06 19:50:52.176125 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:50:52.176104    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-dcfd47f7c-94s56" event={"ID":"120517cb-8a0f-44ff-a76a-a636805b1a8d","Type":"ContainerStarted","Data":"91a001a27ccc5b67f7636673cb85e16ac3028802efb1b13e18d4b28350f67a11"}
Jul 06 19:50:52.202913 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:50:52.202864    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-dcfd47f7c-94s56" podStartSLOduration=1.202848419 podStartE2EDuration="1.202848419s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 19:50:51 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 19:50:52.201695429 +0000 UTC m=+1087.214684115" watchObservedRunningTime="2026-07-06 19:50:52.202848419 +0000 UTC m=+1087.215837149"
Jul 06 19:50:54.537180 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:50:54.537141    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-mfwbr"]
Jul 06 19:51:01.905949 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:51:01.905866    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-dcfd47f7c-94s56"
Jul 06 19:51:01.905949 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:51:01.905919    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-dcfd47f7c-94s56"
Jul 06 19:51:01.910886 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:51:01.910865    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-dcfd47f7c-94s56"
Jul 06 19:51:02.226866 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:51:02.226793    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-dcfd47f7c-94s56"
Jul 06 19:51:02.276717 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:51:02.276687    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-6cddd8b544-qqn86"]
Jul 06 19:51:03.228179 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:51:03.228148    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-mfwbr"]
Jul 06 19:51:14.240999 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:51:14.240962    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-mfwbr"]
Jul 06 19:51:23.126449 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:51:23.126409    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-mfwbr"]
Jul 06 19:51:27.304268 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:51:27.304212    2565 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-console/console-6cddd8b544-qqn86" podUID="7701b72b-f121-4bea-bcd7-01b8f192081f" containerName="console" containerID="cri-o://f1924ea6ee451ebbf6b4cf21c2219e16c0175daa8a9b43b75163937b5aad16d6" gracePeriod=15
Jul 06 19:51:27.560449 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:51:27.560390    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6cddd8b544-qqn86"
Jul 06 19:51:27.653927 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:51:27.653895    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/7701b72b-f121-4bea-bcd7-01b8f192081f-console-config\") pod \"7701b72b-f121-4bea-bcd7-01b8f192081f\" (UID: \"7701b72b-f121-4bea-bcd7-01b8f192081f\") "
Jul 06 19:51:27.653927 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:51:27.653937    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/7701b72b-f121-4bea-bcd7-01b8f192081f-service-ca\") pod \"7701b72b-f121-4bea-bcd7-01b8f192081f\" (UID: \"7701b72b-f121-4bea-bcd7-01b8f192081f\") "
Jul 06 19:51:27.654218 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:51:27.653968    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/7701b72b-f121-4bea-bcd7-01b8f192081f-console-oauth-config\") pod \"7701b72b-f121-4bea-bcd7-01b8f192081f\" (UID: \"7701b72b-f121-4bea-bcd7-01b8f192081f\") "
Jul 06 19:51:27.654218 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:51:27.653997    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-54l97\" (UniqueName: \"kubernetes.io/projected/7701b72b-f121-4bea-bcd7-01b8f192081f-kube-api-access-54l97\") pod \"7701b72b-f121-4bea-bcd7-01b8f192081f\" (UID: \"7701b72b-f121-4bea-bcd7-01b8f192081f\") "
Jul 06 19:51:27.654218 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:51:27.654055    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/7701b72b-f121-4bea-bcd7-01b8f192081f-console-serving-cert\") pod \"7701b72b-f121-4bea-bcd7-01b8f192081f\" (UID: \"7701b72b-f121-4bea-bcd7-01b8f192081f\") "
Jul 06 19:51:27.654218 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:51:27.654084    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/7701b72b-f121-4bea-bcd7-01b8f192081f-oauth-serving-cert\") pod \"7701b72b-f121-4bea-bcd7-01b8f192081f\" (UID: \"7701b72b-f121-4bea-bcd7-01b8f192081f\") "
Jul 06 19:51:27.654218 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:51:27.654135    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7701b72b-f121-4bea-bcd7-01b8f192081f-trusted-ca-bundle\") pod \"7701b72b-f121-4bea-bcd7-01b8f192081f\" (UID: \"7701b72b-f121-4bea-bcd7-01b8f192081f\") "
Jul 06 19:51:27.654458 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:51:27.654330    2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/7701b72b-f121-4bea-bcd7-01b8f192081f-console-config" (OuterVolumeSpecName: "console-config") pod "7701b72b-f121-4bea-bcd7-01b8f192081f" (UID: "7701b72b-f121-4bea-bcd7-01b8f192081f"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 06 19:51:27.654458 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:51:27.654353    2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/7701b72b-f121-4bea-bcd7-01b8f192081f-service-ca" (OuterVolumeSpecName: "service-ca") pod "7701b72b-f121-4bea-bcd7-01b8f192081f" (UID: "7701b72b-f121-4bea-bcd7-01b8f192081f"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 06 19:51:27.654629 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:51:27.654603    2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/7701b72b-f121-4bea-bcd7-01b8f192081f-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "7701b72b-f121-4bea-bcd7-01b8f192081f" (UID: "7701b72b-f121-4bea-bcd7-01b8f192081f"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 06 19:51:27.654689 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:51:27.654630    2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/7701b72b-f121-4bea-bcd7-01b8f192081f-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "7701b72b-f121-4bea-bcd7-01b8f192081f" (UID: "7701b72b-f121-4bea-bcd7-01b8f192081f"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 06 19:51:27.656319 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:51:27.656285    2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7701b72b-f121-4bea-bcd7-01b8f192081f-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "7701b72b-f121-4bea-bcd7-01b8f192081f" (UID: "7701b72b-f121-4bea-bcd7-01b8f192081f"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 06 19:51:27.656319 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:51:27.656302    2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7701b72b-f121-4bea-bcd7-01b8f192081f-kube-api-access-54l97" (OuterVolumeSpecName: "kube-api-access-54l97") pod "7701b72b-f121-4bea-bcd7-01b8f192081f" (UID: "7701b72b-f121-4bea-bcd7-01b8f192081f"). InnerVolumeSpecName "kube-api-access-54l97". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 06 19:51:27.656460 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:51:27.656356    2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7701b72b-f121-4bea-bcd7-01b8f192081f-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "7701b72b-f121-4bea-bcd7-01b8f192081f" (UID: "7701b72b-f121-4bea-bcd7-01b8f192081f"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 06 19:51:27.755032 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:51:27.754979    2565 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/7701b72b-f121-4bea-bcd7-01b8f192081f-console-config\") on node \"ip-10-0-131-168.ec2.internal\" DevicePath \"\""
Jul 06 19:51:27.755032 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:51:27.755023    2565 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/7701b72b-f121-4bea-bcd7-01b8f192081f-service-ca\") on node \"ip-10-0-131-168.ec2.internal\" DevicePath \"\""
Jul 06 19:51:27.755032 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:51:27.755032    2565 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/7701b72b-f121-4bea-bcd7-01b8f192081f-console-oauth-config\") on node \"ip-10-0-131-168.ec2.internal\" DevicePath \"\""
Jul 06 19:51:27.755032 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:51:27.755042    2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-54l97\" (UniqueName: \"kubernetes.io/projected/7701b72b-f121-4bea-bcd7-01b8f192081f-kube-api-access-54l97\") on node \"ip-10-0-131-168.ec2.internal\" DevicePath \"\""
Jul 06 19:51:27.755032 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:51:27.755052    2565 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/7701b72b-f121-4bea-bcd7-01b8f192081f-console-serving-cert\") on node \"ip-10-0-131-168.ec2.internal\" DevicePath \"\""
Jul 06 19:51:27.755336 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:51:27.755060    2565 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/7701b72b-f121-4bea-bcd7-01b8f192081f-oauth-serving-cert\") on node \"ip-10-0-131-168.ec2.internal\" DevicePath \"\""
Jul 06 19:51:27.755336 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:51:27.755068    2565 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7701b72b-f121-4bea-bcd7-01b8f192081f-trusted-ca-bundle\") on node \"ip-10-0-131-168.ec2.internal\" DevicePath \"\""
Jul 06 19:51:28.341730 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:51:28.341692    2565 generic.go:356] "Generic (PLEG): container finished" podID="7701b72b-f121-4bea-bcd7-01b8f192081f" containerID="f1924ea6ee451ebbf6b4cf21c2219e16c0175daa8a9b43b75163937b5aad16d6" exitCode=0
Jul 06 19:51:28.342224 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:51:28.341748    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6cddd8b544-qqn86"
Jul 06 19:51:28.342224 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:51:28.341799    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6cddd8b544-qqn86" event={"ID":"7701b72b-f121-4bea-bcd7-01b8f192081f","Type":"ContainerDied","Data":"f1924ea6ee451ebbf6b4cf21c2219e16c0175daa8a9b43b75163937b5aad16d6"}
Jul 06 19:51:28.342224 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:51:28.341851    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6cddd8b544-qqn86" event={"ID":"7701b72b-f121-4bea-bcd7-01b8f192081f","Type":"ContainerDied","Data":"92fd1426dd584de66efe790a9e11c8b0e31753694d5515144710e50330b55093"}
Jul 06 19:51:28.342224 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:51:28.341875    2565 scope.go:117] "RemoveContainer" containerID="f1924ea6ee451ebbf6b4cf21c2219e16c0175daa8a9b43b75163937b5aad16d6"
Jul 06 19:51:28.350666 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:51:28.350650    2565 scope.go:117] "RemoveContainer" containerID="f1924ea6ee451ebbf6b4cf21c2219e16c0175daa8a9b43b75163937b5aad16d6"
Jul 06 19:51:28.350919 ip-10-0-131-168 kubenswrapper[2565]: E0706 19:51:28.350898    2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f1924ea6ee451ebbf6b4cf21c2219e16c0175daa8a9b43b75163937b5aad16d6\": container with ID starting with f1924ea6ee451ebbf6b4cf21c2219e16c0175daa8a9b43b75163937b5aad16d6 not found: ID does not exist" containerID="f1924ea6ee451ebbf6b4cf21c2219e16c0175daa8a9b43b75163937b5aad16d6"
Jul 06 19:51:28.350986 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:51:28.350931    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f1924ea6ee451ebbf6b4cf21c2219e16c0175daa8a9b43b75163937b5aad16d6"} err="failed to get container status \"f1924ea6ee451ebbf6b4cf21c2219e16c0175daa8a9b43b75163937b5aad16d6\": rpc error: code = NotFound desc = could not find container \"f1924ea6ee451ebbf6b4cf21c2219e16c0175daa8a9b43b75163937b5aad16d6\": container with ID starting with f1924ea6ee451ebbf6b4cf21c2219e16c0175daa8a9b43b75163937b5aad16d6 not found: ID does not exist"
Jul 06 19:51:28.365081 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:51:28.365047    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-6cddd8b544-qqn86"]
Jul 06 19:51:28.368813 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:51:28.368761    2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-6cddd8b544-qqn86"]
Jul 06 19:51:29.495220 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:51:29.495189    2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="7701b72b-f121-4bea-bcd7-01b8f192081f" path="/var/lib/kubelet/pods/7701b72b-f121-4bea-bcd7-01b8f192081f/volumes"
Jul 06 19:51:31.723447 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:51:31.723415    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-mfwbr"]
Jul 06 19:52:45.408791 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:52:45.408748    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-8kjqk_9f15114d-7494-4f17-8a4d-52185f7a2e35/ovn-acl-logging/0.log"
Jul 06 19:52:45.409972 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:52:45.409954    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-8kjqk_9f15114d-7494-4f17-8a4d-52185f7a2e35/ovn-acl-logging/0.log"
Jul 06 19:53:20.028162 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:53:20.028117    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-mfwbr"]
Jul 06 19:53:29.018541 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:53:29.018502    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-mfwbr"]
Jul 06 19:53:41.514606 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:53:41.514516    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-mfwbr"]
Jul 06 19:53:53.749931 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:53:53.749896    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-mfwbr"]
Jul 06 19:54:04.718992 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:54:04.718960    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-mfwbr"]
Jul 06 19:54:15.918004 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:54:15.917964    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-mfwbr"]
Jul 06 19:54:25.932550 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:54:25.932515    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-mfwbr"]
Jul 06 19:54:36.512944 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:54:36.512908    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-mfwbr"]
Jul 06 19:54:47.522761 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:54:47.522732    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-mfwbr"]
Jul 06 19:54:56.715901 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:54:56.715865    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-mfwbr"]
Jul 06 19:55:07.330212 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:55:07.330134    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-mfwbr"]
Jul 06 19:55:31.421345 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:55:31.421309    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-mfwbr"]
Jul 06 19:55:38.420468 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:55:38.420433    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-mfwbr"]
Jul 06 19:55:48.018952 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:55:48.018909    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-mfwbr"]
Jul 06 19:55:58.618915 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:55:58.618873    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-mfwbr"]
Jul 06 19:56:06.015307 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:56:06.015275    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-mfwbr"]
Jul 06 19:56:17.115200 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:56:17.115167    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-mfwbr"]
Jul 06 19:56:25.922552 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:56:25.922513    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-mfwbr"]
Jul 06 19:56:34.714672 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:56:34.714638    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-mfwbr"]
Jul 06 19:56:45.019790 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:56:45.019699    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-mfwbr"]
Jul 06 19:56:53.824885 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:56:53.824843    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-mfwbr"]
Jul 06 19:57:02.913507 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:57:02.913471    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-mfwbr"]
Jul 06 19:57:14.918938 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:57:14.918902    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-mfwbr"]
Jul 06 19:57:25.723490 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:57:25.723457    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-mfwbr"]
Jul 06 19:57:34.716819 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:57:34.716781    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-mfwbr"]
Jul 06 19:57:45.433830 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:57:45.433793    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-8kjqk_9f15114d-7494-4f17-8a4d-52185f7a2e35/ovn-acl-logging/0.log"
Jul 06 19:57:45.435838 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:57:45.435817    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-8kjqk_9f15114d-7494-4f17-8a4d-52185f7a2e35/ovn-acl-logging/0.log"
Jul 06 19:57:46.410807 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:57:46.410760    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-mfwbr"]
Jul 06 19:57:58.019852 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:57:58.019814    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-mfwbr"]
Jul 06 19:58:05.621760 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:58:05.621719    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-mfwbr"]
Jul 06 19:58:17.816568 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:58:17.816520    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-mfwbr"]
Jul 06 19:58:29.517094 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:58:29.517061    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-mfwbr"]
Jul 06 19:58:38.035013 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:58:38.034978    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-mfwbr"]
Jul 06 19:58:51.942335 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:58:51.942295    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-mfwbr"]
Jul 06 19:59:00.424486 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:59:00.424439    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-mfwbr"]
Jul 06 19:59:09.431455 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:59:09.431420    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-mfwbr"]
Jul 06 19:59:47.232763 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:59:47.232722    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-mfwbr"]
Jul 06 19:59:59.437755 ip-10-0-131-168 kubenswrapper[2565]: I0706 19:59:59.437719    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-mfwbr"]
Jul 06 20:01:18.731857 ip-10-0-131-168 kubenswrapper[2565]: I0706 20:01:18.731761    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-mfwbr"]
Jul 06 20:01:26.220969 ip-10-0-131-168 kubenswrapper[2565]: I0706 20:01:26.220925    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-mfwbr"]
Jul 06 20:01:33.427601 ip-10-0-131-168 kubenswrapper[2565]: I0706 20:01:33.427563    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-mfwbr"]
Jul 06 20:01:42.761536 ip-10-0-131-168 kubenswrapper[2565]: I0706 20:01:42.761502    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-mfwbr"]
Jul 06 20:01:52.923462 ip-10-0-131-168 kubenswrapper[2565]: I0706 20:01:52.923427    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-mfwbr"]
Jul 06 20:02:24.822678 ip-10-0-131-168 kubenswrapper[2565]: I0706 20:02:24.822644    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-mfwbr"]
Jul 06 20:02:35.879864 ip-10-0-131-168 kubenswrapper[2565]: I0706 20:02:35.879834    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-mt-5439eb70/e2e-lifecycle-model-5439eb70-kserve-7dc8475ccf-k8cgg"]
Jul 06 20:02:35.880546 ip-10-0-131-168 kubenswrapper[2565]: I0706 20:02:35.880358    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7701b72b-f121-4bea-bcd7-01b8f192081f" containerName="console"
Jul 06 20:02:35.880546 ip-10-0-131-168 kubenswrapper[2565]: I0706 20:02:35.880378    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="7701b72b-f121-4bea-bcd7-01b8f192081f" containerName="console"
Jul 06 20:02:35.880546 ip-10-0-131-168 kubenswrapper[2565]: I0706 20:02:35.880463    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="7701b72b-f121-4bea-bcd7-01b8f192081f" containerName="console"
Jul 06 20:02:35.883200 ip-10-0-131-168 kubenswrapper[2565]: I0706 20:02:35.883180    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-mt-5439eb70/e2e-lifecycle-model-5439eb70-kserve-7dc8475ccf-k8cgg"
Jul 06 20:02:35.886169 ip-10-0-131-168 kubenswrapper[2565]: I0706 20:02:35.886145    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-mt-5439eb70\"/\"kube-root-ca.crt\""
Jul 06 20:02:35.887489 ip-10-0-131-168 kubenswrapper[2565]: I0706 20:02:35.887471    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-mt-5439eb70\"/\"e2e-lifecycle-model-5439eb70-kserve-self-signed-certs\""
Jul 06 20:02:35.887578 ip-10-0-131-168 kubenswrapper[2565]: I0706 20:02:35.887559    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-mt-5439eb70\"/\"openshift-service-ca.crt\""
Jul 06 20:02:35.887635 ip-10-0-131-168 kubenswrapper[2565]: I0706 20:02:35.887559    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-mt-5439eb70\"/\"default-dockercfg-fdx2q\""
Jul 06 20:02:35.897812 ip-10-0-131-168 kubenswrapper[2565]: I0706 20:02:35.897761    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-mt-5439eb70/e2e-lifecycle-model-5439eb70-kserve-7dc8475ccf-k8cgg"]
Jul 06 20:02:35.947397 ip-10-0-131-168 kubenswrapper[2565]: I0706 20:02:35.947350    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-z6psd\" (UniqueName: \"kubernetes.io/projected/f025ccd5-23a9-42a1-943a-73c007cc28da-kube-api-access-z6psd\") pod \"e2e-lifecycle-model-5439eb70-kserve-7dc8475ccf-k8cgg\" (UID: \"f025ccd5-23a9-42a1-943a-73c007cc28da\") " pod="ai-tenant-e2e-mt-5439eb70/e2e-lifecycle-model-5439eb70-kserve-7dc8475ccf-k8cgg"
Jul 06 20:02:35.947577 ip-10-0-131-168 kubenswrapper[2565]: I0706 20:02:35.947438    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/f025ccd5-23a9-42a1-943a-73c007cc28da-model-cache\") pod \"e2e-lifecycle-model-5439eb70-kserve-7dc8475ccf-k8cgg\" (UID: \"f025ccd5-23a9-42a1-943a-73c007cc28da\") " pod="ai-tenant-e2e-mt-5439eb70/e2e-lifecycle-model-5439eb70-kserve-7dc8475ccf-k8cgg"
Jul 06 20:02:35.947577 ip-10-0-131-168 kubenswrapper[2565]: I0706 20:02:35.947548    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/f025ccd5-23a9-42a1-943a-73c007cc28da-home\") pod \"e2e-lifecycle-model-5439eb70-kserve-7dc8475ccf-k8cgg\" (UID: \"f025ccd5-23a9-42a1-943a-73c007cc28da\") " pod="ai-tenant-e2e-mt-5439eb70/e2e-lifecycle-model-5439eb70-kserve-7dc8475ccf-k8cgg"
Jul 06 20:02:35.947577 ip-10-0-131-168 kubenswrapper[2565]: I0706 20:02:35.947574    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f025ccd5-23a9-42a1-943a-73c007cc28da-tls-certs\") pod \"e2e-lifecycle-model-5439eb70-kserve-7dc8475ccf-k8cgg\" (UID: \"f025ccd5-23a9-42a1-943a-73c007cc28da\") " pod="ai-tenant-e2e-mt-5439eb70/e2e-lifecycle-model-5439eb70-kserve-7dc8475ccf-k8cgg"
Jul 06 20:02:35.947715 ip-10-0-131-168 kubenswrapper[2565]: I0706 20:02:35.947647    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f025ccd5-23a9-42a1-943a-73c007cc28da-tmp-dir\") pod \"e2e-lifecycle-model-5439eb70-kserve-7dc8475ccf-k8cgg\" (UID: \"f025ccd5-23a9-42a1-943a-73c007cc28da\") " pod="ai-tenant-e2e-mt-5439eb70/e2e-lifecycle-model-5439eb70-kserve-7dc8475ccf-k8cgg"
Jul 06 20:02:35.947715 ip-10-0-131-168 kubenswrapper[2565]: I0706 20:02:35.947674    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/f025ccd5-23a9-42a1-943a-73c007cc28da-dshm\") pod \"e2e-lifecycle-model-5439eb70-kserve-7dc8475ccf-k8cgg\" (UID: \"f025ccd5-23a9-42a1-943a-73c007cc28da\") " pod="ai-tenant-e2e-mt-5439eb70/e2e-lifecycle-model-5439eb70-kserve-7dc8475ccf-k8cgg"
Jul 06 20:02:36.048111 ip-10-0-131-168 kubenswrapper[2565]: I0706 20:02:36.048067    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f025ccd5-23a9-42a1-943a-73c007cc28da-tmp-dir\") pod \"e2e-lifecycle-model-5439eb70-kserve-7dc8475ccf-k8cgg\" (UID: \"f025ccd5-23a9-42a1-943a-73c007cc28da\") " pod="ai-tenant-e2e-mt-5439eb70/e2e-lifecycle-model-5439eb70-kserve-7dc8475ccf-k8cgg"
Jul 06 20:02:36.048111 ip-10-0-131-168 kubenswrapper[2565]: I0706 20:02:36.048116    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/f025ccd5-23a9-42a1-943a-73c007cc28da-dshm\") pod \"e2e-lifecycle-model-5439eb70-kserve-7dc8475ccf-k8cgg\" (UID: \"f025ccd5-23a9-42a1-943a-73c007cc28da\") " pod="ai-tenant-e2e-mt-5439eb70/e2e-lifecycle-model-5439eb70-kserve-7dc8475ccf-k8cgg"
Jul 06 20:02:36.048111 ip-10-0-131-168 kubenswrapper[2565]: I0706 20:02:36.048136    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-z6psd\" (UniqueName: \"kubernetes.io/projected/f025ccd5-23a9-42a1-943a-73c007cc28da-kube-api-access-z6psd\") pod \"e2e-lifecycle-model-5439eb70-kserve-7dc8475ccf-k8cgg\" (UID: \"f025ccd5-23a9-42a1-943a-73c007cc28da\") " pod="ai-tenant-e2e-mt-5439eb70/e2e-lifecycle-model-5439eb70-kserve-7dc8475ccf-k8cgg"
Jul 06 20:02:36.048423 ip-10-0-131-168 kubenswrapper[2565]: I0706 20:02:36.048261    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/f025ccd5-23a9-42a1-943a-73c007cc28da-model-cache\") pod \"e2e-lifecycle-model-5439eb70-kserve-7dc8475ccf-k8cgg\" (UID: \"f025ccd5-23a9-42a1-943a-73c007cc28da\") " pod="ai-tenant-e2e-mt-5439eb70/e2e-lifecycle-model-5439eb70-kserve-7dc8475ccf-k8cgg"
Jul 06 20:02:36.048423 ip-10-0-131-168 kubenswrapper[2565]: I0706 20:02:36.048327    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/f025ccd5-23a9-42a1-943a-73c007cc28da-home\") pod \"e2e-lifecycle-model-5439eb70-kserve-7dc8475ccf-k8cgg\" (UID: \"f025ccd5-23a9-42a1-943a-73c007cc28da\") " pod="ai-tenant-e2e-mt-5439eb70/e2e-lifecycle-model-5439eb70-kserve-7dc8475ccf-k8cgg"
Jul 06 20:02:36.048423 ip-10-0-131-168 kubenswrapper[2565]: I0706 20:02:36.048352    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f025ccd5-23a9-42a1-943a-73c007cc28da-tls-certs\") pod \"e2e-lifecycle-model-5439eb70-kserve-7dc8475ccf-k8cgg\" (UID: \"f025ccd5-23a9-42a1-943a-73c007cc28da\") " pod="ai-tenant-e2e-mt-5439eb70/e2e-lifecycle-model-5439eb70-kserve-7dc8475ccf-k8cgg"
Jul 06 20:02:36.048567 ip-10-0-131-168 kubenswrapper[2565]: I0706 20:02:36.048442    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f025ccd5-23a9-42a1-943a-73c007cc28da-tmp-dir\") pod \"e2e-lifecycle-model-5439eb70-kserve-7dc8475ccf-k8cgg\" (UID: \"f025ccd5-23a9-42a1-943a-73c007cc28da\") " pod="ai-tenant-e2e-mt-5439eb70/e2e-lifecycle-model-5439eb70-kserve-7dc8475ccf-k8cgg"
Jul 06 20:02:36.048603 ip-10-0-131-168 kubenswrapper[2565]: I0706 20:02:36.048586    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/f025ccd5-23a9-42a1-943a-73c007cc28da-model-cache\") pod \"e2e-lifecycle-model-5439eb70-kserve-7dc8475ccf-k8cgg\" (UID: \"f025ccd5-23a9-42a1-943a-73c007cc28da\") " pod="ai-tenant-e2e-mt-5439eb70/e2e-lifecycle-model-5439eb70-kserve-7dc8475ccf-k8cgg"
Jul 06 20:02:36.048699 ip-10-0-131-168 kubenswrapper[2565]: I0706 20:02:36.048678    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/f025ccd5-23a9-42a1-943a-73c007cc28da-home\") pod \"e2e-lifecycle-model-5439eb70-kserve-7dc8475ccf-k8cgg\" (UID: \"f025ccd5-23a9-42a1-943a-73c007cc28da\") " pod="ai-tenant-e2e-mt-5439eb70/e2e-lifecycle-model-5439eb70-kserve-7dc8475ccf-k8cgg"
Jul 06 20:02:36.050349 ip-10-0-131-168 kubenswrapper[2565]: I0706 20:02:36.050319    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/f025ccd5-23a9-42a1-943a-73c007cc28da-dshm\") pod \"e2e-lifecycle-model-5439eb70-kserve-7dc8475ccf-k8cgg\" (UID: \"f025ccd5-23a9-42a1-943a-73c007cc28da\") " pod="ai-tenant-e2e-mt-5439eb70/e2e-lifecycle-model-5439eb70-kserve-7dc8475ccf-k8cgg"
Jul 06 20:02:36.050617 ip-10-0-131-168 kubenswrapper[2565]: I0706 20:02:36.050602    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f025ccd5-23a9-42a1-943a-73c007cc28da-tls-certs\") pod \"e2e-lifecycle-model-5439eb70-kserve-7dc8475ccf-k8cgg\" (UID: \"f025ccd5-23a9-42a1-943a-73c007cc28da\") " pod="ai-tenant-e2e-mt-5439eb70/e2e-lifecycle-model-5439eb70-kserve-7dc8475ccf-k8cgg"
Jul 06 20:02:36.063681 ip-10-0-131-168 kubenswrapper[2565]: I0706 20:02:36.063647    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-z6psd\" (UniqueName: \"kubernetes.io/projected/f025ccd5-23a9-42a1-943a-73c007cc28da-kube-api-access-z6psd\") pod \"e2e-lifecycle-model-5439eb70-kserve-7dc8475ccf-k8cgg\" (UID: \"f025ccd5-23a9-42a1-943a-73c007cc28da\") " pod="ai-tenant-e2e-mt-5439eb70/e2e-lifecycle-model-5439eb70-kserve-7dc8475ccf-k8cgg"
Jul 06 20:02:36.193312 ip-10-0-131-168 kubenswrapper[2565]: I0706 20:02:36.193214    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-mt-5439eb70/e2e-lifecycle-model-5439eb70-kserve-7dc8475ccf-k8cgg"
Jul 06 20:02:36.329102 ip-10-0-131-168 kubenswrapper[2565]: I0706 20:02:36.329020    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-mt-5439eb70/e2e-lifecycle-model-5439eb70-kserve-7dc8475ccf-k8cgg"]
Jul 06 20:02:36.331306 ip-10-0-131-168 kubenswrapper[2565]: W0706 20:02:36.331282    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podf025ccd5_23a9_42a1_943a_73c007cc28da.slice/crio-dd41254bbb8dbb6143f83988efab9ce6298eada2786eaa1e07d30115170a016c WatchSource:0}: Error finding container dd41254bbb8dbb6143f83988efab9ce6298eada2786eaa1e07d30115170a016c: Status 404 returned error can't find the container with id dd41254bbb8dbb6143f83988efab9ce6298eada2786eaa1e07d30115170a016c
Jul 06 20:02:37.281026 ip-10-0-131-168 kubenswrapper[2565]: I0706 20:02:37.280942    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-mt-5439eb70/e2e-lifecycle-model-5439eb70-kserve-7dc8475ccf-k8cgg" event={"ID":"f025ccd5-23a9-42a1-943a-73c007cc28da","Type":"ContainerStarted","Data":"b8dfe2a23e34c2c594bfd16dcd9e1c17d2ddee72939214d63c1e438a4a894a82"}
Jul 06 20:02:37.281026 ip-10-0-131-168 kubenswrapper[2565]: I0706 20:02:37.280988    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-mt-5439eb70/e2e-lifecycle-model-5439eb70-kserve-7dc8475ccf-k8cgg" event={"ID":"f025ccd5-23a9-42a1-943a-73c007cc28da","Type":"ContainerStarted","Data":"dd41254bbb8dbb6143f83988efab9ce6298eada2786eaa1e07d30115170a016c"}
Jul 06 20:02:37.301103 ip-10-0-131-168 kubenswrapper[2565]: I0706 20:02:37.300907    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-mt-5439eb70/e2e-lifecycle-model-5439eb70-kserve-7dc8475ccf-k8cgg" podStartSLOduration=2.300889201 podStartE2EDuration="2.300889201s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 20:02:35 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 20:02:37.300353587 +0000 UTC m=+1792.313342277" watchObservedRunningTime="2026-07-06 20:02:37.300889201 +0000 UTC m=+1792.313877871"
Jul 06 20:02:39.624832 ip-10-0-131-168 kubenswrapper[2565]: I0706 20:02:39.624799    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-mfwbr"]
Jul 06 20:02:45.459492 ip-10-0-131-168 kubenswrapper[2565]: I0706 20:02:45.459465    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-8kjqk_9f15114d-7494-4f17-8a4d-52185f7a2e35/ovn-acl-logging/0.log"
Jul 06 20:02:45.462845 ip-10-0-131-168 kubenswrapper[2565]: I0706 20:02:45.462824    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-8kjqk_9f15114d-7494-4f17-8a4d-52185f7a2e35/ovn-acl-logging/0.log"
Jul 06 20:02:46.194085 ip-10-0-131-168 kubenswrapper[2565]: I0706 20:02:46.194049    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-mt-5439eb70/e2e-lifecycle-model-5439eb70-kserve-7dc8475ccf-k8cgg"
Jul 06 20:02:46.194085 ip-10-0-131-168 kubenswrapper[2565]: I0706 20:02:46.194097    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-mt-5439eb70/e2e-lifecycle-model-5439eb70-kserve-7dc8475ccf-k8cgg"
Jul 06 20:02:46.206681 ip-10-0-131-168 kubenswrapper[2565]: I0706 20:02:46.206654    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-mt-5439eb70/e2e-lifecycle-model-5439eb70-kserve-7dc8475ccf-k8cgg"
Jul 06 20:02:46.331408 ip-10-0-131-168 kubenswrapper[2565]: I0706 20:02:46.331379    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-mt-5439eb70/e2e-lifecycle-model-5439eb70-kserve-7dc8475ccf-k8cgg"
Jul 06 20:03:01.046506 ip-10-0-131-168 kubenswrapper[2565]: I0706 20:03:01.046466    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-mfwbr"]
Jul 06 20:03:12.776232 ip-10-0-131-168 kubenswrapper[2565]: I0706 20:03:12.776204    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-mt-5439eb70/e2e-lifecycle-model-5439eb70-kserve-7dc8475ccf-k8cgg"]
Jul 06 20:03:12.926405 ip-10-0-131-168 kubenswrapper[2565]: I0706 20:03:12.926367    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-mfwbr"]
Jul 06 20:03:27.795678 ip-10-0-131-168 kubenswrapper[2565]: I0706 20:03:27.795631    2565 kuberuntime_container.go:872] "Killing container with a grace period" pod="ai-tenant-e2e-mt-5439eb70/e2e-lifecycle-model-5439eb70-kserve-7dc8475ccf-k8cgg" podUID="f025ccd5-23a9-42a1-943a-73c007cc28da" containerName="main" containerID="cri-o://b8dfe2a23e34c2c594bfd16dcd9e1c17d2ddee72939214d63c1e438a4a894a82" gracePeriod=45
Jul 06 20:03:28.032335 ip-10-0-131-168 kubenswrapper[2565]: I0706 20:03:28.032314    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-mt-5439eb70/e2e-lifecycle-model-5439eb70-kserve-7dc8475ccf-k8cgg"
Jul 06 20:03:28.103312 ip-10-0-131-168 kubenswrapper[2565]: I0706 20:03:28.103231    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f025ccd5-23a9-42a1-943a-73c007cc28da-tmp-dir\") pod \"f025ccd5-23a9-42a1-943a-73c007cc28da\" (UID: \"f025ccd5-23a9-42a1-943a-73c007cc28da\") "
Jul 06 20:03:28.103312 ip-10-0-131-168 kubenswrapper[2565]: I0706 20:03:28.103275    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/f025ccd5-23a9-42a1-943a-73c007cc28da-home\") pod \"f025ccd5-23a9-42a1-943a-73c007cc28da\" (UID: \"f025ccd5-23a9-42a1-943a-73c007cc28da\") "
Jul 06 20:03:28.103312 ip-10-0-131-168 kubenswrapper[2565]: I0706 20:03:28.103301    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f025ccd5-23a9-42a1-943a-73c007cc28da-tls-certs\") pod \"f025ccd5-23a9-42a1-943a-73c007cc28da\" (UID: \"f025ccd5-23a9-42a1-943a-73c007cc28da\") "
Jul 06 20:03:28.103571 ip-10-0-131-168 kubenswrapper[2565]: I0706 20:03:28.103355    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-z6psd\" (UniqueName: \"kubernetes.io/projected/f025ccd5-23a9-42a1-943a-73c007cc28da-kube-api-access-z6psd\") pod \"f025ccd5-23a9-42a1-943a-73c007cc28da\" (UID: \"f025ccd5-23a9-42a1-943a-73c007cc28da\") "
Jul 06 20:03:28.103571 ip-10-0-131-168 kubenswrapper[2565]: I0706 20:03:28.103379    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/f025ccd5-23a9-42a1-943a-73c007cc28da-dshm\") pod \"f025ccd5-23a9-42a1-943a-73c007cc28da\" (UID: \"f025ccd5-23a9-42a1-943a-73c007cc28da\") "
Jul 06 20:03:28.103571 ip-10-0-131-168 kubenswrapper[2565]: I0706 20:03:28.103447    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/f025ccd5-23a9-42a1-943a-73c007cc28da-model-cache\") pod \"f025ccd5-23a9-42a1-943a-73c007cc28da\" (UID: \"f025ccd5-23a9-42a1-943a-73c007cc28da\") "
Jul 06 20:03:28.103571 ip-10-0-131-168 kubenswrapper[2565]: I0706 20:03:28.103516    2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f025ccd5-23a9-42a1-943a-73c007cc28da-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "f025ccd5-23a9-42a1-943a-73c007cc28da" (UID: "f025ccd5-23a9-42a1-943a-73c007cc28da"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 20:03:28.103571 ip-10-0-131-168 kubenswrapper[2565]: I0706 20:03:28.103535    2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f025ccd5-23a9-42a1-943a-73c007cc28da-home" (OuterVolumeSpecName: "home") pod "f025ccd5-23a9-42a1-943a-73c007cc28da" (UID: "f025ccd5-23a9-42a1-943a-73c007cc28da"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 20:03:28.103857 ip-10-0-131-168 kubenswrapper[2565]: I0706 20:03:28.103722    2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f025ccd5-23a9-42a1-943a-73c007cc28da-model-cache" (OuterVolumeSpecName: "model-cache") pod "f025ccd5-23a9-42a1-943a-73c007cc28da" (UID: "f025ccd5-23a9-42a1-943a-73c007cc28da"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 20:03:28.103857 ip-10-0-131-168 kubenswrapper[2565]: I0706 20:03:28.103756    2565 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f025ccd5-23a9-42a1-943a-73c007cc28da-tmp-dir\") on node \"ip-10-0-131-168.ec2.internal\" DevicePath \"\""
Jul 06 20:03:28.103857 ip-10-0-131-168 kubenswrapper[2565]: I0706 20:03:28.103790    2565 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/f025ccd5-23a9-42a1-943a-73c007cc28da-home\") on node \"ip-10-0-131-168.ec2.internal\" DevicePath \"\""
Jul 06 20:03:28.105476 ip-10-0-131-168 kubenswrapper[2565]: I0706 20:03:28.105452    2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f025ccd5-23a9-42a1-943a-73c007cc28da-kube-api-access-z6psd" (OuterVolumeSpecName: "kube-api-access-z6psd") pod "f025ccd5-23a9-42a1-943a-73c007cc28da" (UID: "f025ccd5-23a9-42a1-943a-73c007cc28da"). InnerVolumeSpecName "kube-api-access-z6psd". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 06 20:03:28.105567 ip-10-0-131-168 kubenswrapper[2565]: I0706 20:03:28.105478    2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f025ccd5-23a9-42a1-943a-73c007cc28da-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "f025ccd5-23a9-42a1-943a-73c007cc28da" (UID: "f025ccd5-23a9-42a1-943a-73c007cc28da"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 06 20:03:28.105567 ip-10-0-131-168 kubenswrapper[2565]: I0706 20:03:28.105522    2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f025ccd5-23a9-42a1-943a-73c007cc28da-dshm" (OuterVolumeSpecName: "dshm") pod "f025ccd5-23a9-42a1-943a-73c007cc28da" (UID: "f025ccd5-23a9-42a1-943a-73c007cc28da"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 20:03:28.204432 ip-10-0-131-168 kubenswrapper[2565]: I0706 20:03:28.204404    2565 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f025ccd5-23a9-42a1-943a-73c007cc28da-tls-certs\") on node \"ip-10-0-131-168.ec2.internal\" DevicePath \"\""
Jul 06 20:03:28.204432 ip-10-0-131-168 kubenswrapper[2565]: I0706 20:03:28.204430    2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-z6psd\" (UniqueName: \"kubernetes.io/projected/f025ccd5-23a9-42a1-943a-73c007cc28da-kube-api-access-z6psd\") on node \"ip-10-0-131-168.ec2.internal\" DevicePath \"\""
Jul 06 20:03:28.204432 ip-10-0-131-168 kubenswrapper[2565]: I0706 20:03:28.204440    2565 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/f025ccd5-23a9-42a1-943a-73c007cc28da-dshm\") on node \"ip-10-0-131-168.ec2.internal\" DevicePath \"\""
Jul 06 20:03:28.204658 ip-10-0-131-168 kubenswrapper[2565]: I0706 20:03:28.204448    2565 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/f025ccd5-23a9-42a1-943a-73c007cc28da-model-cache\") on node \"ip-10-0-131-168.ec2.internal\" DevicePath \"\""
Jul 06 20:03:28.514215 ip-10-0-131-168 kubenswrapper[2565]: I0706 20:03:28.514180    2565 generic.go:356] "Generic (PLEG): container finished" podID="f025ccd5-23a9-42a1-943a-73c007cc28da" containerID="b8dfe2a23e34c2c594bfd16dcd9e1c17d2ddee72939214d63c1e438a4a894a82" exitCode=0
Jul 06 20:03:28.514215 ip-10-0-131-168 kubenswrapper[2565]: I0706 20:03:28.514214    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-mt-5439eb70/e2e-lifecycle-model-5439eb70-kserve-7dc8475ccf-k8cgg"
Jul 06 20:03:28.514472 ip-10-0-131-168 kubenswrapper[2565]: I0706 20:03:28.514263    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-mt-5439eb70/e2e-lifecycle-model-5439eb70-kserve-7dc8475ccf-k8cgg" event={"ID":"f025ccd5-23a9-42a1-943a-73c007cc28da","Type":"ContainerDied","Data":"b8dfe2a23e34c2c594bfd16dcd9e1c17d2ddee72939214d63c1e438a4a894a82"}
Jul 06 20:03:28.514472 ip-10-0-131-168 kubenswrapper[2565]: I0706 20:03:28.514297    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-mt-5439eb70/e2e-lifecycle-model-5439eb70-kserve-7dc8475ccf-k8cgg" event={"ID":"f025ccd5-23a9-42a1-943a-73c007cc28da","Type":"ContainerDied","Data":"dd41254bbb8dbb6143f83988efab9ce6298eada2786eaa1e07d30115170a016c"}
Jul 06 20:03:28.514472 ip-10-0-131-168 kubenswrapper[2565]: I0706 20:03:28.514313    2565 scope.go:117] "RemoveContainer" containerID="b8dfe2a23e34c2c594bfd16dcd9e1c17d2ddee72939214d63c1e438a4a894a82"
Jul 06 20:03:28.523542 ip-10-0-131-168 kubenswrapper[2565]: I0706 20:03:28.523524    2565 scope.go:117] "RemoveContainer" containerID="b8dfe2a23e34c2c594bfd16dcd9e1c17d2ddee72939214d63c1e438a4a894a82"
Jul 06 20:03:28.523829 ip-10-0-131-168 kubenswrapper[2565]: E0706 20:03:28.523803    2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b8dfe2a23e34c2c594bfd16dcd9e1c17d2ddee72939214d63c1e438a4a894a82\": container with ID starting with b8dfe2a23e34c2c594bfd16dcd9e1c17d2ddee72939214d63c1e438a4a894a82 not found: ID does not exist" containerID="b8dfe2a23e34c2c594bfd16dcd9e1c17d2ddee72939214d63c1e438a4a894a82"
Jul 06 20:03:28.523929 ip-10-0-131-168 kubenswrapper[2565]: I0706 20:03:28.523834    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b8dfe2a23e34c2c594bfd16dcd9e1c17d2ddee72939214d63c1e438a4a894a82"} err="failed to get container status \"b8dfe2a23e34c2c594bfd16dcd9e1c17d2ddee72939214d63c1e438a4a894a82\": rpc error: code = NotFound desc = could not find container \"b8dfe2a23e34c2c594bfd16dcd9e1c17d2ddee72939214d63c1e438a4a894a82\": container with ID starting with b8dfe2a23e34c2c594bfd16dcd9e1c17d2ddee72939214d63c1e438a4a894a82 not found: ID does not exist"
Jul 06 20:03:28.538363 ip-10-0-131-168 kubenswrapper[2565]: I0706 20:03:28.538342    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-mt-5439eb70/e2e-lifecycle-model-5439eb70-kserve-7dc8475ccf-k8cgg"]
Jul 06 20:03:28.542561 ip-10-0-131-168 kubenswrapper[2565]: I0706 20:03:28.542543    2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-mt-5439eb70/e2e-lifecycle-model-5439eb70-kserve-7dc8475ccf-k8cgg"]
Jul 06 20:03:29.494862 ip-10-0-131-168 kubenswrapper[2565]: I0706 20:03:29.494828    2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f025ccd5-23a9-42a1-943a-73c007cc28da" path="/var/lib/kubelet/pods/f025ccd5-23a9-42a1-943a-73c007cc28da/volumes"
Jul 06 20:03:52.227966 ip-10-0-131-168 kubenswrapper[2565]: I0706 20:03:52.227932    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-mfwbr"]
Jul 06 20:04:01.232833 ip-10-0-131-168 kubenswrapper[2565]: I0706 20:04:01.232788    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-mfwbr"]
Jul 06 20:04:13.727090 ip-10-0-131-168 kubenswrapper[2565]: I0706 20:04:13.727015    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-mfwbr"]
Jul 06 20:05:03.340297 ip-10-0-131-168 kubenswrapper[2565]: I0706 20:05:03.340262    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-mfwbr"]
Jul 06 20:05:17.033853 ip-10-0-131-168 kubenswrapper[2565]: I0706 20:05:17.033817    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-mfwbr"]
Jul 06 20:05:18.682129 ip-10-0-131-168 kubenswrapper[2565]: I0706 20:05:18.682091    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-inf-a-d14fdd/test-model-d14fdd-kserve-5467d9d4c-x6hfh"]
Jul 06 20:05:18.682488 ip-10-0-131-168 kubenswrapper[2565]: I0706 20:05:18.682412    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f025ccd5-23a9-42a1-943a-73c007cc28da" containerName="main"
Jul 06 20:05:18.682488 ip-10-0-131-168 kubenswrapper[2565]: I0706 20:05:18.682423    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="f025ccd5-23a9-42a1-943a-73c007cc28da" containerName="main"
Jul 06 20:05:18.682558 ip-10-0-131-168 kubenswrapper[2565]: I0706 20:05:18.682493    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="f025ccd5-23a9-42a1-943a-73c007cc28da" containerName="main"
Jul 06 20:05:18.685426 ip-10-0-131-168 kubenswrapper[2565]: I0706 20:05:18.685407    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-a-d14fdd/test-model-d14fdd-kserve-5467d9d4c-x6hfh"
Jul 06 20:05:18.688295 ip-10-0-131-168 kubenswrapper[2565]: I0706 20:05:18.688276    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-inf-a-d14fdd\"/\"openshift-service-ca.crt\""
Jul 06 20:05:18.688422 ip-10-0-131-168 kubenswrapper[2565]: I0706 20:05:18.688276    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-inf-a-d14fdd\"/\"kube-root-ca.crt\""
Jul 06 20:05:18.689557 ip-10-0-131-168 kubenswrapper[2565]: I0706 20:05:18.689535    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-inf-a-d14fdd\"/\"test-model-d14fdd-kserve-self-signed-certs\""
Jul 06 20:05:18.689658 ip-10-0-131-168 kubenswrapper[2565]: I0706 20:05:18.689556    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-inf-a-d14fdd\"/\"default-dockercfg-skqvl\""
Jul 06 20:05:18.702248 ip-10-0-131-168 kubenswrapper[2565]: I0706 20:05:18.702226    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-inf-a-d14fdd/test-model-d14fdd-kserve-5467d9d4c-x6hfh"]
Jul 06 20:05:18.746646 ip-10-0-131-168 kubenswrapper[2565]: I0706 20:05:18.746615    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/afc3a51a-ebc0-4b61-87d7-b6404234d3e4-dshm\") pod \"test-model-d14fdd-kserve-5467d9d4c-x6hfh\" (UID: \"afc3a51a-ebc0-4b61-87d7-b6404234d3e4\") " pod="ai-tenant-e2e-inf-a-d14fdd/test-model-d14fdd-kserve-5467d9d4c-x6hfh"
Jul 06 20:05:18.746843 ip-10-0-131-168 kubenswrapper[2565]: I0706 20:05:18.746672    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/afc3a51a-ebc0-4b61-87d7-b6404234d3e4-home\") pod \"test-model-d14fdd-kserve-5467d9d4c-x6hfh\" (UID: \"afc3a51a-ebc0-4b61-87d7-b6404234d3e4\") " pod="ai-tenant-e2e-inf-a-d14fdd/test-model-d14fdd-kserve-5467d9d4c-x6hfh"
Jul 06 20:05:18.746843 ip-10-0-131-168 kubenswrapper[2565]: I0706 20:05:18.746722    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/afc3a51a-ebc0-4b61-87d7-b6404234d3e4-tls-certs\") pod \"test-model-d14fdd-kserve-5467d9d4c-x6hfh\" (UID: \"afc3a51a-ebc0-4b61-87d7-b6404234d3e4\") " pod="ai-tenant-e2e-inf-a-d14fdd/test-model-d14fdd-kserve-5467d9d4c-x6hfh"
Jul 06 20:05:18.746843 ip-10-0-131-168 kubenswrapper[2565]: I0706 20:05:18.746767    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/afc3a51a-ebc0-4b61-87d7-b6404234d3e4-model-cache\") pod \"test-model-d14fdd-kserve-5467d9d4c-x6hfh\" (UID: \"afc3a51a-ebc0-4b61-87d7-b6404234d3e4\") " pod="ai-tenant-e2e-inf-a-d14fdd/test-model-d14fdd-kserve-5467d9d4c-x6hfh"
Jul 06 20:05:18.746843 ip-10-0-131-168 kubenswrapper[2565]: I0706 20:05:18.746809    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/afc3a51a-ebc0-4b61-87d7-b6404234d3e4-tmp-dir\") pod \"test-model-d14fdd-kserve-5467d9d4c-x6hfh\" (UID: \"afc3a51a-ebc0-4b61-87d7-b6404234d3e4\") " pod="ai-tenant-e2e-inf-a-d14fdd/test-model-d14fdd-kserve-5467d9d4c-x6hfh"
Jul 06 20:05:18.747028 ip-10-0-131-168 kubenswrapper[2565]: I0706 20:05:18.746858    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6pc67\" (UniqueName: \"kubernetes.io/projected/afc3a51a-ebc0-4b61-87d7-b6404234d3e4-kube-api-access-6pc67\") pod \"test-model-d14fdd-kserve-5467d9d4c-x6hfh\" (UID: \"afc3a51a-ebc0-4b61-87d7-b6404234d3e4\") " pod="ai-tenant-e2e-inf-a-d14fdd/test-model-d14fdd-kserve-5467d9d4c-x6hfh"
Jul 06 20:05:18.847690 ip-10-0-131-168 kubenswrapper[2565]: I0706 20:05:18.847654    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/afc3a51a-ebc0-4b61-87d7-b6404234d3e4-home\") pod \"test-model-d14fdd-kserve-5467d9d4c-x6hfh\" (UID: \"afc3a51a-ebc0-4b61-87d7-b6404234d3e4\") " pod="ai-tenant-e2e-inf-a-d14fdd/test-model-d14fdd-kserve-5467d9d4c-x6hfh"
Jul 06 20:05:18.847906 ip-10-0-131-168 kubenswrapper[2565]: I0706 20:05:18.847709    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/afc3a51a-ebc0-4b61-87d7-b6404234d3e4-tls-certs\") pod \"test-model-d14fdd-kserve-5467d9d4c-x6hfh\" (UID: \"afc3a51a-ebc0-4b61-87d7-b6404234d3e4\") " pod="ai-tenant-e2e-inf-a-d14fdd/test-model-d14fdd-kserve-5467d9d4c-x6hfh"
Jul 06 20:05:18.847906 ip-10-0-131-168 kubenswrapper[2565]: I0706 20:05:18.847762    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/afc3a51a-ebc0-4b61-87d7-b6404234d3e4-model-cache\") pod \"test-model-d14fdd-kserve-5467d9d4c-x6hfh\" (UID: \"afc3a51a-ebc0-4b61-87d7-b6404234d3e4\") " pod="ai-tenant-e2e-inf-a-d14fdd/test-model-d14fdd-kserve-5467d9d4c-x6hfh"
Jul 06 20:05:18.847906 ip-10-0-131-168 kubenswrapper[2565]: I0706 20:05:18.847815    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/afc3a51a-ebc0-4b61-87d7-b6404234d3e4-tmp-dir\") pod \"test-model-d14fdd-kserve-5467d9d4c-x6hfh\" (UID: \"afc3a51a-ebc0-4b61-87d7-b6404234d3e4\") " pod="ai-tenant-e2e-inf-a-d14fdd/test-model-d14fdd-kserve-5467d9d4c-x6hfh"
Jul 06 20:05:18.847906 ip-10-0-131-168 kubenswrapper[2565]: I0706 20:05:18.847853    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6pc67\" (UniqueName: \"kubernetes.io/projected/afc3a51a-ebc0-4b61-87d7-b6404234d3e4-kube-api-access-6pc67\") pod \"test-model-d14fdd-kserve-5467d9d4c-x6hfh\" (UID: \"afc3a51a-ebc0-4b61-87d7-b6404234d3e4\") " pod="ai-tenant-e2e-inf-a-d14fdd/test-model-d14fdd-kserve-5467d9d4c-x6hfh"
Jul 06 20:05:18.847906 ip-10-0-131-168 kubenswrapper[2565]: I0706 20:05:18.847902    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/afc3a51a-ebc0-4b61-87d7-b6404234d3e4-dshm\") pod \"test-model-d14fdd-kserve-5467d9d4c-x6hfh\" (UID: \"afc3a51a-ebc0-4b61-87d7-b6404234d3e4\") " pod="ai-tenant-e2e-inf-a-d14fdd/test-model-d14fdd-kserve-5467d9d4c-x6hfh"
Jul 06 20:05:18.848176 ip-10-0-131-168 kubenswrapper[2565]: I0706 20:05:18.848067    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/afc3a51a-ebc0-4b61-87d7-b6404234d3e4-home\") pod \"test-model-d14fdd-kserve-5467d9d4c-x6hfh\" (UID: \"afc3a51a-ebc0-4b61-87d7-b6404234d3e4\") " pod="ai-tenant-e2e-inf-a-d14fdd/test-model-d14fdd-kserve-5467d9d4c-x6hfh"
Jul 06 20:05:18.848176 ip-10-0-131-168 kubenswrapper[2565]: I0706 20:05:18.848147    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/afc3a51a-ebc0-4b61-87d7-b6404234d3e4-model-cache\") pod \"test-model-d14fdd-kserve-5467d9d4c-x6hfh\" (UID: \"afc3a51a-ebc0-4b61-87d7-b6404234d3e4\") " pod="ai-tenant-e2e-inf-a-d14fdd/test-model-d14fdd-kserve-5467d9d4c-x6hfh"
Jul 06 20:05:18.848176 ip-10-0-131-168 kubenswrapper[2565]: I0706 20:05:18.848164    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/afc3a51a-ebc0-4b61-87d7-b6404234d3e4-tmp-dir\") pod \"test-model-d14fdd-kserve-5467d9d4c-x6hfh\" (UID: \"afc3a51a-ebc0-4b61-87d7-b6404234d3e4\") " pod="ai-tenant-e2e-inf-a-d14fdd/test-model-d14fdd-kserve-5467d9d4c-x6hfh"
Jul 06 20:05:18.850026 ip-10-0-131-168 kubenswrapper[2565]: I0706 20:05:18.850004    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/afc3a51a-ebc0-4b61-87d7-b6404234d3e4-dshm\") pod \"test-model-d14fdd-kserve-5467d9d4c-x6hfh\" (UID: \"afc3a51a-ebc0-4b61-87d7-b6404234d3e4\") " pod="ai-tenant-e2e-inf-a-d14fdd/test-model-d14fdd-kserve-5467d9d4c-x6hfh"
Jul 06 20:05:18.850325 ip-10-0-131-168 kubenswrapper[2565]: I0706 20:05:18.850305    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/afc3a51a-ebc0-4b61-87d7-b6404234d3e4-tls-certs\") pod \"test-model-d14fdd-kserve-5467d9d4c-x6hfh\" (UID: \"afc3a51a-ebc0-4b61-87d7-b6404234d3e4\") " pod="ai-tenant-e2e-inf-a-d14fdd/test-model-d14fdd-kserve-5467d9d4c-x6hfh"
Jul 06 20:05:18.859187 ip-10-0-131-168 kubenswrapper[2565]: I0706 20:05:18.859158    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6pc67\" (UniqueName: \"kubernetes.io/projected/afc3a51a-ebc0-4b61-87d7-b6404234d3e4-kube-api-access-6pc67\") pod \"test-model-d14fdd-kserve-5467d9d4c-x6hfh\" (UID: \"afc3a51a-ebc0-4b61-87d7-b6404234d3e4\") " pod="ai-tenant-e2e-inf-a-d14fdd/test-model-d14fdd-kserve-5467d9d4c-x6hfh"
Jul 06 20:05:18.994937 ip-10-0-131-168 kubenswrapper[2565]: I0706 20:05:18.994848    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-a-d14fdd/test-model-d14fdd-kserve-5467d9d4c-x6hfh"
Jul 06 20:05:19.135208 ip-10-0-131-168 kubenswrapper[2565]: I0706 20:05:19.135186    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-inf-a-d14fdd/test-model-d14fdd-kserve-5467d9d4c-x6hfh"]
Jul 06 20:05:19.137288 ip-10-0-131-168 kubenswrapper[2565]: W0706 20:05:19.137259    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podafc3a51a_ebc0_4b61_87d7_b6404234d3e4.slice/crio-f014297a17125badfd0b3118a669d6e58969b2354751a7ac21027cbf33c4fb84 WatchSource:0}: Error finding container f014297a17125badfd0b3118a669d6e58969b2354751a7ac21027cbf33c4fb84: Status 404 returned error can't find the container with id f014297a17125badfd0b3118a669d6e58969b2354751a7ac21027cbf33c4fb84
Jul 06 20:05:20.004083 ip-10-0-131-168 kubenswrapper[2565]: I0706 20:05:20.004049    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-a-d14fdd/test-model-d14fdd-kserve-5467d9d4c-x6hfh" event={"ID":"afc3a51a-ebc0-4b61-87d7-b6404234d3e4","Type":"ContainerStarted","Data":"5951dea93840138080d860bf2d866fb9a8be14b8812898cac7fb865f7f71e37c"}
Jul 06 20:05:20.004083 ip-10-0-131-168 kubenswrapper[2565]: I0706 20:05:20.004089    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-a-d14fdd/test-model-d14fdd-kserve-5467d9d4c-x6hfh" event={"ID":"afc3a51a-ebc0-4b61-87d7-b6404234d3e4","Type":"ContainerStarted","Data":"f014297a17125badfd0b3118a669d6e58969b2354751a7ac21027cbf33c4fb84"}
Jul 06 20:05:20.027908 ip-10-0-131-168 kubenswrapper[2565]: I0706 20:05:20.027862    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-inf-a-d14fdd/test-model-d14fdd-kserve-5467d9d4c-x6hfh" podStartSLOduration=2.027848035 podStartE2EDuration="2.027848035s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 20:05:18 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 20:05:20.026268762 +0000 UTC m=+1955.039257434" watchObservedRunningTime="2026-07-06 20:05:20.027848035 +0000 UTC m=+1955.040836704"
Jul 06 20:05:28.995527 ip-10-0-131-168 kubenswrapper[2565]: I0706 20:05:28.995496    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-inf-a-d14fdd/test-model-d14fdd-kserve-5467d9d4c-x6hfh"
Jul 06 20:05:28.995938 ip-10-0-131-168 kubenswrapper[2565]: I0706 20:05:28.995573    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-inf-a-d14fdd/test-model-d14fdd-kserve-5467d9d4c-x6hfh"
Jul 06 20:05:29.008200 ip-10-0-131-168 kubenswrapper[2565]: I0706 20:05:29.008175    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-inf-a-d14fdd/test-model-d14fdd-kserve-5467d9d4c-x6hfh"
Jul 06 20:05:29.057632 ip-10-0-131-168 kubenswrapper[2565]: I0706 20:05:29.057606    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-inf-a-d14fdd/test-model-d14fdd-kserve-5467d9d4c-x6hfh"
Jul 06 20:05:32.439315 ip-10-0-131-168 kubenswrapper[2565]: I0706 20:05:32.439285    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-mfwbr"]
Jul 06 20:05:34.777869 ip-10-0-131-168 kubenswrapper[2565]: I0706 20:05:34.777834    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-inf-b-91e262/test-model-91e262-kserve-5fd9cbcdf9-qpx5q"]
Jul 06 20:05:34.781078 ip-10-0-131-168 kubenswrapper[2565]: I0706 20:05:34.781062    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-b-91e262/test-model-91e262-kserve-5fd9cbcdf9-qpx5q"
Jul 06 20:05:34.785291 ip-10-0-131-168 kubenswrapper[2565]: I0706 20:05:34.785264    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-inf-b-91e262\"/\"openshift-service-ca.crt\""
Jul 06 20:05:34.785472 ip-10-0-131-168 kubenswrapper[2565]: I0706 20:05:34.785452    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-inf-b-91e262\"/\"test-model-91e262-kserve-self-signed-certs\""
Jul 06 20:05:34.785518 ip-10-0-131-168 kubenswrapper[2565]: I0706 20:05:34.785509    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-inf-b-91e262\"/\"default-dockercfg-42jvz\""
Jul 06 20:05:34.785595 ip-10-0-131-168 kubenswrapper[2565]: I0706 20:05:34.785509    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-inf-b-91e262\"/\"kube-root-ca.crt\""
Jul 06 20:05:34.790183 ip-10-0-131-168 kubenswrapper[2565]: I0706 20:05:34.790160    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-inf-b-91e262/test-model-91e262-kserve-5fd9cbcdf9-qpx5q"]
Jul 06 20:05:34.890074 ip-10-0-131-168 kubenswrapper[2565]: I0706 20:05:34.890035    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gw45k\" (UniqueName: \"kubernetes.io/projected/132a034d-5bd3-4d0f-b9c1-11d6e7f4c213-kube-api-access-gw45k\") pod \"test-model-91e262-kserve-5fd9cbcdf9-qpx5q\" (UID: \"132a034d-5bd3-4d0f-b9c1-11d6e7f4c213\") " pod="ai-tenant-e2e-inf-b-91e262/test-model-91e262-kserve-5fd9cbcdf9-qpx5q"
Jul 06 20:05:34.890074 ip-10-0-131-168 kubenswrapper[2565]: I0706 20:05:34.890072    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/132a034d-5bd3-4d0f-b9c1-11d6e7f4c213-dshm\") pod \"test-model-91e262-kserve-5fd9cbcdf9-qpx5q\" (UID: \"132a034d-5bd3-4d0f-b9c1-11d6e7f4c213\") " pod="ai-tenant-e2e-inf-b-91e262/test-model-91e262-kserve-5fd9cbcdf9-qpx5q"
Jul 06 20:05:34.890278 ip-10-0-131-168 kubenswrapper[2565]: I0706 20:05:34.890106    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/132a034d-5bd3-4d0f-b9c1-11d6e7f4c213-model-cache\") pod \"test-model-91e262-kserve-5fd9cbcdf9-qpx5q\" (UID: \"132a034d-5bd3-4d0f-b9c1-11d6e7f4c213\") " pod="ai-tenant-e2e-inf-b-91e262/test-model-91e262-kserve-5fd9cbcdf9-qpx5q"
Jul 06 20:05:34.890278 ip-10-0-131-168 kubenswrapper[2565]: I0706 20:05:34.890189    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/132a034d-5bd3-4d0f-b9c1-11d6e7f4c213-tmp-dir\") pod \"test-model-91e262-kserve-5fd9cbcdf9-qpx5q\" (UID: \"132a034d-5bd3-4d0f-b9c1-11d6e7f4c213\") " pod="ai-tenant-e2e-inf-b-91e262/test-model-91e262-kserve-5fd9cbcdf9-qpx5q"
Jul 06 20:05:34.890278 ip-10-0-131-168 kubenswrapper[2565]: I0706 20:05:34.890228    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/132a034d-5bd3-4d0f-b9c1-11d6e7f4c213-home\") pod \"test-model-91e262-kserve-5fd9cbcdf9-qpx5q\" (UID: \"132a034d-5bd3-4d0f-b9c1-11d6e7f4c213\") " pod="ai-tenant-e2e-inf-b-91e262/test-model-91e262-kserve-5fd9cbcdf9-qpx5q"
Jul 06 20:05:34.890278 ip-10-0-131-168 kubenswrapper[2565]: I0706 20:05:34.890245    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/132a034d-5bd3-4d0f-b9c1-11d6e7f4c213-tls-certs\") pod \"test-model-91e262-kserve-5fd9cbcdf9-qpx5q\" (UID: \"132a034d-5bd3-4d0f-b9c1-11d6e7f4c213\") " pod="ai-tenant-e2e-inf-b-91e262/test-model-91e262-kserve-5fd9cbcdf9-qpx5q"
Jul 06 20:05:34.991038 ip-10-0-131-168 kubenswrapper[2565]: I0706 20:05:34.991000    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gw45k\" (UniqueName: \"kubernetes.io/projected/132a034d-5bd3-4d0f-b9c1-11d6e7f4c213-kube-api-access-gw45k\") pod \"test-model-91e262-kserve-5fd9cbcdf9-qpx5q\" (UID: \"132a034d-5bd3-4d0f-b9c1-11d6e7f4c213\") " pod="ai-tenant-e2e-inf-b-91e262/test-model-91e262-kserve-5fd9cbcdf9-qpx5q"
Jul 06 20:05:34.991038 ip-10-0-131-168 kubenswrapper[2565]: I0706 20:05:34.991042    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/132a034d-5bd3-4d0f-b9c1-11d6e7f4c213-dshm\") pod \"test-model-91e262-kserve-5fd9cbcdf9-qpx5q\" (UID: \"132a034d-5bd3-4d0f-b9c1-11d6e7f4c213\") " pod="ai-tenant-e2e-inf-b-91e262/test-model-91e262-kserve-5fd9cbcdf9-qpx5q"
Jul 06 20:05:34.991279 ip-10-0-131-168 kubenswrapper[2565]: I0706 20:05:34.991084    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/132a034d-5bd3-4d0f-b9c1-11d6e7f4c213-model-cache\") pod \"test-model-91e262-kserve-5fd9cbcdf9-qpx5q\" (UID: \"132a034d-5bd3-4d0f-b9c1-11d6e7f4c213\") " pod="ai-tenant-e2e-inf-b-91e262/test-model-91e262-kserve-5fd9cbcdf9-qpx5q"
Jul 06 20:05:34.991279 ip-10-0-131-168 kubenswrapper[2565]: I0706 20:05:34.991121    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/132a034d-5bd3-4d0f-b9c1-11d6e7f4c213-tmp-dir\") pod \"test-model-91e262-kserve-5fd9cbcdf9-qpx5q\" (UID: \"132a034d-5bd3-4d0f-b9c1-11d6e7f4c213\") " pod="ai-tenant-e2e-inf-b-91e262/test-model-91e262-kserve-5fd9cbcdf9-qpx5q"
Jul 06 20:05:34.991279 ip-10-0-131-168 kubenswrapper[2565]: I0706 20:05:34.991143    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/132a034d-5bd3-4d0f-b9c1-11d6e7f4c213-home\") pod \"test-model-91e262-kserve-5fd9cbcdf9-qpx5q\" (UID: \"132a034d-5bd3-4d0f-b9c1-11d6e7f4c213\") " pod="ai-tenant-e2e-inf-b-91e262/test-model-91e262-kserve-5fd9cbcdf9-qpx5q"
Jul 06 20:05:34.991279 ip-10-0-131-168 kubenswrapper[2565]: I0706 20:05:34.991157    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/132a034d-5bd3-4d0f-b9c1-11d6e7f4c213-tls-certs\") pod \"test-model-91e262-kserve-5fd9cbcdf9-qpx5q\" (UID: \"132a034d-5bd3-4d0f-b9c1-11d6e7f4c213\") " pod="ai-tenant-e2e-inf-b-91e262/test-model-91e262-kserve-5fd9cbcdf9-qpx5q"
Jul 06 20:05:34.991587 ip-10-0-131-168 kubenswrapper[2565]: I0706 20:05:34.991560    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/132a034d-5bd3-4d0f-b9c1-11d6e7f4c213-model-cache\") pod \"test-model-91e262-kserve-5fd9cbcdf9-qpx5q\" (UID: \"132a034d-5bd3-4d0f-b9c1-11d6e7f4c213\") " pod="ai-tenant-e2e-inf-b-91e262/test-model-91e262-kserve-5fd9cbcdf9-qpx5q"
Jul 06 20:05:34.991695 ip-10-0-131-168 kubenswrapper[2565]: I0706 20:05:34.991604    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/132a034d-5bd3-4d0f-b9c1-11d6e7f4c213-tmp-dir\") pod \"test-model-91e262-kserve-5fd9cbcdf9-qpx5q\" (UID: \"132a034d-5bd3-4d0f-b9c1-11d6e7f4c213\") " pod="ai-tenant-e2e-inf-b-91e262/test-model-91e262-kserve-5fd9cbcdf9-qpx5q"
Jul 06 20:05:34.991695 ip-10-0-131-168 kubenswrapper[2565]: I0706 20:05:34.991676    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/132a034d-5bd3-4d0f-b9c1-11d6e7f4c213-home\") pod \"test-model-91e262-kserve-5fd9cbcdf9-qpx5q\" (UID: \"132a034d-5bd3-4d0f-b9c1-11d6e7f4c213\") " pod="ai-tenant-e2e-inf-b-91e262/test-model-91e262-kserve-5fd9cbcdf9-qpx5q"
Jul 06 20:05:34.993420 ip-10-0-131-168 kubenswrapper[2565]: I0706 20:05:34.993399    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/132a034d-5bd3-4d0f-b9c1-11d6e7f4c213-dshm\") pod \"test-model-91e262-kserve-5fd9cbcdf9-qpx5q\" (UID: \"132a034d-5bd3-4d0f-b9c1-11d6e7f4c213\") " pod="ai-tenant-e2e-inf-b-91e262/test-model-91e262-kserve-5fd9cbcdf9-qpx5q"
Jul 06 20:05:34.993591 ip-10-0-131-168 kubenswrapper[2565]: I0706 20:05:34.993575    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/132a034d-5bd3-4d0f-b9c1-11d6e7f4c213-tls-certs\") pod \"test-model-91e262-kserve-5fd9cbcdf9-qpx5q\" (UID: \"132a034d-5bd3-4d0f-b9c1-11d6e7f4c213\") " pod="ai-tenant-e2e-inf-b-91e262/test-model-91e262-kserve-5fd9cbcdf9-qpx5q"
Jul 06 20:05:35.001011 ip-10-0-131-168 kubenswrapper[2565]: I0706 20:05:35.000989    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gw45k\" (UniqueName: \"kubernetes.io/projected/132a034d-5bd3-4d0f-b9c1-11d6e7f4c213-kube-api-access-gw45k\") pod \"test-model-91e262-kserve-5fd9cbcdf9-qpx5q\" (UID: \"132a034d-5bd3-4d0f-b9c1-11d6e7f4c213\") " pod="ai-tenant-e2e-inf-b-91e262/test-model-91e262-kserve-5fd9cbcdf9-qpx5q"
Jul 06 20:05:35.091047 ip-10-0-131-168 kubenswrapper[2565]: I0706 20:05:35.090961    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-b-91e262/test-model-91e262-kserve-5fd9cbcdf9-qpx5q"
Jul 06 20:05:35.227655 ip-10-0-131-168 kubenswrapper[2565]: I0706 20:05:35.227627    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-inf-b-91e262/test-model-91e262-kserve-5fd9cbcdf9-qpx5q"]
Jul 06 20:05:35.229831 ip-10-0-131-168 kubenswrapper[2565]: W0706 20:05:35.229805    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod132a034d_5bd3_4d0f_b9c1_11d6e7f4c213.slice/crio-f9576e48c4f3cbb633a6f50359e08c1f72eeffd9374ab3d822b8d389fbb9d251 WatchSource:0}: Error finding container f9576e48c4f3cbb633a6f50359e08c1f72eeffd9374ab3d822b8d389fbb9d251: Status 404 returned error can't find the container with id f9576e48c4f3cbb633a6f50359e08c1f72eeffd9374ab3d822b8d389fbb9d251
Jul 06 20:05:36.078619 ip-10-0-131-168 kubenswrapper[2565]: I0706 20:05:36.078583    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-b-91e262/test-model-91e262-kserve-5fd9cbcdf9-qpx5q" event={"ID":"132a034d-5bd3-4d0f-b9c1-11d6e7f4c213","Type":"ContainerStarted","Data":"79a5e0f4b63fb7cc593483f9f55d9d982364b79298e788fc5641470f13e4f660"}
Jul 06 20:05:36.078619 ip-10-0-131-168 kubenswrapper[2565]: I0706 20:05:36.078625    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-b-91e262/test-model-91e262-kserve-5fd9cbcdf9-qpx5q" event={"ID":"132a034d-5bd3-4d0f-b9c1-11d6e7f4c213","Type":"ContainerStarted","Data":"f9576e48c4f3cbb633a6f50359e08c1f72eeffd9374ab3d822b8d389fbb9d251"}
Jul 06 20:05:36.099004 ip-10-0-131-168 kubenswrapper[2565]: I0706 20:05:36.098953    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-inf-b-91e262/test-model-91e262-kserve-5fd9cbcdf9-qpx5q" podStartSLOduration=2.098938572 podStartE2EDuration="2.098938572s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 20:05:34 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 20:05:36.096868508 +0000 UTC m=+1971.109857202" watchObservedRunningTime="2026-07-06 20:05:36.098938572 +0000 UTC m=+1971.111927249"
Jul 06 20:05:45.091824 ip-10-0-131-168 kubenswrapper[2565]: I0706 20:05:45.091783    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-inf-b-91e262/test-model-91e262-kserve-5fd9cbcdf9-qpx5q"
Jul 06 20:05:45.092306 ip-10-0-131-168 kubenswrapper[2565]: I0706 20:05:45.091844    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-inf-b-91e262/test-model-91e262-kserve-5fd9cbcdf9-qpx5q"
Jul 06 20:05:45.104222 ip-10-0-131-168 kubenswrapper[2565]: I0706 20:05:45.104195    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-inf-b-91e262/test-model-91e262-kserve-5fd9cbcdf9-qpx5q"
Jul 06 20:05:45.127148 ip-10-0-131-168 kubenswrapper[2565]: I0706 20:05:45.127116    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-inf-b-91e262/test-model-91e262-kserve-5fd9cbcdf9-qpx5q"
Jul 06 20:05:46.549947 ip-10-0-131-168 kubenswrapper[2565]: I0706 20:05:46.549913    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-mfwbr"]
Jul 06 20:06:06.891445 ip-10-0-131-168 kubenswrapper[2565]: I0706 20:06:06.891405    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-inf-a-d14fdd/test-model-d14fdd-kserve-5467d9d4c-x6hfh"]
Jul 06 20:06:07.927205 ip-10-0-131-168 kubenswrapper[2565]: I0706 20:06:07.927174    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-inf-b-91e262/test-model-91e262-kserve-5fd9cbcdf9-qpx5q"]
Jul 06 20:06:14.048690 ip-10-0-131-168 kubenswrapper[2565]: I0706 20:06:14.048647    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-mfwbr"]
Jul 06 20:06:21.911915 ip-10-0-131-168 kubenswrapper[2565]: I0706 20:06:21.911861    2565 kuberuntime_container.go:872] "Killing container with a grace period" pod="ai-tenant-e2e-inf-a-d14fdd/test-model-d14fdd-kserve-5467d9d4c-x6hfh" podUID="afc3a51a-ebc0-4b61-87d7-b6404234d3e4" containerName="main" containerID="cri-o://5951dea93840138080d860bf2d866fb9a8be14b8812898cac7fb865f7f71e37c" gracePeriod=45
Jul 06 20:06:22.160431 ip-10-0-131-168 kubenswrapper[2565]: I0706 20:06:22.160406    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-a-d14fdd/test-model-d14fdd-kserve-5467d9d4c-x6hfh"
Jul 06 20:06:22.207297 ip-10-0-131-168 kubenswrapper[2565]: I0706 20:06:22.207219    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/afc3a51a-ebc0-4b61-87d7-b6404234d3e4-model-cache\") pod \"afc3a51a-ebc0-4b61-87d7-b6404234d3e4\" (UID: \"afc3a51a-ebc0-4b61-87d7-b6404234d3e4\") "
Jul 06 20:06:22.207440 ip-10-0-131-168 kubenswrapper[2565]: I0706 20:06:22.207318    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/afc3a51a-ebc0-4b61-87d7-b6404234d3e4-dshm\") pod \"afc3a51a-ebc0-4b61-87d7-b6404234d3e4\" (UID: \"afc3a51a-ebc0-4b61-87d7-b6404234d3e4\") "
Jul 06 20:06:22.207440 ip-10-0-131-168 kubenswrapper[2565]: I0706 20:06:22.207346    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/afc3a51a-ebc0-4b61-87d7-b6404234d3e4-tmp-dir\") pod \"afc3a51a-ebc0-4b61-87d7-b6404234d3e4\" (UID: \"afc3a51a-ebc0-4b61-87d7-b6404234d3e4\") "
Jul 06 20:06:22.207440 ip-10-0-131-168 kubenswrapper[2565]: I0706 20:06:22.207392    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/afc3a51a-ebc0-4b61-87d7-b6404234d3e4-tls-certs\") pod \"afc3a51a-ebc0-4b61-87d7-b6404234d3e4\" (UID: \"afc3a51a-ebc0-4b61-87d7-b6404234d3e4\") "
Jul 06 20:06:22.207440 ip-10-0-131-168 kubenswrapper[2565]: I0706 20:06:22.207422    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/afc3a51a-ebc0-4b61-87d7-b6404234d3e4-home\") pod \"afc3a51a-ebc0-4b61-87d7-b6404234d3e4\" (UID: \"afc3a51a-ebc0-4b61-87d7-b6404234d3e4\") "
Jul 06 20:06:22.207648 ip-10-0-131-168 kubenswrapper[2565]: I0706 20:06:22.207451    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-6pc67\" (UniqueName: \"kubernetes.io/projected/afc3a51a-ebc0-4b61-87d7-b6404234d3e4-kube-api-access-6pc67\") pod \"afc3a51a-ebc0-4b61-87d7-b6404234d3e4\" (UID: \"afc3a51a-ebc0-4b61-87d7-b6404234d3e4\") "
Jul 06 20:06:22.207648 ip-10-0-131-168 kubenswrapper[2565]: I0706 20:06:22.207539    2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/afc3a51a-ebc0-4b61-87d7-b6404234d3e4-model-cache" (OuterVolumeSpecName: "model-cache") pod "afc3a51a-ebc0-4b61-87d7-b6404234d3e4" (UID: "afc3a51a-ebc0-4b61-87d7-b6404234d3e4"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 20:06:22.207648 ip-10-0-131-168 kubenswrapper[2565]: I0706 20:06:22.207587    2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/afc3a51a-ebc0-4b61-87d7-b6404234d3e4-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "afc3a51a-ebc0-4b61-87d7-b6404234d3e4" (UID: "afc3a51a-ebc0-4b61-87d7-b6404234d3e4"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 20:06:22.207828 ip-10-0-131-168 kubenswrapper[2565]: I0706 20:06:22.207687    2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/afc3a51a-ebc0-4b61-87d7-b6404234d3e4-home" (OuterVolumeSpecName: "home") pod "afc3a51a-ebc0-4b61-87d7-b6404234d3e4" (UID: "afc3a51a-ebc0-4b61-87d7-b6404234d3e4"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 20:06:22.207828 ip-10-0-131-168 kubenswrapper[2565]: I0706 20:06:22.207816    2565 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/afc3a51a-ebc0-4b61-87d7-b6404234d3e4-model-cache\") on node \"ip-10-0-131-168.ec2.internal\" DevicePath \"\""
Jul 06 20:06:22.207918 ip-10-0-131-168 kubenswrapper[2565]: I0706 20:06:22.207838    2565 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/afc3a51a-ebc0-4b61-87d7-b6404234d3e4-tmp-dir\") on node \"ip-10-0-131-168.ec2.internal\" DevicePath \"\""
Jul 06 20:06:22.207918 ip-10-0-131-168 kubenswrapper[2565]: I0706 20:06:22.207851    2565 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/afc3a51a-ebc0-4b61-87d7-b6404234d3e4-home\") on node \"ip-10-0-131-168.ec2.internal\" DevicePath \"\""
Jul 06 20:06:22.209510 ip-10-0-131-168 kubenswrapper[2565]: I0706 20:06:22.209491    2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/afc3a51a-ebc0-4b61-87d7-b6404234d3e4-dshm" (OuterVolumeSpecName: "dshm") pod "afc3a51a-ebc0-4b61-87d7-b6404234d3e4" (UID: "afc3a51a-ebc0-4b61-87d7-b6404234d3e4"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 20:06:22.209957 ip-10-0-131-168 kubenswrapper[2565]: I0706 20:06:22.209930    2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/afc3a51a-ebc0-4b61-87d7-b6404234d3e4-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "afc3a51a-ebc0-4b61-87d7-b6404234d3e4" (UID: "afc3a51a-ebc0-4b61-87d7-b6404234d3e4"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 06 20:06:22.210048 ip-10-0-131-168 kubenswrapper[2565]: I0706 20:06:22.209952    2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/afc3a51a-ebc0-4b61-87d7-b6404234d3e4-kube-api-access-6pc67" (OuterVolumeSpecName: "kube-api-access-6pc67") pod "afc3a51a-ebc0-4b61-87d7-b6404234d3e4" (UID: "afc3a51a-ebc0-4b61-87d7-b6404234d3e4"). InnerVolumeSpecName "kube-api-access-6pc67". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 06 20:06:22.283356 ip-10-0-131-168 kubenswrapper[2565]: I0706 20:06:22.283319    2565 generic.go:356] "Generic (PLEG): container finished" podID="afc3a51a-ebc0-4b61-87d7-b6404234d3e4" containerID="5951dea93840138080d860bf2d866fb9a8be14b8812898cac7fb865f7f71e37c" exitCode=0
Jul 06 20:06:22.283530 ip-10-0-131-168 kubenswrapper[2565]: I0706 20:06:22.283364    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-a-d14fdd/test-model-d14fdd-kserve-5467d9d4c-x6hfh"
Jul 06 20:06:22.283530 ip-10-0-131-168 kubenswrapper[2565]: I0706 20:06:22.283398    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-a-d14fdd/test-model-d14fdd-kserve-5467d9d4c-x6hfh" event={"ID":"afc3a51a-ebc0-4b61-87d7-b6404234d3e4","Type":"ContainerDied","Data":"5951dea93840138080d860bf2d866fb9a8be14b8812898cac7fb865f7f71e37c"}
Jul 06 20:06:22.283530 ip-10-0-131-168 kubenswrapper[2565]: I0706 20:06:22.283433    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-a-d14fdd/test-model-d14fdd-kserve-5467d9d4c-x6hfh" event={"ID":"afc3a51a-ebc0-4b61-87d7-b6404234d3e4","Type":"ContainerDied","Data":"f014297a17125badfd0b3118a669d6e58969b2354751a7ac21027cbf33c4fb84"}
Jul 06 20:06:22.283530 ip-10-0-131-168 kubenswrapper[2565]: I0706 20:06:22.283451    2565 scope.go:117] "RemoveContainer" containerID="5951dea93840138080d860bf2d866fb9a8be14b8812898cac7fb865f7f71e37c"
Jul 06 20:06:22.292951 ip-10-0-131-168 kubenswrapper[2565]: I0706 20:06:22.292933    2565 scope.go:117] "RemoveContainer" containerID="5951dea93840138080d860bf2d866fb9a8be14b8812898cac7fb865f7f71e37c"
Jul 06 20:06:22.293222 ip-10-0-131-168 kubenswrapper[2565]: E0706 20:06:22.293207    2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5951dea93840138080d860bf2d866fb9a8be14b8812898cac7fb865f7f71e37c\": container with ID starting with 5951dea93840138080d860bf2d866fb9a8be14b8812898cac7fb865f7f71e37c not found: ID does not exist" containerID="5951dea93840138080d860bf2d866fb9a8be14b8812898cac7fb865f7f71e37c"
Jul 06 20:06:22.293260 ip-10-0-131-168 kubenswrapper[2565]: I0706 20:06:22.293230    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5951dea93840138080d860bf2d866fb9a8be14b8812898cac7fb865f7f71e37c"} err="failed to get container status \"5951dea93840138080d860bf2d866fb9a8be14b8812898cac7fb865f7f71e37c\": rpc error: code = NotFound desc = could not find container \"5951dea93840138080d860bf2d866fb9a8be14b8812898cac7fb865f7f71e37c\": container with ID starting with 5951dea93840138080d860bf2d866fb9a8be14b8812898cac7fb865f7f71e37c not found: ID does not exist"
Jul 06 20:06:22.308580 ip-10-0-131-168 kubenswrapper[2565]: I0706 20:06:22.308563    2565 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/afc3a51a-ebc0-4b61-87d7-b6404234d3e4-dshm\") on node \"ip-10-0-131-168.ec2.internal\" DevicePath \"\""
Jul 06 20:06:22.308644 ip-10-0-131-168 kubenswrapper[2565]: I0706 20:06:22.308582    2565 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/afc3a51a-ebc0-4b61-87d7-b6404234d3e4-tls-certs\") on node \"ip-10-0-131-168.ec2.internal\" DevicePath \"\""
Jul 06 20:06:22.308644 ip-10-0-131-168 kubenswrapper[2565]: I0706 20:06:22.308592    2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-6pc67\" (UniqueName: \"kubernetes.io/projected/afc3a51a-ebc0-4b61-87d7-b6404234d3e4-kube-api-access-6pc67\") on node \"ip-10-0-131-168.ec2.internal\" DevicePath \"\""
Jul 06 20:06:22.314464 ip-10-0-131-168 kubenswrapper[2565]: I0706 20:06:22.314441    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-inf-a-d14fdd/test-model-d14fdd-kserve-5467d9d4c-x6hfh"]
Jul 06 20:06:22.323305 ip-10-0-131-168 kubenswrapper[2565]: I0706 20:06:22.321128    2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-inf-a-d14fdd/test-model-d14fdd-kserve-5467d9d4c-x6hfh"]
Jul 06 20:06:22.947045 ip-10-0-131-168 kubenswrapper[2565]: I0706 20:06:22.946994    2565 kuberuntime_container.go:872] "Killing container with a grace period" pod="ai-tenant-e2e-inf-b-91e262/test-model-91e262-kserve-5fd9cbcdf9-qpx5q" podUID="132a034d-5bd3-4d0f-b9c1-11d6e7f4c213" containerName="main" containerID="cri-o://79a5e0f4b63fb7cc593483f9f55d9d982364b79298e788fc5641470f13e4f660" gracePeriod=45
Jul 06 20:06:23.202986 ip-10-0-131-168 kubenswrapper[2565]: I0706 20:06:23.202934    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-b-91e262/test-model-91e262-kserve-5fd9cbcdf9-qpx5q"
Jul 06 20:06:23.290376 ip-10-0-131-168 kubenswrapper[2565]: I0706 20:06:23.290335    2565 generic.go:356] "Generic (PLEG): container finished" podID="132a034d-5bd3-4d0f-b9c1-11d6e7f4c213" containerID="79a5e0f4b63fb7cc593483f9f55d9d982364b79298e788fc5641470f13e4f660" exitCode=0
Jul 06 20:06:23.290557 ip-10-0-131-168 kubenswrapper[2565]: I0706 20:06:23.290385    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-b-91e262/test-model-91e262-kserve-5fd9cbcdf9-qpx5q"
Jul 06 20:06:23.290557 ip-10-0-131-168 kubenswrapper[2565]: I0706 20:06:23.290385    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-b-91e262/test-model-91e262-kserve-5fd9cbcdf9-qpx5q" event={"ID":"132a034d-5bd3-4d0f-b9c1-11d6e7f4c213","Type":"ContainerDied","Data":"79a5e0f4b63fb7cc593483f9f55d9d982364b79298e788fc5641470f13e4f660"}
Jul 06 20:06:23.290557 ip-10-0-131-168 kubenswrapper[2565]: I0706 20:06:23.290489    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-b-91e262/test-model-91e262-kserve-5fd9cbcdf9-qpx5q" event={"ID":"132a034d-5bd3-4d0f-b9c1-11d6e7f4c213","Type":"ContainerDied","Data":"f9576e48c4f3cbb633a6f50359e08c1f72eeffd9374ab3d822b8d389fbb9d251"}
Jul 06 20:06:23.290557 ip-10-0-131-168 kubenswrapper[2565]: I0706 20:06:23.290509    2565 scope.go:117] "RemoveContainer" containerID="79a5e0f4b63fb7cc593483f9f55d9d982364b79298e788fc5641470f13e4f660"
Jul 06 20:06:23.298522 ip-10-0-131-168 kubenswrapper[2565]: I0706 20:06:23.298506    2565 scope.go:117] "RemoveContainer" containerID="79a5e0f4b63fb7cc593483f9f55d9d982364b79298e788fc5641470f13e4f660"
Jul 06 20:06:23.298807 ip-10-0-131-168 kubenswrapper[2565]: E0706 20:06:23.298788    2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"79a5e0f4b63fb7cc593483f9f55d9d982364b79298e788fc5641470f13e4f660\": container with ID starting with 79a5e0f4b63fb7cc593483f9f55d9d982364b79298e788fc5641470f13e4f660 not found: ID does not exist" containerID="79a5e0f4b63fb7cc593483f9f55d9d982364b79298e788fc5641470f13e4f660"
Jul 06 20:06:23.298874 ip-10-0-131-168 kubenswrapper[2565]: I0706 20:06:23.298819    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"79a5e0f4b63fb7cc593483f9f55d9d982364b79298e788fc5641470f13e4f660"} err="failed to get container status \"79a5e0f4b63fb7cc593483f9f55d9d982364b79298e788fc5641470f13e4f660\": rpc error: code = NotFound desc = could not find container \"79a5e0f4b63fb7cc593483f9f55d9d982364b79298e788fc5641470f13e4f660\": container with ID starting with 79a5e0f4b63fb7cc593483f9f55d9d982364b79298e788fc5641470f13e4f660 not found: ID does not exist"
Jul 06 20:06:23.316120 ip-10-0-131-168 kubenswrapper[2565]: I0706 20:06:23.316097    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/132a034d-5bd3-4d0f-b9c1-11d6e7f4c213-dshm\") pod \"132a034d-5bd3-4d0f-b9c1-11d6e7f4c213\" (UID: \"132a034d-5bd3-4d0f-b9c1-11d6e7f4c213\") "
Jul 06 20:06:23.316191 ip-10-0-131-168 kubenswrapper[2565]: I0706 20:06:23.316149    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/132a034d-5bd3-4d0f-b9c1-11d6e7f4c213-tls-certs\") pod \"132a034d-5bd3-4d0f-b9c1-11d6e7f4c213\" (UID: \"132a034d-5bd3-4d0f-b9c1-11d6e7f4c213\") "
Jul 06 20:06:23.316191 ip-10-0-131-168 kubenswrapper[2565]: I0706 20:06:23.316172    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/132a034d-5bd3-4d0f-b9c1-11d6e7f4c213-tmp-dir\") pod \"132a034d-5bd3-4d0f-b9c1-11d6e7f4c213\" (UID: \"132a034d-5bd3-4d0f-b9c1-11d6e7f4c213\") "
Jul 06 20:06:23.316273 ip-10-0-131-168 kubenswrapper[2565]: I0706 20:06:23.316226    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-gw45k\" (UniqueName: \"kubernetes.io/projected/132a034d-5bd3-4d0f-b9c1-11d6e7f4c213-kube-api-access-gw45k\") pod \"132a034d-5bd3-4d0f-b9c1-11d6e7f4c213\" (UID: \"132a034d-5bd3-4d0f-b9c1-11d6e7f4c213\") "
Jul 06 20:06:23.316273 ip-10-0-131-168 kubenswrapper[2565]: I0706 20:06:23.316252    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/132a034d-5bd3-4d0f-b9c1-11d6e7f4c213-model-cache\") pod \"132a034d-5bd3-4d0f-b9c1-11d6e7f4c213\" (UID: \"132a034d-5bd3-4d0f-b9c1-11d6e7f4c213\") "
Jul 06 20:06:23.316273 ip-10-0-131-168 kubenswrapper[2565]: I0706 20:06:23.316267    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/132a034d-5bd3-4d0f-b9c1-11d6e7f4c213-home\") pod \"132a034d-5bd3-4d0f-b9c1-11d6e7f4c213\" (UID: \"132a034d-5bd3-4d0f-b9c1-11d6e7f4c213\") "
Jul 06 20:06:23.316538 ip-10-0-131-168 kubenswrapper[2565]: I0706 20:06:23.316487    2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/132a034d-5bd3-4d0f-b9c1-11d6e7f4c213-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "132a034d-5bd3-4d0f-b9c1-11d6e7f4c213" (UID: "132a034d-5bd3-4d0f-b9c1-11d6e7f4c213"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 20:06:23.316609 ip-10-0-131-168 kubenswrapper[2565]: I0706 20:06:23.316505    2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/132a034d-5bd3-4d0f-b9c1-11d6e7f4c213-model-cache" (OuterVolumeSpecName: "model-cache") pod "132a034d-5bd3-4d0f-b9c1-11d6e7f4c213" (UID: "132a034d-5bd3-4d0f-b9c1-11d6e7f4c213"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 20:06:23.316609 ip-10-0-131-168 kubenswrapper[2565]: I0706 20:06:23.316580    2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/132a034d-5bd3-4d0f-b9c1-11d6e7f4c213-home" (OuterVolumeSpecName: "home") pod "132a034d-5bd3-4d0f-b9c1-11d6e7f4c213" (UID: "132a034d-5bd3-4d0f-b9c1-11d6e7f4c213"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 20:06:23.318357 ip-10-0-131-168 kubenswrapper[2565]: I0706 20:06:23.318334    2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/132a034d-5bd3-4d0f-b9c1-11d6e7f4c213-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "132a034d-5bd3-4d0f-b9c1-11d6e7f4c213" (UID: "132a034d-5bd3-4d0f-b9c1-11d6e7f4c213"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 06 20:06:23.318357 ip-10-0-131-168 kubenswrapper[2565]: I0706 20:06:23.318345    2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/132a034d-5bd3-4d0f-b9c1-11d6e7f4c213-kube-api-access-gw45k" (OuterVolumeSpecName: "kube-api-access-gw45k") pod "132a034d-5bd3-4d0f-b9c1-11d6e7f4c213" (UID: "132a034d-5bd3-4d0f-b9c1-11d6e7f4c213"). InnerVolumeSpecName "kube-api-access-gw45k". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 06 20:06:23.318357 ip-10-0-131-168 kubenswrapper[2565]: I0706 20:06:23.318339    2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/132a034d-5bd3-4d0f-b9c1-11d6e7f4c213-dshm" (OuterVolumeSpecName: "dshm") pod "132a034d-5bd3-4d0f-b9c1-11d6e7f4c213" (UID: "132a034d-5bd3-4d0f-b9c1-11d6e7f4c213"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 20:06:23.416819 ip-10-0-131-168 kubenswrapper[2565]: I0706 20:06:23.416791    2565 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/132a034d-5bd3-4d0f-b9c1-11d6e7f4c213-tls-certs\") on node \"ip-10-0-131-168.ec2.internal\" DevicePath \"\""
Jul 06 20:06:23.416819 ip-10-0-131-168 kubenswrapper[2565]: I0706 20:06:23.416814    2565 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/132a034d-5bd3-4d0f-b9c1-11d6e7f4c213-tmp-dir\") on node \"ip-10-0-131-168.ec2.internal\" DevicePath \"\""
Jul 06 20:06:23.416819 ip-10-0-131-168 kubenswrapper[2565]: I0706 20:06:23.416823    2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-gw45k\" (UniqueName: \"kubernetes.io/projected/132a034d-5bd3-4d0f-b9c1-11d6e7f4c213-kube-api-access-gw45k\") on node \"ip-10-0-131-168.ec2.internal\" DevicePath \"\""
Jul 06 20:06:23.417059 ip-10-0-131-168 kubenswrapper[2565]: I0706 20:06:23.416833    2565 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/132a034d-5bd3-4d0f-b9c1-11d6e7f4c213-model-cache\") on node \"ip-10-0-131-168.ec2.internal\" DevicePath \"\""
Jul 06 20:06:23.417059 ip-10-0-131-168 kubenswrapper[2565]: I0706 20:06:23.416844    2565 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/132a034d-5bd3-4d0f-b9c1-11d6e7f4c213-home\") on node \"ip-10-0-131-168.ec2.internal\" DevicePath \"\""
Jul 06 20:06:23.417059 ip-10-0-131-168 kubenswrapper[2565]: I0706 20:06:23.416857    2565 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/132a034d-5bd3-4d0f-b9c1-11d6e7f4c213-dshm\") on node \"ip-10-0-131-168.ec2.internal\" DevicePath \"\""
Jul 06 20:06:23.495129 ip-10-0-131-168 kubenswrapper[2565]: I0706 20:06:23.495059    2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="afc3a51a-ebc0-4b61-87d7-b6404234d3e4" path="/var/lib/kubelet/pods/afc3a51a-ebc0-4b61-87d7-b6404234d3e4/volumes"
Jul 06 20:06:23.615175 ip-10-0-131-168 kubenswrapper[2565]: I0706 20:06:23.615142    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-inf-b-91e262/test-model-91e262-kserve-5fd9cbcdf9-qpx5q"]
Jul 06 20:06:23.621300 ip-10-0-131-168 kubenswrapper[2565]: I0706 20:06:23.621276    2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-inf-b-91e262/test-model-91e262-kserve-5fd9cbcdf9-qpx5q"]
Jul 06 20:06:25.494693 ip-10-0-131-168 kubenswrapper[2565]: I0706 20:06:25.494661    2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="132a034d-5bd3-4d0f-b9c1-11d6e7f4c213" path="/var/lib/kubelet/pods/132a034d-5bd3-4d0f-b9c1-11d6e7f4c213/volumes"
Jul 06 20:06:55.740119 ip-10-0-131-168 kubenswrapper[2565]: I0706 20:06:55.740081    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-mfwbr"]
Jul 06 20:07:08.925714 ip-10-0-131-168 kubenswrapper[2565]: I0706 20:07:08.925632    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-mfwbr"]
Jul 06 20:07:12.574105 ip-10-0-131-168 kubenswrapper[2565]: I0706 20:07:12.574060    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-api-e2e-api-b-618838-66f5758db7-pff7l"]
Jul 06 20:07:12.574549 ip-10-0-131-168 kubenswrapper[2565]: I0706 20:07:12.574535    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="132a034d-5bd3-4d0f-b9c1-11d6e7f4c213" containerName="main"
Jul 06 20:07:12.574607 ip-10-0-131-168 kubenswrapper[2565]: I0706 20:07:12.574552    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="132a034d-5bd3-4d0f-b9c1-11d6e7f4c213" containerName="main"
Jul 06 20:07:12.574607 ip-10-0-131-168 kubenswrapper[2565]: I0706 20:07:12.574577    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="afc3a51a-ebc0-4b61-87d7-b6404234d3e4" containerName="main"
Jul 06 20:07:12.574607 ip-10-0-131-168 kubenswrapper[2565]: I0706 20:07:12.574585    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="afc3a51a-ebc0-4b61-87d7-b6404234d3e4" containerName="main"
Jul 06 20:07:12.574712 ip-10-0-131-168 kubenswrapper[2565]: I0706 20:07:12.574666    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="afc3a51a-ebc0-4b61-87d7-b6404234d3e4" containerName="main"
Jul 06 20:07:12.574712 ip-10-0-131-168 kubenswrapper[2565]: I0706 20:07:12.574677    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="132a034d-5bd3-4d0f-b9c1-11d6e7f4c213" containerName="main"
Jul 06 20:07:12.577842 ip-10-0-131-168 kubenswrapper[2565]: I0706 20:07:12.577827    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-api-b-618838-66f5758db7-pff7l"
Jul 06 20:07:12.582418 ip-10-0-131-168 kubenswrapper[2565]: I0706 20:07:12.582398    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-e2e-api-b-618838-serving-cert\""
Jul 06 20:07:12.582539 ip-10-0-131-168 kubenswrapper[2565]: I0706 20:07:12.582461    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-dockercfg-2fvtb\""
Jul 06 20:07:12.596400 ip-10-0-131-168 kubenswrapper[2565]: I0706 20:07:12.596374    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-e2e-api-b-618838-66f5758db7-pff7l"]
Jul 06 20:07:12.652982 ip-10-0-131-168 kubenswrapper[2565]: I0706 20:07:12.652949    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/5fa79841-c314-4574-8bf2-f7fead0a8633-openshift-service-ca\") pod \"maas-api-e2e-api-b-618838-66f5758db7-pff7l\" (UID: \"5fa79841-c314-4574-8bf2-f7fead0a8633\") " pod="opendatahub/maas-api-e2e-api-b-618838-66f5758db7-pff7l"
Jul 06 20:07:12.653159 ip-10-0-131-168 kubenswrapper[2565]: I0706 20:07:12.652988    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/5fa79841-c314-4574-8bf2-f7fead0a8633-maas-api-tls\") pod \"maas-api-e2e-api-b-618838-66f5758db7-pff7l\" (UID: \"5fa79841-c314-4574-8bf2-f7fead0a8633\") " pod="opendatahub/maas-api-e2e-api-b-618838-66f5758db7-pff7l"
Jul 06 20:07:12.653159 ip-10-0-131-168 kubenswrapper[2565]: I0706 20:07:12.653015    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4tlf8\" (UniqueName: \"kubernetes.io/projected/5fa79841-c314-4574-8bf2-f7fead0a8633-kube-api-access-4tlf8\") pod \"maas-api-e2e-api-b-618838-66f5758db7-pff7l\" (UID: \"5fa79841-c314-4574-8bf2-f7fead0a8633\") " pod="opendatahub/maas-api-e2e-api-b-618838-66f5758db7-pff7l"
Jul 06 20:07:12.754402 ip-10-0-131-168 kubenswrapper[2565]: I0706 20:07:12.754366    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/5fa79841-c314-4574-8bf2-f7fead0a8633-openshift-service-ca\") pod \"maas-api-e2e-api-b-618838-66f5758db7-pff7l\" (UID: \"5fa79841-c314-4574-8bf2-f7fead0a8633\") " pod="opendatahub/maas-api-e2e-api-b-618838-66f5758db7-pff7l"
Jul 06 20:07:12.754402 ip-10-0-131-168 kubenswrapper[2565]: I0706 20:07:12.754405    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/5fa79841-c314-4574-8bf2-f7fead0a8633-maas-api-tls\") pod \"maas-api-e2e-api-b-618838-66f5758db7-pff7l\" (UID: \"5fa79841-c314-4574-8bf2-f7fead0a8633\") " pod="opendatahub/maas-api-e2e-api-b-618838-66f5758db7-pff7l"
Jul 06 20:07:12.754643 ip-10-0-131-168 kubenswrapper[2565]: I0706 20:07:12.754430    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4tlf8\" (UniqueName: \"kubernetes.io/projected/5fa79841-c314-4574-8bf2-f7fead0a8633-kube-api-access-4tlf8\") pod \"maas-api-e2e-api-b-618838-66f5758db7-pff7l\" (UID: \"5fa79841-c314-4574-8bf2-f7fead0a8633\") " pod="opendatahub/maas-api-e2e-api-b-618838-66f5758db7-pff7l"
Jul 06 20:07:12.754643 ip-10-0-131-168 kubenswrapper[2565]: E0706 20:07:12.754525    2565 secret.go:189] Couldn't get secret opendatahub/maas-api-e2e-api-b-618838-serving-cert: secret "maas-api-e2e-api-b-618838-serving-cert" not found
Jul 06 20:07:12.754643 ip-10-0-131-168 kubenswrapper[2565]: E0706 20:07:12.754592    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5fa79841-c314-4574-8bf2-f7fead0a8633-maas-api-tls podName:5fa79841-c314-4574-8bf2-f7fead0a8633 nodeName:}" failed. No retries permitted until 2026-07-06 20:07:13.254576303 +0000 UTC m=+2068.267564953 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/5fa79841-c314-4574-8bf2-f7fead0a8633-maas-api-tls") pod "maas-api-e2e-api-b-618838-66f5758db7-pff7l" (UID: "5fa79841-c314-4574-8bf2-f7fead0a8633") : secret "maas-api-e2e-api-b-618838-serving-cert" not found
Jul 06 20:07:12.755118 ip-10-0-131-168 kubenswrapper[2565]: I0706 20:07:12.755091    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/5fa79841-c314-4574-8bf2-f7fead0a8633-openshift-service-ca\") pod \"maas-api-e2e-api-b-618838-66f5758db7-pff7l\" (UID: \"5fa79841-c314-4574-8bf2-f7fead0a8633\") " pod="opendatahub/maas-api-e2e-api-b-618838-66f5758db7-pff7l"
Jul 06 20:07:12.777196 ip-10-0-131-168 kubenswrapper[2565]: I0706 20:07:12.777170    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4tlf8\" (UniqueName: \"kubernetes.io/projected/5fa79841-c314-4574-8bf2-f7fead0a8633-kube-api-access-4tlf8\") pod \"maas-api-e2e-api-b-618838-66f5758db7-pff7l\" (UID: \"5fa79841-c314-4574-8bf2-f7fead0a8633\") " pod="opendatahub/maas-api-e2e-api-b-618838-66f5758db7-pff7l"
Jul 06 20:07:13.259312 ip-10-0-131-168 kubenswrapper[2565]: I0706 20:07:13.259274    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/5fa79841-c314-4574-8bf2-f7fead0a8633-maas-api-tls\") pod \"maas-api-e2e-api-b-618838-66f5758db7-pff7l\" (UID: \"5fa79841-c314-4574-8bf2-f7fead0a8633\") " pod="opendatahub/maas-api-e2e-api-b-618838-66f5758db7-pff7l"
Jul 06 20:07:13.261649 ip-10-0-131-168 kubenswrapper[2565]: I0706 20:07:13.261618    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/5fa79841-c314-4574-8bf2-f7fead0a8633-maas-api-tls\") pod \"maas-api-e2e-api-b-618838-66f5758db7-pff7l\" (UID: \"5fa79841-c314-4574-8bf2-f7fead0a8633\") " pod="opendatahub/maas-api-e2e-api-b-618838-66f5758db7-pff7l"
Jul 06 20:07:13.489018 ip-10-0-131-168 kubenswrapper[2565]: I0706 20:07:13.488979    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-api-b-618838-66f5758db7-pff7l"
Jul 06 20:07:13.634689 ip-10-0-131-168 kubenswrapper[2565]: I0706 20:07:13.634651    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-e2e-api-b-618838-66f5758db7-pff7l"]
Jul 06 20:07:13.638892 ip-10-0-131-168 kubenswrapper[2565]: W0706 20:07:13.638860    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5fa79841_c314_4574_8bf2_f7fead0a8633.slice/crio-b0a167bc59d996b15d911d56e2bd84a7c5239e680095c750a7eb406fd778aee6 WatchSource:0}: Error finding container b0a167bc59d996b15d911d56e2bd84a7c5239e680095c750a7eb406fd778aee6: Status 404 returned error can't find the container with id b0a167bc59d996b15d911d56e2bd84a7c5239e680095c750a7eb406fd778aee6
Jul 06 20:07:13.640649 ip-10-0-131-168 kubenswrapper[2565]: I0706 20:07:13.640627    2565 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 06 20:07:14.518640 ip-10-0-131-168 kubenswrapper[2565]: I0706 20:07:14.518597    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-api-b-618838-66f5758db7-pff7l" event={"ID":"5fa79841-c314-4574-8bf2-f7fead0a8633","Type":"ContainerStarted","Data":"b0a167bc59d996b15d911d56e2bd84a7c5239e680095c750a7eb406fd778aee6"}
Jul 06 20:07:15.524957 ip-10-0-131-168 kubenswrapper[2565]: I0706 20:07:15.524921    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-api-b-618838-66f5758db7-pff7l" event={"ID":"5fa79841-c314-4574-8bf2-f7fead0a8633","Type":"ContainerStarted","Data":"19c26dcbdaf2331927d2f845818a820ee5f2635b70c89b5c02b414de2ad734ac"}
Jul 06 20:07:15.525365 ip-10-0-131-168 kubenswrapper[2565]: I0706 20:07:15.524995    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-api-e2e-api-b-618838-66f5758db7-pff7l"
Jul 06 20:07:15.554208 ip-10-0-131-168 kubenswrapper[2565]: I0706 20:07:15.554152    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-api-e2e-api-b-618838-66f5758db7-pff7l" podStartSLOduration=2.155706366 podStartE2EDuration="3.554135757s" totalImagesPullingTime="1.398429391s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 20:07:12 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 20:07:15.553703078 +0000 UTC m=+2070.566691747" watchObservedRunningTime="2026-07-06 20:07:15.554135757 +0000 UTC m=+2070.567124426"
Jul 06 20:07:21.534877 ip-10-0-131-168 kubenswrapper[2565]: I0706 20:07:21.534846    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-api-e2e-api-b-618838-66f5758db7-pff7l"
Jul 06 20:07:24.240137 ip-10-0-131-168 kubenswrapper[2565]: I0706 20:07:24.240104    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-mfwbr"]
Jul 06 20:07:33.828307 ip-10-0-131-168 kubenswrapper[2565]: I0706 20:07:33.828267    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-api-e2e-api-b-618838-66f5758db7-pff7l"]
Jul 06 20:07:33.828906 ip-10-0-131-168 kubenswrapper[2565]: I0706 20:07:33.828487    2565 kuberuntime_container.go:872] "Killing container with a grace period" pod="opendatahub/maas-api-e2e-api-b-618838-66f5758db7-pff7l" podUID="5fa79841-c314-4574-8bf2-f7fead0a8633" containerName="maas-api" containerID="cri-o://19c26dcbdaf2331927d2f845818a820ee5f2635b70c89b5c02b414de2ad734ac" gracePeriod=30
Jul 06 20:07:34.078182 ip-10-0-131-168 kubenswrapper[2565]: I0706 20:07:34.078154    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-api-b-618838-66f5758db7-pff7l"
Jul 06 20:07:34.247706 ip-10-0-131-168 kubenswrapper[2565]: I0706 20:07:34.247675    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/5fa79841-c314-4574-8bf2-f7fead0a8633-maas-api-tls\") pod \"5fa79841-c314-4574-8bf2-f7fead0a8633\" (UID: \"5fa79841-c314-4574-8bf2-f7fead0a8633\") "
Jul 06 20:07:34.247912 ip-10-0-131-168 kubenswrapper[2565]: I0706 20:07:34.247824    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/5fa79841-c314-4574-8bf2-f7fead0a8633-openshift-service-ca\") pod \"5fa79841-c314-4574-8bf2-f7fead0a8633\" (UID: \"5fa79841-c314-4574-8bf2-f7fead0a8633\") "
Jul 06 20:07:34.247912 ip-10-0-131-168 kubenswrapper[2565]: I0706 20:07:34.247850    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-4tlf8\" (UniqueName: \"kubernetes.io/projected/5fa79841-c314-4574-8bf2-f7fead0a8633-kube-api-access-4tlf8\") pod \"5fa79841-c314-4574-8bf2-f7fead0a8633\" (UID: \"5fa79841-c314-4574-8bf2-f7fead0a8633\") "
Jul 06 20:07:34.248177 ip-10-0-131-168 kubenswrapper[2565]: I0706 20:07:34.248150    2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5fa79841-c314-4574-8bf2-f7fead0a8633-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "5fa79841-c314-4574-8bf2-f7fead0a8633" (UID: "5fa79841-c314-4574-8bf2-f7fead0a8633"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 06 20:07:34.249947 ip-10-0-131-168 kubenswrapper[2565]: I0706 20:07:34.249913    2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5fa79841-c314-4574-8bf2-f7fead0a8633-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "5fa79841-c314-4574-8bf2-f7fead0a8633" (UID: "5fa79841-c314-4574-8bf2-f7fead0a8633"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 06 20:07:34.249947 ip-10-0-131-168 kubenswrapper[2565]: I0706 20:07:34.249939    2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5fa79841-c314-4574-8bf2-f7fead0a8633-kube-api-access-4tlf8" (OuterVolumeSpecName: "kube-api-access-4tlf8") pod "5fa79841-c314-4574-8bf2-f7fead0a8633" (UID: "5fa79841-c314-4574-8bf2-f7fead0a8633"). InnerVolumeSpecName "kube-api-access-4tlf8". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 06 20:07:34.349255 ip-10-0-131-168 kubenswrapper[2565]: I0706 20:07:34.349220    2565 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/5fa79841-c314-4574-8bf2-f7fead0a8633-openshift-service-ca\") on node \"ip-10-0-131-168.ec2.internal\" DevicePath \"\""
Jul 06 20:07:34.349255 ip-10-0-131-168 kubenswrapper[2565]: I0706 20:07:34.349247    2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-4tlf8\" (UniqueName: \"kubernetes.io/projected/5fa79841-c314-4574-8bf2-f7fead0a8633-kube-api-access-4tlf8\") on node \"ip-10-0-131-168.ec2.internal\" DevicePath \"\""
Jul 06 20:07:34.349255 ip-10-0-131-168 kubenswrapper[2565]: I0706 20:07:34.349260    2565 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/5fa79841-c314-4574-8bf2-f7fead0a8633-maas-api-tls\") on node \"ip-10-0-131-168.ec2.internal\" DevicePath \"\""
Jul 06 20:07:34.610093 ip-10-0-131-168 kubenswrapper[2565]: I0706 20:07:34.610064    2565 generic.go:356] "Generic (PLEG): container finished" podID="5fa79841-c314-4574-8bf2-f7fead0a8633" containerID="19c26dcbdaf2331927d2f845818a820ee5f2635b70c89b5c02b414de2ad734ac" exitCode=0
Jul 06 20:07:34.610250 ip-10-0-131-168 kubenswrapper[2565]: I0706 20:07:34.610108    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-api-b-618838-66f5758db7-pff7l"
Jul 06 20:07:34.610250 ip-10-0-131-168 kubenswrapper[2565]: I0706 20:07:34.610117    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-api-b-618838-66f5758db7-pff7l" event={"ID":"5fa79841-c314-4574-8bf2-f7fead0a8633","Type":"ContainerDied","Data":"19c26dcbdaf2331927d2f845818a820ee5f2635b70c89b5c02b414de2ad734ac"}
Jul 06 20:07:34.610250 ip-10-0-131-168 kubenswrapper[2565]: I0706 20:07:34.610160    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-api-b-618838-66f5758db7-pff7l" event={"ID":"5fa79841-c314-4574-8bf2-f7fead0a8633","Type":"ContainerDied","Data":"b0a167bc59d996b15d911d56e2bd84a7c5239e680095c750a7eb406fd778aee6"}
Jul 06 20:07:34.610250 ip-10-0-131-168 kubenswrapper[2565]: I0706 20:07:34.610181    2565 scope.go:117] "RemoveContainer" containerID="19c26dcbdaf2331927d2f845818a820ee5f2635b70c89b5c02b414de2ad734ac"
Jul 06 20:07:34.620027 ip-10-0-131-168 kubenswrapper[2565]: I0706 20:07:34.620012    2565 scope.go:117] "RemoveContainer" containerID="19c26dcbdaf2331927d2f845818a820ee5f2635b70c89b5c02b414de2ad734ac"
Jul 06 20:07:34.620260 ip-10-0-131-168 kubenswrapper[2565]: E0706 20:07:34.620243    2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"19c26dcbdaf2331927d2f845818a820ee5f2635b70c89b5c02b414de2ad734ac\": container with ID starting with 19c26dcbdaf2331927d2f845818a820ee5f2635b70c89b5c02b414de2ad734ac not found: ID does not exist" containerID="19c26dcbdaf2331927d2f845818a820ee5f2635b70c89b5c02b414de2ad734ac"
Jul 06 20:07:34.620297 ip-10-0-131-168 kubenswrapper[2565]: I0706 20:07:34.620268    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"19c26dcbdaf2331927d2f845818a820ee5f2635b70c89b5c02b414de2ad734ac"} err="failed to get container status \"19c26dcbdaf2331927d2f845818a820ee5f2635b70c89b5c02b414de2ad734ac\": rpc error: code = NotFound desc = could not find container \"19c26dcbdaf2331927d2f845818a820ee5f2635b70c89b5c02b414de2ad734ac\": container with ID starting with 19c26dcbdaf2331927d2f845818a820ee5f2635b70c89b5c02b414de2ad734ac not found: ID does not exist"
Jul 06 20:07:34.635187 ip-10-0-131-168 kubenswrapper[2565]: I0706 20:07:34.635162    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-api-e2e-api-b-618838-66f5758db7-pff7l"]
Jul 06 20:07:34.640397 ip-10-0-131-168 kubenswrapper[2565]: I0706 20:07:34.640375    2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-api-e2e-api-b-618838-66f5758db7-pff7l"]
Jul 06 20:07:35.497883 ip-10-0-131-168 kubenswrapper[2565]: I0706 20:07:35.497837    2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="5fa79841-c314-4574-8bf2-f7fead0a8633" path="/var/lib/kubelet/pods/5fa79841-c314-4574-8bf2-f7fead0a8633/volumes"
Jul 06 20:07:35.635047 ip-10-0-131-168 kubenswrapper[2565]: I0706 20:07:35.635013    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-mfwbr"]
Jul 06 20:07:44.518349 ip-10-0-131-168 kubenswrapper[2565]: I0706 20:07:44.518308    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-api-e2e-shared-a-ad5c84-78db7c56fb-wmsg8"]
Jul 06 20:07:44.518842 ip-10-0-131-168 kubenswrapper[2565]: I0706 20:07:44.518712    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5fa79841-c314-4574-8bf2-f7fead0a8633" containerName="maas-api"
Jul 06 20:07:44.518842 ip-10-0-131-168 kubenswrapper[2565]: I0706 20:07:44.518726    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="5fa79841-c314-4574-8bf2-f7fead0a8633" containerName="maas-api"
Jul 06 20:07:44.518842 ip-10-0-131-168 kubenswrapper[2565]: I0706 20:07:44.518820    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="5fa79841-c314-4574-8bf2-f7fead0a8633" containerName="maas-api"
Jul 06 20:07:44.523098 ip-10-0-131-168 kubenswrapper[2565]: I0706 20:07:44.523076    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-shared-a-ad5c84-78db7c56fb-wmsg8"
Jul 06 20:07:44.526273 ip-10-0-131-168 kubenswrapper[2565]: I0706 20:07:44.526245    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-dockercfg-2fvtb\""
Jul 06 20:07:44.526607 ip-10-0-131-168 kubenswrapper[2565]: I0706 20:07:44.526582    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-e2e-shared-a-ad5c84-serving-cert\""
Jul 06 20:07:44.550307 ip-10-0-131-168 kubenswrapper[2565]: I0706 20:07:44.550275    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-e2e-shared-a-ad5c84-78db7c56fb-wmsg8"]
Jul 06 20:07:44.629485 ip-10-0-131-168 kubenswrapper[2565]: I0706 20:07:44.629451    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sv9gg\" (UniqueName: \"kubernetes.io/projected/f129de78-75e0-4662-b154-cc4da4cf26ce-kube-api-access-sv9gg\") pod \"maas-api-e2e-shared-a-ad5c84-78db7c56fb-wmsg8\" (UID: \"f129de78-75e0-4662-b154-cc4da4cf26ce\") " pod="opendatahub/maas-api-e2e-shared-a-ad5c84-78db7c56fb-wmsg8"
Jul 06 20:07:44.629661 ip-10-0-131-168 kubenswrapper[2565]: I0706 20:07:44.629515    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/f129de78-75e0-4662-b154-cc4da4cf26ce-maas-api-tls\") pod \"maas-api-e2e-shared-a-ad5c84-78db7c56fb-wmsg8\" (UID: \"f129de78-75e0-4662-b154-cc4da4cf26ce\") " pod="opendatahub/maas-api-e2e-shared-a-ad5c84-78db7c56fb-wmsg8"
Jul 06 20:07:44.629661 ip-10-0-131-168 kubenswrapper[2565]: I0706 20:07:44.629548    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/f129de78-75e0-4662-b154-cc4da4cf26ce-openshift-service-ca\") pod \"maas-api-e2e-shared-a-ad5c84-78db7c56fb-wmsg8\" (UID: \"f129de78-75e0-4662-b154-cc4da4cf26ce\") " pod="opendatahub/maas-api-e2e-shared-a-ad5c84-78db7c56fb-wmsg8"
Jul 06 20:07:44.731020 ip-10-0-131-168 kubenswrapper[2565]: I0706 20:07:44.730986    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sv9gg\" (UniqueName: \"kubernetes.io/projected/f129de78-75e0-4662-b154-cc4da4cf26ce-kube-api-access-sv9gg\") pod \"maas-api-e2e-shared-a-ad5c84-78db7c56fb-wmsg8\" (UID: \"f129de78-75e0-4662-b154-cc4da4cf26ce\") " pod="opendatahub/maas-api-e2e-shared-a-ad5c84-78db7c56fb-wmsg8"
Jul 06 20:07:44.731191 ip-10-0-131-168 kubenswrapper[2565]: I0706 20:07:44.731049    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/f129de78-75e0-4662-b154-cc4da4cf26ce-maas-api-tls\") pod \"maas-api-e2e-shared-a-ad5c84-78db7c56fb-wmsg8\" (UID: \"f129de78-75e0-4662-b154-cc4da4cf26ce\") " pod="opendatahub/maas-api-e2e-shared-a-ad5c84-78db7c56fb-wmsg8"
Jul 06 20:07:44.731191 ip-10-0-131-168 kubenswrapper[2565]: I0706 20:07:44.731087    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/f129de78-75e0-4662-b154-cc4da4cf26ce-openshift-service-ca\") pod \"maas-api-e2e-shared-a-ad5c84-78db7c56fb-wmsg8\" (UID: \"f129de78-75e0-4662-b154-cc4da4cf26ce\") " pod="opendatahub/maas-api-e2e-shared-a-ad5c84-78db7c56fb-wmsg8"
Jul 06 20:07:44.731797 ip-10-0-131-168 kubenswrapper[2565]: I0706 20:07:44.731750    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/f129de78-75e0-4662-b154-cc4da4cf26ce-openshift-service-ca\") pod \"maas-api-e2e-shared-a-ad5c84-78db7c56fb-wmsg8\" (UID: \"f129de78-75e0-4662-b154-cc4da4cf26ce\") " pod="opendatahub/maas-api-e2e-shared-a-ad5c84-78db7c56fb-wmsg8"
Jul 06 20:07:44.733567 ip-10-0-131-168 kubenswrapper[2565]: I0706 20:07:44.733539    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/f129de78-75e0-4662-b154-cc4da4cf26ce-maas-api-tls\") pod \"maas-api-e2e-shared-a-ad5c84-78db7c56fb-wmsg8\" (UID: \"f129de78-75e0-4662-b154-cc4da4cf26ce\") " pod="opendatahub/maas-api-e2e-shared-a-ad5c84-78db7c56fb-wmsg8"
Jul 06 20:07:44.758410 ip-10-0-131-168 kubenswrapper[2565]: I0706 20:07:44.758378    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-mfwbr"]
Jul 06 20:07:44.758749 ip-10-0-131-168 kubenswrapper[2565]: I0706 20:07:44.758732    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-sv9gg\" (UniqueName: \"kubernetes.io/projected/f129de78-75e0-4662-b154-cc4da4cf26ce-kube-api-access-sv9gg\") pod \"maas-api-e2e-shared-a-ad5c84-78db7c56fb-wmsg8\" (UID: \"f129de78-75e0-4662-b154-cc4da4cf26ce\") " pod="opendatahub/maas-api-e2e-shared-a-ad5c84-78db7c56fb-wmsg8"
Jul 06 20:07:44.832956 ip-10-0-131-168 kubenswrapper[2565]: I0706 20:07:44.832895    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-shared-a-ad5c84-78db7c56fb-wmsg8"
Jul 06 20:07:44.968355 ip-10-0-131-168 kubenswrapper[2565]: I0706 20:07:44.968328    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-e2e-shared-a-ad5c84-78db7c56fb-wmsg8"]
Jul 06 20:07:44.970469 ip-10-0-131-168 kubenswrapper[2565]: W0706 20:07:44.970443    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf129de78_75e0_4662_b154_cc4da4cf26ce.slice/crio-a9309f1db666e22da534653f2255043c5f94b222079dd79b17a1b6952131a7a2 WatchSource:0}: Error finding container a9309f1db666e22da534653f2255043c5f94b222079dd79b17a1b6952131a7a2: Status 404 returned error can't find the container with id a9309f1db666e22da534653f2255043c5f94b222079dd79b17a1b6952131a7a2
Jul 06 20:07:45.485864 ip-10-0-131-168 kubenswrapper[2565]: I0706 20:07:45.485833    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-8kjqk_9f15114d-7494-4f17-8a4d-52185f7a2e35/ovn-acl-logging/0.log"
Jul 06 20:07:45.489395 ip-10-0-131-168 kubenswrapper[2565]: I0706 20:07:45.489373    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-8kjqk_9f15114d-7494-4f17-8a4d-52185f7a2e35/ovn-acl-logging/0.log"
Jul 06 20:07:45.660844 ip-10-0-131-168 kubenswrapper[2565]: I0706 20:07:45.660804    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-shared-a-ad5c84-78db7c56fb-wmsg8" event={"ID":"f129de78-75e0-4662-b154-cc4da4cf26ce","Type":"ContainerStarted","Data":"9875be2edc27a3ceb6acf3a9e6d7ef7b3475975ff0acff5c5566302ef85e7d53"}
Jul 06 20:07:45.661196 ip-10-0-131-168 kubenswrapper[2565]: I0706 20:07:45.660864    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-shared-a-ad5c84-78db7c56fb-wmsg8" event={"ID":"f129de78-75e0-4662-b154-cc4da4cf26ce","Type":"ContainerStarted","Data":"a9309f1db666e22da534653f2255043c5f94b222079dd79b17a1b6952131a7a2"}
Jul 06 20:07:45.661196 ip-10-0-131-168 kubenswrapper[2565]: I0706 20:07:45.660926    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-api-e2e-shared-a-ad5c84-78db7c56fb-wmsg8"
Jul 06 20:07:45.683039 ip-10-0-131-168 kubenswrapper[2565]: I0706 20:07:45.682998    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-api-e2e-shared-a-ad5c84-78db7c56fb-wmsg8" podStartSLOduration=1.304984611 podStartE2EDuration="1.682983138s" totalImagesPullingTime="377.998527ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 20:07:44 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 20:07:45.682087867 +0000 UTC m=+2100.695076563" watchObservedRunningTime="2026-07-06 20:07:45.682983138 +0000 UTC m=+2100.695971808"
Jul 06 20:07:51.671319 ip-10-0-131-168 kubenswrapper[2565]: I0706 20:07:51.671287    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-api-e2e-shared-a-ad5c84-78db7c56fb-wmsg8"
Jul 06 20:07:52.848511 ip-10-0-131-168 kubenswrapper[2565]: I0706 20:07:52.848476    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-api-e2e-shared-b-d1d0db-78894d5f7c-lvzls"]
Jul 06 20:07:52.852024 ip-10-0-131-168 kubenswrapper[2565]: I0706 20:07:52.852006    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-shared-b-d1d0db-78894d5f7c-lvzls"
Jul 06 20:07:52.854837 ip-10-0-131-168 kubenswrapper[2565]: I0706 20:07:52.854814    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-e2e-shared-b-d1d0db-serving-cert\""
Jul 06 20:07:52.871013 ip-10-0-131-168 kubenswrapper[2565]: I0706 20:07:52.870993    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-e2e-shared-b-d1d0db-78894d5f7c-lvzls"]
Jul 06 20:07:52.899967 ip-10-0-131-168 kubenswrapper[2565]: I0706 20:07:52.899943    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rt5z6\" (UniqueName: \"kubernetes.io/projected/81dc7154-bd58-4cf5-b3a8-d24743d4c59e-kube-api-access-rt5z6\") pod \"maas-api-e2e-shared-b-d1d0db-78894d5f7c-lvzls\" (UID: \"81dc7154-bd58-4cf5-b3a8-d24743d4c59e\") " pod="opendatahub/maas-api-e2e-shared-b-d1d0db-78894d5f7c-lvzls"
Jul 06 20:07:52.900086 ip-10-0-131-168 kubenswrapper[2565]: I0706 20:07:52.899975    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/81dc7154-bd58-4cf5-b3a8-d24743d4c59e-maas-api-tls\") pod \"maas-api-e2e-shared-b-d1d0db-78894d5f7c-lvzls\" (UID: \"81dc7154-bd58-4cf5-b3a8-d24743d4c59e\") " pod="opendatahub/maas-api-e2e-shared-b-d1d0db-78894d5f7c-lvzls"
Jul 06 20:07:52.900133 ip-10-0-131-168 kubenswrapper[2565]: I0706 20:07:52.900099    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/81dc7154-bd58-4cf5-b3a8-d24743d4c59e-openshift-service-ca\") pod \"maas-api-e2e-shared-b-d1d0db-78894d5f7c-lvzls\" (UID: \"81dc7154-bd58-4cf5-b3a8-d24743d4c59e\") " pod="opendatahub/maas-api-e2e-shared-b-d1d0db-78894d5f7c-lvzls"
Jul 06 20:07:53.001063 ip-10-0-131-168 kubenswrapper[2565]: I0706 20:07:53.001026    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rt5z6\" (UniqueName: \"kubernetes.io/projected/81dc7154-bd58-4cf5-b3a8-d24743d4c59e-kube-api-access-rt5z6\") pod \"maas-api-e2e-shared-b-d1d0db-78894d5f7c-lvzls\" (UID: \"81dc7154-bd58-4cf5-b3a8-d24743d4c59e\") " pod="opendatahub/maas-api-e2e-shared-b-d1d0db-78894d5f7c-lvzls"
Jul 06 20:07:53.001063 ip-10-0-131-168 kubenswrapper[2565]: I0706 20:07:53.001066    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/81dc7154-bd58-4cf5-b3a8-d24743d4c59e-maas-api-tls\") pod \"maas-api-e2e-shared-b-d1d0db-78894d5f7c-lvzls\" (UID: \"81dc7154-bd58-4cf5-b3a8-d24743d4c59e\") " pod="opendatahub/maas-api-e2e-shared-b-d1d0db-78894d5f7c-lvzls"
Jul 06 20:07:53.001296 ip-10-0-131-168 kubenswrapper[2565]: I0706 20:07:53.001158    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/81dc7154-bd58-4cf5-b3a8-d24743d4c59e-openshift-service-ca\") pod \"maas-api-e2e-shared-b-d1d0db-78894d5f7c-lvzls\" (UID: \"81dc7154-bd58-4cf5-b3a8-d24743d4c59e\") " pod="opendatahub/maas-api-e2e-shared-b-d1d0db-78894d5f7c-lvzls"
Jul 06 20:07:53.001296 ip-10-0-131-168 kubenswrapper[2565]: E0706 20:07:53.001263    2565 secret.go:189] Couldn't get secret opendatahub/maas-api-e2e-shared-b-d1d0db-serving-cert: secret "maas-api-e2e-shared-b-d1d0db-serving-cert" not found
Jul 06 20:07:53.001402 ip-10-0-131-168 kubenswrapper[2565]: E0706 20:07:53.001344    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/81dc7154-bd58-4cf5-b3a8-d24743d4c59e-maas-api-tls podName:81dc7154-bd58-4cf5-b3a8-d24743d4c59e nodeName:}" failed. No retries permitted until 2026-07-06 20:07:53.501320135 +0000 UTC m=+2108.514308811 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/81dc7154-bd58-4cf5-b3a8-d24743d4c59e-maas-api-tls") pod "maas-api-e2e-shared-b-d1d0db-78894d5f7c-lvzls" (UID: "81dc7154-bd58-4cf5-b3a8-d24743d4c59e") : secret "maas-api-e2e-shared-b-d1d0db-serving-cert" not found
Jul 06 20:07:53.001803 ip-10-0-131-168 kubenswrapper[2565]: I0706 20:07:53.001761    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/81dc7154-bd58-4cf5-b3a8-d24743d4c59e-openshift-service-ca\") pod \"maas-api-e2e-shared-b-d1d0db-78894d5f7c-lvzls\" (UID: \"81dc7154-bd58-4cf5-b3a8-d24743d4c59e\") " pod="opendatahub/maas-api-e2e-shared-b-d1d0db-78894d5f7c-lvzls"
Jul 06 20:07:53.010937 ip-10-0-131-168 kubenswrapper[2565]: I0706 20:07:53.010913    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rt5z6\" (UniqueName: \"kubernetes.io/projected/81dc7154-bd58-4cf5-b3a8-d24743d4c59e-kube-api-access-rt5z6\") pod \"maas-api-e2e-shared-b-d1d0db-78894d5f7c-lvzls\" (UID: \"81dc7154-bd58-4cf5-b3a8-d24743d4c59e\") " pod="opendatahub/maas-api-e2e-shared-b-d1d0db-78894d5f7c-lvzls"
Jul 06 20:07:53.506628 ip-10-0-131-168 kubenswrapper[2565]: I0706 20:07:53.506599    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/81dc7154-bd58-4cf5-b3a8-d24743d4c59e-maas-api-tls\") pod \"maas-api-e2e-shared-b-d1d0db-78894d5f7c-lvzls\" (UID: \"81dc7154-bd58-4cf5-b3a8-d24743d4c59e\") " pod="opendatahub/maas-api-e2e-shared-b-d1d0db-78894d5f7c-lvzls"
Jul 06 20:07:53.509015 ip-10-0-131-168 kubenswrapper[2565]: I0706 20:07:53.508984    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/81dc7154-bd58-4cf5-b3a8-d24743d4c59e-maas-api-tls\") pod \"maas-api-e2e-shared-b-d1d0db-78894d5f7c-lvzls\" (UID: \"81dc7154-bd58-4cf5-b3a8-d24743d4c59e\") " pod="opendatahub/maas-api-e2e-shared-b-d1d0db-78894d5f7c-lvzls"
Jul 06 20:07:53.762326 ip-10-0-131-168 kubenswrapper[2565]: I0706 20:07:53.762245    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-shared-b-d1d0db-78894d5f7c-lvzls"
Jul 06 20:07:53.921328 ip-10-0-131-168 kubenswrapper[2565]: I0706 20:07:53.921300    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-e2e-shared-b-d1d0db-78894d5f7c-lvzls"]
Jul 06 20:07:53.922894 ip-10-0-131-168 kubenswrapper[2565]: W0706 20:07:53.922866    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod81dc7154_bd58_4cf5_b3a8_d24743d4c59e.slice/crio-49077809a4b0f2527bdfad5e8c530ad7b1cf6b00a8eed3e20256799340a47742 WatchSource:0}: Error finding container 49077809a4b0f2527bdfad5e8c530ad7b1cf6b00a8eed3e20256799340a47742: Status 404 returned error can't find the container with id 49077809a4b0f2527bdfad5e8c530ad7b1cf6b00a8eed3e20256799340a47742
Jul 06 20:07:54.706830 ip-10-0-131-168 kubenswrapper[2565]: I0706 20:07:54.706795    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-shared-b-d1d0db-78894d5f7c-lvzls" event={"ID":"81dc7154-bd58-4cf5-b3a8-d24743d4c59e","Type":"ContainerStarted","Data":"6aa348fb9d6d4e5f6f2e6e056f774399981405523e99238504f611ef42938c30"}
Jul 06 20:07:54.707030 ip-10-0-131-168 kubenswrapper[2565]: I0706 20:07:54.706853    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-shared-b-d1d0db-78894d5f7c-lvzls" event={"ID":"81dc7154-bd58-4cf5-b3a8-d24743d4c59e","Type":"ContainerStarted","Data":"49077809a4b0f2527bdfad5e8c530ad7b1cf6b00a8eed3e20256799340a47742"}
Jul 06 20:07:54.707030 ip-10-0-131-168 kubenswrapper[2565]: I0706 20:07:54.706894    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-api-e2e-shared-b-d1d0db-78894d5f7c-lvzls"
Jul 06 20:07:54.732305 ip-10-0-131-168 kubenswrapper[2565]: I0706 20:07:54.732256    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-api-e2e-shared-b-d1d0db-78894d5f7c-lvzls" podStartSLOduration=2.397882552 podStartE2EDuration="2.732242009s" totalImagesPullingTime="334.359457ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 20:07:52 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 20:07:54.728939549 +0000 UTC m=+2109.741928284" watchObservedRunningTime="2026-07-06 20:07:54.732242009 +0000 UTC m=+2109.745230685"
Jul 06 20:07:59.333378 ip-10-0-131-168 kubenswrapper[2565]: I0706 20:07:59.333341    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-mfwbr"]
Jul 06 20:08:00.717765 ip-10-0-131-168 kubenswrapper[2565]: I0706 20:08:00.717730    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-api-e2e-shared-b-d1d0db-78894d5f7c-lvzls"
Jul 06 20:08:15.298383 ip-10-0-131-168 kubenswrapper[2565]: I0706 20:08:15.298344    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-a-ad5c84/auth-test-model-ad5c84-kserve-7fcb7988c5-jbl8x"]
Jul 06 20:08:15.302277 ip-10-0-131-168 kubenswrapper[2565]: I0706 20:08:15.302252    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-ad5c84/auth-test-model-ad5c84-kserve-7fcb7988c5-jbl8x"
Jul 06 20:08:15.305496 ip-10-0-131-168 kubenswrapper[2565]: I0706 20:08:15.305470    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-a-ad5c84\"/\"default-dockercfg-4w4g5\""
Jul 06 20:08:15.306832 ip-10-0-131-168 kubenswrapper[2565]: I0706 20:08:15.306813    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-a-ad5c84\"/\"openshift-service-ca.crt\""
Jul 06 20:08:15.306943 ip-10-0-131-168 kubenswrapper[2565]: I0706 20:08:15.306845    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-a-ad5c84\"/\"auth-test-model-ad5c84-kserve-self-signed-certs\""
Jul 06 20:08:15.306943 ip-10-0-131-168 kubenswrapper[2565]: I0706 20:08:15.306847    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-a-ad5c84\"/\"kube-root-ca.crt\""
Jul 06 20:08:15.322061 ip-10-0-131-168 kubenswrapper[2565]: I0706 20:08:15.322035    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-ad5c84/auth-test-model-ad5c84-kserve-7fcb7988c5-jbl8x"]
Jul 06 20:08:15.406599 ip-10-0-131-168 kubenswrapper[2565]: I0706 20:08:15.406562    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kg6nm\" (UniqueName: \"kubernetes.io/projected/e711b057-6f19-4c75-b2c3-a2e986f82807-kube-api-access-kg6nm\") pod \"auth-test-model-ad5c84-kserve-7fcb7988c5-jbl8x\" (UID: \"e711b057-6f19-4c75-b2c3-a2e986f82807\") " pod="ai-tenant-e2e-shared-a-ad5c84/auth-test-model-ad5c84-kserve-7fcb7988c5-jbl8x"
Jul 06 20:08:15.406599 ip-10-0-131-168 kubenswrapper[2565]: I0706 20:08:15.406601    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/e711b057-6f19-4c75-b2c3-a2e986f82807-model-cache\") pod \"auth-test-model-ad5c84-kserve-7fcb7988c5-jbl8x\" (UID: \"e711b057-6f19-4c75-b2c3-a2e986f82807\") " pod="ai-tenant-e2e-shared-a-ad5c84/auth-test-model-ad5c84-kserve-7fcb7988c5-jbl8x"
Jul 06 20:08:15.406842 ip-10-0-131-168 kubenswrapper[2565]: I0706 20:08:15.406691    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/e711b057-6f19-4c75-b2c3-a2e986f82807-dshm\") pod \"auth-test-model-ad5c84-kserve-7fcb7988c5-jbl8x\" (UID: \"e711b057-6f19-4c75-b2c3-a2e986f82807\") " pod="ai-tenant-e2e-shared-a-ad5c84/auth-test-model-ad5c84-kserve-7fcb7988c5-jbl8x"
Jul 06 20:08:15.406842 ip-10-0-131-168 kubenswrapper[2565]: I0706 20:08:15.406721    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/e711b057-6f19-4c75-b2c3-a2e986f82807-tmp-dir\") pod \"auth-test-model-ad5c84-kserve-7fcb7988c5-jbl8x\" (UID: \"e711b057-6f19-4c75-b2c3-a2e986f82807\") " pod="ai-tenant-e2e-shared-a-ad5c84/auth-test-model-ad5c84-kserve-7fcb7988c5-jbl8x"
Jul 06 20:08:15.406842 ip-10-0-131-168 kubenswrapper[2565]: I0706 20:08:15.406813    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/e711b057-6f19-4c75-b2c3-a2e986f82807-home\") pod \"auth-test-model-ad5c84-kserve-7fcb7988c5-jbl8x\" (UID: \"e711b057-6f19-4c75-b2c3-a2e986f82807\") " pod="ai-tenant-e2e-shared-a-ad5c84/auth-test-model-ad5c84-kserve-7fcb7988c5-jbl8x"
Jul 06 20:08:15.406943 ip-10-0-131-168 kubenswrapper[2565]: I0706 20:08:15.406867    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/e711b057-6f19-4c75-b2c3-a2e986f82807-tls-certs\") pod \"auth-test-model-ad5c84-kserve-7fcb7988c5-jbl8x\" (UID: \"e711b057-6f19-4c75-b2c3-a2e986f82807\") " pod="ai-tenant-e2e-shared-a-ad5c84/auth-test-model-ad5c84-kserve-7fcb7988c5-jbl8x"
Jul 06 20:08:15.507587 ip-10-0-131-168 kubenswrapper[2565]: I0706 20:08:15.507558    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kg6nm\" (UniqueName: \"kubernetes.io/projected/e711b057-6f19-4c75-b2c3-a2e986f82807-kube-api-access-kg6nm\") pod \"auth-test-model-ad5c84-kserve-7fcb7988c5-jbl8x\" (UID: \"e711b057-6f19-4c75-b2c3-a2e986f82807\") " pod="ai-tenant-e2e-shared-a-ad5c84/auth-test-model-ad5c84-kserve-7fcb7988c5-jbl8x"
Jul 06 20:08:15.507784 ip-10-0-131-168 kubenswrapper[2565]: I0706 20:08:15.507596    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/e711b057-6f19-4c75-b2c3-a2e986f82807-model-cache\") pod \"auth-test-model-ad5c84-kserve-7fcb7988c5-jbl8x\" (UID: \"e711b057-6f19-4c75-b2c3-a2e986f82807\") " pod="ai-tenant-e2e-shared-a-ad5c84/auth-test-model-ad5c84-kserve-7fcb7988c5-jbl8x"
Jul 06 20:08:15.507784 ip-10-0-131-168 kubenswrapper[2565]: I0706 20:08:15.507637    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/e711b057-6f19-4c75-b2c3-a2e986f82807-dshm\") pod \"auth-test-model-ad5c84-kserve-7fcb7988c5-jbl8x\" (UID: \"e711b057-6f19-4c75-b2c3-a2e986f82807\") " pod="ai-tenant-e2e-shared-a-ad5c84/auth-test-model-ad5c84-kserve-7fcb7988c5-jbl8x"
Jul 06 20:08:15.507784 ip-10-0-131-168 kubenswrapper[2565]: I0706 20:08:15.507659    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/e711b057-6f19-4c75-b2c3-a2e986f82807-tmp-dir\") pod \"auth-test-model-ad5c84-kserve-7fcb7988c5-jbl8x\" (UID: \"e711b057-6f19-4c75-b2c3-a2e986f82807\") " pod="ai-tenant-e2e-shared-a-ad5c84/auth-test-model-ad5c84-kserve-7fcb7988c5-jbl8x"
Jul 06 20:08:15.507784 ip-10-0-131-168 kubenswrapper[2565]: I0706 20:08:15.507681    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/e711b057-6f19-4c75-b2c3-a2e986f82807-home\") pod \"auth-test-model-ad5c84-kserve-7fcb7988c5-jbl8x\" (UID: \"e711b057-6f19-4c75-b2c3-a2e986f82807\") " pod="ai-tenant-e2e-shared-a-ad5c84/auth-test-model-ad5c84-kserve-7fcb7988c5-jbl8x"
Jul 06 20:08:15.507784 ip-10-0-131-168 kubenswrapper[2565]: I0706 20:08:15.507721    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/e711b057-6f19-4c75-b2c3-a2e986f82807-tls-certs\") pod \"auth-test-model-ad5c84-kserve-7fcb7988c5-jbl8x\" (UID: \"e711b057-6f19-4c75-b2c3-a2e986f82807\") " pod="ai-tenant-e2e-shared-a-ad5c84/auth-test-model-ad5c84-kserve-7fcb7988c5-jbl8x"
Jul 06 20:08:15.508114 ip-10-0-131-168 kubenswrapper[2565]: I0706 20:08:15.508086    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/e711b057-6f19-4c75-b2c3-a2e986f82807-model-cache\") pod \"auth-test-model-ad5c84-kserve-7fcb7988c5-jbl8x\" (UID: \"e711b057-6f19-4c75-b2c3-a2e986f82807\") " pod="ai-tenant-e2e-shared-a-ad5c84/auth-test-model-ad5c84-kserve-7fcb7988c5-jbl8x"
Jul 06 20:08:15.508177 ip-10-0-131-168 kubenswrapper[2565]: I0706 20:08:15.508116    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/e711b057-6f19-4c75-b2c3-a2e986f82807-home\") pod \"auth-test-model-ad5c84-kserve-7fcb7988c5-jbl8x\" (UID: \"e711b057-6f19-4c75-b2c3-a2e986f82807\") " pod="ai-tenant-e2e-shared-a-ad5c84/auth-test-model-ad5c84-kserve-7fcb7988c5-jbl8x"
Jul 06 20:08:15.508177 ip-10-0-131-168 kubenswrapper[2565]: I0706 20:08:15.508167    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/e711b057-6f19-4c75-b2c3-a2e986f82807-tmp-dir\") pod \"auth-test-model-ad5c84-kserve-7fcb7988c5-jbl8x\" (UID: \"e711b057-6f19-4c75-b2c3-a2e986f82807\") " pod="ai-tenant-e2e-shared-a-ad5c84/auth-test-model-ad5c84-kserve-7fcb7988c5-jbl8x"
Jul 06 20:08:15.510179 ip-10-0-131-168 kubenswrapper[2565]: I0706 20:08:15.510152    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/e711b057-6f19-4c75-b2c3-a2e986f82807-dshm\") pod \"auth-test-model-ad5c84-kserve-7fcb7988c5-jbl8x\" (UID: \"e711b057-6f19-4c75-b2c3-a2e986f82807\") " pod="ai-tenant-e2e-shared-a-ad5c84/auth-test-model-ad5c84-kserve-7fcb7988c5-jbl8x"
Jul 06 20:08:15.510489 ip-10-0-131-168 kubenswrapper[2565]: I0706 20:08:15.510471    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/e711b057-6f19-4c75-b2c3-a2e986f82807-tls-certs\") pod \"auth-test-model-ad5c84-kserve-7fcb7988c5-jbl8x\" (UID: \"e711b057-6f19-4c75-b2c3-a2e986f82807\") " pod="ai-tenant-e2e-shared-a-ad5c84/auth-test-model-ad5c84-kserve-7fcb7988c5-jbl8x"
Jul 06 20:08:15.519091 ip-10-0-131-168 kubenswrapper[2565]: I0706 20:08:15.519062    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-kg6nm\" (UniqueName: \"kubernetes.io/projected/e711b057-6f19-4c75-b2c3-a2e986f82807-kube-api-access-kg6nm\") pod \"auth-test-model-ad5c84-kserve-7fcb7988c5-jbl8x\" (UID: \"e711b057-6f19-4c75-b2c3-a2e986f82807\") " pod="ai-tenant-e2e-shared-a-ad5c84/auth-test-model-ad5c84-kserve-7fcb7988c5-jbl8x"
Jul 06 20:08:15.611965 ip-10-0-131-168 kubenswrapper[2565]: I0706 20:08:15.611939    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-ad5c84/auth-test-model-ad5c84-kserve-7fcb7988c5-jbl8x"
Jul 06 20:08:15.750049 ip-10-0-131-168 kubenswrapper[2565]: I0706 20:08:15.750027    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-ad5c84/auth-test-model-ad5c84-kserve-7fcb7988c5-jbl8x"]
Jul 06 20:08:15.752416 ip-10-0-131-168 kubenswrapper[2565]: W0706 20:08:15.752387    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pode711b057_6f19_4c75_b2c3_a2e986f82807.slice/crio-b3829c76c0d1da456ddcc5ecf689b4e1a5e6691fa9543445fae6ec8d133c4de2 WatchSource:0}: Error finding container b3829c76c0d1da456ddcc5ecf689b4e1a5e6691fa9543445fae6ec8d133c4de2: Status 404 returned error can't find the container with id b3829c76c0d1da456ddcc5ecf689b4e1a5e6691fa9543445fae6ec8d133c4de2
Jul 06 20:08:15.804127 ip-10-0-131-168 kubenswrapper[2565]: I0706 20:08:15.804096    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-ad5c84/auth-test-model-ad5c84-kserve-7fcb7988c5-jbl8x" event={"ID":"e711b057-6f19-4c75-b2c3-a2e986f82807","Type":"ContainerStarted","Data":"b3829c76c0d1da456ddcc5ecf689b4e1a5e6691fa9543445fae6ec8d133c4de2"}
Jul 06 20:08:16.810241 ip-10-0-131-168 kubenswrapper[2565]: I0706 20:08:16.810206    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-ad5c84/auth-test-model-ad5c84-kserve-7fcb7988c5-jbl8x" event={"ID":"e711b057-6f19-4c75-b2c3-a2e986f82807","Type":"ContainerStarted","Data":"0e8c967d9a45b86a8d2832650f5b4e7622673c7328a55d63a59c71a3cdb654aa"}
Jul 06 20:08:16.834211 ip-10-0-131-168 kubenswrapper[2565]: I0706 20:08:16.834157    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-a-ad5c84/auth-test-model-ad5c84-kserve-7fcb7988c5-jbl8x" podStartSLOduration=1.834143417 podStartE2EDuration="1.834143417s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 20:08:15 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 20:08:16.833992786 +0000 UTC m=+2131.846981455" watchObservedRunningTime="2026-07-06 20:08:16.834143417 +0000 UTC m=+2131.847132086"
Jul 06 20:08:18.532970 ip-10-0-131-168 kubenswrapper[2565]: I0706 20:08:18.532929    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-mfwbr"]
Jul 06 20:08:25.612534 ip-10-0-131-168 kubenswrapper[2565]: I0706 20:08:25.612499    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-a-ad5c84/auth-test-model-ad5c84-kserve-7fcb7988c5-jbl8x"
Jul 06 20:08:25.612928 ip-10-0-131-168 kubenswrapper[2565]: I0706 20:08:25.612547    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-a-ad5c84/auth-test-model-ad5c84-kserve-7fcb7988c5-jbl8x"
Jul 06 20:08:25.628966 ip-10-0-131-168 kubenswrapper[2565]: I0706 20:08:25.628945    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-a-ad5c84/auth-test-model-ad5c84-kserve-7fcb7988c5-jbl8x"
Jul 06 20:08:25.864063 ip-10-0-131-168 kubenswrapper[2565]: I0706 20:08:25.863979    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-a-ad5c84/auth-test-model-ad5c84-kserve-7fcb7988c5-jbl8x"
Jul 06 20:08:35.486218 ip-10-0-131-168 kubenswrapper[2565]: I0706 20:08:35.486184    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-b-d1d0db/auth-test-model-d1d0db-kserve-64d4b84bc5-fqtjh"]
Jul 06 20:08:35.490849 ip-10-0-131-168 kubenswrapper[2565]: I0706 20:08:35.490825    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-d1d0db/auth-test-model-d1d0db-kserve-64d4b84bc5-fqtjh"
Jul 06 20:08:35.493940 ip-10-0-131-168 kubenswrapper[2565]: I0706 20:08:35.493921    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-d1d0db\"/\"default-dockercfg-cjs8d\""
Jul 06 20:08:35.494255 ip-10-0-131-168 kubenswrapper[2565]: I0706 20:08:35.494236    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-d1d0db\"/\"openshift-service-ca.crt\""
Jul 06 20:08:35.495251 ip-10-0-131-168 kubenswrapper[2565]: I0706 20:08:35.495233    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-d1d0db\"/\"kube-root-ca.crt\""
Jul 06 20:08:35.495379 ip-10-0-131-168 kubenswrapper[2565]: I0706 20:08:35.495363    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-d1d0db\"/\"auth-test-model-d1d0db-kserve-self-signed-certs\""
Jul 06 20:08:35.505514 ip-10-0-131-168 kubenswrapper[2565]: I0706 20:08:35.505492    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-d1d0db/auth-test-model-d1d0db-kserve-64d4b84bc5-fqtjh"]
Jul 06 20:08:35.586973 ip-10-0-131-168 kubenswrapper[2565]: I0706 20:08:35.586938    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/eca98c5c-1042-4e8a-98ea-ffe502b3e5b8-dshm\") pod \"auth-test-model-d1d0db-kserve-64d4b84bc5-fqtjh\" (UID: \"eca98c5c-1042-4e8a-98ea-ffe502b3e5b8\") " pod="ai-tenant-e2e-shared-b-d1d0db/auth-test-model-d1d0db-kserve-64d4b84bc5-fqtjh"
Jul 06 20:08:35.587137 ip-10-0-131-168 kubenswrapper[2565]: I0706 20:08:35.587001    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-z5rhb\" (UniqueName: \"kubernetes.io/projected/eca98c5c-1042-4e8a-98ea-ffe502b3e5b8-kube-api-access-z5rhb\") pod \"auth-test-model-d1d0db-kserve-64d4b84bc5-fqtjh\" (UID: \"eca98c5c-1042-4e8a-98ea-ffe502b3e5b8\") " pod="ai-tenant-e2e-shared-b-d1d0db/auth-test-model-d1d0db-kserve-64d4b84bc5-fqtjh"
Jul 06 20:08:35.587137 ip-10-0-131-168 kubenswrapper[2565]: I0706 20:08:35.587072    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/eca98c5c-1042-4e8a-98ea-ffe502b3e5b8-tmp-dir\") pod \"auth-test-model-d1d0db-kserve-64d4b84bc5-fqtjh\" (UID: \"eca98c5c-1042-4e8a-98ea-ffe502b3e5b8\") " pod="ai-tenant-e2e-shared-b-d1d0db/auth-test-model-d1d0db-kserve-64d4b84bc5-fqtjh"
Jul 06 20:08:35.587137 ip-10-0-131-168 kubenswrapper[2565]: I0706 20:08:35.587107    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/eca98c5c-1042-4e8a-98ea-ffe502b3e5b8-model-cache\") pod \"auth-test-model-d1d0db-kserve-64d4b84bc5-fqtjh\" (UID: \"eca98c5c-1042-4e8a-98ea-ffe502b3e5b8\") " pod="ai-tenant-e2e-shared-b-d1d0db/auth-test-model-d1d0db-kserve-64d4b84bc5-fqtjh"
Jul 06 20:08:35.587282 ip-10-0-131-168 kubenswrapper[2565]: I0706 20:08:35.587136    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/eca98c5c-1042-4e8a-98ea-ffe502b3e5b8-home\") pod \"auth-test-model-d1d0db-kserve-64d4b84bc5-fqtjh\" (UID: \"eca98c5c-1042-4e8a-98ea-ffe502b3e5b8\") " pod="ai-tenant-e2e-shared-b-d1d0db/auth-test-model-d1d0db-kserve-64d4b84bc5-fqtjh"
Jul 06 20:08:35.587282 ip-10-0-131-168 kubenswrapper[2565]: I0706 20:08:35.587169    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/eca98c5c-1042-4e8a-98ea-ffe502b3e5b8-tls-certs\") pod \"auth-test-model-d1d0db-kserve-64d4b84bc5-fqtjh\" (UID: \"eca98c5c-1042-4e8a-98ea-ffe502b3e5b8\") " pod="ai-tenant-e2e-shared-b-d1d0db/auth-test-model-d1d0db-kserve-64d4b84bc5-fqtjh"
Jul 06 20:08:35.688369 ip-10-0-131-168 kubenswrapper[2565]: I0706 20:08:35.688340    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/eca98c5c-1042-4e8a-98ea-ffe502b3e5b8-tmp-dir\") pod \"auth-test-model-d1d0db-kserve-64d4b84bc5-fqtjh\" (UID: \"eca98c5c-1042-4e8a-98ea-ffe502b3e5b8\") " pod="ai-tenant-e2e-shared-b-d1d0db/auth-test-model-d1d0db-kserve-64d4b84bc5-fqtjh"
Jul 06 20:08:35.688557 ip-10-0-131-168 kubenswrapper[2565]: I0706 20:08:35.688375    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/eca98c5c-1042-4e8a-98ea-ffe502b3e5b8-model-cache\") pod \"auth-test-model-d1d0db-kserve-64d4b84bc5-fqtjh\" (UID: \"eca98c5c-1042-4e8a-98ea-ffe502b3e5b8\") " pod="ai-tenant-e2e-shared-b-d1d0db/auth-test-model-d1d0db-kserve-64d4b84bc5-fqtjh"
Jul 06 20:08:35.688557 ip-10-0-131-168 kubenswrapper[2565]: I0706 20:08:35.688399    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/eca98c5c-1042-4e8a-98ea-ffe502b3e5b8-home\") pod \"auth-test-model-d1d0db-kserve-64d4b84bc5-fqtjh\" (UID: \"eca98c5c-1042-4e8a-98ea-ffe502b3e5b8\") " pod="ai-tenant-e2e-shared-b-d1d0db/auth-test-model-d1d0db-kserve-64d4b84bc5-fqtjh"
Jul 06 20:08:35.688557 ip-10-0-131-168 kubenswrapper[2565]: I0706 20:08:35.688418    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/eca98c5c-1042-4e8a-98ea-ffe502b3e5b8-tls-certs\") pod \"auth-test-model-d1d0db-kserve-64d4b84bc5-fqtjh\" (UID: \"eca98c5c-1042-4e8a-98ea-ffe502b3e5b8\") " pod="ai-tenant-e2e-shared-b-d1d0db/auth-test-model-d1d0db-kserve-64d4b84bc5-fqtjh"
Jul 06 20:08:35.688557 ip-10-0-131-168 kubenswrapper[2565]: I0706 20:08:35.688453    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/eca98c5c-1042-4e8a-98ea-ffe502b3e5b8-dshm\") pod \"auth-test-model-d1d0db-kserve-64d4b84bc5-fqtjh\" (UID: \"eca98c5c-1042-4e8a-98ea-ffe502b3e5b8\") " pod="ai-tenant-e2e-shared-b-d1d0db/auth-test-model-d1d0db-kserve-64d4b84bc5-fqtjh"
Jul 06 20:08:35.688557 ip-10-0-131-168 kubenswrapper[2565]: I0706 20:08:35.688491    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-z5rhb\" (UniqueName: \"kubernetes.io/projected/eca98c5c-1042-4e8a-98ea-ffe502b3e5b8-kube-api-access-z5rhb\") pod \"auth-test-model-d1d0db-kserve-64d4b84bc5-fqtjh\" (UID: \"eca98c5c-1042-4e8a-98ea-ffe502b3e5b8\") " pod="ai-tenant-e2e-shared-b-d1d0db/auth-test-model-d1d0db-kserve-64d4b84bc5-fqtjh"
Jul 06 20:08:35.688861 ip-10-0-131-168 kubenswrapper[2565]: I0706 20:08:35.688816    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/eca98c5c-1042-4e8a-98ea-ffe502b3e5b8-model-cache\") pod \"auth-test-model-d1d0db-kserve-64d4b84bc5-fqtjh\" (UID: \"eca98c5c-1042-4e8a-98ea-ffe502b3e5b8\") " pod="ai-tenant-e2e-shared-b-d1d0db/auth-test-model-d1d0db-kserve-64d4b84bc5-fqtjh"
Jul 06 20:08:35.688903 ip-10-0-131-168 kubenswrapper[2565]: I0706 20:08:35.688856    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/eca98c5c-1042-4e8a-98ea-ffe502b3e5b8-tmp-dir\") pod \"auth-test-model-d1d0db-kserve-64d4b84bc5-fqtjh\" (UID: \"eca98c5c-1042-4e8a-98ea-ffe502b3e5b8\") " pod="ai-tenant-e2e-shared-b-d1d0db/auth-test-model-d1d0db-kserve-64d4b84bc5-fqtjh"
Jul 06 20:08:35.688903 ip-10-0-131-168 kubenswrapper[2565]: I0706 20:08:35.688881    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/eca98c5c-1042-4e8a-98ea-ffe502b3e5b8-home\") pod \"auth-test-model-d1d0db-kserve-64d4b84bc5-fqtjh\" (UID: \"eca98c5c-1042-4e8a-98ea-ffe502b3e5b8\") " pod="ai-tenant-e2e-shared-b-d1d0db/auth-test-model-d1d0db-kserve-64d4b84bc5-fqtjh"
Jul 06 20:08:35.690753 ip-10-0-131-168 kubenswrapper[2565]: I0706 20:08:35.690738    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/eca98c5c-1042-4e8a-98ea-ffe502b3e5b8-dshm\") pod \"auth-test-model-d1d0db-kserve-64d4b84bc5-fqtjh\" (UID: \"eca98c5c-1042-4e8a-98ea-ffe502b3e5b8\") " pod="ai-tenant-e2e-shared-b-d1d0db/auth-test-model-d1d0db-kserve-64d4b84bc5-fqtjh"
Jul 06 20:08:35.691009 ip-10-0-131-168 kubenswrapper[2565]: I0706 20:08:35.690993    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/eca98c5c-1042-4e8a-98ea-ffe502b3e5b8-tls-certs\") pod \"auth-test-model-d1d0db-kserve-64d4b84bc5-fqtjh\" (UID: \"eca98c5c-1042-4e8a-98ea-ffe502b3e5b8\") " pod="ai-tenant-e2e-shared-b-d1d0db/auth-test-model-d1d0db-kserve-64d4b84bc5-fqtjh"
Jul 06 20:08:35.699551 ip-10-0-131-168 kubenswrapper[2565]: I0706 20:08:35.699528    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-z5rhb\" (UniqueName: \"kubernetes.io/projected/eca98c5c-1042-4e8a-98ea-ffe502b3e5b8-kube-api-access-z5rhb\") pod \"auth-test-model-d1d0db-kserve-64d4b84bc5-fqtjh\" (UID: \"eca98c5c-1042-4e8a-98ea-ffe502b3e5b8\") " pod="ai-tenant-e2e-shared-b-d1d0db/auth-test-model-d1d0db-kserve-64d4b84bc5-fqtjh"
Jul 06 20:08:35.800537 ip-10-0-131-168 kubenswrapper[2565]: I0706 20:08:35.800455    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-d1d0db/auth-test-model-d1d0db-kserve-64d4b84bc5-fqtjh"
Jul 06 20:08:35.944344 ip-10-0-131-168 kubenswrapper[2565]: I0706 20:08:35.944316    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-d1d0db/auth-test-model-d1d0db-kserve-64d4b84bc5-fqtjh"]
Jul 06 20:08:35.946253 ip-10-0-131-168 kubenswrapper[2565]: W0706 20:08:35.946224    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podeca98c5c_1042_4e8a_98ea_ffe502b3e5b8.slice/crio-8af06b75ca91a0370d8c9aafb3dd0e163deb8f998c1706352dec1894ea821f76 WatchSource:0}: Error finding container 8af06b75ca91a0370d8c9aafb3dd0e163deb8f998c1706352dec1894ea821f76: Status 404 returned error can't find the container with id 8af06b75ca91a0370d8c9aafb3dd0e163deb8f998c1706352dec1894ea821f76
Jul 06 20:08:36.903310 ip-10-0-131-168 kubenswrapper[2565]: I0706 20:08:36.903225    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-d1d0db/auth-test-model-d1d0db-kserve-64d4b84bc5-fqtjh" event={"ID":"eca98c5c-1042-4e8a-98ea-ffe502b3e5b8","Type":"ContainerStarted","Data":"43f6766becc7501e3b2003506419c9639106cef36dcf794fcb663edb596bed44"}
Jul 06 20:08:36.903310 ip-10-0-131-168 kubenswrapper[2565]: I0706 20:08:36.903278    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-d1d0db/auth-test-model-d1d0db-kserve-64d4b84bc5-fqtjh" event={"ID":"eca98c5c-1042-4e8a-98ea-ffe502b3e5b8","Type":"ContainerStarted","Data":"8af06b75ca91a0370d8c9aafb3dd0e163deb8f998c1706352dec1894ea821f76"}
Jul 06 20:08:43.800096 ip-10-0-131-168 kubenswrapper[2565]: I0706 20:08:43.800040    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-b-d1d0db/auth-test-model-d1d0db-kserve-64d4b84bc5-fqtjh" podStartSLOduration=8.800024464 podStartE2EDuration="8.800024464s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 20:08:35 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 20:08:43.797559612 +0000 UTC m=+2158.810548295" watchObservedRunningTime="2026-07-06 20:08:43.800024464 +0000 UTC m=+2158.813013133"
Jul 06 20:08:45.801320 ip-10-0-131-168 kubenswrapper[2565]: I0706 20:08:45.801284    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-b-d1d0db/auth-test-model-d1d0db-kserve-64d4b84bc5-fqtjh"
Jul 06 20:08:45.801727 ip-10-0-131-168 kubenswrapper[2565]: I0706 20:08:45.801335    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-b-d1d0db/auth-test-model-d1d0db-kserve-64d4b84bc5-fqtjh"
Jul 06 20:08:45.813823 ip-10-0-131-168 kubenswrapper[2565]: I0706 20:08:45.813796    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-b-d1d0db/auth-test-model-d1d0db-kserve-64d4b84bc5-fqtjh"
Jul 06 20:08:45.955878 ip-10-0-131-168 kubenswrapper[2565]: I0706 20:08:45.955845    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-b-d1d0db/auth-test-model-d1d0db-kserve-64d4b84bc5-fqtjh"
Jul 06 20:08:46.339334 ip-10-0-131-168 kubenswrapper[2565]: I0706 20:08:46.339301    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-mfwbr"]
Jul 06 20:09:15.326410 ip-10-0-131-168 kubenswrapper[2565]: I0706 20:09:15.326367    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-mfwbr"]
Jul 06 20:09:31.936450 ip-10-0-131-168 kubenswrapper[2565]: I0706 20:09:31.936414    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-mfwbr"]
Jul 06 20:09:47.941803 ip-10-0-131-168 kubenswrapper[2565]: I0706 20:09:47.941756    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-mfwbr"]
Jul 06 20:10:04.538253 ip-10-0-131-168 kubenswrapper[2565]: I0706 20:10:04.538218    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-mfwbr"]
Jul 06 20:10:19.949977 ip-10-0-131-168 kubenswrapper[2565]: I0706 20:10:19.949898    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-mfwbr"]
Jul 06 20:10:36.124930 ip-10-0-131-168 kubenswrapper[2565]: I0706 20:10:36.124894    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-mfwbr"]
Jul 06 20:10:48.697387 ip-10-0-131-168 kubenswrapper[2565]: I0706 20:10:48.697355    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-ad5c84/auth-test-model-ad5c84-kserve-7fcb7988c5-jbl8x"]
Jul 06 20:10:49.710450 ip-10-0-131-168 kubenswrapper[2565]: I0706 20:10:49.710418    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-d1d0db/auth-test-model-d1d0db-kserve-64d4b84bc5-fqtjh"]
Jul 06 20:10:54.031253 ip-10-0-131-168 kubenswrapper[2565]: I0706 20:10:54.031216    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-mfwbr"]
Jul 06 20:11:03.717206 ip-10-0-131-168 kubenswrapper[2565]: I0706 20:11:03.717162    2565 kuberuntime_container.go:872] "Killing container with a grace period" pod="ai-tenant-e2e-shared-a-ad5c84/auth-test-model-ad5c84-kserve-7fcb7988c5-jbl8x" podUID="e711b057-6f19-4c75-b2c3-a2e986f82807" containerName="main" containerID="cri-o://0e8c967d9a45b86a8d2832650f5b4e7622673c7328a55d63a59c71a3cdb654aa" gracePeriod=45
Jul 06 20:11:03.962422 ip-10-0-131-168 kubenswrapper[2565]: I0706 20:11:03.962397    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-ad5c84/auth-test-model-ad5c84-kserve-7fcb7988c5-jbl8x"
Jul 06 20:11:04.027743 ip-10-0-131-168 kubenswrapper[2565]: I0706 20:11:04.027664    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-mfwbr"]
Jul 06 20:11:04.041299 ip-10-0-131-168 kubenswrapper[2565]: I0706 20:11:04.041273    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/e711b057-6f19-4c75-b2c3-a2e986f82807-tmp-dir\") pod \"e711b057-6f19-4c75-b2c3-a2e986f82807\" (UID: \"e711b057-6f19-4c75-b2c3-a2e986f82807\") "
Jul 06 20:11:04.041432 ip-10-0-131-168 kubenswrapper[2565]: I0706 20:11:04.041316    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-kg6nm\" (UniqueName: \"kubernetes.io/projected/e711b057-6f19-4c75-b2c3-a2e986f82807-kube-api-access-kg6nm\") pod \"e711b057-6f19-4c75-b2c3-a2e986f82807\" (UID: \"e711b057-6f19-4c75-b2c3-a2e986f82807\") "
Jul 06 20:11:04.041432 ip-10-0-131-168 kubenswrapper[2565]: I0706 20:11:04.041364    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/e711b057-6f19-4c75-b2c3-a2e986f82807-home\") pod \"e711b057-6f19-4c75-b2c3-a2e986f82807\" (UID: \"e711b057-6f19-4c75-b2c3-a2e986f82807\") "
Jul 06 20:11:04.041432 ip-10-0-131-168 kubenswrapper[2565]: I0706 20:11:04.041398    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/e711b057-6f19-4c75-b2c3-a2e986f82807-model-cache\") pod \"e711b057-6f19-4c75-b2c3-a2e986f82807\" (UID: \"e711b057-6f19-4c75-b2c3-a2e986f82807\") "
Jul 06 20:11:04.041589 ip-10-0-131-168 kubenswrapper[2565]: I0706 20:11:04.041434    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/e711b057-6f19-4c75-b2c3-a2e986f82807-tls-certs\") pod \"e711b057-6f19-4c75-b2c3-a2e986f82807\" (UID: \"e711b057-6f19-4c75-b2c3-a2e986f82807\") "
Jul 06 20:11:04.041589 ip-10-0-131-168 kubenswrapper[2565]: I0706 20:11:04.041476    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/e711b057-6f19-4c75-b2c3-a2e986f82807-dshm\") pod \"e711b057-6f19-4c75-b2c3-a2e986f82807\" (UID: \"e711b057-6f19-4c75-b2c3-a2e986f82807\") "
Jul 06 20:11:04.041685 ip-10-0-131-168 kubenswrapper[2565]: I0706 20:11:04.041577    2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e711b057-6f19-4c75-b2c3-a2e986f82807-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "e711b057-6f19-4c75-b2c3-a2e986f82807" (UID: "e711b057-6f19-4c75-b2c3-a2e986f82807"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 20:11:04.041737 ip-10-0-131-168 kubenswrapper[2565]: I0706 20:11:04.041680    2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e711b057-6f19-4c75-b2c3-a2e986f82807-model-cache" (OuterVolumeSpecName: "model-cache") pod "e711b057-6f19-4c75-b2c3-a2e986f82807" (UID: "e711b057-6f19-4c75-b2c3-a2e986f82807"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 20:11:04.041737 ip-10-0-131-168 kubenswrapper[2565]: I0706 20:11:04.041698    2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e711b057-6f19-4c75-b2c3-a2e986f82807-home" (OuterVolumeSpecName: "home") pod "e711b057-6f19-4c75-b2c3-a2e986f82807" (UID: "e711b057-6f19-4c75-b2c3-a2e986f82807"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 20:11:04.041887 ip-10-0-131-168 kubenswrapper[2565]: I0706 20:11:04.041870    2565 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/e711b057-6f19-4c75-b2c3-a2e986f82807-home\") on node \"ip-10-0-131-168.ec2.internal\" DevicePath \"\""
Jul 06 20:11:04.041937 ip-10-0-131-168 kubenswrapper[2565]: I0706 20:11:04.041894    2565 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/e711b057-6f19-4c75-b2c3-a2e986f82807-model-cache\") on node \"ip-10-0-131-168.ec2.internal\" DevicePath \"\""
Jul 06 20:11:04.041937 ip-10-0-131-168 kubenswrapper[2565]: I0706 20:11:04.041909    2565 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/e711b057-6f19-4c75-b2c3-a2e986f82807-tmp-dir\") on node \"ip-10-0-131-168.ec2.internal\" DevicePath \"\""
Jul 06 20:11:04.043758 ip-10-0-131-168 kubenswrapper[2565]: I0706 20:11:04.043730    2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e711b057-6f19-4c75-b2c3-a2e986f82807-dshm" (OuterVolumeSpecName: "dshm") pod "e711b057-6f19-4c75-b2c3-a2e986f82807" (UID: "e711b057-6f19-4c75-b2c3-a2e986f82807"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 20:11:04.043758 ip-10-0-131-168 kubenswrapper[2565]: I0706 20:11:04.043734    2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e711b057-6f19-4c75-b2c3-a2e986f82807-kube-api-access-kg6nm" (OuterVolumeSpecName: "kube-api-access-kg6nm") pod "e711b057-6f19-4c75-b2c3-a2e986f82807" (UID: "e711b057-6f19-4c75-b2c3-a2e986f82807"). InnerVolumeSpecName "kube-api-access-kg6nm". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 06 20:11:04.043915 ip-10-0-131-168 kubenswrapper[2565]: I0706 20:11:04.043873    2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e711b057-6f19-4c75-b2c3-a2e986f82807-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "e711b057-6f19-4c75-b2c3-a2e986f82807" (UID: "e711b057-6f19-4c75-b2c3-a2e986f82807"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 06 20:11:04.143334 ip-10-0-131-168 kubenswrapper[2565]: I0706 20:11:04.143294    2565 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/e711b057-6f19-4c75-b2c3-a2e986f82807-tls-certs\") on node \"ip-10-0-131-168.ec2.internal\" DevicePath \"\""
Jul 06 20:11:04.143334 ip-10-0-131-168 kubenswrapper[2565]: I0706 20:11:04.143331    2565 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/e711b057-6f19-4c75-b2c3-a2e986f82807-dshm\") on node \"ip-10-0-131-168.ec2.internal\" DevicePath \"\""
Jul 06 20:11:04.143334 ip-10-0-131-168 kubenswrapper[2565]: I0706 20:11:04.143344    2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-kg6nm\" (UniqueName: \"kubernetes.io/projected/e711b057-6f19-4c75-b2c3-a2e986f82807-kube-api-access-kg6nm\") on node \"ip-10-0-131-168.ec2.internal\" DevicePath \"\""
Jul 06 20:11:04.573340 ip-10-0-131-168 kubenswrapper[2565]: I0706 20:11:04.573304    2565 generic.go:356] "Generic (PLEG): container finished" podID="e711b057-6f19-4c75-b2c3-a2e986f82807" containerID="0e8c967d9a45b86a8d2832650f5b4e7622673c7328a55d63a59c71a3cdb654aa" exitCode=0
Jul 06 20:11:04.573340 ip-10-0-131-168 kubenswrapper[2565]: I0706 20:11:04.573342    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-ad5c84/auth-test-model-ad5c84-kserve-7fcb7988c5-jbl8x"
Jul 06 20:11:04.573551 ip-10-0-131-168 kubenswrapper[2565]: I0706 20:11:04.573389    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-ad5c84/auth-test-model-ad5c84-kserve-7fcb7988c5-jbl8x" event={"ID":"e711b057-6f19-4c75-b2c3-a2e986f82807","Type":"ContainerDied","Data":"0e8c967d9a45b86a8d2832650f5b4e7622673c7328a55d63a59c71a3cdb654aa"}
Jul 06 20:11:04.573551 ip-10-0-131-168 kubenswrapper[2565]: I0706 20:11:04.573427    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-ad5c84/auth-test-model-ad5c84-kserve-7fcb7988c5-jbl8x" event={"ID":"e711b057-6f19-4c75-b2c3-a2e986f82807","Type":"ContainerDied","Data":"b3829c76c0d1da456ddcc5ecf689b4e1a5e6691fa9543445fae6ec8d133c4de2"}
Jul 06 20:11:04.573551 ip-10-0-131-168 kubenswrapper[2565]: I0706 20:11:04.573445    2565 scope.go:117] "RemoveContainer" containerID="0e8c967d9a45b86a8d2832650f5b4e7622673c7328a55d63a59c71a3cdb654aa"
Jul 06 20:11:04.582154 ip-10-0-131-168 kubenswrapper[2565]: I0706 20:11:04.582134    2565 scope.go:117] "RemoveContainer" containerID="0e8c967d9a45b86a8d2832650f5b4e7622673c7328a55d63a59c71a3cdb654aa"
Jul 06 20:11:04.582410 ip-10-0-131-168 kubenswrapper[2565]: E0706 20:11:04.582392    2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0e8c967d9a45b86a8d2832650f5b4e7622673c7328a55d63a59c71a3cdb654aa\": container with ID starting with 0e8c967d9a45b86a8d2832650f5b4e7622673c7328a55d63a59c71a3cdb654aa not found: ID does not exist" containerID="0e8c967d9a45b86a8d2832650f5b4e7622673c7328a55d63a59c71a3cdb654aa"
Jul 06 20:11:04.582449 ip-10-0-131-168 kubenswrapper[2565]: I0706 20:11:04.582418    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0e8c967d9a45b86a8d2832650f5b4e7622673c7328a55d63a59c71a3cdb654aa"} err="failed to get container status \"0e8c967d9a45b86a8d2832650f5b4e7622673c7328a55d63a59c71a3cdb654aa\": rpc error: code = NotFound desc = could not find container \"0e8c967d9a45b86a8d2832650f5b4e7622673c7328a55d63a59c71a3cdb654aa\": container with ID starting with 0e8c967d9a45b86a8d2832650f5b4e7622673c7328a55d63a59c71a3cdb654aa not found: ID does not exist"
Jul 06 20:11:04.601190 ip-10-0-131-168 kubenswrapper[2565]: I0706 20:11:04.601160    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-ad5c84/auth-test-model-ad5c84-kserve-7fcb7988c5-jbl8x"]
Jul 06 20:11:04.609340 ip-10-0-131-168 kubenswrapper[2565]: I0706 20:11:04.609320    2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-a-ad5c84/auth-test-model-ad5c84-kserve-7fcb7988c5-jbl8x"]
Jul 06 20:11:04.730285 ip-10-0-131-168 kubenswrapper[2565]: I0706 20:11:04.730227    2565 kuberuntime_container.go:872] "Killing container with a grace period" pod="ai-tenant-e2e-shared-b-d1d0db/auth-test-model-d1d0db-kserve-64d4b84bc5-fqtjh" podUID="eca98c5c-1042-4e8a-98ea-ffe502b3e5b8" containerName="main" containerID="cri-o://43f6766becc7501e3b2003506419c9639106cef36dcf794fcb663edb596bed44" gracePeriod=45
Jul 06 20:11:04.975737 ip-10-0-131-168 kubenswrapper[2565]: I0706 20:11:04.975707    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-d1d0db/auth-test-model-d1d0db-kserve-64d4b84bc5-fqtjh"
Jul 06 20:11:05.050798 ip-10-0-131-168 kubenswrapper[2565]: I0706 20:11:05.050743    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/eca98c5c-1042-4e8a-98ea-ffe502b3e5b8-dshm\") pod \"eca98c5c-1042-4e8a-98ea-ffe502b3e5b8\" (UID: \"eca98c5c-1042-4e8a-98ea-ffe502b3e5b8\") "
Jul 06 20:11:05.050981 ip-10-0-131-168 kubenswrapper[2565]: I0706 20:11:05.050844    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/eca98c5c-1042-4e8a-98ea-ffe502b3e5b8-tmp-dir\") pod \"eca98c5c-1042-4e8a-98ea-ffe502b3e5b8\" (UID: \"eca98c5c-1042-4e8a-98ea-ffe502b3e5b8\") "
Jul 06 20:11:05.050981 ip-10-0-131-168 kubenswrapper[2565]: I0706 20:11:05.050893    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/eca98c5c-1042-4e8a-98ea-ffe502b3e5b8-model-cache\") pod \"eca98c5c-1042-4e8a-98ea-ffe502b3e5b8\" (UID: \"eca98c5c-1042-4e8a-98ea-ffe502b3e5b8\") "
Jul 06 20:11:05.050981 ip-10-0-131-168 kubenswrapper[2565]: I0706 20:11:05.050927    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-z5rhb\" (UniqueName: \"kubernetes.io/projected/eca98c5c-1042-4e8a-98ea-ffe502b3e5b8-kube-api-access-z5rhb\") pod \"eca98c5c-1042-4e8a-98ea-ffe502b3e5b8\" (UID: \"eca98c5c-1042-4e8a-98ea-ffe502b3e5b8\") "
Jul 06 20:11:05.050981 ip-10-0-131-168 kubenswrapper[2565]: I0706 20:11:05.050953    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/eca98c5c-1042-4e8a-98ea-ffe502b3e5b8-home\") pod \"eca98c5c-1042-4e8a-98ea-ffe502b3e5b8\" (UID: \"eca98c5c-1042-4e8a-98ea-ffe502b3e5b8\") "
Jul 06 20:11:05.051189 ip-10-0-131-168 kubenswrapper[2565]: I0706 20:11:05.051028    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/eca98c5c-1042-4e8a-98ea-ffe502b3e5b8-tls-certs\") pod \"eca98c5c-1042-4e8a-98ea-ffe502b3e5b8\" (UID: \"eca98c5c-1042-4e8a-98ea-ffe502b3e5b8\") "
Jul 06 20:11:05.051189 ip-10-0-131-168 kubenswrapper[2565]: I0706 20:11:05.051139    2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/eca98c5c-1042-4e8a-98ea-ffe502b3e5b8-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "eca98c5c-1042-4e8a-98ea-ffe502b3e5b8" (UID: "eca98c5c-1042-4e8a-98ea-ffe502b3e5b8"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 20:11:05.051310 ip-10-0-131-168 kubenswrapper[2565]: I0706 20:11:05.051174    2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/eca98c5c-1042-4e8a-98ea-ffe502b3e5b8-model-cache" (OuterVolumeSpecName: "model-cache") pod "eca98c5c-1042-4e8a-98ea-ffe502b3e5b8" (UID: "eca98c5c-1042-4e8a-98ea-ffe502b3e5b8"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 20:11:05.051310 ip-10-0-131-168 kubenswrapper[2565]: I0706 20:11:05.051228    2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/eca98c5c-1042-4e8a-98ea-ffe502b3e5b8-home" (OuterVolumeSpecName: "home") pod "eca98c5c-1042-4e8a-98ea-ffe502b3e5b8" (UID: "eca98c5c-1042-4e8a-98ea-ffe502b3e5b8"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 20:11:05.051400 ip-10-0-131-168 kubenswrapper[2565]: I0706 20:11:05.051381    2565 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/eca98c5c-1042-4e8a-98ea-ffe502b3e5b8-tmp-dir\") on node \"ip-10-0-131-168.ec2.internal\" DevicePath \"\""
Jul 06 20:11:05.051400 ip-10-0-131-168 kubenswrapper[2565]: I0706 20:11:05.051397    2565 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/eca98c5c-1042-4e8a-98ea-ffe502b3e5b8-model-cache\") on node \"ip-10-0-131-168.ec2.internal\" DevicePath \"\""
Jul 06 20:11:05.051464 ip-10-0-131-168 kubenswrapper[2565]: I0706 20:11:05.051406    2565 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/eca98c5c-1042-4e8a-98ea-ffe502b3e5b8-home\") on node \"ip-10-0-131-168.ec2.internal\" DevicePath \"\""
Jul 06 20:11:05.053104 ip-10-0-131-168 kubenswrapper[2565]: I0706 20:11:05.053080    2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/eca98c5c-1042-4e8a-98ea-ffe502b3e5b8-dshm" (OuterVolumeSpecName: "dshm") pod "eca98c5c-1042-4e8a-98ea-ffe502b3e5b8" (UID: "eca98c5c-1042-4e8a-98ea-ffe502b3e5b8"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 20:11:05.053104 ip-10-0-131-168 kubenswrapper[2565]: I0706 20:11:05.053096    2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/eca98c5c-1042-4e8a-98ea-ffe502b3e5b8-kube-api-access-z5rhb" (OuterVolumeSpecName: "kube-api-access-z5rhb") pod "eca98c5c-1042-4e8a-98ea-ffe502b3e5b8" (UID: "eca98c5c-1042-4e8a-98ea-ffe502b3e5b8"). InnerVolumeSpecName "kube-api-access-z5rhb". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 06 20:11:05.053207 ip-10-0-131-168 kubenswrapper[2565]: I0706 20:11:05.053098    2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/eca98c5c-1042-4e8a-98ea-ffe502b3e5b8-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "eca98c5c-1042-4e8a-98ea-ffe502b3e5b8" (UID: "eca98c5c-1042-4e8a-98ea-ffe502b3e5b8"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 06 20:11:05.152164 ip-10-0-131-168 kubenswrapper[2565]: I0706 20:11:05.152135    2565 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/eca98c5c-1042-4e8a-98ea-ffe502b3e5b8-tls-certs\") on node \"ip-10-0-131-168.ec2.internal\" DevicePath \"\""
Jul 06 20:11:05.152164 ip-10-0-131-168 kubenswrapper[2565]: I0706 20:11:05.152159    2565 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/eca98c5c-1042-4e8a-98ea-ffe502b3e5b8-dshm\") on node \"ip-10-0-131-168.ec2.internal\" DevicePath \"\""
Jul 06 20:11:05.152164 ip-10-0-131-168 kubenswrapper[2565]: I0706 20:11:05.152167    2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-z5rhb\" (UniqueName: \"kubernetes.io/projected/eca98c5c-1042-4e8a-98ea-ffe502b3e5b8-kube-api-access-z5rhb\") on node \"ip-10-0-131-168.ec2.internal\" DevicePath \"\""
Jul 06 20:11:05.495194 ip-10-0-131-168 kubenswrapper[2565]: I0706 20:11:05.495118    2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e711b057-6f19-4c75-b2c3-a2e986f82807" path="/var/lib/kubelet/pods/e711b057-6f19-4c75-b2c3-a2e986f82807/volumes"
Jul 06 20:11:05.579436 ip-10-0-131-168 kubenswrapper[2565]: I0706 20:11:05.579401    2565 generic.go:356] "Generic (PLEG): container finished" podID="eca98c5c-1042-4e8a-98ea-ffe502b3e5b8" containerID="43f6766becc7501e3b2003506419c9639106cef36dcf794fcb663edb596bed44" exitCode=0
Jul 06 20:11:05.579609 ip-10-0-131-168 kubenswrapper[2565]: I0706 20:11:05.579448    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-d1d0db/auth-test-model-d1d0db-kserve-64d4b84bc5-fqtjh"
Jul 06 20:11:05.579609 ip-10-0-131-168 kubenswrapper[2565]: I0706 20:11:05.579491    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-d1d0db/auth-test-model-d1d0db-kserve-64d4b84bc5-fqtjh" event={"ID":"eca98c5c-1042-4e8a-98ea-ffe502b3e5b8","Type":"ContainerDied","Data":"43f6766becc7501e3b2003506419c9639106cef36dcf794fcb663edb596bed44"}
Jul 06 20:11:05.579609 ip-10-0-131-168 kubenswrapper[2565]: I0706 20:11:05.579534    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-d1d0db/auth-test-model-d1d0db-kserve-64d4b84bc5-fqtjh" event={"ID":"eca98c5c-1042-4e8a-98ea-ffe502b3e5b8","Type":"ContainerDied","Data":"8af06b75ca91a0370d8c9aafb3dd0e163deb8f998c1706352dec1894ea821f76"}
Jul 06 20:11:05.579609 ip-10-0-131-168 kubenswrapper[2565]: I0706 20:11:05.579551    2565 scope.go:117] "RemoveContainer" containerID="43f6766becc7501e3b2003506419c9639106cef36dcf794fcb663edb596bed44"
Jul 06 20:11:05.587832 ip-10-0-131-168 kubenswrapper[2565]: I0706 20:11:05.587816    2565 scope.go:117] "RemoveContainer" containerID="43f6766becc7501e3b2003506419c9639106cef36dcf794fcb663edb596bed44"
Jul 06 20:11:05.588118 ip-10-0-131-168 kubenswrapper[2565]: E0706 20:11:05.588084    2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"43f6766becc7501e3b2003506419c9639106cef36dcf794fcb663edb596bed44\": container with ID starting with 43f6766becc7501e3b2003506419c9639106cef36dcf794fcb663edb596bed44 not found: ID does not exist" containerID="43f6766becc7501e3b2003506419c9639106cef36dcf794fcb663edb596bed44"
Jul 06 20:11:05.588182 ip-10-0-131-168 kubenswrapper[2565]: I0706 20:11:05.588123    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"43f6766becc7501e3b2003506419c9639106cef36dcf794fcb663edb596bed44"} err="failed to get container status \"43f6766becc7501e3b2003506419c9639106cef36dcf794fcb663edb596bed44\": rpc error: code = NotFound desc = could not find container \"43f6766becc7501e3b2003506419c9639106cef36dcf794fcb663edb596bed44\": container with ID starting with 43f6766becc7501e3b2003506419c9639106cef36dcf794fcb663edb596bed44 not found: ID does not exist"
Jul 06 20:11:05.598189 ip-10-0-131-168 kubenswrapper[2565]: I0706 20:11:05.598169    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-d1d0db/auth-test-model-d1d0db-kserve-64d4b84bc5-fqtjh"]
Jul 06 20:11:05.603182 ip-10-0-131-168 kubenswrapper[2565]: I0706 20:11:05.603163    2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-b-d1d0db/auth-test-model-d1d0db-kserve-64d4b84bc5-fqtjh"]
Jul 06 20:11:07.495754 ip-10-0-131-168 kubenswrapper[2565]: I0706 20:11:07.495718    2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="eca98c5c-1042-4e8a-98ea-ffe502b3e5b8" path="/var/lib/kubelet/pods/eca98c5c-1042-4e8a-98ea-ffe502b3e5b8/volumes"
Jul 06 20:11:14.283305 ip-10-0-131-168 kubenswrapper[2565]: I0706 20:11:14.283268    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-b-d1d0db/sub-test-model-d1d0db-kserve-57d655fc7c-zgzw4"]
Jul 06 20:11:14.283698 ip-10-0-131-168 kubenswrapper[2565]: I0706 20:11:14.283673    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e711b057-6f19-4c75-b2c3-a2e986f82807" containerName="main"
Jul 06 20:11:14.283698 ip-10-0-131-168 kubenswrapper[2565]: I0706 20:11:14.283687    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="e711b057-6f19-4c75-b2c3-a2e986f82807" containerName="main"
Jul 06 20:11:14.283868 ip-10-0-131-168 kubenswrapper[2565]: I0706 20:11:14.283700    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="eca98c5c-1042-4e8a-98ea-ffe502b3e5b8" containerName="main"
Jul 06 20:11:14.283868 ip-10-0-131-168 kubenswrapper[2565]: I0706 20:11:14.283709    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="eca98c5c-1042-4e8a-98ea-ffe502b3e5b8" containerName="main"
Jul 06 20:11:14.283868 ip-10-0-131-168 kubenswrapper[2565]: I0706 20:11:14.283827    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="eca98c5c-1042-4e8a-98ea-ffe502b3e5b8" containerName="main"
Jul 06 20:11:14.283868 ip-10-0-131-168 kubenswrapper[2565]: I0706 20:11:14.283841    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="e711b057-6f19-4c75-b2c3-a2e986f82807" containerName="main"
Jul 06 20:11:14.288415 ip-10-0-131-168 kubenswrapper[2565]: I0706 20:11:14.288397    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-d1d0db/sub-test-model-d1d0db-kserve-57d655fc7c-zgzw4"
Jul 06 20:11:14.292757 ip-10-0-131-168 kubenswrapper[2565]: I0706 20:11:14.292729    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-d1d0db\"/\"default-dockercfg-cjs8d\""
Jul 06 20:11:14.292898 ip-10-0-131-168 kubenswrapper[2565]: I0706 20:11:14.292753    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-d1d0db\"/\"sub-test-model-d1d0db-kserve-self-signed-certs\""
Jul 06 20:11:14.292898 ip-10-0-131-168 kubenswrapper[2565]: I0706 20:11:14.292732    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-d1d0db\"/\"openshift-service-ca.crt\""
Jul 06 20:11:14.292898 ip-10-0-131-168 kubenswrapper[2565]: I0706 20:11:14.292732    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-d1d0db\"/\"kube-root-ca.crt\""
Jul 06 20:11:14.299735 ip-10-0-131-168 kubenswrapper[2565]: I0706 20:11:14.299712    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-d1d0db/sub-test-model-d1d0db-kserve-57d655fc7c-zgzw4"]
Jul 06 20:11:14.437052 ip-10-0-131-168 kubenswrapper[2565]: I0706 20:11:14.437023    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/5bc818bb-08e8-4216-ba16-001f3c62ea00-model-cache\") pod \"sub-test-model-d1d0db-kserve-57d655fc7c-zgzw4\" (UID: \"5bc818bb-08e8-4216-ba16-001f3c62ea00\") " pod="ai-tenant-e2e-shared-b-d1d0db/sub-test-model-d1d0db-kserve-57d655fc7c-zgzw4"
Jul 06 20:11:14.437052 ip-10-0-131-168 kubenswrapper[2565]: I0706 20:11:14.437058    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/5bc818bb-08e8-4216-ba16-001f3c62ea00-dshm\") pod \"sub-test-model-d1d0db-kserve-57d655fc7c-zgzw4\" (UID: \"5bc818bb-08e8-4216-ba16-001f3c62ea00\") " pod="ai-tenant-e2e-shared-b-d1d0db/sub-test-model-d1d0db-kserve-57d655fc7c-zgzw4"
Jul 06 20:11:14.437283 ip-10-0-131-168 kubenswrapper[2565]: I0706 20:11:14.437087    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/5bc818bb-08e8-4216-ba16-001f3c62ea00-tmp-dir\") pod \"sub-test-model-d1d0db-kserve-57d655fc7c-zgzw4\" (UID: \"5bc818bb-08e8-4216-ba16-001f3c62ea00\") " pod="ai-tenant-e2e-shared-b-d1d0db/sub-test-model-d1d0db-kserve-57d655fc7c-zgzw4"
Jul 06 20:11:14.437283 ip-10-0-131-168 kubenswrapper[2565]: I0706 20:11:14.437149    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-g7hr4\" (UniqueName: \"kubernetes.io/projected/5bc818bb-08e8-4216-ba16-001f3c62ea00-kube-api-access-g7hr4\") pod \"sub-test-model-d1d0db-kserve-57d655fc7c-zgzw4\" (UID: \"5bc818bb-08e8-4216-ba16-001f3c62ea00\") " pod="ai-tenant-e2e-shared-b-d1d0db/sub-test-model-d1d0db-kserve-57d655fc7c-zgzw4"
Jul 06 20:11:14.437283 ip-10-0-131-168 kubenswrapper[2565]: I0706 20:11:14.437212    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/5bc818bb-08e8-4216-ba16-001f3c62ea00-home\") pod \"sub-test-model-d1d0db-kserve-57d655fc7c-zgzw4\" (UID: \"5bc818bb-08e8-4216-ba16-001f3c62ea00\") " pod="ai-tenant-e2e-shared-b-d1d0db/sub-test-model-d1d0db-kserve-57d655fc7c-zgzw4"
Jul 06 20:11:14.437283 ip-10-0-131-168 kubenswrapper[2565]: I0706 20:11:14.437270    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/5bc818bb-08e8-4216-ba16-001f3c62ea00-tls-certs\") pod \"sub-test-model-d1d0db-kserve-57d655fc7c-zgzw4\" (UID: \"5bc818bb-08e8-4216-ba16-001f3c62ea00\") " pod="ai-tenant-e2e-shared-b-d1d0db/sub-test-model-d1d0db-kserve-57d655fc7c-zgzw4"
Jul 06 20:11:14.538712 ip-10-0-131-168 kubenswrapper[2565]: I0706 20:11:14.538610    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/5bc818bb-08e8-4216-ba16-001f3c62ea00-dshm\") pod \"sub-test-model-d1d0db-kserve-57d655fc7c-zgzw4\" (UID: \"5bc818bb-08e8-4216-ba16-001f3c62ea00\") " pod="ai-tenant-e2e-shared-b-d1d0db/sub-test-model-d1d0db-kserve-57d655fc7c-zgzw4"
Jul 06 20:11:14.538712 ip-10-0-131-168 kubenswrapper[2565]: I0706 20:11:14.538662    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/5bc818bb-08e8-4216-ba16-001f3c62ea00-tmp-dir\") pod \"sub-test-model-d1d0db-kserve-57d655fc7c-zgzw4\" (UID: \"5bc818bb-08e8-4216-ba16-001f3c62ea00\") " pod="ai-tenant-e2e-shared-b-d1d0db/sub-test-model-d1d0db-kserve-57d655fc7c-zgzw4"
Jul 06 20:11:14.538712 ip-10-0-131-168 kubenswrapper[2565]: I0706 20:11:14.538678    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-g7hr4\" (UniqueName: \"kubernetes.io/projected/5bc818bb-08e8-4216-ba16-001f3c62ea00-kube-api-access-g7hr4\") pod \"sub-test-model-d1d0db-kserve-57d655fc7c-zgzw4\" (UID: \"5bc818bb-08e8-4216-ba16-001f3c62ea00\") " pod="ai-tenant-e2e-shared-b-d1d0db/sub-test-model-d1d0db-kserve-57d655fc7c-zgzw4"
Jul 06 20:11:14.539024 ip-10-0-131-168 kubenswrapper[2565]: I0706 20:11:14.538722    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/5bc818bb-08e8-4216-ba16-001f3c62ea00-home\") pod \"sub-test-model-d1d0db-kserve-57d655fc7c-zgzw4\" (UID: \"5bc818bb-08e8-4216-ba16-001f3c62ea00\") " pod="ai-tenant-e2e-shared-b-d1d0db/sub-test-model-d1d0db-kserve-57d655fc7c-zgzw4"
Jul 06 20:11:14.539024 ip-10-0-131-168 kubenswrapper[2565]: I0706 20:11:14.538750    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/5bc818bb-08e8-4216-ba16-001f3c62ea00-tls-certs\") pod \"sub-test-model-d1d0db-kserve-57d655fc7c-zgzw4\" (UID: \"5bc818bb-08e8-4216-ba16-001f3c62ea00\") " pod="ai-tenant-e2e-shared-b-d1d0db/sub-test-model-d1d0db-kserve-57d655fc7c-zgzw4"
Jul 06 20:11:14.539024 ip-10-0-131-168 kubenswrapper[2565]: I0706 20:11:14.538830    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/5bc818bb-08e8-4216-ba16-001f3c62ea00-model-cache\") pod \"sub-test-model-d1d0db-kserve-57d655fc7c-zgzw4\" (UID: \"5bc818bb-08e8-4216-ba16-001f3c62ea00\") " pod="ai-tenant-e2e-shared-b-d1d0db/sub-test-model-d1d0db-kserve-57d655fc7c-zgzw4"
Jul 06 20:11:14.539256 ip-10-0-131-168 kubenswrapper[2565]: I0706 20:11:14.539058    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/5bc818bb-08e8-4216-ba16-001f3c62ea00-tmp-dir\") pod \"sub-test-model-d1d0db-kserve-57d655fc7c-zgzw4\" (UID: \"5bc818bb-08e8-4216-ba16-001f3c62ea00\") " pod="ai-tenant-e2e-shared-b-d1d0db/sub-test-model-d1d0db-kserve-57d655fc7c-zgzw4"
Jul 06 20:11:14.539256 ip-10-0-131-168 kubenswrapper[2565]: I0706 20:11:14.539154    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/5bc818bb-08e8-4216-ba16-001f3c62ea00-home\") pod \"sub-test-model-d1d0db-kserve-57d655fc7c-zgzw4\" (UID: \"5bc818bb-08e8-4216-ba16-001f3c62ea00\") " pod="ai-tenant-e2e-shared-b-d1d0db/sub-test-model-d1d0db-kserve-57d655fc7c-zgzw4"
Jul 06 20:11:14.539256 ip-10-0-131-168 kubenswrapper[2565]: I0706 20:11:14.539171    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/5bc818bb-08e8-4216-ba16-001f3c62ea00-model-cache\") pod \"sub-test-model-d1d0db-kserve-57d655fc7c-zgzw4\" (UID: \"5bc818bb-08e8-4216-ba16-001f3c62ea00\") " pod="ai-tenant-e2e-shared-b-d1d0db/sub-test-model-d1d0db-kserve-57d655fc7c-zgzw4"
Jul 06 20:11:14.540960 ip-10-0-131-168 kubenswrapper[2565]: I0706 20:11:14.540937    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/5bc818bb-08e8-4216-ba16-001f3c62ea00-dshm\") pod \"sub-test-model-d1d0db-kserve-57d655fc7c-zgzw4\" (UID: \"5bc818bb-08e8-4216-ba16-001f3c62ea00\") " pod="ai-tenant-e2e-shared-b-d1d0db/sub-test-model-d1d0db-kserve-57d655fc7c-zgzw4"
Jul 06 20:11:14.541196 ip-10-0-131-168 kubenswrapper[2565]: I0706 20:11:14.541179    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/5bc818bb-08e8-4216-ba16-001f3c62ea00-tls-certs\") pod \"sub-test-model-d1d0db-kserve-57d655fc7c-zgzw4\" (UID: \"5bc818bb-08e8-4216-ba16-001f3c62ea00\") " pod="ai-tenant-e2e-shared-b-d1d0db/sub-test-model-d1d0db-kserve-57d655fc7c-zgzw4"
Jul 06 20:11:14.548711 ip-10-0-131-168 kubenswrapper[2565]: I0706 20:11:14.548688    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-g7hr4\" (UniqueName: \"kubernetes.io/projected/5bc818bb-08e8-4216-ba16-001f3c62ea00-kube-api-access-g7hr4\") pod \"sub-test-model-d1d0db-kserve-57d655fc7c-zgzw4\" (UID: \"5bc818bb-08e8-4216-ba16-001f3c62ea00\") " pod="ai-tenant-e2e-shared-b-d1d0db/sub-test-model-d1d0db-kserve-57d655fc7c-zgzw4"
Jul 06 20:11:14.598713 ip-10-0-131-168 kubenswrapper[2565]: I0706 20:11:14.598661    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-d1d0db/sub-test-model-d1d0db-kserve-57d655fc7c-zgzw4"
Jul 06 20:11:14.739953 ip-10-0-131-168 kubenswrapper[2565]: I0706 20:11:14.739930    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-d1d0db/sub-test-model-d1d0db-kserve-57d655fc7c-zgzw4"]
Jul 06 20:11:14.742531 ip-10-0-131-168 kubenswrapper[2565]: W0706 20:11:14.742506    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod5bc818bb_08e8_4216_ba16_001f3c62ea00.slice/crio-98850d14170f5b6cb0ab103eb7314a93553d50cdf26fe90ce9d572bbdbff0668 WatchSource:0}: Error finding container 98850d14170f5b6cb0ab103eb7314a93553d50cdf26fe90ce9d572bbdbff0668: Status 404 returned error can't find the container with id 98850d14170f5b6cb0ab103eb7314a93553d50cdf26fe90ce9d572bbdbff0668
Jul 06 20:11:15.628606 ip-10-0-131-168 kubenswrapper[2565]: I0706 20:11:15.628571    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-d1d0db/sub-test-model-d1d0db-kserve-57d655fc7c-zgzw4" event={"ID":"5bc818bb-08e8-4216-ba16-001f3c62ea00","Type":"ContainerStarted","Data":"9c7f12563ecf4a19667b5279fedca18be294c0dc4f0923b6d4c931ff1ab74652"}
Jul 06 20:11:15.628995 ip-10-0-131-168 kubenswrapper[2565]: I0706 20:11:15.628619    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-d1d0db/sub-test-model-d1d0db-kserve-57d655fc7c-zgzw4" event={"ID":"5bc818bb-08e8-4216-ba16-001f3c62ea00","Type":"ContainerStarted","Data":"98850d14170f5b6cb0ab103eb7314a93553d50cdf26fe90ce9d572bbdbff0668"}
Jul 06 20:11:15.650783 ip-10-0-131-168 kubenswrapper[2565]: I0706 20:11:15.650718    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-b-d1d0db/sub-test-model-d1d0db-kserve-57d655fc7c-zgzw4" podStartSLOduration=1.650703305 podStartE2EDuration="1.650703305s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 20:11:14 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 20:11:15.6478466 +0000 UTC m=+2310.660835286" watchObservedRunningTime="2026-07-06 20:11:15.650703305 +0000 UTC m=+2310.663692012"
Jul 06 20:11:19.840025 ip-10-0-131-168 kubenswrapper[2565]: I0706 20:11:19.839988    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-mfwbr"]
Jul 06 20:11:24.598895 ip-10-0-131-168 kubenswrapper[2565]: I0706 20:11:24.598860    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-b-d1d0db/sub-test-model-d1d0db-kserve-57d655fc7c-zgzw4"
Jul 06 20:11:24.599295 ip-10-0-131-168 kubenswrapper[2565]: I0706 20:11:24.598909    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-b-d1d0db/sub-test-model-d1d0db-kserve-57d655fc7c-zgzw4"
Jul 06 20:11:24.611627 ip-10-0-131-168 kubenswrapper[2565]: I0706 20:11:24.611592    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-b-d1d0db/sub-test-model-d1d0db-kserve-57d655fc7c-zgzw4"
Jul 06 20:11:24.679171 ip-10-0-131-168 kubenswrapper[2565]: I0706 20:11:24.679138    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-b-d1d0db/sub-test-model-d1d0db-kserve-57d655fc7c-zgzw4"
Jul 06 20:11:38.223103 ip-10-0-131-168 kubenswrapper[2565]: I0706 20:11:38.223012    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-mfwbr"]
Jul 06 20:11:56.625407 ip-10-0-131-168 kubenswrapper[2565]: I0706 20:11:56.625365    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-mfwbr"]
Jul 06 20:12:04.501075 ip-10-0-131-168 kubenswrapper[2565]: I0706 20:12:04.501042    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-d1d0db/sub-test-model-d1d0db-kserve-57d655fc7c-zgzw4"]
Jul 06 20:12:14.520958 ip-10-0-131-168 kubenswrapper[2565]: I0706 20:12:14.520924    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-mfwbr"]
Jul 06 20:12:14.789330 ip-10-0-131-168 kubenswrapper[2565]: I0706 20:12:14.789241    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-a-ad5c84/rate-test-model-ad5c84-kserve-59fd86c6f9-h68ts"]
Jul 06 20:12:14.794742 ip-10-0-131-168 kubenswrapper[2565]: I0706 20:12:14.794137    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-ad5c84/rate-test-model-ad5c84-kserve-59fd86c6f9-h68ts"
Jul 06 20:12:14.797589 ip-10-0-131-168 kubenswrapper[2565]: I0706 20:12:14.797472    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-a-ad5c84\"/\"rate-test-model-ad5c84-kserve-self-signed-certs\""
Jul 06 20:12:14.798613 ip-10-0-131-168 kubenswrapper[2565]: I0706 20:12:14.798530    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-a-ad5c84\"/\"openshift-service-ca.crt\""
Jul 06 20:12:14.798613 ip-10-0-131-168 kubenswrapper[2565]: I0706 20:12:14.798543    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-a-ad5c84\"/\"kube-root-ca.crt\""
Jul 06 20:12:14.798613 ip-10-0-131-168 kubenswrapper[2565]: I0706 20:12:14.798585    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-a-ad5c84\"/\"default-dockercfg-4w4g5\""
Jul 06 20:12:14.801071 ip-10-0-131-168 kubenswrapper[2565]: I0706 20:12:14.801050    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-ad5c84/rate-test-model-ad5c84-kserve-59fd86c6f9-h68ts"]
Jul 06 20:12:14.884631 ip-10-0-131-168 kubenswrapper[2565]: I0706 20:12:14.884593    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/5c5362be-04df-404f-90a8-095576d31016-tmp-dir\") pod \"rate-test-model-ad5c84-kserve-59fd86c6f9-h68ts\" (UID: \"5c5362be-04df-404f-90a8-095576d31016\") " pod="ai-tenant-e2e-shared-a-ad5c84/rate-test-model-ad5c84-kserve-59fd86c6f9-h68ts"
Jul 06 20:12:14.884631 ip-10-0-131-168 kubenswrapper[2565]: I0706 20:12:14.884627    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/5c5362be-04df-404f-90a8-095576d31016-home\") pod \"rate-test-model-ad5c84-kserve-59fd86c6f9-h68ts\" (UID: \"5c5362be-04df-404f-90a8-095576d31016\") " pod="ai-tenant-e2e-shared-a-ad5c84/rate-test-model-ad5c84-kserve-59fd86c6f9-h68ts"
Jul 06 20:12:14.884891 ip-10-0-131-168 kubenswrapper[2565]: I0706 20:12:14.884646    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/5c5362be-04df-404f-90a8-095576d31016-tls-certs\") pod \"rate-test-model-ad5c84-kserve-59fd86c6f9-h68ts\" (UID: \"5c5362be-04df-404f-90a8-095576d31016\") " pod="ai-tenant-e2e-shared-a-ad5c84/rate-test-model-ad5c84-kserve-59fd86c6f9-h68ts"
Jul 06 20:12:14.884891 ip-10-0-131-168 kubenswrapper[2565]: I0706 20:12:14.884674    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hr8qb\" (UniqueName: \"kubernetes.io/projected/5c5362be-04df-404f-90a8-095576d31016-kube-api-access-hr8qb\") pod \"rate-test-model-ad5c84-kserve-59fd86c6f9-h68ts\" (UID: \"5c5362be-04df-404f-90a8-095576d31016\") " pod="ai-tenant-e2e-shared-a-ad5c84/rate-test-model-ad5c84-kserve-59fd86c6f9-h68ts"
Jul 06 20:12:14.884891 ip-10-0-131-168 kubenswrapper[2565]: I0706 20:12:14.884745    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/5c5362be-04df-404f-90a8-095576d31016-model-cache\") pod \"rate-test-model-ad5c84-kserve-59fd86c6f9-h68ts\" (UID: \"5c5362be-04df-404f-90a8-095576d31016\") " pod="ai-tenant-e2e-shared-a-ad5c84/rate-test-model-ad5c84-kserve-59fd86c6f9-h68ts"
Jul 06 20:12:14.884891 ip-10-0-131-168 kubenswrapper[2565]: I0706 20:12:14.884855    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/5c5362be-04df-404f-90a8-095576d31016-dshm\") pod \"rate-test-model-ad5c84-kserve-59fd86c6f9-h68ts\" (UID: \"5c5362be-04df-404f-90a8-095576d31016\") " pod="ai-tenant-e2e-shared-a-ad5c84/rate-test-model-ad5c84-kserve-59fd86c6f9-h68ts"
Jul 06 20:12:14.985460 ip-10-0-131-168 kubenswrapper[2565]: I0706 20:12:14.985419    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/5c5362be-04df-404f-90a8-095576d31016-dshm\") pod \"rate-test-model-ad5c84-kserve-59fd86c6f9-h68ts\" (UID: \"5c5362be-04df-404f-90a8-095576d31016\") " pod="ai-tenant-e2e-shared-a-ad5c84/rate-test-model-ad5c84-kserve-59fd86c6f9-h68ts"
Jul 06 20:12:14.985657 ip-10-0-131-168 kubenswrapper[2565]: I0706 20:12:14.985486    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/5c5362be-04df-404f-90a8-095576d31016-tmp-dir\") pod \"rate-test-model-ad5c84-kserve-59fd86c6f9-h68ts\" (UID: \"5c5362be-04df-404f-90a8-095576d31016\") " pod="ai-tenant-e2e-shared-a-ad5c84/rate-test-model-ad5c84-kserve-59fd86c6f9-h68ts"
Jul 06 20:12:14.985657 ip-10-0-131-168 kubenswrapper[2565]: I0706 20:12:14.985504    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/5c5362be-04df-404f-90a8-095576d31016-home\") pod \"rate-test-model-ad5c84-kserve-59fd86c6f9-h68ts\" (UID: \"5c5362be-04df-404f-90a8-095576d31016\") " pod="ai-tenant-e2e-shared-a-ad5c84/rate-test-model-ad5c84-kserve-59fd86c6f9-h68ts"
Jul 06 20:12:14.985657 ip-10-0-131-168 kubenswrapper[2565]: I0706 20:12:14.985519    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/5c5362be-04df-404f-90a8-095576d31016-tls-certs\") pod \"rate-test-model-ad5c84-kserve-59fd86c6f9-h68ts\" (UID: \"5c5362be-04df-404f-90a8-095576d31016\") " pod="ai-tenant-e2e-shared-a-ad5c84/rate-test-model-ad5c84-kserve-59fd86c6f9-h68ts"
Jul 06 20:12:14.985657 ip-10-0-131-168 kubenswrapper[2565]: I0706 20:12:14.985546    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hr8qb\" (UniqueName: \"kubernetes.io/projected/5c5362be-04df-404f-90a8-095576d31016-kube-api-access-hr8qb\") pod \"rate-test-model-ad5c84-kserve-59fd86c6f9-h68ts\" (UID: \"5c5362be-04df-404f-90a8-095576d31016\") " pod="ai-tenant-e2e-shared-a-ad5c84/rate-test-model-ad5c84-kserve-59fd86c6f9-h68ts"
Jul 06 20:12:14.985657 ip-10-0-131-168 kubenswrapper[2565]: I0706 20:12:14.985567    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/5c5362be-04df-404f-90a8-095576d31016-model-cache\") pod \"rate-test-model-ad5c84-kserve-59fd86c6f9-h68ts\" (UID: \"5c5362be-04df-404f-90a8-095576d31016\") " pod="ai-tenant-e2e-shared-a-ad5c84/rate-test-model-ad5c84-kserve-59fd86c6f9-h68ts"
Jul 06 20:12:14.985972 ip-10-0-131-168 kubenswrapper[2565]: I0706 20:12:14.985960    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/5c5362be-04df-404f-90a8-095576d31016-home\") pod \"rate-test-model-ad5c84-kserve-59fd86c6f9-h68ts\" (UID: \"5c5362be-04df-404f-90a8-095576d31016\") " pod="ai-tenant-e2e-shared-a-ad5c84/rate-test-model-ad5c84-kserve-59fd86c6f9-h68ts"
Jul 06 20:12:14.986038 ip-10-0-131-168 kubenswrapper[2565]: I0706 20:12:14.986013    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/5c5362be-04df-404f-90a8-095576d31016-tmp-dir\") pod \"rate-test-model-ad5c84-kserve-59fd86c6f9-h68ts\" (UID: \"5c5362be-04df-404f-90a8-095576d31016\") " pod="ai-tenant-e2e-shared-a-ad5c84/rate-test-model-ad5c84-kserve-59fd86c6f9-h68ts"
Jul 06 20:12:14.986085 ip-10-0-131-168 kubenswrapper[2565]: I0706 20:12:14.986058    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/5c5362be-04df-404f-90a8-095576d31016-model-cache\") pod \"rate-test-model-ad5c84-kserve-59fd86c6f9-h68ts\" (UID: \"5c5362be-04df-404f-90a8-095576d31016\") " pod="ai-tenant-e2e-shared-a-ad5c84/rate-test-model-ad5c84-kserve-59fd86c6f9-h68ts"
Jul 06 20:12:14.987889 ip-10-0-131-168 kubenswrapper[2565]: I0706 20:12:14.987856    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/5c5362be-04df-404f-90a8-095576d31016-dshm\") pod \"rate-test-model-ad5c84-kserve-59fd86c6f9-h68ts\" (UID: \"5c5362be-04df-404f-90a8-095576d31016\") " pod="ai-tenant-e2e-shared-a-ad5c84/rate-test-model-ad5c84-kserve-59fd86c6f9-h68ts"
Jul 06 20:12:14.988046 ip-10-0-131-168 kubenswrapper[2565]: I0706 20:12:14.988028    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/5c5362be-04df-404f-90a8-095576d31016-tls-certs\") pod \"rate-test-model-ad5c84-kserve-59fd86c6f9-h68ts\" (UID: \"5c5362be-04df-404f-90a8-095576d31016\") " pod="ai-tenant-e2e-shared-a-ad5c84/rate-test-model-ad5c84-kserve-59fd86c6f9-h68ts"
Jul 06 20:12:14.994102 ip-10-0-131-168 kubenswrapper[2565]: I0706 20:12:14.994081    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hr8qb\" (UniqueName: \"kubernetes.io/projected/5c5362be-04df-404f-90a8-095576d31016-kube-api-access-hr8qb\") pod \"rate-test-model-ad5c84-kserve-59fd86c6f9-h68ts\" (UID: \"5c5362be-04df-404f-90a8-095576d31016\") " pod="ai-tenant-e2e-shared-a-ad5c84/rate-test-model-ad5c84-kserve-59fd86c6f9-h68ts"
Jul 06 20:12:15.106143 ip-10-0-131-168 kubenswrapper[2565]: I0706 20:12:15.106057    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-ad5c84/rate-test-model-ad5c84-kserve-59fd86c6f9-h68ts"
Jul 06 20:12:15.252601 ip-10-0-131-168 kubenswrapper[2565]: I0706 20:12:15.252571    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-ad5c84/rate-test-model-ad5c84-kserve-59fd86c6f9-h68ts"]
Jul 06 20:12:15.255473 ip-10-0-131-168 kubenswrapper[2565]: W0706 20:12:15.255437    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod5c5362be_04df_404f_90a8_095576d31016.slice/crio-1856dddb42270e741d98c57a3a619551ec5f4d4f3421123e3f1606716f337054 WatchSource:0}: Error finding container 1856dddb42270e741d98c57a3a619551ec5f4d4f3421123e3f1606716f337054: Status 404 returned error can't find the container with id 1856dddb42270e741d98c57a3a619551ec5f4d4f3421123e3f1606716f337054
Jul 06 20:12:15.911379 ip-10-0-131-168 kubenswrapper[2565]: I0706 20:12:15.911343    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-ad5c84/rate-test-model-ad5c84-kserve-59fd86c6f9-h68ts" event={"ID":"5c5362be-04df-404f-90a8-095576d31016","Type":"ContainerStarted","Data":"2ca3c81c7ba9379c832c1317a17ec9b71dd61607b9321ab1393bc9e41a3e2086"}
Jul 06 20:12:15.911379 ip-10-0-131-168 kubenswrapper[2565]: I0706 20:12:15.911382    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-ad5c84/rate-test-model-ad5c84-kserve-59fd86c6f9-h68ts" event={"ID":"5c5362be-04df-404f-90a8-095576d31016","Type":"ContainerStarted","Data":"1856dddb42270e741d98c57a3a619551ec5f4d4f3421123e3f1606716f337054"}
Jul 06 20:12:15.931956 ip-10-0-131-168 kubenswrapper[2565]: I0706 20:12:15.931906    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-a-ad5c84/rate-test-model-ad5c84-kserve-59fd86c6f9-h68ts" podStartSLOduration=1.931888828 podStartE2EDuration="1.931888828s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 20:12:14 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 20:12:15.930524192 +0000 UTC m=+2370.943512864" watchObservedRunningTime="2026-07-06 20:12:15.931888828 +0000 UTC m=+2370.944877497"
Jul 06 20:12:19.521117 ip-10-0-131-168 kubenswrapper[2565]: I0706 20:12:19.521080    2565 kuberuntime_container.go:872] "Killing container with a grace period" pod="ai-tenant-e2e-shared-b-d1d0db/sub-test-model-d1d0db-kserve-57d655fc7c-zgzw4" podUID="5bc818bb-08e8-4216-ba16-001f3c62ea00" containerName="main" containerID="cri-o://9c7f12563ecf4a19667b5279fedca18be294c0dc4f0923b6d4c931ff1ab74652" gracePeriod=45
Jul 06 20:12:19.762705 ip-10-0-131-168 kubenswrapper[2565]: I0706 20:12:19.762681    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-d1d0db/sub-test-model-d1d0db-kserve-57d655fc7c-zgzw4"
Jul 06 20:12:19.830473 ip-10-0-131-168 kubenswrapper[2565]: I0706 20:12:19.830395    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-g7hr4\" (UniqueName: \"kubernetes.io/projected/5bc818bb-08e8-4216-ba16-001f3c62ea00-kube-api-access-g7hr4\") pod \"5bc818bb-08e8-4216-ba16-001f3c62ea00\" (UID: \"5bc818bb-08e8-4216-ba16-001f3c62ea00\") "
Jul 06 20:12:19.830473 ip-10-0-131-168 kubenswrapper[2565]: I0706 20:12:19.830458    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/5bc818bb-08e8-4216-ba16-001f3c62ea00-dshm\") pod \"5bc818bb-08e8-4216-ba16-001f3c62ea00\" (UID: \"5bc818bb-08e8-4216-ba16-001f3c62ea00\") "
Jul 06 20:12:19.830688 ip-10-0-131-168 kubenswrapper[2565]: I0706 20:12:19.830494    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/5bc818bb-08e8-4216-ba16-001f3c62ea00-tmp-dir\") pod \"5bc818bb-08e8-4216-ba16-001f3c62ea00\" (UID: \"5bc818bb-08e8-4216-ba16-001f3c62ea00\") "
Jul 06 20:12:19.830688 ip-10-0-131-168 kubenswrapper[2565]: I0706 20:12:19.830532    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/5bc818bb-08e8-4216-ba16-001f3c62ea00-model-cache\") pod \"5bc818bb-08e8-4216-ba16-001f3c62ea00\" (UID: \"5bc818bb-08e8-4216-ba16-001f3c62ea00\") "
Jul 06 20:12:19.830688 ip-10-0-131-168 kubenswrapper[2565]: I0706 20:12:19.830588    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/5bc818bb-08e8-4216-ba16-001f3c62ea00-tls-certs\") pod \"5bc818bb-08e8-4216-ba16-001f3c62ea00\" (UID: \"5bc818bb-08e8-4216-ba16-001f3c62ea00\") "
Jul 06 20:12:19.830688 ip-10-0-131-168 kubenswrapper[2565]: I0706 20:12:19.830607    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/5bc818bb-08e8-4216-ba16-001f3c62ea00-home\") pod \"5bc818bb-08e8-4216-ba16-001f3c62ea00\" (UID: \"5bc818bb-08e8-4216-ba16-001f3c62ea00\") "
Jul 06 20:12:19.830943 ip-10-0-131-168 kubenswrapper[2565]: I0706 20:12:19.830840    2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5bc818bb-08e8-4216-ba16-001f3c62ea00-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "5bc818bb-08e8-4216-ba16-001f3c62ea00" (UID: "5bc818bb-08e8-4216-ba16-001f3c62ea00"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 20:12:19.830943 ip-10-0-131-168 kubenswrapper[2565]: I0706 20:12:19.830865    2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5bc818bb-08e8-4216-ba16-001f3c62ea00-model-cache" (OuterVolumeSpecName: "model-cache") pod "5bc818bb-08e8-4216-ba16-001f3c62ea00" (UID: "5bc818bb-08e8-4216-ba16-001f3c62ea00"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 20:12:19.831045 ip-10-0-131-168 kubenswrapper[2565]: I0706 20:12:19.830999    2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5bc818bb-08e8-4216-ba16-001f3c62ea00-home" (OuterVolumeSpecName: "home") pod "5bc818bb-08e8-4216-ba16-001f3c62ea00" (UID: "5bc818bb-08e8-4216-ba16-001f3c62ea00"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 20:12:19.832562 ip-10-0-131-168 kubenswrapper[2565]: I0706 20:12:19.832542    2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5bc818bb-08e8-4216-ba16-001f3c62ea00-dshm" (OuterVolumeSpecName: "dshm") pod "5bc818bb-08e8-4216-ba16-001f3c62ea00" (UID: "5bc818bb-08e8-4216-ba16-001f3c62ea00"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 20:12:19.832642 ip-10-0-131-168 kubenswrapper[2565]: I0706 20:12:19.832608    2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5bc818bb-08e8-4216-ba16-001f3c62ea00-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "5bc818bb-08e8-4216-ba16-001f3c62ea00" (UID: "5bc818bb-08e8-4216-ba16-001f3c62ea00"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 06 20:12:19.832714 ip-10-0-131-168 kubenswrapper[2565]: I0706 20:12:19.832693    2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5bc818bb-08e8-4216-ba16-001f3c62ea00-kube-api-access-g7hr4" (OuterVolumeSpecName: "kube-api-access-g7hr4") pod "5bc818bb-08e8-4216-ba16-001f3c62ea00" (UID: "5bc818bb-08e8-4216-ba16-001f3c62ea00"). InnerVolumeSpecName "kube-api-access-g7hr4". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 06 20:12:19.931240 ip-10-0-131-168 kubenswrapper[2565]: I0706 20:12:19.931212    2565 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/5bc818bb-08e8-4216-ba16-001f3c62ea00-tmp-dir\") on node \"ip-10-0-131-168.ec2.internal\" DevicePath \"\""
Jul 06 20:12:19.931240 ip-10-0-131-168 kubenswrapper[2565]: I0706 20:12:19.931234    2565 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/5bc818bb-08e8-4216-ba16-001f3c62ea00-model-cache\") on node \"ip-10-0-131-168.ec2.internal\" DevicePath \"\""
Jul 06 20:12:19.931240 ip-10-0-131-168 kubenswrapper[2565]: I0706 20:12:19.931243    2565 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/5bc818bb-08e8-4216-ba16-001f3c62ea00-tls-certs\") on node \"ip-10-0-131-168.ec2.internal\" DevicePath \"\""
Jul 06 20:12:19.931240 ip-10-0-131-168 kubenswrapper[2565]: I0706 20:12:19.931250    2565 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/5bc818bb-08e8-4216-ba16-001f3c62ea00-home\") on node \"ip-10-0-131-168.ec2.internal\" DevicePath \"\""
Jul 06 20:12:19.931576 ip-10-0-131-168 kubenswrapper[2565]: I0706 20:12:19.931266    2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-g7hr4\" (UniqueName: \"kubernetes.io/projected/5bc818bb-08e8-4216-ba16-001f3c62ea00-kube-api-access-g7hr4\") on node \"ip-10-0-131-168.ec2.internal\" DevicePath \"\""
Jul 06 20:12:19.931576 ip-10-0-131-168 kubenswrapper[2565]: I0706 20:12:19.931276    2565 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/5bc818bb-08e8-4216-ba16-001f3c62ea00-dshm\") on node \"ip-10-0-131-168.ec2.internal\" DevicePath \"\""
Jul 06 20:12:19.932209 ip-10-0-131-168 kubenswrapper[2565]: I0706 20:12:19.932182    2565 generic.go:356] "Generic (PLEG): container finished" podID="5bc818bb-08e8-4216-ba16-001f3c62ea00" containerID="9c7f12563ecf4a19667b5279fedca18be294c0dc4f0923b6d4c931ff1ab74652" exitCode=0
Jul 06 20:12:19.932304 ip-10-0-131-168 kubenswrapper[2565]: I0706 20:12:19.932234    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-d1d0db/sub-test-model-d1d0db-kserve-57d655fc7c-zgzw4"
Jul 06 20:12:19.932304 ip-10-0-131-168 kubenswrapper[2565]: I0706 20:12:19.932275    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-d1d0db/sub-test-model-d1d0db-kserve-57d655fc7c-zgzw4" event={"ID":"5bc818bb-08e8-4216-ba16-001f3c62ea00","Type":"ContainerDied","Data":"9c7f12563ecf4a19667b5279fedca18be294c0dc4f0923b6d4c931ff1ab74652"}
Jul 06 20:12:19.932405 ip-10-0-131-168 kubenswrapper[2565]: I0706 20:12:19.932316    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-d1d0db/sub-test-model-d1d0db-kserve-57d655fc7c-zgzw4" event={"ID":"5bc818bb-08e8-4216-ba16-001f3c62ea00","Type":"ContainerDied","Data":"98850d14170f5b6cb0ab103eb7314a93553d50cdf26fe90ce9d572bbdbff0668"}
Jul 06 20:12:19.932405 ip-10-0-131-168 kubenswrapper[2565]: I0706 20:12:19.932335    2565 scope.go:117] "RemoveContainer" containerID="9c7f12563ecf4a19667b5279fedca18be294c0dc4f0923b6d4c931ff1ab74652"
Jul 06 20:12:19.942544 ip-10-0-131-168 kubenswrapper[2565]: I0706 20:12:19.942520    2565 scope.go:117] "RemoveContainer" containerID="9c7f12563ecf4a19667b5279fedca18be294c0dc4f0923b6d4c931ff1ab74652"
Jul 06 20:12:19.943851 ip-10-0-131-168 kubenswrapper[2565]: E0706 20:12:19.943818    2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9c7f12563ecf4a19667b5279fedca18be294c0dc4f0923b6d4c931ff1ab74652\": container with ID starting with 9c7f12563ecf4a19667b5279fedca18be294c0dc4f0923b6d4c931ff1ab74652 not found: ID does not exist" containerID="9c7f12563ecf4a19667b5279fedca18be294c0dc4f0923b6d4c931ff1ab74652"
Jul 06 20:12:19.943944 ip-10-0-131-168 kubenswrapper[2565]: I0706 20:12:19.943862    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9c7f12563ecf4a19667b5279fedca18be294c0dc4f0923b6d4c931ff1ab74652"} err="failed to get container status \"9c7f12563ecf4a19667b5279fedca18be294c0dc4f0923b6d4c931ff1ab74652\": rpc error: code = NotFound desc = could not find container \"9c7f12563ecf4a19667b5279fedca18be294c0dc4f0923b6d4c931ff1ab74652\": container with ID starting with 9c7f12563ecf4a19667b5279fedca18be294c0dc4f0923b6d4c931ff1ab74652 not found: ID does not exist"
Jul 06 20:12:19.974887 ip-10-0-131-168 kubenswrapper[2565]: I0706 20:12:19.974859    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-d1d0db/sub-test-model-d1d0db-kserve-57d655fc7c-zgzw4"]
Jul 06 20:12:19.982921 ip-10-0-131-168 kubenswrapper[2565]: I0706 20:12:19.982894    2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-b-d1d0db/sub-test-model-d1d0db-kserve-57d655fc7c-zgzw4"]
Jul 06 20:12:21.494704 ip-10-0-131-168 kubenswrapper[2565]: I0706 20:12:21.494669    2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="5bc818bb-08e8-4216-ba16-001f3c62ea00" path="/var/lib/kubelet/pods/5bc818bb-08e8-4216-ba16-001f3c62ea00/volumes"
Jul 06 20:12:25.106282 ip-10-0-131-168 kubenswrapper[2565]: I0706 20:12:25.106253    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-a-ad5c84/rate-test-model-ad5c84-kserve-59fd86c6f9-h68ts"
Jul 06 20:12:25.106666 ip-10-0-131-168 kubenswrapper[2565]: I0706 20:12:25.106297    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-a-ad5c84/rate-test-model-ad5c84-kserve-59fd86c6f9-h68ts"
Jul 06 20:12:25.119124 ip-10-0-131-168 kubenswrapper[2565]: I0706 20:12:25.119099    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-a-ad5c84/rate-test-model-ad5c84-kserve-59fd86c6f9-h68ts"
Jul 06 20:12:25.515521 ip-10-0-131-168 kubenswrapper[2565]: I0706 20:12:25.515491    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-mfwbr"]
Jul 06 20:12:25.971678 ip-10-0-131-168 kubenswrapper[2565]: I0706 20:12:25.971651    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-a-ad5c84/rate-test-model-ad5c84-kserve-59fd86c6f9-h68ts"
Jul 06 20:12:42.119884 ip-10-0-131-168 kubenswrapper[2565]: I0706 20:12:42.119847    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-mfwbr"]
Jul 06 20:12:45.511515 ip-10-0-131-168 kubenswrapper[2565]: I0706 20:12:45.511488    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-8kjqk_9f15114d-7494-4f17-8a4d-52185f7a2e35/ovn-acl-logging/0.log"
Jul 06 20:12:45.523251 ip-10-0-131-168 kubenswrapper[2565]: I0706 20:12:45.523226    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-8kjqk_9f15114d-7494-4f17-8a4d-52185f7a2e35/ovn-acl-logging/0.log"
Jul 06 20:12:56.523079 ip-10-0-131-168 kubenswrapper[2565]: I0706 20:12:56.523046    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-mfwbr"]
Jul 06 20:13:18.342748 ip-10-0-131-168 kubenswrapper[2565]: I0706 20:13:18.342668    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-mfwbr"]
Jul 06 20:13:22.985652 ip-10-0-131-168 kubenswrapper[2565]: I0706 20:13:22.985621    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-ad5c84/rate-test-model-ad5c84-kserve-59fd86c6f9-h68ts"]
Jul 06 20:13:25.921041 ip-10-0-131-168 kubenswrapper[2565]: I0706 20:13:25.921010    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-api-e2e-shared-a-ad5c84-78db7c56fb-wmsg8"]
Jul 06 20:13:25.921464 ip-10-0-131-168 kubenswrapper[2565]: I0706 20:13:25.921219    2565 kuberuntime_container.go:872] "Killing container with a grace period" pod="opendatahub/maas-api-e2e-shared-a-ad5c84-78db7c56fb-wmsg8" podUID="f129de78-75e0-4662-b154-cc4da4cf26ce" containerName="maas-api" containerID="cri-o://9875be2edc27a3ceb6acf3a9e6d7ef7b3475975ff0acff5c5566302ef85e7d53" gracePeriod=30
Jul 06 20:13:26.173656 ip-10-0-131-168 kubenswrapper[2565]: I0706 20:13:26.173588    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-shared-a-ad5c84-78db7c56fb-wmsg8"
Jul 06 20:13:26.236916 ip-10-0-131-168 kubenswrapper[2565]: I0706 20:13:26.236885    2565 generic.go:356] "Generic (PLEG): container finished" podID="f129de78-75e0-4662-b154-cc4da4cf26ce" containerID="9875be2edc27a3ceb6acf3a9e6d7ef7b3475975ff0acff5c5566302ef85e7d53" exitCode=0
Jul 06 20:13:26.237179 ip-10-0-131-168 kubenswrapper[2565]: I0706 20:13:26.236927    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-shared-a-ad5c84-78db7c56fb-wmsg8"
Jul 06 20:13:26.237179 ip-10-0-131-168 kubenswrapper[2565]: I0706 20:13:26.236942    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-shared-a-ad5c84-78db7c56fb-wmsg8" event={"ID":"f129de78-75e0-4662-b154-cc4da4cf26ce","Type":"ContainerDied","Data":"9875be2edc27a3ceb6acf3a9e6d7ef7b3475975ff0acff5c5566302ef85e7d53"}
Jul 06 20:13:26.237179 ip-10-0-131-168 kubenswrapper[2565]: I0706 20:13:26.237023    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-shared-a-ad5c84-78db7c56fb-wmsg8" event={"ID":"f129de78-75e0-4662-b154-cc4da4cf26ce","Type":"ContainerDied","Data":"a9309f1db666e22da534653f2255043c5f94b222079dd79b17a1b6952131a7a2"}
Jul 06 20:13:26.237179 ip-10-0-131-168 kubenswrapper[2565]: I0706 20:13:26.237053    2565 scope.go:117] "RemoveContainer" containerID="9875be2edc27a3ceb6acf3a9e6d7ef7b3475975ff0acff5c5566302ef85e7d53"
Jul 06 20:13:26.245510 ip-10-0-131-168 kubenswrapper[2565]: I0706 20:13:26.245494    2565 scope.go:117] "RemoveContainer" containerID="9875be2edc27a3ceb6acf3a9e6d7ef7b3475975ff0acff5c5566302ef85e7d53"
Jul 06 20:13:26.245795 ip-10-0-131-168 kubenswrapper[2565]: E0706 20:13:26.245761    2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9875be2edc27a3ceb6acf3a9e6d7ef7b3475975ff0acff5c5566302ef85e7d53\": container with ID starting with 9875be2edc27a3ceb6acf3a9e6d7ef7b3475975ff0acff5c5566302ef85e7d53 not found: ID does not exist" containerID="9875be2edc27a3ceb6acf3a9e6d7ef7b3475975ff0acff5c5566302ef85e7d53"
Jul 06 20:13:26.245849 ip-10-0-131-168 kubenswrapper[2565]: I0706 20:13:26.245804    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9875be2edc27a3ceb6acf3a9e6d7ef7b3475975ff0acff5c5566302ef85e7d53"} err="failed to get container status \"9875be2edc27a3ceb6acf3a9e6d7ef7b3475975ff0acff5c5566302ef85e7d53\": rpc error: code = NotFound desc = could not find container \"9875be2edc27a3ceb6acf3a9e6d7ef7b3475975ff0acff5c5566302ef85e7d53\": container with ID starting with 9875be2edc27a3ceb6acf3a9e6d7ef7b3475975ff0acff5c5566302ef85e7d53 not found: ID does not exist"
Jul 06 20:13:26.353451 ip-10-0-131-168 kubenswrapper[2565]: I0706 20:13:26.353416    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/f129de78-75e0-4662-b154-cc4da4cf26ce-openshift-service-ca\") pod \"f129de78-75e0-4662-b154-cc4da4cf26ce\" (UID: \"f129de78-75e0-4662-b154-cc4da4cf26ce\") "
Jul 06 20:13:26.353617 ip-10-0-131-168 kubenswrapper[2565]: I0706 20:13:26.353467    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/f129de78-75e0-4662-b154-cc4da4cf26ce-maas-api-tls\") pod \"f129de78-75e0-4662-b154-cc4da4cf26ce\" (UID: \"f129de78-75e0-4662-b154-cc4da4cf26ce\") "
Jul 06 20:13:26.353617 ip-10-0-131-168 kubenswrapper[2565]: I0706 20:13:26.353524    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-sv9gg\" (UniqueName: \"kubernetes.io/projected/f129de78-75e0-4662-b154-cc4da4cf26ce-kube-api-access-sv9gg\") pod \"f129de78-75e0-4662-b154-cc4da4cf26ce\" (UID: \"f129de78-75e0-4662-b154-cc4da4cf26ce\") "
Jul 06 20:13:26.353875 ip-10-0-131-168 kubenswrapper[2565]: I0706 20:13:26.353849    2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f129de78-75e0-4662-b154-cc4da4cf26ce-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "f129de78-75e0-4662-b154-cc4da4cf26ce" (UID: "f129de78-75e0-4662-b154-cc4da4cf26ce"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 06 20:13:26.355600 ip-10-0-131-168 kubenswrapper[2565]: I0706 20:13:26.355578    2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f129de78-75e0-4662-b154-cc4da4cf26ce-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "f129de78-75e0-4662-b154-cc4da4cf26ce" (UID: "f129de78-75e0-4662-b154-cc4da4cf26ce"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 06 20:13:26.355666 ip-10-0-131-168 kubenswrapper[2565]: I0706 20:13:26.355583    2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f129de78-75e0-4662-b154-cc4da4cf26ce-kube-api-access-sv9gg" (OuterVolumeSpecName: "kube-api-access-sv9gg") pod "f129de78-75e0-4662-b154-cc4da4cf26ce" (UID: "f129de78-75e0-4662-b154-cc4da4cf26ce"). InnerVolumeSpecName "kube-api-access-sv9gg". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 06 20:13:26.454337 ip-10-0-131-168 kubenswrapper[2565]: I0706 20:13:26.454259    2565 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/f129de78-75e0-4662-b154-cc4da4cf26ce-maas-api-tls\") on node \"ip-10-0-131-168.ec2.internal\" DevicePath \"\""
Jul 06 20:13:26.454337 ip-10-0-131-168 kubenswrapper[2565]: I0706 20:13:26.454286    2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-sv9gg\" (UniqueName: \"kubernetes.io/projected/f129de78-75e0-4662-b154-cc4da4cf26ce-kube-api-access-sv9gg\") on node \"ip-10-0-131-168.ec2.internal\" DevicePath \"\""
Jul 06 20:13:26.454337 ip-10-0-131-168 kubenswrapper[2565]: I0706 20:13:26.454299    2565 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/f129de78-75e0-4662-b154-cc4da4cf26ce-openshift-service-ca\") on node \"ip-10-0-131-168.ec2.internal\" DevicePath \"\""
Jul 06 20:13:26.563003 ip-10-0-131-168 kubenswrapper[2565]: I0706 20:13:26.562966    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-api-e2e-shared-a-ad5c84-78db7c56fb-wmsg8"]
Jul 06 20:13:26.564709 ip-10-0-131-168 kubenswrapper[2565]: I0706 20:13:26.564687    2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-api-e2e-shared-a-ad5c84-78db7c56fb-wmsg8"]
Jul 06 20:13:27.495236 ip-10-0-131-168 kubenswrapper[2565]: I0706 20:13:27.495207    2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f129de78-75e0-4662-b154-cc4da4cf26ce" path="/var/lib/kubelet/pods/f129de78-75e0-4662-b154-cc4da4cf26ce/volumes"
Jul 06 20:13:28.325514 ip-10-0-131-168 kubenswrapper[2565]: I0706 20:13:28.325480    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-mfwbr"]
Jul 06 20:13:38.005003 ip-10-0-131-168 kubenswrapper[2565]: I0706 20:13:38.004955    2565 kuberuntime_container.go:872] "Killing container with a grace period" pod="ai-tenant-e2e-shared-a-ad5c84/rate-test-model-ad5c84-kserve-59fd86c6f9-h68ts" podUID="5c5362be-04df-404f-90a8-095576d31016" containerName="main" containerID="cri-o://2ca3c81c7ba9379c832c1317a17ec9b71dd61607b9321ab1393bc9e41a3e2086" gracePeriod=45
Jul 06 20:13:38.262177 ip-10-0-131-168 kubenswrapper[2565]: I0706 20:13:38.262115    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-ad5c84/rate-test-model-ad5c84-kserve-59fd86c6f9-h68ts"
Jul 06 20:13:38.298405 ip-10-0-131-168 kubenswrapper[2565]: I0706 20:13:38.297799    2565 generic.go:356] "Generic (PLEG): container finished" podID="5c5362be-04df-404f-90a8-095576d31016" containerID="2ca3c81c7ba9379c832c1317a17ec9b71dd61607b9321ab1393bc9e41a3e2086" exitCode=0
Jul 06 20:13:38.298405 ip-10-0-131-168 kubenswrapper[2565]: I0706 20:13:38.297944    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-ad5c84/rate-test-model-ad5c84-kserve-59fd86c6f9-h68ts" event={"ID":"5c5362be-04df-404f-90a8-095576d31016","Type":"ContainerDied","Data":"2ca3c81c7ba9379c832c1317a17ec9b71dd61607b9321ab1393bc9e41a3e2086"}
Jul 06 20:13:38.298405 ip-10-0-131-168 kubenswrapper[2565]: I0706 20:13:38.297976    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-ad5c84/rate-test-model-ad5c84-kserve-59fd86c6f9-h68ts" event={"ID":"5c5362be-04df-404f-90a8-095576d31016","Type":"ContainerDied","Data":"1856dddb42270e741d98c57a3a619551ec5f4d4f3421123e3f1606716f337054"}
Jul 06 20:13:38.298405 ip-10-0-131-168 kubenswrapper[2565]: I0706 20:13:38.297996    2565 scope.go:117] "RemoveContainer" containerID="2ca3c81c7ba9379c832c1317a17ec9b71dd61607b9321ab1393bc9e41a3e2086"
Jul 06 20:13:38.298405 ip-10-0-131-168 kubenswrapper[2565]: I0706 20:13:38.298125    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-ad5c84/rate-test-model-ad5c84-kserve-59fd86c6f9-h68ts"
Jul 06 20:13:38.308571 ip-10-0-131-168 kubenswrapper[2565]: I0706 20:13:38.308552    2565 scope.go:117] "RemoveContainer" containerID="2ca3c81c7ba9379c832c1317a17ec9b71dd61607b9321ab1393bc9e41a3e2086"
Jul 06 20:13:38.308835 ip-10-0-131-168 kubenswrapper[2565]: E0706 20:13:38.308817    2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2ca3c81c7ba9379c832c1317a17ec9b71dd61607b9321ab1393bc9e41a3e2086\": container with ID starting with 2ca3c81c7ba9379c832c1317a17ec9b71dd61607b9321ab1393bc9e41a3e2086 not found: ID does not exist" containerID="2ca3c81c7ba9379c832c1317a17ec9b71dd61607b9321ab1393bc9e41a3e2086"
Jul 06 20:13:38.308929 ip-10-0-131-168 kubenswrapper[2565]: I0706 20:13:38.308840    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2ca3c81c7ba9379c832c1317a17ec9b71dd61607b9321ab1393bc9e41a3e2086"} err="failed to get container status \"2ca3c81c7ba9379c832c1317a17ec9b71dd61607b9321ab1393bc9e41a3e2086\": rpc error: code = NotFound desc = could not find container \"2ca3c81c7ba9379c832c1317a17ec9b71dd61607b9321ab1393bc9e41a3e2086\": container with ID starting with 2ca3c81c7ba9379c832c1317a17ec9b71dd61607b9321ab1393bc9e41a3e2086 not found: ID does not exist"
Jul 06 20:13:38.351595 ip-10-0-131-168 kubenswrapper[2565]: I0706 20:13:38.351568    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-hr8qb\" (UniqueName: \"kubernetes.io/projected/5c5362be-04df-404f-90a8-095576d31016-kube-api-access-hr8qb\") pod \"5c5362be-04df-404f-90a8-095576d31016\" (UID: \"5c5362be-04df-404f-90a8-095576d31016\") "
Jul 06 20:13:38.351595 ip-10-0-131-168 kubenswrapper[2565]: I0706 20:13:38.351596    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/5c5362be-04df-404f-90a8-095576d31016-dshm\") pod \"5c5362be-04df-404f-90a8-095576d31016\" (UID: \"5c5362be-04df-404f-90a8-095576d31016\") "
Jul 06 20:13:38.351759 ip-10-0-131-168 kubenswrapper[2565]: I0706 20:13:38.351622    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/5c5362be-04df-404f-90a8-095576d31016-model-cache\") pod \"5c5362be-04df-404f-90a8-095576d31016\" (UID: \"5c5362be-04df-404f-90a8-095576d31016\") "
Jul 06 20:13:38.351759 ip-10-0-131-168 kubenswrapper[2565]: I0706 20:13:38.351674    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/5c5362be-04df-404f-90a8-095576d31016-tls-certs\") pod \"5c5362be-04df-404f-90a8-095576d31016\" (UID: \"5c5362be-04df-404f-90a8-095576d31016\") "
Jul 06 20:13:38.351759 ip-10-0-131-168 kubenswrapper[2565]: I0706 20:13:38.351728    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/5c5362be-04df-404f-90a8-095576d31016-tmp-dir\") pod \"5c5362be-04df-404f-90a8-095576d31016\" (UID: \"5c5362be-04df-404f-90a8-095576d31016\") "
Jul 06 20:13:38.351901 ip-10-0-131-168 kubenswrapper[2565]: I0706 20:13:38.351800    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/5c5362be-04df-404f-90a8-095576d31016-home\") pod \"5c5362be-04df-404f-90a8-095576d31016\" (UID: \"5c5362be-04df-404f-90a8-095576d31016\") "
Jul 06 20:13:38.352016 ip-10-0-131-168 kubenswrapper[2565]: I0706 20:13:38.351995    2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5c5362be-04df-404f-90a8-095576d31016-model-cache" (OuterVolumeSpecName: "model-cache") pod "5c5362be-04df-404f-90a8-095576d31016" (UID: "5c5362be-04df-404f-90a8-095576d31016"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 20:13:38.352108 ip-10-0-131-168 kubenswrapper[2565]: I0706 20:13:38.352014    2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5c5362be-04df-404f-90a8-095576d31016-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "5c5362be-04df-404f-90a8-095576d31016" (UID: "5c5362be-04df-404f-90a8-095576d31016"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 20:13:38.352169 ip-10-0-131-168 kubenswrapper[2565]: I0706 20:13:38.352141    2565 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/5c5362be-04df-404f-90a8-095576d31016-tmp-dir\") on node \"ip-10-0-131-168.ec2.internal\" DevicePath \"\""
Jul 06 20:13:38.352169 ip-10-0-131-168 kubenswrapper[2565]: I0706 20:13:38.352159    2565 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/5c5362be-04df-404f-90a8-095576d31016-model-cache\") on node \"ip-10-0-131-168.ec2.internal\" DevicePath \"\""
Jul 06 20:13:38.352169 ip-10-0-131-168 kubenswrapper[2565]: I0706 20:13:38.352149    2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5c5362be-04df-404f-90a8-095576d31016-home" (OuterVolumeSpecName: "home") pod "5c5362be-04df-404f-90a8-095576d31016" (UID: "5c5362be-04df-404f-90a8-095576d31016"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 20:13:38.353734 ip-10-0-131-168 kubenswrapper[2565]: I0706 20:13:38.353714    2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5c5362be-04df-404f-90a8-095576d31016-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "5c5362be-04df-404f-90a8-095576d31016" (UID: "5c5362be-04df-404f-90a8-095576d31016"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 06 20:13:38.354176 ip-10-0-131-168 kubenswrapper[2565]: I0706 20:13:38.354149    2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5c5362be-04df-404f-90a8-095576d31016-kube-api-access-hr8qb" (OuterVolumeSpecName: "kube-api-access-hr8qb") pod "5c5362be-04df-404f-90a8-095576d31016" (UID: "5c5362be-04df-404f-90a8-095576d31016"). InnerVolumeSpecName "kube-api-access-hr8qb". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 06 20:13:38.354176 ip-10-0-131-168 kubenswrapper[2565]: I0706 20:13:38.354148    2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5c5362be-04df-404f-90a8-095576d31016-dshm" (OuterVolumeSpecName: "dshm") pod "5c5362be-04df-404f-90a8-095576d31016" (UID: "5c5362be-04df-404f-90a8-095576d31016"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 20:13:38.452831 ip-10-0-131-168 kubenswrapper[2565]: I0706 20:13:38.452798    2565 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/5c5362be-04df-404f-90a8-095576d31016-home\") on node \"ip-10-0-131-168.ec2.internal\" DevicePath \"\""
Jul 06 20:13:38.452831 ip-10-0-131-168 kubenswrapper[2565]: I0706 20:13:38.452826    2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-hr8qb\" (UniqueName: \"kubernetes.io/projected/5c5362be-04df-404f-90a8-095576d31016-kube-api-access-hr8qb\") on node \"ip-10-0-131-168.ec2.internal\" DevicePath \"\""
Jul 06 20:13:38.452831 ip-10-0-131-168 kubenswrapper[2565]: I0706 20:13:38.452836    2565 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/5c5362be-04df-404f-90a8-095576d31016-dshm\") on node \"ip-10-0-131-168.ec2.internal\" DevicePath \"\""
Jul 06 20:13:38.453043 ip-10-0-131-168 kubenswrapper[2565]: I0706 20:13:38.452844    2565 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/5c5362be-04df-404f-90a8-095576d31016-tls-certs\") on node \"ip-10-0-131-168.ec2.internal\" DevicePath \"\""
Jul 06 20:13:38.624134 ip-10-0-131-168 kubenswrapper[2565]: I0706 20:13:38.624101    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-ad5c84/rate-test-model-ad5c84-kserve-59fd86c6f9-h68ts"]
Jul 06 20:13:38.629274 ip-10-0-131-168 kubenswrapper[2565]: I0706 20:13:38.629246    2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-a-ad5c84/rate-test-model-ad5c84-kserve-59fd86c6f9-h68ts"]
Jul 06 20:13:39.495205 ip-10-0-131-168 kubenswrapper[2565]: I0706 20:13:39.495171    2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="5c5362be-04df-404f-90a8-095576d31016" path="/var/lib/kubelet/pods/5c5362be-04df-404f-90a8-095576d31016/volumes"
Jul 06 20:13:55.755838 ip-10-0-131-168 kubenswrapper[2565]: I0706 20:13:55.755802    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-api-e2e-shared-b-d1d0db-78894d5f7c-lvzls"]
Jul 06 20:13:55.756363 ip-10-0-131-168 kubenswrapper[2565]: I0706 20:13:55.756058    2565 kuberuntime_container.go:872] "Killing container with a grace period" pod="opendatahub/maas-api-e2e-shared-b-d1d0db-78894d5f7c-lvzls" podUID="81dc7154-bd58-4cf5-b3a8-d24743d4c59e" containerName="maas-api" containerID="cri-o://6aa348fb9d6d4e5f6f2e6e056f774399981405523e99238504f611ef42938c30" gracePeriod=30
Jul 06 20:13:56.006670 ip-10-0-131-168 kubenswrapper[2565]: I0706 20:13:56.006602    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-shared-b-d1d0db-78894d5f7c-lvzls"
Jul 06 20:13:56.108536 ip-10-0-131-168 kubenswrapper[2565]: I0706 20:13:56.108503    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/81dc7154-bd58-4cf5-b3a8-d24743d4c59e-maas-api-tls\") pod \"81dc7154-bd58-4cf5-b3a8-d24743d4c59e\" (UID: \"81dc7154-bd58-4cf5-b3a8-d24743d4c59e\") "
Jul 06 20:13:56.108800 ip-10-0-131-168 kubenswrapper[2565]: I0706 20:13:56.108554    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/81dc7154-bd58-4cf5-b3a8-d24743d4c59e-openshift-service-ca\") pod \"81dc7154-bd58-4cf5-b3a8-d24743d4c59e\" (UID: \"81dc7154-bd58-4cf5-b3a8-d24743d4c59e\") "
Jul 06 20:13:56.108800 ip-10-0-131-168 kubenswrapper[2565]: I0706 20:13:56.108574    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-rt5z6\" (UniqueName: \"kubernetes.io/projected/81dc7154-bd58-4cf5-b3a8-d24743d4c59e-kube-api-access-rt5z6\") pod \"81dc7154-bd58-4cf5-b3a8-d24743d4c59e\" (UID: \"81dc7154-bd58-4cf5-b3a8-d24743d4c59e\") "
Jul 06 20:13:56.109015 ip-10-0-131-168 kubenswrapper[2565]: I0706 20:13:56.108978    2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/81dc7154-bd58-4cf5-b3a8-d24743d4c59e-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "81dc7154-bd58-4cf5-b3a8-d24743d4c59e" (UID: "81dc7154-bd58-4cf5-b3a8-d24743d4c59e"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 06 20:13:56.110750 ip-10-0-131-168 kubenswrapper[2565]: I0706 20:13:56.110718    2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/81dc7154-bd58-4cf5-b3a8-d24743d4c59e-kube-api-access-rt5z6" (OuterVolumeSpecName: "kube-api-access-rt5z6") pod "81dc7154-bd58-4cf5-b3a8-d24743d4c59e" (UID: "81dc7154-bd58-4cf5-b3a8-d24743d4c59e"). InnerVolumeSpecName "kube-api-access-rt5z6". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 06 20:13:56.110750 ip-10-0-131-168 kubenswrapper[2565]: I0706 20:13:56.110733    2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/81dc7154-bd58-4cf5-b3a8-d24743d4c59e-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "81dc7154-bd58-4cf5-b3a8-d24743d4c59e" (UID: "81dc7154-bd58-4cf5-b3a8-d24743d4c59e"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 06 20:13:56.210064 ip-10-0-131-168 kubenswrapper[2565]: I0706 20:13:56.210035    2565 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/81dc7154-bd58-4cf5-b3a8-d24743d4c59e-maas-api-tls\") on node \"ip-10-0-131-168.ec2.internal\" DevicePath \"\""
Jul 06 20:13:56.210064 ip-10-0-131-168 kubenswrapper[2565]: I0706 20:13:56.210060    2565 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/81dc7154-bd58-4cf5-b3a8-d24743d4c59e-openshift-service-ca\") on node \"ip-10-0-131-168.ec2.internal\" DevicePath \"\""
Jul 06 20:13:56.210064 ip-10-0-131-168 kubenswrapper[2565]: I0706 20:13:56.210071    2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-rt5z6\" (UniqueName: \"kubernetes.io/projected/81dc7154-bd58-4cf5-b3a8-d24743d4c59e-kube-api-access-rt5z6\") on node \"ip-10-0-131-168.ec2.internal\" DevicePath \"\""
Jul 06 20:13:56.379931 ip-10-0-131-168 kubenswrapper[2565]: I0706 20:13:56.379898    2565 generic.go:356] "Generic (PLEG): container finished" podID="81dc7154-bd58-4cf5-b3a8-d24743d4c59e" containerID="6aa348fb9d6d4e5f6f2e6e056f774399981405523e99238504f611ef42938c30" exitCode=0
Jul 06 20:13:56.380123 ip-10-0-131-168 kubenswrapper[2565]: I0706 20:13:56.379947    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-shared-b-d1d0db-78894d5f7c-lvzls"
Jul 06 20:13:56.380123 ip-10-0-131-168 kubenswrapper[2565]: I0706 20:13:56.379977    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-shared-b-d1d0db-78894d5f7c-lvzls" event={"ID":"81dc7154-bd58-4cf5-b3a8-d24743d4c59e","Type":"ContainerDied","Data":"6aa348fb9d6d4e5f6f2e6e056f774399981405523e99238504f611ef42938c30"}
Jul 06 20:13:56.380123 ip-10-0-131-168 kubenswrapper[2565]: I0706 20:13:56.380027    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-shared-b-d1d0db-78894d5f7c-lvzls" event={"ID":"81dc7154-bd58-4cf5-b3a8-d24743d4c59e","Type":"ContainerDied","Data":"49077809a4b0f2527bdfad5e8c530ad7b1cf6b00a8eed3e20256799340a47742"}
Jul 06 20:13:56.380123 ip-10-0-131-168 kubenswrapper[2565]: I0706 20:13:56.380051    2565 scope.go:117] "RemoveContainer" containerID="6aa348fb9d6d4e5f6f2e6e056f774399981405523e99238504f611ef42938c30"
Jul 06 20:13:56.389073 ip-10-0-131-168 kubenswrapper[2565]: I0706 20:13:56.389056    2565 scope.go:117] "RemoveContainer" containerID="6aa348fb9d6d4e5f6f2e6e056f774399981405523e99238504f611ef42938c30"
Jul 06 20:13:56.389307 ip-10-0-131-168 kubenswrapper[2565]: E0706 20:13:56.389288    2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6aa348fb9d6d4e5f6f2e6e056f774399981405523e99238504f611ef42938c30\": container with ID starting with 6aa348fb9d6d4e5f6f2e6e056f774399981405523e99238504f611ef42938c30 not found: ID does not exist" containerID="6aa348fb9d6d4e5f6f2e6e056f774399981405523e99238504f611ef42938c30"
Jul 06 20:13:56.389354 ip-10-0-131-168 kubenswrapper[2565]: I0706 20:13:56.389318    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6aa348fb9d6d4e5f6f2e6e056f774399981405523e99238504f611ef42938c30"} err="failed to get container status \"6aa348fb9d6d4e5f6f2e6e056f774399981405523e99238504f611ef42938c30\": rpc error: code = NotFound desc = could not find container \"6aa348fb9d6d4e5f6f2e6e056f774399981405523e99238504f611ef42938c30\": container with ID starting with 6aa348fb9d6d4e5f6f2e6e056f774399981405523e99238504f611ef42938c30 not found: ID does not exist"
Jul 06 20:13:56.405461 ip-10-0-131-168 kubenswrapper[2565]: I0706 20:13:56.405440    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-api-e2e-shared-b-d1d0db-78894d5f7c-lvzls"]
Jul 06 20:13:56.414608 ip-10-0-131-168 kubenswrapper[2565]: I0706 20:13:56.414587    2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-api-e2e-shared-b-d1d0db-78894d5f7c-lvzls"]
Jul 06 20:13:57.494820 ip-10-0-131-168 kubenswrapper[2565]: I0706 20:13:57.494765    2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="81dc7154-bd58-4cf5-b3a8-d24743d4c59e" path="/var/lib/kubelet/pods/81dc7154-bd58-4cf5-b3a8-d24743d4c59e/volumes"
Jul 06 20:13:58.528685 ip-10-0-131-168 kubenswrapper[2565]: I0706 20:13:58.528647    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-mfwbr"]
Jul 06 20:14:08.646720 ip-10-0-131-168 kubenswrapper[2565]: I0706 20:14:08.646689    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_llmisvc-controller-manager-777c6bd7d5-2gpk4_9928c28e-6a6f-4a8a-9d7d-77e356aafc12/manager/1.log"
Jul 06 20:14:09.392201 ip-10-0-131-168 kubenswrapper[2565]: I0706 20:14:09.392173    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_odh-model-controller-7998c67dc4-spx2c_2c6bf875-f3cc-48a2-bfbe-4d2de4db7482/manager/1.log"
Jul 06 20:14:09.771305 ip-10-0-131-168 kubenswrapper[2565]: I0706 20:14:09.771217    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-5cbdc6848b-wnqd8_ada0f991-1277-401f-9b9d-5e9819d5e44d/copy-manifests/0.log"
Jul 06 20:14:09.784608 ip-10-0-131-168 kubenswrapper[2565]: I0706 20:14:09.784582    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-5cbdc6848b-wnqd8_ada0f991-1277-401f-9b9d-5e9819d5e44d/manager/0.log"
Jul 06 20:14:11.418419 ip-10-0-131-168 kubenswrapper[2565]: I0706 20:14:11.418390    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-75cc8d5cb7-6dp9g_c488330f-977e-4d67-9e61-1e7d470e0dac/manager/0.log"
Jul 06 20:14:12.028019 ip-10-0-131-168 kubenswrapper[2565]: I0706 20:14:12.027992    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-limitador-54d6d988d5-mfwbr_3d988e98-ea11-4250-8a69-7b358dd48967/limitador/0.log"
Jul 06 20:14:12.150703 ip-10-0-131-168 kubenswrapper[2565]: I0706 20:14:12.150676    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-859d7b78bd-rghgc_0a0acf9d-3030-4d9d-b6ac-d8bfa454b68f/manager/0.log"
Jul 06 20:14:12.653533 ip-10-0-131-168 kubenswrapper[2565]: I0706 20:14:12.653507    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-94bb8fbfd-2stz5_6b6e9a9c-0018-4976-8826-bade8fe5fe25/discovery/0.log"
Jul 06 20:14:12.766584 ip-10-0-131-168 kubenswrapper[2565]: I0706 20:14:12.766548    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-86f8887d66-cpzt7_e88646d7-eecd-467f-bd54-19ba6d28bb33/kube-auth-proxy/0.log"
Jul 06 20:14:13.969471 ip-10-0-131-168 kubenswrapper[2565]: I0706 20:14:13.969441    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-trlp-test-simulated-kserve-598466548d-hvklv_06005080-4d62-431c-8c7e-bd8dd5f5008e/main/0.log"
Jul 06 20:14:18.175796 ip-10-0-131-168 kubenswrapper[2565]: I0706 20:14:18.175741    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-kcmql/must-gather-qj8vn"]
Jul 06 20:14:18.176204 ip-10-0-131-168 kubenswrapper[2565]: I0706 20:14:18.176097    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5c5362be-04df-404f-90a8-095576d31016" containerName="main"
Jul 06 20:14:18.176204 ip-10-0-131-168 kubenswrapper[2565]: I0706 20:14:18.176108    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="5c5362be-04df-404f-90a8-095576d31016" containerName="main"
Jul 06 20:14:18.176204 ip-10-0-131-168 kubenswrapper[2565]: I0706 20:14:18.176122    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="81dc7154-bd58-4cf5-b3a8-d24743d4c59e" containerName="maas-api"
Jul 06 20:14:18.176204 ip-10-0-131-168 kubenswrapper[2565]: I0706 20:14:18.176127    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="81dc7154-bd58-4cf5-b3a8-d24743d4c59e" containerName="maas-api"
Jul 06 20:14:18.176204 ip-10-0-131-168 kubenswrapper[2565]: I0706 20:14:18.176140    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f129de78-75e0-4662-b154-cc4da4cf26ce" containerName="maas-api"
Jul 06 20:14:18.176204 ip-10-0-131-168 kubenswrapper[2565]: I0706 20:14:18.176146    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="f129de78-75e0-4662-b154-cc4da4cf26ce" containerName="maas-api"
Jul 06 20:14:18.176204 ip-10-0-131-168 kubenswrapper[2565]: I0706 20:14:18.176152    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5bc818bb-08e8-4216-ba16-001f3c62ea00" containerName="main"
Jul 06 20:14:18.176204 ip-10-0-131-168 kubenswrapper[2565]: I0706 20:14:18.176158    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="5bc818bb-08e8-4216-ba16-001f3c62ea00" containerName="main"
Jul 06 20:14:18.176204 ip-10-0-131-168 kubenswrapper[2565]: I0706 20:14:18.176206    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="81dc7154-bd58-4cf5-b3a8-d24743d4c59e" containerName="maas-api"
Jul 06 20:14:18.176481 ip-10-0-131-168 kubenswrapper[2565]: I0706 20:14:18.176216    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="5c5362be-04df-404f-90a8-095576d31016" containerName="main"
Jul 06 20:14:18.176481 ip-10-0-131-168 kubenswrapper[2565]: I0706 20:14:18.176223    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="5bc818bb-08e8-4216-ba16-001f3c62ea00" containerName="main"
Jul 06 20:14:18.176481 ip-10-0-131-168 kubenswrapper[2565]: I0706 20:14:18.176229    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="f129de78-75e0-4662-b154-cc4da4cf26ce" containerName="maas-api"
Jul 06 20:14:18.180493 ip-10-0-131-168 kubenswrapper[2565]: I0706 20:14:18.180477    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-kcmql/must-gather-qj8vn"
Jul 06 20:14:18.182993 ip-10-0-131-168 kubenswrapper[2565]: I0706 20:14:18.182966    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-kcmql\"/\"openshift-service-ca.crt\""
Jul 06 20:14:18.183115 ip-10-0-131-168 kubenswrapper[2565]: I0706 20:14:18.183008    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-kcmql\"/\"default-dockercfg-mh48k\""
Jul 06 20:14:18.184261 ip-10-0-131-168 kubenswrapper[2565]: I0706 20:14:18.184239    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-kcmql\"/\"kube-root-ca.crt\""
Jul 06 20:14:18.189218 ip-10-0-131-168 kubenswrapper[2565]: I0706 20:14:18.189196    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-kcmql/must-gather-qj8vn"]
Jul 06 20:14:18.297970 ip-10-0-131-168 kubenswrapper[2565]: I0706 20:14:18.297933    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/68808b7a-6c93-4d76-9d9f-e84822cae39f-must-gather-output\") pod \"must-gather-qj8vn\" (UID: \"68808b7a-6c93-4d76-9d9f-e84822cae39f\") " pod="openshift-must-gather-kcmql/must-gather-qj8vn"
Jul 06 20:14:18.298152 ip-10-0-131-168 kubenswrapper[2565]: I0706 20:14:18.297984    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gzzb8\" (UniqueName: \"kubernetes.io/projected/68808b7a-6c93-4d76-9d9f-e84822cae39f-kube-api-access-gzzb8\") pod \"must-gather-qj8vn\" (UID: \"68808b7a-6c93-4d76-9d9f-e84822cae39f\") " pod="openshift-must-gather-kcmql/must-gather-qj8vn"
Jul 06 20:14:18.399382 ip-10-0-131-168 kubenswrapper[2565]: I0706 20:14:18.399348    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/68808b7a-6c93-4d76-9d9f-e84822cae39f-must-gather-output\") pod \"must-gather-qj8vn\" (UID: \"68808b7a-6c93-4d76-9d9f-e84822cae39f\") " pod="openshift-must-gather-kcmql/must-gather-qj8vn"
Jul 06 20:14:18.399546 ip-10-0-131-168 kubenswrapper[2565]: I0706 20:14:18.399388    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gzzb8\" (UniqueName: \"kubernetes.io/projected/68808b7a-6c93-4d76-9d9f-e84822cae39f-kube-api-access-gzzb8\") pod \"must-gather-qj8vn\" (UID: \"68808b7a-6c93-4d76-9d9f-e84822cae39f\") " pod="openshift-must-gather-kcmql/must-gather-qj8vn"
Jul 06 20:14:18.399702 ip-10-0-131-168 kubenswrapper[2565]: I0706 20:14:18.399682    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/68808b7a-6c93-4d76-9d9f-e84822cae39f-must-gather-output\") pod \"must-gather-qj8vn\" (UID: \"68808b7a-6c93-4d76-9d9f-e84822cae39f\") " pod="openshift-must-gather-kcmql/must-gather-qj8vn"
Jul 06 20:14:18.411542 ip-10-0-131-168 kubenswrapper[2565]: I0706 20:14:18.411512    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gzzb8\" (UniqueName: \"kubernetes.io/projected/68808b7a-6c93-4d76-9d9f-e84822cae39f-kube-api-access-gzzb8\") pod \"must-gather-qj8vn\" (UID: \"68808b7a-6c93-4d76-9d9f-e84822cae39f\") " pod="openshift-must-gather-kcmql/must-gather-qj8vn"
Jul 06 20:14:18.490425 ip-10-0-131-168 kubenswrapper[2565]: I0706 20:14:18.490351    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-kcmql/must-gather-qj8vn"
Jul 06 20:14:18.832535 ip-10-0-131-168 kubenswrapper[2565]: I0706 20:14:18.832511    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-kcmql/must-gather-qj8vn"]
Jul 06 20:14:18.835303 ip-10-0-131-168 kubenswrapper[2565]: W0706 20:14:18.835269    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod68808b7a_6c93_4d76_9d9f_e84822cae39f.slice/crio-1eebcb84f265d67531c58bfa32ea9d9acb6ededb2b186b55cd356e1274198988 WatchSource:0}: Error finding container 1eebcb84f265d67531c58bfa32ea9d9acb6ededb2b186b55cd356e1274198988: Status 404 returned error can't find the container with id 1eebcb84f265d67531c58bfa32ea9d9acb6ededb2b186b55cd356e1274198988
Jul 06 20:14:18.837283 ip-10-0-131-168 kubenswrapper[2565]: I0706 20:14:18.837262    2565 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 06 20:14:19.480177 ip-10-0-131-168 kubenswrapper[2565]: I0706 20:14:19.480139    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-kcmql/must-gather-qj8vn" event={"ID":"68808b7a-6c93-4d76-9d9f-e84822cae39f","Type":"ContainerStarted","Data":"1eebcb84f265d67531c58bfa32ea9d9acb6ededb2b186b55cd356e1274198988"}
Jul 06 20:14:20.490208 ip-10-0-131-168 kubenswrapper[2565]: I0706 20:14:20.489412    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-kcmql/must-gather-qj8vn" event={"ID":"68808b7a-6c93-4d76-9d9f-e84822cae39f","Type":"ContainerStarted","Data":"d93148cd906cac10fb85e2d17780dae16a9ba8ac3c92e9765f7584b179b04a47"}
Jul 06 20:14:20.490208 ip-10-0-131-168 kubenswrapper[2565]: I0706 20:14:20.489463    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-kcmql/must-gather-qj8vn" event={"ID":"68808b7a-6c93-4d76-9d9f-e84822cae39f","Type":"ContainerStarted","Data":"ac484ce78f0044fd384339e263da70eaeedcc4695342dbacdf538414326719bf"}
Jul 06 20:14:20.510396 ip-10-0-131-168 kubenswrapper[2565]: I0706 20:14:20.510348    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-kcmql/must-gather-qj8vn" podStartSLOduration=1.68804797 podStartE2EDuration="2.510329909s" totalImagesPullingTime="822.281939ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 20:14:18 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 20:14:20.509368002 +0000 UTC m=+2495.522356672" watchObservedRunningTime="2026-07-06 20:14:20.510329909 +0000 UTC m=+2495.523318577"
Jul 06 20:14:21.334921 ip-10-0-131-168 kubenswrapper[2565]: I0706 20:14:21.334887    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-2rdm6_67af2b66-be49-4b61-a200-b711f4d83397/global-pull-secret-syncer/0.log"
Jul 06 20:14:21.550640 ip-10-0-131-168 kubenswrapper[2565]: I0706 20:14:21.550613    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-xjxq2_c7ddad9c-87f6-4618-b060-800e803d39c1/konnectivity-agent/0.log"
Jul 06 20:14:21.576362 ip-10-0-131-168 kubenswrapper[2565]: I0706 20:14:21.576332    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-131-168.ec2.internal_83399c877cd64b0872925a2b56383a00/haproxy/0.log"
Jul 06 20:14:26.954421 ip-10-0-131-168 kubenswrapper[2565]: I0706 20:14:26.954387    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-75cc8d5cb7-6dp9g_c488330f-977e-4d67-9e61-1e7d470e0dac/manager/0.log"
Jul 06 20:14:27.223983 ip-10-0-131-168 kubenswrapper[2565]: I0706 20:14:27.223907    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-limitador-54d6d988d5-mfwbr_3d988e98-ea11-4250-8a69-7b358dd48967/limitador/0.log"
Jul 06 20:14:27.298834 ip-10-0-131-168 kubenswrapper[2565]: I0706 20:14:27.298806    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-859d7b78bd-rghgc_0a0acf9d-3030-4d9d-b6ac-d8bfa454b68f/manager/0.log"
Jul 06 20:14:29.163400 ip-10-0-131-168 kubenswrapper[2565]: I0706 20:14:29.163366    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-7c9dbb8b7d-g4s4f_89c50da6-a17a-49d0-b9f3-5bc040961c59/kube-state-metrics/0.log"
Jul 06 20:14:29.186868 ip-10-0-131-168 kubenswrapper[2565]: I0706 20:14:29.186839    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-7c9dbb8b7d-g4s4f_89c50da6-a17a-49d0-b9f3-5bc040961c59/kube-rbac-proxy-main/0.log"
Jul 06 20:14:29.215213 ip-10-0-131-168 kubenswrapper[2565]: I0706 20:14:29.215143    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-7c9dbb8b7d-g4s4f_89c50da6-a17a-49d0-b9f3-5bc040961c59/kube-rbac-proxy-self/0.log"
Jul 06 20:14:29.434825 ip-10-0-131-168 kubenswrapper[2565]: I0706 20:14:29.434714    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-crwt9_b15806af-f7b4-4b86-9b07-222bcbdecd37/node-exporter/0.log"
Jul 06 20:14:29.463411 ip-10-0-131-168 kubenswrapper[2565]: I0706 20:14:29.463385    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-crwt9_b15806af-f7b4-4b86-9b07-222bcbdecd37/kube-rbac-proxy/0.log"
Jul 06 20:14:29.485228 ip-10-0-131-168 kubenswrapper[2565]: I0706 20:14:29.485204    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-crwt9_b15806af-f7b4-4b86-9b07-222bcbdecd37/init-textfile/0.log"
Jul 06 20:14:30.141855 ip-10-0-131-168 kubenswrapper[2565]: I0706 20:14:30.141831    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-7f4bd7b5cc-f9ptx_41f79c7b-9ad4-4e8a-abb1-c107ee048bed/thanos-query/0.log"
Jul 06 20:14:30.169591 ip-10-0-131-168 kubenswrapper[2565]: I0706 20:14:30.169547    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-7f4bd7b5cc-f9ptx_41f79c7b-9ad4-4e8a-abb1-c107ee048bed/kube-rbac-proxy-web/0.log"
Jul 06 20:14:30.208978 ip-10-0-131-168 kubenswrapper[2565]: I0706 20:14:30.208955    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-7f4bd7b5cc-f9ptx_41f79c7b-9ad4-4e8a-abb1-c107ee048bed/kube-rbac-proxy/0.log"
Jul 06 20:14:30.236278 ip-10-0-131-168 kubenswrapper[2565]: I0706 20:14:30.236249    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-7f4bd7b5cc-f9ptx_41f79c7b-9ad4-4e8a-abb1-c107ee048bed/prom-label-proxy/0.log"
Jul 06 20:14:30.262968 ip-10-0-131-168 kubenswrapper[2565]: I0706 20:14:30.262941    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-7f4bd7b5cc-f9ptx_41f79c7b-9ad4-4e8a-abb1-c107ee048bed/kube-rbac-proxy-rules/0.log"
Jul 06 20:14:30.289428 ip-10-0-131-168 kubenswrapper[2565]: I0706 20:14:30.289397    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-7f4bd7b5cc-f9ptx_41f79c7b-9ad4-4e8a-abb1-c107ee048bed/kube-rbac-proxy-metrics/0.log"
Jul 06 20:14:30.827507 ip-10-0-131-168 kubenswrapper[2565]: I0706 20:14:30.827468    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-kcmql/perf-node-gather-daemonset-bgr7c"]
Jul 06 20:14:30.833357 ip-10-0-131-168 kubenswrapper[2565]: I0706 20:14:30.833327    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-kcmql/perf-node-gather-daemonset-bgr7c"
Jul 06 20:14:30.841025 ip-10-0-131-168 kubenswrapper[2565]: I0706 20:14:30.840999    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-kcmql/perf-node-gather-daemonset-bgr7c"]
Jul 06 20:14:30.935881 ip-10-0-131-168 kubenswrapper[2565]: I0706 20:14:30.935847    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/523e07bc-4999-456d-bd0d-c6fe9ccb3627-lib-modules\") pod \"perf-node-gather-daemonset-bgr7c\" (UID: \"523e07bc-4999-456d-bd0d-c6fe9ccb3627\") " pod="openshift-must-gather-kcmql/perf-node-gather-daemonset-bgr7c"
Jul 06 20:14:30.936176 ip-10-0-131-168 kubenswrapper[2565]: I0706 20:14:30.936148    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/523e07bc-4999-456d-bd0d-c6fe9ccb3627-podres\") pod \"perf-node-gather-daemonset-bgr7c\" (UID: \"523e07bc-4999-456d-bd0d-c6fe9ccb3627\") " pod="openshift-must-gather-kcmql/perf-node-gather-daemonset-bgr7c"
Jul 06 20:14:30.936314 ip-10-0-131-168 kubenswrapper[2565]: I0706 20:14:30.936197    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/523e07bc-4999-456d-bd0d-c6fe9ccb3627-proc\") pod \"perf-node-gather-daemonset-bgr7c\" (UID: \"523e07bc-4999-456d-bd0d-c6fe9ccb3627\") " pod="openshift-must-gather-kcmql/perf-node-gather-daemonset-bgr7c"
Jul 06 20:14:30.936314 ip-10-0-131-168 kubenswrapper[2565]: I0706 20:14:30.936230    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fgxq9\" (UniqueName: \"kubernetes.io/projected/523e07bc-4999-456d-bd0d-c6fe9ccb3627-kube-api-access-fgxq9\") pod \"perf-node-gather-daemonset-bgr7c\" (UID: \"523e07bc-4999-456d-bd0d-c6fe9ccb3627\") " pod="openshift-must-gather-kcmql/perf-node-gather-daemonset-bgr7c"
Jul 06 20:14:30.936314 ip-10-0-131-168 kubenswrapper[2565]: I0706 20:14:30.936289    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/523e07bc-4999-456d-bd0d-c6fe9ccb3627-sys\") pod \"perf-node-gather-daemonset-bgr7c\" (UID: \"523e07bc-4999-456d-bd0d-c6fe9ccb3627\") " pod="openshift-must-gather-kcmql/perf-node-gather-daemonset-bgr7c"
Jul 06 20:14:31.037649 ip-10-0-131-168 kubenswrapper[2565]: I0706 20:14:31.037618    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/523e07bc-4999-456d-bd0d-c6fe9ccb3627-sys\") pod \"perf-node-gather-daemonset-bgr7c\" (UID: \"523e07bc-4999-456d-bd0d-c6fe9ccb3627\") " pod="openshift-must-gather-kcmql/perf-node-gather-daemonset-bgr7c"
Jul 06 20:14:31.037849 ip-10-0-131-168 kubenswrapper[2565]: I0706 20:14:31.037697    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/523e07bc-4999-456d-bd0d-c6fe9ccb3627-lib-modules\") pod \"perf-node-gather-daemonset-bgr7c\" (UID: \"523e07bc-4999-456d-bd0d-c6fe9ccb3627\") " pod="openshift-must-gather-kcmql/perf-node-gather-daemonset-bgr7c"
Jul 06 20:14:31.037849 ip-10-0-131-168 kubenswrapper[2565]: I0706 20:14:31.037728    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/523e07bc-4999-456d-bd0d-c6fe9ccb3627-sys\") pod \"perf-node-gather-daemonset-bgr7c\" (UID: \"523e07bc-4999-456d-bd0d-c6fe9ccb3627\") " pod="openshift-must-gather-kcmql/perf-node-gather-daemonset-bgr7c"
Jul 06 20:14:31.037849 ip-10-0-131-168 kubenswrapper[2565]: I0706 20:14:31.037753    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/523e07bc-4999-456d-bd0d-c6fe9ccb3627-podres\") pod \"perf-node-gather-daemonset-bgr7c\" (UID: \"523e07bc-4999-456d-bd0d-c6fe9ccb3627\") " pod="openshift-must-gather-kcmql/perf-node-gather-daemonset-bgr7c"
Jul 06 20:14:31.037849 ip-10-0-131-168 kubenswrapper[2565]: I0706 20:14:31.037805    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/523e07bc-4999-456d-bd0d-c6fe9ccb3627-proc\") pod \"perf-node-gather-daemonset-bgr7c\" (UID: \"523e07bc-4999-456d-bd0d-c6fe9ccb3627\") " pod="openshift-must-gather-kcmql/perf-node-gather-daemonset-bgr7c"
Jul 06 20:14:31.037849 ip-10-0-131-168 kubenswrapper[2565]: I0706 20:14:31.037835    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fgxq9\" (UniqueName: \"kubernetes.io/projected/523e07bc-4999-456d-bd0d-c6fe9ccb3627-kube-api-access-fgxq9\") pod \"perf-node-gather-daemonset-bgr7c\" (UID: \"523e07bc-4999-456d-bd0d-c6fe9ccb3627\") " pod="openshift-must-gather-kcmql/perf-node-gather-daemonset-bgr7c"
Jul 06 20:14:31.038107 ip-10-0-131-168 kubenswrapper[2565]: I0706 20:14:31.037851    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/523e07bc-4999-456d-bd0d-c6fe9ccb3627-lib-modules\") pod \"perf-node-gather-daemonset-bgr7c\" (UID: \"523e07bc-4999-456d-bd0d-c6fe9ccb3627\") " pod="openshift-must-gather-kcmql/perf-node-gather-daemonset-bgr7c"
Jul 06 20:14:31.038107 ip-10-0-131-168 kubenswrapper[2565]: I0706 20:14:31.037889    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/523e07bc-4999-456d-bd0d-c6fe9ccb3627-podres\") pod \"perf-node-gather-daemonset-bgr7c\" (UID: \"523e07bc-4999-456d-bd0d-c6fe9ccb3627\") " pod="openshift-must-gather-kcmql/perf-node-gather-daemonset-bgr7c"
Jul 06 20:14:31.038107 ip-10-0-131-168 kubenswrapper[2565]: I0706 20:14:31.037939    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/523e07bc-4999-456d-bd0d-c6fe9ccb3627-proc\") pod \"perf-node-gather-daemonset-bgr7c\" (UID: \"523e07bc-4999-456d-bd0d-c6fe9ccb3627\") " pod="openshift-must-gather-kcmql/perf-node-gather-daemonset-bgr7c"
Jul 06 20:14:31.047174 ip-10-0-131-168 kubenswrapper[2565]: I0706 20:14:31.047148    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-fgxq9\" (UniqueName: \"kubernetes.io/projected/523e07bc-4999-456d-bd0d-c6fe9ccb3627-kube-api-access-fgxq9\") pod \"perf-node-gather-daemonset-bgr7c\" (UID: \"523e07bc-4999-456d-bd0d-c6fe9ccb3627\") " pod="openshift-must-gather-kcmql/perf-node-gather-daemonset-bgr7c"
Jul 06 20:14:31.147418 ip-10-0-131-168 kubenswrapper[2565]: I0706 20:14:31.147382    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-kcmql/perf-node-gather-daemonset-bgr7c"
Jul 06 20:14:31.323460 ip-10-0-131-168 kubenswrapper[2565]: I0706 20:14:31.323351    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-kcmql/perf-node-gather-daemonset-bgr7c"]
Jul 06 20:14:31.325633 ip-10-0-131-168 kubenswrapper[2565]: W0706 20:14:31.325601    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod523e07bc_4999_456d_bd0d_c6fe9ccb3627.slice/crio-47c91db85d6f86ae2eb4a83a8a828f36f7b15e1669166658f1c088429e6dc89e WatchSource:0}: Error finding container 47c91db85d6f86ae2eb4a83a8a828f36f7b15e1669166658f1c088429e6dc89e: Status 404 returned error can't find the container with id 47c91db85d6f86ae2eb4a83a8a828f36f7b15e1669166658f1c088429e6dc89e
Jul 06 20:14:31.561856 ip-10-0-131-168 kubenswrapper[2565]: I0706 20:14:31.561812    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-kcmql/perf-node-gather-daemonset-bgr7c" event={"ID":"523e07bc-4999-456d-bd0d-c6fe9ccb3627","Type":"ContainerStarted","Data":"282bc421ce44a1ed73270cbd3fc63c258290de74d1aaa6e4f78f242a84caef72"}
Jul 06 20:14:31.562027 ip-10-0-131-168 kubenswrapper[2565]: I0706 20:14:31.561871    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-kcmql/perf-node-gather-daemonset-bgr7c" event={"ID":"523e07bc-4999-456d-bd0d-c6fe9ccb3627","Type":"ContainerStarted","Data":"47c91db85d6f86ae2eb4a83a8a828f36f7b15e1669166658f1c088429e6dc89e"}
Jul 06 20:14:31.562097 ip-10-0-131-168 kubenswrapper[2565]: I0706 20:14:31.562025    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-kcmql/perf-node-gather-daemonset-bgr7c"
Jul 06 20:14:32.695312 ip-10-0-131-168 kubenswrapper[2565]: I0706 20:14:32.695283    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-dcfd47f7c-94s56_120517cb-8a0f-44ff-a76a-a636805b1a8d/console/0.log"
Jul 06 20:14:34.339172 ip-10-0-131-168 kubenswrapper[2565]: I0706 20:14:34.339140    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-2gd6k_b1f107bd-53cb-4a16-8b28-58ce84f656c0/dns/0.log"
Jul 06 20:14:34.365204 ip-10-0-131-168 kubenswrapper[2565]: I0706 20:14:34.365167    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-2gd6k_b1f107bd-53cb-4a16-8b28-58ce84f656c0/kube-rbac-proxy/0.log"
Jul 06 20:14:34.494057 ip-10-0-131-168 kubenswrapper[2565]: I0706 20:14:34.494026    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-kx6hd_0ecbe788-9e2c-446a-b154-7b805f3983dd/dns-node-resolver/0.log"
Jul 06 20:14:35.095185 ip-10-0-131-168 kubenswrapper[2565]: I0706 20:14:35.095151    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_image-registry-fb84cd9c9-h7v26_96bae95b-b73f-4387-96db-f55d67b9775c/registry/0.log"
Jul 06 20:14:35.119615 ip-10-0-131-168 kubenswrapper[2565]: I0706 20:14:35.119583    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-cblv9_35683ef3-3b68-4694-acaf-aaee8f598255/node-ca/0.log"
Jul 06 20:14:36.246790 ip-10-0-131-168 kubenswrapper[2565]: I0706 20:14:36.246745    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-94bb8fbfd-2stz5_6b6e9a9c-0018-4976-8826-bade8fe5fe25/discovery/0.log"
Jul 06 20:14:36.266606 ip-10-0-131-168 kubenswrapper[2565]: I0706 20:14:36.266576    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-86f8887d66-cpzt7_e88646d7-eecd-467f-bd54-19ba6d28bb33/kube-auth-proxy/0.log"
Jul 06 20:14:37.238530 ip-10-0-131-168 kubenswrapper[2565]: I0706 20:14:37.238448    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-sk5qz_5cebd7e7-350b-4360-a9f5-e7ef0889b9c2/serve-healthcheck-canary/0.log"
Jul 06 20:14:37.579672 ip-10-0-131-168 kubenswrapper[2565]: I0706 20:14:37.579598    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-kcmql/perf-node-gather-daemonset-bgr7c"
Jul 06 20:14:37.596920 ip-10-0-131-168 kubenswrapper[2565]: I0706 20:14:37.596872    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-kcmql/perf-node-gather-daemonset-bgr7c" podStartSLOduration=7.596853438 podStartE2EDuration="7.596853438s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-06 20:14:30 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 20:14:31.58860016 +0000 UTC m=+2506.601588830" watchObservedRunningTime="2026-07-06 20:14:37.596853438 +0000 UTC m=+2512.609842107"
Jul 06 20:14:37.826260 ip-10-0-131-168 kubenswrapper[2565]: I0706 20:14:37.826198    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-l5bqv_5777f5a5-bc96-408e-a7c0-0c8ab230121e/kube-rbac-proxy/0.log"
Jul 06 20:14:37.865259 ip-10-0-131-168 kubenswrapper[2565]: I0706 20:14:37.865214    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-l5bqv_5777f5a5-bc96-408e-a7c0-0c8ab230121e/exporter/0.log"
Jul 06 20:14:37.897101 ip-10-0-131-168 kubenswrapper[2565]: I0706 20:14:37.897073    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-l5bqv_5777f5a5-bc96-408e-a7c0-0c8ab230121e/extractor/0.log"
Jul 06 20:14:40.526890 ip-10-0-131-168 kubenswrapper[2565]: I0706 20:14:40.526856    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_llmisvc-controller-manager-777c6bd7d5-2gpk4_9928c28e-6a6f-4a8a-9d7d-77e356aafc12/manager/0.log"
Jul 06 20:14:40.674177 ip-10-0-131-168 kubenswrapper[2565]: I0706 20:14:40.674124    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_llmisvc-controller-manager-777c6bd7d5-2gpk4_9928c28e-6a6f-4a8a-9d7d-77e356aafc12/manager/1.log"
Jul 06 20:14:40.949132 ip-10-0-131-168 kubenswrapper[2565]: I0706 20:14:40.949102    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_odh-model-controller-7998c67dc4-spx2c_2c6bf875-f3cc-48a2-bfbe-4d2de4db7482/manager/0.log"
Jul 06 20:14:40.962894 ip-10-0-131-168 kubenswrapper[2565]: I0706 20:14:40.962859    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_odh-model-controller-7998c67dc4-spx2c_2c6bf875-f3cc-48a2-bfbe-4d2de4db7482/manager/1.log"
Jul 06 20:14:41.190229 ip-10-0-131-168 kubenswrapper[2565]: I0706 20:14:41.190179    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-5cbdc6848b-wnqd8_ada0f991-1277-401f-9b9d-5e9819d5e44d/manager/0.log"
Jul 06 20:14:41.211984 ip-10-0-131-168 kubenswrapper[2565]: I0706 20:14:41.211897    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-5cbdc6848b-wnqd8_ada0f991-1277-401f-9b9d-5e9819d5e44d/copy-manifests/0.log"
Jul 06 20:14:41.236421 ip-10-0-131-168 kubenswrapper[2565]: I0706 20:14:41.236390    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-94bb8fbfd-2stz5_6b6e9a9c-0018-4976-8826-bade8fe5fe25/discovery/0.log"
Jul 06 20:14:41.246477 ip-10-0-131-168 kubenswrapper[2565]: I0706 20:14:41.246452    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-86f8887d66-cpzt7_e88646d7-eecd-467f-bd54-19ba6d28bb33/kube-auth-proxy/0.log"
Jul 06 20:14:42.621537 ip-10-0-131-168 kubenswrapper[2565]: I0706 20:14:42.621030    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-94bb8fbfd-2stz5_6b6e9a9c-0018-4976-8826-bade8fe5fe25/discovery/0.log"
Jul 06 20:14:42.634303 ip-10-0-131-168 kubenswrapper[2565]: I0706 20:14:42.634277    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-86f8887d66-cpzt7_e88646d7-eecd-467f-bd54-19ba6d28bb33/kube-auth-proxy/0.log"