Jul 15 18:17:21.318503 ip-10-0-141-171 systemd[1]: Starting Kubernetes Kubelet...
Jul 15 18:17:21.941752 ip-10-0-141-171 kubenswrapper[2567]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 15 18:17:21.941752 ip-10-0-141-171 kubenswrapper[2567]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version.
Jul 15 18:17:21.941752 ip-10-0-141-171 kubenswrapper[2567]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 15 18:17:21.941752 ip-10-0-141-171 kubenswrapper[2567]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI.
Jul 15 18:17:21.941752 ip-10-0-141-171 kubenswrapper[2567]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 15 18:17:21.941752 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:17:21.840220    2567 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime"
Jul 15 18:17:21.941752 ip-10-0-141-171 kubenswrapper[2567]: W0715 18:17:21.847174    2567 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 15 18:17:21.941752 ip-10-0-141-171 kubenswrapper[2567]: W0715 18:17:21.847186    2567 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 15 18:17:21.941752 ip-10-0-141-171 kubenswrapper[2567]: W0715 18:17:21.847190    2567 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 15 18:17:21.941752 ip-10-0-141-171 kubenswrapper[2567]: W0715 18:17:21.847193    2567 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 15 18:17:21.941752 ip-10-0-141-171 kubenswrapper[2567]: W0715 18:17:21.847197    2567 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 15 18:17:21.941752 ip-10-0-141-171 kubenswrapper[2567]: W0715 18:17:21.847200    2567 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 15 18:17:21.941752 ip-10-0-141-171 kubenswrapper[2567]: W0715 18:17:21.847206    2567 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 15 18:17:21.939133 ip-10-0-141-171 systemd[1]: Started Kubernetes Kubelet.
Jul 15 18:17:21.943262 ip-10-0-141-171 kubenswrapper[2567]: W0715 18:17:21.847211    2567 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 15 18:17:21.943262 ip-10-0-141-171 kubenswrapper[2567]: W0715 18:17:21.847214    2567 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 15 18:17:21.943262 ip-10-0-141-171 kubenswrapper[2567]: W0715 18:17:21.847217    2567 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 15 18:17:21.943262 ip-10-0-141-171 kubenswrapper[2567]: W0715 18:17:21.847220    2567 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 15 18:17:21.943262 ip-10-0-141-171 kubenswrapper[2567]: W0715 18:17:21.847223    2567 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 15 18:17:21.943262 ip-10-0-141-171 kubenswrapper[2567]: W0715 18:17:21.847227    2567 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 15 18:17:21.943262 ip-10-0-141-171 kubenswrapper[2567]: W0715 18:17:21.847237    2567 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 15 18:17:21.943262 ip-10-0-141-171 kubenswrapper[2567]: W0715 18:17:21.847241    2567 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 15 18:17:21.943262 ip-10-0-141-171 kubenswrapper[2567]: W0715 18:17:21.847244    2567 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 15 18:17:21.943262 ip-10-0-141-171 kubenswrapper[2567]: W0715 18:17:21.847247    2567 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 15 18:17:21.943262 ip-10-0-141-171 kubenswrapper[2567]: W0715 18:17:21.847250    2567 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 15 18:17:21.943262 ip-10-0-141-171 kubenswrapper[2567]: W0715 18:17:21.847252    2567 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 15 18:17:21.943262 ip-10-0-141-171 kubenswrapper[2567]: W0715 18:17:21.847255    2567 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 15 18:17:21.943262 ip-10-0-141-171 kubenswrapper[2567]: W0715 18:17:21.847258    2567 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 15 18:17:21.943262 ip-10-0-141-171 kubenswrapper[2567]: W0715 18:17:21.847261    2567 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 15 18:17:21.943262 ip-10-0-141-171 kubenswrapper[2567]: W0715 18:17:21.847264    2567 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 15 18:17:21.943262 ip-10-0-141-171 kubenswrapper[2567]: W0715 18:17:21.847266    2567 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 15 18:17:21.943262 ip-10-0-141-171 kubenswrapper[2567]: W0715 18:17:21.847269    2567 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 15 18:17:21.943262 ip-10-0-141-171 kubenswrapper[2567]: W0715 18:17:21.847272    2567 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 15 18:17:21.943262 ip-10-0-141-171 kubenswrapper[2567]: W0715 18:17:21.847275    2567 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 15 18:17:21.944690 ip-10-0-141-171 kubenswrapper[2567]: W0715 18:17:21.847278    2567 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 15 18:17:21.944690 ip-10-0-141-171 kubenswrapper[2567]: W0715 18:17:21.847281    2567 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 15 18:17:21.944690 ip-10-0-141-171 kubenswrapper[2567]: W0715 18:17:21.847283    2567 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 15 18:17:21.944690 ip-10-0-141-171 kubenswrapper[2567]: W0715 18:17:21.847286    2567 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 15 18:17:21.944690 ip-10-0-141-171 kubenswrapper[2567]: W0715 18:17:21.847288    2567 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 15 18:17:21.944690 ip-10-0-141-171 kubenswrapper[2567]: W0715 18:17:21.847307    2567 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 15 18:17:21.944690 ip-10-0-141-171 kubenswrapper[2567]: W0715 18:17:21.847310    2567 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 15 18:17:21.944690 ip-10-0-141-171 kubenswrapper[2567]: W0715 18:17:21.847314    2567 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 15 18:17:21.944690 ip-10-0-141-171 kubenswrapper[2567]: W0715 18:17:21.847317    2567 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 15 18:17:21.944690 ip-10-0-141-171 kubenswrapper[2567]: W0715 18:17:21.847320    2567 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 15 18:17:21.944690 ip-10-0-141-171 kubenswrapper[2567]: W0715 18:17:21.847323    2567 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 15 18:17:21.944690 ip-10-0-141-171 kubenswrapper[2567]: W0715 18:17:21.847327    2567 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 15 18:17:21.944690 ip-10-0-141-171 kubenswrapper[2567]: W0715 18:17:21.847330    2567 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 15 18:17:21.944690 ip-10-0-141-171 kubenswrapper[2567]: W0715 18:17:21.847333    2567 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 15 18:17:21.944690 ip-10-0-141-171 kubenswrapper[2567]: W0715 18:17:21.847336    2567 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 15 18:17:21.944690 ip-10-0-141-171 kubenswrapper[2567]: W0715 18:17:21.847339    2567 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 15 18:17:21.944690 ip-10-0-141-171 kubenswrapper[2567]: W0715 18:17:21.847342    2567 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 15 18:17:21.944690 ip-10-0-141-171 kubenswrapper[2567]: W0715 18:17:21.847345    2567 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 15 18:17:21.944690 ip-10-0-141-171 kubenswrapper[2567]: W0715 18:17:21.847349    2567 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 15 18:17:21.944690 ip-10-0-141-171 kubenswrapper[2567]: W0715 18:17:21.847351    2567 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 15 18:17:21.945634 ip-10-0-141-171 kubenswrapper[2567]: W0715 18:17:21.847354    2567 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 15 18:17:21.945634 ip-10-0-141-171 kubenswrapper[2567]: W0715 18:17:21.847357    2567 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 15 18:17:21.945634 ip-10-0-141-171 kubenswrapper[2567]: W0715 18:17:21.847360    2567 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 15 18:17:21.945634 ip-10-0-141-171 kubenswrapper[2567]: W0715 18:17:21.847363    2567 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 15 18:17:21.945634 ip-10-0-141-171 kubenswrapper[2567]: W0715 18:17:21.847366    2567 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 15 18:17:21.945634 ip-10-0-141-171 kubenswrapper[2567]: W0715 18:17:21.847369    2567 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 15 18:17:21.945634 ip-10-0-141-171 kubenswrapper[2567]: W0715 18:17:21.847371    2567 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 15 18:17:21.945634 ip-10-0-141-171 kubenswrapper[2567]: W0715 18:17:21.847374    2567 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 15 18:17:21.945634 ip-10-0-141-171 kubenswrapper[2567]: W0715 18:17:21.847377    2567 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 15 18:17:21.945634 ip-10-0-141-171 kubenswrapper[2567]: W0715 18:17:21.847381    2567 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 15 18:17:21.945634 ip-10-0-141-171 kubenswrapper[2567]: W0715 18:17:21.847385    2567 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 15 18:17:21.945634 ip-10-0-141-171 kubenswrapper[2567]: W0715 18:17:21.847388    2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 15 18:17:21.945634 ip-10-0-141-171 kubenswrapper[2567]: W0715 18:17:21.847391    2567 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 15 18:17:21.945634 ip-10-0-141-171 kubenswrapper[2567]: W0715 18:17:21.847394    2567 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 15 18:17:21.945634 ip-10-0-141-171 kubenswrapper[2567]: W0715 18:17:21.847397    2567 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 15 18:17:21.945634 ip-10-0-141-171 kubenswrapper[2567]: W0715 18:17:21.847401    2567 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 15 18:17:21.945634 ip-10-0-141-171 kubenswrapper[2567]: W0715 18:17:21.847405    2567 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 15 18:17:21.945634 ip-10-0-141-171 kubenswrapper[2567]: W0715 18:17:21.847408    2567 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 15 18:17:21.945634 ip-10-0-141-171 kubenswrapper[2567]: W0715 18:17:21.847411    2567 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 15 18:17:21.946576 ip-10-0-141-171 kubenswrapper[2567]: W0715 18:17:21.847414    2567 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 15 18:17:21.946576 ip-10-0-141-171 kubenswrapper[2567]: W0715 18:17:21.847417    2567 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 15 18:17:21.946576 ip-10-0-141-171 kubenswrapper[2567]: W0715 18:17:21.847420    2567 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 15 18:17:21.946576 ip-10-0-141-171 kubenswrapper[2567]: W0715 18:17:21.847422    2567 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 15 18:17:21.946576 ip-10-0-141-171 kubenswrapper[2567]: W0715 18:17:21.847425    2567 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 15 18:17:21.946576 ip-10-0-141-171 kubenswrapper[2567]: W0715 18:17:21.847428    2567 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 15 18:17:21.946576 ip-10-0-141-171 kubenswrapper[2567]: W0715 18:17:21.847432    2567 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 15 18:17:21.946576 ip-10-0-141-171 kubenswrapper[2567]: W0715 18:17:21.847435    2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 15 18:17:21.946576 ip-10-0-141-171 kubenswrapper[2567]: W0715 18:17:21.847438    2567 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 15 18:17:21.946576 ip-10-0-141-171 kubenswrapper[2567]: W0715 18:17:21.847441    2567 feature_gate.go:328] unrecognized feature gate: Example
Jul 15 18:17:21.946576 ip-10-0-141-171 kubenswrapper[2567]: W0715 18:17:21.847444    2567 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 15 18:17:21.946576 ip-10-0-141-171 kubenswrapper[2567]: W0715 18:17:21.847447    2567 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 15 18:17:21.946576 ip-10-0-141-171 kubenswrapper[2567]: W0715 18:17:21.847450    2567 feature_gate.go:328] unrecognized feature gate: Example2
Jul 15 18:17:21.946576 ip-10-0-141-171 kubenswrapper[2567]: W0715 18:17:21.847452    2567 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 15 18:17:21.946576 ip-10-0-141-171 kubenswrapper[2567]: W0715 18:17:21.847455    2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 15 18:17:21.946576 ip-10-0-141-171 kubenswrapper[2567]: W0715 18:17:21.847458    2567 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 15 18:17:21.946576 ip-10-0-141-171 kubenswrapper[2567]: W0715 18:17:21.847461    2567 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 15 18:17:21.946576 ip-10-0-141-171 kubenswrapper[2567]: W0715 18:17:21.847464    2567 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 15 18:17:21.946576 ip-10-0-141-171 kubenswrapper[2567]: W0715 18:17:21.847466    2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 15 18:17:21.946576 ip-10-0-141-171 kubenswrapper[2567]: W0715 18:17:21.847469    2567 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 15 18:17:21.947546 ip-10-0-141-171 kubenswrapper[2567]: W0715 18:17:21.847472    2567 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 15 18:17:21.947546 ip-10-0-141-171 kubenswrapper[2567]: W0715 18:17:21.847476    2567 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 15 18:17:21.947546 ip-10-0-141-171 kubenswrapper[2567]: W0715 18:17:21.847479    2567 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 15 18:17:21.947546 ip-10-0-141-171 kubenswrapper[2567]: W0715 18:17:21.847481    2567 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 15 18:17:21.947546 ip-10-0-141-171 kubenswrapper[2567]: W0715 18:17:21.847485    2567 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 15 18:17:21.947546 ip-10-0-141-171 kubenswrapper[2567]: W0715 18:17:21.847488    2567 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 15 18:17:21.947546 ip-10-0-141-171 kubenswrapper[2567]: W0715 18:17:21.847491    2567 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 15 18:17:21.947546 ip-10-0-141-171 kubenswrapper[2567]: W0715 18:17:21.847493    2567 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 15 18:17:21.947546 ip-10-0-141-171 kubenswrapper[2567]: W0715 18:17:21.847496    2567 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 15 18:17:21.947546 ip-10-0-141-171 kubenswrapper[2567]: W0715 18:17:21.847499    2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 15 18:17:21.947546 ip-10-0-141-171 kubenswrapper[2567]: W0715 18:17:21.847502    2567 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 15 18:17:21.947546 ip-10-0-141-171 kubenswrapper[2567]: W0715 18:17:21.847504    2567 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 15 18:17:21.947546 ip-10-0-141-171 kubenswrapper[2567]: W0715 18:17:21.847507    2567 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 15 18:17:21.947546 ip-10-0-141-171 kubenswrapper[2567]: W0715 18:17:21.848252    2567 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 15 18:17:21.947546 ip-10-0-141-171 kubenswrapper[2567]: W0715 18:17:21.848260    2567 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 15 18:17:21.947546 ip-10-0-141-171 kubenswrapper[2567]: W0715 18:17:21.848263    2567 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 15 18:17:21.947546 ip-10-0-141-171 kubenswrapper[2567]: W0715 18:17:21.848266    2567 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 15 18:17:21.947546 ip-10-0-141-171 kubenswrapper[2567]: W0715 18:17:21.848269    2567 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 15 18:17:21.947546 ip-10-0-141-171 kubenswrapper[2567]: W0715 18:17:21.848272    2567 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 15 18:17:21.947546 ip-10-0-141-171 kubenswrapper[2567]: W0715 18:17:21.848275    2567 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 15 18:17:21.948497 ip-10-0-141-171 kubenswrapper[2567]: W0715 18:17:21.848278    2567 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 15 18:17:21.948497 ip-10-0-141-171 kubenswrapper[2567]: W0715 18:17:21.848281    2567 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 15 18:17:21.948497 ip-10-0-141-171 kubenswrapper[2567]: W0715 18:17:21.848284    2567 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 15 18:17:21.948497 ip-10-0-141-171 kubenswrapper[2567]: W0715 18:17:21.848287    2567 feature_gate.go:328] unrecognized feature gate: Example2
Jul 15 18:17:21.948497 ip-10-0-141-171 kubenswrapper[2567]: W0715 18:17:21.848290    2567 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 15 18:17:21.948497 ip-10-0-141-171 kubenswrapper[2567]: W0715 18:17:21.848293    2567 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 15 18:17:21.948497 ip-10-0-141-171 kubenswrapper[2567]: W0715 18:17:21.848295    2567 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 15 18:17:21.948497 ip-10-0-141-171 kubenswrapper[2567]: W0715 18:17:21.848298    2567 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 15 18:17:21.948497 ip-10-0-141-171 kubenswrapper[2567]: W0715 18:17:21.848300    2567 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 15 18:17:21.948497 ip-10-0-141-171 kubenswrapper[2567]: W0715 18:17:21.848303    2567 feature_gate.go:328] unrecognized feature gate: Example
Jul 15 18:17:21.948497 ip-10-0-141-171 kubenswrapper[2567]: W0715 18:17:21.848325    2567 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 15 18:17:21.948497 ip-10-0-141-171 kubenswrapper[2567]: W0715 18:17:21.848328    2567 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 15 18:17:21.948497 ip-10-0-141-171 kubenswrapper[2567]: W0715 18:17:21.848330    2567 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 15 18:17:21.948497 ip-10-0-141-171 kubenswrapper[2567]: W0715 18:17:21.848334    2567 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 15 18:17:21.948497 ip-10-0-141-171 kubenswrapper[2567]: W0715 18:17:21.848337    2567 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 15 18:17:21.948497 ip-10-0-141-171 kubenswrapper[2567]: W0715 18:17:21.848340    2567 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 15 18:17:21.948497 ip-10-0-141-171 kubenswrapper[2567]: W0715 18:17:21.848342    2567 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 15 18:17:21.948497 ip-10-0-141-171 kubenswrapper[2567]: W0715 18:17:21.848345    2567 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 15 18:17:21.948497 ip-10-0-141-171 kubenswrapper[2567]: W0715 18:17:21.848348    2567 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 15 18:17:21.948497 ip-10-0-141-171 kubenswrapper[2567]: W0715 18:17:21.848350    2567 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 15 18:17:21.949665 ip-10-0-141-171 kubenswrapper[2567]: W0715 18:17:21.848353    2567 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 15 18:17:21.949665 ip-10-0-141-171 kubenswrapper[2567]: W0715 18:17:21.848356    2567 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 15 18:17:21.949665 ip-10-0-141-171 kubenswrapper[2567]: W0715 18:17:21.848358    2567 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 15 18:17:21.949665 ip-10-0-141-171 kubenswrapper[2567]: W0715 18:17:21.848361    2567 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 15 18:17:21.949665 ip-10-0-141-171 kubenswrapper[2567]: W0715 18:17:21.848363    2567 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 15 18:17:21.949665 ip-10-0-141-171 kubenswrapper[2567]: W0715 18:17:21.848366    2567 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 15 18:17:21.949665 ip-10-0-141-171 kubenswrapper[2567]: W0715 18:17:21.848369    2567 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 15 18:17:21.949665 ip-10-0-141-171 kubenswrapper[2567]: W0715 18:17:21.848372    2567 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 15 18:17:21.949665 ip-10-0-141-171 kubenswrapper[2567]: W0715 18:17:21.848374    2567 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 15 18:17:21.949665 ip-10-0-141-171 kubenswrapper[2567]: W0715 18:17:21.848377    2567 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 15 18:17:21.949665 ip-10-0-141-171 kubenswrapper[2567]: W0715 18:17:21.848379    2567 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 15 18:17:21.949665 ip-10-0-141-171 kubenswrapper[2567]: W0715 18:17:21.848384    2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 15 18:17:21.949665 ip-10-0-141-171 kubenswrapper[2567]: W0715 18:17:21.848387    2567 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 15 18:17:21.949665 ip-10-0-141-171 kubenswrapper[2567]: W0715 18:17:21.848389    2567 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 15 18:17:21.949665 ip-10-0-141-171 kubenswrapper[2567]: W0715 18:17:21.848392    2567 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 15 18:17:21.949665 ip-10-0-141-171 kubenswrapper[2567]: W0715 18:17:21.848395    2567 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 15 18:17:21.949665 ip-10-0-141-171 kubenswrapper[2567]: W0715 18:17:21.848398    2567 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 15 18:17:21.949665 ip-10-0-141-171 kubenswrapper[2567]: W0715 18:17:21.848401    2567 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 15 18:17:21.949665 ip-10-0-141-171 kubenswrapper[2567]: W0715 18:17:21.848404    2567 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 15 18:17:21.949665 ip-10-0-141-171 kubenswrapper[2567]: W0715 18:17:21.848407    2567 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 15 18:17:21.950822 ip-10-0-141-171 kubenswrapper[2567]: W0715 18:17:21.848410    2567 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 15 18:17:21.950822 ip-10-0-141-171 kubenswrapper[2567]: W0715 18:17:21.848413    2567 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 15 18:17:21.950822 ip-10-0-141-171 kubenswrapper[2567]: W0715 18:17:21.848420    2567 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 15 18:17:21.950822 ip-10-0-141-171 kubenswrapper[2567]: W0715 18:17:21.848423    2567 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 15 18:17:21.950822 ip-10-0-141-171 kubenswrapper[2567]: W0715 18:17:21.848426    2567 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 15 18:17:21.950822 ip-10-0-141-171 kubenswrapper[2567]: W0715 18:17:21.848430    2567 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 15 18:17:21.950822 ip-10-0-141-171 kubenswrapper[2567]: W0715 18:17:21.848433    2567 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 15 18:17:21.950822 ip-10-0-141-171 kubenswrapper[2567]: W0715 18:17:21.848435    2567 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 15 18:17:21.950822 ip-10-0-141-171 kubenswrapper[2567]: W0715 18:17:21.848438    2567 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 15 18:17:21.950822 ip-10-0-141-171 kubenswrapper[2567]: W0715 18:17:21.848441    2567 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 15 18:17:21.950822 ip-10-0-141-171 kubenswrapper[2567]: W0715 18:17:21.848443    2567 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 15 18:17:21.950822 ip-10-0-141-171 kubenswrapper[2567]: W0715 18:17:21.848446    2567 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 15 18:17:21.950822 ip-10-0-141-171 kubenswrapper[2567]: W0715 18:17:21.848449    2567 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 15 18:17:21.950822 ip-10-0-141-171 kubenswrapper[2567]: W0715 18:17:21.848451    2567 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 15 18:17:21.950822 ip-10-0-141-171 kubenswrapper[2567]: W0715 18:17:21.848455    2567 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 15 18:17:21.950822 ip-10-0-141-171 kubenswrapper[2567]: W0715 18:17:21.848457    2567 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 15 18:17:21.950822 ip-10-0-141-171 kubenswrapper[2567]: W0715 18:17:21.848460    2567 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 15 18:17:21.950822 ip-10-0-141-171 kubenswrapper[2567]: W0715 18:17:21.848463    2567 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 15 18:17:21.950822 ip-10-0-141-171 kubenswrapper[2567]: W0715 18:17:21.848465    2567 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 15 18:17:21.953140 ip-10-0-141-171 kubenswrapper[2567]: W0715 18:17:21.848468    2567 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 15 18:17:21.953140 ip-10-0-141-171 kubenswrapper[2567]: W0715 18:17:21.848471    2567 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 15 18:17:21.953140 ip-10-0-141-171 kubenswrapper[2567]: W0715 18:17:21.848473    2567 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 15 18:17:21.953140 ip-10-0-141-171 kubenswrapper[2567]: W0715 18:17:21.848476    2567 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 15 18:17:21.953140 ip-10-0-141-171 kubenswrapper[2567]: W0715 18:17:21.848479    2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 15 18:17:21.953140 ip-10-0-141-171 kubenswrapper[2567]: W0715 18:17:21.848485    2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 15 18:17:21.953140 ip-10-0-141-171 kubenswrapper[2567]: W0715 18:17:21.848488    2567 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 15 18:17:21.953140 ip-10-0-141-171 kubenswrapper[2567]: W0715 18:17:21.848491    2567 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 15 18:17:21.953140 ip-10-0-141-171 kubenswrapper[2567]: W0715 18:17:21.848495    2567 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 15 18:17:21.953140 ip-10-0-141-171 kubenswrapper[2567]: W0715 18:17:21.848500    2567 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 15 18:17:21.953140 ip-10-0-141-171 kubenswrapper[2567]: W0715 18:17:21.848503    2567 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 15 18:17:21.953140 ip-10-0-141-171 kubenswrapper[2567]: W0715 18:17:21.848506    2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 15 18:17:21.953140 ip-10-0-141-171 kubenswrapper[2567]: W0715 18:17:21.848509    2567 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 15 18:17:21.953140 ip-10-0-141-171 kubenswrapper[2567]: W0715 18:17:21.848512    2567 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 15 18:17:21.953140 ip-10-0-141-171 kubenswrapper[2567]: W0715 18:17:21.848515    2567 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 15 18:17:21.953140 ip-10-0-141-171 kubenswrapper[2567]: W0715 18:17:21.848519    2567 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 15 18:17:21.953140 ip-10-0-141-171 kubenswrapper[2567]: W0715 18:17:21.848522    2567 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 15 18:17:21.953140 ip-10-0-141-171 kubenswrapper[2567]: W0715 18:17:21.848524    2567 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 15 18:17:21.953140 ip-10-0-141-171 kubenswrapper[2567]: W0715 18:17:21.848527    2567 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 15 18:17:21.954075 ip-10-0-141-171 kubenswrapper[2567]: W0715 18:17:21.848530    2567 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 15 18:17:21.954075 ip-10-0-141-171 kubenswrapper[2567]: W0715 18:17:21.848532    2567 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 15 18:17:21.954075 ip-10-0-141-171 kubenswrapper[2567]: W0715 18:17:21.848535    2567 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 15 18:17:21.954075 ip-10-0-141-171 kubenswrapper[2567]: W0715 18:17:21.848538    2567 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 15 18:17:21.954075 ip-10-0-141-171 kubenswrapper[2567]: W0715 18:17:21.848540    2567 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 15 18:17:21.954075 ip-10-0-141-171 kubenswrapper[2567]: W0715 18:17:21.848546    2567 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 15 18:17:21.954075 ip-10-0-141-171 kubenswrapper[2567]: W0715 18:17:21.848549    2567 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 15 18:17:21.954075 ip-10-0-141-171 kubenswrapper[2567]: W0715 18:17:21.848552    2567 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 15 18:17:21.954075 ip-10-0-141-171 kubenswrapper[2567]: W0715 18:17:21.848555    2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 15 18:17:21.954075 ip-10-0-141-171 kubenswrapper[2567]: W0715 18:17:21.848559    2567 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 15 18:17:21.954075 ip-10-0-141-171 kubenswrapper[2567]: W0715 18:17:21.848562    2567 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 15 18:17:21.954075 ip-10-0-141-171 kubenswrapper[2567]: W0715 18:17:21.848566    2567 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 15 18:17:21.954075 ip-10-0-141-171 kubenswrapper[2567]: W0715 18:17:21.848568    2567 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 15 18:17:21.954075 ip-10-0-141-171 kubenswrapper[2567]: W0715 18:17:21.848571    2567 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 15 18:17:21.954075 ip-10-0-141-171 kubenswrapper[2567]: W0715 18:17:21.848945    2567 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 15 18:17:21.954075 ip-10-0-141-171 kubenswrapper[2567]: W0715 18:17:21.848951    2567 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 15 18:17:21.954075 ip-10-0-141-171 kubenswrapper[2567]: W0715 18:17:21.848954    2567 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 15 18:17:21.954075 ip-10-0-141-171 kubenswrapper[2567]: W0715 18:17:21.848957    2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 15 18:17:21.954075 ip-10-0-141-171 kubenswrapper[2567]: W0715 18:17:21.848960    2567 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 15 18:17:21.956136 ip-10-0-141-171 kubenswrapper[2567]: W0715 18:17:21.848963    2567 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 15 18:17:21.956136 ip-10-0-141-171 kubenswrapper[2567]: W0715 18:17:21.848965    2567 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 15 18:17:21.956136 ip-10-0-141-171 kubenswrapper[2567]: W0715 18:17:21.848968    2567 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 15 18:17:21.956136 ip-10-0-141-171 kubenswrapper[2567]: W0715 18:17:21.848971    2567 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 15 18:17:21.956136 ip-10-0-141-171 kubenswrapper[2567]: W0715 18:17:21.848974    2567 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 15 18:17:21.956136 ip-10-0-141-171 kubenswrapper[2567]: W0715 18:17:21.848977    2567 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 15 18:17:21.956136 ip-10-0-141-171 kubenswrapper[2567]: W0715 18:17:21.848979    2567 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 15 18:17:21.956136 ip-10-0-141-171 kubenswrapper[2567]: W0715 18:17:21.848982    2567 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 15 18:17:21.956136 ip-10-0-141-171 kubenswrapper[2567]: W0715 18:17:21.848985    2567 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 15 18:17:21.956136 ip-10-0-141-171 kubenswrapper[2567]: W0715 18:17:21.848989    2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 15 18:17:21.956136 ip-10-0-141-171 kubenswrapper[2567]: W0715 18:17:21.848992    2567 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 15 18:17:21.956136 ip-10-0-141-171 kubenswrapper[2567]: W0715 18:17:21.848995    2567 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 15 18:17:21.956136 ip-10-0-141-171 kubenswrapper[2567]: W0715 18:17:21.848998    2567 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 15 18:17:21.956136 ip-10-0-141-171 kubenswrapper[2567]: W0715 18:17:21.849001    2567 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 15 18:17:21.956136 ip-10-0-141-171 kubenswrapper[2567]: W0715 18:17:21.849003    2567 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 15 18:17:21.956136 ip-10-0-141-171 kubenswrapper[2567]: W0715 18:17:21.849006    2567 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 15 18:17:21.956136 ip-10-0-141-171 kubenswrapper[2567]: W0715 18:17:21.849008    2567 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 15 18:17:21.956136 ip-10-0-141-171 kubenswrapper[2567]: W0715 18:17:21.849011    2567 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 15 18:17:21.956136 ip-10-0-141-171 kubenswrapper[2567]: W0715 18:17:21.849014    2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 15 18:17:21.956136 ip-10-0-141-171 kubenswrapper[2567]: W0715 18:17:21.849016    2567 feature_gate.go:328] unrecognized feature gate: Example
Jul 15 18:17:21.957085 ip-10-0-141-171 kubenswrapper[2567]: W0715 18:17:21.849025    2567 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 15 18:17:21.957085 ip-10-0-141-171 kubenswrapper[2567]: W0715 18:17:21.849027    2567 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 15 18:17:21.957085 ip-10-0-141-171 kubenswrapper[2567]: W0715 18:17:21.849030    2567 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 15 18:17:21.957085 ip-10-0-141-171 kubenswrapper[2567]: W0715 18:17:21.849033    2567 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 15 18:17:21.957085 ip-10-0-141-171 kubenswrapper[2567]: W0715 18:17:21.849036    2567 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 15 18:17:21.957085 ip-10-0-141-171 kubenswrapper[2567]: W0715 18:17:21.849039    2567 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 15 18:17:21.957085 ip-10-0-141-171 kubenswrapper[2567]: W0715 18:17:21.849041    2567 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 15 18:17:21.957085 ip-10-0-141-171 kubenswrapper[2567]: W0715 18:17:21.849044    2567 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 15 18:17:21.957085 ip-10-0-141-171 kubenswrapper[2567]: W0715 18:17:21.849047    2567 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 15 18:17:21.957085 ip-10-0-141-171 kubenswrapper[2567]: W0715 18:17:21.849050    2567 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 15 18:17:21.957085 ip-10-0-141-171 kubenswrapper[2567]: W0715 18:17:21.849053    2567 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 15 18:17:21.957085 ip-10-0-141-171 kubenswrapper[2567]: W0715 18:17:21.849056    2567 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 15 18:17:21.957085 ip-10-0-141-171 kubenswrapper[2567]: W0715 18:17:21.849059    2567 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 15 18:17:21.957085 ip-10-0-141-171 kubenswrapper[2567]: W0715 18:17:21.849062    2567 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 15 18:17:21.957085 ip-10-0-141-171 kubenswrapper[2567]: W0715 18:17:21.849065    2567 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 15 18:17:21.957085 ip-10-0-141-171 kubenswrapper[2567]: W0715 18:17:21.849068    2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 15 18:17:21.957085 ip-10-0-141-171 kubenswrapper[2567]: W0715 18:17:21.849071    2567 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 15 18:17:21.957085 ip-10-0-141-171 kubenswrapper[2567]: W0715 18:17:21.849074    2567 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 15 18:17:21.957085 ip-10-0-141-171 kubenswrapper[2567]: W0715 18:17:21.849077    2567 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 15 18:17:21.958729 ip-10-0-141-171 kubenswrapper[2567]: W0715 18:17:21.849079    2567 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 15 18:17:21.958729 ip-10-0-141-171 kubenswrapper[2567]: W0715 18:17:21.849082    2567 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 15 18:17:21.958729 ip-10-0-141-171 kubenswrapper[2567]: W0715 18:17:21.849086    2567 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 15 18:17:21.958729 ip-10-0-141-171 kubenswrapper[2567]: W0715 18:17:21.849089    2567 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 15 18:17:21.958729 ip-10-0-141-171 kubenswrapper[2567]: W0715 18:17:21.849093    2567 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 15 18:17:21.958729 ip-10-0-141-171 kubenswrapper[2567]: W0715 18:17:21.849097    2567 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 15 18:17:21.958729 ip-10-0-141-171 kubenswrapper[2567]: W0715 18:17:21.849101    2567 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 15 18:17:21.958729 ip-10-0-141-171 kubenswrapper[2567]: W0715 18:17:21.849104    2567 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 15 18:17:21.958729 ip-10-0-141-171 kubenswrapper[2567]: W0715 18:17:21.849107    2567 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 15 18:17:21.958729 ip-10-0-141-171 kubenswrapper[2567]: W0715 18:17:21.849110    2567 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 15 18:17:21.958729 ip-10-0-141-171 kubenswrapper[2567]: W0715 18:17:21.849113    2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 15 18:17:21.958729 ip-10-0-141-171 kubenswrapper[2567]: W0715 18:17:21.849116    2567 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 15 18:17:21.958729 ip-10-0-141-171 kubenswrapper[2567]: W0715 18:17:21.849119    2567 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 15 18:17:21.958729 ip-10-0-141-171 kubenswrapper[2567]: W0715 18:17:21.849123    2567 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 15 18:17:21.958729 ip-10-0-141-171 kubenswrapper[2567]: W0715 18:17:21.849126    2567 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 15 18:17:21.958729 ip-10-0-141-171 kubenswrapper[2567]: W0715 18:17:21.849128    2567 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 15 18:17:21.958729 ip-10-0-141-171 kubenswrapper[2567]: W0715 18:17:21.849131    2567 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 15 18:17:21.958729 ip-10-0-141-171 kubenswrapper[2567]: W0715 18:17:21.849134    2567 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 15 18:17:21.958729 ip-10-0-141-171 kubenswrapper[2567]: W0715 18:17:21.849136    2567 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 15 18:17:21.959665 ip-10-0-141-171 kubenswrapper[2567]: W0715 18:17:21.849139    2567 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 15 18:17:21.959665 ip-10-0-141-171 kubenswrapper[2567]: W0715 18:17:21.849141    2567 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 15 18:17:21.959665 ip-10-0-141-171 kubenswrapper[2567]: W0715 18:17:21.849144    2567 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 15 18:17:21.959665 ip-10-0-141-171 kubenswrapper[2567]: W0715 18:17:21.849147    2567 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 15 18:17:21.959665 ip-10-0-141-171 kubenswrapper[2567]: W0715 18:17:21.849149    2567 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 15 18:17:21.959665 ip-10-0-141-171 kubenswrapper[2567]: W0715 18:17:21.849152    2567 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 15 18:17:21.959665 ip-10-0-141-171 kubenswrapper[2567]: W0715 18:17:21.849155    2567 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 15 18:17:21.959665 ip-10-0-141-171 kubenswrapper[2567]: W0715 18:17:21.849158    2567 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 15 18:17:21.959665 ip-10-0-141-171 kubenswrapper[2567]: W0715 18:17:21.849160    2567 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 15 18:17:21.959665 ip-10-0-141-171 kubenswrapper[2567]: W0715 18:17:21.849163    2567 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 15 18:17:21.959665 ip-10-0-141-171 kubenswrapper[2567]: W0715 18:17:21.849165    2567 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 15 18:17:21.959665 ip-10-0-141-171 kubenswrapper[2567]: W0715 18:17:21.849168    2567 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 15 18:17:21.959665 ip-10-0-141-171 kubenswrapper[2567]: W0715 18:17:21.849171    2567 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 15 18:17:21.959665 ip-10-0-141-171 kubenswrapper[2567]: W0715 18:17:21.849175    2567 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 15 18:17:21.959665 ip-10-0-141-171 kubenswrapper[2567]: W0715 18:17:21.849178    2567 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 15 18:17:21.959665 ip-10-0-141-171 kubenswrapper[2567]: W0715 18:17:21.849182    2567 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 15 18:17:21.959665 ip-10-0-141-171 kubenswrapper[2567]: W0715 18:17:21.849185    2567 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 15 18:17:21.959665 ip-10-0-141-171 kubenswrapper[2567]: W0715 18:17:21.849188    2567 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 15 18:17:21.959665 ip-10-0-141-171 kubenswrapper[2567]: W0715 18:17:21.849190    2567 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 15 18:17:21.959665 ip-10-0-141-171 kubenswrapper[2567]: W0715 18:17:21.849193    2567 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 15 18:17:21.960620 ip-10-0-141-171 kubenswrapper[2567]: W0715 18:17:21.849196    2567 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 15 18:17:21.960620 ip-10-0-141-171 kubenswrapper[2567]: W0715 18:17:21.849198    2567 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 15 18:17:21.960620 ip-10-0-141-171 kubenswrapper[2567]: W0715 18:17:21.849201    2567 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 15 18:17:21.960620 ip-10-0-141-171 kubenswrapper[2567]: W0715 18:17:21.849204    2567 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 15 18:17:21.960620 ip-10-0-141-171 kubenswrapper[2567]: W0715 18:17:21.849206    2567 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 15 18:17:21.960620 ip-10-0-141-171 kubenswrapper[2567]: W0715 18:17:21.849211    2567 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 15 18:17:21.960620 ip-10-0-141-171 kubenswrapper[2567]: W0715 18:17:21.849216    2567 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 15 18:17:21.960620 ip-10-0-141-171 kubenswrapper[2567]: W0715 18:17:21.849219    2567 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 15 18:17:21.960620 ip-10-0-141-171 kubenswrapper[2567]: W0715 18:17:21.849222    2567 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 15 18:17:21.960620 ip-10-0-141-171 kubenswrapper[2567]: W0715 18:17:21.849225    2567 feature_gate.go:328] unrecognized feature gate: Example2
Jul 15 18:17:21.960620 ip-10-0-141-171 kubenswrapper[2567]: W0715 18:17:21.849228    2567 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 15 18:17:21.960620 ip-10-0-141-171 kubenswrapper[2567]: W0715 18:17:21.849231    2567 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 15 18:17:21.960620 ip-10-0-141-171 kubenswrapper[2567]: W0715 18:17:21.849234    2567 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 15 18:17:21.960620 ip-10-0-141-171 kubenswrapper[2567]: W0715 18:17:21.849237    2567 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 15 18:17:21.960620 ip-10-0-141-171 kubenswrapper[2567]: W0715 18:17:21.849240    2567 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 15 18:17:21.960620 ip-10-0-141-171 kubenswrapper[2567]: W0715 18:17:21.849243    2567 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 15 18:17:21.960620 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:17:21.849330    2567 flags.go:64] FLAG: --address="0.0.0.0"
Jul 15 18:17:21.960620 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:17:21.849340    2567 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]"
Jul 15 18:17:21.960620 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:17:21.849349    2567 flags.go:64] FLAG: --anonymous-auth="true"
Jul 15 18:17:21.960620 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:17:21.849355    2567 flags.go:64] FLAG: --application-metrics-count-limit="100"
Jul 15 18:17:21.960620 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:17:21.849361    2567 flags.go:64] FLAG: --authentication-token-webhook="false"
Jul 15 18:17:21.961582 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:17:21.849364    2567 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s"
Jul 15 18:17:21.961582 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:17:21.849369    2567 flags.go:64] FLAG: --authorization-mode="AlwaysAllow"
Jul 15 18:17:21.961582 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:17:21.849373    2567 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s"
Jul 15 18:17:21.961582 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:17:21.849377    2567 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s"
Jul 15 18:17:21.961582 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:17:21.849380    2567 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id"
Jul 15 18:17:21.961582 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:17:21.849383    2567 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig"
Jul 15 18:17:21.961582 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:17:21.849389    2567 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki"
Jul 15 18:17:21.961582 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:17:21.849392    2567 flags.go:64] FLAG: --cgroup-driver="cgroupfs"
Jul 15 18:17:21.961582 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:17:21.849396    2567 flags.go:64] FLAG: --cgroup-root=""
Jul 15 18:17:21.961582 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:17:21.849399    2567 flags.go:64] FLAG: --cgroups-per-qos="true"
Jul 15 18:17:21.961582 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:17:21.849402    2567 flags.go:64] FLAG: --client-ca-file=""
Jul 15 18:17:21.961582 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:17:21.849405    2567 flags.go:64] FLAG: --cloud-provider="external"
Jul 15 18:17:21.961582 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:17:21.849409    2567 flags.go:64] FLAG: --cluster-dns="[]"
Jul 15 18:17:21.961582 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:17:21.849413    2567 flags.go:64] FLAG: --cluster-domain=""
Jul 15 18:17:21.961582 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:17:21.849417    2567 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf"
Jul 15 18:17:21.961582 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:17:21.849420    2567 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d"
Jul 15 18:17:21.961582 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:17:21.849423    2567 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json"
Jul 15 18:17:21.961582 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:17:21.849429    2567 flags.go:64] FLAG: --container-log-max-files="5"
Jul 15 18:17:21.961582 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:17:21.849433    2567 flags.go:64] FLAG: --container-log-max-size="10Mi"
Jul 15 18:17:21.961582 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:17:21.849436    2567 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock"
Jul 15 18:17:21.961582 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:17:21.849439    2567 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock"
Jul 15 18:17:21.961582 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:17:21.849443    2567 flags.go:64] FLAG: --containerd-namespace="k8s.io"
Jul 15 18:17:21.961582 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:17:21.849446    2567 flags.go:64] FLAG: --contention-profiling="false"
Jul 15 18:17:21.961582 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:17:21.849449    2567 flags.go:64] FLAG: --cpu-cfs-quota="true"
Jul 15 18:17:21.962745 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:17:21.849452    2567 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms"
Jul 15 18:17:21.962745 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:17:21.849456    2567 flags.go:64] FLAG: --cpu-manager-policy="none"
Jul 15 18:17:21.962745 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:17:21.849459    2567 flags.go:64] FLAG: --cpu-manager-policy-options=""
Jul 15 18:17:21.962745 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:17:21.849463    2567 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s"
Jul 15 18:17:21.962745 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:17:21.849467    2567 flags.go:64] FLAG: --enable-controller-attach-detach="true"
Jul 15 18:17:21.962745 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:17:21.849470    2567 flags.go:64] FLAG: --enable-debugging-handlers="true"
Jul 15 18:17:21.962745 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:17:21.849473    2567 flags.go:64] FLAG: --enable-load-reader="false"
Jul 15 18:17:21.962745 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:17:21.849476    2567 flags.go:64] FLAG: --enable-server="true"
Jul 15 18:17:21.962745 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:17:21.849479    2567 flags.go:64] FLAG: --enforce-node-allocatable="[pods]"
Jul 15 18:17:21.962745 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:17:21.849484    2567 flags.go:64] FLAG: --event-burst="100"
Jul 15 18:17:21.962745 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:17:21.849487    2567 flags.go:64] FLAG: --event-qps="50"
Jul 15 18:17:21.962745 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:17:21.849490    2567 flags.go:64] FLAG: --event-storage-age-limit="default=0"
Jul 15 18:17:21.962745 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:17:21.849493    2567 flags.go:64] FLAG: --event-storage-event-limit="default=0"
Jul 15 18:17:21.962745 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:17:21.849496    2567 flags.go:64] FLAG: --eviction-hard=""
Jul 15 18:17:21.962745 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:17:21.849501    2567 flags.go:64] FLAG: --eviction-max-pod-grace-period="0"
Jul 15 18:17:21.962745 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:17:21.849505    2567 flags.go:64] FLAG: --eviction-minimum-reclaim=""
Jul 15 18:17:21.962745 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:17:21.849508    2567 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s"
Jul 15 18:17:21.962745 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:17:21.849511    2567 flags.go:64] FLAG: --eviction-soft=""
Jul 15 18:17:21.962745 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:17:21.849515    2567 flags.go:64] FLAG: --eviction-soft-grace-period=""
Jul 15 18:17:21.962745 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:17:21.849518    2567 flags.go:64] FLAG: --exit-on-lock-contention="false"
Jul 15 18:17:21.962745 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:17:21.849521    2567 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false"
Jul 15 18:17:21.962745 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:17:21.849524    2567 flags.go:64] FLAG: --experimental-mounter-path=""
Jul 15 18:17:21.962745 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:17:21.849527    2567 flags.go:64] FLAG: --fail-cgroupv1="false"
Jul 15 18:17:21.962745 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:17:21.849530    2567 flags.go:64] FLAG: --fail-swap-on="true"
Jul 15 18:17:21.962745 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:17:21.849533    2567 flags.go:64] FLAG: --feature-gates=""
Jul 15 18:17:21.964825 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:17:21.849538    2567 flags.go:64] FLAG: --file-check-frequency="20s"
Jul 15 18:17:21.964825 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:17:21.849542    2567 flags.go:64] FLAG: --global-housekeeping-interval="1m0s"
Jul 15 18:17:21.964825 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:17:21.849545    2567 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge"
Jul 15 18:17:21.964825 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:17:21.849549    2567 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1"
Jul 15 18:17:21.964825 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:17:21.849552    2567 flags.go:64] FLAG: --healthz-port="10248"
Jul 15 18:17:21.964825 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:17:21.849555    2567 flags.go:64] FLAG: --help="false"
Jul 15 18:17:21.964825 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:17:21.849558    2567 flags.go:64] FLAG: --hostname-override="ip-10-0-141-171.ec2.internal"
Jul 15 18:17:21.964825 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:17:21.849561    2567 flags.go:64] FLAG: --housekeeping-interval="10s"
Jul 15 18:17:21.964825 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:17:21.849565    2567 flags.go:64] FLAG: --http-check-frequency="20s"
Jul 15 18:17:21.964825 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:17:21.849568    2567 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins"
Jul 15 18:17:21.964825 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:17:21.849572    2567 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml"
Jul 15 18:17:21.964825 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:17:21.849576    2567 flags.go:64] FLAG: --image-gc-high-threshold="85"
Jul 15 18:17:21.964825 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:17:21.849579    2567 flags.go:64] FLAG: --image-gc-low-threshold="80"
Jul 15 18:17:21.964825 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:17:21.849582    2567 flags.go:64] FLAG: --image-service-endpoint=""
Jul 15 18:17:21.964825 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:17:21.849585    2567 flags.go:64] FLAG: --kernel-memcg-notification="false"
Jul 15 18:17:21.964825 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:17:21.849588    2567 flags.go:64] FLAG: --kube-api-burst="100"
Jul 15 18:17:21.964825 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:17:21.849592    2567 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf"
Jul 15 18:17:21.964825 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:17:21.849595    2567 flags.go:64] FLAG: --kube-api-qps="50"
Jul 15 18:17:21.964825 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:17:21.849598    2567 flags.go:64] FLAG: --kube-reserved=""
Jul 15 18:17:21.964825 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:17:21.849601    2567 flags.go:64] FLAG: --kube-reserved-cgroup=""
Jul 15 18:17:21.964825 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:17:21.849604    2567 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig"
Jul 15 18:17:21.964825 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:17:21.849608    2567 flags.go:64] FLAG: --kubelet-cgroups=""
Jul 15 18:17:21.964825 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:17:21.849611    2567 flags.go:64] FLAG: --local-storage-capacity-isolation="true"
Jul 15 18:17:21.964825 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:17:21.849614    2567 flags.go:64] FLAG: --lock-file=""
Jul 15 18:17:21.966004 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:17:21.849617    2567 flags.go:64] FLAG: --log-cadvisor-usage="false"
Jul 15 18:17:21.966004 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:17:21.849620    2567 flags.go:64] FLAG: --log-flush-frequency="5s"
Jul 15 18:17:21.966004 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:17:21.849623    2567 flags.go:64] FLAG: --log-json-info-buffer-size="0"
Jul 15 18:17:21.966004 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:17:21.849630    2567 flags.go:64] FLAG: --log-json-split-stream="false"
Jul 15 18:17:21.966004 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:17:21.849633    2567 flags.go:64] FLAG: --log-text-info-buffer-size="0"
Jul 15 18:17:21.966004 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:17:21.849636    2567 flags.go:64] FLAG: --log-text-split-stream="false"
Jul 15 18:17:21.966004 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:17:21.849639    2567 flags.go:64] FLAG: --logging-format="text"
Jul 15 18:17:21.966004 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:17:21.849642    2567 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id"
Jul 15 18:17:21.966004 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:17:21.849646    2567 flags.go:64] FLAG: --make-iptables-util-chains="true"
Jul 15 18:17:21.966004 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:17:21.849650    2567 flags.go:64] FLAG: --manifest-url=""
Jul 15 18:17:21.966004 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:17:21.849653    2567 flags.go:64] FLAG: --manifest-url-header=""
Jul 15 18:17:21.966004 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:17:21.849657    2567 flags.go:64] FLAG: --max-housekeeping-interval="15s"
Jul 15 18:17:21.966004 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:17:21.849660    2567 flags.go:64] FLAG: --max-open-files="1000000"
Jul 15 18:17:21.966004 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:17:21.849664    2567 flags.go:64] FLAG: --max-pods="110"
Jul 15 18:17:21.966004 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:17:21.849668    2567 flags.go:64] FLAG: --maximum-dead-containers="-1"
Jul 15 18:17:21.966004 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:17:21.849671    2567 flags.go:64] FLAG: --maximum-dead-containers-per-container="1"
Jul 15 18:17:21.966004 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:17:21.849674    2567 flags.go:64] FLAG: --memory-manager-policy="None"
Jul 15 18:17:21.966004 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:17:21.849677    2567 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s"
Jul 15 18:17:21.966004 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:17:21.849680    2567 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s"
Jul 15 18:17:21.966004 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:17:21.849683    2567 flags.go:64] FLAG: --node-ip="0.0.0.0"
Jul 15 18:17:21.966004 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:17:21.849686    2567 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel"
Jul 15 18:17:21.966004 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:17:21.849693    2567 flags.go:64] FLAG: --node-status-max-images="50"
Jul 15 18:17:21.966004 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:17:21.849696    2567 flags.go:64] FLAG: --node-status-update-frequency="10s"
Jul 15 18:17:21.966004 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:17:21.849699    2567 flags.go:64] FLAG: --oom-score-adj="-999"
Jul 15 18:17:21.966004 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:17:21.849703    2567 flags.go:64] FLAG: --pod-cidr=""
Jul 15 18:17:21.967178 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:17:21.849706    2567 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:b04c0b1f73af4d021dd8f0b51bfeb302c24482c093de5f2c43654ab56c506926"
Jul 15 18:17:21.967178 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:17:21.849712    2567 flags.go:64] FLAG: --pod-manifest-path=""
Jul 15 18:17:21.967178 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:17:21.849715    2567 flags.go:64] FLAG: --pod-max-pids="-1"
Jul 15 18:17:21.967178 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:17:21.849719    2567 flags.go:64] FLAG: --pods-per-core="0"
Jul 15 18:17:21.967178 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:17:21.849722    2567 flags.go:64] FLAG: --port="10250"
Jul 15 18:17:21.967178 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:17:21.849727    2567 flags.go:64] FLAG: --protect-kernel-defaults="false"
Jul 15 18:17:21.967178 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:17:21.849730    2567 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-07b534e48eaa66f78"
Jul 15 18:17:21.967178 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:17:21.849733    2567 flags.go:64] FLAG: --qos-reserved=""
Jul 15 18:17:21.967178 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:17:21.849736    2567 flags.go:64] FLAG: --read-only-port="10255"
Jul 15 18:17:21.967178 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:17:21.849739    2567 flags.go:64] FLAG: --register-node="true"
Jul 15 18:17:21.967178 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:17:21.849742    2567 flags.go:64] FLAG: --register-with-taints=""
Jul 15 18:17:21.967178 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:17:21.849746    2567 flags.go:64] FLAG: --registry-burst="10"
Jul 15 18:17:21.967178 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:17:21.849749    2567 flags.go:64] FLAG: --registry-qps="5"
Jul 15 18:17:21.967178 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:17:21.849752    2567 flags.go:64] FLAG: --reserved-cpus=""
Jul 15 18:17:21.967178 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:17:21.849756    2567 flags.go:64] FLAG: --reserved-memory=""
Jul 15 18:17:21.967178 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:17:21.849761    2567 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf"
Jul 15 18:17:21.967178 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:17:21.849764    2567 flags.go:64] FLAG: --root-dir="/var/lib/kubelet"
Jul 15 18:17:21.967178 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:17:21.849767    2567 flags.go:64] FLAG: --rotate-certificates="false"
Jul 15 18:17:21.967178 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:17:21.849771    2567 flags.go:64] FLAG: --rotate-server-certificates="false"
Jul 15 18:17:21.967178 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:17:21.849774    2567 flags.go:64] FLAG: --runonce="false"
Jul 15 18:17:21.967178 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:17:21.849777    2567 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service"
Jul 15 18:17:21.967178 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:17:21.849780    2567 flags.go:64] FLAG: --runtime-request-timeout="2m0s"
Jul 15 18:17:21.967178 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:17:21.849783    2567 flags.go:64] FLAG: --seccomp-default="false"
Jul 15 18:17:21.967178 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:17:21.849786    2567 flags.go:64] FLAG: --serialize-image-pulls="true"
Jul 15 18:17:21.967178 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:17:21.849789    2567 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s"
Jul 15 18:17:21.968568 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:17:21.849792    2567 flags.go:64] FLAG: --storage-driver-db="cadvisor"
Jul 15 18:17:21.968568 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:17:21.849795    2567 flags.go:64] FLAG: --storage-driver-host="localhost:8086"
Jul 15 18:17:21.968568 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:17:21.849798    2567 flags.go:64] FLAG: --storage-driver-password="root"
Jul 15 18:17:21.968568 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:17:21.849801    2567 flags.go:64] FLAG: --storage-driver-secure="false"
Jul 15 18:17:21.968568 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:17:21.849804    2567 flags.go:64] FLAG: --storage-driver-table="stats"
Jul 15 18:17:21.968568 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:17:21.849807    2567 flags.go:64] FLAG: --storage-driver-user="root"
Jul 15 18:17:21.968568 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:17:21.849810    2567 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s"
Jul 15 18:17:21.968568 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:17:21.849813    2567 flags.go:64] FLAG: --sync-frequency="1m0s"
Jul 15 18:17:21.968568 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:17:21.849817    2567 flags.go:64] FLAG: --system-cgroups=""
Jul 15 18:17:21.968568 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:17:21.849820    2567 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi"
Jul 15 18:17:21.968568 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:17:21.849825    2567 flags.go:64] FLAG: --system-reserved-cgroup=""
Jul 15 18:17:21.968568 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:17:21.849828    2567 flags.go:64] FLAG: --tls-cert-file=""
Jul 15 18:17:21.968568 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:17:21.849833    2567 flags.go:64] FLAG: --tls-cipher-suites="[]"
Jul 15 18:17:21.968568 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:17:21.849837    2567 flags.go:64] FLAG: --tls-min-version=""
Jul 15 18:17:21.968568 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:17:21.849840    2567 flags.go:64] FLAG: --tls-private-key-file=""
Jul 15 18:17:21.968568 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:17:21.849843    2567 flags.go:64] FLAG: --topology-manager-policy="none"
Jul 15 18:17:21.968568 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:17:21.849846    2567 flags.go:64] FLAG: --topology-manager-policy-options=""
Jul 15 18:17:21.968568 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:17:21.849849    2567 flags.go:64] FLAG: --topology-manager-scope="container"
Jul 15 18:17:21.968568 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:17:21.849852    2567 flags.go:64] FLAG: --v="2"
Jul 15 18:17:21.968568 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:17:21.849856    2567 flags.go:64] FLAG: --version="false"
Jul 15 18:17:21.968568 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:17:21.849860    2567 flags.go:64] FLAG: --vmodule=""
Jul 15 18:17:21.968568 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:17:21.849864    2567 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec"
Jul 15 18:17:21.968568 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:17:21.849869    2567 flags.go:64] FLAG: --volume-stats-agg-period="1m0s"
Jul 15 18:17:21.968568 ip-10-0-141-171 kubenswrapper[2567]: W0715 18:17:21.850011    2567 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 15 18:17:21.968568 ip-10-0-141-171 kubenswrapper[2567]: W0715 18:17:21.850015    2567 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 15 18:17:21.970251 ip-10-0-141-171 kubenswrapper[2567]: W0715 18:17:21.850019    2567 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 15 18:17:21.970251 ip-10-0-141-171 kubenswrapper[2567]: W0715 18:17:21.850022    2567 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 15 18:17:21.970251 ip-10-0-141-171 kubenswrapper[2567]: W0715 18:17:21.850026    2567 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 15 18:17:21.970251 ip-10-0-141-171 kubenswrapper[2567]: W0715 18:17:21.850030    2567 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 15 18:17:21.970251 ip-10-0-141-171 kubenswrapper[2567]: W0715 18:17:21.850034    2567 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 15 18:17:21.970251 ip-10-0-141-171 kubenswrapper[2567]: W0715 18:17:21.850038    2567 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 15 18:17:21.970251 ip-10-0-141-171 kubenswrapper[2567]: W0715 18:17:21.850041    2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 15 18:17:21.970251 ip-10-0-141-171 kubenswrapper[2567]: W0715 18:17:21.850044    2567 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 15 18:17:21.970251 ip-10-0-141-171 kubenswrapper[2567]: W0715 18:17:21.850047    2567 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 15 18:17:21.970251 ip-10-0-141-171 kubenswrapper[2567]: W0715 18:17:21.850049    2567 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 15 18:17:21.970251 ip-10-0-141-171 kubenswrapper[2567]: W0715 18:17:21.850052    2567 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 15 18:17:21.970251 ip-10-0-141-171 kubenswrapper[2567]: W0715 18:17:21.850055    2567 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 15 18:17:21.970251 ip-10-0-141-171 kubenswrapper[2567]: W0715 18:17:21.850057    2567 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 15 18:17:21.970251 ip-10-0-141-171 kubenswrapper[2567]: W0715 18:17:21.850060    2567 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 15 18:17:21.970251 ip-10-0-141-171 kubenswrapper[2567]: W0715 18:17:21.850063    2567 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 15 18:17:21.970251 ip-10-0-141-171 kubenswrapper[2567]: W0715 18:17:21.850065    2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 15 18:17:21.970251 ip-10-0-141-171 kubenswrapper[2567]: W0715 18:17:21.850069    2567 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 15 18:17:21.970251 ip-10-0-141-171 kubenswrapper[2567]: W0715 18:17:21.850071    2567 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 15 18:17:21.970251 ip-10-0-141-171 kubenswrapper[2567]: W0715 18:17:21.850074    2567 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 15 18:17:21.971195 ip-10-0-141-171 kubenswrapper[2567]: W0715 18:17:21.850078    2567 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 15 18:17:21.971195 ip-10-0-141-171 kubenswrapper[2567]: W0715 18:17:21.850081    2567 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 15 18:17:21.971195 ip-10-0-141-171 kubenswrapper[2567]: W0715 18:17:21.850084    2567 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 15 18:17:21.971195 ip-10-0-141-171 kubenswrapper[2567]: W0715 18:17:21.850086    2567 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 15 18:17:21.971195 ip-10-0-141-171 kubenswrapper[2567]: W0715 18:17:21.850089    2567 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 15 18:17:21.971195 ip-10-0-141-171 kubenswrapper[2567]: W0715 18:17:21.850092    2567 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 15 18:17:21.971195 ip-10-0-141-171 kubenswrapper[2567]: W0715 18:17:21.850095    2567 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 15 18:17:21.971195 ip-10-0-141-171 kubenswrapper[2567]: W0715 18:17:21.850098    2567 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 15 18:17:21.971195 ip-10-0-141-171 kubenswrapper[2567]: W0715 18:17:21.850100    2567 feature_gate.go:328] unrecognized feature gate: Example2
Jul 15 18:17:21.971195 ip-10-0-141-171 kubenswrapper[2567]: W0715 18:17:21.850103    2567 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 15 18:17:21.971195 ip-10-0-141-171 kubenswrapper[2567]: W0715 18:17:21.850107    2567 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 15 18:17:21.971195 ip-10-0-141-171 kubenswrapper[2567]: W0715 18:17:21.850110    2567 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 15 18:17:21.971195 ip-10-0-141-171 kubenswrapper[2567]: W0715 18:17:21.850113    2567 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 15 18:17:21.971195 ip-10-0-141-171 kubenswrapper[2567]: W0715 18:17:21.850116    2567 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 15 18:17:21.971195 ip-10-0-141-171 kubenswrapper[2567]: W0715 18:17:21.850119    2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 15 18:17:21.971195 ip-10-0-141-171 kubenswrapper[2567]: W0715 18:17:21.850121    2567 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 15 18:17:21.971195 ip-10-0-141-171 kubenswrapper[2567]: W0715 18:17:21.850124    2567 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 15 18:17:21.971195 ip-10-0-141-171 kubenswrapper[2567]: W0715 18:17:21.850127    2567 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 15 18:17:21.971195 ip-10-0-141-171 kubenswrapper[2567]: W0715 18:17:21.850129    2567 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 15 18:17:21.971195 ip-10-0-141-171 kubenswrapper[2567]: W0715 18:17:21.850132    2567 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 15 18:17:21.972813 ip-10-0-141-171 kubenswrapper[2567]: W0715 18:17:21.850134    2567 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 15 18:17:21.972813 ip-10-0-141-171 kubenswrapper[2567]: W0715 18:17:21.850137    2567 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 15 18:17:21.972813 ip-10-0-141-171 kubenswrapper[2567]: W0715 18:17:21.850140    2567 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 15 18:17:21.972813 ip-10-0-141-171 kubenswrapper[2567]: W0715 18:17:21.850142    2567 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 15 18:17:21.972813 ip-10-0-141-171 kubenswrapper[2567]: W0715 18:17:21.850145    2567 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 15 18:17:21.972813 ip-10-0-141-171 kubenswrapper[2567]: W0715 18:17:21.850148    2567 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 15 18:17:21.972813 ip-10-0-141-171 kubenswrapper[2567]: W0715 18:17:21.850151    2567 feature_gate.go:328] unrecognized feature gate: Example
Jul 15 18:17:21.972813 ip-10-0-141-171 kubenswrapper[2567]: W0715 18:17:21.850154    2567 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 15 18:17:21.972813 ip-10-0-141-171 kubenswrapper[2567]: W0715 18:17:21.850157    2567 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 15 18:17:21.972813 ip-10-0-141-171 kubenswrapper[2567]: W0715 18:17:21.850160    2567 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 15 18:17:21.972813 ip-10-0-141-171 kubenswrapper[2567]: W0715 18:17:21.850164    2567 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 15 18:17:21.972813 ip-10-0-141-171 kubenswrapper[2567]: W0715 18:17:21.850168    2567 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 15 18:17:21.972813 ip-10-0-141-171 kubenswrapper[2567]: W0715 18:17:21.850174    2567 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 15 18:17:21.972813 ip-10-0-141-171 kubenswrapper[2567]: W0715 18:17:21.850177    2567 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 15 18:17:21.972813 ip-10-0-141-171 kubenswrapper[2567]: W0715 18:17:21.850180    2567 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 15 18:17:21.972813 ip-10-0-141-171 kubenswrapper[2567]: W0715 18:17:21.850183    2567 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 15 18:17:21.972813 ip-10-0-141-171 kubenswrapper[2567]: W0715 18:17:21.850186    2567 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 15 18:17:21.972813 ip-10-0-141-171 kubenswrapper[2567]: W0715 18:17:21.850189    2567 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 15 18:17:21.972813 ip-10-0-141-171 kubenswrapper[2567]: W0715 18:17:21.850193    2567 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 15 18:17:21.973762 ip-10-0-141-171 kubenswrapper[2567]: W0715 18:17:21.850195    2567 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 15 18:17:21.973762 ip-10-0-141-171 kubenswrapper[2567]: W0715 18:17:21.850198    2567 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 15 18:17:21.973762 ip-10-0-141-171 kubenswrapper[2567]: W0715 18:17:21.850201    2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 15 18:17:21.973762 ip-10-0-141-171 kubenswrapper[2567]: W0715 18:17:21.850206    2567 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 15 18:17:21.973762 ip-10-0-141-171 kubenswrapper[2567]: W0715 18:17:21.850208    2567 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 15 18:17:21.973762 ip-10-0-141-171 kubenswrapper[2567]: W0715 18:17:21.850211    2567 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 15 18:17:21.973762 ip-10-0-141-171 kubenswrapper[2567]: W0715 18:17:21.850214    2567 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 15 18:17:21.973762 ip-10-0-141-171 kubenswrapper[2567]: W0715 18:17:21.850217    2567 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 15 18:17:21.973762 ip-10-0-141-171 kubenswrapper[2567]: W0715 18:17:21.850220    2567 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 15 18:17:21.973762 ip-10-0-141-171 kubenswrapper[2567]: W0715 18:17:21.850222    2567 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 15 18:17:21.973762 ip-10-0-141-171 kubenswrapper[2567]: W0715 18:17:21.850225    2567 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 15 18:17:21.973762 ip-10-0-141-171 kubenswrapper[2567]: W0715 18:17:21.850228    2567 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 15 18:17:21.973762 ip-10-0-141-171 kubenswrapper[2567]: W0715 18:17:21.850231    2567 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 15 18:17:21.973762 ip-10-0-141-171 kubenswrapper[2567]: W0715 18:17:21.850233    2567 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 15 18:17:21.973762 ip-10-0-141-171 kubenswrapper[2567]: W0715 18:17:21.850236    2567 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 15 18:17:21.973762 ip-10-0-141-171 kubenswrapper[2567]: W0715 18:17:21.850239    2567 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 15 18:17:21.973762 ip-10-0-141-171 kubenswrapper[2567]: W0715 18:17:21.850242    2567 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 15 18:17:21.973762 ip-10-0-141-171 kubenswrapper[2567]: W0715 18:17:21.850244    2567 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 15 18:17:21.973762 ip-10-0-141-171 kubenswrapper[2567]: W0715 18:17:21.850247    2567 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 15 18:17:21.973762 ip-10-0-141-171 kubenswrapper[2567]: W0715 18:17:21.850250    2567 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 15 18:17:21.975165 ip-10-0-141-171 kubenswrapper[2567]: W0715 18:17:21.850254    2567 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 15 18:17:21.975165 ip-10-0-141-171 kubenswrapper[2567]: W0715 18:17:21.850257    2567 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 15 18:17:21.975165 ip-10-0-141-171 kubenswrapper[2567]: W0715 18:17:21.850259    2567 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 15 18:17:21.975165 ip-10-0-141-171 kubenswrapper[2567]: W0715 18:17:21.850262    2567 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 15 18:17:21.975165 ip-10-0-141-171 kubenswrapper[2567]: W0715 18:17:21.850265    2567 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 15 18:17:21.975165 ip-10-0-141-171 kubenswrapper[2567]: W0715 18:17:21.850269    2567 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 15 18:17:21.975165 ip-10-0-141-171 kubenswrapper[2567]: W0715 18:17:21.850272    2567 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 15 18:17:21.975165 ip-10-0-141-171 kubenswrapper[2567]: W0715 18:17:21.850275    2567 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 15 18:17:21.975165 ip-10-0-141-171 kubenswrapper[2567]: W0715 18:17:21.850277    2567 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 15 18:17:21.975165 ip-10-0-141-171 kubenswrapper[2567]: W0715 18:17:21.850280    2567 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 15 18:17:21.975165 ip-10-0-141-171 kubenswrapper[2567]: W0715 18:17:21.850284    2567 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 15 18:17:21.975165 ip-10-0-141-171 kubenswrapper[2567]: W0715 18:17:21.850286    2567 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 15 18:17:21.975165 ip-10-0-141-171 kubenswrapper[2567]: W0715 18:17:21.850289    2567 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 15 18:17:21.975165 ip-10-0-141-171 kubenswrapper[2567]: W0715 18:17:21.850292    2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 15 18:17:21.975165 ip-10-0-141-171 kubenswrapper[2567]: W0715 18:17:21.850295    2567 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 15 18:17:21.975165 ip-10-0-141-171 kubenswrapper[2567]: W0715 18:17:21.850299    2567 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 15 18:17:21.975165 ip-10-0-141-171 kubenswrapper[2567]: W0715 18:17:21.850302    2567 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 15 18:17:21.975165 ip-10-0-141-171 kubenswrapper[2567]: W0715 18:17:21.850319    2567 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 15 18:17:21.975165 ip-10-0-141-171 kubenswrapper[2567]: W0715 18:17:21.850322    2567 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 15 18:17:21.976113 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:17:21.850328    2567 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 15 18:17:21.976113 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:17:21.858728    2567 server.go:529] "Kubelet version" kubeletVersion="v1.34.9"
Jul 15 18:17:21.976113 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:17:21.858746    2567 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK=""
Jul 15 18:17:21.976113 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:17:21.858766    2567 watchdog_linux.go:95] "Systemd watchdog is not enabled"
Jul 15 18:17:21.976113 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:17:21.858773    2567 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started."
Jul 15 18:17:21.976113 ip-10-0-141-171 kubenswrapper[2567]: W0715 18:17:21.858843    2567 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 15 18:17:21.976113 ip-10-0-141-171 kubenswrapper[2567]: W0715 18:17:21.858849    2567 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 15 18:17:21.976113 ip-10-0-141-171 kubenswrapper[2567]: W0715 18:17:21.858853    2567 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 15 18:17:21.976113 ip-10-0-141-171 kubenswrapper[2567]: W0715 18:17:21.858856    2567 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 15 18:17:21.976113 ip-10-0-141-171 kubenswrapper[2567]: W0715 18:17:21.858859    2567 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 15 18:17:21.976113 ip-10-0-141-171 kubenswrapper[2567]: W0715 18:17:21.858861    2567 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 15 18:17:21.976113 ip-10-0-141-171 kubenswrapper[2567]: W0715 18:17:21.858865    2567 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 15 18:17:21.976113 ip-10-0-141-171 kubenswrapper[2567]: W0715 18:17:21.858868    2567 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 15 18:17:21.976113 ip-10-0-141-171 kubenswrapper[2567]: W0715 18:17:21.858871    2567 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 15 18:17:21.977302 ip-10-0-141-171 kubenswrapper[2567]: W0715 18:17:21.858874    2567 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 15 18:17:21.977302 ip-10-0-141-171 kubenswrapper[2567]: W0715 18:17:21.858877    2567 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 15 18:17:21.977302 ip-10-0-141-171 kubenswrapper[2567]: W0715 18:17:21.858880    2567 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 15 18:17:21.977302 ip-10-0-141-171 kubenswrapper[2567]: W0715 18:17:21.858884    2567 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 15 18:17:21.977302 ip-10-0-141-171 kubenswrapper[2567]: W0715 18:17:21.858887    2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 15 18:17:21.977302 ip-10-0-141-171 kubenswrapper[2567]: W0715 18:17:21.858891    2567 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 15 18:17:21.977302 ip-10-0-141-171 kubenswrapper[2567]: W0715 18:17:21.858894    2567 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 15 18:17:21.977302 ip-10-0-141-171 kubenswrapper[2567]: W0715 18:17:21.858896    2567 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 15 18:17:21.977302 ip-10-0-141-171 kubenswrapper[2567]: W0715 18:17:21.858900    2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 15 18:17:21.977302 ip-10-0-141-171 kubenswrapper[2567]: W0715 18:17:21.858904    2567 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 15 18:17:21.977302 ip-10-0-141-171 kubenswrapper[2567]: W0715 18:17:21.858907    2567 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 15 18:17:21.977302 ip-10-0-141-171 kubenswrapper[2567]: W0715 18:17:21.858910    2567 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 15 18:17:21.977302 ip-10-0-141-171 kubenswrapper[2567]: W0715 18:17:21.858913    2567 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 15 18:17:21.977302 ip-10-0-141-171 kubenswrapper[2567]: W0715 18:17:21.858916    2567 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 15 18:17:21.977302 ip-10-0-141-171 kubenswrapper[2567]: W0715 18:17:21.858919    2567 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 15 18:17:21.977302 ip-10-0-141-171 kubenswrapper[2567]: W0715 18:17:21.858922    2567 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 15 18:17:21.977302 ip-10-0-141-171 kubenswrapper[2567]: W0715 18:17:21.858925    2567 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 15 18:17:21.977302 ip-10-0-141-171 kubenswrapper[2567]: W0715 18:17:21.858927    2567 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 15 18:17:21.977302 ip-10-0-141-171 kubenswrapper[2567]: W0715 18:17:21.858930    2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 15 18:17:21.977302 ip-10-0-141-171 kubenswrapper[2567]: W0715 18:17:21.858933    2567 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 15 18:17:21.978274 ip-10-0-141-171 kubenswrapper[2567]: W0715 18:17:21.858936    2567 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 15 18:17:21.978274 ip-10-0-141-171 kubenswrapper[2567]: W0715 18:17:21.858938    2567 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 15 18:17:21.978274 ip-10-0-141-171 kubenswrapper[2567]: W0715 18:17:21.858941    2567 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 15 18:17:21.978274 ip-10-0-141-171 kubenswrapper[2567]: W0715 18:17:21.858945    2567 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 15 18:17:21.978274 ip-10-0-141-171 kubenswrapper[2567]: W0715 18:17:21.858948    2567 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 15 18:17:21.978274 ip-10-0-141-171 kubenswrapper[2567]: W0715 18:17:21.858950    2567 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 15 18:17:21.978274 ip-10-0-141-171 kubenswrapper[2567]: W0715 18:17:21.858953    2567 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 15 18:17:21.978274 ip-10-0-141-171 kubenswrapper[2567]: W0715 18:17:21.858956    2567 feature_gate.go:328] unrecognized feature gate: Example
Jul 15 18:17:21.978274 ip-10-0-141-171 kubenswrapper[2567]: W0715 18:17:21.858959    2567 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 15 18:17:21.978274 ip-10-0-141-171 kubenswrapper[2567]: W0715 18:17:21.858961    2567 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 15 18:17:21.978274 ip-10-0-141-171 kubenswrapper[2567]: W0715 18:17:21.858964    2567 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 15 18:17:21.978274 ip-10-0-141-171 kubenswrapper[2567]: W0715 18:17:21.858967    2567 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 15 18:17:21.978274 ip-10-0-141-171 kubenswrapper[2567]: W0715 18:17:21.858969    2567 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 15 18:17:21.978274 ip-10-0-141-171 kubenswrapper[2567]: W0715 18:17:21.858972    2567 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 15 18:17:21.978274 ip-10-0-141-171 kubenswrapper[2567]: W0715 18:17:21.858975    2567 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 15 18:17:21.978274 ip-10-0-141-171 kubenswrapper[2567]: W0715 18:17:21.858978    2567 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 15 18:17:21.978274 ip-10-0-141-171 kubenswrapper[2567]: W0715 18:17:21.858982    2567 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 15 18:17:21.978274 ip-10-0-141-171 kubenswrapper[2567]: W0715 18:17:21.858985    2567 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 15 18:17:21.978274 ip-10-0-141-171 kubenswrapper[2567]: W0715 18:17:21.858988    2567 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 15 18:17:21.978274 ip-10-0-141-171 kubenswrapper[2567]: W0715 18:17:21.858991    2567 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 15 18:17:21.979901 ip-10-0-141-171 kubenswrapper[2567]: W0715 18:17:21.858994    2567 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 15 18:17:21.979901 ip-10-0-141-171 kubenswrapper[2567]: W0715 18:17:21.858997    2567 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 15 18:17:21.979901 ip-10-0-141-171 kubenswrapper[2567]: W0715 18:17:21.859000    2567 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 15 18:17:21.979901 ip-10-0-141-171 kubenswrapper[2567]: W0715 18:17:21.859002    2567 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 15 18:17:21.979901 ip-10-0-141-171 kubenswrapper[2567]: W0715 18:17:21.859005    2567 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 15 18:17:21.979901 ip-10-0-141-171 kubenswrapper[2567]: W0715 18:17:21.859008    2567 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 15 18:17:21.979901 ip-10-0-141-171 kubenswrapper[2567]: W0715 18:17:21.859011    2567 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 15 18:17:21.979901 ip-10-0-141-171 kubenswrapper[2567]: W0715 18:17:21.859014    2567 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 15 18:17:21.979901 ip-10-0-141-171 kubenswrapper[2567]: W0715 18:17:21.859017    2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 15 18:17:21.979901 ip-10-0-141-171 kubenswrapper[2567]: W0715 18:17:21.859019    2567 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 15 18:17:21.979901 ip-10-0-141-171 kubenswrapper[2567]: W0715 18:17:21.859024    2567 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 15 18:17:21.979901 ip-10-0-141-171 kubenswrapper[2567]: W0715 18:17:21.859027    2567 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 15 18:17:21.979901 ip-10-0-141-171 kubenswrapper[2567]: W0715 18:17:21.859031    2567 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 15 18:17:21.979901 ip-10-0-141-171 kubenswrapper[2567]: W0715 18:17:21.859034    2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 15 18:17:21.979901 ip-10-0-141-171 kubenswrapper[2567]: W0715 18:17:21.859037    2567 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 15 18:17:21.979901 ip-10-0-141-171 kubenswrapper[2567]: W0715 18:17:21.859040    2567 feature_gate.go:328] unrecognized feature gate: Example2
Jul 15 18:17:21.979901 ip-10-0-141-171 kubenswrapper[2567]: W0715 18:17:21.859043    2567 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 15 18:17:21.979901 ip-10-0-141-171 kubenswrapper[2567]: W0715 18:17:21.859046    2567 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 15 18:17:21.979901 ip-10-0-141-171 kubenswrapper[2567]: W0715 18:17:21.859048    2567 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 15 18:17:21.980832 ip-10-0-141-171 kubenswrapper[2567]: W0715 18:17:21.859051    2567 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 15 18:17:21.980832 ip-10-0-141-171 kubenswrapper[2567]: W0715 18:17:21.859054    2567 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 15 18:17:21.980832 ip-10-0-141-171 kubenswrapper[2567]: W0715 18:17:21.859056    2567 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 15 18:17:21.980832 ip-10-0-141-171 kubenswrapper[2567]: W0715 18:17:21.859059    2567 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 15 18:17:21.980832 ip-10-0-141-171 kubenswrapper[2567]: W0715 18:17:21.859062    2567 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 15 18:17:21.980832 ip-10-0-141-171 kubenswrapper[2567]: W0715 18:17:21.859064    2567 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 15 18:17:21.980832 ip-10-0-141-171 kubenswrapper[2567]: W0715 18:17:21.859067    2567 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 15 18:17:21.980832 ip-10-0-141-171 kubenswrapper[2567]: W0715 18:17:21.859070    2567 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 15 18:17:21.980832 ip-10-0-141-171 kubenswrapper[2567]: W0715 18:17:21.859074    2567 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 15 18:17:21.980832 ip-10-0-141-171 kubenswrapper[2567]: W0715 18:17:21.859079    2567 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 15 18:17:21.980832 ip-10-0-141-171 kubenswrapper[2567]: W0715 18:17:21.859083    2567 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 15 18:17:21.980832 ip-10-0-141-171 kubenswrapper[2567]: W0715 18:17:21.859086    2567 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 15 18:17:21.980832 ip-10-0-141-171 kubenswrapper[2567]: W0715 18:17:21.859089    2567 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 15 18:17:21.980832 ip-10-0-141-171 kubenswrapper[2567]: W0715 18:17:21.859092    2567 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 15 18:17:21.980832 ip-10-0-141-171 kubenswrapper[2567]: W0715 18:17:21.859095    2567 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 15 18:17:21.980832 ip-10-0-141-171 kubenswrapper[2567]: W0715 18:17:21.859098    2567 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 15 18:17:21.980832 ip-10-0-141-171 kubenswrapper[2567]: W0715 18:17:21.859101    2567 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 15 18:17:21.980832 ip-10-0-141-171 kubenswrapper[2567]: W0715 18:17:21.859104    2567 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 15 18:17:21.980832 ip-10-0-141-171 kubenswrapper[2567]: W0715 18:17:21.859107    2567 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 15 18:17:21.980832 ip-10-0-141-171 kubenswrapper[2567]: W0715 18:17:21.859110    2567 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 15 18:17:21.982914 ip-10-0-141-171 kubenswrapper[2567]: W0715 18:17:21.859112    2567 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 15 18:17:21.982914 ip-10-0-141-171 kubenswrapper[2567]: W0715 18:17:21.859115    2567 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 15 18:17:21.982914 ip-10-0-141-171 kubenswrapper[2567]: W0715 18:17:21.859118    2567 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 15 18:17:21.982914 ip-10-0-141-171 kubenswrapper[2567]: W0715 18:17:21.859121    2567 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 15 18:17:21.982914 ip-10-0-141-171 kubenswrapper[2567]: W0715 18:17:21.859124    2567 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 15 18:17:21.982914 ip-10-0-141-171 kubenswrapper[2567]: W0715 18:17:21.859126    2567 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 15 18:17:21.982914 ip-10-0-141-171 kubenswrapper[2567]: W0715 18:17:21.859129    2567 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 15 18:17:21.982914 ip-10-0-141-171 kubenswrapper[2567]: W0715 18:17:21.859133    2567 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 15 18:17:21.982914 ip-10-0-141-171 kubenswrapper[2567]: W0715 18:17:21.859137    2567 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 15 18:17:21.982914 ip-10-0-141-171 kubenswrapper[2567]: W0715 18:17:21.859140    2567 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 15 18:17:21.982914 ip-10-0-141-171 kubenswrapper[2567]: W0715 18:17:21.859143    2567 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 15 18:17:21.982914 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:17:21.859148    2567 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 15 18:17:21.982914 ip-10-0-141-171 kubenswrapper[2567]: W0715 18:17:21.859289    2567 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 15 18:17:21.982914 ip-10-0-141-171 kubenswrapper[2567]: W0715 18:17:21.859294    2567 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 15 18:17:21.983588 ip-10-0-141-171 kubenswrapper[2567]: W0715 18:17:21.859298    2567 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 15 18:17:21.983588 ip-10-0-141-171 kubenswrapper[2567]: W0715 18:17:21.859301    2567 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 15 18:17:21.983588 ip-10-0-141-171 kubenswrapper[2567]: W0715 18:17:21.859318    2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 15 18:17:21.983588 ip-10-0-141-171 kubenswrapper[2567]: W0715 18:17:21.859322    2567 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 15 18:17:21.983588 ip-10-0-141-171 kubenswrapper[2567]: W0715 18:17:21.859325    2567 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 15 18:17:21.983588 ip-10-0-141-171 kubenswrapper[2567]: W0715 18:17:21.859328    2567 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 15 18:17:21.983588 ip-10-0-141-171 kubenswrapper[2567]: W0715 18:17:21.859331    2567 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 15 18:17:21.983588 ip-10-0-141-171 kubenswrapper[2567]: W0715 18:17:21.859334    2567 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 15 18:17:21.983588 ip-10-0-141-171 kubenswrapper[2567]: W0715 18:17:21.859338    2567 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 15 18:17:21.983588 ip-10-0-141-171 kubenswrapper[2567]: W0715 18:17:21.859341    2567 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 15 18:17:21.983588 ip-10-0-141-171 kubenswrapper[2567]: W0715 18:17:21.859345    2567 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 15 18:17:21.983588 ip-10-0-141-171 kubenswrapper[2567]: W0715 18:17:21.859351    2567 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 15 18:17:21.983588 ip-10-0-141-171 kubenswrapper[2567]: W0715 18:17:21.859354    2567 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 15 18:17:21.983588 ip-10-0-141-171 kubenswrapper[2567]: W0715 18:17:21.859357    2567 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 15 18:17:21.983588 ip-10-0-141-171 kubenswrapper[2567]: W0715 18:17:21.859359    2567 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 15 18:17:21.983588 ip-10-0-141-171 kubenswrapper[2567]: W0715 18:17:21.859362    2567 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 15 18:17:21.983588 ip-10-0-141-171 kubenswrapper[2567]: W0715 18:17:21.859365    2567 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 15 18:17:21.983588 ip-10-0-141-171 kubenswrapper[2567]: W0715 18:17:21.859368    2567 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 15 18:17:21.983588 ip-10-0-141-171 kubenswrapper[2567]: W0715 18:17:21.859371    2567 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 15 18:17:21.983588 ip-10-0-141-171 kubenswrapper[2567]: W0715 18:17:21.859374    2567 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 15 18:17:21.984519 ip-10-0-141-171 kubenswrapper[2567]: W0715 18:17:21.859377    2567 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 15 18:17:21.984519 ip-10-0-141-171 kubenswrapper[2567]: W0715 18:17:21.859379    2567 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 15 18:17:21.984519 ip-10-0-141-171 kubenswrapper[2567]: W0715 18:17:21.859382    2567 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 15 18:17:21.984519 ip-10-0-141-171 kubenswrapper[2567]: W0715 18:17:21.859385    2567 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 15 18:17:21.984519 ip-10-0-141-171 kubenswrapper[2567]: W0715 18:17:21.859388    2567 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 15 18:17:21.984519 ip-10-0-141-171 kubenswrapper[2567]: W0715 18:17:21.859390    2567 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 15 18:17:21.984519 ip-10-0-141-171 kubenswrapper[2567]: W0715 18:17:21.859394    2567 feature_gate.go:328] unrecognized feature gate: Example
Jul 15 18:17:21.984519 ip-10-0-141-171 kubenswrapper[2567]: W0715 18:17:21.859396    2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 15 18:17:21.984519 ip-10-0-141-171 kubenswrapper[2567]: W0715 18:17:21.859401    2567 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 15 18:17:21.984519 ip-10-0-141-171 kubenswrapper[2567]: W0715 18:17:21.859405    2567 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 15 18:17:21.984519 ip-10-0-141-171 kubenswrapper[2567]: W0715 18:17:21.859407    2567 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 15 18:17:21.984519 ip-10-0-141-171 kubenswrapper[2567]: W0715 18:17:21.859411    2567 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 15 18:17:21.984519 ip-10-0-141-171 kubenswrapper[2567]: W0715 18:17:21.859415    2567 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 15 18:17:21.984519 ip-10-0-141-171 kubenswrapper[2567]: W0715 18:17:21.859417    2567 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 15 18:17:21.984519 ip-10-0-141-171 kubenswrapper[2567]: W0715 18:17:21.859420    2567 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 15 18:17:21.984519 ip-10-0-141-171 kubenswrapper[2567]: W0715 18:17:21.859423    2567 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 15 18:17:21.984519 ip-10-0-141-171 kubenswrapper[2567]: W0715 18:17:21.859426    2567 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 15 18:17:21.984519 ip-10-0-141-171 kubenswrapper[2567]: W0715 18:17:21.859429    2567 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 15 18:17:21.984519 ip-10-0-141-171 kubenswrapper[2567]: W0715 18:17:21.859432    2567 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 15 18:17:21.985472 ip-10-0-141-171 kubenswrapper[2567]: W0715 18:17:21.859435    2567 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 15 18:17:21.985472 ip-10-0-141-171 kubenswrapper[2567]: W0715 18:17:21.859438    2567 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 15 18:17:21.985472 ip-10-0-141-171 kubenswrapper[2567]: W0715 18:17:21.859441    2567 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 15 18:17:21.985472 ip-10-0-141-171 kubenswrapper[2567]: W0715 18:17:21.859444    2567 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 15 18:17:21.985472 ip-10-0-141-171 kubenswrapper[2567]: W0715 18:17:21.859449    2567 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 15 18:17:21.985472 ip-10-0-141-171 kubenswrapper[2567]: W0715 18:17:21.859453    2567 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 15 18:17:21.985472 ip-10-0-141-171 kubenswrapper[2567]: W0715 18:17:21.859458    2567 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 15 18:17:21.985472 ip-10-0-141-171 kubenswrapper[2567]: W0715 18:17:21.859461    2567 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 15 18:17:21.985472 ip-10-0-141-171 kubenswrapper[2567]: W0715 18:17:21.859464    2567 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 15 18:17:21.985472 ip-10-0-141-171 kubenswrapper[2567]: W0715 18:17:21.859468    2567 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 15 18:17:21.985472 ip-10-0-141-171 kubenswrapper[2567]: W0715 18:17:21.859471    2567 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 15 18:17:21.985472 ip-10-0-141-171 kubenswrapper[2567]: W0715 18:17:21.859473    2567 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 15 18:17:21.985472 ip-10-0-141-171 kubenswrapper[2567]: W0715 18:17:21.859476    2567 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 15 18:17:21.985472 ip-10-0-141-171 kubenswrapper[2567]: W0715 18:17:21.859479    2567 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 15 18:17:21.985472 ip-10-0-141-171 kubenswrapper[2567]: W0715 18:17:21.859482    2567 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 15 18:17:21.985472 ip-10-0-141-171 kubenswrapper[2567]: W0715 18:17:21.859484    2567 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 15 18:17:21.985472 ip-10-0-141-171 kubenswrapper[2567]: W0715 18:17:21.859487    2567 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 15 18:17:21.985472 ip-10-0-141-171 kubenswrapper[2567]: W0715 18:17:21.859490    2567 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 15 18:17:21.985472 ip-10-0-141-171 kubenswrapper[2567]: W0715 18:17:21.859493    2567 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 15 18:17:21.987094 ip-10-0-141-171 kubenswrapper[2567]: W0715 18:17:21.859495    2567 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 15 18:17:21.987094 ip-10-0-141-171 kubenswrapper[2567]: W0715 18:17:21.859498    2567 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 15 18:17:21.987094 ip-10-0-141-171 kubenswrapper[2567]: W0715 18:17:21.859503    2567 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 15 18:17:21.987094 ip-10-0-141-171 kubenswrapper[2567]: W0715 18:17:21.859506    2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 15 18:17:21.987094 ip-10-0-141-171 kubenswrapper[2567]: W0715 18:17:21.859508    2567 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 15 18:17:21.987094 ip-10-0-141-171 kubenswrapper[2567]: W0715 18:17:21.859511    2567 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 15 18:17:21.987094 ip-10-0-141-171 kubenswrapper[2567]: W0715 18:17:21.859514    2567 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 15 18:17:21.987094 ip-10-0-141-171 kubenswrapper[2567]: W0715 18:17:21.859517    2567 feature_gate.go:328] unrecognized feature gate: Example2
Jul 15 18:17:21.987094 ip-10-0-141-171 kubenswrapper[2567]: W0715 18:17:21.859519    2567 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 15 18:17:21.987094 ip-10-0-141-171 kubenswrapper[2567]: W0715 18:17:21.859522    2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 15 18:17:21.987094 ip-10-0-141-171 kubenswrapper[2567]: W0715 18:17:21.859525    2567 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 15 18:17:21.987094 ip-10-0-141-171 kubenswrapper[2567]: W0715 18:17:21.859528    2567 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 15 18:17:21.987094 ip-10-0-141-171 kubenswrapper[2567]: W0715 18:17:21.859530    2567 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 15 18:17:21.987094 ip-10-0-141-171 kubenswrapper[2567]: W0715 18:17:21.859534    2567 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 15 18:17:21.987094 ip-10-0-141-171 kubenswrapper[2567]: W0715 18:17:21.859537    2567 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 15 18:17:21.987094 ip-10-0-141-171 kubenswrapper[2567]: W0715 18:17:21.859540    2567 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 15 18:17:21.987094 ip-10-0-141-171 kubenswrapper[2567]: W0715 18:17:21.859548    2567 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 15 18:17:21.987094 ip-10-0-141-171 kubenswrapper[2567]: W0715 18:17:21.859553    2567 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 15 18:17:21.987094 ip-10-0-141-171 kubenswrapper[2567]: W0715 18:17:21.859556    2567 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 15 18:17:21.987094 ip-10-0-141-171 kubenswrapper[2567]: W0715 18:17:21.859559    2567 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 15 18:17:21.988022 ip-10-0-141-171 kubenswrapper[2567]: W0715 18:17:21.859561    2567 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 15 18:17:21.988022 ip-10-0-141-171 kubenswrapper[2567]: W0715 18:17:21.859564    2567 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 15 18:17:21.988022 ip-10-0-141-171 kubenswrapper[2567]: W0715 18:17:21.859567    2567 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 15 18:17:21.988022 ip-10-0-141-171 kubenswrapper[2567]: W0715 18:17:21.859569    2567 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 15 18:17:21.988022 ip-10-0-141-171 kubenswrapper[2567]: W0715 18:17:21.859572    2567 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 15 18:17:21.988022 ip-10-0-141-171 kubenswrapper[2567]: W0715 18:17:21.859575    2567 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 15 18:17:21.988022 ip-10-0-141-171 kubenswrapper[2567]: W0715 18:17:21.859577    2567 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 15 18:17:21.988022 ip-10-0-141-171 kubenswrapper[2567]: W0715 18:17:21.859580    2567 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 15 18:17:21.988022 ip-10-0-141-171 kubenswrapper[2567]: W0715 18:17:21.859583    2567 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 15 18:17:21.988022 ip-10-0-141-171 kubenswrapper[2567]: W0715 18:17:21.859586    2567 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 15 18:17:21.988022 ip-10-0-141-171 kubenswrapper[2567]: W0715 18:17:21.859588    2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 15 18:17:21.988022 ip-10-0-141-171 kubenswrapper[2567]: W0715 18:17:21.859591    2567 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 15 18:17:21.988022 ip-10-0-141-171 kubenswrapper[2567]: W0715 18:17:21.859594    2567 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 15 18:17:21.988022 ip-10-0-141-171 kubenswrapper[2567]: W0715 18:17:21.859597    2567 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 15 18:17:21.988022 ip-10-0-141-171 kubenswrapper[2567]: W0715 18:17:21.859602    2567 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 15 18:17:21.988022 ip-10-0-141-171 kubenswrapper[2567]: W0715 18:17:21.859605    2567 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 15 18:17:21.988022 ip-10-0-141-171 kubenswrapper[2567]: W0715 18:17:21.859608    2567 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 15 18:17:21.988022 ip-10-0-141-171 kubenswrapper[2567]: W0715 18:17:21.859610    2567 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 15 18:17:21.988022 ip-10-0-141-171 kubenswrapper[2567]: W0715 18:17:21.859613    2567 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 15 18:17:22.151367 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:17:21.859619    2567 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 15 18:17:22.151367 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:17:21.859728    2567 server.go:962] "Client rotation is on, will bootstrap in background"
Jul 15 18:17:22.151367 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:17:21.861824    2567 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir"
Jul 15 18:17:22.151367 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:17:21.863737    2567 server.go:1019] "Starting client certificate rotation"
Jul 15 18:17:22.151367 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:17:21.863843    2567 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet"
Jul 15 18:17:22.151367 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:17:21.863876    2567 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet"
Jul 15 18:17:22.151367 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:17:21.866804    2567 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Jul 15 18:17:22.151367 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:17:21.876105    2567 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Jul 15 18:17:22.151367 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:17:21.888471    2567 log.go:25] "Validated CRI v1 runtime API"
Jul 15 18:17:22.151367 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:17:21.893499    2567 log.go:25] "Validated CRI v1 image API"
Jul 15 18:17:22.151367 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:17:21.894318    2567 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd"
Jul 15 18:17:22.151367 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:17:21.898324    2567 fs.go:135] Filesystem UUIDs: map[7B77-95E7:/dev/nvme0n1p2 8c0b5109-996d-42ff-ba4e-2f3a77ee8920:/dev/nvme0n1p3 ba1c6494-6ba2-4a99-994b-9e2b8d72ea1c:/dev/nvme0n1p4]
Jul 15 18:17:22.176465 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:17:21.898340    2567 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}]
Jul 15 18:17:22.176465 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:17:21.904473    2567 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Jul 15 18:17:22.177049 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:17:21.904463    2567 manager.go:216] Machine: {Timestamp:2026-07-15 18:17:21.90304188 +0000 UTC m=+0.437465231 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3101021 MemoryCapacity:33164496896 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec21531f0a635a5ce8fd9ecda31879b5 SystemUUID:ec21531f-0a63-5a5c-e8fd-9ecda31879b5 BootID:021bcb9e-3e2d-4c0e-81f2-b727dd754faf Filesystems:[{Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582246400 Type:vfs Inodes:4048400 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632902656 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6107136 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582250496 Type:vfs Inodes:1048576 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:fc:2d:36:9e:cf Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:fc:2d:36:9e:cf Speed:0 Mtu:9001} {Name:ovs-system MacAddress:46:28:1d:bc:ca:fb Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164496896 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None}
Jul 15 18:17:22.177049 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:17:21.908645    2567 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available.
Jul 15 18:17:22.177049 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:17:21.908736    2567 manager.go:232] Version: {KernelVersion:5.14.0-570.126.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260702-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:}
Jul 15 18:17:22.177049 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:17:21.912580    2567 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[]
Jul 15 18:17:22.177049 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:17:21.912607    2567 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-141-171.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2}
Jul 15 18:17:22.177049 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:17:21.913832    2567 topology_manager.go:138] "Creating topology manager with none policy"
Jul 15 18:17:22.177049 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:17:21.913843    2567 container_manager_linux.go:309] "Creating device plugin manager"
Jul 15 18:17:22.177049 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:17:21.913851    2567 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock"
Jul 15 18:17:22.177049 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:17:21.913862    2567 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock"
Jul 15 18:17:22.177049 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:17:21.915197    2567 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager"
Jul 15 18:17:22.177049 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:17:21.919324    2567 state_mem.go:36] "Initialized new in-memory state store"
Jul 15 18:17:22.177049 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:17:21.919462    2567 server.go:1240] "Using root directory" path="/var/lib/kubelet"
Jul 15 18:17:22.177049 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:17:21.919498    2567 kubelet.go:486] "Attempting to sync node with API server"
Jul 15 18:17:22.177049 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:17:21.919523    2567 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests"
Jul 15 18:17:22.177049 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:17:21.919543    2567 file.go:69] "Watching path" path="/etc/kubernetes/manifests"
Jul 15 18:17:22.177049 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:17:21.919557    2567 kubelet.go:398] "Adding apiserver pod source"
Jul 15 18:17:22.177049 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:17:21.919576    2567 apiserver.go:42] "Waiting for node sync before watching apiserver pods"
Jul 15 18:17:22.177049 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:17:21.920024    2567 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Jul 15 18:17:22.177939 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:17:21.920040    2567 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Jul 15 18:17:22.177939 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:17:21.924785    2567 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-xtmcx"
Jul 15 18:17:22.177939 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:17:21.927640    2567 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.10-2.rhaos4.21.git83ee25b.el9" apiVersion="v1"
Jul 15 18:17:22.177939 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:17:21.929571    2567 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled"
Jul 15 18:17:22.177939 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:17:21.929637    2567 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled"
Jul 15 18:17:22.177939 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:17:21.929888    2567 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume"
Jul 15 18:17:22.177939 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:17:21.929910    2567 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir"
Jul 15 18:17:22.177939 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:17:21.929923    2567 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo"
Jul 15 18:17:22.177939 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:17:21.929934    2567 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path"
Jul 15 18:17:22.177939 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:17:21.929946    2567 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs"
Jul 15 18:17:22.177939 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:17:21.929954    2567 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret"
Jul 15 18:17:22.177939 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:17:21.930429    2567 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi"
Jul 15 18:17:22.177939 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:17:21.930439    2567 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api"
Jul 15 18:17:22.177939 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:17:21.930449    2567 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc"
Jul 15 18:17:22.177939 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:17:21.930455    2567 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap"
Jul 15 18:17:22.177939 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:17:21.930464    2567 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected"
Jul 15 18:17:22.177939 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:17:21.930472    2567 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume"
Jul 15 18:17:22.177939 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:17:21.931453    2567 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi"
Jul 15 18:17:22.177939 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:17:21.931461    2567 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image"
Jul 15 18:17:22.177939 ip-10-0-141-171 kubenswrapper[2567]: E0715 18:17:21.932190    2567 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service"
Jul 15 18:17:22.177939 ip-10-0-141-171 kubenswrapper[2567]: E0715 18:17:21.932206    2567 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-141-171.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node"
Jul 15 18:17:22.177939 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:17:21.932541    2567 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-xtmcx"
Jul 15 18:17:22.177939 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:17:21.935111    2567 server.go:1268] "Started kubelet"
Jul 15 18:17:22.177939 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:17:21.935215    2567 server.go:180] "Starting to listen" address="0.0.0.0" port=10250
Jul 15 18:17:22.177939 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:17:21.935344    2567 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10
Jul 15 18:17:22.177939 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:17:21.938694    2567 server_v1.go:49] "podresources" method="list" useActivePods=true
Jul 15 18:17:22.177939 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:17:21.945461    2567 server.go:310] "Adding debug handlers to kubelet server"
Jul 15 18:17:22.177939 ip-10-0-141-171 kubenswrapper[2567]: E0715 18:17:21.947127    2567 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache"
Jul 15 18:17:22.177939 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:17:21.953577    2567 nodeinfomanager.go:417] Failed to publish CSINode: nodes "ip-10-0-141-171.ec2.internal" not found
Jul 15 18:17:22.177939 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:17:21.971518    2567 nodeinfomanager.go:417] Failed to publish CSINode: nodes "ip-10-0-141-171.ec2.internal" not found
Jul 15 18:17:22.177939 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:17:21.992986    2567 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock"
Jul 15 18:17:22.177939 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:17:21.998569    2567 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer"
Jul 15 18:17:22.177939 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:17:21.998588    2567 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving"
Jul 15 18:17:22.177939 ip-10-0-141-171 kubenswrapper[2567]: E0715 18:17:21.998650    2567 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-171.ec2.internal\" not found"
Jul 15 18:17:22.177939 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:17:21.999229    2567 volume_manager.go:311] "The desired_state_of_world populator starts"
Jul 15 18:17:22.177939 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:17:21.999238    2567 desired_state_of_world_populator.go:146] "Desired state populator starts to run"
Jul 15 18:17:22.177939 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:17:21.999249    2567 volume_manager.go:313] "Starting Kubelet Volume Manager"
Jul 15 18:17:22.177939 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:17:21.999355    2567 reconstruct.go:97] "Volume reconstruction finished"
Jul 15 18:17:22.177939 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:17:21.999367    2567 reconciler.go:29] "Reconciler: start to sync state"
Jul 15 18:17:22.177939 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:17:21.999513    2567 factory.go:55] Registering systemd factory
Jul 15 18:17:22.177939 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:17:21.999529    2567 factory.go:223] Registration of the systemd container factory successfully
Jul 15 18:17:22.177939 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:17:21.999764    2567 factory.go:153] Registering CRI-O factory
Jul 15 18:17:22.177939 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:17:21.999777    2567 factory.go:223] Registration of the crio container factory successfully
Jul 15 18:17:22.177939 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:17:21.999836    2567 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory
Jul 15 18:17:22.177939 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:17:21.999883    2567 factory.go:103] Registering Raw factory
Jul 15 18:17:22.177939 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:17:21.999901    2567 manager.go:1196] Started watching for new ooms in manager
Jul 15 18:17:22.177939 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:17:22.000511    2567 manager.go:349] Starting recovery of all containers
Jul 15 18:17:22.177939 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:17:22.001167    2567 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 15 18:17:22.179570 ip-10-0-141-171 kubenswrapper[2567]: E0715 18:17:22.003833    2567 nodelease.go:49] "Failed to get node when trying to set owner ref to the node lease" err="nodes \"ip-10-0-141-171.ec2.internal\" not found" node="ip-10-0-141-171.ec2.internal"
Jul 15 18:17:22.179570 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:17:22.011547    2567 manager.go:354] Recovery completed
Jul 15 18:17:22.179570 ip-10-0-141-171 kubenswrapper[2567]: E0715 18:17:22.013198    2567 watcher.go:152] Failed to watch directory "/sys/fs/cgroup/system.slice/systemd-update-utmp-runlevel.service": inotify_add_watch /sys/fs/cgroup/system.slice/systemd-update-utmp-runlevel.service: no such file or directory
Jul 15 18:17:22.179570 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:17:22.017339    2567 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 15 18:17:22.179570 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:17:22.020151    2567 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-171.ec2.internal" event="NodeHasSufficientMemory"
Jul 15 18:17:22.179570 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:17:22.020178    2567 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-171.ec2.internal" event="NodeHasNoDiskPressure"
Jul 15 18:17:22.179570 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:17:22.020193    2567 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-171.ec2.internal" event="NodeHasSufficientPID"
Jul 15 18:17:22.179570 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:17:22.020774    2567 cpu_manager.go:222] "Starting CPU manager" policy="none"
Jul 15 18:17:22.179570 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:17:22.020785    2567 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s"
Jul 15 18:17:22.179570 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:17:22.020804    2567 state_mem.go:36] "Initialized new in-memory state store"
Jul 15 18:17:22.179570 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:17:22.021935    2567 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 15 18:17:22.179570 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:17:22.022740    2567 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-171.ec2.internal" event="NodeHasSufficientMemory"
Jul 15 18:17:22.179570 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:17:22.022762    2567 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-171.ec2.internal" event="NodeHasNoDiskPressure"
Jul 15 18:17:22.179570 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:17:22.022773    2567 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-171.ec2.internal" event="NodeHasSufficientPID"
Jul 15 18:17:22.179570 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:17:22.023225    2567 policy_none.go:49] "None policy: Start"
Jul 15 18:17:22.179570 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:17:22.023239    2567 memory_manager.go:187] "Starting memorymanager" policy="None"
Jul 15 18:17:22.179570 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:17:22.023249    2567 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint"
Jul 15 18:17:22.179570 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:17:22.025413    2567 policy_none.go:47] "Start"
Jul 15 18:17:22.179570 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:17:22.029706    2567 nodeinfomanager.go:417] Failed to publish CSINode: nodes "ip-10-0-141-171.ec2.internal" not found
Jul 15 18:17:22.179570 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:17:22.059870    2567 manager.go:337] "Starting Device Plugin manager"
Jul 15 18:17:22.179570 ip-10-0-141-171 kubenswrapper[2567]: E0715 18:17:22.059901    2567 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint"
Jul 15 18:17:22.179570 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:17:22.059910    2567 server.go:87] "Starting device plugin registration server"
Jul 15 18:17:22.179570 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:17:22.060128    2567 eviction_manager.go:189] "Eviction manager: starting control loop"
Jul 15 18:17:22.179570 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:17:22.060140    2567 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s"
Jul 15 18:17:22.179570 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:17:22.060219    2567 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry"
Jul 15 18:17:22.179570 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:17:22.060280    2567 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts"
Jul 15 18:17:22.179570 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:17:22.060287    2567 plugin_manager.go:118] "Starting Kubelet Plugin Manager"
Jul 15 18:17:22.179570 ip-10-0-141-171 kubenswrapper[2567]: E0715 18:17:22.060889    2567 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\""
Jul 15 18:17:22.179570 ip-10-0-141-171 kubenswrapper[2567]: E0715 18:17:22.060938    2567 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-141-171.ec2.internal\" not found"
Jul 15 18:17:22.179570 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:17:22.160532    2567 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 15 18:17:22.179570 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:17:22.161610    2567 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-171.ec2.internal" event="NodeHasSufficientMemory"
Jul 15 18:17:22.179570 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:17:22.161641    2567 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-171.ec2.internal" event="NodeHasNoDiskPressure"
Jul 15 18:17:22.179570 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:17:22.161653    2567 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-171.ec2.internal" event="NodeHasSufficientPID"
Jul 15 18:17:22.179570 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:17:22.161680    2567 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-141-171.ec2.internal"
Jul 15 18:17:22.179570 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:17:22.169193    2567 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-141-171.ec2.internal"
Jul 15 18:17:22.179570 ip-10-0-141-171 kubenswrapper[2567]: E0715 18:17:22.169215    2567 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-141-171.ec2.internal\": node \"ip-10-0-141-171.ec2.internal\" not found"
Jul 15 18:17:22.185183 ip-10-0-141-171 kubenswrapper[2567]: E0715 18:17:22.184671    2567 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-171.ec2.internal\" not found"
Jul 15 18:17:22.391710 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:17:22.197970    2567 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4"
Jul 15 18:17:22.391710 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:17:22.199505    2567 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6"
Jul 15 18:17:22.391710 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:17:22.199569    2567 status_manager.go:244] "Starting to sync pod status with apiserver"
Jul 15 18:17:22.391710 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:17:22.199596    2567 kubelet.go:2448] "Starting kubelet main sync loop"
Jul 15 18:17:22.391710 ip-10-0-141-171 kubenswrapper[2567]: E0715 18:17:22.199638    2567 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful"
Jul 15 18:17:22.391710 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:17:22.205129    2567 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 15 18:17:22.391710 ip-10-0-141-171 kubenswrapper[2567]: E0715 18:17:22.284871    2567 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-171.ec2.internal\" not found"
Jul 15 18:17:22.391710 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:17:22.299674    2567 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-171.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-141-171.ec2.internal"]
Jul 15 18:17:22.391710 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:17:22.299740    2567 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 15 18:17:22.391710 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:17:22.303203    2567 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-171.ec2.internal" event="NodeHasSufficientMemory"
Jul 15 18:17:22.391710 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:17:22.303230    2567 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-171.ec2.internal" event="NodeHasNoDiskPressure"
Jul 15 18:17:22.391710 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:17:22.303260    2567 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-171.ec2.internal" event="NodeHasSufficientPID"
Jul 15 18:17:22.391710 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:17:22.305554    2567 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 15 18:17:22.391710 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:17:22.305707    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-171.ec2.internal"
Jul 15 18:17:22.391710 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:17:22.305735    2567 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 15 18:17:22.391710 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:17:22.309314    2567 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-171.ec2.internal" event="NodeHasSufficientMemory"
Jul 15 18:17:22.391710 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:17:22.309328    2567 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-171.ec2.internal" event="NodeHasSufficientMemory"
Jul 15 18:17:22.391710 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:17:22.309346    2567 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-171.ec2.internal" event="NodeHasNoDiskPressure"
Jul 15 18:17:22.391710 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:17:22.309347    2567 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-171.ec2.internal" event="NodeHasNoDiskPressure"
Jul 15 18:17:22.391710 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:17:22.309363    2567 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-171.ec2.internal" event="NodeHasSufficientPID"
Jul 15 18:17:22.391710 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:17:22.309371    2567 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-171.ec2.internal" event="NodeHasSufficientPID"
Jul 15 18:17:22.391710 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:17:22.311607    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-141-171.ec2.internal"
Jul 15 18:17:22.391710 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:17:22.311632    2567 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 15 18:17:22.391710 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:17:22.312369    2567 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-171.ec2.internal" event="NodeHasSufficientMemory"
Jul 15 18:17:22.391710 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:17:22.312391    2567 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-171.ec2.internal" event="NodeHasNoDiskPressure"
Jul 15 18:17:22.391710 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:17:22.312406    2567 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-171.ec2.internal" event="NodeHasSufficientPID"
Jul 15 18:17:22.391710 ip-10-0-141-171 kubenswrapper[2567]: E0715 18:17:22.335938    2567 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-141-171.ec2.internal\" not found" node="ip-10-0-141-171.ec2.internal"
Jul 15 18:17:22.391710 ip-10-0-141-171 kubenswrapper[2567]: E0715 18:17:22.340967    2567 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-141-171.ec2.internal\" not found" node="ip-10-0-141-171.ec2.internal"
Jul 15 18:17:22.391710 ip-10-0-141-171 kubenswrapper[2567]: E0715 18:17:22.385008    2567 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-171.ec2.internal\" not found"
Jul 15 18:17:22.621636 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:17:22.403426    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/a63a444972a783e4aea8dd589c20d7f5-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-141-171.ec2.internal\" (UID: \"a63a444972a783e4aea8dd589c20d7f5\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-171.ec2.internal"
Jul 15 18:17:22.621636 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:17:22.403453    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/a63a444972a783e4aea8dd589c20d7f5-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-141-171.ec2.internal\" (UID: \"a63a444972a783e4aea8dd589c20d7f5\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-171.ec2.internal"
Jul 15 18:17:22.621636 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:17:22.403474    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/5ba27ba9c439859b7fde96be83dd7679-config\") pod \"kube-apiserver-proxy-ip-10-0-141-171.ec2.internal\" (UID: \"5ba27ba9c439859b7fde96be83dd7679\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-141-171.ec2.internal"
Jul 15 18:17:22.621636 ip-10-0-141-171 kubenswrapper[2567]: E0715 18:17:22.489840    2567 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-171.ec2.internal\" not found"
Jul 15 18:17:22.621636 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:17:22.504301    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/5ba27ba9c439859b7fde96be83dd7679-config\") pod \"kube-apiserver-proxy-ip-10-0-141-171.ec2.internal\" (UID: \"5ba27ba9c439859b7fde96be83dd7679\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-141-171.ec2.internal"
Jul 15 18:17:22.621636 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:17:22.504326    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/5ba27ba9c439859b7fde96be83dd7679-config\") pod \"kube-apiserver-proxy-ip-10-0-141-171.ec2.internal\" (UID: \"5ba27ba9c439859b7fde96be83dd7679\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-141-171.ec2.internal"
Jul 15 18:17:22.621636 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:17:22.504339    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/a63a444972a783e4aea8dd589c20d7f5-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-141-171.ec2.internal\" (UID: \"a63a444972a783e4aea8dd589c20d7f5\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-171.ec2.internal"
Jul 15 18:17:22.621636 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:17:22.504361    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/a63a444972a783e4aea8dd589c20d7f5-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-141-171.ec2.internal\" (UID: \"a63a444972a783e4aea8dd589c20d7f5\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-171.ec2.internal"
Jul 15 18:17:22.621636 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:17:22.504382    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/a63a444972a783e4aea8dd589c20d7f5-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-141-171.ec2.internal\" (UID: \"a63a444972a783e4aea8dd589c20d7f5\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-171.ec2.internal"
Jul 15 18:17:22.621636 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:17:22.504399    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/a63a444972a783e4aea8dd589c20d7f5-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-141-171.ec2.internal\" (UID: \"a63a444972a783e4aea8dd589c20d7f5\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-171.ec2.internal"
Jul 15 18:17:22.621636 ip-10-0-141-171 kubenswrapper[2567]: E0715 18:17:22.596450    2567 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-171.ec2.internal\" not found"
Jul 15 18:17:22.773812 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:17:22.640009    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-171.ec2.internal"
Jul 15 18:17:22.773812 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:17:22.643599    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-141-171.ec2.internal"
Jul 15 18:17:22.773812 ip-10-0-141-171 kubenswrapper[2567]: E0715 18:17:22.697540    2567 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-171.ec2.internal\" not found"
Jul 15 18:17:22.967838 ip-10-0-141-171 kubenswrapper[2567]: E0715 18:17:22.804797    2567 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-171.ec2.internal\" not found"
Jul 15 18:17:22.967838 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:17:22.863544    2567 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials"
Jul 15 18:17:22.967838 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:17:22.863710    2567 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
Jul 15 18:17:22.967838 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:17:22.863733    2567 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
Jul 15 18:17:22.967838 ip-10-0-141-171 kubenswrapper[2567]: E0715 18:17:22.905273    2567 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-171.ec2.internal\" not found"
Jul 15 18:17:22.967838 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:17:22.941354    2567 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-07-14 18:12:22 +0000 UTC" deadline="2027-12-28 17:13:21.708753613 +0000 UTC"
Jul 15 18:17:22.967838 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:17:22.941379    2567 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="12742h55m58.767377954s"
Jul 15 18:17:23.191129 ip-10-0-141-171 kubenswrapper[2567]: E0715 18:17:23.006424    2567 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-171.ec2.internal\" not found"
Jul 15 18:17:23.191129 ip-10-0-141-171 kubenswrapper[2567]: E0715 18:17:23.106542    2567 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-171.ec2.internal\" not found"
Jul 15 18:17:23.347648 ip-10-0-141-171 kubenswrapper[2567]: E0715 18:17:23.207576    2567 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-171.ec2.internal\" not found"
Jul 15 18:17:23.347648 ip-10-0-141-171 kubenswrapper[2567]: E0715 18:17:23.308517    2567 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-171.ec2.internal\" not found"
Jul 15 18:17:23.409694 ip-10-0-141-171 kubenswrapper[2567]: E0715 18:17:23.409660    2567 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-171.ec2.internal\" not found"
Jul 15 18:17:23.481448 ip-10-0-141-171 kubenswrapper[2567]: W0715 18:17:23.481412    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5ba27ba9c439859b7fde96be83dd7679.slice/crio-1f151f70ef2fc4862df32594a8d8e313c7764637d83dac51227d10e95e08830f WatchSource:0}: Error finding container 1f151f70ef2fc4862df32594a8d8e313c7764637d83dac51227d10e95e08830f: Status 404 returned error can't find the container with id 1f151f70ef2fc4862df32594a8d8e313c7764637d83dac51227d10e95e08830f
Jul 15 18:17:23.491163 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:17:23.491144    2567 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 15 18:17:23.499167 ip-10-0-141-171 kubenswrapper[2567]: W0715 18:17:23.499138    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda63a444972a783e4aea8dd589c20d7f5.slice/crio-5e36a493595384ab53a699030c55f9e62b00d2ff04f432aeb0e1a6e9145e31c8 WatchSource:0}: Error finding container 5e36a493595384ab53a699030c55f9e62b00d2ff04f432aeb0e1a6e9145e31c8: Status 404 returned error can't find the container with id 5e36a493595384ab53a699030c55f9e62b00d2ff04f432aeb0e1a6e9145e31c8
Jul 15 18:17:23.506108 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:17:23.506085    2567 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 15 18:17:23.509954 ip-10-0-141-171 kubenswrapper[2567]: E0715 18:17:23.509935    2567 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-171.ec2.internal\" not found"
Jul 15 18:17:23.514276 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:17:23.514257    2567 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 15 18:17:23.605744 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:17:23.605708    2567 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-171.ec2.internal"
Jul 15 18:17:23.618504 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:17:23.618482    2567 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Jul 15 18:17:23.619679 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:17:23.619665    2567 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-141-171.ec2.internal"
Jul 15 18:17:23.627551 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:17:23.627531    2567 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Jul 15 18:17:23.921358 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:17:23.921290    2567 apiserver.go:52] "Watching apiserver"
Jul 15 18:17:23.929128 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:17:23.929103    2567 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66"
Jul 15 18:17:23.929532 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:17:23.929503    2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/node-ca-6qkk4","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-171.ec2.internal","openshift-multus/multus-additional-cni-plugins-d6rg2","openshift-multus/multus-crpmn","openshift-multus/network-metrics-daemon-n88x2","kube-system/global-pull-secret-syncer-dqncz","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-sk2rm","openshift-cluster-node-tuning-operator/tuned-8pv2c","openshift-network-diagnostics/network-check-target-4lm4m","openshift-network-operator/iptables-alerter-2hnlr","openshift-ovn-kubernetes/ovnkube-node-8hmqx","kube-system/konnectivity-agent-t2vtv","kube-system/kube-apiserver-proxy-ip-10-0-141-171.ec2.internal","openshift-dns/node-resolver-8d7kq"]
Jul 15 18:17:23.932156 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:17:23.932127    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-sk2rm"
Jul 15 18:17:23.934564 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:17:23.934543    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-pndnw\""
Jul 15 18:17:23.934895 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:17:23.934754    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\""
Jul 15 18:17:23.934895 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:17:23.934835    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\""
Jul 15 18:17:23.934895 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:17:23.934858    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-8hmqx"
Jul 15 18:17:23.935169 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:17:23.935058    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\""
Jul 15 18:17:23.937203 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:17:23.937182    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\""
Jul 15 18:17:23.937474 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:17:23.937456    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\""
Jul 15 18:17:23.937857 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:17:23.937838    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\""
Jul 15 18:17:23.938267 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:17:23.938244    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-hvn8q\""
Jul 15 18:17:23.938471 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:17:23.938448    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\""
Jul 15 18:17:23.938562 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:17:23.938491    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\""
Jul 15 18:17:23.938700 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:17:23.938675    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-d6rg2"
Jul 15 18:17:23.938772 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:17:23.938704    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\""
Jul 15 18:17:23.939753 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:17:23.939733    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-crpmn"
Jul 15 18:17:23.940527 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:17:23.940506    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\""
Jul 15 18:17:23.941061 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:17:23.941044    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\""
Jul 15 18:17:23.941061 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:17:23.941054    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-6rc5f\""
Jul 15 18:17:23.941272 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:17:23.941050    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\""
Jul 15 18:17:23.941549 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:17:23.941404    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\""
Jul 15 18:17:23.941549 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:17:23.941413    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\""
Jul 15 18:17:23.941682 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:17:23.941665    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-ld77f\""
Jul 15 18:17:23.941776 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:17:23.941754    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\""
Jul 15 18:17:23.942828 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:17:23.942808    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-n88x2"
Jul 15 18:17:23.942991 ip-10-0-141-171 kubenswrapper[2567]: E0715 18:17:23.942919    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-n88x2" podUID="99ec9d0a-ff24-4f04-b38d-b4a7de812d3b"
Jul 15 18:17:23.945347 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:17:23.945327    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-dqncz"
Jul 15 18:17:23.945458 ip-10-0-141-171 kubenswrapper[2567]: E0715 18:17:23.945389    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-dqncz" podUID="0d941f69-52de-4bf3-b262-9d9e07d9d730"
Jul 15 18:17:23.948588 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:17:23.947954    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-4lm4m"
Jul 15 18:17:23.948588 ip-10-0-141-171 kubenswrapper[2567]: E0715 18:17:23.948027    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-4lm4m" podUID="b4f54a92-c72a-4f20-93f7-7b424f8f2656"
Jul 15 18:17:23.950592 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:17:23.950565    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-8d7kq"
Jul 15 18:17:23.952580 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:17:23.952559    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\""
Jul 15 18:17:23.952689 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:17:23.952663    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\""
Jul 15 18:17:23.953166 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:17:23.953141    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-4hnhh\""
Jul 15 18:17:23.953295 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:17:23.953189    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-8pv2c"
Jul 15 18:17:23.955195 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:17:23.955174    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\""
Jul 15 18:17:23.955466 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:17:23.955435    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\""
Jul 15 18:17:23.955592 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:17:23.955574    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-wvqfk\""
Jul 15 18:17:23.956754 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:17:23.956735    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-2hnlr"
Jul 15 18:17:23.959754 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:17:23.959036    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-hppx4\""
Jul 15 18:17:23.959754 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:17:23.959469    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\""
Jul 15 18:17:23.959754 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:17:23.959645    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\""
Jul 15 18:17:23.959754 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:17:23.959653    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\""
Jul 15 18:17:23.961059 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:17:23.961035    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-6qkk4"
Jul 15 18:17:23.963207 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:17:23.963184    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\""
Jul 15 18:17:23.963332 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:17:23.963206    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\""
Jul 15 18:17:23.963419 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:17:23.963359    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-nhwdl\""
Jul 15 18:17:23.963505 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:17:23.963471    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\""
Jul 15 18:17:23.964003 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:17:23.963660    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-t2vtv"
Jul 15 18:17:23.965773 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:17:23.965753    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\""
Jul 15 18:17:23.965890 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:17:23.965857    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-gnk7l\""
Jul 15 18:17:23.965989 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:17:23.965888    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\""
Jul 15 18:17:24.000119 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:17:24.000096    2567 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving"
Jul 15 18:17:24.000824 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:17:24.000389    2567 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world"
Jul 15 18:17:24.014122 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:17:24.014099    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/fd1b71f3-89f1-4883-82f3-ba2ea2037bd1-konnectivity-ca\") pod \"konnectivity-agent-t2vtv\" (UID: \"fd1b71f3-89f1-4883-82f3-ba2ea2037bd1\") " pod="kube-system/konnectivity-agent-t2vtv"
Jul 15 18:17:24.014237 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:17:24.014131    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/2c675bc6-a2aa-458b-893e-533093fd93c1-etc-selinux\") pod \"aws-ebs-csi-driver-node-sk2rm\" (UID: \"2c675bc6-a2aa-458b-893e-533093fd93c1\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-sk2rm"
Jul 15 18:17:24.014237 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:17:24.014149    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/d8816772-beae-4dff-9c51-9043199e488d-run-systemd\") pod \"ovnkube-node-8hmqx\" (UID: \"d8816772-beae-4dff-9c51-9043199e488d\") " pod="openshift-ovn-kubernetes/ovnkube-node-8hmqx"
Jul 15 18:17:24.014237 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:17:24.014170    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/d8816772-beae-4dff-9c51-9043199e488d-ovn-node-metrics-cert\") pod \"ovnkube-node-8hmqx\" (UID: \"d8816772-beae-4dff-9c51-9043199e488d\") " pod="openshift-ovn-kubernetes/ovnkube-node-8hmqx"
Jul 15 18:17:24.014237 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:17:24.014213    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/b4008ec9-cbff-43c2-905e-abd5cf63c321-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-d6rg2\" (UID: \"b4008ec9-cbff-43c2-905e-abd5cf63c321\") " pod="openshift-multus/multus-additional-cni-plugins-d6rg2"
Jul 15 18:17:24.014491 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:17:24.014270    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/b4008ec9-cbff-43c2-905e-abd5cf63c321-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-d6rg2\" (UID: \"b4008ec9-cbff-43c2-905e-abd5cf63c321\") " pod="openshift-multus/multus-additional-cni-plugins-d6rg2"
Jul 15 18:17:24.014491 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:17:24.014311    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/9dd068b6-915e-4ffb-9552-b4b987ca19f2-host-run-multus-certs\") pod \"multus-crpmn\" (UID: \"9dd068b6-915e-4ffb-9552-b4b987ca19f2\") " pod="openshift-multus/multus-crpmn"
Jul 15 18:17:24.014491 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:17:24.014361    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/d8816772-beae-4dff-9c51-9043199e488d-etc-openvswitch\") pod \"ovnkube-node-8hmqx\" (UID: \"d8816772-beae-4dff-9c51-9043199e488d\") " pod="openshift-ovn-kubernetes/ovnkube-node-8hmqx"
Jul 15 18:17:24.014491 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:17:24.014388    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/d8816772-beae-4dff-9c51-9043199e488d-run-ovn\") pod \"ovnkube-node-8hmqx\" (UID: \"d8816772-beae-4dff-9c51-9043199e488d\") " pod="openshift-ovn-kubernetes/ovnkube-node-8hmqx"
Jul 15 18:17:24.014491 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:17:24.014412    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/d8816772-beae-4dff-9c51-9043199e488d-host-cni-bin\") pod \"ovnkube-node-8hmqx\" (UID: \"d8816772-beae-4dff-9c51-9043199e488d\") " pod="openshift-ovn-kubernetes/ovnkube-node-8hmqx"
Jul 15 18:17:24.014491 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:17:24.014435    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/d8816772-beae-4dff-9c51-9043199e488d-ovnkube-script-lib\") pod \"ovnkube-node-8hmqx\" (UID: \"d8816772-beae-4dff-9c51-9043199e488d\") " pod="openshift-ovn-kubernetes/ovnkube-node-8hmqx"
Jul 15 18:17:24.014491 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:17:24.014459    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-njxzx\" (UniqueName: \"kubernetes.io/projected/d8816772-beae-4dff-9c51-9043199e488d-kube-api-access-njxzx\") pod \"ovnkube-node-8hmqx\" (UID: \"d8816772-beae-4dff-9c51-9043199e488d\") " pod="openshift-ovn-kubernetes/ovnkube-node-8hmqx"
Jul 15 18:17:24.014491 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:17:24.014479    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/b4008ec9-cbff-43c2-905e-abd5cf63c321-tuning-conf-dir\") pod \"multus-additional-cni-plugins-d6rg2\" (UID: \"b4008ec9-cbff-43c2-905e-abd5cf63c321\") " pod="openshift-multus/multus-additional-cni-plugins-d6rg2"
Jul 15 18:17:24.014903 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:17:24.014524    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/9dd068b6-915e-4ffb-9552-b4b987ca19f2-host-var-lib-cni-bin\") pod \"multus-crpmn\" (UID: \"9dd068b6-915e-4ffb-9552-b4b987ca19f2\") " pod="openshift-multus/multus-crpmn"
Jul 15 18:17:24.014903 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:17:24.014564    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/b4008ec9-cbff-43c2-905e-abd5cf63c321-cni-binary-copy\") pod \"multus-additional-cni-plugins-d6rg2\" (UID: \"b4008ec9-cbff-43c2-905e-abd5cf63c321\") " pod="openshift-multus/multus-additional-cni-plugins-d6rg2"
Jul 15 18:17:24.014903 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:17:24.014590    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/9dd068b6-915e-4ffb-9552-b4b987ca19f2-host-var-lib-kubelet\") pod \"multus-crpmn\" (UID: \"9dd068b6-915e-4ffb-9552-b4b987ca19f2\") " pod="openshift-multus/multus-crpmn"
Jul 15 18:17:24.014903 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:17:24.014612    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/b62eb6ad-8f6e-4d28-aa2b-9c6579a6d52a-etc-sysconfig\") pod \"tuned-8pv2c\" (UID: \"b62eb6ad-8f6e-4d28-aa2b-9c6579a6d52a\") " pod="openshift-cluster-node-tuning-operator/tuned-8pv2c"
Jul 15 18:17:24.014903 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:17:24.014632    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/b62eb6ad-8f6e-4d28-aa2b-9c6579a6d52a-etc-kubernetes\") pod \"tuned-8pv2c\" (UID: \"b62eb6ad-8f6e-4d28-aa2b-9c6579a6d52a\") " pod="openshift-cluster-node-tuning-operator/tuned-8pv2c"
Jul 15 18:17:24.014903 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:17:24.014664    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/b62eb6ad-8f6e-4d28-aa2b-9c6579a6d52a-etc-sysctl-d\") pod \"tuned-8pv2c\" (UID: \"b62eb6ad-8f6e-4d28-aa2b-9c6579a6d52a\") " pod="openshift-cluster-node-tuning-operator/tuned-8pv2c"
Jul 15 18:17:24.014903 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:17:24.014688    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/b62eb6ad-8f6e-4d28-aa2b-9c6579a6d52a-etc-sysctl-conf\") pod \"tuned-8pv2c\" (UID: \"b62eb6ad-8f6e-4d28-aa2b-9c6579a6d52a\") " pod="openshift-cluster-node-tuning-operator/tuned-8pv2c"
Jul 15 18:17:24.014903 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:17:24.014712    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/b62eb6ad-8f6e-4d28-aa2b-9c6579a6d52a-sys\") pod \"tuned-8pv2c\" (UID: \"b62eb6ad-8f6e-4d28-aa2b-9c6579a6d52a\") " pod="openshift-cluster-node-tuning-operator/tuned-8pv2c"
Jul 15 18:17:24.014903 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:17:24.014734    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/b62eb6ad-8f6e-4d28-aa2b-9c6579a6d52a-run\") pod \"tuned-8pv2c\" (UID: \"b62eb6ad-8f6e-4d28-aa2b-9c6579a6d52a\") " pod="openshift-cluster-node-tuning-operator/tuned-8pv2c"
Jul 15 18:17:24.014903 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:17:24.014787    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/d8816772-beae-4dff-9c51-9043199e488d-host-run-ovn-kubernetes\") pod \"ovnkube-node-8hmqx\" (UID: \"d8816772-beae-4dff-9c51-9043199e488d\") " pod="openshift-ovn-kubernetes/ovnkube-node-8hmqx"
Jul 15 18:17:24.014903 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:17:24.014824    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/d8816772-beae-4dff-9c51-9043199e488d-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-8hmqx\" (UID: \"d8816772-beae-4dff-9c51-9043199e488d\") " pod="openshift-ovn-kubernetes/ovnkube-node-8hmqx"
Jul 15 18:17:24.014903 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:17:24.014853    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/9dd068b6-915e-4ffb-9552-b4b987ca19f2-multus-socket-dir-parent\") pod \"multus-crpmn\" (UID: \"9dd068b6-915e-4ffb-9552-b4b987ca19f2\") " pod="openshift-multus/multus-crpmn"
Jul 15 18:17:24.014903 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:17:24.014885    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/b62eb6ad-8f6e-4d28-aa2b-9c6579a6d52a-etc-systemd\") pod \"tuned-8pv2c\" (UID: \"b62eb6ad-8f6e-4d28-aa2b-9c6579a6d52a\") " pod="openshift-cluster-node-tuning-operator/tuned-8pv2c"
Jul 15 18:17:24.015556 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:17:24.014910    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/b62eb6ad-8f6e-4d28-aa2b-9c6579a6d52a-var-lib-kubelet\") pod \"tuned-8pv2c\" (UID: \"b62eb6ad-8f6e-4d28-aa2b-9c6579a6d52a\") " pod="openshift-cluster-node-tuning-operator/tuned-8pv2c"
Jul 15 18:17:24.015556 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:17:24.014935    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/b62eb6ad-8f6e-4d28-aa2b-9c6579a6d52a-etc-tuned\") pod \"tuned-8pv2c\" (UID: \"b62eb6ad-8f6e-4d28-aa2b-9c6579a6d52a\") " pod="openshift-cluster-node-tuning-operator/tuned-8pv2c"
Jul 15 18:17:24.015556 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:17:24.014971    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-g4s7n\" (UniqueName: \"kubernetes.io/projected/420d5d86-edc6-4c35-a8b1-0501a7aa0887-kube-api-access-g4s7n\") pod \"iptables-alerter-2hnlr\" (UID: \"420d5d86-edc6-4c35-a8b1-0501a7aa0887\") " pod="openshift-network-operator/iptables-alerter-2hnlr"
Jul 15 18:17:24.015556 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:17:24.014998    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/b4008ec9-cbff-43c2-905e-abd5cf63c321-cnibin\") pod \"multus-additional-cni-plugins-d6rg2\" (UID: \"b4008ec9-cbff-43c2-905e-abd5cf63c321\") " pod="openshift-multus/multus-additional-cni-plugins-d6rg2"
Jul 15 18:17:24.015556 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:17:24.015032    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lllr6\" (UniqueName: \"kubernetes.io/projected/b4008ec9-cbff-43c2-905e-abd5cf63c321-kube-api-access-lllr6\") pod \"multus-additional-cni-plugins-d6rg2\" (UID: \"b4008ec9-cbff-43c2-905e-abd5cf63c321\") " pod="openshift-multus/multus-additional-cni-plugins-d6rg2"
Jul 15 18:17:24.015556 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:17:24.015064    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c7dc99b8-7a42-4f46-8de8-5c36675675da-tmp-dir\") pod \"node-resolver-8d7kq\" (UID: \"c7dc99b8-7a42-4f46-8de8-5c36675675da\") " pod="openshift-dns/node-resolver-8d7kq"
Jul 15 18:17:24.015556 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:17:24.015124    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jfzc4\" (UniqueName: \"kubernetes.io/projected/c7dc99b8-7a42-4f46-8de8-5c36675675da-kube-api-access-jfzc4\") pod \"node-resolver-8d7kq\" (UID: \"c7dc99b8-7a42-4f46-8de8-5c36675675da\") " pod="openshift-dns/node-resolver-8d7kq"
Jul 15 18:17:24.015556 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:17:24.015160    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/836f3165-610d-469b-ba6f-773aad82bf92-serviceca\") pod \"node-ca-6qkk4\" (UID: \"836f3165-610d-469b-ba6f-773aad82bf92\") " pod="openshift-image-registry/node-ca-6qkk4"
Jul 15 18:17:24.015556 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:17:24.015196    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/2c675bc6-a2aa-458b-893e-533093fd93c1-kubelet-dir\") pod \"aws-ebs-csi-driver-node-sk2rm\" (UID: \"2c675bc6-a2aa-458b-893e-533093fd93c1\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-sk2rm"
Jul 15 18:17:24.015556 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:17:24.015218    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/d8816772-beae-4dff-9c51-9043199e488d-host-slash\") pod \"ovnkube-node-8hmqx\" (UID: \"d8816772-beae-4dff-9c51-9043199e488d\") " pod="openshift-ovn-kubernetes/ovnkube-node-8hmqx"
Jul 15 18:17:24.015556 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:17:24.015268    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/d8816772-beae-4dff-9c51-9043199e488d-node-log\") pod \"ovnkube-node-8hmqx\" (UID: \"d8816772-beae-4dff-9c51-9043199e488d\") " pod="openshift-ovn-kubernetes/ovnkube-node-8hmqx"
Jul 15 18:17:24.015556 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:17:24.015303    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/9dd068b6-915e-4ffb-9552-b4b987ca19f2-multus-daemon-config\") pod \"multus-crpmn\" (UID: \"9dd068b6-915e-4ffb-9552-b4b987ca19f2\") " pod="openshift-multus/multus-crpmn"
Jul 15 18:17:24.015556 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:17:24.015331    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pjq5n\" (UniqueName: \"kubernetes.io/projected/b4f54a92-c72a-4f20-93f7-7b424f8f2656-kube-api-access-pjq5n\") pod \"network-check-target-4lm4m\" (UID: \"b4f54a92-c72a-4f20-93f7-7b424f8f2656\") " pod="openshift-network-diagnostics/network-check-target-4lm4m"
Jul 15 18:17:24.015556 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:17:24.015361    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/2c675bc6-a2aa-458b-893e-533093fd93c1-sys-fs\") pod \"aws-ebs-csi-driver-node-sk2rm\" (UID: \"2c675bc6-a2aa-458b-893e-533093fd93c1\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-sk2rm"
Jul 15 18:17:24.015556 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:17:24.015385    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/d8816772-beae-4dff-9c51-9043199e488d-host-kubelet\") pod \"ovnkube-node-8hmqx\" (UID: \"d8816772-beae-4dff-9c51-9043199e488d\") " pod="openshift-ovn-kubernetes/ovnkube-node-8hmqx"
Jul 15 18:17:24.015556 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:17:24.015410    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/9dd068b6-915e-4ffb-9552-b4b987ca19f2-os-release\") pod \"multus-crpmn\" (UID: \"9dd068b6-915e-4ffb-9552-b4b987ca19f2\") " pod="openshift-multus/multus-crpmn"
Jul 15 18:17:24.016363 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:17:24.015437    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7k9ch\" (UniqueName: \"kubernetes.io/projected/9dd068b6-915e-4ffb-9552-b4b987ca19f2-kube-api-access-7k9ch\") pod \"multus-crpmn\" (UID: \"9dd068b6-915e-4ffb-9552-b4b987ca19f2\") " pod="openshift-multus/multus-crpmn"
Jul 15 18:17:24.016363 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:17:24.015461    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/b62eb6ad-8f6e-4d28-aa2b-9c6579a6d52a-etc-modprobe-d\") pod \"tuned-8pv2c\" (UID: \"b62eb6ad-8f6e-4d28-aa2b-9c6579a6d52a\") " pod="openshift-cluster-node-tuning-operator/tuned-8pv2c"
Jul 15 18:17:24.016363 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:17:24.015484    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/b62eb6ad-8f6e-4d28-aa2b-9c6579a6d52a-lib-modules\") pod \"tuned-8pv2c\" (UID: \"b62eb6ad-8f6e-4d28-aa2b-9c6579a6d52a\") " pod="openshift-cluster-node-tuning-operator/tuned-8pv2c"
Jul 15 18:17:24.016363 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:17:24.015534    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/0d941f69-52de-4bf3-b262-9d9e07d9d730-dbus\") pod \"global-pull-secret-syncer-dqncz\" (UID: \"0d941f69-52de-4bf3-b262-9d9e07d9d730\") " pod="kube-system/global-pull-secret-syncer-dqncz"
Jul 15 18:17:24.016363 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:17:24.015564    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/836f3165-610d-469b-ba6f-773aad82bf92-host\") pod \"node-ca-6qkk4\" (UID: \"836f3165-610d-469b-ba6f-773aad82bf92\") " pod="openshift-image-registry/node-ca-6qkk4"
Jul 15 18:17:24.016363 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:17:24.015586    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/2c675bc6-a2aa-458b-893e-533093fd93c1-registration-dir\") pod \"aws-ebs-csi-driver-node-sk2rm\" (UID: \"2c675bc6-a2aa-458b-893e-533093fd93c1\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-sk2rm"
Jul 15 18:17:24.016363 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:17:24.015617    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/b4008ec9-cbff-43c2-905e-abd5cf63c321-system-cni-dir\") pod \"multus-additional-cni-plugins-d6rg2\" (UID: \"b4008ec9-cbff-43c2-905e-abd5cf63c321\") " pod="openshift-multus/multus-additional-cni-plugins-d6rg2"
Jul 15 18:17:24.016363 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:17:24.015634    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/d8816772-beae-4dff-9c51-9043199e488d-var-lib-openvswitch\") pod \"ovnkube-node-8hmqx\" (UID: \"d8816772-beae-4dff-9c51-9043199e488d\") " pod="openshift-ovn-kubernetes/ovnkube-node-8hmqx"
Jul 15 18:17:24.016363 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:17:24.015665    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/9dd068b6-915e-4ffb-9552-b4b987ca19f2-host-run-netns\") pod \"multus-crpmn\" (UID: \"9dd068b6-915e-4ffb-9552-b4b987ca19f2\") " pod="openshift-multus/multus-crpmn"
Jul 15 18:17:24.016363 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:17:24.015706    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/b62eb6ad-8f6e-4d28-aa2b-9c6579a6d52a-tmp\") pod \"tuned-8pv2c\" (UID: \"b62eb6ad-8f6e-4d28-aa2b-9c6579a6d52a\") " pod="openshift-cluster-node-tuning-operator/tuned-8pv2c"
Jul 15 18:17:24.016363 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:17:24.015733    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/420d5d86-edc6-4c35-a8b1-0501a7aa0887-host-slash\") pod \"iptables-alerter-2hnlr\" (UID: \"420d5d86-edc6-4c35-a8b1-0501a7aa0887\") " pod="openshift-network-operator/iptables-alerter-2hnlr"
Jul 15 18:17:24.016363 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:17:24.015756    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/b4008ec9-cbff-43c2-905e-abd5cf63c321-os-release\") pod \"multus-additional-cni-plugins-d6rg2\" (UID: \"b4008ec9-cbff-43c2-905e-abd5cf63c321\") " pod="openshift-multus/multus-additional-cni-plugins-d6rg2"
Jul 15 18:17:24.016363 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:17:24.015810    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/9dd068b6-915e-4ffb-9552-b4b987ca19f2-system-cni-dir\") pod \"multus-crpmn\" (UID: \"9dd068b6-915e-4ffb-9552-b4b987ca19f2\") " pod="openshift-multus/multus-crpmn"
Jul 15 18:17:24.016363 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:17:24.015833    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/9dd068b6-915e-4ffb-9552-b4b987ca19f2-hostroot\") pod \"multus-crpmn\" (UID: \"9dd068b6-915e-4ffb-9552-b4b987ca19f2\") " pod="openshift-multus/multus-crpmn"
Jul 15 18:17:24.016363 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:17:24.015855    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/9dd068b6-915e-4ffb-9552-b4b987ca19f2-multus-conf-dir\") pod \"multus-crpmn\" (UID: \"9dd068b6-915e-4ffb-9552-b4b987ca19f2\") " pod="openshift-multus/multus-crpmn"
Jul 15 18:17:24.016363 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:17:24.015878    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/b62eb6ad-8f6e-4d28-aa2b-9c6579a6d52a-host\") pod \"tuned-8pv2c\" (UID: \"b62eb6ad-8f6e-4d28-aa2b-9c6579a6d52a\") " pod="openshift-cluster-node-tuning-operator/tuned-8pv2c"
Jul 15 18:17:24.016363 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:17:24.015904    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/2c675bc6-a2aa-458b-893e-533093fd93c1-device-dir\") pod \"aws-ebs-csi-driver-node-sk2rm\" (UID: \"2c675bc6-a2aa-458b-893e-533093fd93c1\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-sk2rm"
Jul 15 18:17:24.017213 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:17:24.015949    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/9dd068b6-915e-4ffb-9552-b4b987ca19f2-etc-kubernetes\") pod \"multus-crpmn\" (UID: \"9dd068b6-915e-4ffb-9552-b4b987ca19f2\") " pod="openshift-multus/multus-crpmn"
Jul 15 18:17:24.017213 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:17:24.015967    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xjmll\" (UniqueName: \"kubernetes.io/projected/b62eb6ad-8f6e-4d28-aa2b-9c6579a6d52a-kube-api-access-xjmll\") pod \"tuned-8pv2c\" (UID: \"b62eb6ad-8f6e-4d28-aa2b-9c6579a6d52a\") " pod="openshift-cluster-node-tuning-operator/tuned-8pv2c"
Jul 15 18:17:24.017213 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:17:24.015992    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-78kbn\" (UniqueName: \"kubernetes.io/projected/836f3165-610d-469b-ba6f-773aad82bf92-kube-api-access-78kbn\") pod \"node-ca-6qkk4\" (UID: \"836f3165-610d-469b-ba6f-773aad82bf92\") " pod="openshift-image-registry/node-ca-6qkk4"
Jul 15 18:17:24.017213 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:17:24.016009    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/2c675bc6-a2aa-458b-893e-533093fd93c1-socket-dir\") pod \"aws-ebs-csi-driver-node-sk2rm\" (UID: \"2c675bc6-a2aa-458b-893e-533093fd93c1\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-sk2rm"
Jul 15 18:17:24.017213 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:17:24.016023    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/d8816772-beae-4dff-9c51-9043199e488d-host-run-netns\") pod \"ovnkube-node-8hmqx\" (UID: \"d8816772-beae-4dff-9c51-9043199e488d\") " pod="openshift-ovn-kubernetes/ovnkube-node-8hmqx"
Jul 15 18:17:24.017213 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:17:24.016039    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/d8816772-beae-4dff-9c51-9043199e488d-ovnkube-config\") pod \"ovnkube-node-8hmqx\" (UID: \"d8816772-beae-4dff-9c51-9043199e488d\") " pod="openshift-ovn-kubernetes/ovnkube-node-8hmqx"
Jul 15 18:17:24.017213 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:17:24.016062    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/9dd068b6-915e-4ffb-9552-b4b987ca19f2-cni-binary-copy\") pod \"multus-crpmn\" (UID: \"9dd068b6-915e-4ffb-9552-b4b987ca19f2\") " pod="openshift-multus/multus-crpmn"
Jul 15 18:17:24.017213 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:17:24.016090    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/d8816772-beae-4dff-9c51-9043199e488d-systemd-units\") pod \"ovnkube-node-8hmqx\" (UID: \"d8816772-beae-4dff-9c51-9043199e488d\") " pod="openshift-ovn-kubernetes/ovnkube-node-8hmqx"
Jul 15 18:17:24.017213 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:17:24.016120    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/d8816772-beae-4dff-9c51-9043199e488d-env-overrides\") pod \"ovnkube-node-8hmqx\" (UID: \"d8816772-beae-4dff-9c51-9043199e488d\") " pod="openshift-ovn-kubernetes/ovnkube-node-8hmqx"
Jul 15 18:17:24.017213 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:17:24.016145    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/d8816772-beae-4dff-9c51-9043199e488d-run-openvswitch\") pod \"ovnkube-node-8hmqx\" (UID: \"d8816772-beae-4dff-9c51-9043199e488d\") " pod="openshift-ovn-kubernetes/ovnkube-node-8hmqx"
Jul 15 18:17:24.017213 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:17:24.016167    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/d8816772-beae-4dff-9c51-9043199e488d-host-cni-netd\") pod \"ovnkube-node-8hmqx\" (UID: \"d8816772-beae-4dff-9c51-9043199e488d\") " pod="openshift-ovn-kubernetes/ovnkube-node-8hmqx"
Jul 15 18:17:24.017213 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:17:24.016191    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/9dd068b6-915e-4ffb-9552-b4b987ca19f2-cnibin\") pod \"multus-crpmn\" (UID: \"9dd068b6-915e-4ffb-9552-b4b987ca19f2\") " pod="openshift-multus/multus-crpmn"
Jul 15 18:17:24.017213 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:17:24.016217    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dn4pt\" (UniqueName: \"kubernetes.io/projected/99ec9d0a-ff24-4f04-b38d-b4a7de812d3b-kube-api-access-dn4pt\") pod \"network-metrics-daemon-n88x2\" (UID: \"99ec9d0a-ff24-4f04-b38d-b4a7de812d3b\") " pod="openshift-multus/network-metrics-daemon-n88x2"
Jul 15 18:17:24.017213 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:17:24.016244    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/0d941f69-52de-4bf3-b262-9d9e07d9d730-original-pull-secret\") pod \"global-pull-secret-syncer-dqncz\" (UID: \"0d941f69-52de-4bf3-b262-9d9e07d9d730\") " pod="kube-system/global-pull-secret-syncer-dqncz"
Jul 15 18:17:24.017213 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:17:24.016286    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/420d5d86-edc6-4c35-a8b1-0501a7aa0887-iptables-alerter-script\") pod \"iptables-alerter-2hnlr\" (UID: \"420d5d86-edc6-4c35-a8b1-0501a7aa0887\") " pod="openshift-network-operator/iptables-alerter-2hnlr"
Jul 15 18:17:24.017213 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:17:24.016324    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/fd1b71f3-89f1-4883-82f3-ba2ea2037bd1-agent-certs\") pod \"konnectivity-agent-t2vtv\" (UID: \"fd1b71f3-89f1-4883-82f3-ba2ea2037bd1\") " pod="kube-system/konnectivity-agent-t2vtv"
Jul 15 18:17:24.018054 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:17:24.016354    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/d8816772-beae-4dff-9c51-9043199e488d-log-socket\") pod \"ovnkube-node-8hmqx\" (UID: \"d8816772-beae-4dff-9c51-9043199e488d\") " pod="openshift-ovn-kubernetes/ovnkube-node-8hmqx"
Jul 15 18:17:24.018054 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:17:24.016392    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/9dd068b6-915e-4ffb-9552-b4b987ca19f2-host-run-k8s-cni-cncf-io\") pod \"multus-crpmn\" (UID: \"9dd068b6-915e-4ffb-9552-b4b987ca19f2\") " pod="openshift-multus/multus-crpmn"
Jul 15 18:17:24.018054 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:17:24.016420    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/99ec9d0a-ff24-4f04-b38d-b4a7de812d3b-metrics-certs\") pod \"network-metrics-daemon-n88x2\" (UID: \"99ec9d0a-ff24-4f04-b38d-b4a7de812d3b\") " pod="openshift-multus/network-metrics-daemon-n88x2"
Jul 15 18:17:24.018054 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:17:24.016453    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/0d941f69-52de-4bf3-b262-9d9e07d9d730-kubelet-config\") pod \"global-pull-secret-syncer-dqncz\" (UID: \"0d941f69-52de-4bf3-b262-9d9e07d9d730\") " pod="kube-system/global-pull-secret-syncer-dqncz"
Jul 15 18:17:24.018054 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:17:24.016478    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cpbds\" (UniqueName: \"kubernetes.io/projected/2c675bc6-a2aa-458b-893e-533093fd93c1-kube-api-access-cpbds\") pod \"aws-ebs-csi-driver-node-sk2rm\" (UID: \"2c675bc6-a2aa-458b-893e-533093fd93c1\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-sk2rm"
Jul 15 18:17:24.018054 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:17:24.016503    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/9dd068b6-915e-4ffb-9552-b4b987ca19f2-multus-cni-dir\") pod \"multus-crpmn\" (UID: \"9dd068b6-915e-4ffb-9552-b4b987ca19f2\") " pod="openshift-multus/multus-crpmn"
Jul 15 18:17:24.018054 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:17:24.016527    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/9dd068b6-915e-4ffb-9552-b4b987ca19f2-host-var-lib-cni-multus\") pod \"multus-crpmn\" (UID: \"9dd068b6-915e-4ffb-9552-b4b987ca19f2\") " pod="openshift-multus/multus-crpmn"
Jul 15 18:17:24.018054 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:17:24.016549    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/c7dc99b8-7a42-4f46-8de8-5c36675675da-hosts-file\") pod \"node-resolver-8d7kq\" (UID: \"c7dc99b8-7a42-4f46-8de8-5c36675675da\") " pod="openshift-dns/node-resolver-8d7kq"
Jul 15 18:17:24.018462 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:17:24.018409    2567 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Jul 15 18:17:24.040540 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:17:24.040516    2567 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-rgrzk"
Jul 15 18:17:24.046793 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:17:24.046771    2567 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-rgrzk"
Jul 15 18:17:24.073736 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:17:24.073712    2567 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 15 18:17:24.117277 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:17:24.117233    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/836f3165-610d-469b-ba6f-773aad82bf92-host\") pod \"node-ca-6qkk4\" (UID: \"836f3165-610d-469b-ba6f-773aad82bf92\") " pod="openshift-image-registry/node-ca-6qkk4"
Jul 15 18:17:24.117395 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:17:24.117284    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/2c675bc6-a2aa-458b-893e-533093fd93c1-registration-dir\") pod \"aws-ebs-csi-driver-node-sk2rm\" (UID: \"2c675bc6-a2aa-458b-893e-533093fd93c1\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-sk2rm"
Jul 15 18:17:24.117395 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:17:24.117306    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/b4008ec9-cbff-43c2-905e-abd5cf63c321-system-cni-dir\") pod \"multus-additional-cni-plugins-d6rg2\" (UID: \"b4008ec9-cbff-43c2-905e-abd5cf63c321\") " pod="openshift-multus/multus-additional-cni-plugins-d6rg2"
Jul 15 18:17:24.117395 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:17:24.117330    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/d8816772-beae-4dff-9c51-9043199e488d-var-lib-openvswitch\") pod \"ovnkube-node-8hmqx\" (UID: \"d8816772-beae-4dff-9c51-9043199e488d\") " pod="openshift-ovn-kubernetes/ovnkube-node-8hmqx"
Jul 15 18:17:24.117395 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:17:24.117354    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/836f3165-610d-469b-ba6f-773aad82bf92-host\") pod \"node-ca-6qkk4\" (UID: \"836f3165-610d-469b-ba6f-773aad82bf92\") " pod="openshift-image-registry/node-ca-6qkk4"
Jul 15 18:17:24.117395 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:17:24.117357    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/9dd068b6-915e-4ffb-9552-b4b987ca19f2-host-run-netns\") pod \"multus-crpmn\" (UID: \"9dd068b6-915e-4ffb-9552-b4b987ca19f2\") " pod="openshift-multus/multus-crpmn"
Jul 15 18:17:24.117395 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:17:24.117390    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/9dd068b6-915e-4ffb-9552-b4b987ca19f2-host-run-netns\") pod \"multus-crpmn\" (UID: \"9dd068b6-915e-4ffb-9552-b4b987ca19f2\") " pod="openshift-multus/multus-crpmn"
Jul 15 18:17:24.117668 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:17:24.117401    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/b62eb6ad-8f6e-4d28-aa2b-9c6579a6d52a-tmp\") pod \"tuned-8pv2c\" (UID: \"b62eb6ad-8f6e-4d28-aa2b-9c6579a6d52a\") " pod="openshift-cluster-node-tuning-operator/tuned-8pv2c"
Jul 15 18:17:24.117668 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:17:24.117377    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/2c675bc6-a2aa-458b-893e-533093fd93c1-registration-dir\") pod \"aws-ebs-csi-driver-node-sk2rm\" (UID: \"2c675bc6-a2aa-458b-893e-533093fd93c1\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-sk2rm"
Jul 15 18:17:24.117668 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:17:24.117412    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/b4008ec9-cbff-43c2-905e-abd5cf63c321-system-cni-dir\") pod \"multus-additional-cni-plugins-d6rg2\" (UID: \"b4008ec9-cbff-43c2-905e-abd5cf63c321\") " pod="openshift-multus/multus-additional-cni-plugins-d6rg2"
Jul 15 18:17:24.117668 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:17:24.117422    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/420d5d86-edc6-4c35-a8b1-0501a7aa0887-host-slash\") pod \"iptables-alerter-2hnlr\" (UID: \"420d5d86-edc6-4c35-a8b1-0501a7aa0887\") " pod="openshift-network-operator/iptables-alerter-2hnlr"
Jul 15 18:17:24.117668 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:17:24.117448    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/b4008ec9-cbff-43c2-905e-abd5cf63c321-os-release\") pod \"multus-additional-cni-plugins-d6rg2\" (UID: \"b4008ec9-cbff-43c2-905e-abd5cf63c321\") " pod="openshift-multus/multus-additional-cni-plugins-d6rg2"
Jul 15 18:17:24.117668 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:17:24.117455    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/420d5d86-edc6-4c35-a8b1-0501a7aa0887-host-slash\") pod \"iptables-alerter-2hnlr\" (UID: \"420d5d86-edc6-4c35-a8b1-0501a7aa0887\") " pod="openshift-network-operator/iptables-alerter-2hnlr"
Jul 15 18:17:24.117668 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:17:24.117465    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/9dd068b6-915e-4ffb-9552-b4b987ca19f2-system-cni-dir\") pod \"multus-crpmn\" (UID: \"9dd068b6-915e-4ffb-9552-b4b987ca19f2\") " pod="openshift-multus/multus-crpmn"
Jul 15 18:17:24.117668 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:17:24.117456    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/d8816772-beae-4dff-9c51-9043199e488d-var-lib-openvswitch\") pod \"ovnkube-node-8hmqx\" (UID: \"d8816772-beae-4dff-9c51-9043199e488d\") " pod="openshift-ovn-kubernetes/ovnkube-node-8hmqx"
Jul 15 18:17:24.117668 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:17:24.117482    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/9dd068b6-915e-4ffb-9552-b4b987ca19f2-hostroot\") pod \"multus-crpmn\" (UID: \"9dd068b6-915e-4ffb-9552-b4b987ca19f2\") " pod="openshift-multus/multus-crpmn"
Jul 15 18:17:24.117668 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:17:24.117498    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/9dd068b6-915e-4ffb-9552-b4b987ca19f2-multus-conf-dir\") pod \"multus-crpmn\" (UID: \"9dd068b6-915e-4ffb-9552-b4b987ca19f2\") " pod="openshift-multus/multus-crpmn"
Jul 15 18:17:24.117668 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:17:24.117519    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/b62eb6ad-8f6e-4d28-aa2b-9c6579a6d52a-host\") pod \"tuned-8pv2c\" (UID: \"b62eb6ad-8f6e-4d28-aa2b-9c6579a6d52a\") " pod="openshift-cluster-node-tuning-operator/tuned-8pv2c"
Jul 15 18:17:24.117668 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:17:24.117524    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/9dd068b6-915e-4ffb-9552-b4b987ca19f2-system-cni-dir\") pod \"multus-crpmn\" (UID: \"9dd068b6-915e-4ffb-9552-b4b987ca19f2\") " pod="openshift-multus/multus-crpmn"
Jul 15 18:17:24.117668 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:17:24.117533    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/b4008ec9-cbff-43c2-905e-abd5cf63c321-os-release\") pod \"multus-additional-cni-plugins-d6rg2\" (UID: \"b4008ec9-cbff-43c2-905e-abd5cf63c321\") " pod="openshift-multus/multus-additional-cni-plugins-d6rg2"
Jul 15 18:17:24.117668 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:17:24.117544    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/2c675bc6-a2aa-458b-893e-533093fd93c1-device-dir\") pod \"aws-ebs-csi-driver-node-sk2rm\" (UID: \"2c675bc6-a2aa-458b-893e-533093fd93c1\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-sk2rm"
Jul 15 18:17:24.117668 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:17:24.117557    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/9dd068b6-915e-4ffb-9552-b4b987ca19f2-hostroot\") pod \"multus-crpmn\" (UID: \"9dd068b6-915e-4ffb-9552-b4b987ca19f2\") " pod="openshift-multus/multus-crpmn"
Jul 15 18:17:24.117668 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:17:24.117570    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/9dd068b6-915e-4ffb-9552-b4b987ca19f2-etc-kubernetes\") pod \"multus-crpmn\" (UID: \"9dd068b6-915e-4ffb-9552-b4b987ca19f2\") " pod="openshift-multus/multus-crpmn"
Jul 15 18:17:24.117668 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:17:24.117571    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/9dd068b6-915e-4ffb-9552-b4b987ca19f2-multus-conf-dir\") pod \"multus-crpmn\" (UID: \"9dd068b6-915e-4ffb-9552-b4b987ca19f2\") " pod="openshift-multus/multus-crpmn"
Jul 15 18:17:24.117668 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:17:24.117574    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/b62eb6ad-8f6e-4d28-aa2b-9c6579a6d52a-host\") pod \"tuned-8pv2c\" (UID: \"b62eb6ad-8f6e-4d28-aa2b-9c6579a6d52a\") " pod="openshift-cluster-node-tuning-operator/tuned-8pv2c"
Jul 15 18:17:24.118526 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:17:24.117595    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xjmll\" (UniqueName: \"kubernetes.io/projected/b62eb6ad-8f6e-4d28-aa2b-9c6579a6d52a-kube-api-access-xjmll\") pod \"tuned-8pv2c\" (UID: \"b62eb6ad-8f6e-4d28-aa2b-9c6579a6d52a\") " pod="openshift-cluster-node-tuning-operator/tuned-8pv2c"
Jul 15 18:17:24.118526 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:17:24.117602    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/2c675bc6-a2aa-458b-893e-533093fd93c1-device-dir\") pod \"aws-ebs-csi-driver-node-sk2rm\" (UID: \"2c675bc6-a2aa-458b-893e-533093fd93c1\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-sk2rm"
Jul 15 18:17:24.118526 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:17:24.117623    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-78kbn\" (UniqueName: \"kubernetes.io/projected/836f3165-610d-469b-ba6f-773aad82bf92-kube-api-access-78kbn\") pod \"node-ca-6qkk4\" (UID: \"836f3165-610d-469b-ba6f-773aad82bf92\") " pod="openshift-image-registry/node-ca-6qkk4"
Jul 15 18:17:24.118526 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:17:24.117621    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/9dd068b6-915e-4ffb-9552-b4b987ca19f2-etc-kubernetes\") pod \"multus-crpmn\" (UID: \"9dd068b6-915e-4ffb-9552-b4b987ca19f2\") " pod="openshift-multus/multus-crpmn"
Jul 15 18:17:24.118526 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:17:24.118079    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/2c675bc6-a2aa-458b-893e-533093fd93c1-socket-dir\") pod \"aws-ebs-csi-driver-node-sk2rm\" (UID: \"2c675bc6-a2aa-458b-893e-533093fd93c1\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-sk2rm"
Jul 15 18:17:24.118526 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:17:24.118207    2567 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory"
Jul 15 18:17:24.118526 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:17:24.118230    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/2c675bc6-a2aa-458b-893e-533093fd93c1-socket-dir\") pod \"aws-ebs-csi-driver-node-sk2rm\" (UID: \"2c675bc6-a2aa-458b-893e-533093fd93c1\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-sk2rm"
Jul 15 18:17:24.118526 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:17:24.118359    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/d8816772-beae-4dff-9c51-9043199e488d-host-run-netns\") pod \"ovnkube-node-8hmqx\" (UID: \"d8816772-beae-4dff-9c51-9043199e488d\") " pod="openshift-ovn-kubernetes/ovnkube-node-8hmqx"
Jul 15 18:17:24.118526 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:17:24.118397    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/d8816772-beae-4dff-9c51-9043199e488d-ovnkube-config\") pod \"ovnkube-node-8hmqx\" (UID: \"d8816772-beae-4dff-9c51-9043199e488d\") " pod="openshift-ovn-kubernetes/ovnkube-node-8hmqx"
Jul 15 18:17:24.118526 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:17:24.118459    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/d8816772-beae-4dff-9c51-9043199e488d-host-run-netns\") pod \"ovnkube-node-8hmqx\" (UID: \"d8816772-beae-4dff-9c51-9043199e488d\") " pod="openshift-ovn-kubernetes/ovnkube-node-8hmqx"
Jul 15 18:17:24.119064 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:17:24.118533    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/9dd068b6-915e-4ffb-9552-b4b987ca19f2-cni-binary-copy\") pod \"multus-crpmn\" (UID: \"9dd068b6-915e-4ffb-9552-b4b987ca19f2\") " pod="openshift-multus/multus-crpmn"
Jul 15 18:17:24.119064 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:17:24.118573    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/d8816772-beae-4dff-9c51-9043199e488d-systemd-units\") pod \"ovnkube-node-8hmqx\" (UID: \"d8816772-beae-4dff-9c51-9043199e488d\") " pod="openshift-ovn-kubernetes/ovnkube-node-8hmqx"
Jul 15 18:17:24.119064 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:17:24.118605    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/d8816772-beae-4dff-9c51-9043199e488d-env-overrides\") pod \"ovnkube-node-8hmqx\" (UID: \"d8816772-beae-4dff-9c51-9043199e488d\") " pod="openshift-ovn-kubernetes/ovnkube-node-8hmqx"
Jul 15 18:17:24.119064 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:17:24.118636    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/d8816772-beae-4dff-9c51-9043199e488d-run-openvswitch\") pod \"ovnkube-node-8hmqx\" (UID: \"d8816772-beae-4dff-9c51-9043199e488d\") " pod="openshift-ovn-kubernetes/ovnkube-node-8hmqx"
Jul 15 18:17:24.119064 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:17:24.118665    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/d8816772-beae-4dff-9c51-9043199e488d-host-cni-netd\") pod \"ovnkube-node-8hmqx\" (UID: \"d8816772-beae-4dff-9c51-9043199e488d\") " pod="openshift-ovn-kubernetes/ovnkube-node-8hmqx"
Jul 15 18:17:24.119064 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:17:24.118695    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/9dd068b6-915e-4ffb-9552-b4b987ca19f2-cnibin\") pod \"multus-crpmn\" (UID: \"9dd068b6-915e-4ffb-9552-b4b987ca19f2\") " pod="openshift-multus/multus-crpmn"
Jul 15 18:17:24.119064 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:17:24.118727    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dn4pt\" (UniqueName: \"kubernetes.io/projected/99ec9d0a-ff24-4f04-b38d-b4a7de812d3b-kube-api-access-dn4pt\") pod \"network-metrics-daemon-n88x2\" (UID: \"99ec9d0a-ff24-4f04-b38d-b4a7de812d3b\") " pod="openshift-multus/network-metrics-daemon-n88x2"
Jul 15 18:17:24.119064 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:17:24.118761    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/0d941f69-52de-4bf3-b262-9d9e07d9d730-original-pull-secret\") pod \"global-pull-secret-syncer-dqncz\" (UID: \"0d941f69-52de-4bf3-b262-9d9e07d9d730\") " pod="kube-system/global-pull-secret-syncer-dqncz"
Jul 15 18:17:24.119064 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:17:24.118796    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/420d5d86-edc6-4c35-a8b1-0501a7aa0887-iptables-alerter-script\") pod \"iptables-alerter-2hnlr\" (UID: \"420d5d86-edc6-4c35-a8b1-0501a7aa0887\") " pod="openshift-network-operator/iptables-alerter-2hnlr"
Jul 15 18:17:24.119064 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:17:24.118831    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/fd1b71f3-89f1-4883-82f3-ba2ea2037bd1-agent-certs\") pod \"konnectivity-agent-t2vtv\" (UID: \"fd1b71f3-89f1-4883-82f3-ba2ea2037bd1\") " pod="kube-system/konnectivity-agent-t2vtv"
Jul 15 18:17:24.119064 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:17:24.118879    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/d8816772-beae-4dff-9c51-9043199e488d-log-socket\") pod \"ovnkube-node-8hmqx\" (UID: \"d8816772-beae-4dff-9c51-9043199e488d\") " pod="openshift-ovn-kubernetes/ovnkube-node-8hmqx"
Jul 15 18:17:24.119064 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:17:24.118919    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/9dd068b6-915e-4ffb-9552-b4b987ca19f2-host-run-k8s-cni-cncf-io\") pod \"multus-crpmn\" (UID: \"9dd068b6-915e-4ffb-9552-b4b987ca19f2\") " pod="openshift-multus/multus-crpmn"
Jul 15 18:17:24.119064 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:17:24.118959    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/99ec9d0a-ff24-4f04-b38d-b4a7de812d3b-metrics-certs\") pod \"network-metrics-daemon-n88x2\" (UID: \"99ec9d0a-ff24-4f04-b38d-b4a7de812d3b\") " pod="openshift-multus/network-metrics-daemon-n88x2"
Jul 15 18:17:24.119064 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:17:24.119007    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/0d941f69-52de-4bf3-b262-9d9e07d9d730-kubelet-config\") pod \"global-pull-secret-syncer-dqncz\" (UID: \"0d941f69-52de-4bf3-b262-9d9e07d9d730\") " pod="kube-system/global-pull-secret-syncer-dqncz"
Jul 15 18:17:24.119064 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:17:24.119048    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cpbds\" (UniqueName: \"kubernetes.io/projected/2c675bc6-a2aa-458b-893e-533093fd93c1-kube-api-access-cpbds\") pod \"aws-ebs-csi-driver-node-sk2rm\" (UID: \"2c675bc6-a2aa-458b-893e-533093fd93c1\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-sk2rm"
Jul 15 18:17:24.119834 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:17:24.119093    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/9dd068b6-915e-4ffb-9552-b4b987ca19f2-multus-cni-dir\") pod \"multus-crpmn\" (UID: \"9dd068b6-915e-4ffb-9552-b4b987ca19f2\") " pod="openshift-multus/multus-crpmn"
Jul 15 18:17:24.119834 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:17:24.119132    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/9dd068b6-915e-4ffb-9552-b4b987ca19f2-host-var-lib-cni-multus\") pod \"multus-crpmn\" (UID: \"9dd068b6-915e-4ffb-9552-b4b987ca19f2\") " pod="openshift-multus/multus-crpmn"
Jul 15 18:17:24.119834 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:17:24.119173    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/c7dc99b8-7a42-4f46-8de8-5c36675675da-hosts-file\") pod \"node-resolver-8d7kq\" (UID: \"c7dc99b8-7a42-4f46-8de8-5c36675675da\") " pod="openshift-dns/node-resolver-8d7kq"
Jul 15 18:17:24.119834 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:17:24.119214    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/fd1b71f3-89f1-4883-82f3-ba2ea2037bd1-konnectivity-ca\") pod \"konnectivity-agent-t2vtv\" (UID: \"fd1b71f3-89f1-4883-82f3-ba2ea2037bd1\") " pod="kube-system/konnectivity-agent-t2vtv"
Jul 15 18:17:24.119834 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:17:24.119251    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/2c675bc6-a2aa-458b-893e-533093fd93c1-etc-selinux\") pod \"aws-ebs-csi-driver-node-sk2rm\" (UID: \"2c675bc6-a2aa-458b-893e-533093fd93c1\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-sk2rm"
Jul 15 18:17:24.119834 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:17:24.119338    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/d8816772-beae-4dff-9c51-9043199e488d-run-systemd\") pod \"ovnkube-node-8hmqx\" (UID: \"d8816772-beae-4dff-9c51-9043199e488d\") " pod="openshift-ovn-kubernetes/ovnkube-node-8hmqx"
Jul 15 18:17:24.119834 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:17:24.119371    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/d8816772-beae-4dff-9c51-9043199e488d-ovn-node-metrics-cert\") pod \"ovnkube-node-8hmqx\" (UID: \"d8816772-beae-4dff-9c51-9043199e488d\") " pod="openshift-ovn-kubernetes/ovnkube-node-8hmqx"
Jul 15 18:17:24.119834 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:17:24.119392    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/d8816772-beae-4dff-9c51-9043199e488d-run-openvswitch\") pod \"ovnkube-node-8hmqx\" (UID: \"d8816772-beae-4dff-9c51-9043199e488d\") " pod="openshift-ovn-kubernetes/ovnkube-node-8hmqx"
Jul 15 18:17:24.119834 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:17:24.119405    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/b4008ec9-cbff-43c2-905e-abd5cf63c321-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-d6rg2\" (UID: \"b4008ec9-cbff-43c2-905e-abd5cf63c321\") " pod="openshift-multus/multus-additional-cni-plugins-d6rg2"
Jul 15 18:17:24.119834 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:17:24.119447    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/b4008ec9-cbff-43c2-905e-abd5cf63c321-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-d6rg2\" (UID: \"b4008ec9-cbff-43c2-905e-abd5cf63c321\") " pod="openshift-multus/multus-additional-cni-plugins-d6rg2"
Jul 15 18:17:24.119834 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:17:24.119470    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/9dd068b6-915e-4ffb-9552-b4b987ca19f2-host-run-multus-certs\") pod \"multus-crpmn\" (UID: \"9dd068b6-915e-4ffb-9552-b4b987ca19f2\") " pod="openshift-multus/multus-crpmn"
Jul 15 18:17:24.119834 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:17:24.119494    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/d8816772-beae-4dff-9c51-9043199e488d-etc-openvswitch\") pod \"ovnkube-node-8hmqx\" (UID: \"d8816772-beae-4dff-9c51-9043199e488d\") " pod="openshift-ovn-kubernetes/ovnkube-node-8hmqx"
Jul 15 18:17:24.119834 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:17:24.119515    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/d8816772-beae-4dff-9c51-9043199e488d-run-ovn\") pod \"ovnkube-node-8hmqx\" (UID: \"d8816772-beae-4dff-9c51-9043199e488d\") " pod="openshift-ovn-kubernetes/ovnkube-node-8hmqx"
Jul 15 18:17:24.119834 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:17:24.119535    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/d8816772-beae-4dff-9c51-9043199e488d-host-cni-bin\") pod \"ovnkube-node-8hmqx\" (UID: \"d8816772-beae-4dff-9c51-9043199e488d\") " pod="openshift-ovn-kubernetes/ovnkube-node-8hmqx"
Jul 15 18:17:24.119834 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:17:24.119552    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/d8816772-beae-4dff-9c51-9043199e488d-ovnkube-script-lib\") pod \"ovnkube-node-8hmqx\" (UID: \"d8816772-beae-4dff-9c51-9043199e488d\") " pod="openshift-ovn-kubernetes/ovnkube-node-8hmqx"
Jul 15 18:17:24.119834 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:17:24.119558    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/9dd068b6-915e-4ffb-9552-b4b987ca19f2-cni-binary-copy\") pod \"multus-crpmn\" (UID: \"9dd068b6-915e-4ffb-9552-b4b987ca19f2\") " pod="openshift-multus/multus-crpmn"
Jul 15 18:17:24.119834 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:17:24.119577    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-njxzx\" (UniqueName: \"kubernetes.io/projected/d8816772-beae-4dff-9c51-9043199e488d-kube-api-access-njxzx\") pod \"ovnkube-node-8hmqx\" (UID: \"d8816772-beae-4dff-9c51-9043199e488d\") " pod="openshift-ovn-kubernetes/ovnkube-node-8hmqx"
Jul 15 18:17:24.120640 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:17:24.119598    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/b4008ec9-cbff-43c2-905e-abd5cf63c321-tuning-conf-dir\") pod \"multus-additional-cni-plugins-d6rg2\" (UID: \"b4008ec9-cbff-43c2-905e-abd5cf63c321\") " pod="openshift-multus/multus-additional-cni-plugins-d6rg2"
Jul 15 18:17:24.120640 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:17:24.119619    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/9dd068b6-915e-4ffb-9552-b4b987ca19f2-host-var-lib-cni-bin\") pod \"multus-crpmn\" (UID: \"9dd068b6-915e-4ffb-9552-b4b987ca19f2\") " pod="openshift-multus/multus-crpmn"
Jul 15 18:17:24.120640 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:17:24.119644    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/b4008ec9-cbff-43c2-905e-abd5cf63c321-cni-binary-copy\") pod \"multus-additional-cni-plugins-d6rg2\" (UID: \"b4008ec9-cbff-43c2-905e-abd5cf63c321\") " pod="openshift-multus/multus-additional-cni-plugins-d6rg2"
Jul 15 18:17:24.120640 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:17:24.119666    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/9dd068b6-915e-4ffb-9552-b4b987ca19f2-host-var-lib-kubelet\") pod \"multus-crpmn\" (UID: \"9dd068b6-915e-4ffb-9552-b4b987ca19f2\") " pod="openshift-multus/multus-crpmn"
Jul 15 18:17:24.120640 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:17:24.119687    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/b62eb6ad-8f6e-4d28-aa2b-9c6579a6d52a-etc-sysconfig\") pod \"tuned-8pv2c\" (UID: \"b62eb6ad-8f6e-4d28-aa2b-9c6579a6d52a\") " pod="openshift-cluster-node-tuning-operator/tuned-8pv2c"
Jul 15 18:17:24.120640 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:17:24.119704    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/b62eb6ad-8f6e-4d28-aa2b-9c6579a6d52a-etc-kubernetes\") pod \"tuned-8pv2c\" (UID: \"b62eb6ad-8f6e-4d28-aa2b-9c6579a6d52a\") " pod="openshift-cluster-node-tuning-operator/tuned-8pv2c"
Jul 15 18:17:24.120640 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:17:24.119724    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/b62eb6ad-8f6e-4d28-aa2b-9c6579a6d52a-etc-sysctl-d\") pod \"tuned-8pv2c\" (UID: \"b62eb6ad-8f6e-4d28-aa2b-9c6579a6d52a\") " pod="openshift-cluster-node-tuning-operator/tuned-8pv2c"
Jul 15 18:17:24.120640 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:17:24.119751    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/b62eb6ad-8f6e-4d28-aa2b-9c6579a6d52a-etc-sysctl-conf\") pod \"tuned-8pv2c\" (UID: \"b62eb6ad-8f6e-4d28-aa2b-9c6579a6d52a\") " pod="openshift-cluster-node-tuning-operator/tuned-8pv2c"
Jul 15 18:17:24.120640 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:17:24.119770    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/b62eb6ad-8f6e-4d28-aa2b-9c6579a6d52a-sys\") pod \"tuned-8pv2c\" (UID: \"b62eb6ad-8f6e-4d28-aa2b-9c6579a6d52a\") " pod="openshift-cluster-node-tuning-operator/tuned-8pv2c"
Jul 15 18:17:24.120640 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:17:24.119787    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/b62eb6ad-8f6e-4d28-aa2b-9c6579a6d52a-run\") pod \"tuned-8pv2c\" (UID: \"b62eb6ad-8f6e-4d28-aa2b-9c6579a6d52a\") " pod="openshift-cluster-node-tuning-operator/tuned-8pv2c"
Jul 15 18:17:24.120640 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:17:24.119797    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/d8816772-beae-4dff-9c51-9043199e488d-host-cni-netd\") pod \"ovnkube-node-8hmqx\" (UID: \"d8816772-beae-4dff-9c51-9043199e488d\") " pod="openshift-ovn-kubernetes/ovnkube-node-8hmqx"
Jul 15 18:17:24.120640 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:17:24.119807    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/d8816772-beae-4dff-9c51-9043199e488d-host-run-ovn-kubernetes\") pod \"ovnkube-node-8hmqx\" (UID: \"d8816772-beae-4dff-9c51-9043199e488d\") " pod="openshift-ovn-kubernetes/ovnkube-node-8hmqx"
Jul 15 18:17:24.120640 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:17:24.119831    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/d8816772-beae-4dff-9c51-9043199e488d-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-8hmqx\" (UID: \"d8816772-beae-4dff-9c51-9043199e488d\") " pod="openshift-ovn-kubernetes/ovnkube-node-8hmqx"
Jul 15 18:17:24.120640 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:17:24.119929    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/b4008ec9-cbff-43c2-905e-abd5cf63c321-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-d6rg2\" (UID: \"b4008ec9-cbff-43c2-905e-abd5cf63c321\") " pod="openshift-multus/multus-additional-cni-plugins-d6rg2"
Jul 15 18:17:24.120640 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:17:24.119008    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/d8816772-beae-4dff-9c51-9043199e488d-ovnkube-config\") pod \"ovnkube-node-8hmqx\" (UID: \"d8816772-beae-4dff-9c51-9043199e488d\") " pod="openshift-ovn-kubernetes/ovnkube-node-8hmqx"
Jul 15 18:17:24.121381 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:17:24.120905    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/9dd068b6-915e-4ffb-9552-b4b987ca19f2-cnibin\") pod \"multus-crpmn\" (UID: \"9dd068b6-915e-4ffb-9552-b4b987ca19f2\") " pod="openshift-multus/multus-crpmn"
Jul 15 18:17:24.121381 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:17:24.120929    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/9dd068b6-915e-4ffb-9552-b4b987ca19f2-host-var-lib-cni-bin\") pod \"multus-crpmn\" (UID: \"9dd068b6-915e-4ffb-9552-b4b987ca19f2\") " pod="openshift-multus/multus-crpmn"
Jul 15 18:17:24.121381 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:17:24.120948    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/9dd068b6-915e-4ffb-9552-b4b987ca19f2-host-var-lib-cni-multus\") pod \"multus-crpmn\" (UID: \"9dd068b6-915e-4ffb-9552-b4b987ca19f2\") " pod="openshift-multus/multus-crpmn"
Jul 15 18:17:24.121381 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:17:24.121047    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/9dd068b6-915e-4ffb-9552-b4b987ca19f2-multus-cni-dir\") pod \"multus-crpmn\" (UID: \"9dd068b6-915e-4ffb-9552-b4b987ca19f2\") " pod="openshift-multus/multus-crpmn"
Jul 15 18:17:24.121381 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:17:24.121203    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/c7dc99b8-7a42-4f46-8de8-5c36675675da-hosts-file\") pod \"node-resolver-8d7kq\" (UID: \"c7dc99b8-7a42-4f46-8de8-5c36675675da\") " pod="openshift-dns/node-resolver-8d7kq"
Jul 15 18:17:24.121381 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:17:24.121207    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/b4008ec9-cbff-43c2-905e-abd5cf63c321-tuning-conf-dir\") pod \"multus-additional-cni-plugins-d6rg2\" (UID: \"b4008ec9-cbff-43c2-905e-abd5cf63c321\") " pod="openshift-multus/multus-additional-cni-plugins-d6rg2"
Jul 15 18:17:24.121381 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:17:24.121267    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/d8816772-beae-4dff-9c51-9043199e488d-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-8hmqx\" (UID: \"d8816772-beae-4dff-9c51-9043199e488d\") " pod="openshift-ovn-kubernetes/ovnkube-node-8hmqx"
Jul 15 18:17:24.121381 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:17:24.121331    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/d8816772-beae-4dff-9c51-9043199e488d-systemd-units\") pod \"ovnkube-node-8hmqx\" (UID: \"d8816772-beae-4dff-9c51-9043199e488d\") " pod="openshift-ovn-kubernetes/ovnkube-node-8hmqx"
Jul 15 18:17:24.121840 ip-10-0-141-171 kubenswrapper[2567]: E0715 18:17:24.121415    2567 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 15 18:17:24.121840 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:17:24.121490    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/b4008ec9-cbff-43c2-905e-abd5cf63c321-cni-binary-copy\") pod \"multus-additional-cni-plugins-d6rg2\" (UID: \"b4008ec9-cbff-43c2-905e-abd5cf63c321\") " pod="openshift-multus/multus-additional-cni-plugins-d6rg2"
Jul 15 18:17:24.121840 ip-10-0-141-171 kubenswrapper[2567]: E0715 18:17:24.121554    2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0d941f69-52de-4bf3-b262-9d9e07d9d730-original-pull-secret podName:0d941f69-52de-4bf3-b262-9d9e07d9d730 nodeName:}" failed. No retries permitted until 2026-07-15 18:17:24.621523121 +0000 UTC m=+3.155946479 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/0d941f69-52de-4bf3-b262-9d9e07d9d730-original-pull-secret") pod "global-pull-secret-syncer-dqncz" (UID: "0d941f69-52de-4bf3-b262-9d9e07d9d730") : object "kube-system"/"original-pull-secret" not registered
Jul 15 18:17:24.121840 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:17:24.121554    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/d8816772-beae-4dff-9c51-9043199e488d-etc-openvswitch\") pod \"ovnkube-node-8hmqx\" (UID: \"d8816772-beae-4dff-9c51-9043199e488d\") " pod="openshift-ovn-kubernetes/ovnkube-node-8hmqx"
Jul 15 18:17:24.121840 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:17:24.121700    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/b62eb6ad-8f6e-4d28-aa2b-9c6579a6d52a-etc-sysctl-conf\") pod \"tuned-8pv2c\" (UID: \"b62eb6ad-8f6e-4d28-aa2b-9c6579a6d52a\") " pod="openshift-cluster-node-tuning-operator/tuned-8pv2c"
Jul 15 18:17:24.121840 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:17:24.121739    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/fd1b71f3-89f1-4883-82f3-ba2ea2037bd1-konnectivity-ca\") pod \"konnectivity-agent-t2vtv\" (UID: \"fd1b71f3-89f1-4883-82f3-ba2ea2037bd1\") " pod="kube-system/konnectivity-agent-t2vtv"
Jul 15 18:17:24.121840 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:17:24.121747    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/d8816772-beae-4dff-9c51-9043199e488d-run-ovn\") pod \"ovnkube-node-8hmqx\" (UID: \"d8816772-beae-4dff-9c51-9043199e488d\") " pod="openshift-ovn-kubernetes/ovnkube-node-8hmqx"
Jul 15 18:17:24.122209 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:17:24.121916    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/d8816772-beae-4dff-9c51-9043199e488d-env-overrides\") pod \"ovnkube-node-8hmqx\" (UID: \"d8816772-beae-4dff-9c51-9043199e488d\") " pod="openshift-ovn-kubernetes/ovnkube-node-8hmqx"
Jul 15 18:17:24.122209 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:17:24.121949    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/d8816772-beae-4dff-9c51-9043199e488d-run-systemd\") pod \"ovnkube-node-8hmqx\" (UID: \"d8816772-beae-4dff-9c51-9043199e488d\") " pod="openshift-ovn-kubernetes/ovnkube-node-8hmqx"
Jul 15 18:17:24.123873 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:17:24.122411    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/2c675bc6-a2aa-458b-893e-533093fd93c1-etc-selinux\") pod \"aws-ebs-csi-driver-node-sk2rm\" (UID: \"2c675bc6-a2aa-458b-893e-533093fd93c1\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-sk2rm"
Jul 15 18:17:24.123873 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:17:24.122418    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/b4008ec9-cbff-43c2-905e-abd5cf63c321-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-d6rg2\" (UID: \"b4008ec9-cbff-43c2-905e-abd5cf63c321\") " pod="openshift-multus/multus-additional-cni-plugins-d6rg2"
Jul 15 18:17:24.123873 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:17:24.122480    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/b62eb6ad-8f6e-4d28-aa2b-9c6579a6d52a-sys\") pod \"tuned-8pv2c\" (UID: \"b62eb6ad-8f6e-4d28-aa2b-9c6579a6d52a\") " pod="openshift-cluster-node-tuning-operator/tuned-8pv2c"
Jul 15 18:17:24.123873 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:17:24.122511    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/b62eb6ad-8f6e-4d28-aa2b-9c6579a6d52a-run\") pod \"tuned-8pv2c\" (UID: \"b62eb6ad-8f6e-4d28-aa2b-9c6579a6d52a\") " pod="openshift-cluster-node-tuning-operator/tuned-8pv2c"
Jul 15 18:17:24.123873 ip-10-0-141-171 kubenswrapper[2567]: E0715 18:17:24.122608    2567 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 15 18:17:24.123873 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:17:24.122664    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/d8816772-beae-4dff-9c51-9043199e488d-host-run-ovn-kubernetes\") pod \"ovnkube-node-8hmqx\" (UID: \"d8816772-beae-4dff-9c51-9043199e488d\") " pod="openshift-ovn-kubernetes/ovnkube-node-8hmqx"
Jul 15 18:17:24.123873 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:17:24.122703    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/d8816772-beae-4dff-9c51-9043199e488d-log-socket\") pod \"ovnkube-node-8hmqx\" (UID: \"d8816772-beae-4dff-9c51-9043199e488d\") " pod="openshift-ovn-kubernetes/ovnkube-node-8hmqx"
Jul 15 18:17:24.123873 ip-10-0-141-171 kubenswrapper[2567]: E0715 18:17:24.122724    2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/99ec9d0a-ff24-4f04-b38d-b4a7de812d3b-metrics-certs podName:99ec9d0a-ff24-4f04-b38d-b4a7de812d3b nodeName:}" failed. No retries permitted until 2026-07-15 18:17:24.622706603 +0000 UTC m=+3.157129954 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/99ec9d0a-ff24-4f04-b38d-b4a7de812d3b-metrics-certs") pod "network-metrics-daemon-n88x2" (UID: "99ec9d0a-ff24-4f04-b38d-b4a7de812d3b") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 15 18:17:24.123873 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:17:24.122728    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/b62eb6ad-8f6e-4d28-aa2b-9c6579a6d52a-etc-kubernetes\") pod \"tuned-8pv2c\" (UID: \"b62eb6ad-8f6e-4d28-aa2b-9c6579a6d52a\") " pod="openshift-cluster-node-tuning-operator/tuned-8pv2c"
Jul 15 18:17:24.123873 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:17:24.122755    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/b62eb6ad-8f6e-4d28-aa2b-9c6579a6d52a-etc-sysconfig\") pod \"tuned-8pv2c\" (UID: \"b62eb6ad-8f6e-4d28-aa2b-9c6579a6d52a\") " pod="openshift-cluster-node-tuning-operator/tuned-8pv2c"
Jul 15 18:17:24.123873 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:17:24.122763    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/9dd068b6-915e-4ffb-9552-b4b987ca19f2-multus-socket-dir-parent\") pod \"multus-crpmn\" (UID: \"9dd068b6-915e-4ffb-9552-b4b987ca19f2\") " pod="openshift-multus/multus-crpmn"
Jul 15 18:17:24.123873 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:17:24.122773    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/9dd068b6-915e-4ffb-9552-b4b987ca19f2-host-run-k8s-cni-cncf-io\") pod \"multus-crpmn\" (UID: \"9dd068b6-915e-4ffb-9552-b4b987ca19f2\") " pod="openshift-multus/multus-crpmn"
Jul 15 18:17:24.123873 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:17:24.122808    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/b62eb6ad-8f6e-4d28-aa2b-9c6579a6d52a-etc-systemd\") pod \"tuned-8pv2c\" (UID: \"b62eb6ad-8f6e-4d28-aa2b-9c6579a6d52a\") " pod="openshift-cluster-node-tuning-operator/tuned-8pv2c"
Jul 15 18:17:24.123873 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:17:24.122831    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/d8816772-beae-4dff-9c51-9043199e488d-host-cni-bin\") pod \"ovnkube-node-8hmqx\" (UID: \"d8816772-beae-4dff-9c51-9043199e488d\") " pod="openshift-ovn-kubernetes/ovnkube-node-8hmqx"
Jul 15 18:17:24.123873 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:17:24.122844    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/b62eb6ad-8f6e-4d28-aa2b-9c6579a6d52a-var-lib-kubelet\") pod \"tuned-8pv2c\" (UID: \"b62eb6ad-8f6e-4d28-aa2b-9c6579a6d52a\") " pod="openshift-cluster-node-tuning-operator/tuned-8pv2c"
Jul 15 18:17:24.123873 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:17:24.122868    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/9dd068b6-915e-4ffb-9552-b4b987ca19f2-host-run-multus-certs\") pod \"multus-crpmn\" (UID: \"9dd068b6-915e-4ffb-9552-b4b987ca19f2\") " pod="openshift-multus/multus-crpmn"
Jul 15 18:17:24.123873 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:17:24.122873    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/0d941f69-52de-4bf3-b262-9d9e07d9d730-kubelet-config\") pod \"global-pull-secret-syncer-dqncz\" (UID: \"0d941f69-52de-4bf3-b262-9d9e07d9d730\") " pod="kube-system/global-pull-secret-syncer-dqncz"
Jul 15 18:17:24.124832 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:17:24.122936    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/9dd068b6-915e-4ffb-9552-b4b987ca19f2-host-var-lib-kubelet\") pod \"multus-crpmn\" (UID: \"9dd068b6-915e-4ffb-9552-b4b987ca19f2\") " pod="openshift-multus/multus-crpmn"
Jul 15 18:17:24.124832 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:17:24.122987    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/b62eb6ad-8f6e-4d28-aa2b-9c6579a6d52a-etc-tuned\") pod \"tuned-8pv2c\" (UID: \"b62eb6ad-8f6e-4d28-aa2b-9c6579a6d52a\") " pod="openshift-cluster-node-tuning-operator/tuned-8pv2c"
Jul 15 18:17:24.124832 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:17:24.123097    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/b62eb6ad-8f6e-4d28-aa2b-9c6579a6d52a-etc-sysctl-d\") pod \"tuned-8pv2c\" (UID: \"b62eb6ad-8f6e-4d28-aa2b-9c6579a6d52a\") " pod="openshift-cluster-node-tuning-operator/tuned-8pv2c"
Jul 15 18:17:24.124832 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:17:24.123146    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/b62eb6ad-8f6e-4d28-aa2b-9c6579a6d52a-var-lib-kubelet\") pod \"tuned-8pv2c\" (UID: \"b62eb6ad-8f6e-4d28-aa2b-9c6579a6d52a\") " pod="openshift-cluster-node-tuning-operator/tuned-8pv2c"
Jul 15 18:17:24.124832 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:17:24.123225    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/b62eb6ad-8f6e-4d28-aa2b-9c6579a6d52a-etc-systemd\") pod \"tuned-8pv2c\" (UID: \"b62eb6ad-8f6e-4d28-aa2b-9c6579a6d52a\") " pod="openshift-cluster-node-tuning-operator/tuned-8pv2c"
Jul 15 18:17:24.124832 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:17:24.123274    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/9dd068b6-915e-4ffb-9552-b4b987ca19f2-multus-socket-dir-parent\") pod \"multus-crpmn\" (UID: \"9dd068b6-915e-4ffb-9552-b4b987ca19f2\") " pod="openshift-multus/multus-crpmn"
Jul 15 18:17:24.124832 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:17:24.123289    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-g4s7n\" (UniqueName: \"kubernetes.io/projected/420d5d86-edc6-4c35-a8b1-0501a7aa0887-kube-api-access-g4s7n\") pod \"iptables-alerter-2hnlr\" (UID: \"420d5d86-edc6-4c35-a8b1-0501a7aa0887\") " pod="openshift-network-operator/iptables-alerter-2hnlr"
Jul 15 18:17:24.124832 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:17:24.123348    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/b4008ec9-cbff-43c2-905e-abd5cf63c321-cnibin\") pod \"multus-additional-cni-plugins-d6rg2\" (UID: \"b4008ec9-cbff-43c2-905e-abd5cf63c321\") " pod="openshift-multus/multus-additional-cni-plugins-d6rg2"
Jul 15 18:17:24.124832 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:17:24.123381    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lllr6\" (UniqueName: \"kubernetes.io/projected/b4008ec9-cbff-43c2-905e-abd5cf63c321-kube-api-access-lllr6\") pod \"multus-additional-cni-plugins-d6rg2\" (UID: \"b4008ec9-cbff-43c2-905e-abd5cf63c321\") " pod="openshift-multus/multus-additional-cni-plugins-d6rg2"
Jul 15 18:17:24.124832 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:17:24.123426    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c7dc99b8-7a42-4f46-8de8-5c36675675da-tmp-dir\") pod \"node-resolver-8d7kq\" (UID: \"c7dc99b8-7a42-4f46-8de8-5c36675675da\") " pod="openshift-dns/node-resolver-8d7kq"
Jul 15 18:17:24.124832 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:17:24.123460    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jfzc4\" (UniqueName: \"kubernetes.io/projected/c7dc99b8-7a42-4f46-8de8-5c36675675da-kube-api-access-jfzc4\") pod \"node-resolver-8d7kq\" (UID: \"c7dc99b8-7a42-4f46-8de8-5c36675675da\") " pod="openshift-dns/node-resolver-8d7kq"
Jul 15 18:17:24.124832 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:17:24.123491    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/836f3165-610d-469b-ba6f-773aad82bf92-serviceca\") pod \"node-ca-6qkk4\" (UID: \"836f3165-610d-469b-ba6f-773aad82bf92\") " pod="openshift-image-registry/node-ca-6qkk4"
Jul 15 18:17:24.124832 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:17:24.123519    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/2c675bc6-a2aa-458b-893e-533093fd93c1-kubelet-dir\") pod \"aws-ebs-csi-driver-node-sk2rm\" (UID: \"2c675bc6-a2aa-458b-893e-533093fd93c1\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-sk2rm"
Jul 15 18:17:24.124832 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:17:24.123523    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/420d5d86-edc6-4c35-a8b1-0501a7aa0887-iptables-alerter-script\") pod \"iptables-alerter-2hnlr\" (UID: \"420d5d86-edc6-4c35-a8b1-0501a7aa0887\") " pod="openshift-network-operator/iptables-alerter-2hnlr"
Jul 15 18:17:24.124832 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:17:24.123552    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/d8816772-beae-4dff-9c51-9043199e488d-host-slash\") pod \"ovnkube-node-8hmqx\" (UID: \"d8816772-beae-4dff-9c51-9043199e488d\") " pod="openshift-ovn-kubernetes/ovnkube-node-8hmqx"
Jul 15 18:17:24.124832 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:17:24.123588    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/d8816772-beae-4dff-9c51-9043199e488d-node-log\") pod \"ovnkube-node-8hmqx\" (UID: \"d8816772-beae-4dff-9c51-9043199e488d\") " pod="openshift-ovn-kubernetes/ovnkube-node-8hmqx"
Jul 15 18:17:24.124832 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:17:24.123620    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/9dd068b6-915e-4ffb-9552-b4b987ca19f2-multus-daemon-config\") pod \"multus-crpmn\" (UID: \"9dd068b6-915e-4ffb-9552-b4b987ca19f2\") " pod="openshift-multus/multus-crpmn"
Jul 15 18:17:24.125694 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:17:24.123655    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pjq5n\" (UniqueName: \"kubernetes.io/projected/b4f54a92-c72a-4f20-93f7-7b424f8f2656-kube-api-access-pjq5n\") pod \"network-check-target-4lm4m\" (UID: \"b4f54a92-c72a-4f20-93f7-7b424f8f2656\") " pod="openshift-network-diagnostics/network-check-target-4lm4m"
Jul 15 18:17:24.125694 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:17:24.123687    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/2c675bc6-a2aa-458b-893e-533093fd93c1-sys-fs\") pod \"aws-ebs-csi-driver-node-sk2rm\" (UID: \"2c675bc6-a2aa-458b-893e-533093fd93c1\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-sk2rm"
Jul 15 18:17:24.125694 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:17:24.123719    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/d8816772-beae-4dff-9c51-9043199e488d-host-kubelet\") pod \"ovnkube-node-8hmqx\" (UID: \"d8816772-beae-4dff-9c51-9043199e488d\") " pod="openshift-ovn-kubernetes/ovnkube-node-8hmqx"
Jul 15 18:17:24.125694 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:17:24.123749    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/9dd068b6-915e-4ffb-9552-b4b987ca19f2-os-release\") pod \"multus-crpmn\" (UID: \"9dd068b6-915e-4ffb-9552-b4b987ca19f2\") " pod="openshift-multus/multus-crpmn"
Jul 15 18:17:24.125694 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:17:24.123782    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7k9ch\" (UniqueName: \"kubernetes.io/projected/9dd068b6-915e-4ffb-9552-b4b987ca19f2-kube-api-access-7k9ch\") pod \"multus-crpmn\" (UID: \"9dd068b6-915e-4ffb-9552-b4b987ca19f2\") " pod="openshift-multus/multus-crpmn"
Jul 15 18:17:24.125694 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:17:24.123815    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/b62eb6ad-8f6e-4d28-aa2b-9c6579a6d52a-etc-modprobe-d\") pod \"tuned-8pv2c\" (UID: \"b62eb6ad-8f6e-4d28-aa2b-9c6579a6d52a\") " pod="openshift-cluster-node-tuning-operator/tuned-8pv2c"
Jul 15 18:17:24.125694 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:17:24.123844    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/b62eb6ad-8f6e-4d28-aa2b-9c6579a6d52a-lib-modules\") pod \"tuned-8pv2c\" (UID: \"b62eb6ad-8f6e-4d28-aa2b-9c6579a6d52a\") " pod="openshift-cluster-node-tuning-operator/tuned-8pv2c"
Jul 15 18:17:24.125694 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:17:24.123879    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/0d941f69-52de-4bf3-b262-9d9e07d9d730-dbus\") pod \"global-pull-secret-syncer-dqncz\" (UID: \"0d941f69-52de-4bf3-b262-9d9e07d9d730\") " pod="kube-system/global-pull-secret-syncer-dqncz"
Jul 15 18:17:24.125694 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:17:24.124062    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/0d941f69-52de-4bf3-b262-9d9e07d9d730-dbus\") pod \"global-pull-secret-syncer-dqncz\" (UID: \"0d941f69-52de-4bf3-b262-9d9e07d9d730\") " pod="kube-system/global-pull-secret-syncer-dqncz"
Jul 15 18:17:24.125694 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:17:24.124270    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/d8816772-beae-4dff-9c51-9043199e488d-node-log\") pod \"ovnkube-node-8hmqx\" (UID: \"d8816772-beae-4dff-9c51-9043199e488d\") " pod="openshift-ovn-kubernetes/ovnkube-node-8hmqx"
Jul 15 18:17:24.125694 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:17:24.124365    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/b4008ec9-cbff-43c2-905e-abd5cf63c321-cnibin\") pod \"multus-additional-cni-plugins-d6rg2\" (UID: \"b4008ec9-cbff-43c2-905e-abd5cf63c321\") " pod="openshift-multus/multus-additional-cni-plugins-d6rg2"
Jul 15 18:17:24.125694 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:17:24.124585    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/9dd068b6-915e-4ffb-9552-b4b987ca19f2-os-release\") pod \"multus-crpmn\" (UID: \"9dd068b6-915e-4ffb-9552-b4b987ca19f2\") " pod="openshift-multus/multus-crpmn"
Jul 15 18:17:24.125694 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:17:24.124871    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/9dd068b6-915e-4ffb-9552-b4b987ca19f2-multus-daemon-config\") pod \"multus-crpmn\" (UID: \"9dd068b6-915e-4ffb-9552-b4b987ca19f2\") " pod="openshift-multus/multus-crpmn"
Jul 15 18:17:24.125694 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:17:24.124923    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/2c675bc6-a2aa-458b-893e-533093fd93c1-sys-fs\") pod \"aws-ebs-csi-driver-node-sk2rm\" (UID: \"2c675bc6-a2aa-458b-893e-533093fd93c1\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-sk2rm"
Jul 15 18:17:24.125694 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:17:24.125058    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/d8816772-beae-4dff-9c51-9043199e488d-host-kubelet\") pod \"ovnkube-node-8hmqx\" (UID: \"d8816772-beae-4dff-9c51-9043199e488d\") " pod="openshift-ovn-kubernetes/ovnkube-node-8hmqx"
Jul 15 18:17:24.125694 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:17:24.125092    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/b62eb6ad-8f6e-4d28-aa2b-9c6579a6d52a-etc-modprobe-d\") pod \"tuned-8pv2c\" (UID: \"b62eb6ad-8f6e-4d28-aa2b-9c6579a6d52a\") " pod="openshift-cluster-node-tuning-operator/tuned-8pv2c"
Jul 15 18:17:24.125694 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:17:24.125186    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c7dc99b8-7a42-4f46-8de8-5c36675675da-tmp-dir\") pod \"node-resolver-8d7kq\" (UID: \"c7dc99b8-7a42-4f46-8de8-5c36675675da\") " pod="openshift-dns/node-resolver-8d7kq"
Jul 15 18:17:24.125694 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:17:24.125221    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/b62eb6ad-8f6e-4d28-aa2b-9c6579a6d52a-lib-modules\") pod \"tuned-8pv2c\" (UID: \"b62eb6ad-8f6e-4d28-aa2b-9c6579a6d52a\") " pod="openshift-cluster-node-tuning-operator/tuned-8pv2c"
Jul 15 18:17:24.126615 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:17:24.125250    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/2c675bc6-a2aa-458b-893e-533093fd93c1-kubelet-dir\") pod \"aws-ebs-csi-driver-node-sk2rm\" (UID: \"2c675bc6-a2aa-458b-893e-533093fd93c1\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-sk2rm"
Jul 15 18:17:24.126615 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:17:24.125286    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/d8816772-beae-4dff-9c51-9043199e488d-host-slash\") pod \"ovnkube-node-8hmqx\" (UID: \"d8816772-beae-4dff-9c51-9043199e488d\") " pod="openshift-ovn-kubernetes/ovnkube-node-8hmqx"
Jul 15 18:17:24.126615 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:17:24.125678    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/836f3165-610d-469b-ba6f-773aad82bf92-serviceca\") pod \"node-ca-6qkk4\" (UID: \"836f3165-610d-469b-ba6f-773aad82bf92\") " pod="openshift-image-registry/node-ca-6qkk4"
Jul 15 18:17:24.126615 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:17:24.125816    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/b62eb6ad-8f6e-4d28-aa2b-9c6579a6d52a-etc-tuned\") pod \"tuned-8pv2c\" (UID: \"b62eb6ad-8f6e-4d28-aa2b-9c6579a6d52a\") " pod="openshift-cluster-node-tuning-operator/tuned-8pv2c"
Jul 15 18:17:24.126615 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:17:24.125864    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/fd1b71f3-89f1-4883-82f3-ba2ea2037bd1-agent-certs\") pod \"konnectivity-agent-t2vtv\" (UID: \"fd1b71f3-89f1-4883-82f3-ba2ea2037bd1\") " pod="kube-system/konnectivity-agent-t2vtv"
Jul 15 18:17:24.126615 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:17:24.126277    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/b62eb6ad-8f6e-4d28-aa2b-9c6579a6d52a-tmp\") pod \"tuned-8pv2c\" (UID: \"b62eb6ad-8f6e-4d28-aa2b-9c6579a6d52a\") " pod="openshift-cluster-node-tuning-operator/tuned-8pv2c"
Jul 15 18:17:24.126615 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:17:24.126276    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/d8816772-beae-4dff-9c51-9043199e488d-ovn-node-metrics-cert\") pod \"ovnkube-node-8hmqx\" (UID: \"d8816772-beae-4dff-9c51-9043199e488d\") " pod="openshift-ovn-kubernetes/ovnkube-node-8hmqx"
Jul 15 18:17:24.126615 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:17:24.126392    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/d8816772-beae-4dff-9c51-9043199e488d-ovnkube-script-lib\") pod \"ovnkube-node-8hmqx\" (UID: \"d8816772-beae-4dff-9c51-9043199e488d\") " pod="openshift-ovn-kubernetes/ovnkube-node-8hmqx"
Jul 15 18:17:24.127711 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:17:24.127691    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-78kbn\" (UniqueName: \"kubernetes.io/projected/836f3165-610d-469b-ba6f-773aad82bf92-kube-api-access-78kbn\") pod \"node-ca-6qkk4\" (UID: \"836f3165-610d-469b-ba6f-773aad82bf92\") " pod="openshift-image-registry/node-ca-6qkk4"
Jul 15 18:17:24.128153 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:17:24.128131    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xjmll\" (UniqueName: \"kubernetes.io/projected/b62eb6ad-8f6e-4d28-aa2b-9c6579a6d52a-kube-api-access-xjmll\") pod \"tuned-8pv2c\" (UID: \"b62eb6ad-8f6e-4d28-aa2b-9c6579a6d52a\") " pod="openshift-cluster-node-tuning-operator/tuned-8pv2c"
Jul 15 18:17:24.134156 ip-10-0-141-171 kubenswrapper[2567]: E0715 18:17:24.134139    2567 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 15 18:17:24.134156 ip-10-0-141-171 kubenswrapper[2567]: E0715 18:17:24.134159    2567 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 15 18:17:24.134324 ip-10-0-141-171 kubenswrapper[2567]: E0715 18:17:24.134169    2567 projected.go:196] Error preparing data for projected volume kube-api-access-pjq5n for pod openshift-network-diagnostics/network-check-target-4lm4m: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 15 18:17:24.134324 ip-10-0-141-171 kubenswrapper[2567]: E0715 18:17:24.134255    2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/b4f54a92-c72a-4f20-93f7-7b424f8f2656-kube-api-access-pjq5n podName:b4f54a92-c72a-4f20-93f7-7b424f8f2656 nodeName:}" failed. No retries permitted until 2026-07-15 18:17:24.6342236 +0000 UTC m=+3.168646941 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-pjq5n" (UniqueName: "kubernetes.io/projected/b4f54a92-c72a-4f20-93f7-7b424f8f2656-kube-api-access-pjq5n") pod "network-check-target-4lm4m" (UID: "b4f54a92-c72a-4f20-93f7-7b424f8f2656") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 15 18:17:24.134469 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:17:24.134443    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-cpbds\" (UniqueName: \"kubernetes.io/projected/2c675bc6-a2aa-458b-893e-533093fd93c1-kube-api-access-cpbds\") pod \"aws-ebs-csi-driver-node-sk2rm\" (UID: \"2c675bc6-a2aa-458b-893e-533093fd93c1\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-sk2rm"
Jul 15 18:17:24.135854 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:17:24.135817    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dn4pt\" (UniqueName: \"kubernetes.io/projected/99ec9d0a-ff24-4f04-b38d-b4a7de812d3b-kube-api-access-dn4pt\") pod \"network-metrics-daemon-n88x2\" (UID: \"99ec9d0a-ff24-4f04-b38d-b4a7de812d3b\") " pod="openshift-multus/network-metrics-daemon-n88x2"
Jul 15 18:17:24.137029 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:17:24.137008    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lllr6\" (UniqueName: \"kubernetes.io/projected/b4008ec9-cbff-43c2-905e-abd5cf63c321-kube-api-access-lllr6\") pod \"multus-additional-cni-plugins-d6rg2\" (UID: \"b4008ec9-cbff-43c2-905e-abd5cf63c321\") " pod="openshift-multus/multus-additional-cni-plugins-d6rg2"
Jul 15 18:17:24.141817 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:17:24.141792    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jfzc4\" (UniqueName: \"kubernetes.io/projected/c7dc99b8-7a42-4f46-8de8-5c36675675da-kube-api-access-jfzc4\") pod \"node-resolver-8d7kq\" (UID: \"c7dc99b8-7a42-4f46-8de8-5c36675675da\") " pod="openshift-dns/node-resolver-8d7kq"
Jul 15 18:17:24.142203 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:17:24.142184    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7k9ch\" (UniqueName: \"kubernetes.io/projected/9dd068b6-915e-4ffb-9552-b4b987ca19f2-kube-api-access-7k9ch\") pod \"multus-crpmn\" (UID: \"9dd068b6-915e-4ffb-9552-b4b987ca19f2\") " pod="openshift-multus/multus-crpmn"
Jul 15 18:17:24.142648 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:17:24.142626    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-g4s7n\" (UniqueName: \"kubernetes.io/projected/420d5d86-edc6-4c35-a8b1-0501a7aa0887-kube-api-access-g4s7n\") pod \"iptables-alerter-2hnlr\" (UID: \"420d5d86-edc6-4c35-a8b1-0501a7aa0887\") " pod="openshift-network-operator/iptables-alerter-2hnlr"
Jul 15 18:17:24.142741 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:17:24.142714    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-njxzx\" (UniqueName: \"kubernetes.io/projected/d8816772-beae-4dff-9c51-9043199e488d-kube-api-access-njxzx\") pod \"ovnkube-node-8hmqx\" (UID: \"d8816772-beae-4dff-9c51-9043199e488d\") " pod="openshift-ovn-kubernetes/ovnkube-node-8hmqx"
Jul 15 18:17:24.167642 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:17:24.167616    2567 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 15 18:17:24.205477 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:17:24.205366    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-171.ec2.internal" event={"ID":"a63a444972a783e4aea8dd589c20d7f5","Type":"ContainerStarted","Data":"5e36a493595384ab53a699030c55f9e62b00d2ff04f432aeb0e1a6e9145e31c8"}
Jul 15 18:17:24.206957 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:17:24.206908    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-141-171.ec2.internal" event={"ID":"5ba27ba9c439859b7fde96be83dd7679","Type":"ContainerStarted","Data":"1f151f70ef2fc4862df32594a8d8e313c7764637d83dac51227d10e95e08830f"}
Jul 15 18:17:24.245577 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:17:24.245550    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-sk2rm"
Jul 15 18:17:24.253504 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:17:24.253477    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-8hmqx"
Jul 15 18:17:24.263646 ip-10-0-141-171 kubenswrapper[2567]: W0715 18:17:24.263614    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd8816772_beae_4dff_9c51_9043199e488d.slice/crio-15db5a3c248d0b8eb4c8592a333aff8c0b175b27f549685ef3f79682a5a1bbd8 WatchSource:0}: Error finding container 15db5a3c248d0b8eb4c8592a333aff8c0b175b27f549685ef3f79682a5a1bbd8: Status 404 returned error can't find the container with id 15db5a3c248d0b8eb4c8592a333aff8c0b175b27f549685ef3f79682a5a1bbd8
Jul 15 18:17:24.264537 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:17:24.264515    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-d6rg2"
Jul 15 18:17:24.266296 ip-10-0-141-171 kubenswrapper[2567]: W0715 18:17:24.266244    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2c675bc6_a2aa_458b_893e_533093fd93c1.slice/crio-2f16aec6181b4a749abf1abd4520593b9ed0477c796de412fa7a5c2a7c5370b5 WatchSource:0}: Error finding container 2f16aec6181b4a749abf1abd4520593b9ed0477c796de412fa7a5c2a7c5370b5: Status 404 returned error can't find the container with id 2f16aec6181b4a749abf1abd4520593b9ed0477c796de412fa7a5c2a7c5370b5
Jul 15 18:17:24.270986 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:17:24.270953    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-crpmn"
Jul 15 18:17:24.276055 ip-10-0-141-171 kubenswrapper[2567]: W0715 18:17:24.276022    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb4008ec9_cbff_43c2_905e_abd5cf63c321.slice/crio-24c8bd742d52dcbba008f6778f532a74caeb256d7033dff1198dd139f9036c41 WatchSource:0}: Error finding container 24c8bd742d52dcbba008f6778f532a74caeb256d7033dff1198dd139f9036c41: Status 404 returned error can't find the container with id 24c8bd742d52dcbba008f6778f532a74caeb256d7033dff1198dd139f9036c41
Jul 15 18:17:24.277935 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:17:24.277690    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-8d7kq"
Jul 15 18:17:24.282968 ip-10-0-141-171 kubenswrapper[2567]: W0715 18:17:24.282946    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9dd068b6_915e_4ffb_9552_b4b987ca19f2.slice/crio-7f6006cd001339c1c32bd3ab4c77ee3e4f5d200bc3a39feea7f12176597a0ba8 WatchSource:0}: Error finding container 7f6006cd001339c1c32bd3ab4c77ee3e4f5d200bc3a39feea7f12176597a0ba8: Status 404 returned error can't find the container with id 7f6006cd001339c1c32bd3ab4c77ee3e4f5d200bc3a39feea7f12176597a0ba8
Jul 15 18:17:24.284521 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:17:24.284500    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-8pv2c"
Jul 15 18:17:24.289203 ip-10-0-141-171 kubenswrapper[2567]: W0715 18:17:24.289164    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc7dc99b8_7a42_4f46_8de8_5c36675675da.slice/crio-0a751ed70a4388c832373379c5c89e223c8343cf81bcd31828b25cb2a69e9026 WatchSource:0}: Error finding container 0a751ed70a4388c832373379c5c89e223c8343cf81bcd31828b25cb2a69e9026: Status 404 returned error can't find the container with id 0a751ed70a4388c832373379c5c89e223c8343cf81bcd31828b25cb2a69e9026
Jul 15 18:17:24.293948 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:17:24.293922    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-2hnlr"
Jul 15 18:17:24.294325 ip-10-0-141-171 kubenswrapper[2567]: W0715 18:17:24.294237    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb62eb6ad_8f6e_4d28_aa2b_9c6579a6d52a.slice/crio-c27aac38327070df7a3619bcc89a38d8eba3e4c9398828cc768f61d4da6008db WatchSource:0}: Error finding container c27aac38327070df7a3619bcc89a38d8eba3e4c9398828cc768f61d4da6008db: Status 404 returned error can't find the container with id c27aac38327070df7a3619bcc89a38d8eba3e4c9398828cc768f61d4da6008db
Jul 15 18:17:24.300090 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:17:24.300067    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-6qkk4"
Jul 15 18:17:24.305358 ip-10-0-141-171 kubenswrapper[2567]: W0715 18:17:24.305289    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod420d5d86_edc6_4c35_a8b1_0501a7aa0887.slice/crio-7e5d109ffae972312e6bc121d456a84c8d2547c7c5a10341413a330f89eed3a8 WatchSource:0}: Error finding container 7e5d109ffae972312e6bc121d456a84c8d2547c7c5a10341413a330f89eed3a8: Status 404 returned error can't find the container with id 7e5d109ffae972312e6bc121d456a84c8d2547c7c5a10341413a330f89eed3a8
Jul 15 18:17:24.306567 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:17:24.306407    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-t2vtv"
Jul 15 18:17:24.312110 ip-10-0-141-171 kubenswrapper[2567]: W0715 18:17:24.312080    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod836f3165_610d_469b_ba6f_773aad82bf92.slice/crio-4f4b8407eb8c3312dbb23ff9cf9b6b046f92c1025dc503259171b93c13a5965d WatchSource:0}: Error finding container 4f4b8407eb8c3312dbb23ff9cf9b6b046f92c1025dc503259171b93c13a5965d: Status 404 returned error can't find the container with id 4f4b8407eb8c3312dbb23ff9cf9b6b046f92c1025dc503259171b93c13a5965d
Jul 15 18:17:24.316738 ip-10-0-141-171 kubenswrapper[2567]: W0715 18:17:24.316719    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfd1b71f3_89f1_4883_82f3_ba2ea2037bd1.slice/crio-ffd124558e5fa8432d1f60f72fb70a8021d20dc0a6f724fb54fc7e1897328964 WatchSource:0}: Error finding container ffd124558e5fa8432d1f60f72fb70a8021d20dc0a6f724fb54fc7e1897328964: Status 404 returned error can't find the container with id ffd124558e5fa8432d1f60f72fb70a8021d20dc0a6f724fb54fc7e1897328964
Jul 15 18:17:24.627903 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:17:24.627808    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/0d941f69-52de-4bf3-b262-9d9e07d9d730-original-pull-secret\") pod \"global-pull-secret-syncer-dqncz\" (UID: \"0d941f69-52de-4bf3-b262-9d9e07d9d730\") " pod="kube-system/global-pull-secret-syncer-dqncz"
Jul 15 18:17:24.627903 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:17:24.627865    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/99ec9d0a-ff24-4f04-b38d-b4a7de812d3b-metrics-certs\") pod \"network-metrics-daemon-n88x2\" (UID: \"99ec9d0a-ff24-4f04-b38d-b4a7de812d3b\") " pod="openshift-multus/network-metrics-daemon-n88x2"
Jul 15 18:17:24.628203 ip-10-0-141-171 kubenswrapper[2567]: E0715 18:17:24.628033    2567 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 15 18:17:24.628203 ip-10-0-141-171 kubenswrapper[2567]: E0715 18:17:24.628103    2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/99ec9d0a-ff24-4f04-b38d-b4a7de812d3b-metrics-certs podName:99ec9d0a-ff24-4f04-b38d-b4a7de812d3b nodeName:}" failed. No retries permitted until 2026-07-15 18:17:25.628087413 +0000 UTC m=+4.162510769 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/99ec9d0a-ff24-4f04-b38d-b4a7de812d3b-metrics-certs") pod "network-metrics-daemon-n88x2" (UID: "99ec9d0a-ff24-4f04-b38d-b4a7de812d3b") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 15 18:17:24.628203 ip-10-0-141-171 kubenswrapper[2567]: E0715 18:17:24.628033    2567 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 15 18:17:24.628203 ip-10-0-141-171 kubenswrapper[2567]: E0715 18:17:24.628147    2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0d941f69-52de-4bf3-b262-9d9e07d9d730-original-pull-secret podName:0d941f69-52de-4bf3-b262-9d9e07d9d730 nodeName:}" failed. No retries permitted until 2026-07-15 18:17:25.628138355 +0000 UTC m=+4.162561690 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/0d941f69-52de-4bf3-b262-9d9e07d9d730-original-pull-secret") pod "global-pull-secret-syncer-dqncz" (UID: "0d941f69-52de-4bf3-b262-9d9e07d9d730") : object "kube-system"/"original-pull-secret" not registered
Jul 15 18:17:24.728654 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:17:24.728620    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pjq5n\" (UniqueName: \"kubernetes.io/projected/b4f54a92-c72a-4f20-93f7-7b424f8f2656-kube-api-access-pjq5n\") pod \"network-check-target-4lm4m\" (UID: \"b4f54a92-c72a-4f20-93f7-7b424f8f2656\") " pod="openshift-network-diagnostics/network-check-target-4lm4m"
Jul 15 18:17:24.728837 ip-10-0-141-171 kubenswrapper[2567]: E0715 18:17:24.728780    2567 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 15 18:17:24.728837 ip-10-0-141-171 kubenswrapper[2567]: E0715 18:17:24.728801    2567 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 15 18:17:24.728837 ip-10-0-141-171 kubenswrapper[2567]: E0715 18:17:24.728814    2567 projected.go:196] Error preparing data for projected volume kube-api-access-pjq5n for pod openshift-network-diagnostics/network-check-target-4lm4m: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 15 18:17:24.729010 ip-10-0-141-171 kubenswrapper[2567]: E0715 18:17:24.728884    2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/b4f54a92-c72a-4f20-93f7-7b424f8f2656-kube-api-access-pjq5n podName:b4f54a92-c72a-4f20-93f7-7b424f8f2656 nodeName:}" failed. No retries permitted until 2026-07-15 18:17:25.728860842 +0000 UTC m=+4.263284196 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-pjq5n" (UniqueName: "kubernetes.io/projected/b4f54a92-c72a-4f20-93f7-7b424f8f2656-kube-api-access-pjq5n") pod "network-check-target-4lm4m" (UID: "b4f54a92-c72a-4f20-93f7-7b424f8f2656") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 15 18:17:25.050939 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:17:25.050455    2567 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-14 18:12:24 +0000 UTC" deadline="2028-04-28 08:08:06.061458806 +0000 UTC"
Jul 15 18:17:25.050939 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:17:25.050815    2567 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="15661h50m41.010650707s"
Jul 15 18:17:25.200461 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:17:25.200428    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-4lm4m"
Jul 15 18:17:25.200638 ip-10-0-141-171 kubenswrapper[2567]: E0715 18:17:25.200563    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-4lm4m" podUID="b4f54a92-c72a-4f20-93f7-7b424f8f2656"
Jul 15 18:17:25.200998 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:17:25.200972    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-dqncz"
Jul 15 18:17:25.201104 ip-10-0-141-171 kubenswrapper[2567]: E0715 18:17:25.201082    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-dqncz" podUID="0d941f69-52de-4bf3-b262-9d9e07d9d730"
Jul 15 18:17:25.211031 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:17:25.210959    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-6qkk4" event={"ID":"836f3165-610d-469b-ba6f-773aad82bf92","Type":"ContainerStarted","Data":"4f4b8407eb8c3312dbb23ff9cf9b6b046f92c1025dc503259171b93c13a5965d"}
Jul 15 18:17:25.217976 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:17:25.217941    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-8pv2c" event={"ID":"b62eb6ad-8f6e-4d28-aa2b-9c6579a6d52a","Type":"ContainerStarted","Data":"c27aac38327070df7a3619bcc89a38d8eba3e4c9398828cc768f61d4da6008db"}
Jul 15 18:17:25.221683 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:17:25.221652    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-8d7kq" event={"ID":"c7dc99b8-7a42-4f46-8de8-5c36675675da","Type":"ContainerStarted","Data":"0a751ed70a4388c832373379c5c89e223c8343cf81bcd31828b25cb2a69e9026"}
Jul 15 18:17:25.231165 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:17:25.231094    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-d6rg2" event={"ID":"b4008ec9-cbff-43c2-905e-abd5cf63c321","Type":"ContainerStarted","Data":"24c8bd742d52dcbba008f6778f532a74caeb256d7033dff1198dd139f9036c41"}
Jul 15 18:17:25.233575 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:17:25.233545    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-sk2rm" event={"ID":"2c675bc6-a2aa-458b-893e-533093fd93c1","Type":"ContainerStarted","Data":"2f16aec6181b4a749abf1abd4520593b9ed0477c796de412fa7a5c2a7c5370b5"}
Jul 15 18:17:25.235424 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:17:25.235395    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-t2vtv" event={"ID":"fd1b71f3-89f1-4883-82f3-ba2ea2037bd1","Type":"ContainerStarted","Data":"ffd124558e5fa8432d1f60f72fb70a8021d20dc0a6f724fb54fc7e1897328964"}
Jul 15 18:17:25.239856 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:17:25.239828    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-2hnlr" event={"ID":"420d5d86-edc6-4c35-a8b1-0501a7aa0887","Type":"ContainerStarted","Data":"7e5d109ffae972312e6bc121d456a84c8d2547c7c5a10341413a330f89eed3a8"}
Jul 15 18:17:25.242377 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:17:25.242314    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-crpmn" event={"ID":"9dd068b6-915e-4ffb-9552-b4b987ca19f2","Type":"ContainerStarted","Data":"7f6006cd001339c1c32bd3ab4c77ee3e4f5d200bc3a39feea7f12176597a0ba8"}
Jul 15 18:17:25.256123 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:17:25.255829    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-8hmqx" event={"ID":"d8816772-beae-4dff-9c51-9043199e488d","Type":"ContainerStarted","Data":"15db5a3c248d0b8eb4c8592a333aff8c0b175b27f549685ef3f79682a5a1bbd8"}
Jul 15 18:17:25.636295 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:17:25.636240    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/0d941f69-52de-4bf3-b262-9d9e07d9d730-original-pull-secret\") pod \"global-pull-secret-syncer-dqncz\" (UID: \"0d941f69-52de-4bf3-b262-9d9e07d9d730\") " pod="kube-system/global-pull-secret-syncer-dqncz"
Jul 15 18:17:25.636455 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:17:25.636314    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/99ec9d0a-ff24-4f04-b38d-b4a7de812d3b-metrics-certs\") pod \"network-metrics-daemon-n88x2\" (UID: \"99ec9d0a-ff24-4f04-b38d-b4a7de812d3b\") " pod="openshift-multus/network-metrics-daemon-n88x2"
Jul 15 18:17:25.636535 ip-10-0-141-171 kubenswrapper[2567]: E0715 18:17:25.636454    2567 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 15 18:17:25.636535 ip-10-0-141-171 kubenswrapper[2567]: E0715 18:17:25.636521    2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/99ec9d0a-ff24-4f04-b38d-b4a7de812d3b-metrics-certs podName:99ec9d0a-ff24-4f04-b38d-b4a7de812d3b nodeName:}" failed. No retries permitted until 2026-07-15 18:17:27.636499929 +0000 UTC m=+6.170923268 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/99ec9d0a-ff24-4f04-b38d-b4a7de812d3b-metrics-certs") pod "network-metrics-daemon-n88x2" (UID: "99ec9d0a-ff24-4f04-b38d-b4a7de812d3b") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 15 18:17:25.636942 ip-10-0-141-171 kubenswrapper[2567]: E0715 18:17:25.636918    2567 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 15 18:17:25.637094 ip-10-0-141-171 kubenswrapper[2567]: E0715 18:17:25.636975    2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0d941f69-52de-4bf3-b262-9d9e07d9d730-original-pull-secret podName:0d941f69-52de-4bf3-b262-9d9e07d9d730 nodeName:}" failed. No retries permitted until 2026-07-15 18:17:27.636960559 +0000 UTC m=+6.171383900 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/0d941f69-52de-4bf3-b262-9d9e07d9d730-original-pull-secret") pod "global-pull-secret-syncer-dqncz" (UID: "0d941f69-52de-4bf3-b262-9d9e07d9d730") : object "kube-system"/"original-pull-secret" not registered
Jul 15 18:17:25.738157 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:17:25.737321    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pjq5n\" (UniqueName: \"kubernetes.io/projected/b4f54a92-c72a-4f20-93f7-7b424f8f2656-kube-api-access-pjq5n\") pod \"network-check-target-4lm4m\" (UID: \"b4f54a92-c72a-4f20-93f7-7b424f8f2656\") " pod="openshift-network-diagnostics/network-check-target-4lm4m"
Jul 15 18:17:25.738157 ip-10-0-141-171 kubenswrapper[2567]: E0715 18:17:25.737638    2567 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 15 18:17:25.738157 ip-10-0-141-171 kubenswrapper[2567]: E0715 18:17:25.737665    2567 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 15 18:17:25.738157 ip-10-0-141-171 kubenswrapper[2567]: E0715 18:17:25.737680    2567 projected.go:196] Error preparing data for projected volume kube-api-access-pjq5n for pod openshift-network-diagnostics/network-check-target-4lm4m: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 15 18:17:25.738157 ip-10-0-141-171 kubenswrapper[2567]: E0715 18:17:25.737744    2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/b4f54a92-c72a-4f20-93f7-7b424f8f2656-kube-api-access-pjq5n podName:b4f54a92-c72a-4f20-93f7-7b424f8f2656 nodeName:}" failed. No retries permitted until 2026-07-15 18:17:27.737724351 +0000 UTC m=+6.272147711 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-pjq5n" (UniqueName: "kubernetes.io/projected/b4f54a92-c72a-4f20-93f7-7b424f8f2656-kube-api-access-pjq5n") pod "network-check-target-4lm4m" (UID: "b4f54a92-c72a-4f20-93f7-7b424f8f2656") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 15 18:17:26.051499 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:17:26.051375    2567 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-14 18:12:24 +0000 UTC" deadline="2028-02-05 12:19:21.987798979 +0000 UTC"
Jul 15 18:17:26.051499 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:17:26.051442    2567 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="13674h1m55.936362061s"
Jul 15 18:17:26.202715 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:17:26.202122    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-n88x2"
Jul 15 18:17:26.202715 ip-10-0-141-171 kubenswrapper[2567]: E0715 18:17:26.202283    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-n88x2" podUID="99ec9d0a-ff24-4f04-b38d-b4a7de812d3b"
Jul 15 18:17:26.275823 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:17:26.275782    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-171.ec2.internal" event={"ID":"a63a444972a783e4aea8dd589c20d7f5","Type":"ContainerStarted","Data":"1bb29e02cde527d5a7a1f8abb59e898ef7ec60bd435d76a420361e97b725b159"}
Jul 15 18:17:27.200504 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:17:27.200470    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-4lm4m"
Jul 15 18:17:27.200979 ip-10-0-141-171 kubenswrapper[2567]: E0715 18:17:27.200598    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-4lm4m" podUID="b4f54a92-c72a-4f20-93f7-7b424f8f2656"
Jul 15 18:17:27.201083 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:17:27.200992    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-dqncz"
Jul 15 18:17:27.201142 ip-10-0-141-171 kubenswrapper[2567]: E0715 18:17:27.201083    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-dqncz" podUID="0d941f69-52de-4bf3-b262-9d9e07d9d730"
Jul 15 18:17:27.654376 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:17:27.654296    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/0d941f69-52de-4bf3-b262-9d9e07d9d730-original-pull-secret\") pod \"global-pull-secret-syncer-dqncz\" (UID: \"0d941f69-52de-4bf3-b262-9d9e07d9d730\") " pod="kube-system/global-pull-secret-syncer-dqncz"
Jul 15 18:17:27.654376 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:17:27.654345    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/99ec9d0a-ff24-4f04-b38d-b4a7de812d3b-metrics-certs\") pod \"network-metrics-daemon-n88x2\" (UID: \"99ec9d0a-ff24-4f04-b38d-b4a7de812d3b\") " pod="openshift-multus/network-metrics-daemon-n88x2"
Jul 15 18:17:27.654578 ip-10-0-141-171 kubenswrapper[2567]: E0715 18:17:27.654512    2567 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 15 18:17:27.654578 ip-10-0-141-171 kubenswrapper[2567]: E0715 18:17:27.654571    2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/99ec9d0a-ff24-4f04-b38d-b4a7de812d3b-metrics-certs podName:99ec9d0a-ff24-4f04-b38d-b4a7de812d3b nodeName:}" failed. No retries permitted until 2026-07-15 18:17:31.654552296 +0000 UTC m=+10.188975633 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/99ec9d0a-ff24-4f04-b38d-b4a7de812d3b-metrics-certs") pod "network-metrics-daemon-n88x2" (UID: "99ec9d0a-ff24-4f04-b38d-b4a7de812d3b") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 15 18:17:27.654996 ip-10-0-141-171 kubenswrapper[2567]: E0715 18:17:27.654976    2567 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 15 18:17:27.655080 ip-10-0-141-171 kubenswrapper[2567]: E0715 18:17:27.655032    2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0d941f69-52de-4bf3-b262-9d9e07d9d730-original-pull-secret podName:0d941f69-52de-4bf3-b262-9d9e07d9d730 nodeName:}" failed. No retries permitted until 2026-07-15 18:17:31.655016655 +0000 UTC m=+10.189439995 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/0d941f69-52de-4bf3-b262-9d9e07d9d730-original-pull-secret") pod "global-pull-secret-syncer-dqncz" (UID: "0d941f69-52de-4bf3-b262-9d9e07d9d730") : object "kube-system"/"original-pull-secret" not registered
Jul 15 18:17:27.755018 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:17:27.754950    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pjq5n\" (UniqueName: \"kubernetes.io/projected/b4f54a92-c72a-4f20-93f7-7b424f8f2656-kube-api-access-pjq5n\") pod \"network-check-target-4lm4m\" (UID: \"b4f54a92-c72a-4f20-93f7-7b424f8f2656\") " pod="openshift-network-diagnostics/network-check-target-4lm4m"
Jul 15 18:17:27.755197 ip-10-0-141-171 kubenswrapper[2567]: E0715 18:17:27.755180    2567 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 15 18:17:27.755285 ip-10-0-141-171 kubenswrapper[2567]: E0715 18:17:27.755208    2567 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 15 18:17:27.755285 ip-10-0-141-171 kubenswrapper[2567]: E0715 18:17:27.755220    2567 projected.go:196] Error preparing data for projected volume kube-api-access-pjq5n for pod openshift-network-diagnostics/network-check-target-4lm4m: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 15 18:17:27.755413 ip-10-0-141-171 kubenswrapper[2567]: E0715 18:17:27.755294    2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/b4f54a92-c72a-4f20-93f7-7b424f8f2656-kube-api-access-pjq5n podName:b4f54a92-c72a-4f20-93f7-7b424f8f2656 nodeName:}" failed. No retries permitted until 2026-07-15 18:17:31.755274342 +0000 UTC m=+10.289697679 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-pjq5n" (UniqueName: "kubernetes.io/projected/b4f54a92-c72a-4f20-93f7-7b424f8f2656-kube-api-access-pjq5n") pod "network-check-target-4lm4m" (UID: "b4f54a92-c72a-4f20-93f7-7b424f8f2656") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 15 18:17:28.201103 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:17:28.201064    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-n88x2"
Jul 15 18:17:28.201671 ip-10-0-141-171 kubenswrapper[2567]: E0715 18:17:28.201212    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-n88x2" podUID="99ec9d0a-ff24-4f04-b38d-b4a7de812d3b"
Jul 15 18:17:29.199936 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:17:29.199900    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-4lm4m"
Jul 15 18:17:29.200122 ip-10-0-141-171 kubenswrapper[2567]: E0715 18:17:29.200030    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-4lm4m" podUID="b4f54a92-c72a-4f20-93f7-7b424f8f2656"
Jul 15 18:17:29.200420 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:17:29.200403    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-dqncz"
Jul 15 18:17:29.200516 ip-10-0-141-171 kubenswrapper[2567]: E0715 18:17:29.200498    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-dqncz" podUID="0d941f69-52de-4bf3-b262-9d9e07d9d730"
Jul 15 18:17:30.200979 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:17:30.200893    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-n88x2"
Jul 15 18:17:30.201429 ip-10-0-141-171 kubenswrapper[2567]: E0715 18:17:30.201037    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-n88x2" podUID="99ec9d0a-ff24-4f04-b38d-b4a7de812d3b"
Jul 15 18:17:31.200334 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:17:31.200295    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-4lm4m"
Jul 15 18:17:31.200518 ip-10-0-141-171 kubenswrapper[2567]: E0715 18:17:31.200428    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-4lm4m" podUID="b4f54a92-c72a-4f20-93f7-7b424f8f2656"
Jul 15 18:17:31.200842 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:17:31.200822    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-dqncz"
Jul 15 18:17:31.200953 ip-10-0-141-171 kubenswrapper[2567]: E0715 18:17:31.200926    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-dqncz" podUID="0d941f69-52de-4bf3-b262-9d9e07d9d730"
Jul 15 18:17:31.690176 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:17:31.690093    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/0d941f69-52de-4bf3-b262-9d9e07d9d730-original-pull-secret\") pod \"global-pull-secret-syncer-dqncz\" (UID: \"0d941f69-52de-4bf3-b262-9d9e07d9d730\") " pod="kube-system/global-pull-secret-syncer-dqncz"
Jul 15 18:17:31.690176 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:17:31.690143    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/99ec9d0a-ff24-4f04-b38d-b4a7de812d3b-metrics-certs\") pod \"network-metrics-daemon-n88x2\" (UID: \"99ec9d0a-ff24-4f04-b38d-b4a7de812d3b\") " pod="openshift-multus/network-metrics-daemon-n88x2"
Jul 15 18:17:31.690578 ip-10-0-141-171 kubenswrapper[2567]: E0715 18:17:31.690291    2567 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 15 18:17:31.690578 ip-10-0-141-171 kubenswrapper[2567]: E0715 18:17:31.690345    2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/99ec9d0a-ff24-4f04-b38d-b4a7de812d3b-metrics-certs podName:99ec9d0a-ff24-4f04-b38d-b4a7de812d3b nodeName:}" failed. No retries permitted until 2026-07-15 18:17:39.690331277 +0000 UTC m=+18.224754611 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/99ec9d0a-ff24-4f04-b38d-b4a7de812d3b-metrics-certs") pod "network-metrics-daemon-n88x2" (UID: "99ec9d0a-ff24-4f04-b38d-b4a7de812d3b") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 15 18:17:31.690684 ip-10-0-141-171 kubenswrapper[2567]: E0715 18:17:31.690668    2567 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 15 18:17:31.690715 ip-10-0-141-171 kubenswrapper[2567]: E0715 18:17:31.690711    2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0d941f69-52de-4bf3-b262-9d9e07d9d730-original-pull-secret podName:0d941f69-52de-4bf3-b262-9d9e07d9d730 nodeName:}" failed. No retries permitted until 2026-07-15 18:17:39.690699077 +0000 UTC m=+18.225122411 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/0d941f69-52de-4bf3-b262-9d9e07d9d730-original-pull-secret") pod "global-pull-secret-syncer-dqncz" (UID: "0d941f69-52de-4bf3-b262-9d9e07d9d730") : object "kube-system"/"original-pull-secret" not registered
Jul 15 18:17:31.791216 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:17:31.791167    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pjq5n\" (UniqueName: \"kubernetes.io/projected/b4f54a92-c72a-4f20-93f7-7b424f8f2656-kube-api-access-pjq5n\") pod \"network-check-target-4lm4m\" (UID: \"b4f54a92-c72a-4f20-93f7-7b424f8f2656\") " pod="openshift-network-diagnostics/network-check-target-4lm4m"
Jul 15 18:17:31.791415 ip-10-0-141-171 kubenswrapper[2567]: E0715 18:17:31.791356    2567 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 15 18:17:31.791415 ip-10-0-141-171 kubenswrapper[2567]: E0715 18:17:31.791380    2567 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 15 18:17:31.791415 ip-10-0-141-171 kubenswrapper[2567]: E0715 18:17:31.791393    2567 projected.go:196] Error preparing data for projected volume kube-api-access-pjq5n for pod openshift-network-diagnostics/network-check-target-4lm4m: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 15 18:17:31.791584 ip-10-0-141-171 kubenswrapper[2567]: E0715 18:17:31.791471    2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/b4f54a92-c72a-4f20-93f7-7b424f8f2656-kube-api-access-pjq5n podName:b4f54a92-c72a-4f20-93f7-7b424f8f2656 nodeName:}" failed. No retries permitted until 2026-07-15 18:17:39.791449368 +0000 UTC m=+18.325872705 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-pjq5n" (UniqueName: "kubernetes.io/projected/b4f54a92-c72a-4f20-93f7-7b424f8f2656-kube-api-access-pjq5n") pod "network-check-target-4lm4m" (UID: "b4f54a92-c72a-4f20-93f7-7b424f8f2656") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 15 18:17:32.200886 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:17:32.200853    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-n88x2"
Jul 15 18:17:32.201053 ip-10-0-141-171 kubenswrapper[2567]: E0715 18:17:32.200958    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-n88x2" podUID="99ec9d0a-ff24-4f04-b38d-b4a7de812d3b"
Jul 15 18:17:33.200349 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:17:33.200314    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-4lm4m"
Jul 15 18:17:33.200771 ip-10-0-141-171 kubenswrapper[2567]: E0715 18:17:33.200447    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-4lm4m" podUID="b4f54a92-c72a-4f20-93f7-7b424f8f2656"
Jul 15 18:17:33.200878 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:17:33.200814    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-dqncz"
Jul 15 18:17:33.200941 ip-10-0-141-171 kubenswrapper[2567]: E0715 18:17:33.200912    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-dqncz" podUID="0d941f69-52de-4bf3-b262-9d9e07d9d730"
Jul 15 18:17:34.200948 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:17:34.200911    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-n88x2"
Jul 15 18:17:34.201417 ip-10-0-141-171 kubenswrapper[2567]: E0715 18:17:34.201107    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-n88x2" podUID="99ec9d0a-ff24-4f04-b38d-b4a7de812d3b"
Jul 15 18:17:35.199961 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:17:35.199929    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-4lm4m"
Jul 15 18:17:35.200149 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:17:35.199929    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-dqncz"
Jul 15 18:17:35.200149 ip-10-0-141-171 kubenswrapper[2567]: E0715 18:17:35.200038    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-4lm4m" podUID="b4f54a92-c72a-4f20-93f7-7b424f8f2656"
Jul 15 18:17:35.200149 ip-10-0-141-171 kubenswrapper[2567]: E0715 18:17:35.200100    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-dqncz" podUID="0d941f69-52de-4bf3-b262-9d9e07d9d730"
Jul 15 18:17:36.200747 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:17:36.200712    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-n88x2"
Jul 15 18:17:36.201136 ip-10-0-141-171 kubenswrapper[2567]: E0715 18:17:36.200863    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-n88x2" podUID="99ec9d0a-ff24-4f04-b38d-b4a7de812d3b"
Jul 15 18:17:36.296183 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:17:36.296148    2567 generic.go:356] "Generic (PLEG): container finished" podID="a63a444972a783e4aea8dd589c20d7f5" containerID="1bb29e02cde527d5a7a1f8abb59e898ef7ec60bd435d76a420361e97b725b159" exitCode=0
Jul 15 18:17:36.296381 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:17:36.296197    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-171.ec2.internal" event={"ID":"a63a444972a783e4aea8dd589c20d7f5","Type":"ContainerDied","Data":"1bb29e02cde527d5a7a1f8abb59e898ef7ec60bd435d76a420361e97b725b159"}
Jul 15 18:17:37.199993 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:17:37.199945    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-4lm4m"
Jul 15 18:17:37.200180 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:17:37.199945    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-dqncz"
Jul 15 18:17:37.200180 ip-10-0-141-171 kubenswrapper[2567]: E0715 18:17:37.200087    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-4lm4m" podUID="b4f54a92-c72a-4f20-93f7-7b424f8f2656"
Jul 15 18:17:37.200180 ip-10-0-141-171 kubenswrapper[2567]: E0715 18:17:37.200150    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-dqncz" podUID="0d941f69-52de-4bf3-b262-9d9e07d9d730"
Jul 15 18:17:38.200220 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:17:38.200183    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-n88x2"
Jul 15 18:17:38.200681 ip-10-0-141-171 kubenswrapper[2567]: E0715 18:17:38.200337    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-n88x2" podUID="99ec9d0a-ff24-4f04-b38d-b4a7de812d3b"
Jul 15 18:17:39.200109 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:17:39.200076    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-4lm4m"
Jul 15 18:17:39.200305 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:17:39.200116    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-dqncz"
Jul 15 18:17:39.200305 ip-10-0-141-171 kubenswrapper[2567]: E0715 18:17:39.200177    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-4lm4m" podUID="b4f54a92-c72a-4f20-93f7-7b424f8f2656"
Jul 15 18:17:39.200305 ip-10-0-141-171 kubenswrapper[2567]: E0715 18:17:39.200297    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-dqncz" podUID="0d941f69-52de-4bf3-b262-9d9e07d9d730"
Jul 15 18:17:39.746987 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:17:39.746948    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/0d941f69-52de-4bf3-b262-9d9e07d9d730-original-pull-secret\") pod \"global-pull-secret-syncer-dqncz\" (UID: \"0d941f69-52de-4bf3-b262-9d9e07d9d730\") " pod="kube-system/global-pull-secret-syncer-dqncz"
Jul 15 18:17:39.746987 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:17:39.746994    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/99ec9d0a-ff24-4f04-b38d-b4a7de812d3b-metrics-certs\") pod \"network-metrics-daemon-n88x2\" (UID: \"99ec9d0a-ff24-4f04-b38d-b4a7de812d3b\") " pod="openshift-multus/network-metrics-daemon-n88x2"
Jul 15 18:17:39.747257 ip-10-0-141-171 kubenswrapper[2567]: E0715 18:17:39.747112    2567 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 15 18:17:39.747257 ip-10-0-141-171 kubenswrapper[2567]: E0715 18:17:39.747117    2567 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 15 18:17:39.747257 ip-10-0-141-171 kubenswrapper[2567]: E0715 18:17:39.747176    2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/99ec9d0a-ff24-4f04-b38d-b4a7de812d3b-metrics-certs podName:99ec9d0a-ff24-4f04-b38d-b4a7de812d3b nodeName:}" failed. No retries permitted until 2026-07-15 18:17:55.747156471 +0000 UTC m=+34.281579808 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/99ec9d0a-ff24-4f04-b38d-b4a7de812d3b-metrics-certs") pod "network-metrics-daemon-n88x2" (UID: "99ec9d0a-ff24-4f04-b38d-b4a7de812d3b") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 15 18:17:39.747257 ip-10-0-141-171 kubenswrapper[2567]: E0715 18:17:39.747198    2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0d941f69-52de-4bf3-b262-9d9e07d9d730-original-pull-secret podName:0d941f69-52de-4bf3-b262-9d9e07d9d730 nodeName:}" failed. No retries permitted until 2026-07-15 18:17:55.747186093 +0000 UTC m=+34.281609433 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/0d941f69-52de-4bf3-b262-9d9e07d9d730-original-pull-secret") pod "global-pull-secret-syncer-dqncz" (UID: "0d941f69-52de-4bf3-b262-9d9e07d9d730") : object "kube-system"/"original-pull-secret" not registered
Jul 15 18:17:39.848011 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:17:39.847970    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pjq5n\" (UniqueName: \"kubernetes.io/projected/b4f54a92-c72a-4f20-93f7-7b424f8f2656-kube-api-access-pjq5n\") pod \"network-check-target-4lm4m\" (UID: \"b4f54a92-c72a-4f20-93f7-7b424f8f2656\") " pod="openshift-network-diagnostics/network-check-target-4lm4m"
Jul 15 18:17:39.848184 ip-10-0-141-171 kubenswrapper[2567]: E0715 18:17:39.848163    2567 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 15 18:17:39.848184 ip-10-0-141-171 kubenswrapper[2567]: E0715 18:17:39.848186    2567 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 15 18:17:39.848281 ip-10-0-141-171 kubenswrapper[2567]: E0715 18:17:39.848198    2567 projected.go:196] Error preparing data for projected volume kube-api-access-pjq5n for pod openshift-network-diagnostics/network-check-target-4lm4m: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 15 18:17:39.848281 ip-10-0-141-171 kubenswrapper[2567]: E0715 18:17:39.848277    2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/b4f54a92-c72a-4f20-93f7-7b424f8f2656-kube-api-access-pjq5n podName:b4f54a92-c72a-4f20-93f7-7b424f8f2656 nodeName:}" failed. No retries permitted until 2026-07-15 18:17:55.848256807 +0000 UTC m=+34.382680160 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-pjq5n" (UniqueName: "kubernetes.io/projected/b4f54a92-c72a-4f20-93f7-7b424f8f2656-kube-api-access-pjq5n") pod "network-check-target-4lm4m" (UID: "b4f54a92-c72a-4f20-93f7-7b424f8f2656") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 15 18:17:40.200199 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:17:40.200117    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-n88x2"
Jul 15 18:17:40.200386 ip-10-0-141-171 kubenswrapper[2567]: E0715 18:17:40.200275    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-n88x2" podUID="99ec9d0a-ff24-4f04-b38d-b4a7de812d3b"
Jul 15 18:17:41.200143 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:17:41.200102    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-4lm4m"
Jul 15 18:17:41.200334 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:17:41.200116    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-dqncz"
Jul 15 18:17:41.200334 ip-10-0-141-171 kubenswrapper[2567]: E0715 18:17:41.200220    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-4lm4m" podUID="b4f54a92-c72a-4f20-93f7-7b424f8f2656"
Jul 15 18:17:41.200334 ip-10-0-141-171 kubenswrapper[2567]: E0715 18:17:41.200284    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-dqncz" podUID="0d941f69-52de-4bf3-b262-9d9e07d9d730"
Jul 15 18:17:42.201306 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:17:42.201265    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-n88x2"
Jul 15 18:17:42.201733 ip-10-0-141-171 kubenswrapper[2567]: E0715 18:17:42.201398    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-n88x2" podUID="99ec9d0a-ff24-4f04-b38d-b4a7de812d3b"
Jul 15 18:17:43.200144 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:17:43.200108    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-4lm4m"
Jul 15 18:17:43.200336 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:17:43.200160    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-dqncz"
Jul 15 18:17:43.200336 ip-10-0-141-171 kubenswrapper[2567]: E0715 18:17:43.200219    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-4lm4m" podUID="b4f54a92-c72a-4f20-93f7-7b424f8f2656"
Jul 15 18:17:43.200457 ip-10-0-141-171 kubenswrapper[2567]: E0715 18:17:43.200351    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-dqncz" podUID="0d941f69-52de-4bf3-b262-9d9e07d9d730"
Jul 15 18:17:44.200553 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:17:44.200381    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-n88x2"
Jul 15 18:17:44.201179 ip-10-0-141-171 kubenswrapper[2567]: E0715 18:17:44.200641    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-n88x2" podUID="99ec9d0a-ff24-4f04-b38d-b4a7de812d3b"
Jul 15 18:17:44.311444 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:17:44.311412    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-8d7kq" event={"ID":"c7dc99b8-7a42-4f46-8de8-5c36675675da","Type":"ContainerStarted","Data":"77b0465efdd2768a846a51c0ca6935be7b1efa6212421d7a61fa47b15fa81eac"}
Jul 15 18:17:44.313045 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:17:44.313020    2567 generic.go:356] "Generic (PLEG): container finished" podID="b4008ec9-cbff-43c2-905e-abd5cf63c321" containerID="b536d524a13b50d7a7ccdf821e0eba57cb175c56a7bbfeb6f5b73f5dd473042c" exitCode=0
Jul 15 18:17:44.313188 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:17:44.313089    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-d6rg2" event={"ID":"b4008ec9-cbff-43c2-905e-abd5cf63c321","Type":"ContainerDied","Data":"b536d524a13b50d7a7ccdf821e0eba57cb175c56a7bbfeb6f5b73f5dd473042c"}
Jul 15 18:17:44.314660 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:17:44.314629    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-sk2rm" event={"ID":"2c675bc6-a2aa-458b-893e-533093fd93c1","Type":"ContainerStarted","Data":"16cf3115f01ee015393f6a216b0191532b902b66cb004e6f230993488f24ed32"}
Jul 15 18:17:44.316180 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:17:44.316158    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-t2vtv" event={"ID":"fd1b71f3-89f1-4883-82f3-ba2ea2037bd1","Type":"ContainerStarted","Data":"3654c90eab3defcc3c7d83114cc4f1ee9eb6bbe8520b3337d0daad2a32c2da70"}
Jul 15 18:17:44.317640 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:17:44.317615    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-crpmn" event={"ID":"9dd068b6-915e-4ffb-9552-b4b987ca19f2","Type":"ContainerStarted","Data":"0e2f346c3f63dcbc17b8d1fe8265ea3ef81dc8059ae9fe554dff283f6c0d071c"}
Jul 15 18:17:44.319543 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:17:44.319522    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-171.ec2.internal" event={"ID":"a63a444972a783e4aea8dd589c20d7f5","Type":"ContainerStarted","Data":"72d0dca83ed1c05f941c7f71e6e580502e7786b065898cbba17a32282a756d65"}
Jul 15 18:17:44.320990 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:17:44.320969    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-141-171.ec2.internal" event={"ID":"5ba27ba9c439859b7fde96be83dd7679","Type":"ContainerStarted","Data":"1883638a5e36b2c195915f554d14946b1bc27e5b135cc3d0900ae63ac92491f5"}
Jul 15 18:17:44.322371 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:17:44.322347    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-6qkk4" event={"ID":"836f3165-610d-469b-ba6f-773aad82bf92","Type":"ContainerStarted","Data":"5e5848805df5c28aac617f589b9e4035ecc9348b2c8bcb10e33b11e14121c966"}
Jul 15 18:17:44.323955 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:17:44.323937    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-8pv2c" event={"ID":"b62eb6ad-8f6e-4d28-aa2b-9c6579a6d52a","Type":"ContainerStarted","Data":"93cb0adfd2091a7eaa8c72328103bd9468d5edc03862883e7b65e2d96b94d065"}
Jul 15 18:17:44.326958 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:17:44.326898    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-8d7kq" podStartSLOduration=2.795673148 podStartE2EDuration="22.326887541s" totalImagesPullingTime="19.531214393s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-15 18:17:22 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 18:17:44.3267454 +0000 UTC m=+22.861168756" watchObservedRunningTime="2026-07-15 18:17:44.326887541 +0000 UTC m=+22.861310897"
Jul 15 18:17:44.344330 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:17:44.344285    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-141-171.ec2.internal" podStartSLOduration=21.344271759 podStartE2EDuration="21.344271759s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-15 18:17:23 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 18:17:44.343655117 +0000 UTC m=+22.878078474" watchObservedRunningTime="2026-07-15 18:17:44.344271759 +0000 UTC m=+22.878695114"
Jul 15 18:17:44.380931 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:17:44.380884    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-6qkk4" podStartSLOduration=2.818135011 podStartE2EDuration="22.380871013s" totalImagesPullingTime="19.562736002s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-15 18:17:22 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 18:17:44.38069277 +0000 UTC m=+22.915116125" watchObservedRunningTime="2026-07-15 18:17:44.380871013 +0000 UTC m=+22.915294369"
Jul 15 18:17:44.400496 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:17:44.400453    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-171.ec2.internal" podStartSLOduration=21.400438481 podStartE2EDuration="21.400438481s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-15 18:17:23 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 18:17:44.399845408 +0000 UTC m=+22.934268783" watchObservedRunningTime="2026-07-15 18:17:44.400438481 +0000 UTC m=+22.934861837"
Jul 15 18:17:44.435957 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:17:44.435910    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-crpmn" podStartSLOduration=2.843234174 podStartE2EDuration="22.435895766s" totalImagesPullingTime="19.592661592s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-15 18:17:22 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 18:17:44.418662374 +0000 UTC m=+22.953085730" watchObservedRunningTime="2026-07-15 18:17:44.435895766 +0000 UTC m=+22.970319161"
Jul 15 18:17:44.451073 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:17:44.451034    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-8pv2c" podStartSLOduration=2.871607144 podStartE2EDuration="22.451019107s" totalImagesPullingTime="19.579411963s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-15 18:17:22 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 18:17:44.435614674 +0000 UTC m=+22.970038042" watchObservedRunningTime="2026-07-15 18:17:44.451019107 +0000 UTC m=+22.985442463"
Jul 15 18:17:45.200463 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:17:45.200156    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-4lm4m"
Jul 15 18:17:45.200580 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:17:45.200256    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-dqncz"
Jul 15 18:17:45.200580 ip-10-0-141-171 kubenswrapper[2567]: E0715 18:17:45.200565    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-4lm4m" podUID="b4f54a92-c72a-4f20-93f7-7b424f8f2656"
Jul 15 18:17:45.201171 ip-10-0-141-171 kubenswrapper[2567]: E0715 18:17:45.200613    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-dqncz" podUID="0d941f69-52de-4bf3-b262-9d9e07d9d730"
Jul 15 18:17:45.270765 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:17:45.270741    2567 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock"
Jul 15 18:17:45.328039 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:17:45.328006    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-sk2rm" event={"ID":"2c675bc6-a2aa-458b-893e-533093fd93c1","Type":"ContainerStarted","Data":"6eedefdb76010e7a33beeed64daaed4c04d4394dc9b33040ff09b581f02ddcd1"}
Jul 15 18:17:45.330674 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:17:45.330656    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-8hmqx_d8816772-beae-4dff-9c51-9043199e488d/ovn-acl-logging/0.log"
Jul 15 18:17:45.331024 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:17:45.330996    2567 generic.go:356] "Generic (PLEG): container finished" podID="d8816772-beae-4dff-9c51-9043199e488d" containerID="7feb9b91a5f9bb4a258443829d4b06d3dbd6480e4bcf74b928a49bd960c99541" exitCode=1
Jul 15 18:17:45.331125 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:17:45.331074    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-8hmqx" event={"ID":"d8816772-beae-4dff-9c51-9043199e488d","Type":"ContainerStarted","Data":"f6ce27490a9fa8d8b69ec23b7889af9a39f69df8f642a2bef56a0205bdc3d7ee"}
Jul 15 18:17:45.331193 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:17:45.331149    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-8hmqx" event={"ID":"d8816772-beae-4dff-9c51-9043199e488d","Type":"ContainerStarted","Data":"ae20cc32e2df126f9e25dd3ec6d113f8ffd18085e454e47cffe69e9e99fb9cbd"}
Jul 15 18:17:45.331269 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:17:45.331202    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-8hmqx" event={"ID":"d8816772-beae-4dff-9c51-9043199e488d","Type":"ContainerStarted","Data":"d214ee7e5ca0c5683c79998e7a91c5243f6b74924af2fe88fe66f0d90ea27e42"}
Jul 15 18:17:45.331329 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:17:45.331275    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-8hmqx" event={"ID":"d8816772-beae-4dff-9c51-9043199e488d","Type":"ContainerDied","Data":"7feb9b91a5f9bb4a258443829d4b06d3dbd6480e4bcf74b928a49bd960c99541"}
Jul 15 18:17:45.331383 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:17:45.331329    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-8hmqx" event={"ID":"d8816772-beae-4dff-9c51-9043199e488d","Type":"ContainerStarted","Data":"d441f5fd6de39ed114788303294a165809a3b5fbba9eadfbd595fd7b0a4b1efc"}
Jul 15 18:17:46.073360 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:17:46.073177    2567 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-07-15T18:17:45.270761732Z","UUID":"3b11fb2e-6349-4fd0-8997-633f025b6c68","Handler":null,"Name":"","Endpoint":""}
Jul 15 18:17:46.075123 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:17:46.075070    2567 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0
Jul 15 18:17:46.075123 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:17:46.075117    2567 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock
Jul 15 18:17:46.199987 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:17:46.199952    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-n88x2"
Jul 15 18:17:46.200276 ip-10-0-141-171 kubenswrapper[2567]: E0715 18:17:46.200119    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-n88x2" podUID="99ec9d0a-ff24-4f04-b38d-b4a7de812d3b"
Jul 15 18:17:46.335359 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:17:46.335268    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-2hnlr" event={"ID":"420d5d86-edc6-4c35-a8b1-0501a7aa0887","Type":"ContainerStarted","Data":"dfd3db23d57a909c7303b7d3d4a14073d7aa9a6a74d5bed926f7469d20aeb72c"}
Jul 15 18:17:46.338594 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:17:46.338572    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-8hmqx_d8816772-beae-4dff-9c51-9043199e488d/ovn-acl-logging/0.log"
Jul 15 18:17:46.338970 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:17:46.338950    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-8hmqx" event={"ID":"d8816772-beae-4dff-9c51-9043199e488d","Type":"ContainerStarted","Data":"515603c8333302ac53ccfa7920f0a30bf8300facecfbbd30fb36d556d74ef047"}
Jul 15 18:17:46.351838 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:17:46.351790    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-2hnlr" podStartSLOduration=4.778632225 podStartE2EDuration="24.351773535s" totalImagesPullingTime="19.57314131s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-15 18:17:22 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 18:17:46.351442024 +0000 UTC m=+24.885865380" watchObservedRunningTime="2026-07-15 18:17:46.351773535 +0000 UTC m=+24.886196893"
Jul 15 18:17:46.352036 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:17:46.352004    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-t2vtv" podStartSLOduration=4.847899859 podStartE2EDuration="24.351999167s" totalImagesPullingTime="19.504099308s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 18:17:22 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 18:17:44.450739545 +0000 UTC m=+22.985162900" watchObservedRunningTime="2026-07-15 18:17:46.351999167 +0000 UTC m=+24.886422523"
Jul 15 18:17:47.200852 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:17:47.200645    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-dqncz"
Jul 15 18:17:47.201020 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:17:47.200686    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-4lm4m"
Jul 15 18:17:47.201020 ip-10-0-141-171 kubenswrapper[2567]: E0715 18:17:47.200961    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-dqncz" podUID="0d941f69-52de-4bf3-b262-9d9e07d9d730"
Jul 15 18:17:47.201138 ip-10-0-141-171 kubenswrapper[2567]: E0715 18:17:47.201054    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-4lm4m" podUID="b4f54a92-c72a-4f20-93f7-7b424f8f2656"
Jul 15 18:17:47.344422 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:17:47.344377    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-sk2rm" event={"ID":"2c675bc6-a2aa-458b-893e-533093fd93c1","Type":"ContainerStarted","Data":"ae368b6e61cc577def2df70ef90996d41f0132865d88332ae1434c09b53e8175"}
Jul 15 18:17:47.364292 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:17:47.364241    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-sk2rm" podStartSLOduration=3.705247333 podStartE2EDuration="25.364213528s" totalImagesPullingTime="21.658966195s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-15 18:17:22 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 18:17:47.363858991 +0000 UTC m=+25.898282349" watchObservedRunningTime="2026-07-15 18:17:47.364213528 +0000 UTC m=+25.898636885"
Jul 15 18:17:48.200641 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:17:48.200614    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-n88x2"
Jul 15 18:17:48.200828 ip-10-0-141-171 kubenswrapper[2567]: E0715 18:17:48.200742    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-n88x2" podUID="99ec9d0a-ff24-4f04-b38d-b4a7de812d3b"
Jul 15 18:17:48.511129 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:17:48.511105    2567 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-t2vtv"
Jul 15 18:17:48.511774 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:17:48.511565    2567 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-t2vtv"
Jul 15 18:17:48.520151 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:17:48.520118    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-t2vtv"
Jul 15 18:17:48.520525 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:17:48.520510    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-t2vtv"
Jul 15 18:17:49.200059 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:17:49.199990    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-4lm4m"
Jul 15 18:17:49.200290 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:17:49.199991    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-dqncz"
Jul 15 18:17:49.200290 ip-10-0-141-171 kubenswrapper[2567]: E0715 18:17:49.200091    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-4lm4m" podUID="b4f54a92-c72a-4f20-93f7-7b424f8f2656"
Jul 15 18:17:49.200290 ip-10-0-141-171 kubenswrapper[2567]: E0715 18:17:49.200162    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-dqncz" podUID="0d941f69-52de-4bf3-b262-9d9e07d9d730"
Jul 15 18:17:49.350738 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:17:49.350709    2567 generic.go:356] "Generic (PLEG): container finished" podID="b4008ec9-cbff-43c2-905e-abd5cf63c321" containerID="10decde79106071ca11ba0f935c7025926bfd9fb8f0cf6acabd524e2f675c419" exitCode=0
Jul 15 18:17:49.351004 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:17:49.350782    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-d6rg2" event={"ID":"b4008ec9-cbff-43c2-905e-abd5cf63c321","Type":"ContainerDied","Data":"10decde79106071ca11ba0f935c7025926bfd9fb8f0cf6acabd524e2f675c419"}
Jul 15 18:17:49.353973 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:17:49.353950    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-8hmqx_d8816772-beae-4dff-9c51-9043199e488d/ovn-acl-logging/0.log"
Jul 15 18:17:49.354332 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:17:49.354315    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-8hmqx" event={"ID":"d8816772-beae-4dff-9c51-9043199e488d","Type":"ContainerStarted","Data":"e42c9659c332db481fb961f2b84b6c43d5210239efea93234da00a7063ea44d8"}
Jul 15 18:17:50.200874 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:17:50.200842    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-n88x2"
Jul 15 18:17:50.201649 ip-10-0-141-171 kubenswrapper[2567]: E0715 18:17:50.201358    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-n88x2" podUID="99ec9d0a-ff24-4f04-b38d-b4a7de812d3b"
Jul 15 18:17:51.200264 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:17:51.200009    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-4lm4m"
Jul 15 18:17:51.200451 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:17:51.200009    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-dqncz"
Jul 15 18:17:51.200451 ip-10-0-141-171 kubenswrapper[2567]: E0715 18:17:51.200318    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-4lm4m" podUID="b4f54a92-c72a-4f20-93f7-7b424f8f2656"
Jul 15 18:17:51.200451 ip-10-0-141-171 kubenswrapper[2567]: E0715 18:17:51.200365    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-dqncz" podUID="0d941f69-52de-4bf3-b262-9d9e07d9d730"
Jul 15 18:17:51.360414 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:17:51.360384    2567 generic.go:356] "Generic (PLEG): container finished" podID="b4008ec9-cbff-43c2-905e-abd5cf63c321" containerID="57b6d0929be6148f64b61d63a31b0a85e2f85755b9671e971aff394bf4139ad7" exitCode=0
Jul 15 18:17:51.360821 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:17:51.360468    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-d6rg2" event={"ID":"b4008ec9-cbff-43c2-905e-abd5cf63c321","Type":"ContainerDied","Data":"57b6d0929be6148f64b61d63a31b0a85e2f85755b9671e971aff394bf4139ad7"}
Jul 15 18:17:51.363843 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:17:51.363827    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-8hmqx_d8816772-beae-4dff-9c51-9043199e488d/ovn-acl-logging/0.log"
Jul 15 18:17:51.364210 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:17:51.364183    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-8hmqx" event={"ID":"d8816772-beae-4dff-9c51-9043199e488d","Type":"ContainerStarted","Data":"f41b56d618d8ea4ba18c94c9b49f80c61b0c83374a04e4b7df1cd38a47798c63"}
Jul 15 18:17:51.364495 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:17:51.364463    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-8hmqx"
Jul 15 18:17:51.364594 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:17:51.364551    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-8hmqx"
Jul 15 18:17:51.364685 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:17:51.364604    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-8hmqx"
Jul 15 18:17:51.364685 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:17:51.364637    2567 scope.go:117] "RemoveContainer" containerID="7feb9b91a5f9bb4a258443829d4b06d3dbd6480e4bcf74b928a49bd960c99541"
Jul 15 18:17:51.382201 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:17:51.382182    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-8hmqx"
Jul 15 18:17:51.382355 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:17:51.382340    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-8hmqx"
Jul 15 18:17:52.200572 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:17:52.200543    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-n88x2"
Jul 15 18:17:52.200713 ip-10-0-141-171 kubenswrapper[2567]: E0715 18:17:52.200632    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-n88x2" podUID="99ec9d0a-ff24-4f04-b38d-b4a7de812d3b"
Jul 15 18:17:52.369902 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:17:52.369874    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-8hmqx_d8816772-beae-4dff-9c51-9043199e488d/ovn-acl-logging/0.log"
Jul 15 18:17:52.370335 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:17:52.370244    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-8hmqx" event={"ID":"d8816772-beae-4dff-9c51-9043199e488d","Type":"ContainerStarted","Data":"e16d483043c4a271fc02c9d93d0571cad194bc65b0ca72109cc5a2b599333116"}
Jul 15 18:17:52.396321 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:17:52.396275    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-8hmqx" podStartSLOduration=10.146006656 podStartE2EDuration="30.39626133s" totalImagesPullingTime="20.250254674s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-15 18:17:22 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 18:17:52.395680611 +0000 UTC m=+30.930103988" watchObservedRunningTime="2026-07-15 18:17:52.39626133 +0000 UTC m=+30.930684685"
Jul 15 18:17:53.200081 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:17:53.200046    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-4lm4m"
Jul 15 18:17:53.200226 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:17:53.200090    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-dqncz"
Jul 15 18:17:53.200226 ip-10-0-141-171 kubenswrapper[2567]: E0715 18:17:53.200161    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-4lm4m" podUID="b4f54a92-c72a-4f20-93f7-7b424f8f2656"
Jul 15 18:17:53.200330 ip-10-0-141-171 kubenswrapper[2567]: E0715 18:17:53.200250    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-dqncz" podUID="0d941f69-52de-4bf3-b262-9d9e07d9d730"
Jul 15 18:17:54.199910 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:17:54.199877    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-n88x2"
Jul 15 18:17:54.200404 ip-10-0-141-171 kubenswrapper[2567]: E0715 18:17:54.199985    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-n88x2" podUID="99ec9d0a-ff24-4f04-b38d-b4a7de812d3b"
Jul 15 18:17:54.376581 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:17:54.376544    2567 generic.go:356] "Generic (PLEG): container finished" podID="b4008ec9-cbff-43c2-905e-abd5cf63c321" containerID="7bbd5dfe170ecfff7d523177d4e4c851a7dd7b4a0ef1389e6df1d71e4436411f" exitCode=0
Jul 15 18:17:54.376718 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:17:54.376594    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-d6rg2" event={"ID":"b4008ec9-cbff-43c2-905e-abd5cf63c321","Type":"ContainerDied","Data":"7bbd5dfe170ecfff7d523177d4e4c851a7dd7b4a0ef1389e6df1d71e4436411f"}
Jul 15 18:17:55.200987 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:17:55.200780    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-4lm4m"
Jul 15 18:17:55.201497 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:17:55.200801    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-dqncz"
Jul 15 18:17:55.201497 ip-10-0-141-171 kubenswrapper[2567]: E0715 18:17:55.201066    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-4lm4m" podUID="b4f54a92-c72a-4f20-93f7-7b424f8f2656"
Jul 15 18:17:55.201497 ip-10-0-141-171 kubenswrapper[2567]: E0715 18:17:55.201124    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-dqncz" podUID="0d941f69-52de-4bf3-b262-9d9e07d9d730"
Jul 15 18:17:55.770931 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:17:55.770897    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/0d941f69-52de-4bf3-b262-9d9e07d9d730-original-pull-secret\") pod \"global-pull-secret-syncer-dqncz\" (UID: \"0d941f69-52de-4bf3-b262-9d9e07d9d730\") " pod="kube-system/global-pull-secret-syncer-dqncz"
Jul 15 18:17:55.771120 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:17:55.770943    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/99ec9d0a-ff24-4f04-b38d-b4a7de812d3b-metrics-certs\") pod \"network-metrics-daemon-n88x2\" (UID: \"99ec9d0a-ff24-4f04-b38d-b4a7de812d3b\") " pod="openshift-multus/network-metrics-daemon-n88x2"
Jul 15 18:17:55.771120 ip-10-0-141-171 kubenswrapper[2567]: E0715 18:17:55.771028    2567 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 15 18:17:55.771120 ip-10-0-141-171 kubenswrapper[2567]: E0715 18:17:55.771054    2567 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 15 18:17:55.771120 ip-10-0-141-171 kubenswrapper[2567]: E0715 18:17:55.771105    2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0d941f69-52de-4bf3-b262-9d9e07d9d730-original-pull-secret podName:0d941f69-52de-4bf3-b262-9d9e07d9d730 nodeName:}" failed. No retries permitted until 2026-07-15 18:18:27.771084298 +0000 UTC m=+66.305507632 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/0d941f69-52de-4bf3-b262-9d9e07d9d730-original-pull-secret") pod "global-pull-secret-syncer-dqncz" (UID: "0d941f69-52de-4bf3-b262-9d9e07d9d730") : object "kube-system"/"original-pull-secret" not registered
Jul 15 18:17:55.771120 ip-10-0-141-171 kubenswrapper[2567]: E0715 18:17:55.771125    2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/99ec9d0a-ff24-4f04-b38d-b4a7de812d3b-metrics-certs podName:99ec9d0a-ff24-4f04-b38d-b4a7de812d3b nodeName:}" failed. No retries permitted until 2026-07-15 18:18:27.771115838 +0000 UTC m=+66.305539172 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/99ec9d0a-ff24-4f04-b38d-b4a7de812d3b-metrics-certs") pod "network-metrics-daemon-n88x2" (UID: "99ec9d0a-ff24-4f04-b38d-b4a7de812d3b") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 15 18:17:55.871661 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:17:55.871606    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pjq5n\" (UniqueName: \"kubernetes.io/projected/b4f54a92-c72a-4f20-93f7-7b424f8f2656-kube-api-access-pjq5n\") pod \"network-check-target-4lm4m\" (UID: \"b4f54a92-c72a-4f20-93f7-7b424f8f2656\") " pod="openshift-network-diagnostics/network-check-target-4lm4m"
Jul 15 18:17:55.871820 ip-10-0-141-171 kubenswrapper[2567]: E0715 18:17:55.871772    2567 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 15 18:17:55.871820 ip-10-0-141-171 kubenswrapper[2567]: E0715 18:17:55.871793    2567 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 15 18:17:55.871820 ip-10-0-141-171 kubenswrapper[2567]: E0715 18:17:55.871805    2567 projected.go:196] Error preparing data for projected volume kube-api-access-pjq5n for pod openshift-network-diagnostics/network-check-target-4lm4m: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 15 18:17:55.871934 ip-10-0-141-171 kubenswrapper[2567]: E0715 18:17:55.871863    2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/b4f54a92-c72a-4f20-93f7-7b424f8f2656-kube-api-access-pjq5n podName:b4f54a92-c72a-4f20-93f7-7b424f8f2656 nodeName:}" failed. No retries permitted until 2026-07-15 18:18:27.871844932 +0000 UTC m=+66.406268269 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-pjq5n" (UniqueName: "kubernetes.io/projected/b4f54a92-c72a-4f20-93f7-7b424f8f2656-kube-api-access-pjq5n") pod "network-check-target-4lm4m" (UID: "b4f54a92-c72a-4f20-93f7-7b424f8f2656") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 15 18:17:56.200238 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:17:56.200195    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-n88x2"
Jul 15 18:17:56.200416 ip-10-0-141-171 kubenswrapper[2567]: E0715 18:17:56.200351    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-n88x2" podUID="99ec9d0a-ff24-4f04-b38d-b4a7de812d3b"
Jul 15 18:17:57.200621 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:17:57.200583    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-4lm4m"
Jul 15 18:17:57.201097 ip-10-0-141-171 kubenswrapper[2567]: E0715 18:17:57.200718    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-4lm4m" podUID="b4f54a92-c72a-4f20-93f7-7b424f8f2656"
Jul 15 18:17:57.201097 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:17:57.200762    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-dqncz"
Jul 15 18:17:57.201097 ip-10-0-141-171 kubenswrapper[2567]: E0715 18:17:57.200875    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-dqncz" podUID="0d941f69-52de-4bf3-b262-9d9e07d9d730"
Jul 15 18:17:58.200010 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:17:58.199977    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-n88x2"
Jul 15 18:17:58.200183 ip-10-0-141-171 kubenswrapper[2567]: E0715 18:17:58.200124    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-n88x2" podUID="99ec9d0a-ff24-4f04-b38d-b4a7de812d3b"
Jul 15 18:17:58.388993 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:17:58.388963    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-d6rg2" event={"ID":"b4008ec9-cbff-43c2-905e-abd5cf63c321","Type":"ContainerStarted","Data":"7aaa01cf7a9cb2e5d8cd92a4cb82d0cc8f5c417b8f7ecfcfe331299574c82a71"}
Jul 15 18:17:59.199878 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:17:59.199850    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-4lm4m"
Jul 15 18:17:59.200044 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:17:59.199850    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-dqncz"
Jul 15 18:17:59.200044 ip-10-0-141-171 kubenswrapper[2567]: E0715 18:17:59.199943    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-4lm4m" podUID="b4f54a92-c72a-4f20-93f7-7b424f8f2656"
Jul 15 18:17:59.200044 ip-10-0-141-171 kubenswrapper[2567]: E0715 18:17:59.200009    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-dqncz" podUID="0d941f69-52de-4bf3-b262-9d9e07d9d730"
Jul 15 18:17:59.393762 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:17:59.393728    2567 generic.go:356] "Generic (PLEG): container finished" podID="b4008ec9-cbff-43c2-905e-abd5cf63c321" containerID="7aaa01cf7a9cb2e5d8cd92a4cb82d0cc8f5c417b8f7ecfcfe331299574c82a71" exitCode=0
Jul 15 18:17:59.394126 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:17:59.393782    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-d6rg2" event={"ID":"b4008ec9-cbff-43c2-905e-abd5cf63c321","Type":"ContainerDied","Data":"7aaa01cf7a9cb2e5d8cd92a4cb82d0cc8f5c417b8f7ecfcfe331299574c82a71"}
Jul 15 18:18:00.200593 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:18:00.200562    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-n88x2"
Jul 15 18:18:00.200760 ip-10-0-141-171 kubenswrapper[2567]: E0715 18:18:00.200673    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-n88x2" podUID="99ec9d0a-ff24-4f04-b38d-b4a7de812d3b"
Jul 15 18:18:00.399149 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:18:00.399116    2567 generic.go:356] "Generic (PLEG): container finished" podID="b4008ec9-cbff-43c2-905e-abd5cf63c321" containerID="b5f457744d8f146c41cc5d2d3b8e51c97e4c33e6cf39252a8d9a56a5a544dd36" exitCode=0
Jul 15 18:18:00.399526 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:18:00.399168    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-d6rg2" event={"ID":"b4008ec9-cbff-43c2-905e-abd5cf63c321","Type":"ContainerDied","Data":"b5f457744d8f146c41cc5d2d3b8e51c97e4c33e6cf39252a8d9a56a5a544dd36"}
Jul 15 18:18:01.200662 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:18:01.200631    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-4lm4m"
Jul 15 18:18:01.200830 ip-10-0-141-171 kubenswrapper[2567]: E0715 18:18:01.200726    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-4lm4m" podUID="b4f54a92-c72a-4f20-93f7-7b424f8f2656"
Jul 15 18:18:01.200830 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:18:01.200753    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-dqncz"
Jul 15 18:18:01.200830 ip-10-0-141-171 kubenswrapper[2567]: E0715 18:18:01.200808    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-dqncz" podUID="0d941f69-52de-4bf3-b262-9d9e07d9d730"
Jul 15 18:18:01.403971 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:18:01.403940    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-d6rg2" event={"ID":"b4008ec9-cbff-43c2-905e-abd5cf63c321","Type":"ContainerStarted","Data":"3be37204a0f8291ed5f3a8f247eb44d79c17fe89fa819effbc51527ae5a070b0"}
Jul 15 18:18:01.425901 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:18:01.425860    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-d6rg2" podStartSLOduration=8.331659527 podStartE2EDuration="39.425846448s" totalImagesPullingTime="31.094186921s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-15 18:17:22 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 18:18:01.425219849 +0000 UTC m=+39.959643206" watchObservedRunningTime="2026-07-15 18:18:01.425846448 +0000 UTC m=+39.960269803"
Jul 15 18:18:02.200915 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:18:02.200887    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-n88x2"
Jul 15 18:18:02.201078 ip-10-0-141-171 kubenswrapper[2567]: E0715 18:18:02.200969    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-n88x2" podUID="99ec9d0a-ff24-4f04-b38d-b4a7de812d3b"
Jul 15 18:18:03.199858 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:18:03.199820    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-4lm4m"
Jul 15 18:18:03.200276 ip-10-0-141-171 kubenswrapper[2567]: E0715 18:18:03.199925    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-4lm4m" podUID="b4f54a92-c72a-4f20-93f7-7b424f8f2656"
Jul 15 18:18:03.200276 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:18:03.199975    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-dqncz"
Jul 15 18:18:03.200276 ip-10-0-141-171 kubenswrapper[2567]: E0715 18:18:03.200054    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-dqncz" podUID="0d941f69-52de-4bf3-b262-9d9e07d9d730"
Jul 15 18:18:04.200708 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:18:04.200672    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-n88x2"
Jul 15 18:18:04.201065 ip-10-0-141-171 kubenswrapper[2567]: E0715 18:18:04.200842    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-n88x2" podUID="99ec9d0a-ff24-4f04-b38d-b4a7de812d3b"
Jul 15 18:18:04.951844 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:18:04.951815    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-dqncz"]
Jul 15 18:18:04.952009 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:18:04.951914    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-dqncz"
Jul 15 18:18:04.952086 ip-10-0-141-171 kubenswrapper[2567]: E0715 18:18:04.952024    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-dqncz" podUID="0d941f69-52de-4bf3-b262-9d9e07d9d730"
Jul 15 18:18:04.954739 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:18:04.954707    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-4lm4m"]
Jul 15 18:18:04.954865 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:18:04.954791    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-4lm4m"
Jul 15 18:18:04.954929 ip-10-0-141-171 kubenswrapper[2567]: E0715 18:18:04.954886    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-4lm4m" podUID="b4f54a92-c72a-4f20-93f7-7b424f8f2656"
Jul 15 18:18:04.955576 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:18:04.955553    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-n88x2"]
Jul 15 18:18:04.955670 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:18:04.955629    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-n88x2"
Jul 15 18:18:04.955745 ip-10-0-141-171 kubenswrapper[2567]: E0715 18:18:04.955726    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-n88x2" podUID="99ec9d0a-ff24-4f04-b38d-b4a7de812d3b"
Jul 15 18:18:06.200483 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:18:06.200450    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-dqncz"
Jul 15 18:18:06.201097 ip-10-0-141-171 kubenswrapper[2567]: E0715 18:18:06.200563    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-dqncz" podUID="0d941f69-52de-4bf3-b262-9d9e07d9d730"
Jul 15 18:18:07.200134 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:18:07.199956    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-4lm4m"
Jul 15 18:18:07.200311 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:18:07.199955    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-n88x2"
Jul 15 18:18:07.200311 ip-10-0-141-171 kubenswrapper[2567]: E0715 18:18:07.200204    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-4lm4m" podUID="b4f54a92-c72a-4f20-93f7-7b424f8f2656"
Jul 15 18:18:07.200311 ip-10-0-141-171 kubenswrapper[2567]: E0715 18:18:07.200298    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-n88x2" podUID="99ec9d0a-ff24-4f04-b38d-b4a7de812d3b"
Jul 15 18:18:08.200774 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:18:08.200743    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-dqncz"
Jul 15 18:18:08.201156 ip-10-0-141-171 kubenswrapper[2567]: E0715 18:18:08.200839    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-dqncz" podUID="0d941f69-52de-4bf3-b262-9d9e07d9d730"
Jul 15 18:18:08.700086 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:18:08.700059    2567 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-171.ec2.internal" event="NodeReady"
Jul 15 18:18:08.700253 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:18:08.700190    2567 kubelet_node_status.go:489] "Fast updating node status as it just became ready"
Jul 15 18:18:08.751611 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:18:08.751434    2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-mhp9p"]
Jul 15 18:18:08.773891 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:18:08.773870    2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-qnlmp"]
Jul 15 18:18:08.774020 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:18:08.774001    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-mhp9p"
Jul 15 18:18:08.776337 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:18:08.776311    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\""
Jul 15 18:18:08.776337 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:18:08.776334    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-42x79\""
Jul 15 18:18:08.776556 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:18:08.776539    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\""
Jul 15 18:18:08.787921 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:18:08.787902    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-mhp9p"]
Jul 15 18:18:08.788000 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:18:08.787934    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-qnlmp"]
Jul 15 18:18:08.788041 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:18:08.788003    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-qnlmp"
Jul 15 18:18:08.790404 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:18:08.790386    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\""
Jul 15 18:18:08.790500 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:18:08.790406    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\""
Jul 15 18:18:08.790500 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:18:08.790442    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-4vnzq\""
Jul 15 18:18:08.790614 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:18:08.790555    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\""
Jul 15 18:18:08.849155 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:18:08.849128    2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-fl6p6"]
Jul 15 18:18:08.867981 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:18:08.867961    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-fl6p6"]
Jul 15 18:18:08.868100 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:18:08.868047    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-fl6p6"
Jul 15 18:18:08.870506 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:18:08.870487    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\""
Jul 15 18:18:08.870590 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:18:08.870554    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\""
Jul 15 18:18:08.870686 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:18:08.870671    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\""
Jul 15 18:18:08.870749 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:18:08.870672    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-bvrpn\""
Jul 15 18:18:08.870801 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:18:08.870694    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\""
Jul 15 18:18:08.873453 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:18:08.873436    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qhjgj\" (UniqueName: \"kubernetes.io/projected/6286cd3a-ede8-4245-b546-5298905ddb17-kube-api-access-qhjgj\") pod \"ingress-canary-qnlmp\" (UID: \"6286cd3a-ede8-4245-b546-5298905ddb17\") " pod="openshift-ingress-canary/ingress-canary-qnlmp"
Jul 15 18:18:08.873568 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:18:08.873466    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/e3c4d1b4-5f66-4bdb-be2f-e9287585ab2c-tmp-dir\") pod \"dns-default-mhp9p\" (UID: \"e3c4d1b4-5f66-4bdb-be2f-e9287585ab2c\") " pod="openshift-dns/dns-default-mhp9p"
Jul 15 18:18:08.873568 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:18:08.873518    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/e3c4d1b4-5f66-4bdb-be2f-e9287585ab2c-config-volume\") pod \"dns-default-mhp9p\" (UID: \"e3c4d1b4-5f66-4bdb-be2f-e9287585ab2c\") " pod="openshift-dns/dns-default-mhp9p"
Jul 15 18:18:08.873568 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:18:08.873542    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2p2jf\" (UniqueName: \"kubernetes.io/projected/e3c4d1b4-5f66-4bdb-be2f-e9287585ab2c-kube-api-access-2p2jf\") pod \"dns-default-mhp9p\" (UID: \"e3c4d1b4-5f66-4bdb-be2f-e9287585ab2c\") " pod="openshift-dns/dns-default-mhp9p"
Jul 15 18:18:08.873697 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:18:08.873567    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/3aed4f45-6d7c-43e1-be08-99e65ea41508-data-volume\") pod \"insights-runtime-extractor-fl6p6\" (UID: \"3aed4f45-6d7c-43e1-be08-99e65ea41508\") " pod="openshift-insights/insights-runtime-extractor-fl6p6"
Jul 15 18:18:08.873697 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:18:08.873609    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/6286cd3a-ede8-4245-b546-5298905ddb17-cert\") pod \"ingress-canary-qnlmp\" (UID: \"6286cd3a-ede8-4245-b546-5298905ddb17\") " pod="openshift-ingress-canary/ingress-canary-qnlmp"
Jul 15 18:18:08.873779 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:18:08.873693    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/3aed4f45-6d7c-43e1-be08-99e65ea41508-crio-socket\") pod \"insights-runtime-extractor-fl6p6\" (UID: \"3aed4f45-6d7c-43e1-be08-99e65ea41508\") " pod="openshift-insights/insights-runtime-extractor-fl6p6"
Jul 15 18:18:08.873779 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:18:08.873715    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bnxdh\" (UniqueName: \"kubernetes.io/projected/3aed4f45-6d7c-43e1-be08-99e65ea41508-kube-api-access-bnxdh\") pod \"insights-runtime-extractor-fl6p6\" (UID: \"3aed4f45-6d7c-43e1-be08-99e65ea41508\") " pod="openshift-insights/insights-runtime-extractor-fl6p6"
Jul 15 18:18:08.873779 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:18:08.873742    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/e3c4d1b4-5f66-4bdb-be2f-e9287585ab2c-metrics-tls\") pod \"dns-default-mhp9p\" (UID: \"e3c4d1b4-5f66-4bdb-be2f-e9287585ab2c\") " pod="openshift-dns/dns-default-mhp9p"
Jul 15 18:18:08.873779 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:18:08.873764    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/3aed4f45-6d7c-43e1-be08-99e65ea41508-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-fl6p6\" (UID: \"3aed4f45-6d7c-43e1-be08-99e65ea41508\") " pod="openshift-insights/insights-runtime-extractor-fl6p6"
Jul 15 18:18:08.873920 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:18:08.873782    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/3aed4f45-6d7c-43e1-be08-99e65ea41508-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-fl6p6\" (UID: \"3aed4f45-6d7c-43e1-be08-99e65ea41508\") " pod="openshift-insights/insights-runtime-extractor-fl6p6"
Jul 15 18:18:08.974338 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:18:08.974302    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/6286cd3a-ede8-4245-b546-5298905ddb17-cert\") pod \"ingress-canary-qnlmp\" (UID: \"6286cd3a-ede8-4245-b546-5298905ddb17\") " pod="openshift-ingress-canary/ingress-canary-qnlmp"
Jul 15 18:18:08.974472 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:18:08.974347    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/3aed4f45-6d7c-43e1-be08-99e65ea41508-crio-socket\") pod \"insights-runtime-extractor-fl6p6\" (UID: \"3aed4f45-6d7c-43e1-be08-99e65ea41508\") " pod="openshift-insights/insights-runtime-extractor-fl6p6"
Jul 15 18:18:08.974472 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:18:08.974365    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bnxdh\" (UniqueName: \"kubernetes.io/projected/3aed4f45-6d7c-43e1-be08-99e65ea41508-kube-api-access-bnxdh\") pod \"insights-runtime-extractor-fl6p6\" (UID: \"3aed4f45-6d7c-43e1-be08-99e65ea41508\") " pod="openshift-insights/insights-runtime-extractor-fl6p6"
Jul 15 18:18:08.974472 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:18:08.974383    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/e3c4d1b4-5f66-4bdb-be2f-e9287585ab2c-metrics-tls\") pod \"dns-default-mhp9p\" (UID: \"e3c4d1b4-5f66-4bdb-be2f-e9287585ab2c\") " pod="openshift-dns/dns-default-mhp9p"
Jul 15 18:18:08.974472 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:18:08.974411    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/3aed4f45-6d7c-43e1-be08-99e65ea41508-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-fl6p6\" (UID: \"3aed4f45-6d7c-43e1-be08-99e65ea41508\") " pod="openshift-insights/insights-runtime-extractor-fl6p6"
Jul 15 18:18:08.974646 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:18:08.974540    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/3aed4f45-6d7c-43e1-be08-99e65ea41508-crio-socket\") pod \"insights-runtime-extractor-fl6p6\" (UID: \"3aed4f45-6d7c-43e1-be08-99e65ea41508\") " pod="openshift-insights/insights-runtime-extractor-fl6p6"
Jul 15 18:18:08.974646 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:18:08.974585    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/3aed4f45-6d7c-43e1-be08-99e65ea41508-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-fl6p6\" (UID: \"3aed4f45-6d7c-43e1-be08-99e65ea41508\") " pod="openshift-insights/insights-runtime-extractor-fl6p6"
Jul 15 18:18:08.974646 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:18:08.974633    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qhjgj\" (UniqueName: \"kubernetes.io/projected/6286cd3a-ede8-4245-b546-5298905ddb17-kube-api-access-qhjgj\") pod \"ingress-canary-qnlmp\" (UID: \"6286cd3a-ede8-4245-b546-5298905ddb17\") " pod="openshift-ingress-canary/ingress-canary-qnlmp"
Jul 15 18:18:08.974790 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:18:08.974667    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/e3c4d1b4-5f66-4bdb-be2f-e9287585ab2c-tmp-dir\") pod \"dns-default-mhp9p\" (UID: \"e3c4d1b4-5f66-4bdb-be2f-e9287585ab2c\") " pod="openshift-dns/dns-default-mhp9p"
Jul 15 18:18:08.974790 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:18:08.974727    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/e3c4d1b4-5f66-4bdb-be2f-e9287585ab2c-config-volume\") pod \"dns-default-mhp9p\" (UID: \"e3c4d1b4-5f66-4bdb-be2f-e9287585ab2c\") " pod="openshift-dns/dns-default-mhp9p"
Jul 15 18:18:08.974790 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:18:08.974752    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2p2jf\" (UniqueName: \"kubernetes.io/projected/e3c4d1b4-5f66-4bdb-be2f-e9287585ab2c-kube-api-access-2p2jf\") pod \"dns-default-mhp9p\" (UID: \"e3c4d1b4-5f66-4bdb-be2f-e9287585ab2c\") " pod="openshift-dns/dns-default-mhp9p"
Jul 15 18:18:08.974790 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:18:08.974777    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/3aed4f45-6d7c-43e1-be08-99e65ea41508-data-volume\") pod \"insights-runtime-extractor-fl6p6\" (UID: \"3aed4f45-6d7c-43e1-be08-99e65ea41508\") " pod="openshift-insights/insights-runtime-extractor-fl6p6"
Jul 15 18:18:08.975284 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:18:08.975264    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/3aed4f45-6d7c-43e1-be08-99e65ea41508-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-fl6p6\" (UID: \"3aed4f45-6d7c-43e1-be08-99e65ea41508\") " pod="openshift-insights/insights-runtime-extractor-fl6p6"
Jul 15 18:18:08.975363 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:18:08.975302    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/3aed4f45-6d7c-43e1-be08-99e65ea41508-data-volume\") pod \"insights-runtime-extractor-fl6p6\" (UID: \"3aed4f45-6d7c-43e1-be08-99e65ea41508\") " pod="openshift-insights/insights-runtime-extractor-fl6p6"
Jul 15 18:18:08.975593 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:18:08.975551    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/e3c4d1b4-5f66-4bdb-be2f-e9287585ab2c-tmp-dir\") pod \"dns-default-mhp9p\" (UID: \"e3c4d1b4-5f66-4bdb-be2f-e9287585ab2c\") " pod="openshift-dns/dns-default-mhp9p"
Jul 15 18:18:08.976198 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:18:08.975782    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/e3c4d1b4-5f66-4bdb-be2f-e9287585ab2c-config-volume\") pod \"dns-default-mhp9p\" (UID: \"e3c4d1b4-5f66-4bdb-be2f-e9287585ab2c\") " pod="openshift-dns/dns-default-mhp9p"
Jul 15 18:18:08.980002 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:18:08.978992    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/e3c4d1b4-5f66-4bdb-be2f-e9287585ab2c-metrics-tls\") pod \"dns-default-mhp9p\" (UID: \"e3c4d1b4-5f66-4bdb-be2f-e9287585ab2c\") " pod="openshift-dns/dns-default-mhp9p"
Jul 15 18:18:08.980002 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:18:08.979092    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/6286cd3a-ede8-4245-b546-5298905ddb17-cert\") pod \"ingress-canary-qnlmp\" (UID: \"6286cd3a-ede8-4245-b546-5298905ddb17\") " pod="openshift-ingress-canary/ingress-canary-qnlmp"
Jul 15 18:18:08.980820 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:18:08.980798    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/3aed4f45-6d7c-43e1-be08-99e65ea41508-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-fl6p6\" (UID: \"3aed4f45-6d7c-43e1-be08-99e65ea41508\") " pod="openshift-insights/insights-runtime-extractor-fl6p6"
Jul 15 18:18:08.982633 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:18:08.982606    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qhjgj\" (UniqueName: \"kubernetes.io/projected/6286cd3a-ede8-4245-b546-5298905ddb17-kube-api-access-qhjgj\") pod \"ingress-canary-qnlmp\" (UID: \"6286cd3a-ede8-4245-b546-5298905ddb17\") " pod="openshift-ingress-canary/ingress-canary-qnlmp"
Jul 15 18:18:08.982780 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:18:08.982760    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bnxdh\" (UniqueName: \"kubernetes.io/projected/3aed4f45-6d7c-43e1-be08-99e65ea41508-kube-api-access-bnxdh\") pod \"insights-runtime-extractor-fl6p6\" (UID: \"3aed4f45-6d7c-43e1-be08-99e65ea41508\") " pod="openshift-insights/insights-runtime-extractor-fl6p6"
Jul 15 18:18:08.982839 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:18:08.982827    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2p2jf\" (UniqueName: \"kubernetes.io/projected/e3c4d1b4-5f66-4bdb-be2f-e9287585ab2c-kube-api-access-2p2jf\") pod \"dns-default-mhp9p\" (UID: \"e3c4d1b4-5f66-4bdb-be2f-e9287585ab2c\") " pod="openshift-dns/dns-default-mhp9p"
Jul 15 18:18:09.083218 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:18:09.083146    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-mhp9p"
Jul 15 18:18:09.096429 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:18:09.096407    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-qnlmp"
Jul 15 18:18:09.176566 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:18:09.176520    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-fl6p6"
Jul 15 18:18:09.201855 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:18:09.200452    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-4lm4m"
Jul 15 18:18:09.201855 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:18:09.200886    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-n88x2"
Jul 15 18:18:09.206415 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:18:09.205539    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-s7m6p\""
Jul 15 18:18:09.206415 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:18:09.205658    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-rzhtl\""
Jul 15 18:18:09.206415 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:18:09.205825    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Jul 15 18:18:09.206415 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:18:09.205905    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Jul 15 18:18:09.206415 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:18:09.206140    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Jul 15 18:18:09.287912 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:18:09.287892    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-qnlmp"]
Jul 15 18:18:09.290631 ip-10-0-141-171 kubenswrapper[2567]: W0715 18:18:09.290601    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6286cd3a_ede8_4245_b546_5298905ddb17.slice/crio-83fe55b8ec07e478f21bf3d12cab9fca4d514507d385d5ee654c40ca1c110a62 WatchSource:0}: Error finding container 83fe55b8ec07e478f21bf3d12cab9fca4d514507d385d5ee654c40ca1c110a62: Status 404 returned error can't find the container with id 83fe55b8ec07e478f21bf3d12cab9fca4d514507d385d5ee654c40ca1c110a62
Jul 15 18:18:09.292835 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:18:09.292816    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-mhp9p"]
Jul 15 18:18:09.297475 ip-10-0-141-171 kubenswrapper[2567]: W0715 18:18:09.297451    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode3c4d1b4_5f66_4bdb_be2f_e9287585ab2c.slice/crio-ad55738fca0bfe7ed2cf0e23c78bbe951b6c6362197102f80083214e70ad93e5 WatchSource:0}: Error finding container ad55738fca0bfe7ed2cf0e23c78bbe951b6c6362197102f80083214e70ad93e5: Status 404 returned error can't find the container with id ad55738fca0bfe7ed2cf0e23c78bbe951b6c6362197102f80083214e70ad93e5
Jul 15 18:18:09.332766 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:18:09.332743    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-fl6p6"]
Jul 15 18:18:09.335563 ip-10-0-141-171 kubenswrapper[2567]: W0715 18:18:09.335538    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3aed4f45_6d7c_43e1_be08_99e65ea41508.slice/crio-0d53fb3bc37c226bb6f59c0c39ecdc66628ecedc5ddce52412f9bbf4cfe4b9db WatchSource:0}: Error finding container 0d53fb3bc37c226bb6f59c0c39ecdc66628ecedc5ddce52412f9bbf4cfe4b9db: Status 404 returned error can't find the container with id 0d53fb3bc37c226bb6f59c0c39ecdc66628ecedc5ddce52412f9bbf4cfe4b9db
Jul 15 18:18:09.422771 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:18:09.422741    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-qnlmp" event={"ID":"6286cd3a-ede8-4245-b546-5298905ddb17","Type":"ContainerStarted","Data":"83fe55b8ec07e478f21bf3d12cab9fca4d514507d385d5ee654c40ca1c110a62"}
Jul 15 18:18:09.423922 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:18:09.423897    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-mhp9p" event={"ID":"e3c4d1b4-5f66-4bdb-be2f-e9287585ab2c","Type":"ContainerStarted","Data":"ad55738fca0bfe7ed2cf0e23c78bbe951b6c6362197102f80083214e70ad93e5"}
Jul 15 18:18:09.424881 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:18:09.424859    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-fl6p6" event={"ID":"3aed4f45-6d7c-43e1-be08-99e65ea41508","Type":"ContainerStarted","Data":"0d53fb3bc37c226bb6f59c0c39ecdc66628ecedc5ddce52412f9bbf4cfe4b9db"}
Jul 15 18:18:10.201466 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:18:10.201429    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-dqncz"
Jul 15 18:18:10.204886 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:18:10.204857    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Jul 15 18:18:13.135279 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:18:13.135057    2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-9b6fc9785-k9w2d"]
Jul 15 18:18:13.157540 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:18:13.157518    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-9b6fc9785-k9w2d"]
Jul 15 18:18:13.157685 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:18:13.157605    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-9b6fc9785-k9w2d"
Jul 15 18:18:13.160053 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:18:13.160029    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\""
Jul 15 18:18:13.160873 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:18:13.160851    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\""
Jul 15 18:18:13.161001 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:18:13.160910    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\""
Jul 15 18:18:13.161001 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:18:13.160980    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-lb7sl\""
Jul 15 18:18:13.161108 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:18:13.160912    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\""
Jul 15 18:18:13.161108 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:18:13.161098    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\""
Jul 15 18:18:13.161210 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:18:13.161184    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\""
Jul 15 18:18:13.161463 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:18:13.161432    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\""
Jul 15 18:18:13.209313 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:18:13.209277    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/9c030f72-5d14-4fa9-89a4-ae7a58a23af7-console-config\") pod \"console-9b6fc9785-k9w2d\" (UID: \"9c030f72-5d14-4fa9-89a4-ae7a58a23af7\") " pod="openshift-console/console-9b6fc9785-k9w2d"
Jul 15 18:18:13.209313 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:18:13.209307    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/9c030f72-5d14-4fa9-89a4-ae7a58a23af7-oauth-serving-cert\") pod \"console-9b6fc9785-k9w2d\" (UID: \"9c030f72-5d14-4fa9-89a4-ae7a58a23af7\") " pod="openshift-console/console-9b6fc9785-k9w2d"
Jul 15 18:18:13.209559 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:18:13.209353    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/9c030f72-5d14-4fa9-89a4-ae7a58a23af7-console-oauth-config\") pod \"console-9b6fc9785-k9w2d\" (UID: \"9c030f72-5d14-4fa9-89a4-ae7a58a23af7\") " pod="openshift-console/console-9b6fc9785-k9w2d"
Jul 15 18:18:13.209559 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:18:13.209403    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/9c030f72-5d14-4fa9-89a4-ae7a58a23af7-console-serving-cert\") pod \"console-9b6fc9785-k9w2d\" (UID: \"9c030f72-5d14-4fa9-89a4-ae7a58a23af7\") " pod="openshift-console/console-9b6fc9785-k9w2d"
Jul 15 18:18:13.209559 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:18:13.209439    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-px8rr\" (UniqueName: \"kubernetes.io/projected/9c030f72-5d14-4fa9-89a4-ae7a58a23af7-kube-api-access-px8rr\") pod \"console-9b6fc9785-k9w2d\" (UID: \"9c030f72-5d14-4fa9-89a4-ae7a58a23af7\") " pod="openshift-console/console-9b6fc9785-k9w2d"
Jul 15 18:18:13.209559 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:18:13.209490    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/9c030f72-5d14-4fa9-89a4-ae7a58a23af7-service-ca\") pod \"console-9b6fc9785-k9w2d\" (UID: \"9c030f72-5d14-4fa9-89a4-ae7a58a23af7\") " pod="openshift-console/console-9b6fc9785-k9w2d"
Jul 15 18:18:13.310588 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:18:13.310551    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/9c030f72-5d14-4fa9-89a4-ae7a58a23af7-console-config\") pod \"console-9b6fc9785-k9w2d\" (UID: \"9c030f72-5d14-4fa9-89a4-ae7a58a23af7\") " pod="openshift-console/console-9b6fc9785-k9w2d"
Jul 15 18:18:13.310793 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:18:13.310600    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/9c030f72-5d14-4fa9-89a4-ae7a58a23af7-oauth-serving-cert\") pod \"console-9b6fc9785-k9w2d\" (UID: \"9c030f72-5d14-4fa9-89a4-ae7a58a23af7\") " pod="openshift-console/console-9b6fc9785-k9w2d"
Jul 15 18:18:13.310793 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:18:13.310658    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/9c030f72-5d14-4fa9-89a4-ae7a58a23af7-console-oauth-config\") pod \"console-9b6fc9785-k9w2d\" (UID: \"9c030f72-5d14-4fa9-89a4-ae7a58a23af7\") " pod="openshift-console/console-9b6fc9785-k9w2d"
Jul 15 18:18:13.310793 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:18:13.310689    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/9c030f72-5d14-4fa9-89a4-ae7a58a23af7-console-serving-cert\") pod \"console-9b6fc9785-k9w2d\" (UID: \"9c030f72-5d14-4fa9-89a4-ae7a58a23af7\") " pod="openshift-console/console-9b6fc9785-k9w2d"
Jul 15 18:18:13.310793 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:18:13.310717    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-px8rr\" (UniqueName: \"kubernetes.io/projected/9c030f72-5d14-4fa9-89a4-ae7a58a23af7-kube-api-access-px8rr\") pod \"console-9b6fc9785-k9w2d\" (UID: \"9c030f72-5d14-4fa9-89a4-ae7a58a23af7\") " pod="openshift-console/console-9b6fc9785-k9w2d"
Jul 15 18:18:13.310972 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:18:13.310874    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/9c030f72-5d14-4fa9-89a4-ae7a58a23af7-service-ca\") pod \"console-9b6fc9785-k9w2d\" (UID: \"9c030f72-5d14-4fa9-89a4-ae7a58a23af7\") " pod="openshift-console/console-9b6fc9785-k9w2d"
Jul 15 18:18:13.311594 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:18:13.311570    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/9c030f72-5d14-4fa9-89a4-ae7a58a23af7-console-config\") pod \"console-9b6fc9785-k9w2d\" (UID: \"9c030f72-5d14-4fa9-89a4-ae7a58a23af7\") " pod="openshift-console/console-9b6fc9785-k9w2d"
Jul 15 18:18:13.311717 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:18:13.311638    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/9c030f72-5d14-4fa9-89a4-ae7a58a23af7-oauth-serving-cert\") pod \"console-9b6fc9785-k9w2d\" (UID: \"9c030f72-5d14-4fa9-89a4-ae7a58a23af7\") " pod="openshift-console/console-9b6fc9785-k9w2d"
Jul 15 18:18:13.311717 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:18:13.311653    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/9c030f72-5d14-4fa9-89a4-ae7a58a23af7-service-ca\") pod \"console-9b6fc9785-k9w2d\" (UID: \"9c030f72-5d14-4fa9-89a4-ae7a58a23af7\") " pod="openshift-console/console-9b6fc9785-k9w2d"
Jul 15 18:18:13.314441 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:18:13.314421    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/9c030f72-5d14-4fa9-89a4-ae7a58a23af7-console-oauth-config\") pod \"console-9b6fc9785-k9w2d\" (UID: \"9c030f72-5d14-4fa9-89a4-ae7a58a23af7\") " pod="openshift-console/console-9b6fc9785-k9w2d"
Jul 15 18:18:13.314594 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:18:13.314568    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/9c030f72-5d14-4fa9-89a4-ae7a58a23af7-console-serving-cert\") pod \"console-9b6fc9785-k9w2d\" (UID: \"9c030f72-5d14-4fa9-89a4-ae7a58a23af7\") " pod="openshift-console/console-9b6fc9785-k9w2d"
Jul 15 18:18:13.319153 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:18:13.319118    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-px8rr\" (UniqueName: \"kubernetes.io/projected/9c030f72-5d14-4fa9-89a4-ae7a58a23af7-kube-api-access-px8rr\") pod \"console-9b6fc9785-k9w2d\" (UID: \"9c030f72-5d14-4fa9-89a4-ae7a58a23af7\") " pod="openshift-console/console-9b6fc9785-k9w2d"
Jul 15 18:18:13.467835 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:18:13.467800    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-9b6fc9785-k9w2d"
Jul 15 18:18:16.432199 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:18:16.431934    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-9b6fc9785-k9w2d"]
Jul 15 18:18:16.449573 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:18:16.449050    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-qnlmp" event={"ID":"6286cd3a-ede8-4245-b546-5298905ddb17","Type":"ContainerStarted","Data":"8a4f40922aa90282166fcff0bcb3fe16f4ac74a3713583bf032cd07497fe11ce"}
Jul 15 18:18:16.452650 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:18:16.452580    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-mhp9p" event={"ID":"e3c4d1b4-5f66-4bdb-be2f-e9287585ab2c","Type":"ContainerStarted","Data":"2b625f2e8b9efc1448cdd7b8de1fe2561926a563806c2d449097588e5a99e132"}
Jul 15 18:18:16.465365 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:18:16.465316    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-qnlmp" podStartSLOduration=1.482288011 podStartE2EDuration="8.465290338s" totalImagesPullingTime="6.983002327s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 18:18:08 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 18:18:16.464999708 +0000 UTC m=+54.999423082" watchObservedRunningTime="2026-07-15 18:18:16.465290338 +0000 UTC m=+54.999713721"
Jul 15 18:18:16.469327 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:18:16.468861    2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-77d98bc786-5c44d"]
Jul 15 18:18:16.483949 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:18:16.483928    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-77d98bc786-5c44d"]
Jul 15 18:18:16.484091 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:18:16.484038    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-77d98bc786-5c44d"
Jul 15 18:18:16.486757 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:18:16.486525    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-dockercfg-bbnkp\""
Jul 15 18:18:16.486757 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:18:16.486530    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-tls\""
Jul 15 18:18:16.540615 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:18:16.540483    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/79788eb3-58b1-498f-ade3-3b7ab47b0c85-tls-certificates\") pod \"prometheus-operator-admission-webhook-77d98bc786-5c44d\" (UID: \"79788eb3-58b1-498f-ade3-3b7ab47b0c85\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-77d98bc786-5c44d"
Jul 15 18:18:16.641067 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:18:16.641034    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/79788eb3-58b1-498f-ade3-3b7ab47b0c85-tls-certificates\") pod \"prometheus-operator-admission-webhook-77d98bc786-5c44d\" (UID: \"79788eb3-58b1-498f-ade3-3b7ab47b0c85\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-77d98bc786-5c44d"
Jul 15 18:18:16.644462 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:18:16.644436    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/79788eb3-58b1-498f-ade3-3b7ab47b0c85-tls-certificates\") pod \"prometheus-operator-admission-webhook-77d98bc786-5c44d\" (UID: \"79788eb3-58b1-498f-ade3-3b7ab47b0c85\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-77d98bc786-5c44d"
Jul 15 18:18:16.794879 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:18:16.794803    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-77d98bc786-5c44d"
Jul 15 18:18:16.947493 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:18:16.947420    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-77d98bc786-5c44d"]
Jul 15 18:18:16.952897 ip-10-0-141-171 kubenswrapper[2567]: W0715 18:18:16.952868    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod79788eb3_58b1_498f_ade3_3b7ab47b0c85.slice/crio-32c3ac0e46891423e1efbafe25c7ddb1edbed46c83bd6cd77005fdc04af2fcee WatchSource:0}: Error finding container 32c3ac0e46891423e1efbafe25c7ddb1edbed46c83bd6cd77005fdc04af2fcee: Status 404 returned error can't find the container with id 32c3ac0e46891423e1efbafe25c7ddb1edbed46c83bd6cd77005fdc04af2fcee
Jul 15 18:18:17.459393 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:18:17.459300    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-fl6p6" event={"ID":"3aed4f45-6d7c-43e1-be08-99e65ea41508","Type":"ContainerStarted","Data":"3acdf8a1ea3e129d382b217d1872ff47dfad8e0e7b5193342776e00b54c4c0ea"}
Jul 15 18:18:17.460952 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:18:17.460869    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-9b6fc9785-k9w2d" event={"ID":"9c030f72-5d14-4fa9-89a4-ae7a58a23af7","Type":"ContainerStarted","Data":"b89a09c4dc4509d6652be4d71509e7304b55fd7d3e46f102835ebd906f707557"}
Jul 15 18:18:17.463156 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:18:17.463132    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-mhp9p" event={"ID":"e3c4d1b4-5f66-4bdb-be2f-e9287585ab2c","Type":"ContainerStarted","Data":"64ac385d0e1633c361b6bd96ee3b51e34cacb6da0e4078fab2f1833651062307"}
Jul 15 18:18:17.463800 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:18:17.463728    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-mhp9p"
Jul 15 18:18:17.465107 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:18:17.465084    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-77d98bc786-5c44d" event={"ID":"79788eb3-58b1-498f-ade3-3b7ab47b0c85","Type":"ContainerStarted","Data":"32c3ac0e46891423e1efbafe25c7ddb1edbed46c83bd6cd77005fdc04af2fcee"}
Jul 15 18:18:17.481726 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:18:17.481671    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-mhp9p" podStartSLOduration=2.507531815 podStartE2EDuration="9.481656465s" totalImagesPullingTime="6.97412465s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 18:18:08 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 18:18:17.481031525 +0000 UTC m=+56.015454884" watchObservedRunningTime="2026-07-15 18:18:17.481656465 +0000 UTC m=+56.016079818"
Jul 15 18:18:19.712957 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:18:19.712710    2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-6c775749fc-6wksh"]
Jul 15 18:18:19.715320 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:18:19.715295    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6c775749fc-6wksh"
Jul 15 18:18:19.722100 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:18:19.722078    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\""
Jul 15 18:18:19.726564 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:18:19.726511    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-6c775749fc-6wksh"]
Jul 15 18:18:19.768344 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:18:19.768316    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/7f33bdee-5244-4c91-93b0-09ed9b5056b8-console-oauth-config\") pod \"console-6c775749fc-6wksh\" (UID: \"7f33bdee-5244-4c91-93b0-09ed9b5056b8\") " pod="openshift-console/console-6c775749fc-6wksh"
Jul 15 18:18:19.768463 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:18:19.768354    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/7f33bdee-5244-4c91-93b0-09ed9b5056b8-oauth-serving-cert\") pod \"console-6c775749fc-6wksh\" (UID: \"7f33bdee-5244-4c91-93b0-09ed9b5056b8\") " pod="openshift-console/console-6c775749fc-6wksh"
Jul 15 18:18:19.768463 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:18:19.768399    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/7f33bdee-5244-4c91-93b0-09ed9b5056b8-console-serving-cert\") pod \"console-6c775749fc-6wksh\" (UID: \"7f33bdee-5244-4c91-93b0-09ed9b5056b8\") " pod="openshift-console/console-6c775749fc-6wksh"
Jul 15 18:18:19.768463 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:18:19.768421    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/7f33bdee-5244-4c91-93b0-09ed9b5056b8-service-ca\") pod \"console-6c775749fc-6wksh\" (UID: \"7f33bdee-5244-4c91-93b0-09ed9b5056b8\") " pod="openshift-console/console-6c775749fc-6wksh"
Jul 15 18:18:19.768605 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:18:19.768471    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-d6zrx\" (UniqueName: \"kubernetes.io/projected/7f33bdee-5244-4c91-93b0-09ed9b5056b8-kube-api-access-d6zrx\") pod \"console-6c775749fc-6wksh\" (UID: \"7f33bdee-5244-4c91-93b0-09ed9b5056b8\") " pod="openshift-console/console-6c775749fc-6wksh"
Jul 15 18:18:19.768605 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:18:19.768502    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7f33bdee-5244-4c91-93b0-09ed9b5056b8-trusted-ca-bundle\") pod \"console-6c775749fc-6wksh\" (UID: \"7f33bdee-5244-4c91-93b0-09ed9b5056b8\") " pod="openshift-console/console-6c775749fc-6wksh"
Jul 15 18:18:19.768605 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:18:19.768564    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/7f33bdee-5244-4c91-93b0-09ed9b5056b8-console-config\") pod \"console-6c775749fc-6wksh\" (UID: \"7f33bdee-5244-4c91-93b0-09ed9b5056b8\") " pod="openshift-console/console-6c775749fc-6wksh"
Jul 15 18:18:19.869827 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:18:19.869797    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/7f33bdee-5244-4c91-93b0-09ed9b5056b8-console-serving-cert\") pod \"console-6c775749fc-6wksh\" (UID: \"7f33bdee-5244-4c91-93b0-09ed9b5056b8\") " pod="openshift-console/console-6c775749fc-6wksh"
Jul 15 18:18:19.869827 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:18:19.869829    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/7f33bdee-5244-4c91-93b0-09ed9b5056b8-service-ca\") pod \"console-6c775749fc-6wksh\" (UID: \"7f33bdee-5244-4c91-93b0-09ed9b5056b8\") " pod="openshift-console/console-6c775749fc-6wksh"
Jul 15 18:18:19.870040 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:18:19.869848    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-d6zrx\" (UniqueName: \"kubernetes.io/projected/7f33bdee-5244-4c91-93b0-09ed9b5056b8-kube-api-access-d6zrx\") pod \"console-6c775749fc-6wksh\" (UID: \"7f33bdee-5244-4c91-93b0-09ed9b5056b8\") " pod="openshift-console/console-6c775749fc-6wksh"
Jul 15 18:18:19.870040 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:18:19.869869    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7f33bdee-5244-4c91-93b0-09ed9b5056b8-trusted-ca-bundle\") pod \"console-6c775749fc-6wksh\" (UID: \"7f33bdee-5244-4c91-93b0-09ed9b5056b8\") " pod="openshift-console/console-6c775749fc-6wksh"
Jul 15 18:18:19.870040 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:18:19.869928    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/7f33bdee-5244-4c91-93b0-09ed9b5056b8-console-config\") pod \"console-6c775749fc-6wksh\" (UID: \"7f33bdee-5244-4c91-93b0-09ed9b5056b8\") " pod="openshift-console/console-6c775749fc-6wksh"
Jul 15 18:18:19.870040 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:18:19.869990    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/7f33bdee-5244-4c91-93b0-09ed9b5056b8-console-oauth-config\") pod \"console-6c775749fc-6wksh\" (UID: \"7f33bdee-5244-4c91-93b0-09ed9b5056b8\") " pod="openshift-console/console-6c775749fc-6wksh"
Jul 15 18:18:19.870040 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:18:19.870014    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/7f33bdee-5244-4c91-93b0-09ed9b5056b8-oauth-serving-cert\") pod \"console-6c775749fc-6wksh\" (UID: \"7f33bdee-5244-4c91-93b0-09ed9b5056b8\") " pod="openshift-console/console-6c775749fc-6wksh"
Jul 15 18:18:19.870730 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:18:19.870704    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/7f33bdee-5244-4c91-93b0-09ed9b5056b8-service-ca\") pod \"console-6c775749fc-6wksh\" (UID: \"7f33bdee-5244-4c91-93b0-09ed9b5056b8\") " pod="openshift-console/console-6c775749fc-6wksh"
Jul 15 18:18:19.870730 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:18:19.870711    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/7f33bdee-5244-4c91-93b0-09ed9b5056b8-oauth-serving-cert\") pod \"console-6c775749fc-6wksh\" (UID: \"7f33bdee-5244-4c91-93b0-09ed9b5056b8\") " pod="openshift-console/console-6c775749fc-6wksh"
Jul 15 18:18:19.870931 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:18:19.870915    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/7f33bdee-5244-4c91-93b0-09ed9b5056b8-console-config\") pod \"console-6c775749fc-6wksh\" (UID: \"7f33bdee-5244-4c91-93b0-09ed9b5056b8\") " pod="openshift-console/console-6c775749fc-6wksh"
Jul 15 18:18:19.871092 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:18:19.871064    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7f33bdee-5244-4c91-93b0-09ed9b5056b8-trusted-ca-bundle\") pod \"console-6c775749fc-6wksh\" (UID: \"7f33bdee-5244-4c91-93b0-09ed9b5056b8\") " pod="openshift-console/console-6c775749fc-6wksh"
Jul 15 18:18:19.873618 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:18:19.873593    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/7f33bdee-5244-4c91-93b0-09ed9b5056b8-console-oauth-config\") pod \"console-6c775749fc-6wksh\" (UID: \"7f33bdee-5244-4c91-93b0-09ed9b5056b8\") " pod="openshift-console/console-6c775749fc-6wksh"
Jul 15 18:18:19.873707 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:18:19.873645    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/7f33bdee-5244-4c91-93b0-09ed9b5056b8-console-serving-cert\") pod \"console-6c775749fc-6wksh\" (UID: \"7f33bdee-5244-4c91-93b0-09ed9b5056b8\") " pod="openshift-console/console-6c775749fc-6wksh"
Jul 15 18:18:19.879330 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:18:19.879305    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-d6zrx\" (UniqueName: \"kubernetes.io/projected/7f33bdee-5244-4c91-93b0-09ed9b5056b8-kube-api-access-d6zrx\") pod \"console-6c775749fc-6wksh\" (UID: \"7f33bdee-5244-4c91-93b0-09ed9b5056b8\") " pod="openshift-console/console-6c775749fc-6wksh"
Jul 15 18:18:20.027261 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:18:20.027161    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6c775749fc-6wksh"
Jul 15 18:18:21.404294 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:18:21.404202    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-6c775749fc-6wksh"]
Jul 15 18:18:21.410790 ip-10-0-141-171 kubenswrapper[2567]: W0715 18:18:21.410751    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7f33bdee_5244_4c91_93b0_09ed9b5056b8.slice/crio-0d4b60a0cd010ac5c26c4693fc516c321f32ff15b89ac1bda7d279b02e8866fb WatchSource:0}: Error finding container 0d4b60a0cd010ac5c26c4693fc516c321f32ff15b89ac1bda7d279b02e8866fb: Status 404 returned error can't find the container with id 0d4b60a0cd010ac5c26c4693fc516c321f32ff15b89ac1bda7d279b02e8866fb
Jul 15 18:18:21.479484 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:18:21.479450    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-fl6p6" event={"ID":"3aed4f45-6d7c-43e1-be08-99e65ea41508","Type":"ContainerStarted","Data":"906e13ed60f546e135afc64c50fc6802c22bccf01266ebf17d848df1d34109d5"}
Jul 15 18:18:21.481572 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:18:21.481509    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-9b6fc9785-k9w2d" event={"ID":"9c030f72-5d14-4fa9-89a4-ae7a58a23af7","Type":"ContainerStarted","Data":"a90e0580815344d8fc5a7b3f031a304026316b13019b0a4b587960da32c0c56a"}
Jul 15 18:18:21.483272 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:18:21.483244    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-77d98bc786-5c44d" event={"ID":"79788eb3-58b1-498f-ade3-3b7ab47b0c85","Type":"ContainerStarted","Data":"02db82dafcbd46f8ebd1823e3d35af2c7f204a0f84846e4294e3633aaefff6c9"}
Jul 15 18:18:21.483454 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:18:21.483404    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-77d98bc786-5c44d"
Jul 15 18:18:21.485144 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:18:21.485123    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6c775749fc-6wksh" event={"ID":"7f33bdee-5244-4c91-93b0-09ed9b5056b8","Type":"ContainerStarted","Data":"a9a8781a5f40ee3cbd36a91a06f19d7137596e43c6eaf5676f3f7126ce2aa9cf"}
Jul 15 18:18:21.485278 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:18:21.485156    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6c775749fc-6wksh" event={"ID":"7f33bdee-5244-4c91-93b0-09ed9b5056b8","Type":"ContainerStarted","Data":"0d4b60a0cd010ac5c26c4693fc516c321f32ff15b89ac1bda7d279b02e8866fb"}
Jul 15 18:18:21.488837 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:18:21.488816    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-77d98bc786-5c44d"
Jul 15 18:18:21.498068 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:18:21.498024    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-9b6fc9785-k9w2d" podStartSLOduration=3.666235609 podStartE2EDuration="8.498009477s" totalImagesPullingTime="4.831773868s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 18:18:13 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 18:18:21.497157064 +0000 UTC m=+60.031580423" watchObservedRunningTime="2026-07-15 18:18:21.498009477 +0000 UTC m=+60.032432832"
Jul 15 18:18:21.512363 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:18:21.512319    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-admission-webhook-77d98bc786-5c44d" podStartSLOduration=1.209456523 podStartE2EDuration="5.512308326s" totalImagesPullingTime="4.302851803s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 18:18:16 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 18:18:21.511288853 +0000 UTC m=+60.045712227" watchObservedRunningTime="2026-07-15 18:18:21.512308326 +0000 UTC m=+60.046731682"
Jul 15 18:18:21.530741 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:18:21.530692    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-6c775749fc-6wksh" podStartSLOduration=2.53067778 podStartE2EDuration="2.53067778s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 18:18:19 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 18:18:21.529844314 +0000 UTC m=+60.064267687" watchObservedRunningTime="2026-07-15 18:18:21.53067778 +0000 UTC m=+60.065101135"
Jul 15 18:18:22.529742 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:18:22.529708    2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-64785b6675-8bzcj"]
Jul 15 18:18:22.563283 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:18:22.563256    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-64785b6675-8bzcj"]
Jul 15 18:18:22.563455 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:18:22.563376    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-64785b6675-8bzcj"
Jul 15 18:18:22.566731 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:18:22.566423    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\""
Jul 15 18:18:22.566731 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:18:22.566490    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-tls\""
Jul 15 18:18:22.566731 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:18:22.566541    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-kube-rbac-proxy-config\""
Jul 15 18:18:22.568744 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:18:22.567285    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\""
Jul 15 18:18:22.568744 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:18:22.567761    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\""
Jul 15 18:18:22.568744 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:18:22.568501    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-dockercfg-n5hpt\""
Jul 15 18:18:22.693492 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:18:22.693452    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/54e8b5c7-e4da-44a2-ac80-0dc7ef91a6b9-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-64785b6675-8bzcj\" (UID: \"54e8b5c7-e4da-44a2-ac80-0dc7ef91a6b9\") " pod="openshift-monitoring/prometheus-operator-64785b6675-8bzcj"
Jul 15 18:18:22.693682 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:18:22.693570    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mg7rn\" (UniqueName: \"kubernetes.io/projected/54e8b5c7-e4da-44a2-ac80-0dc7ef91a6b9-kube-api-access-mg7rn\") pod \"prometheus-operator-64785b6675-8bzcj\" (UID: \"54e8b5c7-e4da-44a2-ac80-0dc7ef91a6b9\") " pod="openshift-monitoring/prometheus-operator-64785b6675-8bzcj"
Jul 15 18:18:22.693682 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:18:22.693592    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/54e8b5c7-e4da-44a2-ac80-0dc7ef91a6b9-prometheus-operator-tls\") pod \"prometheus-operator-64785b6675-8bzcj\" (UID: \"54e8b5c7-e4da-44a2-ac80-0dc7ef91a6b9\") " pod="openshift-monitoring/prometheus-operator-64785b6675-8bzcj"
Jul 15 18:18:22.693776 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:18:22.693702    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/54e8b5c7-e4da-44a2-ac80-0dc7ef91a6b9-metrics-client-ca\") pod \"prometheus-operator-64785b6675-8bzcj\" (UID: \"54e8b5c7-e4da-44a2-ac80-0dc7ef91a6b9\") " pod="openshift-monitoring/prometheus-operator-64785b6675-8bzcj"
Jul 15 18:18:22.794265 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:18:22.794169    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/54e8b5c7-e4da-44a2-ac80-0dc7ef91a6b9-metrics-client-ca\") pod \"prometheus-operator-64785b6675-8bzcj\" (UID: \"54e8b5c7-e4da-44a2-ac80-0dc7ef91a6b9\") " pod="openshift-monitoring/prometheus-operator-64785b6675-8bzcj"
Jul 15 18:18:22.794265 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:18:22.794249    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/54e8b5c7-e4da-44a2-ac80-0dc7ef91a6b9-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-64785b6675-8bzcj\" (UID: \"54e8b5c7-e4da-44a2-ac80-0dc7ef91a6b9\") " pod="openshift-monitoring/prometheus-operator-64785b6675-8bzcj"
Jul 15 18:18:22.794486 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:18:22.794331    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mg7rn\" (UniqueName: \"kubernetes.io/projected/54e8b5c7-e4da-44a2-ac80-0dc7ef91a6b9-kube-api-access-mg7rn\") pod \"prometheus-operator-64785b6675-8bzcj\" (UID: \"54e8b5c7-e4da-44a2-ac80-0dc7ef91a6b9\") " pod="openshift-monitoring/prometheus-operator-64785b6675-8bzcj"
Jul 15 18:18:22.794486 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:18:22.794361    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/54e8b5c7-e4da-44a2-ac80-0dc7ef91a6b9-prometheus-operator-tls\") pod \"prometheus-operator-64785b6675-8bzcj\" (UID: \"54e8b5c7-e4da-44a2-ac80-0dc7ef91a6b9\") " pod="openshift-monitoring/prometheus-operator-64785b6675-8bzcj"
Jul 15 18:18:22.794486 ip-10-0-141-171 kubenswrapper[2567]: E0715 18:18:22.794458    2567 secret.go:189] Couldn't get secret openshift-monitoring/prometheus-operator-tls: secret "prometheus-operator-tls" not found
Jul 15 18:18:22.794636 ip-10-0-141-171 kubenswrapper[2567]: E0715 18:18:22.794528    2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/54e8b5c7-e4da-44a2-ac80-0dc7ef91a6b9-prometheus-operator-tls podName:54e8b5c7-e4da-44a2-ac80-0dc7ef91a6b9 nodeName:}" failed. No retries permitted until 2026-07-15 18:18:23.294508971 +0000 UTC m=+61.828932310 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "prometheus-operator-tls" (UniqueName: "kubernetes.io/secret/54e8b5c7-e4da-44a2-ac80-0dc7ef91a6b9-prometheus-operator-tls") pod "prometheus-operator-64785b6675-8bzcj" (UID: "54e8b5c7-e4da-44a2-ac80-0dc7ef91a6b9") : secret "prometheus-operator-tls" not found
Jul 15 18:18:22.794944 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:18:22.794919    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/54e8b5c7-e4da-44a2-ac80-0dc7ef91a6b9-metrics-client-ca\") pod \"prometheus-operator-64785b6675-8bzcj\" (UID: \"54e8b5c7-e4da-44a2-ac80-0dc7ef91a6b9\") " pod="openshift-monitoring/prometheus-operator-64785b6675-8bzcj"
Jul 15 18:18:22.797185 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:18:22.797157    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/54e8b5c7-e4da-44a2-ac80-0dc7ef91a6b9-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-64785b6675-8bzcj\" (UID: \"54e8b5c7-e4da-44a2-ac80-0dc7ef91a6b9\") " pod="openshift-monitoring/prometheus-operator-64785b6675-8bzcj"
Jul 15 18:18:22.804595 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:18:22.804576    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mg7rn\" (UniqueName: \"kubernetes.io/projected/54e8b5c7-e4da-44a2-ac80-0dc7ef91a6b9-kube-api-access-mg7rn\") pod \"prometheus-operator-64785b6675-8bzcj\" (UID: \"54e8b5c7-e4da-44a2-ac80-0dc7ef91a6b9\") " pod="openshift-monitoring/prometheus-operator-64785b6675-8bzcj"
Jul 15 18:18:23.298769 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:18:23.298715    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/54e8b5c7-e4da-44a2-ac80-0dc7ef91a6b9-prometheus-operator-tls\") pod \"prometheus-operator-64785b6675-8bzcj\" (UID: \"54e8b5c7-e4da-44a2-ac80-0dc7ef91a6b9\") " pod="openshift-monitoring/prometheus-operator-64785b6675-8bzcj"
Jul 15 18:18:23.301215 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:18:23.301189    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/54e8b5c7-e4da-44a2-ac80-0dc7ef91a6b9-prometheus-operator-tls\") pod \"prometheus-operator-64785b6675-8bzcj\" (UID: \"54e8b5c7-e4da-44a2-ac80-0dc7ef91a6b9\") " pod="openshift-monitoring/prometheus-operator-64785b6675-8bzcj"
Jul 15 18:18:23.387797 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:18:23.387771    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-8hmqx"
Jul 15 18:18:23.468220 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:18:23.468187    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-9b6fc9785-k9w2d"
Jul 15 18:18:23.468405 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:18:23.468271    2567 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-9b6fc9785-k9w2d"
Jul 15 18:18:23.469730 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:18:23.469707    2567 patch_prober.go:28] interesting pod/console-9b6fc9785-k9w2d container/console namespace/openshift-console: Startup probe status=failure output="Get \"https://10.134.0.9:8443/health\": dial tcp 10.134.0.9:8443: connect: connection refused" start-of-body=
Jul 15 18:18:23.469819 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:18:23.469754    2567 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-console/console-9b6fc9785-k9w2d" podUID="9c030f72-5d14-4fa9-89a4-ae7a58a23af7" containerName="console" probeResult="failure" output="Get \"https://10.134.0.9:8443/health\": dial tcp 10.134.0.9:8443: connect: connection refused"
Jul 15 18:18:23.477110 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:18:23.477082    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-64785b6675-8bzcj"
Jul 15 18:18:25.059182 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:18:25.059146    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-64785b6675-8bzcj"]
Jul 15 18:18:25.062180 ip-10-0-141-171 kubenswrapper[2567]: W0715 18:18:25.062153    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod54e8b5c7_e4da_44a2_ac80_0dc7ef91a6b9.slice/crio-7807e315ac19037f8c552f855b40a486d9db9978d0170b29b43cf7120d549244 WatchSource:0}: Error finding container 7807e315ac19037f8c552f855b40a486d9db9978d0170b29b43cf7120d549244: Status 404 returned error can't find the container with id 7807e315ac19037f8c552f855b40a486d9db9978d0170b29b43cf7120d549244
Jul 15 18:18:25.500541 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:18:25.500501    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-fl6p6" event={"ID":"3aed4f45-6d7c-43e1-be08-99e65ea41508","Type":"ContainerStarted","Data":"9aa737c9da6e082fdb4b35fcefa3852dc9d1043b39a12b1d8a917033555a162e"}
Jul 15 18:18:25.501593 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:18:25.501566    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-64785b6675-8bzcj" event={"ID":"54e8b5c7-e4da-44a2-ac80-0dc7ef91a6b9","Type":"ContainerStarted","Data":"7807e315ac19037f8c552f855b40a486d9db9978d0170b29b43cf7120d549244"}
Jul 15 18:18:25.516715 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:18:25.516666    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-fl6p6" podStartSLOduration=2.042068903 podStartE2EDuration="17.516650224s" totalImagesPullingTime="15.474581321s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-15 18:18:08 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 18:18:25.516105466 +0000 UTC m=+64.050528847" watchObservedRunningTime="2026-07-15 18:18:25.516650224 +0000 UTC m=+64.051073579"
Jul 15 18:18:26.507511 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:18:26.507467    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-64785b6675-8bzcj" event={"ID":"54e8b5c7-e4da-44a2-ac80-0dc7ef91a6b9","Type":"ContainerStarted","Data":"364e825f8343bb697cbb838d733a435b0201332626937d1b2394fad27f69167f"}
Jul 15 18:18:26.507934 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:18:26.507552    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-64785b6675-8bzcj" event={"ID":"54e8b5c7-e4da-44a2-ac80-0dc7ef91a6b9","Type":"ContainerStarted","Data":"b6f230c63ad1374379551f302170135d7d9dff96afe05d734726fc83ec44fcf2"}
Jul 15 18:18:26.523375 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:18:26.523325    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-64785b6675-8bzcj" podStartSLOduration=3.228476249 podStartE2EDuration="4.523308882s" totalImagesPullingTime="1.294832633s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 18:18:22 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 18:18:26.52260861 +0000 UTC m=+65.057031966" watchObservedRunningTime="2026-07-15 18:18:26.523308882 +0000 UTC m=+65.057732237"
Jul 15 18:18:27.838104 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:18:27.838054    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/99ec9d0a-ff24-4f04-b38d-b4a7de812d3b-metrics-certs\") pod \"network-metrics-daemon-n88x2\" (UID: \"99ec9d0a-ff24-4f04-b38d-b4a7de812d3b\") " pod="openshift-multus/network-metrics-daemon-n88x2"
Jul 15 18:18:27.838104 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:18:27.838120    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/0d941f69-52de-4bf3-b262-9d9e07d9d730-original-pull-secret\") pod \"global-pull-secret-syncer-dqncz\" (UID: \"0d941f69-52de-4bf3-b262-9d9e07d9d730\") " pod="kube-system/global-pull-secret-syncer-dqncz"
Jul 15 18:18:27.840372 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:18:27.840351    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Jul 15 18:18:27.840516 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:18:27.840502    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Jul 15 18:18:27.851322 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:18:27.851297    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/0d941f69-52de-4bf3-b262-9d9e07d9d730-original-pull-secret\") pod \"global-pull-secret-syncer-dqncz\" (UID: \"0d941f69-52de-4bf3-b262-9d9e07d9d730\") " pod="kube-system/global-pull-secret-syncer-dqncz"
Jul 15 18:18:27.851423 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:18:27.851375    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/99ec9d0a-ff24-4f04-b38d-b4a7de812d3b-metrics-certs\") pod \"network-metrics-daemon-n88x2\" (UID: \"99ec9d0a-ff24-4f04-b38d-b4a7de812d3b\") " pod="openshift-multus/network-metrics-daemon-n88x2"
Jul 15 18:18:27.913702 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:18:27.913681    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-dqncz"
Jul 15 18:18:27.938955 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:18:27.938922    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pjq5n\" (UniqueName: \"kubernetes.io/projected/b4f54a92-c72a-4f20-93f7-7b424f8f2656-kube-api-access-pjq5n\") pod \"network-check-target-4lm4m\" (UID: \"b4f54a92-c72a-4f20-93f7-7b424f8f2656\") " pod="openshift-network-diagnostics/network-check-target-4lm4m"
Jul 15 18:18:27.941056 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:18:27.941040    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Jul 15 18:18:27.951985 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:18:27.951964    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Jul 15 18:18:27.963024 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:18:27.963003    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pjq5n\" (UniqueName: \"kubernetes.io/projected/b4f54a92-c72a-4f20-93f7-7b424f8f2656-kube-api-access-pjq5n\") pod \"network-check-target-4lm4m\" (UID: \"b4f54a92-c72a-4f20-93f7-7b424f8f2656\") " pod="openshift-network-diagnostics/network-check-target-4lm4m"
Jul 15 18:18:28.028565 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:18:28.028537    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-dqncz"]
Jul 15 18:18:28.031578 ip-10-0-141-171 kubenswrapper[2567]: W0715 18:18:28.031552    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0d941f69_52de_4bf3_b262_9d9e07d9d730.slice/crio-3eba363ebbf4115c17408fbf58d59e2cac6ab22cd808be214a3b4c53962eeb56 WatchSource:0}: Error finding container 3eba363ebbf4115c17408fbf58d59e2cac6ab22cd808be214a3b4c53962eeb56: Status 404 returned error can't find the container with id 3eba363ebbf4115c17408fbf58d59e2cac6ab22cd808be214a3b4c53962eeb56
Jul 15 18:18:28.123561 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:18:28.123507    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-s7m6p\""
Jul 15 18:18:28.128932 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:18:28.128915    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-rzhtl\""
Jul 15 18:18:28.131502 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:18:28.131487    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-4lm4m"
Jul 15 18:18:28.137926 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:18:28.137911    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-n88x2"
Jul 15 18:18:28.258451 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:18:28.258368    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-4lm4m"]
Jul 15 18:18:28.261037 ip-10-0-141-171 kubenswrapper[2567]: W0715 18:18:28.261014    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb4f54a92_c72a_4f20_93f7_7b424f8f2656.slice/crio-2036d0301629cabf1a1ce6d5b2b4a49494f686686d06045ccacc7848c095858e WatchSource:0}: Error finding container 2036d0301629cabf1a1ce6d5b2b4a49494f686686d06045ccacc7848c095858e: Status 404 returned error can't find the container with id 2036d0301629cabf1a1ce6d5b2b4a49494f686686d06045ccacc7848c095858e
Jul 15 18:18:28.272964 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:18:28.272940    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-n88x2"]
Jul 15 18:18:28.275486 ip-10-0-141-171 kubenswrapper[2567]: W0715 18:18:28.275464    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod99ec9d0a_ff24_4f04_b38d_b4a7de812d3b.slice/crio-708ae15d8b0cac38676de8f6544db3ca2b1c77a2fab6d24f7cf979b16484f8e5 WatchSource:0}: Error finding container 708ae15d8b0cac38676de8f6544db3ca2b1c77a2fab6d24f7cf979b16484f8e5: Status 404 returned error can't find the container with id 708ae15d8b0cac38676de8f6544db3ca2b1c77a2fab6d24f7cf979b16484f8e5
Jul 15 18:18:28.474688 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:18:28.474584    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-mhp9p"
Jul 15 18:18:28.517537 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:18:28.517463    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-4lm4m" event={"ID":"b4f54a92-c72a-4f20-93f7-7b424f8f2656","Type":"ContainerStarted","Data":"2036d0301629cabf1a1ce6d5b2b4a49494f686686d06045ccacc7848c095858e"}
Jul 15 18:18:28.519055 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:18:28.519026    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-dqncz" event={"ID":"0d941f69-52de-4bf3-b262-9d9e07d9d730","Type":"ContainerStarted","Data":"3eba363ebbf4115c17408fbf58d59e2cac6ab22cd808be214a3b4c53962eeb56"}
Jul 15 18:18:28.520417 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:18:28.520388    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-n88x2" event={"ID":"99ec9d0a-ff24-4f04-b38d-b4a7de812d3b","Type":"ContainerStarted","Data":"708ae15d8b0cac38676de8f6544db3ca2b1c77a2fab6d24f7cf979b16484f8e5"}
Jul 15 18:18:28.871585 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:18:28.871505    2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/openshift-state-metrics-84bd68b896-r78xl"]
Jul 15 18:18:28.873989 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:18:28.873965    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-84bd68b896-r78xl"
Jul 15 18:18:28.877507 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:18:28.877176    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-tls\""
Jul 15 18:18:28.877507 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:18:28.877469    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-kube-rbac-proxy-config\""
Jul 15 18:18:28.877728 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:18:28.877705    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-dockercfg-mj6bz\""
Jul 15 18:18:28.892787 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:18:28.892709    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-84bd68b896-r78xl"]
Jul 15 18:18:28.913727 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:18:28.912699    2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/kube-state-metrics-785778ff74-mvdt9"]
Jul 15 18:18:28.915313 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:18:28.915292    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-785778ff74-mvdt9"
Jul 15 18:18:28.919046 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:18:28.919013    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-dockercfg-2lvsk\""
Jul 15 18:18:28.919910 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:18:28.919886    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-tls\""
Jul 15 18:18:28.920011 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:18:28.919943    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-kube-rbac-proxy-config\""
Jul 15 18:18:28.920377 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:18:28.920358    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-custom-resource-state-configmap\""
Jul 15 18:18:28.929345 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:18:28.929271    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-785778ff74-mvdt9"]
Jul 15 18:18:28.934483 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:18:28.933788    2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-zhfjg"]
Jul 15 18:18:28.937178 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:18:28.936299    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-zhfjg"
Jul 15 18:18:28.939538 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:18:28.938833    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\""
Jul 15 18:18:28.939538 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:18:28.938881    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\""
Jul 15 18:18:28.939538 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:18:28.939179    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-wmw6k\""
Jul 15 18:18:28.939538 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:18:28.939405    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\""
Jul 15 18:18:28.949103 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:18:28.949075    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/16717ecb-2c1e-4b6f-be6f-c02162eb178d-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-84bd68b896-r78xl\" (UID: \"16717ecb-2c1e-4b6f-be6f-c02162eb178d\") " pod="openshift-monitoring/openshift-state-metrics-84bd68b896-r78xl"
Jul 15 18:18:28.949218 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:18:28.949117    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bbj8r\" (UniqueName: \"kubernetes.io/projected/16717ecb-2c1e-4b6f-be6f-c02162eb178d-kube-api-access-bbj8r\") pod \"openshift-state-metrics-84bd68b896-r78xl\" (UID: \"16717ecb-2c1e-4b6f-be6f-c02162eb178d\") " pod="openshift-monitoring/openshift-state-metrics-84bd68b896-r78xl"
Jul 15 18:18:28.949713 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:18:28.949688    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/16717ecb-2c1e-4b6f-be6f-c02162eb178d-openshift-state-metrics-tls\") pod \"openshift-state-metrics-84bd68b896-r78xl\" (UID: \"16717ecb-2c1e-4b6f-be6f-c02162eb178d\") " pod="openshift-monitoring/openshift-state-metrics-84bd68b896-r78xl"
Jul 15 18:18:28.949799 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:18:28.949746    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/16717ecb-2c1e-4b6f-be6f-c02162eb178d-metrics-client-ca\") pod \"openshift-state-metrics-84bd68b896-r78xl\" (UID: \"16717ecb-2c1e-4b6f-be6f-c02162eb178d\") " pod="openshift-monitoring/openshift-state-metrics-84bd68b896-r78xl"
Jul 15 18:18:29.050441 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:18:29.050354    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-68cs6\" (UniqueName: \"kubernetes.io/projected/e60f42cb-1b48-4897-b7f4-422ce77e048c-kube-api-access-68cs6\") pod \"kube-state-metrics-785778ff74-mvdt9\" (UID: \"e60f42cb-1b48-4897-b7f4-422ce77e048c\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-mvdt9"
Jul 15 18:18:29.050441 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:18:29.050424    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9l45z\" (UniqueName: \"kubernetes.io/projected/77a85f70-62db-476e-8397-ee0759a55745-kube-api-access-9l45z\") pod \"node-exporter-zhfjg\" (UID: \"77a85f70-62db-476e-8397-ee0759a55745\") " pod="openshift-monitoring/node-exporter-zhfjg"
Jul 15 18:18:29.050684 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:18:29.050452    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/77a85f70-62db-476e-8397-ee0759a55745-sys\") pod \"node-exporter-zhfjg\" (UID: \"77a85f70-62db-476e-8397-ee0759a55745\") " pod="openshift-monitoring/node-exporter-zhfjg"
Jul 15 18:18:29.050684 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:18:29.050475    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/77a85f70-62db-476e-8397-ee0759a55745-metrics-client-ca\") pod \"node-exporter-zhfjg\" (UID: \"77a85f70-62db-476e-8397-ee0759a55745\") " pod="openshift-monitoring/node-exporter-zhfjg"
Jul 15 18:18:29.050684 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:18:29.050541    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/77a85f70-62db-476e-8397-ee0759a55745-node-exporter-accelerators-collector-config\") pod \"node-exporter-zhfjg\" (UID: \"77a85f70-62db-476e-8397-ee0759a55745\") " pod="openshift-monitoring/node-exporter-zhfjg"
Jul 15 18:18:29.050684 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:18:29.050591    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/e60f42cb-1b48-4897-b7f4-422ce77e048c-metrics-client-ca\") pod \"kube-state-metrics-785778ff74-mvdt9\" (UID: \"e60f42cb-1b48-4897-b7f4-422ce77e048c\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-mvdt9"
Jul 15 18:18:29.050684 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:18:29.050637    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/77a85f70-62db-476e-8397-ee0759a55745-node-exporter-wtmp\") pod \"node-exporter-zhfjg\" (UID: \"77a85f70-62db-476e-8397-ee0759a55745\") " pod="openshift-monitoring/node-exporter-zhfjg"
Jul 15 18:18:29.050684 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:18:29.050674    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/77a85f70-62db-476e-8397-ee0759a55745-root\") pod \"node-exporter-zhfjg\" (UID: \"77a85f70-62db-476e-8397-ee0759a55745\") " pod="openshift-monitoring/node-exporter-zhfjg"
Jul 15 18:18:29.050984 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:18:29.050699    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/e60f42cb-1b48-4897-b7f4-422ce77e048c-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-785778ff74-mvdt9\" (UID: \"e60f42cb-1b48-4897-b7f4-422ce77e048c\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-mvdt9"
Jul 15 18:18:29.050984 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:18:29.050728    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/e60f42cb-1b48-4897-b7f4-422ce77e048c-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-785778ff74-mvdt9\" (UID: \"e60f42cb-1b48-4897-b7f4-422ce77e048c\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-mvdt9"
Jul 15 18:18:29.050984 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:18:29.050761    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/77a85f70-62db-476e-8397-ee0759a55745-node-exporter-textfile\") pod \"node-exporter-zhfjg\" (UID: \"77a85f70-62db-476e-8397-ee0759a55745\") " pod="openshift-monitoring/node-exporter-zhfjg"
Jul 15 18:18:29.050984 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:18:29.050784    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/77a85f70-62db-476e-8397-ee0759a55745-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-zhfjg\" (UID: \"77a85f70-62db-476e-8397-ee0759a55745\") " pod="openshift-monitoring/node-exporter-zhfjg"
Jul 15 18:18:29.050984 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:18:29.050812    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/77a85f70-62db-476e-8397-ee0759a55745-node-exporter-tls\") pod \"node-exporter-zhfjg\" (UID: \"77a85f70-62db-476e-8397-ee0759a55745\") " pod="openshift-monitoring/node-exporter-zhfjg"
Jul 15 18:18:29.050984 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:18:29.050847    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/16717ecb-2c1e-4b6f-be6f-c02162eb178d-openshift-state-metrics-tls\") pod \"openshift-state-metrics-84bd68b896-r78xl\" (UID: \"16717ecb-2c1e-4b6f-be6f-c02162eb178d\") " pod="openshift-monitoring/openshift-state-metrics-84bd68b896-r78xl"
Jul 15 18:18:29.050984 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:18:29.050882    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/16717ecb-2c1e-4b6f-be6f-c02162eb178d-metrics-client-ca\") pod \"openshift-state-metrics-84bd68b896-r78xl\" (UID: \"16717ecb-2c1e-4b6f-be6f-c02162eb178d\") " pod="openshift-monitoring/openshift-state-metrics-84bd68b896-r78xl"
Jul 15 18:18:29.050984 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:18:29.050905    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/e60f42cb-1b48-4897-b7f4-422ce77e048c-kube-state-metrics-tls\") pod \"kube-state-metrics-785778ff74-mvdt9\" (UID: \"e60f42cb-1b48-4897-b7f4-422ce77e048c\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-mvdt9"
Jul 15 18:18:29.050984 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:18:29.050935    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/e60f42cb-1b48-4897-b7f4-422ce77e048c-volume-directive-shadow\") pod \"kube-state-metrics-785778ff74-mvdt9\" (UID: \"e60f42cb-1b48-4897-b7f4-422ce77e048c\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-mvdt9"
Jul 15 18:18:29.050984 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:18:29.050972    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/16717ecb-2c1e-4b6f-be6f-c02162eb178d-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-84bd68b896-r78xl\" (UID: \"16717ecb-2c1e-4b6f-be6f-c02162eb178d\") " pod="openshift-monitoring/openshift-state-metrics-84bd68b896-r78xl"
Jul 15 18:18:29.051481 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:18:29.050999    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bbj8r\" (UniqueName: \"kubernetes.io/projected/16717ecb-2c1e-4b6f-be6f-c02162eb178d-kube-api-access-bbj8r\") pod \"openshift-state-metrics-84bd68b896-r78xl\" (UID: \"16717ecb-2c1e-4b6f-be6f-c02162eb178d\") " pod="openshift-monitoring/openshift-state-metrics-84bd68b896-r78xl"
Jul 15 18:18:29.052202 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:18:29.052154    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/16717ecb-2c1e-4b6f-be6f-c02162eb178d-metrics-client-ca\") pod \"openshift-state-metrics-84bd68b896-r78xl\" (UID: \"16717ecb-2c1e-4b6f-be6f-c02162eb178d\") " pod="openshift-monitoring/openshift-state-metrics-84bd68b896-r78xl"
Jul 15 18:18:29.054437 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:18:29.054409    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/16717ecb-2c1e-4b6f-be6f-c02162eb178d-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-84bd68b896-r78xl\" (UID: \"16717ecb-2c1e-4b6f-be6f-c02162eb178d\") " pod="openshift-monitoring/openshift-state-metrics-84bd68b896-r78xl"
Jul 15 18:18:29.056139 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:18:29.056111    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/16717ecb-2c1e-4b6f-be6f-c02162eb178d-openshift-state-metrics-tls\") pod \"openshift-state-metrics-84bd68b896-r78xl\" (UID: \"16717ecb-2c1e-4b6f-be6f-c02162eb178d\") " pod="openshift-monitoring/openshift-state-metrics-84bd68b896-r78xl"
Jul 15 18:18:29.060778 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:18:29.060735    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bbj8r\" (UniqueName: \"kubernetes.io/projected/16717ecb-2c1e-4b6f-be6f-c02162eb178d-kube-api-access-bbj8r\") pod \"openshift-state-metrics-84bd68b896-r78xl\" (UID: \"16717ecb-2c1e-4b6f-be6f-c02162eb178d\") " pod="openshift-monitoring/openshift-state-metrics-84bd68b896-r78xl"
Jul 15 18:18:29.152304 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:18:29.151543    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9l45z\" (UniqueName: \"kubernetes.io/projected/77a85f70-62db-476e-8397-ee0759a55745-kube-api-access-9l45z\") pod \"node-exporter-zhfjg\" (UID: \"77a85f70-62db-476e-8397-ee0759a55745\") " pod="openshift-monitoring/node-exporter-zhfjg"
Jul 15 18:18:29.152304 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:18:29.151588    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/77a85f70-62db-476e-8397-ee0759a55745-sys\") pod \"node-exporter-zhfjg\" (UID: \"77a85f70-62db-476e-8397-ee0759a55745\") " pod="openshift-monitoring/node-exporter-zhfjg"
Jul 15 18:18:29.152304 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:18:29.151614    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/77a85f70-62db-476e-8397-ee0759a55745-metrics-client-ca\") pod \"node-exporter-zhfjg\" (UID: \"77a85f70-62db-476e-8397-ee0759a55745\") " pod="openshift-monitoring/node-exporter-zhfjg"
Jul 15 18:18:29.152304 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:18:29.151643    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/77a85f70-62db-476e-8397-ee0759a55745-node-exporter-accelerators-collector-config\") pod \"node-exporter-zhfjg\" (UID: \"77a85f70-62db-476e-8397-ee0759a55745\") " pod="openshift-monitoring/node-exporter-zhfjg"
Jul 15 18:18:29.152304 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:18:29.151668    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/e60f42cb-1b48-4897-b7f4-422ce77e048c-metrics-client-ca\") pod \"kube-state-metrics-785778ff74-mvdt9\" (UID: \"e60f42cb-1b48-4897-b7f4-422ce77e048c\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-mvdt9"
Jul 15 18:18:29.152304 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:18:29.151700    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/77a85f70-62db-476e-8397-ee0759a55745-node-exporter-wtmp\") pod \"node-exporter-zhfjg\" (UID: \"77a85f70-62db-476e-8397-ee0759a55745\") " pod="openshift-monitoring/node-exporter-zhfjg"
Jul 15 18:18:29.152304 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:18:29.151730    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/77a85f70-62db-476e-8397-ee0759a55745-root\") pod \"node-exporter-zhfjg\" (UID: \"77a85f70-62db-476e-8397-ee0759a55745\") " pod="openshift-monitoring/node-exporter-zhfjg"
Jul 15 18:18:29.152304 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:18:29.151796    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/77a85f70-62db-476e-8397-ee0759a55745-root\") pod \"node-exporter-zhfjg\" (UID: \"77a85f70-62db-476e-8397-ee0759a55745\") " pod="openshift-monitoring/node-exporter-zhfjg"
Jul 15 18:18:29.152304 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:18:29.152027    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/77a85f70-62db-476e-8397-ee0759a55745-sys\") pod \"node-exporter-zhfjg\" (UID: \"77a85f70-62db-476e-8397-ee0759a55745\") " pod="openshift-monitoring/node-exporter-zhfjg"
Jul 15 18:18:29.152304 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:18:29.152107    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/77a85f70-62db-476e-8397-ee0759a55745-node-exporter-wtmp\") pod \"node-exporter-zhfjg\" (UID: \"77a85f70-62db-476e-8397-ee0759a55745\") " pod="openshift-monitoring/node-exporter-zhfjg"
Jul 15 18:18:29.152304 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:18:29.152148    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/e60f42cb-1b48-4897-b7f4-422ce77e048c-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-785778ff74-mvdt9\" (UID: \"e60f42cb-1b48-4897-b7f4-422ce77e048c\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-mvdt9"
Jul 15 18:18:29.152304 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:18:29.152187    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/e60f42cb-1b48-4897-b7f4-422ce77e048c-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-785778ff74-mvdt9\" (UID: \"e60f42cb-1b48-4897-b7f4-422ce77e048c\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-mvdt9"
Jul 15 18:18:29.152304 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:18:29.152224    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/77a85f70-62db-476e-8397-ee0759a55745-node-exporter-textfile\") pod \"node-exporter-zhfjg\" (UID: \"77a85f70-62db-476e-8397-ee0759a55745\") " pod="openshift-monitoring/node-exporter-zhfjg"
Jul 15 18:18:29.152304 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:18:29.152267    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/77a85f70-62db-476e-8397-ee0759a55745-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-zhfjg\" (UID: \"77a85f70-62db-476e-8397-ee0759a55745\") " pod="openshift-monitoring/node-exporter-zhfjg"
Jul 15 18:18:29.152304 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:18:29.152300    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/77a85f70-62db-476e-8397-ee0759a55745-node-exporter-tls\") pod \"node-exporter-zhfjg\" (UID: \"77a85f70-62db-476e-8397-ee0759a55745\") " pod="openshift-monitoring/node-exporter-zhfjg"
Jul 15 18:18:29.153162 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:18:29.152343    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/e60f42cb-1b48-4897-b7f4-422ce77e048c-kube-state-metrics-tls\") pod \"kube-state-metrics-785778ff74-mvdt9\" (UID: \"e60f42cb-1b48-4897-b7f4-422ce77e048c\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-mvdt9"
Jul 15 18:18:29.153162 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:18:29.152372    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/e60f42cb-1b48-4897-b7f4-422ce77e048c-volume-directive-shadow\") pod \"kube-state-metrics-785778ff74-mvdt9\" (UID: \"e60f42cb-1b48-4897-b7f4-422ce77e048c\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-mvdt9"
Jul 15 18:18:29.153162 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:18:29.152415    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-68cs6\" (UniqueName: \"kubernetes.io/projected/e60f42cb-1b48-4897-b7f4-422ce77e048c-kube-api-access-68cs6\") pod \"kube-state-metrics-785778ff74-mvdt9\" (UID: \"e60f42cb-1b48-4897-b7f4-422ce77e048c\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-mvdt9"
Jul 15 18:18:29.153162 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:18:29.152626    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/77a85f70-62db-476e-8397-ee0759a55745-metrics-client-ca\") pod \"node-exporter-zhfjg\" (UID: \"77a85f70-62db-476e-8397-ee0759a55745\") " pod="openshift-monitoring/node-exporter-zhfjg"
Jul 15 18:18:29.153162 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:18:29.152679    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/77a85f70-62db-476e-8397-ee0759a55745-node-exporter-accelerators-collector-config\") pod \"node-exporter-zhfjg\" (UID: \"77a85f70-62db-476e-8397-ee0759a55745\") " pod="openshift-monitoring/node-exporter-zhfjg"
Jul 15 18:18:29.153162 ip-10-0-141-171 kubenswrapper[2567]: E0715 18:18:29.152723    2567 secret.go:189] Couldn't get secret openshift-monitoring/node-exporter-tls: secret "node-exporter-tls" not found
Jul 15 18:18:29.153162 ip-10-0-141-171 kubenswrapper[2567]: E0715 18:18:29.152779    2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/77a85f70-62db-476e-8397-ee0759a55745-node-exporter-tls podName:77a85f70-62db-476e-8397-ee0759a55745 nodeName:}" failed. No retries permitted until 2026-07-15 18:18:29.652759445 +0000 UTC m=+68.187182784 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "node-exporter-tls" (UniqueName: "kubernetes.io/secret/77a85f70-62db-476e-8397-ee0759a55745-node-exporter-tls") pod "node-exporter-zhfjg" (UID: "77a85f70-62db-476e-8397-ee0759a55745") : secret "node-exporter-tls" not found
Jul 15 18:18:29.153162 ip-10-0-141-171 kubenswrapper[2567]: E0715 18:18:29.152777    2567 secret.go:189] Couldn't get secret openshift-monitoring/kube-state-metrics-tls: secret "kube-state-metrics-tls" not found
Jul 15 18:18:29.153162 ip-10-0-141-171 kubenswrapper[2567]: E0715 18:18:29.152830    2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e60f42cb-1b48-4897-b7f4-422ce77e048c-kube-state-metrics-tls podName:e60f42cb-1b48-4897-b7f4-422ce77e048c nodeName:}" failed. No retries permitted until 2026-07-15 18:18:29.652814682 +0000 UTC m=+68.187238019 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-state-metrics-tls" (UniqueName: "kubernetes.io/secret/e60f42cb-1b48-4897-b7f4-422ce77e048c-kube-state-metrics-tls") pod "kube-state-metrics-785778ff74-mvdt9" (UID: "e60f42cb-1b48-4897-b7f4-422ce77e048c") : secret "kube-state-metrics-tls" not found
Jul 15 18:18:29.153162 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:18:29.153038    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/77a85f70-62db-476e-8397-ee0759a55745-node-exporter-textfile\") pod \"node-exporter-zhfjg\" (UID: \"77a85f70-62db-476e-8397-ee0759a55745\") " pod="openshift-monitoring/node-exporter-zhfjg"
Jul 15 18:18:29.153162 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:18:29.153128    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/e60f42cb-1b48-4897-b7f4-422ce77e048c-metrics-client-ca\") pod \"kube-state-metrics-785778ff74-mvdt9\" (UID: \"e60f42cb-1b48-4897-b7f4-422ce77e048c\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-mvdt9"
Jul 15 18:18:29.153738 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:18:29.153273    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/e60f42cb-1b48-4897-b7f4-422ce77e048c-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-785778ff74-mvdt9\" (UID: \"e60f42cb-1b48-4897-b7f4-422ce77e048c\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-mvdt9"
Jul 15 18:18:29.153738 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:18:29.153369    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/e60f42cb-1b48-4897-b7f4-422ce77e048c-volume-directive-shadow\") pod \"kube-state-metrics-785778ff74-mvdt9\" (UID: \"e60f42cb-1b48-4897-b7f4-422ce77e048c\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-mvdt9"
Jul 15 18:18:29.155528 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:18:29.155504    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/77a85f70-62db-476e-8397-ee0759a55745-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-zhfjg\" (UID: \"77a85f70-62db-476e-8397-ee0759a55745\") " pod="openshift-monitoring/node-exporter-zhfjg"
Jul 15 18:18:29.156940 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:18:29.156913    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/e60f42cb-1b48-4897-b7f4-422ce77e048c-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-785778ff74-mvdt9\" (UID: \"e60f42cb-1b48-4897-b7f4-422ce77e048c\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-mvdt9"
Jul 15 18:18:29.161748 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:18:29.161724    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-68cs6\" (UniqueName: \"kubernetes.io/projected/e60f42cb-1b48-4897-b7f4-422ce77e048c-kube-api-access-68cs6\") pod \"kube-state-metrics-785778ff74-mvdt9\" (UID: \"e60f42cb-1b48-4897-b7f4-422ce77e048c\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-mvdt9"
Jul 15 18:18:29.162693 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:18:29.162671    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9l45z\" (UniqueName: \"kubernetes.io/projected/77a85f70-62db-476e-8397-ee0759a55745-kube-api-access-9l45z\") pod \"node-exporter-zhfjg\" (UID: \"77a85f70-62db-476e-8397-ee0759a55745\") " pod="openshift-monitoring/node-exporter-zhfjg"
Jul 15 18:18:29.187136 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:18:29.187113    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-84bd68b896-r78xl"
Jul 15 18:18:29.519659 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:18:29.519546    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-84bd68b896-r78xl"]
Jul 15 18:18:29.530434 ip-10-0-141-171 kubenswrapper[2567]: W0715 18:18:29.530405    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod16717ecb_2c1e_4b6f_be6f_c02162eb178d.slice/crio-2db1c7d7f4c8753063ba0eb5912b12931dae56b1709ac6d8bd75ddf3715e3efa WatchSource:0}: Error finding container 2db1c7d7f4c8753063ba0eb5912b12931dae56b1709ac6d8bd75ddf3715e3efa: Status 404 returned error can't find the container with id 2db1c7d7f4c8753063ba0eb5912b12931dae56b1709ac6d8bd75ddf3715e3efa
Jul 15 18:18:29.658794 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:18:29.658767    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/77a85f70-62db-476e-8397-ee0759a55745-node-exporter-tls\") pod \"node-exporter-zhfjg\" (UID: \"77a85f70-62db-476e-8397-ee0759a55745\") " pod="openshift-monitoring/node-exporter-zhfjg"
Jul 15 18:18:29.658924 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:18:29.658823    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/e60f42cb-1b48-4897-b7f4-422ce77e048c-kube-state-metrics-tls\") pod \"kube-state-metrics-785778ff74-mvdt9\" (UID: \"e60f42cb-1b48-4897-b7f4-422ce77e048c\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-mvdt9"
Jul 15 18:18:29.661401 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:18:29.661370    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/e60f42cb-1b48-4897-b7f4-422ce77e048c-kube-state-metrics-tls\") pod \"kube-state-metrics-785778ff74-mvdt9\" (UID: \"e60f42cb-1b48-4897-b7f4-422ce77e048c\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-mvdt9"
Jul 15 18:18:29.663457 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:18:29.663413    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/77a85f70-62db-476e-8397-ee0759a55745-node-exporter-tls\") pod \"node-exporter-zhfjg\" (UID: \"77a85f70-62db-476e-8397-ee0759a55745\") " pod="openshift-monitoring/node-exporter-zhfjg"
Jul 15 18:18:29.828083 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:18:29.827899    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-785778ff74-mvdt9"
Jul 15 18:18:29.855526 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:18:29.855499    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-zhfjg"
Jul 15 18:18:29.880894 ip-10-0-141-171 kubenswrapper[2567]: W0715 18:18:29.880857    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod77a85f70_62db_476e_8397_ee0759a55745.slice/crio-72d4f677eddaffc97f0d082c59df53bc9f08504ffea13519f1b1d430aa5d98d9 WatchSource:0}: Error finding container 72d4f677eddaffc97f0d082c59df53bc9f08504ffea13519f1b1d430aa5d98d9: Status 404 returned error can't find the container with id 72d4f677eddaffc97f0d082c59df53bc9f08504ffea13519f1b1d430aa5d98d9
Jul 15 18:18:29.957194 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:18:29.957053    2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Jul 15 18:18:29.991338 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:18:29.991307    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Jul 15 18:18:29.991508 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:18:29.991472    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Jul 15 18:18:29.994183 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:18:29.993962    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\""
Jul 15 18:18:29.994183 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:18:29.993980    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\""
Jul 15 18:18:29.995744 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:18:29.994778    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\""
Jul 15 18:18:29.995744 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:18:29.994974    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-bjvlj\""
Jul 15 18:18:29.995744 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:18:29.995034    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\""
Jul 15 18:18:29.995744 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:18:29.995085    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\""
Jul 15 18:18:29.995744 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:18:29.995173    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\""
Jul 15 18:18:29.995744 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:18:29.995351    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\""
Jul 15 18:18:29.995744 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:18:29.995499    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\""
Jul 15 18:18:29.995744 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:18:29.995638    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\""
Jul 15 18:18:30.016604 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:18:30.016574    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-785778ff74-mvdt9"]
Jul 15 18:18:30.021168 ip-10-0-141-171 kubenswrapper[2567]: W0715 18:18:30.021135    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode60f42cb_1b48_4897_b7f4_422ce77e048c.slice/crio-59672c13b9db055bdce806b89d93b6fcec909f746ee421a49288b9655ebf8e3d WatchSource:0}: Error finding container 59672c13b9db055bdce806b89d93b6fcec909f746ee421a49288b9655ebf8e3d: Status 404 returned error can't find the container with id 59672c13b9db055bdce806b89d93b6fcec909f746ee421a49288b9655ebf8e3d
Jul 15 18:18:30.028261 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:18:30.028018    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-6c775749fc-6wksh"
Jul 15 18:18:30.028542 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:18:30.028471    2567 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-6c775749fc-6wksh"
Jul 15 18:18:30.034663 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:18:30.034626    2567 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-6c775749fc-6wksh"
Jul 15 18:18:30.061448 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:18:30.061219    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/0a3d2b71-dc31-4a25-ad7f-89bf188082f4-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"0a3d2b71-dc31-4a25-ad7f-89bf188082f4\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 15 18:18:30.061448 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:18:30.061282    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/0a3d2b71-dc31-4a25-ad7f-89bf188082f4-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"0a3d2b71-dc31-4a25-ad7f-89bf188082f4\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 15 18:18:30.061448 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:18:30.061326    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/0a3d2b71-dc31-4a25-ad7f-89bf188082f4-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"0a3d2b71-dc31-4a25-ad7f-89bf188082f4\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 15 18:18:30.061448 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:18:30.061355    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/0a3d2b71-dc31-4a25-ad7f-89bf188082f4-config-volume\") pod \"alertmanager-main-0\" (UID: \"0a3d2b71-dc31-4a25-ad7f-89bf188082f4\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 15 18:18:30.061448 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:18:30.061388    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/0a3d2b71-dc31-4a25-ad7f-89bf188082f4-web-config\") pod \"alertmanager-main-0\" (UID: \"0a3d2b71-dc31-4a25-ad7f-89bf188082f4\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 15 18:18:30.061448 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:18:30.061414    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-w82h2\" (UniqueName: \"kubernetes.io/projected/0a3d2b71-dc31-4a25-ad7f-89bf188082f4-kube-api-access-w82h2\") pod \"alertmanager-main-0\" (UID: \"0a3d2b71-dc31-4a25-ad7f-89bf188082f4\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 15 18:18:30.061796 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:18:30.061491    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/0a3d2b71-dc31-4a25-ad7f-89bf188082f4-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"0a3d2b71-dc31-4a25-ad7f-89bf188082f4\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 15 18:18:30.061796 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:18:30.061533    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/0a3d2b71-dc31-4a25-ad7f-89bf188082f4-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"0a3d2b71-dc31-4a25-ad7f-89bf188082f4\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 15 18:18:30.061796 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:18:30.061560    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/0a3d2b71-dc31-4a25-ad7f-89bf188082f4-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"0a3d2b71-dc31-4a25-ad7f-89bf188082f4\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 15 18:18:30.061796 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:18:30.061602    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/0a3d2b71-dc31-4a25-ad7f-89bf188082f4-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"0a3d2b71-dc31-4a25-ad7f-89bf188082f4\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 15 18:18:30.061796 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:18:30.061635    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/0a3d2b71-dc31-4a25-ad7f-89bf188082f4-tls-assets\") pod \"alertmanager-main-0\" (UID: \"0a3d2b71-dc31-4a25-ad7f-89bf188082f4\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 15 18:18:30.061796 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:18:30.061663    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0a3d2b71-dc31-4a25-ad7f-89bf188082f4-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"0a3d2b71-dc31-4a25-ad7f-89bf188082f4\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 15 18:18:30.061796 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:18:30.061694    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/0a3d2b71-dc31-4a25-ad7f-89bf188082f4-config-out\") pod \"alertmanager-main-0\" (UID: \"0a3d2b71-dc31-4a25-ad7f-89bf188082f4\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 15 18:18:30.162075 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:18:30.162041    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/0a3d2b71-dc31-4a25-ad7f-89bf188082f4-config-volume\") pod \"alertmanager-main-0\" (UID: \"0a3d2b71-dc31-4a25-ad7f-89bf188082f4\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 15 18:18:30.162274 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:18:30.162087    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/0a3d2b71-dc31-4a25-ad7f-89bf188082f4-web-config\") pod \"alertmanager-main-0\" (UID: \"0a3d2b71-dc31-4a25-ad7f-89bf188082f4\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 15 18:18:30.162274 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:18:30.162116    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-w82h2\" (UniqueName: \"kubernetes.io/projected/0a3d2b71-dc31-4a25-ad7f-89bf188082f4-kube-api-access-w82h2\") pod \"alertmanager-main-0\" (UID: \"0a3d2b71-dc31-4a25-ad7f-89bf188082f4\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 15 18:18:30.162274 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:18:30.162172    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/0a3d2b71-dc31-4a25-ad7f-89bf188082f4-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"0a3d2b71-dc31-4a25-ad7f-89bf188082f4\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 15 18:18:30.162274 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:18:30.162220    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/0a3d2b71-dc31-4a25-ad7f-89bf188082f4-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"0a3d2b71-dc31-4a25-ad7f-89bf188082f4\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 15 18:18:30.162274 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:18:30.162268    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/0a3d2b71-dc31-4a25-ad7f-89bf188082f4-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"0a3d2b71-dc31-4a25-ad7f-89bf188082f4\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 15 18:18:30.162529 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:18:30.162311    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/0a3d2b71-dc31-4a25-ad7f-89bf188082f4-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"0a3d2b71-dc31-4a25-ad7f-89bf188082f4\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 15 18:18:30.162529 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:18:30.162377    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/0a3d2b71-dc31-4a25-ad7f-89bf188082f4-tls-assets\") pod \"alertmanager-main-0\" (UID: \"0a3d2b71-dc31-4a25-ad7f-89bf188082f4\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 15 18:18:30.162529 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:18:30.162422    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0a3d2b71-dc31-4a25-ad7f-89bf188082f4-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"0a3d2b71-dc31-4a25-ad7f-89bf188082f4\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 15 18:18:30.162529 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:18:30.162452    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/0a3d2b71-dc31-4a25-ad7f-89bf188082f4-config-out\") pod \"alertmanager-main-0\" (UID: \"0a3d2b71-dc31-4a25-ad7f-89bf188082f4\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 15 18:18:30.162529 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:18:30.162482    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/0a3d2b71-dc31-4a25-ad7f-89bf188082f4-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"0a3d2b71-dc31-4a25-ad7f-89bf188082f4\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 15 18:18:30.162529 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:18:30.162507    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/0a3d2b71-dc31-4a25-ad7f-89bf188082f4-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"0a3d2b71-dc31-4a25-ad7f-89bf188082f4\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 15 18:18:30.162801 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:18:30.162560    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/0a3d2b71-dc31-4a25-ad7f-89bf188082f4-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"0a3d2b71-dc31-4a25-ad7f-89bf188082f4\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 15 18:18:30.163631 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:18:30.163329    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/0a3d2b71-dc31-4a25-ad7f-89bf188082f4-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"0a3d2b71-dc31-4a25-ad7f-89bf188082f4\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 15 18:18:30.163816 ip-10-0-141-171 kubenswrapper[2567]: E0715 18:18:30.163798    2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/0a3d2b71-dc31-4a25-ad7f-89bf188082f4-alertmanager-trusted-ca-bundle podName:0a3d2b71-dc31-4a25-ad7f-89bf188082f4 nodeName:}" failed. No retries permitted until 2026-07-15 18:18:30.663775316 +0000 UTC m=+69.198198669 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "alertmanager-trusted-ca-bundle" (UniqueName: "kubernetes.io/configmap/0a3d2b71-dc31-4a25-ad7f-89bf188082f4-alertmanager-trusted-ca-bundle") pod "alertmanager-main-0" (UID: "0a3d2b71-dc31-4a25-ad7f-89bf188082f4") : configmap references non-existent config key: ca-bundle.crt
Jul 15 18:18:30.164213 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:18:30.164168    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/0a3d2b71-dc31-4a25-ad7f-89bf188082f4-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"0a3d2b71-dc31-4a25-ad7f-89bf188082f4\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 15 18:18:30.167663 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:18:30.167126    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/0a3d2b71-dc31-4a25-ad7f-89bf188082f4-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"0a3d2b71-dc31-4a25-ad7f-89bf188082f4\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 15 18:18:30.167663 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:18:30.167599    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/0a3d2b71-dc31-4a25-ad7f-89bf188082f4-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"0a3d2b71-dc31-4a25-ad7f-89bf188082f4\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 15 18:18:30.169710 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:18:30.168128    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/0a3d2b71-dc31-4a25-ad7f-89bf188082f4-config-volume\") pod \"alertmanager-main-0\" (UID: \"0a3d2b71-dc31-4a25-ad7f-89bf188082f4\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 15 18:18:30.169710 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:18:30.168244    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/0a3d2b71-dc31-4a25-ad7f-89bf188082f4-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"0a3d2b71-dc31-4a25-ad7f-89bf188082f4\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 15 18:18:30.169710 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:18:30.168278    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/0a3d2b71-dc31-4a25-ad7f-89bf188082f4-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"0a3d2b71-dc31-4a25-ad7f-89bf188082f4\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 15 18:18:30.169710 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:18:30.168644    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/0a3d2b71-dc31-4a25-ad7f-89bf188082f4-web-config\") pod \"alertmanager-main-0\" (UID: \"0a3d2b71-dc31-4a25-ad7f-89bf188082f4\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 15 18:18:30.169710 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:18:30.168730    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/0a3d2b71-dc31-4a25-ad7f-89bf188082f4-tls-assets\") pod \"alertmanager-main-0\" (UID: \"0a3d2b71-dc31-4a25-ad7f-89bf188082f4\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 15 18:18:30.169710 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:18:30.168757    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/0a3d2b71-dc31-4a25-ad7f-89bf188082f4-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"0a3d2b71-dc31-4a25-ad7f-89bf188082f4\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 15 18:18:30.169710 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:18:30.169330    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/0a3d2b71-dc31-4a25-ad7f-89bf188082f4-config-out\") pod \"alertmanager-main-0\" (UID: \"0a3d2b71-dc31-4a25-ad7f-89bf188082f4\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 15 18:18:30.175024 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:18:30.175001    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-w82h2\" (UniqueName: \"kubernetes.io/projected/0a3d2b71-dc31-4a25-ad7f-89bf188082f4-kube-api-access-w82h2\") pod \"alertmanager-main-0\" (UID: \"0a3d2b71-dc31-4a25-ad7f-89bf188082f4\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 15 18:18:30.532022 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:18:30.531926    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-785778ff74-mvdt9" event={"ID":"e60f42cb-1b48-4897-b7f4-422ce77e048c","Type":"ContainerStarted","Data":"59672c13b9db055bdce806b89d93b6fcec909f746ee421a49288b9655ebf8e3d"}
Jul 15 18:18:30.536575 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:18:30.536450    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-84bd68b896-r78xl" event={"ID":"16717ecb-2c1e-4b6f-be6f-c02162eb178d","Type":"ContainerStarted","Data":"a2b0a92929c59c85e28fdca160d14b87fbf029f4c689a1dbddca8ba9c8a96a0d"}
Jul 15 18:18:30.536575 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:18:30.536509    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-84bd68b896-r78xl" event={"ID":"16717ecb-2c1e-4b6f-be6f-c02162eb178d","Type":"ContainerStarted","Data":"71e1c3429fb956a21ee5b374c924921b2e7f36f77f76ce263289b08e7206e487"}
Jul 15 18:18:30.536575 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:18:30.536537    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-84bd68b896-r78xl" event={"ID":"16717ecb-2c1e-4b6f-be6f-c02162eb178d","Type":"ContainerStarted","Data":"2db1c7d7f4c8753063ba0eb5912b12931dae56b1709ac6d8bd75ddf3715e3efa"}
Jul 15 18:18:30.539102 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:18:30.539011    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-n88x2" event={"ID":"99ec9d0a-ff24-4f04-b38d-b4a7de812d3b","Type":"ContainerStarted","Data":"94db4d0222c75ac9edc998c299618948de796aba5ce38e04e7d99a439ade2db6"}
Jul 15 18:18:30.539102 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:18:30.539062    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-n88x2" event={"ID":"99ec9d0a-ff24-4f04-b38d-b4a7de812d3b","Type":"ContainerStarted","Data":"c1248cf69aa00351b024ff1974c870e8bf9e4f85a0ea591db48996d63fe54bc5"}
Jul 15 18:18:30.542172 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:18:30.542147    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-zhfjg" event={"ID":"77a85f70-62db-476e-8397-ee0759a55745","Type":"ContainerStarted","Data":"72d4f677eddaffc97f0d082c59df53bc9f08504ffea13519f1b1d430aa5d98d9"}
Jul 15 18:18:30.549044 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:18:30.548992    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-6c775749fc-6wksh"
Jul 15 18:18:30.572880 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:18:30.572354    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-n88x2" podStartSLOduration=67.41639636 podStartE2EDuration="1m8.572334961s" totalImagesPullingTime="1.155938601s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 18:17:22 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 18:18:30.556316478 +0000 UTC m=+69.090739870" watchObservedRunningTime="2026-07-15 18:18:30.572334961 +0000 UTC m=+69.106758318"
Jul 15 18:18:30.602329 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:18:30.601611    2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-9b6fc9785-k9w2d"]
Jul 15 18:18:30.668631 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:18:30.668599    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0a3d2b71-dc31-4a25-ad7f-89bf188082f4-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"0a3d2b71-dc31-4a25-ad7f-89bf188082f4\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 15 18:18:30.669616 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:18:30.669570    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0a3d2b71-dc31-4a25-ad7f-89bf188082f4-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"0a3d2b71-dc31-4a25-ad7f-89bf188082f4\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 15 18:18:30.906612 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:18:30.906519    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Jul 15 18:18:31.871285 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:18:31.871222    2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/thanos-querier-6f66584585-8nvch"]
Jul 15 18:18:31.875001 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:18:31.874979    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-6f66584585-8nvch"
Jul 15 18:18:31.877445 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:18:31.877423    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-web\""
Jul 15 18:18:31.877552 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:18:31.877503    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-dockercfg-4vrgc\""
Jul 15 18:18:31.877552 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:18:31.877523    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy\""
Jul 15 18:18:31.877552 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:18:31.877534    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-grpc-tls-88sgv5r4bpcph\""
Jul 15 18:18:31.877717 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:18:31.877664    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-tls\""
Jul 15 18:18:31.877717 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:18:31.877672    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-metrics\""
Jul 15 18:18:31.877818 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:18:31.877764    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-rules\""
Jul 15 18:18:31.886544 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:18:31.886519    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-6f66584585-8nvch"]
Jul 15 18:18:31.980522 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:18:31.980489    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4x89s\" (UniqueName: \"kubernetes.io/projected/58b027cc-0443-48c9-813b-7fbbd36a68c0-kube-api-access-4x89s\") pod \"thanos-querier-6f66584585-8nvch\" (UID: \"58b027cc-0443-48c9-813b-7fbbd36a68c0\") " pod="openshift-monitoring/thanos-querier-6f66584585-8nvch"
Jul 15 18:18:31.980959 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:18:31.980541    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/58b027cc-0443-48c9-813b-7fbbd36a68c0-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-6f66584585-8nvch\" (UID: \"58b027cc-0443-48c9-813b-7fbbd36a68c0\") " pod="openshift-monitoring/thanos-querier-6f66584585-8nvch"
Jul 15 18:18:31.980959 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:18:31.980589    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/58b027cc-0443-48c9-813b-7fbbd36a68c0-metrics-client-ca\") pod \"thanos-querier-6f66584585-8nvch\" (UID: \"58b027cc-0443-48c9-813b-7fbbd36a68c0\") " pod="openshift-monitoring/thanos-querier-6f66584585-8nvch"
Jul 15 18:18:31.980959 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:18:31.980619    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/58b027cc-0443-48c9-813b-7fbbd36a68c0-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-6f66584585-8nvch\" (UID: \"58b027cc-0443-48c9-813b-7fbbd36a68c0\") " pod="openshift-monitoring/thanos-querier-6f66584585-8nvch"
Jul 15 18:18:31.980959 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:18:31.980638    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/58b027cc-0443-48c9-813b-7fbbd36a68c0-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-6f66584585-8nvch\" (UID: \"58b027cc-0443-48c9-813b-7fbbd36a68c0\") " pod="openshift-monitoring/thanos-querier-6f66584585-8nvch"
Jul 15 18:18:31.980959 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:18:31.980676    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/58b027cc-0443-48c9-813b-7fbbd36a68c0-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-6f66584585-8nvch\" (UID: \"58b027cc-0443-48c9-813b-7fbbd36a68c0\") " pod="openshift-monitoring/thanos-querier-6f66584585-8nvch"
Jul 15 18:18:31.980959 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:18:31.980773    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/58b027cc-0443-48c9-813b-7fbbd36a68c0-secret-grpc-tls\") pod \"thanos-querier-6f66584585-8nvch\" (UID: \"58b027cc-0443-48c9-813b-7fbbd36a68c0\") " pod="openshift-monitoring/thanos-querier-6f66584585-8nvch"
Jul 15 18:18:31.980959 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:18:31.980814    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/58b027cc-0443-48c9-813b-7fbbd36a68c0-secret-thanos-querier-tls\") pod \"thanos-querier-6f66584585-8nvch\" (UID: \"58b027cc-0443-48c9-813b-7fbbd36a68c0\") " pod="openshift-monitoring/thanos-querier-6f66584585-8nvch"
Jul 15 18:18:32.081279 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:18:32.081222    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/58b027cc-0443-48c9-813b-7fbbd36a68c0-secret-thanos-querier-tls\") pod \"thanos-querier-6f66584585-8nvch\" (UID: \"58b027cc-0443-48c9-813b-7fbbd36a68c0\") " pod="openshift-monitoring/thanos-querier-6f66584585-8nvch"
Jul 15 18:18:32.081463 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:18:32.081325    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4x89s\" (UniqueName: \"kubernetes.io/projected/58b027cc-0443-48c9-813b-7fbbd36a68c0-kube-api-access-4x89s\") pod \"thanos-querier-6f66584585-8nvch\" (UID: \"58b027cc-0443-48c9-813b-7fbbd36a68c0\") " pod="openshift-monitoring/thanos-querier-6f66584585-8nvch"
Jul 15 18:18:32.081463 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:18:32.081362    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/58b027cc-0443-48c9-813b-7fbbd36a68c0-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-6f66584585-8nvch\" (UID: \"58b027cc-0443-48c9-813b-7fbbd36a68c0\") " pod="openshift-monitoring/thanos-querier-6f66584585-8nvch"
Jul 15 18:18:32.081463 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:18:32.081394    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/58b027cc-0443-48c9-813b-7fbbd36a68c0-metrics-client-ca\") pod \"thanos-querier-6f66584585-8nvch\" (UID: \"58b027cc-0443-48c9-813b-7fbbd36a68c0\") " pod="openshift-monitoring/thanos-querier-6f66584585-8nvch"
Jul 15 18:18:32.081463 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:18:32.081427    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/58b027cc-0443-48c9-813b-7fbbd36a68c0-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-6f66584585-8nvch\" (UID: \"58b027cc-0443-48c9-813b-7fbbd36a68c0\") " pod="openshift-monitoring/thanos-querier-6f66584585-8nvch"
Jul 15 18:18:32.081463 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:18:32.081456    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/58b027cc-0443-48c9-813b-7fbbd36a68c0-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-6f66584585-8nvch\" (UID: \"58b027cc-0443-48c9-813b-7fbbd36a68c0\") " pod="openshift-monitoring/thanos-querier-6f66584585-8nvch"
Jul 15 18:18:32.081728 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:18:32.081509    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/58b027cc-0443-48c9-813b-7fbbd36a68c0-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-6f66584585-8nvch\" (UID: \"58b027cc-0443-48c9-813b-7fbbd36a68c0\") " pod="openshift-monitoring/thanos-querier-6f66584585-8nvch"
Jul 15 18:18:32.081728 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:18:32.081536    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/58b027cc-0443-48c9-813b-7fbbd36a68c0-secret-grpc-tls\") pod \"thanos-querier-6f66584585-8nvch\" (UID: \"58b027cc-0443-48c9-813b-7fbbd36a68c0\") " pod="openshift-monitoring/thanos-querier-6f66584585-8nvch"
Jul 15 18:18:32.084630 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:18:32.084565    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/58b027cc-0443-48c9-813b-7fbbd36a68c0-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-6f66584585-8nvch\" (UID: \"58b027cc-0443-48c9-813b-7fbbd36a68c0\") " pod="openshift-monitoring/thanos-querier-6f66584585-8nvch"
Jul 15 18:18:32.084630 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:18:32.084612    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/58b027cc-0443-48c9-813b-7fbbd36a68c0-secret-grpc-tls\") pod \"thanos-querier-6f66584585-8nvch\" (UID: \"58b027cc-0443-48c9-813b-7fbbd36a68c0\") " pod="openshift-monitoring/thanos-querier-6f66584585-8nvch"
Jul 15 18:18:32.084900 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:18:32.084861    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/58b027cc-0443-48c9-813b-7fbbd36a68c0-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-6f66584585-8nvch\" (UID: \"58b027cc-0443-48c9-813b-7fbbd36a68c0\") " pod="openshift-monitoring/thanos-querier-6f66584585-8nvch"
Jul 15 18:18:32.084900 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:18:32.084867    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/58b027cc-0443-48c9-813b-7fbbd36a68c0-metrics-client-ca\") pod \"thanos-querier-6f66584585-8nvch\" (UID: \"58b027cc-0443-48c9-813b-7fbbd36a68c0\") " pod="openshift-monitoring/thanos-querier-6f66584585-8nvch"
Jul 15 18:18:32.088979 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:18:32.085124    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/58b027cc-0443-48c9-813b-7fbbd36a68c0-secret-thanos-querier-tls\") pod \"thanos-querier-6f66584585-8nvch\" (UID: \"58b027cc-0443-48c9-813b-7fbbd36a68c0\") " pod="openshift-monitoring/thanos-querier-6f66584585-8nvch"
Jul 15 18:18:32.088979 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:18:32.087301    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/58b027cc-0443-48c9-813b-7fbbd36a68c0-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-6f66584585-8nvch\" (UID: \"58b027cc-0443-48c9-813b-7fbbd36a68c0\") " pod="openshift-monitoring/thanos-querier-6f66584585-8nvch"
Jul 15 18:18:32.089725 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:18:32.089643    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/58b027cc-0443-48c9-813b-7fbbd36a68c0-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-6f66584585-8nvch\" (UID: \"58b027cc-0443-48c9-813b-7fbbd36a68c0\") " pod="openshift-monitoring/thanos-querier-6f66584585-8nvch"
Jul 15 18:18:32.090332 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:18:32.090285    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4x89s\" (UniqueName: \"kubernetes.io/projected/58b027cc-0443-48c9-813b-7fbbd36a68c0-kube-api-access-4x89s\") pod \"thanos-querier-6f66584585-8nvch\" (UID: \"58b027cc-0443-48c9-813b-7fbbd36a68c0\") " pod="openshift-monitoring/thanos-querier-6f66584585-8nvch"
Jul 15 18:18:32.185727 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:18:32.185700    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-6f66584585-8nvch"
Jul 15 18:18:33.390985 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:18:33.390945    2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/metrics-server-5d5c95d576-cgbcs"]
Jul 15 18:18:33.394588 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:18:33.394565    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-5d5c95d576-cgbcs"
Jul 15 18:18:33.396973 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:18:33.396789    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-client-certs\""
Jul 15 18:18:33.396973 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:18:33.396904    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-dockercfg-bv2mv\""
Jul 15 18:18:33.396973 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:18:33.396953    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\""
Jul 15 18:18:33.397676 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:18:33.397634    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-tls\""
Jul 15 18:18:33.397676 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:18:33.397647    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-server-audit-profiles\""
Jul 15 18:18:33.397809 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:18:33.397700    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-dbga7hh2jk56q\""
Jul 15 18:18:33.404691 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:18:33.404671    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-5d5c95d576-cgbcs"]
Jul 15 18:18:33.493995 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:18:33.493958    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/0b3aa63d-db37-403b-b6ce-0786a746f07a-metrics-server-audit-profiles\") pod \"metrics-server-5d5c95d576-cgbcs\" (UID: \"0b3aa63d-db37-403b-b6ce-0786a746f07a\") " pod="openshift-monitoring/metrics-server-5d5c95d576-cgbcs"
Jul 15 18:18:33.493995 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:18:33.494007    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/0b3aa63d-db37-403b-b6ce-0786a746f07a-audit-log\") pod \"metrics-server-5d5c95d576-cgbcs\" (UID: \"0b3aa63d-db37-403b-b6ce-0786a746f07a\") " pod="openshift-monitoring/metrics-server-5d5c95d576-cgbcs"
Jul 15 18:18:33.494225 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:18:33.494099    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/0b3aa63d-db37-403b-b6ce-0786a746f07a-client-ca-bundle\") pod \"metrics-server-5d5c95d576-cgbcs\" (UID: \"0b3aa63d-db37-403b-b6ce-0786a746f07a\") " pod="openshift-monitoring/metrics-server-5d5c95d576-cgbcs"
Jul 15 18:18:33.494225 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:18:33.494141    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/0b3aa63d-db37-403b-b6ce-0786a746f07a-secret-metrics-server-client-certs\") pod \"metrics-server-5d5c95d576-cgbcs\" (UID: \"0b3aa63d-db37-403b-b6ce-0786a746f07a\") " pod="openshift-monitoring/metrics-server-5d5c95d576-cgbcs"
Jul 15 18:18:33.494225 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:18:33.494205    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rkqmf\" (UniqueName: \"kubernetes.io/projected/0b3aa63d-db37-403b-b6ce-0786a746f07a-kube-api-access-rkqmf\") pod \"metrics-server-5d5c95d576-cgbcs\" (UID: \"0b3aa63d-db37-403b-b6ce-0786a746f07a\") " pod="openshift-monitoring/metrics-server-5d5c95d576-cgbcs"
Jul 15 18:18:33.494394 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:18:33.494267    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/0b3aa63d-db37-403b-b6ce-0786a746f07a-secret-metrics-server-tls\") pod \"metrics-server-5d5c95d576-cgbcs\" (UID: \"0b3aa63d-db37-403b-b6ce-0786a746f07a\") " pod="openshift-monitoring/metrics-server-5d5c95d576-cgbcs"
Jul 15 18:18:33.494394 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:18:33.494309    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0b3aa63d-db37-403b-b6ce-0786a746f07a-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-5d5c95d576-cgbcs\" (UID: \"0b3aa63d-db37-403b-b6ce-0786a746f07a\") " pod="openshift-monitoring/metrics-server-5d5c95d576-cgbcs"
Jul 15 18:18:33.594975 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:18:33.594937    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/0b3aa63d-db37-403b-b6ce-0786a746f07a-secret-metrics-server-client-certs\") pod \"metrics-server-5d5c95d576-cgbcs\" (UID: \"0b3aa63d-db37-403b-b6ce-0786a746f07a\") " pod="openshift-monitoring/metrics-server-5d5c95d576-cgbcs"
Jul 15 18:18:33.595153 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:18:33.594997    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rkqmf\" (UniqueName: \"kubernetes.io/projected/0b3aa63d-db37-403b-b6ce-0786a746f07a-kube-api-access-rkqmf\") pod \"metrics-server-5d5c95d576-cgbcs\" (UID: \"0b3aa63d-db37-403b-b6ce-0786a746f07a\") " pod="openshift-monitoring/metrics-server-5d5c95d576-cgbcs"
Jul 15 18:18:33.595153 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:18:33.595021    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/0b3aa63d-db37-403b-b6ce-0786a746f07a-secret-metrics-server-tls\") pod \"metrics-server-5d5c95d576-cgbcs\" (UID: \"0b3aa63d-db37-403b-b6ce-0786a746f07a\") " pod="openshift-monitoring/metrics-server-5d5c95d576-cgbcs"
Jul 15 18:18:33.595153 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:18:33.595059    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0b3aa63d-db37-403b-b6ce-0786a746f07a-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-5d5c95d576-cgbcs\" (UID: \"0b3aa63d-db37-403b-b6ce-0786a746f07a\") " pod="openshift-monitoring/metrics-server-5d5c95d576-cgbcs"
Jul 15 18:18:33.595153 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:18:33.595134    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/0b3aa63d-db37-403b-b6ce-0786a746f07a-metrics-server-audit-profiles\") pod \"metrics-server-5d5c95d576-cgbcs\" (UID: \"0b3aa63d-db37-403b-b6ce-0786a746f07a\") " pod="openshift-monitoring/metrics-server-5d5c95d576-cgbcs"
Jul 15 18:18:33.595399 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:18:33.595176    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/0b3aa63d-db37-403b-b6ce-0786a746f07a-audit-log\") pod \"metrics-server-5d5c95d576-cgbcs\" (UID: \"0b3aa63d-db37-403b-b6ce-0786a746f07a\") " pod="openshift-monitoring/metrics-server-5d5c95d576-cgbcs"
Jul 15 18:18:33.595399 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:18:33.595224    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/0b3aa63d-db37-403b-b6ce-0786a746f07a-client-ca-bundle\") pod \"metrics-server-5d5c95d576-cgbcs\" (UID: \"0b3aa63d-db37-403b-b6ce-0786a746f07a\") " pod="openshift-monitoring/metrics-server-5d5c95d576-cgbcs"
Jul 15 18:18:33.595794 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:18:33.595767    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/0b3aa63d-db37-403b-b6ce-0786a746f07a-audit-log\") pod \"metrics-server-5d5c95d576-cgbcs\" (UID: \"0b3aa63d-db37-403b-b6ce-0786a746f07a\") " pod="openshift-monitoring/metrics-server-5d5c95d576-cgbcs"
Jul 15 18:18:33.595951 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:18:33.595912    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0b3aa63d-db37-403b-b6ce-0786a746f07a-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-5d5c95d576-cgbcs\" (UID: \"0b3aa63d-db37-403b-b6ce-0786a746f07a\") " pod="openshift-monitoring/metrics-server-5d5c95d576-cgbcs"
Jul 15 18:18:33.596246 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:18:33.596205    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/0b3aa63d-db37-403b-b6ce-0786a746f07a-metrics-server-audit-profiles\") pod \"metrics-server-5d5c95d576-cgbcs\" (UID: \"0b3aa63d-db37-403b-b6ce-0786a746f07a\") " pod="openshift-monitoring/metrics-server-5d5c95d576-cgbcs"
Jul 15 18:18:33.597908 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:18:33.597881    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/0b3aa63d-db37-403b-b6ce-0786a746f07a-client-ca-bundle\") pod \"metrics-server-5d5c95d576-cgbcs\" (UID: \"0b3aa63d-db37-403b-b6ce-0786a746f07a\") " pod="openshift-monitoring/metrics-server-5d5c95d576-cgbcs"
Jul 15 18:18:33.598045 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:18:33.598025    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/0b3aa63d-db37-403b-b6ce-0786a746f07a-secret-metrics-server-client-certs\") pod \"metrics-server-5d5c95d576-cgbcs\" (UID: \"0b3aa63d-db37-403b-b6ce-0786a746f07a\") " pod="openshift-monitoring/metrics-server-5d5c95d576-cgbcs"
Jul 15 18:18:33.598150 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:18:33.598100    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/0b3aa63d-db37-403b-b6ce-0786a746f07a-secret-metrics-server-tls\") pod \"metrics-server-5d5c95d576-cgbcs\" (UID: \"0b3aa63d-db37-403b-b6ce-0786a746f07a\") " pod="openshift-monitoring/metrics-server-5d5c95d576-cgbcs"
Jul 15 18:18:33.604177 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:18:33.604156    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rkqmf\" (UniqueName: \"kubernetes.io/projected/0b3aa63d-db37-403b-b6ce-0786a746f07a-kube-api-access-rkqmf\") pod \"metrics-server-5d5c95d576-cgbcs\" (UID: \"0b3aa63d-db37-403b-b6ce-0786a746f07a\") " pod="openshift-monitoring/metrics-server-5d5c95d576-cgbcs"
Jul 15 18:18:33.668995 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:18:33.668907    2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-7f768f64d6-qkw2d"]
Jul 15 18:18:33.674151 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:18:33.674124    2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/monitoring-plugin-5f68df7f58-8wt6r"]
Jul 15 18:18:33.674295 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:18:33.674253    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7f768f64d6-qkw2d"
Jul 15 18:18:33.677329 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:18:33.677307    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-5f68df7f58-8wt6r"
Jul 15 18:18:33.679315 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:18:33.679297    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-cert\""
Jul 15 18:18:33.679436 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:18:33.679325    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-dockercfg-ffstp\""
Jul 15 18:18:33.685863 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:18:33.685838    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-7f768f64d6-qkw2d"]
Jul 15 18:18:33.686908 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:18:33.686887    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-5f68df7f58-8wt6r"]
Jul 15 18:18:33.706767 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:18:33.706744    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-5d5c95d576-cgbcs"
Jul 15 18:18:33.796423 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:18:33.796394    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/3eb0e193-d9a7-4f35-8da0-590eaa374d1a-service-ca\") pod \"console-7f768f64d6-qkw2d\" (UID: \"3eb0e193-d9a7-4f35-8da0-590eaa374d1a\") " pod="openshift-console/console-7f768f64d6-qkw2d"
Jul 15 18:18:33.796423 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:18:33.796430    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/fe6de8a4-feae-4c63-92e9-882042af5ece-monitoring-plugin-cert\") pod \"monitoring-plugin-5f68df7f58-8wt6r\" (UID: \"fe6de8a4-feae-4c63-92e9-882042af5ece\") " pod="openshift-monitoring/monitoring-plugin-5f68df7f58-8wt6r"
Jul 15 18:18:33.796652 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:18:33.796466    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3eb0e193-d9a7-4f35-8da0-590eaa374d1a-trusted-ca-bundle\") pod \"console-7f768f64d6-qkw2d\" (UID: \"3eb0e193-d9a7-4f35-8da0-590eaa374d1a\") " pod="openshift-console/console-7f768f64d6-qkw2d"
Jul 15 18:18:33.796652 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:18:33.796538    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vqq7m\" (UniqueName: \"kubernetes.io/projected/fe6de8a4-feae-4c63-92e9-882042af5ece-kube-api-access-vqq7m\") pod \"monitoring-plugin-5f68df7f58-8wt6r\" (UID: \"fe6de8a4-feae-4c63-92e9-882042af5ece\") " pod="openshift-monitoring/monitoring-plugin-5f68df7f58-8wt6r"
Jul 15 18:18:33.796652 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:18:33.796592    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/3eb0e193-d9a7-4f35-8da0-590eaa374d1a-oauth-serving-cert\") pod \"console-7f768f64d6-qkw2d\" (UID: \"3eb0e193-d9a7-4f35-8da0-590eaa374d1a\") " pod="openshift-console/console-7f768f64d6-qkw2d"
Jul 15 18:18:33.796769 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:18:33.796651    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/3eb0e193-d9a7-4f35-8da0-590eaa374d1a-console-serving-cert\") pod \"console-7f768f64d6-qkw2d\" (UID: \"3eb0e193-d9a7-4f35-8da0-590eaa374d1a\") " pod="openshift-console/console-7f768f64d6-qkw2d"
Jul 15 18:18:33.796769 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:18:33.796672    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/3eb0e193-d9a7-4f35-8da0-590eaa374d1a-console-config\") pod \"console-7f768f64d6-qkw2d\" (UID: \"3eb0e193-d9a7-4f35-8da0-590eaa374d1a\") " pod="openshift-console/console-7f768f64d6-qkw2d"
Jul 15 18:18:33.796769 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:18:33.796701    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/3eb0e193-d9a7-4f35-8da0-590eaa374d1a-console-oauth-config\") pod \"console-7f768f64d6-qkw2d\" (UID: \"3eb0e193-d9a7-4f35-8da0-590eaa374d1a\") " pod="openshift-console/console-7f768f64d6-qkw2d"
Jul 15 18:18:33.796769 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:18:33.796722    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-g4f78\" (UniqueName: \"kubernetes.io/projected/3eb0e193-d9a7-4f35-8da0-590eaa374d1a-kube-api-access-g4f78\") pod \"console-7f768f64d6-qkw2d\" (UID: \"3eb0e193-d9a7-4f35-8da0-590eaa374d1a\") " pod="openshift-console/console-7f768f64d6-qkw2d"
Jul 15 18:18:33.897584 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:18:33.897537    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3eb0e193-d9a7-4f35-8da0-590eaa374d1a-trusted-ca-bundle\") pod \"console-7f768f64d6-qkw2d\" (UID: \"3eb0e193-d9a7-4f35-8da0-590eaa374d1a\") " pod="openshift-console/console-7f768f64d6-qkw2d"
Jul 15 18:18:33.897584 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:18:33.897590    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vqq7m\" (UniqueName: \"kubernetes.io/projected/fe6de8a4-feae-4c63-92e9-882042af5ece-kube-api-access-vqq7m\") pod \"monitoring-plugin-5f68df7f58-8wt6r\" (UID: \"fe6de8a4-feae-4c63-92e9-882042af5ece\") " pod="openshift-monitoring/monitoring-plugin-5f68df7f58-8wt6r"
Jul 15 18:18:33.897826 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:18:33.897619    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/3eb0e193-d9a7-4f35-8da0-590eaa374d1a-oauth-serving-cert\") pod \"console-7f768f64d6-qkw2d\" (UID: \"3eb0e193-d9a7-4f35-8da0-590eaa374d1a\") " pod="openshift-console/console-7f768f64d6-qkw2d"
Jul 15 18:18:33.897826 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:18:33.897659    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/3eb0e193-d9a7-4f35-8da0-590eaa374d1a-console-serving-cert\") pod \"console-7f768f64d6-qkw2d\" (UID: \"3eb0e193-d9a7-4f35-8da0-590eaa374d1a\") " pod="openshift-console/console-7f768f64d6-qkw2d"
Jul 15 18:18:33.897826 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:18:33.897681    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/3eb0e193-d9a7-4f35-8da0-590eaa374d1a-console-config\") pod \"console-7f768f64d6-qkw2d\" (UID: \"3eb0e193-d9a7-4f35-8da0-590eaa374d1a\") " pod="openshift-console/console-7f768f64d6-qkw2d"
Jul 15 18:18:33.897826 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:18:33.897716    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/3eb0e193-d9a7-4f35-8da0-590eaa374d1a-console-oauth-config\") pod \"console-7f768f64d6-qkw2d\" (UID: \"3eb0e193-d9a7-4f35-8da0-590eaa374d1a\") " pod="openshift-console/console-7f768f64d6-qkw2d"
Jul 15 18:18:33.897826 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:18:33.897740    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-g4f78\" (UniqueName: \"kubernetes.io/projected/3eb0e193-d9a7-4f35-8da0-590eaa374d1a-kube-api-access-g4f78\") pod \"console-7f768f64d6-qkw2d\" (UID: \"3eb0e193-d9a7-4f35-8da0-590eaa374d1a\") " pod="openshift-console/console-7f768f64d6-qkw2d"
Jul 15 18:18:33.897826 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:18:33.897783    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/3eb0e193-d9a7-4f35-8da0-590eaa374d1a-service-ca\") pod \"console-7f768f64d6-qkw2d\" (UID: \"3eb0e193-d9a7-4f35-8da0-590eaa374d1a\") " pod="openshift-console/console-7f768f64d6-qkw2d"
Jul 15 18:18:33.897826 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:18:33.897810    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/fe6de8a4-feae-4c63-92e9-882042af5ece-monitoring-plugin-cert\") pod \"monitoring-plugin-5f68df7f58-8wt6r\" (UID: \"fe6de8a4-feae-4c63-92e9-882042af5ece\") " pod="openshift-monitoring/monitoring-plugin-5f68df7f58-8wt6r"
Jul 15 18:18:33.898747 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:18:33.898719    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/3eb0e193-d9a7-4f35-8da0-590eaa374d1a-oauth-serving-cert\") pod \"console-7f768f64d6-qkw2d\" (UID: \"3eb0e193-d9a7-4f35-8da0-590eaa374d1a\") " pod="openshift-console/console-7f768f64d6-qkw2d"
Jul 15 18:18:33.898901 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:18:33.898878    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/3eb0e193-d9a7-4f35-8da0-590eaa374d1a-console-config\") pod \"console-7f768f64d6-qkw2d\" (UID: \"3eb0e193-d9a7-4f35-8da0-590eaa374d1a\") " pod="openshift-console/console-7f768f64d6-qkw2d"
Jul 15 18:18:33.899315 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:18:33.899139    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3eb0e193-d9a7-4f35-8da0-590eaa374d1a-trusted-ca-bundle\") pod \"console-7f768f64d6-qkw2d\" (UID: \"3eb0e193-d9a7-4f35-8da0-590eaa374d1a\") " pod="openshift-console/console-7f768f64d6-qkw2d"
Jul 15 18:18:33.899700 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:18:33.899679    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/3eb0e193-d9a7-4f35-8da0-590eaa374d1a-service-ca\") pod \"console-7f768f64d6-qkw2d\" (UID: \"3eb0e193-d9a7-4f35-8da0-590eaa374d1a\") " pod="openshift-console/console-7f768f64d6-qkw2d"
Jul 15 18:18:33.901329 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:18:33.901308    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/3eb0e193-d9a7-4f35-8da0-590eaa374d1a-console-oauth-config\") pod \"console-7f768f64d6-qkw2d\" (UID: \"3eb0e193-d9a7-4f35-8da0-590eaa374d1a\") " pod="openshift-console/console-7f768f64d6-qkw2d"
Jul 15 18:18:33.901490 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:18:33.901352    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/fe6de8a4-feae-4c63-92e9-882042af5ece-monitoring-plugin-cert\") pod \"monitoring-plugin-5f68df7f58-8wt6r\" (UID: \"fe6de8a4-feae-4c63-92e9-882042af5ece\") " pod="openshift-monitoring/monitoring-plugin-5f68df7f58-8wt6r"
Jul 15 18:18:33.901713 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:18:33.901694    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/3eb0e193-d9a7-4f35-8da0-590eaa374d1a-console-serving-cert\") pod \"console-7f768f64d6-qkw2d\" (UID: \"3eb0e193-d9a7-4f35-8da0-590eaa374d1a\") " pod="openshift-console/console-7f768f64d6-qkw2d"
Jul 15 18:18:33.905866 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:18:33.905824    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-g4f78\" (UniqueName: \"kubernetes.io/projected/3eb0e193-d9a7-4f35-8da0-590eaa374d1a-kube-api-access-g4f78\") pod \"console-7f768f64d6-qkw2d\" (UID: \"3eb0e193-d9a7-4f35-8da0-590eaa374d1a\") " pod="openshift-console/console-7f768f64d6-qkw2d"
Jul 15 18:18:33.906780 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:18:33.906136    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vqq7m\" (UniqueName: \"kubernetes.io/projected/fe6de8a4-feae-4c63-92e9-882042af5ece-kube-api-access-vqq7m\") pod \"monitoring-plugin-5f68df7f58-8wt6r\" (UID: \"fe6de8a4-feae-4c63-92e9-882042af5ece\") " pod="openshift-monitoring/monitoring-plugin-5f68df7f58-8wt6r"
Jul 15 18:18:33.988777 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:18:33.988732    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7f768f64d6-qkw2d"
Jul 15 18:18:33.998590 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:18:33.998563    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-5f68df7f58-8wt6r"
Jul 15 18:18:34.320717 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:18:34.320621    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Jul 15 18:18:34.325711 ip-10-0-141-171 kubenswrapper[2567]: W0715 18:18:34.325680    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0a3d2b71_dc31_4a25_ad7f_89bf188082f4.slice/crio-7fa6dccc24b69134621a6e16732576769f414892c01726f6420cab7ef99217d7 WatchSource:0}: Error finding container 7fa6dccc24b69134621a6e16732576769f414892c01726f6420cab7ef99217d7: Status 404 returned error can't find the container with id 7fa6dccc24b69134621a6e16732576769f414892c01726f6420cab7ef99217d7
Jul 15 18:18:34.539514 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:18:34.539429    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-5f68df7f58-8wt6r"]
Jul 15 18:18:34.542707 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:18:34.542687    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-7f768f64d6-qkw2d"]
Jul 15 18:18:34.543190 ip-10-0-141-171 kubenswrapper[2567]: W0715 18:18:34.543155    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfe6de8a4_feae_4c63_92e9_882042af5ece.slice/crio-ff1844aa833f68c66f8e3ce9687d20d8148eec440fbfb97e6e3b5438b9820355 WatchSource:0}: Error finding container ff1844aa833f68c66f8e3ce9687d20d8148eec440fbfb97e6e3b5438b9820355: Status 404 returned error can't find the container with id ff1844aa833f68c66f8e3ce9687d20d8148eec440fbfb97e6e3b5438b9820355
Jul 15 18:18:34.546305 ip-10-0-141-171 kubenswrapper[2567]: W0715 18:18:34.545663    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3eb0e193_d9a7_4f35_8da0_590eaa374d1a.slice/crio-0173074d5c57c43de8d6e646122d4b2bb49882653d33e35590fff730c1cd140f WatchSource:0}: Error finding container 0173074d5c57c43de8d6e646122d4b2bb49882653d33e35590fff730c1cd140f: Status 404 returned error can't find the container with id 0173074d5c57c43de8d6e646122d4b2bb49882653d33e35590fff730c1cd140f
Jul 15 18:18:34.546305 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:18:34.546035    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-5d5c95d576-cgbcs"]
Jul 15 18:18:34.547398 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:18:34.547366    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-6f66584585-8nvch"]
Jul 15 18:18:34.549990 ip-10-0-141-171 kubenswrapper[2567]: W0715 18:18:34.549965    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod58b027cc_0443_48c9_813b_7fbbd36a68c0.slice/crio-07aec19404798c918cb58363b9410fda879364c3911b662d5b010892cce79232 WatchSource:0}: Error finding container 07aec19404798c918cb58363b9410fda879364c3911b662d5b010892cce79232: Status 404 returned error can't find the container with id 07aec19404798c918cb58363b9410fda879364c3911b662d5b010892cce79232
Jul 15 18:18:34.550806 ip-10-0-141-171 kubenswrapper[2567]: W0715 18:18:34.550786    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0b3aa63d_db37_403b_b6ce_0786a746f07a.slice/crio-082fdfd2be60648911f97fdfd2d82e277164461827acfeb62898d26f91208d17 WatchSource:0}: Error finding container 082fdfd2be60648911f97fdfd2d82e277164461827acfeb62898d26f91208d17: Status 404 returned error can't find the container with id 082fdfd2be60648911f97fdfd2d82e277164461827acfeb62898d26f91208d17
Jul 15 18:18:34.562657 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:18:34.562201    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-4lm4m" event={"ID":"b4f54a92-c72a-4f20-93f7-7b424f8f2656","Type":"ContainerStarted","Data":"debc788b2f193c8dda3b934dfc7dc2b3c7b2d12a865c69fa4f6f51efa6335d0c"}
Jul 15 18:18:34.562879 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:18:34.562820    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-4lm4m"
Jul 15 18:18:34.564844 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:18:34.564821    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-dqncz" event={"ID":"0d941f69-52de-4bf3-b262-9d9e07d9d730","Type":"ContainerStarted","Data":"ae942b649f1ea180d30fbc2eacc67b3b760e872c944c4ebb10fbb569a1962222"}
Jul 15 18:18:34.567664 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:18:34.567631    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-785778ff74-mvdt9" event={"ID":"e60f42cb-1b48-4897-b7f4-422ce77e048c","Type":"ContainerStarted","Data":"6459a8821def39485d060e8c3133fa169f1b49ec1053733313e7ad16928bcf40"}
Jul 15 18:18:34.567760 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:18:34.567681    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-785778ff74-mvdt9" event={"ID":"e60f42cb-1b48-4897-b7f4-422ce77e048c","Type":"ContainerStarted","Data":"53ad21a28d834d3b6b769a6143349c48826047688fdfc214be2a1762bf165563"}
Jul 15 18:18:34.567760 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:18:34.567734    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-785778ff74-mvdt9" event={"ID":"e60f42cb-1b48-4897-b7f4-422ce77e048c","Type":"ContainerStarted","Data":"cbe1db7f6743153f5fd8c1c3ec1390c484b07a7075e6d2cec18b757a7a32ecd8"}
Jul 15 18:18:34.569016 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:18:34.568998    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-5d5c95d576-cgbcs" event={"ID":"0b3aa63d-db37-403b-b6ce-0786a746f07a","Type":"ContainerStarted","Data":"082fdfd2be60648911f97fdfd2d82e277164461827acfeb62898d26f91208d17"}
Jul 15 18:18:34.570183 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:18:34.570163    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-6f66584585-8nvch" event={"ID":"58b027cc-0443-48c9-813b-7fbbd36a68c0","Type":"ContainerStarted","Data":"07aec19404798c918cb58363b9410fda879364c3911b662d5b010892cce79232"}
Jul 15 18:18:34.572770 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:18:34.572742    2567 generic.go:356] "Generic (PLEG): container finished" podID="77a85f70-62db-476e-8397-ee0759a55745" containerID="33ff40f29e225b0bd5cf1f0fe15579f3fbc04f20218f9288fb39525e68fedffc" exitCode=0
Jul 15 18:18:34.572859 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:18:34.572824    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-zhfjg" event={"ID":"77a85f70-62db-476e-8397-ee0759a55745","Type":"ContainerDied","Data":"33ff40f29e225b0bd5cf1f0fe15579f3fbc04f20218f9288fb39525e68fedffc"}
Jul 15 18:18:34.575121 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:18:34.575090    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-84bd68b896-r78xl" event={"ID":"16717ecb-2c1e-4b6f-be6f-c02162eb178d","Type":"ContainerStarted","Data":"929fcd770f0d37e148a119fd11894bb102fcb342e42a780133f10fd56a9dbc97"}
Jul 15 18:18:34.576341 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:18:34.576322    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"0a3d2b71-dc31-4a25-ad7f-89bf188082f4","Type":"ContainerStarted","Data":"7fa6dccc24b69134621a6e16732576769f414892c01726f6420cab7ef99217d7"}
Jul 15 18:18:34.577355 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:18:34.577334    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-5f68df7f58-8wt6r" event={"ID":"fe6de8a4-feae-4c63-92e9-882042af5ece","Type":"ContainerStarted","Data":"ff1844aa833f68c66f8e3ce9687d20d8148eec440fbfb97e6e3b5438b9820355"}
Jul 15 18:18:34.579059 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:18:34.579038    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7f768f64d6-qkw2d" event={"ID":"3eb0e193-d9a7-4f35-8da0-590eaa374d1a","Type":"ContainerStarted","Data":"0173074d5c57c43de8d6e646122d4b2bb49882653d33e35590fff730c1cd140f"}
Jul 15 18:18:34.579746 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:18:34.579705    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-4lm4m" podStartSLOduration=66.771281223 podStartE2EDuration="1m12.579688193s" totalImagesPullingTime="5.80840697s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 18:17:22 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 18:18:34.577765671 +0000 UTC m=+73.112189041" watchObservedRunningTime="2026-07-15 18:18:34.579688193 +0000 UTC m=+73.114111557"
Jul 15 18:18:34.591866 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:18:34.591817    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-dqncz" podStartSLOduration=66.548440781 podStartE2EDuration="1m12.591800421s" totalImagesPullingTime="6.04335964s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-15 18:17:22 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 18:18:34.590209644 +0000 UTC m=+73.124633001" watchObservedRunningTime="2026-07-15 18:18:34.591800421 +0000 UTC m=+73.126223778"
Jul 15 18:18:34.608208 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:18:34.608153    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/kube-state-metrics-785778ff74-mvdt9" podStartSLOduration=2.5560430849999998 podStartE2EDuration="6.608135011s" totalImagesPullingTime="4.052091926s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 18:18:28 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 18:18:34.60740936 +0000 UTC m=+73.141832717" watchObservedRunningTime="2026-07-15 18:18:34.608135011 +0000 UTC m=+73.142558368"
Jul 15 18:18:34.624667 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:18:34.624619    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/openshift-state-metrics-84bd68b896-r78xl" podStartSLOduration=2.36923335 podStartE2EDuration="6.624598223s" totalImagesPullingTime="4.255364873s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 18:18:28 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 18:18:34.623022192 +0000 UTC m=+73.157445570" watchObservedRunningTime="2026-07-15 18:18:34.624598223 +0000 UTC m=+73.159021581"
Jul 15 18:18:35.128054 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:18:35.128019    2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 15 18:18:35.134444 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:18:35.134416    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Jul 15 18:18:35.139051 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:18:35.139026    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\""
Jul 15 18:18:35.139559 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:18:35.139536    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-9rtxx\""
Jul 15 18:18:35.139662 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:18:35.139586    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\""
Jul 15 18:18:35.139662 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:18:35.139410    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\""
Jul 15 18:18:35.139795 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:18:35.139539    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-2rbgbbrcngto2\""
Jul 15 18:18:35.139795 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:18:35.139766    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\""
Jul 15 18:18:35.139904 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:18:35.139352    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-2\""
Jul 15 18:18:35.139904 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:18:35.139882    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\""
Jul 15 18:18:35.140004 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:18:35.139928    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\""
Jul 15 18:18:35.140050 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:18:35.140011    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\""
Jul 15 18:18:35.140050 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:18:35.140030    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-1\""
Jul 15 18:18:35.140140 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:18:35.139213    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\""
Jul 15 18:18:35.140409 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:18:35.140296    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\""
Jul 15 18:18:35.142146 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:18:35.142123    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\""
Jul 15 18:18:35.155222 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:18:35.155192    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\""
Jul 15 18:18:35.159488 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:18:35.158772    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\""
Jul 15 18:18:35.161995 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:18:35.161972    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 15 18:18:35.211877 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:18:35.211837    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/bbd39087-922a-489c-8bd8-aa6cd503d786-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"bbd39087-922a-489c-8bd8-aa6cd503d786\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 15 18:18:35.212072 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:18:35.211907    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/bbd39087-922a-489c-8bd8-aa6cd503d786-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"bbd39087-922a-489c-8bd8-aa6cd503d786\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 15 18:18:35.212072 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:18:35.211942    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/bbd39087-922a-489c-8bd8-aa6cd503d786-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"bbd39087-922a-489c-8bd8-aa6cd503d786\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 15 18:18:35.212072 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:18:35.211971    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/bbd39087-922a-489c-8bd8-aa6cd503d786-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"bbd39087-922a-489c-8bd8-aa6cd503d786\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 15 18:18:35.212072 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:18:35.212001    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/bbd39087-922a-489c-8bd8-aa6cd503d786-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"bbd39087-922a-489c-8bd8-aa6cd503d786\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 15 18:18:35.212072 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:18:35.212029    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/bbd39087-922a-489c-8bd8-aa6cd503d786-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"bbd39087-922a-489c-8bd8-aa6cd503d786\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 15 18:18:35.212072 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:18:35.212056    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/bbd39087-922a-489c-8bd8-aa6cd503d786-config\") pod \"prometheus-k8s-0\" (UID: \"bbd39087-922a-489c-8bd8-aa6cd503d786\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 15 18:18:35.212390 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:18:35.212089    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/bbd39087-922a-489c-8bd8-aa6cd503d786-config-out\") pod \"prometheus-k8s-0\" (UID: \"bbd39087-922a-489c-8bd8-aa6cd503d786\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 15 18:18:35.212390 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:18:35.212113    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8q894\" (UniqueName: \"kubernetes.io/projected/bbd39087-922a-489c-8bd8-aa6cd503d786-kube-api-access-8q894\") pod \"prometheus-k8s-0\" (UID: \"bbd39087-922a-489c-8bd8-aa6cd503d786\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 15 18:18:35.212390 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:18:35.212147    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/bbd39087-922a-489c-8bd8-aa6cd503d786-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"bbd39087-922a-489c-8bd8-aa6cd503d786\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 15 18:18:35.212390 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:18:35.212174    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/bbd39087-922a-489c-8bd8-aa6cd503d786-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"bbd39087-922a-489c-8bd8-aa6cd503d786\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 15 18:18:35.212390 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:18:35.212204    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/bbd39087-922a-489c-8bd8-aa6cd503d786-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"bbd39087-922a-489c-8bd8-aa6cd503d786\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 15 18:18:35.212390 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:18:35.212252    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/bbd39087-922a-489c-8bd8-aa6cd503d786-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"bbd39087-922a-489c-8bd8-aa6cd503d786\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 15 18:18:35.212390 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:18:35.212295    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/bbd39087-922a-489c-8bd8-aa6cd503d786-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"bbd39087-922a-489c-8bd8-aa6cd503d786\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 15 18:18:35.212390 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:18:35.212367    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/bbd39087-922a-489c-8bd8-aa6cd503d786-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"bbd39087-922a-489c-8bd8-aa6cd503d786\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 15 18:18:35.212390 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:18:35.212392    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/bbd39087-922a-489c-8bd8-aa6cd503d786-web-config\") pod \"prometheus-k8s-0\" (UID: \"bbd39087-922a-489c-8bd8-aa6cd503d786\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 15 18:18:35.212822 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:18:35.212522    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/bbd39087-922a-489c-8bd8-aa6cd503d786-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"bbd39087-922a-489c-8bd8-aa6cd503d786\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 15 18:18:35.212822 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:18:35.212564    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/bbd39087-922a-489c-8bd8-aa6cd503d786-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"bbd39087-922a-489c-8bd8-aa6cd503d786\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 15 18:18:35.212822 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:18:35.212613    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/bbd39087-922a-489c-8bd8-aa6cd503d786-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"bbd39087-922a-489c-8bd8-aa6cd503d786\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 15 18:18:35.212822 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:18:35.212640    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/bbd39087-922a-489c-8bd8-aa6cd503d786-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"bbd39087-922a-489c-8bd8-aa6cd503d786\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 15 18:18:35.315262 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:18:35.314075    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/bbd39087-922a-489c-8bd8-aa6cd503d786-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"bbd39087-922a-489c-8bd8-aa6cd503d786\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 15 18:18:35.315262 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:18:35.314145    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/bbd39087-922a-489c-8bd8-aa6cd503d786-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"bbd39087-922a-489c-8bd8-aa6cd503d786\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 15 18:18:35.315262 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:18:35.314179    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/bbd39087-922a-489c-8bd8-aa6cd503d786-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"bbd39087-922a-489c-8bd8-aa6cd503d786\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 15 18:18:35.315262 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:18:35.314212    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/bbd39087-922a-489c-8bd8-aa6cd503d786-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"bbd39087-922a-489c-8bd8-aa6cd503d786\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 15 18:18:35.315262 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:18:35.314259    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/bbd39087-922a-489c-8bd8-aa6cd503d786-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"bbd39087-922a-489c-8bd8-aa6cd503d786\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 15 18:18:35.315262 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:18:35.314288    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/bbd39087-922a-489c-8bd8-aa6cd503d786-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"bbd39087-922a-489c-8bd8-aa6cd503d786\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 15 18:18:35.315262 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:18:35.314317    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/bbd39087-922a-489c-8bd8-aa6cd503d786-config\") pod \"prometheus-k8s-0\" (UID: \"bbd39087-922a-489c-8bd8-aa6cd503d786\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 15 18:18:35.315262 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:18:35.314348    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/bbd39087-922a-489c-8bd8-aa6cd503d786-config-out\") pod \"prometheus-k8s-0\" (UID: \"bbd39087-922a-489c-8bd8-aa6cd503d786\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 15 18:18:35.315262 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:18:35.314369    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8q894\" (UniqueName: \"kubernetes.io/projected/bbd39087-922a-489c-8bd8-aa6cd503d786-kube-api-access-8q894\") pod \"prometheus-k8s-0\" (UID: \"bbd39087-922a-489c-8bd8-aa6cd503d786\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 15 18:18:35.315262 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:18:35.314394    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/bbd39087-922a-489c-8bd8-aa6cd503d786-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"bbd39087-922a-489c-8bd8-aa6cd503d786\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 15 18:18:35.315262 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:18:35.314419    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/bbd39087-922a-489c-8bd8-aa6cd503d786-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"bbd39087-922a-489c-8bd8-aa6cd503d786\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 15 18:18:35.315262 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:18:35.314451    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/bbd39087-922a-489c-8bd8-aa6cd503d786-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"bbd39087-922a-489c-8bd8-aa6cd503d786\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 15 18:18:35.315262 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:18:35.314473    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/bbd39087-922a-489c-8bd8-aa6cd503d786-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"bbd39087-922a-489c-8bd8-aa6cd503d786\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 15 18:18:35.315262 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:18:35.314515    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/bbd39087-922a-489c-8bd8-aa6cd503d786-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"bbd39087-922a-489c-8bd8-aa6cd503d786\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 15 18:18:35.315262 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:18:35.314554    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/bbd39087-922a-489c-8bd8-aa6cd503d786-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"bbd39087-922a-489c-8bd8-aa6cd503d786\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 15 18:18:35.315262 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:18:35.314577    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/bbd39087-922a-489c-8bd8-aa6cd503d786-web-config\") pod \"prometheus-k8s-0\" (UID: \"bbd39087-922a-489c-8bd8-aa6cd503d786\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 15 18:18:35.315262 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:18:35.314616    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/bbd39087-922a-489c-8bd8-aa6cd503d786-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"bbd39087-922a-489c-8bd8-aa6cd503d786\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 15 18:18:35.316200 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:18:35.314641    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/bbd39087-922a-489c-8bd8-aa6cd503d786-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"bbd39087-922a-489c-8bd8-aa6cd503d786\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 15 18:18:35.316200 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:18:35.314697    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/bbd39087-922a-489c-8bd8-aa6cd503d786-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"bbd39087-922a-489c-8bd8-aa6cd503d786\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 15 18:18:35.316200 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:18:35.314721    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/bbd39087-922a-489c-8bd8-aa6cd503d786-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"bbd39087-922a-489c-8bd8-aa6cd503d786\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 15 18:18:35.316200 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:18:35.315083    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/bbd39087-922a-489c-8bd8-aa6cd503d786-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"bbd39087-922a-489c-8bd8-aa6cd503d786\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 15 18:18:35.316423 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:18:35.316340    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/bbd39087-922a-489c-8bd8-aa6cd503d786-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"bbd39087-922a-489c-8bd8-aa6cd503d786\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 15 18:18:35.317495 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:18:35.316653    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/bbd39087-922a-489c-8bd8-aa6cd503d786-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"bbd39087-922a-489c-8bd8-aa6cd503d786\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 15 18:18:35.317495 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:18:35.317164    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/bbd39087-922a-489c-8bd8-aa6cd503d786-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"bbd39087-922a-489c-8bd8-aa6cd503d786\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 15 18:18:35.321461 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:18:35.320663    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/bbd39087-922a-489c-8bd8-aa6cd503d786-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"bbd39087-922a-489c-8bd8-aa6cd503d786\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 15 18:18:35.321461 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:18:35.320861    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/bbd39087-922a-489c-8bd8-aa6cd503d786-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"bbd39087-922a-489c-8bd8-aa6cd503d786\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 15 18:18:35.321461 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:18:35.321144    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/bbd39087-922a-489c-8bd8-aa6cd503d786-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"bbd39087-922a-489c-8bd8-aa6cd503d786\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 15 18:18:35.323837 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:18:35.323221    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/bbd39087-922a-489c-8bd8-aa6cd503d786-config-out\") pod \"prometheus-k8s-0\" (UID: \"bbd39087-922a-489c-8bd8-aa6cd503d786\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 15 18:18:35.323837 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:18:35.323521    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/bbd39087-922a-489c-8bd8-aa6cd503d786-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"bbd39087-922a-489c-8bd8-aa6cd503d786\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 15 18:18:35.325566 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:18:35.325260    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/bbd39087-922a-489c-8bd8-aa6cd503d786-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"bbd39087-922a-489c-8bd8-aa6cd503d786\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 15 18:18:35.326932 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:18:35.326851    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/bbd39087-922a-489c-8bd8-aa6cd503d786-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"bbd39087-922a-489c-8bd8-aa6cd503d786\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 15 18:18:35.326932 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:18:35.326889    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/bbd39087-922a-489c-8bd8-aa6cd503d786-web-config\") pod \"prometheus-k8s-0\" (UID: \"bbd39087-922a-489c-8bd8-aa6cd503d786\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 15 18:18:35.328300 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:18:35.328259    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/bbd39087-922a-489c-8bd8-aa6cd503d786-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"bbd39087-922a-489c-8bd8-aa6cd503d786\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 15 18:18:35.330961 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:18:35.330881    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/bbd39087-922a-489c-8bd8-aa6cd503d786-config\") pod \"prometheus-k8s-0\" (UID: \"bbd39087-922a-489c-8bd8-aa6cd503d786\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 15 18:18:35.332776 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:18:35.332737    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/bbd39087-922a-489c-8bd8-aa6cd503d786-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"bbd39087-922a-489c-8bd8-aa6cd503d786\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 15 18:18:35.334898 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:18:35.334863    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/bbd39087-922a-489c-8bd8-aa6cd503d786-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"bbd39087-922a-489c-8bd8-aa6cd503d786\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 15 18:18:35.335336 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:18:35.335312    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/bbd39087-922a-489c-8bd8-aa6cd503d786-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"bbd39087-922a-489c-8bd8-aa6cd503d786\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 15 18:18:35.335936 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:18:35.335894    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/bbd39087-922a-489c-8bd8-aa6cd503d786-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"bbd39087-922a-489c-8bd8-aa6cd503d786\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 15 18:18:35.336816 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:18:35.336778    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/bbd39087-922a-489c-8bd8-aa6cd503d786-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"bbd39087-922a-489c-8bd8-aa6cd503d786\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 15 18:18:35.339335 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:18:35.339290    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8q894\" (UniqueName: \"kubernetes.io/projected/bbd39087-922a-489c-8bd8-aa6cd503d786-kube-api-access-8q894\") pod \"prometheus-k8s-0\" (UID: \"bbd39087-922a-489c-8bd8-aa6cd503d786\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 15 18:18:35.460546 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:18:35.460248    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Jul 15 18:18:35.593995 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:18:35.593281    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7f768f64d6-qkw2d" event={"ID":"3eb0e193-d9a7-4f35-8da0-590eaa374d1a","Type":"ContainerStarted","Data":"931769c405484be8e706701125a89264fdc040b95946c1926a940b3fec818cb5"}
Jul 15 18:18:35.601252 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:18:35.600684    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-zhfjg" event={"ID":"77a85f70-62db-476e-8397-ee0759a55745","Type":"ContainerStarted","Data":"abfdbf7ffbe3a072ee682dcfe340f03e2867192552a07344758d2dccffb843ec"}
Jul 15 18:18:35.601252 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:18:35.600738    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-zhfjg" event={"ID":"77a85f70-62db-476e-8397-ee0759a55745","Type":"ContainerStarted","Data":"014c70d99effb3c16114316e385a3bbdf9280403116a2683b52fcb0974902214"}
Jul 15 18:18:35.613919 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:18:35.612185    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-7f768f64d6-qkw2d" podStartSLOduration=2.612161791 podStartE2EDuration="2.612161791s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 18:18:33 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 18:18:35.609747636 +0000 UTC m=+74.144170994" watchObservedRunningTime="2026-07-15 18:18:35.612161791 +0000 UTC m=+74.146585150"
Jul 15 18:18:35.629841 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:18:35.628414    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-zhfjg" podStartSLOduration=3.33591981 podStartE2EDuration="7.628390183s" totalImagesPullingTime="4.194124502s" totalInitContainerRuntime="98.345871ms" isStatefulPod=true podCreationTimestamp="2026-07-15 18:18:28 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 18:18:35.627263972 +0000 UTC m=+74.161687353" watchObservedRunningTime="2026-07-15 18:18:35.628390183 +0000 UTC m=+74.162813541"
Jul 15 18:18:35.666004 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:18:35.665911    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 15 18:18:35.672284 ip-10-0-141-171 kubenswrapper[2567]: W0715 18:18:35.672256    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbbd39087_922a_489c_8bd8_aa6cd503d786.slice/crio-1cae0b5028d63a4aaeb6227f997fe7f6c43ede84fe8005a8992f40592110f6c3 WatchSource:0}: Error finding container 1cae0b5028d63a4aaeb6227f997fe7f6c43ede84fe8005a8992f40592110f6c3: Status 404 returned error can't find the container with id 1cae0b5028d63a4aaeb6227f997fe7f6c43ede84fe8005a8992f40592110f6c3
Jul 15 18:18:36.605128 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:18:36.605096    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"bbd39087-922a-489c-8bd8-aa6cd503d786","Type":"ContainerStarted","Data":"1cae0b5028d63a4aaeb6227f997fe7f6c43ede84fe8005a8992f40592110f6c3"}
Jul 15 18:18:37.615762 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:18:37.615729    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-5f68df7f58-8wt6r" event={"ID":"fe6de8a4-feae-4c63-92e9-882042af5ece","Type":"ContainerStarted","Data":"589a94764d597867ff43ac1e0d44b7b5eaee13c76947fe6ab85fa3bcecc676ea"}
Jul 15 18:18:37.617896 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:18:37.617877    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/monitoring-plugin-5f68df7f58-8wt6r"
Jul 15 18:18:37.618034 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:18:37.618017    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-5d5c95d576-cgbcs" event={"ID":"0b3aa63d-db37-403b-b6ce-0786a746f07a","Type":"ContainerStarted","Data":"b88030b6bb74b67d1b30b77f27003e6260e2414cb1651a27f4de559aa1508b7a"}
Jul 15 18:18:37.620764 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:18:37.620135    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-6f66584585-8nvch" event={"ID":"58b027cc-0443-48c9-813b-7fbbd36a68c0","Type":"ContainerStarted","Data":"22adf6928c8d98bc38b40f92f54d571d60d304c1c75ab89aebfc12c722634bfb"}
Jul 15 18:18:37.622410 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:18:37.622391    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/monitoring-plugin-5f68df7f58-8wt6r"
Jul 15 18:18:37.623222 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:18:37.623190    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"bbd39087-922a-489c-8bd8-aa6cd503d786","Type":"ContainerStarted","Data":"4615d2739b7ecaa2a09fceb4e7084c3d75643cd1f2a228046018e103a7aee22f"}
Jul 15 18:18:37.625478 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:18:37.625446    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"0a3d2b71-dc31-4a25-ad7f-89bf188082f4","Type":"ContainerStarted","Data":"79b38b69b0dc829c875ad7695710e4be7c4a2ef4a4e7c6683c5412ed40f751f8"}
Jul 15 18:18:37.635487 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:18:37.635444    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/monitoring-plugin-5f68df7f58-8wt6r" podStartSLOduration=1.727696415 podStartE2EDuration="4.635428653s" totalImagesPullingTime="2.907732238s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 18:18:33 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 18:18:37.634530079 +0000 UTC m=+76.168953432" watchObservedRunningTime="2026-07-15 18:18:37.635428653 +0000 UTC m=+76.169851987"
Jul 15 18:18:37.689125 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:18:37.689030    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/metrics-server-5d5c95d576-cgbcs" podStartSLOduration=1.78767766 podStartE2EDuration="4.689011009s" totalImagesPullingTime="2.901333349s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 18:18:33 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 18:18:37.688350117 +0000 UTC m=+76.222773472" watchObservedRunningTime="2026-07-15 18:18:37.689011009 +0000 UTC m=+76.223434366"
Jul 15 18:18:38.631994 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:18:38.631964    2567 generic.go:356] "Generic (PLEG): container finished" podID="bbd39087-922a-489c-8bd8-aa6cd503d786" containerID="4615d2739b7ecaa2a09fceb4e7084c3d75643cd1f2a228046018e103a7aee22f" exitCode=0
Jul 15 18:18:38.632428 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:18:38.632051    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"bbd39087-922a-489c-8bd8-aa6cd503d786","Type":"ContainerDied","Data":"4615d2739b7ecaa2a09fceb4e7084c3d75643cd1f2a228046018e103a7aee22f"}
Jul 15 18:18:38.633776 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:18:38.633736    2567 generic.go:356] "Generic (PLEG): container finished" podID="0a3d2b71-dc31-4a25-ad7f-89bf188082f4" containerID="79b38b69b0dc829c875ad7695710e4be7c4a2ef4a4e7c6683c5412ed40f751f8" exitCode=0
Jul 15 18:18:38.633905 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:18:38.633771    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"0a3d2b71-dc31-4a25-ad7f-89bf188082f4","Type":"ContainerDied","Data":"79b38b69b0dc829c875ad7695710e4be7c4a2ef4a4e7c6683c5412ed40f751f8"}
Jul 15 18:18:38.636658 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:18:38.636547    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-6f66584585-8nvch" event={"ID":"58b027cc-0443-48c9-813b-7fbbd36a68c0","Type":"ContainerStarted","Data":"a671d82ec63bd28d6da272f4f0a815ff791b4d820545f8c9ec3e1042c5736a97"}
Jul 15 18:18:38.636658 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:18:38.636621    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-6f66584585-8nvch" event={"ID":"58b027cc-0443-48c9-813b-7fbbd36a68c0","Type":"ContainerStarted","Data":"e7bbe078284513870f089d638f75b59ce92ae955ae1ea0bccdc2035cad53e20c"}
Jul 15 18:18:39.645186 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:18:39.645147    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-6f66584585-8nvch" event={"ID":"58b027cc-0443-48c9-813b-7fbbd36a68c0","Type":"ContainerStarted","Data":"b71c7a913203049781533a12dc9e360e8ed144c9d3f051d5f7686508e73ac381"}
Jul 15 18:18:39.645678 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:18:39.645251    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-6f66584585-8nvch" event={"ID":"58b027cc-0443-48c9-813b-7fbbd36a68c0","Type":"ContainerStarted","Data":"907b30fde4030436a2ff43864e0cc7984e503d895d8f0a396d1e614ed4d3150d"}
Jul 15 18:18:39.645678 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:18:39.645300    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-6f66584585-8nvch" event={"ID":"58b027cc-0443-48c9-813b-7fbbd36a68c0","Type":"ContainerStarted","Data":"9aef7212808cf42b570f45f49d7dfa91adb40b0c2836a546882b10598cd974f9"}
Jul 15 18:18:39.672642 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:18:39.672576    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/thanos-querier-6f66584585-8nvch" podStartSLOduration=4.793787042 podStartE2EDuration="8.672555109s" totalImagesPullingTime="3.878768067s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 18:18:31 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 18:18:39.670561192 +0000 UTC m=+78.204984568" watchObservedRunningTime="2026-07-15 18:18:39.672555109 +0000 UTC m=+78.206978466"
Jul 15 18:18:40.651186 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:18:40.651055    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/thanos-querier-6f66584585-8nvch"
Jul 15 18:18:40.790993 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:18:40.790969    2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-7f768f64d6-qkw2d"]
Jul 15 18:18:40.821860 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:18:40.821206    2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-78f5b5fd94-rw8lz"]
Jul 15 18:18:40.826476 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:18:40.826457    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-78f5b5fd94-rw8lz"
Jul 15 18:18:40.833672 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:18:40.833640    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-78f5b5fd94-rw8lz"]
Jul 15 18:18:40.977963 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:18:40.977929    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/a382b616-05c2-4ca7-9d99-5e8ea16c0056-console-config\") pod \"console-78f5b5fd94-rw8lz\" (UID: \"a382b616-05c2-4ca7-9d99-5e8ea16c0056\") " pod="openshift-console/console-78f5b5fd94-rw8lz"
Jul 15 18:18:40.978078 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:18:40.977995    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/a382b616-05c2-4ca7-9d99-5e8ea16c0056-service-ca\") pod \"console-78f5b5fd94-rw8lz\" (UID: \"a382b616-05c2-4ca7-9d99-5e8ea16c0056\") " pod="openshift-console/console-78f5b5fd94-rw8lz"
Jul 15 18:18:40.978078 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:18:40.978028    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a382b616-05c2-4ca7-9d99-5e8ea16c0056-trusted-ca-bundle\") pod \"console-78f5b5fd94-rw8lz\" (UID: \"a382b616-05c2-4ca7-9d99-5e8ea16c0056\") " pod="openshift-console/console-78f5b5fd94-rw8lz"
Jul 15 18:18:40.978268 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:18:40.978076    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/a382b616-05c2-4ca7-9d99-5e8ea16c0056-oauth-serving-cert\") pod \"console-78f5b5fd94-rw8lz\" (UID: \"a382b616-05c2-4ca7-9d99-5e8ea16c0056\") " pod="openshift-console/console-78f5b5fd94-rw8lz"
Jul 15 18:18:40.978332 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:18:40.978265    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-h5qbr\" (UniqueName: \"kubernetes.io/projected/a382b616-05c2-4ca7-9d99-5e8ea16c0056-kube-api-access-h5qbr\") pod \"console-78f5b5fd94-rw8lz\" (UID: \"a382b616-05c2-4ca7-9d99-5e8ea16c0056\") " pod="openshift-console/console-78f5b5fd94-rw8lz"
Jul 15 18:18:40.978332 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:18:40.978295    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/a382b616-05c2-4ca7-9d99-5e8ea16c0056-console-oauth-config\") pod \"console-78f5b5fd94-rw8lz\" (UID: \"a382b616-05c2-4ca7-9d99-5e8ea16c0056\") " pod="openshift-console/console-78f5b5fd94-rw8lz"
Jul 15 18:18:40.978332 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:18:40.978325    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/a382b616-05c2-4ca7-9d99-5e8ea16c0056-console-serving-cert\") pod \"console-78f5b5fd94-rw8lz\" (UID: \"a382b616-05c2-4ca7-9d99-5e8ea16c0056\") " pod="openshift-console/console-78f5b5fd94-rw8lz"
Jul 15 18:18:41.079649 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:18:41.079562    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a382b616-05c2-4ca7-9d99-5e8ea16c0056-trusted-ca-bundle\") pod \"console-78f5b5fd94-rw8lz\" (UID: \"a382b616-05c2-4ca7-9d99-5e8ea16c0056\") " pod="openshift-console/console-78f5b5fd94-rw8lz"
Jul 15 18:18:41.079649 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:18:41.079605    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/a382b616-05c2-4ca7-9d99-5e8ea16c0056-oauth-serving-cert\") pod \"console-78f5b5fd94-rw8lz\" (UID: \"a382b616-05c2-4ca7-9d99-5e8ea16c0056\") " pod="openshift-console/console-78f5b5fd94-rw8lz"
Jul 15 18:18:41.079847 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:18:41.079693    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-h5qbr\" (UniqueName: \"kubernetes.io/projected/a382b616-05c2-4ca7-9d99-5e8ea16c0056-kube-api-access-h5qbr\") pod \"console-78f5b5fd94-rw8lz\" (UID: \"a382b616-05c2-4ca7-9d99-5e8ea16c0056\") " pod="openshift-console/console-78f5b5fd94-rw8lz"
Jul 15 18:18:41.079847 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:18:41.079724    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/a382b616-05c2-4ca7-9d99-5e8ea16c0056-console-oauth-config\") pod \"console-78f5b5fd94-rw8lz\" (UID: \"a382b616-05c2-4ca7-9d99-5e8ea16c0056\") " pod="openshift-console/console-78f5b5fd94-rw8lz"
Jul 15 18:18:41.079847 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:18:41.079761    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/a382b616-05c2-4ca7-9d99-5e8ea16c0056-console-serving-cert\") pod \"console-78f5b5fd94-rw8lz\" (UID: \"a382b616-05c2-4ca7-9d99-5e8ea16c0056\") " pod="openshift-console/console-78f5b5fd94-rw8lz"
Jul 15 18:18:41.080137 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:18:41.080106    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/a382b616-05c2-4ca7-9d99-5e8ea16c0056-console-config\") pod \"console-78f5b5fd94-rw8lz\" (UID: \"a382b616-05c2-4ca7-9d99-5e8ea16c0056\") " pod="openshift-console/console-78f5b5fd94-rw8lz"
Jul 15 18:18:41.080278 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:18:41.080164    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/a382b616-05c2-4ca7-9d99-5e8ea16c0056-service-ca\") pod \"console-78f5b5fd94-rw8lz\" (UID: \"a382b616-05c2-4ca7-9d99-5e8ea16c0056\") " pod="openshift-console/console-78f5b5fd94-rw8lz"
Jul 15 18:18:41.080480 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:18:41.080418    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/a382b616-05c2-4ca7-9d99-5e8ea16c0056-oauth-serving-cert\") pod \"console-78f5b5fd94-rw8lz\" (UID: \"a382b616-05c2-4ca7-9d99-5e8ea16c0056\") " pod="openshift-console/console-78f5b5fd94-rw8lz"
Jul 15 18:18:41.080596 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:18:41.080553    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a382b616-05c2-4ca7-9d99-5e8ea16c0056-trusted-ca-bundle\") pod \"console-78f5b5fd94-rw8lz\" (UID: \"a382b616-05c2-4ca7-9d99-5e8ea16c0056\") " pod="openshift-console/console-78f5b5fd94-rw8lz"
Jul 15 18:18:41.081033 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:18:41.080797    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/a382b616-05c2-4ca7-9d99-5e8ea16c0056-console-config\") pod \"console-78f5b5fd94-rw8lz\" (UID: \"a382b616-05c2-4ca7-9d99-5e8ea16c0056\") " pod="openshift-console/console-78f5b5fd94-rw8lz"
Jul 15 18:18:41.081033 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:18:41.080916    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/a382b616-05c2-4ca7-9d99-5e8ea16c0056-service-ca\") pod \"console-78f5b5fd94-rw8lz\" (UID: \"a382b616-05c2-4ca7-9d99-5e8ea16c0056\") " pod="openshift-console/console-78f5b5fd94-rw8lz"
Jul 15 18:18:41.082405 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:18:41.082371    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/a382b616-05c2-4ca7-9d99-5e8ea16c0056-console-oauth-config\") pod \"console-78f5b5fd94-rw8lz\" (UID: \"a382b616-05c2-4ca7-9d99-5e8ea16c0056\") " pod="openshift-console/console-78f5b5fd94-rw8lz"
Jul 15 18:18:41.082520 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:18:41.082499    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/a382b616-05c2-4ca7-9d99-5e8ea16c0056-console-serving-cert\") pod \"console-78f5b5fd94-rw8lz\" (UID: \"a382b616-05c2-4ca7-9d99-5e8ea16c0056\") " pod="openshift-console/console-78f5b5fd94-rw8lz"
Jul 15 18:18:41.087445 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:18:41.087414    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-h5qbr\" (UniqueName: \"kubernetes.io/projected/a382b616-05c2-4ca7-9d99-5e8ea16c0056-kube-api-access-h5qbr\") pod \"console-78f5b5fd94-rw8lz\" (UID: \"a382b616-05c2-4ca7-9d99-5e8ea16c0056\") " pod="openshift-console/console-78f5b5fd94-rw8lz"
Jul 15 18:18:41.165291 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:18:41.165250    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-78f5b5fd94-rw8lz"
Jul 15 18:18:41.659783 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:18:41.659744    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"0a3d2b71-dc31-4a25-ad7f-89bf188082f4","Type":"ContainerStarted","Data":"c6f5b4a55545a507d3ba95b81b1f9f7d3cc7837b5a0bae3c31d33c36fd7f4194"}
Jul 15 18:18:41.660277 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:18:41.659818    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"0a3d2b71-dc31-4a25-ad7f-89bf188082f4","Type":"ContainerStarted","Data":"b76af200ecd609c6466148750bdfbac8d28a981c931859ccc0ab660f5a488086"}
Jul 15 18:18:41.660277 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:18:41.659861    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"0a3d2b71-dc31-4a25-ad7f-89bf188082f4","Type":"ContainerStarted","Data":"1c2db477d14033a9b128af104ccc1c2460ce65ea50b32b6ebedeffdb3344950a"}
Jul 15 18:18:41.660277 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:18:41.659889    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"0a3d2b71-dc31-4a25-ad7f-89bf188082f4","Type":"ContainerStarted","Data":"e9af8666069dde83ad8a069c5b62aadc3c340ac8b482f5ec991bdab598d2038c"}
Jul 15 18:18:41.660277 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:18:41.659914    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"0a3d2b71-dc31-4a25-ad7f-89bf188082f4","Type":"ContainerStarted","Data":"6081a1a0475a58178cc19fc6a914e3037ee80d472bbb8f9d2886388a4036f9cb"}
Jul 15 18:18:41.660277 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:18:41.659954    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"0a3d2b71-dc31-4a25-ad7f-89bf188082f4","Type":"ContainerStarted","Data":"304bf41fe1d7fab51436016eac00ac14a163c6132efc4fa82f5535d5b7cc70d2"}
Jul 15 18:18:41.688169 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:18:41.688121    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=7.596429146 podStartE2EDuration="12.688105474s" totalImagesPullingTime="5.057478377s" totalInitContainerRuntime="34.197951ms" isStatefulPod=false podCreationTimestamp="2026-07-15 18:18:29 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 18:18:41.687191013 +0000 UTC m=+80.221614370" watchObservedRunningTime="2026-07-15 18:18:41.688105474 +0000 UTC m=+80.222528829"
Jul 15 18:18:42.305974 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:18:42.305949    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-78f5b5fd94-rw8lz"]
Jul 15 18:18:42.307754 ip-10-0-141-171 kubenswrapper[2567]: W0715 18:18:42.307728    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda382b616_05c2_4ca7_9d99_5e8ea16c0056.slice/crio-de6072e71fe7f530d2b2706b98393105c0238446671da5340d456457e78fe3b4 WatchSource:0}: Error finding container de6072e71fe7f530d2b2706b98393105c0238446671da5340d456457e78fe3b4: Status 404 returned error can't find the container with id de6072e71fe7f530d2b2706b98393105c0238446671da5340d456457e78fe3b4
Jul 15 18:18:42.665937 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:18:42.665905    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-78f5b5fd94-rw8lz" event={"ID":"a382b616-05c2-4ca7-9d99-5e8ea16c0056","Type":"ContainerStarted","Data":"b371e0d7ddb60359222b57033acf02a30e196388a217e6a9a48efcde649196fd"}
Jul 15 18:18:42.666275 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:18:42.665968    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-78f5b5fd94-rw8lz" event={"ID":"a382b616-05c2-4ca7-9d99-5e8ea16c0056","Type":"ContainerStarted","Data":"de6072e71fe7f530d2b2706b98393105c0238446671da5340d456457e78fe3b4"}
Jul 15 18:18:42.669498 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:18:42.669464    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"bbd39087-922a-489c-8bd8-aa6cd503d786","Type":"ContainerStarted","Data":"b4f67ece270287ba49b7726e3c383e5c2711859457a025db5fff46c4efe2da64"}
Jul 15 18:18:42.669602 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:18:42.669522    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"bbd39087-922a-489c-8bd8-aa6cd503d786","Type":"ContainerStarted","Data":"c6bcb27e694704907e79a31e40965ff68c6ed0a6174a5f1744652e9461076353"}
Jul 15 18:18:42.669602 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:18:42.669551    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"bbd39087-922a-489c-8bd8-aa6cd503d786","Type":"ContainerStarted","Data":"23b80880c717b95516fcda3b31e32d5460b407033b79062d1d5653da64018cdb"}
Jul 15 18:18:42.669602 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:18:42.669578    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"bbd39087-922a-489c-8bd8-aa6cd503d786","Type":"ContainerStarted","Data":"0073d6ba731fb276842b9781e062677ad4ac65932e10516816a77c812688283b"}
Jul 15 18:18:42.669602 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:18:42.669601    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"bbd39087-922a-489c-8bd8-aa6cd503d786","Type":"ContainerStarted","Data":"32e2db4b227401943ae2cba3a0bcc6ab58c5d63c89997b7f9943b77a023d4869"}
Jul 15 18:18:42.683607 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:18:42.683540    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-78f5b5fd94-rw8lz" podStartSLOduration=2.683524538 podStartE2EDuration="2.683524538s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 18:18:40 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 18:18:42.682191645 +0000 UTC m=+81.216615032" watchObservedRunningTime="2026-07-15 18:18:42.683524538 +0000 UTC m=+81.217947967"
Jul 15 18:18:43.677763 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:18:43.677723    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"bbd39087-922a-489c-8bd8-aa6cd503d786","Type":"ContainerStarted","Data":"908095cd71e9b4ed312539b5827dc9aedf72c31cc001e20ee23f4ac81753c105"}
Jul 15 18:18:43.713729 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:18:43.713681    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=3.2830501229999998 podStartE2EDuration="8.71366693s" totalImagesPullingTime="5.398188445s" totalInitContainerRuntime="32.428362ms" isStatefulPod=false podCreationTimestamp="2026-07-15 18:18:35 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 18:18:43.71088251 +0000 UTC m=+82.245305866" watchObservedRunningTime="2026-07-15 18:18:43.71366693 +0000 UTC m=+82.248090287"
Jul 15 18:18:43.989384 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:18:43.989302    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-7f768f64d6-qkw2d"
Jul 15 18:18:45.461245 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:18:45.461202    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0"
Jul 15 18:18:46.665649 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:18:46.665625    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/thanos-querier-6f66584585-8nvch"
Jul 15 18:18:51.165384 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:18:51.165346    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-78f5b5fd94-rw8lz"
Jul 15 18:18:51.165907 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:18:51.165636    2567 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-78f5b5fd94-rw8lz"
Jul 15 18:18:51.170307 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:18:51.170286    2567 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-78f5b5fd94-rw8lz"
Jul 15 18:18:51.719376 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:18:51.719349    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-78f5b5fd94-rw8lz"
Jul 15 18:18:51.765459 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:18:51.765425    2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-6c775749fc-6wksh"]
Jul 15 18:18:53.707166 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:18:53.707132    2567 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/metrics-server-5d5c95d576-cgbcs"
Jul 15 18:18:53.707560 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:18:53.707244    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/metrics-server-5d5c95d576-cgbcs"
Jul 15 18:18:55.631998 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:18:55.631960    2567 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-9b6fc9785-k9w2d" podUID="9c030f72-5d14-4fa9-89a4-ae7a58a23af7" containerName="console" containerID="cri-o://a90e0580815344d8fc5a7b3f031a304026316b13019b0a4b587960da32c0c56a" gracePeriod=15
Jul 15 18:18:56.407615 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:18:56.407586    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-9b6fc9785-k9w2d"
Jul 15 18:18:56.419979 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:18:56.419954    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/9c030f72-5d14-4fa9-89a4-ae7a58a23af7-console-oauth-config\") pod \"9c030f72-5d14-4fa9-89a4-ae7a58a23af7\" (UID: \"9c030f72-5d14-4fa9-89a4-ae7a58a23af7\") "
Jul 15 18:18:56.420107 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:18:56.419992    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/9c030f72-5d14-4fa9-89a4-ae7a58a23af7-oauth-serving-cert\") pod \"9c030f72-5d14-4fa9-89a4-ae7a58a23af7\" (UID: \"9c030f72-5d14-4fa9-89a4-ae7a58a23af7\") "
Jul 15 18:18:56.420107 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:18:56.420043    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/9c030f72-5d14-4fa9-89a4-ae7a58a23af7-service-ca\") pod \"9c030f72-5d14-4fa9-89a4-ae7a58a23af7\" (UID: \"9c030f72-5d14-4fa9-89a4-ae7a58a23af7\") "
Jul 15 18:18:56.420107 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:18:56.420083    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/9c030f72-5d14-4fa9-89a4-ae7a58a23af7-console-config\") pod \"9c030f72-5d14-4fa9-89a4-ae7a58a23af7\" (UID: \"9c030f72-5d14-4fa9-89a4-ae7a58a23af7\") "
Jul 15 18:18:56.420277 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:18:56.420127    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-px8rr\" (UniqueName: \"kubernetes.io/projected/9c030f72-5d14-4fa9-89a4-ae7a58a23af7-kube-api-access-px8rr\") pod \"9c030f72-5d14-4fa9-89a4-ae7a58a23af7\" (UID: \"9c030f72-5d14-4fa9-89a4-ae7a58a23af7\") "
Jul 15 18:18:56.420277 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:18:56.420219    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/9c030f72-5d14-4fa9-89a4-ae7a58a23af7-console-serving-cert\") pod \"9c030f72-5d14-4fa9-89a4-ae7a58a23af7\" (UID: \"9c030f72-5d14-4fa9-89a4-ae7a58a23af7\") "
Jul 15 18:18:56.420424 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:18:56.420399    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9c030f72-5d14-4fa9-89a4-ae7a58a23af7-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "9c030f72-5d14-4fa9-89a4-ae7a58a23af7" (UID: "9c030f72-5d14-4fa9-89a4-ae7a58a23af7"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 15 18:18:56.420480 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:18:56.420420    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9c030f72-5d14-4fa9-89a4-ae7a58a23af7-service-ca" (OuterVolumeSpecName: "service-ca") pod "9c030f72-5d14-4fa9-89a4-ae7a58a23af7" (UID: "9c030f72-5d14-4fa9-89a4-ae7a58a23af7"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 15 18:18:56.420480 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:18:56.420462    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9c030f72-5d14-4fa9-89a4-ae7a58a23af7-console-config" (OuterVolumeSpecName: "console-config") pod "9c030f72-5d14-4fa9-89a4-ae7a58a23af7" (UID: "9c030f72-5d14-4fa9-89a4-ae7a58a23af7"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 15 18:18:56.420577 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:18:56.420530    2567 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/9c030f72-5d14-4fa9-89a4-ae7a58a23af7-console-config\") on node \"ip-10-0-141-171.ec2.internal\" DevicePath \"\""
Jul 15 18:18:56.420577 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:18:56.420549    2567 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/9c030f72-5d14-4fa9-89a4-ae7a58a23af7-oauth-serving-cert\") on node \"ip-10-0-141-171.ec2.internal\" DevicePath \"\""
Jul 15 18:18:56.420577 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:18:56.420565    2567 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/9c030f72-5d14-4fa9-89a4-ae7a58a23af7-service-ca\") on node \"ip-10-0-141-171.ec2.internal\" DevicePath \"\""
Jul 15 18:18:56.422453 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:18:56.422389    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9c030f72-5d14-4fa9-89a4-ae7a58a23af7-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "9c030f72-5d14-4fa9-89a4-ae7a58a23af7" (UID: "9c030f72-5d14-4fa9-89a4-ae7a58a23af7"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 15 18:18:56.422547 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:18:56.422527    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9c030f72-5d14-4fa9-89a4-ae7a58a23af7-kube-api-access-px8rr" (OuterVolumeSpecName: "kube-api-access-px8rr") pod "9c030f72-5d14-4fa9-89a4-ae7a58a23af7" (UID: "9c030f72-5d14-4fa9-89a4-ae7a58a23af7"). InnerVolumeSpecName "kube-api-access-px8rr". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 15 18:18:56.422590 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:18:56.422555    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9c030f72-5d14-4fa9-89a4-ae7a58a23af7-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "9c030f72-5d14-4fa9-89a4-ae7a58a23af7" (UID: "9c030f72-5d14-4fa9-89a4-ae7a58a23af7"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 15 18:18:56.521345 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:18:56.521318    2567 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/9c030f72-5d14-4fa9-89a4-ae7a58a23af7-console-oauth-config\") on node \"ip-10-0-141-171.ec2.internal\" DevicePath \"\""
Jul 15 18:18:56.521345 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:18:56.521341    2567 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-px8rr\" (UniqueName: \"kubernetes.io/projected/9c030f72-5d14-4fa9-89a4-ae7a58a23af7-kube-api-access-px8rr\") on node \"ip-10-0-141-171.ec2.internal\" DevicePath \"\""
Jul 15 18:18:56.521345 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:18:56.521351    2567 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/9c030f72-5d14-4fa9-89a4-ae7a58a23af7-console-serving-cert\") on node \"ip-10-0-141-171.ec2.internal\" DevicePath \"\""
Jul 15 18:18:56.739775 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:18:56.739752    2567 generic.go:356] "Generic (PLEG): container finished" podID="9c030f72-5d14-4fa9-89a4-ae7a58a23af7" containerID="a90e0580815344d8fc5a7b3f031a304026316b13019b0a4b587960da32c0c56a" exitCode=0
Jul 15 18:18:56.740106 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:18:56.739795    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-9b6fc9785-k9w2d"
Jul 15 18:18:56.740106 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:18:56.739797    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-9b6fc9785-k9w2d" event={"ID":"9c030f72-5d14-4fa9-89a4-ae7a58a23af7","Type":"ContainerDied","Data":"a90e0580815344d8fc5a7b3f031a304026316b13019b0a4b587960da32c0c56a"}
Jul 15 18:18:56.740106 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:18:56.739911    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-9b6fc9785-k9w2d" event={"ID":"9c030f72-5d14-4fa9-89a4-ae7a58a23af7","Type":"ContainerDied","Data":"b89a09c4dc4509d6652be4d71509e7304b55fd7d3e46f102835ebd906f707557"}
Jul 15 18:18:56.740106 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:18:56.739940    2567 scope.go:117] "RemoveContainer" containerID="a90e0580815344d8fc5a7b3f031a304026316b13019b0a4b587960da32c0c56a"
Jul 15 18:18:56.749586 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:18:56.749567    2567 scope.go:117] "RemoveContainer" containerID="a90e0580815344d8fc5a7b3f031a304026316b13019b0a4b587960da32c0c56a"
Jul 15 18:18:56.749841 ip-10-0-141-171 kubenswrapper[2567]: E0715 18:18:56.749821    2567 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a90e0580815344d8fc5a7b3f031a304026316b13019b0a4b587960da32c0c56a\": container with ID starting with a90e0580815344d8fc5a7b3f031a304026316b13019b0a4b587960da32c0c56a not found: ID does not exist" containerID="a90e0580815344d8fc5a7b3f031a304026316b13019b0a4b587960da32c0c56a"
Jul 15 18:18:56.749888 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:18:56.749850    2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a90e0580815344d8fc5a7b3f031a304026316b13019b0a4b587960da32c0c56a"} err="failed to get container status \"a90e0580815344d8fc5a7b3f031a304026316b13019b0a4b587960da32c0c56a\": rpc error: code = NotFound desc = could not find container \"a90e0580815344d8fc5a7b3f031a304026316b13019b0a4b587960da32c0c56a\": container with ID starting with a90e0580815344d8fc5a7b3f031a304026316b13019b0a4b587960da32c0c56a not found: ID does not exist"
Jul 15 18:18:56.760009 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:18:56.759987    2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-9b6fc9785-k9w2d"]
Jul 15 18:18:56.766096 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:18:56.766077    2567 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-9b6fc9785-k9w2d"]
Jul 15 18:18:58.205394 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:18:58.205365    2567 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="9c030f72-5d14-4fa9-89a4-ae7a58a23af7" path="/var/lib/kubelet/pods/9c030f72-5d14-4fa9-89a4-ae7a58a23af7/volumes"
Jul 15 18:19:05.815157 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:19:05.815117    2567 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-7f768f64d6-qkw2d" podUID="3eb0e193-d9a7-4f35-8da0-590eaa374d1a" containerName="console" containerID="cri-o://931769c405484be8e706701125a89264fdc040b95946c1926a940b3fec818cb5" gracePeriod=15
Jul 15 18:19:06.080854 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:19:06.080785    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7f768f64d6-qkw2d"
Jul 15 18:19:06.200130 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:19:06.200097    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-g4f78\" (UniqueName: \"kubernetes.io/projected/3eb0e193-d9a7-4f35-8da0-590eaa374d1a-kube-api-access-g4f78\") pod \"3eb0e193-d9a7-4f35-8da0-590eaa374d1a\" (UID: \"3eb0e193-d9a7-4f35-8da0-590eaa374d1a\") "
Jul 15 18:19:06.200331 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:19:06.200140    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/3eb0e193-d9a7-4f35-8da0-590eaa374d1a-oauth-serving-cert\") pod \"3eb0e193-d9a7-4f35-8da0-590eaa374d1a\" (UID: \"3eb0e193-d9a7-4f35-8da0-590eaa374d1a\") "
Jul 15 18:19:06.200331 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:19:06.200165    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3eb0e193-d9a7-4f35-8da0-590eaa374d1a-trusted-ca-bundle\") pod \"3eb0e193-d9a7-4f35-8da0-590eaa374d1a\" (UID: \"3eb0e193-d9a7-4f35-8da0-590eaa374d1a\") "
Jul 15 18:19:06.200331 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:19:06.200199    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/3eb0e193-d9a7-4f35-8da0-590eaa374d1a-console-oauth-config\") pod \"3eb0e193-d9a7-4f35-8da0-590eaa374d1a\" (UID: \"3eb0e193-d9a7-4f35-8da0-590eaa374d1a\") "
Jul 15 18:19:06.200331 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:19:06.200252    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/3eb0e193-d9a7-4f35-8da0-590eaa374d1a-console-serving-cert\") pod \"3eb0e193-d9a7-4f35-8da0-590eaa374d1a\" (UID: \"3eb0e193-d9a7-4f35-8da0-590eaa374d1a\") "
Jul 15 18:19:06.200331 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:19:06.200307    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/3eb0e193-d9a7-4f35-8da0-590eaa374d1a-service-ca\") pod \"3eb0e193-d9a7-4f35-8da0-590eaa374d1a\" (UID: \"3eb0e193-d9a7-4f35-8da0-590eaa374d1a\") "
Jul 15 18:19:06.200576 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:19:06.200340    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/3eb0e193-d9a7-4f35-8da0-590eaa374d1a-console-config\") pod \"3eb0e193-d9a7-4f35-8da0-590eaa374d1a\" (UID: \"3eb0e193-d9a7-4f35-8da0-590eaa374d1a\") "
Jul 15 18:19:06.200628 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:19:06.200562    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3eb0e193-d9a7-4f35-8da0-590eaa374d1a-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "3eb0e193-d9a7-4f35-8da0-590eaa374d1a" (UID: "3eb0e193-d9a7-4f35-8da0-590eaa374d1a"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 15 18:19:06.200745 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:19:06.200712    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3eb0e193-d9a7-4f35-8da0-590eaa374d1a-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "3eb0e193-d9a7-4f35-8da0-590eaa374d1a" (UID: "3eb0e193-d9a7-4f35-8da0-590eaa374d1a"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 15 18:19:06.200971 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:19:06.200934    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3eb0e193-d9a7-4f35-8da0-590eaa374d1a-service-ca" (OuterVolumeSpecName: "service-ca") pod "3eb0e193-d9a7-4f35-8da0-590eaa374d1a" (UID: "3eb0e193-d9a7-4f35-8da0-590eaa374d1a"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 15 18:19:06.200971 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:19:06.200946    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3eb0e193-d9a7-4f35-8da0-590eaa374d1a-console-config" (OuterVolumeSpecName: "console-config") pod "3eb0e193-d9a7-4f35-8da0-590eaa374d1a" (UID: "3eb0e193-d9a7-4f35-8da0-590eaa374d1a"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 15 18:19:06.202646 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:19:06.202621    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3eb0e193-d9a7-4f35-8da0-590eaa374d1a-kube-api-access-g4f78" (OuterVolumeSpecName: "kube-api-access-g4f78") pod "3eb0e193-d9a7-4f35-8da0-590eaa374d1a" (UID: "3eb0e193-d9a7-4f35-8da0-590eaa374d1a"). InnerVolumeSpecName "kube-api-access-g4f78". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 15 18:19:06.202646 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:19:06.202634    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3eb0e193-d9a7-4f35-8da0-590eaa374d1a-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "3eb0e193-d9a7-4f35-8da0-590eaa374d1a" (UID: "3eb0e193-d9a7-4f35-8da0-590eaa374d1a"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 15 18:19:06.202828 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:19:06.202808    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3eb0e193-d9a7-4f35-8da0-590eaa374d1a-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "3eb0e193-d9a7-4f35-8da0-590eaa374d1a" (UID: "3eb0e193-d9a7-4f35-8da0-590eaa374d1a"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 15 18:19:06.301093 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:19:06.301069    2567 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/3eb0e193-d9a7-4f35-8da0-590eaa374d1a-console-config\") on node \"ip-10-0-141-171.ec2.internal\" DevicePath \"\""
Jul 15 18:19:06.301093 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:19:06.301090    2567 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-g4f78\" (UniqueName: \"kubernetes.io/projected/3eb0e193-d9a7-4f35-8da0-590eaa374d1a-kube-api-access-g4f78\") on node \"ip-10-0-141-171.ec2.internal\" DevicePath \"\""
Jul 15 18:19:06.301221 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:19:06.301100    2567 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/3eb0e193-d9a7-4f35-8da0-590eaa374d1a-oauth-serving-cert\") on node \"ip-10-0-141-171.ec2.internal\" DevicePath \"\""
Jul 15 18:19:06.301221 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:19:06.301109    2567 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3eb0e193-d9a7-4f35-8da0-590eaa374d1a-trusted-ca-bundle\") on node \"ip-10-0-141-171.ec2.internal\" DevicePath \"\""
Jul 15 18:19:06.301221 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:19:06.301117    2567 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/3eb0e193-d9a7-4f35-8da0-590eaa374d1a-console-oauth-config\") on node \"ip-10-0-141-171.ec2.internal\" DevicePath \"\""
Jul 15 18:19:06.301221 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:19:06.301125    2567 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/3eb0e193-d9a7-4f35-8da0-590eaa374d1a-console-serving-cert\") on node \"ip-10-0-141-171.ec2.internal\" DevicePath \"\""
Jul 15 18:19:06.301221 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:19:06.301134    2567 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/3eb0e193-d9a7-4f35-8da0-590eaa374d1a-service-ca\") on node \"ip-10-0-141-171.ec2.internal\" DevicePath \"\""
Jul 15 18:19:06.607381 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:19:06.607352    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-4lm4m"
Jul 15 18:19:06.783641 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:19:06.783612    2567 generic.go:356] "Generic (PLEG): container finished" podID="3eb0e193-d9a7-4f35-8da0-590eaa374d1a" containerID="931769c405484be8e706701125a89264fdc040b95946c1926a940b3fec818cb5" exitCode=0
Jul 15 18:19:06.783865 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:19:06.783661    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7f768f64d6-qkw2d"
Jul 15 18:19:06.783865 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:19:06.783703    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7f768f64d6-qkw2d" event={"ID":"3eb0e193-d9a7-4f35-8da0-590eaa374d1a","Type":"ContainerDied","Data":"931769c405484be8e706701125a89264fdc040b95946c1926a940b3fec818cb5"}
Jul 15 18:19:06.783865 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:19:06.783758    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7f768f64d6-qkw2d" event={"ID":"3eb0e193-d9a7-4f35-8da0-590eaa374d1a","Type":"ContainerDied","Data":"0173074d5c57c43de8d6e646122d4b2bb49882653d33e35590fff730c1cd140f"}
Jul 15 18:19:06.783865 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:19:06.783785    2567 scope.go:117] "RemoveContainer" containerID="931769c405484be8e706701125a89264fdc040b95946c1926a940b3fec818cb5"
Jul 15 18:19:06.792172 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:19:06.792153    2567 scope.go:117] "RemoveContainer" containerID="931769c405484be8e706701125a89264fdc040b95946c1926a940b3fec818cb5"
Jul 15 18:19:06.792435 ip-10-0-141-171 kubenswrapper[2567]: E0715 18:19:06.792418    2567 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"931769c405484be8e706701125a89264fdc040b95946c1926a940b3fec818cb5\": container with ID starting with 931769c405484be8e706701125a89264fdc040b95946c1926a940b3fec818cb5 not found: ID does not exist" containerID="931769c405484be8e706701125a89264fdc040b95946c1926a940b3fec818cb5"
Jul 15 18:19:06.792482 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:19:06.792441    2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"931769c405484be8e706701125a89264fdc040b95946c1926a940b3fec818cb5"} err="failed to get container status \"931769c405484be8e706701125a89264fdc040b95946c1926a940b3fec818cb5\": rpc error: code = NotFound desc = could not find container \"931769c405484be8e706701125a89264fdc040b95946c1926a940b3fec818cb5\": container with ID starting with 931769c405484be8e706701125a89264fdc040b95946c1926a940b3fec818cb5 not found: ID does not exist"
Jul 15 18:19:06.800609 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:19:06.800581    2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-7f768f64d6-qkw2d"]
Jul 15 18:19:06.804067 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:19:06.804045    2567 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-7f768f64d6-qkw2d"]
Jul 15 18:19:08.205839 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:19:08.205804    2567 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="3eb0e193-d9a7-4f35-8da0-590eaa374d1a" path="/var/lib/kubelet/pods/3eb0e193-d9a7-4f35-8da0-590eaa374d1a/volumes"
Jul 15 18:19:13.712818 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:19:13.712786    2567 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/metrics-server-5d5c95d576-cgbcs"
Jul 15 18:19:13.716547 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:19:13.716526    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/metrics-server-5d5c95d576-cgbcs"
Jul 15 18:19:16.789988 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:19:16.789941    2567 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-6c775749fc-6wksh" podUID="7f33bdee-5244-4c91-93b0-09ed9b5056b8" containerName="console" containerID="cri-o://a9a8781a5f40ee3cbd36a91a06f19d7137596e43c6eaf5676f3f7126ce2aa9cf" gracePeriod=15
Jul 15 18:19:17.037141 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:19:17.037117    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6c775749fc-6wksh"
Jul 15 18:19:17.083468 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:19:17.083382    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-d6zrx\" (UniqueName: \"kubernetes.io/projected/7f33bdee-5244-4c91-93b0-09ed9b5056b8-kube-api-access-d6zrx\") pod \"7f33bdee-5244-4c91-93b0-09ed9b5056b8\" (UID: \"7f33bdee-5244-4c91-93b0-09ed9b5056b8\") "
Jul 15 18:19:17.083624 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:19:17.083484    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/7f33bdee-5244-4c91-93b0-09ed9b5056b8-console-oauth-config\") pod \"7f33bdee-5244-4c91-93b0-09ed9b5056b8\" (UID: \"7f33bdee-5244-4c91-93b0-09ed9b5056b8\") "
Jul 15 18:19:17.083624 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:19:17.083528    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/7f33bdee-5244-4c91-93b0-09ed9b5056b8-console-serving-cert\") pod \"7f33bdee-5244-4c91-93b0-09ed9b5056b8\" (UID: \"7f33bdee-5244-4c91-93b0-09ed9b5056b8\") "
Jul 15 18:19:17.083624 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:19:17.083553    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/7f33bdee-5244-4c91-93b0-09ed9b5056b8-service-ca\") pod \"7f33bdee-5244-4c91-93b0-09ed9b5056b8\" (UID: \"7f33bdee-5244-4c91-93b0-09ed9b5056b8\") "
Jul 15 18:19:17.083624 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:19:17.083586    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7f33bdee-5244-4c91-93b0-09ed9b5056b8-trusted-ca-bundle\") pod \"7f33bdee-5244-4c91-93b0-09ed9b5056b8\" (UID: \"7f33bdee-5244-4c91-93b0-09ed9b5056b8\") "
Jul 15 18:19:17.083818 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:19:17.083629    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/7f33bdee-5244-4c91-93b0-09ed9b5056b8-console-config\") pod \"7f33bdee-5244-4c91-93b0-09ed9b5056b8\" (UID: \"7f33bdee-5244-4c91-93b0-09ed9b5056b8\") "
Jul 15 18:19:17.083818 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:19:17.083656    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/7f33bdee-5244-4c91-93b0-09ed9b5056b8-oauth-serving-cert\") pod \"7f33bdee-5244-4c91-93b0-09ed9b5056b8\" (UID: \"7f33bdee-5244-4c91-93b0-09ed9b5056b8\") "
Jul 15 18:19:17.084007 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:19:17.083975    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/7f33bdee-5244-4c91-93b0-09ed9b5056b8-service-ca" (OuterVolumeSpecName: "service-ca") pod "7f33bdee-5244-4c91-93b0-09ed9b5056b8" (UID: "7f33bdee-5244-4c91-93b0-09ed9b5056b8"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 15 18:19:17.084218 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:19:17.084188    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/7f33bdee-5244-4c91-93b0-09ed9b5056b8-console-config" (OuterVolumeSpecName: "console-config") pod "7f33bdee-5244-4c91-93b0-09ed9b5056b8" (UID: "7f33bdee-5244-4c91-93b0-09ed9b5056b8"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 15 18:19:17.084218 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:19:17.084202    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/7f33bdee-5244-4c91-93b0-09ed9b5056b8-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "7f33bdee-5244-4c91-93b0-09ed9b5056b8" (UID: "7f33bdee-5244-4c91-93b0-09ed9b5056b8"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 15 18:19:17.084409 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:19:17.084388    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/7f33bdee-5244-4c91-93b0-09ed9b5056b8-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "7f33bdee-5244-4c91-93b0-09ed9b5056b8" (UID: "7f33bdee-5244-4c91-93b0-09ed9b5056b8"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 15 18:19:17.085812 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:19:17.085773    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7f33bdee-5244-4c91-93b0-09ed9b5056b8-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "7f33bdee-5244-4c91-93b0-09ed9b5056b8" (UID: "7f33bdee-5244-4c91-93b0-09ed9b5056b8"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 15 18:19:17.085928 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:19:17.085827    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7f33bdee-5244-4c91-93b0-09ed9b5056b8-kube-api-access-d6zrx" (OuterVolumeSpecName: "kube-api-access-d6zrx") pod "7f33bdee-5244-4c91-93b0-09ed9b5056b8" (UID: "7f33bdee-5244-4c91-93b0-09ed9b5056b8"). InnerVolumeSpecName "kube-api-access-d6zrx". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 15 18:19:17.085928 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:19:17.085839    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7f33bdee-5244-4c91-93b0-09ed9b5056b8-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "7f33bdee-5244-4c91-93b0-09ed9b5056b8" (UID: "7f33bdee-5244-4c91-93b0-09ed9b5056b8"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 15 18:19:17.185308 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:19:17.185276    2567 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-d6zrx\" (UniqueName: \"kubernetes.io/projected/7f33bdee-5244-4c91-93b0-09ed9b5056b8-kube-api-access-d6zrx\") on node \"ip-10-0-141-171.ec2.internal\" DevicePath \"\""
Jul 15 18:19:17.185308 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:19:17.185303    2567 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/7f33bdee-5244-4c91-93b0-09ed9b5056b8-console-oauth-config\") on node \"ip-10-0-141-171.ec2.internal\" DevicePath \"\""
Jul 15 18:19:17.185308 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:19:17.185312    2567 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/7f33bdee-5244-4c91-93b0-09ed9b5056b8-console-serving-cert\") on node \"ip-10-0-141-171.ec2.internal\" DevicePath \"\""
Jul 15 18:19:17.185535 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:19:17.185321    2567 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/7f33bdee-5244-4c91-93b0-09ed9b5056b8-service-ca\") on node \"ip-10-0-141-171.ec2.internal\" DevicePath \"\""
Jul 15 18:19:17.185535 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:19:17.185329    2567 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7f33bdee-5244-4c91-93b0-09ed9b5056b8-trusted-ca-bundle\") on node \"ip-10-0-141-171.ec2.internal\" DevicePath \"\""
Jul 15 18:19:17.185535 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:19:17.185340    2567 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/7f33bdee-5244-4c91-93b0-09ed9b5056b8-console-config\") on node \"ip-10-0-141-171.ec2.internal\" DevicePath \"\""
Jul 15 18:19:17.185535 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:19:17.185348    2567 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/7f33bdee-5244-4c91-93b0-09ed9b5056b8-oauth-serving-cert\") on node \"ip-10-0-141-171.ec2.internal\" DevicePath \"\""
Jul 15 18:19:17.831986 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:19:17.831951    2567 generic.go:356] "Generic (PLEG): container finished" podID="7f33bdee-5244-4c91-93b0-09ed9b5056b8" containerID="a9a8781a5f40ee3cbd36a91a06f19d7137596e43c6eaf5676f3f7126ce2aa9cf" exitCode=0
Jul 15 18:19:17.832393 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:19:17.832046    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6c775749fc-6wksh"
Jul 15 18:19:17.832393 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:19:17.832045    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6c775749fc-6wksh" event={"ID":"7f33bdee-5244-4c91-93b0-09ed9b5056b8","Type":"ContainerDied","Data":"a9a8781a5f40ee3cbd36a91a06f19d7137596e43c6eaf5676f3f7126ce2aa9cf"}
Jul 15 18:19:17.832393 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:19:17.832175    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6c775749fc-6wksh" event={"ID":"7f33bdee-5244-4c91-93b0-09ed9b5056b8","Type":"ContainerDied","Data":"0d4b60a0cd010ac5c26c4693fc516c321f32ff15b89ac1bda7d279b02e8866fb"}
Jul 15 18:19:17.832393 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:19:17.832195    2567 scope.go:117] "RemoveContainer" containerID="a9a8781a5f40ee3cbd36a91a06f19d7137596e43c6eaf5676f3f7126ce2aa9cf"
Jul 15 18:19:17.840693 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:19:17.840676    2567 scope.go:117] "RemoveContainer" containerID="a9a8781a5f40ee3cbd36a91a06f19d7137596e43c6eaf5676f3f7126ce2aa9cf"
Jul 15 18:19:17.840962 ip-10-0-141-171 kubenswrapper[2567]: E0715 18:19:17.840945    2567 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a9a8781a5f40ee3cbd36a91a06f19d7137596e43c6eaf5676f3f7126ce2aa9cf\": container with ID starting with a9a8781a5f40ee3cbd36a91a06f19d7137596e43c6eaf5676f3f7126ce2aa9cf not found: ID does not exist" containerID="a9a8781a5f40ee3cbd36a91a06f19d7137596e43c6eaf5676f3f7126ce2aa9cf"
Jul 15 18:19:17.841027 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:19:17.840976    2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a9a8781a5f40ee3cbd36a91a06f19d7137596e43c6eaf5676f3f7126ce2aa9cf"} err="failed to get container status \"a9a8781a5f40ee3cbd36a91a06f19d7137596e43c6eaf5676f3f7126ce2aa9cf\": rpc error: code = NotFound desc = could not find container \"a9a8781a5f40ee3cbd36a91a06f19d7137596e43c6eaf5676f3f7126ce2aa9cf\": container with ID starting with a9a8781a5f40ee3cbd36a91a06f19d7137596e43c6eaf5676f3f7126ce2aa9cf not found: ID does not exist"
Jul 15 18:19:17.865849 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:19:17.865787    2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-6c775749fc-6wksh"]
Jul 15 18:19:17.867925 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:19:17.867901    2567 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-6c775749fc-6wksh"]
Jul 15 18:19:18.209369 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:19:18.209339    2567 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="7f33bdee-5244-4c91-93b0-09ed9b5056b8" path="/var/lib/kubelet/pods/7f33bdee-5244-4c91-93b0-09ed9b5056b8/volumes"
Jul 15 18:19:35.461428 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:19:35.461392    2567 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0"
Jul 15 18:19:35.481072 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:19:35.481042    2567 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0"
Jul 15 18:19:35.919190 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:19:35.919113    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0"
Jul 15 18:19:58.422350 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:19:58.422312    2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-65794f774d-kb284"]
Jul 15 18:19:58.422827 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:19:58.422778    2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9c030f72-5d14-4fa9-89a4-ae7a58a23af7" containerName="console"
Jul 15 18:19:58.422827 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:19:58.422797    2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="9c030f72-5d14-4fa9-89a4-ae7a58a23af7" containerName="console"
Jul 15 18:19:58.422827 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:19:58.422824    2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7f33bdee-5244-4c91-93b0-09ed9b5056b8" containerName="console"
Jul 15 18:19:58.422990 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:19:58.422833    2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="7f33bdee-5244-4c91-93b0-09ed9b5056b8" containerName="console"
Jul 15 18:19:58.422990 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:19:58.422853    2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3eb0e193-d9a7-4f35-8da0-590eaa374d1a" containerName="console"
Jul 15 18:19:58.422990 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:19:58.422861    2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="3eb0e193-d9a7-4f35-8da0-590eaa374d1a" containerName="console"
Jul 15 18:19:58.422990 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:19:58.422942    2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="3eb0e193-d9a7-4f35-8da0-590eaa374d1a" containerName="console"
Jul 15 18:19:58.422990 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:19:58.422953    2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="7f33bdee-5244-4c91-93b0-09ed9b5056b8" containerName="console"
Jul 15 18:19:58.422990 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:19:58.422966    2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="9c030f72-5d14-4fa9-89a4-ae7a58a23af7" containerName="console"
Jul 15 18:19:58.428512 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:19:58.428485    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-65794f774d-kb284"
Jul 15 18:19:58.438101 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:19:58.438078    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-65794f774d-kb284"]
Jul 15 18:19:58.544478 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:19:58.544444    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/8378f1bb-3794-44c1-8ec8-c4c06ec46960-console-oauth-config\") pod \"console-65794f774d-kb284\" (UID: \"8378f1bb-3794-44c1-8ec8-c4c06ec46960\") " pod="openshift-console/console-65794f774d-kb284"
Jul 15 18:19:58.544478 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:19:58.544491    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/8378f1bb-3794-44c1-8ec8-c4c06ec46960-console-config\") pod \"console-65794f774d-kb284\" (UID: \"8378f1bb-3794-44c1-8ec8-c4c06ec46960\") " pod="openshift-console/console-65794f774d-kb284"
Jul 15 18:19:58.544683 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:19:58.544515    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8378f1bb-3794-44c1-8ec8-c4c06ec46960-trusted-ca-bundle\") pod \"console-65794f774d-kb284\" (UID: \"8378f1bb-3794-44c1-8ec8-c4c06ec46960\") " pod="openshift-console/console-65794f774d-kb284"
Jul 15 18:19:58.544683 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:19:58.544547    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/8378f1bb-3794-44c1-8ec8-c4c06ec46960-oauth-serving-cert\") pod \"console-65794f774d-kb284\" (UID: \"8378f1bb-3794-44c1-8ec8-c4c06ec46960\") " pod="openshift-console/console-65794f774d-kb284"
Jul 15 18:19:58.544683 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:19:58.544581    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fzvq6\" (UniqueName: \"kubernetes.io/projected/8378f1bb-3794-44c1-8ec8-c4c06ec46960-kube-api-access-fzvq6\") pod \"console-65794f774d-kb284\" (UID: \"8378f1bb-3794-44c1-8ec8-c4c06ec46960\") " pod="openshift-console/console-65794f774d-kb284"
Jul 15 18:19:58.544683 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:19:58.544611    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/8378f1bb-3794-44c1-8ec8-c4c06ec46960-service-ca\") pod \"console-65794f774d-kb284\" (UID: \"8378f1bb-3794-44c1-8ec8-c4c06ec46960\") " pod="openshift-console/console-65794f774d-kb284"
Jul 15 18:19:58.544683 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:19:58.544658    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/8378f1bb-3794-44c1-8ec8-c4c06ec46960-console-serving-cert\") pod \"console-65794f774d-kb284\" (UID: \"8378f1bb-3794-44c1-8ec8-c4c06ec46960\") " pod="openshift-console/console-65794f774d-kb284"
Jul 15 18:19:58.645798 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:19:58.645747    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8378f1bb-3794-44c1-8ec8-c4c06ec46960-trusted-ca-bundle\") pod \"console-65794f774d-kb284\" (UID: \"8378f1bb-3794-44c1-8ec8-c4c06ec46960\") " pod="openshift-console/console-65794f774d-kb284"
Jul 15 18:19:58.645798 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:19:58.645806    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/8378f1bb-3794-44c1-8ec8-c4c06ec46960-oauth-serving-cert\") pod \"console-65794f774d-kb284\" (UID: \"8378f1bb-3794-44c1-8ec8-c4c06ec46960\") " pod="openshift-console/console-65794f774d-kb284"
Jul 15 18:19:58.645964 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:19:58.645831    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fzvq6\" (UniqueName: \"kubernetes.io/projected/8378f1bb-3794-44c1-8ec8-c4c06ec46960-kube-api-access-fzvq6\") pod \"console-65794f774d-kb284\" (UID: \"8378f1bb-3794-44c1-8ec8-c4c06ec46960\") " pod="openshift-console/console-65794f774d-kb284"
Jul 15 18:19:58.645964 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:19:58.645856    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/8378f1bb-3794-44c1-8ec8-c4c06ec46960-service-ca\") pod \"console-65794f774d-kb284\" (UID: \"8378f1bb-3794-44c1-8ec8-c4c06ec46960\") " pod="openshift-console/console-65794f774d-kb284"
Jul 15 18:19:58.645964 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:19:58.645886    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/8378f1bb-3794-44c1-8ec8-c4c06ec46960-console-serving-cert\") pod \"console-65794f774d-kb284\" (UID: \"8378f1bb-3794-44c1-8ec8-c4c06ec46960\") " pod="openshift-console/console-65794f774d-kb284"
Jul 15 18:19:58.646129 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:19:58.646106    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/8378f1bb-3794-44c1-8ec8-c4c06ec46960-console-oauth-config\") pod \"console-65794f774d-kb284\" (UID: \"8378f1bb-3794-44c1-8ec8-c4c06ec46960\") " pod="openshift-console/console-65794f774d-kb284"
Jul 15 18:19:58.646191 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:19:58.646174    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/8378f1bb-3794-44c1-8ec8-c4c06ec46960-console-config\") pod \"console-65794f774d-kb284\" (UID: \"8378f1bb-3794-44c1-8ec8-c4c06ec46960\") " pod="openshift-console/console-65794f774d-kb284"
Jul 15 18:19:58.646672 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:19:58.646651    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/8378f1bb-3794-44c1-8ec8-c4c06ec46960-service-ca\") pod \"console-65794f774d-kb284\" (UID: \"8378f1bb-3794-44c1-8ec8-c4c06ec46960\") " pod="openshift-console/console-65794f774d-kb284"
Jul 15 18:19:58.646780 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:19:58.646675    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/8378f1bb-3794-44c1-8ec8-c4c06ec46960-oauth-serving-cert\") pod \"console-65794f774d-kb284\" (UID: \"8378f1bb-3794-44c1-8ec8-c4c06ec46960\") " pod="openshift-console/console-65794f774d-kb284"
Jul 15 18:19:58.646839 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:19:58.646775    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8378f1bb-3794-44c1-8ec8-c4c06ec46960-trusted-ca-bundle\") pod \"console-65794f774d-kb284\" (UID: \"8378f1bb-3794-44c1-8ec8-c4c06ec46960\") " pod="openshift-console/console-65794f774d-kb284"
Jul 15 18:19:58.646839 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:19:58.646798    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/8378f1bb-3794-44c1-8ec8-c4c06ec46960-console-config\") pod \"console-65794f774d-kb284\" (UID: \"8378f1bb-3794-44c1-8ec8-c4c06ec46960\") " pod="openshift-console/console-65794f774d-kb284"
Jul 15 18:19:58.648416 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:19:58.648398    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/8378f1bb-3794-44c1-8ec8-c4c06ec46960-console-serving-cert\") pod \"console-65794f774d-kb284\" (UID: \"8378f1bb-3794-44c1-8ec8-c4c06ec46960\") " pod="openshift-console/console-65794f774d-kb284"
Jul 15 18:19:58.648499 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:19:58.648431    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/8378f1bb-3794-44c1-8ec8-c4c06ec46960-console-oauth-config\") pod \"console-65794f774d-kb284\" (UID: \"8378f1bb-3794-44c1-8ec8-c4c06ec46960\") " pod="openshift-console/console-65794f774d-kb284"
Jul 15 18:19:58.654244 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:19:58.654211    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fzvq6\" (UniqueName: \"kubernetes.io/projected/8378f1bb-3794-44c1-8ec8-c4c06ec46960-kube-api-access-fzvq6\") pod \"console-65794f774d-kb284\" (UID: \"8378f1bb-3794-44c1-8ec8-c4c06ec46960\") " pod="openshift-console/console-65794f774d-kb284"
Jul 15 18:19:58.738429 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:19:58.738389    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-65794f774d-kb284"
Jul 15 18:19:58.866861 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:19:58.866838    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-65794f774d-kb284"]
Jul 15 18:19:58.868578 ip-10-0-141-171 kubenswrapper[2567]: W0715 18:19:58.868548    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8378f1bb_3794_44c1_8ec8_c4c06ec46960.slice/crio-367bbe3525139fd554592c5b312b874ca8f01fa065849049bdf638e648d0c572 WatchSource:0}: Error finding container 367bbe3525139fd554592c5b312b874ca8f01fa065849049bdf638e648d0c572: Status 404 returned error can't find the container with id 367bbe3525139fd554592c5b312b874ca8f01fa065849049bdf638e648d0c572
Jul 15 18:19:59.003116 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:19:59.003028    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-65794f774d-kb284" event={"ID":"8378f1bb-3794-44c1-8ec8-c4c06ec46960","Type":"ContainerStarted","Data":"6857eb223f09bcffdd2ede461dd5d551e534b0f7f02be523bceb9fb23ca3823f"}
Jul 15 18:19:59.003116 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:19:59.003084    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-65794f774d-kb284" event={"ID":"8378f1bb-3794-44c1-8ec8-c4c06ec46960","Type":"ContainerStarted","Data":"367bbe3525139fd554592c5b312b874ca8f01fa065849049bdf638e648d0c572"}
Jul 15 18:19:59.021504 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:19:59.021457    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-65794f774d-kb284" podStartSLOduration=1.021442255 podStartE2EDuration="1.021442255s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 18:19:58 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 18:19:59.019413133 +0000 UTC m=+157.553836490" watchObservedRunningTime="2026-07-15 18:19:59.021442255 +0000 UTC m=+157.555865610"
Jul 15 18:20:08.739329 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:20:08.739287    2567 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-65794f774d-kb284"
Jul 15 18:20:08.739801 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:20:08.739385    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-65794f774d-kb284"
Jul 15 18:20:08.744012 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:20:08.743988    2567 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-65794f774d-kb284"
Jul 15 18:20:09.048189 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:20:09.048103    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-65794f774d-kb284"
Jul 15 18:20:09.114845 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:20:09.114814    2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-78f5b5fd94-rw8lz"]
Jul 15 18:20:34.136307 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:20:34.136266    2567 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-78f5b5fd94-rw8lz" podUID="a382b616-05c2-4ca7-9d99-5e8ea16c0056" containerName="console" containerID="cri-o://b371e0d7ddb60359222b57033acf02a30e196388a217e6a9a48efcde649196fd" gracePeriod=15
Jul 15 18:20:34.377374 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:20:34.377350    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-78f5b5fd94-rw8lz"
Jul 15 18:20:34.462989 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:20:34.462964    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a382b616-05c2-4ca7-9d99-5e8ea16c0056-trusted-ca-bundle\") pod \"a382b616-05c2-4ca7-9d99-5e8ea16c0056\" (UID: \"a382b616-05c2-4ca7-9d99-5e8ea16c0056\") "
Jul 15 18:20:34.462989 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:20:34.462999    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/a382b616-05c2-4ca7-9d99-5e8ea16c0056-oauth-serving-cert\") pod \"a382b616-05c2-4ca7-9d99-5e8ea16c0056\" (UID: \"a382b616-05c2-4ca7-9d99-5e8ea16c0056\") "
Jul 15 18:20:34.463219 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:20:34.463023    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/a382b616-05c2-4ca7-9d99-5e8ea16c0056-console-oauth-config\") pod \"a382b616-05c2-4ca7-9d99-5e8ea16c0056\" (UID: \"a382b616-05c2-4ca7-9d99-5e8ea16c0056\") "
Jul 15 18:20:34.463219 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:20:34.463053    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/a382b616-05c2-4ca7-9d99-5e8ea16c0056-console-config\") pod \"a382b616-05c2-4ca7-9d99-5e8ea16c0056\" (UID: \"a382b616-05c2-4ca7-9d99-5e8ea16c0056\") "
Jul 15 18:20:34.463219 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:20:34.463089    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-h5qbr\" (UniqueName: \"kubernetes.io/projected/a382b616-05c2-4ca7-9d99-5e8ea16c0056-kube-api-access-h5qbr\") pod \"a382b616-05c2-4ca7-9d99-5e8ea16c0056\" (UID: \"a382b616-05c2-4ca7-9d99-5e8ea16c0056\") "
Jul 15 18:20:34.463219 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:20:34.463171    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/a382b616-05c2-4ca7-9d99-5e8ea16c0056-console-serving-cert\") pod \"a382b616-05c2-4ca7-9d99-5e8ea16c0056\" (UID: \"a382b616-05c2-4ca7-9d99-5e8ea16c0056\") "
Jul 15 18:20:34.463219 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:20:34.463196    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/a382b616-05c2-4ca7-9d99-5e8ea16c0056-service-ca\") pod \"a382b616-05c2-4ca7-9d99-5e8ea16c0056\" (UID: \"a382b616-05c2-4ca7-9d99-5e8ea16c0056\") "
Jul 15 18:20:34.463487 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:20:34.463400    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a382b616-05c2-4ca7-9d99-5e8ea16c0056-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "a382b616-05c2-4ca7-9d99-5e8ea16c0056" (UID: "a382b616-05c2-4ca7-9d99-5e8ea16c0056"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 15 18:20:34.463580 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:20:34.463555    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a382b616-05c2-4ca7-9d99-5e8ea16c0056-console-config" (OuterVolumeSpecName: "console-config") pod "a382b616-05c2-4ca7-9d99-5e8ea16c0056" (UID: "a382b616-05c2-4ca7-9d99-5e8ea16c0056"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 15 18:20:34.463672 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:20:34.463650    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a382b616-05c2-4ca7-9d99-5e8ea16c0056-service-ca" (OuterVolumeSpecName: "service-ca") pod "a382b616-05c2-4ca7-9d99-5e8ea16c0056" (UID: "a382b616-05c2-4ca7-9d99-5e8ea16c0056"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 15 18:20:34.463711 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:20:34.463645    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a382b616-05c2-4ca7-9d99-5e8ea16c0056-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "a382b616-05c2-4ca7-9d99-5e8ea16c0056" (UID: "a382b616-05c2-4ca7-9d99-5e8ea16c0056"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 15 18:20:34.465163 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:20:34.465140    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a382b616-05c2-4ca7-9d99-5e8ea16c0056-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "a382b616-05c2-4ca7-9d99-5e8ea16c0056" (UID: "a382b616-05c2-4ca7-9d99-5e8ea16c0056"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 15 18:20:34.465391 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:20:34.465372    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a382b616-05c2-4ca7-9d99-5e8ea16c0056-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "a382b616-05c2-4ca7-9d99-5e8ea16c0056" (UID: "a382b616-05c2-4ca7-9d99-5e8ea16c0056"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 15 18:20:34.465592 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:20:34.465572    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a382b616-05c2-4ca7-9d99-5e8ea16c0056-kube-api-access-h5qbr" (OuterVolumeSpecName: "kube-api-access-h5qbr") pod "a382b616-05c2-4ca7-9d99-5e8ea16c0056" (UID: "a382b616-05c2-4ca7-9d99-5e8ea16c0056"). InnerVolumeSpecName "kube-api-access-h5qbr". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 15 18:20:34.563808 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:20:34.563780    2567 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/a382b616-05c2-4ca7-9d99-5e8ea16c0056-console-config\") on node \"ip-10-0-141-171.ec2.internal\" DevicePath \"\""
Jul 15 18:20:34.563808 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:20:34.563803    2567 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-h5qbr\" (UniqueName: \"kubernetes.io/projected/a382b616-05c2-4ca7-9d99-5e8ea16c0056-kube-api-access-h5qbr\") on node \"ip-10-0-141-171.ec2.internal\" DevicePath \"\""
Jul 15 18:20:34.563808 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:20:34.563814    2567 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/a382b616-05c2-4ca7-9d99-5e8ea16c0056-console-serving-cert\") on node \"ip-10-0-141-171.ec2.internal\" DevicePath \"\""
Jul 15 18:20:34.563996 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:20:34.563823    2567 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/a382b616-05c2-4ca7-9d99-5e8ea16c0056-service-ca\") on node \"ip-10-0-141-171.ec2.internal\" DevicePath \"\""
Jul 15 18:20:34.563996 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:20:34.563831    2567 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a382b616-05c2-4ca7-9d99-5e8ea16c0056-trusted-ca-bundle\") on node \"ip-10-0-141-171.ec2.internal\" DevicePath \"\""
Jul 15 18:20:34.563996 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:20:34.563839    2567 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/a382b616-05c2-4ca7-9d99-5e8ea16c0056-oauth-serving-cert\") on node \"ip-10-0-141-171.ec2.internal\" DevicePath \"\""
Jul 15 18:20:34.563996 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:20:34.563847    2567 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/a382b616-05c2-4ca7-9d99-5e8ea16c0056-console-oauth-config\") on node \"ip-10-0-141-171.ec2.internal\" DevicePath \"\""
Jul 15 18:20:35.149927 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:20:35.149892    2567 generic.go:356] "Generic (PLEG): container finished" podID="a382b616-05c2-4ca7-9d99-5e8ea16c0056" containerID="b371e0d7ddb60359222b57033acf02a30e196388a217e6a9a48efcde649196fd" exitCode=0
Jul 15 18:20:35.150355 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:20:35.149933    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-78f5b5fd94-rw8lz" event={"ID":"a382b616-05c2-4ca7-9d99-5e8ea16c0056","Type":"ContainerDied","Data":"b371e0d7ddb60359222b57033acf02a30e196388a217e6a9a48efcde649196fd"}
Jul 15 18:20:35.150355 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:20:35.149975    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-78f5b5fd94-rw8lz" event={"ID":"a382b616-05c2-4ca7-9d99-5e8ea16c0056","Type":"ContainerDied","Data":"de6072e71fe7f530d2b2706b98393105c0238446671da5340d456457e78fe3b4"}
Jul 15 18:20:35.150355 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:20:35.149995    2567 scope.go:117] "RemoveContainer" containerID="b371e0d7ddb60359222b57033acf02a30e196388a217e6a9a48efcde649196fd"
Jul 15 18:20:35.150355 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:20:35.149934    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-78f5b5fd94-rw8lz"
Jul 15 18:20:35.158455 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:20:35.158438    2567 scope.go:117] "RemoveContainer" containerID="b371e0d7ddb60359222b57033acf02a30e196388a217e6a9a48efcde649196fd"
Jul 15 18:20:35.158701 ip-10-0-141-171 kubenswrapper[2567]: E0715 18:20:35.158683    2567 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b371e0d7ddb60359222b57033acf02a30e196388a217e6a9a48efcde649196fd\": container with ID starting with b371e0d7ddb60359222b57033acf02a30e196388a217e6a9a48efcde649196fd not found: ID does not exist" containerID="b371e0d7ddb60359222b57033acf02a30e196388a217e6a9a48efcde649196fd"
Jul 15 18:20:35.158749 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:20:35.158710    2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b371e0d7ddb60359222b57033acf02a30e196388a217e6a9a48efcde649196fd"} err="failed to get container status \"b371e0d7ddb60359222b57033acf02a30e196388a217e6a9a48efcde649196fd\": rpc error: code = NotFound desc = could not find container \"b371e0d7ddb60359222b57033acf02a30e196388a217e6a9a48efcde649196fd\": container with ID starting with b371e0d7ddb60359222b57033acf02a30e196388a217e6a9a48efcde649196fd not found: ID does not exist"
Jul 15 18:20:35.173838 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:20:35.173812    2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-78f5b5fd94-rw8lz"]
Jul 15 18:20:35.177766 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:20:35.177745    2567 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-78f5b5fd94-rw8lz"]
Jul 15 18:20:36.209369 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:20:36.209327    2567 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a382b616-05c2-4ca7-9d99-5e8ea16c0056" path="/var/lib/kubelet/pods/a382b616-05c2-4ca7-9d99-5e8ea16c0056/volumes"
Jul 15 18:21:24.916685 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:21:24.916650    2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-cainjector-559cdd8c87-42bxq"]
Jul 15 18:21:24.917069 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:21:24.916961    2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a382b616-05c2-4ca7-9d99-5e8ea16c0056" containerName="console"
Jul 15 18:21:24.917069 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:21:24.916972    2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="a382b616-05c2-4ca7-9d99-5e8ea16c0056" containerName="console"
Jul 15 18:21:24.917069 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:21:24.917040    2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="a382b616-05c2-4ca7-9d99-5e8ea16c0056" containerName="console"
Jul 15 18:21:24.919472 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:21:24.919453    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-cainjector-559cdd8c87-42bxq"
Jul 15 18:21:24.921533 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:21:24.921515    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"kube-root-ca.crt\""
Jul 15 18:21:24.921533 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:21:24.921524    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"openshift-service-ca.crt\""
Jul 15 18:21:24.922141 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:21:24.922124    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-cainjector-dockercfg-r2zn6\""
Jul 15 18:21:24.929499 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:21:24.929475    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-cainjector-559cdd8c87-42bxq"]
Jul 15 18:21:25.066064 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:21:25.066030    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/3636791b-cf84-4528-8d8d-bdcdfe73aa88-bound-sa-token\") pod \"cert-manager-cainjector-559cdd8c87-42bxq\" (UID: \"3636791b-cf84-4528-8d8d-bdcdfe73aa88\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-42bxq"
Jul 15 18:21:25.066064 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:21:25.066065    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-27r78\" (UniqueName: \"kubernetes.io/projected/3636791b-cf84-4528-8d8d-bdcdfe73aa88-kube-api-access-27r78\") pod \"cert-manager-cainjector-559cdd8c87-42bxq\" (UID: \"3636791b-cf84-4528-8d8d-bdcdfe73aa88\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-42bxq"
Jul 15 18:21:25.167447 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:21:25.167370    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/3636791b-cf84-4528-8d8d-bdcdfe73aa88-bound-sa-token\") pod \"cert-manager-cainjector-559cdd8c87-42bxq\" (UID: \"3636791b-cf84-4528-8d8d-bdcdfe73aa88\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-42bxq"
Jul 15 18:21:25.167447 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:21:25.167410    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-27r78\" (UniqueName: \"kubernetes.io/projected/3636791b-cf84-4528-8d8d-bdcdfe73aa88-kube-api-access-27r78\") pod \"cert-manager-cainjector-559cdd8c87-42bxq\" (UID: \"3636791b-cf84-4528-8d8d-bdcdfe73aa88\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-42bxq"
Jul 15 18:21:25.174992 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:21:25.174962    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/3636791b-cf84-4528-8d8d-bdcdfe73aa88-bound-sa-token\") pod \"cert-manager-cainjector-559cdd8c87-42bxq\" (UID: \"3636791b-cf84-4528-8d8d-bdcdfe73aa88\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-42bxq"
Jul 15 18:21:25.175329 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:21:25.175310    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-27r78\" (UniqueName: \"kubernetes.io/projected/3636791b-cf84-4528-8d8d-bdcdfe73aa88-kube-api-access-27r78\") pod \"cert-manager-cainjector-559cdd8c87-42bxq\" (UID: \"3636791b-cf84-4528-8d8d-bdcdfe73aa88\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-42bxq"
Jul 15 18:21:25.238668 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:21:25.238634    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-cainjector-559cdd8c87-42bxq"
Jul 15 18:21:25.361123 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:21:25.361101    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-cainjector-559cdd8c87-42bxq"]
Jul 15 18:21:25.363653 ip-10-0-141-171 kubenswrapper[2567]: W0715 18:21:25.363625    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod3636791b_cf84_4528_8d8d_bdcdfe73aa88.slice/crio-76afbd87a3a1e64722219c9607370c9d67f680439837fe2e479b4832eb734aa0 WatchSource:0}: Error finding container 76afbd87a3a1e64722219c9607370c9d67f680439837fe2e479b4832eb734aa0: Status 404 returned error can't find the container with id 76afbd87a3a1e64722219c9607370c9d67f680439837fe2e479b4832eb734aa0
Jul 15 18:21:26.355710 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:21:26.355670    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-cainjector-559cdd8c87-42bxq" event={"ID":"3636791b-cf84-4528-8d8d-bdcdfe73aa88","Type":"ContainerStarted","Data":"76afbd87a3a1e64722219c9607370c9d67f680439837fe2e479b4832eb734aa0"}
Jul 15 18:21:29.372068 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:21:29.372031    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-cainjector-559cdd8c87-42bxq" event={"ID":"3636791b-cf84-4528-8d8d-bdcdfe73aa88","Type":"ContainerStarted","Data":"e5c2444774bd5faedd9ee2c0f51cc153773ec8615ba53f7c89242122f13fed64"}
Jul 15 18:21:29.389926 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:21:29.389877    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-cainjector-559cdd8c87-42bxq" podStartSLOduration=2.255796729 podStartE2EDuration="5.389861422s" totalImagesPullingTime="3.134064693s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 18:21:24 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 18:21:29.389107278 +0000 UTC m=+247.923530635" watchObservedRunningTime="2026-07-15 18:21:29.389861422 +0000 UTC m=+247.924284777"
Jul 15 18:21:59.012069 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:21:59.012030    2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-5664889d69-ljx6h"]
Jul 15 18:21:59.063900 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:21:59.063866    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-5664889d69-ljx6h"]
Jul 15 18:21:59.064047 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:21:59.063991    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-5664889d69-ljx6h"
Jul 15 18:21:59.069432 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:21:59.069406    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\""
Jul 15 18:21:59.070078 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:21:59.070024    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\""
Jul 15 18:21:59.070078 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:21:59.070039    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\""
Jul 15 18:21:59.070272 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:21:59.070040    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\""
Jul 15 18:21:59.070272 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:21:59.070210    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-555sq\""
Jul 15 18:21:59.170281 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:21:59.170225    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ldvj8\" (UniqueName: \"kubernetes.io/projected/b41427bd-3d8d-433b-9332-d2460acd529c-kube-api-access-ldvj8\") pod \"opendatahub-operator-controller-manager-5664889d69-ljx6h\" (UID: \"b41427bd-3d8d-433b-9332-d2460acd529c\") " pod="opendatahub/opendatahub-operator-controller-manager-5664889d69-ljx6h"
Jul 15 18:21:59.170461 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:21:59.170376    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/b41427bd-3d8d-433b-9332-d2460acd529c-manifests\") pod \"opendatahub-operator-controller-manager-5664889d69-ljx6h\" (UID: \"b41427bd-3d8d-433b-9332-d2460acd529c\") " pod="opendatahub/opendatahub-operator-controller-manager-5664889d69-ljx6h"
Jul 15 18:21:59.170461 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:21:59.170415    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/b41427bd-3d8d-433b-9332-d2460acd529c-apiservice-cert\") pod \"opendatahub-operator-controller-manager-5664889d69-ljx6h\" (UID: \"b41427bd-3d8d-433b-9332-d2460acd529c\") " pod="opendatahub/opendatahub-operator-controller-manager-5664889d69-ljx6h"
Jul 15 18:21:59.170461 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:21:59.170455    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/b41427bd-3d8d-433b-9332-d2460acd529c-webhook-cert\") pod \"opendatahub-operator-controller-manager-5664889d69-ljx6h\" (UID: \"b41427bd-3d8d-433b-9332-d2460acd529c\") " pod="opendatahub/opendatahub-operator-controller-manager-5664889d69-ljx6h"
Jul 15 18:21:59.170592 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:21:59.170508    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/b41427bd-3d8d-433b-9332-d2460acd529c-tmp\") pod \"opendatahub-operator-controller-manager-5664889d69-ljx6h\" (UID: \"b41427bd-3d8d-433b-9332-d2460acd529c\") " pod="opendatahub/opendatahub-operator-controller-manager-5664889d69-ljx6h"
Jul 15 18:21:59.271410 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:21:59.271329    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ldvj8\" (UniqueName: \"kubernetes.io/projected/b41427bd-3d8d-433b-9332-d2460acd529c-kube-api-access-ldvj8\") pod \"opendatahub-operator-controller-manager-5664889d69-ljx6h\" (UID: \"b41427bd-3d8d-433b-9332-d2460acd529c\") " pod="opendatahub/opendatahub-operator-controller-manager-5664889d69-ljx6h"
Jul 15 18:21:59.271558 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:21:59.271415    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/b41427bd-3d8d-433b-9332-d2460acd529c-manifests\") pod \"opendatahub-operator-controller-manager-5664889d69-ljx6h\" (UID: \"b41427bd-3d8d-433b-9332-d2460acd529c\") " pod="opendatahub/opendatahub-operator-controller-manager-5664889d69-ljx6h"
Jul 15 18:21:59.271558 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:21:59.271440    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/b41427bd-3d8d-433b-9332-d2460acd529c-apiservice-cert\") pod \"opendatahub-operator-controller-manager-5664889d69-ljx6h\" (UID: \"b41427bd-3d8d-433b-9332-d2460acd529c\") " pod="opendatahub/opendatahub-operator-controller-manager-5664889d69-ljx6h"
Jul 15 18:21:59.271558 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:21:59.271472    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/b41427bd-3d8d-433b-9332-d2460acd529c-webhook-cert\") pod \"opendatahub-operator-controller-manager-5664889d69-ljx6h\" (UID: \"b41427bd-3d8d-433b-9332-d2460acd529c\") " pod="opendatahub/opendatahub-operator-controller-manager-5664889d69-ljx6h"
Jul 15 18:21:59.271558 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:21:59.271525    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/b41427bd-3d8d-433b-9332-d2460acd529c-tmp\") pod \"opendatahub-operator-controller-manager-5664889d69-ljx6h\" (UID: \"b41427bd-3d8d-433b-9332-d2460acd529c\") " pod="opendatahub/opendatahub-operator-controller-manager-5664889d69-ljx6h"
Jul 15 18:21:59.271886 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:21:59.271854    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/b41427bd-3d8d-433b-9332-d2460acd529c-manifests\") pod \"opendatahub-operator-controller-manager-5664889d69-ljx6h\" (UID: \"b41427bd-3d8d-433b-9332-d2460acd529c\") " pod="opendatahub/opendatahub-operator-controller-manager-5664889d69-ljx6h"
Jul 15 18:21:59.273785 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:21:59.273764    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/b41427bd-3d8d-433b-9332-d2460acd529c-tmp\") pod \"opendatahub-operator-controller-manager-5664889d69-ljx6h\" (UID: \"b41427bd-3d8d-433b-9332-d2460acd529c\") " pod="opendatahub/opendatahub-operator-controller-manager-5664889d69-ljx6h"
Jul 15 18:21:59.273913 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:21:59.273897    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/b41427bd-3d8d-433b-9332-d2460acd529c-webhook-cert\") pod \"opendatahub-operator-controller-manager-5664889d69-ljx6h\" (UID: \"b41427bd-3d8d-433b-9332-d2460acd529c\") " pod="opendatahub/opendatahub-operator-controller-manager-5664889d69-ljx6h"
Jul 15 18:21:59.273955 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:21:59.273939    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/b41427bd-3d8d-433b-9332-d2460acd529c-apiservice-cert\") pod \"opendatahub-operator-controller-manager-5664889d69-ljx6h\" (UID: \"b41427bd-3d8d-433b-9332-d2460acd529c\") " pod="opendatahub/opendatahub-operator-controller-manager-5664889d69-ljx6h"
Jul 15 18:21:59.279782 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:21:59.279760    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ldvj8\" (UniqueName: \"kubernetes.io/projected/b41427bd-3d8d-433b-9332-d2460acd529c-kube-api-access-ldvj8\") pod \"opendatahub-operator-controller-manager-5664889d69-ljx6h\" (UID: \"b41427bd-3d8d-433b-9332-d2460acd529c\") " pod="opendatahub/opendatahub-operator-controller-manager-5664889d69-ljx6h"
Jul 15 18:21:59.374778 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:21:59.374743    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-5664889d69-ljx6h"
Jul 15 18:21:59.540046 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:21:59.540022    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-5664889d69-ljx6h"]
Jul 15 18:21:59.541740 ip-10-0-141-171 kubenswrapper[2567]: W0715 18:21:59.541707    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb41427bd_3d8d_433b_9332_d2460acd529c.slice/crio-918b97636d5c68ef5be623fcadc2300f85594d6068f8bbbc0a5877409e650c76 WatchSource:0}: Error finding container 918b97636d5c68ef5be623fcadc2300f85594d6068f8bbbc0a5877409e650c76: Status 404 returned error can't find the container with id 918b97636d5c68ef5be623fcadc2300f85594d6068f8bbbc0a5877409e650c76
Jul 15 18:22:00.499389 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:22:00.499355    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-5664889d69-ljx6h" event={"ID":"b41427bd-3d8d-433b-9332-d2460acd529c","Type":"ContainerStarted","Data":"918b97636d5c68ef5be623fcadc2300f85594d6068f8bbbc0a5877409e650c76"}
Jul 15 18:22:03.514094 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:22:03.514057    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-5664889d69-ljx6h" event={"ID":"b41427bd-3d8d-433b-9332-d2460acd529c","Type":"ContainerStarted","Data":"6b1e18557ebef61346d26e5b3f3ae5ea4991812db45a8753f6ee8d651438cb4c"}
Jul 15 18:22:04.522037 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:22:04.521996    2567 generic.go:356] "Generic (PLEG): container finished" podID="b41427bd-3d8d-433b-9332-d2460acd529c" containerID="6b1e18557ebef61346d26e5b3f3ae5ea4991812db45a8753f6ee8d651438cb4c" exitCode=0
Jul 15 18:22:04.522482 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:22:04.522130    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-5664889d69-ljx6h" event={"ID":"b41427bd-3d8d-433b-9332-d2460acd529c","Type":"ContainerDied","Data":"6b1e18557ebef61346d26e5b3f3ae5ea4991812db45a8753f6ee8d651438cb4c"}
Jul 15 18:22:05.527864 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:22:05.527829    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-5664889d69-ljx6h" event={"ID":"b41427bd-3d8d-433b-9332-d2460acd529c","Type":"ContainerStarted","Data":"c781eeb64f7f9724698b1853ae5b2cbb5430f5bf93689e52b607c5996c1629f2"}
Jul 15 18:22:05.528207 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:22:05.527971    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-5664889d69-ljx6h"
Jul 15 18:22:05.549827 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:22:05.549780    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-5664889d69-ljx6h" podStartSLOduration=3.16698702 podStartE2EDuration="7.549764063s" totalImagesPullingTime="3.310747159s" totalInitContainerRuntime="1.072029884s" isStatefulPod=false podCreationTimestamp="2026-07-15 18:21:58 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 18:22:05.548660912 +0000 UTC m=+284.083084269" watchObservedRunningTime="2026-07-15 18:22:05.549764063 +0000 UTC m=+284.084187416"
Jul 15 18:22:16.533985 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:22:16.533951    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-5664889d69-ljx6h"
Jul 15 18:22:19.143126 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:22:19.143093    2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/kube-auth-proxy-6b5bc7bcd6-nk57w"]
Jul 15 18:22:19.146366 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:22:19.146349    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-6b5bc7bcd6-nk57w"
Jul 15 18:22:19.150269 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:22:19.150252    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-creds\""
Jul 15 18:22:19.150502 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:22:19.150485    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\""
Jul 15 18:22:19.150858 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:22:19.150835    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-dockercfg-6lmbd\""
Jul 15 18:22:19.150949 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:22:19.150891    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-tls\""
Jul 15 18:22:19.151637 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:22:19.151619    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\""
Jul 15 18:22:19.163019 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:22:19.162999    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-6b5bc7bcd6-nk57w"]
Jul 15 18:22:19.239711 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:22:19.239669    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/dd26deef-9d7b-471d-b0e1-2838c9312d58-tls-certs\") pod \"kube-auth-proxy-6b5bc7bcd6-nk57w\" (UID: \"dd26deef-9d7b-471d-b0e1-2838c9312d58\") " pod="openshift-ingress/kube-auth-proxy-6b5bc7bcd6-nk57w"
Jul 15 18:22:19.239890 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:22:19.239789    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/dd26deef-9d7b-471d-b0e1-2838c9312d58-tmp\") pod \"kube-auth-proxy-6b5bc7bcd6-nk57w\" (UID: \"dd26deef-9d7b-471d-b0e1-2838c9312d58\") " pod="openshift-ingress/kube-auth-proxy-6b5bc7bcd6-nk57w"
Jul 15 18:22:19.239965 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:22:19.239893    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-84zrf\" (UniqueName: \"kubernetes.io/projected/dd26deef-9d7b-471d-b0e1-2838c9312d58-kube-api-access-84zrf\") pod \"kube-auth-proxy-6b5bc7bcd6-nk57w\" (UID: \"dd26deef-9d7b-471d-b0e1-2838c9312d58\") " pod="openshift-ingress/kube-auth-proxy-6b5bc7bcd6-nk57w"
Jul 15 18:22:19.341123 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:22:19.341085    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/dd26deef-9d7b-471d-b0e1-2838c9312d58-tls-certs\") pod \"kube-auth-proxy-6b5bc7bcd6-nk57w\" (UID: \"dd26deef-9d7b-471d-b0e1-2838c9312d58\") " pod="openshift-ingress/kube-auth-proxy-6b5bc7bcd6-nk57w"
Jul 15 18:22:19.341350 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:22:19.341141    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/dd26deef-9d7b-471d-b0e1-2838c9312d58-tmp\") pod \"kube-auth-proxy-6b5bc7bcd6-nk57w\" (UID: \"dd26deef-9d7b-471d-b0e1-2838c9312d58\") " pod="openshift-ingress/kube-auth-proxy-6b5bc7bcd6-nk57w"
Jul 15 18:22:19.341350 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:22:19.341166    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-84zrf\" (UniqueName: \"kubernetes.io/projected/dd26deef-9d7b-471d-b0e1-2838c9312d58-kube-api-access-84zrf\") pod \"kube-auth-proxy-6b5bc7bcd6-nk57w\" (UID: \"dd26deef-9d7b-471d-b0e1-2838c9312d58\") " pod="openshift-ingress/kube-auth-proxy-6b5bc7bcd6-nk57w"
Jul 15 18:22:19.343387 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:22:19.343356    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/dd26deef-9d7b-471d-b0e1-2838c9312d58-tmp\") pod \"kube-auth-proxy-6b5bc7bcd6-nk57w\" (UID: \"dd26deef-9d7b-471d-b0e1-2838c9312d58\") " pod="openshift-ingress/kube-auth-proxy-6b5bc7bcd6-nk57w"
Jul 15 18:22:19.343524 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:22:19.343506    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/dd26deef-9d7b-471d-b0e1-2838c9312d58-tls-certs\") pod \"kube-auth-proxy-6b5bc7bcd6-nk57w\" (UID: \"dd26deef-9d7b-471d-b0e1-2838c9312d58\") " pod="openshift-ingress/kube-auth-proxy-6b5bc7bcd6-nk57w"
Jul 15 18:22:19.364988 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:22:19.364959    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-84zrf\" (UniqueName: \"kubernetes.io/projected/dd26deef-9d7b-471d-b0e1-2838c9312d58-kube-api-access-84zrf\") pod \"kube-auth-proxy-6b5bc7bcd6-nk57w\" (UID: \"dd26deef-9d7b-471d-b0e1-2838c9312d58\") " pod="openshift-ingress/kube-auth-proxy-6b5bc7bcd6-nk57w"
Jul 15 18:22:19.456131 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:22:19.456098    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-6b5bc7bcd6-nk57w"
Jul 15 18:22:19.620807 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:22:19.620777    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-6b5bc7bcd6-nk57w"]
Jul 15 18:22:19.622292 ip-10-0-141-171 kubenswrapper[2567]: W0715 18:22:19.622265    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddd26deef_9d7b_471d_b0e1_2838c9312d58.slice/crio-d0c1b9934522c7a17fe216d9eb634b3b005d5010eeea3d1d8375d5fd79fab3f1 WatchSource:0}: Error finding container d0c1b9934522c7a17fe216d9eb634b3b005d5010eeea3d1d8375d5fd79fab3f1: Status 404 returned error can't find the container with id d0c1b9934522c7a17fe216d9eb634b3b005d5010eeea3d1d8375d5fd79fab3f1
Jul 15 18:22:19.684374 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:22:19.684070    2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/lws-controller-manager-68b4879c65-bkbss"]
Jul 15 18:22:19.696189 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:22:19.696160    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-68b4879c65-bkbss"
Jul 15 18:22:19.703270 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:22:19.703224    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"openshift-service-ca.crt\""
Jul 15 18:22:19.703491 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:22:19.703474    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"lws-controller-manager-dockercfg-wpdlm\""
Jul 15 18:22:19.703561 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:22:19.703542    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"kube-root-ca.crt\""
Jul 15 18:22:19.704514 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:22:19.704459    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"metrics-server-cert\""
Jul 15 18:22:19.705224 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:22:19.705203    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-68b4879c65-bkbss"]
Jul 15 18:22:19.710483 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:22:19.710439    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"webhook-server-cert\""
Jul 15 18:22:19.712032 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:22:19.712019    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"lws-manager-config\""
Jul 15 18:22:19.744343 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:22:19.744316    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/c22ea5f0-516e-4833-b7ce-0cc1fa048cea-cert\") pod \"lws-controller-manager-68b4879c65-bkbss\" (UID: \"c22ea5f0-516e-4833-b7ce-0cc1fa048cea\") " pod="openshift-lws-operator/lws-controller-manager-68b4879c65-bkbss"
Jul 15 18:22:19.744486 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:22:19.744398    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/c22ea5f0-516e-4833-b7ce-0cc1fa048cea-manager-config\") pod \"lws-controller-manager-68b4879c65-bkbss\" (UID: \"c22ea5f0-516e-4833-b7ce-0cc1fa048cea\") " pod="openshift-lws-operator/lws-controller-manager-68b4879c65-bkbss"
Jul 15 18:22:19.744486 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:22:19.744447    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/c22ea5f0-516e-4833-b7ce-0cc1fa048cea-metrics-cert\") pod \"lws-controller-manager-68b4879c65-bkbss\" (UID: \"c22ea5f0-516e-4833-b7ce-0cc1fa048cea\") " pod="openshift-lws-operator/lws-controller-manager-68b4879c65-bkbss"
Jul 15 18:22:19.744570 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:22:19.744509    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hkphr\" (UniqueName: \"kubernetes.io/projected/c22ea5f0-516e-4833-b7ce-0cc1fa048cea-kube-api-access-hkphr\") pod \"lws-controller-manager-68b4879c65-bkbss\" (UID: \"c22ea5f0-516e-4833-b7ce-0cc1fa048cea\") " pod="openshift-lws-operator/lws-controller-manager-68b4879c65-bkbss"
Jul 15 18:22:19.845081 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:22:19.845039    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/c22ea5f0-516e-4833-b7ce-0cc1fa048cea-manager-config\") pod \"lws-controller-manager-68b4879c65-bkbss\" (UID: \"c22ea5f0-516e-4833-b7ce-0cc1fa048cea\") " pod="openshift-lws-operator/lws-controller-manager-68b4879c65-bkbss"
Jul 15 18:22:19.845081 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:22:19.845092    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/c22ea5f0-516e-4833-b7ce-0cc1fa048cea-metrics-cert\") pod \"lws-controller-manager-68b4879c65-bkbss\" (UID: \"c22ea5f0-516e-4833-b7ce-0cc1fa048cea\") " pod="openshift-lws-operator/lws-controller-manager-68b4879c65-bkbss"
Jul 15 18:22:19.845373 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:22:19.845130    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hkphr\" (UniqueName: \"kubernetes.io/projected/c22ea5f0-516e-4833-b7ce-0cc1fa048cea-kube-api-access-hkphr\") pod \"lws-controller-manager-68b4879c65-bkbss\" (UID: \"c22ea5f0-516e-4833-b7ce-0cc1fa048cea\") " pod="openshift-lws-operator/lws-controller-manager-68b4879c65-bkbss"
Jul 15 18:22:19.845373 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:22:19.845159    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/c22ea5f0-516e-4833-b7ce-0cc1fa048cea-cert\") pod \"lws-controller-manager-68b4879c65-bkbss\" (UID: \"c22ea5f0-516e-4833-b7ce-0cc1fa048cea\") " pod="openshift-lws-operator/lws-controller-manager-68b4879c65-bkbss"
Jul 15 18:22:19.845736 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:22:19.845713    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/c22ea5f0-516e-4833-b7ce-0cc1fa048cea-manager-config\") pod \"lws-controller-manager-68b4879c65-bkbss\" (UID: \"c22ea5f0-516e-4833-b7ce-0cc1fa048cea\") " pod="openshift-lws-operator/lws-controller-manager-68b4879c65-bkbss"
Jul 15 18:22:19.847645 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:22:19.847622    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/c22ea5f0-516e-4833-b7ce-0cc1fa048cea-cert\") pod \"lws-controller-manager-68b4879c65-bkbss\" (UID: \"c22ea5f0-516e-4833-b7ce-0cc1fa048cea\") " pod="openshift-lws-operator/lws-controller-manager-68b4879c65-bkbss"
Jul 15 18:22:19.847748 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:22:19.847681    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/c22ea5f0-516e-4833-b7ce-0cc1fa048cea-metrics-cert\") pod \"lws-controller-manager-68b4879c65-bkbss\" (UID: \"c22ea5f0-516e-4833-b7ce-0cc1fa048cea\") " pod="openshift-lws-operator/lws-controller-manager-68b4879c65-bkbss"
Jul 15 18:22:19.859750 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:22:19.859726    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hkphr\" (UniqueName: \"kubernetes.io/projected/c22ea5f0-516e-4833-b7ce-0cc1fa048cea-kube-api-access-hkphr\") pod \"lws-controller-manager-68b4879c65-bkbss\" (UID: \"c22ea5f0-516e-4833-b7ce-0cc1fa048cea\") " pod="openshift-lws-operator/lws-controller-manager-68b4879c65-bkbss"
Jul 15 18:22:20.007479 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:22:20.007381    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-68b4879c65-bkbss"
Jul 15 18:22:20.154153 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:22:20.154128    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-68b4879c65-bkbss"]
Jul 15 18:22:20.156688 ip-10-0-141-171 kubenswrapper[2567]: W0715 18:22:20.156665    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc22ea5f0_516e_4833_b7ce_0cc1fa048cea.slice/crio-6bb2aa6d999c070a01c76a53405bc793f69e022e9a1b18228c2c18a9bd7cc095 WatchSource:0}: Error finding container 6bb2aa6d999c070a01c76a53405bc793f69e022e9a1b18228c2c18a9bd7cc095: Status 404 returned error can't find the container with id 6bb2aa6d999c070a01c76a53405bc793f69e022e9a1b18228c2c18a9bd7cc095
Jul 15 18:22:20.597022 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:22:20.596974    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-6b5bc7bcd6-nk57w" event={"ID":"dd26deef-9d7b-471d-b0e1-2838c9312d58","Type":"ContainerStarted","Data":"d0c1b9934522c7a17fe216d9eb634b3b005d5010eeea3d1d8375d5fd79fab3f1"}
Jul 15 18:22:20.598192 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:22:20.598159    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-68b4879c65-bkbss" event={"ID":"c22ea5f0-516e-4833-b7ce-0cc1fa048cea","Type":"ContainerStarted","Data":"6bb2aa6d999c070a01c76a53405bc793f69e022e9a1b18228c2c18a9bd7cc095"}
Jul 15 18:22:23.364569 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:22:23.360524    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-creds\""
Jul 15 18:22:23.385247 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:22:23.385207    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-8hmqx_d8816772-beae-4dff-9c51-9043199e488d/ovn-acl-logging/0.log"
Jul 15 18:22:23.386295 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:22:23.386274    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-8hmqx_d8816772-beae-4dff-9c51-9043199e488d/ovn-acl-logging/0.log"
Jul 15 18:22:23.389268 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:22:23.389204    2567 kubelet.go:1648] "Image garbage collection succeeded"
Jul 15 18:22:23.616472 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:22:23.616379    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-6b5bc7bcd6-nk57w" event={"ID":"dd26deef-9d7b-471d-b0e1-2838c9312d58","Type":"ContainerStarted","Data":"f9b08219383f91921386959edb0c2580fc5c8e4b002a65e8ac28f7bcf409e873"}
Jul 15 18:22:23.617800 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:22:23.617772    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-68b4879c65-bkbss" event={"ID":"c22ea5f0-516e-4833-b7ce-0cc1fa048cea","Type":"ContainerStarted","Data":"8722849e0d0b43436d2a1bb7a84bcf07bb25614f812b166c21c16629ce1af134"}
Jul 15 18:22:23.617911 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:22:23.617841    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-lws-operator/lws-controller-manager-68b4879c65-bkbss"
Jul 15 18:22:23.633863 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:22:23.633810    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/kube-auth-proxy-6b5bc7bcd6-nk57w" podStartSLOduration=0.900682956 podStartE2EDuration="4.633789542s" totalImagesPullingTime="3.733106586s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 18:22:19 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 18:22:23.63237703 +0000 UTC m=+302.166800411" watchObservedRunningTime="2026-07-15 18:22:23.633789542 +0000 UTC m=+302.168212900"
Jul 15 18:22:23.649569 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:22:23.649519    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/lws-controller-manager-68b4879c65-bkbss" podStartSLOduration=1.452751803 podStartE2EDuration="4.649502489s" totalImagesPullingTime="3.196750686s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 18:22:19 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 18:22:23.648020488 +0000 UTC m=+302.182443848" watchObservedRunningTime="2026-07-15 18:22:23.649502489 +0000 UTC m=+302.183925844"
Jul 15 18:22:34.624545 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:22:34.624515    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-lws-operator/lws-controller-manager-68b4879c65-bkbss"
Jul 15 18:23:41.411399 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:23:41.411360    2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-78f8879b76-mj5hs"]
Jul 15 18:23:41.414977 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:23:41.414956    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-78f8879b76-mj5hs"
Jul 15 18:23:41.424451 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:23:41.424429    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-78f8879b76-mj5hs"]
Jul 15 18:23:41.556503 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:23:41.556468    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/7891829b-6ded-4135-8675-a7afc0021eee-console-oauth-config\") pod \"console-78f8879b76-mj5hs\" (UID: \"7891829b-6ded-4135-8675-a7afc0021eee\") " pod="openshift-console/console-78f8879b76-mj5hs"
Jul 15 18:23:41.556666 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:23:41.556512    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/7891829b-6ded-4135-8675-a7afc0021eee-console-serving-cert\") pod \"console-78f8879b76-mj5hs\" (UID: \"7891829b-6ded-4135-8675-a7afc0021eee\") " pod="openshift-console/console-78f8879b76-mj5hs"
Jul 15 18:23:41.556666 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:23:41.556534    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/7891829b-6ded-4135-8675-a7afc0021eee-oauth-serving-cert\") pod \"console-78f8879b76-mj5hs\" (UID: \"7891829b-6ded-4135-8675-a7afc0021eee\") " pod="openshift-console/console-78f8879b76-mj5hs"
Jul 15 18:23:41.556666 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:23:41.556601    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7891829b-6ded-4135-8675-a7afc0021eee-trusted-ca-bundle\") pod \"console-78f8879b76-mj5hs\" (UID: \"7891829b-6ded-4135-8675-a7afc0021eee\") " pod="openshift-console/console-78f8879b76-mj5hs"
Jul 15 18:23:41.556666 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:23:41.556641    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/7891829b-6ded-4135-8675-a7afc0021eee-service-ca\") pod \"console-78f8879b76-mj5hs\" (UID: \"7891829b-6ded-4135-8675-a7afc0021eee\") " pod="openshift-console/console-78f8879b76-mj5hs"
Jul 15 18:23:41.556804 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:23:41.556675    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/7891829b-6ded-4135-8675-a7afc0021eee-console-config\") pod \"console-78f8879b76-mj5hs\" (UID: \"7891829b-6ded-4135-8675-a7afc0021eee\") " pod="openshift-console/console-78f8879b76-mj5hs"
Jul 15 18:23:41.556804 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:23:41.556718    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vqmr8\" (UniqueName: \"kubernetes.io/projected/7891829b-6ded-4135-8675-a7afc0021eee-kube-api-access-vqmr8\") pod \"console-78f8879b76-mj5hs\" (UID: \"7891829b-6ded-4135-8675-a7afc0021eee\") " pod="openshift-console/console-78f8879b76-mj5hs"
Jul 15 18:23:41.657771 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:23:41.657738    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/7891829b-6ded-4135-8675-a7afc0021eee-console-oauth-config\") pod \"console-78f8879b76-mj5hs\" (UID: \"7891829b-6ded-4135-8675-a7afc0021eee\") " pod="openshift-console/console-78f8879b76-mj5hs"
Jul 15 18:23:41.657978 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:23:41.657783    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/7891829b-6ded-4135-8675-a7afc0021eee-console-serving-cert\") pod \"console-78f8879b76-mj5hs\" (UID: \"7891829b-6ded-4135-8675-a7afc0021eee\") " pod="openshift-console/console-78f8879b76-mj5hs"
Jul 15 18:23:41.657978 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:23:41.657820    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/7891829b-6ded-4135-8675-a7afc0021eee-oauth-serving-cert\") pod \"console-78f8879b76-mj5hs\" (UID: \"7891829b-6ded-4135-8675-a7afc0021eee\") " pod="openshift-console/console-78f8879b76-mj5hs"
Jul 15 18:23:41.657978 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:23:41.657856    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7891829b-6ded-4135-8675-a7afc0021eee-trusted-ca-bundle\") pod \"console-78f8879b76-mj5hs\" (UID: \"7891829b-6ded-4135-8675-a7afc0021eee\") " pod="openshift-console/console-78f8879b76-mj5hs"
Jul 15 18:23:41.657978 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:23:41.657890    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/7891829b-6ded-4135-8675-a7afc0021eee-service-ca\") pod \"console-78f8879b76-mj5hs\" (UID: \"7891829b-6ded-4135-8675-a7afc0021eee\") " pod="openshift-console/console-78f8879b76-mj5hs"
Jul 15 18:23:41.657978 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:23:41.657936    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/7891829b-6ded-4135-8675-a7afc0021eee-console-config\") pod \"console-78f8879b76-mj5hs\" (UID: \"7891829b-6ded-4135-8675-a7afc0021eee\") " pod="openshift-console/console-78f8879b76-mj5hs"
Jul 15 18:23:41.657978 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:23:41.657964    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vqmr8\" (UniqueName: \"kubernetes.io/projected/7891829b-6ded-4135-8675-a7afc0021eee-kube-api-access-vqmr8\") pod \"console-78f8879b76-mj5hs\" (UID: \"7891829b-6ded-4135-8675-a7afc0021eee\") " pod="openshift-console/console-78f8879b76-mj5hs"
Jul 15 18:23:41.658819 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:23:41.658788    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/7891829b-6ded-4135-8675-a7afc0021eee-oauth-serving-cert\") pod \"console-78f8879b76-mj5hs\" (UID: \"7891829b-6ded-4135-8675-a7afc0021eee\") " pod="openshift-console/console-78f8879b76-mj5hs"
Jul 15 18:23:41.658819 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:23:41.658809    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/7891829b-6ded-4135-8675-a7afc0021eee-service-ca\") pod \"console-78f8879b76-mj5hs\" (UID: \"7891829b-6ded-4135-8675-a7afc0021eee\") " pod="openshift-console/console-78f8879b76-mj5hs"
Jul 15 18:23:41.658964 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:23:41.658790    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/7891829b-6ded-4135-8675-a7afc0021eee-console-config\") pod \"console-78f8879b76-mj5hs\" (UID: \"7891829b-6ded-4135-8675-a7afc0021eee\") " pod="openshift-console/console-78f8879b76-mj5hs"
Jul 15 18:23:41.658964 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:23:41.658840    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7891829b-6ded-4135-8675-a7afc0021eee-trusted-ca-bundle\") pod \"console-78f8879b76-mj5hs\" (UID: \"7891829b-6ded-4135-8675-a7afc0021eee\") " pod="openshift-console/console-78f8879b76-mj5hs"
Jul 15 18:23:41.660206 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:23:41.660180    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/7891829b-6ded-4135-8675-a7afc0021eee-console-oauth-config\") pod \"console-78f8879b76-mj5hs\" (UID: \"7891829b-6ded-4135-8675-a7afc0021eee\") " pod="openshift-console/console-78f8879b76-mj5hs"
Jul 15 18:23:41.660471 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:23:41.660452    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/7891829b-6ded-4135-8675-a7afc0021eee-console-serving-cert\") pod \"console-78f8879b76-mj5hs\" (UID: \"7891829b-6ded-4135-8675-a7afc0021eee\") " pod="openshift-console/console-78f8879b76-mj5hs"
Jul 15 18:23:41.666350 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:23:41.666300    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vqmr8\" (UniqueName: \"kubernetes.io/projected/7891829b-6ded-4135-8675-a7afc0021eee-kube-api-access-vqmr8\") pod \"console-78f8879b76-mj5hs\" (UID: \"7891829b-6ded-4135-8675-a7afc0021eee\") " pod="openshift-console/console-78f8879b76-mj5hs"
Jul 15 18:23:41.724448 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:23:41.724421    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-78f8879b76-mj5hs"
Jul 15 18:23:41.853923 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:23:41.853897    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-78f8879b76-mj5hs"]
Jul 15 18:23:41.856899 ip-10-0-141-171 kubenswrapper[2567]: W0715 18:23:41.856867    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7891829b_6ded_4135_8675_a7afc0021eee.slice/crio-75439c80ddc0671f5697a1bbbc68c9b087d19c90c39470ac9ffa845d62316f39 WatchSource:0}: Error finding container 75439c80ddc0671f5697a1bbbc68c9b087d19c90c39470ac9ffa845d62316f39: Status 404 returned error can't find the container with id 75439c80ddc0671f5697a1bbbc68c9b087d19c90c39470ac9ffa845d62316f39
Jul 15 18:23:41.968778 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:23:41.968741    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-78f8879b76-mj5hs" event={"ID":"7891829b-6ded-4135-8675-a7afc0021eee","Type":"ContainerStarted","Data":"e34f62d455f3ddb839112782086e10aa9b563dac23fba91f1f20d0bfe122749a"}
Jul 15 18:23:41.968936 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:23:41.968797    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-78f8879b76-mj5hs" event={"ID":"7891829b-6ded-4135-8675-a7afc0021eee","Type":"ContainerStarted","Data":"75439c80ddc0671f5697a1bbbc68c9b087d19c90c39470ac9ffa845d62316f39"}
Jul 15 18:23:51.724924 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:23:51.724880    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-78f8879b76-mj5hs"
Jul 15 18:23:51.725420 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:23:51.725158    2567 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-78f8879b76-mj5hs"
Jul 15 18:23:51.729611 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:23:51.729593    2567 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-78f8879b76-mj5hs"
Jul 15 18:23:51.751403 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:23:51.751340    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-78f8879b76-mj5hs" podStartSLOduration=10.75132577 podStartE2EDuration="10.75132577s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 18:23:41 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 18:23:41.987777296 +0000 UTC m=+380.522200676" watchObservedRunningTime="2026-07-15 18:23:51.75132577 +0000 UTC m=+390.285749126"
Jul 15 18:23:52.017660 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:23:52.017577    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-78f8879b76-mj5hs"
Jul 15 18:23:52.071032 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:23:52.070990    2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-65794f774d-kb284"]
Jul 15 18:24:14.428884 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:24:14.428853    2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-h5klp"]
Jul 15 18:24:14.432586 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:24:14.432563    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-h5klp"
Jul 15 18:24:14.435153 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:24:14.435130    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-7p4cx\""
Jul 15 18:24:14.435285 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:24:14.435156    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\""
Jul 15 18:24:14.435285 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:24:14.435199    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\""
Jul 15 18:24:14.446974 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:24:14.446950    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-h5klp"]
Jul 15 18:24:14.554031 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:24:14.553997    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/0fb11901-57d3-46af-972f-80d5cf4c0922-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-h5klp\" (UID: \"0fb11901-57d3-46af-972f-80d5cf4c0922\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-h5klp"
Jul 15 18:24:14.554031 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:24:14.554032    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-q5gfn\" (UniqueName: \"kubernetes.io/projected/0fb11901-57d3-46af-972f-80d5cf4c0922-kube-api-access-q5gfn\") pod \"kuadrant-operator-controller-manager-8684c9ff49-h5klp\" (UID: \"0fb11901-57d3-46af-972f-80d5cf4c0922\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-h5klp"
Jul 15 18:24:14.655507 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:24:14.655394    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/0fb11901-57d3-46af-972f-80d5cf4c0922-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-h5klp\" (UID: \"0fb11901-57d3-46af-972f-80d5cf4c0922\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-h5klp"
Jul 15 18:24:14.655507 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:24:14.655438    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-q5gfn\" (UniqueName: \"kubernetes.io/projected/0fb11901-57d3-46af-972f-80d5cf4c0922-kube-api-access-q5gfn\") pod \"kuadrant-operator-controller-manager-8684c9ff49-h5klp\" (UID: \"0fb11901-57d3-46af-972f-80d5cf4c0922\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-h5klp"
Jul 15 18:24:14.655832 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:24:14.655810    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/0fb11901-57d3-46af-972f-80d5cf4c0922-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-h5klp\" (UID: \"0fb11901-57d3-46af-972f-80d5cf4c0922\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-h5klp"
Jul 15 18:24:14.665781 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:24:14.665761    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-q5gfn\" (UniqueName: \"kubernetes.io/projected/0fb11901-57d3-46af-972f-80d5cf4c0922-kube-api-access-q5gfn\") pod \"kuadrant-operator-controller-manager-8684c9ff49-h5klp\" (UID: \"0fb11901-57d3-46af-972f-80d5cf4c0922\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-h5klp"
Jul 15 18:24:14.744814 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:24:14.744780    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-h5klp"
Jul 15 18:24:14.881299 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:24:14.881275    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-h5klp"]
Jul 15 18:24:14.883647 ip-10-0-141-171 kubenswrapper[2567]: W0715 18:24:14.883617    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0fb11901_57d3_46af_972f_80d5cf4c0922.slice/crio-987cd77182983f48049d27bc8ef6b153cf883ba708de33178861db53e0d71278 WatchSource:0}: Error finding container 987cd77182983f48049d27bc8ef6b153cf883ba708de33178861db53e0d71278: Status 404 returned error can't find the container with id 987cd77182983f48049d27bc8ef6b153cf883ba708de33178861db53e0d71278
Jul 15 18:24:14.886057 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:24:14.886041    2567 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 15 18:24:15.114654 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:24:15.114618    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-h5klp" event={"ID":"0fb11901-57d3-46af-972f-80d5cf4c0922","Type":"ContainerStarted","Data":"987cd77182983f48049d27bc8ef6b153cf883ba708de33178861db53e0d71278"}
Jul 15 18:24:17.093501 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:24:17.093432    2567 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-65794f774d-kb284" podUID="8378f1bb-3794-44c1-8ec8-c4c06ec46960" containerName="console" containerID="cri-o://6857eb223f09bcffdd2ede461dd5d551e534b0f7f02be523bceb9fb23ca3823f" gracePeriod=15
Jul 15 18:24:17.363966 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:24:17.363941    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-65794f774d-kb284"
Jul 15 18:24:17.482261 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:24:17.482203    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8378f1bb-3794-44c1-8ec8-c4c06ec46960-trusted-ca-bundle\") pod \"8378f1bb-3794-44c1-8ec8-c4c06ec46960\" (UID: \"8378f1bb-3794-44c1-8ec8-c4c06ec46960\") "
Jul 15 18:24:17.482261 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:24:17.482260    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/8378f1bb-3794-44c1-8ec8-c4c06ec46960-service-ca\") pod \"8378f1bb-3794-44c1-8ec8-c4c06ec46960\" (UID: \"8378f1bb-3794-44c1-8ec8-c4c06ec46960\") "
Jul 15 18:24:17.482509 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:24:17.482303    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/8378f1bb-3794-44c1-8ec8-c4c06ec46960-console-config\") pod \"8378f1bb-3794-44c1-8ec8-c4c06ec46960\" (UID: \"8378f1bb-3794-44c1-8ec8-c4c06ec46960\") "
Jul 15 18:24:17.482509 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:24:17.482349    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/8378f1bb-3794-44c1-8ec8-c4c06ec46960-oauth-serving-cert\") pod \"8378f1bb-3794-44c1-8ec8-c4c06ec46960\" (UID: \"8378f1bb-3794-44c1-8ec8-c4c06ec46960\") "
Jul 15 18:24:17.482509 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:24:17.482387    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/8378f1bb-3794-44c1-8ec8-c4c06ec46960-console-oauth-config\") pod \"8378f1bb-3794-44c1-8ec8-c4c06ec46960\" (UID: \"8378f1bb-3794-44c1-8ec8-c4c06ec46960\") "
Jul 15 18:24:17.482509 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:24:17.482419    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-fzvq6\" (UniqueName: \"kubernetes.io/projected/8378f1bb-3794-44c1-8ec8-c4c06ec46960-kube-api-access-fzvq6\") pod \"8378f1bb-3794-44c1-8ec8-c4c06ec46960\" (UID: \"8378f1bb-3794-44c1-8ec8-c4c06ec46960\") "
Jul 15 18:24:17.482509 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:24:17.482442    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/8378f1bb-3794-44c1-8ec8-c4c06ec46960-console-serving-cert\") pod \"8378f1bb-3794-44c1-8ec8-c4c06ec46960\" (UID: \"8378f1bb-3794-44c1-8ec8-c4c06ec46960\") "
Jul 15 18:24:17.482758 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:24:17.482682    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8378f1bb-3794-44c1-8ec8-c4c06ec46960-console-config" (OuterVolumeSpecName: "console-config") pod "8378f1bb-3794-44c1-8ec8-c4c06ec46960" (UID: "8378f1bb-3794-44c1-8ec8-c4c06ec46960"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 15 18:24:17.482816 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:24:17.482754    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8378f1bb-3794-44c1-8ec8-c4c06ec46960-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "8378f1bb-3794-44c1-8ec8-c4c06ec46960" (UID: "8378f1bb-3794-44c1-8ec8-c4c06ec46960"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 15 18:24:17.482816 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:24:17.482764    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8378f1bb-3794-44c1-8ec8-c4c06ec46960-service-ca" (OuterVolumeSpecName: "service-ca") pod "8378f1bb-3794-44c1-8ec8-c4c06ec46960" (UID: "8378f1bb-3794-44c1-8ec8-c4c06ec46960"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 15 18:24:17.482918 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:24:17.482829    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8378f1bb-3794-44c1-8ec8-c4c06ec46960-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "8378f1bb-3794-44c1-8ec8-c4c06ec46960" (UID: "8378f1bb-3794-44c1-8ec8-c4c06ec46960"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 15 18:24:17.484710 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:24:17.484684    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8378f1bb-3794-44c1-8ec8-c4c06ec46960-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "8378f1bb-3794-44c1-8ec8-c4c06ec46960" (UID: "8378f1bb-3794-44c1-8ec8-c4c06ec46960"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 15 18:24:17.484846 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:24:17.484742    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8378f1bb-3794-44c1-8ec8-c4c06ec46960-kube-api-access-fzvq6" (OuterVolumeSpecName: "kube-api-access-fzvq6") pod "8378f1bb-3794-44c1-8ec8-c4c06ec46960" (UID: "8378f1bb-3794-44c1-8ec8-c4c06ec46960"). InnerVolumeSpecName "kube-api-access-fzvq6". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 15 18:24:17.484846 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:24:17.484774    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8378f1bb-3794-44c1-8ec8-c4c06ec46960-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "8378f1bb-3794-44c1-8ec8-c4c06ec46960" (UID: "8378f1bb-3794-44c1-8ec8-c4c06ec46960"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 15 18:24:17.583375 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:24:17.583345    2567 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/8378f1bb-3794-44c1-8ec8-c4c06ec46960-oauth-serving-cert\") on node \"ip-10-0-141-171.ec2.internal\" DevicePath \"\""
Jul 15 18:24:17.583375 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:24:17.583369    2567 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/8378f1bb-3794-44c1-8ec8-c4c06ec46960-console-oauth-config\") on node \"ip-10-0-141-171.ec2.internal\" DevicePath \"\""
Jul 15 18:24:17.583375 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:24:17.583379    2567 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-fzvq6\" (UniqueName: \"kubernetes.io/projected/8378f1bb-3794-44c1-8ec8-c4c06ec46960-kube-api-access-fzvq6\") on node \"ip-10-0-141-171.ec2.internal\" DevicePath \"\""
Jul 15 18:24:17.583601 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:24:17.583387    2567 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/8378f1bb-3794-44c1-8ec8-c4c06ec46960-console-serving-cert\") on node \"ip-10-0-141-171.ec2.internal\" DevicePath \"\""
Jul 15 18:24:17.583601 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:24:17.583395    2567 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8378f1bb-3794-44c1-8ec8-c4c06ec46960-trusted-ca-bundle\") on node \"ip-10-0-141-171.ec2.internal\" DevicePath \"\""
Jul 15 18:24:17.583601 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:24:17.583404    2567 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/8378f1bb-3794-44c1-8ec8-c4c06ec46960-service-ca\") on node \"ip-10-0-141-171.ec2.internal\" DevicePath \"\""
Jul 15 18:24:17.583601 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:24:17.583412    2567 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/8378f1bb-3794-44c1-8ec8-c4c06ec46960-console-config\") on node \"ip-10-0-141-171.ec2.internal\" DevicePath \"\""
Jul 15 18:24:18.130832 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:24:18.130797    2567 generic.go:356] "Generic (PLEG): container finished" podID="8378f1bb-3794-44c1-8ec8-c4c06ec46960" containerID="6857eb223f09bcffdd2ede461dd5d551e534b0f7f02be523bceb9fb23ca3823f" exitCode=0
Jul 15 18:24:18.131196 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:24:18.130845    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-65794f774d-kb284"
Jul 15 18:24:18.131196 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:24:18.130875    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-65794f774d-kb284" event={"ID":"8378f1bb-3794-44c1-8ec8-c4c06ec46960","Type":"ContainerDied","Data":"6857eb223f09bcffdd2ede461dd5d551e534b0f7f02be523bceb9fb23ca3823f"}
Jul 15 18:24:18.131196 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:24:18.130950    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-65794f774d-kb284" event={"ID":"8378f1bb-3794-44c1-8ec8-c4c06ec46960","Type":"ContainerDied","Data":"367bbe3525139fd554592c5b312b874ca8f01fa065849049bdf638e648d0c572"}
Jul 15 18:24:18.131196 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:24:18.130970    2567 scope.go:117] "RemoveContainer" containerID="6857eb223f09bcffdd2ede461dd5d551e534b0f7f02be523bceb9fb23ca3823f"
Jul 15 18:24:18.140145 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:24:18.140127    2567 scope.go:117] "RemoveContainer" containerID="6857eb223f09bcffdd2ede461dd5d551e534b0f7f02be523bceb9fb23ca3823f"
Jul 15 18:24:18.140436 ip-10-0-141-171 kubenswrapper[2567]: E0715 18:24:18.140416    2567 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6857eb223f09bcffdd2ede461dd5d551e534b0f7f02be523bceb9fb23ca3823f\": container with ID starting with 6857eb223f09bcffdd2ede461dd5d551e534b0f7f02be523bceb9fb23ca3823f not found: ID does not exist" containerID="6857eb223f09bcffdd2ede461dd5d551e534b0f7f02be523bceb9fb23ca3823f"
Jul 15 18:24:18.140506 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:24:18.140449    2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6857eb223f09bcffdd2ede461dd5d551e534b0f7f02be523bceb9fb23ca3823f"} err="failed to get container status \"6857eb223f09bcffdd2ede461dd5d551e534b0f7f02be523bceb9fb23ca3823f\": rpc error: code = NotFound desc = could not find container \"6857eb223f09bcffdd2ede461dd5d551e534b0f7f02be523bceb9fb23ca3823f\": container with ID starting with 6857eb223f09bcffdd2ede461dd5d551e534b0f7f02be523bceb9fb23ca3823f not found: ID does not exist"
Jul 15 18:24:18.154151 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:24:18.154124    2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-65794f774d-kb284"]
Jul 15 18:24:18.158090 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:24:18.158064    2567 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-65794f774d-kb284"]
Jul 15 18:24:18.206888 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:24:18.206854    2567 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="8378f1bb-3794-44c1-8ec8-c4c06ec46960" path="/var/lib/kubelet/pods/8378f1bb-3794-44c1-8ec8-c4c06ec46960/volumes"
Jul 15 18:24:21.151546 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:24:21.151506    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-h5klp" event={"ID":"0fb11901-57d3-46af-972f-80d5cf4c0922","Type":"ContainerStarted","Data":"5b7866ec8e6c9c067c8bfbcaa70c8aa172241367ad35173f7837c0678077b489"}
Jul 15 18:24:21.151965 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:24:21.151625    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-h5klp"
Jul 15 18:24:21.170906 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:24:21.170863    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-h5klp" podStartSLOduration=1.9665236149999998 podStartE2EDuration="7.170844007s" totalImagesPullingTime="5.204320392s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 18:24:14 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 18:24:21.169614658 +0000 UTC m=+419.704038013" watchObservedRunningTime="2026-07-15 18:24:21.170844007 +0000 UTC m=+419.705267363"
Jul 15 18:24:32.157764 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:24:32.157733    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-h5klp"
Jul 15 18:24:37.671459 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:24:37.671427    2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-h5klp"]
Jul 15 18:24:37.671846 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:24:37.671659    2567 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-h5klp" podUID="0fb11901-57d3-46af-972f-80d5cf4c0922" containerName="manager" containerID="cri-o://5b7866ec8e6c9c067c8bfbcaa70c8aa172241367ad35173f7837c0678077b489" gracePeriod=10
Jul 15 18:24:38.710638 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:24:38.710612    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-h5klp"
Jul 15 18:24:38.878857 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:24:38.878774    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-q5gfn\" (UniqueName: \"kubernetes.io/projected/0fb11901-57d3-46af-972f-80d5cf4c0922-kube-api-access-q5gfn\") pod \"0fb11901-57d3-46af-972f-80d5cf4c0922\" (UID: \"0fb11901-57d3-46af-972f-80d5cf4c0922\") "
Jul 15 18:24:38.878857 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:24:38.878848    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/0fb11901-57d3-46af-972f-80d5cf4c0922-extensions-socket-volume\") pod \"0fb11901-57d3-46af-972f-80d5cf4c0922\" (UID: \"0fb11901-57d3-46af-972f-80d5cf4c0922\") "
Jul 15 18:24:38.879192 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:24:38.879167    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0fb11901-57d3-46af-972f-80d5cf4c0922-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "0fb11901-57d3-46af-972f-80d5cf4c0922" (UID: "0fb11901-57d3-46af-972f-80d5cf4c0922"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 15 18:24:38.880982 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:24:38.880962    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0fb11901-57d3-46af-972f-80d5cf4c0922-kube-api-access-q5gfn" (OuterVolumeSpecName: "kube-api-access-q5gfn") pod "0fb11901-57d3-46af-972f-80d5cf4c0922" (UID: "0fb11901-57d3-46af-972f-80d5cf4c0922"). InnerVolumeSpecName "kube-api-access-q5gfn". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 15 18:24:38.980257 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:24:38.980205    2567 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-q5gfn\" (UniqueName: \"kubernetes.io/projected/0fb11901-57d3-46af-972f-80d5cf4c0922-kube-api-access-q5gfn\") on node \"ip-10-0-141-171.ec2.internal\" DevicePath \"\""
Jul 15 18:24:38.980257 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:24:38.980250    2567 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/0fb11901-57d3-46af-972f-80d5cf4c0922-extensions-socket-volume\") on node \"ip-10-0-141-171.ec2.internal\" DevicePath \"\""
Jul 15 18:24:39.235398 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:24:39.235362    2567 generic.go:356] "Generic (PLEG): container finished" podID="0fb11901-57d3-46af-972f-80d5cf4c0922" containerID="5b7866ec8e6c9c067c8bfbcaa70c8aa172241367ad35173f7837c0678077b489" exitCode=0
Jul 15 18:24:39.235581 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:24:39.235407    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-h5klp" event={"ID":"0fb11901-57d3-46af-972f-80d5cf4c0922","Type":"ContainerDied","Data":"5b7866ec8e6c9c067c8bfbcaa70c8aa172241367ad35173f7837c0678077b489"}
Jul 15 18:24:39.235581 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:24:39.235431    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-h5klp"
Jul 15 18:24:39.235581 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:24:39.235469    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-h5klp" event={"ID":"0fb11901-57d3-46af-972f-80d5cf4c0922","Type":"ContainerDied","Data":"987cd77182983f48049d27bc8ef6b153cf883ba708de33178861db53e0d71278"}
Jul 15 18:24:39.235581 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:24:39.235499    2567 scope.go:117] "RemoveContainer" containerID="5b7866ec8e6c9c067c8bfbcaa70c8aa172241367ad35173f7837c0678077b489"
Jul 15 18:24:39.244778 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:24:39.244759    2567 scope.go:117] "RemoveContainer" containerID="5b7866ec8e6c9c067c8bfbcaa70c8aa172241367ad35173f7837c0678077b489"
Jul 15 18:24:39.245016 ip-10-0-141-171 kubenswrapper[2567]: E0715 18:24:39.244998    2567 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5b7866ec8e6c9c067c8bfbcaa70c8aa172241367ad35173f7837c0678077b489\": container with ID starting with 5b7866ec8e6c9c067c8bfbcaa70c8aa172241367ad35173f7837c0678077b489 not found: ID does not exist" containerID="5b7866ec8e6c9c067c8bfbcaa70c8aa172241367ad35173f7837c0678077b489"
Jul 15 18:24:39.245057 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:24:39.245024    2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5b7866ec8e6c9c067c8bfbcaa70c8aa172241367ad35173f7837c0678077b489"} err="failed to get container status \"5b7866ec8e6c9c067c8bfbcaa70c8aa172241367ad35173f7837c0678077b489\": rpc error: code = NotFound desc = could not find container \"5b7866ec8e6c9c067c8bfbcaa70c8aa172241367ad35173f7837c0678077b489\": container with ID starting with 5b7866ec8e6c9c067c8bfbcaa70c8aa172241367ad35173f7837c0678077b489 not found: ID does not exist"
Jul 15 18:24:39.258433 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:24:39.258414    2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-h5klp"]
Jul 15 18:24:39.265164 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:24:39.265144    2567 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-h5klp"]
Jul 15 18:24:40.205949 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:24:40.205919    2567 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="0fb11901-57d3-46af-972f-80d5cf4c0922" path="/var/lib/kubelet/pods/0fb11901-57d3-46af-972f-80d5cf4c0922/volumes"
Jul 15 18:24:59.090107 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:24:59.090077    2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-xkk68"]
Jul 15 18:24:59.090571 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:24:59.090469    2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8378f1bb-3794-44c1-8ec8-c4c06ec46960" containerName="console"
Jul 15 18:24:59.090571 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:24:59.090481    2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="8378f1bb-3794-44c1-8ec8-c4c06ec46960" containerName="console"
Jul 15 18:24:59.090571 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:24:59.090488    2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0fb11901-57d3-46af-972f-80d5cf4c0922" containerName="manager"
Jul 15 18:24:59.090571 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:24:59.090493    2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="0fb11901-57d3-46af-972f-80d5cf4c0922" containerName="manager"
Jul 15 18:24:59.090571 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:24:59.090554    2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="0fb11901-57d3-46af-972f-80d5cf4c0922" containerName="manager"
Jul 15 18:24:59.090571 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:24:59.090562    2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="8378f1bb-3794-44c1-8ec8-c4c06ec46960" containerName="console"
Jul 15 18:24:59.093489 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:24:59.093471    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-xkk68"
Jul 15 18:24:59.096022 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:24:59.096002    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\""
Jul 15 18:24:59.096678 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:24:59.096663    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"limitador-limits-config-limitador\""
Jul 15 18:24:59.096752 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:24:59.096681    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\""
Jul 15 18:24:59.096752 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:24:59.096739    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-dpmc2\""
Jul 15 18:24:59.105846 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:24:59.105826    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-xkk68"]
Jul 15 18:24:59.146079 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:24:59.146051    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/f80b652d-d80f-4b8a-bad1-cc92c04d7918-config-file\") pod \"limitador-limitador-64c94fd64f-xkk68\" (UID: \"f80b652d-d80f-4b8a-bad1-cc92c04d7918\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-xkk68"
Jul 15 18:24:59.146266 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:24:59.146089    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-z72lf\" (UniqueName: \"kubernetes.io/projected/f80b652d-d80f-4b8a-bad1-cc92c04d7918-kube-api-access-z72lf\") pod \"limitador-limitador-64c94fd64f-xkk68\" (UID: \"f80b652d-d80f-4b8a-bad1-cc92c04d7918\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-xkk68"
Jul 15 18:24:59.188297 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:24:59.188260    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-xkk68"]
Jul 15 18:24:59.247034 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:24:59.246996    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/f80b652d-d80f-4b8a-bad1-cc92c04d7918-config-file\") pod \"limitador-limitador-64c94fd64f-xkk68\" (UID: \"f80b652d-d80f-4b8a-bad1-cc92c04d7918\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-xkk68"
Jul 15 18:24:59.247219 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:24:59.247052    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-z72lf\" (UniqueName: \"kubernetes.io/projected/f80b652d-d80f-4b8a-bad1-cc92c04d7918-kube-api-access-z72lf\") pod \"limitador-limitador-64c94fd64f-xkk68\" (UID: \"f80b652d-d80f-4b8a-bad1-cc92c04d7918\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-xkk68"
Jul 15 18:24:59.247679 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:24:59.247660    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/f80b652d-d80f-4b8a-bad1-cc92c04d7918-config-file\") pod \"limitador-limitador-64c94fd64f-xkk68\" (UID: \"f80b652d-d80f-4b8a-bad1-cc92c04d7918\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-xkk68"
Jul 15 18:24:59.258726 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:24:59.258703    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-z72lf\" (UniqueName: \"kubernetes.io/projected/f80b652d-d80f-4b8a-bad1-cc92c04d7918-kube-api-access-z72lf\") pod \"limitador-limitador-64c94fd64f-xkk68\" (UID: \"f80b652d-d80f-4b8a-bad1-cc92c04d7918\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-xkk68"
Jul 15 18:24:59.403729 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:24:59.403642    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-xkk68"
Jul 15 18:24:59.434264 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:24:59.431058    2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-qfldk"]
Jul 15 18:24:59.440768 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:24:59.440744    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-54d6d988d5-qfldk"
Jul 15 18:24:59.450500 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:24:59.450476    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-qfldk"]
Jul 15 18:24:59.477937 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:24:59.477908    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-qfldk"]
Jul 15 18:24:59.549691 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:24:59.549641    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-xkk68"]
Jul 15 18:24:59.549931 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:24:59.549913    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/b0193733-3432-4db9-a6c8-bbd85c79b008-config-file\") pod \"limitador-limitador-54d6d988d5-qfldk\" (UID: \"b0193733-3432-4db9-a6c8-bbd85c79b008\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-qfldk"
Jul 15 18:24:59.549975 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:24:59.549952    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-77smq\" (UniqueName: \"kubernetes.io/projected/b0193733-3432-4db9-a6c8-bbd85c79b008-kube-api-access-77smq\") pod \"limitador-limitador-54d6d988d5-qfldk\" (UID: \"b0193733-3432-4db9-a6c8-bbd85c79b008\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-qfldk"
Jul 15 18:24:59.552056 ip-10-0-141-171 kubenswrapper[2567]: W0715 18:24:59.552032    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf80b652d_d80f_4b8a_bad1_cc92c04d7918.slice/crio-aa6a95f464c2850004768ac15355c2efe3210c7093aae54b220b573af80e97f4 WatchSource:0}: Error finding container aa6a95f464c2850004768ac15355c2efe3210c7093aae54b220b573af80e97f4: Status 404 returned error can't find the container with id aa6a95f464c2850004768ac15355c2efe3210c7093aae54b220b573af80e97f4
Jul 15 18:24:59.650815 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:24:59.650786    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/b0193733-3432-4db9-a6c8-bbd85c79b008-config-file\") pod \"limitador-limitador-54d6d988d5-qfldk\" (UID: \"b0193733-3432-4db9-a6c8-bbd85c79b008\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-qfldk"
Jul 15 18:24:59.650930 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:24:59.650825    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-77smq\" (UniqueName: \"kubernetes.io/projected/b0193733-3432-4db9-a6c8-bbd85c79b008-kube-api-access-77smq\") pod \"limitador-limitador-54d6d988d5-qfldk\" (UID: \"b0193733-3432-4db9-a6c8-bbd85c79b008\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-qfldk"
Jul 15 18:24:59.651446 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:24:59.651428    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/b0193733-3432-4db9-a6c8-bbd85c79b008-config-file\") pod \"limitador-limitador-54d6d988d5-qfldk\" (UID: \"b0193733-3432-4db9-a6c8-bbd85c79b008\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-qfldk"
Jul 15 18:24:59.660594 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:24:59.660541    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-77smq\" (UniqueName: \"kubernetes.io/projected/b0193733-3432-4db9-a6c8-bbd85c79b008-kube-api-access-77smq\") pod \"limitador-limitador-54d6d988d5-qfldk\" (UID: \"b0193733-3432-4db9-a6c8-bbd85c79b008\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-qfldk"
Jul 15 18:24:59.752917 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:24:59.752892    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-54d6d988d5-qfldk"
Jul 15 18:24:59.879773 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:24:59.879686    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-qfldk"]
Jul 15 18:24:59.881954 ip-10-0-141-171 kubenswrapper[2567]: W0715 18:24:59.881924    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb0193733_3432_4db9_a6c8_bbd85c79b008.slice/crio-e763fb8b499a4930665243f0a2f5760fb2aa21e1f3f695cf0d3ad8afc3723421 WatchSource:0}: Error finding container e763fb8b499a4930665243f0a2f5760fb2aa21e1f3f695cf0d3ad8afc3723421: Status 404 returned error can't find the container with id e763fb8b499a4930665243f0a2f5760fb2aa21e1f3f695cf0d3ad8afc3723421
Jul 15 18:25:00.330223 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:25:00.330184    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-54d6d988d5-qfldk" event={"ID":"b0193733-3432-4db9-a6c8-bbd85c79b008","Type":"ContainerStarted","Data":"e763fb8b499a4930665243f0a2f5760fb2aa21e1f3f695cf0d3ad8afc3723421"}
Jul 15 18:25:00.331441 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:25:00.331415    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-xkk68" event={"ID":"f80b652d-d80f-4b8a-bad1-cc92c04d7918","Type":"ContainerStarted","Data":"aa6a95f464c2850004768ac15355c2efe3210c7093aae54b220b573af80e97f4"}
Jul 15 18:25:03.347106 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:25:03.347076    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-xkk68" event={"ID":"f80b652d-d80f-4b8a-bad1-cc92c04d7918","Type":"ContainerStarted","Data":"5e31b5e387ce16ed3aab60ac3012eb31465dd493dc28a53a1b20c67a46308565"}
Jul 15 18:25:03.347561 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:25:03.347156    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-limitador-64c94fd64f-xkk68"
Jul 15 18:25:03.348620 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:25:03.348596    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-54d6d988d5-qfldk" event={"ID":"b0193733-3432-4db9-a6c8-bbd85c79b008","Type":"ContainerStarted","Data":"6c931298294d953c3427cbbbf9065eba137955ae9b00ab0bdaf5e38281bb1e0a"}
Jul 15 18:25:03.348730 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:25:03.348643    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-limitador-54d6d988d5-qfldk"
Jul 15 18:25:03.363535 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:25:03.363496    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-limitador-64c94fd64f-xkk68" podStartSLOduration=1.410934855 podStartE2EDuration="4.363484193s" totalImagesPullingTime="2.952549338s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 18:24:59 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 18:25:03.362444767 +0000 UTC m=+461.896868124" watchObservedRunningTime="2026-07-15 18:25:03.363484193 +0000 UTC m=+461.897907526"
Jul 15 18:25:03.381447 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:25:03.381398    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-limitador-54d6d988d5-qfldk" podStartSLOduration=1.7504012370000002 podStartE2EDuration="4.381382753s" totalImagesPullingTime="2.630981516s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 18:24:59 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 18:25:03.38055001 +0000 UTC m=+461.914973367" watchObservedRunningTime="2026-07-15 18:25:03.381382753 +0000 UTC m=+461.915806111"
Jul 15 18:25:14.353902 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:25:14.353869    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-limitador-64c94fd64f-xkk68"
Jul 15 18:25:14.354302 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:25:14.353942    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-limitador-54d6d988d5-qfldk"
Jul 15 18:25:14.437281 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:25:14.437254    2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-xkk68"]
Jul 15 18:25:14.437448 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:25:14.437427    2567 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/limitador-limitador-64c94fd64f-xkk68" podUID="f80b652d-d80f-4b8a-bad1-cc92c04d7918" containerName="limitador" containerID="cri-o://5e31b5e387ce16ed3aab60ac3012eb31465dd493dc28a53a1b20c67a46308565" gracePeriod=30
Jul 15 18:25:14.988979 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:25:14.988955    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-xkk68"
Jul 15 18:25:15.093384 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:25:15.093284    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/f80b652d-d80f-4b8a-bad1-cc92c04d7918-config-file\") pod \"f80b652d-d80f-4b8a-bad1-cc92c04d7918\" (UID: \"f80b652d-d80f-4b8a-bad1-cc92c04d7918\") "
Jul 15 18:25:15.093384 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:25:15.093329    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-z72lf\" (UniqueName: \"kubernetes.io/projected/f80b652d-d80f-4b8a-bad1-cc92c04d7918-kube-api-access-z72lf\") pod \"f80b652d-d80f-4b8a-bad1-cc92c04d7918\" (UID: \"f80b652d-d80f-4b8a-bad1-cc92c04d7918\") "
Jul 15 18:25:15.093650 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:25:15.093627    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f80b652d-d80f-4b8a-bad1-cc92c04d7918-config-file" (OuterVolumeSpecName: "config-file") pod "f80b652d-d80f-4b8a-bad1-cc92c04d7918" (UID: "f80b652d-d80f-4b8a-bad1-cc92c04d7918"). InnerVolumeSpecName "config-file". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 15 18:25:15.095430 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:25:15.095400    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f80b652d-d80f-4b8a-bad1-cc92c04d7918-kube-api-access-z72lf" (OuterVolumeSpecName: "kube-api-access-z72lf") pod "f80b652d-d80f-4b8a-bad1-cc92c04d7918" (UID: "f80b652d-d80f-4b8a-bad1-cc92c04d7918"). InnerVolumeSpecName "kube-api-access-z72lf". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 15 18:25:15.194790 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:25:15.194741    2567 reconciler_common.go:299] "Volume detached for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/f80b652d-d80f-4b8a-bad1-cc92c04d7918-config-file\") on node \"ip-10-0-141-171.ec2.internal\" DevicePath \"\""
Jul 15 18:25:15.194790 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:25:15.194783    2567 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-z72lf\" (UniqueName: \"kubernetes.io/projected/f80b652d-d80f-4b8a-bad1-cc92c04d7918-kube-api-access-z72lf\") on node \"ip-10-0-141-171.ec2.internal\" DevicePath \"\""
Jul 15 18:25:15.402826 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:25:15.402734    2567 generic.go:356] "Generic (PLEG): container finished" podID="f80b652d-d80f-4b8a-bad1-cc92c04d7918" containerID="5e31b5e387ce16ed3aab60ac3012eb31465dd493dc28a53a1b20c67a46308565" exitCode=0
Jul 15 18:25:15.402826 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:25:15.402777    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-xkk68"
Jul 15 18:25:15.402826 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:25:15.402792    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-xkk68" event={"ID":"f80b652d-d80f-4b8a-bad1-cc92c04d7918","Type":"ContainerDied","Data":"5e31b5e387ce16ed3aab60ac3012eb31465dd493dc28a53a1b20c67a46308565"}
Jul 15 18:25:15.403353 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:25:15.402846    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-xkk68" event={"ID":"f80b652d-d80f-4b8a-bad1-cc92c04d7918","Type":"ContainerDied","Data":"aa6a95f464c2850004768ac15355c2efe3210c7093aae54b220b573af80e97f4"}
Jul 15 18:25:15.403353 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:25:15.402876    2567 scope.go:117] "RemoveContainer" containerID="5e31b5e387ce16ed3aab60ac3012eb31465dd493dc28a53a1b20c67a46308565"
Jul 15 18:25:15.411817 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:25:15.411799    2567 scope.go:117] "RemoveContainer" containerID="5e31b5e387ce16ed3aab60ac3012eb31465dd493dc28a53a1b20c67a46308565"
Jul 15 18:25:15.412089 ip-10-0-141-171 kubenswrapper[2567]: E0715 18:25:15.412070    2567 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5e31b5e387ce16ed3aab60ac3012eb31465dd493dc28a53a1b20c67a46308565\": container with ID starting with 5e31b5e387ce16ed3aab60ac3012eb31465dd493dc28a53a1b20c67a46308565 not found: ID does not exist" containerID="5e31b5e387ce16ed3aab60ac3012eb31465dd493dc28a53a1b20c67a46308565"
Jul 15 18:25:15.412132 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:25:15.412100    2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5e31b5e387ce16ed3aab60ac3012eb31465dd493dc28a53a1b20c67a46308565"} err="failed to get container status \"5e31b5e387ce16ed3aab60ac3012eb31465dd493dc28a53a1b20c67a46308565\": rpc error: code = NotFound desc = could not find container \"5e31b5e387ce16ed3aab60ac3012eb31465dd493dc28a53a1b20c67a46308565\": container with ID starting with 5e31b5e387ce16ed3aab60ac3012eb31465dd493dc28a53a1b20c67a46308565 not found: ID does not exist"
Jul 15 18:25:15.424324 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:25:15.424304    2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-xkk68"]
Jul 15 18:25:15.428034 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:25:15.428010    2567 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-xkk68"]
Jul 15 18:25:16.206743 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:25:16.206713    2567 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f80b652d-d80f-4b8a-bad1-cc92c04d7918" path="/var/lib/kubelet/pods/f80b652d-d80f-4b8a-bad1-cc92c04d7918/volumes"
Jul 15 18:25:17.592553 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:25:17.592516    2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/postgres-69fb4594cf-z8rt8"]
Jul 15 18:25:17.593095 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:25:17.593077    2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f80b652d-d80f-4b8a-bad1-cc92c04d7918" containerName="limitador"
Jul 15 18:25:17.593150 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:25:17.593100    2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="f80b652d-d80f-4b8a-bad1-cc92c04d7918" containerName="limitador"
Jul 15 18:25:17.593204 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:25:17.593196    2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="f80b652d-d80f-4b8a-bad1-cc92c04d7918" containerName="limitador"
Jul 15 18:25:17.597679 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:25:17.597660    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/postgres-69fb4594cf-z8rt8"
Jul 15 18:25:17.599906 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:25:17.599888    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"default-dockercfg-9rfv6\""
Jul 15 18:25:17.599906 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:25:17.599900    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"kube-root-ca.crt\""
Jul 15 18:25:17.600589 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:25:17.600574    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"postgres-creds\""
Jul 15 18:25:17.600589 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:25:17.600581    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 15 18:25:17.607426 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:25:17.607400    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/postgres-69fb4594cf-z8rt8"]
Jul 15 18:25:17.717647 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:25:17.717615    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/b6f7a534-ecf3-45db-bebc-7e252380e96a-data\") pod \"postgres-69fb4594cf-z8rt8\" (UID: \"b6f7a534-ecf3-45db-bebc-7e252380e96a\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-z8rt8"
Jul 15 18:25:17.717795 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:25:17.717680    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dlbrd\" (UniqueName: \"kubernetes.io/projected/b6f7a534-ecf3-45db-bebc-7e252380e96a-kube-api-access-dlbrd\") pod \"postgres-69fb4594cf-z8rt8\" (UID: \"b6f7a534-ecf3-45db-bebc-7e252380e96a\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-z8rt8"
Jul 15 18:25:17.818821 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:25:17.818789    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dlbrd\" (UniqueName: \"kubernetes.io/projected/b6f7a534-ecf3-45db-bebc-7e252380e96a-kube-api-access-dlbrd\") pod \"postgres-69fb4594cf-z8rt8\" (UID: \"b6f7a534-ecf3-45db-bebc-7e252380e96a\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-z8rt8"
Jul 15 18:25:17.818976 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:25:17.818868    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/b6f7a534-ecf3-45db-bebc-7e252380e96a-data\") pod \"postgres-69fb4594cf-z8rt8\" (UID: \"b6f7a534-ecf3-45db-bebc-7e252380e96a\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-z8rt8"
Jul 15 18:25:17.819192 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:25:17.819176    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/b6f7a534-ecf3-45db-bebc-7e252380e96a-data\") pod \"postgres-69fb4594cf-z8rt8\" (UID: \"b6f7a534-ecf3-45db-bebc-7e252380e96a\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-z8rt8"
Jul 15 18:25:17.826603 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:25:17.826577    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dlbrd\" (UniqueName: \"kubernetes.io/projected/b6f7a534-ecf3-45db-bebc-7e252380e96a-kube-api-access-dlbrd\") pod \"postgres-69fb4594cf-z8rt8\" (UID: \"b6f7a534-ecf3-45db-bebc-7e252380e96a\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-z8rt8"
Jul 15 18:25:17.913264 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:25:17.913175    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/postgres-69fb4594cf-z8rt8"
Jul 15 18:25:18.040205 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:25:18.040180    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/postgres-69fb4594cf-z8rt8"]
Jul 15 18:25:18.042436 ip-10-0-141-171 kubenswrapper[2567]: W0715 18:25:18.042411    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb6f7a534_ecf3_45db_bebc_7e252380e96a.slice/crio-48aed9c637c59298b8500b45db7db36b26edf7bc925fae8255286eb980de4119 WatchSource:0}: Error finding container 48aed9c637c59298b8500b45db7db36b26edf7bc925fae8255286eb980de4119: Status 404 returned error can't find the container with id 48aed9c637c59298b8500b45db7db36b26edf7bc925fae8255286eb980de4119
Jul 15 18:25:18.418878 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:25:18.418847    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/postgres-69fb4594cf-z8rt8" event={"ID":"b6f7a534-ecf3-45db-bebc-7e252380e96a","Type":"ContainerStarted","Data":"48aed9c637c59298b8500b45db7db36b26edf7bc925fae8255286eb980de4119"}
Jul 15 18:25:22.788854 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:25:22.788826    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"postgres-creds\""
Jul 15 18:25:23.447738 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:25:23.447705    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/postgres-69fb4594cf-z8rt8" event={"ID":"b6f7a534-ecf3-45db-bebc-7e252380e96a","Type":"ContainerStarted","Data":"6eac8abe360df6c2e57f24ced80b84691d0aa6dc5b9a57808e1efa6a3196a174"}
Jul 15 18:25:23.447875 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:25:23.447770    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/postgres-69fb4594cf-z8rt8"
Jul 15 18:25:23.462867 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:25:23.462817    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/postgres-69fb4594cf-z8rt8" podStartSLOduration=1.720115792 podStartE2EDuration="6.462803346s" totalImagesPullingTime="4.742687554s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 18:25:17 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 18:25:23.46243777 +0000 UTC m=+481.996861126" watchObservedRunningTime="2026-07-15 18:25:23.462803346 +0000 UTC m=+481.997226702"
Jul 15 18:25:29.482456 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:25:29.482427    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/postgres-69fb4594cf-z8rt8"
Jul 15 18:25:30.072832 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:25:30.072797    2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-5d4b67c446-n2s6c"]
Jul 15 18:25:30.077981 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:25:30.077960    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-n2s6c"
Jul 15 18:25:30.080166 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:25:30.080145    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-authorino-dockercfg-cf5cm\""
Jul 15 18:25:30.083002 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:25:30.082975    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-n2s6c"]
Jul 15 18:25:30.129136 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:25:30.129104    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-b28jf\" (UniqueName: \"kubernetes.io/projected/b91921e1-648f-4e91-a0f3-f9ac303e05af-kube-api-access-b28jf\") pod \"authorino-5d4b67c446-n2s6c\" (UID: \"b91921e1-648f-4e91-a0f3-f9ac303e05af\") " pod="kuadrant-system/authorino-5d4b67c446-n2s6c"
Jul 15 18:25:30.230470 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:25:30.230428    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-b28jf\" (UniqueName: \"kubernetes.io/projected/b91921e1-648f-4e91-a0f3-f9ac303e05af-kube-api-access-b28jf\") pod \"authorino-5d4b67c446-n2s6c\" (UID: \"b91921e1-648f-4e91-a0f3-f9ac303e05af\") " pod="kuadrant-system/authorino-5d4b67c446-n2s6c"
Jul 15 18:25:30.239338 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:25:30.239308    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-b28jf\" (UniqueName: \"kubernetes.io/projected/b91921e1-648f-4e91-a0f3-f9ac303e05af-kube-api-access-b28jf\") pod \"authorino-5d4b67c446-n2s6c\" (UID: \"b91921e1-648f-4e91-a0f3-f9ac303e05af\") " pod="kuadrant-system/authorino-5d4b67c446-n2s6c"
Jul 15 18:25:30.271580 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:25:30.271548    2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-n2s6c"]
Jul 15 18:25:30.271814 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:25:30.271803    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-n2s6c"
Jul 15 18:25:30.299692 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:25:30.299664    2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-76877994-2rkxm"]
Jul 15 18:25:30.303985 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:25:30.303962    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-76877994-2rkxm"
Jul 15 18:25:30.306159 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:25:30.306139    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-server-cert\""
Jul 15 18:25:30.313883 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:25:30.313859    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-76877994-2rkxm"]
Jul 15 18:25:30.331616 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:25:30.331586    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/eac14d7f-204a-4607-bfd3-bfd5908d1523-tls-cert\") pod \"authorino-76877994-2rkxm\" (UID: \"eac14d7f-204a-4607-bfd3-bfd5908d1523\") " pod="kuadrant-system/authorino-76877994-2rkxm"
Jul 15 18:25:30.331738 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:25:30.331655    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qs976\" (UniqueName: \"kubernetes.io/projected/eac14d7f-204a-4607-bfd3-bfd5908d1523-kube-api-access-qs976\") pod \"authorino-76877994-2rkxm\" (UID: \"eac14d7f-204a-4607-bfd3-bfd5908d1523\") " pod="kuadrant-system/authorino-76877994-2rkxm"
Jul 15 18:25:30.362030 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:25:30.362002    2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-76877994-2rkxm"]
Jul 15 18:25:30.362383 ip-10-0-141-171 kubenswrapper[2567]: E0715 18:25:30.362358    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[kube-api-access-qs976 tls-cert], unattached volumes=[], failed to process volumes=[]: context canceled" pod="kuadrant-system/authorino-76877994-2rkxm" podUID="eac14d7f-204a-4607-bfd3-bfd5908d1523"
Jul 15 18:25:30.405027 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:25:30.405003    2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-n2s6c"]
Jul 15 18:25:30.407368 ip-10-0-141-171 kubenswrapper[2567]: W0715 18:25:30.407337    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podb91921e1_648f_4e91_a0f3_f9ac303e05af.slice/crio-83cf931599018f0d2104d491ef0ad899accaf0122fbc0f48ba2e6debbf1774fc WatchSource:0}: Error finding container 83cf931599018f0d2104d491ef0ad899accaf0122fbc0f48ba2e6debbf1774fc: Status 404 returned error can't find the container with id 83cf931599018f0d2104d491ef0ad899accaf0122fbc0f48ba2e6debbf1774fc
Jul 15 18:25:30.432635 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:25:30.432610    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/eac14d7f-204a-4607-bfd3-bfd5908d1523-tls-cert\") pod \"authorino-76877994-2rkxm\" (UID: \"eac14d7f-204a-4607-bfd3-bfd5908d1523\") " pod="kuadrant-system/authorino-76877994-2rkxm"
Jul 15 18:25:30.432720 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:25:30.432646    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qs976\" (UniqueName: \"kubernetes.io/projected/eac14d7f-204a-4607-bfd3-bfd5908d1523-kube-api-access-qs976\") pod \"authorino-76877994-2rkxm\" (UID: \"eac14d7f-204a-4607-bfd3-bfd5908d1523\") " pod="kuadrant-system/authorino-76877994-2rkxm"
Jul 15 18:25:30.434872 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:25:30.434852    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/eac14d7f-204a-4607-bfd3-bfd5908d1523-tls-cert\") pod \"authorino-76877994-2rkxm\" (UID: \"eac14d7f-204a-4607-bfd3-bfd5908d1523\") " pod="kuadrant-system/authorino-76877994-2rkxm"
Jul 15 18:25:30.441129 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:25:30.441109    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qs976\" (UniqueName: \"kubernetes.io/projected/eac14d7f-204a-4607-bfd3-bfd5908d1523-kube-api-access-qs976\") pod \"authorino-76877994-2rkxm\" (UID: \"eac14d7f-204a-4607-bfd3-bfd5908d1523\") " pod="kuadrant-system/authorino-76877994-2rkxm"
Jul 15 18:25:30.481594 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:25:30.481566    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5d4b67c446-n2s6c" event={"ID":"b91921e1-648f-4e91-a0f3-f9ac303e05af","Type":"ContainerStarted","Data":"83cf931599018f0d2104d491ef0ad899accaf0122fbc0f48ba2e6debbf1774fc"}
Jul 15 18:25:30.481594 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:25:30.481589    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-76877994-2rkxm"
Jul 15 18:25:30.489556 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:25:30.489537    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-76877994-2rkxm"
Jul 15 18:25:30.533682 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:25:30.533653    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/eac14d7f-204a-4607-bfd3-bfd5908d1523-tls-cert\") pod \"eac14d7f-204a-4607-bfd3-bfd5908d1523\" (UID: \"eac14d7f-204a-4607-bfd3-bfd5908d1523\") "
Jul 15 18:25:30.533833 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:25:30.533690    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-qs976\" (UniqueName: \"kubernetes.io/projected/eac14d7f-204a-4607-bfd3-bfd5908d1523-kube-api-access-qs976\") pod \"eac14d7f-204a-4607-bfd3-bfd5908d1523\" (UID: \"eac14d7f-204a-4607-bfd3-bfd5908d1523\") "
Jul 15 18:25:30.535672 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:25:30.535644    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/eac14d7f-204a-4607-bfd3-bfd5908d1523-tls-cert" (OuterVolumeSpecName: "tls-cert") pod "eac14d7f-204a-4607-bfd3-bfd5908d1523" (UID: "eac14d7f-204a-4607-bfd3-bfd5908d1523"). InnerVolumeSpecName "tls-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 15 18:25:30.535672 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:25:30.535667    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/eac14d7f-204a-4607-bfd3-bfd5908d1523-kube-api-access-qs976" (OuterVolumeSpecName: "kube-api-access-qs976") pod "eac14d7f-204a-4607-bfd3-bfd5908d1523" (UID: "eac14d7f-204a-4607-bfd3-bfd5908d1523"). InnerVolumeSpecName "kube-api-access-qs976". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 15 18:25:30.634347 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:25:30.634267    2567 reconciler_common.go:299] "Volume detached for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/eac14d7f-204a-4607-bfd3-bfd5908d1523-tls-cert\") on node \"ip-10-0-141-171.ec2.internal\" DevicePath \"\""
Jul 15 18:25:30.634347 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:25:30.634294    2567 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-qs976\" (UniqueName: \"kubernetes.io/projected/eac14d7f-204a-4607-bfd3-bfd5908d1523-kube-api-access-qs976\") on node \"ip-10-0-141-171.ec2.internal\" DevicePath \"\""
Jul 15 18:25:31.489298 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:25:31.489267    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-76877994-2rkxm"
Jul 15 18:25:31.525648 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:25:31.525557    2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-76877994-2rkxm"]
Jul 15 18:25:31.531144 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:25:31.531121    2567 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-76877994-2rkxm"]
Jul 15 18:25:32.207145 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:25:32.207108    2567 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="eac14d7f-204a-4607-bfd3-bfd5908d1523" path="/var/lib/kubelet/pods/eac14d7f-204a-4607-bfd3-bfd5908d1523/volumes"
Jul 15 18:25:33.499852 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:25:33.499819    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5d4b67c446-n2s6c" event={"ID":"b91921e1-648f-4e91-a0f3-f9ac303e05af","Type":"ContainerStarted","Data":"8fd91d5cbb5f8074d9177b9c79fcea3bed35c42315b387e903e729a1908fd88f"}
Jul 15 18:25:33.500319 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:25:33.499907    2567 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/authorino-5d4b67c446-n2s6c" podUID="b91921e1-648f-4e91-a0f3-f9ac303e05af" containerName="authorino" containerID="cri-o://8fd91d5cbb5f8074d9177b9c79fcea3bed35c42315b387e903e729a1908fd88f" gracePeriod=30
Jul 15 18:25:33.514955 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:25:33.514910    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-5d4b67c446-n2s6c" podStartSLOduration=0.627069281 podStartE2EDuration="3.514895282s" totalImagesPullingTime="2.887826001s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 18:25:30 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 18:25:33.514015821 +0000 UTC m=+492.048439199" watchObservedRunningTime="2026-07-15 18:25:33.514895282 +0000 UTC m=+492.049318632"
Jul 15 18:25:33.778402 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:25:33.778367    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-n2s6c"
Jul 15 18:25:33.863155 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:25:33.863125    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-b28jf\" (UniqueName: \"kubernetes.io/projected/b91921e1-648f-4e91-a0f3-f9ac303e05af-kube-api-access-b28jf\") pod \"b91921e1-648f-4e91-a0f3-f9ac303e05af\" (UID: \"b91921e1-648f-4e91-a0f3-f9ac303e05af\") "
Jul 15 18:25:33.865109 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:25:33.865073    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b91921e1-648f-4e91-a0f3-f9ac303e05af-kube-api-access-b28jf" (OuterVolumeSpecName: "kube-api-access-b28jf") pod "b91921e1-648f-4e91-a0f3-f9ac303e05af" (UID: "b91921e1-648f-4e91-a0f3-f9ac303e05af"). InnerVolumeSpecName "kube-api-access-b28jf". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 15 18:25:33.963832 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:25:33.963806    2567 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-b28jf\" (UniqueName: \"kubernetes.io/projected/b91921e1-648f-4e91-a0f3-f9ac303e05af-kube-api-access-b28jf\") on node \"ip-10-0-141-171.ec2.internal\" DevicePath \"\""
Jul 15 18:25:34.506506 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:25:34.506472    2567 generic.go:356] "Generic (PLEG): container finished" podID="b91921e1-648f-4e91-a0f3-f9ac303e05af" containerID="8fd91d5cbb5f8074d9177b9c79fcea3bed35c42315b387e903e729a1908fd88f" exitCode=0
Jul 15 18:25:34.506887 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:25:34.506518    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-n2s6c"
Jul 15 18:25:34.506887 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:25:34.506527    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5d4b67c446-n2s6c" event={"ID":"b91921e1-648f-4e91-a0f3-f9ac303e05af","Type":"ContainerDied","Data":"8fd91d5cbb5f8074d9177b9c79fcea3bed35c42315b387e903e729a1908fd88f"}
Jul 15 18:25:34.506887 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:25:34.506573    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5d4b67c446-n2s6c" event={"ID":"b91921e1-648f-4e91-a0f3-f9ac303e05af","Type":"ContainerDied","Data":"83cf931599018f0d2104d491ef0ad899accaf0122fbc0f48ba2e6debbf1774fc"}
Jul 15 18:25:34.506887 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:25:34.506593    2567 scope.go:117] "RemoveContainer" containerID="8fd91d5cbb5f8074d9177b9c79fcea3bed35c42315b387e903e729a1908fd88f"
Jul 15 18:25:34.514530 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:25:34.514514    2567 scope.go:117] "RemoveContainer" containerID="8fd91d5cbb5f8074d9177b9c79fcea3bed35c42315b387e903e729a1908fd88f"
Jul 15 18:25:34.514754 ip-10-0-141-171 kubenswrapper[2567]: E0715 18:25:34.514728    2567 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8fd91d5cbb5f8074d9177b9c79fcea3bed35c42315b387e903e729a1908fd88f\": container with ID starting with 8fd91d5cbb5f8074d9177b9c79fcea3bed35c42315b387e903e729a1908fd88f not found: ID does not exist" containerID="8fd91d5cbb5f8074d9177b9c79fcea3bed35c42315b387e903e729a1908fd88f"
Jul 15 18:25:34.514852 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:25:34.514762    2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8fd91d5cbb5f8074d9177b9c79fcea3bed35c42315b387e903e729a1908fd88f"} err="failed to get container status \"8fd91d5cbb5f8074d9177b9c79fcea3bed35c42315b387e903e729a1908fd88f\": rpc error: code = NotFound desc = could not find container \"8fd91d5cbb5f8074d9177b9c79fcea3bed35c42315b387e903e729a1908fd88f\": container with ID starting with 8fd91d5cbb5f8074d9177b9c79fcea3bed35c42315b387e903e729a1908fd88f not found: ID does not exist"
Jul 15 18:25:34.520383 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:25:34.520361    2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-n2s6c"]
Jul 15 18:25:34.525404 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:25:34.525385    2567 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-n2s6c"]
Jul 15 18:25:36.205917 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:25:36.205883    2567 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b91921e1-648f-4e91-a0f3-f9ac303e05af" path="/var/lib/kubelet/pods/b91921e1-648f-4e91-a0f3-f9ac303e05af/volumes"
Jul 15 18:25:39.961804 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:25:39.961768    2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-797f6f78d7-b6sqp"]
Jul 15 18:25:39.962178 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:25:39.962165    2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b91921e1-648f-4e91-a0f3-f9ac303e05af" containerName="authorino"
Jul 15 18:25:39.962220 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:25:39.962179    2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="b91921e1-648f-4e91-a0f3-f9ac303e05af" containerName="authorino"
Jul 15 18:25:39.962275 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:25:39.962252    2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="b91921e1-648f-4e91-a0f3-f9ac303e05af" containerName="authorino"
Jul 15 18:25:39.971435 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:25:39.971415    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-797f6f78d7-b6sqp"
Jul 15 18:25:39.974724 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:25:39.974692    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-vjtw5\""
Jul 15 18:25:39.975110 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:25:39.975092    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\""
Jul 15 18:25:39.975223 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:25:39.975129    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-webhook-cert\""
Jul 15 18:25:39.976755 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:25:39.976732    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-797f6f78d7-b6sqp"]
Jul 15 18:25:40.019185 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:25:40.019157    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/98a67419-9c25-4b23-837e-49198df17aa1-webhook-cert\") pod \"maas-controller-797f6f78d7-b6sqp\" (UID: \"98a67419-9c25-4b23-837e-49198df17aa1\") " pod="opendatahub/maas-controller-797f6f78d7-b6sqp"
Jul 15 18:25:40.019341 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:25:40.019274    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wvzwb\" (UniqueName: \"kubernetes.io/projected/98a67419-9c25-4b23-837e-49198df17aa1-kube-api-access-wvzwb\") pod \"maas-controller-797f6f78d7-b6sqp\" (UID: \"98a67419-9c25-4b23-837e-49198df17aa1\") " pod="opendatahub/maas-controller-797f6f78d7-b6sqp"
Jul 15 18:25:40.120669 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:25:40.120637    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/98a67419-9c25-4b23-837e-49198df17aa1-webhook-cert\") pod \"maas-controller-797f6f78d7-b6sqp\" (UID: \"98a67419-9c25-4b23-837e-49198df17aa1\") " pod="opendatahub/maas-controller-797f6f78d7-b6sqp"
Jul 15 18:25:40.120824 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:25:40.120697    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wvzwb\" (UniqueName: \"kubernetes.io/projected/98a67419-9c25-4b23-837e-49198df17aa1-kube-api-access-wvzwb\") pod \"maas-controller-797f6f78d7-b6sqp\" (UID: \"98a67419-9c25-4b23-837e-49198df17aa1\") " pod="opendatahub/maas-controller-797f6f78d7-b6sqp"
Jul 15 18:25:40.123050 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:25:40.123026    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/98a67419-9c25-4b23-837e-49198df17aa1-webhook-cert\") pod \"maas-controller-797f6f78d7-b6sqp\" (UID: \"98a67419-9c25-4b23-837e-49198df17aa1\") " pod="opendatahub/maas-controller-797f6f78d7-b6sqp"
Jul 15 18:25:40.132068 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:25:40.132042    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wvzwb\" (UniqueName: \"kubernetes.io/projected/98a67419-9c25-4b23-837e-49198df17aa1-kube-api-access-wvzwb\") pod \"maas-controller-797f6f78d7-b6sqp\" (UID: \"98a67419-9c25-4b23-837e-49198df17aa1\") " pod="opendatahub/maas-controller-797f6f78d7-b6sqp"
Jul 15 18:25:40.282296 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:25:40.282175    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-797f6f78d7-b6sqp"
Jul 15 18:25:40.407286 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:25:40.407261    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-797f6f78d7-b6sqp"]
Jul 15 18:25:40.409018 ip-10-0-141-171 kubenswrapper[2567]: W0715 18:25:40.408985    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod98a67419_9c25_4b23_837e_49198df17aa1.slice/crio-b7177ce514472e3f3eb4f6bee823901bedd4753244a654a8c8deec46e3174a73 WatchSource:0}: Error finding container b7177ce514472e3f3eb4f6bee823901bedd4753244a654a8c8deec46e3174a73: Status 404 returned error can't find the container with id b7177ce514472e3f3eb4f6bee823901bedd4753244a654a8c8deec46e3174a73
Jul 15 18:25:40.538373 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:25:40.538297    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-797f6f78d7-b6sqp" event={"ID":"98a67419-9c25-4b23-837e-49198df17aa1","Type":"ContainerStarted","Data":"b7177ce514472e3f3eb4f6bee823901bedd4753244a654a8c8deec46e3174a73"}
Jul 15 18:25:44.560042 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:25:44.560005    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-797f6f78d7-b6sqp" event={"ID":"98a67419-9c25-4b23-837e-49198df17aa1","Type":"ContainerStarted","Data":"8ccbd76e3670015732e9e86b80ed554c83f05cf736dad4be8b9b477ec414a38e"}
Jul 15 18:25:44.560463 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:25:44.560138    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-797f6f78d7-b6sqp"
Jul 15 18:25:44.576141 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:25:44.576087    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-797f6f78d7-b6sqp" podStartSLOduration=2.370200903 podStartE2EDuration="5.576071413s" totalImagesPullingTime="3.20587051s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 18:25:39 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 18:25:44.575471367 +0000 UTC m=+503.109894725" watchObservedRunningTime="2026-07-15 18:25:44.576071413 +0000 UTC m=+503.110494769"
Jul 15 18:25:54.093425 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:25:54.093388    2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-797f6f78d7-b6sqp"]
Jul 15 18:25:54.093869 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:25:54.093687    2567 kuberuntime_container.go:873] "Killing container with a grace period" pod="opendatahub/maas-controller-797f6f78d7-b6sqp" podUID="98a67419-9c25-4b23-837e-49198df17aa1" containerName="manager" containerID="cri-o://8ccbd76e3670015732e9e86b80ed554c83f05cf736dad4be8b9b477ec414a38e" gracePeriod=30
Jul 15 18:25:54.095519 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:25:54.095492    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-797f6f78d7-b6sqp"
Jul 15 18:25:54.327978 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:25:54.327953    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-797f6f78d7-b6sqp"
Jul 15 18:25:54.446928 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:25:54.446887    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/98a67419-9c25-4b23-837e-49198df17aa1-webhook-cert\") pod \"98a67419-9c25-4b23-837e-49198df17aa1\" (UID: \"98a67419-9c25-4b23-837e-49198df17aa1\") "
Jul 15 18:25:54.447118 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:25:54.447022    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-wvzwb\" (UniqueName: \"kubernetes.io/projected/98a67419-9c25-4b23-837e-49198df17aa1-kube-api-access-wvzwb\") pod \"98a67419-9c25-4b23-837e-49198df17aa1\" (UID: \"98a67419-9c25-4b23-837e-49198df17aa1\") "
Jul 15 18:25:54.449078 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:25:54.449051    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/98a67419-9c25-4b23-837e-49198df17aa1-webhook-cert" (OuterVolumeSpecName: "webhook-cert") pod "98a67419-9c25-4b23-837e-49198df17aa1" (UID: "98a67419-9c25-4b23-837e-49198df17aa1"). InnerVolumeSpecName "webhook-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 15 18:25:54.449212 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:25:54.449118    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/98a67419-9c25-4b23-837e-49198df17aa1-kube-api-access-wvzwb" (OuterVolumeSpecName: "kube-api-access-wvzwb") pod "98a67419-9c25-4b23-837e-49198df17aa1" (UID: "98a67419-9c25-4b23-837e-49198df17aa1"). InnerVolumeSpecName "kube-api-access-wvzwb". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 15 18:25:54.548046 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:25:54.548011    2567 reconciler_common.go:299] "Volume detached for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/98a67419-9c25-4b23-837e-49198df17aa1-webhook-cert\") on node \"ip-10-0-141-171.ec2.internal\" DevicePath \"\""
Jul 15 18:25:54.548203 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:25:54.548041    2567 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-wvzwb\" (UniqueName: \"kubernetes.io/projected/98a67419-9c25-4b23-837e-49198df17aa1-kube-api-access-wvzwb\") on node \"ip-10-0-141-171.ec2.internal\" DevicePath \"\""
Jul 15 18:25:54.605168 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:25:54.605132    2567 generic.go:356] "Generic (PLEG): container finished" podID="98a67419-9c25-4b23-837e-49198df17aa1" containerID="8ccbd76e3670015732e9e86b80ed554c83f05cf736dad4be8b9b477ec414a38e" exitCode=0
Jul 15 18:25:54.605338 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:25:54.605182    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-797f6f78d7-b6sqp"
Jul 15 18:25:54.605338 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:25:54.605214    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-797f6f78d7-b6sqp" event={"ID":"98a67419-9c25-4b23-837e-49198df17aa1","Type":"ContainerDied","Data":"8ccbd76e3670015732e9e86b80ed554c83f05cf736dad4be8b9b477ec414a38e"}
Jul 15 18:25:54.605338 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:25:54.605292    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-797f6f78d7-b6sqp" event={"ID":"98a67419-9c25-4b23-837e-49198df17aa1","Type":"ContainerDied","Data":"b7177ce514472e3f3eb4f6bee823901bedd4753244a654a8c8deec46e3174a73"}
Jul 15 18:25:54.605338 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:25:54.605317    2567 scope.go:117] "RemoveContainer" containerID="8ccbd76e3670015732e9e86b80ed554c83f05cf736dad4be8b9b477ec414a38e"
Jul 15 18:25:54.614453 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:25:54.614433    2567 scope.go:117] "RemoveContainer" containerID="8ccbd76e3670015732e9e86b80ed554c83f05cf736dad4be8b9b477ec414a38e"
Jul 15 18:25:54.614676 ip-10-0-141-171 kubenswrapper[2567]: E0715 18:25:54.614657    2567 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8ccbd76e3670015732e9e86b80ed554c83f05cf736dad4be8b9b477ec414a38e\": container with ID starting with 8ccbd76e3670015732e9e86b80ed554c83f05cf736dad4be8b9b477ec414a38e not found: ID does not exist" containerID="8ccbd76e3670015732e9e86b80ed554c83f05cf736dad4be8b9b477ec414a38e"
Jul 15 18:25:54.614730 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:25:54.614684    2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8ccbd76e3670015732e9e86b80ed554c83f05cf736dad4be8b9b477ec414a38e"} err="failed to get container status \"8ccbd76e3670015732e9e86b80ed554c83f05cf736dad4be8b9b477ec414a38e\": rpc error: code = NotFound desc = could not find container \"8ccbd76e3670015732e9e86b80ed554c83f05cf736dad4be8b9b477ec414a38e\": container with ID starting with 8ccbd76e3670015732e9e86b80ed554c83f05cf736dad4be8b9b477ec414a38e not found: ID does not exist"
Jul 15 18:25:54.626204 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:25:54.626181    2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-797f6f78d7-b6sqp"]
Jul 15 18:25:54.630211 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:25:54.630190    2567 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-controller-797f6f78d7-b6sqp"]
Jul 15 18:25:56.205336 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:25:56.205304    2567 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="98a67419-9c25-4b23-837e-49198df17aa1" path="/var/lib/kubelet/pods/98a67419-9c25-4b23-837e-49198df17aa1/volumes"
Jul 15 18:26:16.057825 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:26:16.057792    2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-f9b8d9b9b-v4h87"]
Jul 15 18:26:16.058226 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:26:16.058135    2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="98a67419-9c25-4b23-837e-49198df17aa1" containerName="manager"
Jul 15 18:26:16.058226 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:26:16.058148    2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="98a67419-9c25-4b23-837e-49198df17aa1" containerName="manager"
Jul 15 18:26:16.058226 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:26:16.058224    2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="98a67419-9c25-4b23-837e-49198df17aa1" containerName="manager"
Jul 15 18:26:16.061002 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:26:16.060985    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-f9b8d9b9b-v4h87"
Jul 15 18:26:16.063255 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:26:16.063220    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins\""
Jul 15 18:26:16.063381 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:26:16.063222    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-dockercfg-nk64h\""
Jul 15 18:26:16.072392 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:26:16.072371    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-f9b8d9b9b-v4h87"]
Jul 15 18:26:16.134856 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:26:16.134826    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/cd1168ac-c1c1-42cb-b2db-e8f131953d09-plugins-config-volume\") pod \"payload-processing-f9b8d9b9b-v4h87\" (UID: \"cd1168ac-c1c1-42cb-b2db-e8f131953d09\") " pod="openshift-ingress/payload-processing-f9b8d9b9b-v4h87"
Jul 15 18:26:16.134995 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:26:16.134907    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-52wzm\" (UniqueName: \"kubernetes.io/projected/cd1168ac-c1c1-42cb-b2db-e8f131953d09-kube-api-access-52wzm\") pod \"payload-processing-f9b8d9b9b-v4h87\" (UID: \"cd1168ac-c1c1-42cb-b2db-e8f131953d09\") " pod="openshift-ingress/payload-processing-f9b8d9b9b-v4h87"
Jul 15 18:26:16.235675 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:26:16.235645    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-52wzm\" (UniqueName: \"kubernetes.io/projected/cd1168ac-c1c1-42cb-b2db-e8f131953d09-kube-api-access-52wzm\") pod \"payload-processing-f9b8d9b9b-v4h87\" (UID: \"cd1168ac-c1c1-42cb-b2db-e8f131953d09\") " pod="openshift-ingress/payload-processing-f9b8d9b9b-v4h87"
Jul 15 18:26:16.235675 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:26:16.235680    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/cd1168ac-c1c1-42cb-b2db-e8f131953d09-plugins-config-volume\") pod \"payload-processing-f9b8d9b9b-v4h87\" (UID: \"cd1168ac-c1c1-42cb-b2db-e8f131953d09\") " pod="openshift-ingress/payload-processing-f9b8d9b9b-v4h87"
Jul 15 18:26:16.236376 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:26:16.236354    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/cd1168ac-c1c1-42cb-b2db-e8f131953d09-plugins-config-volume\") pod \"payload-processing-f9b8d9b9b-v4h87\" (UID: \"cd1168ac-c1c1-42cb-b2db-e8f131953d09\") " pod="openshift-ingress/payload-processing-f9b8d9b9b-v4h87"
Jul 15 18:26:16.243254 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:26:16.243221    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-52wzm\" (UniqueName: \"kubernetes.io/projected/cd1168ac-c1c1-42cb-b2db-e8f131953d09-kube-api-access-52wzm\") pod \"payload-processing-f9b8d9b9b-v4h87\" (UID: \"cd1168ac-c1c1-42cb-b2db-e8f131953d09\") " pod="openshift-ingress/payload-processing-f9b8d9b9b-v4h87"
Jul 15 18:26:16.324177 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:26:16.324116    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-qfldk"]
Jul 15 18:26:16.371002 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:26:16.370978    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-f9b8d9b9b-v4h87"
Jul 15 18:26:16.506675 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:26:16.506652    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-f9b8d9b9b-v4h87"]
Jul 15 18:26:16.508380 ip-10-0-141-171 kubenswrapper[2567]: W0715 18:26:16.508336    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcd1168ac_c1c1_42cb_b2db_e8f131953d09.slice/crio-767885f7091a867ea354b37ee356743201bec265d9476ee7c64d495d1f34a34d WatchSource:0}: Error finding container 767885f7091a867ea354b37ee356743201bec265d9476ee7c64d495d1f34a34d: Status 404 returned error can't find the container with id 767885f7091a867ea354b37ee356743201bec265d9476ee7c64d495d1f34a34d
Jul 15 18:26:16.708620 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:26:16.708589    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-f9b8d9b9b-v4h87" event={"ID":"cd1168ac-c1c1-42cb-b2db-e8f131953d09","Type":"ContainerStarted","Data":"767885f7091a867ea354b37ee356743201bec265d9476ee7c64d495d1f34a34d"}
Jul 15 18:26:18.719671 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:26:18.719635    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-f9b8d9b9b-v4h87" event={"ID":"cd1168ac-c1c1-42cb-b2db-e8f131953d09","Type":"ContainerStarted","Data":"eb6f417cd200dcf52a58dd75da720844d0c0207a382aa9731fc2e67075564bb2"}
Jul 15 18:26:18.720130 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:26:18.719778    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-f9b8d9b9b-v4h87"
Jul 15 18:26:18.736213 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:26:18.736169    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-f9b8d9b9b-v4h87" podStartSLOduration=1.466755569 podStartE2EDuration="2.736153548s" totalImagesPullingTime="1.269397979s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 18:26:16 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 18:26:18.734199123 +0000 UTC m=+537.268622475" watchObservedRunningTime="2026-07-15 18:26:18.736153548 +0000 UTC m=+537.270576905"
Jul 15 18:26:29.726015 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:26:29.725985    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-f9b8d9b9b-v4h87"
Jul 15 18:26:49.407734 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:26:49.407700    2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-hx59b"]
Jul 15 18:26:49.411308 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:26:49.411289    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-hx59b"
Jul 15 18:26:49.414553 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:26:49.414533    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-distinct-2-simulated-kserve-self-signed-certs\""
Jul 15 18:26:49.414691 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:26:49.414675    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\""
Jul 15 18:26:49.414775 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:26:49.414759    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\""
Jul 15 18:26:49.415131 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:26:49.415117    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-8r5n2\""
Jul 15 18:26:49.423444 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:26:49.423424    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-hx59b"]
Jul 15 18:26:49.526776 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:26:49.526735    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-j7hhq\" (UniqueName: \"kubernetes.io/projected/02224416-06a1-4e11-9118-a870806b6b4a-kube-api-access-j7hhq\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-hx59b\" (UID: \"02224416-06a1-4e11-9118-a870806b6b4a\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-hx59b"
Jul 15 18:26:49.526939 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:26:49.526787    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/02224416-06a1-4e11-9118-a870806b6b4a-model-cache\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-hx59b\" (UID: \"02224416-06a1-4e11-9118-a870806b6b4a\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-hx59b"
Jul 15 18:26:49.526939 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:26:49.526867    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/02224416-06a1-4e11-9118-a870806b6b4a-dshm\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-hx59b\" (UID: \"02224416-06a1-4e11-9118-a870806b6b4a\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-hx59b"
Jul 15 18:26:49.527021 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:26:49.526936    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/02224416-06a1-4e11-9118-a870806b6b4a-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-hx59b\" (UID: \"02224416-06a1-4e11-9118-a870806b6b4a\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-hx59b"
Jul 15 18:26:49.527021 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:26:49.527007    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/02224416-06a1-4e11-9118-a870806b6b4a-home\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-hx59b\" (UID: \"02224416-06a1-4e11-9118-a870806b6b4a\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-hx59b"
Jul 15 18:26:49.527100 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:26:49.527046    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/02224416-06a1-4e11-9118-a870806b6b4a-tmp-dir\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-hx59b\" (UID: \"02224416-06a1-4e11-9118-a870806b6b4a\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-hx59b"
Jul 15 18:26:49.628106 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:26:49.628066    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/02224416-06a1-4e11-9118-a870806b6b4a-tmp-dir\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-hx59b\" (UID: \"02224416-06a1-4e11-9118-a870806b6b4a\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-hx59b"
Jul 15 18:26:49.628304 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:26:49.628119    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-j7hhq\" (UniqueName: \"kubernetes.io/projected/02224416-06a1-4e11-9118-a870806b6b4a-kube-api-access-j7hhq\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-hx59b\" (UID: \"02224416-06a1-4e11-9118-a870806b6b4a\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-hx59b"
Jul 15 18:26:49.628304 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:26:49.628140    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/02224416-06a1-4e11-9118-a870806b6b4a-model-cache\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-hx59b\" (UID: \"02224416-06a1-4e11-9118-a870806b6b4a\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-hx59b"
Jul 15 18:26:49.628304 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:26:49.628173    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/02224416-06a1-4e11-9118-a870806b6b4a-dshm\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-hx59b\" (UID: \"02224416-06a1-4e11-9118-a870806b6b4a\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-hx59b"
Jul 15 18:26:49.628304 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:26:49.628196    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/02224416-06a1-4e11-9118-a870806b6b4a-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-hx59b\" (UID: \"02224416-06a1-4e11-9118-a870806b6b4a\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-hx59b"
Jul 15 18:26:49.628304 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:26:49.628260    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/02224416-06a1-4e11-9118-a870806b6b4a-home\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-hx59b\" (UID: \"02224416-06a1-4e11-9118-a870806b6b4a\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-hx59b"
Jul 15 18:26:49.628563 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:26:49.628531    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/02224416-06a1-4e11-9118-a870806b6b4a-tmp-dir\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-hx59b\" (UID: \"02224416-06a1-4e11-9118-a870806b6b4a\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-hx59b"
Jul 15 18:26:49.628678 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:26:49.628659    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/02224416-06a1-4e11-9118-a870806b6b4a-model-cache\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-hx59b\" (UID: \"02224416-06a1-4e11-9118-a870806b6b4a\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-hx59b"
Jul 15 18:26:49.628716 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:26:49.628660    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/02224416-06a1-4e11-9118-a870806b6b4a-home\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-hx59b\" (UID: \"02224416-06a1-4e11-9118-a870806b6b4a\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-hx59b"
Jul 15 18:26:49.630421 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:26:49.630397    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/02224416-06a1-4e11-9118-a870806b6b4a-dshm\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-hx59b\" (UID: \"02224416-06a1-4e11-9118-a870806b6b4a\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-hx59b"
Jul 15 18:26:49.630661 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:26:49.630642    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/02224416-06a1-4e11-9118-a870806b6b4a-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-hx59b\" (UID: \"02224416-06a1-4e11-9118-a870806b6b4a\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-hx59b"
Jul 15 18:26:49.636500 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:26:49.636478    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-j7hhq\" (UniqueName: \"kubernetes.io/projected/02224416-06a1-4e11-9118-a870806b6b4a-kube-api-access-j7hhq\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-hx59b\" (UID: \"02224416-06a1-4e11-9118-a870806b6b4a\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-hx59b"
Jul 15 18:26:49.721575 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:26:49.721547    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-hx59b"
Jul 15 18:26:49.853687 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:26:49.853661    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-hx59b"]
Jul 15 18:26:49.856052 ip-10-0-141-171 kubenswrapper[2567]: W0715 18:26:49.856021    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod02224416_06a1_4e11_9118_a870806b6b4a.slice/crio-799965584ff3a15af5baea6a84508740d29f2150097c40d78753ec233aea9b3c WatchSource:0}: Error finding container 799965584ff3a15af5baea6a84508740d29f2150097c40d78753ec233aea9b3c: Status 404 returned error can't find the container with id 799965584ff3a15af5baea6a84508740d29f2150097c40d78753ec233aea9b3c
Jul 15 18:26:49.877245 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:26:49.877199    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-hx59b" event={"ID":"02224416-06a1-4e11-9118-a870806b6b4a","Type":"ContainerStarted","Data":"799965584ff3a15af5baea6a84508740d29f2150097c40d78753ec233aea9b3c"}
Jul 15 18:26:49.985359 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:26:49.985273    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-qfldk"]
Jul 15 18:26:51.888627 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:26:51.888585    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-hx59b" event={"ID":"02224416-06a1-4e11-9118-a870806b6b4a","Type":"ContainerStarted","Data":"f51dc23022c6147e809b6869b134c557fbf38ab56ee9c1bbece5f13c7851c5b6"}
Jul 15 18:26:51.907027 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:26:51.906978    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-hx59b" podStartSLOduration=1.7159023329999998 podStartE2EDuration="2.906962497s" totalImagesPullingTime="1.191060164s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 18:26:49 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 18:26:51.906089357 +0000 UTC m=+570.440512714" watchObservedRunningTime="2026-07-15 18:26:51.906962497 +0000 UTC m=+570.441385901"
Jul 15 18:26:59.722091 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:26:59.722058    2567 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-hx59b"
Jul 15 18:26:59.722588 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:26:59.722117    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-hx59b"
Jul 15 18:26:59.734575 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:26:59.734549    2567 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-hx59b"
Jul 15 18:26:59.938337 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:26:59.938308    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-hx59b"
Jul 15 18:27:17.414816 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:27:17.414782    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-qfldk"]
Jul 15 18:27:23.414289 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:27:23.414168    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-8hmqx_d8816772-beae-4dff-9c51-9043199e488d/ovn-acl-logging/0.log"
Jul 15 18:27:23.418088 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:27:23.415403    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-8hmqx_d8816772-beae-4dff-9c51-9043199e488d/ovn-acl-logging/0.log"
Jul 15 18:27:30.404065 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:27:30.404030    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-qfldk"]
Jul 15 18:28:07.391740 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:28:07.391701    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-qfldk"]
Jul 15 18:28:15.990704 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:28:15.990674    2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-74b68447df-gscwq"]
Jul 15 18:28:15.994018 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:28:15.993996    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-gscwq"
Jul 15 18:28:15.996523 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:28:15.996502    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"facebook-opt-125m-simulated-kserve-self-signed-certs\""
Jul 15 18:28:16.004532 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:28:16.004509    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-74b68447df-gscwq"]
Jul 15 18:28:16.112846 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:28:16.112812    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/4b1c2131-5398-4439-ad7f-3ce983468768-model-cache\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-gscwq\" (UID: \"4b1c2131-5398-4439-ad7f-3ce983468768\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-gscwq"
Jul 15 18:28:16.112998 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:28:16.112863    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/4b1c2131-5398-4439-ad7f-3ce983468768-tmp-dir\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-gscwq\" (UID: \"4b1c2131-5398-4439-ad7f-3ce983468768\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-gscwq"
Jul 15 18:28:16.112998 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:28:16.112945    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xc9tl\" (UniqueName: \"kubernetes.io/projected/4b1c2131-5398-4439-ad7f-3ce983468768-kube-api-access-xc9tl\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-gscwq\" (UID: \"4b1c2131-5398-4439-ad7f-3ce983468768\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-gscwq"
Jul 15 18:28:16.113074 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:28:16.113001    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/4b1c2131-5398-4439-ad7f-3ce983468768-dshm\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-gscwq\" (UID: \"4b1c2131-5398-4439-ad7f-3ce983468768\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-gscwq"
Jul 15 18:28:16.113074 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:28:16.113028    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/4b1c2131-5398-4439-ad7f-3ce983468768-home\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-gscwq\" (UID: \"4b1c2131-5398-4439-ad7f-3ce983468768\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-gscwq"
Jul 15 18:28:16.113074 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:28:16.113056    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/4b1c2131-5398-4439-ad7f-3ce983468768-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-gscwq\" (UID: \"4b1c2131-5398-4439-ad7f-3ce983468768\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-gscwq"
Jul 15 18:28:16.213904 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:28:16.213864    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/4b1c2131-5398-4439-ad7f-3ce983468768-dshm\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-gscwq\" (UID: \"4b1c2131-5398-4439-ad7f-3ce983468768\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-gscwq"
Jul 15 18:28:16.213904 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:28:16.213908    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/4b1c2131-5398-4439-ad7f-3ce983468768-home\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-gscwq\" (UID: \"4b1c2131-5398-4439-ad7f-3ce983468768\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-gscwq"
Jul 15 18:28:16.214148 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:28:16.213944    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/4b1c2131-5398-4439-ad7f-3ce983468768-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-gscwq\" (UID: \"4b1c2131-5398-4439-ad7f-3ce983468768\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-gscwq"
Jul 15 18:28:16.214148 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:28:16.213974    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/4b1c2131-5398-4439-ad7f-3ce983468768-model-cache\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-gscwq\" (UID: \"4b1c2131-5398-4439-ad7f-3ce983468768\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-gscwq"
Jul 15 18:28:16.214148 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:28:16.214032    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/4b1c2131-5398-4439-ad7f-3ce983468768-tmp-dir\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-gscwq\" (UID: \"4b1c2131-5398-4439-ad7f-3ce983468768\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-gscwq"
Jul 15 18:28:16.214148 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:28:16.214087    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xc9tl\" (UniqueName: \"kubernetes.io/projected/4b1c2131-5398-4439-ad7f-3ce983468768-kube-api-access-xc9tl\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-gscwq\" (UID: \"4b1c2131-5398-4439-ad7f-3ce983468768\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-gscwq"
Jul 15 18:28:16.214397 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:28:16.214373    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/4b1c2131-5398-4439-ad7f-3ce983468768-home\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-gscwq\" (UID: \"4b1c2131-5398-4439-ad7f-3ce983468768\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-gscwq"
Jul 15 18:28:16.214459 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:28:16.214387    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/4b1c2131-5398-4439-ad7f-3ce983468768-model-cache\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-gscwq\" (UID: \"4b1c2131-5398-4439-ad7f-3ce983468768\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-gscwq"
Jul 15 18:28:16.214893 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:28:16.214605    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/4b1c2131-5398-4439-ad7f-3ce983468768-tmp-dir\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-gscwq\" (UID: \"4b1c2131-5398-4439-ad7f-3ce983468768\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-gscwq"
Jul 15 18:28:16.221830 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:28:16.216993    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/4b1c2131-5398-4439-ad7f-3ce983468768-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-gscwq\" (UID: \"4b1c2131-5398-4439-ad7f-3ce983468768\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-gscwq"
Jul 15 18:28:16.222321 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:28:16.222217    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/4b1c2131-5398-4439-ad7f-3ce983468768-dshm\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-gscwq\" (UID: \"4b1c2131-5398-4439-ad7f-3ce983468768\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-gscwq"
Jul 15 18:28:16.222491 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:28:16.222474    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xc9tl\" (UniqueName: \"kubernetes.io/projected/4b1c2131-5398-4439-ad7f-3ce983468768-kube-api-access-xc9tl\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-gscwq\" (UID: \"4b1c2131-5398-4439-ad7f-3ce983468768\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-gscwq"
Jul 15 18:28:16.304709 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:28:16.304621    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-gscwq"
Jul 15 18:28:16.435609 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:28:16.435587    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-74b68447df-gscwq"]
Jul 15 18:28:16.437700 ip-10-0-141-171 kubenswrapper[2567]: W0715 18:28:16.437671    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4b1c2131_5398_4439_ad7f_3ce983468768.slice/crio-6b8552ac390227a019bcd59075da729248eee82a79bb519453b574a507a48fab WatchSource:0}: Error finding container 6b8552ac390227a019bcd59075da729248eee82a79bb519453b574a507a48fab: Status 404 returned error can't find the container with id 6b8552ac390227a019bcd59075da729248eee82a79bb519453b574a507a48fab
Jul 15 18:28:17.278177 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:28:17.278143    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-gscwq" event={"ID":"4b1c2131-5398-4439-ad7f-3ce983468768","Type":"ContainerStarted","Data":"b5d33dba2373a05ff9e17f915e6919324d3558d91ae17ff466bcf6fb6a1fdd41"}
Jul 15 18:28:17.278584 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:28:17.278199    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-gscwq" event={"ID":"4b1c2131-5398-4439-ad7f-3ce983468768","Type":"ContainerStarted","Data":"6b8552ac390227a019bcd59075da729248eee82a79bb519453b574a507a48fab"}
Jul 15 18:28:17.297397 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:28:17.297347    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-gscwq" podStartSLOduration=2.109125754 podStartE2EDuration="2.297330714s" totalImagesPullingTime="188.20496ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 18:28:15 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 18:28:17.296207586 +0000 UTC m=+655.830630942" watchObservedRunningTime="2026-07-15 18:28:17.297330714 +0000 UTC m=+655.831754070"
Jul 15 18:28:18.085794 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:28:18.085760    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-qfldk"]
Jul 15 18:28:19.705985 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:28:19.705957    2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-2htj2"]
Jul 15 18:28:19.709504 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:28:19.709486    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-2htj2"
Jul 15 18:28:19.718937 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:28:19.718917    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"premium-simulated-simulated-premium-kserve-self-signed-certs\""
Jul 15 18:28:19.731491 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:28:19.731468    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-2htj2"]
Jul 15 18:28:19.847612 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:28:19.847578    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/6dec4d6e-b17a-4bba-a8fd-4488c7c2da0f-home\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-2htj2\" (UID: \"6dec4d6e-b17a-4bba-a8fd-4488c7c2da0f\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-2htj2"
Jul 15 18:28:19.847612 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:28:19.847615    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/6dec4d6e-b17a-4bba-a8fd-4488c7c2da0f-tmp-dir\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-2htj2\" (UID: \"6dec4d6e-b17a-4bba-a8fd-4488c7c2da0f\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-2htj2"
Jul 15 18:28:19.847821 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:28:19.847707    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/6dec4d6e-b17a-4bba-a8fd-4488c7c2da0f-model-cache\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-2htj2\" (UID: \"6dec4d6e-b17a-4bba-a8fd-4488c7c2da0f\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-2htj2"
Jul 15 18:28:19.847821 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:28:19.847747    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bkmbb\" (UniqueName: \"kubernetes.io/projected/6dec4d6e-b17a-4bba-a8fd-4488c7c2da0f-kube-api-access-bkmbb\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-2htj2\" (UID: \"6dec4d6e-b17a-4bba-a8fd-4488c7c2da0f\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-2htj2"
Jul 15 18:28:19.847821 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:28:19.847774    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/6dec4d6e-b17a-4bba-a8fd-4488c7c2da0f-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-2htj2\" (UID: \"6dec4d6e-b17a-4bba-a8fd-4488c7c2da0f\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-2htj2"
Jul 15 18:28:19.847919 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:28:19.847834    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/6dec4d6e-b17a-4bba-a8fd-4488c7c2da0f-dshm\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-2htj2\" (UID: \"6dec4d6e-b17a-4bba-a8fd-4488c7c2da0f\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-2htj2"
Jul 15 18:28:19.948909 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:28:19.948871    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/6dec4d6e-b17a-4bba-a8fd-4488c7c2da0f-home\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-2htj2\" (UID: \"6dec4d6e-b17a-4bba-a8fd-4488c7c2da0f\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-2htj2"
Jul 15 18:28:19.948909 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:28:19.948911    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/6dec4d6e-b17a-4bba-a8fd-4488c7c2da0f-tmp-dir\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-2htj2\" (UID: \"6dec4d6e-b17a-4bba-a8fd-4488c7c2da0f\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-2htj2"
Jul 15 18:28:19.949141 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:28:19.948957    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/6dec4d6e-b17a-4bba-a8fd-4488c7c2da0f-model-cache\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-2htj2\" (UID: \"6dec4d6e-b17a-4bba-a8fd-4488c7c2da0f\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-2htj2"
Jul 15 18:28:19.949141 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:28:19.948979    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bkmbb\" (UniqueName: \"kubernetes.io/projected/6dec4d6e-b17a-4bba-a8fd-4488c7c2da0f-kube-api-access-bkmbb\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-2htj2\" (UID: \"6dec4d6e-b17a-4bba-a8fd-4488c7c2da0f\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-2htj2"
Jul 15 18:28:19.949141 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:28:19.949000    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/6dec4d6e-b17a-4bba-a8fd-4488c7c2da0f-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-2htj2\" (UID: \"6dec4d6e-b17a-4bba-a8fd-4488c7c2da0f\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-2htj2"
Jul 15 18:28:19.949141 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:28:19.949026    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/6dec4d6e-b17a-4bba-a8fd-4488c7c2da0f-dshm\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-2htj2\" (UID: \"6dec4d6e-b17a-4bba-a8fd-4488c7c2da0f\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-2htj2"
Jul 15 18:28:19.949394 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:28:19.949354    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/6dec4d6e-b17a-4bba-a8fd-4488c7c2da0f-home\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-2htj2\" (UID: \"6dec4d6e-b17a-4bba-a8fd-4488c7c2da0f\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-2htj2"
Jul 15 18:28:19.949492 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:28:19.949396    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/6dec4d6e-b17a-4bba-a8fd-4488c7c2da0f-model-cache\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-2htj2\" (UID: \"6dec4d6e-b17a-4bba-a8fd-4488c7c2da0f\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-2htj2"
Jul 15 18:28:19.949492 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:28:19.949408    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/6dec4d6e-b17a-4bba-a8fd-4488c7c2da0f-tmp-dir\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-2htj2\" (UID: \"6dec4d6e-b17a-4bba-a8fd-4488c7c2da0f\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-2htj2"
Jul 15 18:28:19.951248 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:28:19.951213    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/6dec4d6e-b17a-4bba-a8fd-4488c7c2da0f-dshm\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-2htj2\" (UID: \"6dec4d6e-b17a-4bba-a8fd-4488c7c2da0f\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-2htj2"
Jul 15 18:28:19.951495 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:28:19.951480    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/6dec4d6e-b17a-4bba-a8fd-4488c7c2da0f-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-2htj2\" (UID: \"6dec4d6e-b17a-4bba-a8fd-4488c7c2da0f\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-2htj2"
Jul 15 18:28:19.956973 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:28:19.956927    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bkmbb\" (UniqueName: \"kubernetes.io/projected/6dec4d6e-b17a-4bba-a8fd-4488c7c2da0f-kube-api-access-bkmbb\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-2htj2\" (UID: \"6dec4d6e-b17a-4bba-a8fd-4488c7c2da0f\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-2htj2"
Jul 15 18:28:20.019365 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:28:20.019334    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-2htj2"
Jul 15 18:28:20.186974 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:28:20.186950    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-2htj2"]
Jul 15 18:28:20.188752 ip-10-0-141-171 kubenswrapper[2567]: W0715 18:28:20.188724    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod6dec4d6e_b17a_4bba_a8fd_4488c7c2da0f.slice/crio-00e4b70e625c022beeebd66b4ed1bad54c70c0d942b6ee6ecd09655b55cb8b91 WatchSource:0}: Error finding container 00e4b70e625c022beeebd66b4ed1bad54c70c0d942b6ee6ecd09655b55cb8b91: Status 404 returned error can't find the container with id 00e4b70e625c022beeebd66b4ed1bad54c70c0d942b6ee6ecd09655b55cb8b91
Jul 15 18:28:20.292464 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:28:20.292384    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-2htj2" event={"ID":"6dec4d6e-b17a-4bba-a8fd-4488c7c2da0f","Type":"ContainerStarted","Data":"00e4b70e625c022beeebd66b4ed1bad54c70c0d942b6ee6ecd09655b55cb8b91"}
Jul 15 18:28:21.298584 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:28:21.298545    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-2htj2" event={"ID":"6dec4d6e-b17a-4bba-a8fd-4488c7c2da0f","Type":"ContainerStarted","Data":"f616301b83fd1b1be0b306711e0aaae89c6a8049256e824be9ff53e712cd4269"}
Jul 15 18:28:21.318525 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:28:21.318481    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-2htj2" podStartSLOduration=2.111378606 podStartE2EDuration="2.318467811s" totalImagesPullingTime="207.089205ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 18:28:19 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 18:28:21.316030271 +0000 UTC m=+659.850453651" watchObservedRunningTime="2026-07-15 18:28:21.318467811 +0000 UTC m=+659.852891166"
Jul 15 18:28:26.305001 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:28:26.304968    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-gscwq"
Jul 15 18:28:26.305396 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:28:26.305016    2567 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-gscwq"
Jul 15 18:28:26.317448 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:28:26.317423    2567 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-gscwq"
Jul 15 18:28:26.332657 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:28:26.332632    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-gscwq"
Jul 15 18:28:29.088833 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:28:29.088795    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-qfldk"]
Jul 15 18:28:30.019700 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:28:30.019660    2567 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-2htj2"
Jul 15 18:28:30.019889 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:28:30.019722    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-2htj2"
Jul 15 18:28:30.032316 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:28:30.032286    2567 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-2htj2"
Jul 15 18:28:30.349725 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:28:30.349645    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-2htj2"
Jul 15 18:30:15.696290 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:30:15.696256    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-qfldk"]
Jul 15 18:30:24.785807 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:30:24.785772    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-qfldk"]
Jul 15 18:30:36.784143 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:30:36.784105    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-qfldk"]
Jul 15 18:30:45.593743 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:30:45.593663    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-qfldk"]
Jul 15 18:30:56.287853 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:30:56.287815    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-qfldk"]
Jul 15 18:32:00.781824 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:32:00.781786    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-qfldk"]
Jul 15 18:32:11.281570 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:32:11.281537    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-qfldk"]
Jul 15 18:32:21.685459 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:32:21.685420    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-qfldk"]
Jul 15 18:32:23.447533 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:32:23.447507    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-8hmqx_d8816772-beae-4dff-9c51-9043199e488d/ovn-acl-logging/0.log"
Jul 15 18:32:23.450956 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:32:23.450937    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-8hmqx_d8816772-beae-4dff-9c51-9043199e488d/ovn-acl-logging/0.log"
Jul 15 18:32:29.492558 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:32:29.492525    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-qfldk"]
Jul 15 18:32:40.293962 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:32:40.293928    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-qfldk"]
Jul 15 18:32:51.595726 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:32:51.595688    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-qfldk"]
Jul 15 18:33:02.188469 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:33:02.188435    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-qfldk"]
Jul 15 18:33:12.084613 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:33:12.084581    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-qfldk"]
Jul 15 18:33:37.293801 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:33:37.293766    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-qfldk"]
Jul 15 18:33:48.207992 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:33:48.207902    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-qfldk"]
Jul 15 18:34:10.895955 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:34:10.895921    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-qfldk"]
Jul 15 18:34:24.479050 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:34:24.479011    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-qfldk"]
Jul 15 18:34:37.485309 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:34:37.485217    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-qfldk"]
Jul 15 18:34:49.396347 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:34:49.396310    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-qfldk"]
Jul 15 18:34:58.795130 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:34:58.795092    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-qfldk"]
Jul 15 18:35:08.685368 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:35:08.685326    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-qfldk"]
Jul 15 18:35:18.784711 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:35:18.784630    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-qfldk"]
Jul 15 18:37:05.386341 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:37:05.386307    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-qfldk"]
Jul 15 18:37:15.092718 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:37:15.092678    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-qfldk"]
Jul 15 18:37:23.477533 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:37:23.477414    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-8hmqx_d8816772-beae-4dff-9c51-9043199e488d/ovn-acl-logging/0.log"
Jul 15 18:37:23.481519 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:37:23.481501    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-8hmqx_d8816772-beae-4dff-9c51-9043199e488d/ovn-acl-logging/0.log"
Jul 15 18:37:28.884147 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:37:28.884111    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-qfldk"]
Jul 15 18:37:39.687608 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:37:39.687571    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-qfldk"]
Jul 15 18:37:57.284968 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:37:57.284933    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-qfldk"]
Jul 15 18:38:06.690764 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:38:06.690730    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-qfldk"]
Jul 15 18:38:15.282632 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:38:15.282547    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-qfldk"]
Jul 15 18:38:25.289941 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:38:25.289899    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-qfldk"]
Jul 15 18:38:34.780749 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:38:34.780708    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-qfldk"]
Jul 15 18:38:43.582490 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:38:43.582455    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-qfldk"]
Jul 15 18:38:54.383496 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:38:54.383459    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-qfldk"]
Jul 15 18:39:18.779008 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:39:18.778970    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-qfldk"]
Jul 15 18:39:26.783257 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:39:26.783196    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-qfldk"]
Jul 15 18:39:36.484917 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:39:36.484882    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-qfldk"]
Jul 15 18:39:45.788664 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:39:45.788578    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-qfldk"]
Jul 15 18:39:58.380466 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:39:58.380429    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-qfldk"]
Jul 15 18:40:10.389615 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:40:10.389575    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-qfldk"]
Jul 15 18:40:24.693081 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:40:24.693042    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-qfldk"]
Jul 15 18:40:33.584297 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:40:33.584264    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-qfldk"]
Jul 15 18:40:47.989972 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:40:47.989933    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-qfldk"]
Jul 15 18:40:57.085495 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:40:57.085456    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-qfldk"]
Jul 15 18:41:10.186338 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:41:10.186300    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-qfldk"]
Jul 15 18:41:19.686599 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:41:19.686520    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-qfldk"]
Jul 15 18:41:29.611579 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:41:29.611543    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-qfldk"]
Jul 15 18:41:40.786409 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:41:40.786372    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-qfldk"]
Jul 15 18:41:51.789270 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:41:51.789219    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-qfldk"]
Jul 15 18:41:58.521139 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:41:58.521107    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-qfldk"]
Jul 15 18:42:13.987881 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:42:13.987838    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-qfldk"]
Jul 15 18:42:23.510530 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:42:23.510414    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-8hmqx_d8816772-beae-4dff-9c51-9043199e488d/ovn-acl-logging/0.log"
Jul 15 18:42:23.514537 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:42:23.514176    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-8hmqx_d8816772-beae-4dff-9c51-9043199e488d/ovn-acl-logging/0.log"
Jul 15 18:42:25.897314 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:42:25.897280    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-qfldk"]
Jul 15 18:42:37.682892 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:42:37.682856    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-qfldk"]
Jul 15 18:42:46.882641 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:42:46.882566    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-qfldk"]
Jul 15 18:42:58.883814 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:42:58.883776    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-qfldk"]
Jul 15 18:43:11.510430 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:43:11.510396    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-qfldk"]
Jul 15 18:43:26.103926 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:43:26.103888    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-qfldk"]
Jul 15 18:44:33.813974 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:44:33.813940    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-qfldk"]
Jul 15 18:44:49.783527 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:44:49.783487    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-qfldk"]
Jul 15 18:45:55.189359 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:45:55.189285    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-qfldk"]
Jul 15 18:46:07.980816 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:46:07.980784    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-qfldk"]
Jul 15 18:47:23.540664 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:47:23.540556    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-8hmqx_d8816772-beae-4dff-9c51-9043199e488d/ovn-acl-logging/0.log"
Jul 15 18:47:23.545978 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:47:23.545965    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-8hmqx_d8816772-beae-4dff-9c51-9043199e488d/ovn-acl-logging/0.log"
Jul 15 18:47:24.085443 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:47:24.085411    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-qfldk"]
Jul 15 18:47:44.994887 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:47:44.994853    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-qfldk"]
Jul 15 18:48:45.691449 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:48:45.691376    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-qfldk"]
Jul 15 18:50:22.697056 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:50:22.696975    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-qfldk"]
Jul 15 18:50:31.921718 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:50:31.921680    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-qfldk"]
Jul 15 18:50:47.535695 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:50:47.535611    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-qfldk"]
Jul 15 18:51:06.702277 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:51:06.702246    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-qfldk"]
Jul 15 18:51:50.190926 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:51:50.190888    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-qfldk"]
Jul 15 18:51:58.597273 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:51:58.597226    2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-mt-ba7662e4/e2e-lifecycle-model-ba7662e4-kserve-7b599d8dc5-ph7tf"]
Jul 15 18:51:58.600784 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:51:58.600762    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-mt-ba7662e4/e2e-lifecycle-model-ba7662e4-kserve-7b599d8dc5-ph7tf"
Jul 15 18:51:58.603485 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:51:58.603462    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-mt-ba7662e4\"/\"openshift-service-ca.crt\""
Jul 15 18:51:58.603605 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:51:58.603587    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-mt-ba7662e4\"/\"kube-root-ca.crt\""
Jul 15 18:51:58.604296 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:51:58.604275    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-mt-ba7662e4\"/\"e2e-lifecycle-model-ba7662e4-kserve-self-signed-certs\""
Jul 15 18:51:58.604381 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:51:58.604298    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-mt-ba7662e4\"/\"default-dockercfg-n5px2\""
Jul 15 18:51:58.611952 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:51:58.611932    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-mt-ba7662e4/e2e-lifecycle-model-ba7662e4-kserve-7b599d8dc5-ph7tf"]
Jul 15 18:51:58.628328 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:51:58.628306    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/6f3e1621-7dc3-49d3-91d7-2967a56024de-tmp-dir\") pod \"e2e-lifecycle-model-ba7662e4-kserve-7b599d8dc5-ph7tf\" (UID: \"6f3e1621-7dc3-49d3-91d7-2967a56024de\") " pod="ai-tenant-e2e-mt-ba7662e4/e2e-lifecycle-model-ba7662e4-kserve-7b599d8dc5-ph7tf"
Jul 15 18:51:58.628328 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:51:58.628334    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vwv2d\" (UniqueName: \"kubernetes.io/projected/6f3e1621-7dc3-49d3-91d7-2967a56024de-kube-api-access-vwv2d\") pod \"e2e-lifecycle-model-ba7662e4-kserve-7b599d8dc5-ph7tf\" (UID: \"6f3e1621-7dc3-49d3-91d7-2967a56024de\") " pod="ai-tenant-e2e-mt-ba7662e4/e2e-lifecycle-model-ba7662e4-kserve-7b599d8dc5-ph7tf"
Jul 15 18:51:58.628477 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:51:58.628375    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/6f3e1621-7dc3-49d3-91d7-2967a56024de-dshm\") pod \"e2e-lifecycle-model-ba7662e4-kserve-7b599d8dc5-ph7tf\" (UID: \"6f3e1621-7dc3-49d3-91d7-2967a56024de\") " pod="ai-tenant-e2e-mt-ba7662e4/e2e-lifecycle-model-ba7662e4-kserve-7b599d8dc5-ph7tf"
Jul 15 18:51:58.628477 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:51:58.628437    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/6f3e1621-7dc3-49d3-91d7-2967a56024de-home\") pod \"e2e-lifecycle-model-ba7662e4-kserve-7b599d8dc5-ph7tf\" (UID: \"6f3e1621-7dc3-49d3-91d7-2967a56024de\") " pod="ai-tenant-e2e-mt-ba7662e4/e2e-lifecycle-model-ba7662e4-kserve-7b599d8dc5-ph7tf"
Jul 15 18:51:58.628552 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:51:58.628491    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/6f3e1621-7dc3-49d3-91d7-2967a56024de-model-cache\") pod \"e2e-lifecycle-model-ba7662e4-kserve-7b599d8dc5-ph7tf\" (UID: \"6f3e1621-7dc3-49d3-91d7-2967a56024de\") " pod="ai-tenant-e2e-mt-ba7662e4/e2e-lifecycle-model-ba7662e4-kserve-7b599d8dc5-ph7tf"
Jul 15 18:51:58.628552 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:51:58.628512    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/6f3e1621-7dc3-49d3-91d7-2967a56024de-tls-certs\") pod \"e2e-lifecycle-model-ba7662e4-kserve-7b599d8dc5-ph7tf\" (UID: \"6f3e1621-7dc3-49d3-91d7-2967a56024de\") " pod="ai-tenant-e2e-mt-ba7662e4/e2e-lifecycle-model-ba7662e4-kserve-7b599d8dc5-ph7tf"
Jul 15 18:51:58.729602 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:51:58.729566    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/6f3e1621-7dc3-49d3-91d7-2967a56024de-home\") pod \"e2e-lifecycle-model-ba7662e4-kserve-7b599d8dc5-ph7tf\" (UID: \"6f3e1621-7dc3-49d3-91d7-2967a56024de\") " pod="ai-tenant-e2e-mt-ba7662e4/e2e-lifecycle-model-ba7662e4-kserve-7b599d8dc5-ph7tf"
Jul 15 18:51:58.729712 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:51:58.729616    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/6f3e1621-7dc3-49d3-91d7-2967a56024de-model-cache\") pod \"e2e-lifecycle-model-ba7662e4-kserve-7b599d8dc5-ph7tf\" (UID: \"6f3e1621-7dc3-49d3-91d7-2967a56024de\") " pod="ai-tenant-e2e-mt-ba7662e4/e2e-lifecycle-model-ba7662e4-kserve-7b599d8dc5-ph7tf"
Jul 15 18:51:58.729712 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:51:58.729658    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/6f3e1621-7dc3-49d3-91d7-2967a56024de-tls-certs\") pod \"e2e-lifecycle-model-ba7662e4-kserve-7b599d8dc5-ph7tf\" (UID: \"6f3e1621-7dc3-49d3-91d7-2967a56024de\") " pod="ai-tenant-e2e-mt-ba7662e4/e2e-lifecycle-model-ba7662e4-kserve-7b599d8dc5-ph7tf"
Jul 15 18:51:58.729813 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:51:58.729743    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/6f3e1621-7dc3-49d3-91d7-2967a56024de-tmp-dir\") pod \"e2e-lifecycle-model-ba7662e4-kserve-7b599d8dc5-ph7tf\" (UID: \"6f3e1621-7dc3-49d3-91d7-2967a56024de\") " pod="ai-tenant-e2e-mt-ba7662e4/e2e-lifecycle-model-ba7662e4-kserve-7b599d8dc5-ph7tf"
Jul 15 18:51:58.729813 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:51:58.729760    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vwv2d\" (UniqueName: \"kubernetes.io/projected/6f3e1621-7dc3-49d3-91d7-2967a56024de-kube-api-access-vwv2d\") pod \"e2e-lifecycle-model-ba7662e4-kserve-7b599d8dc5-ph7tf\" (UID: \"6f3e1621-7dc3-49d3-91d7-2967a56024de\") " pod="ai-tenant-e2e-mt-ba7662e4/e2e-lifecycle-model-ba7662e4-kserve-7b599d8dc5-ph7tf"
Jul 15 18:51:58.729893 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:51:58.729816    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/6f3e1621-7dc3-49d3-91d7-2967a56024de-dshm\") pod \"e2e-lifecycle-model-ba7662e4-kserve-7b599d8dc5-ph7tf\" (UID: \"6f3e1621-7dc3-49d3-91d7-2967a56024de\") " pod="ai-tenant-e2e-mt-ba7662e4/e2e-lifecycle-model-ba7662e4-kserve-7b599d8dc5-ph7tf"
Jul 15 18:51:58.730003 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:51:58.729985    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/6f3e1621-7dc3-49d3-91d7-2967a56024de-home\") pod \"e2e-lifecycle-model-ba7662e4-kserve-7b599d8dc5-ph7tf\" (UID: \"6f3e1621-7dc3-49d3-91d7-2967a56024de\") " pod="ai-tenant-e2e-mt-ba7662e4/e2e-lifecycle-model-ba7662e4-kserve-7b599d8dc5-ph7tf"
Jul 15 18:51:58.730072 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:51:58.730021    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/6f3e1621-7dc3-49d3-91d7-2967a56024de-model-cache\") pod \"e2e-lifecycle-model-ba7662e4-kserve-7b599d8dc5-ph7tf\" (UID: \"6f3e1621-7dc3-49d3-91d7-2967a56024de\") " pod="ai-tenant-e2e-mt-ba7662e4/e2e-lifecycle-model-ba7662e4-kserve-7b599d8dc5-ph7tf"
Jul 15 18:51:58.730072 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:51:58.730054    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/6f3e1621-7dc3-49d3-91d7-2967a56024de-tmp-dir\") pod \"e2e-lifecycle-model-ba7662e4-kserve-7b599d8dc5-ph7tf\" (UID: \"6f3e1621-7dc3-49d3-91d7-2967a56024de\") " pod="ai-tenant-e2e-mt-ba7662e4/e2e-lifecycle-model-ba7662e4-kserve-7b599d8dc5-ph7tf"
Jul 15 18:51:58.731901 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:51:58.731880    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/6f3e1621-7dc3-49d3-91d7-2967a56024de-dshm\") pod \"e2e-lifecycle-model-ba7662e4-kserve-7b599d8dc5-ph7tf\" (UID: \"6f3e1621-7dc3-49d3-91d7-2967a56024de\") " pod="ai-tenant-e2e-mt-ba7662e4/e2e-lifecycle-model-ba7662e4-kserve-7b599d8dc5-ph7tf"
Jul 15 18:51:58.732195 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:51:58.732173    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/6f3e1621-7dc3-49d3-91d7-2967a56024de-tls-certs\") pod \"e2e-lifecycle-model-ba7662e4-kserve-7b599d8dc5-ph7tf\" (UID: \"6f3e1621-7dc3-49d3-91d7-2967a56024de\") " pod="ai-tenant-e2e-mt-ba7662e4/e2e-lifecycle-model-ba7662e4-kserve-7b599d8dc5-ph7tf"
Jul 15 18:51:58.745572 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:51:58.745542    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vwv2d\" (UniqueName: \"kubernetes.io/projected/6f3e1621-7dc3-49d3-91d7-2967a56024de-kube-api-access-vwv2d\") pod \"e2e-lifecycle-model-ba7662e4-kserve-7b599d8dc5-ph7tf\" (UID: \"6f3e1621-7dc3-49d3-91d7-2967a56024de\") " pod="ai-tenant-e2e-mt-ba7662e4/e2e-lifecycle-model-ba7662e4-kserve-7b599d8dc5-ph7tf"
Jul 15 18:51:58.910022 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:51:58.909946    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-mt-ba7662e4/e2e-lifecycle-model-ba7662e4-kserve-7b599d8dc5-ph7tf"
Jul 15 18:51:59.038618 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:51:59.038594    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-mt-ba7662e4/e2e-lifecycle-model-ba7662e4-kserve-7b599d8dc5-ph7tf"]
Jul 15 18:51:59.040185 ip-10-0-141-171 kubenswrapper[2567]: W0715 18:51:59.040153    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod6f3e1621_7dc3_49d3_91d7_2967a56024de.slice/crio-ccfe6aa8ebf3b4aff0faaa61f5b6a8a5d07808163d506a80d176f9aa3670cc92 WatchSource:0}: Error finding container ccfe6aa8ebf3b4aff0faaa61f5b6a8a5d07808163d506a80d176f9aa3670cc92: Status 404 returned error can't find the container with id ccfe6aa8ebf3b4aff0faaa61f5b6a8a5d07808163d506a80d176f9aa3670cc92
Jul 15 18:51:59.980773 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:51:59.980729    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-mt-ba7662e4/e2e-lifecycle-model-ba7662e4-kserve-7b599d8dc5-ph7tf" event={"ID":"6f3e1621-7dc3-49d3-91d7-2967a56024de","Type":"ContainerStarted","Data":"88d6967c11470ea754cf9b649be37afe47e7b5a420522567d7bb286fd5d07a7f"}
Jul 15 18:51:59.981149 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:51:59.980782    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-mt-ba7662e4/e2e-lifecycle-model-ba7662e4-kserve-7b599d8dc5-ph7tf" event={"ID":"6f3e1621-7dc3-49d3-91d7-2967a56024de","Type":"ContainerStarted","Data":"ccfe6aa8ebf3b4aff0faaa61f5b6a8a5d07808163d506a80d176f9aa3670cc92"}
Jul 15 18:52:00.015797 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:52:00.015745    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-mt-ba7662e4/e2e-lifecycle-model-ba7662e4-kserve-7b599d8dc5-ph7tf" podStartSLOduration=2.015727002 podStartE2EDuration="2.015727002s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 18:51:58 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 18:52:00.015675377 +0000 UTC m=+2078.550098733" watchObservedRunningTime="2026-07-15 18:52:00.015727002 +0000 UTC m=+2078.550150359"
Jul 15 18:52:04.697748 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:52:04.697716    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-qfldk"]
Jul 15 18:52:08.910490 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:52:08.910454    2567 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-mt-ba7662e4/e2e-lifecycle-model-ba7662e4-kserve-7b599d8dc5-ph7tf"
Jul 15 18:52:08.910490 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:52:08.910498    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-mt-ba7662e4/e2e-lifecycle-model-ba7662e4-kserve-7b599d8dc5-ph7tf"
Jul 15 18:52:08.922917 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:52:08.922884    2567 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-mt-ba7662e4/e2e-lifecycle-model-ba7662e4-kserve-7b599d8dc5-ph7tf"
Jul 15 18:52:09.034000 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:52:09.033964    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-mt-ba7662e4/e2e-lifecycle-model-ba7662e4-kserve-7b599d8dc5-ph7tf"
Jul 15 18:52:13.415528 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:52:13.415495    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-qfldk"]
Jul 15 18:52:23.577931 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:52:23.577821    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-8hmqx_d8816772-beae-4dff-9c51-9043199e488d/ovn-acl-logging/0.log"
Jul 15 18:52:23.592504 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:52:23.584129    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-8hmqx_d8816772-beae-4dff-9c51-9043199e488d/ovn-acl-logging/0.log"
Jul 15 18:52:31.697067 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:52:31.697035    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-qfldk"]
Jul 15 18:52:37.122152 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:52:37.122114    2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-mt-ba7662e4/e2e-lifecycle-model-ba7662e4-kserve-7b599d8dc5-ph7tf"]
Jul 15 18:52:52.144202 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:52:52.144156    2567 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-mt-ba7662e4/e2e-lifecycle-model-ba7662e4-kserve-7b599d8dc5-ph7tf" podUID="6f3e1621-7dc3-49d3-91d7-2967a56024de" containerName="main" containerID="cri-o://88d6967c11470ea754cf9b649be37afe47e7b5a420522567d7bb286fd5d07a7f" gracePeriod=45
Jul 15 18:52:52.399844 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:52:52.399782    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-mt-ba7662e4/e2e-lifecycle-model-ba7662e4-kserve-7b599d8dc5-ph7tf"
Jul 15 18:52:52.524722 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:52:52.524687    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/6f3e1621-7dc3-49d3-91d7-2967a56024de-home\") pod \"6f3e1621-7dc3-49d3-91d7-2967a56024de\" (UID: \"6f3e1621-7dc3-49d3-91d7-2967a56024de\") "
Jul 15 18:52:52.524722 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:52:52.524723    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/6f3e1621-7dc3-49d3-91d7-2967a56024de-model-cache\") pod \"6f3e1621-7dc3-49d3-91d7-2967a56024de\" (UID: \"6f3e1621-7dc3-49d3-91d7-2967a56024de\") "
Jul 15 18:52:52.524981 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:52:52.524768    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-vwv2d\" (UniqueName: \"kubernetes.io/projected/6f3e1621-7dc3-49d3-91d7-2967a56024de-kube-api-access-vwv2d\") pod \"6f3e1621-7dc3-49d3-91d7-2967a56024de\" (UID: \"6f3e1621-7dc3-49d3-91d7-2967a56024de\") "
Jul 15 18:52:52.524981 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:52:52.524791    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/6f3e1621-7dc3-49d3-91d7-2967a56024de-dshm\") pod \"6f3e1621-7dc3-49d3-91d7-2967a56024de\" (UID: \"6f3e1621-7dc3-49d3-91d7-2967a56024de\") "
Jul 15 18:52:52.524981 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:52:52.524841    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/6f3e1621-7dc3-49d3-91d7-2967a56024de-tls-certs\") pod \"6f3e1621-7dc3-49d3-91d7-2967a56024de\" (UID: \"6f3e1621-7dc3-49d3-91d7-2967a56024de\") "
Jul 15 18:52:52.524981 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:52:52.524910    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/6f3e1621-7dc3-49d3-91d7-2967a56024de-tmp-dir\") pod \"6f3e1621-7dc3-49d3-91d7-2967a56024de\" (UID: \"6f3e1621-7dc3-49d3-91d7-2967a56024de\") "
Jul 15 18:52:52.525181 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:52:52.524991    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6f3e1621-7dc3-49d3-91d7-2967a56024de-home" (OuterVolumeSpecName: "home") pod "6f3e1621-7dc3-49d3-91d7-2967a56024de" (UID: "6f3e1621-7dc3-49d3-91d7-2967a56024de"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 15 18:52:52.525181 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:52:52.525068    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6f3e1621-7dc3-49d3-91d7-2967a56024de-model-cache" (OuterVolumeSpecName: "model-cache") pod "6f3e1621-7dc3-49d3-91d7-2967a56024de" (UID: "6f3e1621-7dc3-49d3-91d7-2967a56024de"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 15 18:52:52.525313 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:52:52.525225    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6f3e1621-7dc3-49d3-91d7-2967a56024de-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "6f3e1621-7dc3-49d3-91d7-2967a56024de" (UID: "6f3e1621-7dc3-49d3-91d7-2967a56024de"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 15 18:52:52.525313 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:52:52.525269    2567 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/6f3e1621-7dc3-49d3-91d7-2967a56024de-home\") on node \"ip-10-0-141-171.ec2.internal\" DevicePath \"\""
Jul 15 18:52:52.525313 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:52:52.525292    2567 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/6f3e1621-7dc3-49d3-91d7-2967a56024de-model-cache\") on node \"ip-10-0-141-171.ec2.internal\" DevicePath \"\""
Jul 15 18:52:52.527080 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:52:52.527057    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6f3e1621-7dc3-49d3-91d7-2967a56024de-dshm" (OuterVolumeSpecName: "dshm") pod "6f3e1621-7dc3-49d3-91d7-2967a56024de" (UID: "6f3e1621-7dc3-49d3-91d7-2967a56024de"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 15 18:52:52.527080 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:52:52.527072    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6f3e1621-7dc3-49d3-91d7-2967a56024de-kube-api-access-vwv2d" (OuterVolumeSpecName: "kube-api-access-vwv2d") pod "6f3e1621-7dc3-49d3-91d7-2967a56024de" (UID: "6f3e1621-7dc3-49d3-91d7-2967a56024de"). InnerVolumeSpecName "kube-api-access-vwv2d". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 15 18:52:52.527182 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:52:52.527148    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6f3e1621-7dc3-49d3-91d7-2967a56024de-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "6f3e1621-7dc3-49d3-91d7-2967a56024de" (UID: "6f3e1621-7dc3-49d3-91d7-2967a56024de"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 15 18:52:52.625986 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:52:52.625956    2567 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/6f3e1621-7dc3-49d3-91d7-2967a56024de-tmp-dir\") on node \"ip-10-0-141-171.ec2.internal\" DevicePath \"\""
Jul 15 18:52:52.625986 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:52:52.625984    2567 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-vwv2d\" (UniqueName: \"kubernetes.io/projected/6f3e1621-7dc3-49d3-91d7-2967a56024de-kube-api-access-vwv2d\") on node \"ip-10-0-141-171.ec2.internal\" DevicePath \"\""
Jul 15 18:52:52.625986 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:52:52.625995    2567 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/6f3e1621-7dc3-49d3-91d7-2967a56024de-dshm\") on node \"ip-10-0-141-171.ec2.internal\" DevicePath \"\""
Jul 15 18:52:52.626207 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:52:52.626003    2567 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/6f3e1621-7dc3-49d3-91d7-2967a56024de-tls-certs\") on node \"ip-10-0-141-171.ec2.internal\" DevicePath \"\""
Jul 15 18:52:53.236166 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:52:53.236131    2567 generic.go:356] "Generic (PLEG): container finished" podID="6f3e1621-7dc3-49d3-91d7-2967a56024de" containerID="88d6967c11470ea754cf9b649be37afe47e7b5a420522567d7bb286fd5d07a7f" exitCode=0
Jul 15 18:52:53.236604 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:52:53.236174    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-mt-ba7662e4/e2e-lifecycle-model-ba7662e4-kserve-7b599d8dc5-ph7tf"
Jul 15 18:52:53.236604 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:52:53.236244    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-mt-ba7662e4/e2e-lifecycle-model-ba7662e4-kserve-7b599d8dc5-ph7tf" event={"ID":"6f3e1621-7dc3-49d3-91d7-2967a56024de","Type":"ContainerDied","Data":"88d6967c11470ea754cf9b649be37afe47e7b5a420522567d7bb286fd5d07a7f"}
Jul 15 18:52:53.236604 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:52:53.236293    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-mt-ba7662e4/e2e-lifecycle-model-ba7662e4-kserve-7b599d8dc5-ph7tf" event={"ID":"6f3e1621-7dc3-49d3-91d7-2967a56024de","Type":"ContainerDied","Data":"ccfe6aa8ebf3b4aff0faaa61f5b6a8a5d07808163d506a80d176f9aa3670cc92"}
Jul 15 18:52:53.236604 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:52:53.236318    2567 scope.go:117] "RemoveContainer" containerID="88d6967c11470ea754cf9b649be37afe47e7b5a420522567d7bb286fd5d07a7f"
Jul 15 18:52:53.245527 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:52:53.245510    2567 scope.go:117] "RemoveContainer" containerID="88d6967c11470ea754cf9b649be37afe47e7b5a420522567d7bb286fd5d07a7f"
Jul 15 18:52:53.245814 ip-10-0-141-171 kubenswrapper[2567]: E0715 18:52:53.245797    2567 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"88d6967c11470ea754cf9b649be37afe47e7b5a420522567d7bb286fd5d07a7f\": container with ID starting with 88d6967c11470ea754cf9b649be37afe47e7b5a420522567d7bb286fd5d07a7f not found: ID does not exist" containerID="88d6967c11470ea754cf9b649be37afe47e7b5a420522567d7bb286fd5d07a7f"
Jul 15 18:52:53.245875 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:52:53.245823    2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"88d6967c11470ea754cf9b649be37afe47e7b5a420522567d7bb286fd5d07a7f"} err="failed to get container status \"88d6967c11470ea754cf9b649be37afe47e7b5a420522567d7bb286fd5d07a7f\": rpc error: code = NotFound desc = could not find container \"88d6967c11470ea754cf9b649be37afe47e7b5a420522567d7bb286fd5d07a7f\": container with ID starting with 88d6967c11470ea754cf9b649be37afe47e7b5a420522567d7bb286fd5d07a7f not found: ID does not exist"
Jul 15 18:52:53.257441 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:52:53.257419    2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-mt-ba7662e4/e2e-lifecycle-model-ba7662e4-kserve-7b599d8dc5-ph7tf"]
Jul 15 18:52:53.264252 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:52:53.264213    2567 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-mt-ba7662e4/e2e-lifecycle-model-ba7662e4-kserve-7b599d8dc5-ph7tf"]
Jul 15 18:52:54.205953 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:52:54.205918    2567 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="6f3e1621-7dc3-49d3-91d7-2967a56024de" path="/var/lib/kubelet/pods/6f3e1621-7dc3-49d3-91d7-2967a56024de/volumes"
Jul 15 18:53:28.001077 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:53:28.001039    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-qfldk"]
Jul 15 18:53:41.783070 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:53:41.783038    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-qfldk"]
Jul 15 18:54:29.407728 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:54:29.407695    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-qfldk"]
Jul 15 18:54:42.511266 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:54:42.511217    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-qfldk"]
Jul 15 18:54:52.593946 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:54:52.593912    2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-inf-a-cbf10e/test-model-cbf10e-kserve-59c5fdc8f9-q9xsb"]
Jul 15 18:54:52.594357 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:54:52.594322    2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6f3e1621-7dc3-49d3-91d7-2967a56024de" containerName="main"
Jul 15 18:54:52.594357 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:54:52.594333    2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="6f3e1621-7dc3-49d3-91d7-2967a56024de" containerName="main"
Jul 15 18:54:52.594436 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:54:52.594389    2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="6f3e1621-7dc3-49d3-91d7-2967a56024de" containerName="main"
Jul 15 18:54:52.597445 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:54:52.597428    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-a-cbf10e/test-model-cbf10e-kserve-59c5fdc8f9-q9xsb"
Jul 15 18:54:52.599876 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:54:52.599856    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-inf-a-cbf10e\"/\"kube-root-ca.crt\""
Jul 15 18:54:52.600463 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:54:52.600438    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-inf-a-cbf10e\"/\"openshift-service-ca.crt\""
Jul 15 18:54:52.600585 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:54:52.600438    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-inf-a-cbf10e\"/\"default-dockercfg-fb4xm\""
Jul 15 18:54:52.600666 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:54:52.600608    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-inf-a-cbf10e\"/\"test-model-cbf10e-kserve-self-signed-certs\""
Jul 15 18:54:52.607926 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:54:52.607902    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-inf-a-cbf10e/test-model-cbf10e-kserve-59c5fdc8f9-q9xsb"]
Jul 15 18:54:52.616077 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:54:52.616053    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/1a083ce6-d542-4598-9b3d-157e53d3a4a2-home\") pod \"test-model-cbf10e-kserve-59c5fdc8f9-q9xsb\" (UID: \"1a083ce6-d542-4598-9b3d-157e53d3a4a2\") " pod="ai-tenant-e2e-inf-a-cbf10e/test-model-cbf10e-kserve-59c5fdc8f9-q9xsb"
Jul 15 18:54:52.616207 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:54:52.616083    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/1a083ce6-d542-4598-9b3d-157e53d3a4a2-model-cache\") pod \"test-model-cbf10e-kserve-59c5fdc8f9-q9xsb\" (UID: \"1a083ce6-d542-4598-9b3d-157e53d3a4a2\") " pod="ai-tenant-e2e-inf-a-cbf10e/test-model-cbf10e-kserve-59c5fdc8f9-q9xsb"
Jul 15 18:54:52.616207 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:54:52.616103    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/1a083ce6-d542-4598-9b3d-157e53d3a4a2-tls-certs\") pod \"test-model-cbf10e-kserve-59c5fdc8f9-q9xsb\" (UID: \"1a083ce6-d542-4598-9b3d-157e53d3a4a2\") " pod="ai-tenant-e2e-inf-a-cbf10e/test-model-cbf10e-kserve-59c5fdc8f9-q9xsb"
Jul 15 18:54:52.616207 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:54:52.616126    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7pqv9\" (UniqueName: \"kubernetes.io/projected/1a083ce6-d542-4598-9b3d-157e53d3a4a2-kube-api-access-7pqv9\") pod \"test-model-cbf10e-kserve-59c5fdc8f9-q9xsb\" (UID: \"1a083ce6-d542-4598-9b3d-157e53d3a4a2\") " pod="ai-tenant-e2e-inf-a-cbf10e/test-model-cbf10e-kserve-59c5fdc8f9-q9xsb"
Jul 15 18:54:52.616207 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:54:52.616186    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/1a083ce6-d542-4598-9b3d-157e53d3a4a2-dshm\") pod \"test-model-cbf10e-kserve-59c5fdc8f9-q9xsb\" (UID: \"1a083ce6-d542-4598-9b3d-157e53d3a4a2\") " pod="ai-tenant-e2e-inf-a-cbf10e/test-model-cbf10e-kserve-59c5fdc8f9-q9xsb"
Jul 15 18:54:52.616451 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:54:52.616280    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/1a083ce6-d542-4598-9b3d-157e53d3a4a2-tmp-dir\") pod \"test-model-cbf10e-kserve-59c5fdc8f9-q9xsb\" (UID: \"1a083ce6-d542-4598-9b3d-157e53d3a4a2\") " pod="ai-tenant-e2e-inf-a-cbf10e/test-model-cbf10e-kserve-59c5fdc8f9-q9xsb"
Jul 15 18:54:52.717328 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:54:52.717286    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/1a083ce6-d542-4598-9b3d-157e53d3a4a2-tmp-dir\") pod \"test-model-cbf10e-kserve-59c5fdc8f9-q9xsb\" (UID: \"1a083ce6-d542-4598-9b3d-157e53d3a4a2\") " pod="ai-tenant-e2e-inf-a-cbf10e/test-model-cbf10e-kserve-59c5fdc8f9-q9xsb"
Jul 15 18:54:52.717513 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:54:52.717363    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/1a083ce6-d542-4598-9b3d-157e53d3a4a2-home\") pod \"test-model-cbf10e-kserve-59c5fdc8f9-q9xsb\" (UID: \"1a083ce6-d542-4598-9b3d-157e53d3a4a2\") " pod="ai-tenant-e2e-inf-a-cbf10e/test-model-cbf10e-kserve-59c5fdc8f9-q9xsb"
Jul 15 18:54:52.717513 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:54:52.717385    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/1a083ce6-d542-4598-9b3d-157e53d3a4a2-model-cache\") pod \"test-model-cbf10e-kserve-59c5fdc8f9-q9xsb\" (UID: \"1a083ce6-d542-4598-9b3d-157e53d3a4a2\") " pod="ai-tenant-e2e-inf-a-cbf10e/test-model-cbf10e-kserve-59c5fdc8f9-q9xsb"
Jul 15 18:54:52.717513 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:54:52.717403    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/1a083ce6-d542-4598-9b3d-157e53d3a4a2-tls-certs\") pod \"test-model-cbf10e-kserve-59c5fdc8f9-q9xsb\" (UID: \"1a083ce6-d542-4598-9b3d-157e53d3a4a2\") " pod="ai-tenant-e2e-inf-a-cbf10e/test-model-cbf10e-kserve-59c5fdc8f9-q9xsb"
Jul 15 18:54:52.717513 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:54:52.717437    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7pqv9\" (UniqueName: \"kubernetes.io/projected/1a083ce6-d542-4598-9b3d-157e53d3a4a2-kube-api-access-7pqv9\") pod \"test-model-cbf10e-kserve-59c5fdc8f9-q9xsb\" (UID: \"1a083ce6-d542-4598-9b3d-157e53d3a4a2\") " pod="ai-tenant-e2e-inf-a-cbf10e/test-model-cbf10e-kserve-59c5fdc8f9-q9xsb"
Jul 15 18:54:52.717513 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:54:52.717466    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/1a083ce6-d542-4598-9b3d-157e53d3a4a2-dshm\") pod \"test-model-cbf10e-kserve-59c5fdc8f9-q9xsb\" (UID: \"1a083ce6-d542-4598-9b3d-157e53d3a4a2\") " pod="ai-tenant-e2e-inf-a-cbf10e/test-model-cbf10e-kserve-59c5fdc8f9-q9xsb"
Jul 15 18:54:52.717756 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:54:52.717701    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/1a083ce6-d542-4598-9b3d-157e53d3a4a2-tmp-dir\") pod \"test-model-cbf10e-kserve-59c5fdc8f9-q9xsb\" (UID: \"1a083ce6-d542-4598-9b3d-157e53d3a4a2\") " pod="ai-tenant-e2e-inf-a-cbf10e/test-model-cbf10e-kserve-59c5fdc8f9-q9xsb"
Jul 15 18:54:52.717811 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:54:52.717763    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/1a083ce6-d542-4598-9b3d-157e53d3a4a2-home\") pod \"test-model-cbf10e-kserve-59c5fdc8f9-q9xsb\" (UID: \"1a083ce6-d542-4598-9b3d-157e53d3a4a2\") " pod="ai-tenant-e2e-inf-a-cbf10e/test-model-cbf10e-kserve-59c5fdc8f9-q9xsb"
Jul 15 18:54:52.717849 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:54:52.717802    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/1a083ce6-d542-4598-9b3d-157e53d3a4a2-model-cache\") pod \"test-model-cbf10e-kserve-59c5fdc8f9-q9xsb\" (UID: \"1a083ce6-d542-4598-9b3d-157e53d3a4a2\") " pod="ai-tenant-e2e-inf-a-cbf10e/test-model-cbf10e-kserve-59c5fdc8f9-q9xsb"
Jul 15 18:54:52.719652 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:54:52.719633    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/1a083ce6-d542-4598-9b3d-157e53d3a4a2-dshm\") pod \"test-model-cbf10e-kserve-59c5fdc8f9-q9xsb\" (UID: \"1a083ce6-d542-4598-9b3d-157e53d3a4a2\") " pod="ai-tenant-e2e-inf-a-cbf10e/test-model-cbf10e-kserve-59c5fdc8f9-q9xsb"
Jul 15 18:54:52.719996 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:54:52.719979    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/1a083ce6-d542-4598-9b3d-157e53d3a4a2-tls-certs\") pod \"test-model-cbf10e-kserve-59c5fdc8f9-q9xsb\" (UID: \"1a083ce6-d542-4598-9b3d-157e53d3a4a2\") " pod="ai-tenant-e2e-inf-a-cbf10e/test-model-cbf10e-kserve-59c5fdc8f9-q9xsb"
Jul 15 18:54:52.725134 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:54:52.725115    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7pqv9\" (UniqueName: \"kubernetes.io/projected/1a083ce6-d542-4598-9b3d-157e53d3a4a2-kube-api-access-7pqv9\") pod \"test-model-cbf10e-kserve-59c5fdc8f9-q9xsb\" (UID: \"1a083ce6-d542-4598-9b3d-157e53d3a4a2\") " pod="ai-tenant-e2e-inf-a-cbf10e/test-model-cbf10e-kserve-59c5fdc8f9-q9xsb"
Jul 15 18:54:52.906891 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:54:52.906806    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-a-cbf10e/test-model-cbf10e-kserve-59c5fdc8f9-q9xsb"
Jul 15 18:54:53.040818 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:54:53.040793    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-inf-a-cbf10e/test-model-cbf10e-kserve-59c5fdc8f9-q9xsb"]
Jul 15 18:54:53.042968 ip-10-0-141-171 kubenswrapper[2567]: W0715 18:54:53.042941    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod1a083ce6_d542_4598_9b3d_157e53d3a4a2.slice/crio-48193335ec4be6f2b94519fa7aadfb7b0e94047ad2bba9d1a907ae81a28c3236 WatchSource:0}: Error finding container 48193335ec4be6f2b94519fa7aadfb7b0e94047ad2bba9d1a907ae81a28c3236: Status 404 returned error can't find the container with id 48193335ec4be6f2b94519fa7aadfb7b0e94047ad2bba9d1a907ae81a28c3236
Jul 15 18:54:53.803701 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:54:53.803669    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-a-cbf10e/test-model-cbf10e-kserve-59c5fdc8f9-q9xsb" event={"ID":"1a083ce6-d542-4598-9b3d-157e53d3a4a2","Type":"ContainerStarted","Data":"ad6d7209c0bf560d30573517bb57df274d000b35062efc114111886cc19cb496"}
Jul 15 18:54:53.804164 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:54:53.803716    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-a-cbf10e/test-model-cbf10e-kserve-59c5fdc8f9-q9xsb" event={"ID":"1a083ce6-d542-4598-9b3d-157e53d3a4a2","Type":"ContainerStarted","Data":"48193335ec4be6f2b94519fa7aadfb7b0e94047ad2bba9d1a907ae81a28c3236"}
Jul 15 18:54:53.826926 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:54:53.826880    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-inf-a-cbf10e/test-model-cbf10e-kserve-59c5fdc8f9-q9xsb" podStartSLOduration=1.826863773 podStartE2EDuration="1.826863773s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 18:54:52 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 18:54:53.82626783 +0000 UTC m=+2252.360691205" watchObservedRunningTime="2026-07-15 18:54:53.826863773 +0000 UTC m=+2252.361287128"
Jul 15 18:54:56.438202 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:54:56.438174    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-qfldk"]
Jul 15 18:55:02.907546 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:55:02.907512    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-inf-a-cbf10e/test-model-cbf10e-kserve-59c5fdc8f9-q9xsb"
Jul 15 18:55:02.908034 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:55:02.907787    2567 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-inf-a-cbf10e/test-model-cbf10e-kserve-59c5fdc8f9-q9xsb"
Jul 15 18:55:02.920136 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:55:02.920110    2567 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-inf-a-cbf10e/test-model-cbf10e-kserve-59c5fdc8f9-q9xsb"
Jul 15 18:55:03.860433 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:55:03.860404    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-inf-a-cbf10e/test-model-cbf10e-kserve-59c5fdc8f9-q9xsb"
Jul 15 18:55:08.010979 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:55:08.010944    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-qfldk"]
Jul 15 18:55:14.434106 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:55:14.434070    2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-inf-b-f83daa/test-model-f83daa-kserve-545989ffc5-cdw9d"]
Jul 15 18:55:14.437873 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:55:14.437851    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-b-f83daa/test-model-f83daa-kserve-545989ffc5-cdw9d"
Jul 15 18:55:14.442410 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:55:14.442390    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-inf-b-f83daa\"/\"kube-root-ca.crt\""
Jul 15 18:55:14.443243 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:55:14.443209    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-inf-b-f83daa\"/\"test-model-f83daa-kserve-self-signed-certs\""
Jul 15 18:55:14.443349 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:55:14.443261    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-inf-b-f83daa\"/\"default-dockercfg-hpmml\""
Jul 15 18:55:14.448989 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:55:14.448974    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-inf-b-f83daa\"/\"openshift-service-ca.crt\""
Jul 15 18:55:14.460742 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:55:14.460711    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-inf-b-f83daa/test-model-f83daa-kserve-545989ffc5-cdw9d"]
Jul 15 18:55:14.529493 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:55:14.529465    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/3b17ffb1-a0e2-46c9-8217-4aed97222895-dshm\") pod \"test-model-f83daa-kserve-545989ffc5-cdw9d\" (UID: \"3b17ffb1-a0e2-46c9-8217-4aed97222895\") " pod="ai-tenant-e2e-inf-b-f83daa/test-model-f83daa-kserve-545989ffc5-cdw9d"
Jul 15 18:55:14.529679 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:55:14.529527    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/3b17ffb1-a0e2-46c9-8217-4aed97222895-model-cache\") pod \"test-model-f83daa-kserve-545989ffc5-cdw9d\" (UID: \"3b17ffb1-a0e2-46c9-8217-4aed97222895\") " pod="ai-tenant-e2e-inf-b-f83daa/test-model-f83daa-kserve-545989ffc5-cdw9d"
Jul 15 18:55:14.529679 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:55:14.529613    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/3b17ffb1-a0e2-46c9-8217-4aed97222895-home\") pod \"test-model-f83daa-kserve-545989ffc5-cdw9d\" (UID: \"3b17ffb1-a0e2-46c9-8217-4aed97222895\") " pod="ai-tenant-e2e-inf-b-f83daa/test-model-f83daa-kserve-545989ffc5-cdw9d"
Jul 15 18:55:14.529679 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:55:14.529648    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7kbsd\" (UniqueName: \"kubernetes.io/projected/3b17ffb1-a0e2-46c9-8217-4aed97222895-kube-api-access-7kbsd\") pod \"test-model-f83daa-kserve-545989ffc5-cdw9d\" (UID: \"3b17ffb1-a0e2-46c9-8217-4aed97222895\") " pod="ai-tenant-e2e-inf-b-f83daa/test-model-f83daa-kserve-545989ffc5-cdw9d"
Jul 15 18:55:14.529855 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:55:14.529726    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/3b17ffb1-a0e2-46c9-8217-4aed97222895-tmp-dir\") pod \"test-model-f83daa-kserve-545989ffc5-cdw9d\" (UID: \"3b17ffb1-a0e2-46c9-8217-4aed97222895\") " pod="ai-tenant-e2e-inf-b-f83daa/test-model-f83daa-kserve-545989ffc5-cdw9d"
Jul 15 18:55:14.529855 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:55:14.529752    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/3b17ffb1-a0e2-46c9-8217-4aed97222895-tls-certs\") pod \"test-model-f83daa-kserve-545989ffc5-cdw9d\" (UID: \"3b17ffb1-a0e2-46c9-8217-4aed97222895\") " pod="ai-tenant-e2e-inf-b-f83daa/test-model-f83daa-kserve-545989ffc5-cdw9d"
Jul 15 18:55:14.631382 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:55:14.631346    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/3b17ffb1-a0e2-46c9-8217-4aed97222895-model-cache\") pod \"test-model-f83daa-kserve-545989ffc5-cdw9d\" (UID: \"3b17ffb1-a0e2-46c9-8217-4aed97222895\") " pod="ai-tenant-e2e-inf-b-f83daa/test-model-f83daa-kserve-545989ffc5-cdw9d"
Jul 15 18:55:14.631566 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:55:14.631399    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/3b17ffb1-a0e2-46c9-8217-4aed97222895-home\") pod \"test-model-f83daa-kserve-545989ffc5-cdw9d\" (UID: \"3b17ffb1-a0e2-46c9-8217-4aed97222895\") " pod="ai-tenant-e2e-inf-b-f83daa/test-model-f83daa-kserve-545989ffc5-cdw9d"
Jul 15 18:55:14.631566 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:55:14.631442    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7kbsd\" (UniqueName: \"kubernetes.io/projected/3b17ffb1-a0e2-46c9-8217-4aed97222895-kube-api-access-7kbsd\") pod \"test-model-f83daa-kserve-545989ffc5-cdw9d\" (UID: \"3b17ffb1-a0e2-46c9-8217-4aed97222895\") " pod="ai-tenant-e2e-inf-b-f83daa/test-model-f83daa-kserve-545989ffc5-cdw9d"
Jul 15 18:55:14.631566 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:55:14.631478    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/3b17ffb1-a0e2-46c9-8217-4aed97222895-tmp-dir\") pod \"test-model-f83daa-kserve-545989ffc5-cdw9d\" (UID: \"3b17ffb1-a0e2-46c9-8217-4aed97222895\") " pod="ai-tenant-e2e-inf-b-f83daa/test-model-f83daa-kserve-545989ffc5-cdw9d"
Jul 15 18:55:14.631566 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:55:14.631502    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/3b17ffb1-a0e2-46c9-8217-4aed97222895-tls-certs\") pod \"test-model-f83daa-kserve-545989ffc5-cdw9d\" (UID: \"3b17ffb1-a0e2-46c9-8217-4aed97222895\") " pod="ai-tenant-e2e-inf-b-f83daa/test-model-f83daa-kserve-545989ffc5-cdw9d"
Jul 15 18:55:14.631798 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:55:14.631571    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/3b17ffb1-a0e2-46c9-8217-4aed97222895-dshm\") pod \"test-model-f83daa-kserve-545989ffc5-cdw9d\" (UID: \"3b17ffb1-a0e2-46c9-8217-4aed97222895\") " pod="ai-tenant-e2e-inf-b-f83daa/test-model-f83daa-kserve-545989ffc5-cdw9d"
Jul 15 18:55:14.631853 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:55:14.631814    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/3b17ffb1-a0e2-46c9-8217-4aed97222895-model-cache\") pod \"test-model-f83daa-kserve-545989ffc5-cdw9d\" (UID: \"3b17ffb1-a0e2-46c9-8217-4aed97222895\") " pod="ai-tenant-e2e-inf-b-f83daa/test-model-f83daa-kserve-545989ffc5-cdw9d"
Jul 15 18:55:14.631894 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:55:14.631850    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/3b17ffb1-a0e2-46c9-8217-4aed97222895-home\") pod \"test-model-f83daa-kserve-545989ffc5-cdw9d\" (UID: \"3b17ffb1-a0e2-46c9-8217-4aed97222895\") " pod="ai-tenant-e2e-inf-b-f83daa/test-model-f83daa-kserve-545989ffc5-cdw9d"
Jul 15 18:55:14.631894 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:55:14.631866    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/3b17ffb1-a0e2-46c9-8217-4aed97222895-tmp-dir\") pod \"test-model-f83daa-kserve-545989ffc5-cdw9d\" (UID: \"3b17ffb1-a0e2-46c9-8217-4aed97222895\") " pod="ai-tenant-e2e-inf-b-f83daa/test-model-f83daa-kserve-545989ffc5-cdw9d"
Jul 15 18:55:14.633754 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:55:14.633733    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/3b17ffb1-a0e2-46c9-8217-4aed97222895-dshm\") pod \"test-model-f83daa-kserve-545989ffc5-cdw9d\" (UID: \"3b17ffb1-a0e2-46c9-8217-4aed97222895\") " pod="ai-tenant-e2e-inf-b-f83daa/test-model-f83daa-kserve-545989ffc5-cdw9d"
Jul 15 18:55:14.634164 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:55:14.634141    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/3b17ffb1-a0e2-46c9-8217-4aed97222895-tls-certs\") pod \"test-model-f83daa-kserve-545989ffc5-cdw9d\" (UID: \"3b17ffb1-a0e2-46c9-8217-4aed97222895\") " pod="ai-tenant-e2e-inf-b-f83daa/test-model-f83daa-kserve-545989ffc5-cdw9d"
Jul 15 18:55:14.639801 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:55:14.639770    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7kbsd\" (UniqueName: \"kubernetes.io/projected/3b17ffb1-a0e2-46c9-8217-4aed97222895-kube-api-access-7kbsd\") pod \"test-model-f83daa-kserve-545989ffc5-cdw9d\" (UID: \"3b17ffb1-a0e2-46c9-8217-4aed97222895\") " pod="ai-tenant-e2e-inf-b-f83daa/test-model-f83daa-kserve-545989ffc5-cdw9d"
Jul 15 18:55:14.747172 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:55:14.747097    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-b-f83daa/test-model-f83daa-kserve-545989ffc5-cdw9d"
Jul 15 18:55:14.886750 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:55:14.886722    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-inf-b-f83daa/test-model-f83daa-kserve-545989ffc5-cdw9d"]
Jul 15 18:55:14.889111 ip-10-0-141-171 kubenswrapper[2567]: W0715 18:55:14.889086    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod3b17ffb1_a0e2_46c9_8217_4aed97222895.slice/crio-c8cfac01e07fecd3f44441bd1eccb9a9dba3f706947cffe3a26d2c0075c76b49 WatchSource:0}: Error finding container c8cfac01e07fecd3f44441bd1eccb9a9dba3f706947cffe3a26d2c0075c76b49: Status 404 returned error can't find the container with id c8cfac01e07fecd3f44441bd1eccb9a9dba3f706947cffe3a26d2c0075c76b49
Jul 15 18:55:14.904432 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:55:14.904391    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-b-f83daa/test-model-f83daa-kserve-545989ffc5-cdw9d" event={"ID":"3b17ffb1-a0e2-46c9-8217-4aed97222895","Type":"ContainerStarted","Data":"c8cfac01e07fecd3f44441bd1eccb9a9dba3f706947cffe3a26d2c0075c76b49"}
Jul 15 18:55:15.911375 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:55:15.911344    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-b-f83daa/test-model-f83daa-kserve-545989ffc5-cdw9d" event={"ID":"3b17ffb1-a0e2-46c9-8217-4aed97222895","Type":"ContainerStarted","Data":"9c840efb9485bd6a20be65ebb6e2d4b03c9f995ec8ad45b1e587b9cc9e56030f"}
Jul 15 18:55:15.933846 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:55:15.933794    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-inf-b-f83daa/test-model-f83daa-kserve-545989ffc5-cdw9d" podStartSLOduration=1.933777982 podStartE2EDuration="1.933777982s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 18:55:14 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 18:55:15.931194907 +0000 UTC m=+2274.465618288" watchObservedRunningTime="2026-07-15 18:55:15.933777982 +0000 UTC m=+2274.468201337"
Jul 15 18:55:18.095966 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:55:18.095925    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-qfldk"]
Jul 15 18:55:24.747710 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:55:24.747674    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-inf-b-f83daa/test-model-f83daa-kserve-545989ffc5-cdw9d"
Jul 15 18:55:24.748204 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:55:24.747759    2567 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-inf-b-f83daa/test-model-f83daa-kserve-545989ffc5-cdw9d"
Jul 15 18:55:24.760330 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:55:24.760305    2567 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-inf-b-f83daa/test-model-f83daa-kserve-545989ffc5-cdw9d"
Jul 15 18:55:24.966672 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:55:24.966639    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-inf-b-f83daa/test-model-f83daa-kserve-545989ffc5-cdw9d"
Jul 15 18:55:35.816484 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:55:35.816446    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-qfldk"]
Jul 15 18:55:49.290274 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:55:49.290240    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-qfldk"]
Jul 15 18:55:56.955008 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:55:56.954977    2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-inf-a-cbf10e/test-model-cbf10e-kserve-59c5fdc8f9-q9xsb"]
Jul 15 18:55:58.067823 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:55:58.067792    2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-inf-b-f83daa/test-model-f83daa-kserve-545989ffc5-cdw9d"]
Jul 15 18:56:03.724246 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:56:03.724203    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-qfldk"]
Jul 15 18:56:11.975368 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:56:11.975319    2567 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-inf-a-cbf10e/test-model-cbf10e-kserve-59c5fdc8f9-q9xsb" podUID="1a083ce6-d542-4598-9b3d-157e53d3a4a2" containerName="main" containerID="cri-o://ad6d7209c0bf560d30573517bb57df274d000b35062efc114111886cc19cb496" gracePeriod=45
Jul 15 18:56:12.178945 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:56:12.178908    2567 generic.go:356] "Generic (PLEG): container finished" podID="1a083ce6-d542-4598-9b3d-157e53d3a4a2" containerID="ad6d7209c0bf560d30573517bb57df274d000b35062efc114111886cc19cb496" exitCode=0
Jul 15 18:56:12.179122 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:56:12.178979    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-a-cbf10e/test-model-cbf10e-kserve-59c5fdc8f9-q9xsb" event={"ID":"1a083ce6-d542-4598-9b3d-157e53d3a4a2","Type":"ContainerDied","Data":"ad6d7209c0bf560d30573517bb57df274d000b35062efc114111886cc19cb496"}
Jul 15 18:56:12.231713 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:56:12.231652    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-a-cbf10e/test-model-cbf10e-kserve-59c5fdc8f9-q9xsb"
Jul 15 18:56:12.269388 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:56:12.269360    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/1a083ce6-d542-4598-9b3d-157e53d3a4a2-model-cache\") pod \"1a083ce6-d542-4598-9b3d-157e53d3a4a2\" (UID: \"1a083ce6-d542-4598-9b3d-157e53d3a4a2\") "
Jul 15 18:56:12.269564 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:56:12.269397    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-7pqv9\" (UniqueName: \"kubernetes.io/projected/1a083ce6-d542-4598-9b3d-157e53d3a4a2-kube-api-access-7pqv9\") pod \"1a083ce6-d542-4598-9b3d-157e53d3a4a2\" (UID: \"1a083ce6-d542-4598-9b3d-157e53d3a4a2\") "
Jul 15 18:56:12.269564 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:56:12.269434    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/1a083ce6-d542-4598-9b3d-157e53d3a4a2-home\") pod \"1a083ce6-d542-4598-9b3d-157e53d3a4a2\" (UID: \"1a083ce6-d542-4598-9b3d-157e53d3a4a2\") "
Jul 15 18:56:12.269564 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:56:12.269470    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/1a083ce6-d542-4598-9b3d-157e53d3a4a2-dshm\") pod \"1a083ce6-d542-4598-9b3d-157e53d3a4a2\" (UID: \"1a083ce6-d542-4598-9b3d-157e53d3a4a2\") "
Jul 15 18:56:12.269564 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:56:12.269496    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/1a083ce6-d542-4598-9b3d-157e53d3a4a2-tmp-dir\") pod \"1a083ce6-d542-4598-9b3d-157e53d3a4a2\" (UID: \"1a083ce6-d542-4598-9b3d-157e53d3a4a2\") "
Jul 15 18:56:12.269564 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:56:12.269520    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/1a083ce6-d542-4598-9b3d-157e53d3a4a2-tls-certs\") pod \"1a083ce6-d542-4598-9b3d-157e53d3a4a2\" (UID: \"1a083ce6-d542-4598-9b3d-157e53d3a4a2\") "
Jul 15 18:56:12.269846 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:56:12.269638    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1a083ce6-d542-4598-9b3d-157e53d3a4a2-model-cache" (OuterVolumeSpecName: "model-cache") pod "1a083ce6-d542-4598-9b3d-157e53d3a4a2" (UID: "1a083ce6-d542-4598-9b3d-157e53d3a4a2"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 15 18:56:12.269846 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:56:12.269770    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1a083ce6-d542-4598-9b3d-157e53d3a4a2-home" (OuterVolumeSpecName: "home") pod "1a083ce6-d542-4598-9b3d-157e53d3a4a2" (UID: "1a083ce6-d542-4598-9b3d-157e53d3a4a2"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 15 18:56:12.269846 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:56:12.269779    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1a083ce6-d542-4598-9b3d-157e53d3a4a2-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "1a083ce6-d542-4598-9b3d-157e53d3a4a2" (UID: "1a083ce6-d542-4598-9b3d-157e53d3a4a2"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 15 18:56:12.269978 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:56:12.269893    2567 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/1a083ce6-d542-4598-9b3d-157e53d3a4a2-tmp-dir\") on node \"ip-10-0-141-171.ec2.internal\" DevicePath \"\""
Jul 15 18:56:12.269978 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:56:12.269907    2567 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/1a083ce6-d542-4598-9b3d-157e53d3a4a2-model-cache\") on node \"ip-10-0-141-171.ec2.internal\" DevicePath \"\""
Jul 15 18:56:12.269978 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:56:12.269923    2567 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/1a083ce6-d542-4598-9b3d-157e53d3a4a2-home\") on node \"ip-10-0-141-171.ec2.internal\" DevicePath \"\""
Jul 15 18:56:12.271782 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:56:12.271756    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1a083ce6-d542-4598-9b3d-157e53d3a4a2-dshm" (OuterVolumeSpecName: "dshm") pod "1a083ce6-d542-4598-9b3d-157e53d3a4a2" (UID: "1a083ce6-d542-4598-9b3d-157e53d3a4a2"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 15 18:56:12.271878 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:56:12.271828    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1a083ce6-d542-4598-9b3d-157e53d3a4a2-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "1a083ce6-d542-4598-9b3d-157e53d3a4a2" (UID: "1a083ce6-d542-4598-9b3d-157e53d3a4a2"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 15 18:56:12.271878 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:56:12.271831    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1a083ce6-d542-4598-9b3d-157e53d3a4a2-kube-api-access-7pqv9" (OuterVolumeSpecName: "kube-api-access-7pqv9") pod "1a083ce6-d542-4598-9b3d-157e53d3a4a2" (UID: "1a083ce6-d542-4598-9b3d-157e53d3a4a2"). InnerVolumeSpecName "kube-api-access-7pqv9". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 15 18:56:12.371138 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:56:12.371104    2567 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/1a083ce6-d542-4598-9b3d-157e53d3a4a2-dshm\") on node \"ip-10-0-141-171.ec2.internal\" DevicePath \"\""
Jul 15 18:56:12.371138 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:56:12.371132    2567 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/1a083ce6-d542-4598-9b3d-157e53d3a4a2-tls-certs\") on node \"ip-10-0-141-171.ec2.internal\" DevicePath \"\""
Jul 15 18:56:12.371138 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:56:12.371143    2567 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-7pqv9\" (UniqueName: \"kubernetes.io/projected/1a083ce6-d542-4598-9b3d-157e53d3a4a2-kube-api-access-7pqv9\") on node \"ip-10-0-141-171.ec2.internal\" DevicePath \"\""
Jul 15 18:56:13.088163 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:56:13.088118    2567 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-inf-b-f83daa/test-model-f83daa-kserve-545989ffc5-cdw9d" podUID="3b17ffb1-a0e2-46c9-8217-4aed97222895" containerName="main" containerID="cri-o://9c840efb9485bd6a20be65ebb6e2d4b03c9f995ec8ad45b1e587b9cc9e56030f" gracePeriod=45
Jul 15 18:56:13.185093 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:56:13.185062    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-a-cbf10e/test-model-cbf10e-kserve-59c5fdc8f9-q9xsb"
Jul 15 18:56:13.185093 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:56:13.185070    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-a-cbf10e/test-model-cbf10e-kserve-59c5fdc8f9-q9xsb" event={"ID":"1a083ce6-d542-4598-9b3d-157e53d3a4a2","Type":"ContainerDied","Data":"48193335ec4be6f2b94519fa7aadfb7b0e94047ad2bba9d1a907ae81a28c3236"}
Jul 15 18:56:13.185357 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:56:13.185129    2567 scope.go:117] "RemoveContainer" containerID="ad6d7209c0bf560d30573517bb57df274d000b35062efc114111886cc19cb496"
Jul 15 18:56:13.208556 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:56:13.208522    2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-inf-a-cbf10e/test-model-cbf10e-kserve-59c5fdc8f9-q9xsb"]
Jul 15 18:56:13.214697 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:56:13.214665    2567 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-inf-a-cbf10e/test-model-cbf10e-kserve-59c5fdc8f9-q9xsb"]
Jul 15 18:56:13.339064 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:56:13.338999    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-b-f83daa/test-model-f83daa-kserve-545989ffc5-cdw9d"
Jul 15 18:56:13.379651 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:56:13.379620    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-7kbsd\" (UniqueName: \"kubernetes.io/projected/3b17ffb1-a0e2-46c9-8217-4aed97222895-kube-api-access-7kbsd\") pod \"3b17ffb1-a0e2-46c9-8217-4aed97222895\" (UID: \"3b17ffb1-a0e2-46c9-8217-4aed97222895\") "
Jul 15 18:56:13.379818 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:56:13.379743    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/3b17ffb1-a0e2-46c9-8217-4aed97222895-tmp-dir\") pod \"3b17ffb1-a0e2-46c9-8217-4aed97222895\" (UID: \"3b17ffb1-a0e2-46c9-8217-4aed97222895\") "
Jul 15 18:56:13.379818 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:56:13.379782    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/3b17ffb1-a0e2-46c9-8217-4aed97222895-model-cache\") pod \"3b17ffb1-a0e2-46c9-8217-4aed97222895\" (UID: \"3b17ffb1-a0e2-46c9-8217-4aed97222895\") "
Jul 15 18:56:13.379818 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:56:13.379809    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/3b17ffb1-a0e2-46c9-8217-4aed97222895-home\") pod \"3b17ffb1-a0e2-46c9-8217-4aed97222895\" (UID: \"3b17ffb1-a0e2-46c9-8217-4aed97222895\") "
Jul 15 18:56:13.379999 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:56:13.379839    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/3b17ffb1-a0e2-46c9-8217-4aed97222895-tls-certs\") pod \"3b17ffb1-a0e2-46c9-8217-4aed97222895\" (UID: \"3b17ffb1-a0e2-46c9-8217-4aed97222895\") "
Jul 15 18:56:13.379999 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:56:13.379872    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/3b17ffb1-a0e2-46c9-8217-4aed97222895-dshm\") pod \"3b17ffb1-a0e2-46c9-8217-4aed97222895\" (UID: \"3b17ffb1-a0e2-46c9-8217-4aed97222895\") "
Jul 15 18:56:13.380100 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:56:13.380053    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3b17ffb1-a0e2-46c9-8217-4aed97222895-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "3b17ffb1-a0e2-46c9-8217-4aed97222895" (UID: "3b17ffb1-a0e2-46c9-8217-4aed97222895"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 15 18:56:13.380100 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:56:13.380069    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3b17ffb1-a0e2-46c9-8217-4aed97222895-model-cache" (OuterVolumeSpecName: "model-cache") pod "3b17ffb1-a0e2-46c9-8217-4aed97222895" (UID: "3b17ffb1-a0e2-46c9-8217-4aed97222895"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 15 18:56:13.380100 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:56:13.380082    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3b17ffb1-a0e2-46c9-8217-4aed97222895-home" (OuterVolumeSpecName: "home") pod "3b17ffb1-a0e2-46c9-8217-4aed97222895" (UID: "3b17ffb1-a0e2-46c9-8217-4aed97222895"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 15 18:56:13.380305 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:56:13.380286    2567 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/3b17ffb1-a0e2-46c9-8217-4aed97222895-tmp-dir\") on node \"ip-10-0-141-171.ec2.internal\" DevicePath \"\""
Jul 15 18:56:13.380369 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:56:13.380306    2567 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/3b17ffb1-a0e2-46c9-8217-4aed97222895-model-cache\") on node \"ip-10-0-141-171.ec2.internal\" DevicePath \"\""
Jul 15 18:56:13.380369 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:56:13.380315    2567 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/3b17ffb1-a0e2-46c9-8217-4aed97222895-home\") on node \"ip-10-0-141-171.ec2.internal\" DevicePath \"\""
Jul 15 18:56:13.382015 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:56:13.381982    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3b17ffb1-a0e2-46c9-8217-4aed97222895-kube-api-access-7kbsd" (OuterVolumeSpecName: "kube-api-access-7kbsd") pod "3b17ffb1-a0e2-46c9-8217-4aed97222895" (UID: "3b17ffb1-a0e2-46c9-8217-4aed97222895"). InnerVolumeSpecName "kube-api-access-7kbsd". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 15 18:56:13.382119 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:56:13.382015    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3b17ffb1-a0e2-46c9-8217-4aed97222895-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "3b17ffb1-a0e2-46c9-8217-4aed97222895" (UID: "3b17ffb1-a0e2-46c9-8217-4aed97222895"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 15 18:56:13.382119 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:56:13.382053    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3b17ffb1-a0e2-46c9-8217-4aed97222895-dshm" (OuterVolumeSpecName: "dshm") pod "3b17ffb1-a0e2-46c9-8217-4aed97222895" (UID: "3b17ffb1-a0e2-46c9-8217-4aed97222895"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 15 18:56:13.481526 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:56:13.481494    2567 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-7kbsd\" (UniqueName: \"kubernetes.io/projected/3b17ffb1-a0e2-46c9-8217-4aed97222895-kube-api-access-7kbsd\") on node \"ip-10-0-141-171.ec2.internal\" DevicePath \"\""
Jul 15 18:56:13.481526 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:56:13.481519    2567 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/3b17ffb1-a0e2-46c9-8217-4aed97222895-tls-certs\") on node \"ip-10-0-141-171.ec2.internal\" DevicePath \"\""
Jul 15 18:56:13.481526 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:56:13.481528    2567 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/3b17ffb1-a0e2-46c9-8217-4aed97222895-dshm\") on node \"ip-10-0-141-171.ec2.internal\" DevicePath \"\""
Jul 15 18:56:14.190841 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:56:14.190802    2567 generic.go:356] "Generic (PLEG): container finished" podID="3b17ffb1-a0e2-46c9-8217-4aed97222895" containerID="9c840efb9485bd6a20be65ebb6e2d4b03c9f995ec8ad45b1e587b9cc9e56030f" exitCode=0
Jul 15 18:56:14.190841 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:56:14.190844    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-b-f83daa/test-model-f83daa-kserve-545989ffc5-cdw9d"
Jul 15 18:56:14.191413 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:56:14.190889    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-b-f83daa/test-model-f83daa-kserve-545989ffc5-cdw9d" event={"ID":"3b17ffb1-a0e2-46c9-8217-4aed97222895","Type":"ContainerDied","Data":"9c840efb9485bd6a20be65ebb6e2d4b03c9f995ec8ad45b1e587b9cc9e56030f"}
Jul 15 18:56:14.191413 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:56:14.190938    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-b-f83daa/test-model-f83daa-kserve-545989ffc5-cdw9d" event={"ID":"3b17ffb1-a0e2-46c9-8217-4aed97222895","Type":"ContainerDied","Data":"c8cfac01e07fecd3f44441bd1eccb9a9dba3f706947cffe3a26d2c0075c76b49"}
Jul 15 18:56:14.191413 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:56:14.190961    2567 scope.go:117] "RemoveContainer" containerID="9c840efb9485bd6a20be65ebb6e2d4b03c9f995ec8ad45b1e587b9cc9e56030f"
Jul 15 18:56:14.200040 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:56:14.200019    2567 scope.go:117] "RemoveContainer" containerID="9c840efb9485bd6a20be65ebb6e2d4b03c9f995ec8ad45b1e587b9cc9e56030f"
Jul 15 18:56:14.200356 ip-10-0-141-171 kubenswrapper[2567]: E0715 18:56:14.200336    2567 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9c840efb9485bd6a20be65ebb6e2d4b03c9f995ec8ad45b1e587b9cc9e56030f\": container with ID starting with 9c840efb9485bd6a20be65ebb6e2d4b03c9f995ec8ad45b1e587b9cc9e56030f not found: ID does not exist" containerID="9c840efb9485bd6a20be65ebb6e2d4b03c9f995ec8ad45b1e587b9cc9e56030f"
Jul 15 18:56:14.200429 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:56:14.200364    2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9c840efb9485bd6a20be65ebb6e2d4b03c9f995ec8ad45b1e587b9cc9e56030f"} err="failed to get container status \"9c840efb9485bd6a20be65ebb6e2d4b03c9f995ec8ad45b1e587b9cc9e56030f\": rpc error: code = NotFound desc = could not find container \"9c840efb9485bd6a20be65ebb6e2d4b03c9f995ec8ad45b1e587b9cc9e56030f\": container with ID starting with 9c840efb9485bd6a20be65ebb6e2d4b03c9f995ec8ad45b1e587b9cc9e56030f not found: ID does not exist"
Jul 15 18:56:14.205727 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:56:14.205704    2567 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="1a083ce6-d542-4598-9b3d-157e53d3a4a2" path="/var/lib/kubelet/pods/1a083ce6-d542-4598-9b3d-157e53d3a4a2/volumes"
Jul 15 18:56:14.219243 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:56:14.219209    2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-inf-b-f83daa/test-model-f83daa-kserve-545989ffc5-cdw9d"]
Jul 15 18:56:14.229818 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:56:14.229794    2567 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-inf-b-f83daa/test-model-f83daa-kserve-545989ffc5-cdw9d"]
Jul 15 18:56:14.397294 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:56:14.397261    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-qfldk"]
Jul 15 18:56:16.206005 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:56:16.205971    2567 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="3b17ffb1-a0e2-46c9-8217-4aed97222895" path="/var/lib/kubelet/pods/3b17ffb1-a0e2-46c9-8217-4aed97222895/volumes"
Jul 15 18:56:38.995963 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:56:38.995928    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-qfldk"]
Jul 15 18:56:59.207124 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:56:59.207094    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-qfldk"]
Jul 15 18:57:11.594380 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:57:11.594339    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-qfldk"]
Jul 15 18:57:23.607715 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:57:23.607608    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-8hmqx_d8816772-beae-4dff-9c51-9043199e488d/ovn-acl-logging/0.log"
Jul 15 18:57:23.614814 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:57:23.614793    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-8hmqx_d8816772-beae-4dff-9c51-9043199e488d/ovn-acl-logging/0.log"
Jul 15 18:57:30.815660 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:57:30.815626    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-qfldk"]
Jul 15 18:57:56.192140 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:57:56.192102    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-qfldk"]
Jul 15 18:58:15.796299 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:58:15.796263    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-qfldk"]
Jul 15 18:58:32.392710 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:58:32.392667    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-qfldk"]
Jul 15 18:58:41.989327 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:58:41.989292    2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-a-401e9f/auth-test-model-401e9f-kserve-857c55b59-t7vz6"]
Jul 15 18:58:41.989690 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:58:41.989679    2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3b17ffb1-a0e2-46c9-8217-4aed97222895" containerName="main"
Jul 15 18:58:41.989690 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:58:41.989690    2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="3b17ffb1-a0e2-46c9-8217-4aed97222895" containerName="main"
Jul 15 18:58:41.989762 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:58:41.989702    2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1a083ce6-d542-4598-9b3d-157e53d3a4a2" containerName="main"
Jul 15 18:58:41.989762 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:58:41.989708    2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="1a083ce6-d542-4598-9b3d-157e53d3a4a2" containerName="main"
Jul 15 18:58:41.989823 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:58:41.989780    2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="3b17ffb1-a0e2-46c9-8217-4aed97222895" containerName="main"
Jul 15 18:58:41.989823 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:58:41.989791    2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="1a083ce6-d542-4598-9b3d-157e53d3a4a2" containerName="main"
Jul 15 18:58:41.992913 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:58:41.992892    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-401e9f/auth-test-model-401e9f-kserve-857c55b59-t7vz6"
Jul 15 18:58:41.996104 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:58:41.996068    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-a-401e9f\"/\"auth-test-model-401e9f-kserve-self-signed-certs\""
Jul 15 18:58:41.996226 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:58:41.996127    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-a-401e9f\"/\"kube-root-ca.crt\""
Jul 15 18:58:41.996226 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:58:41.996166    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-a-401e9f\"/\"openshift-service-ca.crt\""
Jul 15 18:58:41.996372 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:58:41.996254    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-a-401e9f\"/\"default-dockercfg-7zfmv\""
Jul 15 18:58:42.004747 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:58:42.004724    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-401e9f/auth-test-model-401e9f-kserve-857c55b59-t7vz6"]
Jul 15 18:58:42.159743 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:58:42.159704    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/36c9d6a1-f46a-41f1-aa97-275a19d4b575-tmp-dir\") pod \"auth-test-model-401e9f-kserve-857c55b59-t7vz6\" (UID: \"36c9d6a1-f46a-41f1-aa97-275a19d4b575\") " pod="ai-tenant-e2e-shared-a-401e9f/auth-test-model-401e9f-kserve-857c55b59-t7vz6"
Jul 15 18:58:42.159934 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:58:42.159753    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8q7jr\" (UniqueName: \"kubernetes.io/projected/36c9d6a1-f46a-41f1-aa97-275a19d4b575-kube-api-access-8q7jr\") pod \"auth-test-model-401e9f-kserve-857c55b59-t7vz6\" (UID: \"36c9d6a1-f46a-41f1-aa97-275a19d4b575\") " pod="ai-tenant-e2e-shared-a-401e9f/auth-test-model-401e9f-kserve-857c55b59-t7vz6"
Jul 15 18:58:42.159934 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:58:42.159786    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/36c9d6a1-f46a-41f1-aa97-275a19d4b575-tls-certs\") pod \"auth-test-model-401e9f-kserve-857c55b59-t7vz6\" (UID: \"36c9d6a1-f46a-41f1-aa97-275a19d4b575\") " pod="ai-tenant-e2e-shared-a-401e9f/auth-test-model-401e9f-kserve-857c55b59-t7vz6"
Jul 15 18:58:42.159934 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:58:42.159834    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/36c9d6a1-f46a-41f1-aa97-275a19d4b575-model-cache\") pod \"auth-test-model-401e9f-kserve-857c55b59-t7vz6\" (UID: \"36c9d6a1-f46a-41f1-aa97-275a19d4b575\") " pod="ai-tenant-e2e-shared-a-401e9f/auth-test-model-401e9f-kserve-857c55b59-t7vz6"
Jul 15 18:58:42.160053 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:58:42.159938    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/36c9d6a1-f46a-41f1-aa97-275a19d4b575-dshm\") pod \"auth-test-model-401e9f-kserve-857c55b59-t7vz6\" (UID: \"36c9d6a1-f46a-41f1-aa97-275a19d4b575\") " pod="ai-tenant-e2e-shared-a-401e9f/auth-test-model-401e9f-kserve-857c55b59-t7vz6"
Jul 15 18:58:42.160053 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:58:42.159986    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/36c9d6a1-f46a-41f1-aa97-275a19d4b575-home\") pod \"auth-test-model-401e9f-kserve-857c55b59-t7vz6\" (UID: \"36c9d6a1-f46a-41f1-aa97-275a19d4b575\") " pod="ai-tenant-e2e-shared-a-401e9f/auth-test-model-401e9f-kserve-857c55b59-t7vz6"
Jul 15 18:58:42.260799 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:58:42.260712    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/36c9d6a1-f46a-41f1-aa97-275a19d4b575-home\") pod \"auth-test-model-401e9f-kserve-857c55b59-t7vz6\" (UID: \"36c9d6a1-f46a-41f1-aa97-275a19d4b575\") " pod="ai-tenant-e2e-shared-a-401e9f/auth-test-model-401e9f-kserve-857c55b59-t7vz6"
Jul 15 18:58:42.260799 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:58:42.260769    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/36c9d6a1-f46a-41f1-aa97-275a19d4b575-tmp-dir\") pod \"auth-test-model-401e9f-kserve-857c55b59-t7vz6\" (UID: \"36c9d6a1-f46a-41f1-aa97-275a19d4b575\") " pod="ai-tenant-e2e-shared-a-401e9f/auth-test-model-401e9f-kserve-857c55b59-t7vz6"
Jul 15 18:58:42.261028 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:58:42.260805    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8q7jr\" (UniqueName: \"kubernetes.io/projected/36c9d6a1-f46a-41f1-aa97-275a19d4b575-kube-api-access-8q7jr\") pod \"auth-test-model-401e9f-kserve-857c55b59-t7vz6\" (UID: \"36c9d6a1-f46a-41f1-aa97-275a19d4b575\") " pod="ai-tenant-e2e-shared-a-401e9f/auth-test-model-401e9f-kserve-857c55b59-t7vz6"
Jul 15 18:58:42.261028 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:58:42.260835    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/36c9d6a1-f46a-41f1-aa97-275a19d4b575-tls-certs\") pod \"auth-test-model-401e9f-kserve-857c55b59-t7vz6\" (UID: \"36c9d6a1-f46a-41f1-aa97-275a19d4b575\") " pod="ai-tenant-e2e-shared-a-401e9f/auth-test-model-401e9f-kserve-857c55b59-t7vz6"
Jul 15 18:58:42.261028 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:58:42.260860    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/36c9d6a1-f46a-41f1-aa97-275a19d4b575-model-cache\") pod \"auth-test-model-401e9f-kserve-857c55b59-t7vz6\" (UID: \"36c9d6a1-f46a-41f1-aa97-275a19d4b575\") " pod="ai-tenant-e2e-shared-a-401e9f/auth-test-model-401e9f-kserve-857c55b59-t7vz6"
Jul 15 18:58:42.261028 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:58:42.260924    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/36c9d6a1-f46a-41f1-aa97-275a19d4b575-dshm\") pod \"auth-test-model-401e9f-kserve-857c55b59-t7vz6\" (UID: \"36c9d6a1-f46a-41f1-aa97-275a19d4b575\") " pod="ai-tenant-e2e-shared-a-401e9f/auth-test-model-401e9f-kserve-857c55b59-t7vz6"
Jul 15 18:58:42.261220 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:58:42.261160    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/36c9d6a1-f46a-41f1-aa97-275a19d4b575-home\") pod \"auth-test-model-401e9f-kserve-857c55b59-t7vz6\" (UID: \"36c9d6a1-f46a-41f1-aa97-275a19d4b575\") " pod="ai-tenant-e2e-shared-a-401e9f/auth-test-model-401e9f-kserve-857c55b59-t7vz6"
Jul 15 18:58:42.261351 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:58:42.261329    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/36c9d6a1-f46a-41f1-aa97-275a19d4b575-model-cache\") pod \"auth-test-model-401e9f-kserve-857c55b59-t7vz6\" (UID: \"36c9d6a1-f46a-41f1-aa97-275a19d4b575\") " pod="ai-tenant-e2e-shared-a-401e9f/auth-test-model-401e9f-kserve-857c55b59-t7vz6"
Jul 15 18:58:42.261403 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:58:42.261357    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/36c9d6a1-f46a-41f1-aa97-275a19d4b575-tmp-dir\") pod \"auth-test-model-401e9f-kserve-857c55b59-t7vz6\" (UID: \"36c9d6a1-f46a-41f1-aa97-275a19d4b575\") " pod="ai-tenant-e2e-shared-a-401e9f/auth-test-model-401e9f-kserve-857c55b59-t7vz6"
Jul 15 18:58:42.263358 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:58:42.263329    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/36c9d6a1-f46a-41f1-aa97-275a19d4b575-dshm\") pod \"auth-test-model-401e9f-kserve-857c55b59-t7vz6\" (UID: \"36c9d6a1-f46a-41f1-aa97-275a19d4b575\") " pod="ai-tenant-e2e-shared-a-401e9f/auth-test-model-401e9f-kserve-857c55b59-t7vz6"
Jul 15 18:58:42.263670 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:58:42.263653    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/36c9d6a1-f46a-41f1-aa97-275a19d4b575-tls-certs\") pod \"auth-test-model-401e9f-kserve-857c55b59-t7vz6\" (UID: \"36c9d6a1-f46a-41f1-aa97-275a19d4b575\") " pod="ai-tenant-e2e-shared-a-401e9f/auth-test-model-401e9f-kserve-857c55b59-t7vz6"
Jul 15 18:58:42.270087 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:58:42.270061    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8q7jr\" (UniqueName: \"kubernetes.io/projected/36c9d6a1-f46a-41f1-aa97-275a19d4b575-kube-api-access-8q7jr\") pod \"auth-test-model-401e9f-kserve-857c55b59-t7vz6\" (UID: \"36c9d6a1-f46a-41f1-aa97-275a19d4b575\") " pod="ai-tenant-e2e-shared-a-401e9f/auth-test-model-401e9f-kserve-857c55b59-t7vz6"
Jul 15 18:58:42.302775 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:58:42.302745    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-401e9f/auth-test-model-401e9f-kserve-857c55b59-t7vz6"
Jul 15 18:58:42.444036 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:58:42.444004    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-401e9f/auth-test-model-401e9f-kserve-857c55b59-t7vz6"]
Jul 15 18:58:42.446073 ip-10-0-141-171 kubenswrapper[2567]: W0715 18:58:42.446042    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod36c9d6a1_f46a_41f1_aa97_275a19d4b575.slice/crio-168093dbb9467ed8c496f8c7f69966714b14f3abee9fad9de1a218d28982ef3b WatchSource:0}: Error finding container 168093dbb9467ed8c496f8c7f69966714b14f3abee9fad9de1a218d28982ef3b: Status 404 returned error can't find the container with id 168093dbb9467ed8c496f8c7f69966714b14f3abee9fad9de1a218d28982ef3b
Jul 15 18:58:42.900416 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:58:42.900374    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-401e9f/auth-test-model-401e9f-kserve-857c55b59-t7vz6" event={"ID":"36c9d6a1-f46a-41f1-aa97-275a19d4b575","Type":"ContainerStarted","Data":"2cf464abf96bed7ef6fa1df7204c45f3c22984f42649289c32c289f9c001e9ef"}
Jul 15 18:58:42.900602 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:58:42.900425    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-401e9f/auth-test-model-401e9f-kserve-857c55b59-t7vz6" event={"ID":"36c9d6a1-f46a-41f1-aa97-275a19d4b575","Type":"ContainerStarted","Data":"168093dbb9467ed8c496f8c7f69966714b14f3abee9fad9de1a218d28982ef3b"}
Jul 15 18:58:42.919953 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:58:42.919905    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-a-401e9f/auth-test-model-401e9f-kserve-857c55b59-t7vz6" podStartSLOduration=1.919890574 podStartE2EDuration="1.919890574s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 18:58:41 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 18:58:42.918357699 +0000 UTC m=+2481.452781070" watchObservedRunningTime="2026-07-15 18:58:42.919890574 +0000 UTC m=+2481.454313930"
Jul 15 18:58:45.688583 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:58:45.688541    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-qfldk"]
Jul 15 18:58:52.302905 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:58:52.302863    2567 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-a-401e9f/auth-test-model-401e9f-kserve-857c55b59-t7vz6"
Jul 15 18:58:52.303317 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:58:52.302920    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-a-401e9f/auth-test-model-401e9f-kserve-857c55b59-t7vz6"
Jul 15 18:58:52.315212 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:58:52.315190    2567 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-a-401e9f/auth-test-model-401e9f-kserve-857c55b59-t7vz6"
Jul 15 18:58:52.958244 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:58:52.958202    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-a-401e9f/auth-test-model-401e9f-kserve-857c55b59-t7vz6"
Jul 15 18:59:05.001439 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:59:05.001401    2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-b-46e17a/auth-test-model-46e17a-kserve-7868c47cbc-7pc5b"]
Jul 15 18:59:05.005121 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:59:05.005100    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-46e17a/auth-test-model-46e17a-kserve-7868c47cbc-7pc5b"
Jul 15 18:59:05.008527 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:59:05.008500    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-46e17a\"/\"default-dockercfg-mhc85\""
Jul 15 18:59:05.008658 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:59:05.008527    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-46e17a\"/\"kube-root-ca.crt\""
Jul 15 18:59:05.008658 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:59:05.008505    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-46e17a\"/\"openshift-service-ca.crt\""
Jul 15 18:59:05.008658 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:59:05.008505    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-46e17a\"/\"auth-test-model-46e17a-kserve-self-signed-certs\""
Jul 15 18:59:05.015744 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:59:05.015722    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-46e17a/auth-test-model-46e17a-kserve-7868c47cbc-7pc5b"]
Jul 15 18:59:05.077002 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:59:05.076968    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/e04eef19-fad9-4caa-a943-14faf3a04312-model-cache\") pod \"auth-test-model-46e17a-kserve-7868c47cbc-7pc5b\" (UID: \"e04eef19-fad9-4caa-a943-14faf3a04312\") " pod="ai-tenant-e2e-shared-b-46e17a/auth-test-model-46e17a-kserve-7868c47cbc-7pc5b"
Jul 15 18:59:05.077002 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:59:05.077003    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/e04eef19-fad9-4caa-a943-14faf3a04312-dshm\") pod \"auth-test-model-46e17a-kserve-7868c47cbc-7pc5b\" (UID: \"e04eef19-fad9-4caa-a943-14faf3a04312\") " pod="ai-tenant-e2e-shared-b-46e17a/auth-test-model-46e17a-kserve-7868c47cbc-7pc5b"
Jul 15 18:59:05.077323 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:59:05.077099    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/e04eef19-fad9-4caa-a943-14faf3a04312-tmp-dir\") pod \"auth-test-model-46e17a-kserve-7868c47cbc-7pc5b\" (UID: \"e04eef19-fad9-4caa-a943-14faf3a04312\") " pod="ai-tenant-e2e-shared-b-46e17a/auth-test-model-46e17a-kserve-7868c47cbc-7pc5b"
Jul 15 18:59:05.077323 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:59:05.077140    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/e04eef19-fad9-4caa-a943-14faf3a04312-tls-certs\") pod \"auth-test-model-46e17a-kserve-7868c47cbc-7pc5b\" (UID: \"e04eef19-fad9-4caa-a943-14faf3a04312\") " pod="ai-tenant-e2e-shared-b-46e17a/auth-test-model-46e17a-kserve-7868c47cbc-7pc5b"
Jul 15 18:59:05.077323 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:59:05.077304    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-88qvc\" (UniqueName: \"kubernetes.io/projected/e04eef19-fad9-4caa-a943-14faf3a04312-kube-api-access-88qvc\") pod \"auth-test-model-46e17a-kserve-7868c47cbc-7pc5b\" (UID: \"e04eef19-fad9-4caa-a943-14faf3a04312\") " pod="ai-tenant-e2e-shared-b-46e17a/auth-test-model-46e17a-kserve-7868c47cbc-7pc5b"
Jul 15 18:59:05.077472 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:59:05.077341    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/e04eef19-fad9-4caa-a943-14faf3a04312-home\") pod \"auth-test-model-46e17a-kserve-7868c47cbc-7pc5b\" (UID: \"e04eef19-fad9-4caa-a943-14faf3a04312\") " pod="ai-tenant-e2e-shared-b-46e17a/auth-test-model-46e17a-kserve-7868c47cbc-7pc5b"
Jul 15 18:59:05.178393 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:59:05.178358    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/e04eef19-fad9-4caa-a943-14faf3a04312-tmp-dir\") pod \"auth-test-model-46e17a-kserve-7868c47cbc-7pc5b\" (UID: \"e04eef19-fad9-4caa-a943-14faf3a04312\") " pod="ai-tenant-e2e-shared-b-46e17a/auth-test-model-46e17a-kserve-7868c47cbc-7pc5b"
Jul 15 18:59:05.178584 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:59:05.178409    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/e04eef19-fad9-4caa-a943-14faf3a04312-tls-certs\") pod \"auth-test-model-46e17a-kserve-7868c47cbc-7pc5b\" (UID: \"e04eef19-fad9-4caa-a943-14faf3a04312\") " pod="ai-tenant-e2e-shared-b-46e17a/auth-test-model-46e17a-kserve-7868c47cbc-7pc5b"
Jul 15 18:59:05.178584 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:59:05.178493    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-88qvc\" (UniqueName: \"kubernetes.io/projected/e04eef19-fad9-4caa-a943-14faf3a04312-kube-api-access-88qvc\") pod \"auth-test-model-46e17a-kserve-7868c47cbc-7pc5b\" (UID: \"e04eef19-fad9-4caa-a943-14faf3a04312\") " pod="ai-tenant-e2e-shared-b-46e17a/auth-test-model-46e17a-kserve-7868c47cbc-7pc5b"
Jul 15 18:59:05.178584 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:59:05.178518    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/e04eef19-fad9-4caa-a943-14faf3a04312-home\") pod \"auth-test-model-46e17a-kserve-7868c47cbc-7pc5b\" (UID: \"e04eef19-fad9-4caa-a943-14faf3a04312\") " pod="ai-tenant-e2e-shared-b-46e17a/auth-test-model-46e17a-kserve-7868c47cbc-7pc5b"
Jul 15 18:59:05.178584 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:59:05.178550    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/e04eef19-fad9-4caa-a943-14faf3a04312-model-cache\") pod \"auth-test-model-46e17a-kserve-7868c47cbc-7pc5b\" (UID: \"e04eef19-fad9-4caa-a943-14faf3a04312\") " pod="ai-tenant-e2e-shared-b-46e17a/auth-test-model-46e17a-kserve-7868c47cbc-7pc5b"
Jul 15 18:59:05.178584 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:59:05.178573    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/e04eef19-fad9-4caa-a943-14faf3a04312-dshm\") pod \"auth-test-model-46e17a-kserve-7868c47cbc-7pc5b\" (UID: \"e04eef19-fad9-4caa-a943-14faf3a04312\") " pod="ai-tenant-e2e-shared-b-46e17a/auth-test-model-46e17a-kserve-7868c47cbc-7pc5b"
Jul 15 18:59:05.178853 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:59:05.178798    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/e04eef19-fad9-4caa-a943-14faf3a04312-tmp-dir\") pod \"auth-test-model-46e17a-kserve-7868c47cbc-7pc5b\" (UID: \"e04eef19-fad9-4caa-a943-14faf3a04312\") " pod="ai-tenant-e2e-shared-b-46e17a/auth-test-model-46e17a-kserve-7868c47cbc-7pc5b"
Jul 15 18:59:05.178853 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:59:05.178834    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/e04eef19-fad9-4caa-a943-14faf3a04312-home\") pod \"auth-test-model-46e17a-kserve-7868c47cbc-7pc5b\" (UID: \"e04eef19-fad9-4caa-a943-14faf3a04312\") " pod="ai-tenant-e2e-shared-b-46e17a/auth-test-model-46e17a-kserve-7868c47cbc-7pc5b"
Jul 15 18:59:05.178987 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:59:05.178967    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/e04eef19-fad9-4caa-a943-14faf3a04312-model-cache\") pod \"auth-test-model-46e17a-kserve-7868c47cbc-7pc5b\" (UID: \"e04eef19-fad9-4caa-a943-14faf3a04312\") " pod="ai-tenant-e2e-shared-b-46e17a/auth-test-model-46e17a-kserve-7868c47cbc-7pc5b"
Jul 15 18:59:05.180704 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:59:05.180683    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/e04eef19-fad9-4caa-a943-14faf3a04312-dshm\") pod \"auth-test-model-46e17a-kserve-7868c47cbc-7pc5b\" (UID: \"e04eef19-fad9-4caa-a943-14faf3a04312\") " pod="ai-tenant-e2e-shared-b-46e17a/auth-test-model-46e17a-kserve-7868c47cbc-7pc5b"
Jul 15 18:59:05.180884 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:59:05.180866    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/e04eef19-fad9-4caa-a943-14faf3a04312-tls-certs\") pod \"auth-test-model-46e17a-kserve-7868c47cbc-7pc5b\" (UID: \"e04eef19-fad9-4caa-a943-14faf3a04312\") " pod="ai-tenant-e2e-shared-b-46e17a/auth-test-model-46e17a-kserve-7868c47cbc-7pc5b"
Jul 15 18:59:05.186804 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:59:05.186782    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-88qvc\" (UniqueName: \"kubernetes.io/projected/e04eef19-fad9-4caa-a943-14faf3a04312-kube-api-access-88qvc\") pod \"auth-test-model-46e17a-kserve-7868c47cbc-7pc5b\" (UID: \"e04eef19-fad9-4caa-a943-14faf3a04312\") " pod="ai-tenant-e2e-shared-b-46e17a/auth-test-model-46e17a-kserve-7868c47cbc-7pc5b"
Jul 15 18:59:05.315166 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:59:05.315072    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-46e17a/auth-test-model-46e17a-kserve-7868c47cbc-7pc5b"
Jul 15 18:59:05.451092 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:59:05.451062    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-46e17a/auth-test-model-46e17a-kserve-7868c47cbc-7pc5b"]
Jul 15 18:59:05.454344 ip-10-0-141-171 kubenswrapper[2567]: W0715 18:59:05.454320    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pode04eef19_fad9_4caa_a943_14faf3a04312.slice/crio-7aa5266106d719079a271c51ad0b863adf6a83250284d65e21953144893d5222 WatchSource:0}: Error finding container 7aa5266106d719079a271c51ad0b863adf6a83250284d65e21953144893d5222: Status 404 returned error can't find the container with id 7aa5266106d719079a271c51ad0b863adf6a83250284d65e21953144893d5222
Jul 15 18:59:06.010093 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:59:06.010052    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-46e17a/auth-test-model-46e17a-kserve-7868c47cbc-7pc5b" event={"ID":"e04eef19-fad9-4caa-a943-14faf3a04312","Type":"ContainerStarted","Data":"02d145ce835c99d0f8426f64281195328dc6b678651ee1afaac9c60fe8d7074f"}
Jul 15 18:59:06.010093 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:59:06.010099    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-46e17a/auth-test-model-46e17a-kserve-7868c47cbc-7pc5b" event={"ID":"e04eef19-fad9-4caa-a943-14faf3a04312","Type":"ContainerStarted","Data":"7aa5266106d719079a271c51ad0b863adf6a83250284d65e21953144893d5222"}
Jul 15 18:59:06.026730 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:59:06.026681    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-b-46e17a/auth-test-model-46e17a-kserve-7868c47cbc-7pc5b" podStartSLOduration=2.026664859 podStartE2EDuration="2.026664859s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 18:59:04 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 18:59:06.026008468 +0000 UTC m=+2504.560432085" watchObservedRunningTime="2026-07-15 18:59:06.026664859 +0000 UTC m=+2504.561088219"
Jul 15 18:59:08.695759 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:59:08.695712    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-qfldk"]
Jul 15 18:59:15.315743 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:59:15.315650    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-b-46e17a/auth-test-model-46e17a-kserve-7868c47cbc-7pc5b"
Jul 15 18:59:15.315743 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:59:15.315702    2567 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-b-46e17a/auth-test-model-46e17a-kserve-7868c47cbc-7pc5b"
Jul 15 18:59:15.328190 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:59:15.328164    2567 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-b-46e17a/auth-test-model-46e17a-kserve-7868c47cbc-7pc5b"
Jul 15 18:59:16.068296 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:59:16.068268    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-b-46e17a/auth-test-model-46e17a-kserve-7868c47cbc-7pc5b"
Jul 15 18:59:22.597583 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:59:22.597547    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-qfldk"]
Jul 15 18:59:41.797946 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:59:41.797908    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-qfldk"]
Jul 15 18:59:57.790966 ip-10-0-141-171 kubenswrapper[2567]: I0715 18:59:57.790923    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-qfldk"]
Jul 15 19:00:17.592151 ip-10-0-141-171 kubenswrapper[2567]: I0715 19:00:17.592108    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-qfldk"]
Jul 15 19:00:34.783352 ip-10-0-141-171 kubenswrapper[2567]: I0715 19:00:34.783318    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-qfldk"]
Jul 15 19:00:52.888308 ip-10-0-141-171 kubenswrapper[2567]: I0715 19:00:52.888191    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-qfldk"]
Jul 15 19:01:06.566687 ip-10-0-141-171 kubenswrapper[2567]: I0715 19:01:06.566655    2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-401e9f/auth-test-model-401e9f-kserve-857c55b59-t7vz6"]
Jul 15 19:01:07.666276 ip-10-0-141-171 kubenswrapper[2567]: I0715 19:01:07.666223    2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-46e17a/auth-test-model-46e17a-kserve-7868c47cbc-7pc5b"]
Jul 15 19:01:11.187563 ip-10-0-141-171 kubenswrapper[2567]: I0715 19:01:11.187527    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-qfldk"]
Jul 15 19:01:21.587096 ip-10-0-141-171 kubenswrapper[2567]: I0715 19:01:21.587035    2567 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-shared-a-401e9f/auth-test-model-401e9f-kserve-857c55b59-t7vz6" podUID="36c9d6a1-f46a-41f1-aa97-275a19d4b575" containerName="main" containerID="cri-o://2cf464abf96bed7ef6fa1df7204c45f3c22984f42649289c32c289f9c001e9ef" gracePeriod=45
Jul 15 19:01:21.848181 ip-10-0-141-171 kubenswrapper[2567]: I0715 19:01:21.848107    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-401e9f/auth-test-model-401e9f-kserve-857c55b59-t7vz6"
Jul 15 19:01:21.977720 ip-10-0-141-171 kubenswrapper[2567]: I0715 19:01:21.977678    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/36c9d6a1-f46a-41f1-aa97-275a19d4b575-tmp-dir\") pod \"36c9d6a1-f46a-41f1-aa97-275a19d4b575\" (UID: \"36c9d6a1-f46a-41f1-aa97-275a19d4b575\") "
Jul 15 19:01:21.977868 ip-10-0-141-171 kubenswrapper[2567]: I0715 19:01:21.977733    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/36c9d6a1-f46a-41f1-aa97-275a19d4b575-tls-certs\") pod \"36c9d6a1-f46a-41f1-aa97-275a19d4b575\" (UID: \"36c9d6a1-f46a-41f1-aa97-275a19d4b575\") "
Jul 15 19:01:21.977868 ip-10-0-141-171 kubenswrapper[2567]: I0715 19:01:21.977808    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/36c9d6a1-f46a-41f1-aa97-275a19d4b575-dshm\") pod \"36c9d6a1-f46a-41f1-aa97-275a19d4b575\" (UID: \"36c9d6a1-f46a-41f1-aa97-275a19d4b575\") "
Jul 15 19:01:21.977970 ip-10-0-141-171 kubenswrapper[2567]: I0715 19:01:21.977877    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-8q7jr\" (UniqueName: \"kubernetes.io/projected/36c9d6a1-f46a-41f1-aa97-275a19d4b575-kube-api-access-8q7jr\") pod \"36c9d6a1-f46a-41f1-aa97-275a19d4b575\" (UID: \"36c9d6a1-f46a-41f1-aa97-275a19d4b575\") "
Jul 15 19:01:21.977970 ip-10-0-141-171 kubenswrapper[2567]: I0715 19:01:21.977945    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/36c9d6a1-f46a-41f1-aa97-275a19d4b575-model-cache\") pod \"36c9d6a1-f46a-41f1-aa97-275a19d4b575\" (UID: \"36c9d6a1-f46a-41f1-aa97-275a19d4b575\") "
Jul 15 19:01:21.978080 ip-10-0-141-171 kubenswrapper[2567]: I0715 19:01:21.977975    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/36c9d6a1-f46a-41f1-aa97-275a19d4b575-home\") pod \"36c9d6a1-f46a-41f1-aa97-275a19d4b575\" (UID: \"36c9d6a1-f46a-41f1-aa97-275a19d4b575\") "
Jul 15 19:01:21.978080 ip-10-0-141-171 kubenswrapper[2567]: I0715 19:01:21.978012    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/36c9d6a1-f46a-41f1-aa97-275a19d4b575-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "36c9d6a1-f46a-41f1-aa97-275a19d4b575" (UID: "36c9d6a1-f46a-41f1-aa97-275a19d4b575"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 15 19:01:21.978302 ip-10-0-141-171 kubenswrapper[2567]: I0715 19:01:21.978277    2567 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/36c9d6a1-f46a-41f1-aa97-275a19d4b575-tmp-dir\") on node \"ip-10-0-141-171.ec2.internal\" DevicePath \"\""
Jul 15 19:01:21.978431 ip-10-0-141-171 kubenswrapper[2567]: I0715 19:01:21.978283    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/36c9d6a1-f46a-41f1-aa97-275a19d4b575-model-cache" (OuterVolumeSpecName: "model-cache") pod "36c9d6a1-f46a-41f1-aa97-275a19d4b575" (UID: "36c9d6a1-f46a-41f1-aa97-275a19d4b575"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 15 19:01:21.978431 ip-10-0-141-171 kubenswrapper[2567]: I0715 19:01:21.978296    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/36c9d6a1-f46a-41f1-aa97-275a19d4b575-home" (OuterVolumeSpecName: "home") pod "36c9d6a1-f46a-41f1-aa97-275a19d4b575" (UID: "36c9d6a1-f46a-41f1-aa97-275a19d4b575"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 15 19:01:21.980172 ip-10-0-141-171 kubenswrapper[2567]: I0715 19:01:21.980148    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/36c9d6a1-f46a-41f1-aa97-275a19d4b575-dshm" (OuterVolumeSpecName: "dshm") pod "36c9d6a1-f46a-41f1-aa97-275a19d4b575" (UID: "36c9d6a1-f46a-41f1-aa97-275a19d4b575"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 15 19:01:21.980265 ip-10-0-141-171 kubenswrapper[2567]: I0715 19:01:21.980169    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/36c9d6a1-f46a-41f1-aa97-275a19d4b575-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "36c9d6a1-f46a-41f1-aa97-275a19d4b575" (UID: "36c9d6a1-f46a-41f1-aa97-275a19d4b575"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 15 19:01:21.980265 ip-10-0-141-171 kubenswrapper[2567]: I0715 19:01:21.980179    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/36c9d6a1-f46a-41f1-aa97-275a19d4b575-kube-api-access-8q7jr" (OuterVolumeSpecName: "kube-api-access-8q7jr") pod "36c9d6a1-f46a-41f1-aa97-275a19d4b575" (UID: "36c9d6a1-f46a-41f1-aa97-275a19d4b575"). InnerVolumeSpecName "kube-api-access-8q7jr". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 15 19:01:22.079180 ip-10-0-141-171 kubenswrapper[2567]: I0715 19:01:22.079145    2567 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-8q7jr\" (UniqueName: \"kubernetes.io/projected/36c9d6a1-f46a-41f1-aa97-275a19d4b575-kube-api-access-8q7jr\") on node \"ip-10-0-141-171.ec2.internal\" DevicePath \"\""
Jul 15 19:01:22.079180 ip-10-0-141-171 kubenswrapper[2567]: I0715 19:01:22.079175    2567 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/36c9d6a1-f46a-41f1-aa97-275a19d4b575-model-cache\") on node \"ip-10-0-141-171.ec2.internal\" DevicePath \"\""
Jul 15 19:01:22.079180 ip-10-0-141-171 kubenswrapper[2567]: I0715 19:01:22.079184    2567 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/36c9d6a1-f46a-41f1-aa97-275a19d4b575-home\") on node \"ip-10-0-141-171.ec2.internal\" DevicePath \"\""
Jul 15 19:01:22.079180 ip-10-0-141-171 kubenswrapper[2567]: I0715 19:01:22.079192    2567 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/36c9d6a1-f46a-41f1-aa97-275a19d4b575-tls-certs\") on node \"ip-10-0-141-171.ec2.internal\" DevicePath \"\""
Jul 15 19:01:22.079481 ip-10-0-141-171 kubenswrapper[2567]: I0715 19:01:22.079200    2567 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/36c9d6a1-f46a-41f1-aa97-275a19d4b575-dshm\") on node \"ip-10-0-141-171.ec2.internal\" DevicePath \"\""
Jul 15 19:01:22.660408 ip-10-0-141-171 kubenswrapper[2567]: I0715 19:01:22.660320    2567 generic.go:356] "Generic (PLEG): container finished" podID="36c9d6a1-f46a-41f1-aa97-275a19d4b575" containerID="2cf464abf96bed7ef6fa1df7204c45f3c22984f42649289c32c289f9c001e9ef" exitCode=0
Jul 15 19:01:22.660408 ip-10-0-141-171 kubenswrapper[2567]: I0715 19:01:22.660369    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-401e9f/auth-test-model-401e9f-kserve-857c55b59-t7vz6"
Jul 15 19:01:22.660903 ip-10-0-141-171 kubenswrapper[2567]: I0715 19:01:22.660410    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-401e9f/auth-test-model-401e9f-kserve-857c55b59-t7vz6" event={"ID":"36c9d6a1-f46a-41f1-aa97-275a19d4b575","Type":"ContainerDied","Data":"2cf464abf96bed7ef6fa1df7204c45f3c22984f42649289c32c289f9c001e9ef"}
Jul 15 19:01:22.660903 ip-10-0-141-171 kubenswrapper[2567]: I0715 19:01:22.660452    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-401e9f/auth-test-model-401e9f-kserve-857c55b59-t7vz6" event={"ID":"36c9d6a1-f46a-41f1-aa97-275a19d4b575","Type":"ContainerDied","Data":"168093dbb9467ed8c496f8c7f69966714b14f3abee9fad9de1a218d28982ef3b"}
Jul 15 19:01:22.660903 ip-10-0-141-171 kubenswrapper[2567]: I0715 19:01:22.660470    2567 scope.go:117] "RemoveContainer" containerID="2cf464abf96bed7ef6fa1df7204c45f3c22984f42649289c32c289f9c001e9ef"
Jul 15 19:01:22.669200 ip-10-0-141-171 kubenswrapper[2567]: I0715 19:01:22.669181    2567 scope.go:117] "RemoveContainer" containerID="2cf464abf96bed7ef6fa1df7204c45f3c22984f42649289c32c289f9c001e9ef"
Jul 15 19:01:22.669512 ip-10-0-141-171 kubenswrapper[2567]: E0715 19:01:22.669490    2567 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2cf464abf96bed7ef6fa1df7204c45f3c22984f42649289c32c289f9c001e9ef\": container with ID starting with 2cf464abf96bed7ef6fa1df7204c45f3c22984f42649289c32c289f9c001e9ef not found: ID does not exist" containerID="2cf464abf96bed7ef6fa1df7204c45f3c22984f42649289c32c289f9c001e9ef"
Jul 15 19:01:22.669574 ip-10-0-141-171 kubenswrapper[2567]: I0715 19:01:22.669521    2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2cf464abf96bed7ef6fa1df7204c45f3c22984f42649289c32c289f9c001e9ef"} err="failed to get container status \"2cf464abf96bed7ef6fa1df7204c45f3c22984f42649289c32c289f9c001e9ef\": rpc error: code = NotFound desc = could not find container \"2cf464abf96bed7ef6fa1df7204c45f3c22984f42649289c32c289f9c001e9ef\": container with ID starting with 2cf464abf96bed7ef6fa1df7204c45f3c22984f42649289c32c289f9c001e9ef not found: ID does not exist"
Jul 15 19:01:22.677426 ip-10-0-141-171 kubenswrapper[2567]: I0715 19:01:22.677399    2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-401e9f/auth-test-model-401e9f-kserve-857c55b59-t7vz6"]
Jul 15 19:01:22.681528 ip-10-0-141-171 kubenswrapper[2567]: I0715 19:01:22.681505    2567 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-a-401e9f/auth-test-model-401e9f-kserve-857c55b59-t7vz6"]
Jul 15 19:01:22.686440 ip-10-0-141-171 kubenswrapper[2567]: I0715 19:01:22.686411    2567 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-shared-b-46e17a/auth-test-model-46e17a-kserve-7868c47cbc-7pc5b" podUID="e04eef19-fad9-4caa-a943-14faf3a04312" containerName="main" containerID="cri-o://02d145ce835c99d0f8426f64281195328dc6b678651ee1afaac9c60fe8d7074f" gracePeriod=45
Jul 15 19:01:22.943793 ip-10-0-141-171 kubenswrapper[2567]: I0715 19:01:22.943768    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-46e17a/auth-test-model-46e17a-kserve-7868c47cbc-7pc5b"
Jul 15 19:01:23.089980 ip-10-0-141-171 kubenswrapper[2567]: I0715 19:01:23.089944    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/e04eef19-fad9-4caa-a943-14faf3a04312-model-cache\") pod \"e04eef19-fad9-4caa-a943-14faf3a04312\" (UID: \"e04eef19-fad9-4caa-a943-14faf3a04312\") "
Jul 15 19:01:23.089980 ip-10-0-141-171 kubenswrapper[2567]: I0715 19:01:23.089990    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/e04eef19-fad9-4caa-a943-14faf3a04312-tls-certs\") pod \"e04eef19-fad9-4caa-a943-14faf3a04312\" (UID: \"e04eef19-fad9-4caa-a943-14faf3a04312\") "
Jul 15 19:01:23.090189 ip-10-0-141-171 kubenswrapper[2567]: I0715 19:01:23.090018    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/e04eef19-fad9-4caa-a943-14faf3a04312-dshm\") pod \"e04eef19-fad9-4caa-a943-14faf3a04312\" (UID: \"e04eef19-fad9-4caa-a943-14faf3a04312\") "
Jul 15 19:01:23.090189 ip-10-0-141-171 kubenswrapper[2567]: I0715 19:01:23.090142    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/e04eef19-fad9-4caa-a943-14faf3a04312-home\") pod \"e04eef19-fad9-4caa-a943-14faf3a04312\" (UID: \"e04eef19-fad9-4caa-a943-14faf3a04312\") "
Jul 15 19:01:23.090324 ip-10-0-141-171 kubenswrapper[2567]: I0715 19:01:23.090207    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-88qvc\" (UniqueName: \"kubernetes.io/projected/e04eef19-fad9-4caa-a943-14faf3a04312-kube-api-access-88qvc\") pod \"e04eef19-fad9-4caa-a943-14faf3a04312\" (UID: \"e04eef19-fad9-4caa-a943-14faf3a04312\") "
Jul 15 19:01:23.090324 ip-10-0-141-171 kubenswrapper[2567]: I0715 19:01:23.090275    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e04eef19-fad9-4caa-a943-14faf3a04312-model-cache" (OuterVolumeSpecName: "model-cache") pod "e04eef19-fad9-4caa-a943-14faf3a04312" (UID: "e04eef19-fad9-4caa-a943-14faf3a04312"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 15 19:01:23.090324 ip-10-0-141-171 kubenswrapper[2567]: I0715 19:01:23.090295    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/e04eef19-fad9-4caa-a943-14faf3a04312-tmp-dir\") pod \"e04eef19-fad9-4caa-a943-14faf3a04312\" (UID: \"e04eef19-fad9-4caa-a943-14faf3a04312\") "
Jul 15 19:01:23.090486 ip-10-0-141-171 kubenswrapper[2567]: I0715 19:01:23.090442    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e04eef19-fad9-4caa-a943-14faf3a04312-home" (OuterVolumeSpecName: "home") pod "e04eef19-fad9-4caa-a943-14faf3a04312" (UID: "e04eef19-fad9-4caa-a943-14faf3a04312"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 15 19:01:23.090550 ip-10-0-141-171 kubenswrapper[2567]: I0715 19:01:23.090488    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e04eef19-fad9-4caa-a943-14faf3a04312-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "e04eef19-fad9-4caa-a943-14faf3a04312" (UID: "e04eef19-fad9-4caa-a943-14faf3a04312"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 15 19:01:23.090635 ip-10-0-141-171 kubenswrapper[2567]: I0715 19:01:23.090612    2567 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/e04eef19-fad9-4caa-a943-14faf3a04312-home\") on node \"ip-10-0-141-171.ec2.internal\" DevicePath \"\""
Jul 15 19:01:23.090674 ip-10-0-141-171 kubenswrapper[2567]: I0715 19:01:23.090643    2567 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/e04eef19-fad9-4caa-a943-14faf3a04312-tmp-dir\") on node \"ip-10-0-141-171.ec2.internal\" DevicePath \"\""
Jul 15 19:01:23.090674 ip-10-0-141-171 kubenswrapper[2567]: I0715 19:01:23.090659    2567 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/e04eef19-fad9-4caa-a943-14faf3a04312-model-cache\") on node \"ip-10-0-141-171.ec2.internal\" DevicePath \"\""
Jul 15 19:01:23.092414 ip-10-0-141-171 kubenswrapper[2567]: I0715 19:01:23.092383    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e04eef19-fad9-4caa-a943-14faf3a04312-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "e04eef19-fad9-4caa-a943-14faf3a04312" (UID: "e04eef19-fad9-4caa-a943-14faf3a04312"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 15 19:01:23.092520 ip-10-0-141-171 kubenswrapper[2567]: I0715 19:01:23.092430    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e04eef19-fad9-4caa-a943-14faf3a04312-kube-api-access-88qvc" (OuterVolumeSpecName: "kube-api-access-88qvc") pod "e04eef19-fad9-4caa-a943-14faf3a04312" (UID: "e04eef19-fad9-4caa-a943-14faf3a04312"). InnerVolumeSpecName "kube-api-access-88qvc". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 15 19:01:23.092520 ip-10-0-141-171 kubenswrapper[2567]: I0715 19:01:23.092493    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e04eef19-fad9-4caa-a943-14faf3a04312-dshm" (OuterVolumeSpecName: "dshm") pod "e04eef19-fad9-4caa-a943-14faf3a04312" (UID: "e04eef19-fad9-4caa-a943-14faf3a04312"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 15 19:01:23.191942 ip-10-0-141-171 kubenswrapper[2567]: I0715 19:01:23.191912    2567 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/e04eef19-fad9-4caa-a943-14faf3a04312-tls-certs\") on node \"ip-10-0-141-171.ec2.internal\" DevicePath \"\""
Jul 15 19:01:23.191942 ip-10-0-141-171 kubenswrapper[2567]: I0715 19:01:23.191941    2567 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/e04eef19-fad9-4caa-a943-14faf3a04312-dshm\") on node \"ip-10-0-141-171.ec2.internal\" DevicePath \"\""
Jul 15 19:01:23.192136 ip-10-0-141-171 kubenswrapper[2567]: I0715 19:01:23.191950    2567 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-88qvc\" (UniqueName: \"kubernetes.io/projected/e04eef19-fad9-4caa-a943-14faf3a04312-kube-api-access-88qvc\") on node \"ip-10-0-141-171.ec2.internal\" DevicePath \"\""
Jul 15 19:01:23.666791 ip-10-0-141-171 kubenswrapper[2567]: I0715 19:01:23.666700    2567 generic.go:356] "Generic (PLEG): container finished" podID="e04eef19-fad9-4caa-a943-14faf3a04312" containerID="02d145ce835c99d0f8426f64281195328dc6b678651ee1afaac9c60fe8d7074f" exitCode=0
Jul 15 19:01:23.666791 ip-10-0-141-171 kubenswrapper[2567]: I0715 19:01:23.666740    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-46e17a/auth-test-model-46e17a-kserve-7868c47cbc-7pc5b"
Jul 15 19:01:23.667316 ip-10-0-141-171 kubenswrapper[2567]: I0715 19:01:23.666792    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-46e17a/auth-test-model-46e17a-kserve-7868c47cbc-7pc5b" event={"ID":"e04eef19-fad9-4caa-a943-14faf3a04312","Type":"ContainerDied","Data":"02d145ce835c99d0f8426f64281195328dc6b678651ee1afaac9c60fe8d7074f"}
Jul 15 19:01:23.667316 ip-10-0-141-171 kubenswrapper[2567]: I0715 19:01:23.666831    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-46e17a/auth-test-model-46e17a-kserve-7868c47cbc-7pc5b" event={"ID":"e04eef19-fad9-4caa-a943-14faf3a04312","Type":"ContainerDied","Data":"7aa5266106d719079a271c51ad0b863adf6a83250284d65e21953144893d5222"}
Jul 15 19:01:23.667316 ip-10-0-141-171 kubenswrapper[2567]: I0715 19:01:23.666849    2567 scope.go:117] "RemoveContainer" containerID="02d145ce835c99d0f8426f64281195328dc6b678651ee1afaac9c60fe8d7074f"
Jul 15 19:01:23.675941 ip-10-0-141-171 kubenswrapper[2567]: I0715 19:01:23.675921    2567 scope.go:117] "RemoveContainer" containerID="02d145ce835c99d0f8426f64281195328dc6b678651ee1afaac9c60fe8d7074f"
Jul 15 19:01:23.676174 ip-10-0-141-171 kubenswrapper[2567]: E0715 19:01:23.676156    2567 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"02d145ce835c99d0f8426f64281195328dc6b678651ee1afaac9c60fe8d7074f\": container with ID starting with 02d145ce835c99d0f8426f64281195328dc6b678651ee1afaac9c60fe8d7074f not found: ID does not exist" containerID="02d145ce835c99d0f8426f64281195328dc6b678651ee1afaac9c60fe8d7074f"
Jul 15 19:01:23.676215 ip-10-0-141-171 kubenswrapper[2567]: I0715 19:01:23.676182    2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"02d145ce835c99d0f8426f64281195328dc6b678651ee1afaac9c60fe8d7074f"} err="failed to get container status \"02d145ce835c99d0f8426f64281195328dc6b678651ee1afaac9c60fe8d7074f\": rpc error: code = NotFound desc = could not find container \"02d145ce835c99d0f8426f64281195328dc6b678651ee1afaac9c60fe8d7074f\": container with ID starting with 02d145ce835c99d0f8426f64281195328dc6b678651ee1afaac9c60fe8d7074f not found: ID does not exist"
Jul 15 19:01:23.689082 ip-10-0-141-171 kubenswrapper[2567]: I0715 19:01:23.689045    2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-46e17a/auth-test-model-46e17a-kserve-7868c47cbc-7pc5b"]
Jul 15 19:01:23.692171 ip-10-0-141-171 kubenswrapper[2567]: I0715 19:01:23.692149    2567 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-b-46e17a/auth-test-model-46e17a-kserve-7868c47cbc-7pc5b"]
Jul 15 19:01:24.206993 ip-10-0-141-171 kubenswrapper[2567]: I0715 19:01:24.206953    2567 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="36c9d6a1-f46a-41f1-aa97-275a19d4b575" path="/var/lib/kubelet/pods/36c9d6a1-f46a-41f1-aa97-275a19d4b575/volumes"
Jul 15 19:01:24.207381 ip-10-0-141-171 kubenswrapper[2567]: I0715 19:01:24.207367    2567 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e04eef19-fad9-4caa-a943-14faf3a04312" path="/var/lib/kubelet/pods/e04eef19-fad9-4caa-a943-14faf3a04312/volumes"
Jul 15 19:01:27.590062 ip-10-0-141-171 kubenswrapper[2567]: I0715 19:01:27.590022    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-qfldk"]
Jul 15 19:01:56.994533 ip-10-0-141-171 kubenswrapper[2567]: I0715 19:01:56.994497    2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-b-46e17a/sub-test-model-46e17a-kserve-5f85cb87-r6p6j"]
Jul 15 19:01:56.994978 ip-10-0-141-171 kubenswrapper[2567]: I0715 19:01:56.994949    2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="36c9d6a1-f46a-41f1-aa97-275a19d4b575" containerName="main"
Jul 15 19:01:56.994978 ip-10-0-141-171 kubenswrapper[2567]: I0715 19:01:56.994967    2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="36c9d6a1-f46a-41f1-aa97-275a19d4b575" containerName="main"
Jul 15 19:01:56.995053 ip-10-0-141-171 kubenswrapper[2567]: I0715 19:01:56.994994    2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e04eef19-fad9-4caa-a943-14faf3a04312" containerName="main"
Jul 15 19:01:56.995053 ip-10-0-141-171 kubenswrapper[2567]: I0715 19:01:56.995002    2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="e04eef19-fad9-4caa-a943-14faf3a04312" containerName="main"
Jul 15 19:01:56.995124 ip-10-0-141-171 kubenswrapper[2567]: I0715 19:01:56.995110    2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="e04eef19-fad9-4caa-a943-14faf3a04312" containerName="main"
Jul 15 19:01:56.995160 ip-10-0-141-171 kubenswrapper[2567]: I0715 19:01:56.995132    2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="36c9d6a1-f46a-41f1-aa97-275a19d4b575" containerName="main"
Jul 15 19:01:56.998594 ip-10-0-141-171 kubenswrapper[2567]: I0715 19:01:56.998577    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-46e17a/sub-test-model-46e17a-kserve-5f85cb87-r6p6j"
Jul 15 19:01:57.001378 ip-10-0-141-171 kubenswrapper[2567]: I0715 19:01:57.001356    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-46e17a\"/\"kube-root-ca.crt\""
Jul 15 19:01:57.002224 ip-10-0-141-171 kubenswrapper[2567]: I0715 19:01:57.002201    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-46e17a\"/\"sub-test-model-46e17a-kserve-self-signed-certs\""
Jul 15 19:01:57.002224 ip-10-0-141-171 kubenswrapper[2567]: I0715 19:01:57.002206    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-46e17a\"/\"openshift-service-ca.crt\""
Jul 15 19:01:57.002414 ip-10-0-141-171 kubenswrapper[2567]: I0715 19:01:57.002290    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-46e17a\"/\"default-dockercfg-mhc85\""
Jul 15 19:01:57.007856 ip-10-0-141-171 kubenswrapper[2567]: I0715 19:01:57.007834    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-46e17a/sub-test-model-46e17a-kserve-5f85cb87-r6p6j"]
Jul 15 19:01:57.103415 ip-10-0-141-171 kubenswrapper[2567]: I0715 19:01:57.103381    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/9a2729b3-900b-4554-b4e1-a80b959a99cf-dshm\") pod \"sub-test-model-46e17a-kserve-5f85cb87-r6p6j\" (UID: \"9a2729b3-900b-4554-b4e1-a80b959a99cf\") " pod="ai-tenant-e2e-shared-b-46e17a/sub-test-model-46e17a-kserve-5f85cb87-r6p6j"
Jul 15 19:01:57.103620 ip-10-0-141-171 kubenswrapper[2567]: I0715 19:01:57.103427    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/9a2729b3-900b-4554-b4e1-a80b959a99cf-tmp-dir\") pod \"sub-test-model-46e17a-kserve-5f85cb87-r6p6j\" (UID: \"9a2729b3-900b-4554-b4e1-a80b959a99cf\") " pod="ai-tenant-e2e-shared-b-46e17a/sub-test-model-46e17a-kserve-5f85cb87-r6p6j"
Jul 15 19:01:57.103620 ip-10-0-141-171 kubenswrapper[2567]: I0715 19:01:57.103539    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/9a2729b3-900b-4554-b4e1-a80b959a99cf-tls-certs\") pod \"sub-test-model-46e17a-kserve-5f85cb87-r6p6j\" (UID: \"9a2729b3-900b-4554-b4e1-a80b959a99cf\") " pod="ai-tenant-e2e-shared-b-46e17a/sub-test-model-46e17a-kserve-5f85cb87-r6p6j"
Jul 15 19:01:57.103620 ip-10-0-141-171 kubenswrapper[2567]: I0715 19:01:57.103576    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vccgt\" (UniqueName: \"kubernetes.io/projected/9a2729b3-900b-4554-b4e1-a80b959a99cf-kube-api-access-vccgt\") pod \"sub-test-model-46e17a-kserve-5f85cb87-r6p6j\" (UID: \"9a2729b3-900b-4554-b4e1-a80b959a99cf\") " pod="ai-tenant-e2e-shared-b-46e17a/sub-test-model-46e17a-kserve-5f85cb87-r6p6j"
Jul 15 19:01:57.103801 ip-10-0-141-171 kubenswrapper[2567]: I0715 19:01:57.103706    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/9a2729b3-900b-4554-b4e1-a80b959a99cf-home\") pod \"sub-test-model-46e17a-kserve-5f85cb87-r6p6j\" (UID: \"9a2729b3-900b-4554-b4e1-a80b959a99cf\") " pod="ai-tenant-e2e-shared-b-46e17a/sub-test-model-46e17a-kserve-5f85cb87-r6p6j"
Jul 15 19:01:57.103801 ip-10-0-141-171 kubenswrapper[2567]: I0715 19:01:57.103734    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/9a2729b3-900b-4554-b4e1-a80b959a99cf-model-cache\") pod \"sub-test-model-46e17a-kserve-5f85cb87-r6p6j\" (UID: \"9a2729b3-900b-4554-b4e1-a80b959a99cf\") " pod="ai-tenant-e2e-shared-b-46e17a/sub-test-model-46e17a-kserve-5f85cb87-r6p6j"
Jul 15 19:01:57.204307 ip-10-0-141-171 kubenswrapper[2567]: I0715 19:01:57.204261    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/9a2729b3-900b-4554-b4e1-a80b959a99cf-home\") pod \"sub-test-model-46e17a-kserve-5f85cb87-r6p6j\" (UID: \"9a2729b3-900b-4554-b4e1-a80b959a99cf\") " pod="ai-tenant-e2e-shared-b-46e17a/sub-test-model-46e17a-kserve-5f85cb87-r6p6j"
Jul 15 19:01:57.204307 ip-10-0-141-171 kubenswrapper[2567]: I0715 19:01:57.204305    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/9a2729b3-900b-4554-b4e1-a80b959a99cf-model-cache\") pod \"sub-test-model-46e17a-kserve-5f85cb87-r6p6j\" (UID: \"9a2729b3-900b-4554-b4e1-a80b959a99cf\") " pod="ai-tenant-e2e-shared-b-46e17a/sub-test-model-46e17a-kserve-5f85cb87-r6p6j"
Jul 15 19:01:57.204557 ip-10-0-141-171 kubenswrapper[2567]: I0715 19:01:57.204330    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/9a2729b3-900b-4554-b4e1-a80b959a99cf-dshm\") pod \"sub-test-model-46e17a-kserve-5f85cb87-r6p6j\" (UID: \"9a2729b3-900b-4554-b4e1-a80b959a99cf\") " pod="ai-tenant-e2e-shared-b-46e17a/sub-test-model-46e17a-kserve-5f85cb87-r6p6j"
Jul 15 19:01:57.204557 ip-10-0-141-171 kubenswrapper[2567]: I0715 19:01:57.204355    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/9a2729b3-900b-4554-b4e1-a80b959a99cf-tmp-dir\") pod \"sub-test-model-46e17a-kserve-5f85cb87-r6p6j\" (UID: \"9a2729b3-900b-4554-b4e1-a80b959a99cf\") " pod="ai-tenant-e2e-shared-b-46e17a/sub-test-model-46e17a-kserve-5f85cb87-r6p6j"
Jul 15 19:01:57.204557 ip-10-0-141-171 kubenswrapper[2567]: I0715 19:01:57.204385    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/9a2729b3-900b-4554-b4e1-a80b959a99cf-tls-certs\") pod \"sub-test-model-46e17a-kserve-5f85cb87-r6p6j\" (UID: \"9a2729b3-900b-4554-b4e1-a80b959a99cf\") " pod="ai-tenant-e2e-shared-b-46e17a/sub-test-model-46e17a-kserve-5f85cb87-r6p6j"
Jul 15 19:01:57.204557 ip-10-0-141-171 kubenswrapper[2567]: I0715 19:01:57.204411    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vccgt\" (UniqueName: \"kubernetes.io/projected/9a2729b3-900b-4554-b4e1-a80b959a99cf-kube-api-access-vccgt\") pod \"sub-test-model-46e17a-kserve-5f85cb87-r6p6j\" (UID: \"9a2729b3-900b-4554-b4e1-a80b959a99cf\") " pod="ai-tenant-e2e-shared-b-46e17a/sub-test-model-46e17a-kserve-5f85cb87-r6p6j"
Jul 15 19:01:57.204835 ip-10-0-141-171 kubenswrapper[2567]: I0715 19:01:57.204722    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/9a2729b3-900b-4554-b4e1-a80b959a99cf-home\") pod \"sub-test-model-46e17a-kserve-5f85cb87-r6p6j\" (UID: \"9a2729b3-900b-4554-b4e1-a80b959a99cf\") " pod="ai-tenant-e2e-shared-b-46e17a/sub-test-model-46e17a-kserve-5f85cb87-r6p6j"
Jul 15 19:01:57.204835 ip-10-0-141-171 kubenswrapper[2567]: I0715 19:01:57.204735    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/9a2729b3-900b-4554-b4e1-a80b959a99cf-tmp-dir\") pod \"sub-test-model-46e17a-kserve-5f85cb87-r6p6j\" (UID: \"9a2729b3-900b-4554-b4e1-a80b959a99cf\") " pod="ai-tenant-e2e-shared-b-46e17a/sub-test-model-46e17a-kserve-5f85cb87-r6p6j"
Jul 15 19:01:57.204835 ip-10-0-141-171 kubenswrapper[2567]: I0715 19:01:57.204808    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/9a2729b3-900b-4554-b4e1-a80b959a99cf-model-cache\") pod \"sub-test-model-46e17a-kserve-5f85cb87-r6p6j\" (UID: \"9a2729b3-900b-4554-b4e1-a80b959a99cf\") " pod="ai-tenant-e2e-shared-b-46e17a/sub-test-model-46e17a-kserve-5f85cb87-r6p6j"
Jul 15 19:01:57.206691 ip-10-0-141-171 kubenswrapper[2567]: I0715 19:01:57.206669    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/9a2729b3-900b-4554-b4e1-a80b959a99cf-dshm\") pod \"sub-test-model-46e17a-kserve-5f85cb87-r6p6j\" (UID: \"9a2729b3-900b-4554-b4e1-a80b959a99cf\") " pod="ai-tenant-e2e-shared-b-46e17a/sub-test-model-46e17a-kserve-5f85cb87-r6p6j"
Jul 15 19:01:57.206928 ip-10-0-141-171 kubenswrapper[2567]: I0715 19:01:57.206911    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/9a2729b3-900b-4554-b4e1-a80b959a99cf-tls-certs\") pod \"sub-test-model-46e17a-kserve-5f85cb87-r6p6j\" (UID: \"9a2729b3-900b-4554-b4e1-a80b959a99cf\") " pod="ai-tenant-e2e-shared-b-46e17a/sub-test-model-46e17a-kserve-5f85cb87-r6p6j"
Jul 15 19:01:57.212703 ip-10-0-141-171 kubenswrapper[2567]: I0715 19:01:57.212684    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vccgt\" (UniqueName: \"kubernetes.io/projected/9a2729b3-900b-4554-b4e1-a80b959a99cf-kube-api-access-vccgt\") pod \"sub-test-model-46e17a-kserve-5f85cb87-r6p6j\" (UID: \"9a2729b3-900b-4554-b4e1-a80b959a99cf\") " pod="ai-tenant-e2e-shared-b-46e17a/sub-test-model-46e17a-kserve-5f85cb87-r6p6j"
Jul 15 19:01:57.308187 ip-10-0-141-171 kubenswrapper[2567]: I0715 19:01:57.308097    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-46e17a/sub-test-model-46e17a-kserve-5f85cb87-r6p6j"
Jul 15 19:01:57.443967 ip-10-0-141-171 kubenswrapper[2567]: I0715 19:01:57.443941    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-46e17a/sub-test-model-46e17a-kserve-5f85cb87-r6p6j"]
Jul 15 19:01:57.446779 ip-10-0-141-171 kubenswrapper[2567]: W0715 19:01:57.446752    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod9a2729b3_900b_4554_b4e1_a80b959a99cf.slice/crio-970758fbc181c57dbf8675783204a99673c6dfde2a32148f92bc4e57d30bc8e0 WatchSource:0}: Error finding container 970758fbc181c57dbf8675783204a99673c6dfde2a32148f92bc4e57d30bc8e0: Status 404 returned error can't find the container with id 970758fbc181c57dbf8675783204a99673c6dfde2a32148f92bc4e57d30bc8e0
Jul 15 19:01:57.828121 ip-10-0-141-171 kubenswrapper[2567]: I0715 19:01:57.828084    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-46e17a/sub-test-model-46e17a-kserve-5f85cb87-r6p6j" event={"ID":"9a2729b3-900b-4554-b4e1-a80b959a99cf","Type":"ContainerStarted","Data":"55bc673cb9c5a2dcd43d8be6a34c60b70c931a669ffa39a2cc93741218eceba3"}
Jul 15 19:01:57.828323 ip-10-0-141-171 kubenswrapper[2567]: I0715 19:01:57.828133    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-46e17a/sub-test-model-46e17a-kserve-5f85cb87-r6p6j" event={"ID":"9a2729b3-900b-4554-b4e1-a80b959a99cf","Type":"ContainerStarted","Data":"970758fbc181c57dbf8675783204a99673c6dfde2a32148f92bc4e57d30bc8e0"}
Jul 15 19:01:57.845383 ip-10-0-141-171 kubenswrapper[2567]: I0715 19:01:57.845328    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-b-46e17a/sub-test-model-46e17a-kserve-5f85cb87-r6p6j" podStartSLOduration=1.845310541 podStartE2EDuration="1.845310541s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 19:01:56 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 19:01:57.843717226 +0000 UTC m=+2676.378140602" watchObservedRunningTime="2026-07-15 19:01:57.845310541 +0000 UTC m=+2676.379733896"
Jul 15 19:02:01.294383 ip-10-0-141-171 kubenswrapper[2567]: I0715 19:02:01.294343    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-qfldk"]
Jul 15 19:02:07.309202 ip-10-0-141-171 kubenswrapper[2567]: I0715 19:02:07.309166    2567 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-b-46e17a/sub-test-model-46e17a-kserve-5f85cb87-r6p6j"
Jul 15 19:02:07.309202 ip-10-0-141-171 kubenswrapper[2567]: I0715 19:02:07.309211    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-b-46e17a/sub-test-model-46e17a-kserve-5f85cb87-r6p6j"
Jul 15 19:02:07.321559 ip-10-0-141-171 kubenswrapper[2567]: I0715 19:02:07.321537    2567 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-b-46e17a/sub-test-model-46e17a-kserve-5f85cb87-r6p6j"
Jul 15 19:02:07.884768 ip-10-0-141-171 kubenswrapper[2567]: I0715 19:02:07.884734    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-b-46e17a/sub-test-model-46e17a-kserve-5f85cb87-r6p6j"
Jul 15 19:02:16.781011 ip-10-0-141-171 kubenswrapper[2567]: I0715 19:02:16.780977    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-qfldk"]
Jul 15 19:02:23.639290 ip-10-0-141-171 kubenswrapper[2567]: I0715 19:02:23.639172    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-8hmqx_d8816772-beae-4dff-9c51-9043199e488d/ovn-acl-logging/0.log"
Jul 15 19:02:23.651073 ip-10-0-141-171 kubenswrapper[2567]: I0715 19:02:23.645972    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-8hmqx_d8816772-beae-4dff-9c51-9043199e488d/ovn-acl-logging/0.log"
Jul 15 19:02:35.866014 ip-10-0-141-171 kubenswrapper[2567]: I0715 19:02:35.865981    2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-46e17a/sub-test-model-46e17a-kserve-5f85cb87-r6p6j"]
Jul 15 19:02:36.999008 ip-10-0-141-171 kubenswrapper[2567]: I0715 19:02:36.998975    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-qfldk"]
Jul 15 19:02:50.886043 ip-10-0-141-171 kubenswrapper[2567]: I0715 19:02:50.885995    2567 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-shared-b-46e17a/sub-test-model-46e17a-kserve-5f85cb87-r6p6j" podUID="9a2729b3-900b-4554-b4e1-a80b959a99cf" containerName="main" containerID="cri-o://55bc673cb9c5a2dcd43d8be6a34c60b70c931a669ffa39a2cc93741218eceba3" gracePeriod=45
Jul 15 19:02:51.082133 ip-10-0-141-171 kubenswrapper[2567]: I0715 19:02:51.082103    2567 generic.go:356] "Generic (PLEG): container finished" podID="9a2729b3-900b-4554-b4e1-a80b959a99cf" containerID="55bc673cb9c5a2dcd43d8be6a34c60b70c931a669ffa39a2cc93741218eceba3" exitCode=0
Jul 15 19:02:51.082301 ip-10-0-141-171 kubenswrapper[2567]: I0715 19:02:51.082133    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-46e17a/sub-test-model-46e17a-kserve-5f85cb87-r6p6j" event={"ID":"9a2729b3-900b-4554-b4e1-a80b959a99cf","Type":"ContainerDied","Data":"55bc673cb9c5a2dcd43d8be6a34c60b70c931a669ffa39a2cc93741218eceba3"}
Jul 15 19:02:51.136174 ip-10-0-141-171 kubenswrapper[2567]: I0715 19:02:51.136112    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-46e17a/sub-test-model-46e17a-kserve-5f85cb87-r6p6j"
Jul 15 19:02:51.237670 ip-10-0-141-171 kubenswrapper[2567]: I0715 19:02:51.237636    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/9a2729b3-900b-4554-b4e1-a80b959a99cf-home\") pod \"9a2729b3-900b-4554-b4e1-a80b959a99cf\" (UID: \"9a2729b3-900b-4554-b4e1-a80b959a99cf\") "
Jul 15 19:02:51.237835 ip-10-0-141-171 kubenswrapper[2567]: I0715 19:02:51.237681    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/9a2729b3-900b-4554-b4e1-a80b959a99cf-tls-certs\") pod \"9a2729b3-900b-4554-b4e1-a80b959a99cf\" (UID: \"9a2729b3-900b-4554-b4e1-a80b959a99cf\") "
Jul 15 19:02:51.237835 ip-10-0-141-171 kubenswrapper[2567]: I0715 19:02:51.237698    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/9a2729b3-900b-4554-b4e1-a80b959a99cf-dshm\") pod \"9a2729b3-900b-4554-b4e1-a80b959a99cf\" (UID: \"9a2729b3-900b-4554-b4e1-a80b959a99cf\") "
Jul 15 19:02:51.237835 ip-10-0-141-171 kubenswrapper[2567]: I0715 19:02:51.237738    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/9a2729b3-900b-4554-b4e1-a80b959a99cf-model-cache\") pod \"9a2729b3-900b-4554-b4e1-a80b959a99cf\" (UID: \"9a2729b3-900b-4554-b4e1-a80b959a99cf\") "
Jul 15 19:02:51.237835 ip-10-0-141-171 kubenswrapper[2567]: I0715 19:02:51.237764    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/9a2729b3-900b-4554-b4e1-a80b959a99cf-tmp-dir\") pod \"9a2729b3-900b-4554-b4e1-a80b959a99cf\" (UID: \"9a2729b3-900b-4554-b4e1-a80b959a99cf\") "
Jul 15 19:02:51.238046 ip-10-0-141-171 kubenswrapper[2567]: I0715 19:02:51.237857    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-vccgt\" (UniqueName: \"kubernetes.io/projected/9a2729b3-900b-4554-b4e1-a80b959a99cf-kube-api-access-vccgt\") pod \"9a2729b3-900b-4554-b4e1-a80b959a99cf\" (UID: \"9a2729b3-900b-4554-b4e1-a80b959a99cf\") "
Jul 15 19:02:51.238046 ip-10-0-141-171 kubenswrapper[2567]: I0715 19:02:51.237963    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9a2729b3-900b-4554-b4e1-a80b959a99cf-home" (OuterVolumeSpecName: "home") pod "9a2729b3-900b-4554-b4e1-a80b959a99cf" (UID: "9a2729b3-900b-4554-b4e1-a80b959a99cf"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 15 19:02:51.238151 ip-10-0-141-171 kubenswrapper[2567]: I0715 19:02:51.238039    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9a2729b3-900b-4554-b4e1-a80b959a99cf-model-cache" (OuterVolumeSpecName: "model-cache") pod "9a2729b3-900b-4554-b4e1-a80b959a99cf" (UID: "9a2729b3-900b-4554-b4e1-a80b959a99cf"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 15 19:02:51.238151 ip-10-0-141-171 kubenswrapper[2567]: I0715 19:02:51.238119    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9a2729b3-900b-4554-b4e1-a80b959a99cf-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "9a2729b3-900b-4554-b4e1-a80b959a99cf" (UID: "9a2729b3-900b-4554-b4e1-a80b959a99cf"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 15 19:02:51.238282 ip-10-0-141-171 kubenswrapper[2567]: I0715 19:02:51.238262    2567 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/9a2729b3-900b-4554-b4e1-a80b959a99cf-tmp-dir\") on node \"ip-10-0-141-171.ec2.internal\" DevicePath \"\""
Jul 15 19:02:51.238337 ip-10-0-141-171 kubenswrapper[2567]: I0715 19:02:51.238284    2567 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/9a2729b3-900b-4554-b4e1-a80b959a99cf-home\") on node \"ip-10-0-141-171.ec2.internal\" DevicePath \"\""
Jul 15 19:02:51.238337 ip-10-0-141-171 kubenswrapper[2567]: I0715 19:02:51.238299    2567 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/9a2729b3-900b-4554-b4e1-a80b959a99cf-model-cache\") on node \"ip-10-0-141-171.ec2.internal\" DevicePath \"\""
Jul 15 19:02:51.239866 ip-10-0-141-171 kubenswrapper[2567]: I0715 19:02:51.239834    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9a2729b3-900b-4554-b4e1-a80b959a99cf-dshm" (OuterVolumeSpecName: "dshm") pod "9a2729b3-900b-4554-b4e1-a80b959a99cf" (UID: "9a2729b3-900b-4554-b4e1-a80b959a99cf"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 15 19:02:51.239983 ip-10-0-141-171 kubenswrapper[2567]: I0715 19:02:51.239877    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9a2729b3-900b-4554-b4e1-a80b959a99cf-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "9a2729b3-900b-4554-b4e1-a80b959a99cf" (UID: "9a2729b3-900b-4554-b4e1-a80b959a99cf"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 15 19:02:51.239983 ip-10-0-141-171 kubenswrapper[2567]: I0715 19:02:51.239923    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9a2729b3-900b-4554-b4e1-a80b959a99cf-kube-api-access-vccgt" (OuterVolumeSpecName: "kube-api-access-vccgt") pod "9a2729b3-900b-4554-b4e1-a80b959a99cf" (UID: "9a2729b3-900b-4554-b4e1-a80b959a99cf"). InnerVolumeSpecName "kube-api-access-vccgt". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 15 19:02:51.339757 ip-10-0-141-171 kubenswrapper[2567]: I0715 19:02:51.339714    2567 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-vccgt\" (UniqueName: \"kubernetes.io/projected/9a2729b3-900b-4554-b4e1-a80b959a99cf-kube-api-access-vccgt\") on node \"ip-10-0-141-171.ec2.internal\" DevicePath \"\""
Jul 15 19:02:51.339757 ip-10-0-141-171 kubenswrapper[2567]: I0715 19:02:51.339747    2567 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/9a2729b3-900b-4554-b4e1-a80b959a99cf-tls-certs\") on node \"ip-10-0-141-171.ec2.internal\" DevicePath \"\""
Jul 15 19:02:51.339757 ip-10-0-141-171 kubenswrapper[2567]: I0715 19:02:51.339763    2567 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/9a2729b3-900b-4554-b4e1-a80b959a99cf-dshm\") on node \"ip-10-0-141-171.ec2.internal\" DevicePath \"\""
Jul 15 19:02:52.088650 ip-10-0-141-171 kubenswrapper[2567]: I0715 19:02:52.088617    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-46e17a/sub-test-model-46e17a-kserve-5f85cb87-r6p6j" event={"ID":"9a2729b3-900b-4554-b4e1-a80b959a99cf","Type":"ContainerDied","Data":"970758fbc181c57dbf8675783204a99673c6dfde2a32148f92bc4e57d30bc8e0"}
Jul 15 19:02:52.088650 ip-10-0-141-171 kubenswrapper[2567]: I0715 19:02:52.088636    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-46e17a/sub-test-model-46e17a-kserve-5f85cb87-r6p6j"
Jul 15 19:02:52.088650 ip-10-0-141-171 kubenswrapper[2567]: I0715 19:02:52.088665    2567 scope.go:117] "RemoveContainer" containerID="55bc673cb9c5a2dcd43d8be6a34c60b70c931a669ffa39a2cc93741218eceba3"
Jul 15 19:02:52.109446 ip-10-0-141-171 kubenswrapper[2567]: I0715 19:02:52.109418    2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-46e17a/sub-test-model-46e17a-kserve-5f85cb87-r6p6j"]
Jul 15 19:02:52.114845 ip-10-0-141-171 kubenswrapper[2567]: I0715 19:02:52.114825    2567 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-b-46e17a/sub-test-model-46e17a-kserve-5f85cb87-r6p6j"]
Jul 15 19:02:52.205725 ip-10-0-141-171 kubenswrapper[2567]: I0715 19:02:52.205684    2567 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="9a2729b3-900b-4554-b4e1-a80b959a99cf" path="/var/lib/kubelet/pods/9a2729b3-900b-4554-b4e1-a80b959a99cf/volumes"
Jul 15 19:02:53.289784 ip-10-0-141-171 kubenswrapper[2567]: I0715 19:02:53.289744    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-qfldk"]
Jul 15 19:02:54.390993 ip-10-0-141-171 kubenswrapper[2567]: I0715 19:02:54.390962    2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-a-401e9f/rate-test-model-401e9f-kserve-f788f7bdc-nrn7q"]
Jul 15 19:02:54.391412 ip-10-0-141-171 kubenswrapper[2567]: I0715 19:02:54.391399    2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9a2729b3-900b-4554-b4e1-a80b959a99cf" containerName="main"
Jul 15 19:02:54.391463 ip-10-0-141-171 kubenswrapper[2567]: I0715 19:02:54.391414    2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="9a2729b3-900b-4554-b4e1-a80b959a99cf" containerName="main"
Jul 15 19:02:54.391500 ip-10-0-141-171 kubenswrapper[2567]: I0715 19:02:54.391480    2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="9a2729b3-900b-4554-b4e1-a80b959a99cf" containerName="main"
Jul 15 19:02:54.396024 ip-10-0-141-171 kubenswrapper[2567]: I0715 19:02:54.396006    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-401e9f/rate-test-model-401e9f-kserve-f788f7bdc-nrn7q"
Jul 15 19:02:54.398379 ip-10-0-141-171 kubenswrapper[2567]: I0715 19:02:54.398354    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-a-401e9f\"/\"openshift-service-ca.crt\""
Jul 15 19:02:54.399285 ip-10-0-141-171 kubenswrapper[2567]: I0715 19:02:54.399261    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-a-401e9f\"/\"kube-root-ca.crt\""
Jul 15 19:02:54.399402 ip-10-0-141-171 kubenswrapper[2567]: I0715 19:02:54.399304    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-a-401e9f\"/\"default-dockercfg-7zfmv\""
Jul 15 19:02:54.399402 ip-10-0-141-171 kubenswrapper[2567]: I0715 19:02:54.399323    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-a-401e9f\"/\"rate-test-model-401e9f-kserve-self-signed-certs\""
Jul 15 19:02:54.405117 ip-10-0-141-171 kubenswrapper[2567]: I0715 19:02:54.405094    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-401e9f/rate-test-model-401e9f-kserve-f788f7bdc-nrn7q"]
Jul 15 19:02:54.571495 ip-10-0-141-171 kubenswrapper[2567]: I0715 19:02:54.571457    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/30008554-207c-4711-b65d-436ebdbbf664-home\") pod \"rate-test-model-401e9f-kserve-f788f7bdc-nrn7q\" (UID: \"30008554-207c-4711-b65d-436ebdbbf664\") " pod="ai-tenant-e2e-shared-a-401e9f/rate-test-model-401e9f-kserve-f788f7bdc-nrn7q"
Jul 15 19:02:54.571668 ip-10-0-141-171 kubenswrapper[2567]: I0715 19:02:54.571591    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/30008554-207c-4711-b65d-436ebdbbf664-dshm\") pod \"rate-test-model-401e9f-kserve-f788f7bdc-nrn7q\" (UID: \"30008554-207c-4711-b65d-436ebdbbf664\") " pod="ai-tenant-e2e-shared-a-401e9f/rate-test-model-401e9f-kserve-f788f7bdc-nrn7q"
Jul 15 19:02:54.571668 ip-10-0-141-171 kubenswrapper[2567]: I0715 19:02:54.571639    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/30008554-207c-4711-b65d-436ebdbbf664-tls-certs\") pod \"rate-test-model-401e9f-kserve-f788f7bdc-nrn7q\" (UID: \"30008554-207c-4711-b65d-436ebdbbf664\") " pod="ai-tenant-e2e-shared-a-401e9f/rate-test-model-401e9f-kserve-f788f7bdc-nrn7q"
Jul 15 19:02:54.571668 ip-10-0-141-171 kubenswrapper[2567]: I0715 19:02:54.571659    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/30008554-207c-4711-b65d-436ebdbbf664-tmp-dir\") pod \"rate-test-model-401e9f-kserve-f788f7bdc-nrn7q\" (UID: \"30008554-207c-4711-b65d-436ebdbbf664\") " pod="ai-tenant-e2e-shared-a-401e9f/rate-test-model-401e9f-kserve-f788f7bdc-nrn7q"
Jul 15 19:02:54.571783 ip-10-0-141-171 kubenswrapper[2567]: I0715 19:02:54.571680    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5mq2t\" (UniqueName: \"kubernetes.io/projected/30008554-207c-4711-b65d-436ebdbbf664-kube-api-access-5mq2t\") pod \"rate-test-model-401e9f-kserve-f788f7bdc-nrn7q\" (UID: \"30008554-207c-4711-b65d-436ebdbbf664\") " pod="ai-tenant-e2e-shared-a-401e9f/rate-test-model-401e9f-kserve-f788f7bdc-nrn7q"
Jul 15 19:02:54.571783 ip-10-0-141-171 kubenswrapper[2567]: I0715 19:02:54.571698    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/30008554-207c-4711-b65d-436ebdbbf664-model-cache\") pod \"rate-test-model-401e9f-kserve-f788f7bdc-nrn7q\" (UID: \"30008554-207c-4711-b65d-436ebdbbf664\") " pod="ai-tenant-e2e-shared-a-401e9f/rate-test-model-401e9f-kserve-f788f7bdc-nrn7q"
Jul 15 19:02:54.672791 ip-10-0-141-171 kubenswrapper[2567]: I0715 19:02:54.672715    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/30008554-207c-4711-b65d-436ebdbbf664-home\") pod \"rate-test-model-401e9f-kserve-f788f7bdc-nrn7q\" (UID: \"30008554-207c-4711-b65d-436ebdbbf664\") " pod="ai-tenant-e2e-shared-a-401e9f/rate-test-model-401e9f-kserve-f788f7bdc-nrn7q"
Jul 15 19:02:54.672950 ip-10-0-141-171 kubenswrapper[2567]: I0715 19:02:54.672792    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/30008554-207c-4711-b65d-436ebdbbf664-dshm\") pod \"rate-test-model-401e9f-kserve-f788f7bdc-nrn7q\" (UID: \"30008554-207c-4711-b65d-436ebdbbf664\") " pod="ai-tenant-e2e-shared-a-401e9f/rate-test-model-401e9f-kserve-f788f7bdc-nrn7q"
Jul 15 19:02:54.672950 ip-10-0-141-171 kubenswrapper[2567]: I0715 19:02:54.672812    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/30008554-207c-4711-b65d-436ebdbbf664-tls-certs\") pod \"rate-test-model-401e9f-kserve-f788f7bdc-nrn7q\" (UID: \"30008554-207c-4711-b65d-436ebdbbf664\") " pod="ai-tenant-e2e-shared-a-401e9f/rate-test-model-401e9f-kserve-f788f7bdc-nrn7q"
Jul 15 19:02:54.672950 ip-10-0-141-171 kubenswrapper[2567]: I0715 19:02:54.672828    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/30008554-207c-4711-b65d-436ebdbbf664-tmp-dir\") pod \"rate-test-model-401e9f-kserve-f788f7bdc-nrn7q\" (UID: \"30008554-207c-4711-b65d-436ebdbbf664\") " pod="ai-tenant-e2e-shared-a-401e9f/rate-test-model-401e9f-kserve-f788f7bdc-nrn7q"
Jul 15 19:02:54.672950 ip-10-0-141-171 kubenswrapper[2567]: I0715 19:02:54.672845    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5mq2t\" (UniqueName: \"kubernetes.io/projected/30008554-207c-4711-b65d-436ebdbbf664-kube-api-access-5mq2t\") pod \"rate-test-model-401e9f-kserve-f788f7bdc-nrn7q\" (UID: \"30008554-207c-4711-b65d-436ebdbbf664\") " pod="ai-tenant-e2e-shared-a-401e9f/rate-test-model-401e9f-kserve-f788f7bdc-nrn7q"
Jul 15 19:02:54.672950 ip-10-0-141-171 kubenswrapper[2567]: I0715 19:02:54.672864    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/30008554-207c-4711-b65d-436ebdbbf664-model-cache\") pod \"rate-test-model-401e9f-kserve-f788f7bdc-nrn7q\" (UID: \"30008554-207c-4711-b65d-436ebdbbf664\") " pod="ai-tenant-e2e-shared-a-401e9f/rate-test-model-401e9f-kserve-f788f7bdc-nrn7q"
Jul 15 19:02:54.673219 ip-10-0-141-171 kubenswrapper[2567]: I0715 19:02:54.673146    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/30008554-207c-4711-b65d-436ebdbbf664-home\") pod \"rate-test-model-401e9f-kserve-f788f7bdc-nrn7q\" (UID: \"30008554-207c-4711-b65d-436ebdbbf664\") " pod="ai-tenant-e2e-shared-a-401e9f/rate-test-model-401e9f-kserve-f788f7bdc-nrn7q"
Jul 15 19:02:54.673219 ip-10-0-141-171 kubenswrapper[2567]: I0715 19:02:54.673160    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/30008554-207c-4711-b65d-436ebdbbf664-tmp-dir\") pod \"rate-test-model-401e9f-kserve-f788f7bdc-nrn7q\" (UID: \"30008554-207c-4711-b65d-436ebdbbf664\") " pod="ai-tenant-e2e-shared-a-401e9f/rate-test-model-401e9f-kserve-f788f7bdc-nrn7q"
Jul 15 19:02:54.673341 ip-10-0-141-171 kubenswrapper[2567]: I0715 19:02:54.673273    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/30008554-207c-4711-b65d-436ebdbbf664-model-cache\") pod \"rate-test-model-401e9f-kserve-f788f7bdc-nrn7q\" (UID: \"30008554-207c-4711-b65d-436ebdbbf664\") " pod="ai-tenant-e2e-shared-a-401e9f/rate-test-model-401e9f-kserve-f788f7bdc-nrn7q"
Jul 15 19:02:54.675080 ip-10-0-141-171 kubenswrapper[2567]: I0715 19:02:54.675062    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/30008554-207c-4711-b65d-436ebdbbf664-dshm\") pod \"rate-test-model-401e9f-kserve-f788f7bdc-nrn7q\" (UID: \"30008554-207c-4711-b65d-436ebdbbf664\") " pod="ai-tenant-e2e-shared-a-401e9f/rate-test-model-401e9f-kserve-f788f7bdc-nrn7q"
Jul 15 19:02:54.675391 ip-10-0-141-171 kubenswrapper[2567]: I0715 19:02:54.675373    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/30008554-207c-4711-b65d-436ebdbbf664-tls-certs\") pod \"rate-test-model-401e9f-kserve-f788f7bdc-nrn7q\" (UID: \"30008554-207c-4711-b65d-436ebdbbf664\") " pod="ai-tenant-e2e-shared-a-401e9f/rate-test-model-401e9f-kserve-f788f7bdc-nrn7q"
Jul 15 19:02:54.681093 ip-10-0-141-171 kubenswrapper[2567]: I0715 19:02:54.681067    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5mq2t\" (UniqueName: \"kubernetes.io/projected/30008554-207c-4711-b65d-436ebdbbf664-kube-api-access-5mq2t\") pod \"rate-test-model-401e9f-kserve-f788f7bdc-nrn7q\" (UID: \"30008554-207c-4711-b65d-436ebdbbf664\") " pod="ai-tenant-e2e-shared-a-401e9f/rate-test-model-401e9f-kserve-f788f7bdc-nrn7q"
Jul 15 19:02:54.706056 ip-10-0-141-171 kubenswrapper[2567]: I0715 19:02:54.706037    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-401e9f/rate-test-model-401e9f-kserve-f788f7bdc-nrn7q"
Jul 15 19:02:54.836384 ip-10-0-141-171 kubenswrapper[2567]: I0715 19:02:54.836355    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-401e9f/rate-test-model-401e9f-kserve-f788f7bdc-nrn7q"]
Jul 15 19:02:54.838893 ip-10-0-141-171 kubenswrapper[2567]: W0715 19:02:54.838866    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod30008554_207c_4711_b65d_436ebdbbf664.slice/crio-d518ece70cb15d78f0bec8950f8dd40240acd74ab3bfb6814cce47ae8431e57d WatchSource:0}: Error finding container d518ece70cb15d78f0bec8950f8dd40240acd74ab3bfb6814cce47ae8431e57d: Status 404 returned error can't find the container with id d518ece70cb15d78f0bec8950f8dd40240acd74ab3bfb6814cce47ae8431e57d
Jul 15 19:02:55.103860 ip-10-0-141-171 kubenswrapper[2567]: I0715 19:02:55.103818    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-401e9f/rate-test-model-401e9f-kserve-f788f7bdc-nrn7q" event={"ID":"30008554-207c-4711-b65d-436ebdbbf664","Type":"ContainerStarted","Data":"f5940e32e99ff5978bf7c0c68ec4e53323e82d66e9a85be740f84d7c60829691"}
Jul 15 19:02:55.104031 ip-10-0-141-171 kubenswrapper[2567]: I0715 19:02:55.103871    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-401e9f/rate-test-model-401e9f-kserve-f788f7bdc-nrn7q" event={"ID":"30008554-207c-4711-b65d-436ebdbbf664","Type":"ContainerStarted","Data":"d518ece70cb15d78f0bec8950f8dd40240acd74ab3bfb6814cce47ae8431e57d"}
Jul 15 19:02:55.121886 ip-10-0-141-171 kubenswrapper[2567]: I0715 19:02:55.121834    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-a-401e9f/rate-test-model-401e9f-kserve-f788f7bdc-nrn7q" podStartSLOduration=1.121818044 podStartE2EDuration="1.121818044s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 19:02:54 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 19:02:55.120776407 +0000 UTC m=+2733.655199763" watchObservedRunningTime="2026-07-15 19:02:55.121818044 +0000 UTC m=+2733.656241447"
Jul 15 19:03:04.706206 ip-10-0-141-171 kubenswrapper[2567]: I0715 19:03:04.706165    2567 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-a-401e9f/rate-test-model-401e9f-kserve-f788f7bdc-nrn7q"
Jul 15 19:03:04.706585 ip-10-0-141-171 kubenswrapper[2567]: I0715 19:03:04.706251    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-a-401e9f/rate-test-model-401e9f-kserve-f788f7bdc-nrn7q"
Jul 15 19:03:04.718398 ip-10-0-141-171 kubenswrapper[2567]: I0715 19:03:04.718363    2567 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-a-401e9f/rate-test-model-401e9f-kserve-f788f7bdc-nrn7q"
Jul 15 19:03:05.162031 ip-10-0-141-171 kubenswrapper[2567]: I0715 19:03:05.161949    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-a-401e9f/rate-test-model-401e9f-kserve-f788f7bdc-nrn7q"
Jul 15 19:03:05.790831 ip-10-0-141-171 kubenswrapper[2567]: I0715 19:03:05.790788    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-qfldk"]
Jul 15 19:03:39.700510 ip-10-0-141-171 kubenswrapper[2567]: I0715 19:03:39.700466    2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-b-46e17a/rate-test-model-46e17a-kserve-5cd589fc99-g2cm9"]
Jul 15 19:03:39.704127 ip-10-0-141-171 kubenswrapper[2567]: I0715 19:03:39.704102    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-46e17a/rate-test-model-46e17a-kserve-5cd589fc99-g2cm9"
Jul 15 19:03:39.706396 ip-10-0-141-171 kubenswrapper[2567]: I0715 19:03:39.706373    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-46e17a\"/\"openshift-service-ca.crt\""
Jul 15 19:03:39.706519 ip-10-0-141-171 kubenswrapper[2567]: I0715 19:03:39.706421    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-46e17a\"/\"kube-root-ca.crt\""
Jul 15 19:03:39.707030 ip-10-0-141-171 kubenswrapper[2567]: I0715 19:03:39.707014    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-46e17a\"/\"default-dockercfg-mhc85\""
Jul 15 19:03:39.707186 ip-10-0-141-171 kubenswrapper[2567]: I0715 19:03:39.707171    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-46e17a\"/\"rate-test-model-46e17a-kserve-self-signed-certs\""
Jul 15 19:03:39.714662 ip-10-0-141-171 kubenswrapper[2567]: I0715 19:03:39.714642    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-46e17a/rate-test-model-46e17a-kserve-5cd589fc99-g2cm9"]
Jul 15 19:03:39.796870 ip-10-0-141-171 kubenswrapper[2567]: I0715 19:03:39.796841    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/3c919c72-cbe7-47f4-af75-6cca03706e06-home\") pod \"rate-test-model-46e17a-kserve-5cd589fc99-g2cm9\" (UID: \"3c919c72-cbe7-47f4-af75-6cca03706e06\") " pod="ai-tenant-e2e-shared-b-46e17a/rate-test-model-46e17a-kserve-5cd589fc99-g2cm9"
Jul 15 19:03:39.797039 ip-10-0-141-171 kubenswrapper[2567]: I0715 19:03:39.796895    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/3c919c72-cbe7-47f4-af75-6cca03706e06-dshm\") pod \"rate-test-model-46e17a-kserve-5cd589fc99-g2cm9\" (UID: \"3c919c72-cbe7-47f4-af75-6cca03706e06\") " pod="ai-tenant-e2e-shared-b-46e17a/rate-test-model-46e17a-kserve-5cd589fc99-g2cm9"
Jul 15 19:03:39.797039 ip-10-0-141-171 kubenswrapper[2567]: I0715 19:03:39.796914    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/3c919c72-cbe7-47f4-af75-6cca03706e06-tls-certs\") pod \"rate-test-model-46e17a-kserve-5cd589fc99-g2cm9\" (UID: \"3c919c72-cbe7-47f4-af75-6cca03706e06\") " pod="ai-tenant-e2e-shared-b-46e17a/rate-test-model-46e17a-kserve-5cd589fc99-g2cm9"
Jul 15 19:03:39.797039 ip-10-0-141-171 kubenswrapper[2567]: I0715 19:03:39.796937    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/3c919c72-cbe7-47f4-af75-6cca03706e06-tmp-dir\") pod \"rate-test-model-46e17a-kserve-5cd589fc99-g2cm9\" (UID: \"3c919c72-cbe7-47f4-af75-6cca03706e06\") " pod="ai-tenant-e2e-shared-b-46e17a/rate-test-model-46e17a-kserve-5cd589fc99-g2cm9"
Jul 15 19:03:39.797039 ip-10-0-141-171 kubenswrapper[2567]: I0715 19:03:39.796969    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/3c919c72-cbe7-47f4-af75-6cca03706e06-model-cache\") pod \"rate-test-model-46e17a-kserve-5cd589fc99-g2cm9\" (UID: \"3c919c72-cbe7-47f4-af75-6cca03706e06\") " pod="ai-tenant-e2e-shared-b-46e17a/rate-test-model-46e17a-kserve-5cd589fc99-g2cm9"
Jul 15 19:03:39.797278 ip-10-0-141-171 kubenswrapper[2567]: I0715 19:03:39.797067    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-q64lj\" (UniqueName: \"kubernetes.io/projected/3c919c72-cbe7-47f4-af75-6cca03706e06-kube-api-access-q64lj\") pod \"rate-test-model-46e17a-kserve-5cd589fc99-g2cm9\" (UID: \"3c919c72-cbe7-47f4-af75-6cca03706e06\") " pod="ai-tenant-e2e-shared-b-46e17a/rate-test-model-46e17a-kserve-5cd589fc99-g2cm9"
Jul 15 19:03:39.898593 ip-10-0-141-171 kubenswrapper[2567]: I0715 19:03:39.898553    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/3c919c72-cbe7-47f4-af75-6cca03706e06-home\") pod \"rate-test-model-46e17a-kserve-5cd589fc99-g2cm9\" (UID: \"3c919c72-cbe7-47f4-af75-6cca03706e06\") " pod="ai-tenant-e2e-shared-b-46e17a/rate-test-model-46e17a-kserve-5cd589fc99-g2cm9"
Jul 15 19:03:39.898780 ip-10-0-141-171 kubenswrapper[2567]: I0715 19:03:39.898624    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/3c919c72-cbe7-47f4-af75-6cca03706e06-dshm\") pod \"rate-test-model-46e17a-kserve-5cd589fc99-g2cm9\" (UID: \"3c919c72-cbe7-47f4-af75-6cca03706e06\") " pod="ai-tenant-e2e-shared-b-46e17a/rate-test-model-46e17a-kserve-5cd589fc99-g2cm9"
Jul 15 19:03:39.898780 ip-10-0-141-171 kubenswrapper[2567]: I0715 19:03:39.898648    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/3c919c72-cbe7-47f4-af75-6cca03706e06-tls-certs\") pod \"rate-test-model-46e17a-kserve-5cd589fc99-g2cm9\" (UID: \"3c919c72-cbe7-47f4-af75-6cca03706e06\") " pod="ai-tenant-e2e-shared-b-46e17a/rate-test-model-46e17a-kserve-5cd589fc99-g2cm9"
Jul 15 19:03:39.898780 ip-10-0-141-171 kubenswrapper[2567]: I0715 19:03:39.898679    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/3c919c72-cbe7-47f4-af75-6cca03706e06-tmp-dir\") pod \"rate-test-model-46e17a-kserve-5cd589fc99-g2cm9\" (UID: \"3c919c72-cbe7-47f4-af75-6cca03706e06\") " pod="ai-tenant-e2e-shared-b-46e17a/rate-test-model-46e17a-kserve-5cd589fc99-g2cm9"
Jul 15 19:03:39.898780 ip-10-0-141-171 kubenswrapper[2567]: I0715 19:03:39.898730    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/3c919c72-cbe7-47f4-af75-6cca03706e06-model-cache\") pod \"rate-test-model-46e17a-kserve-5cd589fc99-g2cm9\" (UID: \"3c919c72-cbe7-47f4-af75-6cca03706e06\") " pod="ai-tenant-e2e-shared-b-46e17a/rate-test-model-46e17a-kserve-5cd589fc99-g2cm9"
Jul 15 19:03:39.898780 ip-10-0-141-171 kubenswrapper[2567]: I0715 19:03:39.898774    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-q64lj\" (UniqueName: \"kubernetes.io/projected/3c919c72-cbe7-47f4-af75-6cca03706e06-kube-api-access-q64lj\") pod \"rate-test-model-46e17a-kserve-5cd589fc99-g2cm9\" (UID: \"3c919c72-cbe7-47f4-af75-6cca03706e06\") " pod="ai-tenant-e2e-shared-b-46e17a/rate-test-model-46e17a-kserve-5cd589fc99-g2cm9"
Jul 15 19:03:39.899047 ip-10-0-141-171 kubenswrapper[2567]: I0715 19:03:39.898974    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/3c919c72-cbe7-47f4-af75-6cca03706e06-home\") pod \"rate-test-model-46e17a-kserve-5cd589fc99-g2cm9\" (UID: \"3c919c72-cbe7-47f4-af75-6cca03706e06\") " pod="ai-tenant-e2e-shared-b-46e17a/rate-test-model-46e17a-kserve-5cd589fc99-g2cm9"
Jul 15 19:03:39.899106 ip-10-0-141-171 kubenswrapper[2567]: I0715 19:03:39.899068    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/3c919c72-cbe7-47f4-af75-6cca03706e06-tmp-dir\") pod \"rate-test-model-46e17a-kserve-5cd589fc99-g2cm9\" (UID: \"3c919c72-cbe7-47f4-af75-6cca03706e06\") " pod="ai-tenant-e2e-shared-b-46e17a/rate-test-model-46e17a-kserve-5cd589fc99-g2cm9"
Jul 15 19:03:39.899162 ip-10-0-141-171 kubenswrapper[2567]: I0715 19:03:39.899120    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/3c919c72-cbe7-47f4-af75-6cca03706e06-model-cache\") pod \"rate-test-model-46e17a-kserve-5cd589fc99-g2cm9\" (UID: \"3c919c72-cbe7-47f4-af75-6cca03706e06\") " pod="ai-tenant-e2e-shared-b-46e17a/rate-test-model-46e17a-kserve-5cd589fc99-g2cm9"
Jul 15 19:03:39.900921 ip-10-0-141-171 kubenswrapper[2567]: I0715 19:03:39.900899    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/3c919c72-cbe7-47f4-af75-6cca03706e06-dshm\") pod \"rate-test-model-46e17a-kserve-5cd589fc99-g2cm9\" (UID: \"3c919c72-cbe7-47f4-af75-6cca03706e06\") " pod="ai-tenant-e2e-shared-b-46e17a/rate-test-model-46e17a-kserve-5cd589fc99-g2cm9"
Jul 15 19:03:39.901075 ip-10-0-141-171 kubenswrapper[2567]: I0715 19:03:39.901056    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/3c919c72-cbe7-47f4-af75-6cca03706e06-tls-certs\") pod \"rate-test-model-46e17a-kserve-5cd589fc99-g2cm9\" (UID: \"3c919c72-cbe7-47f4-af75-6cca03706e06\") " pod="ai-tenant-e2e-shared-b-46e17a/rate-test-model-46e17a-kserve-5cd589fc99-g2cm9"
Jul 15 19:03:39.906955 ip-10-0-141-171 kubenswrapper[2567]: I0715 19:03:39.906937    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-q64lj\" (UniqueName: \"kubernetes.io/projected/3c919c72-cbe7-47f4-af75-6cca03706e06-kube-api-access-q64lj\") pod \"rate-test-model-46e17a-kserve-5cd589fc99-g2cm9\" (UID: \"3c919c72-cbe7-47f4-af75-6cca03706e06\") " pod="ai-tenant-e2e-shared-b-46e17a/rate-test-model-46e17a-kserve-5cd589fc99-g2cm9"
Jul 15 19:03:40.014027 ip-10-0-141-171 kubenswrapper[2567]: I0715 19:03:40.013952    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-46e17a/rate-test-model-46e17a-kserve-5cd589fc99-g2cm9"
Jul 15 19:03:40.155584 ip-10-0-141-171 kubenswrapper[2567]: I0715 19:03:40.152893    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-46e17a/rate-test-model-46e17a-kserve-5cd589fc99-g2cm9"]
Jul 15 19:03:40.156276 ip-10-0-141-171 kubenswrapper[2567]: W0715 19:03:40.156223    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod3c919c72_cbe7_47f4_af75_6cca03706e06.slice/crio-3e2d197b23a4109f89fc7aa017162641971f39c64d4a1f2a8d2b4fba6dc160b5 WatchSource:0}: Error finding container 3e2d197b23a4109f89fc7aa017162641971f39c64d4a1f2a8d2b4fba6dc160b5: Status 404 returned error can't find the container with id 3e2d197b23a4109f89fc7aa017162641971f39c64d4a1f2a8d2b4fba6dc160b5
Jul 15 19:03:40.315497 ip-10-0-141-171 kubenswrapper[2567]: I0715 19:03:40.315412    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-46e17a/rate-test-model-46e17a-kserve-5cd589fc99-g2cm9" event={"ID":"3c919c72-cbe7-47f4-af75-6cca03706e06","Type":"ContainerStarted","Data":"86856f26317a489a339724218485289088e27536c5802bb2d767df90e521b210"}
Jul 15 19:03:40.315497 ip-10-0-141-171 kubenswrapper[2567]: I0715 19:03:40.315468    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-46e17a/rate-test-model-46e17a-kserve-5cd589fc99-g2cm9" event={"ID":"3c919c72-cbe7-47f4-af75-6cca03706e06","Type":"ContainerStarted","Data":"3e2d197b23a4109f89fc7aa017162641971f39c64d4a1f2a8d2b4fba6dc160b5"}
Jul 15 19:03:40.332544 ip-10-0-141-171 kubenswrapper[2567]: I0715 19:03:40.332487    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-b-46e17a/rate-test-model-46e17a-kserve-5cd589fc99-g2cm9" podStartSLOduration=1.332469165 podStartE2EDuration="1.332469165s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 19:03:39 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 19:03:40.331979072 +0000 UTC m=+2778.866402432" watchObservedRunningTime="2026-07-15 19:03:40.332469165 +0000 UTC m=+2778.866892522"
Jul 15 19:03:44.291415 ip-10-0-141-171 kubenswrapper[2567]: I0715 19:03:44.291338    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-qfldk"]
Jul 15 19:03:50.014490 ip-10-0-141-171 kubenswrapper[2567]: I0715 19:03:50.014451    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-b-46e17a/rate-test-model-46e17a-kserve-5cd589fc99-g2cm9"
Jul 15 19:03:50.014965 ip-10-0-141-171 kubenswrapper[2567]: I0715 19:03:50.014510    2567 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-b-46e17a/rate-test-model-46e17a-kserve-5cd589fc99-g2cm9"
Jul 15 19:03:50.027363 ip-10-0-141-171 kubenswrapper[2567]: I0715 19:03:50.027338    2567 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-b-46e17a/rate-test-model-46e17a-kserve-5cd589fc99-g2cm9"
Jul 15 19:03:50.373949 ip-10-0-141-171 kubenswrapper[2567]: I0715 19:03:50.373865    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-b-46e17a/rate-test-model-46e17a-kserve-5cd589fc99-g2cm9"
Jul 15 19:03:58.793932 ip-10-0-141-171 kubenswrapper[2567]: I0715 19:03:58.793894    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-qfldk"]
Jul 15 19:04:18.888048 ip-10-0-141-171 kubenswrapper[2567]: I0715 19:04:18.888011    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-qfldk"]
Jul 15 19:04:23.528105 ip-10-0-141-171 kubenswrapper[2567]: I0715 19:04:23.528070    2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-401e9f/rate-test-model-401e9f-kserve-f788f7bdc-nrn7q"]
Jul 15 19:04:24.300700 ip-10-0-141-171 kubenswrapper[2567]: I0715 19:04:24.300665    2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-46e17a/rate-test-model-46e17a-kserve-5cd589fc99-g2cm9"]
Jul 15 19:04:29.492819 ip-10-0-141-171 kubenswrapper[2567]: I0715 19:04:29.492779    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-qfldk"]
Jul 15 19:04:38.547675 ip-10-0-141-171 kubenswrapper[2567]: I0715 19:04:38.547632    2567 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-shared-a-401e9f/rate-test-model-401e9f-kserve-f788f7bdc-nrn7q" podUID="30008554-207c-4711-b65d-436ebdbbf664" containerName="main" containerID="cri-o://f5940e32e99ff5978bf7c0c68ec4e53323e82d66e9a85be740f84d7c60829691" gracePeriod=45
Jul 15 19:04:38.799994 ip-10-0-141-171 kubenswrapper[2567]: I0715 19:04:38.799933    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-401e9f/rate-test-model-401e9f-kserve-f788f7bdc-nrn7q"
Jul 15 19:04:38.959750 ip-10-0-141-171 kubenswrapper[2567]: I0715 19:04:38.959710    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/30008554-207c-4711-b65d-436ebdbbf664-home\") pod \"30008554-207c-4711-b65d-436ebdbbf664\" (UID: \"30008554-207c-4711-b65d-436ebdbbf664\") "
Jul 15 19:04:38.959935 ip-10-0-141-171 kubenswrapper[2567]: I0715 19:04:38.959778    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/30008554-207c-4711-b65d-436ebdbbf664-dshm\") pod \"30008554-207c-4711-b65d-436ebdbbf664\" (UID: \"30008554-207c-4711-b65d-436ebdbbf664\") "
Jul 15 19:04:38.959935 ip-10-0-141-171 kubenswrapper[2567]: I0715 19:04:38.959804    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/30008554-207c-4711-b65d-436ebdbbf664-tls-certs\") pod \"30008554-207c-4711-b65d-436ebdbbf664\" (UID: \"30008554-207c-4711-b65d-436ebdbbf664\") "
Jul 15 19:04:38.959935 ip-10-0-141-171 kubenswrapper[2567]: I0715 19:04:38.959837    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-5mq2t\" (UniqueName: \"kubernetes.io/projected/30008554-207c-4711-b65d-436ebdbbf664-kube-api-access-5mq2t\") pod \"30008554-207c-4711-b65d-436ebdbbf664\" (UID: \"30008554-207c-4711-b65d-436ebdbbf664\") "
Jul 15 19:04:38.959935 ip-10-0-141-171 kubenswrapper[2567]: I0715 19:04:38.959874    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/30008554-207c-4711-b65d-436ebdbbf664-tmp-dir\") pod \"30008554-207c-4711-b65d-436ebdbbf664\" (UID: \"30008554-207c-4711-b65d-436ebdbbf664\") "
Jul 15 19:04:38.959935 ip-10-0-141-171 kubenswrapper[2567]: I0715 19:04:38.959889    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/30008554-207c-4711-b65d-436ebdbbf664-model-cache\") pod \"30008554-207c-4711-b65d-436ebdbbf664\" (UID: \"30008554-207c-4711-b65d-436ebdbbf664\") "
Jul 15 19:04:38.960210 ip-10-0-141-171 kubenswrapper[2567]: I0715 19:04:38.960032    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/30008554-207c-4711-b65d-436ebdbbf664-home" (OuterVolumeSpecName: "home") pod "30008554-207c-4711-b65d-436ebdbbf664" (UID: "30008554-207c-4711-b65d-436ebdbbf664"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 15 19:04:38.960210 ip-10-0-141-171 kubenswrapper[2567]: I0715 19:04:38.960152    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/30008554-207c-4711-b65d-436ebdbbf664-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "30008554-207c-4711-b65d-436ebdbbf664" (UID: "30008554-207c-4711-b65d-436ebdbbf664"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 15 19:04:38.960210 ip-10-0-141-171 kubenswrapper[2567]: I0715 19:04:38.960190    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/30008554-207c-4711-b65d-436ebdbbf664-model-cache" (OuterVolumeSpecName: "model-cache") pod "30008554-207c-4711-b65d-436ebdbbf664" (UID: "30008554-207c-4711-b65d-436ebdbbf664"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 15 19:04:38.960407 ip-10-0-141-171 kubenswrapper[2567]: I0715 19:04:38.960293    2567 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/30008554-207c-4711-b65d-436ebdbbf664-home\") on node \"ip-10-0-141-171.ec2.internal\" DevicePath \"\""
Jul 15 19:04:38.960407 ip-10-0-141-171 kubenswrapper[2567]: I0715 19:04:38.960334    2567 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/30008554-207c-4711-b65d-436ebdbbf664-tmp-dir\") on node \"ip-10-0-141-171.ec2.internal\" DevicePath \"\""
Jul 15 19:04:38.960407 ip-10-0-141-171 kubenswrapper[2567]: I0715 19:04:38.960351    2567 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/30008554-207c-4711-b65d-436ebdbbf664-model-cache\") on node \"ip-10-0-141-171.ec2.internal\" DevicePath \"\""
Jul 15 19:04:38.961934 ip-10-0-141-171 kubenswrapper[2567]: I0715 19:04:38.961897    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/30008554-207c-4711-b65d-436ebdbbf664-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "30008554-207c-4711-b65d-436ebdbbf664" (UID: "30008554-207c-4711-b65d-436ebdbbf664"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 15 19:04:38.962172 ip-10-0-141-171 kubenswrapper[2567]: I0715 19:04:38.962152    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/30008554-207c-4711-b65d-436ebdbbf664-dshm" (OuterVolumeSpecName: "dshm") pod "30008554-207c-4711-b65d-436ebdbbf664" (UID: "30008554-207c-4711-b65d-436ebdbbf664"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 15 19:04:38.962256 ip-10-0-141-171 kubenswrapper[2567]: I0715 19:04:38.962208    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/30008554-207c-4711-b65d-436ebdbbf664-kube-api-access-5mq2t" (OuterVolumeSpecName: "kube-api-access-5mq2t") pod "30008554-207c-4711-b65d-436ebdbbf664" (UID: "30008554-207c-4711-b65d-436ebdbbf664"). InnerVolumeSpecName "kube-api-access-5mq2t". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 15 19:04:39.060887 ip-10-0-141-171 kubenswrapper[2567]: I0715 19:04:39.060801    2567 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/30008554-207c-4711-b65d-436ebdbbf664-dshm\") on node \"ip-10-0-141-171.ec2.internal\" DevicePath \"\""
Jul 15 19:04:39.060887 ip-10-0-141-171 kubenswrapper[2567]: I0715 19:04:39.060832    2567 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/30008554-207c-4711-b65d-436ebdbbf664-tls-certs\") on node \"ip-10-0-141-171.ec2.internal\" DevicePath \"\""
Jul 15 19:04:39.060887 ip-10-0-141-171 kubenswrapper[2567]: I0715 19:04:39.060855    2567 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-5mq2t\" (UniqueName: \"kubernetes.io/projected/30008554-207c-4711-b65d-436ebdbbf664-kube-api-access-5mq2t\") on node \"ip-10-0-141-171.ec2.internal\" DevicePath \"\""
Jul 15 19:04:39.321141 ip-10-0-141-171 kubenswrapper[2567]: I0715 19:04:39.321025    2567 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-shared-b-46e17a/rate-test-model-46e17a-kserve-5cd589fc99-g2cm9" podUID="3c919c72-cbe7-47f4-af75-6cca03706e06" containerName="main" containerID="cri-o://86856f26317a489a339724218485289088e27536c5802bb2d767df90e521b210" gracePeriod=45
Jul 15 19:04:39.559605 ip-10-0-141-171 kubenswrapper[2567]: I0715 19:04:39.559505    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-46e17a/rate-test-model-46e17a-kserve-5cd589fc99-g2cm9"
Jul 15 19:04:39.603939 ip-10-0-141-171 kubenswrapper[2567]: I0715 19:04:39.603832    2567 generic.go:356] "Generic (PLEG): container finished" podID="3c919c72-cbe7-47f4-af75-6cca03706e06" containerID="86856f26317a489a339724218485289088e27536c5802bb2d767df90e521b210" exitCode=0
Jul 15 19:04:39.603939 ip-10-0-141-171 kubenswrapper[2567]: I0715 19:04:39.603874    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-46e17a/rate-test-model-46e17a-kserve-5cd589fc99-g2cm9"
Jul 15 19:04:39.603939 ip-10-0-141-171 kubenswrapper[2567]: I0715 19:04:39.603916    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-46e17a/rate-test-model-46e17a-kserve-5cd589fc99-g2cm9" event={"ID":"3c919c72-cbe7-47f4-af75-6cca03706e06","Type":"ContainerDied","Data":"86856f26317a489a339724218485289088e27536c5802bb2d767df90e521b210"}
Jul 15 19:04:39.604200 ip-10-0-141-171 kubenswrapper[2567]: I0715 19:04:39.603967    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-46e17a/rate-test-model-46e17a-kserve-5cd589fc99-g2cm9" event={"ID":"3c919c72-cbe7-47f4-af75-6cca03706e06","Type":"ContainerDied","Data":"3e2d197b23a4109f89fc7aa017162641971f39c64d4a1f2a8d2b4fba6dc160b5"}
Jul 15 19:04:39.604200 ip-10-0-141-171 kubenswrapper[2567]: I0715 19:04:39.603989    2567 scope.go:117] "RemoveContainer" containerID="86856f26317a489a339724218485289088e27536c5802bb2d767df90e521b210"
Jul 15 19:04:39.605662 ip-10-0-141-171 kubenswrapper[2567]: I0715 19:04:39.605639    2567 generic.go:356] "Generic (PLEG): container finished" podID="30008554-207c-4711-b65d-436ebdbbf664" containerID="f5940e32e99ff5978bf7c0c68ec4e53323e82d66e9a85be740f84d7c60829691" exitCode=0
Jul 15 19:04:39.605749 ip-10-0-141-171 kubenswrapper[2567]: I0715 19:04:39.605675    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-401e9f/rate-test-model-401e9f-kserve-f788f7bdc-nrn7q" event={"ID":"30008554-207c-4711-b65d-436ebdbbf664","Type":"ContainerDied","Data":"f5940e32e99ff5978bf7c0c68ec4e53323e82d66e9a85be740f84d7c60829691"}
Jul 15 19:04:39.605749 ip-10-0-141-171 kubenswrapper[2567]: I0715 19:04:39.605702    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-401e9f/rate-test-model-401e9f-kserve-f788f7bdc-nrn7q" event={"ID":"30008554-207c-4711-b65d-436ebdbbf664","Type":"ContainerDied","Data":"d518ece70cb15d78f0bec8950f8dd40240acd74ab3bfb6814cce47ae8431e57d"}
Jul 15 19:04:39.605749 ip-10-0-141-171 kubenswrapper[2567]: I0715 19:04:39.605680    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-401e9f/rate-test-model-401e9f-kserve-f788f7bdc-nrn7q"
Jul 15 19:04:39.612396 ip-10-0-141-171 kubenswrapper[2567]: I0715 19:04:39.612377    2567 scope.go:117] "RemoveContainer" containerID="86856f26317a489a339724218485289088e27536c5802bb2d767df90e521b210"
Jul 15 19:04:39.612640 ip-10-0-141-171 kubenswrapper[2567]: E0715 19:04:39.612619    2567 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"86856f26317a489a339724218485289088e27536c5802bb2d767df90e521b210\": container with ID starting with 86856f26317a489a339724218485289088e27536c5802bb2d767df90e521b210 not found: ID does not exist" containerID="86856f26317a489a339724218485289088e27536c5802bb2d767df90e521b210"
Jul 15 19:04:39.612733 ip-10-0-141-171 kubenswrapper[2567]: I0715 19:04:39.612645    2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"86856f26317a489a339724218485289088e27536c5802bb2d767df90e521b210"} err="failed to get container status \"86856f26317a489a339724218485289088e27536c5802bb2d767df90e521b210\": rpc error: code = NotFound desc = could not find container \"86856f26317a489a339724218485289088e27536c5802bb2d767df90e521b210\": container with ID starting with 86856f26317a489a339724218485289088e27536c5802bb2d767df90e521b210 not found: ID does not exist"
Jul 15 19:04:39.612733 ip-10-0-141-171 kubenswrapper[2567]: I0715 19:04:39.612661    2567 scope.go:117] "RemoveContainer" containerID="f5940e32e99ff5978bf7c0c68ec4e53323e82d66e9a85be740f84d7c60829691"
Jul 15 19:04:39.620900 ip-10-0-141-171 kubenswrapper[2567]: I0715 19:04:39.620877    2567 scope.go:117] "RemoveContainer" containerID="f5940e32e99ff5978bf7c0c68ec4e53323e82d66e9a85be740f84d7c60829691"
Jul 15 19:04:39.621126 ip-10-0-141-171 kubenswrapper[2567]: E0715 19:04:39.621109    2567 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f5940e32e99ff5978bf7c0c68ec4e53323e82d66e9a85be740f84d7c60829691\": container with ID starting with f5940e32e99ff5978bf7c0c68ec4e53323e82d66e9a85be740f84d7c60829691 not found: ID does not exist" containerID="f5940e32e99ff5978bf7c0c68ec4e53323e82d66e9a85be740f84d7c60829691"
Jul 15 19:04:39.621191 ip-10-0-141-171 kubenswrapper[2567]: I0715 19:04:39.621132    2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f5940e32e99ff5978bf7c0c68ec4e53323e82d66e9a85be740f84d7c60829691"} err="failed to get container status \"f5940e32e99ff5978bf7c0c68ec4e53323e82d66e9a85be740f84d7c60829691\": rpc error: code = NotFound desc = could not find container \"f5940e32e99ff5978bf7c0c68ec4e53323e82d66e9a85be740f84d7c60829691\": container with ID starting with f5940e32e99ff5978bf7c0c68ec4e53323e82d66e9a85be740f84d7c60829691 not found: ID does not exist"
Jul 15 19:04:39.635897 ip-10-0-141-171 kubenswrapper[2567]: I0715 19:04:39.635873    2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-401e9f/rate-test-model-401e9f-kserve-f788f7bdc-nrn7q"]
Jul 15 19:04:39.643032 ip-10-0-141-171 kubenswrapper[2567]: I0715 19:04:39.643012    2567 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-a-401e9f/rate-test-model-401e9f-kserve-f788f7bdc-nrn7q"]
Jul 15 19:04:39.666921 ip-10-0-141-171 kubenswrapper[2567]: I0715 19:04:39.666899    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/3c919c72-cbe7-47f4-af75-6cca03706e06-dshm\") pod \"3c919c72-cbe7-47f4-af75-6cca03706e06\" (UID: \"3c919c72-cbe7-47f4-af75-6cca03706e06\") "
Jul 15 19:04:39.667011 ip-10-0-141-171 kubenswrapper[2567]: I0715 19:04:39.666966    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/3c919c72-cbe7-47f4-af75-6cca03706e06-home\") pod \"3c919c72-cbe7-47f4-af75-6cca03706e06\" (UID: \"3c919c72-cbe7-47f4-af75-6cca03706e06\") "
Jul 15 19:04:39.667056 ip-10-0-141-171 kubenswrapper[2567]: I0715 19:04:39.667011    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-q64lj\" (UniqueName: \"kubernetes.io/projected/3c919c72-cbe7-47f4-af75-6cca03706e06-kube-api-access-q64lj\") pod \"3c919c72-cbe7-47f4-af75-6cca03706e06\" (UID: \"3c919c72-cbe7-47f4-af75-6cca03706e06\") "
Jul 15 19:04:39.667163 ip-10-0-141-171 kubenswrapper[2567]: I0715 19:04:39.667099    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/3c919c72-cbe7-47f4-af75-6cca03706e06-model-cache\") pod \"3c919c72-cbe7-47f4-af75-6cca03706e06\" (UID: \"3c919c72-cbe7-47f4-af75-6cca03706e06\") "
Jul 15 19:04:39.667163 ip-10-0-141-171 kubenswrapper[2567]: I0715 19:04:39.667128    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/3c919c72-cbe7-47f4-af75-6cca03706e06-tmp-dir\") pod \"3c919c72-cbe7-47f4-af75-6cca03706e06\" (UID: \"3c919c72-cbe7-47f4-af75-6cca03706e06\") "
Jul 15 19:04:39.667298 ip-10-0-141-171 kubenswrapper[2567]: I0715 19:04:39.667175    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/3c919c72-cbe7-47f4-af75-6cca03706e06-tls-certs\") pod \"3c919c72-cbe7-47f4-af75-6cca03706e06\" (UID: \"3c919c72-cbe7-47f4-af75-6cca03706e06\") "
Jul 15 19:04:39.667473 ip-10-0-141-171 kubenswrapper[2567]: I0715 19:04:39.667172    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3c919c72-cbe7-47f4-af75-6cca03706e06-home" (OuterVolumeSpecName: "home") pod "3c919c72-cbe7-47f4-af75-6cca03706e06" (UID: "3c919c72-cbe7-47f4-af75-6cca03706e06"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 15 19:04:39.667473 ip-10-0-141-171 kubenswrapper[2567]: I0715 19:04:39.667380    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3c919c72-cbe7-47f4-af75-6cca03706e06-model-cache" (OuterVolumeSpecName: "model-cache") pod "3c919c72-cbe7-47f4-af75-6cca03706e06" (UID: "3c919c72-cbe7-47f4-af75-6cca03706e06"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 15 19:04:39.667473 ip-10-0-141-171 kubenswrapper[2567]: I0715 19:04:39.667389    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3c919c72-cbe7-47f4-af75-6cca03706e06-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "3c919c72-cbe7-47f4-af75-6cca03706e06" (UID: "3c919c72-cbe7-47f4-af75-6cca03706e06"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 15 19:04:39.667689 ip-10-0-141-171 kubenswrapper[2567]: I0715 19:04:39.667576    2567 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/3c919c72-cbe7-47f4-af75-6cca03706e06-model-cache\") on node \"ip-10-0-141-171.ec2.internal\" DevicePath \"\""
Jul 15 19:04:39.667689 ip-10-0-141-171 kubenswrapper[2567]: I0715 19:04:39.667606    2567 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/3c919c72-cbe7-47f4-af75-6cca03706e06-tmp-dir\") on node \"ip-10-0-141-171.ec2.internal\" DevicePath \"\""
Jul 15 19:04:39.667689 ip-10-0-141-171 kubenswrapper[2567]: I0715 19:04:39.667619    2567 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/3c919c72-cbe7-47f4-af75-6cca03706e06-home\") on node \"ip-10-0-141-171.ec2.internal\" DevicePath \"\""
Jul 15 19:04:39.669044 ip-10-0-141-171 kubenswrapper[2567]: I0715 19:04:39.669024    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3c919c72-cbe7-47f4-af75-6cca03706e06-dshm" (OuterVolumeSpecName: "dshm") pod "3c919c72-cbe7-47f4-af75-6cca03706e06" (UID: "3c919c72-cbe7-47f4-af75-6cca03706e06"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 15 19:04:39.669128 ip-10-0-141-171 kubenswrapper[2567]: I0715 19:04:39.669102    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3c919c72-cbe7-47f4-af75-6cca03706e06-kube-api-access-q64lj" (OuterVolumeSpecName: "kube-api-access-q64lj") pod "3c919c72-cbe7-47f4-af75-6cca03706e06" (UID: "3c919c72-cbe7-47f4-af75-6cca03706e06"). InnerVolumeSpecName "kube-api-access-q64lj". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 15 19:04:39.669175 ip-10-0-141-171 kubenswrapper[2567]: I0715 19:04:39.669141    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3c919c72-cbe7-47f4-af75-6cca03706e06-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "3c919c72-cbe7-47f4-af75-6cca03706e06" (UID: "3c919c72-cbe7-47f4-af75-6cca03706e06"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 15 19:04:39.768549 ip-10-0-141-171 kubenswrapper[2567]: I0715 19:04:39.768520    2567 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/3c919c72-cbe7-47f4-af75-6cca03706e06-tls-certs\") on node \"ip-10-0-141-171.ec2.internal\" DevicePath \"\""
Jul 15 19:04:39.768549 ip-10-0-141-171 kubenswrapper[2567]: I0715 19:04:39.768545    2567 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/3c919c72-cbe7-47f4-af75-6cca03706e06-dshm\") on node \"ip-10-0-141-171.ec2.internal\" DevicePath \"\""
Jul 15 19:04:39.768549 ip-10-0-141-171 kubenswrapper[2567]: I0715 19:04:39.768554    2567 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-q64lj\" (UniqueName: \"kubernetes.io/projected/3c919c72-cbe7-47f4-af75-6cca03706e06-kube-api-access-q64lj\") on node \"ip-10-0-141-171.ec2.internal\" DevicePath \"\""
Jul 15 19:04:39.931768 ip-10-0-141-171 kubenswrapper[2567]: I0715 19:04:39.931738    2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-46e17a/rate-test-model-46e17a-kserve-5cd589fc99-g2cm9"]
Jul 15 19:04:39.936173 ip-10-0-141-171 kubenswrapper[2567]: I0715 19:04:39.936146    2567 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-b-46e17a/rate-test-model-46e17a-kserve-5cd589fc99-g2cm9"]
Jul 15 19:04:40.207320 ip-10-0-141-171 kubenswrapper[2567]: I0715 19:04:40.207287    2567 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="30008554-207c-4711-b65d-436ebdbbf664" path="/var/lib/kubelet/pods/30008554-207c-4711-b65d-436ebdbbf664/volumes"
Jul 15 19:04:40.207781 ip-10-0-141-171 kubenswrapper[2567]: I0715 19:04:40.207763    2567 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="3c919c72-cbe7-47f4-af75-6cca03706e06" path="/var/lib/kubelet/pods/3c919c72-cbe7-47f4-af75-6cca03706e06/volumes"
Jul 15 19:04:40.981149 ip-10-0-141-171 kubenswrapper[2567]: I0715 19:04:40.981113    2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/test-curl-7130-140263871201120"]
Jul 15 19:04:40.981552 ip-10-0-141-171 kubenswrapper[2567]: I0715 19:04:40.981539    2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3c919c72-cbe7-47f4-af75-6cca03706e06" containerName="main"
Jul 15 19:04:40.981599 ip-10-0-141-171 kubenswrapper[2567]: I0715 19:04:40.981554    2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="3c919c72-cbe7-47f4-af75-6cca03706e06" containerName="main"
Jul 15 19:04:40.981599 ip-10-0-141-171 kubenswrapper[2567]: I0715 19:04:40.981569    2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="30008554-207c-4711-b65d-436ebdbbf664" containerName="main"
Jul 15 19:04:40.981599 ip-10-0-141-171 kubenswrapper[2567]: I0715 19:04:40.981575    2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="30008554-207c-4711-b65d-436ebdbbf664" containerName="main"
Jul 15 19:04:40.981690 ip-10-0-141-171 kubenswrapper[2567]: I0715 19:04:40.981631    2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="30008554-207c-4711-b65d-436ebdbbf664" containerName="main"
Jul 15 19:04:40.981690 ip-10-0-141-171 kubenswrapper[2567]: I0715 19:04:40.981645    2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="3c919c72-cbe7-47f4-af75-6cca03706e06" containerName="main"
Jul 15 19:04:40.986016 ip-10-0-141-171 kubenswrapper[2567]: I0715 19:04:40.985996    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7130-140263871201120"
Jul 15 19:04:40.988829 ip-10-0-141-171 kubenswrapper[2567]: I0715 19:04:40.988803    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"default-dockercfg-trk8x\""
Jul 15 19:04:40.990203 ip-10-0-141-171 kubenswrapper[2567]: I0715 19:04:40.990180    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7130-140263871201120"]
Jul 15 19:04:41.081085 ip-10-0-141-171 kubenswrapper[2567]: I0715 19:04:41.081050    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-l98vr\" (UniqueName: \"kubernetes.io/projected/9f492a30-e3e9-482e-a8bb-79db0fdd195f-kube-api-access-l98vr\") pod \"test-curl-7130-140263871201120\" (UID: \"9f492a30-e3e9-482e-a8bb-79db0fdd195f\") " pod="opendatahub/test-curl-7130-140263871201120"
Jul 15 19:04:41.182583 ip-10-0-141-171 kubenswrapper[2567]: I0715 19:04:41.182546    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-l98vr\" (UniqueName: \"kubernetes.io/projected/9f492a30-e3e9-482e-a8bb-79db0fdd195f-kube-api-access-l98vr\") pod \"test-curl-7130-140263871201120\" (UID: \"9f492a30-e3e9-482e-a8bb-79db0fdd195f\") " pod="opendatahub/test-curl-7130-140263871201120"
Jul 15 19:04:41.196636 ip-10-0-141-171 kubenswrapper[2567]: I0715 19:04:41.196610    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-l98vr\" (UniqueName: \"kubernetes.io/projected/9f492a30-e3e9-482e-a8bb-79db0fdd195f-kube-api-access-l98vr\") pod \"test-curl-7130-140263871201120\" (UID: \"9f492a30-e3e9-482e-a8bb-79db0fdd195f\") " pod="opendatahub/test-curl-7130-140263871201120"
Jul 15 19:04:41.296438 ip-10-0-141-171 kubenswrapper[2567]: I0715 19:04:41.296350    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7130-140263871201120"
Jul 15 19:04:41.448669 ip-10-0-141-171 kubenswrapper[2567]: I0715 19:04:41.448641    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7130-140263871201120"]
Jul 15 19:04:41.451394 ip-10-0-141-171 kubenswrapper[2567]: W0715 19:04:41.451364    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod9f492a30_e3e9_482e_a8bb_79db0fdd195f.slice/crio-ecee4b8832ebef94323d9344dbfa0336a588f125236ea5b59ef428ef68ce4f19 WatchSource:0}: Error finding container ecee4b8832ebef94323d9344dbfa0336a588f125236ea5b59ef428ef68ce4f19: Status 404 returned error can't find the container with id ecee4b8832ebef94323d9344dbfa0336a588f125236ea5b59ef428ef68ce4f19
Jul 15 19:04:41.452698 ip-10-0-141-171 kubenswrapper[2567]: I0715 19:04:41.452679    2567 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 15 19:04:41.617875 ip-10-0-141-171 kubenswrapper[2567]: I0715 19:04:41.617793    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7130-140263871201120" event={"ID":"9f492a30-e3e9-482e-a8bb-79db0fdd195f","Type":"ContainerStarted","Data":"ecee4b8832ebef94323d9344dbfa0336a588f125236ea5b59ef428ef68ce4f19"}
Jul 15 19:04:42.623720 ip-10-0-141-171 kubenswrapper[2567]: I0715 19:04:42.623678    2567 generic.go:356] "Generic (PLEG): container finished" podID="9f492a30-e3e9-482e-a8bb-79db0fdd195f" containerID="c70476cb1d5adc9964ba3e1a45e14666d342d33f25e1970c2244d045dcbfbb91" exitCode=0
Jul 15 19:04:42.624111 ip-10-0-141-171 kubenswrapper[2567]: I0715 19:04:42.623727    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7130-140263871201120" event={"ID":"9f492a30-e3e9-482e-a8bb-79db0fdd195f","Type":"ContainerDied","Data":"c70476cb1d5adc9964ba3e1a45e14666d342d33f25e1970c2244d045dcbfbb91"}
Jul 15 19:04:43.758549 ip-10-0-141-171 kubenswrapper[2567]: I0715 19:04:43.758518    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7130-140263871201120"
Jul 15 19:04:43.810667 ip-10-0-141-171 kubenswrapper[2567]: I0715 19:04:43.810640    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_test-curl-7130-140263871201120_9f492a30-e3e9-482e-a8bb-79db0fdd195f/test-curl-7130-140263871201120/0.log"
Jul 15 19:04:43.837251 ip-10-0-141-171 kubenswrapper[2567]: I0715 19:04:43.837199    2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/test-curl-7130-140263871201120"]
Jul 15 19:04:43.843129 ip-10-0-141-171 kubenswrapper[2567]: I0715 19:04:43.843102    2567 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/test-curl-7130-140263871201120"]
Jul 15 19:04:43.907285 ip-10-0-141-171 kubenswrapper[2567]: I0715 19:04:43.907176    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-l98vr\" (UniqueName: \"kubernetes.io/projected/9f492a30-e3e9-482e-a8bb-79db0fdd195f-kube-api-access-l98vr\") pod \"9f492a30-e3e9-482e-a8bb-79db0fdd195f\" (UID: \"9f492a30-e3e9-482e-a8bb-79db0fdd195f\") "
Jul 15 19:04:43.909241 ip-10-0-141-171 kubenswrapper[2567]: I0715 19:04:43.909208    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9f492a30-e3e9-482e-a8bb-79db0fdd195f-kube-api-access-l98vr" (OuterVolumeSpecName: "kube-api-access-l98vr") pod "9f492a30-e3e9-482e-a8bb-79db0fdd195f" (UID: "9f492a30-e3e9-482e-a8bb-79db0fdd195f"). InnerVolumeSpecName "kube-api-access-l98vr". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 15 19:04:44.008296 ip-10-0-141-171 kubenswrapper[2567]: I0715 19:04:44.008266    2567 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-l98vr\" (UniqueName: \"kubernetes.io/projected/9f492a30-e3e9-482e-a8bb-79db0fdd195f-kube-api-access-l98vr\") on node \"ip-10-0-141-171.ec2.internal\" DevicePath \"\""
Jul 15 19:04:44.206211 ip-10-0-141-171 kubenswrapper[2567]: I0715 19:04:44.206177    2567 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="9f492a30-e3e9-482e-a8bb-79db0fdd195f" path="/var/lib/kubelet/pods/9f492a30-e3e9-482e-a8bb-79db0fdd195f/volumes"
Jul 15 19:04:44.635802 ip-10-0-141-171 kubenswrapper[2567]: I0715 19:04:44.635728    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7130-140263871201120"
Jul 15 19:04:44.635964 ip-10-0-141-171 kubenswrapper[2567]: I0715 19:04:44.635740    2567 scope.go:117] "RemoveContainer" containerID="c70476cb1d5adc9964ba3e1a45e14666d342d33f25e1970c2244d045dcbfbb91"
Jul 15 19:04:57.983810 ip-10-0-141-171 kubenswrapper[2567]: I0715 19:04:57.983775    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-qfldk"]
Jul 15 19:05:23.990807 ip-10-0-141-171 kubenswrapper[2567]: I0715 19:05:23.990773    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-qfldk"]
Jul 15 19:05:43.080614 ip-10-0-141-171 kubenswrapper[2567]: I0715 19:05:43.080586    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-5664889d69-ljx6h_b41427bd-3d8d-433b-9332-d2460acd529c/copy-manifests/0.log"
Jul 15 19:05:43.088114 ip-10-0-141-171 kubenswrapper[2567]: I0715 19:05:43.088091    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-5664889d69-ljx6h_b41427bd-3d8d-433b-9332-d2460acd529c/manager/0.log"
Jul 15 19:05:45.595905 ip-10-0-141-171 kubenswrapper[2567]: I0715 19:05:45.595869    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_postgres-69fb4594cf-z8rt8_b6f7a534-ecf3-45db-bebc-7e252380e96a/postgres/0.log"
Jul 15 19:05:47.726671 ip-10-0-141-171 kubenswrapper[2567]: I0715 19:05:47.726641    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-limitador-54d6d988d5-qfldk_b0193733-3432-4db9-a6c8-bbd85c79b008/limitador/0.log"
Jul 15 19:05:48.613823 ip-10-0-141-171 kubenswrapper[2567]: I0715 19:05:48.613785    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-6b5bc7bcd6-nk57w_dd26deef-9d7b-471d-b0e1-2838c9312d58/kube-auth-proxy/0.log"
Jul 15 19:05:48.992406 ip-10-0-141-171 kubenswrapper[2567]: I0715 19:05:48.992376    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-f9b8d9b9b-v4h87_cd1168ac-c1c1-42cb-b2db-e8f131953d09/payload-processing/0.log"
Jul 15 19:05:49.466676 ip-10-0-141-171 kubenswrapper[2567]: I0715 19:05:49.466640    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-2-simulated-kserve-67d8d5d6d-hx59b_02224416-06a1-4e11-9118-a870806b6b4a/main/0.log"
Jul 15 19:05:49.947962 ip-10-0-141-171 kubenswrapper[2567]: I0715 19:05:49.947911    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_facebook-opt-125m-simulated-kserve-74b68447df-gscwq_4b1c2131-5398-4439-ad7f-3ce983468768/main/0.log"
Jul 15 19:05:50.068401 ip-10-0-141-171 kubenswrapper[2567]: I0715 19:05:50.068377    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_premium-simulated-simulated-premium-kserve-5fc6fb456f-2htj2_6dec4d6e-b17a-4bba-a8fd-4488c7c2da0f/main/0.log"
Jul 15 19:05:59.557770 ip-10-0-141-171 kubenswrapper[2567]: I0715 19:05:59.557735    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-dqncz_0d941f69-52de-4bf3-b262-9d9e07d9d730/global-pull-secret-syncer/0.log"
Jul 15 19:05:59.650385 ip-10-0-141-171 kubenswrapper[2567]: I0715 19:05:59.650354    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-t2vtv_fd1b71f3-89f1-4883-82f3-ba2ea2037bd1/konnectivity-agent/0.log"
Jul 15 19:05:59.792688 ip-10-0-141-171 kubenswrapper[2567]: I0715 19:05:59.792641    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-141-171.ec2.internal_5ba27ba9c439859b7fde96be83dd7679/haproxy/0.log"
Jul 15 19:06:05.379180 ip-10-0-141-171 kubenswrapper[2567]: I0715 19:06:05.379139    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-limitador-54d6d988d5-qfldk_b0193733-3432-4db9-a6c8-bbd85c79b008/limitador/0.log"
Jul 15 19:06:07.018456 ip-10-0-141-171 kubenswrapper[2567]: I0715 19:06:07.018417    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_0a3d2b71-dc31-4a25-ad7f-89bf188082f4/alertmanager/0.log"
Jul 15 19:06:07.050412 ip-10-0-141-171 kubenswrapper[2567]: I0715 19:06:07.050363    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_0a3d2b71-dc31-4a25-ad7f-89bf188082f4/config-reloader/0.log"
Jul 15 19:06:07.091212 ip-10-0-141-171 kubenswrapper[2567]: I0715 19:06:07.091169    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_0a3d2b71-dc31-4a25-ad7f-89bf188082f4/kube-rbac-proxy-web/0.log"
Jul 15 19:06:07.116611 ip-10-0-141-171 kubenswrapper[2567]: I0715 19:06:07.116586    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_0a3d2b71-dc31-4a25-ad7f-89bf188082f4/kube-rbac-proxy/0.log"
Jul 15 19:06:07.144754 ip-10-0-141-171 kubenswrapper[2567]: I0715 19:06:07.144694    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_0a3d2b71-dc31-4a25-ad7f-89bf188082f4/kube-rbac-proxy-metric/0.log"
Jul 15 19:06:07.171471 ip-10-0-141-171 kubenswrapper[2567]: I0715 19:06:07.171441    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_0a3d2b71-dc31-4a25-ad7f-89bf188082f4/prom-label-proxy/0.log"
Jul 15 19:06:07.195687 ip-10-0-141-171 kubenswrapper[2567]: I0715 19:06:07.195664    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_0a3d2b71-dc31-4a25-ad7f-89bf188082f4/init-config-reloader/0.log"
Jul 15 19:06:07.273961 ip-10-0-141-171 kubenswrapper[2567]: I0715 19:06:07.273934    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-785778ff74-mvdt9_e60f42cb-1b48-4897-b7f4-422ce77e048c/kube-state-metrics/0.log"
Jul 15 19:06:07.299284 ip-10-0-141-171 kubenswrapper[2567]: I0715 19:06:07.299263    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-785778ff74-mvdt9_e60f42cb-1b48-4897-b7f4-422ce77e048c/kube-rbac-proxy-main/0.log"
Jul 15 19:06:07.323599 ip-10-0-141-171 kubenswrapper[2567]: I0715 19:06:07.323577    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-785778ff74-mvdt9_e60f42cb-1b48-4897-b7f4-422ce77e048c/kube-rbac-proxy-self/0.log"
Jul 15 19:06:07.348635 ip-10-0-141-171 kubenswrapper[2567]: I0715 19:06:07.348615    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_metrics-server-5d5c95d576-cgbcs_0b3aa63d-db37-403b-b6ce-0786a746f07a/metrics-server/0.log"
Jul 15 19:06:07.385972 ip-10-0-141-171 kubenswrapper[2567]: I0715 19:06:07.385937    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_monitoring-plugin-5f68df7f58-8wt6r_fe6de8a4-feae-4c63-92e9-882042af5ece/monitoring-plugin/0.log"
Jul 15 19:06:07.574888 ip-10-0-141-171 kubenswrapper[2567]: I0715 19:06:07.574861    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-zhfjg_77a85f70-62db-476e-8397-ee0759a55745/node-exporter/0.log"
Jul 15 19:06:07.599494 ip-10-0-141-171 kubenswrapper[2567]: I0715 19:06:07.599449    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-zhfjg_77a85f70-62db-476e-8397-ee0759a55745/kube-rbac-proxy/0.log"
Jul 15 19:06:07.620536 ip-10-0-141-171 kubenswrapper[2567]: I0715 19:06:07.620518    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-zhfjg_77a85f70-62db-476e-8397-ee0759a55745/init-textfile/0.log"
Jul 15 19:06:07.659100 ip-10-0-141-171 kubenswrapper[2567]: I0715 19:06:07.659077    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-84bd68b896-r78xl_16717ecb-2c1e-4b6f-be6f-c02162eb178d/kube-rbac-proxy-main/0.log"
Jul 15 19:06:07.683720 ip-10-0-141-171 kubenswrapper[2567]: I0715 19:06:07.683700    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-84bd68b896-r78xl_16717ecb-2c1e-4b6f-be6f-c02162eb178d/kube-rbac-proxy-self/0.log"
Jul 15 19:06:07.708202 ip-10-0-141-171 kubenswrapper[2567]: I0715 19:06:07.708182    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-84bd68b896-r78xl_16717ecb-2c1e-4b6f-be6f-c02162eb178d/openshift-state-metrics/0.log"
Jul 15 19:06:07.745775 ip-10-0-141-171 kubenswrapper[2567]: I0715 19:06:07.745738    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_bbd39087-922a-489c-8bd8-aa6cd503d786/prometheus/0.log"
Jul 15 19:06:07.769576 ip-10-0-141-171 kubenswrapper[2567]: I0715 19:06:07.769558    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_bbd39087-922a-489c-8bd8-aa6cd503d786/config-reloader/0.log"
Jul 15 19:06:07.795153 ip-10-0-141-171 kubenswrapper[2567]: I0715 19:06:07.795127    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_bbd39087-922a-489c-8bd8-aa6cd503d786/thanos-sidecar/0.log"
Jul 15 19:06:07.817662 ip-10-0-141-171 kubenswrapper[2567]: I0715 19:06:07.817645    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_bbd39087-922a-489c-8bd8-aa6cd503d786/kube-rbac-proxy-web/0.log"
Jul 15 19:06:07.840457 ip-10-0-141-171 kubenswrapper[2567]: I0715 19:06:07.840383    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_bbd39087-922a-489c-8bd8-aa6cd503d786/kube-rbac-proxy/0.log"
Jul 15 19:06:07.907561 ip-10-0-141-171 kubenswrapper[2567]: I0715 19:06:07.907517    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_bbd39087-922a-489c-8bd8-aa6cd503d786/kube-rbac-proxy-thanos/0.log"
Jul 15 19:06:07.969684 ip-10-0-141-171 kubenswrapper[2567]: I0715 19:06:07.969639    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_bbd39087-922a-489c-8bd8-aa6cd503d786/init-config-reloader/0.log"
Jul 15 19:06:08.024854 ip-10-0-141-171 kubenswrapper[2567]: I0715 19:06:08.024826    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-64785b6675-8bzcj_54e8b5c7-e4da-44a2-ac80-0dc7ef91a6b9/prometheus-operator/0.log"
Jul 15 19:06:08.056350 ip-10-0-141-171 kubenswrapper[2567]: I0715 19:06:08.056301    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-64785b6675-8bzcj_54e8b5c7-e4da-44a2-ac80-0dc7ef91a6b9/kube-rbac-proxy/0.log"
Jul 15 19:06:08.083682 ip-10-0-141-171 kubenswrapper[2567]: I0715 19:06:08.083657    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-admission-webhook-77d98bc786-5c44d_79788eb3-58b1-498f-ade3-3b7ab47b0c85/prometheus-operator-admission-webhook/0.log"
Jul 15 19:06:08.207102 ip-10-0-141-171 kubenswrapper[2567]: I0715 19:06:08.207065    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-6f66584585-8nvch_58b027cc-0443-48c9-813b-7fbbd36a68c0/thanos-query/0.log"
Jul 15 19:06:08.228466 ip-10-0-141-171 kubenswrapper[2567]: I0715 19:06:08.228443    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-6f66584585-8nvch_58b027cc-0443-48c9-813b-7fbbd36a68c0/kube-rbac-proxy-web/0.log"
Jul 15 19:06:08.250474 ip-10-0-141-171 kubenswrapper[2567]: I0715 19:06:08.250451    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-6f66584585-8nvch_58b027cc-0443-48c9-813b-7fbbd36a68c0/kube-rbac-proxy/0.log"
Jul 15 19:06:08.290434 ip-10-0-141-171 kubenswrapper[2567]: I0715 19:06:08.290406    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-6f66584585-8nvch_58b027cc-0443-48c9-813b-7fbbd36a68c0/prom-label-proxy/0.log"
Jul 15 19:06:08.313122 ip-10-0-141-171 kubenswrapper[2567]: I0715 19:06:08.313100    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-6f66584585-8nvch_58b027cc-0443-48c9-813b-7fbbd36a68c0/kube-rbac-proxy-rules/0.log"
Jul 15 19:06:08.336800 ip-10-0-141-171 kubenswrapper[2567]: I0715 19:06:08.336744    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-6f66584585-8nvch_58b027cc-0443-48c9-813b-7fbbd36a68c0/kube-rbac-proxy-metrics/0.log"
Jul 15 19:06:09.842979 ip-10-0-141-171 kubenswrapper[2567]: I0715 19:06:09.842948    2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-858dh/perf-node-gather-daemonset-5whd5"]
Jul 15 19:06:09.843403 ip-10-0-141-171 kubenswrapper[2567]: I0715 19:06:09.843365    2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9f492a30-e3e9-482e-a8bb-79db0fdd195f" containerName="test-curl-7130-140263871201120"
Jul 15 19:06:09.843403 ip-10-0-141-171 kubenswrapper[2567]: I0715 19:06:09.843377    2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="9f492a30-e3e9-482e-a8bb-79db0fdd195f" containerName="test-curl-7130-140263871201120"
Jul 15 19:06:09.843484 ip-10-0-141-171 kubenswrapper[2567]: I0715 19:06:09.843428    2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="9f492a30-e3e9-482e-a8bb-79db0fdd195f" containerName="test-curl-7130-140263871201120"
Jul 15 19:06:09.846681 ip-10-0-141-171 kubenswrapper[2567]: I0715 19:06:09.846660    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-858dh/perf-node-gather-daemonset-5whd5"
Jul 15 19:06:09.852350 ip-10-0-141-171 kubenswrapper[2567]: I0715 19:06:09.852330    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-858dh\"/\"kube-root-ca.crt\""
Jul 15 19:06:09.853374 ip-10-0-141-171 kubenswrapper[2567]: I0715 19:06:09.853349    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-858dh\"/\"default-dockercfg-td7m4\""
Jul 15 19:06:09.853575 ip-10-0-141-171 kubenswrapper[2567]: I0715 19:06:09.853552    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-858dh\"/\"openshift-service-ca.crt\""
Jul 15 19:06:09.864100 ip-10-0-141-171 kubenswrapper[2567]: I0715 19:06:09.864074    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-858dh/perf-node-gather-daemonset-5whd5"]
Jul 15 19:06:09.980587 ip-10-0-141-171 kubenswrapper[2567]: I0715 19:06:09.980550    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/a25ef565-9027-4545-b547-70f18b8c9244-proc\") pod \"perf-node-gather-daemonset-5whd5\" (UID: \"a25ef565-9027-4545-b547-70f18b8c9244\") " pod="openshift-must-gather-858dh/perf-node-gather-daemonset-5whd5"
Jul 15 19:06:09.980785 ip-10-0-141-171 kubenswrapper[2567]: I0715 19:06:09.980610    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/a25ef565-9027-4545-b547-70f18b8c9244-sys\") pod \"perf-node-gather-daemonset-5whd5\" (UID: \"a25ef565-9027-4545-b547-70f18b8c9244\") " pod="openshift-must-gather-858dh/perf-node-gather-daemonset-5whd5"
Jul 15 19:06:09.980785 ip-10-0-141-171 kubenswrapper[2567]: I0715 19:06:09.980669    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/a25ef565-9027-4545-b547-70f18b8c9244-lib-modules\") pod \"perf-node-gather-daemonset-5whd5\" (UID: \"a25ef565-9027-4545-b547-70f18b8c9244\") " pod="openshift-must-gather-858dh/perf-node-gather-daemonset-5whd5"
Jul 15 19:06:09.980785 ip-10-0-141-171 kubenswrapper[2567]: I0715 19:06:09.980759    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/a25ef565-9027-4545-b547-70f18b8c9244-podres\") pod \"perf-node-gather-daemonset-5whd5\" (UID: \"a25ef565-9027-4545-b547-70f18b8c9244\") " pod="openshift-must-gather-858dh/perf-node-gather-daemonset-5whd5"
Jul 15 19:06:09.980939 ip-10-0-141-171 kubenswrapper[2567]: I0715 19:06:09.980804    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-c8sfl\" (UniqueName: \"kubernetes.io/projected/a25ef565-9027-4545-b547-70f18b8c9244-kube-api-access-c8sfl\") pod \"perf-node-gather-daemonset-5whd5\" (UID: \"a25ef565-9027-4545-b547-70f18b8c9244\") " pod="openshift-must-gather-858dh/perf-node-gather-daemonset-5whd5"
Jul 15 19:06:10.082060 ip-10-0-141-171 kubenswrapper[2567]: I0715 19:06:10.082030    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/a25ef565-9027-4545-b547-70f18b8c9244-proc\") pod \"perf-node-gather-daemonset-5whd5\" (UID: \"a25ef565-9027-4545-b547-70f18b8c9244\") " pod="openshift-must-gather-858dh/perf-node-gather-daemonset-5whd5"
Jul 15 19:06:10.082292 ip-10-0-141-171 kubenswrapper[2567]: I0715 19:06:10.082083    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/a25ef565-9027-4545-b547-70f18b8c9244-sys\") pod \"perf-node-gather-daemonset-5whd5\" (UID: \"a25ef565-9027-4545-b547-70f18b8c9244\") " pod="openshift-must-gather-858dh/perf-node-gather-daemonset-5whd5"
Jul 15 19:06:10.082292 ip-10-0-141-171 kubenswrapper[2567]: I0715 19:06:10.082121    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/a25ef565-9027-4545-b547-70f18b8c9244-lib-modules\") pod \"perf-node-gather-daemonset-5whd5\" (UID: \"a25ef565-9027-4545-b547-70f18b8c9244\") " pod="openshift-must-gather-858dh/perf-node-gather-daemonset-5whd5"
Jul 15 19:06:10.082292 ip-10-0-141-171 kubenswrapper[2567]: I0715 19:06:10.082162    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/a25ef565-9027-4545-b547-70f18b8c9244-podres\") pod \"perf-node-gather-daemonset-5whd5\" (UID: \"a25ef565-9027-4545-b547-70f18b8c9244\") " pod="openshift-must-gather-858dh/perf-node-gather-daemonset-5whd5"
Jul 15 19:06:10.082292 ip-10-0-141-171 kubenswrapper[2567]: I0715 19:06:10.082164    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/a25ef565-9027-4545-b547-70f18b8c9244-proc\") pod \"perf-node-gather-daemonset-5whd5\" (UID: \"a25ef565-9027-4545-b547-70f18b8c9244\") " pod="openshift-must-gather-858dh/perf-node-gather-daemonset-5whd5"
Jul 15 19:06:10.082292 ip-10-0-141-171 kubenswrapper[2567]: I0715 19:06:10.082181    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-c8sfl\" (UniqueName: \"kubernetes.io/projected/a25ef565-9027-4545-b547-70f18b8c9244-kube-api-access-c8sfl\") pod \"perf-node-gather-daemonset-5whd5\" (UID: \"a25ef565-9027-4545-b547-70f18b8c9244\") " pod="openshift-must-gather-858dh/perf-node-gather-daemonset-5whd5"
Jul 15 19:06:10.082292 ip-10-0-141-171 kubenswrapper[2567]: I0715 19:06:10.082252    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/a25ef565-9027-4545-b547-70f18b8c9244-sys\") pod \"perf-node-gather-daemonset-5whd5\" (UID: \"a25ef565-9027-4545-b547-70f18b8c9244\") " pod="openshift-must-gather-858dh/perf-node-gather-daemonset-5whd5"
Jul 15 19:06:10.082513 ip-10-0-141-171 kubenswrapper[2567]: I0715 19:06:10.082308    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/a25ef565-9027-4545-b547-70f18b8c9244-lib-modules\") pod \"perf-node-gather-daemonset-5whd5\" (UID: \"a25ef565-9027-4545-b547-70f18b8c9244\") " pod="openshift-must-gather-858dh/perf-node-gather-daemonset-5whd5"
Jul 15 19:06:10.082513 ip-10-0-141-171 kubenswrapper[2567]: I0715 19:06:10.082311    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/a25ef565-9027-4545-b547-70f18b8c9244-podres\") pod \"perf-node-gather-daemonset-5whd5\" (UID: \"a25ef565-9027-4545-b547-70f18b8c9244\") " pod="openshift-must-gather-858dh/perf-node-gather-daemonset-5whd5"
Jul 15 19:06:10.089831 ip-10-0-141-171 kubenswrapper[2567]: I0715 19:06:10.089800    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-c8sfl\" (UniqueName: \"kubernetes.io/projected/a25ef565-9027-4545-b547-70f18b8c9244-kube-api-access-c8sfl\") pod \"perf-node-gather-daemonset-5whd5\" (UID: \"a25ef565-9027-4545-b547-70f18b8c9244\") " pod="openshift-must-gather-858dh/perf-node-gather-daemonset-5whd5"
Jul 15 19:06:10.156910 ip-10-0-141-171 kubenswrapper[2567]: I0715 19:06:10.156853    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-858dh/perf-node-gather-daemonset-5whd5"
Jul 15 19:06:10.290762 ip-10-0-141-171 kubenswrapper[2567]: I0715 19:06:10.290738    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-858dh/perf-node-gather-daemonset-5whd5"]
Jul 15 19:06:10.293137 ip-10-0-141-171 kubenswrapper[2567]: W0715 19:06:10.293109    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-poda25ef565_9027_4545_b547_70f18b8c9244.slice/crio-7a8a9b009d5549393c98243da3198f9102fddc1941cd5c22ed23f9e1e977593d WatchSource:0}: Error finding container 7a8a9b009d5549393c98243da3198f9102fddc1941cd5c22ed23f9e1e977593d: Status 404 returned error can't find the container with id 7a8a9b009d5549393c98243da3198f9102fddc1941cd5c22ed23f9e1e977593d
Jul 15 19:06:10.593046 ip-10-0-141-171 kubenswrapper[2567]: I0715 19:06:10.593015    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-78f8879b76-mj5hs_7891829b-6ded-4135-8675-a7afc0021eee/console/0.log"
Jul 15 19:06:11.037612 ip-10-0-141-171 kubenswrapper[2567]: I0715 19:06:11.037576    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-858dh/perf-node-gather-daemonset-5whd5" event={"ID":"a25ef565-9027-4545-b547-70f18b8c9244","Type":"ContainerStarted","Data":"3f46a1426b7b7861a469263fd5b38d56880ddd9066847ea43d223d57f9fe36fe"}
Jul 15 19:06:11.037971 ip-10-0-141-171 kubenswrapper[2567]: I0715 19:06:11.037625    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-858dh/perf-node-gather-daemonset-5whd5" event={"ID":"a25ef565-9027-4545-b547-70f18b8c9244","Type":"ContainerStarted","Data":"7a8a9b009d5549393c98243da3198f9102fddc1941cd5c22ed23f9e1e977593d"}
Jul 15 19:06:11.037971 ip-10-0-141-171 kubenswrapper[2567]: I0715 19:06:11.037744    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-858dh/perf-node-gather-daemonset-5whd5"
Jul 15 19:06:11.057101 ip-10-0-141-171 kubenswrapper[2567]: I0715 19:06:11.057049    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-858dh/perf-node-gather-daemonset-5whd5" podStartSLOduration=2.057034134 podStartE2EDuration="2.057034134s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-15 19:06:09 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 19:06:11.05469403 +0000 UTC m=+2929.589117409" watchObservedRunningTime="2026-07-15 19:06:11.057034134 +0000 UTC m=+2929.591457489"
Jul 15 19:06:12.211840 ip-10-0-141-171 kubenswrapper[2567]: I0715 19:06:12.211809    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-mhp9p_e3c4d1b4-5f66-4bdb-be2f-e9287585ab2c/dns/0.log"
Jul 15 19:06:12.236242 ip-10-0-141-171 kubenswrapper[2567]: I0715 19:06:12.236202    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-mhp9p_e3c4d1b4-5f66-4bdb-be2f-e9287585ab2c/kube-rbac-proxy/0.log"
Jul 15 19:06:12.390045 ip-10-0-141-171 kubenswrapper[2567]: I0715 19:06:12.390009    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-8d7kq_c7dc99b8-7a42-4f46-8de8-5c36675675da/dns-node-resolver/0.log"
Jul 15 19:06:12.974804 ip-10-0-141-171 kubenswrapper[2567]: I0715 19:06:12.974774    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-6qkk4_836f3165-610d-469b-ba6f-773aad82bf92/node-ca/0.log"
Jul 15 19:06:14.241547 ip-10-0-141-171 kubenswrapper[2567]: I0715 19:06:14.241519    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-6b5bc7bcd6-nk57w_dd26deef-9d7b-471d-b0e1-2838c9312d58/kube-auth-proxy/0.log"
Jul 15 19:06:14.381224 ip-10-0-141-171 kubenswrapper[2567]: I0715 19:06:14.381192    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-f9b8d9b9b-v4h87_cd1168ac-c1c1-42cb-b2db-e8f131953d09/payload-processing/0.log"
Jul 15 19:06:15.151757 ip-10-0-141-171 kubenswrapper[2567]: I0715 19:06:15.151727    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-qnlmp_6286cd3a-ede8-4245-b546-5298905ddb17/serve-healthcheck-canary/0.log"
Jul 15 19:06:15.735813 ip-10-0-141-171 kubenswrapper[2567]: I0715 19:06:15.735786    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-fl6p6_3aed4f45-6d7c-43e1-be08-99e65ea41508/kube-rbac-proxy/0.log"
Jul 15 19:06:15.761837 ip-10-0-141-171 kubenswrapper[2567]: I0715 19:06:15.761815    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-fl6p6_3aed4f45-6d7c-43e1-be08-99e65ea41508/exporter/0.log"
Jul 15 19:06:15.784398 ip-10-0-141-171 kubenswrapper[2567]: I0715 19:06:15.784375    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-fl6p6_3aed4f45-6d7c-43e1-be08-99e65ea41508/extractor/0.log"
Jul 15 19:06:17.051986 ip-10-0-141-171 kubenswrapper[2567]: I0715 19:06:17.051959    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-858dh/perf-node-gather-daemonset-5whd5"
Jul 15 19:06:18.450701 ip-10-0-141-171 kubenswrapper[2567]: I0715 19:06:18.450673    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-5664889d69-ljx6h_b41427bd-3d8d-433b-9332-d2460acd529c/manager/0.log"
Jul 15 19:06:18.478347 ip-10-0-141-171 kubenswrapper[2567]: I0715 19:06:18.478323    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-5664889d69-ljx6h_b41427bd-3d8d-433b-9332-d2460acd529c/copy-manifests/0.log"
Jul 15 19:06:19.555924 ip-10-0-141-171 kubenswrapper[2567]: I0715 19:06:19.555894    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-6b5bc7bcd6-nk57w_dd26deef-9d7b-471d-b0e1-2838c9312d58/kube-auth-proxy/0.log"
Jul 15 19:06:19.661358 ip-10-0-141-171 kubenswrapper[2567]: I0715 19:06:19.661328    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-f9b8d9b9b-v4h87_cd1168ac-c1c1-42cb-b2db-e8f131953d09/payload-processing/0.log"
Jul 15 19:06:19.933078 ip-10-0-141-171 kubenswrapper[2567]: I0715 19:06:19.933047    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_lws-controller-manager-68b4879c65-bkbss_c22ea5f0-516e-4833-b7ce-0cc1fa048cea/manager/0.log"
Jul 15 19:06:21.330184 ip-10-0-141-171 kubenswrapper[2567]: I0715 19:06:21.330108    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-6b5bc7bcd6-nk57w_dd26deef-9d7b-471d-b0e1-2838c9312d58/kube-auth-proxy/0.log"
Jul 15 19:06:21.453211 ip-10-0-141-171 kubenswrapper[2567]: I0715 19:06:21.453183    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-f9b8d9b9b-v4h87_cd1168ac-c1c1-42cb-b2db-e8f131953d09/payload-processing/0.log"
Jul 15 19:06:26.796836 ip-10-0-141-171 kubenswrapper[2567]: I0715 19:06:26.796808    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-d6rg2_b4008ec9-cbff-43c2-905e-abd5cf63c321/kube-multus-additional-cni-plugins/0.log"
Jul 15 19:06:26.827112 ip-10-0-141-171 kubenswrapper[2567]: I0715 19:06:26.827034    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-d6rg2_b4008ec9-cbff-43c2-905e-abd5cf63c321/egress-router-binary-copy/0.log"
Jul 15 19:06:26.856549 ip-10-0-141-171 kubenswrapper[2567]: I0715 19:06:26.856525    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-d6rg2_b4008ec9-cbff-43c2-905e-abd5cf63c321/cni-plugins/0.log"
Jul 15 19:06:26.882704 ip-10-0-141-171 kubenswrapper[2567]: I0715 19:06:26.882684    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-d6rg2_b4008ec9-cbff-43c2-905e-abd5cf63c321/bond-cni-plugin/0.log"
Jul 15 19:06:26.914926 ip-10-0-141-171 kubenswrapper[2567]: I0715 19:06:26.914904    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-d6rg2_b4008ec9-cbff-43c2-905e-abd5cf63c321/routeoverride-cni/0.log"
Jul 15 19:06:26.943764 ip-10-0-141-171 kubenswrapper[2567]: I0715 19:06:26.943740    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-d6rg2_b4008ec9-cbff-43c2-905e-abd5cf63c321/whereabouts-cni-bincopy/0.log"
Jul 15 19:06:26.975940 ip-10-0-141-171 kubenswrapper[2567]: I0715 19:06:26.975919    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-d6rg2_b4008ec9-cbff-43c2-905e-abd5cf63c321/whereabouts-cni/0.log"
Jul 15 19:06:27.201386 ip-10-0-141-171 kubenswrapper[2567]: I0715 19:06:27.201360    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-crpmn_9dd068b6-915e-4ffb-9552-b4b987ca19f2/kube-multus/0.log"
Jul 15 19:06:27.321887 ip-10-0-141-171 kubenswrapper[2567]: I0715 19:06:27.321853    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-n88x2_99ec9d0a-ff24-4f04-b38d-b4a7de812d3b/network-metrics-daemon/0.log"
Jul 15 19:06:27.351704 ip-10-0-141-171 kubenswrapper[2567]: I0715 19:06:27.351678    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-n88x2_99ec9d0a-ff24-4f04-b38d-b4a7de812d3b/kube-rbac-proxy/0.log"