Jul 18 01:47:48.184889 ip-10-0-142-238 systemd[1]: Starting Kubernetes Kubelet...
Jul 18 01:47:48.645400 ip-10-0-142-238 kubenswrapper[2566]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 18 01:47:48.645400 ip-10-0-142-238 kubenswrapper[2566]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version.
Jul 18 01:47:48.645400 ip-10-0-142-238 kubenswrapper[2566]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 18 01:47:48.646002 ip-10-0-142-238 kubenswrapper[2566]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI.
Jul 18 01:47:48.646002 ip-10-0-142-238 kubenswrapper[2566]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 18 01:47:48.647869 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:47:48.647784    2566 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime"
Jul 18 01:47:48.653382 ip-10-0-142-238 kubenswrapper[2566]: W0718 01:47:48.653363    2566 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 18 01:47:48.653382 ip-10-0-142-238 kubenswrapper[2566]: W0718 01:47:48.653379    2566 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 18 01:47:48.653382 ip-10-0-142-238 kubenswrapper[2566]: W0718 01:47:48.653383    2566 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 18 01:47:48.653382 ip-10-0-142-238 kubenswrapper[2566]: W0718 01:47:48.653388    2566 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 18 01:47:48.653589 ip-10-0-142-238 kubenswrapper[2566]: W0718 01:47:48.653392    2566 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 18 01:47:48.653589 ip-10-0-142-238 kubenswrapper[2566]: W0718 01:47:48.653396    2566 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 18 01:47:48.653589 ip-10-0-142-238 kubenswrapper[2566]: W0718 01:47:48.653401    2566 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 18 01:47:48.653589 ip-10-0-142-238 kubenswrapper[2566]: W0718 01:47:48.653407    2566 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 18 01:47:48.653589 ip-10-0-142-238 kubenswrapper[2566]: W0718 01:47:48.653413    2566 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 18 01:47:48.653589 ip-10-0-142-238 kubenswrapper[2566]: W0718 01:47:48.653417    2566 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 18 01:47:48.653589 ip-10-0-142-238 kubenswrapper[2566]: W0718 01:47:48.653421    2566 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 18 01:47:48.653589 ip-10-0-142-238 kubenswrapper[2566]: W0718 01:47:48.653426    2566 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 18 01:47:48.653589 ip-10-0-142-238 kubenswrapper[2566]: W0718 01:47:48.653430    2566 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 18 01:47:48.653589 ip-10-0-142-238 kubenswrapper[2566]: W0718 01:47:48.653433    2566 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 18 01:47:48.653589 ip-10-0-142-238 kubenswrapper[2566]: W0718 01:47:48.653437    2566 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 18 01:47:48.653589 ip-10-0-142-238 kubenswrapper[2566]: W0718 01:47:48.653441    2566 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 18 01:47:48.653589 ip-10-0-142-238 kubenswrapper[2566]: W0718 01:47:48.653445    2566 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 18 01:47:48.653589 ip-10-0-142-238 kubenswrapper[2566]: W0718 01:47:48.653449    2566 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 18 01:47:48.653589 ip-10-0-142-238 kubenswrapper[2566]: W0718 01:47:48.653455    2566 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 18 01:47:48.653589 ip-10-0-142-238 kubenswrapper[2566]: W0718 01:47:48.653461    2566 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 18 01:47:48.653589 ip-10-0-142-238 kubenswrapper[2566]: W0718 01:47:48.653465    2566 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 18 01:47:48.653589 ip-10-0-142-238 kubenswrapper[2566]: W0718 01:47:48.653469    2566 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 18 01:47:48.653589 ip-10-0-142-238 kubenswrapper[2566]: W0718 01:47:48.653473    2566 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 18 01:47:48.654343 ip-10-0-142-238 kubenswrapper[2566]: W0718 01:47:48.653478    2566 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 18 01:47:48.654343 ip-10-0-142-238 kubenswrapper[2566]: W0718 01:47:48.653482    2566 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 18 01:47:48.654343 ip-10-0-142-238 kubenswrapper[2566]: W0718 01:47:48.653497    2566 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 18 01:47:48.654343 ip-10-0-142-238 kubenswrapper[2566]: W0718 01:47:48.653502    2566 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 18 01:47:48.654343 ip-10-0-142-238 kubenswrapper[2566]: W0718 01:47:48.653506    2566 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 18 01:47:48.654343 ip-10-0-142-238 kubenswrapper[2566]: W0718 01:47:48.653510    2566 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 18 01:47:48.654343 ip-10-0-142-238 kubenswrapper[2566]: W0718 01:47:48.653514    2566 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 18 01:47:48.654343 ip-10-0-142-238 kubenswrapper[2566]: W0718 01:47:48.653518    2566 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 18 01:47:48.654343 ip-10-0-142-238 kubenswrapper[2566]: W0718 01:47:48.653522    2566 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 18 01:47:48.654343 ip-10-0-142-238 kubenswrapper[2566]: W0718 01:47:48.653529    2566 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 18 01:47:48.654343 ip-10-0-142-238 kubenswrapper[2566]: W0718 01:47:48.653533    2566 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 18 01:47:48.654343 ip-10-0-142-238 kubenswrapper[2566]: W0718 01:47:48.653537    2566 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 18 01:47:48.654343 ip-10-0-142-238 kubenswrapper[2566]: W0718 01:47:48.653541    2566 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 18 01:47:48.654343 ip-10-0-142-238 kubenswrapper[2566]: W0718 01:47:48.653545    2566 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 18 01:47:48.654343 ip-10-0-142-238 kubenswrapper[2566]: W0718 01:47:48.653550    2566 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 18 01:47:48.654343 ip-10-0-142-238 kubenswrapper[2566]: W0718 01:47:48.653554    2566 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 18 01:47:48.654343 ip-10-0-142-238 kubenswrapper[2566]: W0718 01:47:48.653558    2566 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 18 01:47:48.654343 ip-10-0-142-238 kubenswrapper[2566]: W0718 01:47:48.653563    2566 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 18 01:47:48.654343 ip-10-0-142-238 kubenswrapper[2566]: W0718 01:47:48.653567    2566 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 18 01:47:48.654343 ip-10-0-142-238 kubenswrapper[2566]: W0718 01:47:48.653572    2566 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 18 01:47:48.655161 ip-10-0-142-238 kubenswrapper[2566]: W0718 01:47:48.653576    2566 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 18 01:47:48.655161 ip-10-0-142-238 kubenswrapper[2566]: W0718 01:47:48.653580    2566 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 18 01:47:48.655161 ip-10-0-142-238 kubenswrapper[2566]: W0718 01:47:48.653584    2566 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 18 01:47:48.655161 ip-10-0-142-238 kubenswrapper[2566]: W0718 01:47:48.653588    2566 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 18 01:47:48.655161 ip-10-0-142-238 kubenswrapper[2566]: W0718 01:47:48.653592    2566 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 18 01:47:48.655161 ip-10-0-142-238 kubenswrapper[2566]: W0718 01:47:48.653596    2566 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 18 01:47:48.655161 ip-10-0-142-238 kubenswrapper[2566]: W0718 01:47:48.653600    2566 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 18 01:47:48.655161 ip-10-0-142-238 kubenswrapper[2566]: W0718 01:47:48.653604    2566 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 18 01:47:48.655161 ip-10-0-142-238 kubenswrapper[2566]: W0718 01:47:48.653626    2566 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 18 01:47:48.655161 ip-10-0-142-238 kubenswrapper[2566]: W0718 01:47:48.653631    2566 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 18 01:47:48.655161 ip-10-0-142-238 kubenswrapper[2566]: W0718 01:47:48.653636    2566 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 18 01:47:48.655161 ip-10-0-142-238 kubenswrapper[2566]: W0718 01:47:48.653640    2566 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 18 01:47:48.655161 ip-10-0-142-238 kubenswrapper[2566]: W0718 01:47:48.653644    2566 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 18 01:47:48.655161 ip-10-0-142-238 kubenswrapper[2566]: W0718 01:47:48.653648    2566 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 18 01:47:48.655161 ip-10-0-142-238 kubenswrapper[2566]: W0718 01:47:48.653653    2566 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 18 01:47:48.655161 ip-10-0-142-238 kubenswrapper[2566]: W0718 01:47:48.653657    2566 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 18 01:47:48.655161 ip-10-0-142-238 kubenswrapper[2566]: W0718 01:47:48.653662    2566 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 18 01:47:48.655161 ip-10-0-142-238 kubenswrapper[2566]: W0718 01:47:48.653665    2566 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 18 01:47:48.655161 ip-10-0-142-238 kubenswrapper[2566]: W0718 01:47:48.653669    2566 feature_gate.go:328] unrecognized feature gate: Example2
Jul 18 01:47:48.655161 ip-10-0-142-238 kubenswrapper[2566]: W0718 01:47:48.653673    2566 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 18 01:47:48.656012 ip-10-0-142-238 kubenswrapper[2566]: W0718 01:47:48.653678    2566 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 18 01:47:48.656012 ip-10-0-142-238 kubenswrapper[2566]: W0718 01:47:48.653683    2566 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 18 01:47:48.656012 ip-10-0-142-238 kubenswrapper[2566]: W0718 01:47:48.653687    2566 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 18 01:47:48.656012 ip-10-0-142-238 kubenswrapper[2566]: W0718 01:47:48.653691    2566 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 18 01:47:48.656012 ip-10-0-142-238 kubenswrapper[2566]: W0718 01:47:48.653695    2566 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 18 01:47:48.656012 ip-10-0-142-238 kubenswrapper[2566]: W0718 01:47:48.653703    2566 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 18 01:47:48.656012 ip-10-0-142-238 kubenswrapper[2566]: W0718 01:47:48.653708    2566 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 18 01:47:48.656012 ip-10-0-142-238 kubenswrapper[2566]: W0718 01:47:48.653713    2566 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 18 01:47:48.656012 ip-10-0-142-238 kubenswrapper[2566]: W0718 01:47:48.653718    2566 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 18 01:47:48.656012 ip-10-0-142-238 kubenswrapper[2566]: W0718 01:47:48.653723    2566 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 18 01:47:48.656012 ip-10-0-142-238 kubenswrapper[2566]: W0718 01:47:48.653728    2566 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 18 01:47:48.656012 ip-10-0-142-238 kubenswrapper[2566]: W0718 01:47:48.653733    2566 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 18 01:47:48.656012 ip-10-0-142-238 kubenswrapper[2566]: W0718 01:47:48.653738    2566 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 18 01:47:48.656012 ip-10-0-142-238 kubenswrapper[2566]: W0718 01:47:48.653742    2566 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 18 01:47:48.656012 ip-10-0-142-238 kubenswrapper[2566]: W0718 01:47:48.653746    2566 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 18 01:47:48.656012 ip-10-0-142-238 kubenswrapper[2566]: W0718 01:47:48.653751    2566 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 18 01:47:48.656012 ip-10-0-142-238 kubenswrapper[2566]: W0718 01:47:48.653756    2566 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 18 01:47:48.656012 ip-10-0-142-238 kubenswrapper[2566]: W0718 01:47:48.653760    2566 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 18 01:47:48.656012 ip-10-0-142-238 kubenswrapper[2566]: W0718 01:47:48.653764    2566 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 18 01:47:48.656812 ip-10-0-142-238 kubenswrapper[2566]: W0718 01:47:48.653768    2566 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 18 01:47:48.656812 ip-10-0-142-238 kubenswrapper[2566]: W0718 01:47:48.653774    2566 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 18 01:47:48.656812 ip-10-0-142-238 kubenswrapper[2566]: W0718 01:47:48.653778    2566 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 18 01:47:48.656812 ip-10-0-142-238 kubenswrapper[2566]: W0718 01:47:48.653783    2566 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 18 01:47:48.656812 ip-10-0-142-238 kubenswrapper[2566]: W0718 01:47:48.653787    2566 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 18 01:47:48.656812 ip-10-0-142-238 kubenswrapper[2566]: W0718 01:47:48.653791    2566 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 18 01:47:48.656812 ip-10-0-142-238 kubenswrapper[2566]: W0718 01:47:48.653795    2566 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 18 01:47:48.656812 ip-10-0-142-238 kubenswrapper[2566]: W0718 01:47:48.653799    2566 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 18 01:47:48.656812 ip-10-0-142-238 kubenswrapper[2566]: W0718 01:47:48.653804    2566 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 18 01:47:48.656812 ip-10-0-142-238 kubenswrapper[2566]: W0718 01:47:48.653807    2566 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 18 01:47:48.656812 ip-10-0-142-238 kubenswrapper[2566]: W0718 01:47:48.653812    2566 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 18 01:47:48.656812 ip-10-0-142-238 kubenswrapper[2566]: W0718 01:47:48.653816    2566 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 18 01:47:48.656812 ip-10-0-142-238 kubenswrapper[2566]: W0718 01:47:48.653819    2566 feature_gate.go:328] unrecognized feature gate: Example
Jul 18 01:47:48.656812 ip-10-0-142-238 kubenswrapper[2566]: W0718 01:47:48.653823    2566 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 18 01:47:48.656812 ip-10-0-142-238 kubenswrapper[2566]: W0718 01:47:48.653828    2566 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 18 01:47:48.656812 ip-10-0-142-238 kubenswrapper[2566]: W0718 01:47:48.653833    2566 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 18 01:47:48.656812 ip-10-0-142-238 kubenswrapper[2566]: W0718 01:47:48.653837    2566 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 18 01:47:48.656812 ip-10-0-142-238 kubenswrapper[2566]: W0718 01:47:48.655013    2566 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 18 01:47:48.656812 ip-10-0-142-238 kubenswrapper[2566]: W0718 01:47:48.655024    2566 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 18 01:47:48.656812 ip-10-0-142-238 kubenswrapper[2566]: W0718 01:47:48.655030    2566 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 18 01:47:48.657348 ip-10-0-142-238 kubenswrapper[2566]: W0718 01:47:48.655035    2566 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 18 01:47:48.657348 ip-10-0-142-238 kubenswrapper[2566]: W0718 01:47:48.655040    2566 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 18 01:47:48.657348 ip-10-0-142-238 kubenswrapper[2566]: W0718 01:47:48.655044    2566 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 18 01:47:48.657348 ip-10-0-142-238 kubenswrapper[2566]: W0718 01:47:48.655049    2566 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 18 01:47:48.657348 ip-10-0-142-238 kubenswrapper[2566]: W0718 01:47:48.655053    2566 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 18 01:47:48.657348 ip-10-0-142-238 kubenswrapper[2566]: W0718 01:47:48.655057    2566 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 18 01:47:48.657348 ip-10-0-142-238 kubenswrapper[2566]: W0718 01:47:48.655063    2566 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 18 01:47:48.657348 ip-10-0-142-238 kubenswrapper[2566]: W0718 01:47:48.655067    2566 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 18 01:47:48.657348 ip-10-0-142-238 kubenswrapper[2566]: W0718 01:47:48.655071    2566 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 18 01:47:48.657348 ip-10-0-142-238 kubenswrapper[2566]: W0718 01:47:48.655075    2566 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 18 01:47:48.657348 ip-10-0-142-238 kubenswrapper[2566]: W0718 01:47:48.655079    2566 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 18 01:47:48.657348 ip-10-0-142-238 kubenswrapper[2566]: W0718 01:47:48.655083    2566 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 18 01:47:48.657348 ip-10-0-142-238 kubenswrapper[2566]: W0718 01:47:48.655087    2566 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 18 01:47:48.657348 ip-10-0-142-238 kubenswrapper[2566]: W0718 01:47:48.655091    2566 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 18 01:47:48.657348 ip-10-0-142-238 kubenswrapper[2566]: W0718 01:47:48.655095    2566 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 18 01:47:48.657348 ip-10-0-142-238 kubenswrapper[2566]: W0718 01:47:48.655099    2566 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 18 01:47:48.657348 ip-10-0-142-238 kubenswrapper[2566]: W0718 01:47:48.655103    2566 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 18 01:47:48.657348 ip-10-0-142-238 kubenswrapper[2566]: W0718 01:47:48.655107    2566 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 18 01:47:48.657348 ip-10-0-142-238 kubenswrapper[2566]: W0718 01:47:48.655111    2566 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 18 01:47:48.657348 ip-10-0-142-238 kubenswrapper[2566]: W0718 01:47:48.655116    2566 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 18 01:47:48.657879 ip-10-0-142-238 kubenswrapper[2566]: W0718 01:47:48.655120    2566 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 18 01:47:48.657879 ip-10-0-142-238 kubenswrapper[2566]: W0718 01:47:48.655124    2566 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 18 01:47:48.657879 ip-10-0-142-238 kubenswrapper[2566]: W0718 01:47:48.655128    2566 feature_gate.go:328] unrecognized feature gate: Example2
Jul 18 01:47:48.657879 ip-10-0-142-238 kubenswrapper[2566]: W0718 01:47:48.655133    2566 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 18 01:47:48.657879 ip-10-0-142-238 kubenswrapper[2566]: W0718 01:47:48.655137    2566 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 18 01:47:48.657879 ip-10-0-142-238 kubenswrapper[2566]: W0718 01:47:48.655141    2566 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 18 01:47:48.657879 ip-10-0-142-238 kubenswrapper[2566]: W0718 01:47:48.655146    2566 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 18 01:47:48.657879 ip-10-0-142-238 kubenswrapper[2566]: W0718 01:47:48.655151    2566 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 18 01:47:48.657879 ip-10-0-142-238 kubenswrapper[2566]: W0718 01:47:48.655155    2566 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 18 01:47:48.657879 ip-10-0-142-238 kubenswrapper[2566]: W0718 01:47:48.655159    2566 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 18 01:47:48.657879 ip-10-0-142-238 kubenswrapper[2566]: W0718 01:47:48.655166    2566 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 18 01:47:48.657879 ip-10-0-142-238 kubenswrapper[2566]: W0718 01:47:48.655172    2566 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 18 01:47:48.657879 ip-10-0-142-238 kubenswrapper[2566]: W0718 01:47:48.655176    2566 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 18 01:47:48.657879 ip-10-0-142-238 kubenswrapper[2566]: W0718 01:47:48.655181    2566 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 18 01:47:48.657879 ip-10-0-142-238 kubenswrapper[2566]: W0718 01:47:48.655186    2566 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 18 01:47:48.657879 ip-10-0-142-238 kubenswrapper[2566]: W0718 01:47:48.655190    2566 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 18 01:47:48.657879 ip-10-0-142-238 kubenswrapper[2566]: W0718 01:47:48.655195    2566 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 18 01:47:48.657879 ip-10-0-142-238 kubenswrapper[2566]: W0718 01:47:48.655200    2566 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 18 01:47:48.657879 ip-10-0-142-238 kubenswrapper[2566]: W0718 01:47:48.655204    2566 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 18 01:47:48.658322 ip-10-0-142-238 kubenswrapper[2566]: W0718 01:47:48.655209    2566 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 18 01:47:48.658322 ip-10-0-142-238 kubenswrapper[2566]: W0718 01:47:48.655213    2566 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 18 01:47:48.658322 ip-10-0-142-238 kubenswrapper[2566]: W0718 01:47:48.655217    2566 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 18 01:47:48.658322 ip-10-0-142-238 kubenswrapper[2566]: W0718 01:47:48.655221    2566 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 18 01:47:48.658322 ip-10-0-142-238 kubenswrapper[2566]: W0718 01:47:48.655225    2566 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 18 01:47:48.658322 ip-10-0-142-238 kubenswrapper[2566]: W0718 01:47:48.655229    2566 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 18 01:47:48.658322 ip-10-0-142-238 kubenswrapper[2566]: W0718 01:47:48.655234    2566 feature_gate.go:328] unrecognized feature gate: Example
Jul 18 01:47:48.658322 ip-10-0-142-238 kubenswrapper[2566]: W0718 01:47:48.655238    2566 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 18 01:47:48.658322 ip-10-0-142-238 kubenswrapper[2566]: W0718 01:47:48.655242    2566 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 18 01:47:48.658322 ip-10-0-142-238 kubenswrapper[2566]: W0718 01:47:48.655245    2566 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 18 01:47:48.658322 ip-10-0-142-238 kubenswrapper[2566]: W0718 01:47:48.655249    2566 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 18 01:47:48.658322 ip-10-0-142-238 kubenswrapper[2566]: W0718 01:47:48.655254    2566 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 18 01:47:48.658322 ip-10-0-142-238 kubenswrapper[2566]: W0718 01:47:48.655257    2566 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 18 01:47:48.658322 ip-10-0-142-238 kubenswrapper[2566]: W0718 01:47:48.655261    2566 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 18 01:47:48.658322 ip-10-0-142-238 kubenswrapper[2566]: W0718 01:47:48.655265    2566 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 18 01:47:48.658322 ip-10-0-142-238 kubenswrapper[2566]: W0718 01:47:48.655270    2566 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 18 01:47:48.658322 ip-10-0-142-238 kubenswrapper[2566]: W0718 01:47:48.655274    2566 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 18 01:47:48.658322 ip-10-0-142-238 kubenswrapper[2566]: W0718 01:47:48.655279    2566 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 18 01:47:48.658322 ip-10-0-142-238 kubenswrapper[2566]: W0718 01:47:48.655283    2566 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 18 01:47:48.658322 ip-10-0-142-238 kubenswrapper[2566]: W0718 01:47:48.655287    2566 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 18 01:47:48.658803 ip-10-0-142-238 kubenswrapper[2566]: W0718 01:47:48.655291    2566 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 18 01:47:48.658803 ip-10-0-142-238 kubenswrapper[2566]: W0718 01:47:48.655295    2566 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 18 01:47:48.658803 ip-10-0-142-238 kubenswrapper[2566]: W0718 01:47:48.655300    2566 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 18 01:47:48.658803 ip-10-0-142-238 kubenswrapper[2566]: W0718 01:47:48.655303    2566 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 18 01:47:48.658803 ip-10-0-142-238 kubenswrapper[2566]: W0718 01:47:48.655307    2566 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 18 01:47:48.658803 ip-10-0-142-238 kubenswrapper[2566]: W0718 01:47:48.655312    2566 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 18 01:47:48.658803 ip-10-0-142-238 kubenswrapper[2566]: W0718 01:47:48.655318    2566 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 18 01:47:48.658803 ip-10-0-142-238 kubenswrapper[2566]: W0718 01:47:48.655324    2566 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 18 01:47:48.658803 ip-10-0-142-238 kubenswrapper[2566]: W0718 01:47:48.655330    2566 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 18 01:47:48.658803 ip-10-0-142-238 kubenswrapper[2566]: W0718 01:47:48.655334    2566 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 18 01:47:48.658803 ip-10-0-142-238 kubenswrapper[2566]: W0718 01:47:48.655340    2566 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 18 01:47:48.658803 ip-10-0-142-238 kubenswrapper[2566]: W0718 01:47:48.655344    2566 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 18 01:47:48.658803 ip-10-0-142-238 kubenswrapper[2566]: W0718 01:47:48.655347    2566 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 18 01:47:48.658803 ip-10-0-142-238 kubenswrapper[2566]: W0718 01:47:48.655353    2566 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 18 01:47:48.658803 ip-10-0-142-238 kubenswrapper[2566]: W0718 01:47:48.655357    2566 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 18 01:47:48.658803 ip-10-0-142-238 kubenswrapper[2566]: W0718 01:47:48.655361    2566 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 18 01:47:48.658803 ip-10-0-142-238 kubenswrapper[2566]: W0718 01:47:48.655365    2566 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 18 01:47:48.658803 ip-10-0-142-238 kubenswrapper[2566]: W0718 01:47:48.655371    2566 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 18 01:47:48.658803 ip-10-0-142-238 kubenswrapper[2566]: W0718 01:47:48.655377    2566 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 18 01:47:48.659255 ip-10-0-142-238 kubenswrapper[2566]: W0718 01:47:48.655381    2566 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 18 01:47:48.659255 ip-10-0-142-238 kubenswrapper[2566]: W0718 01:47:48.655386    2566 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 18 01:47:48.659255 ip-10-0-142-238 kubenswrapper[2566]: W0718 01:47:48.655390    2566 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 18 01:47:48.659255 ip-10-0-142-238 kubenswrapper[2566]: W0718 01:47:48.655394    2566 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 18 01:47:48.659255 ip-10-0-142-238 kubenswrapper[2566]: W0718 01:47:48.655399    2566 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 18 01:47:48.659255 ip-10-0-142-238 kubenswrapper[2566]: W0718 01:47:48.655404    2566 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 18 01:47:48.659255 ip-10-0-142-238 kubenswrapper[2566]: W0718 01:47:48.655408    2566 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 18 01:47:48.659255 ip-10-0-142-238 kubenswrapper[2566]: W0718 01:47:48.655413    2566 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 18 01:47:48.659255 ip-10-0-142-238 kubenswrapper[2566]: W0718 01:47:48.655417    2566 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 18 01:47:48.659255 ip-10-0-142-238 kubenswrapper[2566]: W0718 01:47:48.655422    2566 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 18 01:47:48.659255 ip-10-0-142-238 kubenswrapper[2566]: W0718 01:47:48.655426    2566 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 18 01:47:48.659255 ip-10-0-142-238 kubenswrapper[2566]: W0718 01:47:48.655431    2566 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 18 01:47:48.659255 ip-10-0-142-238 kubenswrapper[2566]: W0718 01:47:48.655435    2566 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 18 01:47:48.659255 ip-10-0-142-238 kubenswrapper[2566]: W0718 01:47:48.655440    2566 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 18 01:47:48.659255 ip-10-0-142-238 kubenswrapper[2566]: W0718 01:47:48.655444    2566 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 18 01:47:48.659255 ip-10-0-142-238 kubenswrapper[2566]: W0718 01:47:48.655449    2566 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 18 01:47:48.659255 ip-10-0-142-238 kubenswrapper[2566]: W0718 01:47:48.655453    2566 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 18 01:47:48.659255 ip-10-0-142-238 kubenswrapper[2566]: W0718 01:47:48.655458    2566 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 18 01:47:48.659255 ip-10-0-142-238 kubenswrapper[2566]: W0718 01:47:48.656034    2566 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 18 01:47:48.659255 ip-10-0-142-238 kubenswrapper[2566]: W0718 01:47:48.656044    2566 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 18 01:47:48.659741 ip-10-0-142-238 kubenswrapper[2566]: W0718 01:47:48.656049    2566 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 18 01:47:48.659741 ip-10-0-142-238 kubenswrapper[2566]: W0718 01:47:48.656054    2566 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 18 01:47:48.659741 ip-10-0-142-238 kubenswrapper[2566]: W0718 01:47:48.656059    2566 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 18 01:47:48.659741 ip-10-0-142-238 kubenswrapper[2566]: W0718 01:47:48.656063    2566 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 18 01:47:48.659741 ip-10-0-142-238 kubenswrapper[2566]: W0718 01:47:48.656068    2566 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 18 01:47:48.659741 ip-10-0-142-238 kubenswrapper[2566]: W0718 01:47:48.656072    2566 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 18 01:47:48.659741 ip-10-0-142-238 kubenswrapper[2566]: W0718 01:47:48.656077    2566 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 18 01:47:48.659741 ip-10-0-142-238 kubenswrapper[2566]: W0718 01:47:48.656081    2566 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 18 01:47:48.659741 ip-10-0-142-238 kubenswrapper[2566]: W0718 01:47:48.656085    2566 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 18 01:47:48.659741 ip-10-0-142-238 kubenswrapper[2566]: W0718 01:47:48.656093    2566 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 18 01:47:48.659741 ip-10-0-142-238 kubenswrapper[2566]: W0718 01:47:48.656098    2566 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 18 01:47:48.659741 ip-10-0-142-238 kubenswrapper[2566]: W0718 01:47:48.656102    2566 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 18 01:47:48.659741 ip-10-0-142-238 kubenswrapper[2566]: W0718 01:47:48.656107    2566 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 18 01:47:48.659741 ip-10-0-142-238 kubenswrapper[2566]: W0718 01:47:48.656111    2566 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 18 01:47:48.659741 ip-10-0-142-238 kubenswrapper[2566]: W0718 01:47:48.656115    2566 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 18 01:47:48.659741 ip-10-0-142-238 kubenswrapper[2566]: W0718 01:47:48.656119    2566 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 18 01:47:48.659741 ip-10-0-142-238 kubenswrapper[2566]: W0718 01:47:48.656123    2566 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 18 01:47:48.659741 ip-10-0-142-238 kubenswrapper[2566]: W0718 01:47:48.656127    2566 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 18 01:47:48.659741 ip-10-0-142-238 kubenswrapper[2566]: W0718 01:47:48.656131    2566 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 18 01:47:48.659741 ip-10-0-142-238 kubenswrapper[2566]: W0718 01:47:48.656136    2566 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 18 01:47:48.660195 ip-10-0-142-238 kubenswrapper[2566]: W0718 01:47:48.656140    2566 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 18 01:47:48.660195 ip-10-0-142-238 kubenswrapper[2566]: W0718 01:47:48.656144    2566 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 18 01:47:48.660195 ip-10-0-142-238 kubenswrapper[2566]: W0718 01:47:48.656148    2566 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 18 01:47:48.660195 ip-10-0-142-238 kubenswrapper[2566]: W0718 01:47:48.656152    2566 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 18 01:47:48.660195 ip-10-0-142-238 kubenswrapper[2566]: W0718 01:47:48.656156    2566 feature_gate.go:328] unrecognized feature gate: Example
Jul 18 01:47:48.660195 ip-10-0-142-238 kubenswrapper[2566]: W0718 01:47:48.656161    2566 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 18 01:47:48.660195 ip-10-0-142-238 kubenswrapper[2566]: W0718 01:47:48.656165    2566 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 18 01:47:48.660195 ip-10-0-142-238 kubenswrapper[2566]: W0718 01:47:48.656169    2566 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 18 01:47:48.660195 ip-10-0-142-238 kubenswrapper[2566]: W0718 01:47:48.656173    2566 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 18 01:47:48.660195 ip-10-0-142-238 kubenswrapper[2566]: W0718 01:47:48.656177    2566 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 18 01:47:48.660195 ip-10-0-142-238 kubenswrapper[2566]: W0718 01:47:48.656181    2566 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 18 01:47:48.660195 ip-10-0-142-238 kubenswrapper[2566]: W0718 01:47:48.656185    2566 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 18 01:47:48.660195 ip-10-0-142-238 kubenswrapper[2566]: W0718 01:47:48.656189    2566 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 18 01:47:48.660195 ip-10-0-142-238 kubenswrapper[2566]: W0718 01:47:48.656193    2566 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 18 01:47:48.660195 ip-10-0-142-238 kubenswrapper[2566]: W0718 01:47:48.656197    2566 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 18 01:47:48.660195 ip-10-0-142-238 kubenswrapper[2566]: W0718 01:47:48.656201    2566 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 18 01:47:48.660195 ip-10-0-142-238 kubenswrapper[2566]: W0718 01:47:48.656205    2566 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 18 01:47:48.660195 ip-10-0-142-238 kubenswrapper[2566]: W0718 01:47:48.656209    2566 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 18 01:47:48.660195 ip-10-0-142-238 kubenswrapper[2566]: W0718 01:47:48.656213    2566 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 18 01:47:48.660195 ip-10-0-142-238 kubenswrapper[2566]: W0718 01:47:48.656218    2566 feature_gate.go:328] unrecognized feature gate: Example2
Jul 18 01:47:48.660673 ip-10-0-142-238 kubenswrapper[2566]: W0718 01:47:48.656223    2566 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 18 01:47:48.660673 ip-10-0-142-238 kubenswrapper[2566]: W0718 01:47:48.656227    2566 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 18 01:47:48.660673 ip-10-0-142-238 kubenswrapper[2566]: W0718 01:47:48.656231    2566 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 18 01:47:48.660673 ip-10-0-142-238 kubenswrapper[2566]: W0718 01:47:48.656235    2566 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 18 01:47:48.660673 ip-10-0-142-238 kubenswrapper[2566]: W0718 01:47:48.656238    2566 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 18 01:47:48.660673 ip-10-0-142-238 kubenswrapper[2566]: W0718 01:47:48.656243    2566 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 18 01:47:48.660673 ip-10-0-142-238 kubenswrapper[2566]: W0718 01:47:48.656247    2566 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 18 01:47:48.660673 ip-10-0-142-238 kubenswrapper[2566]: W0718 01:47:48.656251    2566 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 18 01:47:48.660673 ip-10-0-142-238 kubenswrapper[2566]: W0718 01:47:48.656255    2566 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 18 01:47:48.660673 ip-10-0-142-238 kubenswrapper[2566]: W0718 01:47:48.656259    2566 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 18 01:47:48.660673 ip-10-0-142-238 kubenswrapper[2566]: W0718 01:47:48.656265    2566 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 18 01:47:48.660673 ip-10-0-142-238 kubenswrapper[2566]: W0718 01:47:48.656269    2566 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 18 01:47:48.660673 ip-10-0-142-238 kubenswrapper[2566]: W0718 01:47:48.656273    2566 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 18 01:47:48.660673 ip-10-0-142-238 kubenswrapper[2566]: W0718 01:47:48.656278    2566 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 18 01:47:48.660673 ip-10-0-142-238 kubenswrapper[2566]: W0718 01:47:48.656281    2566 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 18 01:47:48.660673 ip-10-0-142-238 kubenswrapper[2566]: W0718 01:47:48.656286    2566 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 18 01:47:48.660673 ip-10-0-142-238 kubenswrapper[2566]: W0718 01:47:48.656291    2566 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 18 01:47:48.660673 ip-10-0-142-238 kubenswrapper[2566]: W0718 01:47:48.656296    2566 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 18 01:47:48.660673 ip-10-0-142-238 kubenswrapper[2566]: W0718 01:47:48.656300    2566 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 18 01:47:48.661143 ip-10-0-142-238 kubenswrapper[2566]: W0718 01:47:48.656306    2566 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 18 01:47:48.661143 ip-10-0-142-238 kubenswrapper[2566]: W0718 01:47:48.656312    2566 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 18 01:47:48.661143 ip-10-0-142-238 kubenswrapper[2566]: W0718 01:47:48.656317    2566 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 18 01:47:48.661143 ip-10-0-142-238 kubenswrapper[2566]: W0718 01:47:48.656322    2566 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 18 01:47:48.661143 ip-10-0-142-238 kubenswrapper[2566]: W0718 01:47:48.656326    2566 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 18 01:47:48.661143 ip-10-0-142-238 kubenswrapper[2566]: W0718 01:47:48.656331    2566 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 18 01:47:48.661143 ip-10-0-142-238 kubenswrapper[2566]: W0718 01:47:48.656336    2566 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 18 01:47:48.661143 ip-10-0-142-238 kubenswrapper[2566]: W0718 01:47:48.656340    2566 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 18 01:47:48.661143 ip-10-0-142-238 kubenswrapper[2566]: W0718 01:47:48.656344    2566 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 18 01:47:48.661143 ip-10-0-142-238 kubenswrapper[2566]: W0718 01:47:48.656348    2566 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 18 01:47:48.661143 ip-10-0-142-238 kubenswrapper[2566]: W0718 01:47:48.656352    2566 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 18 01:47:48.661143 ip-10-0-142-238 kubenswrapper[2566]: W0718 01:47:48.656356    2566 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 18 01:47:48.661143 ip-10-0-142-238 kubenswrapper[2566]: W0718 01:47:48.656360    2566 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 18 01:47:48.661143 ip-10-0-142-238 kubenswrapper[2566]: W0718 01:47:48.656365    2566 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 18 01:47:48.661143 ip-10-0-142-238 kubenswrapper[2566]: W0718 01:47:48.656369    2566 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 18 01:47:48.661143 ip-10-0-142-238 kubenswrapper[2566]: W0718 01:47:48.656373    2566 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 18 01:47:48.661143 ip-10-0-142-238 kubenswrapper[2566]: W0718 01:47:48.656377    2566 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 18 01:47:48.661143 ip-10-0-142-238 kubenswrapper[2566]: W0718 01:47:48.656383    2566 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 18 01:47:48.661143 ip-10-0-142-238 kubenswrapper[2566]: W0718 01:47:48.656387    2566 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 18 01:47:48.661607 ip-10-0-142-238 kubenswrapper[2566]: W0718 01:47:48.656391    2566 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 18 01:47:48.661607 ip-10-0-142-238 kubenswrapper[2566]: W0718 01:47:48.656395    2566 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 18 01:47:48.661607 ip-10-0-142-238 kubenswrapper[2566]: W0718 01:47:48.656402    2566 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 18 01:47:48.661607 ip-10-0-142-238 kubenswrapper[2566]: W0718 01:47:48.656406    2566 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 18 01:47:48.661607 ip-10-0-142-238 kubenswrapper[2566]: W0718 01:47:48.656412    2566 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 18 01:47:48.661607 ip-10-0-142-238 kubenswrapper[2566]: W0718 01:47:48.656416    2566 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 18 01:47:48.661607 ip-10-0-142-238 kubenswrapper[2566]: W0718 01:47:48.656420    2566 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 18 01:47:48.661607 ip-10-0-142-238 kubenswrapper[2566]: W0718 01:47:48.656424    2566 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 18 01:47:48.661607 ip-10-0-142-238 kubenswrapper[2566]: W0718 01:47:48.656428    2566 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 18 01:47:48.661607 ip-10-0-142-238 kubenswrapper[2566]: W0718 01:47:48.656432    2566 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 18 01:47:48.661607 ip-10-0-142-238 kubenswrapper[2566]: W0718 01:47:48.656436    2566 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 18 01:47:48.661607 ip-10-0-142-238 kubenswrapper[2566]: W0718 01:47:48.656440    2566 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 18 01:47:48.661607 ip-10-0-142-238 kubenswrapper[2566]: W0718 01:47:48.656444    2566 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 18 01:47:48.661607 ip-10-0-142-238 kubenswrapper[2566]: W0718 01:47:48.656448    2566 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 18 01:47:48.661607 ip-10-0-142-238 kubenswrapper[2566]: W0718 01:47:48.656452    2566 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 18 01:47:48.661607 ip-10-0-142-238 kubenswrapper[2566]: W0718 01:47:48.656456    2566 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 18 01:47:48.661607 ip-10-0-142-238 kubenswrapper[2566]: W0718 01:47:48.656461    2566 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 18 01:47:48.661607 ip-10-0-142-238 kubenswrapper[2566]: W0718 01:47:48.656466    2566 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 18 01:47:48.661607 ip-10-0-142-238 kubenswrapper[2566]: W0718 01:47:48.656470    2566 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 18 01:47:48.662065 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:47:48.656571    2566 flags.go:64] FLAG: --address="0.0.0.0"
Jul 18 01:47:48.662065 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:47:48.656581    2566 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]"
Jul 18 01:47:48.662065 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:47:48.656590    2566 flags.go:64] FLAG: --anonymous-auth="true"
Jul 18 01:47:48.662065 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:47:48.656596    2566 flags.go:64] FLAG: --application-metrics-count-limit="100"
Jul 18 01:47:48.662065 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:47:48.656602    2566 flags.go:64] FLAG: --authentication-token-webhook="false"
Jul 18 01:47:48.662065 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:47:48.656624    2566 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s"
Jul 18 01:47:48.662065 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:47:48.656631    2566 flags.go:64] FLAG: --authorization-mode="AlwaysAllow"
Jul 18 01:47:48.662065 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:47:48.656637    2566 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s"
Jul 18 01:47:48.662065 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:47:48.656644    2566 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s"
Jul 18 01:47:48.662065 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:47:48.656648    2566 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id"
Jul 18 01:47:48.662065 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:47:48.656654    2566 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig"
Jul 18 01:47:48.662065 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:47:48.656659    2566 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki"
Jul 18 01:47:48.662065 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:47:48.656664    2566 flags.go:64] FLAG: --cgroup-driver="cgroupfs"
Jul 18 01:47:48.662065 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:47:48.656669    2566 flags.go:64] FLAG: --cgroup-root=""
Jul 18 01:47:48.662065 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:47:48.656673    2566 flags.go:64] FLAG: --cgroups-per-qos="true"
Jul 18 01:47:48.662065 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:47:48.656681    2566 flags.go:64] FLAG: --client-ca-file=""
Jul 18 01:47:48.662065 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:47:48.656685    2566 flags.go:64] FLAG: --cloud-provider="external"
Jul 18 01:47:48.662065 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:47:48.656691    2566 flags.go:64] FLAG: --cluster-dns="[]"
Jul 18 01:47:48.662065 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:47:48.656699    2566 flags.go:64] FLAG: --cluster-domain=""
Jul 18 01:47:48.662065 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:47:48.656703    2566 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf"
Jul 18 01:47:48.662065 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:47:48.656708    2566 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d"
Jul 18 01:47:48.662065 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:47:48.656713    2566 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json"
Jul 18 01:47:48.662065 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:47:48.656719    2566 flags.go:64] FLAG: --container-log-max-files="5"
Jul 18 01:47:48.662065 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:47:48.656724    2566 flags.go:64] FLAG: --container-log-max-size="10Mi"
Jul 18 01:47:48.662670 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:47:48.656729    2566 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock"
Jul 18 01:47:48.662670 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:47:48.656734    2566 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock"
Jul 18 01:47:48.662670 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:47:48.656739    2566 flags.go:64] FLAG: --containerd-namespace="k8s.io"
Jul 18 01:47:48.662670 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:47:48.656744    2566 flags.go:64] FLAG: --contention-profiling="false"
Jul 18 01:47:48.662670 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:47:48.656749    2566 flags.go:64] FLAG: --cpu-cfs-quota="true"
Jul 18 01:47:48.662670 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:47:48.656753    2566 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms"
Jul 18 01:47:48.662670 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:47:48.656759    2566 flags.go:64] FLAG: --cpu-manager-policy="none"
Jul 18 01:47:48.662670 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:47:48.656763    2566 flags.go:64] FLAG: --cpu-manager-policy-options=""
Jul 18 01:47:48.662670 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:47:48.656774    2566 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s"
Jul 18 01:47:48.662670 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:47:48.656778    2566 flags.go:64] FLAG: --enable-controller-attach-detach="true"
Jul 18 01:47:48.662670 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:47:48.656783    2566 flags.go:64] FLAG: --enable-debugging-handlers="true"
Jul 18 01:47:48.662670 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:47:48.656788    2566 flags.go:64] FLAG: --enable-load-reader="false"
Jul 18 01:47:48.662670 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:47:48.656793    2566 flags.go:64] FLAG: --enable-server="true"
Jul 18 01:47:48.662670 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:47:48.656797    2566 flags.go:64] FLAG: --enforce-node-allocatable="[pods]"
Jul 18 01:47:48.662670 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:47:48.656804    2566 flags.go:64] FLAG: --event-burst="100"
Jul 18 01:47:48.662670 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:47:48.656809    2566 flags.go:64] FLAG: --event-qps="50"
Jul 18 01:47:48.662670 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:47:48.656813    2566 flags.go:64] FLAG: --event-storage-age-limit="default=0"
Jul 18 01:47:48.662670 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:47:48.656819    2566 flags.go:64] FLAG: --event-storage-event-limit="default=0"
Jul 18 01:47:48.662670 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:47:48.656823    2566 flags.go:64] FLAG: --eviction-hard=""
Jul 18 01:47:48.662670 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:47:48.656828    2566 flags.go:64] FLAG: --eviction-max-pod-grace-period="0"
Jul 18 01:47:48.662670 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:47:48.656833    2566 flags.go:64] FLAG: --eviction-minimum-reclaim=""
Jul 18 01:47:48.662670 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:47:48.656837    2566 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s"
Jul 18 01:47:48.662670 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:47:48.656842    2566 flags.go:64] FLAG: --eviction-soft=""
Jul 18 01:47:48.662670 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:47:48.656849    2566 flags.go:64] FLAG: --eviction-soft-grace-period=""
Jul 18 01:47:48.662670 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:47:48.656854    2566 flags.go:64] FLAG: --exit-on-lock-contention="false"
Jul 18 01:47:48.663263 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:47:48.656860    2566 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false"
Jul 18 01:47:48.663263 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:47:48.656864    2566 flags.go:64] FLAG: --experimental-mounter-path=""
Jul 18 01:47:48.663263 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:47:48.656869    2566 flags.go:64] FLAG: --fail-cgroupv1="false"
Jul 18 01:47:48.663263 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:47:48.656873    2566 flags.go:64] FLAG: --fail-swap-on="true"
Jul 18 01:47:48.663263 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:47:48.656877    2566 flags.go:64] FLAG: --feature-gates=""
Jul 18 01:47:48.663263 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:47:48.656883    2566 flags.go:64] FLAG: --file-check-frequency="20s"
Jul 18 01:47:48.663263 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:47:48.656888    2566 flags.go:64] FLAG: --global-housekeeping-interval="1m0s"
Jul 18 01:47:48.663263 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:47:48.656893    2566 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge"
Jul 18 01:47:48.663263 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:47:48.656898    2566 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1"
Jul 18 01:47:48.663263 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:47:48.656903    2566 flags.go:64] FLAG: --healthz-port="10248"
Jul 18 01:47:48.663263 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:47:48.656908    2566 flags.go:64] FLAG: --help="false"
Jul 18 01:47:48.663263 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:47:48.656913    2566 flags.go:64] FLAG: --hostname-override="ip-10-0-142-238.ec2.internal"
Jul 18 01:47:48.663263 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:47:48.656917    2566 flags.go:64] FLAG: --housekeeping-interval="10s"
Jul 18 01:47:48.663263 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:47:48.656922    2566 flags.go:64] FLAG: --http-check-frequency="20s"
Jul 18 01:47:48.663263 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:47:48.656927    2566 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins"
Jul 18 01:47:48.663263 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:47:48.656932    2566 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml"
Jul 18 01:47:48.663263 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:47:48.656938    2566 flags.go:64] FLAG: --image-gc-high-threshold="85"
Jul 18 01:47:48.663263 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:47:48.656942    2566 flags.go:64] FLAG: --image-gc-low-threshold="80"
Jul 18 01:47:48.663263 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:47:48.656946    2566 flags.go:64] FLAG: --image-service-endpoint=""
Jul 18 01:47:48.663263 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:47:48.656965    2566 flags.go:64] FLAG: --kernel-memcg-notification="false"
Jul 18 01:47:48.663263 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:47:48.656988    2566 flags.go:64] FLAG: --kube-api-burst="100"
Jul 18 01:47:48.663263 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:47:48.656993    2566 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf"
Jul 18 01:47:48.663263 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:47:48.656998    2566 flags.go:64] FLAG: --kube-api-qps="50"
Jul 18 01:47:48.663263 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:47:48.657001    2566 flags.go:64] FLAG: --kube-reserved=""
Jul 18 01:47:48.663879 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:47:48.657006    2566 flags.go:64] FLAG: --kube-reserved-cgroup=""
Jul 18 01:47:48.663879 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:47:48.657009    2566 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig"
Jul 18 01:47:48.663879 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:47:48.657012    2566 flags.go:64] FLAG: --kubelet-cgroups=""
Jul 18 01:47:48.663879 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:47:48.657015    2566 flags.go:64] FLAG: --local-storage-capacity-isolation="true"
Jul 18 01:47:48.663879 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:47:48.657018    2566 flags.go:64] FLAG: --lock-file=""
Jul 18 01:47:48.663879 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:47:48.657021    2566 flags.go:64] FLAG: --log-cadvisor-usage="false"
Jul 18 01:47:48.663879 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:47:48.657024    2566 flags.go:64] FLAG: --log-flush-frequency="5s"
Jul 18 01:47:48.663879 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:47:48.657027    2566 flags.go:64] FLAG: --log-json-info-buffer-size="0"
Jul 18 01:47:48.663879 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:47:48.657041    2566 flags.go:64] FLAG: --log-json-split-stream="false"
Jul 18 01:47:48.663879 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:47:48.657044    2566 flags.go:64] FLAG: --log-text-info-buffer-size="0"
Jul 18 01:47:48.663879 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:47:48.657047    2566 flags.go:64] FLAG: --log-text-split-stream="false"
Jul 18 01:47:48.663879 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:47:48.657050    2566 flags.go:64] FLAG: --logging-format="text"
Jul 18 01:47:48.663879 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:47:48.657053    2566 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id"
Jul 18 01:47:48.663879 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:47:48.657056    2566 flags.go:64] FLAG: --make-iptables-util-chains="true"
Jul 18 01:47:48.663879 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:47:48.657059    2566 flags.go:64] FLAG: --manifest-url=""
Jul 18 01:47:48.663879 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:47:48.657062    2566 flags.go:64] FLAG: --manifest-url-header=""
Jul 18 01:47:48.663879 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:47:48.657067    2566 flags.go:64] FLAG: --max-housekeeping-interval="15s"
Jul 18 01:47:48.663879 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:47:48.657070    2566 flags.go:64] FLAG: --max-open-files="1000000"
Jul 18 01:47:48.663879 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:47:48.657074    2566 flags.go:64] FLAG: --max-pods="110"
Jul 18 01:47:48.663879 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:47:48.657077    2566 flags.go:64] FLAG: --maximum-dead-containers="-1"
Jul 18 01:47:48.663879 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:47:48.657080    2566 flags.go:64] FLAG: --maximum-dead-containers-per-container="1"
Jul 18 01:47:48.663879 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:47:48.657083    2566 flags.go:64] FLAG: --memory-manager-policy="None"
Jul 18 01:47:48.663879 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:47:48.657086    2566 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s"
Jul 18 01:47:48.663879 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:47:48.657091    2566 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s"
Jul 18 01:47:48.663879 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:47:48.657094    2566 flags.go:64] FLAG: --node-ip="0.0.0.0"
Jul 18 01:47:48.664457 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:47:48.657096    2566 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel"
Jul 18 01:47:48.664457 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:47:48.657106    2566 flags.go:64] FLAG: --node-status-max-images="50"
Jul 18 01:47:48.664457 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:47:48.657109    2566 flags.go:64] FLAG: --node-status-update-frequency="10s"
Jul 18 01:47:48.664457 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:47:48.657113    2566 flags.go:64] FLAG: --oom-score-adj="-999"
Jul 18 01:47:48.664457 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:47:48.657117    2566 flags.go:64] FLAG: --pod-cidr=""
Jul 18 01:47:48.664457 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:47:48.657120    2566 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:4017e99d76d7b91598d3a3430cd0eba6eda8b33653addd3838fdfe3cca69c5a0"
Jul 18 01:47:48.664457 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:47:48.657126    2566 flags.go:64] FLAG: --pod-manifest-path=""
Jul 18 01:47:48.664457 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:47:48.657129    2566 flags.go:64] FLAG: --pod-max-pids="-1"
Jul 18 01:47:48.664457 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:47:48.657132    2566 flags.go:64] FLAG: --pods-per-core="0"
Jul 18 01:47:48.664457 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:47:48.657135    2566 flags.go:64] FLAG: --port="10250"
Jul 18 01:47:48.664457 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:47:48.657139    2566 flags.go:64] FLAG: --protect-kernel-defaults="false"
Jul 18 01:47:48.664457 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:47:48.657142    2566 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-00c7d836fafbbfff5"
Jul 18 01:47:48.664457 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:47:48.657145    2566 flags.go:64] FLAG: --qos-reserved=""
Jul 18 01:47:48.664457 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:47:48.657148    2566 flags.go:64] FLAG: --read-only-port="10255"
Jul 18 01:47:48.664457 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:47:48.657151    2566 flags.go:64] FLAG: --register-node="true"
Jul 18 01:47:48.664457 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:47:48.657153    2566 flags.go:64] FLAG: --register-with-taints=""
Jul 18 01:47:48.664457 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:47:48.657157    2566 flags.go:64] FLAG: --registry-burst="10"
Jul 18 01:47:48.664457 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:47:48.657160    2566 flags.go:64] FLAG: --registry-qps="5"
Jul 18 01:47:48.664457 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:47:48.657163    2566 flags.go:64] FLAG: --reserved-cpus=""
Jul 18 01:47:48.664457 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:47:48.657165    2566 flags.go:64] FLAG: --reserved-memory=""
Jul 18 01:47:48.664457 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:47:48.657169    2566 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf"
Jul 18 01:47:48.664457 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:47:48.657172    2566 flags.go:64] FLAG: --root-dir="/var/lib/kubelet"
Jul 18 01:47:48.664457 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:47:48.657175    2566 flags.go:64] FLAG: --rotate-certificates="false"
Jul 18 01:47:48.664457 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:47:48.657183    2566 flags.go:64] FLAG: --rotate-server-certificates="false"
Jul 18 01:47:48.664457 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:47:48.657186    2566 flags.go:64] FLAG: --runonce="false"
Jul 18 01:47:48.665086 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:47:48.657189    2566 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service"
Jul 18 01:47:48.665086 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:47:48.657192    2566 flags.go:64] FLAG: --runtime-request-timeout="2m0s"
Jul 18 01:47:48.665086 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:47:48.657195    2566 flags.go:64] FLAG: --seccomp-default="false"
Jul 18 01:47:48.665086 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:47:48.657198    2566 flags.go:64] FLAG: --serialize-image-pulls="true"
Jul 18 01:47:48.665086 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:47:48.657201    2566 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s"
Jul 18 01:47:48.665086 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:47:48.657204    2566 flags.go:64] FLAG: --storage-driver-db="cadvisor"
Jul 18 01:47:48.665086 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:47:48.657207    2566 flags.go:64] FLAG: --storage-driver-host="localhost:8086"
Jul 18 01:47:48.665086 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:47:48.657210    2566 flags.go:64] FLAG: --storage-driver-password="root"
Jul 18 01:47:48.665086 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:47:48.657212    2566 flags.go:64] FLAG: --storage-driver-secure="false"
Jul 18 01:47:48.665086 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:47:48.657215    2566 flags.go:64] FLAG: --storage-driver-table="stats"
Jul 18 01:47:48.665086 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:47:48.657218    2566 flags.go:64] FLAG: --storage-driver-user="root"
Jul 18 01:47:48.665086 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:47:48.657224    2566 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s"
Jul 18 01:47:48.665086 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:47:48.657228    2566 flags.go:64] FLAG: --sync-frequency="1m0s"
Jul 18 01:47:48.665086 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:47:48.657231    2566 flags.go:64] FLAG: --system-cgroups=""
Jul 18 01:47:48.665086 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:47:48.657233    2566 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi"
Jul 18 01:47:48.665086 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:47:48.657240    2566 flags.go:64] FLAG: --system-reserved-cgroup=""
Jul 18 01:47:48.665086 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:47:48.657243    2566 flags.go:64] FLAG: --tls-cert-file=""
Jul 18 01:47:48.665086 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:47:48.657245    2566 flags.go:64] FLAG: --tls-cipher-suites="[]"
Jul 18 01:47:48.665086 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:47:48.657907    2566 flags.go:64] FLAG: --tls-min-version=""
Jul 18 01:47:48.665086 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:47:48.657912    2566 flags.go:64] FLAG: --tls-private-key-file=""
Jul 18 01:47:48.665086 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:47:48.657915    2566 flags.go:64] FLAG: --topology-manager-policy="none"
Jul 18 01:47:48.665086 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:47:48.657918    2566 flags.go:64] FLAG: --topology-manager-policy-options=""
Jul 18 01:47:48.665086 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:47:48.657922    2566 flags.go:64] FLAG: --topology-manager-scope="container"
Jul 18 01:47:48.665086 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:47:48.657925    2566 flags.go:64] FLAG: --v="2"
Jul 18 01:47:48.665086 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:47:48.657929    2566 flags.go:64] FLAG: --version="false"
Jul 18 01:47:48.665689 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:47:48.657933    2566 flags.go:64] FLAG: --vmodule=""
Jul 18 01:47:48.665689 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:47:48.657937    2566 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec"
Jul 18 01:47:48.665689 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:47:48.657940    2566 flags.go:64] FLAG: --volume-stats-agg-period="1m0s"
Jul 18 01:47:48.665689 ip-10-0-142-238 kubenswrapper[2566]: W0718 01:47:48.658058    2566 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 18 01:47:48.665689 ip-10-0-142-238 kubenswrapper[2566]: W0718 01:47:48.658062    2566 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 18 01:47:48.665689 ip-10-0-142-238 kubenswrapper[2566]: W0718 01:47:48.658065    2566 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 18 01:47:48.665689 ip-10-0-142-238 kubenswrapper[2566]: W0718 01:47:48.658069    2566 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 18 01:47:48.665689 ip-10-0-142-238 kubenswrapper[2566]: W0718 01:47:48.658072    2566 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 18 01:47:48.665689 ip-10-0-142-238 kubenswrapper[2566]: W0718 01:47:48.658075    2566 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 18 01:47:48.665689 ip-10-0-142-238 kubenswrapper[2566]: W0718 01:47:48.658077    2566 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 18 01:47:48.665689 ip-10-0-142-238 kubenswrapper[2566]: W0718 01:47:48.658080    2566 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 18 01:47:48.665689 ip-10-0-142-238 kubenswrapper[2566]: W0718 01:47:48.658082    2566 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 18 01:47:48.665689 ip-10-0-142-238 kubenswrapper[2566]: W0718 01:47:48.658085    2566 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 18 01:47:48.665689 ip-10-0-142-238 kubenswrapper[2566]: W0718 01:47:48.658088    2566 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 18 01:47:48.665689 ip-10-0-142-238 kubenswrapper[2566]: W0718 01:47:48.658092    2566 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 18 01:47:48.665689 ip-10-0-142-238 kubenswrapper[2566]: W0718 01:47:48.658096    2566 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 18 01:47:48.665689 ip-10-0-142-238 kubenswrapper[2566]: W0718 01:47:48.658099    2566 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 18 01:47:48.665689 ip-10-0-142-238 kubenswrapper[2566]: W0718 01:47:48.658102    2566 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 18 01:47:48.665689 ip-10-0-142-238 kubenswrapper[2566]: W0718 01:47:48.658107    2566 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 18 01:47:48.665689 ip-10-0-142-238 kubenswrapper[2566]: W0718 01:47:48.658110    2566 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 18 01:47:48.666199 ip-10-0-142-238 kubenswrapper[2566]: W0718 01:47:48.658113    2566 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 18 01:47:48.666199 ip-10-0-142-238 kubenswrapper[2566]: W0718 01:47:48.658116    2566 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 18 01:47:48.666199 ip-10-0-142-238 kubenswrapper[2566]: W0718 01:47:48.658118    2566 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 18 01:47:48.666199 ip-10-0-142-238 kubenswrapper[2566]: W0718 01:47:48.658122    2566 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 18 01:47:48.666199 ip-10-0-142-238 kubenswrapper[2566]: W0718 01:47:48.658125    2566 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 18 01:47:48.666199 ip-10-0-142-238 kubenswrapper[2566]: W0718 01:47:48.658128    2566 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 18 01:47:48.666199 ip-10-0-142-238 kubenswrapper[2566]: W0718 01:47:48.658131    2566 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 18 01:47:48.666199 ip-10-0-142-238 kubenswrapper[2566]: W0718 01:47:48.658134    2566 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 18 01:47:48.666199 ip-10-0-142-238 kubenswrapper[2566]: W0718 01:47:48.658136    2566 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 18 01:47:48.666199 ip-10-0-142-238 kubenswrapper[2566]: W0718 01:47:48.658139    2566 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 18 01:47:48.666199 ip-10-0-142-238 kubenswrapper[2566]: W0718 01:47:48.658142    2566 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 18 01:47:48.666199 ip-10-0-142-238 kubenswrapper[2566]: W0718 01:47:48.658144    2566 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 18 01:47:48.666199 ip-10-0-142-238 kubenswrapper[2566]: W0718 01:47:48.658147    2566 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 18 01:47:48.666199 ip-10-0-142-238 kubenswrapper[2566]: W0718 01:47:48.658150    2566 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 18 01:47:48.666199 ip-10-0-142-238 kubenswrapper[2566]: W0718 01:47:48.658152    2566 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 18 01:47:48.666199 ip-10-0-142-238 kubenswrapper[2566]: W0718 01:47:48.658155    2566 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 18 01:47:48.666199 ip-10-0-142-238 kubenswrapper[2566]: W0718 01:47:48.658158    2566 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 18 01:47:48.666199 ip-10-0-142-238 kubenswrapper[2566]: W0718 01:47:48.658161    2566 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 18 01:47:48.666199 ip-10-0-142-238 kubenswrapper[2566]: W0718 01:47:48.658163    2566 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 18 01:47:48.666668 ip-10-0-142-238 kubenswrapper[2566]: W0718 01:47:48.658166    2566 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 18 01:47:48.666668 ip-10-0-142-238 kubenswrapper[2566]: W0718 01:47:48.658168    2566 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 18 01:47:48.666668 ip-10-0-142-238 kubenswrapper[2566]: W0718 01:47:48.658171    2566 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 18 01:47:48.666668 ip-10-0-142-238 kubenswrapper[2566]: W0718 01:47:48.658173    2566 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 18 01:47:48.666668 ip-10-0-142-238 kubenswrapper[2566]: W0718 01:47:48.658176    2566 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 18 01:47:48.666668 ip-10-0-142-238 kubenswrapper[2566]: W0718 01:47:48.658178    2566 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 18 01:47:48.666668 ip-10-0-142-238 kubenswrapper[2566]: W0718 01:47:48.658181    2566 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 18 01:47:48.666668 ip-10-0-142-238 kubenswrapper[2566]: W0718 01:47:48.658183    2566 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 18 01:47:48.666668 ip-10-0-142-238 kubenswrapper[2566]: W0718 01:47:48.658186    2566 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 18 01:47:48.666668 ip-10-0-142-238 kubenswrapper[2566]: W0718 01:47:48.658188    2566 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 18 01:47:48.666668 ip-10-0-142-238 kubenswrapper[2566]: W0718 01:47:48.658191    2566 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 18 01:47:48.666668 ip-10-0-142-238 kubenswrapper[2566]: W0718 01:47:48.658194    2566 feature_gate.go:328] unrecognized feature gate: Example
Jul 18 01:47:48.666668 ip-10-0-142-238 kubenswrapper[2566]: W0718 01:47:48.658197    2566 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 18 01:47:48.666668 ip-10-0-142-238 kubenswrapper[2566]: W0718 01:47:48.658199    2566 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 18 01:47:48.666668 ip-10-0-142-238 kubenswrapper[2566]: W0718 01:47:48.658203    2566 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 18 01:47:48.666668 ip-10-0-142-238 kubenswrapper[2566]: W0718 01:47:48.658205    2566 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 18 01:47:48.666668 ip-10-0-142-238 kubenswrapper[2566]: W0718 01:47:48.658209    2566 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 18 01:47:48.666668 ip-10-0-142-238 kubenswrapper[2566]: W0718 01:47:48.658213    2566 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 18 01:47:48.666668 ip-10-0-142-238 kubenswrapper[2566]: W0718 01:47:48.658216    2566 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 18 01:47:48.666668 ip-10-0-142-238 kubenswrapper[2566]: W0718 01:47:48.658218    2566 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 18 01:47:48.667223 ip-10-0-142-238 kubenswrapper[2566]: W0718 01:47:48.658221    2566 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 18 01:47:48.667223 ip-10-0-142-238 kubenswrapper[2566]: W0718 01:47:48.658224    2566 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 18 01:47:48.667223 ip-10-0-142-238 kubenswrapper[2566]: W0718 01:47:48.658226    2566 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 18 01:47:48.667223 ip-10-0-142-238 kubenswrapper[2566]: W0718 01:47:48.658229    2566 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 18 01:47:48.667223 ip-10-0-142-238 kubenswrapper[2566]: W0718 01:47:48.658231    2566 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 18 01:47:48.667223 ip-10-0-142-238 kubenswrapper[2566]: W0718 01:47:48.658234    2566 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 18 01:47:48.667223 ip-10-0-142-238 kubenswrapper[2566]: W0718 01:47:48.658239    2566 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 18 01:47:48.667223 ip-10-0-142-238 kubenswrapper[2566]: W0718 01:47:48.658242    2566 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 18 01:47:48.667223 ip-10-0-142-238 kubenswrapper[2566]: W0718 01:47:48.658244    2566 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 18 01:47:48.667223 ip-10-0-142-238 kubenswrapper[2566]: W0718 01:47:48.658247    2566 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 18 01:47:48.667223 ip-10-0-142-238 kubenswrapper[2566]: W0718 01:47:48.658249    2566 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 18 01:47:48.667223 ip-10-0-142-238 kubenswrapper[2566]: W0718 01:47:48.658252    2566 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 18 01:47:48.667223 ip-10-0-142-238 kubenswrapper[2566]: W0718 01:47:48.658254    2566 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 18 01:47:48.667223 ip-10-0-142-238 kubenswrapper[2566]: W0718 01:47:48.658257    2566 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 18 01:47:48.667223 ip-10-0-142-238 kubenswrapper[2566]: W0718 01:47:48.658259    2566 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 18 01:47:48.667223 ip-10-0-142-238 kubenswrapper[2566]: W0718 01:47:48.658262    2566 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 18 01:47:48.667223 ip-10-0-142-238 kubenswrapper[2566]: W0718 01:47:48.658264    2566 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 18 01:47:48.667223 ip-10-0-142-238 kubenswrapper[2566]: W0718 01:47:48.658267    2566 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 18 01:47:48.667223 ip-10-0-142-238 kubenswrapper[2566]: W0718 01:47:48.658269    2566 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 18 01:47:48.667223 ip-10-0-142-238 kubenswrapper[2566]: W0718 01:47:48.658272    2566 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 18 01:47:48.667787 ip-10-0-142-238 kubenswrapper[2566]: W0718 01:47:48.658274    2566 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 18 01:47:48.667787 ip-10-0-142-238 kubenswrapper[2566]: W0718 01:47:48.658277    2566 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 18 01:47:48.667787 ip-10-0-142-238 kubenswrapper[2566]: W0718 01:47:48.658279    2566 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 18 01:47:48.667787 ip-10-0-142-238 kubenswrapper[2566]: W0718 01:47:48.658283    2566 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 18 01:47:48.667787 ip-10-0-142-238 kubenswrapper[2566]: W0718 01:47:48.658286    2566 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 18 01:47:48.667787 ip-10-0-142-238 kubenswrapper[2566]: W0718 01:47:48.658288    2566 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 18 01:47:48.667787 ip-10-0-142-238 kubenswrapper[2566]: W0718 01:47:48.658291    2566 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 18 01:47:48.667787 ip-10-0-142-238 kubenswrapper[2566]: W0718 01:47:48.658294    2566 feature_gate.go:328] unrecognized feature gate: Example2
Jul 18 01:47:48.667787 ip-10-0-142-238 kubenswrapper[2566]: W0718 01:47:48.658297    2566 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 18 01:47:48.667787 ip-10-0-142-238 kubenswrapper[2566]: W0718 01:47:48.658299    2566 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 18 01:47:48.667787 ip-10-0-142-238 kubenswrapper[2566]: W0718 01:47:48.658302    2566 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 18 01:47:48.667787 ip-10-0-142-238 kubenswrapper[2566]: W0718 01:47:48.658304    2566 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 18 01:47:48.667787 ip-10-0-142-238 kubenswrapper[2566]: W0718 01:47:48.658307    2566 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 18 01:47:48.667787 ip-10-0-142-238 kubenswrapper[2566]: W0718 01:47:48.658309    2566 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 18 01:47:48.667787 ip-10-0-142-238 kubenswrapper[2566]: W0718 01:47:48.658312    2566 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 18 01:47:48.667787 ip-10-0-142-238 kubenswrapper[2566]: W0718 01:47:48.658314    2566 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 18 01:47:48.667787 ip-10-0-142-238 kubenswrapper[2566]: W0718 01:47:48.658317    2566 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 18 01:47:48.667787 ip-10-0-142-238 kubenswrapper[2566]: W0718 01:47:48.658319    2566 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 18 01:47:48.667787 ip-10-0-142-238 kubenswrapper[2566]: W0718 01:47:48.658323    2566 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 18 01:47:48.667787 ip-10-0-142-238 kubenswrapper[2566]: W0718 01:47:48.658326    2566 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 18 01:47:48.668274 ip-10-0-142-238 kubenswrapper[2566]: W0718 01:47:48.658329    2566 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 18 01:47:48.668274 ip-10-0-142-238 kubenswrapper[2566]: W0718 01:47:48.658331    2566 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 18 01:47:48.668274 ip-10-0-142-238 kubenswrapper[2566]: W0718 01:47:48.658334    2566 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 18 01:47:48.668274 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:47:48.658342    2566 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 18 01:47:48.668274 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:47:48.665069    2566 server.go:529] "Kubelet version" kubeletVersion="v1.34.9"
Jul 18 01:47:48.668274 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:47:48.665086    2566 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK=""
Jul 18 01:47:48.668274 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:47:48.665106    2566 watchdog_linux.go:95] "Systemd watchdog is not enabled"
Jul 18 01:47:48.668274 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:47:48.665112    2566 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started."
Jul 18 01:47:48.668274 ip-10-0-142-238 kubenswrapper[2566]: W0718 01:47:48.665165    2566 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 18 01:47:48.668274 ip-10-0-142-238 kubenswrapper[2566]: W0718 01:47:48.665170    2566 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 18 01:47:48.668274 ip-10-0-142-238 kubenswrapper[2566]: W0718 01:47:48.665173    2566 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 18 01:47:48.668274 ip-10-0-142-238 kubenswrapper[2566]: W0718 01:47:48.665183    2566 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 18 01:47:48.668274 ip-10-0-142-238 kubenswrapper[2566]: W0718 01:47:48.665187    2566 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 18 01:47:48.668274 ip-10-0-142-238 kubenswrapper[2566]: W0718 01:47:48.665190    2566 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 18 01:47:48.668274 ip-10-0-142-238 kubenswrapper[2566]: W0718 01:47:48.665193    2566 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 18 01:47:48.668699 ip-10-0-142-238 kubenswrapper[2566]: W0718 01:47:48.665196    2566 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 18 01:47:48.668699 ip-10-0-142-238 kubenswrapper[2566]: W0718 01:47:48.665199    2566 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 18 01:47:48.668699 ip-10-0-142-238 kubenswrapper[2566]: W0718 01:47:48.665202    2566 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 18 01:47:48.668699 ip-10-0-142-238 kubenswrapper[2566]: W0718 01:47:48.665204    2566 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 18 01:47:48.668699 ip-10-0-142-238 kubenswrapper[2566]: W0718 01:47:48.665207    2566 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 18 01:47:48.668699 ip-10-0-142-238 kubenswrapper[2566]: W0718 01:47:48.665210    2566 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 18 01:47:48.668699 ip-10-0-142-238 kubenswrapper[2566]: W0718 01:47:48.665213    2566 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 18 01:47:48.668699 ip-10-0-142-238 kubenswrapper[2566]: W0718 01:47:48.665215    2566 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 18 01:47:48.668699 ip-10-0-142-238 kubenswrapper[2566]: W0718 01:47:48.665218    2566 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 18 01:47:48.668699 ip-10-0-142-238 kubenswrapper[2566]: W0718 01:47:48.665221    2566 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 18 01:47:48.668699 ip-10-0-142-238 kubenswrapper[2566]: W0718 01:47:48.665223    2566 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 18 01:47:48.668699 ip-10-0-142-238 kubenswrapper[2566]: W0718 01:47:48.665226    2566 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 18 01:47:48.668699 ip-10-0-142-238 kubenswrapper[2566]: W0718 01:47:48.665229    2566 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 18 01:47:48.668699 ip-10-0-142-238 kubenswrapper[2566]: W0718 01:47:48.665231    2566 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 18 01:47:48.668699 ip-10-0-142-238 kubenswrapper[2566]: W0718 01:47:48.665234    2566 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 18 01:47:48.668699 ip-10-0-142-238 kubenswrapper[2566]: W0718 01:47:48.665236    2566 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 18 01:47:48.668699 ip-10-0-142-238 kubenswrapper[2566]: W0718 01:47:48.665239    2566 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 18 01:47:48.668699 ip-10-0-142-238 kubenswrapper[2566]: W0718 01:47:48.665241    2566 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 18 01:47:48.668699 ip-10-0-142-238 kubenswrapper[2566]: W0718 01:47:48.665244    2566 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 18 01:47:48.668699 ip-10-0-142-238 kubenswrapper[2566]: W0718 01:47:48.665246    2566 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 18 01:47:48.669167 ip-10-0-142-238 kubenswrapper[2566]: W0718 01:47:48.665249    2566 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 18 01:47:48.669167 ip-10-0-142-238 kubenswrapper[2566]: W0718 01:47:48.665252    2566 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 18 01:47:48.669167 ip-10-0-142-238 kubenswrapper[2566]: W0718 01:47:48.665256    2566 feature_gate.go:328] unrecognized feature gate: Example2
Jul 18 01:47:48.669167 ip-10-0-142-238 kubenswrapper[2566]: W0718 01:47:48.665259    2566 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 18 01:47:48.669167 ip-10-0-142-238 kubenswrapper[2566]: W0718 01:47:48.665262    2566 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 18 01:47:48.669167 ip-10-0-142-238 kubenswrapper[2566]: W0718 01:47:48.665264    2566 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 18 01:47:48.669167 ip-10-0-142-238 kubenswrapper[2566]: W0718 01:47:48.665269    2566 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 18 01:47:48.669167 ip-10-0-142-238 kubenswrapper[2566]: W0718 01:47:48.665273    2566 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 18 01:47:48.669167 ip-10-0-142-238 kubenswrapper[2566]: W0718 01:47:48.665276    2566 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 18 01:47:48.669167 ip-10-0-142-238 kubenswrapper[2566]: W0718 01:47:48.665278    2566 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 18 01:47:48.669167 ip-10-0-142-238 kubenswrapper[2566]: W0718 01:47:48.665281    2566 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 18 01:47:48.669167 ip-10-0-142-238 kubenswrapper[2566]: W0718 01:47:48.665283    2566 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 18 01:47:48.669167 ip-10-0-142-238 kubenswrapper[2566]: W0718 01:47:48.665286    2566 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 18 01:47:48.669167 ip-10-0-142-238 kubenswrapper[2566]: W0718 01:47:48.665288    2566 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 18 01:47:48.669167 ip-10-0-142-238 kubenswrapper[2566]: W0718 01:47:48.665291    2566 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 18 01:47:48.669167 ip-10-0-142-238 kubenswrapper[2566]: W0718 01:47:48.665293    2566 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 18 01:47:48.669167 ip-10-0-142-238 kubenswrapper[2566]: W0718 01:47:48.665296    2566 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 18 01:47:48.669167 ip-10-0-142-238 kubenswrapper[2566]: W0718 01:47:48.665298    2566 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 18 01:47:48.669167 ip-10-0-142-238 kubenswrapper[2566]: W0718 01:47:48.665301    2566 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 18 01:47:48.669648 ip-10-0-142-238 kubenswrapper[2566]: W0718 01:47:48.665303    2566 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 18 01:47:48.669648 ip-10-0-142-238 kubenswrapper[2566]: W0718 01:47:48.665306    2566 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 18 01:47:48.669648 ip-10-0-142-238 kubenswrapper[2566]: W0718 01:47:48.665308    2566 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 18 01:47:48.669648 ip-10-0-142-238 kubenswrapper[2566]: W0718 01:47:48.665311    2566 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 18 01:47:48.669648 ip-10-0-142-238 kubenswrapper[2566]: W0718 01:47:48.665313    2566 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 18 01:47:48.669648 ip-10-0-142-238 kubenswrapper[2566]: W0718 01:47:48.665315    2566 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 18 01:47:48.669648 ip-10-0-142-238 kubenswrapper[2566]: W0718 01:47:48.665318    2566 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 18 01:47:48.669648 ip-10-0-142-238 kubenswrapper[2566]: W0718 01:47:48.665320    2566 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 18 01:47:48.669648 ip-10-0-142-238 kubenswrapper[2566]: W0718 01:47:48.665323    2566 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 18 01:47:48.669648 ip-10-0-142-238 kubenswrapper[2566]: W0718 01:47:48.665325    2566 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 18 01:47:48.669648 ip-10-0-142-238 kubenswrapper[2566]: W0718 01:47:48.665327    2566 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 18 01:47:48.669648 ip-10-0-142-238 kubenswrapper[2566]: W0718 01:47:48.665330    2566 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 18 01:47:48.669648 ip-10-0-142-238 kubenswrapper[2566]: W0718 01:47:48.665332    2566 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 18 01:47:48.669648 ip-10-0-142-238 kubenswrapper[2566]: W0718 01:47:48.665335    2566 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 18 01:47:48.669648 ip-10-0-142-238 kubenswrapper[2566]: W0718 01:47:48.665338    2566 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 18 01:47:48.669648 ip-10-0-142-238 kubenswrapper[2566]: W0718 01:47:48.665341    2566 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 18 01:47:48.669648 ip-10-0-142-238 kubenswrapper[2566]: W0718 01:47:48.665344    2566 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 18 01:47:48.669648 ip-10-0-142-238 kubenswrapper[2566]: W0718 01:47:48.665347    2566 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 18 01:47:48.669648 ip-10-0-142-238 kubenswrapper[2566]: W0718 01:47:48.665350    2566 feature_gate.go:328] unrecognized feature gate: Example
Jul 18 01:47:48.669648 ip-10-0-142-238 kubenswrapper[2566]: W0718 01:47:48.665352    2566 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 18 01:47:48.670190 ip-10-0-142-238 kubenswrapper[2566]: W0718 01:47:48.665355    2566 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 18 01:47:48.670190 ip-10-0-142-238 kubenswrapper[2566]: W0718 01:47:48.665357    2566 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 18 01:47:48.670190 ip-10-0-142-238 kubenswrapper[2566]: W0718 01:47:48.665360    2566 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 18 01:47:48.670190 ip-10-0-142-238 kubenswrapper[2566]: W0718 01:47:48.665362    2566 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 18 01:47:48.670190 ip-10-0-142-238 kubenswrapper[2566]: W0718 01:47:48.665365    2566 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 18 01:47:48.670190 ip-10-0-142-238 kubenswrapper[2566]: W0718 01:47:48.665367    2566 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 18 01:47:48.670190 ip-10-0-142-238 kubenswrapper[2566]: W0718 01:47:48.665369    2566 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 18 01:47:48.670190 ip-10-0-142-238 kubenswrapper[2566]: W0718 01:47:48.665372    2566 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 18 01:47:48.670190 ip-10-0-142-238 kubenswrapper[2566]: W0718 01:47:48.665374    2566 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 18 01:47:48.670190 ip-10-0-142-238 kubenswrapper[2566]: W0718 01:47:48.665377    2566 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 18 01:47:48.670190 ip-10-0-142-238 kubenswrapper[2566]: W0718 01:47:48.665379    2566 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 18 01:47:48.670190 ip-10-0-142-238 kubenswrapper[2566]: W0718 01:47:48.665381    2566 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 18 01:47:48.670190 ip-10-0-142-238 kubenswrapper[2566]: W0718 01:47:48.665384    2566 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 18 01:47:48.670190 ip-10-0-142-238 kubenswrapper[2566]: W0718 01:47:48.665388    2566 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 18 01:47:48.670190 ip-10-0-142-238 kubenswrapper[2566]: W0718 01:47:48.665391    2566 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 18 01:47:48.670190 ip-10-0-142-238 kubenswrapper[2566]: W0718 01:47:48.665394    2566 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 18 01:47:48.670190 ip-10-0-142-238 kubenswrapper[2566]: W0718 01:47:48.665397    2566 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 18 01:47:48.670190 ip-10-0-142-238 kubenswrapper[2566]: W0718 01:47:48.665399    2566 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 18 01:47:48.670190 ip-10-0-142-238 kubenswrapper[2566]: W0718 01:47:48.665403    2566 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 18 01:47:48.670941 ip-10-0-142-238 kubenswrapper[2566]: W0718 01:47:48.665406    2566 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 18 01:47:48.670941 ip-10-0-142-238 kubenswrapper[2566]: W0718 01:47:48.665409    2566 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 18 01:47:48.670941 ip-10-0-142-238 kubenswrapper[2566]: W0718 01:47:48.665412    2566 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 18 01:47:48.670941 ip-10-0-142-238 kubenswrapper[2566]: W0718 01:47:48.665414    2566 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 18 01:47:48.670941 ip-10-0-142-238 kubenswrapper[2566]: W0718 01:47:48.665417    2566 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 18 01:47:48.670941 ip-10-0-142-238 kubenswrapper[2566]: W0718 01:47:48.665420    2566 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 18 01:47:48.670941 ip-10-0-142-238 kubenswrapper[2566]: W0718 01:47:48.665423    2566 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 18 01:47:48.670941 ip-10-0-142-238 kubenswrapper[2566]: W0718 01:47:48.665427    2566 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 18 01:47:48.670941 ip-10-0-142-238 kubenswrapper[2566]: W0718 01:47:48.665429    2566 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 18 01:47:48.670941 ip-10-0-142-238 kubenswrapper[2566]: W0718 01:47:48.665432    2566 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 18 01:47:48.670941 ip-10-0-142-238 kubenswrapper[2566]: W0718 01:47:48.665436    2566 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 18 01:47:48.670941 ip-10-0-142-238 kubenswrapper[2566]: W0718 01:47:48.665438    2566 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 18 01:47:48.670941 ip-10-0-142-238 kubenswrapper[2566]: W0718 01:47:48.665441    2566 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 18 01:47:48.670941 ip-10-0-142-238 kubenswrapper[2566]: W0718 01:47:48.665444    2566 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 18 01:47:48.670941 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:47:48.665449    2566 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 18 01:47:48.671374 ip-10-0-142-238 kubenswrapper[2566]: W0718 01:47:48.665556    2566 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 18 01:47:48.671374 ip-10-0-142-238 kubenswrapper[2566]: W0718 01:47:48.665560    2566 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 18 01:47:48.671374 ip-10-0-142-238 kubenswrapper[2566]: W0718 01:47:48.665563    2566 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 18 01:47:48.671374 ip-10-0-142-238 kubenswrapper[2566]: W0718 01:47:48.665566    2566 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 18 01:47:48.671374 ip-10-0-142-238 kubenswrapper[2566]: W0718 01:47:48.665569    2566 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 18 01:47:48.671374 ip-10-0-142-238 kubenswrapper[2566]: W0718 01:47:48.665572    2566 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 18 01:47:48.671374 ip-10-0-142-238 kubenswrapper[2566]: W0718 01:47:48.665575    2566 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 18 01:47:48.671374 ip-10-0-142-238 kubenswrapper[2566]: W0718 01:47:48.665578    2566 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 18 01:47:48.671374 ip-10-0-142-238 kubenswrapper[2566]: W0718 01:47:48.665581    2566 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 18 01:47:48.671374 ip-10-0-142-238 kubenswrapper[2566]: W0718 01:47:48.665584    2566 feature_gate.go:328] unrecognized feature gate: Example
Jul 18 01:47:48.671374 ip-10-0-142-238 kubenswrapper[2566]: W0718 01:47:48.665588    2566 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 18 01:47:48.671374 ip-10-0-142-238 kubenswrapper[2566]: W0718 01:47:48.665592    2566 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 18 01:47:48.671374 ip-10-0-142-238 kubenswrapper[2566]: W0718 01:47:48.665594    2566 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 18 01:47:48.671374 ip-10-0-142-238 kubenswrapper[2566]: W0718 01:47:48.665597    2566 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 18 01:47:48.671374 ip-10-0-142-238 kubenswrapper[2566]: W0718 01:47:48.665600    2566 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 18 01:47:48.671374 ip-10-0-142-238 kubenswrapper[2566]: W0718 01:47:48.665603    2566 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 18 01:47:48.671374 ip-10-0-142-238 kubenswrapper[2566]: W0718 01:47:48.665606    2566 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 18 01:47:48.671374 ip-10-0-142-238 kubenswrapper[2566]: W0718 01:47:48.665621    2566 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 18 01:47:48.671374 ip-10-0-142-238 kubenswrapper[2566]: W0718 01:47:48.665624    2566 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 18 01:47:48.671857 ip-10-0-142-238 kubenswrapper[2566]: W0718 01:47:48.665627    2566 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 18 01:47:48.671857 ip-10-0-142-238 kubenswrapper[2566]: W0718 01:47:48.665630    2566 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 18 01:47:48.671857 ip-10-0-142-238 kubenswrapper[2566]: W0718 01:47:48.665632    2566 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 18 01:47:48.671857 ip-10-0-142-238 kubenswrapper[2566]: W0718 01:47:48.665635    2566 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 18 01:47:48.671857 ip-10-0-142-238 kubenswrapper[2566]: W0718 01:47:48.665637    2566 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 18 01:47:48.671857 ip-10-0-142-238 kubenswrapper[2566]: W0718 01:47:48.665640    2566 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 18 01:47:48.671857 ip-10-0-142-238 kubenswrapper[2566]: W0718 01:47:48.665643    2566 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 18 01:47:48.671857 ip-10-0-142-238 kubenswrapper[2566]: W0718 01:47:48.665645    2566 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 18 01:47:48.671857 ip-10-0-142-238 kubenswrapper[2566]: W0718 01:47:48.665648    2566 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 18 01:47:48.671857 ip-10-0-142-238 kubenswrapper[2566]: W0718 01:47:48.665652    2566 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 18 01:47:48.671857 ip-10-0-142-238 kubenswrapper[2566]: W0718 01:47:48.665655    2566 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 18 01:47:48.671857 ip-10-0-142-238 kubenswrapper[2566]: W0718 01:47:48.665657    2566 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 18 01:47:48.671857 ip-10-0-142-238 kubenswrapper[2566]: W0718 01:47:48.665660    2566 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 18 01:47:48.671857 ip-10-0-142-238 kubenswrapper[2566]: W0718 01:47:48.665662    2566 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 18 01:47:48.671857 ip-10-0-142-238 kubenswrapper[2566]: W0718 01:47:48.665665    2566 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 18 01:47:48.671857 ip-10-0-142-238 kubenswrapper[2566]: W0718 01:47:48.665667    2566 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 18 01:47:48.671857 ip-10-0-142-238 kubenswrapper[2566]: W0718 01:47:48.665670    2566 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 18 01:47:48.671857 ip-10-0-142-238 kubenswrapper[2566]: W0718 01:47:48.665674    2566 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 18 01:47:48.671857 ip-10-0-142-238 kubenswrapper[2566]: W0718 01:47:48.665676    2566 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 18 01:47:48.672306 ip-10-0-142-238 kubenswrapper[2566]: W0718 01:47:48.665679    2566 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 18 01:47:48.672306 ip-10-0-142-238 kubenswrapper[2566]: W0718 01:47:48.665681    2566 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 18 01:47:48.672306 ip-10-0-142-238 kubenswrapper[2566]: W0718 01:47:48.665683    2566 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 18 01:47:48.672306 ip-10-0-142-238 kubenswrapper[2566]: W0718 01:47:48.665686    2566 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 18 01:47:48.672306 ip-10-0-142-238 kubenswrapper[2566]: W0718 01:47:48.665688    2566 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 18 01:47:48.672306 ip-10-0-142-238 kubenswrapper[2566]: W0718 01:47:48.665691    2566 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 18 01:47:48.672306 ip-10-0-142-238 kubenswrapper[2566]: W0718 01:47:48.665693    2566 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 18 01:47:48.672306 ip-10-0-142-238 kubenswrapper[2566]: W0718 01:47:48.665697    2566 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 18 01:47:48.672306 ip-10-0-142-238 kubenswrapper[2566]: W0718 01:47:48.665699    2566 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 18 01:47:48.672306 ip-10-0-142-238 kubenswrapper[2566]: W0718 01:47:48.665702    2566 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 18 01:47:48.672306 ip-10-0-142-238 kubenswrapper[2566]: W0718 01:47:48.665705    2566 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 18 01:47:48.672306 ip-10-0-142-238 kubenswrapper[2566]: W0718 01:47:48.665707    2566 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 18 01:47:48.672306 ip-10-0-142-238 kubenswrapper[2566]: W0718 01:47:48.665710    2566 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 18 01:47:48.672306 ip-10-0-142-238 kubenswrapper[2566]: W0718 01:47:48.665712    2566 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 18 01:47:48.672306 ip-10-0-142-238 kubenswrapper[2566]: W0718 01:47:48.665715    2566 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 18 01:47:48.672306 ip-10-0-142-238 kubenswrapper[2566]: W0718 01:47:48.665717    2566 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 18 01:47:48.672306 ip-10-0-142-238 kubenswrapper[2566]: W0718 01:47:48.665720    2566 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 18 01:47:48.672306 ip-10-0-142-238 kubenswrapper[2566]: W0718 01:47:48.665722    2566 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 18 01:47:48.672306 ip-10-0-142-238 kubenswrapper[2566]: W0718 01:47:48.665725    2566 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 18 01:47:48.672306 ip-10-0-142-238 kubenswrapper[2566]: W0718 01:47:48.665728    2566 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 18 01:47:48.672913 ip-10-0-142-238 kubenswrapper[2566]: W0718 01:47:48.665730    2566 feature_gate.go:328] unrecognized feature gate: Example2
Jul 18 01:47:48.672913 ip-10-0-142-238 kubenswrapper[2566]: W0718 01:47:48.665732    2566 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 18 01:47:48.672913 ip-10-0-142-238 kubenswrapper[2566]: W0718 01:47:48.665735    2566 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 18 01:47:48.672913 ip-10-0-142-238 kubenswrapper[2566]: W0718 01:47:48.665738    2566 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 18 01:47:48.672913 ip-10-0-142-238 kubenswrapper[2566]: W0718 01:47:48.665740    2566 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 18 01:47:48.672913 ip-10-0-142-238 kubenswrapper[2566]: W0718 01:47:48.665743    2566 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 18 01:47:48.672913 ip-10-0-142-238 kubenswrapper[2566]: W0718 01:47:48.665745    2566 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 18 01:47:48.672913 ip-10-0-142-238 kubenswrapper[2566]: W0718 01:47:48.665748    2566 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 18 01:47:48.672913 ip-10-0-142-238 kubenswrapper[2566]: W0718 01:47:48.665750    2566 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 18 01:47:48.672913 ip-10-0-142-238 kubenswrapper[2566]: W0718 01:47:48.665753    2566 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 18 01:47:48.672913 ip-10-0-142-238 kubenswrapper[2566]: W0718 01:47:48.665755    2566 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 18 01:47:48.672913 ip-10-0-142-238 kubenswrapper[2566]: W0718 01:47:48.665758    2566 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 18 01:47:48.672913 ip-10-0-142-238 kubenswrapper[2566]: W0718 01:47:48.665760    2566 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 18 01:47:48.672913 ip-10-0-142-238 kubenswrapper[2566]: W0718 01:47:48.665763    2566 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 18 01:47:48.672913 ip-10-0-142-238 kubenswrapper[2566]: W0718 01:47:48.665765    2566 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 18 01:47:48.672913 ip-10-0-142-238 kubenswrapper[2566]: W0718 01:47:48.665767    2566 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 18 01:47:48.672913 ip-10-0-142-238 kubenswrapper[2566]: W0718 01:47:48.665770    2566 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 18 01:47:48.672913 ip-10-0-142-238 kubenswrapper[2566]: W0718 01:47:48.665772    2566 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 18 01:47:48.672913 ip-10-0-142-238 kubenswrapper[2566]: W0718 01:47:48.665775    2566 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 18 01:47:48.673362 ip-10-0-142-238 kubenswrapper[2566]: W0718 01:47:48.665777    2566 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 18 01:47:48.673362 ip-10-0-142-238 kubenswrapper[2566]: W0718 01:47:48.665780    2566 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 18 01:47:48.673362 ip-10-0-142-238 kubenswrapper[2566]: W0718 01:47:48.665782    2566 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 18 01:47:48.673362 ip-10-0-142-238 kubenswrapper[2566]: W0718 01:47:48.665785    2566 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 18 01:47:48.673362 ip-10-0-142-238 kubenswrapper[2566]: W0718 01:47:48.665787    2566 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 18 01:47:48.673362 ip-10-0-142-238 kubenswrapper[2566]: W0718 01:47:48.665790    2566 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 18 01:47:48.673362 ip-10-0-142-238 kubenswrapper[2566]: W0718 01:47:48.665792    2566 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 18 01:47:48.673362 ip-10-0-142-238 kubenswrapper[2566]: W0718 01:47:48.665795    2566 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 18 01:47:48.673362 ip-10-0-142-238 kubenswrapper[2566]: W0718 01:47:48.665797    2566 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 18 01:47:48.673362 ip-10-0-142-238 kubenswrapper[2566]: W0718 01:47:48.665800    2566 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 18 01:47:48.673362 ip-10-0-142-238 kubenswrapper[2566]: W0718 01:47:48.665802    2566 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 18 01:47:48.673362 ip-10-0-142-238 kubenswrapper[2566]: W0718 01:47:48.665805    2566 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 18 01:47:48.673362 ip-10-0-142-238 kubenswrapper[2566]: W0718 01:47:48.665807    2566 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 18 01:47:48.673362 ip-10-0-142-238 kubenswrapper[2566]: W0718 01:47:48.665810    2566 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 18 01:47:48.673362 ip-10-0-142-238 kubenswrapper[2566]: W0718 01:47:48.665812    2566 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 18 01:47:48.673362 ip-10-0-142-238 kubenswrapper[2566]: W0718 01:47:48.665814    2566 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 18 01:47:48.673362 ip-10-0-142-238 kubenswrapper[2566]: W0718 01:47:48.665817    2566 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 18 01:47:48.673362 ip-10-0-142-238 kubenswrapper[2566]: W0718 01:47:48.665819    2566 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 18 01:47:48.673362 ip-10-0-142-238 kubenswrapper[2566]: W0718 01:47:48.665822    2566 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 18 01:47:48.674015 ip-10-0-142-238 kubenswrapper[2566]: W0718 01:47:48.665824    2566 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 18 01:47:48.674015 ip-10-0-142-238 kubenswrapper[2566]: W0718 01:47:48.665827    2566 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 18 01:47:48.674015 ip-10-0-142-238 kubenswrapper[2566]: W0718 01:47:48.665829    2566 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 18 01:47:48.674015 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:47:48.665834    2566 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 18 01:47:48.674015 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:47:48.665971    2566 server.go:962] "Client rotation is on, will bootstrap in background"
Jul 18 01:47:48.674015 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:47:48.668288    2566 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir"
Jul 18 01:47:48.674015 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:47:48.669982    2566 server.go:1019] "Starting client certificate rotation"
Jul 18 01:47:48.674015 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:47:48.670090    2566 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet"
Jul 18 01:47:48.674015 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:47:48.670132    2566 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet"
Jul 18 01:47:48.674015 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:47:48.672936    2566 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Jul 18 01:47:48.676641 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:47:48.676623    2566 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Jul 18 01:47:48.692844 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:47:48.692828    2566 log.go:25] "Validated CRI v1 runtime API"
Jul 18 01:47:48.695278 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:47:48.695261    2566 log.go:25] "Validated CRI v1 image API"
Jul 18 01:47:48.696143 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:47:48.696127    2566 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd"
Jul 18 01:47:48.700554 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:47:48.700523    2566 fs.go:135] Filesystem UUIDs: map[21555ffe-51a8-4aaa-9076-95b752de0b51:/dev/nvme0n1p3 6e9bf40c-1fa7-4cd0-942e-f0b1e8dc786f:/dev/nvme0n1p4 7B77-95E7:/dev/nvme0n1p2]
Jul 18 01:47:48.700645 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:47:48.700553    2566 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}]
Jul 18 01:47:48.700696 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:47:48.700675    2566 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Jul 18 01:47:48.705793 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:47:48.705682    2566 manager.go:216] Machine: {Timestamp:2026-07-18 01:47:48.704289571 +0000 UTC m=+0.393017009 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3185894 MemoryCapacity:33164500992 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec2bbdcb85413f58a5bddfb203755f25 SystemUUID:ec2bbdcb-8541-3f58-a5bd-dfb203755f25 BootID:db980fd4-4b91-400c-b3c4-5d0e156e9de5 Filesystems:[{Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582250496 Type:vfs Inodes:4048401 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632902656 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6111232 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582250496 Type:vfs Inodes:1048576 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:bc:91:2f:f2:89 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:bc:91:2f:f2:89 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:f2:a6:d5:c7:c8:e5 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164500992 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None}
Jul 18 01:47:48.705793 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:47:48.705783    2566 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available.
Jul 18 01:47:48.705918 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:47:48.705864    2566 manager.go:232] Version: {KernelVersion:5.14.0-570.128.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260715-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:}
Jul 18 01:47:48.708691 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:47:48.708670    2566 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[]
Jul 18 01:47:48.708825 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:47:48.708695    2566 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-142-238.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2}
Jul 18 01:47:48.710152 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:47:48.710142    2566 topology_manager.go:138] "Creating topology manager with none policy"
Jul 18 01:47:48.710190 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:47:48.710153    2566 container_manager_linux.go:309] "Creating device plugin manager"
Jul 18 01:47:48.710190 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:47:48.710160    2566 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock"
Jul 18 01:47:48.710961 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:47:48.710951    2566 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock"
Jul 18 01:47:48.712693 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:47:48.712683    2566 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager"
Jul 18 01:47:48.716955 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:47:48.716944    2566 state_mem.go:36] "Initialized new in-memory state store"
Jul 18 01:47:48.717075 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:47:48.717066    2566 server.go:1240] "Using root directory" path="/var/lib/kubelet"
Jul 18 01:47:48.717104 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:47:48.717095    2566 kubelet.go:486] "Attempting to sync node with API server"
Jul 18 01:47:48.717136 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:47:48.717105    2566 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests"
Jul 18 01:47:48.717136 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:47:48.717123    2566 file.go:69] "Watching path" path="/etc/kubernetes/manifests"
Jul 18 01:47:48.717136 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:47:48.717133    2566 kubelet.go:398] "Adding apiserver pod source"
Jul 18 01:47:48.717238 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:47:48.717142    2566 apiserver.go:42] "Waiting for node sync before watching apiserver pods"
Jul 18 01:47:48.717512 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:47:48.717500    2566 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Jul 18 01:47:48.717551 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:47:48.717522    2566 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Jul 18 01:47:48.720019 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:47:48.720001    2566 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.10-2.rhaos4.21.git83ee25b.el9" apiVersion="v1"
Jul 18 01:47:48.723855 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:47:48.723830    2566 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-24tl7"
Jul 18 01:47:48.723952 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:47:48.723860    2566 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled"
Jul 18 01:47:48.723952 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:47:48.723899    2566 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled"
Jul 18 01:47:48.725507 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:47:48.725492    2566 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume"
Jul 18 01:47:48.725507 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:47:48.725510    2566 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir"
Jul 18 01:47:48.725599 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:47:48.725516    2566 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo"
Jul 18 01:47:48.725599 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:47:48.725522    2566 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path"
Jul 18 01:47:48.725599 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:47:48.725530    2566 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs"
Jul 18 01:47:48.725599 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:47:48.725536    2566 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret"
Jul 18 01:47:48.725599 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:47:48.725543    2566 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi"
Jul 18 01:47:48.725599 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:47:48.725548    2566 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api"
Jul 18 01:47:48.725599 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:47:48.725555    2566 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc"
Jul 18 01:47:48.725599 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:47:48.725560    2566 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap"
Jul 18 01:47:48.725599 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:47:48.725568    2566 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected"
Jul 18 01:47:48.725599 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:47:48.725573    2566 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume"
Jul 18 01:47:48.726525 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:47:48.726511    2566 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi"
Jul 18 01:47:48.726557 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:47:48.726528    2566 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image"
Jul 18 01:47:48.728968 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:47:48.728950    2566 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-24tl7"
Jul 18 01:47:48.730570 ip-10-0-142-238 kubenswrapper[2566]: E0718 01:47:48.730545    2566 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service"
Jul 18 01:47:48.730647 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:47:48.730569    2566 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-142-238.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope
Jul 18 01:47:48.730647 ip-10-0-142-238 kubenswrapper[2566]: E0718 01:47:48.730626    2566 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-142-238.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node"
Jul 18 01:47:48.730883 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:47:48.730871    2566 server.go:1268] "Started kubelet"
Jul 18 01:47:48.730972 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:47:48.730932    2566 server.go:180] "Starting to listen" address="0.0.0.0" port=10250
Jul 18 01:47:48.731102 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:47:48.731023    2566 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10
Jul 18 01:47:48.731156 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:47:48.731125    2566 server_v1.go:49] "podresources" method="list" useActivePods=true
Jul 18 01:47:48.731690 ip-10-0-142-238 systemd[1]: Started Kubernetes Kubelet.
Jul 18 01:47:48.732537 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:47:48.732521    2566 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock"
Jul 18 01:47:48.733107 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:47:48.733095    2566 server.go:310] "Adding debug handlers to kubelet server"
Jul 18 01:47:48.738951 ip-10-0-142-238 kubenswrapper[2566]: E0718 01:47:48.738921    2566 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache"
Jul 18 01:47:48.742633 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:47:48.742604    2566 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer"
Jul 18 01:47:48.742728 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:47:48.742630    2566 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving"
Jul 18 01:47:48.742783 ip-10-0-142-238 kubenswrapper[2566]: E0718 01:47:48.742735    2566 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-238.ec2.internal\" not found"
Jul 18 01:47:48.743367 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:47:48.743340    2566 desired_state_of_world_populator.go:146] "Desired state populator starts to run"
Jul 18 01:47:48.743451 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:47:48.743340    2566 volume_manager.go:311] "The desired_state_of_world populator starts"
Jul 18 01:47:48.743451 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:47:48.743411    2566 volume_manager.go:313] "Starting Kubelet Volume Manager"
Jul 18 01:47:48.743451 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:47:48.743418    2566 factory.go:55] Registering systemd factory
Jul 18 01:47:48.743451 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:47:48.743433    2566 factory.go:223] Registration of the systemd container factory successfully
Jul 18 01:47:48.743648 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:47:48.743467    2566 reconstruct.go:97] "Volume reconstruction finished"
Jul 18 01:47:48.743648 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:47:48.743475    2566 reconciler.go:29] "Reconciler: start to sync state"
Jul 18 01:47:48.743648 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:47:48.743645    2566 factory.go:153] Registering CRI-O factory
Jul 18 01:47:48.743758 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:47:48.743656    2566 factory.go:223] Registration of the crio container factory successfully
Jul 18 01:47:48.743758 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:47:48.743716    2566 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory
Jul 18 01:47:48.743758 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:47:48.743734    2566 factory.go:103] Registering Raw factory
Jul 18 01:47:48.743758 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:47:48.743744    2566 manager.go:1196] Started watching for new ooms in manager
Jul 18 01:47:48.744261 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:47:48.744241    2566 manager.go:349] Starting recovery of all containers
Jul 18 01:47:48.744931 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:47:48.744911    2566 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 18 01:47:48.747733 ip-10-0-142-238 kubenswrapper[2566]: E0718 01:47:48.747713    2566 nodelease.go:49] "Failed to get node when trying to set owner ref to the node lease" err="nodes \"ip-10-0-142-238.ec2.internal\" not found" node="ip-10-0-142-238.ec2.internal"
Jul 18 01:47:48.754087 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:47:48.754061    2566 manager.go:354] Recovery completed
Jul 18 01:47:48.759464 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:47:48.759449    2566 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 18 01:47:48.761298 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:47:48.761281    2566 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-238.ec2.internal" event="NodeHasSufficientMemory"
Jul 18 01:47:48.761372 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:47:48.761309    2566 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-238.ec2.internal" event="NodeHasNoDiskPressure"
Jul 18 01:47:48.761372 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:47:48.761323    2566 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-238.ec2.internal" event="NodeHasSufficientPID"
Jul 18 01:47:48.761933 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:47:48.761918    2566 cpu_manager.go:222] "Starting CPU manager" policy="none"
Jul 18 01:47:48.761933 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:47:48.761932    2566 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s"
Jul 18 01:47:48.762047 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:47:48.761951    2566 state_mem.go:36] "Initialized new in-memory state store"
Jul 18 01:47:48.762047 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:47:48.761975    2566 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 18 01:47:48.762701 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:47:48.762685    2566 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-238.ec2.internal" event="NodeHasSufficientMemory"
Jul 18 01:47:48.762750 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:47:48.762714    2566 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-238.ec2.internal" event="NodeHasNoDiskPressure"
Jul 18 01:47:48.762750 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:47:48.762724    2566 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-238.ec2.internal" event="NodeHasSufficientPID"
Jul 18 01:47:48.764110 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:47:48.764098    2566 policy_none.go:49] "None policy: Start"
Jul 18 01:47:48.764946 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:47:48.764935    2566 memory_manager.go:187] "Starting memorymanager" policy="None"
Jul 18 01:47:48.765010 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:47:48.764955    2566 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint"
Jul 18 01:47:48.766854 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:47:48.766842    2566 policy_none.go:47] "Start"
Jul 18 01:47:48.808371 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:47:48.808238    2566 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4"
Jul 18 01:47:48.821488 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:47:48.809453    2566 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6"
Jul 18 01:47:48.821488 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:47:48.809507    2566 status_manager.go:244] "Starting to sync pod status with apiserver"
Jul 18 01:47:48.821488 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:47:48.809531    2566 kubelet.go:2448] "Starting kubelet main sync loop"
Jul 18 01:47:48.821488 ip-10-0-142-238 kubenswrapper[2566]: E0718 01:47:48.809571    2566 kubelet.go:2472] "Skipping pod synchronization" err="[container runtime status check may not have completed yet, PLEG is not healthy: pleg has yet to be successful]"
Jul 18 01:47:48.821488 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:47:48.811904    2566 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 18 01:47:48.842921 ip-10-0-142-238 kubenswrapper[2566]: E0718 01:47:48.842903    2566 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-238.ec2.internal\" not found"
Jul 18 01:47:48.910280 ip-10-0-142-238 kubenswrapper[2566]: E0718 01:47:48.910223    2566 kubelet.go:2472] "Skipping pod synchronization" err="container runtime status check may not have completed yet"
Jul 18 01:47:48.943214 ip-10-0-142-238 kubenswrapper[2566]: E0718 01:47:48.943195    2566 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-238.ec2.internal\" not found"
Jul 18 01:47:48.950101 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:47:48.950087    2566 manager.go:337] "Starting Device Plugin manager"
Jul 18 01:47:48.950178 ip-10-0-142-238 kubenswrapper[2566]: E0718 01:47:48.950124    2566 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint"
Jul 18 01:47:48.950178 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:47:48.950137    2566 server.go:87] "Starting device plugin registration server"
Jul 18 01:47:48.950413 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:47:48.950401    2566 eviction_manager.go:189] "Eviction manager: starting control loop"
Jul 18 01:47:48.950471 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:47:48.950418    2566 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s"
Jul 18 01:47:48.950520 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:47:48.950500    2566 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry"
Jul 18 01:47:48.950644 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:47:48.950568    2566 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts"
Jul 18 01:47:48.950644 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:47:48.950594    2566 plugin_manager.go:118] "Starting Kubelet Plugin Manager"
Jul 18 01:47:48.951689 ip-10-0-142-238 kubenswrapper[2566]: E0718 01:47:48.951666    2566 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\""
Jul 18 01:47:48.951762 ip-10-0-142-238 kubenswrapper[2566]: E0718 01:47:48.951709    2566 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-142-238.ec2.internal\" not found"
Jul 18 01:47:49.050953 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:47:49.050932    2566 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 18 01:47:49.051796 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:47:49.051781    2566 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-238.ec2.internal" event="NodeHasSufficientMemory"
Jul 18 01:47:49.051882 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:47:49.051808    2566 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-238.ec2.internal" event="NodeHasNoDiskPressure"
Jul 18 01:47:49.051882 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:47:49.051817    2566 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-238.ec2.internal" event="NodeHasSufficientPID"
Jul 18 01:47:49.051882 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:47:49.051837    2566 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-142-238.ec2.internal"
Jul 18 01:47:49.061854 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:47:49.061838    2566 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-142-238.ec2.internal"
Jul 18 01:47:49.061904 ip-10-0-142-238 kubenswrapper[2566]: E0718 01:47:49.061858    2566 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-142-238.ec2.internal\": node \"ip-10-0-142-238.ec2.internal\" not found"
Jul 18 01:47:49.078403 ip-10-0-142-238 kubenswrapper[2566]: E0718 01:47:49.078383    2566 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-238.ec2.internal\" not found"
Jul 18 01:47:49.110479 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:47:49.110459    2566 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-238.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-142-238.ec2.internal"]
Jul 18 01:47:49.110561 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:47:49.110523    2566 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 18 01:47:49.111262 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:47:49.111246    2566 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-238.ec2.internal" event="NodeHasSufficientMemory"
Jul 18 01:47:49.111350 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:47:49.111273    2566 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-238.ec2.internal" event="NodeHasNoDiskPressure"
Jul 18 01:47:49.111350 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:47:49.111283    2566 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-238.ec2.internal" event="NodeHasSufficientPID"
Jul 18 01:47:49.113464 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:47:49.113451    2566 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 18 01:47:49.113585 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:47:49.113566    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-238.ec2.internal"
Jul 18 01:47:49.113642 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:47:49.113593    2566 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 18 01:47:49.114101 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:47:49.114087    2566 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-238.ec2.internal" event="NodeHasSufficientMemory"
Jul 18 01:47:49.114158 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:47:49.114112    2566 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-238.ec2.internal" event="NodeHasNoDiskPressure"
Jul 18 01:47:49.114158 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:47:49.114087    2566 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-238.ec2.internal" event="NodeHasSufficientMemory"
Jul 18 01:47:49.114158 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:47:49.114122    2566 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-238.ec2.internal" event="NodeHasSufficientPID"
Jul 18 01:47:49.114158 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:47:49.114136    2566 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-238.ec2.internal" event="NodeHasNoDiskPressure"
Jul 18 01:47:49.114158 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:47:49.114151    2566 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-238.ec2.internal" event="NodeHasSufficientPID"
Jul 18 01:47:49.116201 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:47:49.116188    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-142-238.ec2.internal"
Jul 18 01:47:49.116238 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:47:49.116212    2566 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 18 01:47:49.116860 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:47:49.116847    2566 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-238.ec2.internal" event="NodeHasSufficientMemory"
Jul 18 01:47:49.116903 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:47:49.116873    2566 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-238.ec2.internal" event="NodeHasNoDiskPressure"
Jul 18 01:47:49.116903 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:47:49.116886    2566 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-238.ec2.internal" event="NodeHasSufficientPID"
Jul 18 01:47:49.145078 ip-10-0-142-238 kubenswrapper[2566]: E0718 01:47:49.145057    2566 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-142-238.ec2.internal\" not found" node="ip-10-0-142-238.ec2.internal"
Jul 18 01:47:49.145078 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:47:49.145065    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/3d826c346f2df407603e1c503f38c6db-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-142-238.ec2.internal\" (UID: \"3d826c346f2df407603e1c503f38c6db\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-238.ec2.internal"
Jul 18 01:47:49.145193 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:47:49.145096    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/3d826c346f2df407603e1c503f38c6db-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-142-238.ec2.internal\" (UID: \"3d826c346f2df407603e1c503f38c6db\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-238.ec2.internal"
Jul 18 01:47:49.145193 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:47:49.145121    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/780b86b12592a8e7c650c0643a729f9d-config\") pod \"kube-apiserver-proxy-ip-10-0-142-238.ec2.internal\" (UID: \"780b86b12592a8e7c650c0643a729f9d\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-142-238.ec2.internal"
Jul 18 01:47:49.149272 ip-10-0-142-238 kubenswrapper[2566]: E0718 01:47:49.149256    2566 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-142-238.ec2.internal\" not found" node="ip-10-0-142-238.ec2.internal"
Jul 18 01:47:49.179489 ip-10-0-142-238 kubenswrapper[2566]: E0718 01:47:49.179446    2566 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-238.ec2.internal\" not found"
Jul 18 01:47:49.245375 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:47:49.245354    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/3d826c346f2df407603e1c503f38c6db-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-142-238.ec2.internal\" (UID: \"3d826c346f2df407603e1c503f38c6db\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-238.ec2.internal"
Jul 18 01:47:49.245447 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:47:49.245377    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/3d826c346f2df407603e1c503f38c6db-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-142-238.ec2.internal\" (UID: \"3d826c346f2df407603e1c503f38c6db\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-238.ec2.internal"
Jul 18 01:47:49.245447 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:47:49.245410    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/780b86b12592a8e7c650c0643a729f9d-config\") pod \"kube-apiserver-proxy-ip-10-0-142-238.ec2.internal\" (UID: \"780b86b12592a8e7c650c0643a729f9d\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-142-238.ec2.internal"
Jul 18 01:47:49.245510 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:47:49.245452    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/3d826c346f2df407603e1c503f38c6db-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-142-238.ec2.internal\" (UID: \"3d826c346f2df407603e1c503f38c6db\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-238.ec2.internal"
Jul 18 01:47:49.245510 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:47:49.245492    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/3d826c346f2df407603e1c503f38c6db-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-142-238.ec2.internal\" (UID: \"3d826c346f2df407603e1c503f38c6db\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-238.ec2.internal"
Jul 18 01:47:49.245571 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:47:49.245518    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/780b86b12592a8e7c650c0643a729f9d-config\") pod \"kube-apiserver-proxy-ip-10-0-142-238.ec2.internal\" (UID: \"780b86b12592a8e7c650c0643a729f9d\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-142-238.ec2.internal"
Jul 18 01:47:49.280488 ip-10-0-142-238 kubenswrapper[2566]: E0718 01:47:49.280462    2566 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-238.ec2.internal\" not found"
Jul 18 01:47:49.380885 ip-10-0-142-238 kubenswrapper[2566]: E0718 01:47:49.380864    2566 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-238.ec2.internal\" not found"
Jul 18 01:47:49.449406 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:47:49.449370    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-238.ec2.internal"
Jul 18 01:47:49.452868 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:47:49.452855    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-142-238.ec2.internal"
Jul 18 01:47:49.481771 ip-10-0-142-238 kubenswrapper[2566]: E0718 01:47:49.481747    2566 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-238.ec2.internal\" not found"
Jul 18 01:47:49.582211 ip-10-0-142-238 kubenswrapper[2566]: E0718 01:47:49.582190    2566 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-238.ec2.internal\" not found"
Jul 18 01:47:49.668744 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:47:49.668715    2566 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials"
Jul 18 01:47:49.669121 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:47:49.668872    2566 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
Jul 18 01:47:49.669121 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:47:49.668882    2566 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
Jul 18 01:47:49.682990 ip-10-0-142-238 kubenswrapper[2566]: E0718 01:47:49.682970    2566 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-238.ec2.internal\" not found"
Jul 18 01:47:49.734953 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:47:49.734901    2566 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-07-17 01:42:49 +0000 UTC" deadline="2028-01-10 20:58:19.877697938 +0000 UTC"
Jul 18 01:47:49.734953 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:47:49.734922    2566 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="13003h10m30.142778789s"
Jul 18 01:47:49.745358 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:47:49.745341    2566 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 18 01:47:49.842998 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:47:49.842978    2566 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-238.ec2.internal"
Jul 18 01:47:49.854763 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:47:49.854742    2566 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Jul 18 01:47:49.857036 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:47:49.857022    2566 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-142-238.ec2.internal"
Jul 18 01:47:49.863418 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:47:49.863397    2566 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Jul 18 01:47:50.020025 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:47:50.019965    2566 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 18 01:47:50.047006 ip-10-0-142-238 kubenswrapper[2566]: W0718 01:47:50.046979    2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod780b86b12592a8e7c650c0643a729f9d.slice/crio-933de4dd2147996ada245175635faa69b13fab41f77162570ff36e645003f7f4 WatchSource:0}: Error finding container 933de4dd2147996ada245175635faa69b13fab41f77162570ff36e645003f7f4: Status 404 returned error can't find the container with id 933de4dd2147996ada245175635faa69b13fab41f77162570ff36e645003f7f4
Jul 18 01:47:50.047380 ip-10-0-142-238 kubenswrapper[2566]: W0718 01:47:50.047348    2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3d826c346f2df407603e1c503f38c6db.slice/crio-627ceeebe6eeceb826a66e9a2abaf517b29de38109c277fb97be3f48f4130738 WatchSource:0}: Error finding container 627ceeebe6eeceb826a66e9a2abaf517b29de38109c277fb97be3f48f4130738: Status 404 returned error can't find the container with id 627ceeebe6eeceb826a66e9a2abaf517b29de38109c277fb97be3f48f4130738
Jul 18 01:47:50.053232 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:47:50.053217    2566 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 18 01:47:50.718374 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:47:50.718345    2566 apiserver.go:52] "Watching apiserver"
Jul 18 01:47:50.725637 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:47:50.725611    2566 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66"
Jul 18 01:47:50.728273 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:47:50.728242    2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kube-system/global-pull-secret-syncer-2jzkc","kube-system/konnectivity-agent-l28dd","openshift-multus/multus-additional-cni-plugins-smml7","openshift-multus/network-metrics-daemon-pdflp","openshift-network-diagnostics/network-check-target-n8bdx","openshift-ovn-kubernetes/ovnkube-node-zn27c","kube-system/kube-apiserver-proxy-ip-10-0-142-238.ec2.internal","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dkzsl","openshift-cluster-node-tuning-operator/tuned-tscwd","openshift-dns/node-resolver-cpp62","openshift-image-registry/node-ca-lt6hj","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-238.ec2.internal","openshift-multus/multus-z6hz2","openshift-network-operator/iptables-alerter-cqkkm"]
Jul 18 01:47:50.730854 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:47:50.730834    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-2jzkc"
Jul 18 01:47:50.730930 ip-10-0-142-238 kubenswrapper[2566]: E0718 01:47:50.730900    2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-2jzkc" podUID="26d75b92-43d7-43e7-96c8-dd42a5288953"
Jul 18 01:47:50.733883 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:47:50.733862    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-l28dd"
Jul 18 01:47:50.736269 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:47:50.736134    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\""
Jul 18 01:47:50.736269 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:47:50.736154    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-stdrl\""
Jul 18 01:47:50.736269 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:47:50.736163    2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\""
Jul 18 01:47:50.736434 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:47:50.736346    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-smml7"
Jul 18 01:47:50.738679 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:47:50.738648    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-pdflp"
Jul 18 01:47:50.738804 ip-10-0-142-238 kubenswrapper[2566]: E0718 01:47:50.738723    2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-pdflp" podUID="7c91433e-b6e6-47a8-8df6-2231cbc7d28c"
Jul 18 01:47:50.738804 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:47:50.738776    2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\""
Jul 18 01:47:50.738804 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:47:50.738780    2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\""
Jul 18 01:47:50.739002 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:47:50.738984    2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\""
Jul 18 01:47:50.739067 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:47:50.739054    2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\""
Jul 18 01:47:50.739122 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:47:50.739076    2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\""
Jul 18 01:47:50.739175 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:47:50.739132    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-gldf4\""
Jul 18 01:47:50.741319 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:47:50.741227    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-n8bdx"
Jul 18 01:47:50.741319 ip-10-0-142-238 kubenswrapper[2566]: E0718 01:47:50.741285    2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-n8bdx" podUID="25c58f22-7d60-4a06-844f-f3508d910e76"
Jul 18 01:47:50.743758 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:47:50.743689    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-zn27c"
Jul 18 01:47:50.743758 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:47:50.743738    2566 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving"
Jul 18 01:47:50.746966 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:47:50.746237    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dkzsl"
Jul 18 01:47:50.747799 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:47:50.747112    2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\""
Jul 18 01:47:50.747799 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:47:50.747162    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\""
Jul 18 01:47:50.747799 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:47:50.747381    2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\""
Jul 18 01:47:50.747799 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:47:50.747501    2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\""
Jul 18 01:47:50.747799 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:47:50.747511    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-jd5g2\""
Jul 18 01:47:50.747799 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:47:50.747642    2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\""
Jul 18 01:47:50.747799 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:47:50.747766    2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\""
Jul 18 01:47:50.748372 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:47:50.748212    2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\""
Jul 18 01:47:50.748451 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:47:50.748381    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-hvdg2\""
Jul 18 01:47:50.748507 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:47:50.748477    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\""
Jul 18 01:47:50.748787 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:47:50.748761    2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\""
Jul 18 01:47:50.749429 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:47:50.748992    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-tscwd"
Jul 18 01:47:50.751971 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:47:50.751943    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-f4bzj\""
Jul 18 01:47:50.752311 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:47:50.752177    2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\""
Jul 18 01:47:50.752311 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:47:50.752245    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-cpp62"
Jul 18 01:47:50.752424 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:47:50.752332    2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\""
Jul 18 01:47:50.754564 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:47:50.753269    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/06903f84-978e-4cd4-9f1a-6ccdf2b7524b-run-systemd\") pod \"ovnkube-node-zn27c\" (UID: \"06903f84-978e-4cd4-9f1a-6ccdf2b7524b\") " pod="openshift-ovn-kubernetes/ovnkube-node-zn27c"
Jul 18 01:47:50.754564 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:47:50.753314    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/06903f84-978e-4cd4-9f1a-6ccdf2b7524b-var-lib-openvswitch\") pod \"ovnkube-node-zn27c\" (UID: \"06903f84-978e-4cd4-9f1a-6ccdf2b7524b\") " pod="openshift-ovn-kubernetes/ovnkube-node-zn27c"
Jul 18 01:47:50.754564 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:47:50.753350    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/06903f84-978e-4cd4-9f1a-6ccdf2b7524b-run-ovn\") pod \"ovnkube-node-zn27c\" (UID: \"06903f84-978e-4cd4-9f1a-6ccdf2b7524b\") " pod="openshift-ovn-kubernetes/ovnkube-node-zn27c"
Jul 18 01:47:50.754564 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:47:50.753381    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/06903f84-978e-4cd4-9f1a-6ccdf2b7524b-env-overrides\") pod \"ovnkube-node-zn27c\" (UID: \"06903f84-978e-4cd4-9f1a-6ccdf2b7524b\") " pod="openshift-ovn-kubernetes/ovnkube-node-zn27c"
Jul 18 01:47:50.754564 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:47:50.753411    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kdj7h\" (UniqueName: \"kubernetes.io/projected/7c91433e-b6e6-47a8-8df6-2231cbc7d28c-kube-api-access-kdj7h\") pod \"network-metrics-daemon-pdflp\" (UID: \"7c91433e-b6e6-47a8-8df6-2231cbc7d28c\") " pod="openshift-multus/network-metrics-daemon-pdflp"
Jul 18 01:47:50.754564 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:47:50.753444    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/06903f84-978e-4cd4-9f1a-6ccdf2b7524b-host-cni-bin\") pod \"ovnkube-node-zn27c\" (UID: \"06903f84-978e-4cd4-9f1a-6ccdf2b7524b\") " pod="openshift-ovn-kubernetes/ovnkube-node-zn27c"
Jul 18 01:47:50.754564 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:47:50.753475    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/06903f84-978e-4cd4-9f1a-6ccdf2b7524b-ovnkube-config\") pod \"ovnkube-node-zn27c\" (UID: \"06903f84-978e-4cd4-9f1a-6ccdf2b7524b\") " pod="openshift-ovn-kubernetes/ovnkube-node-zn27c"
Jul 18 01:47:50.754564 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:47:50.753505    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/075e93b2-88e3-4a5f-9200-2d0f9fc1d599-sys-fs\") pod \"aws-ebs-csi-driver-node-dkzsl\" (UID: \"075e93b2-88e3-4a5f-9200-2d0f9fc1d599\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dkzsl"
Jul 18 01:47:50.754564 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:47:50.753538    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/26d75b92-43d7-43e7-96c8-dd42a5288953-original-pull-secret\") pod \"global-pull-secret-syncer-2jzkc\" (UID: \"26d75b92-43d7-43e7-96c8-dd42a5288953\") " pod="kube-system/global-pull-secret-syncer-2jzkc"
Jul 18 01:47:50.754564 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:47:50.753567    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/fae2962e-4ef0-41af-a49e-d6216d1aa7c9-cni-binary-copy\") pod \"multus-additional-cni-plugins-smml7\" (UID: \"fae2962e-4ef0-41af-a49e-d6216d1aa7c9\") " pod="openshift-multus/multus-additional-cni-plugins-smml7"
Jul 18 01:47:50.754564 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:47:50.753599    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/fae2962e-4ef0-41af-a49e-d6216d1aa7c9-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-smml7\" (UID: \"fae2962e-4ef0-41af-a49e-d6216d1aa7c9\") " pod="openshift-multus/multus-additional-cni-plugins-smml7"
Jul 18 01:47:50.754564 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:47:50.753633    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/06903f84-978e-4cd4-9f1a-6ccdf2b7524b-systemd-units\") pod \"ovnkube-node-zn27c\" (UID: \"06903f84-978e-4cd4-9f1a-6ccdf2b7524b\") " pod="openshift-ovn-kubernetes/ovnkube-node-zn27c"
Jul 18 01:47:50.754564 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:47:50.753665    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/06903f84-978e-4cd4-9f1a-6ccdf2b7524b-host-run-netns\") pod \"ovnkube-node-zn27c\" (UID: \"06903f84-978e-4cd4-9f1a-6ccdf2b7524b\") " pod="openshift-ovn-kubernetes/ovnkube-node-zn27c"
Jul 18 01:47:50.754564 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:47:50.753720    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/06903f84-978e-4cd4-9f1a-6ccdf2b7524b-host-cni-netd\") pod \"ovnkube-node-zn27c\" (UID: \"06903f84-978e-4cd4-9f1a-6ccdf2b7524b\") " pod="openshift-ovn-kubernetes/ovnkube-node-zn27c"
Jul 18 01:47:50.754564 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:47:50.753750    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/26d75b92-43d7-43e7-96c8-dd42a5288953-kubelet-config\") pod \"global-pull-secret-syncer-2jzkc\" (UID: \"26d75b92-43d7-43e7-96c8-dd42a5288953\") " pod="kube-system/global-pull-secret-syncer-2jzkc"
Jul 18 01:47:50.754564 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:47:50.753808    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/44aa7f9e-049a-45bc-98bc-ff1d4309f5de-konnectivity-ca\") pod \"konnectivity-agent-l28dd\" (UID: \"44aa7f9e-049a-45bc-98bc-ff1d4309f5de\") " pod="kube-system/konnectivity-agent-l28dd"
Jul 18 01:47:50.755466 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:47:50.753849    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/fae2962e-4ef0-41af-a49e-d6216d1aa7c9-os-release\") pod \"multus-additional-cni-plugins-smml7\" (UID: \"fae2962e-4ef0-41af-a49e-d6216d1aa7c9\") " pod="openshift-multus/multus-additional-cni-plugins-smml7"
Jul 18 01:47:50.755466 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:47:50.753888    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/06903f84-978e-4cd4-9f1a-6ccdf2b7524b-log-socket\") pod \"ovnkube-node-zn27c\" (UID: \"06903f84-978e-4cd4-9f1a-6ccdf2b7524b\") " pod="openshift-ovn-kubernetes/ovnkube-node-zn27c"
Jul 18 01:47:50.755466 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:47:50.753922    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/06903f84-978e-4cd4-9f1a-6ccdf2b7524b-ovn-node-metrics-cert\") pod \"ovnkube-node-zn27c\" (UID: \"06903f84-978e-4cd4-9f1a-6ccdf2b7524b\") " pod="openshift-ovn-kubernetes/ovnkube-node-zn27c"
Jul 18 01:47:50.755466 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:47:50.753955    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fjllh\" (UniqueName: \"kubernetes.io/projected/06903f84-978e-4cd4-9f1a-6ccdf2b7524b-kube-api-access-fjllh\") pod \"ovnkube-node-zn27c\" (UID: \"06903f84-978e-4cd4-9f1a-6ccdf2b7524b\") " pod="openshift-ovn-kubernetes/ovnkube-node-zn27c"
Jul 18 01:47:50.755466 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:47:50.753985    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/075e93b2-88e3-4a5f-9200-2d0f9fc1d599-socket-dir\") pod \"aws-ebs-csi-driver-node-dkzsl\" (UID: \"075e93b2-88e3-4a5f-9200-2d0f9fc1d599\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dkzsl"
Jul 18 01:47:50.755466 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:47:50.754018    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/075e93b2-88e3-4a5f-9200-2d0f9fc1d599-etc-selinux\") pod \"aws-ebs-csi-driver-node-dkzsl\" (UID: \"075e93b2-88e3-4a5f-9200-2d0f9fc1d599\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dkzsl"
Jul 18 01:47:50.755466 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:47:50.754052    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lscmb\" (UniqueName: \"kubernetes.io/projected/075e93b2-88e3-4a5f-9200-2d0f9fc1d599-kube-api-access-lscmb\") pod \"aws-ebs-csi-driver-node-dkzsl\" (UID: \"075e93b2-88e3-4a5f-9200-2d0f9fc1d599\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dkzsl"
Jul 18 01:47:50.755466 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:47:50.754087    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/26d75b92-43d7-43e7-96c8-dd42a5288953-dbus\") pod \"global-pull-secret-syncer-2jzkc\" (UID: \"26d75b92-43d7-43e7-96c8-dd42a5288953\") " pod="kube-system/global-pull-secret-syncer-2jzkc"
Jul 18 01:47:50.755466 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:47:50.754120    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/fae2962e-4ef0-41af-a49e-d6216d1aa7c9-cnibin\") pod \"multus-additional-cni-plugins-smml7\" (UID: \"fae2962e-4ef0-41af-a49e-d6216d1aa7c9\") " pod="openshift-multus/multus-additional-cni-plugins-smml7"
Jul 18 01:47:50.755466 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:47:50.754168    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/fae2962e-4ef0-41af-a49e-d6216d1aa7c9-tuning-conf-dir\") pod \"multus-additional-cni-plugins-smml7\" (UID: \"fae2962e-4ef0-41af-a49e-d6216d1aa7c9\") " pod="openshift-multus/multus-additional-cni-plugins-smml7"
Jul 18 01:47:50.755466 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:47:50.754198    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bc6g4\" (UniqueName: \"kubernetes.io/projected/fae2962e-4ef0-41af-a49e-d6216d1aa7c9-kube-api-access-bc6g4\") pod \"multus-additional-cni-plugins-smml7\" (UID: \"fae2962e-4ef0-41af-a49e-d6216d1aa7c9\") " pod="openshift-multus/multus-additional-cni-plugins-smml7"
Jul 18 01:47:50.755466 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:47:50.754233    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/075e93b2-88e3-4a5f-9200-2d0f9fc1d599-kubelet-dir\") pod \"aws-ebs-csi-driver-node-dkzsl\" (UID: \"075e93b2-88e3-4a5f-9200-2d0f9fc1d599\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dkzsl"
Jul 18 01:47:50.755466 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:47:50.754266    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/075e93b2-88e3-4a5f-9200-2d0f9fc1d599-device-dir\") pod \"aws-ebs-csi-driver-node-dkzsl\" (UID: \"075e93b2-88e3-4a5f-9200-2d0f9fc1d599\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dkzsl"
Jul 18 01:47:50.755466 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:47:50.754299    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/fae2962e-4ef0-41af-a49e-d6216d1aa7c9-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-smml7\" (UID: \"fae2962e-4ef0-41af-a49e-d6216d1aa7c9\") " pod="openshift-multus/multus-additional-cni-plugins-smml7"
Jul 18 01:47:50.755466 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:47:50.754332    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7c91433e-b6e6-47a8-8df6-2231cbc7d28c-metrics-certs\") pod \"network-metrics-daemon-pdflp\" (UID: \"7c91433e-b6e6-47a8-8df6-2231cbc7d28c\") " pod="openshift-multus/network-metrics-daemon-pdflp"
Jul 18 01:47:50.755466 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:47:50.754359    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-x4khf\" (UniqueName: \"kubernetes.io/projected/25c58f22-7d60-4a06-844f-f3508d910e76-kube-api-access-x4khf\") pod \"network-check-target-n8bdx\" (UID: \"25c58f22-7d60-4a06-844f-f3508d910e76\") " pod="openshift-network-diagnostics/network-check-target-n8bdx"
Jul 18 01:47:50.756254 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:47:50.754393    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/06903f84-978e-4cd4-9f1a-6ccdf2b7524b-host-slash\") pod \"ovnkube-node-zn27c\" (UID: \"06903f84-978e-4cd4-9f1a-6ccdf2b7524b\") " pod="openshift-ovn-kubernetes/ovnkube-node-zn27c"
Jul 18 01:47:50.756254 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:47:50.754437    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/06903f84-978e-4cd4-9f1a-6ccdf2b7524b-node-log\") pod \"ovnkube-node-zn27c\" (UID: \"06903f84-978e-4cd4-9f1a-6ccdf2b7524b\") " pod="openshift-ovn-kubernetes/ovnkube-node-zn27c"
Jul 18 01:47:50.756254 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:47:50.754514    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/06903f84-978e-4cd4-9f1a-6ccdf2b7524b-host-run-ovn-kubernetes\") pod \"ovnkube-node-zn27c\" (UID: \"06903f84-978e-4cd4-9f1a-6ccdf2b7524b\") " pod="openshift-ovn-kubernetes/ovnkube-node-zn27c"
Jul 18 01:47:50.756254 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:47:50.754565    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-j5smt\""
Jul 18 01:47:50.756254 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:47:50.754668    2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\""
Jul 18 01:47:50.756254 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:47:50.754561    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/075e93b2-88e3-4a5f-9200-2d0f9fc1d599-registration-dir\") pod \"aws-ebs-csi-driver-node-dkzsl\" (UID: \"075e93b2-88e3-4a5f-9200-2d0f9fc1d599\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dkzsl"
Jul 18 01:47:50.756254 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:47:50.755372    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/06903f84-978e-4cd4-9f1a-6ccdf2b7524b-run-openvswitch\") pod \"ovnkube-node-zn27c\" (UID: \"06903f84-978e-4cd4-9f1a-6ccdf2b7524b\") " pod="openshift-ovn-kubernetes/ovnkube-node-zn27c"
Jul 18 01:47:50.756254 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:47:50.755400    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/06903f84-978e-4cd4-9f1a-6ccdf2b7524b-ovnkube-script-lib\") pod \"ovnkube-node-zn27c\" (UID: \"06903f84-978e-4cd4-9f1a-6ccdf2b7524b\") " pod="openshift-ovn-kubernetes/ovnkube-node-zn27c"
Jul 18 01:47:50.756254 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:47:50.755434    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/fae2962e-4ef0-41af-a49e-d6216d1aa7c9-system-cni-dir\") pod \"multus-additional-cni-plugins-smml7\" (UID: \"fae2962e-4ef0-41af-a49e-d6216d1aa7c9\") " pod="openshift-multus/multus-additional-cni-plugins-smml7"
Jul 18 01:47:50.756254 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:47:50.755467    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/06903f84-978e-4cd4-9f1a-6ccdf2b7524b-etc-openvswitch\") pod \"ovnkube-node-zn27c\" (UID: \"06903f84-978e-4cd4-9f1a-6ccdf2b7524b\") " pod="openshift-ovn-kubernetes/ovnkube-node-zn27c"
Jul 18 01:47:50.756254 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:47:50.755500    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/06903f84-978e-4cd4-9f1a-6ccdf2b7524b-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-zn27c\" (UID: \"06903f84-978e-4cd4-9f1a-6ccdf2b7524b\") " pod="openshift-ovn-kubernetes/ovnkube-node-zn27c"
Jul 18 01:47:50.756254 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:47:50.755531    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/06903f84-978e-4cd4-9f1a-6ccdf2b7524b-host-kubelet\") pod \"ovnkube-node-zn27c\" (UID: \"06903f84-978e-4cd4-9f1a-6ccdf2b7524b\") " pod="openshift-ovn-kubernetes/ovnkube-node-zn27c"
Jul 18 01:47:50.756254 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:47:50.755554    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/44aa7f9e-049a-45bc-98bc-ff1d4309f5de-agent-certs\") pod \"konnectivity-agent-l28dd\" (UID: \"44aa7f9e-049a-45bc-98bc-ff1d4309f5de\") " pod="kube-system/konnectivity-agent-l28dd"
Jul 18 01:47:50.756895 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:47:50.756577    2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\""
Jul 18 01:47:50.756952 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:47:50.756921    2566 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Jul 18 01:47:50.757629 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:47:50.757105    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-lt6hj"
Jul 18 01:47:50.759197 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:47:50.759178    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-z6hz2"
Jul 18 01:47:50.760704 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:47:50.760526    2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\""
Jul 18 01:47:50.760704 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:47:50.760583    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-tkjhz\""
Jul 18 01:47:50.760704 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:47:50.760583    2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\""
Jul 18 01:47:50.760913 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:47:50.760865    2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\""
Jul 18 01:47:50.761246 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:47:50.761228    2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\""
Jul 18 01:47:50.761436 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:47:50.761420    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-rj2mt\""
Jul 18 01:47:50.762501 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:47:50.762069    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-cqkkm"
Jul 18 01:47:50.764091 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:47:50.764071    2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\""
Jul 18 01:47:50.764203 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:47:50.764179    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-lvbch\""
Jul 18 01:47:50.764330 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:47:50.764277    2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\""
Jul 18 01:47:50.764330 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:47:50.764082    2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\""
Jul 18 01:47:50.778796 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:47:50.778775    2566 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-nqcgm"
Jul 18 01:47:50.786459 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:47:50.786386    2566 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-nqcgm"
Jul 18 01:47:50.814438 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:47:50.814394    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-142-238.ec2.internal" event={"ID":"780b86b12592a8e7c650c0643a729f9d","Type":"ContainerStarted","Data":"933de4dd2147996ada245175635faa69b13fab41f77162570ff36e645003f7f4"}
Jul 18 01:47:50.816539 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:47:50.816514    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-238.ec2.internal" event={"ID":"3d826c346f2df407603e1c503f38c6db","Type":"ContainerStarted","Data":"627ceeebe6eeceb826a66e9a2abaf517b29de38109c277fb97be3f48f4130738"}
Jul 18 01:47:50.844668 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:47:50.844649    2566 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world"
Jul 18 01:47:50.856293 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:47:50.856266    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bc6g4\" (UniqueName: \"kubernetes.io/projected/fae2962e-4ef0-41af-a49e-d6216d1aa7c9-kube-api-access-bc6g4\") pod \"multus-additional-cni-plugins-smml7\" (UID: \"fae2962e-4ef0-41af-a49e-d6216d1aa7c9\") " pod="openshift-multus/multus-additional-cni-plugins-smml7"
Jul 18 01:47:50.856390 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:47:50.856309    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7c91433e-b6e6-47a8-8df6-2231cbc7d28c-metrics-certs\") pod \"network-metrics-daemon-pdflp\" (UID: \"7c91433e-b6e6-47a8-8df6-2231cbc7d28c\") " pod="openshift-multus/network-metrics-daemon-pdflp"
Jul 18 01:47:50.856390 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:47:50.856340    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/d43cde0e-8b28-405b-a229-dedf1d9c4435-host-run-netns\") pod \"multus-z6hz2\" (UID: \"d43cde0e-8b28-405b-a229-dedf1d9c4435\") " pod="openshift-multus/multus-z6hz2"
Jul 18 01:47:50.856390 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:47:50.856367    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/840829b1-92cb-4b4d-839f-a27bb50774ea-iptables-alerter-script\") pod \"iptables-alerter-cqkkm\" (UID: \"840829b1-92cb-4b4d-839f-a27bb50774ea\") " pod="openshift-network-operator/iptables-alerter-cqkkm"
Jul 18 01:47:50.856576 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:47:50.856557    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/075e93b2-88e3-4a5f-9200-2d0f9fc1d599-kubelet-dir\") pod \"aws-ebs-csi-driver-node-dkzsl\" (UID: \"075e93b2-88e3-4a5f-9200-2d0f9fc1d599\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dkzsl"
Jul 18 01:47:50.856652 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:47:50.856588    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-x4khf\" (UniqueName: \"kubernetes.io/projected/25c58f22-7d60-4a06-844f-f3508d910e76-kube-api-access-x4khf\") pod \"network-check-target-n8bdx\" (UID: \"25c58f22-7d60-4a06-844f-f3508d910e76\") " pod="openshift-network-diagnostics/network-check-target-n8bdx"
Jul 18 01:47:50.856652 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:47:50.856613    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/06903f84-978e-4cd4-9f1a-6ccdf2b7524b-node-log\") pod \"ovnkube-node-zn27c\" (UID: \"06903f84-978e-4cd4-9f1a-6ccdf2b7524b\") " pod="openshift-ovn-kubernetes/ovnkube-node-zn27c"
Jul 18 01:47:50.856652 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:47:50.856653    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ddbb4203-0f8f-4799-a645-184ca2236211-tmp-dir\") pod \"node-resolver-cpp62\" (UID: \"ddbb4203-0f8f-4799-a645-184ca2236211\") " pod="openshift-dns/node-resolver-cpp62"
Jul 18 01:47:50.856855 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:47:50.856677    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/d43cde0e-8b28-405b-a229-dedf1d9c4435-hostroot\") pod \"multus-z6hz2\" (UID: \"d43cde0e-8b28-405b-a229-dedf1d9c4435\") " pod="openshift-multus/multus-z6hz2"
Jul 18 01:47:50.856855 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:47:50.856702    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/075e93b2-88e3-4a5f-9200-2d0f9fc1d599-registration-dir\") pod \"aws-ebs-csi-driver-node-dkzsl\" (UID: \"075e93b2-88e3-4a5f-9200-2d0f9fc1d599\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dkzsl"
Jul 18 01:47:50.856855 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:47:50.856726    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/06903f84-978e-4cd4-9f1a-6ccdf2b7524b-ovnkube-script-lib\") pod \"ovnkube-node-zn27c\" (UID: \"06903f84-978e-4cd4-9f1a-6ccdf2b7524b\") " pod="openshift-ovn-kubernetes/ovnkube-node-zn27c"
Jul 18 01:47:50.856855 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:47:50.856749    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/f3a548b3-84f2-4a68-8676-5b8b26777d81-etc-modprobe-d\") pod \"tuned-tscwd\" (UID: \"f3a548b3-84f2-4a68-8676-5b8b26777d81\") " pod="openshift-cluster-node-tuning-operator/tuned-tscwd"
Jul 18 01:47:50.856855 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:47:50.856773    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/f3a548b3-84f2-4a68-8676-5b8b26777d81-lib-modules\") pod \"tuned-tscwd\" (UID: \"f3a548b3-84f2-4a68-8676-5b8b26777d81\") " pod="openshift-cluster-node-tuning-operator/tuned-tscwd"
Jul 18 01:47:50.856855 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:47:50.856781    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/06903f84-978e-4cd4-9f1a-6ccdf2b7524b-node-log\") pod \"ovnkube-node-zn27c\" (UID: \"06903f84-978e-4cd4-9f1a-6ccdf2b7524b\") " pod="openshift-ovn-kubernetes/ovnkube-node-zn27c"
Jul 18 01:47:50.856855 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:47:50.856798    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/fae2962e-4ef0-41af-a49e-d6216d1aa7c9-system-cni-dir\") pod \"multus-additional-cni-plugins-smml7\" (UID: \"fae2962e-4ef0-41af-a49e-d6216d1aa7c9\") " pod="openshift-multus/multus-additional-cni-plugins-smml7"
Jul 18 01:47:50.856855 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:47:50.856825    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/06903f84-978e-4cd4-9f1a-6ccdf2b7524b-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-zn27c\" (UID: \"06903f84-978e-4cd4-9f1a-6ccdf2b7524b\") " pod="openshift-ovn-kubernetes/ovnkube-node-zn27c"
Jul 18 01:47:50.857244 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:47:50.856875    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-t7dg2\" (UniqueName: \"kubernetes.io/projected/ddbb4203-0f8f-4799-a645-184ca2236211-kube-api-access-t7dg2\") pod \"node-resolver-cpp62\" (UID: \"ddbb4203-0f8f-4799-a645-184ca2236211\") " pod="openshift-dns/node-resolver-cpp62"
Jul 18 01:47:50.857244 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:47:50.856910    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/fae2962e-4ef0-41af-a49e-d6216d1aa7c9-system-cni-dir\") pod \"multus-additional-cni-plugins-smml7\" (UID: \"fae2962e-4ef0-41af-a49e-d6216d1aa7c9\") " pod="openshift-multus/multus-additional-cni-plugins-smml7"
Jul 18 01:47:50.857244 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:47:50.856879    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/075e93b2-88e3-4a5f-9200-2d0f9fc1d599-kubelet-dir\") pod \"aws-ebs-csi-driver-node-dkzsl\" (UID: \"075e93b2-88e3-4a5f-9200-2d0f9fc1d599\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dkzsl"
Jul 18 01:47:50.857244 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:47:50.856914    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/840829b1-92cb-4b4d-839f-a27bb50774ea-host-slash\") pod \"iptables-alerter-cqkkm\" (UID: \"840829b1-92cb-4b4d-839f-a27bb50774ea\") " pod="openshift-network-operator/iptables-alerter-cqkkm"
Jul 18 01:47:50.857244 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:47:50.856964    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/06903f84-978e-4cd4-9f1a-6ccdf2b7524b-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-zn27c\" (UID: \"06903f84-978e-4cd4-9f1a-6ccdf2b7524b\") " pod="openshift-ovn-kubernetes/ovnkube-node-zn27c"
Jul 18 01:47:50.857244 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:47:50.856972    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/075e93b2-88e3-4a5f-9200-2d0f9fc1d599-registration-dir\") pod \"aws-ebs-csi-driver-node-dkzsl\" (UID: \"075e93b2-88e3-4a5f-9200-2d0f9fc1d599\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dkzsl"
Jul 18 01:47:50.857244 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:47:50.856980    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/44aa7f9e-049a-45bc-98bc-ff1d4309f5de-agent-certs\") pod \"konnectivity-agent-l28dd\" (UID: \"44aa7f9e-049a-45bc-98bc-ff1d4309f5de\") " pod="kube-system/konnectivity-agent-l28dd"
Jul 18 01:47:50.857244 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:47:50.857008    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/06903f84-978e-4cd4-9f1a-6ccdf2b7524b-run-systemd\") pod \"ovnkube-node-zn27c\" (UID: \"06903f84-978e-4cd4-9f1a-6ccdf2b7524b\") " pod="openshift-ovn-kubernetes/ovnkube-node-zn27c"
Jul 18 01:47:50.857244 ip-10-0-142-238 kubenswrapper[2566]: E0718 01:47:50.857133    2566 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 18 01:47:50.857244 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:47:50.857128    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/f3a548b3-84f2-4a68-8676-5b8b26777d81-host\") pod \"tuned-tscwd\" (UID: \"f3a548b3-84f2-4a68-8676-5b8b26777d81\") " pod="openshift-cluster-node-tuning-operator/tuned-tscwd"
Jul 18 01:47:50.857244 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:47:50.857174    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/06903f84-978e-4cd4-9f1a-6ccdf2b7524b-run-systemd\") pod \"ovnkube-node-zn27c\" (UID: \"06903f84-978e-4cd4-9f1a-6ccdf2b7524b\") " pod="openshift-ovn-kubernetes/ovnkube-node-zn27c"
Jul 18 01:47:50.857244 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:47:50.857231    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/f3a548b3-84f2-4a68-8676-5b8b26777d81-etc-tuned\") pod \"tuned-tscwd\" (UID: \"f3a548b3-84f2-4a68-8676-5b8b26777d81\") " pod="openshift-cluster-node-tuning-operator/tuned-tscwd"
Jul 18 01:47:50.857244 ip-10-0-142-238 kubenswrapper[2566]: E0718 01:47:50.857257    2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7c91433e-b6e6-47a8-8df6-2231cbc7d28c-metrics-certs podName:7c91433e-b6e6-47a8-8df6-2231cbc7d28c nodeName:}" failed. No retries permitted until 2026-07-18 01:47:51.357233166 +0000 UTC m=+3.045960628 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/7c91433e-b6e6-47a8-8df6-2231cbc7d28c-metrics-certs") pod "network-metrics-daemon-pdflp" (UID: "7c91433e-b6e6-47a8-8df6-2231cbc7d28c") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 18 01:47:50.857998 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:47:50.857293    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/573bdc5a-3cb5-4729-9426-270ba59b0d02-serviceca\") pod \"node-ca-lt6hj\" (UID: \"573bdc5a-3cb5-4729-9426-270ba59b0d02\") " pod="openshift-image-registry/node-ca-lt6hj"
Jul 18 01:47:50.857998 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:47:50.857318    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/d43cde0e-8b28-405b-a229-dedf1d9c4435-cni-binary-copy\") pod \"multus-z6hz2\" (UID: \"d43cde0e-8b28-405b-a229-dedf1d9c4435\") " pod="openshift-multus/multus-z6hz2"
Jul 18 01:47:50.857998 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:47:50.857341    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/d43cde0e-8b28-405b-a229-dedf1d9c4435-host-run-k8s-cni-cncf-io\") pod \"multus-z6hz2\" (UID: \"d43cde0e-8b28-405b-a229-dedf1d9c4435\") " pod="openshift-multus/multus-z6hz2"
Jul 18 01:47:50.857998 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:47:50.857371    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kdj7h\" (UniqueName: \"kubernetes.io/projected/7c91433e-b6e6-47a8-8df6-2231cbc7d28c-kube-api-access-kdj7h\") pod \"network-metrics-daemon-pdflp\" (UID: \"7c91433e-b6e6-47a8-8df6-2231cbc7d28c\") " pod="openshift-multus/network-metrics-daemon-pdflp"
Jul 18 01:47:50.857998 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:47:50.857395    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/06903f84-978e-4cd4-9f1a-6ccdf2b7524b-ovnkube-config\") pod \"ovnkube-node-zn27c\" (UID: \"06903f84-978e-4cd4-9f1a-6ccdf2b7524b\") " pod="openshift-ovn-kubernetes/ovnkube-node-zn27c"
Jul 18 01:47:50.857998 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:47:50.857418    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/d43cde0e-8b28-405b-a229-dedf1d9c4435-multus-cni-dir\") pod \"multus-z6hz2\" (UID: \"d43cde0e-8b28-405b-a229-dedf1d9c4435\") " pod="openshift-multus/multus-z6hz2"
Jul 18 01:47:50.857998 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:47:50.857434    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/d43cde0e-8b28-405b-a229-dedf1d9c4435-host-var-lib-cni-bin\") pod \"multus-z6hz2\" (UID: \"d43cde0e-8b28-405b-a229-dedf1d9c4435\") " pod="openshift-multus/multus-z6hz2"
Jul 18 01:47:50.857998 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:47:50.857450    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/26d75b92-43d7-43e7-96c8-dd42a5288953-original-pull-secret\") pod \"global-pull-secret-syncer-2jzkc\" (UID: \"26d75b92-43d7-43e7-96c8-dd42a5288953\") " pod="kube-system/global-pull-secret-syncer-2jzkc"
Jul 18 01:47:50.857998 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:47:50.857468    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/fae2962e-4ef0-41af-a49e-d6216d1aa7c9-cni-binary-copy\") pod \"multus-additional-cni-plugins-smml7\" (UID: \"fae2962e-4ef0-41af-a49e-d6216d1aa7c9\") " pod="openshift-multus/multus-additional-cni-plugins-smml7"
Jul 18 01:47:50.857998 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:47:50.857452    2566 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory"
Jul 18 01:47:50.857998 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:47:50.857479    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/06903f84-978e-4cd4-9f1a-6ccdf2b7524b-ovnkube-script-lib\") pod \"ovnkube-node-zn27c\" (UID: \"06903f84-978e-4cd4-9f1a-6ccdf2b7524b\") " pod="openshift-ovn-kubernetes/ovnkube-node-zn27c"
Jul 18 01:47:50.857998 ip-10-0-142-238 kubenswrapper[2566]: E0718 01:47:50.857549    2566 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 18 01:47:50.857998 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:47:50.857549    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/06903f84-978e-4cd4-9f1a-6ccdf2b7524b-systemd-units\") pod \"ovnkube-node-zn27c\" (UID: \"06903f84-978e-4cd4-9f1a-6ccdf2b7524b\") " pod="openshift-ovn-kubernetes/ovnkube-node-zn27c"
Jul 18 01:47:50.857998 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:47:50.857486    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/06903f84-978e-4cd4-9f1a-6ccdf2b7524b-systemd-units\") pod \"ovnkube-node-zn27c\" (UID: \"06903f84-978e-4cd4-9f1a-6ccdf2b7524b\") " pod="openshift-ovn-kubernetes/ovnkube-node-zn27c"
Jul 18 01:47:50.857998 ip-10-0-142-238 kubenswrapper[2566]: E0718 01:47:50.857580    2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/26d75b92-43d7-43e7-96c8-dd42a5288953-original-pull-secret podName:26d75b92-43d7-43e7-96c8-dd42a5288953 nodeName:}" failed. No retries permitted until 2026-07-18 01:47:51.357569423 +0000 UTC m=+3.046296850 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/26d75b92-43d7-43e7-96c8-dd42a5288953-original-pull-secret") pod "global-pull-secret-syncer-2jzkc" (UID: "26d75b92-43d7-43e7-96c8-dd42a5288953") : object "kube-system"/"original-pull-secret" not registered
Jul 18 01:47:50.857998 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:47:50.857593    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/d43cde0e-8b28-405b-a229-dedf1d9c4435-host-var-lib-cni-multus\") pod \"multus-z6hz2\" (UID: \"d43cde0e-8b28-405b-a229-dedf1d9c4435\") " pod="openshift-multus/multus-z6hz2"
Jul 18 01:47:50.857998 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:47:50.857612    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/26d75b92-43d7-43e7-96c8-dd42a5288953-kubelet-config\") pod \"global-pull-secret-syncer-2jzkc\" (UID: \"26d75b92-43d7-43e7-96c8-dd42a5288953\") " pod="kube-system/global-pull-secret-syncer-2jzkc"
Jul 18 01:47:50.858886 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:47:50.857635    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/06903f84-978e-4cd4-9f1a-6ccdf2b7524b-ovn-node-metrics-cert\") pod \"ovnkube-node-zn27c\" (UID: \"06903f84-978e-4cd4-9f1a-6ccdf2b7524b\") " pod="openshift-ovn-kubernetes/ovnkube-node-zn27c"
Jul 18 01:47:50.858886 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:47:50.857677    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fjllh\" (UniqueName: \"kubernetes.io/projected/06903f84-978e-4cd4-9f1a-6ccdf2b7524b-kube-api-access-fjllh\") pod \"ovnkube-node-zn27c\" (UID: \"06903f84-978e-4cd4-9f1a-6ccdf2b7524b\") " pod="openshift-ovn-kubernetes/ovnkube-node-zn27c"
Jul 18 01:47:50.858886 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:47:50.857703    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/d43cde0e-8b28-405b-a229-dedf1d9c4435-multus-conf-dir\") pod \"multus-z6hz2\" (UID: \"d43cde0e-8b28-405b-a229-dedf1d9c4435\") " pod="openshift-multus/multus-z6hz2"
Jul 18 01:47:50.858886 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:47:50.857729    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/075e93b2-88e3-4a5f-9200-2d0f9fc1d599-socket-dir\") pod \"aws-ebs-csi-driver-node-dkzsl\" (UID: \"075e93b2-88e3-4a5f-9200-2d0f9fc1d599\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dkzsl"
Jul 18 01:47:50.858886 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:47:50.857765    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/fae2962e-4ef0-41af-a49e-d6216d1aa7c9-cnibin\") pod \"multus-additional-cni-plugins-smml7\" (UID: \"fae2962e-4ef0-41af-a49e-d6216d1aa7c9\") " pod="openshift-multus/multus-additional-cni-plugins-smml7"
Jul 18 01:47:50.858886 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:47:50.857790    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/fae2962e-4ef0-41af-a49e-d6216d1aa7c9-tuning-conf-dir\") pod \"multus-additional-cni-plugins-smml7\" (UID: \"fae2962e-4ef0-41af-a49e-d6216d1aa7c9\") " pod="openshift-multus/multus-additional-cni-plugins-smml7"
Jul 18 01:47:50.858886 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:47:50.857818    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/f3a548b3-84f2-4a68-8676-5b8b26777d81-run\") pod \"tuned-tscwd\" (UID: \"f3a548b3-84f2-4a68-8676-5b8b26777d81\") " pod="openshift-cluster-node-tuning-operator/tuned-tscwd"
Jul 18 01:47:50.858886 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:47:50.857842    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/f3a548b3-84f2-4a68-8676-5b8b26777d81-var-lib-kubelet\") pod \"tuned-tscwd\" (UID: \"f3a548b3-84f2-4a68-8676-5b8b26777d81\") " pod="openshift-cluster-node-tuning-operator/tuned-tscwd"
Jul 18 01:47:50.858886 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:47:50.857866    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/075e93b2-88e3-4a5f-9200-2d0f9fc1d599-device-dir\") pod \"aws-ebs-csi-driver-node-dkzsl\" (UID: \"075e93b2-88e3-4a5f-9200-2d0f9fc1d599\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dkzsl"
Jul 18 01:47:50.858886 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:47:50.857895    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/fae2962e-4ef0-41af-a49e-d6216d1aa7c9-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-smml7\" (UID: \"fae2962e-4ef0-41af-a49e-d6216d1aa7c9\") " pod="openshift-multus/multus-additional-cni-plugins-smml7"
Jul 18 01:47:50.858886 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:47:50.857899    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/06903f84-978e-4cd4-9f1a-6ccdf2b7524b-ovnkube-config\") pod \"ovnkube-node-zn27c\" (UID: \"06903f84-978e-4cd4-9f1a-6ccdf2b7524b\") " pod="openshift-ovn-kubernetes/ovnkube-node-zn27c"
Jul 18 01:47:50.858886 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:47:50.857788    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/26d75b92-43d7-43e7-96c8-dd42a5288953-kubelet-config\") pod \"global-pull-secret-syncer-2jzkc\" (UID: \"26d75b92-43d7-43e7-96c8-dd42a5288953\") " pod="kube-system/global-pull-secret-syncer-2jzkc"
Jul 18 01:47:50.858886 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:47:50.857919    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/06903f84-978e-4cd4-9f1a-6ccdf2b7524b-host-slash\") pod \"ovnkube-node-zn27c\" (UID: \"06903f84-978e-4cd4-9f1a-6ccdf2b7524b\") " pod="openshift-ovn-kubernetes/ovnkube-node-zn27c"
Jul 18 01:47:50.858886 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:47:50.857966    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/06903f84-978e-4cd4-9f1a-6ccdf2b7524b-host-slash\") pod \"ovnkube-node-zn27c\" (UID: \"06903f84-978e-4cd4-9f1a-6ccdf2b7524b\") " pod="openshift-ovn-kubernetes/ovnkube-node-zn27c"
Jul 18 01:47:50.858886 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:47:50.857965    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/06903f84-978e-4cd4-9f1a-6ccdf2b7524b-host-run-ovn-kubernetes\") pod \"ovnkube-node-zn27c\" (UID: \"06903f84-978e-4cd4-9f1a-6ccdf2b7524b\") " pod="openshift-ovn-kubernetes/ovnkube-node-zn27c"
Jul 18 01:47:50.858886 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:47:50.858017    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/d43cde0e-8b28-405b-a229-dedf1d9c4435-cnibin\") pod \"multus-z6hz2\" (UID: \"d43cde0e-8b28-405b-a229-dedf1d9c4435\") " pod="openshift-multus/multus-z6hz2"
Jul 18 01:47:50.858886 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:47:50.858046    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/06903f84-978e-4cd4-9f1a-6ccdf2b7524b-run-openvswitch\") pod \"ovnkube-node-zn27c\" (UID: \"06903f84-978e-4cd4-9f1a-6ccdf2b7524b\") " pod="openshift-ovn-kubernetes/ovnkube-node-zn27c"
Jul 18 01:47:50.859816 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:47:50.858071    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/f3a548b3-84f2-4a68-8676-5b8b26777d81-etc-sysconfig\") pod \"tuned-tscwd\" (UID: \"f3a548b3-84f2-4a68-8676-5b8b26777d81\") " pod="openshift-cluster-node-tuning-operator/tuned-tscwd"
Jul 18 01:47:50.859816 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:47:50.858095    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/f3a548b3-84f2-4a68-8676-5b8b26777d81-etc-sysctl-conf\") pod \"tuned-tscwd\" (UID: \"f3a548b3-84f2-4a68-8676-5b8b26777d81\") " pod="openshift-cluster-node-tuning-operator/tuned-tscwd"
Jul 18 01:47:50.859816 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:47:50.858118    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/ddbb4203-0f8f-4799-a645-184ca2236211-hosts-file\") pod \"node-resolver-cpp62\" (UID: \"ddbb4203-0f8f-4799-a645-184ca2236211\") " pod="openshift-dns/node-resolver-cpp62"
Jul 18 01:47:50.859816 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:47:50.858071    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/fae2962e-4ef0-41af-a49e-d6216d1aa7c9-cni-binary-copy\") pod \"multus-additional-cni-plugins-smml7\" (UID: \"fae2962e-4ef0-41af-a49e-d6216d1aa7c9\") " pod="openshift-multus/multus-additional-cni-plugins-smml7"
Jul 18 01:47:50.859816 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:47:50.858143    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/06903f84-978e-4cd4-9f1a-6ccdf2b7524b-etc-openvswitch\") pod \"ovnkube-node-zn27c\" (UID: \"06903f84-978e-4cd4-9f1a-6ccdf2b7524b\") " pod="openshift-ovn-kubernetes/ovnkube-node-zn27c"
Jul 18 01:47:50.859816 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:47:50.858168    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-z9bkl\" (UniqueName: \"kubernetes.io/projected/f3a548b3-84f2-4a68-8676-5b8b26777d81-kube-api-access-z9bkl\") pod \"tuned-tscwd\" (UID: \"f3a548b3-84f2-4a68-8676-5b8b26777d81\") " pod="openshift-cluster-node-tuning-operator/tuned-tscwd"
Jul 18 01:47:50.859816 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:47:50.858192    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/573bdc5a-3cb5-4729-9426-270ba59b0d02-host\") pod \"node-ca-lt6hj\" (UID: \"573bdc5a-3cb5-4729-9426-270ba59b0d02\") " pod="openshift-image-registry/node-ca-lt6hj"
Jul 18 01:47:50.859816 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:47:50.858200    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/06903f84-978e-4cd4-9f1a-6ccdf2b7524b-run-openvswitch\") pod \"ovnkube-node-zn27c\" (UID: \"06903f84-978e-4cd4-9f1a-6ccdf2b7524b\") " pod="openshift-ovn-kubernetes/ovnkube-node-zn27c"
Jul 18 01:47:50.859816 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:47:50.858046    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/075e93b2-88e3-4a5f-9200-2d0f9fc1d599-device-dir\") pod \"aws-ebs-csi-driver-node-dkzsl\" (UID: \"075e93b2-88e3-4a5f-9200-2d0f9fc1d599\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dkzsl"
Jul 18 01:47:50.859816 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:47:50.858217    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/d43cde0e-8b28-405b-a229-dedf1d9c4435-host-run-multus-certs\") pod \"multus-z6hz2\" (UID: \"d43cde0e-8b28-405b-a229-dedf1d9c4435\") " pod="openshift-multus/multus-z6hz2"
Jul 18 01:47:50.859816 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:47:50.858226    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/075e93b2-88e3-4a5f-9200-2d0f9fc1d599-socket-dir\") pod \"aws-ebs-csi-driver-node-dkzsl\" (UID: \"075e93b2-88e3-4a5f-9200-2d0f9fc1d599\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dkzsl"
Jul 18 01:47:50.859816 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:47:50.858256    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/06903f84-978e-4cd4-9f1a-6ccdf2b7524b-host-kubelet\") pod \"ovnkube-node-zn27c\" (UID: \"06903f84-978e-4cd4-9f1a-6ccdf2b7524b\") " pod="openshift-ovn-kubernetes/ovnkube-node-zn27c"
Jul 18 01:47:50.859816 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:47:50.858282    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/fae2962e-4ef0-41af-a49e-d6216d1aa7c9-cnibin\") pod \"multus-additional-cni-plugins-smml7\" (UID: \"fae2962e-4ef0-41af-a49e-d6216d1aa7c9\") " pod="openshift-multus/multus-additional-cni-plugins-smml7"
Jul 18 01:47:50.859816 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:47:50.858310    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/06903f84-978e-4cd4-9f1a-6ccdf2b7524b-host-run-ovn-kubernetes\") pod \"ovnkube-node-zn27c\" (UID: \"06903f84-978e-4cd4-9f1a-6ccdf2b7524b\") " pod="openshift-ovn-kubernetes/ovnkube-node-zn27c"
Jul 18 01:47:50.859816 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:47:50.858322    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/06903f84-978e-4cd4-9f1a-6ccdf2b7524b-host-kubelet\") pod \"ovnkube-node-zn27c\" (UID: \"06903f84-978e-4cd4-9f1a-6ccdf2b7524b\") " pod="openshift-ovn-kubernetes/ovnkube-node-zn27c"
Jul 18 01:47:50.859816 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:47:50.858331    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/06903f84-978e-4cd4-9f1a-6ccdf2b7524b-var-lib-openvswitch\") pod \"ovnkube-node-zn27c\" (UID: \"06903f84-978e-4cd4-9f1a-6ccdf2b7524b\") " pod="openshift-ovn-kubernetes/ovnkube-node-zn27c"
Jul 18 01:47:50.859816 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:47:50.858284    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/06903f84-978e-4cd4-9f1a-6ccdf2b7524b-var-lib-openvswitch\") pod \"ovnkube-node-zn27c\" (UID: \"06903f84-978e-4cd4-9f1a-6ccdf2b7524b\") " pod="openshift-ovn-kubernetes/ovnkube-node-zn27c"
Jul 18 01:47:50.860691 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:47:50.858353    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/06903f84-978e-4cd4-9f1a-6ccdf2b7524b-etc-openvswitch\") pod \"ovnkube-node-zn27c\" (UID: \"06903f84-978e-4cd4-9f1a-6ccdf2b7524b\") " pod="openshift-ovn-kubernetes/ovnkube-node-zn27c"
Jul 18 01:47:50.860691 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:47:50.858379    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/06903f84-978e-4cd4-9f1a-6ccdf2b7524b-run-ovn\") pod \"ovnkube-node-zn27c\" (UID: \"06903f84-978e-4cd4-9f1a-6ccdf2b7524b\") " pod="openshift-ovn-kubernetes/ovnkube-node-zn27c"
Jul 18 01:47:50.860691 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:47:50.858396    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/fae2962e-4ef0-41af-a49e-d6216d1aa7c9-tuning-conf-dir\") pod \"multus-additional-cni-plugins-smml7\" (UID: \"fae2962e-4ef0-41af-a49e-d6216d1aa7c9\") " pod="openshift-multus/multus-additional-cni-plugins-smml7"
Jul 18 01:47:50.860691 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:47:50.858406    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/06903f84-978e-4cd4-9f1a-6ccdf2b7524b-env-overrides\") pod \"ovnkube-node-zn27c\" (UID: \"06903f84-978e-4cd4-9f1a-6ccdf2b7524b\") " pod="openshift-ovn-kubernetes/ovnkube-node-zn27c"
Jul 18 01:47:50.860691 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:47:50.858435    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/f3a548b3-84f2-4a68-8676-5b8b26777d81-etc-sysctl-d\") pod \"tuned-tscwd\" (UID: \"f3a548b3-84f2-4a68-8676-5b8b26777d81\") " pod="openshift-cluster-node-tuning-operator/tuned-tscwd"
Jul 18 01:47:50.860691 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:47:50.858483    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/fae2962e-4ef0-41af-a49e-d6216d1aa7c9-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-smml7\" (UID: \"fae2962e-4ef0-41af-a49e-d6216d1aa7c9\") " pod="openshift-multus/multus-additional-cni-plugins-smml7"
Jul 18 01:47:50.860691 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:47:50.858514    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/06903f84-978e-4cd4-9f1a-6ccdf2b7524b-host-cni-bin\") pod \"ovnkube-node-zn27c\" (UID: \"06903f84-978e-4cd4-9f1a-6ccdf2b7524b\") " pod="openshift-ovn-kubernetes/ovnkube-node-zn27c"
Jul 18 01:47:50.860691 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:47:50.858397    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/06903f84-978e-4cd4-9f1a-6ccdf2b7524b-run-ovn\") pod \"ovnkube-node-zn27c\" (UID: \"06903f84-978e-4cd4-9f1a-6ccdf2b7524b\") " pod="openshift-ovn-kubernetes/ovnkube-node-zn27c"
Jul 18 01:47:50.860691 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:47:50.858532    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/f3a548b3-84f2-4a68-8676-5b8b26777d81-etc-systemd\") pod \"tuned-tscwd\" (UID: \"f3a548b3-84f2-4a68-8676-5b8b26777d81\") " pod="openshift-cluster-node-tuning-operator/tuned-tscwd"
Jul 18 01:47:50.860691 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:47:50.858572    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/06903f84-978e-4cd4-9f1a-6ccdf2b7524b-host-cni-bin\") pod \"ovnkube-node-zn27c\" (UID: \"06903f84-978e-4cd4-9f1a-6ccdf2b7524b\") " pod="openshift-ovn-kubernetes/ovnkube-node-zn27c"
Jul 18 01:47:50.860691 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:47:50.858602    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/f3a548b3-84f2-4a68-8676-5b8b26777d81-tmp\") pod \"tuned-tscwd\" (UID: \"f3a548b3-84f2-4a68-8676-5b8b26777d81\") " pod="openshift-cluster-node-tuning-operator/tuned-tscwd"
Jul 18 01:47:50.860691 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:47:50.858645    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/d43cde0e-8b28-405b-a229-dedf1d9c4435-host-var-lib-kubelet\") pod \"multus-z6hz2\" (UID: \"d43cde0e-8b28-405b-a229-dedf1d9c4435\") " pod="openshift-multus/multus-z6hz2"
Jul 18 01:47:50.860691 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:47:50.858671    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jthqx\" (UniqueName: \"kubernetes.io/projected/d43cde0e-8b28-405b-a229-dedf1d9c4435-kube-api-access-jthqx\") pod \"multus-z6hz2\" (UID: \"d43cde0e-8b28-405b-a229-dedf1d9c4435\") " pod="openshift-multus/multus-z6hz2"
Jul 18 01:47:50.860691 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:47:50.858697    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/075e93b2-88e3-4a5f-9200-2d0f9fc1d599-sys-fs\") pod \"aws-ebs-csi-driver-node-dkzsl\" (UID: \"075e93b2-88e3-4a5f-9200-2d0f9fc1d599\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dkzsl"
Jul 18 01:47:50.860691 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:47:50.858728    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/fae2962e-4ef0-41af-a49e-d6216d1aa7c9-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-smml7\" (UID: \"fae2962e-4ef0-41af-a49e-d6216d1aa7c9\") " pod="openshift-multus/multus-additional-cni-plugins-smml7"
Jul 18 01:47:50.860691 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:47:50.858742    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/075e93b2-88e3-4a5f-9200-2d0f9fc1d599-sys-fs\") pod \"aws-ebs-csi-driver-node-dkzsl\" (UID: \"075e93b2-88e3-4a5f-9200-2d0f9fc1d599\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dkzsl"
Jul 18 01:47:50.860691 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:47:50.858763    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/06903f84-978e-4cd4-9f1a-6ccdf2b7524b-host-run-netns\") pod \"ovnkube-node-zn27c\" (UID: \"06903f84-978e-4cd4-9f1a-6ccdf2b7524b\") " pod="openshift-ovn-kubernetes/ovnkube-node-zn27c"
Jul 18 01:47:50.861435 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:47:50.858788    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/06903f84-978e-4cd4-9f1a-6ccdf2b7524b-host-cni-netd\") pod \"ovnkube-node-zn27c\" (UID: \"06903f84-978e-4cd4-9f1a-6ccdf2b7524b\") " pod="openshift-ovn-kubernetes/ovnkube-node-zn27c"
Jul 18 01:47:50.861435 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:47:50.858790    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/06903f84-978e-4cd4-9f1a-6ccdf2b7524b-env-overrides\") pod \"ovnkube-node-zn27c\" (UID: \"06903f84-978e-4cd4-9f1a-6ccdf2b7524b\") " pod="openshift-ovn-kubernetes/ovnkube-node-zn27c"
Jul 18 01:47:50.861435 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:47:50.858812    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/f3a548b3-84f2-4a68-8676-5b8b26777d81-etc-kubernetes\") pod \"tuned-tscwd\" (UID: \"f3a548b3-84f2-4a68-8676-5b8b26777d81\") " pod="openshift-cluster-node-tuning-operator/tuned-tscwd"
Jul 18 01:47:50.861435 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:47:50.858820    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/06903f84-978e-4cd4-9f1a-6ccdf2b7524b-host-run-netns\") pod \"ovnkube-node-zn27c\" (UID: \"06903f84-978e-4cd4-9f1a-6ccdf2b7524b\") " pod="openshift-ovn-kubernetes/ovnkube-node-zn27c"
Jul 18 01:47:50.861435 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:47:50.858836    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/d43cde0e-8b28-405b-a229-dedf1d9c4435-system-cni-dir\") pod \"multus-z6hz2\" (UID: \"d43cde0e-8b28-405b-a229-dedf1d9c4435\") " pod="openshift-multus/multus-z6hz2"
Jul 18 01:47:50.861435 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:47:50.858842    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/06903f84-978e-4cd4-9f1a-6ccdf2b7524b-host-cni-netd\") pod \"ovnkube-node-zn27c\" (UID: \"06903f84-978e-4cd4-9f1a-6ccdf2b7524b\") " pod="openshift-ovn-kubernetes/ovnkube-node-zn27c"
Jul 18 01:47:50.861435 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:47:50.858870    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/d43cde0e-8b28-405b-a229-dedf1d9c4435-os-release\") pod \"multus-z6hz2\" (UID: \"d43cde0e-8b28-405b-a229-dedf1d9c4435\") " pod="openshift-multus/multus-z6hz2"
Jul 18 01:47:50.861435 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:47:50.858897    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/d43cde0e-8b28-405b-a229-dedf1d9c4435-multus-daemon-config\") pod \"multus-z6hz2\" (UID: \"d43cde0e-8b28-405b-a229-dedf1d9c4435\") " pod="openshift-multus/multus-z6hz2"
Jul 18 01:47:50.861435 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:47:50.858921    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/44aa7f9e-049a-45bc-98bc-ff1d4309f5de-konnectivity-ca\") pod \"konnectivity-agent-l28dd\" (UID: \"44aa7f9e-049a-45bc-98bc-ff1d4309f5de\") " pod="kube-system/konnectivity-agent-l28dd"
Jul 18 01:47:50.861435 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:47:50.858974    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/fae2962e-4ef0-41af-a49e-d6216d1aa7c9-os-release\") pod \"multus-additional-cni-plugins-smml7\" (UID: \"fae2962e-4ef0-41af-a49e-d6216d1aa7c9\") " pod="openshift-multus/multus-additional-cni-plugins-smml7"
Jul 18 01:47:50.861435 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:47:50.859001    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/06903f84-978e-4cd4-9f1a-6ccdf2b7524b-log-socket\") pod \"ovnkube-node-zn27c\" (UID: \"06903f84-978e-4cd4-9f1a-6ccdf2b7524b\") " pod="openshift-ovn-kubernetes/ovnkube-node-zn27c"
Jul 18 01:47:50.861435 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:47:50.859029    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/f3a548b3-84f2-4a68-8676-5b8b26777d81-sys\") pod \"tuned-tscwd\" (UID: \"f3a548b3-84f2-4a68-8676-5b8b26777d81\") " pod="openshift-cluster-node-tuning-operator/tuned-tscwd"
Jul 18 01:47:50.861435 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:47:50.859054    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tqf9n\" (UniqueName: \"kubernetes.io/projected/573bdc5a-3cb5-4729-9426-270ba59b0d02-kube-api-access-tqf9n\") pod \"node-ca-lt6hj\" (UID: \"573bdc5a-3cb5-4729-9426-270ba59b0d02\") " pod="openshift-image-registry/node-ca-lt6hj"
Jul 18 01:47:50.861435 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:47:50.859080    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/d43cde0e-8b28-405b-a229-dedf1d9c4435-multus-socket-dir-parent\") pod \"multus-z6hz2\" (UID: \"d43cde0e-8b28-405b-a229-dedf1d9c4435\") " pod="openshift-multus/multus-z6hz2"
Jul 18 01:47:50.861435 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:47:50.859107    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/d43cde0e-8b28-405b-a229-dedf1d9c4435-etc-kubernetes\") pod \"multus-z6hz2\" (UID: \"d43cde0e-8b28-405b-a229-dedf1d9c4435\") " pod="openshift-multus/multus-z6hz2"
Jul 18 01:47:50.861435 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:47:50.859132    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rfxnj\" (UniqueName: \"kubernetes.io/projected/840829b1-92cb-4b4d-839f-a27bb50774ea-kube-api-access-rfxnj\") pod \"iptables-alerter-cqkkm\" (UID: \"840829b1-92cb-4b4d-839f-a27bb50774ea\") " pod="openshift-network-operator/iptables-alerter-cqkkm"
Jul 18 01:47:50.861435 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:47:50.859148    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/06903f84-978e-4cd4-9f1a-6ccdf2b7524b-log-socket\") pod \"ovnkube-node-zn27c\" (UID: \"06903f84-978e-4cd4-9f1a-6ccdf2b7524b\") " pod="openshift-ovn-kubernetes/ovnkube-node-zn27c"
Jul 18 01:47:50.862274 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:47:50.859158    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/075e93b2-88e3-4a5f-9200-2d0f9fc1d599-etc-selinux\") pod \"aws-ebs-csi-driver-node-dkzsl\" (UID: \"075e93b2-88e3-4a5f-9200-2d0f9fc1d599\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dkzsl"
Jul 18 01:47:50.862274 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:47:50.859186    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lscmb\" (UniqueName: \"kubernetes.io/projected/075e93b2-88e3-4a5f-9200-2d0f9fc1d599-kube-api-access-lscmb\") pod \"aws-ebs-csi-driver-node-dkzsl\" (UID: \"075e93b2-88e3-4a5f-9200-2d0f9fc1d599\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dkzsl"
Jul 18 01:47:50.862274 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:47:50.859188    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/fae2962e-4ef0-41af-a49e-d6216d1aa7c9-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-smml7\" (UID: \"fae2962e-4ef0-41af-a49e-d6216d1aa7c9\") " pod="openshift-multus/multus-additional-cni-plugins-smml7"
Jul 18 01:47:50.862274 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:47:50.859107    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/fae2962e-4ef0-41af-a49e-d6216d1aa7c9-os-release\") pod \"multus-additional-cni-plugins-smml7\" (UID: \"fae2962e-4ef0-41af-a49e-d6216d1aa7c9\") " pod="openshift-multus/multus-additional-cni-plugins-smml7"
Jul 18 01:47:50.862274 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:47:50.859214    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/26d75b92-43d7-43e7-96c8-dd42a5288953-dbus\") pod \"global-pull-secret-syncer-2jzkc\" (UID: \"26d75b92-43d7-43e7-96c8-dd42a5288953\") " pod="kube-system/global-pull-secret-syncer-2jzkc"
Jul 18 01:47:50.862274 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:47:50.859287    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/075e93b2-88e3-4a5f-9200-2d0f9fc1d599-etc-selinux\") pod \"aws-ebs-csi-driver-node-dkzsl\" (UID: \"075e93b2-88e3-4a5f-9200-2d0f9fc1d599\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dkzsl"
Jul 18 01:47:50.862274 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:47:50.859387    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/44aa7f9e-049a-45bc-98bc-ff1d4309f5de-konnectivity-ca\") pod \"konnectivity-agent-l28dd\" (UID: \"44aa7f9e-049a-45bc-98bc-ff1d4309f5de\") " pod="kube-system/konnectivity-agent-l28dd"
Jul 18 01:47:50.862274 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:47:50.859403    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/26d75b92-43d7-43e7-96c8-dd42a5288953-dbus\") pod \"global-pull-secret-syncer-2jzkc\" (UID: \"26d75b92-43d7-43e7-96c8-dd42a5288953\") " pod="kube-system/global-pull-secret-syncer-2jzkc"
Jul 18 01:47:50.862274 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:47:50.861805    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/44aa7f9e-049a-45bc-98bc-ff1d4309f5de-agent-certs\") pod \"konnectivity-agent-l28dd\" (UID: \"44aa7f9e-049a-45bc-98bc-ff1d4309f5de\") " pod="kube-system/konnectivity-agent-l28dd"
Jul 18 01:47:50.862274 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:47:50.862047    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/06903f84-978e-4cd4-9f1a-6ccdf2b7524b-ovn-node-metrics-cert\") pod \"ovnkube-node-zn27c\" (UID: \"06903f84-978e-4cd4-9f1a-6ccdf2b7524b\") " pod="openshift-ovn-kubernetes/ovnkube-node-zn27c"
Jul 18 01:47:50.868299 ip-10-0-142-238 kubenswrapper[2566]: E0718 01:47:50.868271    2566 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 18 01:47:50.868299 ip-10-0-142-238 kubenswrapper[2566]: E0718 01:47:50.868296    2566 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 18 01:47:50.868460 ip-10-0-142-238 kubenswrapper[2566]: E0718 01:47:50.868309    2566 projected.go:196] Error preparing data for projected volume kube-api-access-x4khf for pod openshift-network-diagnostics/network-check-target-n8bdx: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 18 01:47:50.868460 ip-10-0-142-238 kubenswrapper[2566]: E0718 01:47:50.868384    2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/25c58f22-7d60-4a06-844f-f3508d910e76-kube-api-access-x4khf podName:25c58f22-7d60-4a06-844f-f3508d910e76 nodeName:}" failed. No retries permitted until 2026-07-18 01:47:51.368368768 +0000 UTC m=+3.057096199 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-x4khf" (UniqueName: "kubernetes.io/projected/25c58f22-7d60-4a06-844f-f3508d910e76-kube-api-access-x4khf") pod "network-check-target-n8bdx" (UID: "25c58f22-7d60-4a06-844f-f3508d910e76") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 18 01:47:50.870184 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:47:50.870158    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bc6g4\" (UniqueName: \"kubernetes.io/projected/fae2962e-4ef0-41af-a49e-d6216d1aa7c9-kube-api-access-bc6g4\") pod \"multus-additional-cni-plugins-smml7\" (UID: \"fae2962e-4ef0-41af-a49e-d6216d1aa7c9\") " pod="openshift-multus/multus-additional-cni-plugins-smml7"
Jul 18 01:47:50.871169 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:47:50.871148    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lscmb\" (UniqueName: \"kubernetes.io/projected/075e93b2-88e3-4a5f-9200-2d0f9fc1d599-kube-api-access-lscmb\") pod \"aws-ebs-csi-driver-node-dkzsl\" (UID: \"075e93b2-88e3-4a5f-9200-2d0f9fc1d599\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dkzsl"
Jul 18 01:47:50.871273 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:47:50.871207    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kdj7h\" (UniqueName: \"kubernetes.io/projected/7c91433e-b6e6-47a8-8df6-2231cbc7d28c-kube-api-access-kdj7h\") pod \"network-metrics-daemon-pdflp\" (UID: \"7c91433e-b6e6-47a8-8df6-2231cbc7d28c\") " pod="openshift-multus/network-metrics-daemon-pdflp"
Jul 18 01:47:50.873402 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:47:50.873350    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fjllh\" (UniqueName: \"kubernetes.io/projected/06903f84-978e-4cd4-9f1a-6ccdf2b7524b-kube-api-access-fjllh\") pod \"ovnkube-node-zn27c\" (UID: \"06903f84-978e-4cd4-9f1a-6ccdf2b7524b\") " pod="openshift-ovn-kubernetes/ovnkube-node-zn27c"
Jul 18 01:47:50.960499 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:47:50.960476    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/d43cde0e-8b28-405b-a229-dedf1d9c4435-host-run-k8s-cni-cncf-io\") pod \"multus-z6hz2\" (UID: \"d43cde0e-8b28-405b-a229-dedf1d9c4435\") " pod="openshift-multus/multus-z6hz2"
Jul 18 01:47:50.960611 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:47:50.960507    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/d43cde0e-8b28-405b-a229-dedf1d9c4435-multus-cni-dir\") pod \"multus-z6hz2\" (UID: \"d43cde0e-8b28-405b-a229-dedf1d9c4435\") " pod="openshift-multus/multus-z6hz2"
Jul 18 01:47:50.960611 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:47:50.960531    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/d43cde0e-8b28-405b-a229-dedf1d9c4435-host-var-lib-cni-bin\") pod \"multus-z6hz2\" (UID: \"d43cde0e-8b28-405b-a229-dedf1d9c4435\") " pod="openshift-multus/multus-z6hz2"
Jul 18 01:47:50.960611 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:47:50.960562    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/d43cde0e-8b28-405b-a229-dedf1d9c4435-host-var-lib-cni-multus\") pod \"multus-z6hz2\" (UID: \"d43cde0e-8b28-405b-a229-dedf1d9c4435\") " pod="openshift-multus/multus-z6hz2"
Jul 18 01:47:50.960611 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:47:50.960588    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/d43cde0e-8b28-405b-a229-dedf1d9c4435-multus-conf-dir\") pod \"multus-z6hz2\" (UID: \"d43cde0e-8b28-405b-a229-dedf1d9c4435\") " pod="openshift-multus/multus-z6hz2"
Jul 18 01:47:50.960611 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:47:50.960597    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/d43cde0e-8b28-405b-a229-dedf1d9c4435-host-run-k8s-cni-cncf-io\") pod \"multus-z6hz2\" (UID: \"d43cde0e-8b28-405b-a229-dedf1d9c4435\") " pod="openshift-multus/multus-z6hz2"
Jul 18 01:47:50.960611 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:47:50.960616    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/f3a548b3-84f2-4a68-8676-5b8b26777d81-run\") pod \"tuned-tscwd\" (UID: \"f3a548b3-84f2-4a68-8676-5b8b26777d81\") " pod="openshift-cluster-node-tuning-operator/tuned-tscwd"
Jul 18 01:47:50.960611 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:47:50.960610    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/d43cde0e-8b28-405b-a229-dedf1d9c4435-host-var-lib-cni-bin\") pod \"multus-z6hz2\" (UID: \"d43cde0e-8b28-405b-a229-dedf1d9c4435\") " pod="openshift-multus/multus-z6hz2"
Jul 18 01:47:50.960995 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:47:50.960634    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/d43cde0e-8b28-405b-a229-dedf1d9c4435-multus-cni-dir\") pod \"multus-z6hz2\" (UID: \"d43cde0e-8b28-405b-a229-dedf1d9c4435\") " pod="openshift-multus/multus-z6hz2"
Jul 18 01:47:50.960995 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:47:50.960656    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/f3a548b3-84f2-4a68-8676-5b8b26777d81-var-lib-kubelet\") pod \"tuned-tscwd\" (UID: \"f3a548b3-84f2-4a68-8676-5b8b26777d81\") " pod="openshift-cluster-node-tuning-operator/tuned-tscwd"
Jul 18 01:47:50.960995 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:47:50.960673    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/d43cde0e-8b28-405b-a229-dedf1d9c4435-host-var-lib-cni-multus\") pod \"multus-z6hz2\" (UID: \"d43cde0e-8b28-405b-a229-dedf1d9c4435\") " pod="openshift-multus/multus-z6hz2"
Jul 18 01:47:50.960995 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:47:50.960683    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/d43cde0e-8b28-405b-a229-dedf1d9c4435-cnibin\") pod \"multus-z6hz2\" (UID: \"d43cde0e-8b28-405b-a229-dedf1d9c4435\") " pod="openshift-multus/multus-z6hz2"
Jul 18 01:47:50.960995 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:47:50.960698    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/f3a548b3-84f2-4a68-8676-5b8b26777d81-run\") pod \"tuned-tscwd\" (UID: \"f3a548b3-84f2-4a68-8676-5b8b26777d81\") " pod="openshift-cluster-node-tuning-operator/tuned-tscwd"
Jul 18 01:47:50.960995 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:47:50.960685    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/d43cde0e-8b28-405b-a229-dedf1d9c4435-multus-conf-dir\") pod \"multus-z6hz2\" (UID: \"d43cde0e-8b28-405b-a229-dedf1d9c4435\") " pod="openshift-multus/multus-z6hz2"
Jul 18 01:47:50.960995 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:47:50.960710    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/f3a548b3-84f2-4a68-8676-5b8b26777d81-etc-sysconfig\") pod \"tuned-tscwd\" (UID: \"f3a548b3-84f2-4a68-8676-5b8b26777d81\") " pod="openshift-cluster-node-tuning-operator/tuned-tscwd"
Jul 18 01:47:50.960995 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:47:50.960736    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/f3a548b3-84f2-4a68-8676-5b8b26777d81-var-lib-kubelet\") pod \"tuned-tscwd\" (UID: \"f3a548b3-84f2-4a68-8676-5b8b26777d81\") " pod="openshift-cluster-node-tuning-operator/tuned-tscwd"
Jul 18 01:47:50.960995 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:47:50.960741    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/f3a548b3-84f2-4a68-8676-5b8b26777d81-etc-sysctl-conf\") pod \"tuned-tscwd\" (UID: \"f3a548b3-84f2-4a68-8676-5b8b26777d81\") " pod="openshift-cluster-node-tuning-operator/tuned-tscwd"
Jul 18 01:47:50.960995 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:47:50.960744    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/d43cde0e-8b28-405b-a229-dedf1d9c4435-cnibin\") pod \"multus-z6hz2\" (UID: \"d43cde0e-8b28-405b-a229-dedf1d9c4435\") " pod="openshift-multus/multus-z6hz2"
Jul 18 01:47:50.960995 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:47:50.960762    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/f3a548b3-84f2-4a68-8676-5b8b26777d81-etc-sysconfig\") pod \"tuned-tscwd\" (UID: \"f3a548b3-84f2-4a68-8676-5b8b26777d81\") " pod="openshift-cluster-node-tuning-operator/tuned-tscwd"
Jul 18 01:47:50.960995 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:47:50.960772    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/ddbb4203-0f8f-4799-a645-184ca2236211-hosts-file\") pod \"node-resolver-cpp62\" (UID: \"ddbb4203-0f8f-4799-a645-184ca2236211\") " pod="openshift-dns/node-resolver-cpp62"
Jul 18 01:47:50.960995 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:47:50.960799    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-z9bkl\" (UniqueName: \"kubernetes.io/projected/f3a548b3-84f2-4a68-8676-5b8b26777d81-kube-api-access-z9bkl\") pod \"tuned-tscwd\" (UID: \"f3a548b3-84f2-4a68-8676-5b8b26777d81\") " pod="openshift-cluster-node-tuning-operator/tuned-tscwd"
Jul 18 01:47:50.960995 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:47:50.960812    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/ddbb4203-0f8f-4799-a645-184ca2236211-hosts-file\") pod \"node-resolver-cpp62\" (UID: \"ddbb4203-0f8f-4799-a645-184ca2236211\") " pod="openshift-dns/node-resolver-cpp62"
Jul 18 01:47:50.960995 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:47:50.960823    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/573bdc5a-3cb5-4729-9426-270ba59b0d02-host\") pod \"node-ca-lt6hj\" (UID: \"573bdc5a-3cb5-4729-9426-270ba59b0d02\") " pod="openshift-image-registry/node-ca-lt6hj"
Jul 18 01:47:50.960995 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:47:50.960854    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/d43cde0e-8b28-405b-a229-dedf1d9c4435-host-run-multus-certs\") pod \"multus-z6hz2\" (UID: \"d43cde0e-8b28-405b-a229-dedf1d9c4435\") " pod="openshift-multus/multus-z6hz2"
Jul 18 01:47:50.960995 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:47:50.960867    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/f3a548b3-84f2-4a68-8676-5b8b26777d81-etc-sysctl-conf\") pod \"tuned-tscwd\" (UID: \"f3a548b3-84f2-4a68-8676-5b8b26777d81\") " pod="openshift-cluster-node-tuning-operator/tuned-tscwd"
Jul 18 01:47:50.960995 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:47:50.960880    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/f3a548b3-84f2-4a68-8676-5b8b26777d81-etc-sysctl-d\") pod \"tuned-tscwd\" (UID: \"f3a548b3-84f2-4a68-8676-5b8b26777d81\") " pod="openshift-cluster-node-tuning-operator/tuned-tscwd"
Jul 18 01:47:50.961885 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:47:50.960904    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/f3a548b3-84f2-4a68-8676-5b8b26777d81-etc-systemd\") pod \"tuned-tscwd\" (UID: \"f3a548b3-84f2-4a68-8676-5b8b26777d81\") " pod="openshift-cluster-node-tuning-operator/tuned-tscwd"
Jul 18 01:47:50.961885 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:47:50.960914    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/573bdc5a-3cb5-4729-9426-270ba59b0d02-host\") pod \"node-ca-lt6hj\" (UID: \"573bdc5a-3cb5-4729-9426-270ba59b0d02\") " pod="openshift-image-registry/node-ca-lt6hj"
Jul 18 01:47:50.961885 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:47:50.960962    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/f3a548b3-84f2-4a68-8676-5b8b26777d81-etc-systemd\") pod \"tuned-tscwd\" (UID: \"f3a548b3-84f2-4a68-8676-5b8b26777d81\") " pod="openshift-cluster-node-tuning-operator/tuned-tscwd"
Jul 18 01:47:50.961885 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:47:50.960998    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/d43cde0e-8b28-405b-a229-dedf1d9c4435-host-run-multus-certs\") pod \"multus-z6hz2\" (UID: \"d43cde0e-8b28-405b-a229-dedf1d9c4435\") " pod="openshift-multus/multus-z6hz2"
Jul 18 01:47:50.961885 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:47:50.961011    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/f3a548b3-84f2-4a68-8676-5b8b26777d81-etc-sysctl-d\") pod \"tuned-tscwd\" (UID: \"f3a548b3-84f2-4a68-8676-5b8b26777d81\") " pod="openshift-cluster-node-tuning-operator/tuned-tscwd"
Jul 18 01:47:50.961885 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:47:50.961024    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/f3a548b3-84f2-4a68-8676-5b8b26777d81-tmp\") pod \"tuned-tscwd\" (UID: \"f3a548b3-84f2-4a68-8676-5b8b26777d81\") " pod="openshift-cluster-node-tuning-operator/tuned-tscwd"
Jul 18 01:47:50.961885 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:47:50.961053    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/d43cde0e-8b28-405b-a229-dedf1d9c4435-host-var-lib-kubelet\") pod \"multus-z6hz2\" (UID: \"d43cde0e-8b28-405b-a229-dedf1d9c4435\") " pod="openshift-multus/multus-z6hz2"
Jul 18 01:47:50.961885 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:47:50.961078    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jthqx\" (UniqueName: \"kubernetes.io/projected/d43cde0e-8b28-405b-a229-dedf1d9c4435-kube-api-access-jthqx\") pod \"multus-z6hz2\" (UID: \"d43cde0e-8b28-405b-a229-dedf1d9c4435\") " pod="openshift-multus/multus-z6hz2"
Jul 18 01:47:50.961885 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:47:50.961106    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/f3a548b3-84f2-4a68-8676-5b8b26777d81-etc-kubernetes\") pod \"tuned-tscwd\" (UID: \"f3a548b3-84f2-4a68-8676-5b8b26777d81\") " pod="openshift-cluster-node-tuning-operator/tuned-tscwd"
Jul 18 01:47:50.961885 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:47:50.961130    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/d43cde0e-8b28-405b-a229-dedf1d9c4435-system-cni-dir\") pod \"multus-z6hz2\" (UID: \"d43cde0e-8b28-405b-a229-dedf1d9c4435\") " pod="openshift-multus/multus-z6hz2"
Jul 18 01:47:50.961885 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:47:50.961132    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/d43cde0e-8b28-405b-a229-dedf1d9c4435-host-var-lib-kubelet\") pod \"multus-z6hz2\" (UID: \"d43cde0e-8b28-405b-a229-dedf1d9c4435\") " pod="openshift-multus/multus-z6hz2"
Jul 18 01:47:50.961885 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:47:50.961153    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/d43cde0e-8b28-405b-a229-dedf1d9c4435-os-release\") pod \"multus-z6hz2\" (UID: \"d43cde0e-8b28-405b-a229-dedf1d9c4435\") " pod="openshift-multus/multus-z6hz2"
Jul 18 01:47:50.961885 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:47:50.961178    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/d43cde0e-8b28-405b-a229-dedf1d9c4435-multus-daemon-config\") pod \"multus-z6hz2\" (UID: \"d43cde0e-8b28-405b-a229-dedf1d9c4435\") " pod="openshift-multus/multus-z6hz2"
Jul 18 01:47:50.961885 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:47:50.961184    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/f3a548b3-84f2-4a68-8676-5b8b26777d81-etc-kubernetes\") pod \"tuned-tscwd\" (UID: \"f3a548b3-84f2-4a68-8676-5b8b26777d81\") " pod="openshift-cluster-node-tuning-operator/tuned-tscwd"
Jul 18 01:47:50.961885 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:47:50.961204    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/f3a548b3-84f2-4a68-8676-5b8b26777d81-sys\") pod \"tuned-tscwd\" (UID: \"f3a548b3-84f2-4a68-8676-5b8b26777d81\") " pod="openshift-cluster-node-tuning-operator/tuned-tscwd"
Jul 18 01:47:50.961885 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:47:50.961227    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tqf9n\" (UniqueName: \"kubernetes.io/projected/573bdc5a-3cb5-4729-9426-270ba59b0d02-kube-api-access-tqf9n\") pod \"node-ca-lt6hj\" (UID: \"573bdc5a-3cb5-4729-9426-270ba59b0d02\") " pod="openshift-image-registry/node-ca-lt6hj"
Jul 18 01:47:50.961885 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:47:50.961250    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/d43cde0e-8b28-405b-a229-dedf1d9c4435-multus-socket-dir-parent\") pod \"multus-z6hz2\" (UID: \"d43cde0e-8b28-405b-a229-dedf1d9c4435\") " pod="openshift-multus/multus-z6hz2"
Jul 18 01:47:50.961885 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:47:50.961273    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/d43cde0e-8b28-405b-a229-dedf1d9c4435-etc-kubernetes\") pod \"multus-z6hz2\" (UID: \"d43cde0e-8b28-405b-a229-dedf1d9c4435\") " pod="openshift-multus/multus-z6hz2"
Jul 18 01:47:50.962773 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:47:50.961298    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rfxnj\" (UniqueName: \"kubernetes.io/projected/840829b1-92cb-4b4d-839f-a27bb50774ea-kube-api-access-rfxnj\") pod \"iptables-alerter-cqkkm\" (UID: \"840829b1-92cb-4b4d-839f-a27bb50774ea\") " pod="openshift-network-operator/iptables-alerter-cqkkm"
Jul 18 01:47:50.962773 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:47:50.961340    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/d43cde0e-8b28-405b-a229-dedf1d9c4435-host-run-netns\") pod \"multus-z6hz2\" (UID: \"d43cde0e-8b28-405b-a229-dedf1d9c4435\") " pod="openshift-multus/multus-z6hz2"
Jul 18 01:47:50.962773 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:47:50.961383    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/840829b1-92cb-4b4d-839f-a27bb50774ea-iptables-alerter-script\") pod \"iptables-alerter-cqkkm\" (UID: \"840829b1-92cb-4b4d-839f-a27bb50774ea\") " pod="openshift-network-operator/iptables-alerter-cqkkm"
Jul 18 01:47:50.962773 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:47:50.961405    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/f3a548b3-84f2-4a68-8676-5b8b26777d81-sys\") pod \"tuned-tscwd\" (UID: \"f3a548b3-84f2-4a68-8676-5b8b26777d81\") " pod="openshift-cluster-node-tuning-operator/tuned-tscwd"
Jul 18 01:47:50.962773 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:47:50.961408    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/d43cde0e-8b28-405b-a229-dedf1d9c4435-etc-kubernetes\") pod \"multus-z6hz2\" (UID: \"d43cde0e-8b28-405b-a229-dedf1d9c4435\") " pod="openshift-multus/multus-z6hz2"
Jul 18 01:47:50.962773 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:47:50.961420    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ddbb4203-0f8f-4799-a645-184ca2236211-tmp-dir\") pod \"node-resolver-cpp62\" (UID: \"ddbb4203-0f8f-4799-a645-184ca2236211\") " pod="openshift-dns/node-resolver-cpp62"
Jul 18 01:47:50.962773 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:47:50.961452    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/d43cde0e-8b28-405b-a229-dedf1d9c4435-hostroot\") pod \"multus-z6hz2\" (UID: \"d43cde0e-8b28-405b-a229-dedf1d9c4435\") " pod="openshift-multus/multus-z6hz2"
Jul 18 01:47:50.962773 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:47:50.961468    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/d43cde0e-8b28-405b-a229-dedf1d9c4435-system-cni-dir\") pod \"multus-z6hz2\" (UID: \"d43cde0e-8b28-405b-a229-dedf1d9c4435\") " pod="openshift-multus/multus-z6hz2"
Jul 18 01:47:50.962773 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:47:50.961479    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/f3a548b3-84f2-4a68-8676-5b8b26777d81-etc-modprobe-d\") pod \"tuned-tscwd\" (UID: \"f3a548b3-84f2-4a68-8676-5b8b26777d81\") " pod="openshift-cluster-node-tuning-operator/tuned-tscwd"
Jul 18 01:47:50.962773 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:47:50.961517    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/f3a548b3-84f2-4a68-8676-5b8b26777d81-lib-modules\") pod \"tuned-tscwd\" (UID: \"f3a548b3-84f2-4a68-8676-5b8b26777d81\") " pod="openshift-cluster-node-tuning-operator/tuned-tscwd"
Jul 18 01:47:50.962773 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:47:50.961524    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/d43cde0e-8b28-405b-a229-dedf1d9c4435-os-release\") pod \"multus-z6hz2\" (UID: \"d43cde0e-8b28-405b-a229-dedf1d9c4435\") " pod="openshift-multus/multus-z6hz2"
Jul 18 01:47:50.962773 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:47:50.961554    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-t7dg2\" (UniqueName: \"kubernetes.io/projected/ddbb4203-0f8f-4799-a645-184ca2236211-kube-api-access-t7dg2\") pod \"node-resolver-cpp62\" (UID: \"ddbb4203-0f8f-4799-a645-184ca2236211\") " pod="openshift-dns/node-resolver-cpp62"
Jul 18 01:47:50.962773 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:47:50.961581    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/840829b1-92cb-4b4d-839f-a27bb50774ea-host-slash\") pod \"iptables-alerter-cqkkm\" (UID: \"840829b1-92cb-4b4d-839f-a27bb50774ea\") " pod="openshift-network-operator/iptables-alerter-cqkkm"
Jul 18 01:47:50.962773 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:47:50.961605    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/d43cde0e-8b28-405b-a229-dedf1d9c4435-multus-socket-dir-parent\") pod \"multus-z6hz2\" (UID: \"d43cde0e-8b28-405b-a229-dedf1d9c4435\") " pod="openshift-multus/multus-z6hz2"
Jul 18 01:47:50.962773 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:47:50.961627    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/f3a548b3-84f2-4a68-8676-5b8b26777d81-lib-modules\") pod \"tuned-tscwd\" (UID: \"f3a548b3-84f2-4a68-8676-5b8b26777d81\") " pod="openshift-cluster-node-tuning-operator/tuned-tscwd"
Jul 18 01:47:50.962773 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:47:50.961673    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/840829b1-92cb-4b4d-839f-a27bb50774ea-host-slash\") pod \"iptables-alerter-cqkkm\" (UID: \"840829b1-92cb-4b4d-839f-a27bb50774ea\") " pod="openshift-network-operator/iptables-alerter-cqkkm"
Jul 18 01:47:50.962773 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:47:50.961675    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/f3a548b3-84f2-4a68-8676-5b8b26777d81-host\") pod \"tuned-tscwd\" (UID: \"f3a548b3-84f2-4a68-8676-5b8b26777d81\") " pod="openshift-cluster-node-tuning-operator/tuned-tscwd"
Jul 18 01:47:50.962773 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:47:50.961609    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/f3a548b3-84f2-4a68-8676-5b8b26777d81-host\") pod \"tuned-tscwd\" (UID: \"f3a548b3-84f2-4a68-8676-5b8b26777d81\") " pod="openshift-cluster-node-tuning-operator/tuned-tscwd"
Jul 18 01:47:50.963549 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:47:50.961713    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/f3a548b3-84f2-4a68-8676-5b8b26777d81-etc-tuned\") pod \"tuned-tscwd\" (UID: \"f3a548b3-84f2-4a68-8676-5b8b26777d81\") " pod="openshift-cluster-node-tuning-operator/tuned-tscwd"
Jul 18 01:47:50.963549 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:47:50.961739    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/573bdc5a-3cb5-4729-9426-270ba59b0d02-serviceca\") pod \"node-ca-lt6hj\" (UID: \"573bdc5a-3cb5-4729-9426-270ba59b0d02\") " pod="openshift-image-registry/node-ca-lt6hj"
Jul 18 01:47:50.963549 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:47:50.961761    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/d43cde0e-8b28-405b-a229-dedf1d9c4435-cni-binary-copy\") pod \"multus-z6hz2\" (UID: \"d43cde0e-8b28-405b-a229-dedf1d9c4435\") " pod="openshift-multus/multus-z6hz2"
Jul 18 01:47:50.963549 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:47:50.961832    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/d43cde0e-8b28-405b-a229-dedf1d9c4435-host-run-netns\") pod \"multus-z6hz2\" (UID: \"d43cde0e-8b28-405b-a229-dedf1d9c4435\") " pod="openshift-multus/multus-z6hz2"
Jul 18 01:47:50.963549 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:47:50.961911    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/d43cde0e-8b28-405b-a229-dedf1d9c4435-hostroot\") pod \"multus-z6hz2\" (UID: \"d43cde0e-8b28-405b-a229-dedf1d9c4435\") " pod="openshift-multus/multus-z6hz2"
Jul 18 01:47:50.963549 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:47:50.962171    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ddbb4203-0f8f-4799-a645-184ca2236211-tmp-dir\") pod \"node-resolver-cpp62\" (UID: \"ddbb4203-0f8f-4799-a645-184ca2236211\") " pod="openshift-dns/node-resolver-cpp62"
Jul 18 01:47:50.963549 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:47:50.962396    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/d43cde0e-8b28-405b-a229-dedf1d9c4435-cni-binary-copy\") pod \"multus-z6hz2\" (UID: \"d43cde0e-8b28-405b-a229-dedf1d9c4435\") " pod="openshift-multus/multus-z6hz2"
Jul 18 01:47:50.963549 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:47:50.962452    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/840829b1-92cb-4b4d-839f-a27bb50774ea-iptables-alerter-script\") pod \"iptables-alerter-cqkkm\" (UID: \"840829b1-92cb-4b4d-839f-a27bb50774ea\") " pod="openshift-network-operator/iptables-alerter-cqkkm"
Jul 18 01:47:50.963549 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:47:50.962554    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/f3a548b3-84f2-4a68-8676-5b8b26777d81-etc-modprobe-d\") pod \"tuned-tscwd\" (UID: \"f3a548b3-84f2-4a68-8676-5b8b26777d81\") " pod="openshift-cluster-node-tuning-operator/tuned-tscwd"
Jul 18 01:47:50.963549 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:47:50.962827    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/573bdc5a-3cb5-4729-9426-270ba59b0d02-serviceca\") pod \"node-ca-lt6hj\" (UID: \"573bdc5a-3cb5-4729-9426-270ba59b0d02\") " pod="openshift-image-registry/node-ca-lt6hj"
Jul 18 01:47:50.963549 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:47:50.963009    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/d43cde0e-8b28-405b-a229-dedf1d9c4435-multus-daemon-config\") pod \"multus-z6hz2\" (UID: \"d43cde0e-8b28-405b-a229-dedf1d9c4435\") " pod="openshift-multus/multus-z6hz2"
Jul 18 01:47:50.964523 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:47:50.964496    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/f3a548b3-84f2-4a68-8676-5b8b26777d81-etc-tuned\") pod \"tuned-tscwd\" (UID: \"f3a548b3-84f2-4a68-8676-5b8b26777d81\") " pod="openshift-cluster-node-tuning-operator/tuned-tscwd"
Jul 18 01:47:50.964703 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:47:50.964536    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/f3a548b3-84f2-4a68-8676-5b8b26777d81-tmp\") pod \"tuned-tscwd\" (UID: \"f3a548b3-84f2-4a68-8676-5b8b26777d81\") " pod="openshift-cluster-node-tuning-operator/tuned-tscwd"
Jul 18 01:47:50.969978 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:47:50.969911    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tqf9n\" (UniqueName: \"kubernetes.io/projected/573bdc5a-3cb5-4729-9426-270ba59b0d02-kube-api-access-tqf9n\") pod \"node-ca-lt6hj\" (UID: \"573bdc5a-3cb5-4729-9426-270ba59b0d02\") " pod="openshift-image-registry/node-ca-lt6hj"
Jul 18 01:47:50.970359 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:47:50.970336    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-z9bkl\" (UniqueName: \"kubernetes.io/projected/f3a548b3-84f2-4a68-8676-5b8b26777d81-kube-api-access-z9bkl\") pod \"tuned-tscwd\" (UID: \"f3a548b3-84f2-4a68-8676-5b8b26777d81\") " pod="openshift-cluster-node-tuning-operator/tuned-tscwd"
Jul 18 01:47:50.970599 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:47:50.970576    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rfxnj\" (UniqueName: \"kubernetes.io/projected/840829b1-92cb-4b4d-839f-a27bb50774ea-kube-api-access-rfxnj\") pod \"iptables-alerter-cqkkm\" (UID: \"840829b1-92cb-4b4d-839f-a27bb50774ea\") " pod="openshift-network-operator/iptables-alerter-cqkkm"
Jul 18 01:47:50.971335 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:47:50.971314    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-t7dg2\" (UniqueName: \"kubernetes.io/projected/ddbb4203-0f8f-4799-a645-184ca2236211-kube-api-access-t7dg2\") pod \"node-resolver-cpp62\" (UID: \"ddbb4203-0f8f-4799-a645-184ca2236211\") " pod="openshift-dns/node-resolver-cpp62"
Jul 18 01:47:50.971836 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:47:50.971813    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jthqx\" (UniqueName: \"kubernetes.io/projected/d43cde0e-8b28-405b-a229-dedf1d9c4435-kube-api-access-jthqx\") pod \"multus-z6hz2\" (UID: \"d43cde0e-8b28-405b-a229-dedf1d9c4435\") " pod="openshift-multus/multus-z6hz2"
Jul 18 01:47:51.040824 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:47:51.040798    2566 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 18 01:47:51.048791 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:47:51.048762    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-l28dd"
Jul 18 01:47:51.056936 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:47:51.056920    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-smml7"
Jul 18 01:47:51.068219 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:47:51.068199    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-zn27c"
Jul 18 01:47:51.076348 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:47:51.076331    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dkzsl"
Jul 18 01:47:51.084212 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:47:51.084191    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-tscwd"
Jul 18 01:47:51.092806 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:47:51.092789    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-cpp62"
Jul 18 01:47:51.100634 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:47:51.100598    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-lt6hj"
Jul 18 01:47:51.101721 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:47:51.101689    2566 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 18 01:47:51.109438 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:47:51.109422    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-z6hz2"
Jul 18 01:47:51.117387 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:47:51.117368    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-cqkkm"
Jul 18 01:47:51.364675 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:47:51.364581    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7c91433e-b6e6-47a8-8df6-2231cbc7d28c-metrics-certs\") pod \"network-metrics-daemon-pdflp\" (UID: \"7c91433e-b6e6-47a8-8df6-2231cbc7d28c\") " pod="openshift-multus/network-metrics-daemon-pdflp"
Jul 18 01:47:51.364675 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:47:51.364651    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/26d75b92-43d7-43e7-96c8-dd42a5288953-original-pull-secret\") pod \"global-pull-secret-syncer-2jzkc\" (UID: \"26d75b92-43d7-43e7-96c8-dd42a5288953\") " pod="kube-system/global-pull-secret-syncer-2jzkc"
Jul 18 01:47:51.364879 ip-10-0-142-238 kubenswrapper[2566]: E0718 01:47:51.364759    2566 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 18 01:47:51.364879 ip-10-0-142-238 kubenswrapper[2566]: E0718 01:47:51.364775    2566 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 18 01:47:51.364879 ip-10-0-142-238 kubenswrapper[2566]: E0718 01:47:51.364823    2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/26d75b92-43d7-43e7-96c8-dd42a5288953-original-pull-secret podName:26d75b92-43d7-43e7-96c8-dd42a5288953 nodeName:}" failed. No retries permitted until 2026-07-18 01:47:52.364808863 +0000 UTC m=+4.053536290 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/26d75b92-43d7-43e7-96c8-dd42a5288953-original-pull-secret") pod "global-pull-secret-syncer-2jzkc" (UID: "26d75b92-43d7-43e7-96c8-dd42a5288953") : object "kube-system"/"original-pull-secret" not registered
Jul 18 01:47:51.364879 ip-10-0-142-238 kubenswrapper[2566]: E0718 01:47:51.364842    2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7c91433e-b6e6-47a8-8df6-2231cbc7d28c-metrics-certs podName:7c91433e-b6e6-47a8-8df6-2231cbc7d28c nodeName:}" failed. No retries permitted until 2026-07-18 01:47:52.364833018 +0000 UTC m=+4.053560447 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/7c91433e-b6e6-47a8-8df6-2231cbc7d28c-metrics-certs") pod "network-metrics-daemon-pdflp" (UID: "7c91433e-b6e6-47a8-8df6-2231cbc7d28c") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 18 01:47:51.465010 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:47:51.464976    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-x4khf\" (UniqueName: \"kubernetes.io/projected/25c58f22-7d60-4a06-844f-f3508d910e76-kube-api-access-x4khf\") pod \"network-check-target-n8bdx\" (UID: \"25c58f22-7d60-4a06-844f-f3508d910e76\") " pod="openshift-network-diagnostics/network-check-target-n8bdx"
Jul 18 01:47:51.465159 ip-10-0-142-238 kubenswrapper[2566]: E0718 01:47:51.465110    2566 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 18 01:47:51.465159 ip-10-0-142-238 kubenswrapper[2566]: E0718 01:47:51.465123    2566 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 18 01:47:51.465159 ip-10-0-142-238 kubenswrapper[2566]: E0718 01:47:51.465133    2566 projected.go:196] Error preparing data for projected volume kube-api-access-x4khf for pod openshift-network-diagnostics/network-check-target-n8bdx: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 18 01:47:51.465278 ip-10-0-142-238 kubenswrapper[2566]: E0718 01:47:51.465184    2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/25c58f22-7d60-4a06-844f-f3508d910e76-kube-api-access-x4khf podName:25c58f22-7d60-4a06-844f-f3508d910e76 nodeName:}" failed. No retries permitted until 2026-07-18 01:47:52.465170387 +0000 UTC m=+4.153897814 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-x4khf" (UniqueName: "kubernetes.io/projected/25c58f22-7d60-4a06-844f-f3508d910e76-kube-api-access-x4khf") pod "network-check-target-n8bdx" (UID: "25c58f22-7d60-4a06-844f-f3508d910e76") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 18 01:47:51.789808 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:47:51.789718    2566 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-17 01:42:51 +0000 UTC" deadline="2028-02-22 07:39:49.312479448 +0000 UTC"
Jul 18 01:47:51.789808 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:47:51.789757    2566 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="14021h51m57.522727574s"
Jul 18 01:47:51.810090 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:47:51.810062    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-n8bdx"
Jul 18 01:47:51.810211 ip-10-0-142-238 kubenswrapper[2566]: E0718 01:47:51.810175    2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-n8bdx" podUID="25c58f22-7d60-4a06-844f-f3508d910e76"
Jul 18 01:47:52.124045 ip-10-0-142-238 kubenswrapper[2566]: W0718 01:47:52.124001    2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod44aa7f9e_049a_45bc_98bc_ff1d4309f5de.slice/crio-8ac6c41ba0049802f5f68505598269d73e36a14e5f9b7e4c0d69097948133034 WatchSource:0}: Error finding container 8ac6c41ba0049802f5f68505598269d73e36a14e5f9b7e4c0d69097948133034: Status 404 returned error can't find the container with id 8ac6c41ba0049802f5f68505598269d73e36a14e5f9b7e4c0d69097948133034
Jul 18 01:47:52.126001 ip-10-0-142-238 kubenswrapper[2566]: W0718 01:47:52.125938    2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfae2962e_4ef0_41af_a49e_d6216d1aa7c9.slice/crio-51ae423e0ba68a7dd7d5d32783fc94e101efda78feadbd65c1571af2f0a1ecb1 WatchSource:0}: Error finding container 51ae423e0ba68a7dd7d5d32783fc94e101efda78feadbd65c1571af2f0a1ecb1: Status 404 returned error can't find the container with id 51ae423e0ba68a7dd7d5d32783fc94e101efda78feadbd65c1571af2f0a1ecb1
Jul 18 01:47:52.130098 ip-10-0-142-238 kubenswrapper[2566]: W0718 01:47:52.130067    2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod075e93b2_88e3_4a5f_9200_2d0f9fc1d599.slice/crio-63a7649f1f34686951617be30ee80cfb6c04b5665a631767227482bd0e66dd45 WatchSource:0}: Error finding container 63a7649f1f34686951617be30ee80cfb6c04b5665a631767227482bd0e66dd45: Status 404 returned error can't find the container with id 63a7649f1f34686951617be30ee80cfb6c04b5665a631767227482bd0e66dd45
Jul 18 01:47:52.130704 ip-10-0-142-238 kubenswrapper[2566]: W0718 01:47:52.130666    2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod06903f84_978e_4cd4_9f1a_6ccdf2b7524b.slice/crio-528c9963d45c350d8fdda5b9751f934f1e0db815f946ccfbd9a824c0eb3003e2 WatchSource:0}: Error finding container 528c9963d45c350d8fdda5b9751f934f1e0db815f946ccfbd9a824c0eb3003e2: Status 404 returned error can't find the container with id 528c9963d45c350d8fdda5b9751f934f1e0db815f946ccfbd9a824c0eb3003e2
Jul 18 01:47:52.132397 ip-10-0-142-238 kubenswrapper[2566]: W0718 01:47:52.132372    2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod840829b1_92cb_4b4d_839f_a27bb50774ea.slice/crio-10aa4f849075ce57c33c39ccdb374913f747d5d0eb61fea61352f1de704c15a0 WatchSource:0}: Error finding container 10aa4f849075ce57c33c39ccdb374913f747d5d0eb61fea61352f1de704c15a0: Status 404 returned error can't find the container with id 10aa4f849075ce57c33c39ccdb374913f747d5d0eb61fea61352f1de704c15a0
Jul 18 01:47:52.372730 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:47:52.372535    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7c91433e-b6e6-47a8-8df6-2231cbc7d28c-metrics-certs\") pod \"network-metrics-daemon-pdflp\" (UID: \"7c91433e-b6e6-47a8-8df6-2231cbc7d28c\") " pod="openshift-multus/network-metrics-daemon-pdflp"
Jul 18 01:47:52.372844 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:47:52.372771    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/26d75b92-43d7-43e7-96c8-dd42a5288953-original-pull-secret\") pod \"global-pull-secret-syncer-2jzkc\" (UID: \"26d75b92-43d7-43e7-96c8-dd42a5288953\") " pod="kube-system/global-pull-secret-syncer-2jzkc"
Jul 18 01:47:52.372844 ip-10-0-142-238 kubenswrapper[2566]: E0718 01:47:52.372692    2566 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 18 01:47:52.372925 ip-10-0-142-238 kubenswrapper[2566]: E0718 01:47:52.372852    2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7c91433e-b6e6-47a8-8df6-2231cbc7d28c-metrics-certs podName:7c91433e-b6e6-47a8-8df6-2231cbc7d28c nodeName:}" failed. No retries permitted until 2026-07-18 01:47:54.372835762 +0000 UTC m=+6.061563192 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/7c91433e-b6e6-47a8-8df6-2231cbc7d28c-metrics-certs") pod "network-metrics-daemon-pdflp" (UID: "7c91433e-b6e6-47a8-8df6-2231cbc7d28c") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 18 01:47:52.372925 ip-10-0-142-238 kubenswrapper[2566]: E0718 01:47:52.372878    2566 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 18 01:47:52.372998 ip-10-0-142-238 kubenswrapper[2566]: E0718 01:47:52.372926    2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/26d75b92-43d7-43e7-96c8-dd42a5288953-original-pull-secret podName:26d75b92-43d7-43e7-96c8-dd42a5288953 nodeName:}" failed. No retries permitted until 2026-07-18 01:47:54.372913521 +0000 UTC m=+6.061640948 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/26d75b92-43d7-43e7-96c8-dd42a5288953-original-pull-secret") pod "global-pull-secret-syncer-2jzkc" (UID: "26d75b92-43d7-43e7-96c8-dd42a5288953") : object "kube-system"/"original-pull-secret" not registered
Jul 18 01:47:52.473189 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:47:52.473159    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-x4khf\" (UniqueName: \"kubernetes.io/projected/25c58f22-7d60-4a06-844f-f3508d910e76-kube-api-access-x4khf\") pod \"network-check-target-n8bdx\" (UID: \"25c58f22-7d60-4a06-844f-f3508d910e76\") " pod="openshift-network-diagnostics/network-check-target-n8bdx"
Jul 18 01:47:52.473330 ip-10-0-142-238 kubenswrapper[2566]: E0718 01:47:52.473316    2566 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 18 01:47:52.473375 ip-10-0-142-238 kubenswrapper[2566]: E0718 01:47:52.473336    2566 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 18 01:47:52.473375 ip-10-0-142-238 kubenswrapper[2566]: E0718 01:47:52.473344    2566 projected.go:196] Error preparing data for projected volume kube-api-access-x4khf for pod openshift-network-diagnostics/network-check-target-n8bdx: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 18 01:47:52.473481 ip-10-0-142-238 kubenswrapper[2566]: E0718 01:47:52.473398    2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/25c58f22-7d60-4a06-844f-f3508d910e76-kube-api-access-x4khf podName:25c58f22-7d60-4a06-844f-f3508d910e76 nodeName:}" failed. No retries permitted until 2026-07-18 01:47:54.473380261 +0000 UTC m=+6.162107705 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-x4khf" (UniqueName: "kubernetes.io/projected/25c58f22-7d60-4a06-844f-f3508d910e76-kube-api-access-x4khf") pod "network-check-target-n8bdx" (UID: "25c58f22-7d60-4a06-844f-f3508d910e76") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 18 01:47:52.790937 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:47:52.790790    2566 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-17 01:42:51 +0000 UTC" deadline="2028-03-10 02:29:15.764145416 +0000 UTC"
Jul 18 01:47:52.790937 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:47:52.790851    2566 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="14424h41m22.973298413s"
Jul 18 01:47:52.812644 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:47:52.812615    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-2jzkc"
Jul 18 01:47:52.812816 ip-10-0-142-238 kubenswrapper[2566]: E0718 01:47:52.812764    2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-2jzkc" podUID="26d75b92-43d7-43e7-96c8-dd42a5288953"
Jul 18 01:47:52.813193 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:47:52.813171    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-pdflp"
Jul 18 01:47:52.813302 ip-10-0-142-238 kubenswrapper[2566]: E0718 01:47:52.813284    2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-pdflp" podUID="7c91433e-b6e6-47a8-8df6-2231cbc7d28c"
Jul 18 01:47:52.824746 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:47:52.824662    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-l28dd" event={"ID":"44aa7f9e-049a-45bc-98bc-ff1d4309f5de","Type":"ContainerStarted","Data":"8ac6c41ba0049802f5f68505598269d73e36a14e5f9b7e4c0d69097948133034"}
Jul 18 01:47:52.834708 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:47:52.834419    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-142-238.ec2.internal" event={"ID":"780b86b12592a8e7c650c0643a729f9d","Type":"ContainerStarted","Data":"9b3631decc1a67e55aa0acb5ee6b5135c92dc0e65afa7ca33a6b63262c8229dc"}
Jul 18 01:47:52.839277 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:47:52.838728    2566 generic.go:356] "Generic (PLEG): container finished" podID="3d826c346f2df407603e1c503f38c6db" containerID="d78cbb569481c1f863ac622e5b0c9036a9d05d6512694d3d2171aadf3879dfde" exitCode=0
Jul 18 01:47:52.839277 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:47:52.839018    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-238.ec2.internal" event={"ID":"3d826c346f2df407603e1c503f38c6db","Type":"ContainerDied","Data":"d78cbb569481c1f863ac622e5b0c9036a9d05d6512694d3d2171aadf3879dfde"}
Jul 18 01:47:52.844395 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:47:52.844174    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-z6hz2" event={"ID":"d43cde0e-8b28-405b-a229-dedf1d9c4435","Type":"ContainerStarted","Data":"8dbba393a8e820b3ae5ef30dd98137eb37c782613b29fe88213dc2e6549f1731"}
Jul 18 01:47:52.847479 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:47:52.847421    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-cpp62" event={"ID":"ddbb4203-0f8f-4799-a645-184ca2236211","Type":"ContainerStarted","Data":"81676c83cd0e8d429d850b132019e6a01eb94733254fdcd845764c0ff6cfe523"}
Jul 18 01:47:52.850289 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:47:52.850166    2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-142-238.ec2.internal" podStartSLOduration=2.850148849 podStartE2EDuration="2.850148849s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-18 01:47:50 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-18 01:47:52.849590701 +0000 UTC m=+4.538318153" watchObservedRunningTime="2026-07-18 01:47:52.850148849 +0000 UTC m=+4.538876300"
Jul 18 01:47:52.855776 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:47:52.855665    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-tscwd" event={"ID":"f3a548b3-84f2-4a68-8676-5b8b26777d81","Type":"ContainerStarted","Data":"4b6d2f921b1a0d95947f25cc7872c03473d56949025b845e4680534f98cda70c"}
Jul 18 01:47:52.857348 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:47:52.857323    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-lt6hj" event={"ID":"573bdc5a-3cb5-4729-9426-270ba59b0d02","Type":"ContainerStarted","Data":"ea06126319697e0c4d8b1ed567b4bafe0af28c6ac1cc48700cc3227f1fc43011"}
Jul 18 01:47:52.872514 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:47:52.872486    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-zn27c" event={"ID":"06903f84-978e-4cd4-9f1a-6ccdf2b7524b","Type":"ContainerStarted","Data":"528c9963d45c350d8fdda5b9751f934f1e0db815f946ccfbd9a824c0eb3003e2"}
Jul 18 01:47:52.875012 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:47:52.874928    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dkzsl" event={"ID":"075e93b2-88e3-4a5f-9200-2d0f9fc1d599","Type":"ContainerStarted","Data":"63a7649f1f34686951617be30ee80cfb6c04b5665a631767227482bd0e66dd45"}
Jul 18 01:47:52.882464 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:47:52.882394    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-cqkkm" event={"ID":"840829b1-92cb-4b4d-839f-a27bb50774ea","Type":"ContainerStarted","Data":"10aa4f849075ce57c33c39ccdb374913f747d5d0eb61fea61352f1de704c15a0"}
Jul 18 01:47:52.889011 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:47:52.888988    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-smml7" event={"ID":"fae2962e-4ef0-41af-a49e-d6216d1aa7c9","Type":"ContainerStarted","Data":"51ae423e0ba68a7dd7d5d32783fc94e101efda78feadbd65c1571af2f0a1ecb1"}
Jul 18 01:47:53.810343 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:47:53.810312    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-n8bdx"
Jul 18 01:47:53.810894 ip-10-0-142-238 kubenswrapper[2566]: E0718 01:47:53.810439    2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-n8bdx" podUID="25c58f22-7d60-4a06-844f-f3508d910e76"
Jul 18 01:47:53.911742 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:47:53.911707    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-238.ec2.internal" event={"ID":"3d826c346f2df407603e1c503f38c6db","Type":"ContainerStarted","Data":"6b2c5910c19965dd265ac82a44c9c26a68e80ebfcc014be051534a2ef28d8435"}
Jul 18 01:47:53.927251 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:47:53.927198    2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-238.ec2.internal" podStartSLOduration=3.927176478 podStartE2EDuration="3.927176478s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-18 01:47:50 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-18 01:47:53.926029035 +0000 UTC m=+5.614756503" watchObservedRunningTime="2026-07-18 01:47:53.927176478 +0000 UTC m=+5.615903930"
Jul 18 01:47:54.393640 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:47:54.393598    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/26d75b92-43d7-43e7-96c8-dd42a5288953-original-pull-secret\") pod \"global-pull-secret-syncer-2jzkc\" (UID: \"26d75b92-43d7-43e7-96c8-dd42a5288953\") " pod="kube-system/global-pull-secret-syncer-2jzkc"
Jul 18 01:47:54.393836 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:47:54.393704    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7c91433e-b6e6-47a8-8df6-2231cbc7d28c-metrics-certs\") pod \"network-metrics-daemon-pdflp\" (UID: \"7c91433e-b6e6-47a8-8df6-2231cbc7d28c\") " pod="openshift-multus/network-metrics-daemon-pdflp"
Jul 18 01:47:54.393912 ip-10-0-142-238 kubenswrapper[2566]: E0718 01:47:54.393881    2566 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 18 01:47:54.394006 ip-10-0-142-238 kubenswrapper[2566]: E0718 01:47:54.393942    2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7c91433e-b6e6-47a8-8df6-2231cbc7d28c-metrics-certs podName:7c91433e-b6e6-47a8-8df6-2231cbc7d28c nodeName:}" failed. No retries permitted until 2026-07-18 01:47:58.393924361 +0000 UTC m=+10.082651795 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/7c91433e-b6e6-47a8-8df6-2231cbc7d28c-metrics-certs") pod "network-metrics-daemon-pdflp" (UID: "7c91433e-b6e6-47a8-8df6-2231cbc7d28c") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 18 01:47:54.394119 ip-10-0-142-238 kubenswrapper[2566]: E0718 01:47:54.394024    2566 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 18 01:47:54.394119 ip-10-0-142-238 kubenswrapper[2566]: E0718 01:47:54.394066    2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/26d75b92-43d7-43e7-96c8-dd42a5288953-original-pull-secret podName:26d75b92-43d7-43e7-96c8-dd42a5288953 nodeName:}" failed. No retries permitted until 2026-07-18 01:47:58.394054374 +0000 UTC m=+10.082781809 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/26d75b92-43d7-43e7-96c8-dd42a5288953-original-pull-secret") pod "global-pull-secret-syncer-2jzkc" (UID: "26d75b92-43d7-43e7-96c8-dd42a5288953") : object "kube-system"/"original-pull-secret" not registered
Jul 18 01:47:54.494833 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:47:54.494778    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-x4khf\" (UniqueName: \"kubernetes.io/projected/25c58f22-7d60-4a06-844f-f3508d910e76-kube-api-access-x4khf\") pod \"network-check-target-n8bdx\" (UID: \"25c58f22-7d60-4a06-844f-f3508d910e76\") " pod="openshift-network-diagnostics/network-check-target-n8bdx"
Jul 18 01:47:54.495174 ip-10-0-142-238 kubenswrapper[2566]: E0718 01:47:54.495108    2566 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 18 01:47:54.495280 ip-10-0-142-238 kubenswrapper[2566]: E0718 01:47:54.495199    2566 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 18 01:47:54.495280 ip-10-0-142-238 kubenswrapper[2566]: E0718 01:47:54.495213    2566 projected.go:196] Error preparing data for projected volume kube-api-access-x4khf for pod openshift-network-diagnostics/network-check-target-n8bdx: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 18 01:47:54.495280 ip-10-0-142-238 kubenswrapper[2566]: E0718 01:47:54.495279    2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/25c58f22-7d60-4a06-844f-f3508d910e76-kube-api-access-x4khf podName:25c58f22-7d60-4a06-844f-f3508d910e76 nodeName:}" failed. No retries permitted until 2026-07-18 01:47:58.495259585 +0000 UTC m=+10.183987013 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-x4khf" (UniqueName: "kubernetes.io/projected/25c58f22-7d60-4a06-844f-f3508d910e76-kube-api-access-x4khf") pod "network-check-target-n8bdx" (UID: "25c58f22-7d60-4a06-844f-f3508d910e76") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 18 01:47:54.811556 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:47:54.810776    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-2jzkc"
Jul 18 01:47:54.811556 ip-10-0-142-238 kubenswrapper[2566]: E0718 01:47:54.810909    2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-2jzkc" podUID="26d75b92-43d7-43e7-96c8-dd42a5288953"
Jul 18 01:47:54.811556 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:47:54.811349    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-pdflp"
Jul 18 01:47:54.811556 ip-10-0-142-238 kubenswrapper[2566]: E0718 01:47:54.811449    2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-pdflp" podUID="7c91433e-b6e6-47a8-8df6-2231cbc7d28c"
Jul 18 01:47:55.810712 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:47:55.810661    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-n8bdx"
Jul 18 01:47:55.810931 ip-10-0-142-238 kubenswrapper[2566]: E0718 01:47:55.810791    2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-n8bdx" podUID="25c58f22-7d60-4a06-844f-f3508d910e76"
Jul 18 01:47:56.813026 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:47:56.812329    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-2jzkc"
Jul 18 01:47:56.813026 ip-10-0-142-238 kubenswrapper[2566]: E0718 01:47:56.812466    2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-2jzkc" podUID="26d75b92-43d7-43e7-96c8-dd42a5288953"
Jul 18 01:47:56.813026 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:47:56.812863    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-pdflp"
Jul 18 01:47:56.813026 ip-10-0-142-238 kubenswrapper[2566]: E0718 01:47:56.812970    2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-pdflp" podUID="7c91433e-b6e6-47a8-8df6-2231cbc7d28c"
Jul 18 01:47:57.810332 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:47:57.810247    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-n8bdx"
Jul 18 01:47:57.810522 ip-10-0-142-238 kubenswrapper[2566]: E0718 01:47:57.810458    2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-n8bdx" podUID="25c58f22-7d60-4a06-844f-f3508d910e76"
Jul 18 01:47:58.430183 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:47:58.430130    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/26d75b92-43d7-43e7-96c8-dd42a5288953-original-pull-secret\") pod \"global-pull-secret-syncer-2jzkc\" (UID: \"26d75b92-43d7-43e7-96c8-dd42a5288953\") " pod="kube-system/global-pull-secret-syncer-2jzkc"
Jul 18 01:47:58.430685 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:47:58.430210    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7c91433e-b6e6-47a8-8df6-2231cbc7d28c-metrics-certs\") pod \"network-metrics-daemon-pdflp\" (UID: \"7c91433e-b6e6-47a8-8df6-2231cbc7d28c\") " pod="openshift-multus/network-metrics-daemon-pdflp"
Jul 18 01:47:58.430685 ip-10-0-142-238 kubenswrapper[2566]: E0718 01:47:58.430354    2566 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 18 01:47:58.430685 ip-10-0-142-238 kubenswrapper[2566]: E0718 01:47:58.430426    2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7c91433e-b6e6-47a8-8df6-2231cbc7d28c-metrics-certs podName:7c91433e-b6e6-47a8-8df6-2231cbc7d28c nodeName:}" failed. No retries permitted until 2026-07-18 01:48:06.430406578 +0000 UTC m=+18.119134010 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/7c91433e-b6e6-47a8-8df6-2231cbc7d28c-metrics-certs") pod "network-metrics-daemon-pdflp" (UID: "7c91433e-b6e6-47a8-8df6-2231cbc7d28c") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 18 01:47:58.430685 ip-10-0-142-238 kubenswrapper[2566]: E0718 01:47:58.430520    2566 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 18 01:47:58.430685 ip-10-0-142-238 kubenswrapper[2566]: E0718 01:47:58.430586    2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/26d75b92-43d7-43e7-96c8-dd42a5288953-original-pull-secret podName:26d75b92-43d7-43e7-96c8-dd42a5288953 nodeName:}" failed. No retries permitted until 2026-07-18 01:48:06.430568525 +0000 UTC m=+18.119295967 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/26d75b92-43d7-43e7-96c8-dd42a5288953-original-pull-secret") pod "global-pull-secret-syncer-2jzkc" (UID: "26d75b92-43d7-43e7-96c8-dd42a5288953") : object "kube-system"/"original-pull-secret" not registered
Jul 18 01:47:58.531440 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:47:58.531308    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-x4khf\" (UniqueName: \"kubernetes.io/projected/25c58f22-7d60-4a06-844f-f3508d910e76-kube-api-access-x4khf\") pod \"network-check-target-n8bdx\" (UID: \"25c58f22-7d60-4a06-844f-f3508d910e76\") " pod="openshift-network-diagnostics/network-check-target-n8bdx"
Jul 18 01:47:58.531660 ip-10-0-142-238 kubenswrapper[2566]: E0718 01:47:58.531487    2566 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 18 01:47:58.531660 ip-10-0-142-238 kubenswrapper[2566]: E0718 01:47:58.531507    2566 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 18 01:47:58.531660 ip-10-0-142-238 kubenswrapper[2566]: E0718 01:47:58.531519    2566 projected.go:196] Error preparing data for projected volume kube-api-access-x4khf for pod openshift-network-diagnostics/network-check-target-n8bdx: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 18 01:47:58.531660 ip-10-0-142-238 kubenswrapper[2566]: E0718 01:47:58.531579    2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/25c58f22-7d60-4a06-844f-f3508d910e76-kube-api-access-x4khf podName:25c58f22-7d60-4a06-844f-f3508d910e76 nodeName:}" failed. No retries permitted until 2026-07-18 01:48:06.531561359 +0000 UTC m=+18.220288804 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-x4khf" (UniqueName: "kubernetes.io/projected/25c58f22-7d60-4a06-844f-f3508d910e76-kube-api-access-x4khf") pod "network-check-target-n8bdx" (UID: "25c58f22-7d60-4a06-844f-f3508d910e76") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 18 01:47:58.811991 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:47:58.811899    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-2jzkc"
Jul 18 01:47:58.812153 ip-10-0-142-238 kubenswrapper[2566]: E0718 01:47:58.812024    2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-2jzkc" podUID="26d75b92-43d7-43e7-96c8-dd42a5288953"
Jul 18 01:47:58.812260 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:47:58.812233    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-pdflp"
Jul 18 01:47:58.812397 ip-10-0-142-238 kubenswrapper[2566]: E0718 01:47:58.812370    2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-pdflp" podUID="7c91433e-b6e6-47a8-8df6-2231cbc7d28c"
Jul 18 01:47:59.810007 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:47:59.809969    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-n8bdx"
Jul 18 01:47:59.810463 ip-10-0-142-238 kubenswrapper[2566]: E0718 01:47:59.810108    2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-n8bdx" podUID="25c58f22-7d60-4a06-844f-f3508d910e76"
Jul 18 01:48:00.810557 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:48:00.810518    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-pdflp"
Jul 18 01:48:00.811064 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:48:00.810518    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-2jzkc"
Jul 18 01:48:00.811064 ip-10-0-142-238 kubenswrapper[2566]: E0718 01:48:00.810680    2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-pdflp" podUID="7c91433e-b6e6-47a8-8df6-2231cbc7d28c"
Jul 18 01:48:00.811064 ip-10-0-142-238 kubenswrapper[2566]: E0718 01:48:00.810731    2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-2jzkc" podUID="26d75b92-43d7-43e7-96c8-dd42a5288953"
Jul 18 01:48:01.810028 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:48:01.809993    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-n8bdx"
Jul 18 01:48:01.810222 ip-10-0-142-238 kubenswrapper[2566]: E0718 01:48:01.810130    2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-n8bdx" podUID="25c58f22-7d60-4a06-844f-f3508d910e76"
Jul 18 01:48:02.810275 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:48:02.810243    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-2jzkc"
Jul 18 01:48:02.810738 ip-10-0-142-238 kubenswrapper[2566]: E0718 01:48:02.810372    2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-2jzkc" podUID="26d75b92-43d7-43e7-96c8-dd42a5288953"
Jul 18 01:48:02.810738 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:48:02.810401    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-pdflp"
Jul 18 01:48:02.810738 ip-10-0-142-238 kubenswrapper[2566]: E0718 01:48:02.810457    2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-pdflp" podUID="7c91433e-b6e6-47a8-8df6-2231cbc7d28c"
Jul 18 01:48:03.810061 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:48:03.809977    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-n8bdx"
Jul 18 01:48:03.810229 ip-10-0-142-238 kubenswrapper[2566]: E0718 01:48:03.810121    2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-n8bdx" podUID="25c58f22-7d60-4a06-844f-f3508d910e76"
Jul 18 01:48:03.934580 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:48:03.934530    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dkzsl" event={"ID":"075e93b2-88e3-4a5f-9200-2d0f9fc1d599","Type":"ContainerStarted","Data":"3b1bfaf0bfc03750ebe342a6b462229772e639e318d83566e5f045cf781d4138"}
Jul 18 01:48:03.936451 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:48:03.936407    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-smml7" event={"ID":"fae2962e-4ef0-41af-a49e-d6216d1aa7c9","Type":"ContainerStarted","Data":"93529aec5259a2aa6b27bff281183dcfce7c94de3cc67e93ea72d02a416f113d"}
Jul 18 01:48:03.938250 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:48:03.938222    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-l28dd" event={"ID":"44aa7f9e-049a-45bc-98bc-ff1d4309f5de","Type":"ContainerStarted","Data":"590d9aafbe0048fc2052dc06669bfc74c2c11e10812b893d4ceeb0736272e4f1"}
Jul 18 01:48:04.809806 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:48:04.809770    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-2jzkc"
Jul 18 01:48:04.809976 ip-10-0-142-238 kubenswrapper[2566]: E0718 01:48:04.809908    2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-2jzkc" podUID="26d75b92-43d7-43e7-96c8-dd42a5288953"
Jul 18 01:48:04.809976 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:48:04.809944    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-pdflp"
Jul 18 01:48:04.810084 ip-10-0-142-238 kubenswrapper[2566]: E0718 01:48:04.810027    2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-pdflp" podUID="7c91433e-b6e6-47a8-8df6-2231cbc7d28c"
Jul 18 01:48:05.810491 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:48:05.810457    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-n8bdx"
Jul 18 01:48:05.810935 ip-10-0-142-238 kubenswrapper[2566]: E0718 01:48:05.810577    2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-n8bdx" podUID="25c58f22-7d60-4a06-844f-f3508d910e76"
Jul 18 01:48:06.497648 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:48:06.497597    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7c91433e-b6e6-47a8-8df6-2231cbc7d28c-metrics-certs\") pod \"network-metrics-daemon-pdflp\" (UID: \"7c91433e-b6e6-47a8-8df6-2231cbc7d28c\") " pod="openshift-multus/network-metrics-daemon-pdflp"
Jul 18 01:48:06.497834 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:48:06.497681    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/26d75b92-43d7-43e7-96c8-dd42a5288953-original-pull-secret\") pod \"global-pull-secret-syncer-2jzkc\" (UID: \"26d75b92-43d7-43e7-96c8-dd42a5288953\") " pod="kube-system/global-pull-secret-syncer-2jzkc"
Jul 18 01:48:06.497834 ip-10-0-142-238 kubenswrapper[2566]: E0718 01:48:06.497766    2566 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 18 01:48:06.497834 ip-10-0-142-238 kubenswrapper[2566]: E0718 01:48:06.497777    2566 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 18 01:48:06.497957 ip-10-0-142-238 kubenswrapper[2566]: E0718 01:48:06.497838    2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7c91433e-b6e6-47a8-8df6-2231cbc7d28c-metrics-certs podName:7c91433e-b6e6-47a8-8df6-2231cbc7d28c nodeName:}" failed. No retries permitted until 2026-07-18 01:48:22.497817824 +0000 UTC m=+34.186545263 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/7c91433e-b6e6-47a8-8df6-2231cbc7d28c-metrics-certs") pod "network-metrics-daemon-pdflp" (UID: "7c91433e-b6e6-47a8-8df6-2231cbc7d28c") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 18 01:48:06.497957 ip-10-0-142-238 kubenswrapper[2566]: E0718 01:48:06.497858    2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/26d75b92-43d7-43e7-96c8-dd42a5288953-original-pull-secret podName:26d75b92-43d7-43e7-96c8-dd42a5288953 nodeName:}" failed. No retries permitted until 2026-07-18 01:48:22.497848651 +0000 UTC m=+34.186576077 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/26d75b92-43d7-43e7-96c8-dd42a5288953-original-pull-secret") pod "global-pull-secret-syncer-2jzkc" (UID: "26d75b92-43d7-43e7-96c8-dd42a5288953") : object "kube-system"/"original-pull-secret" not registered
Jul 18 01:48:06.598170 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:48:06.598141    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-x4khf\" (UniqueName: \"kubernetes.io/projected/25c58f22-7d60-4a06-844f-f3508d910e76-kube-api-access-x4khf\") pod \"network-check-target-n8bdx\" (UID: \"25c58f22-7d60-4a06-844f-f3508d910e76\") " pod="openshift-network-diagnostics/network-check-target-n8bdx"
Jul 18 01:48:06.598349 ip-10-0-142-238 kubenswrapper[2566]: E0718 01:48:06.598331    2566 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 18 01:48:06.598409 ip-10-0-142-238 kubenswrapper[2566]: E0718 01:48:06.598357    2566 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 18 01:48:06.598409 ip-10-0-142-238 kubenswrapper[2566]: E0718 01:48:06.598370    2566 projected.go:196] Error preparing data for projected volume kube-api-access-x4khf for pod openshift-network-diagnostics/network-check-target-n8bdx: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 18 01:48:06.598508 ip-10-0-142-238 kubenswrapper[2566]: E0718 01:48:06.598428    2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/25c58f22-7d60-4a06-844f-f3508d910e76-kube-api-access-x4khf podName:25c58f22-7d60-4a06-844f-f3508d910e76 nodeName:}" failed. No retries permitted until 2026-07-18 01:48:22.598410015 +0000 UTC m=+34.287137458 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-x4khf" (UniqueName: "kubernetes.io/projected/25c58f22-7d60-4a06-844f-f3508d910e76-kube-api-access-x4khf") pod "network-check-target-n8bdx" (UID: "25c58f22-7d60-4a06-844f-f3508d910e76") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 18 01:48:06.810075 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:48:06.810001    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-2jzkc"
Jul 18 01:48:06.810240 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:48:06.810000    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-pdflp"
Jul 18 01:48:06.810240 ip-10-0-142-238 kubenswrapper[2566]: E0718 01:48:06.810115    2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-2jzkc" podUID="26d75b92-43d7-43e7-96c8-dd42a5288953"
Jul 18 01:48:06.810240 ip-10-0-142-238 kubenswrapper[2566]: E0718 01:48:06.810195    2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-pdflp" podUID="7c91433e-b6e6-47a8-8df6-2231cbc7d28c"
Jul 18 01:48:07.809884 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:48:07.809852    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-n8bdx"
Jul 18 01:48:07.810317 ip-10-0-142-238 kubenswrapper[2566]: E0718 01:48:07.809965    2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-n8bdx" podUID="25c58f22-7d60-4a06-844f-f3508d910e76"
Jul 18 01:48:07.857480 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:48:07.857450    2566 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-l28dd"
Jul 18 01:48:07.858158 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:48:07.858137    2566 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-l28dd"
Jul 18 01:48:07.872872 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:48:07.872833    2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-l28dd" podStartSLOduration=7.119711778 podStartE2EDuration="17.872815431s" totalImagesPullingTime="10.753103653s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-18 01:47:50 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-18 01:48:03.969229334 +0000 UTC m=+15.657956780" watchObservedRunningTime="2026-07-18 01:48:07.872815431 +0000 UTC m=+19.561542881"
Jul 18 01:48:07.946702 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:48:07.946667    2566 generic.go:356] "Generic (PLEG): container finished" podID="fae2962e-4ef0-41af-a49e-d6216d1aa7c9" containerID="93529aec5259a2aa6b27bff281183dcfce7c94de3cc67e93ea72d02a416f113d" exitCode=0
Jul 18 01:48:07.946869 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:48:07.946733    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-smml7" event={"ID":"fae2962e-4ef0-41af-a49e-d6216d1aa7c9","Type":"ContainerDied","Data":"93529aec5259a2aa6b27bff281183dcfce7c94de3cc67e93ea72d02a416f113d"}
Jul 18 01:48:07.947009 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:48:07.946988    2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-l28dd"
Jul 18 01:48:07.947474 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:48:07.947457    2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-l28dd"
Jul 18 01:48:08.810867 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:48:08.810832    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-pdflp"
Jul 18 01:48:08.811290 ip-10-0-142-238 kubenswrapper[2566]: E0718 01:48:08.810956    2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-pdflp" podUID="7c91433e-b6e6-47a8-8df6-2231cbc7d28c"
Jul 18 01:48:08.811290 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:48:08.811018    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-2jzkc"
Jul 18 01:48:08.811290 ip-10-0-142-238 kubenswrapper[2566]: E0718 01:48:08.811138    2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-2jzkc" podUID="26d75b92-43d7-43e7-96c8-dd42a5288953"
Jul 18 01:48:09.810281 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:48:09.810249    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-n8bdx"
Jul 18 01:48:09.810447 ip-10-0-142-238 kubenswrapper[2566]: E0718 01:48:09.810361    2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-n8bdx" podUID="25c58f22-7d60-4a06-844f-f3508d910e76"
Jul 18 01:48:10.813459 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:48:10.813432    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-pdflp"
Jul 18 01:48:10.813942 ip-10-0-142-238 kubenswrapper[2566]: E0718 01:48:10.813551    2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-pdflp" podUID="7c91433e-b6e6-47a8-8df6-2231cbc7d28c"
Jul 18 01:48:10.813942 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:48:10.813622    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-2jzkc"
Jul 18 01:48:10.813942 ip-10-0-142-238 kubenswrapper[2566]: E0718 01:48:10.813718    2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-2jzkc" podUID="26d75b92-43d7-43e7-96c8-dd42a5288953"
Jul 18 01:48:11.810283 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:48:11.810104    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-n8bdx"
Jul 18 01:48:11.810407 ip-10-0-142-238 kubenswrapper[2566]: E0718 01:48:11.810368    2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-n8bdx" podUID="25c58f22-7d60-4a06-844f-f3508d910e76"
Jul 18 01:48:11.955293 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:48:11.955262    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-lt6hj" event={"ID":"573bdc5a-3cb5-4729-9426-270ba59b0d02","Type":"ContainerStarted","Data":"c0d1b3c31adc0b82111452c095b85c4a662b36c0fd87c8fdd01af597c6ca19d5"}
Jul 18 01:48:11.958441 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:48:11.958417    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-zn27c" event={"ID":"06903f84-978e-4cd4-9f1a-6ccdf2b7524b","Type":"ContainerStarted","Data":"00d5e49db33b82d4d5c839fc461c47dc7eec27b2a7cb3e7d2c4a49ab93daa4f7"}
Jul 18 01:48:11.958539 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:48:11.958493    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-zn27c" event={"ID":"06903f84-978e-4cd4-9f1a-6ccdf2b7524b","Type":"ContainerStarted","Data":"e6be268389ad926b11d47c5613a4e05256644d91b80334afb2819f8ed0fe119c"}
Jul 18 01:48:11.958601 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:48:11.958542    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-zn27c" event={"ID":"06903f84-978e-4cd4-9f1a-6ccdf2b7524b","Type":"ContainerStarted","Data":"4c19a752985c3bdd47d019b62bc145db59abd71114ccdd3e9a17273d91ad173e"}
Jul 18 01:48:11.958601 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:48:11.958595    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-zn27c" event={"ID":"06903f84-978e-4cd4-9f1a-6ccdf2b7524b","Type":"ContainerStarted","Data":"9da716d1a9d6bdc5eb3dcbef402b6b76c364649f8dbf6dc144b030e2dce9584d"}
Jul 18 01:48:11.958728 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:48:11.958663    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-zn27c" event={"ID":"06903f84-978e-4cd4-9f1a-6ccdf2b7524b","Type":"ContainerStarted","Data":"cb1758a4a5116a8de0707a6e328355c871300c5db8b8305cc3c3db51b1376e58"}
Jul 18 01:48:11.960052 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:48:11.959986    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-z6hz2" event={"ID":"d43cde0e-8b28-405b-a229-dedf1d9c4435","Type":"ContainerStarted","Data":"12e1690a284a22d8b6971b9a8ec9e98db5bcc0faec1454defd051615b37fec5e"}
Jul 18 01:48:11.961536 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:48:11.961396    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-cpp62" event={"ID":"ddbb4203-0f8f-4799-a645-184ca2236211","Type":"ContainerStarted","Data":"04b539d50fbda5115a25ee8e3e1af494594af4985e7318a870fc419909dab6a0"}
Jul 18 01:48:11.963029 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:48:11.963002    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-tscwd" event={"ID":"f3a548b3-84f2-4a68-8676-5b8b26777d81","Type":"ContainerStarted","Data":"2755f2bceff299970f4ab88ab9d225509b3d781fb45551591381801fb30f08ac"}
Jul 18 01:48:11.971596 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:48:11.971195    2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-lt6hj" podStartSLOduration=10.919117163 podStartE2EDuration="21.971178309s" totalImagesPullingTime="11.052061146s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-18 01:47:50 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-18 01:48:11.970980725 +0000 UTC m=+23.659708174" watchObservedRunningTime="2026-07-18 01:48:11.971178309 +0000 UTC m=+23.659905756"
Jul 18 01:48:11.989921 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:48:11.989301    2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-z6hz2" podStartSLOduration=3.096139652 podStartE2EDuration="21.989284102s" totalImagesPullingTime="18.89314445s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-18 01:47:50 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-18 01:48:11.989158968 +0000 UTC m=+23.677886417" watchObservedRunningTime="2026-07-18 01:48:11.989284102 +0000 UTC m=+23.678011549"
Jul 18 01:48:12.008122 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:48:12.008085    2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-tscwd" podStartSLOduration=10.938751442000001 podStartE2EDuration="22.008071517s" totalImagesPullingTime="11.069320075s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-18 01:47:50 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-18 01:48:12.007800813 +0000 UTC m=+23.696528261" watchObservedRunningTime="2026-07-18 01:48:12.008071517 +0000 UTC m=+23.696798962"
Jul 18 01:48:12.026478 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:48:12.026426    2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-cpp62" podStartSLOduration=10.977812725 podStartE2EDuration="22.026408348s" totalImagesPullingTime="11.048595623s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-18 01:47:50 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-18 01:48:12.026238486 +0000 UTC m=+23.714965934" watchObservedRunningTime="2026-07-18 01:48:12.026408348 +0000 UTC m=+23.715135986"
Jul 18 01:48:12.075074 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:48:12.075049    2566 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock"
Jul 18 01:48:12.814053 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:48:12.813906    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-pdflp"
Jul 18 01:48:12.814053 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:48:12.814010    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-2jzkc"
Jul 18 01:48:12.814053 ip-10-0-142-238 kubenswrapper[2566]: E0718 01:48:12.814015    2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-pdflp" podUID="7c91433e-b6e6-47a8-8df6-2231cbc7d28c"
Jul 18 01:48:12.814470 ip-10-0-142-238 kubenswrapper[2566]: E0718 01:48:12.814115    2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-2jzkc" podUID="26d75b92-43d7-43e7-96c8-dd42a5288953"
Jul 18 01:48:12.963227 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:48:12.963123    2566 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-07-18T01:48:12.075070726Z","UUID":"791a4cf5-88ed-4e49-984c-3ee827d3616c","Handler":null,"Name":"","Endpoint":""}
Jul 18 01:48:12.964853 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:48:12.964803    2566 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0
Jul 18 01:48:12.964853 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:48:12.964846    2566 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock
Jul 18 01:48:12.973639 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:48:12.972855    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-zn27c" event={"ID":"06903f84-978e-4cd4-9f1a-6ccdf2b7524b","Type":"ContainerStarted","Data":"02669e519363bf6a2ddfe6da1f6292b2cad31d020bbd6a1f45c8ea1c923755b2"}
Jul 18 01:48:12.976190 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:48:12.976152    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dkzsl" event={"ID":"075e93b2-88e3-4a5f-9200-2d0f9fc1d599","Type":"ContainerStarted","Data":"e110767960ca06518e9d98cd727200b15988b4eee64aa1121a666e6cd67fe638"}
Jul 18 01:48:12.977789 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:48:12.977764    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-cqkkm" event={"ID":"840829b1-92cb-4b4d-839f-a27bb50774ea","Type":"ContainerStarted","Data":"0619ec467e96c65a354ac9548b21bf086555024870c15c98292e5a0cc6cecfbc"}
Jul 18 01:48:12.993807 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:48:12.993758    2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-cqkkm" podStartSLOduration=11.938513350000001 podStartE2EDuration="22.993744767s" totalImagesPullingTime="11.055231417s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-18 01:47:50 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-18 01:48:12.993296609 +0000 UTC m=+24.682024056" watchObservedRunningTime="2026-07-18 01:48:12.993744767 +0000 UTC m=+24.682472213"
Jul 18 01:48:13.809710 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:48:13.809680    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-n8bdx"
Jul 18 01:48:13.809921 ip-10-0-142-238 kubenswrapper[2566]: E0718 01:48:13.809780    2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-n8bdx" podUID="25c58f22-7d60-4a06-844f-f3508d910e76"
Jul 18 01:48:13.982335 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:48:13.982297    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dkzsl" event={"ID":"075e93b2-88e3-4a5f-9200-2d0f9fc1d599","Type":"ContainerStarted","Data":"807f740070c494014721968893a0b608e36136cf2cfc95cc6d7860bb576deeb3"}
Jul 18 01:48:13.998589 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:48:13.998538    2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dkzsl" podStartSLOduration=3.532007369 podStartE2EDuration="23.998522787s" totalImagesPullingTime="20.466515418s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-18 01:47:50 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-18 01:48:13.997797522 +0000 UTC m=+25.686524971" watchObservedRunningTime="2026-07-18 01:48:13.998522787 +0000 UTC m=+25.687250233"
Jul 18 01:48:14.810100 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:48:14.810071    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-2jzkc"
Jul 18 01:48:14.810100 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:48:14.810086    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-pdflp"
Jul 18 01:48:14.810326 ip-10-0-142-238 kubenswrapper[2566]: E0718 01:48:14.810179    2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-2jzkc" podUID="26d75b92-43d7-43e7-96c8-dd42a5288953"
Jul 18 01:48:14.810326 ip-10-0-142-238 kubenswrapper[2566]: E0718 01:48:14.810253    2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-pdflp" podUID="7c91433e-b6e6-47a8-8df6-2231cbc7d28c"
Jul 18 01:48:14.988105 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:48:14.987932    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-zn27c" event={"ID":"06903f84-978e-4cd4-9f1a-6ccdf2b7524b","Type":"ContainerStarted","Data":"21689086aefd243304808052b1556a234c76f8c4c010e60a757d5ad15bb38513"}
Jul 18 01:48:15.748542 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:48:15.748475    2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-l28dd_44aa7f9e-049a-45bc-98bc-ff1d4309f5de/konnectivity-agent/0.log" limit=1024
Jul 18 01:48:15.809946 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:48:15.809925    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-n8bdx"
Jul 18 01:48:15.810039 ip-10-0-142-238 kubenswrapper[2566]: E0718 01:48:15.810014    2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-n8bdx" podUID="25c58f22-7d60-4a06-844f-f3508d910e76"
Jul 18 01:48:15.991685 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:48:15.991660    2566 generic.go:356] "Generic (PLEG): container finished" podID="fae2962e-4ef0-41af-a49e-d6216d1aa7c9" containerID="d64d876af752cdafbe03da24d3f6e3943a4703d084608b00c93d08674e26481b" exitCode=0
Jul 18 01:48:15.992095 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:48:15.991703    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-smml7" event={"ID":"fae2962e-4ef0-41af-a49e-d6216d1aa7c9","Type":"ContainerDied","Data":"d64d876af752cdafbe03da24d3f6e3943a4703d084608b00c93d08674e26481b"}
Jul 18 01:48:16.067988 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:48:16.067928    2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-l28dd_44aa7f9e-049a-45bc-98bc-ff1d4309f5de/konnectivity-agent/0.log" limit=1024
Jul 18 01:48:16.437143 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:48:16.437078    2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-l28dd_44aa7f9e-049a-45bc-98bc-ff1d4309f5de/konnectivity-agent/0.log" limit=1024
Jul 18 01:48:16.535020 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:48:16.534997    2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-l28dd_44aa7f9e-049a-45bc-98bc-ff1d4309f5de/konnectivity-agent/0.log" limit=1024
Jul 18 01:48:16.810524 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:48:16.810449    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-pdflp"
Jul 18 01:48:16.810720 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:48:16.810449    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-2jzkc"
Jul 18 01:48:16.810720 ip-10-0-142-238 kubenswrapper[2566]: E0718 01:48:16.810585    2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-pdflp" podUID="7c91433e-b6e6-47a8-8df6-2231cbc7d28c"
Jul 18 01:48:16.810720 ip-10-0-142-238 kubenswrapper[2566]: E0718 01:48:16.810660    2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-2jzkc" podUID="26d75b92-43d7-43e7-96c8-dd42a5288953"
Jul 18 01:48:16.834143 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:48:16.834112    2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-l28dd_44aa7f9e-049a-45bc-98bc-ff1d4309f5de/konnectivity-agent/0.log" limit=1024
Jul 18 01:48:16.890280 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:48:16.890258    2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-l28dd_44aa7f9e-049a-45bc-98bc-ff1d4309f5de/konnectivity-agent/0.log" limit=1024
Jul 18 01:48:17.810441 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:48:17.810226    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-n8bdx"
Jul 18 01:48:17.810920 ip-10-0-142-238 kubenswrapper[2566]: E0718 01:48:17.810481    2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-n8bdx" podUID="25c58f22-7d60-4a06-844f-f3508d910e76"
Jul 18 01:48:17.999577 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:48:17.999539    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-zn27c" event={"ID":"06903f84-978e-4cd4-9f1a-6ccdf2b7524b","Type":"ContainerStarted","Data":"28af281276a13fb6fd9bdb6a6f4733a75939181e0358f8d10c54684dc247d699"}
Jul 18 01:48:17.999907 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:48:17.999838    2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-zn27c"
Jul 18 01:48:18.001641 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:48:18.001597    2566 generic.go:356] "Generic (PLEG): container finished" podID="fae2962e-4ef0-41af-a49e-d6216d1aa7c9" containerID="520a4aa8cfe71650be837b918f11d3340aca0407d6ce804f4946e7e18fd15abb" exitCode=0
Jul 18 01:48:18.001732 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:48:18.001647    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-smml7" event={"ID":"fae2962e-4ef0-41af-a49e-d6216d1aa7c9","Type":"ContainerDied","Data":"520a4aa8cfe71650be837b918f11d3340aca0407d6ce804f4946e7e18fd15abb"}
Jul 18 01:48:18.016241 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:48:18.016215    2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-zn27c"
Jul 18 01:48:18.032411 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:48:18.032376    2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-zn27c" podStartSLOduration=9.117214643 podStartE2EDuration="28.032364539s" totalImagesPullingTime="18.915149896s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-18 01:47:50 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-18 01:48:18.031044368 +0000 UTC m=+29.719771806" watchObservedRunningTime="2026-07-18 01:48:18.032364539 +0000 UTC m=+29.721091985"
Jul 18 01:48:18.811382 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:48:18.811355    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-2jzkc"
Jul 18 01:48:18.811908 ip-10-0-142-238 kubenswrapper[2566]: E0718 01:48:18.811431    2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-2jzkc" podUID="26d75b92-43d7-43e7-96c8-dd42a5288953"
Jul 18 01:48:18.811908 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:48:18.811478    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-pdflp"
Jul 18 01:48:18.811908 ip-10-0-142-238 kubenswrapper[2566]: E0718 01:48:18.811571    2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-pdflp" podUID="7c91433e-b6e6-47a8-8df6-2231cbc7d28c"
Jul 18 01:48:19.004175 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:48:19.004152    2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-zn27c"
Jul 18 01:48:19.004282 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:48:19.004224    2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-zn27c"
Jul 18 01:48:19.019372 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:48:19.019350    2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-zn27c"
Jul 18 01:48:19.508772 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:48:19.508579    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-2jzkc"]
Jul 18 01:48:19.508931 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:48:19.508883    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-2jzkc"
Jul 18 01:48:19.509005 ip-10-0-142-238 kubenswrapper[2566]: E0718 01:48:19.508985    2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-2jzkc" podUID="26d75b92-43d7-43e7-96c8-dd42a5288953"
Jul 18 01:48:19.511974 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:48:19.511949    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-n8bdx"]
Jul 18 01:48:19.512102 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:48:19.512059    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-n8bdx"
Jul 18 01:48:19.512172 ip-10-0-142-238 kubenswrapper[2566]: E0718 01:48:19.512151    2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-n8bdx" podUID="25c58f22-7d60-4a06-844f-f3508d910e76"
Jul 18 01:48:19.512803 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:48:19.512776    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-pdflp"]
Jul 18 01:48:19.513013 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:48:19.512993    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-pdflp"
Jul 18 01:48:19.513133 ip-10-0-142-238 kubenswrapper[2566]: E0718 01:48:19.513113    2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-pdflp" podUID="7c91433e-b6e6-47a8-8df6-2231cbc7d28c"
Jul 18 01:48:20.007848 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:48:20.007815    2566 generic.go:356] "Generic (PLEG): container finished" podID="fae2962e-4ef0-41af-a49e-d6216d1aa7c9" containerID="bdd882fd597fa80ebc97c42c119b3d096292b3c2440c405bb295ed74264b9d29" exitCode=0
Jul 18 01:48:20.008175 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:48:20.007879    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-smml7" event={"ID":"fae2962e-4ef0-41af-a49e-d6216d1aa7c9","Type":"ContainerDied","Data":"bdd882fd597fa80ebc97c42c119b3d096292b3c2440c405bb295ed74264b9d29"}
Jul 18 01:48:20.254786 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:48:20.254756    2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-l28dd_44aa7f9e-049a-45bc-98bc-ff1d4309f5de/konnectivity-agent/0.log" limit=1024
Jul 18 01:48:20.355847 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:48:20.355815    2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-l28dd_44aa7f9e-049a-45bc-98bc-ff1d4309f5de/konnectivity-agent/0.log" limit=1024
Jul 18 01:48:20.455568 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:48:20.455541    2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-l28dd_44aa7f9e-049a-45bc-98bc-ff1d4309f5de/konnectivity-agent/0.log" limit=1024
Jul 18 01:48:20.555768 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:48:20.555738    2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-l28dd_44aa7f9e-049a-45bc-98bc-ff1d4309f5de/konnectivity-agent/0.log" limit=1024
Jul 18 01:48:20.809783 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:48:20.809749    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-pdflp"
Jul 18 01:48:20.809936 ip-10-0-142-238 kubenswrapper[2566]: E0718 01:48:20.809878    2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-pdflp" podUID="7c91433e-b6e6-47a8-8df6-2231cbc7d28c"
Jul 18 01:48:20.879841 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:48:20.879806    2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-l28dd_44aa7f9e-049a-45bc-98bc-ff1d4309f5de/konnectivity-agent/0.log" limit=1024
Jul 18 01:48:20.982030 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:48:20.981998    2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-l28dd_44aa7f9e-049a-45bc-98bc-ff1d4309f5de/konnectivity-agent/0.log" limit=1024
Jul 18 01:48:21.810495 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:48:21.810459    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-n8bdx"
Jul 18 01:48:21.810991 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:48:21.810460    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-2jzkc"
Jul 18 01:48:21.810991 ip-10-0-142-238 kubenswrapper[2566]: E0718 01:48:21.810575    2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-n8bdx" podUID="25c58f22-7d60-4a06-844f-f3508d910e76"
Jul 18 01:48:21.810991 ip-10-0-142-238 kubenswrapper[2566]: E0718 01:48:21.810675    2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-2jzkc" podUID="26d75b92-43d7-43e7-96c8-dd42a5288953"
Jul 18 01:48:22.521063 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:48:22.521026    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7c91433e-b6e6-47a8-8df6-2231cbc7d28c-metrics-certs\") pod \"network-metrics-daemon-pdflp\" (UID: \"7c91433e-b6e6-47a8-8df6-2231cbc7d28c\") " pod="openshift-multus/network-metrics-daemon-pdflp"
Jul 18 01:48:22.521228 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:48:22.521092    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/26d75b92-43d7-43e7-96c8-dd42a5288953-original-pull-secret\") pod \"global-pull-secret-syncer-2jzkc\" (UID: \"26d75b92-43d7-43e7-96c8-dd42a5288953\") " pod="kube-system/global-pull-secret-syncer-2jzkc"
Jul 18 01:48:22.521228 ip-10-0-142-238 kubenswrapper[2566]: E0718 01:48:22.521174    2566 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 18 01:48:22.521228 ip-10-0-142-238 kubenswrapper[2566]: E0718 01:48:22.521189    2566 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 18 01:48:22.521395 ip-10-0-142-238 kubenswrapper[2566]: E0718 01:48:22.521233    2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7c91433e-b6e6-47a8-8df6-2231cbc7d28c-metrics-certs podName:7c91433e-b6e6-47a8-8df6-2231cbc7d28c nodeName:}" failed. No retries permitted until 2026-07-18 01:48:54.521215327 +0000 UTC m=+66.209942757 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/7c91433e-b6e6-47a8-8df6-2231cbc7d28c-metrics-certs") pod "network-metrics-daemon-pdflp" (UID: "7c91433e-b6e6-47a8-8df6-2231cbc7d28c") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 18 01:48:22.521395 ip-10-0-142-238 kubenswrapper[2566]: E0718 01:48:22.521248    2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/26d75b92-43d7-43e7-96c8-dd42a5288953-original-pull-secret podName:26d75b92-43d7-43e7-96c8-dd42a5288953 nodeName:}" failed. No retries permitted until 2026-07-18 01:48:54.521242028 +0000 UTC m=+66.209969455 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/26d75b92-43d7-43e7-96c8-dd42a5288953-original-pull-secret") pod "global-pull-secret-syncer-2jzkc" (UID: "26d75b92-43d7-43e7-96c8-dd42a5288953") : object "kube-system"/"original-pull-secret" not registered
Jul 18 01:48:22.621581 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:48:22.621547    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-x4khf\" (UniqueName: \"kubernetes.io/projected/25c58f22-7d60-4a06-844f-f3508d910e76-kube-api-access-x4khf\") pod \"network-check-target-n8bdx\" (UID: \"25c58f22-7d60-4a06-844f-f3508d910e76\") " pod="openshift-network-diagnostics/network-check-target-n8bdx"
Jul 18 01:48:22.621739 ip-10-0-142-238 kubenswrapper[2566]: E0718 01:48:22.621716    2566 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 18 01:48:22.621739 ip-10-0-142-238 kubenswrapper[2566]: E0718 01:48:22.621736    2566 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 18 01:48:22.621854 ip-10-0-142-238 kubenswrapper[2566]: E0718 01:48:22.621748    2566 projected.go:196] Error preparing data for projected volume kube-api-access-x4khf for pod openshift-network-diagnostics/network-check-target-n8bdx: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 18 01:48:22.621854 ip-10-0-142-238 kubenswrapper[2566]: E0718 01:48:22.621807    2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/25c58f22-7d60-4a06-844f-f3508d910e76-kube-api-access-x4khf podName:25c58f22-7d60-4a06-844f-f3508d910e76 nodeName:}" failed. No retries permitted until 2026-07-18 01:48:54.621789771 +0000 UTC m=+66.310517212 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-x4khf" (UniqueName: "kubernetes.io/projected/25c58f22-7d60-4a06-844f-f3508d910e76-kube-api-access-x4khf") pod "network-check-target-n8bdx" (UID: "25c58f22-7d60-4a06-844f-f3508d910e76") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 18 01:48:22.810098 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:48:22.810066    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-pdflp"
Jul 18 01:48:22.810240 ip-10-0-142-238 kubenswrapper[2566]: E0718 01:48:22.810199    2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-pdflp" podUID="7c91433e-b6e6-47a8-8df6-2231cbc7d28c"
Jul 18 01:48:23.625639 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:48:23.625598    2566 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-238.ec2.internal" event="NodeReady"
Jul 18 01:48:23.626048 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:48:23.625739    2566 kubelet_node_status.go:489] "Fast updating node status as it just became ready"
Jul 18 01:48:23.665669 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:48:23.665637    2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-lh5mf"]
Jul 18 01:48:23.670027 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:48:23.670004    2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-pz72j"]
Jul 18 01:48:23.670174 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:48:23.670135    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-lh5mf"
Jul 18 01:48:23.672326 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:48:23.672306    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-ml5qw\""
Jul 18 01:48:23.672493 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:48:23.672417    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\""
Jul 18 01:48:23.672748 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:48:23.672729    2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\""
Jul 18 01:48:23.674415 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:48:23.674394    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-pz72j"
Jul 18 01:48:23.676416 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:48:23.676397    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\""
Jul 18 01:48:23.676518 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:48:23.676500    2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\""
Jul 18 01:48:23.676575 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:48:23.676544    2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\""
Jul 18 01:48:23.676642 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:48:23.676592    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-pf5pc\""
Jul 18 01:48:23.678214 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:48:23.678164    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-lh5mf"]
Jul 18 01:48:23.681287 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:48:23.681268    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-pz72j"]
Jul 18 01:48:23.810153 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:48:23.810122    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-2jzkc"
Jul 18 01:48:23.810334 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:48:23.810122    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-n8bdx"
Jul 18 01:48:23.812746 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:48:23.812554    2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Jul 18 01:48:23.812746 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:48:23.812554    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-vwvlx\""
Jul 18 01:48:23.812746 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:48:23.812586    2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Jul 18 01:48:23.812746 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:48:23.812687    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Jul 18 01:48:23.831758 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:48:23.831733    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/fdf6ac26-5f24-480c-ad15-d6dbb18adc78-cert\") pod \"ingress-canary-pz72j\" (UID: \"fdf6ac26-5f24-480c-ad15-d6dbb18adc78\") " pod="openshift-ingress-canary/ingress-canary-pz72j"
Jul 18 01:48:23.831852 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:48:23.831775    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-n2dwq\" (UniqueName: \"kubernetes.io/projected/bf30ad74-8679-41d3-aa9d-19b3cea07be7-kube-api-access-n2dwq\") pod \"dns-default-lh5mf\" (UID: \"bf30ad74-8679-41d3-aa9d-19b3cea07be7\") " pod="openshift-dns/dns-default-lh5mf"
Jul 18 01:48:23.831852 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:48:23.831829    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wdllc\" (UniqueName: \"kubernetes.io/projected/fdf6ac26-5f24-480c-ad15-d6dbb18adc78-kube-api-access-wdllc\") pod \"ingress-canary-pz72j\" (UID: \"fdf6ac26-5f24-480c-ad15-d6dbb18adc78\") " pod="openshift-ingress-canary/ingress-canary-pz72j"
Jul 18 01:48:23.831963 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:48:23.831887    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/bf30ad74-8679-41d3-aa9d-19b3cea07be7-config-volume\") pod \"dns-default-lh5mf\" (UID: \"bf30ad74-8679-41d3-aa9d-19b3cea07be7\") " pod="openshift-dns/dns-default-lh5mf"
Jul 18 01:48:23.831963 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:48:23.831928    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/bf30ad74-8679-41d3-aa9d-19b3cea07be7-metrics-tls\") pod \"dns-default-lh5mf\" (UID: \"bf30ad74-8679-41d3-aa9d-19b3cea07be7\") " pod="openshift-dns/dns-default-lh5mf"
Jul 18 01:48:23.832063 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:48:23.832009    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/bf30ad74-8679-41d3-aa9d-19b3cea07be7-tmp-dir\") pod \"dns-default-lh5mf\" (UID: \"bf30ad74-8679-41d3-aa9d-19b3cea07be7\") " pod="openshift-dns/dns-default-lh5mf"
Jul 18 01:48:23.933133 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:48:23.933102    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wdllc\" (UniqueName: \"kubernetes.io/projected/fdf6ac26-5f24-480c-ad15-d6dbb18adc78-kube-api-access-wdllc\") pod \"ingress-canary-pz72j\" (UID: \"fdf6ac26-5f24-480c-ad15-d6dbb18adc78\") " pod="openshift-ingress-canary/ingress-canary-pz72j"
Jul 18 01:48:23.933307 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:48:23.933146    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/bf30ad74-8679-41d3-aa9d-19b3cea07be7-config-volume\") pod \"dns-default-lh5mf\" (UID: \"bf30ad74-8679-41d3-aa9d-19b3cea07be7\") " pod="openshift-dns/dns-default-lh5mf"
Jul 18 01:48:23.933307 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:48:23.933178    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/bf30ad74-8679-41d3-aa9d-19b3cea07be7-metrics-tls\") pod \"dns-default-lh5mf\" (UID: \"bf30ad74-8679-41d3-aa9d-19b3cea07be7\") " pod="openshift-dns/dns-default-lh5mf"
Jul 18 01:48:23.933307 ip-10-0-142-238 kubenswrapper[2566]: E0718 01:48:23.933280    2566 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 18 01:48:23.933462 ip-10-0-142-238 kubenswrapper[2566]: E0718 01:48:23.933333    2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/bf30ad74-8679-41d3-aa9d-19b3cea07be7-metrics-tls podName:bf30ad74-8679-41d3-aa9d-19b3cea07be7 nodeName:}" failed. No retries permitted until 2026-07-18 01:48:24.433314729 +0000 UTC m=+36.122042154 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/bf30ad74-8679-41d3-aa9d-19b3cea07be7-metrics-tls") pod "dns-default-lh5mf" (UID: "bf30ad74-8679-41d3-aa9d-19b3cea07be7") : secret "dns-default-metrics-tls" not found
Jul 18 01:48:23.933462 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:48:23.933351    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/bf30ad74-8679-41d3-aa9d-19b3cea07be7-tmp-dir\") pod \"dns-default-lh5mf\" (UID: \"bf30ad74-8679-41d3-aa9d-19b3cea07be7\") " pod="openshift-dns/dns-default-lh5mf"
Jul 18 01:48:23.933462 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:48:23.933395    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/fdf6ac26-5f24-480c-ad15-d6dbb18adc78-cert\") pod \"ingress-canary-pz72j\" (UID: \"fdf6ac26-5f24-480c-ad15-d6dbb18adc78\") " pod="openshift-ingress-canary/ingress-canary-pz72j"
Jul 18 01:48:23.933462 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:48:23.933423    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-n2dwq\" (UniqueName: \"kubernetes.io/projected/bf30ad74-8679-41d3-aa9d-19b3cea07be7-kube-api-access-n2dwq\") pod \"dns-default-lh5mf\" (UID: \"bf30ad74-8679-41d3-aa9d-19b3cea07be7\") " pod="openshift-dns/dns-default-lh5mf"
Jul 18 01:48:23.933796 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:48:23.933748    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/bf30ad74-8679-41d3-aa9d-19b3cea07be7-tmp-dir\") pod \"dns-default-lh5mf\" (UID: \"bf30ad74-8679-41d3-aa9d-19b3cea07be7\") " pod="openshift-dns/dns-default-lh5mf"
Jul 18 01:48:23.933906 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:48:23.933825    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/bf30ad74-8679-41d3-aa9d-19b3cea07be7-config-volume\") pod \"dns-default-lh5mf\" (UID: \"bf30ad74-8679-41d3-aa9d-19b3cea07be7\") " pod="openshift-dns/dns-default-lh5mf"
Jul 18 01:48:23.938122 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:48:23.938097    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/fdf6ac26-5f24-480c-ad15-d6dbb18adc78-cert\") pod \"ingress-canary-pz72j\" (UID: \"fdf6ac26-5f24-480c-ad15-d6dbb18adc78\") " pod="openshift-ingress-canary/ingress-canary-pz72j"
Jul 18 01:48:23.942546 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:48:23.942504    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-n2dwq\" (UniqueName: \"kubernetes.io/projected/bf30ad74-8679-41d3-aa9d-19b3cea07be7-kube-api-access-n2dwq\") pod \"dns-default-lh5mf\" (UID: \"bf30ad74-8679-41d3-aa9d-19b3cea07be7\") " pod="openshift-dns/dns-default-lh5mf"
Jul 18 01:48:23.942885 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:48:23.942862    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wdllc\" (UniqueName: \"kubernetes.io/projected/fdf6ac26-5f24-480c-ad15-d6dbb18adc78-kube-api-access-wdllc\") pod \"ingress-canary-pz72j\" (UID: \"fdf6ac26-5f24-480c-ad15-d6dbb18adc78\") " pod="openshift-ingress-canary/ingress-canary-pz72j"
Jul 18 01:48:23.989496 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:48:23.989471    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-pz72j"
Jul 18 01:48:24.149779 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:48:24.149588    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-pz72j"]
Jul 18 01:48:24.152747 ip-10-0-142-238 kubenswrapper[2566]: W0718 01:48:24.152725    2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfdf6ac26_5f24_480c_ad15_d6dbb18adc78.slice/crio-ccb8b86ffdebedbfd8558306f2a4f773e6d444f85170c0711ef43a383c100ed4 WatchSource:0}: Error finding container ccb8b86ffdebedbfd8558306f2a4f773e6d444f85170c0711ef43a383c100ed4: Status 404 returned error can't find the container with id ccb8b86ffdebedbfd8558306f2a4f773e6d444f85170c0711ef43a383c100ed4
Jul 18 01:48:24.437163 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:48:24.437080    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/bf30ad74-8679-41d3-aa9d-19b3cea07be7-metrics-tls\") pod \"dns-default-lh5mf\" (UID: \"bf30ad74-8679-41d3-aa9d-19b3cea07be7\") " pod="openshift-dns/dns-default-lh5mf"
Jul 18 01:48:24.437266 ip-10-0-142-238 kubenswrapper[2566]: E0718 01:48:24.437228    2566 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 18 01:48:24.437302 ip-10-0-142-238 kubenswrapper[2566]: E0718 01:48:24.437290    2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/bf30ad74-8679-41d3-aa9d-19b3cea07be7-metrics-tls podName:bf30ad74-8679-41d3-aa9d-19b3cea07be7 nodeName:}" failed. No retries permitted until 2026-07-18 01:48:25.437275865 +0000 UTC m=+37.126003294 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/bf30ad74-8679-41d3-aa9d-19b3cea07be7-metrics-tls") pod "dns-default-lh5mf" (UID: "bf30ad74-8679-41d3-aa9d-19b3cea07be7") : secret "dns-default-metrics-tls" not found
Jul 18 01:48:24.810076 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:48:24.810049    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-pdflp"
Jul 18 01:48:24.812485 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:48:24.812460    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Jul 18 01:48:24.812638 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:48:24.812495    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-tqgxz\""
Jul 18 01:48:25.023033 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:48:25.023001    2566 generic.go:356] "Generic (PLEG): container finished" podID="fae2962e-4ef0-41af-a49e-d6216d1aa7c9" containerID="bd04280e1dcdb438f43b47d810137a10461c67fad92621153456b8ff39a487ab" exitCode=0
Jul 18 01:48:25.023182 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:48:25.023063    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-smml7" event={"ID":"fae2962e-4ef0-41af-a49e-d6216d1aa7c9","Type":"ContainerDied","Data":"bd04280e1dcdb438f43b47d810137a10461c67fad92621153456b8ff39a487ab"}
Jul 18 01:48:25.024518 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:48:25.024445    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-pz72j" event={"ID":"fdf6ac26-5f24-480c-ad15-d6dbb18adc78","Type":"ContainerStarted","Data":"ccb8b86ffdebedbfd8558306f2a4f773e6d444f85170c0711ef43a383c100ed4"}
Jul 18 01:48:25.446369 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:48:25.446301    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/bf30ad74-8679-41d3-aa9d-19b3cea07be7-metrics-tls\") pod \"dns-default-lh5mf\" (UID: \"bf30ad74-8679-41d3-aa9d-19b3cea07be7\") " pod="openshift-dns/dns-default-lh5mf"
Jul 18 01:48:25.446499 ip-10-0-142-238 kubenswrapper[2566]: E0718 01:48:25.446439    2566 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 18 01:48:25.446539 ip-10-0-142-238 kubenswrapper[2566]: E0718 01:48:25.446508    2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/bf30ad74-8679-41d3-aa9d-19b3cea07be7-metrics-tls podName:bf30ad74-8679-41d3-aa9d-19b3cea07be7 nodeName:}" failed. No retries permitted until 2026-07-18 01:48:27.446492642 +0000 UTC m=+39.135220067 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/bf30ad74-8679-41d3-aa9d-19b3cea07be7-metrics-tls") pod "dns-default-lh5mf" (UID: "bf30ad74-8679-41d3-aa9d-19b3cea07be7") : secret "dns-default-metrics-tls" not found
Jul 18 01:48:26.030747 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:48:26.030710    2566 generic.go:356] "Generic (PLEG): container finished" podID="fae2962e-4ef0-41af-a49e-d6216d1aa7c9" containerID="0abbb4abd153de89a51e630d18a790533c129e56b66f24fcff006e59fe4a4985" exitCode=0
Jul 18 01:48:26.031274 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:48:26.030747    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-smml7" event={"ID":"fae2962e-4ef0-41af-a49e-d6216d1aa7c9","Type":"ContainerDied","Data":"0abbb4abd153de89a51e630d18a790533c129e56b66f24fcff006e59fe4a4985"}
Jul 18 01:48:27.037091 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:48:27.036895    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-smml7" event={"ID":"fae2962e-4ef0-41af-a49e-d6216d1aa7c9","Type":"ContainerStarted","Data":"5e41d49d6549bff00fe8804cdf3ed6aea5aa1f09b33ebbb75fe91083812e18b1"}
Jul 18 01:48:27.041343 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:48:27.041303    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-pz72j" event={"ID":"fdf6ac26-5f24-480c-ad15-d6dbb18adc78","Type":"ContainerStarted","Data":"4000afb09b4bdf1580697622d7327de2b4bf2fe923f76ccc2a0415f50c4c806d"}
Jul 18 01:48:27.066819 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:48:27.066778    2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-smml7" podStartSLOduration=12.747823069 podStartE2EDuration="37.066764041s" totalImagesPullingTime="24.318940972s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-18 01:47:50 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-18 01:48:27.064792759 +0000 UTC m=+38.753520205" watchObservedRunningTime="2026-07-18 01:48:27.066764041 +0000 UTC m=+38.755491486"
Jul 18 01:48:27.106187 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:48:27.106147    2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-pz72j" podStartSLOduration=1.922274797 podStartE2EDuration="4.106134386s" totalImagesPullingTime="2.183859589s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-18 01:48:23 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-18 01:48:27.105528698 +0000 UTC m=+38.794256156" watchObservedRunningTime="2026-07-18 01:48:27.106134386 +0000 UTC m=+38.794861832"
Jul 18 01:48:27.204008 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:48:27.203986    2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-l28dd_44aa7f9e-049a-45bc-98bc-ff1d4309f5de/konnectivity-agent/0.log" limit=1024
Jul 18 01:48:27.261487 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:48:27.261468    2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-l28dd_44aa7f9e-049a-45bc-98bc-ff1d4309f5de/konnectivity-agent/0.log" limit=1024
Jul 18 01:48:27.460478 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:48:27.460418    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/bf30ad74-8679-41d3-aa9d-19b3cea07be7-metrics-tls\") pod \"dns-default-lh5mf\" (UID: \"bf30ad74-8679-41d3-aa9d-19b3cea07be7\") " pod="openshift-dns/dns-default-lh5mf"
Jul 18 01:48:27.460592 ip-10-0-142-238 kubenswrapper[2566]: E0718 01:48:27.460559    2566 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 18 01:48:27.460655 ip-10-0-142-238 kubenswrapper[2566]: E0718 01:48:27.460643    2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/bf30ad74-8679-41d3-aa9d-19b3cea07be7-metrics-tls podName:bf30ad74-8679-41d3-aa9d-19b3cea07be7 nodeName:}" failed. No retries permitted until 2026-07-18 01:48:31.460605708 +0000 UTC m=+43.149333154 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/bf30ad74-8679-41d3-aa9d-19b3cea07be7-metrics-tls") pod "dns-default-lh5mf" (UID: "bf30ad74-8679-41d3-aa9d-19b3cea07be7") : secret "dns-default-metrics-tls" not found
Jul 18 01:48:29.338532 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:48:29.338461    2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-l28dd_44aa7f9e-049a-45bc-98bc-ff1d4309f5de/konnectivity-agent/0.log" limit=1024
Jul 18 01:48:29.438464 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:48:29.438425    2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-l28dd_44aa7f9e-049a-45bc-98bc-ff1d4309f5de/konnectivity-agent/0.log" limit=1024
Jul 18 01:48:31.486835 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:48:31.486794    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/bf30ad74-8679-41d3-aa9d-19b3cea07be7-metrics-tls\") pod \"dns-default-lh5mf\" (UID: \"bf30ad74-8679-41d3-aa9d-19b3cea07be7\") " pod="openshift-dns/dns-default-lh5mf"
Jul 18 01:48:31.487208 ip-10-0-142-238 kubenswrapper[2566]: E0718 01:48:31.486931    2566 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 18 01:48:31.487208 ip-10-0-142-238 kubenswrapper[2566]: E0718 01:48:31.487000    2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/bf30ad74-8679-41d3-aa9d-19b3cea07be7-metrics-tls podName:bf30ad74-8679-41d3-aa9d-19b3cea07be7 nodeName:}" failed. No retries permitted until 2026-07-18 01:48:39.486985173 +0000 UTC m=+51.175712598 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/bf30ad74-8679-41d3-aa9d-19b3cea07be7-metrics-tls") pod "dns-default-lh5mf" (UID: "bf30ad74-8679-41d3-aa9d-19b3cea07be7") : secret "dns-default-metrics-tls" not found
Jul 18 01:48:35.846525 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:48:35.846490    2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-diagnostics/network-check-source-7bc5b6bf85-nw297"]
Jul 18 01:48:35.879375 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:48:35.879350    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-7bc5b6bf85-nw297"]
Jul 18 01:48:35.879536 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:48:35.879384    2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-78cf4c6f6-thdcg"]
Jul 18 01:48:35.879536 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:48:35.879488    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-7bc5b6bf85-nw297"
Jul 18 01:48:35.881932 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:48:35.881904    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"network-diagnostics-dockercfg-c66sz\""
Jul 18 01:48:35.903147 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:48:35.903128    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-78cf4c6f6-thdcg"]
Jul 18 01:48:35.903239 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:48:35.903155    2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-5cc4778d68-sk4t6"]
Jul 18 01:48:35.903239 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:48:35.903231    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-78cf4c6f6-thdcg"
Jul 18 01:48:35.906183 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:48:35.906164    2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"openshift-service-ca.crt\""
Jul 18 01:48:35.906295 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:48:35.906232    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-storage-operator\"/\"volume-data-source-validator-dockercfg-pxlx9\""
Jul 18 01:48:35.906295 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:48:35.906249    2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"kube-root-ca.crt\""
Jul 18 01:48:35.912156 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:48:35.912113    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tjj94\" (UniqueName: \"kubernetes.io/projected/4b63949b-c2fa-49b9-92c4-98cf185a403e-kube-api-access-tjj94\") pod \"network-check-source-7bc5b6bf85-nw297\" (UID: \"4b63949b-c2fa-49b9-92c4-98cf185a403e\") " pod="openshift-network-diagnostics/network-check-source-7bc5b6bf85-nw297"
Jul 18 01:48:35.912156 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:48:35.912156    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-n4dg8\" (UniqueName: \"kubernetes.io/projected/01816298-697d-4189-96fd-d961c5e530ac-kube-api-access-n4dg8\") pod \"volume-data-source-validator-78cf4c6f6-thdcg\" (UID: \"01816298-697d-4189-96fd-d961c5e530ac\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-78cf4c6f6-thdcg"
Jul 18 01:48:35.924996 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:48:35.924976    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-5cc4778d68-sk4t6"]
Jul 18 01:48:35.925092 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:48:35.925060    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-5cc4778d68-sk4t6"
Jul 18 01:48:35.927971 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:48:35.927953    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-66smx\""
Jul 18 01:48:35.928062 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:48:35.927984    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\""
Jul 18 01:48:35.928566 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:48:35.928524    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\""
Jul 18 01:48:35.928825 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:48:35.928808    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\""
Jul 18 01:48:35.935138 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:48:35.935119    2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\""
Jul 18 01:48:35.960004 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:48:35.959979    2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-operator-555d9d7885-d2pwt"]
Jul 18 01:48:35.979017 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:48:35.978999    2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-hd8cg"]
Jul 18 01:48:35.979161 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:48:35.979139    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-555d9d7885-d2pwt"
Jul 18 01:48:35.981470 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:48:35.981453    2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\""
Jul 18 01:48:35.981564 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:48:35.981453    2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\""
Jul 18 01:48:35.981753 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:48:35.981737    2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"service-ca-bundle\""
Jul 18 01:48:35.981870 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:48:35.981855    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"operator-dockercfg-bvlwz\""
Jul 18 01:48:35.981941 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:48:35.981889    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"openshift-insights-serving-cert\""
Jul 18 01:48:35.987559 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:48:35.987534    2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"trusted-ca-bundle\""
Jul 18 01:48:36.005107 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:48:36.005086    2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/router-default-57ff4ffb64-8n2hs"]
Jul 18 01:48:36.005227 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:48:36.005213    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-hd8cg"
Jul 18 01:48:36.007337 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:48:36.007321    2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"openshift-service-ca.crt\""
Jul 18 01:48:36.007337 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:48:36.007331    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"samples-operator-tls\""
Jul 18 01:48:36.007554 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:48:36.007541    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"cluster-samples-operator-dockercfg-pqdc5\""
Jul 18 01:48:36.007679 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:48:36.007602    2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"kube-root-ca.crt\""
Jul 18 01:48:36.012548 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:48:36.012532    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-n4dg8\" (UniqueName: \"kubernetes.io/projected/01816298-697d-4189-96fd-d961c5e530ac-kube-api-access-n4dg8\") pod \"volume-data-source-validator-78cf4c6f6-thdcg\" (UID: \"01816298-697d-4189-96fd-d961c5e530ac\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-78cf4c6f6-thdcg"
Jul 18 01:48:36.012644 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:48:36.012557    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/276db0cf-ad20-45dc-b0a4-53079f105793-trusted-ca\") pod \"image-registry-5cc4778d68-sk4t6\" (UID: \"276db0cf-ad20-45dc-b0a4-53079f105793\") " pod="openshift-image-registry/image-registry-5cc4778d68-sk4t6"
Jul 18 01:48:36.012644 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:48:36.012574    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/276db0cf-ad20-45dc-b0a4-53079f105793-installation-pull-secrets\") pod \"image-registry-5cc4778d68-sk4t6\" (UID: \"276db0cf-ad20-45dc-b0a4-53079f105793\") " pod="openshift-image-registry/image-registry-5cc4778d68-sk4t6"
Jul 18 01:48:36.012644 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:48:36.012593    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/efcaba5e-5f68-4e32-9930-0e11bc9f9363-trusted-ca-bundle\") pod \"insights-operator-555d9d7885-d2pwt\" (UID: \"efcaba5e-5f68-4e32-9930-0e11bc9f9363\") " pod="openshift-insights/insights-operator-555d9d7885-d2pwt"
Jul 18 01:48:36.012766 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:48:36.012658    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/efcaba5e-5f68-4e32-9930-0e11bc9f9363-serving-cert\") pod \"insights-operator-555d9d7885-d2pwt\" (UID: \"efcaba5e-5f68-4e32-9930-0e11bc9f9363\") " pod="openshift-insights/insights-operator-555d9d7885-d2pwt"
Jul 18 01:48:36.012766 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:48:36.012743    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/efcaba5e-5f68-4e32-9930-0e11bc9f9363-tmp\") pod \"insights-operator-555d9d7885-d2pwt\" (UID: \"efcaba5e-5f68-4e32-9930-0e11bc9f9363\") " pod="openshift-insights/insights-operator-555d9d7885-d2pwt"
Jul 18 01:48:36.012835 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:48:36.012770    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/efcaba5e-5f68-4e32-9930-0e11bc9f9363-snapshots\") pod \"insights-operator-555d9d7885-d2pwt\" (UID: \"efcaba5e-5f68-4e32-9930-0e11bc9f9363\") " pod="openshift-insights/insights-operator-555d9d7885-d2pwt"
Jul 18 01:48:36.012835 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:48:36.012792    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fv9dq\" (UniqueName: \"kubernetes.io/projected/efcaba5e-5f68-4e32-9930-0e11bc9f9363-kube-api-access-fv9dq\") pod \"insights-operator-555d9d7885-d2pwt\" (UID: \"efcaba5e-5f68-4e32-9930-0e11bc9f9363\") " pod="openshift-insights/insights-operator-555d9d7885-d2pwt"
Jul 18 01:48:36.012835 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:48:36.012824    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tjj94\" (UniqueName: \"kubernetes.io/projected/4b63949b-c2fa-49b9-92c4-98cf185a403e-kube-api-access-tjj94\") pod \"network-check-source-7bc5b6bf85-nw297\" (UID: \"4b63949b-c2fa-49b9-92c4-98cf185a403e\") " pod="openshift-network-diagnostics/network-check-source-7bc5b6bf85-nw297"
Jul 18 01:48:36.012952 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:48:36.012871    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rrf2f\" (UniqueName: \"kubernetes.io/projected/276db0cf-ad20-45dc-b0a4-53079f105793-kube-api-access-rrf2f\") pod \"image-registry-5cc4778d68-sk4t6\" (UID: \"276db0cf-ad20-45dc-b0a4-53079f105793\") " pod="openshift-image-registry/image-registry-5cc4778d68-sk4t6"
Jul 18 01:48:36.012952 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:48:36.012920    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/efcaba5e-5f68-4e32-9930-0e11bc9f9363-service-ca-bundle\") pod \"insights-operator-555d9d7885-d2pwt\" (UID: \"efcaba5e-5f68-4e32-9930-0e11bc9f9363\") " pod="openshift-insights/insights-operator-555d9d7885-d2pwt"
Jul 18 01:48:36.013041 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:48:36.012949    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/6837ebbd-e9f4-401f-88a3-ab11bc740ba8-samples-operator-tls\") pod \"cluster-samples-operator-79b7c55f87-hd8cg\" (UID: \"6837ebbd-e9f4-401f-88a3-ab11bc740ba8\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-hd8cg"
Jul 18 01:48:36.013041 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:48:36.012979    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-m2jfj\" (UniqueName: \"kubernetes.io/projected/6837ebbd-e9f4-401f-88a3-ab11bc740ba8-kube-api-access-m2jfj\") pod \"cluster-samples-operator-79b7c55f87-hd8cg\" (UID: \"6837ebbd-e9f4-401f-88a3-ab11bc740ba8\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-hd8cg"
Jul 18 01:48:36.013041 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:48:36.013009    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/276db0cf-ad20-45dc-b0a4-53079f105793-image-registry-private-configuration\") pod \"image-registry-5cc4778d68-sk4t6\" (UID: \"276db0cf-ad20-45dc-b0a4-53079f105793\") " pod="openshift-image-registry/image-registry-5cc4778d68-sk4t6"
Jul 18 01:48:36.013183 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:48:36.013056    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/276db0cf-ad20-45dc-b0a4-53079f105793-registry-certificates\") pod \"image-registry-5cc4778d68-sk4t6\" (UID: \"276db0cf-ad20-45dc-b0a4-53079f105793\") " pod="openshift-image-registry/image-registry-5cc4778d68-sk4t6"
Jul 18 01:48:36.013183 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:48:36.013087    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/276db0cf-ad20-45dc-b0a4-53079f105793-bound-sa-token\") pod \"image-registry-5cc4778d68-sk4t6\" (UID: \"276db0cf-ad20-45dc-b0a4-53079f105793\") " pod="openshift-image-registry/image-registry-5cc4778d68-sk4t6"
Jul 18 01:48:36.013183 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:48:36.013134    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/276db0cf-ad20-45dc-b0a4-53079f105793-registry-tls\") pod \"image-registry-5cc4778d68-sk4t6\" (UID: \"276db0cf-ad20-45dc-b0a4-53079f105793\") " pod="openshift-image-registry/image-registry-5cc4778d68-sk4t6"
Jul 18 01:48:36.013183 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:48:36.013163    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/276db0cf-ad20-45dc-b0a4-53079f105793-ca-trust-extracted\") pod \"image-registry-5cc4778d68-sk4t6\" (UID: \"276db0cf-ad20-45dc-b0a4-53079f105793\") " pod="openshift-image-registry/image-registry-5cc4778d68-sk4t6"
Jul 18 01:48:36.022518 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:48:36.022497    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tjj94\" (UniqueName: \"kubernetes.io/projected/4b63949b-c2fa-49b9-92c4-98cf185a403e-kube-api-access-tjj94\") pod \"network-check-source-7bc5b6bf85-nw297\" (UID: \"4b63949b-c2fa-49b9-92c4-98cf185a403e\") " pod="openshift-network-diagnostics/network-check-source-7bc5b6bf85-nw297"
Jul 18 01:48:36.022653 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:48:36.022633    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-n4dg8\" (UniqueName: \"kubernetes.io/projected/01816298-697d-4189-96fd-d961c5e530ac-kube-api-access-n4dg8\") pod \"volume-data-source-validator-78cf4c6f6-thdcg\" (UID: \"01816298-697d-4189-96fd-d961c5e530ac\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-78cf4c6f6-thdcg"
Jul 18 01:48:36.023138 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:48:36.023124    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-hd8cg"]
Jul 18 01:48:36.023172 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:48:36.023158    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-555d9d7885-d2pwt"]
Jul 18 01:48:36.023172 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:48:36.023171    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-57ff4ffb64-8n2hs"]
Jul 18 01:48:36.023262 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:48:36.023245    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-57ff4ffb64-8n2hs"
Jul 18 01:48:36.025571 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:48:36.025551    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-dockercfg-d5qhg\""
Jul 18 01:48:36.025692 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:48:36.025603    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-metrics-certs-default\""
Jul 18 01:48:36.025824 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:48:36.025811    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-stats-default\""
Jul 18 01:48:36.025891 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:48:36.025821    2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\""
Jul 18 01:48:36.025945 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:48:36.025889    2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"service-ca-bundle\""
Jul 18 01:48:36.025945 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:48:36.025934    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"default-ingress-cert\""
Jul 18 01:48:36.026144 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:48:36.026094    2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\""
Jul 18 01:48:36.059233 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:48:36.059211    2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-zldws"]
Jul 18 01:48:36.083380 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:48:36.083360    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-zldws"
Jul 18 01:48:36.083483 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:48:36.083366    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-zldws"]
Jul 18 01:48:36.085681 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:48:36.085664    2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"openshift-service-ca.crt\""
Jul 18 01:48:36.085819 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:48:36.085801    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"serving-cert\""
Jul 18 01:48:36.085887 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:48:36.085803    2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-root-ca.crt\""
Jul 18 01:48:36.086373 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:48:36.086288    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-storage-version-migrator-operator-dockercfg-hjn5g\""
Jul 18 01:48:36.086373 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:48:36.086328    2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"config\""
Jul 18 01:48:36.113852 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:48:36.113805    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/276db0cf-ad20-45dc-b0a4-53079f105793-image-registry-private-configuration\") pod \"image-registry-5cc4778d68-sk4t6\" (UID: \"276db0cf-ad20-45dc-b0a4-53079f105793\") " pod="openshift-image-registry/image-registry-5cc4778d68-sk4t6"
Jul 18 01:48:36.113852 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:48:36.113835    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/f34b225d-0b2f-474f-9b87-40443dba791b-stats-auth\") pod \"router-default-57ff4ffb64-8n2hs\" (UID: \"f34b225d-0b2f-474f-9b87-40443dba791b\") " pod="openshift-ingress/router-default-57ff4ffb64-8n2hs"
Jul 18 01:48:36.113852 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:48:36.113852    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/26d03adb-3892-4d46-a693-735f83aee367-serving-cert\") pod \"kube-storage-version-migrator-operator-7658d9b749-zldws\" (UID: \"26d03adb-3892-4d46-a693-735f83aee367\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-zldws"
Jul 18 01:48:36.114040 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:48:36.113879    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/276db0cf-ad20-45dc-b0a4-53079f105793-registry-certificates\") pod \"image-registry-5cc4778d68-sk4t6\" (UID: \"276db0cf-ad20-45dc-b0a4-53079f105793\") " pod="openshift-image-registry/image-registry-5cc4778d68-sk4t6"
Jul 18 01:48:36.114040 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:48:36.113894    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/276db0cf-ad20-45dc-b0a4-53079f105793-bound-sa-token\") pod \"image-registry-5cc4778d68-sk4t6\" (UID: \"276db0cf-ad20-45dc-b0a4-53079f105793\") " pod="openshift-image-registry/image-registry-5cc4778d68-sk4t6"
Jul 18 01:48:36.114040 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:48:36.113940    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/276db0cf-ad20-45dc-b0a4-53079f105793-ca-trust-extracted\") pod \"image-registry-5cc4778d68-sk4t6\" (UID: \"276db0cf-ad20-45dc-b0a4-53079f105793\") " pod="openshift-image-registry/image-registry-5cc4778d68-sk4t6"
Jul 18 01:48:36.114040 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:48:36.113975    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/276db0cf-ad20-45dc-b0a4-53079f105793-trusted-ca\") pod \"image-registry-5cc4778d68-sk4t6\" (UID: \"276db0cf-ad20-45dc-b0a4-53079f105793\") " pod="openshift-image-registry/image-registry-5cc4778d68-sk4t6"
Jul 18 01:48:36.114040 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:48:36.113992    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/276db0cf-ad20-45dc-b0a4-53079f105793-installation-pull-secrets\") pod \"image-registry-5cc4778d68-sk4t6\" (UID: \"276db0cf-ad20-45dc-b0a4-53079f105793\") " pod="openshift-image-registry/image-registry-5cc4778d68-sk4t6"
Jul 18 01:48:36.114040 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:48:36.114021    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-slgzx\" (UniqueName: \"kubernetes.io/projected/f34b225d-0b2f-474f-9b87-40443dba791b-kube-api-access-slgzx\") pod \"router-default-57ff4ffb64-8n2hs\" (UID: \"f34b225d-0b2f-474f-9b87-40443dba791b\") " pod="openshift-ingress/router-default-57ff4ffb64-8n2hs"
Jul 18 01:48:36.114319 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:48:36.114148    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f34b225d-0b2f-474f-9b87-40443dba791b-metrics-certs\") pod \"router-default-57ff4ffb64-8n2hs\" (UID: \"f34b225d-0b2f-474f-9b87-40443dba791b\") " pod="openshift-ingress/router-default-57ff4ffb64-8n2hs"
Jul 18 01:48:36.114319 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:48:36.114241    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f34b225d-0b2f-474f-9b87-40443dba791b-service-ca-bundle\") pod \"router-default-57ff4ffb64-8n2hs\" (UID: \"f34b225d-0b2f-474f-9b87-40443dba791b\") " pod="openshift-ingress/router-default-57ff4ffb64-8n2hs"
Jul 18 01:48:36.114319 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:48:36.114292    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rrf2f\" (UniqueName: \"kubernetes.io/projected/276db0cf-ad20-45dc-b0a4-53079f105793-kube-api-access-rrf2f\") pod \"image-registry-5cc4778d68-sk4t6\" (UID: \"276db0cf-ad20-45dc-b0a4-53079f105793\") " pod="openshift-image-registry/image-registry-5cc4778d68-sk4t6"
Jul 18 01:48:36.114463 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:48:36.114418    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/efcaba5e-5f68-4e32-9930-0e11bc9f9363-tmp\") pod \"insights-operator-555d9d7885-d2pwt\" (UID: \"efcaba5e-5f68-4e32-9930-0e11bc9f9363\") " pod="openshift-insights/insights-operator-555d9d7885-d2pwt"
Jul 18 01:48:36.114463 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:48:36.114449    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/6837ebbd-e9f4-401f-88a3-ab11bc740ba8-samples-operator-tls\") pod \"cluster-samples-operator-79b7c55f87-hd8cg\" (UID: \"6837ebbd-e9f4-401f-88a3-ab11bc740ba8\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-hd8cg"
Jul 18 01:48:36.114554 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:48:36.114471    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/276db0cf-ad20-45dc-b0a4-53079f105793-ca-trust-extracted\") pod \"image-registry-5cc4778d68-sk4t6\" (UID: \"276db0cf-ad20-45dc-b0a4-53079f105793\") " pod="openshift-image-registry/image-registry-5cc4778d68-sk4t6"
Jul 18 01:48:36.114554 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:48:36.114485    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fv9dq\" (UniqueName: \"kubernetes.io/projected/efcaba5e-5f68-4e32-9930-0e11bc9f9363-kube-api-access-fv9dq\") pod \"insights-operator-555d9d7885-d2pwt\" (UID: \"efcaba5e-5f68-4e32-9930-0e11bc9f9363\") " pod="openshift-insights/insights-operator-555d9d7885-d2pwt"
Jul 18 01:48:36.114554 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:48:36.114520    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-m2jfj\" (UniqueName: \"kubernetes.io/projected/6837ebbd-e9f4-401f-88a3-ab11bc740ba8-kube-api-access-m2jfj\") pod \"cluster-samples-operator-79b7c55f87-hd8cg\" (UID: \"6837ebbd-e9f4-401f-88a3-ab11bc740ba8\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-hd8cg"
Jul 18 01:48:36.114554 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:48:36.114548    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/26d03adb-3892-4d46-a693-735f83aee367-config\") pod \"kube-storage-version-migrator-operator-7658d9b749-zldws\" (UID: \"26d03adb-3892-4d46-a693-735f83aee367\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-zldws"
Jul 18 01:48:36.114773 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:48:36.114558    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/276db0cf-ad20-45dc-b0a4-53079f105793-registry-certificates\") pod \"image-registry-5cc4778d68-sk4t6\" (UID: \"276db0cf-ad20-45dc-b0a4-53079f105793\") " pod="openshift-image-registry/image-registry-5cc4778d68-sk4t6"
Jul 18 01:48:36.114773 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:48:36.114582    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/f34b225d-0b2f-474f-9b87-40443dba791b-default-certificate\") pod \"router-default-57ff4ffb64-8n2hs\" (UID: \"f34b225d-0b2f-474f-9b87-40443dba791b\") " pod="openshift-ingress/router-default-57ff4ffb64-8n2hs"
Jul 18 01:48:36.114773 ip-10-0-142-238 kubenswrapper[2566]: E0718 01:48:36.114564    2566 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Jul 18 01:48:36.114773 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:48:36.114645    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xcl9w\" (UniqueName: \"kubernetes.io/projected/26d03adb-3892-4d46-a693-735f83aee367-kube-api-access-xcl9w\") pod \"kube-storage-version-migrator-operator-7658d9b749-zldws\" (UID: \"26d03adb-3892-4d46-a693-735f83aee367\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-zldws"
Jul 18 01:48:36.114773 ip-10-0-142-238 kubenswrapper[2566]: E0718 01:48:36.114683    2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6837ebbd-e9f4-401f-88a3-ab11bc740ba8-samples-operator-tls podName:6837ebbd-e9f4-401f-88a3-ab11bc740ba8 nodeName:}" failed. No retries permitted until 2026-07-18 01:48:36.614667131 +0000 UTC m=+48.303394560 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/6837ebbd-e9f4-401f-88a3-ab11bc740ba8-samples-operator-tls") pod "cluster-samples-operator-79b7c55f87-hd8cg" (UID: "6837ebbd-e9f4-401f-88a3-ab11bc740ba8") : secret "samples-operator-tls" not found
Jul 18 01:48:36.114773 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:48:36.114700    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/276db0cf-ad20-45dc-b0a4-53079f105793-registry-tls\") pod \"image-registry-5cc4778d68-sk4t6\" (UID: \"276db0cf-ad20-45dc-b0a4-53079f105793\") " pod="openshift-image-registry/image-registry-5cc4778d68-sk4t6"
Jul 18 01:48:36.114773 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:48:36.114734    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/efcaba5e-5f68-4e32-9930-0e11bc9f9363-trusted-ca-bundle\") pod \"insights-operator-555d9d7885-d2pwt\" (UID: \"efcaba5e-5f68-4e32-9930-0e11bc9f9363\") " pod="openshift-insights/insights-operator-555d9d7885-d2pwt"
Jul 18 01:48:36.114773 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:48:36.114756    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/efcaba5e-5f68-4e32-9930-0e11bc9f9363-serving-cert\") pod \"insights-operator-555d9d7885-d2pwt\" (UID: \"efcaba5e-5f68-4e32-9930-0e11bc9f9363\") " pod="openshift-insights/insights-operator-555d9d7885-d2pwt"
Jul 18 01:48:36.115102 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:48:36.114821    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/efcaba5e-5f68-4e32-9930-0e11bc9f9363-snapshots\") pod \"insights-operator-555d9d7885-d2pwt\" (UID: \"efcaba5e-5f68-4e32-9930-0e11bc9f9363\") " pod="openshift-insights/insights-operator-555d9d7885-d2pwt"
Jul 18 01:48:36.115102 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:48:36.114829    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/efcaba5e-5f68-4e32-9930-0e11bc9f9363-tmp\") pod \"insights-operator-555d9d7885-d2pwt\" (UID: \"efcaba5e-5f68-4e32-9930-0e11bc9f9363\") " pod="openshift-insights/insights-operator-555d9d7885-d2pwt"
Jul 18 01:48:36.115102 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:48:36.114845    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/efcaba5e-5f68-4e32-9930-0e11bc9f9363-service-ca-bundle\") pod \"insights-operator-555d9d7885-d2pwt\" (UID: \"efcaba5e-5f68-4e32-9930-0e11bc9f9363\") " pod="openshift-insights/insights-operator-555d9d7885-d2pwt"
Jul 18 01:48:36.115102 ip-10-0-142-238 kubenswrapper[2566]: E0718 01:48:36.114850    2566 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 18 01:48:36.115102 ip-10-0-142-238 kubenswrapper[2566]: E0718 01:48:36.114867    2566 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-5cc4778d68-sk4t6: secret "image-registry-tls" not found
Jul 18 01:48:36.115102 ip-10-0-142-238 kubenswrapper[2566]: E0718 01:48:36.114898    2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/276db0cf-ad20-45dc-b0a4-53079f105793-registry-tls podName:276db0cf-ad20-45dc-b0a4-53079f105793 nodeName:}" failed. No retries permitted until 2026-07-18 01:48:36.614887792 +0000 UTC m=+48.303615220 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/276db0cf-ad20-45dc-b0a4-53079f105793-registry-tls") pod "image-registry-5cc4778d68-sk4t6" (UID: "276db0cf-ad20-45dc-b0a4-53079f105793") : secret "image-registry-tls" not found
Jul 18 01:48:36.115102 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:48:36.114989    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/276db0cf-ad20-45dc-b0a4-53079f105793-trusted-ca\") pod \"image-registry-5cc4778d68-sk4t6\" (UID: \"276db0cf-ad20-45dc-b0a4-53079f105793\") " pod="openshift-image-registry/image-registry-5cc4778d68-sk4t6"
Jul 18 01:48:36.115401 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:48:36.115344    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/efcaba5e-5f68-4e32-9930-0e11bc9f9363-service-ca-bundle\") pod \"insights-operator-555d9d7885-d2pwt\" (UID: \"efcaba5e-5f68-4e32-9930-0e11bc9f9363\") " pod="openshift-insights/insights-operator-555d9d7885-d2pwt"
Jul 18 01:48:36.115401 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:48:36.115386    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/efcaba5e-5f68-4e32-9930-0e11bc9f9363-snapshots\") pod \"insights-operator-555d9d7885-d2pwt\" (UID: \"efcaba5e-5f68-4e32-9930-0e11bc9f9363\") " pod="openshift-insights/insights-operator-555d9d7885-d2pwt"
Jul 18 01:48:36.115491 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:48:36.115433    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/efcaba5e-5f68-4e32-9930-0e11bc9f9363-trusted-ca-bundle\") pod \"insights-operator-555d9d7885-d2pwt\" (UID: \"efcaba5e-5f68-4e32-9930-0e11bc9f9363\") " pod="openshift-insights/insights-operator-555d9d7885-d2pwt"
Jul 18 01:48:36.116488 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:48:36.116463    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/276db0cf-ad20-45dc-b0a4-53079f105793-image-registry-private-configuration\") pod \"image-registry-5cc4778d68-sk4t6\" (UID: \"276db0cf-ad20-45dc-b0a4-53079f105793\") " pod="openshift-image-registry/image-registry-5cc4778d68-sk4t6"
Jul 18 01:48:36.116984 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:48:36.116963    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/276db0cf-ad20-45dc-b0a4-53079f105793-installation-pull-secrets\") pod \"image-registry-5cc4778d68-sk4t6\" (UID: \"276db0cf-ad20-45dc-b0a4-53079f105793\") " pod="openshift-image-registry/image-registry-5cc4778d68-sk4t6"
Jul 18 01:48:36.117499 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:48:36.117481    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/efcaba5e-5f68-4e32-9930-0e11bc9f9363-serving-cert\") pod \"insights-operator-555d9d7885-d2pwt\" (UID: \"efcaba5e-5f68-4e32-9930-0e11bc9f9363\") " pod="openshift-insights/insights-operator-555d9d7885-d2pwt"
Jul 18 01:48:36.121557 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:48:36.121526    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/276db0cf-ad20-45dc-b0a4-53079f105793-bound-sa-token\") pod \"image-registry-5cc4778d68-sk4t6\" (UID: \"276db0cf-ad20-45dc-b0a4-53079f105793\") " pod="openshift-image-registry/image-registry-5cc4778d68-sk4t6"
Jul 18 01:48:36.123557 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:48:36.123535    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-m2jfj\" (UniqueName: \"kubernetes.io/projected/6837ebbd-e9f4-401f-88a3-ab11bc740ba8-kube-api-access-m2jfj\") pod \"cluster-samples-operator-79b7c55f87-hd8cg\" (UID: \"6837ebbd-e9f4-401f-88a3-ab11bc740ba8\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-hd8cg"
Jul 18 01:48:36.123728 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:48:36.123710    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fv9dq\" (UniqueName: \"kubernetes.io/projected/efcaba5e-5f68-4e32-9930-0e11bc9f9363-kube-api-access-fv9dq\") pod \"insights-operator-555d9d7885-d2pwt\" (UID: \"efcaba5e-5f68-4e32-9930-0e11bc9f9363\") " pod="openshift-insights/insights-operator-555d9d7885-d2pwt"
Jul 18 01:48:36.123790 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:48:36.123770    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rrf2f\" (UniqueName: \"kubernetes.io/projected/276db0cf-ad20-45dc-b0a4-53079f105793-kube-api-access-rrf2f\") pod \"image-registry-5cc4778d68-sk4t6\" (UID: \"276db0cf-ad20-45dc-b0a4-53079f105793\") " pod="openshift-image-registry/image-registry-5cc4778d68-sk4t6"
Jul 18 01:48:36.126163 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:48:36.126144    2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-l28dd_44aa7f9e-049a-45bc-98bc-ff1d4309f5de/konnectivity-agent/0.log" limit=1024
Jul 18 01:48:36.188671 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:48:36.188649    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-7bc5b6bf85-nw297"
Jul 18 01:48:36.211830 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:48:36.211809    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-78cf4c6f6-thdcg"
Jul 18 01:48:36.215159 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:48:36.215143    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/f34b225d-0b2f-474f-9b87-40443dba791b-stats-auth\") pod \"router-default-57ff4ffb64-8n2hs\" (UID: \"f34b225d-0b2f-474f-9b87-40443dba791b\") " pod="openshift-ingress/router-default-57ff4ffb64-8n2hs"
Jul 18 01:48:36.215258 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:48:36.215171    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/26d03adb-3892-4d46-a693-735f83aee367-serving-cert\") pod \"kube-storage-version-migrator-operator-7658d9b749-zldws\" (UID: \"26d03adb-3892-4d46-a693-735f83aee367\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-zldws"
Jul 18 01:48:36.215258 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:48:36.215222    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-slgzx\" (UniqueName: \"kubernetes.io/projected/f34b225d-0b2f-474f-9b87-40443dba791b-kube-api-access-slgzx\") pod \"router-default-57ff4ffb64-8n2hs\" (UID: \"f34b225d-0b2f-474f-9b87-40443dba791b\") " pod="openshift-ingress/router-default-57ff4ffb64-8n2hs"
Jul 18 01:48:36.215258 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:48:36.215248    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f34b225d-0b2f-474f-9b87-40443dba791b-metrics-certs\") pod \"router-default-57ff4ffb64-8n2hs\" (UID: \"f34b225d-0b2f-474f-9b87-40443dba791b\") " pod="openshift-ingress/router-default-57ff4ffb64-8n2hs"
Jul 18 01:48:36.215401 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:48:36.215275    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f34b225d-0b2f-474f-9b87-40443dba791b-service-ca-bundle\") pod \"router-default-57ff4ffb64-8n2hs\" (UID: \"f34b225d-0b2f-474f-9b87-40443dba791b\") " pod="openshift-ingress/router-default-57ff4ffb64-8n2hs"
Jul 18 01:48:36.215401 ip-10-0-142-238 kubenswrapper[2566]: E0718 01:48:36.215336    2566 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Jul 18 01:48:36.215401 ip-10-0-142-238 kubenswrapper[2566]: E0718 01:48:36.215387    2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f34b225d-0b2f-474f-9b87-40443dba791b-metrics-certs podName:f34b225d-0b2f-474f-9b87-40443dba791b nodeName:}" failed. No retries permitted until 2026-07-18 01:48:36.715373212 +0000 UTC m=+48.404100638 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/f34b225d-0b2f-474f-9b87-40443dba791b-metrics-certs") pod "router-default-57ff4ffb64-8n2hs" (UID: "f34b225d-0b2f-474f-9b87-40443dba791b") : secret "router-metrics-certs-default" not found
Jul 18 01:48:36.215553 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:48:36.215338    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/26d03adb-3892-4d46-a693-735f83aee367-config\") pod \"kube-storage-version-migrator-operator-7658d9b749-zldws\" (UID: \"26d03adb-3892-4d46-a693-735f83aee367\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-zldws"
Jul 18 01:48:36.215553 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:48:36.215447    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/f34b225d-0b2f-474f-9b87-40443dba791b-default-certificate\") pod \"router-default-57ff4ffb64-8n2hs\" (UID: \"f34b225d-0b2f-474f-9b87-40443dba791b\") " pod="openshift-ingress/router-default-57ff4ffb64-8n2hs"
Jul 18 01:48:36.215553 ip-10-0-142-238 kubenswrapper[2566]: E0718 01:48:36.215461    2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/f34b225d-0b2f-474f-9b87-40443dba791b-service-ca-bundle podName:f34b225d-0b2f-474f-9b87-40443dba791b nodeName:}" failed. No retries permitted until 2026-07-18 01:48:36.715440849 +0000 UTC m=+48.404168279 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/f34b225d-0b2f-474f-9b87-40443dba791b-service-ca-bundle") pod "router-default-57ff4ffb64-8n2hs" (UID: "f34b225d-0b2f-474f-9b87-40443dba791b") : configmap references non-existent config key: service-ca.crt
Jul 18 01:48:36.215553 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:48:36.215500    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xcl9w\" (UniqueName: \"kubernetes.io/projected/26d03adb-3892-4d46-a693-735f83aee367-kube-api-access-xcl9w\") pod \"kube-storage-version-migrator-operator-7658d9b749-zldws\" (UID: \"26d03adb-3892-4d46-a693-735f83aee367\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-zldws"
Jul 18 01:48:36.215855 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:48:36.215837    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/26d03adb-3892-4d46-a693-735f83aee367-config\") pod \"kube-storage-version-migrator-operator-7658d9b749-zldws\" (UID: \"26d03adb-3892-4d46-a693-735f83aee367\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-zldws"
Jul 18 01:48:36.217474 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:48:36.217458    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/f34b225d-0b2f-474f-9b87-40443dba791b-stats-auth\") pod \"router-default-57ff4ffb64-8n2hs\" (UID: \"f34b225d-0b2f-474f-9b87-40443dba791b\") " pod="openshift-ingress/router-default-57ff4ffb64-8n2hs"
Jul 18 01:48:36.217707 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:48:36.217688    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/26d03adb-3892-4d46-a693-735f83aee367-serving-cert\") pod \"kube-storage-version-migrator-operator-7658d9b749-zldws\" (UID: \"26d03adb-3892-4d46-a693-735f83aee367\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-zldws"
Jul 18 01:48:36.217860 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:48:36.217844    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/f34b225d-0b2f-474f-9b87-40443dba791b-default-certificate\") pod \"router-default-57ff4ffb64-8n2hs\" (UID: \"f34b225d-0b2f-474f-9b87-40443dba791b\") " pod="openshift-ingress/router-default-57ff4ffb64-8n2hs"
Jul 18 01:48:36.223778 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:48:36.223756    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xcl9w\" (UniqueName: \"kubernetes.io/projected/26d03adb-3892-4d46-a693-735f83aee367-kube-api-access-xcl9w\") pod \"kube-storage-version-migrator-operator-7658d9b749-zldws\" (UID: \"26d03adb-3892-4d46-a693-735f83aee367\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-zldws"
Jul 18 01:48:36.224162 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:48:36.224144    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-slgzx\" (UniqueName: \"kubernetes.io/projected/f34b225d-0b2f-474f-9b87-40443dba791b-kube-api-access-slgzx\") pod \"router-default-57ff4ffb64-8n2hs\" (UID: \"f34b225d-0b2f-474f-9b87-40443dba791b\") " pod="openshift-ingress/router-default-57ff4ffb64-8n2hs"
Jul 18 01:48:36.227398 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:48:36.227376    2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-l28dd_44aa7f9e-049a-45bc-98bc-ff1d4309f5de/konnectivity-agent/0.log" limit=1024
Jul 18 01:48:36.289023 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:48:36.288997    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-555d9d7885-d2pwt"
Jul 18 01:48:36.345399 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:48:36.345369    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-7bc5b6bf85-nw297"]
Jul 18 01:48:36.348501 ip-10-0-142-238 kubenswrapper[2566]: W0718 01:48:36.348463    2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4b63949b_c2fa_49b9_92c4_98cf185a403e.slice/crio-3eba039409c07447a25c7fc3240854bb9139f44558ff975f5bf5def0e2a98f0f WatchSource:0}: Error finding container 3eba039409c07447a25c7fc3240854bb9139f44558ff975f5bf5def0e2a98f0f: Status 404 returned error can't find the container with id 3eba039409c07447a25c7fc3240854bb9139f44558ff975f5bf5def0e2a98f0f
Jul 18 01:48:36.387830 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:48:36.387803    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-78cf4c6f6-thdcg"]
Jul 18 01:48:36.390392 ip-10-0-142-238 kubenswrapper[2566]: W0718 01:48:36.390366    2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod01816298_697d_4189_96fd_d961c5e530ac.slice/crio-327e4370105c91ded3be48568c7d04e6206735ab32769a0d5a5d52c04583b758 WatchSource:0}: Error finding container 327e4370105c91ded3be48568c7d04e6206735ab32769a0d5a5d52c04583b758: Status 404 returned error can't find the container with id 327e4370105c91ded3be48568c7d04e6206735ab32769a0d5a5d52c04583b758
Jul 18 01:48:36.392502 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:48:36.392480    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-zldws"
Jul 18 01:48:36.437800 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:48:36.437773    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-555d9d7885-d2pwt"]
Jul 18 01:48:36.440825 ip-10-0-142-238 kubenswrapper[2566]: W0718 01:48:36.440786    2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podefcaba5e_5f68_4e32_9930_0e11bc9f9363.slice/crio-fbf724d7a5c1ebb22936e6a549cc163ed44eb72a4b742c47bd261c8561eb9da3 WatchSource:0}: Error finding container fbf724d7a5c1ebb22936e6a549cc163ed44eb72a4b742c47bd261c8561eb9da3: Status 404 returned error can't find the container with id fbf724d7a5c1ebb22936e6a549cc163ed44eb72a4b742c47bd261c8561eb9da3
Jul 18 01:48:36.538392 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:48:36.538370    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-zldws"]
Jul 18 01:48:36.540564 ip-10-0-142-238 kubenswrapper[2566]: W0718 01:48:36.540542    2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod26d03adb_3892_4d46_a693_735f83aee367.slice/crio-47863a9ffa3ca7247c5e47f3a9f41d3cbb791293b2c441c5d9d633c65c4f9175 WatchSource:0}: Error finding container 47863a9ffa3ca7247c5e47f3a9f41d3cbb791293b2c441c5d9d633c65c4f9175: Status 404 returned error can't find the container with id 47863a9ffa3ca7247c5e47f3a9f41d3cbb791293b2c441c5d9d633c65c4f9175
Jul 18 01:48:36.620292 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:48:36.620240    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/6837ebbd-e9f4-401f-88a3-ab11bc740ba8-samples-operator-tls\") pod \"cluster-samples-operator-79b7c55f87-hd8cg\" (UID: \"6837ebbd-e9f4-401f-88a3-ab11bc740ba8\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-hd8cg"
Jul 18 01:48:36.620292 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:48:36.620281    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/276db0cf-ad20-45dc-b0a4-53079f105793-registry-tls\") pod \"image-registry-5cc4778d68-sk4t6\" (UID: \"276db0cf-ad20-45dc-b0a4-53079f105793\") " pod="openshift-image-registry/image-registry-5cc4778d68-sk4t6"
Jul 18 01:48:36.620408 ip-10-0-142-238 kubenswrapper[2566]: E0718 01:48:36.620379    2566 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Jul 18 01:48:36.620440 ip-10-0-142-238 kubenswrapper[2566]: E0718 01:48:36.620411    2566 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 18 01:48:36.620440 ip-10-0-142-238 kubenswrapper[2566]: E0718 01:48:36.620420    2566 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-5cc4778d68-sk4t6: secret "image-registry-tls" not found
Jul 18 01:48:36.620440 ip-10-0-142-238 kubenswrapper[2566]: E0718 01:48:36.620435    2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6837ebbd-e9f4-401f-88a3-ab11bc740ba8-samples-operator-tls podName:6837ebbd-e9f4-401f-88a3-ab11bc740ba8 nodeName:}" failed. No retries permitted until 2026-07-18 01:48:37.620419247 +0000 UTC m=+49.309146673 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/6837ebbd-e9f4-401f-88a3-ab11bc740ba8-samples-operator-tls") pod "cluster-samples-operator-79b7c55f87-hd8cg" (UID: "6837ebbd-e9f4-401f-88a3-ab11bc740ba8") : secret "samples-operator-tls" not found
Jul 18 01:48:36.620529 ip-10-0-142-238 kubenswrapper[2566]: E0718 01:48:36.620452    2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/276db0cf-ad20-45dc-b0a4-53079f105793-registry-tls podName:276db0cf-ad20-45dc-b0a4-53079f105793 nodeName:}" failed. No retries permitted until 2026-07-18 01:48:37.620441613 +0000 UTC m=+49.309169038 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/276db0cf-ad20-45dc-b0a4-53079f105793-registry-tls") pod "image-registry-5cc4778d68-sk4t6" (UID: "276db0cf-ad20-45dc-b0a4-53079f105793") : secret "image-registry-tls" not found
Jul 18 01:48:36.721113 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:48:36.721089    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f34b225d-0b2f-474f-9b87-40443dba791b-metrics-certs\") pod \"router-default-57ff4ffb64-8n2hs\" (UID: \"f34b225d-0b2f-474f-9b87-40443dba791b\") " pod="openshift-ingress/router-default-57ff4ffb64-8n2hs"
Jul 18 01:48:36.721197 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:48:36.721117    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f34b225d-0b2f-474f-9b87-40443dba791b-service-ca-bundle\") pod \"router-default-57ff4ffb64-8n2hs\" (UID: \"f34b225d-0b2f-474f-9b87-40443dba791b\") " pod="openshift-ingress/router-default-57ff4ffb64-8n2hs"
Jul 18 01:48:36.721234 ip-10-0-142-238 kubenswrapper[2566]: E0718 01:48:36.721204    2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/f34b225d-0b2f-474f-9b87-40443dba791b-service-ca-bundle podName:f34b225d-0b2f-474f-9b87-40443dba791b nodeName:}" failed. No retries permitted until 2026-07-18 01:48:37.721193643 +0000 UTC m=+49.409921068 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/f34b225d-0b2f-474f-9b87-40443dba791b-service-ca-bundle") pod "router-default-57ff4ffb64-8n2hs" (UID: "f34b225d-0b2f-474f-9b87-40443dba791b") : configmap references non-existent config key: service-ca.crt
Jul 18 01:48:36.721234 ip-10-0-142-238 kubenswrapper[2566]: E0718 01:48:36.721210    2566 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Jul 18 01:48:36.721303 ip-10-0-142-238 kubenswrapper[2566]: E0718 01:48:36.721248    2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f34b225d-0b2f-474f-9b87-40443dba791b-metrics-certs podName:f34b225d-0b2f-474f-9b87-40443dba791b nodeName:}" failed. No retries permitted until 2026-07-18 01:48:37.72123839 +0000 UTC m=+49.409965820 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/f34b225d-0b2f-474f-9b87-40443dba791b-metrics-certs") pod "router-default-57ff4ffb64-8n2hs" (UID: "f34b225d-0b2f-474f-9b87-40443dba791b") : secret "router-metrics-certs-default" not found
Jul 18 01:48:37.065051 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:48:37.065015    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-zldws" event={"ID":"26d03adb-3892-4d46-a693-735f83aee367","Type":"ContainerStarted","Data":"47863a9ffa3ca7247c5e47f3a9f41d3cbb791293b2c441c5d9d633c65c4f9175"}
Jul 18 01:48:37.066414 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:48:37.066371    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-555d9d7885-d2pwt" event={"ID":"efcaba5e-5f68-4e32-9930-0e11bc9f9363","Type":"ContainerStarted","Data":"fbf724d7a5c1ebb22936e6a549cc163ed44eb72a4b742c47bd261c8561eb9da3"}
Jul 18 01:48:37.067793 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:48:37.067746    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-78cf4c6f6-thdcg" event={"ID":"01816298-697d-4189-96fd-d961c5e530ac","Type":"ContainerStarted","Data":"327e4370105c91ded3be48568c7d04e6206735ab32769a0d5a5d52c04583b758"}
Jul 18 01:48:37.068990 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:48:37.068960    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-7bc5b6bf85-nw297" event={"ID":"4b63949b-c2fa-49b9-92c4-98cf185a403e","Type":"ContainerStarted","Data":"3eba039409c07447a25c7fc3240854bb9139f44558ff975f5bf5def0e2a98f0f"}
Jul 18 01:48:37.630789 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:48:37.630752    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/6837ebbd-e9f4-401f-88a3-ab11bc740ba8-samples-operator-tls\") pod \"cluster-samples-operator-79b7c55f87-hd8cg\" (UID: \"6837ebbd-e9f4-401f-88a3-ab11bc740ba8\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-hd8cg"
Jul 18 01:48:37.630976 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:48:37.630825    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/276db0cf-ad20-45dc-b0a4-53079f105793-registry-tls\") pod \"image-registry-5cc4778d68-sk4t6\" (UID: \"276db0cf-ad20-45dc-b0a4-53079f105793\") " pod="openshift-image-registry/image-registry-5cc4778d68-sk4t6"
Jul 18 01:48:37.630976 ip-10-0-142-238 kubenswrapper[2566]: E0718 01:48:37.630966    2566 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 18 01:48:37.631092 ip-10-0-142-238 kubenswrapper[2566]: E0718 01:48:37.630981    2566 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-5cc4778d68-sk4t6: secret "image-registry-tls" not found
Jul 18 01:48:37.631092 ip-10-0-142-238 kubenswrapper[2566]: E0718 01:48:37.631036    2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/276db0cf-ad20-45dc-b0a4-53079f105793-registry-tls podName:276db0cf-ad20-45dc-b0a4-53079f105793 nodeName:}" failed. No retries permitted until 2026-07-18 01:48:39.63101895 +0000 UTC m=+51.319746380 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/276db0cf-ad20-45dc-b0a4-53079f105793-registry-tls") pod "image-registry-5cc4778d68-sk4t6" (UID: "276db0cf-ad20-45dc-b0a4-53079f105793") : secret "image-registry-tls" not found
Jul 18 01:48:37.631204 ip-10-0-142-238 kubenswrapper[2566]: E0718 01:48:37.631174    2566 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Jul 18 01:48:37.631254 ip-10-0-142-238 kubenswrapper[2566]: E0718 01:48:37.631218    2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6837ebbd-e9f4-401f-88a3-ab11bc740ba8-samples-operator-tls podName:6837ebbd-e9f4-401f-88a3-ab11bc740ba8 nodeName:}" failed. No retries permitted until 2026-07-18 01:48:39.631205371 +0000 UTC m=+51.319932800 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/6837ebbd-e9f4-401f-88a3-ab11bc740ba8-samples-operator-tls") pod "cluster-samples-operator-79b7c55f87-hd8cg" (UID: "6837ebbd-e9f4-401f-88a3-ab11bc740ba8") : secret "samples-operator-tls" not found
Jul 18 01:48:37.731978 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:48:37.731727    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f34b225d-0b2f-474f-9b87-40443dba791b-metrics-certs\") pod \"router-default-57ff4ffb64-8n2hs\" (UID: \"f34b225d-0b2f-474f-9b87-40443dba791b\") " pod="openshift-ingress/router-default-57ff4ffb64-8n2hs"
Jul 18 01:48:37.731978 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:48:37.731774    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f34b225d-0b2f-474f-9b87-40443dba791b-service-ca-bundle\") pod \"router-default-57ff4ffb64-8n2hs\" (UID: \"f34b225d-0b2f-474f-9b87-40443dba791b\") " pod="openshift-ingress/router-default-57ff4ffb64-8n2hs"
Jul 18 01:48:37.731978 ip-10-0-142-238 kubenswrapper[2566]: E0718 01:48:37.731890    2566 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Jul 18 01:48:37.731978 ip-10-0-142-238 kubenswrapper[2566]: E0718 01:48:37.731932    2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/f34b225d-0b2f-474f-9b87-40443dba791b-service-ca-bundle podName:f34b225d-0b2f-474f-9b87-40443dba791b nodeName:}" failed. No retries permitted until 2026-07-18 01:48:39.731914676 +0000 UTC m=+51.420642107 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/f34b225d-0b2f-474f-9b87-40443dba791b-service-ca-bundle") pod "router-default-57ff4ffb64-8n2hs" (UID: "f34b225d-0b2f-474f-9b87-40443dba791b") : configmap references non-existent config key: service-ca.crt
Jul 18 01:48:37.731978 ip-10-0-142-238 kubenswrapper[2566]: E0718 01:48:37.731954    2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f34b225d-0b2f-474f-9b87-40443dba791b-metrics-certs podName:f34b225d-0b2f-474f-9b87-40443dba791b nodeName:}" failed. No retries permitted until 2026-07-18 01:48:39.731942692 +0000 UTC m=+51.420670124 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/f34b225d-0b2f-474f-9b87-40443dba791b-metrics-certs") pod "router-default-57ff4ffb64-8n2hs" (UID: "f34b225d-0b2f-474f-9b87-40443dba791b") : secret "router-metrics-certs-default" not found
Jul 18 01:48:39.546471 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:48:39.546434    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/bf30ad74-8679-41d3-aa9d-19b3cea07be7-metrics-tls\") pod \"dns-default-lh5mf\" (UID: \"bf30ad74-8679-41d3-aa9d-19b3cea07be7\") " pod="openshift-dns/dns-default-lh5mf"
Jul 18 01:48:39.546933 ip-10-0-142-238 kubenswrapper[2566]: E0718 01:48:39.546566    2566 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 18 01:48:39.546933 ip-10-0-142-238 kubenswrapper[2566]: E0718 01:48:39.546653    2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/bf30ad74-8679-41d3-aa9d-19b3cea07be7-metrics-tls podName:bf30ad74-8679-41d3-aa9d-19b3cea07be7 nodeName:}" failed. No retries permitted until 2026-07-18 01:48:55.546634519 +0000 UTC m=+67.235361948 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/bf30ad74-8679-41d3-aa9d-19b3cea07be7-metrics-tls") pod "dns-default-lh5mf" (UID: "bf30ad74-8679-41d3-aa9d-19b3cea07be7") : secret "dns-default-metrics-tls" not found
Jul 18 01:48:39.647482 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:48:39.647438    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/6837ebbd-e9f4-401f-88a3-ab11bc740ba8-samples-operator-tls\") pod \"cluster-samples-operator-79b7c55f87-hd8cg\" (UID: \"6837ebbd-e9f4-401f-88a3-ab11bc740ba8\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-hd8cg"
Jul 18 01:48:39.647729 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:48:39.647525    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/276db0cf-ad20-45dc-b0a4-53079f105793-registry-tls\") pod \"image-registry-5cc4778d68-sk4t6\" (UID: \"276db0cf-ad20-45dc-b0a4-53079f105793\") " pod="openshift-image-registry/image-registry-5cc4778d68-sk4t6"
Jul 18 01:48:39.647729 ip-10-0-142-238 kubenswrapper[2566]: E0718 01:48:39.647559    2566 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Jul 18 01:48:39.647729 ip-10-0-142-238 kubenswrapper[2566]: E0718 01:48:39.647642    2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6837ebbd-e9f4-401f-88a3-ab11bc740ba8-samples-operator-tls podName:6837ebbd-e9f4-401f-88a3-ab11bc740ba8 nodeName:}" failed. No retries permitted until 2026-07-18 01:48:43.647604817 +0000 UTC m=+55.336332253 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/6837ebbd-e9f4-401f-88a3-ab11bc740ba8-samples-operator-tls") pod "cluster-samples-operator-79b7c55f87-hd8cg" (UID: "6837ebbd-e9f4-401f-88a3-ab11bc740ba8") : secret "samples-operator-tls" not found
Jul 18 01:48:39.647729 ip-10-0-142-238 kubenswrapper[2566]: E0718 01:48:39.647718    2566 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 18 01:48:39.647926 ip-10-0-142-238 kubenswrapper[2566]: E0718 01:48:39.647740    2566 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-5cc4778d68-sk4t6: secret "image-registry-tls" not found
Jul 18 01:48:39.647926 ip-10-0-142-238 kubenswrapper[2566]: E0718 01:48:39.647800    2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/276db0cf-ad20-45dc-b0a4-53079f105793-registry-tls podName:276db0cf-ad20-45dc-b0a4-53079f105793 nodeName:}" failed. No retries permitted until 2026-07-18 01:48:43.647782288 +0000 UTC m=+55.336509730 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/276db0cf-ad20-45dc-b0a4-53079f105793-registry-tls") pod "image-registry-5cc4778d68-sk4t6" (UID: "276db0cf-ad20-45dc-b0a4-53079f105793") : secret "image-registry-tls" not found
Jul 18 01:48:39.748136 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:48:39.748102    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f34b225d-0b2f-474f-9b87-40443dba791b-metrics-certs\") pod \"router-default-57ff4ffb64-8n2hs\" (UID: \"f34b225d-0b2f-474f-9b87-40443dba791b\") " pod="openshift-ingress/router-default-57ff4ffb64-8n2hs"
Jul 18 01:48:39.748353 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:48:39.748145    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f34b225d-0b2f-474f-9b87-40443dba791b-service-ca-bundle\") pod \"router-default-57ff4ffb64-8n2hs\" (UID: \"f34b225d-0b2f-474f-9b87-40443dba791b\") " pod="openshift-ingress/router-default-57ff4ffb64-8n2hs"
Jul 18 01:48:39.748353 ip-10-0-142-238 kubenswrapper[2566]: E0718 01:48:39.748266    2566 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Jul 18 01:48:39.748353 ip-10-0-142-238 kubenswrapper[2566]: E0718 01:48:39.748299    2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/f34b225d-0b2f-474f-9b87-40443dba791b-service-ca-bundle podName:f34b225d-0b2f-474f-9b87-40443dba791b nodeName:}" failed. No retries permitted until 2026-07-18 01:48:43.748286022 +0000 UTC m=+55.437013463 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/f34b225d-0b2f-474f-9b87-40443dba791b-service-ca-bundle") pod "router-default-57ff4ffb64-8n2hs" (UID: "f34b225d-0b2f-474f-9b87-40443dba791b") : configmap references non-existent config key: service-ca.crt
Jul 18 01:48:39.748353 ip-10-0-142-238 kubenswrapper[2566]: E0718 01:48:39.748333    2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f34b225d-0b2f-474f-9b87-40443dba791b-metrics-certs podName:f34b225d-0b2f-474f-9b87-40443dba791b nodeName:}" failed. No retries permitted until 2026-07-18 01:48:43.748313941 +0000 UTC m=+55.437041370 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/f34b225d-0b2f-474f-9b87-40443dba791b-metrics-certs") pod "router-default-57ff4ffb64-8n2hs" (UID: "f34b225d-0b2f-474f-9b87-40443dba791b") : secret "router-metrics-certs-default" not found
Jul 18 01:48:41.081643 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:48:41.081591    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-zldws" event={"ID":"26d03adb-3892-4d46-a693-735f83aee367","Type":"ContainerStarted","Data":"c239d610219c92488532033f369c7a9221af16e78c35cc3918f520080044b9c2"}
Jul 18 01:48:41.083115 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:48:41.083091    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-555d9d7885-d2pwt" event={"ID":"efcaba5e-5f68-4e32-9930-0e11bc9f9363","Type":"ContainerStarted","Data":"9287468a55d4cb1dd67510929f85d8490fe348d4901c0ee222620b01ca090944"}
Jul 18 01:48:41.084809 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:48:41.084783    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-78cf4c6f6-thdcg" event={"ID":"01816298-697d-4189-96fd-d961c5e530ac","Type":"ContainerStarted","Data":"1b2e38f629c2c5aafebc9a737b15e011ebf4175521017030ae5dfac9bd913f85"}
Jul 18 01:48:41.086509 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:48:41.086486    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-7bc5b6bf85-nw297" event={"ID":"4b63949b-c2fa-49b9-92c4-98cf185a403e","Type":"ContainerStarted","Data":"ada55a1fa9cf0ce461c8f4a95ec3f7e60f0d8510abe44cd0f0e1656ea3e9aa1b"}
Jul 18 01:48:41.098025 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:48:41.097986    2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-zldws" podStartSLOduration=1.084616957 podStartE2EDuration="5.097974079s" totalImagesPullingTime="4.013357122s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-18 01:48:36 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-18 01:48:41.096553241 +0000 UTC m=+52.785280690" watchObservedRunningTime="2026-07-18 01:48:41.097974079 +0000 UTC m=+52.786701525"
Jul 18 01:48:41.111127 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:48:41.111089    2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-storage-operator/volume-data-source-validator-78cf4c6f6-thdcg" podStartSLOduration=4.406007133 podStartE2EDuration="6.111076096s" totalImagesPullingTime="1.705068963s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-18 01:48:35 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-18 01:48:41.110191022 +0000 UTC m=+52.798918471" watchObservedRunningTime="2026-07-18 01:48:41.111076096 +0000 UTC m=+52.799803521"
Jul 18 01:48:41.127884 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:48:41.127843    2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-operator-555d9d7885-d2pwt" podStartSLOduration=2.015016536 podStartE2EDuration="6.127826857s" totalImagesPullingTime="4.112810321s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-18 01:48:35 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-18 01:48:41.126874453 +0000 UTC m=+52.815601901" watchObservedRunningTime="2026-07-18 01:48:41.127826857 +0000 UTC m=+52.816554306"
Jul 18 01:48:41.148820 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:48:41.148781    2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-source-7bc5b6bf85-nw297" podStartSLOduration=1.93375094 podStartE2EDuration="6.148766733s" totalImagesPullingTime="4.215015793s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-18 01:48:35 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-18 01:48:41.148185471 +0000 UTC m=+52.836912919" watchObservedRunningTime="2026-07-18 01:48:41.148766733 +0000 UTC m=+52.837494179"
Jul 18 01:48:41.674140 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:48:41.674098    2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-gfxbj"]
Jul 18 01:48:41.706431 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:48:41.706395    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-gfxbj"]
Jul 18 01:48:41.706582 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:48:41.706506    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-gfxbj"
Jul 18 01:48:41.708817 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:48:41.708790    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-zn9g6\""
Jul 18 01:48:41.708817 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:48:41.708792    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\""
Jul 18 01:48:41.709516 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:48:41.709503    2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\""
Jul 18 01:48:41.765873 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:48:41.765844    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/a313b3f0-c006-44fc-8b93-d5a250b450ef-crio-socket\") pod \"insights-runtime-extractor-gfxbj\" (UID: \"a313b3f0-c006-44fc-8b93-d5a250b450ef\") " pod="openshift-insights/insights-runtime-extractor-gfxbj"
Jul 18 01:48:41.766047 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:48:41.765906    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/a313b3f0-c006-44fc-8b93-d5a250b450ef-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-gfxbj\" (UID: \"a313b3f0-c006-44fc-8b93-d5a250b450ef\") " pod="openshift-insights/insights-runtime-extractor-gfxbj"
Jul 18 01:48:41.766047 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:48:41.765957    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/a313b3f0-c006-44fc-8b93-d5a250b450ef-data-volume\") pod \"insights-runtime-extractor-gfxbj\" (UID: \"a313b3f0-c006-44fc-8b93-d5a250b450ef\") " pod="openshift-insights/insights-runtime-extractor-gfxbj"
Jul 18 01:48:41.766047 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:48:41.765997    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-l4589\" (UniqueName: \"kubernetes.io/projected/a313b3f0-c006-44fc-8b93-d5a250b450ef-kube-api-access-l4589\") pod \"insights-runtime-extractor-gfxbj\" (UID: \"a313b3f0-c006-44fc-8b93-d5a250b450ef\") " pod="openshift-insights/insights-runtime-extractor-gfxbj"
Jul 18 01:48:41.766047 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:48:41.766038    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/a313b3f0-c006-44fc-8b93-d5a250b450ef-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-gfxbj\" (UID: \"a313b3f0-c006-44fc-8b93-d5a250b450ef\") " pod="openshift-insights/insights-runtime-extractor-gfxbj"
Jul 18 01:48:41.867019 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:48:41.866992    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/a313b3f0-c006-44fc-8b93-d5a250b450ef-crio-socket\") pod \"insights-runtime-extractor-gfxbj\" (UID: \"a313b3f0-c006-44fc-8b93-d5a250b450ef\") " pod="openshift-insights/insights-runtime-extractor-gfxbj"
Jul 18 01:48:41.867178 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:48:41.867075    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/a313b3f0-c006-44fc-8b93-d5a250b450ef-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-gfxbj\" (UID: \"a313b3f0-c006-44fc-8b93-d5a250b450ef\") " pod="openshift-insights/insights-runtime-extractor-gfxbj"
Jul 18 01:48:41.867178 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:48:41.867111    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/a313b3f0-c006-44fc-8b93-d5a250b450ef-crio-socket\") pod \"insights-runtime-extractor-gfxbj\" (UID: \"a313b3f0-c006-44fc-8b93-d5a250b450ef\") " pod="openshift-insights/insights-runtime-extractor-gfxbj"
Jul 18 01:48:41.867178 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:48:41.867137    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/a313b3f0-c006-44fc-8b93-d5a250b450ef-data-volume\") pod \"insights-runtime-extractor-gfxbj\" (UID: \"a313b3f0-c006-44fc-8b93-d5a250b450ef\") " pod="openshift-insights/insights-runtime-extractor-gfxbj"
Jul 18 01:48:41.867347 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:48:41.867225    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-l4589\" (UniqueName: \"kubernetes.io/projected/a313b3f0-c006-44fc-8b93-d5a250b450ef-kube-api-access-l4589\") pod \"insights-runtime-extractor-gfxbj\" (UID: \"a313b3f0-c006-44fc-8b93-d5a250b450ef\") " pod="openshift-insights/insights-runtime-extractor-gfxbj"
Jul 18 01:48:41.867347 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:48:41.867289    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/a313b3f0-c006-44fc-8b93-d5a250b450ef-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-gfxbj\" (UID: \"a313b3f0-c006-44fc-8b93-d5a250b450ef\") " pod="openshift-insights/insights-runtime-extractor-gfxbj"
Jul 18 01:48:41.867500 ip-10-0-142-238 kubenswrapper[2566]: E0718 01:48:41.867421    2566 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 18 01:48:41.867500 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:48:41.867424    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/a313b3f0-c006-44fc-8b93-d5a250b450ef-data-volume\") pod \"insights-runtime-extractor-gfxbj\" (UID: \"a313b3f0-c006-44fc-8b93-d5a250b450ef\") " pod="openshift-insights/insights-runtime-extractor-gfxbj"
Jul 18 01:48:41.867500 ip-10-0-142-238 kubenswrapper[2566]: E0718 01:48:41.867473    2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/a313b3f0-c006-44fc-8b93-d5a250b450ef-kube-rbac-proxy-cm podName:a313b3f0-c006-44fc-8b93-d5a250b450ef nodeName:}" failed. No retries permitted until 2026-07-18 01:48:42.367456687 +0000 UTC m=+54.056184118 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/a313b3f0-c006-44fc-8b93-d5a250b450ef-kube-rbac-proxy-cm") pod "insights-runtime-extractor-gfxbj" (UID: "a313b3f0-c006-44fc-8b93-d5a250b450ef") : configmap "kube-rbac-proxy" not found
Jul 18 01:48:41.867664 ip-10-0-142-238 kubenswrapper[2566]: E0718 01:48:41.867516    2566 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 18 01:48:41.867664 ip-10-0-142-238 kubenswrapper[2566]: E0718 01:48:41.867580    2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a313b3f0-c006-44fc-8b93-d5a250b450ef-insights-runtime-extractor-tls podName:a313b3f0-c006-44fc-8b93-d5a250b450ef nodeName:}" failed. No retries permitted until 2026-07-18 01:48:42.367567327 +0000 UTC m=+54.056294765 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/a313b3f0-c006-44fc-8b93-d5a250b450ef-insights-runtime-extractor-tls") pod "insights-runtime-extractor-gfxbj" (UID: "a313b3f0-c006-44fc-8b93-d5a250b450ef") : secret "insights-runtime-extractor-tls" not found
Jul 18 01:48:41.875161 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:48:41.875139    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-l4589\" (UniqueName: \"kubernetes.io/projected/a313b3f0-c006-44fc-8b93-d5a250b450ef-kube-api-access-l4589\") pod \"insights-runtime-extractor-gfxbj\" (UID: \"a313b3f0-c006-44fc-8b93-d5a250b450ef\") " pod="openshift-insights/insights-runtime-extractor-gfxbj"
Jul 18 01:48:42.371981 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:48:42.371937    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/a313b3f0-c006-44fc-8b93-d5a250b450ef-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-gfxbj\" (UID: \"a313b3f0-c006-44fc-8b93-d5a250b450ef\") " pod="openshift-insights/insights-runtime-extractor-gfxbj"
Jul 18 01:48:42.372396 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:48:42.372051    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/a313b3f0-c006-44fc-8b93-d5a250b450ef-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-gfxbj\" (UID: \"a313b3f0-c006-44fc-8b93-d5a250b450ef\") " pod="openshift-insights/insights-runtime-extractor-gfxbj"
Jul 18 01:48:42.372396 ip-10-0-142-238 kubenswrapper[2566]: E0718 01:48:42.372055    2566 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 18 01:48:42.372396 ip-10-0-142-238 kubenswrapper[2566]: E0718 01:48:42.372122    2566 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 18 01:48:42.372396 ip-10-0-142-238 kubenswrapper[2566]: E0718 01:48:42.372182    2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a313b3f0-c006-44fc-8b93-d5a250b450ef-insights-runtime-extractor-tls podName:a313b3f0-c006-44fc-8b93-d5a250b450ef nodeName:}" failed. No retries permitted until 2026-07-18 01:48:43.37216366 +0000 UTC m=+55.060891102 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/a313b3f0-c006-44fc-8b93-d5a250b450ef-insights-runtime-extractor-tls") pod "insights-runtime-extractor-gfxbj" (UID: "a313b3f0-c006-44fc-8b93-d5a250b450ef") : secret "insights-runtime-extractor-tls" not found
Jul 18 01:48:42.372396 ip-10-0-142-238 kubenswrapper[2566]: E0718 01:48:42.372229    2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/a313b3f0-c006-44fc-8b93-d5a250b450ef-kube-rbac-proxy-cm podName:a313b3f0-c006-44fc-8b93-d5a250b450ef nodeName:}" failed. No retries permitted until 2026-07-18 01:48:43.372210596 +0000 UTC m=+55.060938037 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/a313b3f0-c006-44fc-8b93-d5a250b450ef-kube-rbac-proxy-cm") pod "insights-runtime-extractor-gfxbj" (UID: "a313b3f0-c006-44fc-8b93-d5a250b450ef") : configmap "kube-rbac-proxy" not found
Jul 18 01:48:42.585414 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:48:42.585382    2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator/migrator-7cc9c7ffd7-7zb86"]
Jul 18 01:48:42.588007 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:48:42.587985    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-7cc9c7ffd7-7zb86"
Jul 18 01:48:42.590100 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:48:42.590081    2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"openshift-service-ca.crt\""
Jul 18 01:48:42.590205 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:48:42.590133    2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-root-ca.crt\""
Jul 18 01:48:42.590835 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:48:42.590820    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-storage-version-migrator-sa-dockercfg-srgl4\""
Jul 18 01:48:42.595692 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:48:42.595671    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-7cc9c7ffd7-7zb86"]
Jul 18 01:48:42.674371 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:48:42.674318    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ksgdr\" (UniqueName: \"kubernetes.io/projected/4b0102b2-4cdc-49e1-b67e-95cde3bf129a-kube-api-access-ksgdr\") pod \"migrator-7cc9c7ffd7-7zb86\" (UID: \"4b0102b2-4cdc-49e1-b67e-95cde3bf129a\") " pod="openshift-kube-storage-version-migrator/migrator-7cc9c7ffd7-7zb86"
Jul 18 01:48:42.775332 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:48:42.775307    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ksgdr\" (UniqueName: \"kubernetes.io/projected/4b0102b2-4cdc-49e1-b67e-95cde3bf129a-kube-api-access-ksgdr\") pod \"migrator-7cc9c7ffd7-7zb86\" (UID: \"4b0102b2-4cdc-49e1-b67e-95cde3bf129a\") " pod="openshift-kube-storage-version-migrator/migrator-7cc9c7ffd7-7zb86"
Jul 18 01:48:42.783427 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:48:42.783402    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ksgdr\" (UniqueName: \"kubernetes.io/projected/4b0102b2-4cdc-49e1-b67e-95cde3bf129a-kube-api-access-ksgdr\") pod \"migrator-7cc9c7ffd7-7zb86\" (UID: \"4b0102b2-4cdc-49e1-b67e-95cde3bf129a\") " pod="openshift-kube-storage-version-migrator/migrator-7cc9c7ffd7-7zb86"
Jul 18 01:48:42.898182 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:48:42.898155    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-7cc9c7ffd7-7zb86"
Jul 18 01:48:43.023602 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:48:43.023571    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-7cc9c7ffd7-7zb86"]
Jul 18 01:48:43.026626 ip-10-0-142-238 kubenswrapper[2566]: W0718 01:48:43.026586    2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4b0102b2_4cdc_49e1_b67e_95cde3bf129a.slice/crio-d35ade0d0b7db7d7511762c620ef26c55bd2fdb919b3eb9b7ae7ea9e8785c41b WatchSource:0}: Error finding container d35ade0d0b7db7d7511762c620ef26c55bd2fdb919b3eb9b7ae7ea9e8785c41b: Status 404 returned error can't find the container with id d35ade0d0b7db7d7511762c620ef26c55bd2fdb919b3eb9b7ae7ea9e8785c41b
Jul 18 01:48:43.092994 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:48:43.092962    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-7cc9c7ffd7-7zb86" event={"ID":"4b0102b2-4cdc-49e1-b67e-95cde3bf129a","Type":"ContainerStarted","Data":"d35ade0d0b7db7d7511762c620ef26c55bd2fdb919b3eb9b7ae7ea9e8785c41b"}
Jul 18 01:48:43.367702 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:48:43.367675    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-cpp62_ddbb4203-0f8f-4799-a645-184ca2236211/dns-node-resolver/0.log"
Jul 18 01:48:43.380935 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:48:43.380907    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/a313b3f0-c006-44fc-8b93-d5a250b450ef-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-gfxbj\" (UID: \"a313b3f0-c006-44fc-8b93-d5a250b450ef\") " pod="openshift-insights/insights-runtime-extractor-gfxbj"
Jul 18 01:48:43.381262 ip-10-0-142-238 kubenswrapper[2566]: E0718 01:48:43.381046    2566 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 18 01:48:43.381262 ip-10-0-142-238 kubenswrapper[2566]: E0718 01:48:43.381102    2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a313b3f0-c006-44fc-8b93-d5a250b450ef-insights-runtime-extractor-tls podName:a313b3f0-c006-44fc-8b93-d5a250b450ef nodeName:}" failed. No retries permitted until 2026-07-18 01:48:45.381086981 +0000 UTC m=+57.069814406 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/a313b3f0-c006-44fc-8b93-d5a250b450ef-insights-runtime-extractor-tls") pod "insights-runtime-extractor-gfxbj" (UID: "a313b3f0-c006-44fc-8b93-d5a250b450ef") : secret "insights-runtime-extractor-tls" not found
Jul 18 01:48:43.381262 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:48:43.381048    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/a313b3f0-c006-44fc-8b93-d5a250b450ef-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-gfxbj\" (UID: \"a313b3f0-c006-44fc-8b93-d5a250b450ef\") " pod="openshift-insights/insights-runtime-extractor-gfxbj"
Jul 18 01:48:43.381262 ip-10-0-142-238 kubenswrapper[2566]: E0718 01:48:43.381101    2566 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 18 01:48:43.381262 ip-10-0-142-238 kubenswrapper[2566]: E0718 01:48:43.381198    2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/a313b3f0-c006-44fc-8b93-d5a250b450ef-kube-rbac-proxy-cm podName:a313b3f0-c006-44fc-8b93-d5a250b450ef nodeName:}" failed. No retries permitted until 2026-07-18 01:48:45.38118747 +0000 UTC m=+57.069914895 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/a313b3f0-c006-44fc-8b93-d5a250b450ef-kube-rbac-proxy-cm") pod "insights-runtime-extractor-gfxbj" (UID: "a313b3f0-c006-44fc-8b93-d5a250b450ef") : configmap "kube-rbac-proxy" not found
Jul 18 01:48:43.683244 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:48:43.683170    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/276db0cf-ad20-45dc-b0a4-53079f105793-registry-tls\") pod \"image-registry-5cc4778d68-sk4t6\" (UID: \"276db0cf-ad20-45dc-b0a4-53079f105793\") " pod="openshift-image-registry/image-registry-5cc4778d68-sk4t6"
Jul 18 01:48:43.683397 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:48:43.683325    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/6837ebbd-e9f4-401f-88a3-ab11bc740ba8-samples-operator-tls\") pod \"cluster-samples-operator-79b7c55f87-hd8cg\" (UID: \"6837ebbd-e9f4-401f-88a3-ab11bc740ba8\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-hd8cg"
Jul 18 01:48:43.683397 ip-10-0-142-238 kubenswrapper[2566]: E0718 01:48:43.683355    2566 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 18 01:48:43.683397 ip-10-0-142-238 kubenswrapper[2566]: E0718 01:48:43.683376    2566 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-5cc4778d68-sk4t6: secret "image-registry-tls" not found
Jul 18 01:48:43.683547 ip-10-0-142-238 kubenswrapper[2566]: E0718 01:48:43.683419    2566 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Jul 18 01:48:43.683547 ip-10-0-142-238 kubenswrapper[2566]: E0718 01:48:43.683441    2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/276db0cf-ad20-45dc-b0a4-53079f105793-registry-tls podName:276db0cf-ad20-45dc-b0a4-53079f105793 nodeName:}" failed. No retries permitted until 2026-07-18 01:48:51.683421374 +0000 UTC m=+63.372148802 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/276db0cf-ad20-45dc-b0a4-53079f105793-registry-tls") pod "image-registry-5cc4778d68-sk4t6" (UID: "276db0cf-ad20-45dc-b0a4-53079f105793") : secret "image-registry-tls" not found
Jul 18 01:48:43.683547 ip-10-0-142-238 kubenswrapper[2566]: E0718 01:48:43.683458    2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6837ebbd-e9f4-401f-88a3-ab11bc740ba8-samples-operator-tls podName:6837ebbd-e9f4-401f-88a3-ab11bc740ba8 nodeName:}" failed. No retries permitted until 2026-07-18 01:48:51.683448113 +0000 UTC m=+63.372175538 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/6837ebbd-e9f4-401f-88a3-ab11bc740ba8-samples-operator-tls") pod "cluster-samples-operator-79b7c55f87-hd8cg" (UID: "6837ebbd-e9f4-401f-88a3-ab11bc740ba8") : secret "samples-operator-tls" not found
Jul 18 01:48:43.783989 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:48:43.783952    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f34b225d-0b2f-474f-9b87-40443dba791b-metrics-certs\") pod \"router-default-57ff4ffb64-8n2hs\" (UID: \"f34b225d-0b2f-474f-9b87-40443dba791b\") " pod="openshift-ingress/router-default-57ff4ffb64-8n2hs"
Jul 18 01:48:43.783989 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:48:43.783985    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f34b225d-0b2f-474f-9b87-40443dba791b-service-ca-bundle\") pod \"router-default-57ff4ffb64-8n2hs\" (UID: \"f34b225d-0b2f-474f-9b87-40443dba791b\") " pod="openshift-ingress/router-default-57ff4ffb64-8n2hs"
Jul 18 01:48:43.784178 ip-10-0-142-238 kubenswrapper[2566]: E0718 01:48:43.784100    2566 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Jul 18 01:48:43.784178 ip-10-0-142-238 kubenswrapper[2566]: E0718 01:48:43.784107    2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/f34b225d-0b2f-474f-9b87-40443dba791b-service-ca-bundle podName:f34b225d-0b2f-474f-9b87-40443dba791b nodeName:}" failed. No retries permitted until 2026-07-18 01:48:51.784089021 +0000 UTC m=+63.472816446 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/f34b225d-0b2f-474f-9b87-40443dba791b-service-ca-bundle") pod "router-default-57ff4ffb64-8n2hs" (UID: "f34b225d-0b2f-474f-9b87-40443dba791b") : configmap references non-existent config key: service-ca.crt
Jul 18 01:48:43.784284 ip-10-0-142-238 kubenswrapper[2566]: E0718 01:48:43.784207    2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f34b225d-0b2f-474f-9b87-40443dba791b-metrics-certs podName:f34b225d-0b2f-474f-9b87-40443dba791b nodeName:}" failed. No retries permitted until 2026-07-18 01:48:51.784192702 +0000 UTC m=+63.472920129 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/f34b225d-0b2f-474f-9b87-40443dba791b-metrics-certs") pod "router-default-57ff4ffb64-8n2hs" (UID: "f34b225d-0b2f-474f-9b87-40443dba791b") : secret "router-metrics-certs-default" not found
Jul 18 01:48:44.568054 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:48:44.568025    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-lt6hj_573bdc5a-3cb5-4729-9426-270ba59b0d02/node-ca/0.log"
Jul 18 01:48:45.102111 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:48:45.102075    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-7cc9c7ffd7-7zb86" event={"ID":"4b0102b2-4cdc-49e1-b67e-95cde3bf129a","Type":"ContainerStarted","Data":"dda2ca4195b66f53ad505b1e873248c9e241890f36c2dd1a0b166cee36626af2"}
Jul 18 01:48:45.102300 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:48:45.102132    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-7cc9c7ffd7-7zb86" event={"ID":"4b0102b2-4cdc-49e1-b67e-95cde3bf129a","Type":"ContainerStarted","Data":"ff9cede880f7e95a2b75519a0c712c5a7bfecac25bfacaddd5dc6bb0175defcd"}
Jul 18 01:48:45.117626 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:48:45.117566    2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator/migrator-7cc9c7ffd7-7zb86" podStartSLOduration=1.933878992 podStartE2EDuration="3.11755199s" totalImagesPullingTime="1.183672998s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-18 01:48:42 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-18 01:48:45.116822954 +0000 UTC m=+56.805550402" watchObservedRunningTime="2026-07-18 01:48:45.11755199 +0000 UTC m=+56.806279435"
Jul 18 01:48:45.165458 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:48:45.165431    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-pz72j_fdf6ac26-5f24-480c-ad15-d6dbb18adc78/serve-healthcheck-canary/0.log"
Jul 18 01:48:45.396689 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:48:45.396599    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/a313b3f0-c006-44fc-8b93-d5a250b450ef-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-gfxbj\" (UID: \"a313b3f0-c006-44fc-8b93-d5a250b450ef\") " pod="openshift-insights/insights-runtime-extractor-gfxbj"
Jul 18 01:48:45.396830 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:48:45.396690    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/a313b3f0-c006-44fc-8b93-d5a250b450ef-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-gfxbj\" (UID: \"a313b3f0-c006-44fc-8b93-d5a250b450ef\") " pod="openshift-insights/insights-runtime-extractor-gfxbj"
Jul 18 01:48:45.396830 ip-10-0-142-238 kubenswrapper[2566]: E0718 01:48:45.396757    2566 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 18 01:48:45.396830 ip-10-0-142-238 kubenswrapper[2566]: E0718 01:48:45.396759    2566 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 18 01:48:45.396830 ip-10-0-142-238 kubenswrapper[2566]: E0718 01:48:45.396809    2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/a313b3f0-c006-44fc-8b93-d5a250b450ef-kube-rbac-proxy-cm podName:a313b3f0-c006-44fc-8b93-d5a250b450ef nodeName:}" failed. No retries permitted until 2026-07-18 01:48:49.396795108 +0000 UTC m=+61.085522533 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/a313b3f0-c006-44fc-8b93-d5a250b450ef-kube-rbac-proxy-cm") pod "insights-runtime-extractor-gfxbj" (UID: "a313b3f0-c006-44fc-8b93-d5a250b450ef") : configmap "kube-rbac-proxy" not found
Jul 18 01:48:45.396830 ip-10-0-142-238 kubenswrapper[2566]: E0718 01:48:45.396822    2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a313b3f0-c006-44fc-8b93-d5a250b450ef-insights-runtime-extractor-tls podName:a313b3f0-c006-44fc-8b93-d5a250b450ef nodeName:}" failed. No retries permitted until 2026-07-18 01:48:49.396815896 +0000 UTC m=+61.085543321 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/a313b3f0-c006-44fc-8b93-d5a250b450ef-insights-runtime-extractor-tls") pod "insights-runtime-extractor-gfxbj" (UID: "a313b3f0-c006-44fc-8b93-d5a250b450ef") : secret "insights-runtime-extractor-tls" not found
Jul 18 01:48:49.431735 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:48:49.431703    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/a313b3f0-c006-44fc-8b93-d5a250b450ef-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-gfxbj\" (UID: \"a313b3f0-c006-44fc-8b93-d5a250b450ef\") " pod="openshift-insights/insights-runtime-extractor-gfxbj"
Jul 18 01:48:49.432100 ip-10-0-142-238 kubenswrapper[2566]: E0718 01:48:49.431825    2566 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 18 01:48:49.432100 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:48:49.431874    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/a313b3f0-c006-44fc-8b93-d5a250b450ef-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-gfxbj\" (UID: \"a313b3f0-c006-44fc-8b93-d5a250b450ef\") " pod="openshift-insights/insights-runtime-extractor-gfxbj"
Jul 18 01:48:49.432100 ip-10-0-142-238 kubenswrapper[2566]: E0718 01:48:49.431891    2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/a313b3f0-c006-44fc-8b93-d5a250b450ef-kube-rbac-proxy-cm podName:a313b3f0-c006-44fc-8b93-d5a250b450ef nodeName:}" failed. No retries permitted until 2026-07-18 01:48:57.431870847 +0000 UTC m=+69.120598294 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/a313b3f0-c006-44fc-8b93-d5a250b450ef-kube-rbac-proxy-cm") pod "insights-runtime-extractor-gfxbj" (UID: "a313b3f0-c006-44fc-8b93-d5a250b450ef") : configmap "kube-rbac-proxy" not found
Jul 18 01:48:49.432100 ip-10-0-142-238 kubenswrapper[2566]: E0718 01:48:49.431956    2566 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 18 01:48:49.432100 ip-10-0-142-238 kubenswrapper[2566]: E0718 01:48:49.432003    2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a313b3f0-c006-44fc-8b93-d5a250b450ef-insights-runtime-extractor-tls podName:a313b3f0-c006-44fc-8b93-d5a250b450ef nodeName:}" failed. No retries permitted until 2026-07-18 01:48:57.431989098 +0000 UTC m=+69.120716562 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/a313b3f0-c006-44fc-8b93-d5a250b450ef-insights-runtime-extractor-tls") pod "insights-runtime-extractor-gfxbj" (UID: "a313b3f0-c006-44fc-8b93-d5a250b450ef") : secret "insights-runtime-extractor-tls" not found
Jul 18 01:48:51.021138 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:48:51.021110    2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-zn27c"
Jul 18 01:48:51.752445 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:48:51.752411    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/6837ebbd-e9f4-401f-88a3-ab11bc740ba8-samples-operator-tls\") pod \"cluster-samples-operator-79b7c55f87-hd8cg\" (UID: \"6837ebbd-e9f4-401f-88a3-ab11bc740ba8\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-hd8cg"
Jul 18 01:48:51.752600 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:48:51.752463    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/276db0cf-ad20-45dc-b0a4-53079f105793-registry-tls\") pod \"image-registry-5cc4778d68-sk4t6\" (UID: \"276db0cf-ad20-45dc-b0a4-53079f105793\") " pod="openshift-image-registry/image-registry-5cc4778d68-sk4t6"
Jul 18 01:48:51.754861 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:48:51.754834    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/6837ebbd-e9f4-401f-88a3-ab11bc740ba8-samples-operator-tls\") pod \"cluster-samples-operator-79b7c55f87-hd8cg\" (UID: \"6837ebbd-e9f4-401f-88a3-ab11bc740ba8\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-hd8cg"
Jul 18 01:48:51.754861 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:48:51.754852    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/276db0cf-ad20-45dc-b0a4-53079f105793-registry-tls\") pod \"image-registry-5cc4778d68-sk4t6\" (UID: \"276db0cf-ad20-45dc-b0a4-53079f105793\") " pod="openshift-image-registry/image-registry-5cc4778d68-sk4t6"
Jul 18 01:48:51.837388 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:48:51.837365    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-66smx\""
Jul 18 01:48:51.845240 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:48:51.845222    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-5cc4778d68-sk4t6"
Jul 18 01:48:51.853338 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:48:51.853313    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f34b225d-0b2f-474f-9b87-40443dba791b-metrics-certs\") pod \"router-default-57ff4ffb64-8n2hs\" (UID: \"f34b225d-0b2f-474f-9b87-40443dba791b\") " pod="openshift-ingress/router-default-57ff4ffb64-8n2hs"
Jul 18 01:48:51.853420 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:48:51.853354    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f34b225d-0b2f-474f-9b87-40443dba791b-service-ca-bundle\") pod \"router-default-57ff4ffb64-8n2hs\" (UID: \"f34b225d-0b2f-474f-9b87-40443dba791b\") " pod="openshift-ingress/router-default-57ff4ffb64-8n2hs"
Jul 18 01:48:51.853942 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:48:51.853919    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f34b225d-0b2f-474f-9b87-40443dba791b-service-ca-bundle\") pod \"router-default-57ff4ffb64-8n2hs\" (UID: \"f34b225d-0b2f-474f-9b87-40443dba791b\") " pod="openshift-ingress/router-default-57ff4ffb64-8n2hs"
Jul 18 01:48:51.855735 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:48:51.855703    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f34b225d-0b2f-474f-9b87-40443dba791b-metrics-certs\") pod \"router-default-57ff4ffb64-8n2hs\" (UID: \"f34b225d-0b2f-474f-9b87-40443dba791b\") " pod="openshift-ingress/router-default-57ff4ffb64-8n2hs"
Jul 18 01:48:51.914983 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:48:51.914938    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"cluster-samples-operator-dockercfg-pqdc5\""
Jul 18 01:48:51.923883 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:48:51.923827    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-hd8cg"
Jul 18 01:48:51.938922 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:48:51.938900    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-dockercfg-d5qhg\""
Jul 18 01:48:51.947704 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:48:51.947674    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-57ff4ffb64-8n2hs"
Jul 18 01:48:51.964931 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:48:51.964906    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-5cc4778d68-sk4t6"]
Jul 18 01:48:51.968705 ip-10-0-142-238 kubenswrapper[2566]: W0718 01:48:51.968675    2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod276db0cf_ad20_45dc_b0a4_53079f105793.slice/crio-0fd9f3c7acfba2f870c30582b17540d5ca793a8ef506edafbb150ad43f9ca2e7 WatchSource:0}: Error finding container 0fd9f3c7acfba2f870c30582b17540d5ca793a8ef506edafbb150ad43f9ca2e7: Status 404 returned error can't find the container with id 0fd9f3c7acfba2f870c30582b17540d5ca793a8ef506edafbb150ad43f9ca2e7
Jul 18 01:48:52.053271 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:48:52.053216    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-hd8cg"]
Jul 18 01:48:52.076860 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:48:52.076834    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-57ff4ffb64-8n2hs"]
Jul 18 01:48:52.082915 ip-10-0-142-238 kubenswrapper[2566]: W0718 01:48:52.082885    2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf34b225d_0b2f_474f_9b87_40443dba791b.slice/crio-5a236eb502be4e600049594de9717054bc8113805234aad32cbb4cdad0380e4e WatchSource:0}: Error finding container 5a236eb502be4e600049594de9717054bc8113805234aad32cbb4cdad0380e4e: Status 404 returned error can't find the container with id 5a236eb502be4e600049594de9717054bc8113805234aad32cbb4cdad0380e4e
Jul 18 01:48:52.123124 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:48:52.123102    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-hd8cg" event={"ID":"6837ebbd-e9f4-401f-88a3-ab11bc740ba8","Type":"ContainerStarted","Data":"937e6e00af9738f7770b99e634353649c549fe2f1dadcdfc2e93c6463f92ab91"}
Jul 18 01:48:52.124495 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:48:52.124469    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-57ff4ffb64-8n2hs" event={"ID":"f34b225d-0b2f-474f-9b87-40443dba791b","Type":"ContainerStarted","Data":"5a236eb502be4e600049594de9717054bc8113805234aad32cbb4cdad0380e4e"}
Jul 18 01:48:52.125966 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:48:52.125943    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-5cc4778d68-sk4t6" event={"ID":"276db0cf-ad20-45dc-b0a4-53079f105793","Type":"ContainerStarted","Data":"98f67bc76eb27f6be5613adb5df17f4b364557f2f5b60fcfe42e83d11bdce380"}
Jul 18 01:48:52.126049 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:48:52.125983    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-5cc4778d68-sk4t6" event={"ID":"276db0cf-ad20-45dc-b0a4-53079f105793","Type":"ContainerStarted","Data":"0fd9f3c7acfba2f870c30582b17540d5ca793a8ef506edafbb150ad43f9ca2e7"}
Jul 18 01:48:52.126103 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:48:52.126073    2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-5cc4778d68-sk4t6"
Jul 18 01:48:52.149860 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:48:52.149805    2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-5cc4778d68-sk4t6" podStartSLOduration=17.149786823 podStartE2EDuration="17.149786823s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-18 01:48:35 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-18 01:48:52.148571313 +0000 UTC m=+63.837298758" watchObservedRunningTime="2026-07-18 01:48:52.149786823 +0000 UTC m=+63.838514267"
Jul 18 01:48:53.131649 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:48:53.131594    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-57ff4ffb64-8n2hs" event={"ID":"f34b225d-0b2f-474f-9b87-40443dba791b","Type":"ContainerStarted","Data":"133357268f80a9a895da03d038ecdb6606a0296f55db40cf84a20697da4ce87d"}
Jul 18 01:48:53.150491 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:48:53.150451    2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/router-default-57ff4ffb64-8n2hs" podStartSLOduration=18.150437396 podStartE2EDuration="18.150437396s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-18 01:48:35 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-18 01:48:53.1498903 +0000 UTC m=+64.838617749" watchObservedRunningTime="2026-07-18 01:48:53.150437396 +0000 UTC m=+64.839164843"
Jul 18 01:48:53.947885 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:48:53.947857    2566 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/router-default-57ff4ffb64-8n2hs"
Jul 18 01:48:53.950110 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:48:53.950088    2566 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/router-default-57ff4ffb64-8n2hs"
Jul 18 01:48:54.136878 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:48:54.136800    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-hd8cg" event={"ID":"6837ebbd-e9f4-401f-88a3-ab11bc740ba8","Type":"ContainerStarted","Data":"b934b0738926d9b052d7852c3bf7853827bda893e5b915c2182e0743920538fa"}
Jul 18 01:48:54.137216 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:48:54.137057    2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/router-default-57ff4ffb64-8n2hs"
Jul 18 01:48:54.137216 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:48:54.137093    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-hd8cg" event={"ID":"6837ebbd-e9f4-401f-88a3-ab11bc740ba8","Type":"ContainerStarted","Data":"d588a3e7130bf65251b1c6eaf41d7acf499c41b673e18d5e74c63e5279f94049"}
Jul 18 01:48:54.138043 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:48:54.138028    2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/router-default-57ff4ffb64-8n2hs"
Jul 18 01:48:54.154735 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:48:54.154693    2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-hd8cg" podStartSLOduration=17.361988983 podStartE2EDuration="19.15467728s" totalImagesPullingTime="1.792688297s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-18 01:48:35 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-18 01:48:54.154056142 +0000 UTC m=+65.842783590" watchObservedRunningTime="2026-07-18 01:48:54.15467728 +0000 UTC m=+65.843404730"
Jul 18 01:48:54.579473 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:48:54.579437    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7c91433e-b6e6-47a8-8df6-2231cbc7d28c-metrics-certs\") pod \"network-metrics-daemon-pdflp\" (UID: \"7c91433e-b6e6-47a8-8df6-2231cbc7d28c\") " pod="openshift-multus/network-metrics-daemon-pdflp"
Jul 18 01:48:54.579670 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:48:54.579483    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/26d75b92-43d7-43e7-96c8-dd42a5288953-original-pull-secret\") pod \"global-pull-secret-syncer-2jzkc\" (UID: \"26d75b92-43d7-43e7-96c8-dd42a5288953\") " pod="kube-system/global-pull-secret-syncer-2jzkc"
Jul 18 01:48:54.581940 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:48:54.581917    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Jul 18 01:48:54.582029 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:48:54.581917    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Jul 18 01:48:54.592310 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:48:54.592284    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/26d75b92-43d7-43e7-96c8-dd42a5288953-original-pull-secret\") pod \"global-pull-secret-syncer-2jzkc\" (UID: \"26d75b92-43d7-43e7-96c8-dd42a5288953\") " pod="kube-system/global-pull-secret-syncer-2jzkc"
Jul 18 01:48:54.592310 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:48:54.592306    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7c91433e-b6e6-47a8-8df6-2231cbc7d28c-metrics-certs\") pod \"network-metrics-daemon-pdflp\" (UID: \"7c91433e-b6e6-47a8-8df6-2231cbc7d28c\") " pod="openshift-multus/network-metrics-daemon-pdflp"
Jul 18 01:48:54.679901 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:48:54.679873    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-x4khf\" (UniqueName: \"kubernetes.io/projected/25c58f22-7d60-4a06-844f-f3508d910e76-kube-api-access-x4khf\") pod \"network-check-target-n8bdx\" (UID: \"25c58f22-7d60-4a06-844f-f3508d910e76\") " pod="openshift-network-diagnostics/network-check-target-n8bdx"
Jul 18 01:48:54.682050 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:48:54.682025    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-x4khf\" (UniqueName: \"kubernetes.io/projected/25c58f22-7d60-4a06-844f-f3508d910e76-kube-api-access-x4khf\") pod \"network-check-target-n8bdx\" (UID: \"25c58f22-7d60-4a06-844f-f3508d910e76\") " pod="openshift-network-diagnostics/network-check-target-n8bdx"
Jul 18 01:48:54.720089 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:48:54.720068    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-2jzkc"
Jul 18 01:48:54.727644 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:48:54.727607    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-vwvlx\""
Jul 18 01:48:54.735542 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:48:54.735526    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-n8bdx"
Jul 18 01:48:54.822181 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:48:54.822157    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-tqgxz\""
Jul 18 01:48:54.830432 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:48:54.830410    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-pdflp"
Jul 18 01:48:54.844636 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:48:54.844590    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-2jzkc"]
Jul 18 01:48:54.847288 ip-10-0-142-238 kubenswrapper[2566]: W0718 01:48:54.847262    2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod26d75b92_43d7_43e7_96c8_dd42a5288953.slice/crio-4c509b4c768f7c26bd76a0fa88cdf2250e831b6505d51ef82b33ce5cf2b91fb3 WatchSource:0}: Error finding container 4c509b4c768f7c26bd76a0fa88cdf2250e831b6505d51ef82b33ce5cf2b91fb3: Status 404 returned error can't find the container with id 4c509b4c768f7c26bd76a0fa88cdf2250e831b6505d51ef82b33ce5cf2b91fb3
Jul 18 01:48:54.860406 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:48:54.860385    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-n8bdx"]
Jul 18 01:48:54.862497 ip-10-0-142-238 kubenswrapper[2566]: W0718 01:48:54.862475    2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod25c58f22_7d60_4a06_844f_f3508d910e76.slice/crio-b562787a31d7b49b36c1a4322557c2c1c7337ea2702e029eaea38f1f2f37e105 WatchSource:0}: Error finding container b562787a31d7b49b36c1a4322557c2c1c7337ea2702e029eaea38f1f2f37e105: Status 404 returned error can't find the container with id b562787a31d7b49b36c1a4322557c2c1c7337ea2702e029eaea38f1f2f37e105
Jul 18 01:48:54.953004 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:48:54.952975    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-pdflp"]
Jul 18 01:48:54.956856 ip-10-0-142-238 kubenswrapper[2566]: W0718 01:48:54.956833    2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7c91433e_b6e6_47a8_8df6_2231cbc7d28c.slice/crio-3ee51186ef5da34e5773ad00a7cd97772741dd453f1cd2b26eeb5e4d7162fc7f WatchSource:0}: Error finding container 3ee51186ef5da34e5773ad00a7cd97772741dd453f1cd2b26eeb5e4d7162fc7f: Status 404 returned error can't find the container with id 3ee51186ef5da34e5773ad00a7cd97772741dd453f1cd2b26eeb5e4d7162fc7f
Jul 18 01:48:55.141200 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:48:55.141174    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-n8bdx" event={"ID":"25c58f22-7d60-4a06-844f-f3508d910e76","Type":"ContainerStarted","Data":"e0e22ca92b736766211bb70c36202195ee6cc3c2f4c5ed119ca17a4b69d5f79f"}
Jul 18 01:48:55.141587 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:48:55.141219    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-n8bdx" event={"ID":"25c58f22-7d60-4a06-844f-f3508d910e76","Type":"ContainerStarted","Data":"b562787a31d7b49b36c1a4322557c2c1c7337ea2702e029eaea38f1f2f37e105"}
Jul 18 01:48:55.141587 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:48:55.141241    2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-n8bdx"
Jul 18 01:48:55.142502 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:48:55.142473    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-2jzkc" event={"ID":"26d75b92-43d7-43e7-96c8-dd42a5288953","Type":"ContainerStarted","Data":"4c509b4c768f7c26bd76a0fa88cdf2250e831b6505d51ef82b33ce5cf2b91fb3"}
Jul 18 01:48:55.143566 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:48:55.143546    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-pdflp" event={"ID":"7c91433e-b6e6-47a8-8df6-2231cbc7d28c","Type":"ContainerStarted","Data":"3ee51186ef5da34e5773ad00a7cd97772741dd453f1cd2b26eeb5e4d7162fc7f"}
Jul 18 01:48:55.156268 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:48:55.156233    2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-n8bdx" podStartSLOduration=65.15621925 podStartE2EDuration="1m5.15621925s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-18 01:47:50 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-18 01:48:55.15530515 +0000 UTC m=+66.844032598" watchObservedRunningTime="2026-07-18 01:48:55.15621925 +0000 UTC m=+66.844946675"
Jul 18 01:48:55.587272 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:48:55.587229    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/bf30ad74-8679-41d3-aa9d-19b3cea07be7-metrics-tls\") pod \"dns-default-lh5mf\" (UID: \"bf30ad74-8679-41d3-aa9d-19b3cea07be7\") " pod="openshift-dns/dns-default-lh5mf"
Jul 18 01:48:55.590195 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:48:55.590169    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/bf30ad74-8679-41d3-aa9d-19b3cea07be7-metrics-tls\") pod \"dns-default-lh5mf\" (UID: \"bf30ad74-8679-41d3-aa9d-19b3cea07be7\") " pod="openshift-dns/dns-default-lh5mf"
Jul 18 01:48:55.785550 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:48:55.785516    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-ml5qw\""
Jul 18 01:48:55.793623 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:48:55.793570    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-lh5mf"
Jul 18 01:48:55.954668 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:48:55.954636    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-lh5mf"]
Jul 18 01:48:56.237926 ip-10-0-142-238 kubenswrapper[2566]: W0718 01:48:56.237847    2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbf30ad74_8679_41d3_aa9d_19b3cea07be7.slice/crio-c5cd9794f06bccdc325b495a651ef683661fb4eb7535fc6450de1c29e8e51d40 WatchSource:0}: Error finding container c5cd9794f06bccdc325b495a651ef683661fb4eb7535fc6450de1c29e8e51d40: Status 404 returned error can't find the container with id c5cd9794f06bccdc325b495a651ef683661fb4eb7535fc6450de1c29e8e51d40
Jul 18 01:48:57.154252 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:48:57.154155    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-pdflp" event={"ID":"7c91433e-b6e6-47a8-8df6-2231cbc7d28c","Type":"ContainerStarted","Data":"d4c6caf3d4e478bce146d6efdccc24ab9747b0a7d62567ddb3498cbb1f08772d"}
Jul 18 01:48:57.154252 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:48:57.154223    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-pdflp" event={"ID":"7c91433e-b6e6-47a8-8df6-2231cbc7d28c","Type":"ContainerStarted","Data":"646cea15b8ae3aa20b0efc63bd1f8904eeff529b016a746b318acbf5382936cc"}
Jul 18 01:48:57.155922 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:48:57.155890    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-lh5mf" event={"ID":"bf30ad74-8679-41d3-aa9d-19b3cea07be7","Type":"ContainerStarted","Data":"c5cd9794f06bccdc325b495a651ef683661fb4eb7535fc6450de1c29e8e51d40"}
Jul 18 01:48:57.171088 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:48:57.171036    2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-pdflp" podStartSLOduration=65.585173533 podStartE2EDuration="1m7.171022411s" totalImagesPullingTime="1.585848878s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-18 01:47:50 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-18 01:48:57.170219983 +0000 UTC m=+68.858947428" watchObservedRunningTime="2026-07-18 01:48:57.171022411 +0000 UTC m=+68.859749860"
Jul 18 01:48:57.503815 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:48:57.503725    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/a313b3f0-c006-44fc-8b93-d5a250b450ef-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-gfxbj\" (UID: \"a313b3f0-c006-44fc-8b93-d5a250b450ef\") " pod="openshift-insights/insights-runtime-extractor-gfxbj"
Jul 18 01:48:57.504265 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:48:57.503826    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/a313b3f0-c006-44fc-8b93-d5a250b450ef-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-gfxbj\" (UID: \"a313b3f0-c006-44fc-8b93-d5a250b450ef\") " pod="openshift-insights/insights-runtime-extractor-gfxbj"
Jul 18 01:48:57.504647 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:48:57.504601    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/a313b3f0-c006-44fc-8b93-d5a250b450ef-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-gfxbj\" (UID: \"a313b3f0-c006-44fc-8b93-d5a250b450ef\") " pod="openshift-insights/insights-runtime-extractor-gfxbj"
Jul 18 01:48:57.506901 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:48:57.506869    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/a313b3f0-c006-44fc-8b93-d5a250b450ef-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-gfxbj\" (UID: \"a313b3f0-c006-44fc-8b93-d5a250b450ef\") " pod="openshift-insights/insights-runtime-extractor-gfxbj"
Jul 18 01:48:57.618082 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:48:57.618048    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-zn9g6\""
Jul 18 01:48:57.625887 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:48:57.625859    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-gfxbj"
Jul 18 01:48:59.313157 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:48:59.313050    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-gfxbj"]
Jul 18 01:48:59.316054 ip-10-0-142-238 kubenswrapper[2566]: W0718 01:48:59.316023    2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda313b3f0_c006_44fc_8b93_d5a250b450ef.slice/crio-48025339f20090e092e97698990bcd09505e531733ef196a735131616974cae5 WatchSource:0}: Error finding container 48025339f20090e092e97698990bcd09505e531733ef196a735131616974cae5: Status 404 returned error can't find the container with id 48025339f20090e092e97698990bcd09505e531733ef196a735131616974cae5
Jul 18 01:49:00.170863 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:49:00.170821    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-lh5mf" event={"ID":"bf30ad74-8679-41d3-aa9d-19b3cea07be7","Type":"ContainerStarted","Data":"411955f2e3618025e4c503caf9d0adeca666a5f55d318c87a4453055a3374bab"}
Jul 18 01:49:00.171030 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:49:00.170884    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-lh5mf" event={"ID":"bf30ad74-8679-41d3-aa9d-19b3cea07be7","Type":"ContainerStarted","Data":"f0bb810b65ccfb86fd1e5a642f40abbf530555fc51c9b7ccbb5a89fa935b5f4a"}
Jul 18 01:49:00.171030 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:49:00.170911    2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-lh5mf"
Jul 18 01:49:00.172360 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:49:00.172330    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-2jzkc" event={"ID":"26d75b92-43d7-43e7-96c8-dd42a5288953","Type":"ContainerStarted","Data":"5682d30ed329abe89c2635c26fe9c09d19e1519768bad81ec3ad7d32f56e1982"}
Jul 18 01:49:00.173409 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:49:00.173392    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-gfxbj" event={"ID":"a313b3f0-c006-44fc-8b93-d5a250b450ef","Type":"ContainerStarted","Data":"48025339f20090e092e97698990bcd09505e531733ef196a735131616974cae5"}
Jul 18 01:49:00.192544 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:49:00.192503    2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-lh5mf" podStartSLOduration=34.248845568 podStartE2EDuration="37.192489991s" totalImagesPullingTime="2.943644423s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-18 01:48:23 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-18 01:49:00.19112951 +0000 UTC m=+71.879856958" watchObservedRunningTime="2026-07-18 01:49:00.192489991 +0000 UTC m=+71.881217437"
Jul 18 01:49:00.206128 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:49:00.206094    2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-2jzkc" podStartSLOduration=65.86816894 podStartE2EDuration="1m10.206082112s" totalImagesPullingTime="4.337913172s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-18 01:47:50 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-18 01:49:00.205567326 +0000 UTC m=+71.894294775" watchObservedRunningTime="2026-07-18 01:49:00.206082112 +0000 UTC m=+71.894809558"
Jul 18 01:49:04.191005 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:49:04.190968    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-gfxbj" event={"ID":"a313b3f0-c006-44fc-8b93-d5a250b450ef","Type":"ContainerStarted","Data":"d810aba1fe3af3e6558dc78a40d039e81576b86b789a23f196eed0b08047cba2"}
Jul 18 01:49:05.651170 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:49:05.651140    2566 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-5cc4778d68-sk4t6"]
Jul 18 01:49:05.765697 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:49:05.765666    2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-6bc57544c9-t2bd8"]
Jul 18 01:49:05.775896 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:49:05.775871    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-6bc57544c9-t2bd8"
Jul 18 01:49:05.785862 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:49:05.785768    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-6bc57544c9-t2bd8"]
Jul 18 01:49:05.869464 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:49:05.869293    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/381b3b1f-2d24-47ba-99dd-0c27bc36fa5c-ca-trust-extracted\") pod \"image-registry-6bc57544c9-t2bd8\" (UID: \"381b3b1f-2d24-47ba-99dd-0c27bc36fa5c\") " pod="openshift-image-registry/image-registry-6bc57544c9-t2bd8"
Jul 18 01:49:05.869464 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:49:05.869338    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/381b3b1f-2d24-47ba-99dd-0c27bc36fa5c-trusted-ca\") pod \"image-registry-6bc57544c9-t2bd8\" (UID: \"381b3b1f-2d24-47ba-99dd-0c27bc36fa5c\") " pod="openshift-image-registry/image-registry-6bc57544c9-t2bd8"
Jul 18 01:49:05.869464 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:49:05.869376    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/381b3b1f-2d24-47ba-99dd-0c27bc36fa5c-installation-pull-secrets\") pod \"image-registry-6bc57544c9-t2bd8\" (UID: \"381b3b1f-2d24-47ba-99dd-0c27bc36fa5c\") " pod="openshift-image-registry/image-registry-6bc57544c9-t2bd8"
Jul 18 01:49:05.869464 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:49:05.869407    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/381b3b1f-2d24-47ba-99dd-0c27bc36fa5c-bound-sa-token\") pod \"image-registry-6bc57544c9-t2bd8\" (UID: \"381b3b1f-2d24-47ba-99dd-0c27bc36fa5c\") " pod="openshift-image-registry/image-registry-6bc57544c9-t2bd8"
Jul 18 01:49:05.869464 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:49:05.869441    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/381b3b1f-2d24-47ba-99dd-0c27bc36fa5c-registry-certificates\") pod \"image-registry-6bc57544c9-t2bd8\" (UID: \"381b3b1f-2d24-47ba-99dd-0c27bc36fa5c\") " pod="openshift-image-registry/image-registry-6bc57544c9-t2bd8"
Jul 18 01:49:05.869722 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:49:05.869480    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nxtnl\" (UniqueName: \"kubernetes.io/projected/381b3b1f-2d24-47ba-99dd-0c27bc36fa5c-kube-api-access-nxtnl\") pod \"image-registry-6bc57544c9-t2bd8\" (UID: \"381b3b1f-2d24-47ba-99dd-0c27bc36fa5c\") " pod="openshift-image-registry/image-registry-6bc57544c9-t2bd8"
Jul 18 01:49:05.869722 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:49:05.869510    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/381b3b1f-2d24-47ba-99dd-0c27bc36fa5c-image-registry-private-configuration\") pod \"image-registry-6bc57544c9-t2bd8\" (UID: \"381b3b1f-2d24-47ba-99dd-0c27bc36fa5c\") " pod="openshift-image-registry/image-registry-6bc57544c9-t2bd8"
Jul 18 01:49:05.869722 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:49:05.869568    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/381b3b1f-2d24-47ba-99dd-0c27bc36fa5c-registry-tls\") pod \"image-registry-6bc57544c9-t2bd8\" (UID: \"381b3b1f-2d24-47ba-99dd-0c27bc36fa5c\") " pod="openshift-image-registry/image-registry-6bc57544c9-t2bd8"
Jul 18 01:49:05.970241 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:49:05.970210    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/381b3b1f-2d24-47ba-99dd-0c27bc36fa5c-registry-tls\") pod \"image-registry-6bc57544c9-t2bd8\" (UID: \"381b3b1f-2d24-47ba-99dd-0c27bc36fa5c\") " pod="openshift-image-registry/image-registry-6bc57544c9-t2bd8"
Jul 18 01:49:05.970454 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:49:05.970269    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/381b3b1f-2d24-47ba-99dd-0c27bc36fa5c-ca-trust-extracted\") pod \"image-registry-6bc57544c9-t2bd8\" (UID: \"381b3b1f-2d24-47ba-99dd-0c27bc36fa5c\") " pod="openshift-image-registry/image-registry-6bc57544c9-t2bd8"
Jul 18 01:49:05.970454 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:49:05.970316    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/381b3b1f-2d24-47ba-99dd-0c27bc36fa5c-trusted-ca\") pod \"image-registry-6bc57544c9-t2bd8\" (UID: \"381b3b1f-2d24-47ba-99dd-0c27bc36fa5c\") " pod="openshift-image-registry/image-registry-6bc57544c9-t2bd8"
Jul 18 01:49:05.970454 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:49:05.970347    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/381b3b1f-2d24-47ba-99dd-0c27bc36fa5c-installation-pull-secrets\") pod \"image-registry-6bc57544c9-t2bd8\" (UID: \"381b3b1f-2d24-47ba-99dd-0c27bc36fa5c\") " pod="openshift-image-registry/image-registry-6bc57544c9-t2bd8"
Jul 18 01:49:05.970454 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:49:05.970373    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/381b3b1f-2d24-47ba-99dd-0c27bc36fa5c-bound-sa-token\") pod \"image-registry-6bc57544c9-t2bd8\" (UID: \"381b3b1f-2d24-47ba-99dd-0c27bc36fa5c\") " pod="openshift-image-registry/image-registry-6bc57544c9-t2bd8"
Jul 18 01:49:05.970454 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:49:05.970404    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/381b3b1f-2d24-47ba-99dd-0c27bc36fa5c-registry-certificates\") pod \"image-registry-6bc57544c9-t2bd8\" (UID: \"381b3b1f-2d24-47ba-99dd-0c27bc36fa5c\") " pod="openshift-image-registry/image-registry-6bc57544c9-t2bd8"
Jul 18 01:49:05.970454 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:49:05.970436    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nxtnl\" (UniqueName: \"kubernetes.io/projected/381b3b1f-2d24-47ba-99dd-0c27bc36fa5c-kube-api-access-nxtnl\") pod \"image-registry-6bc57544c9-t2bd8\" (UID: \"381b3b1f-2d24-47ba-99dd-0c27bc36fa5c\") " pod="openshift-image-registry/image-registry-6bc57544c9-t2bd8"
Jul 18 01:49:05.970792 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:49:05.970464    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/381b3b1f-2d24-47ba-99dd-0c27bc36fa5c-image-registry-private-configuration\") pod \"image-registry-6bc57544c9-t2bd8\" (UID: \"381b3b1f-2d24-47ba-99dd-0c27bc36fa5c\") " pod="openshift-image-registry/image-registry-6bc57544c9-t2bd8"
Jul 18 01:49:05.970792 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:49:05.970751    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/381b3b1f-2d24-47ba-99dd-0c27bc36fa5c-ca-trust-extracted\") pod \"image-registry-6bc57544c9-t2bd8\" (UID: \"381b3b1f-2d24-47ba-99dd-0c27bc36fa5c\") " pod="openshift-image-registry/image-registry-6bc57544c9-t2bd8"
Jul 18 01:49:05.971795 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:49:05.971748    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/381b3b1f-2d24-47ba-99dd-0c27bc36fa5c-trusted-ca\") pod \"image-registry-6bc57544c9-t2bd8\" (UID: \"381b3b1f-2d24-47ba-99dd-0c27bc36fa5c\") " pod="openshift-image-registry/image-registry-6bc57544c9-t2bd8"
Jul 18 01:49:05.971795 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:49:05.971768    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/381b3b1f-2d24-47ba-99dd-0c27bc36fa5c-registry-certificates\") pod \"image-registry-6bc57544c9-t2bd8\" (UID: \"381b3b1f-2d24-47ba-99dd-0c27bc36fa5c\") " pod="openshift-image-registry/image-registry-6bc57544c9-t2bd8"
Jul 18 01:49:05.973568 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:49:05.973504    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/381b3b1f-2d24-47ba-99dd-0c27bc36fa5c-registry-tls\") pod \"image-registry-6bc57544c9-t2bd8\" (UID: \"381b3b1f-2d24-47ba-99dd-0c27bc36fa5c\") " pod="openshift-image-registry/image-registry-6bc57544c9-t2bd8"
Jul 18 01:49:05.973701 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:49:05.973534    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/381b3b1f-2d24-47ba-99dd-0c27bc36fa5c-image-registry-private-configuration\") pod \"image-registry-6bc57544c9-t2bd8\" (UID: \"381b3b1f-2d24-47ba-99dd-0c27bc36fa5c\") " pod="openshift-image-registry/image-registry-6bc57544c9-t2bd8"
Jul 18 01:49:05.973769 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:49:05.973743    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/381b3b1f-2d24-47ba-99dd-0c27bc36fa5c-installation-pull-secrets\") pod \"image-registry-6bc57544c9-t2bd8\" (UID: \"381b3b1f-2d24-47ba-99dd-0c27bc36fa5c\") " pod="openshift-image-registry/image-registry-6bc57544c9-t2bd8"
Jul 18 01:49:05.998948 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:49:05.998923    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-nxtnl\" (UniqueName: \"kubernetes.io/projected/381b3b1f-2d24-47ba-99dd-0c27bc36fa5c-kube-api-access-nxtnl\") pod \"image-registry-6bc57544c9-t2bd8\" (UID: \"381b3b1f-2d24-47ba-99dd-0c27bc36fa5c\") " pod="openshift-image-registry/image-registry-6bc57544c9-t2bd8"
Jul 18 01:49:05.999947 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:49:05.999924    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/381b3b1f-2d24-47ba-99dd-0c27bc36fa5c-bound-sa-token\") pod \"image-registry-6bc57544c9-t2bd8\" (UID: \"381b3b1f-2d24-47ba-99dd-0c27bc36fa5c\") " pod="openshift-image-registry/image-registry-6bc57544c9-t2bd8"
Jul 18 01:49:06.085567 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:49:06.085534    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-6bc57544c9-t2bd8"
Jul 18 01:49:07.281964 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:49:07.281933    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-6bc57544c9-t2bd8"]
Jul 18 01:49:07.284553 ip-10-0-142-238 kubenswrapper[2566]: W0718 01:49:07.284530    2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod381b3b1f_2d24_47ba_99dd_0c27bc36fa5c.slice/crio-2aa81c2c9f65fef23fab8b33734f13d95b3eb96ea834ebcf77ef35ca7db94081 WatchSource:0}: Error finding container 2aa81c2c9f65fef23fab8b33734f13d95b3eb96ea834ebcf77ef35ca7db94081: Status 404 returned error can't find the container with id 2aa81c2c9f65fef23fab8b33734f13d95b3eb96ea834ebcf77ef35ca7db94081
Jul 18 01:49:08.208274 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:49:08.208231    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-gfxbj" event={"ID":"a313b3f0-c006-44fc-8b93-d5a250b450ef","Type":"ContainerStarted","Data":"5d3520f039ff05e08faf272cefdfe514b76e0844705fc524728d75407ce39617"}
Jul 18 01:49:08.209958 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:49:08.209922    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-6bc57544c9-t2bd8" event={"ID":"381b3b1f-2d24-47ba-99dd-0c27bc36fa5c","Type":"ContainerStarted","Data":"78e75d60c0e30a61f6576bea0fa06790637151b6e7346ccd58a8557d65da4db7"}
Jul 18 01:49:08.210100 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:49:08.209979    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-6bc57544c9-t2bd8" event={"ID":"381b3b1f-2d24-47ba-99dd-0c27bc36fa5c","Type":"ContainerStarted","Data":"2aa81c2c9f65fef23fab8b33734f13d95b3eb96ea834ebcf77ef35ca7db94081"}
Jul 18 01:49:08.210100 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:49:08.210076    2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-6bc57544c9-t2bd8"
Jul 18 01:49:08.270228 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:49:08.270168    2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-6bc57544c9-t2bd8" podStartSLOduration=3.2701481709999998 podStartE2EDuration="3.270148171s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-18 01:49:05 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-18 01:49:08.269274536 +0000 UTC m=+79.958001985" watchObservedRunningTime="2026-07-18 01:49:08.270148171 +0000 UTC m=+79.958875618"
Jul 18 01:49:10.182195 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:49:10.182160    2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-lh5mf"
Jul 18 01:49:11.223222 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:49:11.223153    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-gfxbj" event={"ID":"a313b3f0-c006-44fc-8b93-d5a250b450ef","Type":"ContainerStarted","Data":"f5fe5006d37ab68ff79e2b85d6ce31c836ecbeb53464d5e51272a7249d50982c"}
Jul 18 01:49:11.242459 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:49:11.242412    2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-gfxbj" podStartSLOduration=18.749143303 podStartE2EDuration="30.242396208s" totalImagesPullingTime="11.493252905s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-18 01:48:41 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-18 01:49:11.240607556 +0000 UTC m=+82.929335003" watchObservedRunningTime="2026-07-18 01:49:11.242396208 +0000 UTC m=+82.931123656"
Jul 18 01:49:15.656775 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:49:15.656750    2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-5cc4778d68-sk4t6"
Jul 18 01:49:17.966704 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:49:17.966667    2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-kf4kl"]
Jul 18 01:49:17.973319 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:49:17.973299    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-kf4kl"
Jul 18 01:49:17.975746 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:49:17.975727    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\""
Jul 18 01:49:17.976159 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:49:17.976144    2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\""
Jul 18 01:49:17.976423 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:49:17.976404    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\""
Jul 18 01:49:17.976876 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:49:17.976863    2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\""
Jul 18 01:49:17.977193 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:49:17.977177    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-jzc4s\""
Jul 18 01:49:17.977702 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:49:17.977690    2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\""
Jul 18 01:49:17.983340 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:49:17.983327    2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\""
Jul 18 01:49:18.160009 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:49:18.159971    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hsfqq\" (UniqueName: \"kubernetes.io/projected/dbcde2ae-53a4-41b6-b1b9-5b39eadd9820-kube-api-access-hsfqq\") pod \"node-exporter-kf4kl\" (UID: \"dbcde2ae-53a4-41b6-b1b9-5b39eadd9820\") " pod="openshift-monitoring/node-exporter-kf4kl"
Jul 18 01:49:18.160009 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:49:18.160011    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/dbcde2ae-53a4-41b6-b1b9-5b39eadd9820-node-exporter-wtmp\") pod \"node-exporter-kf4kl\" (UID: \"dbcde2ae-53a4-41b6-b1b9-5b39eadd9820\") " pod="openshift-monitoring/node-exporter-kf4kl"
Jul 18 01:49:18.160200 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:49:18.160085    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/dbcde2ae-53a4-41b6-b1b9-5b39eadd9820-node-exporter-tls\") pod \"node-exporter-kf4kl\" (UID: \"dbcde2ae-53a4-41b6-b1b9-5b39eadd9820\") " pod="openshift-monitoring/node-exporter-kf4kl"
Jul 18 01:49:18.160200 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:49:18.160122    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/dbcde2ae-53a4-41b6-b1b9-5b39eadd9820-sys\") pod \"node-exporter-kf4kl\" (UID: \"dbcde2ae-53a4-41b6-b1b9-5b39eadd9820\") " pod="openshift-monitoring/node-exporter-kf4kl"
Jul 18 01:49:18.160200 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:49:18.160141    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/dbcde2ae-53a4-41b6-b1b9-5b39eadd9820-root\") pod \"node-exporter-kf4kl\" (UID: \"dbcde2ae-53a4-41b6-b1b9-5b39eadd9820\") " pod="openshift-monitoring/node-exporter-kf4kl"
Jul 18 01:49:18.160200 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:49:18.160156    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/dbcde2ae-53a4-41b6-b1b9-5b39eadd9820-metrics-client-ca\") pod \"node-exporter-kf4kl\" (UID: \"dbcde2ae-53a4-41b6-b1b9-5b39eadd9820\") " pod="openshift-monitoring/node-exporter-kf4kl"
Jul 18 01:49:18.160321 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:49:18.160248    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/dbcde2ae-53a4-41b6-b1b9-5b39eadd9820-node-exporter-textfile\") pod \"node-exporter-kf4kl\" (UID: \"dbcde2ae-53a4-41b6-b1b9-5b39eadd9820\") " pod="openshift-monitoring/node-exporter-kf4kl"
Jul 18 01:49:18.160321 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:49:18.160266    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/dbcde2ae-53a4-41b6-b1b9-5b39eadd9820-node-exporter-accelerators-collector-config\") pod \"node-exporter-kf4kl\" (UID: \"dbcde2ae-53a4-41b6-b1b9-5b39eadd9820\") " pod="openshift-monitoring/node-exporter-kf4kl"
Jul 18 01:49:18.160321 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:49:18.160288    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/dbcde2ae-53a4-41b6-b1b9-5b39eadd9820-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-kf4kl\" (UID: \"dbcde2ae-53a4-41b6-b1b9-5b39eadd9820\") " pod="openshift-monitoring/node-exporter-kf4kl"
Jul 18 01:49:18.260846 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:49:18.260782    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/dbcde2ae-53a4-41b6-b1b9-5b39eadd9820-node-exporter-wtmp\") pod \"node-exporter-kf4kl\" (UID: \"dbcde2ae-53a4-41b6-b1b9-5b39eadd9820\") " pod="openshift-monitoring/node-exporter-kf4kl"
Jul 18 01:49:18.260846 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:49:18.260831    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/dbcde2ae-53a4-41b6-b1b9-5b39eadd9820-node-exporter-tls\") pod \"node-exporter-kf4kl\" (UID: \"dbcde2ae-53a4-41b6-b1b9-5b39eadd9820\") " pod="openshift-monitoring/node-exporter-kf4kl"
Jul 18 01:49:18.261018 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:49:18.260851    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/dbcde2ae-53a4-41b6-b1b9-5b39eadd9820-sys\") pod \"node-exporter-kf4kl\" (UID: \"dbcde2ae-53a4-41b6-b1b9-5b39eadd9820\") " pod="openshift-monitoring/node-exporter-kf4kl"
Jul 18 01:49:18.261018 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:49:18.260869    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/dbcde2ae-53a4-41b6-b1b9-5b39eadd9820-root\") pod \"node-exporter-kf4kl\" (UID: \"dbcde2ae-53a4-41b6-b1b9-5b39eadd9820\") " pod="openshift-monitoring/node-exporter-kf4kl"
Jul 18 01:49:18.261018 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:49:18.260890    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/dbcde2ae-53a4-41b6-b1b9-5b39eadd9820-metrics-client-ca\") pod \"node-exporter-kf4kl\" (UID: \"dbcde2ae-53a4-41b6-b1b9-5b39eadd9820\") " pod="openshift-monitoring/node-exporter-kf4kl"
Jul 18 01:49:18.261018 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:49:18.260911    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/dbcde2ae-53a4-41b6-b1b9-5b39eadd9820-node-exporter-textfile\") pod \"node-exporter-kf4kl\" (UID: \"dbcde2ae-53a4-41b6-b1b9-5b39eadd9820\") " pod="openshift-monitoring/node-exporter-kf4kl"
Jul 18 01:49:18.261018 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:49:18.260928    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/dbcde2ae-53a4-41b6-b1b9-5b39eadd9820-node-exporter-accelerators-collector-config\") pod \"node-exporter-kf4kl\" (UID: \"dbcde2ae-53a4-41b6-b1b9-5b39eadd9820\") " pod="openshift-monitoring/node-exporter-kf4kl"
Jul 18 01:49:18.261018 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:49:18.260956    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/dbcde2ae-53a4-41b6-b1b9-5b39eadd9820-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-kf4kl\" (UID: \"dbcde2ae-53a4-41b6-b1b9-5b39eadd9820\") " pod="openshift-monitoring/node-exporter-kf4kl"
Jul 18 01:49:18.261018 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:49:18.260959    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/dbcde2ae-53a4-41b6-b1b9-5b39eadd9820-node-exporter-wtmp\") pod \"node-exporter-kf4kl\" (UID: \"dbcde2ae-53a4-41b6-b1b9-5b39eadd9820\") " pod="openshift-monitoring/node-exporter-kf4kl"
Jul 18 01:49:18.261018 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:49:18.260969    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/dbcde2ae-53a4-41b6-b1b9-5b39eadd9820-root\") pod \"node-exporter-kf4kl\" (UID: \"dbcde2ae-53a4-41b6-b1b9-5b39eadd9820\") " pod="openshift-monitoring/node-exporter-kf4kl"
Jul 18 01:49:18.261018 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:49:18.260985    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hsfqq\" (UniqueName: \"kubernetes.io/projected/dbcde2ae-53a4-41b6-b1b9-5b39eadd9820-kube-api-access-hsfqq\") pod \"node-exporter-kf4kl\" (UID: \"dbcde2ae-53a4-41b6-b1b9-5b39eadd9820\") " pod="openshift-monitoring/node-exporter-kf4kl"
Jul 18 01:49:18.261018 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:49:18.260998    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/dbcde2ae-53a4-41b6-b1b9-5b39eadd9820-sys\") pod \"node-exporter-kf4kl\" (UID: \"dbcde2ae-53a4-41b6-b1b9-5b39eadd9820\") " pod="openshift-monitoring/node-exporter-kf4kl"
Jul 18 01:49:18.261413 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:49:18.261300    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/dbcde2ae-53a4-41b6-b1b9-5b39eadd9820-node-exporter-textfile\") pod \"node-exporter-kf4kl\" (UID: \"dbcde2ae-53a4-41b6-b1b9-5b39eadd9820\") " pod="openshift-monitoring/node-exporter-kf4kl"
Jul 18 01:49:18.261629 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:49:18.261590    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/dbcde2ae-53a4-41b6-b1b9-5b39eadd9820-node-exporter-accelerators-collector-config\") pod \"node-exporter-kf4kl\" (UID: \"dbcde2ae-53a4-41b6-b1b9-5b39eadd9820\") " pod="openshift-monitoring/node-exporter-kf4kl"
Jul 18 01:49:18.261677 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:49:18.261590    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/dbcde2ae-53a4-41b6-b1b9-5b39eadd9820-metrics-client-ca\") pod \"node-exporter-kf4kl\" (UID: \"dbcde2ae-53a4-41b6-b1b9-5b39eadd9820\") " pod="openshift-monitoring/node-exporter-kf4kl"
Jul 18 01:49:18.263121 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:49:18.263103    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/dbcde2ae-53a4-41b6-b1b9-5b39eadd9820-node-exporter-tls\") pod \"node-exporter-kf4kl\" (UID: \"dbcde2ae-53a4-41b6-b1b9-5b39eadd9820\") " pod="openshift-monitoring/node-exporter-kf4kl"
Jul 18 01:49:18.263175 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:49:18.263146    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/dbcde2ae-53a4-41b6-b1b9-5b39eadd9820-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-kf4kl\" (UID: \"dbcde2ae-53a4-41b6-b1b9-5b39eadd9820\") " pod="openshift-monitoring/node-exporter-kf4kl"
Jul 18 01:49:18.268490 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:49:18.268462    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hsfqq\" (UniqueName: \"kubernetes.io/projected/dbcde2ae-53a4-41b6-b1b9-5b39eadd9820-kube-api-access-hsfqq\") pod \"node-exporter-kf4kl\" (UID: \"dbcde2ae-53a4-41b6-b1b9-5b39eadd9820\") " pod="openshift-monitoring/node-exporter-kf4kl"
Jul 18 01:49:18.282377 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:49:18.282356    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-kf4kl"
Jul 18 01:49:18.294576 ip-10-0-142-238 kubenswrapper[2566]: W0718 01:49:18.294552    2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddbcde2ae_53a4_41b6_b1b9_5b39eadd9820.slice/crio-d5a40606b7f7814b1c36d6060fe913cb46de7238caa9f0dd130ad5616024df36 WatchSource:0}: Error finding container d5a40606b7f7814b1c36d6060fe913cb46de7238caa9f0dd130ad5616024df36: Status 404 returned error can't find the container with id d5a40606b7f7814b1c36d6060fe913cb46de7238caa9f0dd130ad5616024df36
Jul 18 01:49:19.250654 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:49:19.250604    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-kf4kl" event={"ID":"dbcde2ae-53a4-41b6-b1b9-5b39eadd9820","Type":"ContainerStarted","Data":"4063f67f0de2f6b32024b11cddc91d32348d9b1715fd0220269c0257bb6c753d"}
Jul 18 01:49:19.250968 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:49:19.250683    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-kf4kl" event={"ID":"dbcde2ae-53a4-41b6-b1b9-5b39eadd9820","Type":"ContainerStarted","Data":"d5a40606b7f7814b1c36d6060fe913cb46de7238caa9f0dd130ad5616024df36"}
Jul 18 01:49:20.256428 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:49:20.256395    2566 generic.go:356] "Generic (PLEG): container finished" podID="dbcde2ae-53a4-41b6-b1b9-5b39eadd9820" containerID="4063f67f0de2f6b32024b11cddc91d32348d9b1715fd0220269c0257bb6c753d" exitCode=0
Jul 18 01:49:20.256916 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:49:20.256463    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-kf4kl" event={"ID":"dbcde2ae-53a4-41b6-b1b9-5b39eadd9820","Type":"ContainerDied","Data":"4063f67f0de2f6b32024b11cddc91d32348d9b1715fd0220269c0257bb6c753d"}
Jul 18 01:49:21.261588 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:49:21.261550    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-kf4kl" event={"ID":"dbcde2ae-53a4-41b6-b1b9-5b39eadd9820","Type":"ContainerStarted","Data":"f43b5184e42bd69aa41c7c03117add21ef997ce0096aefb496706f162e7ab59b"}
Jul 18 01:49:21.261976 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:49:21.261604    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-kf4kl" event={"ID":"dbcde2ae-53a4-41b6-b1b9-5b39eadd9820","Type":"ContainerStarted","Data":"3b58574becff0338ea3fbd831194b6e912da32d43c13e42f9bd53c46f2502668"}
Jul 18 01:49:21.284330 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:49:21.284284    2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-kf4kl" podStartSLOduration=3.331979982 podStartE2EDuration="4.284269796s" totalImagesPullingTime="891.896721ms" totalInitContainerRuntime="60.393093ms" isStatefulPod=true podCreationTimestamp="2026-07-18 01:49:17 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-18 01:49:21.282581921 +0000 UTC m=+92.971309368" watchObservedRunningTime="2026-07-18 01:49:21.284269796 +0000 UTC m=+92.972997281"
Jul 18 01:49:26.149339 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:49:26.149307    2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-n8bdx"
Jul 18 01:49:29.218065 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:49:29.218036    2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-6bc57544c9-t2bd8"
Jul 18 01:49:30.672687 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:49:30.672639    2566 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-image-registry/image-registry-5cc4778d68-sk4t6" podUID="276db0cf-ad20-45dc-b0a4-53079f105793" containerName="registry" containerID="cri-o://98f67bc76eb27f6be5613adb5df17f4b364557f2f5b60fcfe42e83d11bdce380" gracePeriod=30
Jul 18 01:49:30.925981 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:49:30.925921    2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-5cc4778d68-sk4t6"
Jul 18 01:49:30.950022 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:49:30.949992    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/276db0cf-ad20-45dc-b0a4-53079f105793-registry-tls\") pod \"276db0cf-ad20-45dc-b0a4-53079f105793\" (UID: \"276db0cf-ad20-45dc-b0a4-53079f105793\") "
Jul 18 01:49:30.950192 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:49:30.950170    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/276db0cf-ad20-45dc-b0a4-53079f105793-bound-sa-token\") pod \"276db0cf-ad20-45dc-b0a4-53079f105793\" (UID: \"276db0cf-ad20-45dc-b0a4-53079f105793\") "
Jul 18 01:49:30.950248 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:49:30.950230    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/276db0cf-ad20-45dc-b0a4-53079f105793-image-registry-private-configuration\") pod \"276db0cf-ad20-45dc-b0a4-53079f105793\" (UID: \"276db0cf-ad20-45dc-b0a4-53079f105793\") "
Jul 18 01:49:30.950316 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:49:30.950285    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/276db0cf-ad20-45dc-b0a4-53079f105793-ca-trust-extracted\") pod \"276db0cf-ad20-45dc-b0a4-53079f105793\" (UID: \"276db0cf-ad20-45dc-b0a4-53079f105793\") "
Jul 18 01:49:30.950395 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:49:30.950321    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/276db0cf-ad20-45dc-b0a4-53079f105793-registry-certificates\") pod \"276db0cf-ad20-45dc-b0a4-53079f105793\" (UID: \"276db0cf-ad20-45dc-b0a4-53079f105793\") "
Jul 18 01:49:30.950395 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:49:30.950358    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/276db0cf-ad20-45dc-b0a4-53079f105793-trusted-ca\") pod \"276db0cf-ad20-45dc-b0a4-53079f105793\" (UID: \"276db0cf-ad20-45dc-b0a4-53079f105793\") "
Jul 18 01:49:30.950395 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:49:30.950392    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-rrf2f\" (UniqueName: \"kubernetes.io/projected/276db0cf-ad20-45dc-b0a4-53079f105793-kube-api-access-rrf2f\") pod \"276db0cf-ad20-45dc-b0a4-53079f105793\" (UID: \"276db0cf-ad20-45dc-b0a4-53079f105793\") "
Jul 18 01:49:30.950547 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:49:30.950416    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/276db0cf-ad20-45dc-b0a4-53079f105793-installation-pull-secrets\") pod \"276db0cf-ad20-45dc-b0a4-53079f105793\" (UID: \"276db0cf-ad20-45dc-b0a4-53079f105793\") "
Jul 18 01:49:30.951373 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:49:30.951317    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/276db0cf-ad20-45dc-b0a4-53079f105793-trusted-ca" (OuterVolumeSpecName: "trusted-ca") pod "276db0cf-ad20-45dc-b0a4-53079f105793" (UID: "276db0cf-ad20-45dc-b0a4-53079f105793"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 18 01:49:30.951733 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:49:30.951697    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/276db0cf-ad20-45dc-b0a4-53079f105793-registry-certificates" (OuterVolumeSpecName: "registry-certificates") pod "276db0cf-ad20-45dc-b0a4-53079f105793" (UID: "276db0cf-ad20-45dc-b0a4-53079f105793"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 18 01:49:30.952761 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:49:30.952715    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/276db0cf-ad20-45dc-b0a4-53079f105793-bound-sa-token" (OuterVolumeSpecName: "bound-sa-token") pod "276db0cf-ad20-45dc-b0a4-53079f105793" (UID: "276db0cf-ad20-45dc-b0a4-53079f105793"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 18 01:49:30.952852 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:49:30.952794    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/276db0cf-ad20-45dc-b0a4-53079f105793-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "276db0cf-ad20-45dc-b0a4-53079f105793" (UID: "276db0cf-ad20-45dc-b0a4-53079f105793"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 18 01:49:30.952913 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:49:30.952877    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/276db0cf-ad20-45dc-b0a4-53079f105793-image-registry-private-configuration" (OuterVolumeSpecName: "image-registry-private-configuration") pod "276db0cf-ad20-45dc-b0a4-53079f105793" (UID: "276db0cf-ad20-45dc-b0a4-53079f105793"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 18 01:49:30.952961 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:49:30.952950    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/276db0cf-ad20-45dc-b0a4-53079f105793-installation-pull-secrets" (OuterVolumeSpecName: "installation-pull-secrets") pod "276db0cf-ad20-45dc-b0a4-53079f105793" (UID: "276db0cf-ad20-45dc-b0a4-53079f105793"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 18 01:49:30.953107 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:49:30.953084    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/276db0cf-ad20-45dc-b0a4-53079f105793-kube-api-access-rrf2f" (OuterVolumeSpecName: "kube-api-access-rrf2f") pod "276db0cf-ad20-45dc-b0a4-53079f105793" (UID: "276db0cf-ad20-45dc-b0a4-53079f105793"). InnerVolumeSpecName "kube-api-access-rrf2f". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 18 01:49:30.961906 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:49:30.961879    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/276db0cf-ad20-45dc-b0a4-53079f105793-ca-trust-extracted" (OuterVolumeSpecName: "ca-trust-extracted") pod "276db0cf-ad20-45dc-b0a4-53079f105793" (UID: "276db0cf-ad20-45dc-b0a4-53079f105793"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 18 01:49:31.051578 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:49:31.051546    2566 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/276db0cf-ad20-45dc-b0a4-53079f105793-trusted-ca\") on node \"ip-10-0-142-238.ec2.internal\" DevicePath \"\""
Jul 18 01:49:31.051578 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:49:31.051574    2566 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-rrf2f\" (UniqueName: \"kubernetes.io/projected/276db0cf-ad20-45dc-b0a4-53079f105793-kube-api-access-rrf2f\") on node \"ip-10-0-142-238.ec2.internal\" DevicePath \"\""
Jul 18 01:49:31.051754 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:49:31.051588    2566 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/276db0cf-ad20-45dc-b0a4-53079f105793-installation-pull-secrets\") on node \"ip-10-0-142-238.ec2.internal\" DevicePath \"\""
Jul 18 01:49:31.051754 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:49:31.051600    2566 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/276db0cf-ad20-45dc-b0a4-53079f105793-registry-tls\") on node \"ip-10-0-142-238.ec2.internal\" DevicePath \"\""
Jul 18 01:49:31.051754 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:49:31.051634    2566 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/276db0cf-ad20-45dc-b0a4-53079f105793-bound-sa-token\") on node \"ip-10-0-142-238.ec2.internal\" DevicePath \"\""
Jul 18 01:49:31.051754 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:49:31.051646    2566 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/276db0cf-ad20-45dc-b0a4-53079f105793-image-registry-private-configuration\") on node \"ip-10-0-142-238.ec2.internal\" DevicePath \"\""
Jul 18 01:49:31.051754 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:49:31.051658    2566 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/276db0cf-ad20-45dc-b0a4-53079f105793-ca-trust-extracted\") on node \"ip-10-0-142-238.ec2.internal\" DevicePath \"\""
Jul 18 01:49:31.051754 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:49:31.051669    2566 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/276db0cf-ad20-45dc-b0a4-53079f105793-registry-certificates\") on node \"ip-10-0-142-238.ec2.internal\" DevicePath \"\""
Jul 18 01:49:31.295634 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:49:31.295590    2566 generic.go:356] "Generic (PLEG): container finished" podID="276db0cf-ad20-45dc-b0a4-53079f105793" containerID="98f67bc76eb27f6be5613adb5df17f4b364557f2f5b60fcfe42e83d11bdce380" exitCode=0
Jul 18 01:49:31.295814 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:49:31.295657    2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-5cc4778d68-sk4t6"
Jul 18 01:49:31.295814 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:49:31.295676    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-5cc4778d68-sk4t6" event={"ID":"276db0cf-ad20-45dc-b0a4-53079f105793","Type":"ContainerDied","Data":"98f67bc76eb27f6be5613adb5df17f4b364557f2f5b60fcfe42e83d11bdce380"}
Jul 18 01:49:31.295814 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:49:31.295736    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-5cc4778d68-sk4t6" event={"ID":"276db0cf-ad20-45dc-b0a4-53079f105793","Type":"ContainerDied","Data":"0fd9f3c7acfba2f870c30582b17540d5ca793a8ef506edafbb150ad43f9ca2e7"}
Jul 18 01:49:31.295814 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:49:31.295775    2566 scope.go:117] "RemoveContainer" containerID="98f67bc76eb27f6be5613adb5df17f4b364557f2f5b60fcfe42e83d11bdce380"
Jul 18 01:49:31.303914 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:49:31.303897    2566 scope.go:117] "RemoveContainer" containerID="98f67bc76eb27f6be5613adb5df17f4b364557f2f5b60fcfe42e83d11bdce380"
Jul 18 01:49:31.304171 ip-10-0-142-238 kubenswrapper[2566]: E0718 01:49:31.304151    2566 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"98f67bc76eb27f6be5613adb5df17f4b364557f2f5b60fcfe42e83d11bdce380\": container with ID starting with 98f67bc76eb27f6be5613adb5df17f4b364557f2f5b60fcfe42e83d11bdce380 not found: ID does not exist" containerID="98f67bc76eb27f6be5613adb5df17f4b364557f2f5b60fcfe42e83d11bdce380"
Jul 18 01:49:31.304239 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:49:31.304183    2566 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"98f67bc76eb27f6be5613adb5df17f4b364557f2f5b60fcfe42e83d11bdce380"} err="failed to get container status \"98f67bc76eb27f6be5613adb5df17f4b364557f2f5b60fcfe42e83d11bdce380\": rpc error: code = NotFound desc = could not find container \"98f67bc76eb27f6be5613adb5df17f4b364557f2f5b60fcfe42e83d11bdce380\": container with ID starting with 98f67bc76eb27f6be5613adb5df17f4b364557f2f5b60fcfe42e83d11bdce380 not found: ID does not exist"
Jul 18 01:49:31.315377 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:49:31.315352    2566 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-5cc4778d68-sk4t6"]
Jul 18 01:49:31.318982 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:49:31.318962    2566 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-5cc4778d68-sk4t6"]
Jul 18 01:49:32.814378 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:49:32.814339    2566 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="276db0cf-ad20-45dc-b0a4-53079f105793" path="/var/lib/kubelet/pods/276db0cf-ad20-45dc-b0a4-53079f105793/volumes"
Jul 18 01:50:02.402205 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:50:02.402170    2566 generic.go:356] "Generic (PLEG): container finished" podID="26d03adb-3892-4d46-a693-735f83aee367" containerID="c239d610219c92488532033f369c7a9221af16e78c35cc3918f520080044b9c2" exitCode=0
Jul 18 01:50:02.402594 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:50:02.402223    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-zldws" event={"ID":"26d03adb-3892-4d46-a693-735f83aee367","Type":"ContainerDied","Data":"c239d610219c92488532033f369c7a9221af16e78c35cc3918f520080044b9c2"}
Jul 18 01:50:02.402594 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:50:02.402516    2566 scope.go:117] "RemoveContainer" containerID="c239d610219c92488532033f369c7a9221af16e78c35cc3918f520080044b9c2"
Jul 18 01:50:03.407472 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:50:03.407432    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-zldws" event={"ID":"26d03adb-3892-4d46-a693-735f83aee367","Type":"ContainerStarted","Data":"8eef26898d0f63554af4fc1b80a3bfefa1484b345bcc7c31e39a2a9c2346d3b2"}
Jul 18 01:50:06.419209 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:50:06.419176    2566 generic.go:356] "Generic (PLEG): container finished" podID="efcaba5e-5f68-4e32-9930-0e11bc9f9363" containerID="9287468a55d4cb1dd67510929f85d8490fe348d4901c0ee222620b01ca090944" exitCode=0
Jul 18 01:50:06.419546 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:50:06.419229    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-555d9d7885-d2pwt" event={"ID":"efcaba5e-5f68-4e32-9930-0e11bc9f9363","Type":"ContainerDied","Data":"9287468a55d4cb1dd67510929f85d8490fe348d4901c0ee222620b01ca090944"}
Jul 18 01:50:06.419585 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:50:06.419568    2566 scope.go:117] "RemoveContainer" containerID="9287468a55d4cb1dd67510929f85d8490fe348d4901c0ee222620b01ca090944"
Jul 18 01:50:07.424444 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:50:07.424407    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-555d9d7885-d2pwt" event={"ID":"efcaba5e-5f68-4e32-9930-0e11bc9f9363","Type":"ContainerStarted","Data":"74319f7213f1e4f93df220418e1e3b93e47f2661d3dcc15f2d532811f0e5f9c8"}
Jul 18 01:51:08.938356 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:51:08.938279    2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-79689d56d7-6whch"]
Jul 18 01:51:08.938847 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:51:08.938522    2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="276db0cf-ad20-45dc-b0a4-53079f105793" containerName="registry"
Jul 18 01:51:08.938847 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:51:08.938532    2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="276db0cf-ad20-45dc-b0a4-53079f105793" containerName="registry"
Jul 18 01:51:08.938847 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:51:08.938581    2566 memory_manager.go:368] "RemoveStaleState removing state" podUID="276db0cf-ad20-45dc-b0a4-53079f105793" containerName="registry"
Jul 18 01:51:08.941445 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:51:08.941429    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-79689d56d7-6whch"
Jul 18 01:51:08.943821 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:51:08.943790    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"open-cluster-management-image-pull-credentials\""
Jul 18 01:51:08.943968 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:51:08.943855    2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"openshift-service-ca.crt\""
Jul 18 01:51:08.943968 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:51:08.943858    2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"kube-root-ca.crt\""
Jul 18 01:51:08.944661 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:51:08.944646    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"work-manager-hub-kubeconfig\""
Jul 18 01:51:08.951744 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:51:08.951722    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-79689d56d7-6whch"]
Jul 18 01:51:09.010520 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:51:09.010494    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/3b9d2d18-9544-4133-bf5f-ea0393959b7b-tmp\") pod \"klusterlet-addon-workmgr-79689d56d7-6whch\" (UID: \"3b9d2d18-9544-4133-bf5f-ea0393959b7b\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-79689d56d7-6whch"
Jul 18 01:51:09.010643 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:51:09.010528    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2dwvq\" (UniqueName: \"kubernetes.io/projected/3b9d2d18-9544-4133-bf5f-ea0393959b7b-kube-api-access-2dwvq\") pod \"klusterlet-addon-workmgr-79689d56d7-6whch\" (UID: \"3b9d2d18-9544-4133-bf5f-ea0393959b7b\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-79689d56d7-6whch"
Jul 18 01:51:09.010643 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:51:09.010577    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/3b9d2d18-9544-4133-bf5f-ea0393959b7b-klusterlet-config\") pod \"klusterlet-addon-workmgr-79689d56d7-6whch\" (UID: \"3b9d2d18-9544-4133-bf5f-ea0393959b7b\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-79689d56d7-6whch"
Jul 18 01:51:09.111666 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:51:09.111635    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/3b9d2d18-9544-4133-bf5f-ea0393959b7b-tmp\") pod \"klusterlet-addon-workmgr-79689d56d7-6whch\" (UID: \"3b9d2d18-9544-4133-bf5f-ea0393959b7b\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-79689d56d7-6whch"
Jul 18 01:51:09.111757 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:51:09.111677    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2dwvq\" (UniqueName: \"kubernetes.io/projected/3b9d2d18-9544-4133-bf5f-ea0393959b7b-kube-api-access-2dwvq\") pod \"klusterlet-addon-workmgr-79689d56d7-6whch\" (UID: \"3b9d2d18-9544-4133-bf5f-ea0393959b7b\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-79689d56d7-6whch"
Jul 18 01:51:09.111757 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:51:09.111720    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/3b9d2d18-9544-4133-bf5f-ea0393959b7b-klusterlet-config\") pod \"klusterlet-addon-workmgr-79689d56d7-6whch\" (UID: \"3b9d2d18-9544-4133-bf5f-ea0393959b7b\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-79689d56d7-6whch"
Jul 18 01:51:09.111981 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:51:09.111962    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/3b9d2d18-9544-4133-bf5f-ea0393959b7b-tmp\") pod \"klusterlet-addon-workmgr-79689d56d7-6whch\" (UID: \"3b9d2d18-9544-4133-bf5f-ea0393959b7b\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-79689d56d7-6whch"
Jul 18 01:51:09.113949 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:51:09.113933    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/3b9d2d18-9544-4133-bf5f-ea0393959b7b-klusterlet-config\") pod \"klusterlet-addon-workmgr-79689d56d7-6whch\" (UID: \"3b9d2d18-9544-4133-bf5f-ea0393959b7b\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-79689d56d7-6whch"
Jul 18 01:51:09.119857 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:51:09.119834    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2dwvq\" (UniqueName: \"kubernetes.io/projected/3b9d2d18-9544-4133-bf5f-ea0393959b7b-kube-api-access-2dwvq\") pod \"klusterlet-addon-workmgr-79689d56d7-6whch\" (UID: \"3b9d2d18-9544-4133-bf5f-ea0393959b7b\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-79689d56d7-6whch"
Jul 18 01:51:09.250257 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:51:09.250203    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-79689d56d7-6whch"
Jul 18 01:51:09.372112 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:51:09.372082    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-79689d56d7-6whch"]
Jul 18 01:51:09.374955 ip-10-0-142-238 kubenswrapper[2566]: W0718 01:51:09.374928    2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3b9d2d18_9544_4133_bf5f_ea0393959b7b.slice/crio-62d0fd6b6ee2107dd116c7d9ee4aa38385a71fd82e3bbc230084d7a6c252d376 WatchSource:0}: Error finding container 62d0fd6b6ee2107dd116c7d9ee4aa38385a71fd82e3bbc230084d7a6c252d376: Status 404 returned error can't find the container with id 62d0fd6b6ee2107dd116c7d9ee4aa38385a71fd82e3bbc230084d7a6c252d376
Jul 18 01:51:09.632003 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:51:09.631970    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-79689d56d7-6whch" event={"ID":"3b9d2d18-9544-4133-bf5f-ea0393959b7b","Type":"ContainerStarted","Data":"62d0fd6b6ee2107dd116c7d9ee4aa38385a71fd82e3bbc230084d7a6c252d376"}
Jul 18 01:51:13.648604 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:51:13.648562    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-79689d56d7-6whch" event={"ID":"3b9d2d18-9544-4133-bf5f-ea0393959b7b","Type":"ContainerStarted","Data":"366f9658ca463ebae049a7f9fa70f27c74c9216d162960003440517e18a6601b"}
Jul 18 01:51:13.649030 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:51:13.648710    2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-79689d56d7-6whch"
Jul 18 01:51:13.650569 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:51:13.650548    2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-79689d56d7-6whch"
Jul 18 01:51:13.664312 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:51:13.664270    2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-79689d56d7-6whch" podStartSLOduration=2.159764545 podStartE2EDuration="5.664259061s" totalImagesPullingTime="3.504494516s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-18 01:51:08 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-18 01:51:13.663430662 +0000 UTC m=+205.352158109" watchObservedRunningTime="2026-07-18 01:51:13.664259061 +0000 UTC m=+205.352986508"
Jul 18 01:51:31.402343 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:51:31.402306    2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e6754074t79"]
Jul 18 01:51:31.405697 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:51:31.405682    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e6754074t79"
Jul 18 01:51:31.408170 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:51:31.408142    2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\""
Jul 18 01:51:31.408170 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:51:31.408156    2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\""
Jul 18 01:51:31.408967 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:51:31.408939    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-pgpkr\""
Jul 18 01:51:31.413720 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:51:31.413697    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e6754074t79"]
Jul 18 01:51:31.475367 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:51:31.475339    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/3cf03f40-20cc-41d0-992a-f5f95cfa9e55-util\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e6754074t79\" (UID: \"3cf03f40-20cc-41d0-992a-f5f95cfa9e55\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e6754074t79"
Jul 18 01:51:31.475503 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:51:31.475381    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/3cf03f40-20cc-41d0-992a-f5f95cfa9e55-bundle\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e6754074t79\" (UID: \"3cf03f40-20cc-41d0-992a-f5f95cfa9e55\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e6754074t79"
Jul 18 01:51:31.475503 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:51:31.475438    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dlzs8\" (UniqueName: \"kubernetes.io/projected/3cf03f40-20cc-41d0-992a-f5f95cfa9e55-kube-api-access-dlzs8\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e6754074t79\" (UID: \"3cf03f40-20cc-41d0-992a-f5f95cfa9e55\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e6754074t79"
Jul 18 01:51:31.575900 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:51:31.575864    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dlzs8\" (UniqueName: \"kubernetes.io/projected/3cf03f40-20cc-41d0-992a-f5f95cfa9e55-kube-api-access-dlzs8\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e6754074t79\" (UID: \"3cf03f40-20cc-41d0-992a-f5f95cfa9e55\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e6754074t79"
Jul 18 01:51:31.576038 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:51:31.575916    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/3cf03f40-20cc-41d0-992a-f5f95cfa9e55-util\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e6754074t79\" (UID: \"3cf03f40-20cc-41d0-992a-f5f95cfa9e55\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e6754074t79"
Jul 18 01:51:31.576038 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:51:31.575953    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/3cf03f40-20cc-41d0-992a-f5f95cfa9e55-bundle\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e6754074t79\" (UID: \"3cf03f40-20cc-41d0-992a-f5f95cfa9e55\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e6754074t79"
Jul 18 01:51:31.576334 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:51:31.576317    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/3cf03f40-20cc-41d0-992a-f5f95cfa9e55-bundle\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e6754074t79\" (UID: \"3cf03f40-20cc-41d0-992a-f5f95cfa9e55\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e6754074t79"
Jul 18 01:51:31.576369 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:51:31.576332    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/3cf03f40-20cc-41d0-992a-f5f95cfa9e55-util\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e6754074t79\" (UID: \"3cf03f40-20cc-41d0-992a-f5f95cfa9e55\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e6754074t79"
Jul 18 01:51:31.584175 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:51:31.584152    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dlzs8\" (UniqueName: \"kubernetes.io/projected/3cf03f40-20cc-41d0-992a-f5f95cfa9e55-kube-api-access-dlzs8\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e6754074t79\" (UID: \"3cf03f40-20cc-41d0-992a-f5f95cfa9e55\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e6754074t79"
Jul 18 01:51:31.713918 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:51:31.713842    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e6754074t79"
Jul 18 01:51:31.833798 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:51:31.833776    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e6754074t79"]
Jul 18 01:51:31.836192 ip-10-0-142-238 kubenswrapper[2566]: W0718 01:51:31.836163    2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3cf03f40_20cc_41d0_992a_f5f95cfa9e55.slice/crio-e03be9ee590dec72d6a2b1a71de3e8486fa552f93e4dca4ae499a5e99292266d WatchSource:0}: Error finding container e03be9ee590dec72d6a2b1a71de3e8486fa552f93e4dca4ae499a5e99292266d: Status 404 returned error can't find the container with id e03be9ee590dec72d6a2b1a71de3e8486fa552f93e4dca4ae499a5e99292266d
Jul 18 01:51:32.714011 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:51:32.713979    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e6754074t79" event={"ID":"3cf03f40-20cc-41d0-992a-f5f95cfa9e55","Type":"ContainerStarted","Data":"e03be9ee590dec72d6a2b1a71de3e8486fa552f93e4dca4ae499a5e99292266d"}
Jul 18 01:51:38.739369 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:51:38.739332    2566 generic.go:356] "Generic (PLEG): container finished" podID="3cf03f40-20cc-41d0-992a-f5f95cfa9e55" containerID="939b39ec2f77f94d8293cc28778232b8613c2d9d9d5b2027a8e2de6bed98369f" exitCode=0
Jul 18 01:51:38.739369 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:51:38.739372    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e6754074t79" event={"ID":"3cf03f40-20cc-41d0-992a-f5f95cfa9e55","Type":"ContainerDied","Data":"939b39ec2f77f94d8293cc28778232b8613c2d9d9d5b2027a8e2de6bed98369f"}
Jul 18 01:51:41.754013 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:51:41.753952    2566 generic.go:356] "Generic (PLEG): container finished" podID="3cf03f40-20cc-41d0-992a-f5f95cfa9e55" containerID="d7f7d702c4d5a69206f4e9fe5cd842d3e0dda0b03b6223914c2af0a1dcc7a962" exitCode=0
Jul 18 01:51:41.754314 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:51:41.754018    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e6754074t79" event={"ID":"3cf03f40-20cc-41d0-992a-f5f95cfa9e55","Type":"ContainerDied","Data":"d7f7d702c4d5a69206f4e9fe5cd842d3e0dda0b03b6223914c2af0a1dcc7a962"}
Jul 18 01:51:49.783264 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:51:49.783226    2566 generic.go:356] "Generic (PLEG): container finished" podID="3cf03f40-20cc-41d0-992a-f5f95cfa9e55" containerID="b402eed878af27404cda049e23a9c40c462bf254d6fff2382bd1c3043a8b666b" exitCode=0
Jul 18 01:51:49.783685 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:51:49.783302    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e6754074t79" event={"ID":"3cf03f40-20cc-41d0-992a-f5f95cfa9e55","Type":"ContainerDied","Data":"b402eed878af27404cda049e23a9c40c462bf254d6fff2382bd1c3043a8b666b"}
Jul 18 01:51:50.905445 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:51:50.905406    2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e6754074t79"
Jul 18 01:51:51.021797 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:51:51.021774    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/3cf03f40-20cc-41d0-992a-f5f95cfa9e55-util\") pod \"3cf03f40-20cc-41d0-992a-f5f95cfa9e55\" (UID: \"3cf03f40-20cc-41d0-992a-f5f95cfa9e55\") "
Jul 18 01:51:51.021928 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:51:51.021811    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-dlzs8\" (UniqueName: \"kubernetes.io/projected/3cf03f40-20cc-41d0-992a-f5f95cfa9e55-kube-api-access-dlzs8\") pod \"3cf03f40-20cc-41d0-992a-f5f95cfa9e55\" (UID: \"3cf03f40-20cc-41d0-992a-f5f95cfa9e55\") "
Jul 18 01:51:51.021928 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:51:51.021834    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/3cf03f40-20cc-41d0-992a-f5f95cfa9e55-bundle\") pod \"3cf03f40-20cc-41d0-992a-f5f95cfa9e55\" (UID: \"3cf03f40-20cc-41d0-992a-f5f95cfa9e55\") "
Jul 18 01:51:51.022455 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:51:51.022428    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3cf03f40-20cc-41d0-992a-f5f95cfa9e55-bundle" (OuterVolumeSpecName: "bundle") pod "3cf03f40-20cc-41d0-992a-f5f95cfa9e55" (UID: "3cf03f40-20cc-41d0-992a-f5f95cfa9e55"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 18 01:51:51.023783 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:51:51.023755    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3cf03f40-20cc-41d0-992a-f5f95cfa9e55-kube-api-access-dlzs8" (OuterVolumeSpecName: "kube-api-access-dlzs8") pod "3cf03f40-20cc-41d0-992a-f5f95cfa9e55" (UID: "3cf03f40-20cc-41d0-992a-f5f95cfa9e55"). InnerVolumeSpecName "kube-api-access-dlzs8". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 18 01:51:51.025809 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:51:51.025789    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3cf03f40-20cc-41d0-992a-f5f95cfa9e55-util" (OuterVolumeSpecName: "util") pod "3cf03f40-20cc-41d0-992a-f5f95cfa9e55" (UID: "3cf03f40-20cc-41d0-992a-f5f95cfa9e55"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 18 01:51:51.122966 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:51:51.122903    2566 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/3cf03f40-20cc-41d0-992a-f5f95cfa9e55-util\") on node \"ip-10-0-142-238.ec2.internal\" DevicePath \"\""
Jul 18 01:51:51.122966 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:51:51.122928    2566 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-dlzs8\" (UniqueName: \"kubernetes.io/projected/3cf03f40-20cc-41d0-992a-f5f95cfa9e55-kube-api-access-dlzs8\") on node \"ip-10-0-142-238.ec2.internal\" DevicePath \"\""
Jul 18 01:51:51.122966 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:51:51.122942    2566 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/3cf03f40-20cc-41d0-992a-f5f95cfa9e55-bundle\") on node \"ip-10-0-142-238.ec2.internal\" DevicePath \"\""
Jul 18 01:51:51.792131 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:51:51.792099    2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e6754074t79"
Jul 18 01:51:51.792311 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:51:51.792093    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e6754074t79" event={"ID":"3cf03f40-20cc-41d0-992a-f5f95cfa9e55","Type":"ContainerDied","Data":"e03be9ee590dec72d6a2b1a71de3e8486fa552f93e4dca4ae499a5e99292266d"}
Jul 18 01:51:51.792311 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:51:51.792226    2566 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="e03be9ee590dec72d6a2b1a71de3e8486fa552f93e4dca4ae499a5e99292266d"
Jul 18 01:51:59.470509 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:51:59.470473    2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-rnjvv"]
Jul 18 01:51:59.470952 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:51:59.470865    2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3cf03f40-20cc-41d0-992a-f5f95cfa9e55" containerName="util"
Jul 18 01:51:59.470952 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:51:59.470882    2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="3cf03f40-20cc-41d0-992a-f5f95cfa9e55" containerName="util"
Jul 18 01:51:59.470952 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:51:59.470898    2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3cf03f40-20cc-41d0-992a-f5f95cfa9e55" containerName="extract"
Jul 18 01:51:59.470952 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:51:59.470908    2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="3cf03f40-20cc-41d0-992a-f5f95cfa9e55" containerName="extract"
Jul 18 01:51:59.470952 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:51:59.470935    2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3cf03f40-20cc-41d0-992a-f5f95cfa9e55" containerName="pull"
Jul 18 01:51:59.470952 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:51:59.470945    2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="3cf03f40-20cc-41d0-992a-f5f95cfa9e55" containerName="pull"
Jul 18 01:51:59.471129 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:51:59.471005    2566 memory_manager.go:368] "RemoveStaleState removing state" podUID="3cf03f40-20cc-41d0-992a-f5f95cfa9e55" containerName="extract"
Jul 18 01:51:59.474258 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:51:59.474240    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-rnjvv"
Jul 18 01:51:59.476739 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:51:59.476719    2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager-operator\"/\"openshift-service-ca.crt\""
Jul 18 01:51:59.476831 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:51:59.476808    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager-operator\"/\"cert-manager-operator-controller-manager-dockercfg-68ckr\""
Jul 18 01:51:59.476884 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:51:59.476866    2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager-operator\"/\"kube-root-ca.crt\""
Jul 18 01:51:59.484968 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:51:59.484947    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-rnjvv"]
Jul 18 01:51:59.586287 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:51:59.586263    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/fbe4651f-95a2-44de-b5d9-53fe42ba8804-tmp\") pod \"cert-manager-operator-controller-manager-55c444bf86-rnjvv\" (UID: \"fbe4651f-95a2-44de-b5d9-53fe42ba8804\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-rnjvv"
Jul 18 01:51:59.586399 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:51:59.586295    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2zftj\" (UniqueName: \"kubernetes.io/projected/fbe4651f-95a2-44de-b5d9-53fe42ba8804-kube-api-access-2zftj\") pod \"cert-manager-operator-controller-manager-55c444bf86-rnjvv\" (UID: \"fbe4651f-95a2-44de-b5d9-53fe42ba8804\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-rnjvv"
Jul 18 01:51:59.686763 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:51:59.686733    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/fbe4651f-95a2-44de-b5d9-53fe42ba8804-tmp\") pod \"cert-manager-operator-controller-manager-55c444bf86-rnjvv\" (UID: \"fbe4651f-95a2-44de-b5d9-53fe42ba8804\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-rnjvv"
Jul 18 01:51:59.686864 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:51:59.686770    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2zftj\" (UniqueName: \"kubernetes.io/projected/fbe4651f-95a2-44de-b5d9-53fe42ba8804-kube-api-access-2zftj\") pod \"cert-manager-operator-controller-manager-55c444bf86-rnjvv\" (UID: \"fbe4651f-95a2-44de-b5d9-53fe42ba8804\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-rnjvv"
Jul 18 01:51:59.687098 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:51:59.687081    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/fbe4651f-95a2-44de-b5d9-53fe42ba8804-tmp\") pod \"cert-manager-operator-controller-manager-55c444bf86-rnjvv\" (UID: \"fbe4651f-95a2-44de-b5d9-53fe42ba8804\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-rnjvv"
Jul 18 01:51:59.694770 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:51:59.694752    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2zftj\" (UniqueName: \"kubernetes.io/projected/fbe4651f-95a2-44de-b5d9-53fe42ba8804-kube-api-access-2zftj\") pod \"cert-manager-operator-controller-manager-55c444bf86-rnjvv\" (UID: \"fbe4651f-95a2-44de-b5d9-53fe42ba8804\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-rnjvv"
Jul 18 01:51:59.782840 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:51:59.782822    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-rnjvv"
Jul 18 01:51:59.915463 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:51:59.915378    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-rnjvv"]
Jul 18 01:51:59.917775 ip-10-0-142-238 kubenswrapper[2566]: W0718 01:51:59.917747    2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfbe4651f_95a2_44de_b5d9_53fe42ba8804.slice/crio-ab295f8a064265deaeb11257ed7f6ede96a799494cd71178930d9896a6eb9eae WatchSource:0}: Error finding container ab295f8a064265deaeb11257ed7f6ede96a799494cd71178930d9896a6eb9eae: Status 404 returned error can't find the container with id ab295f8a064265deaeb11257ed7f6ede96a799494cd71178930d9896a6eb9eae
Jul 18 01:52:00.825434 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:52:00.825396    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-rnjvv" event={"ID":"fbe4651f-95a2-44de-b5d9-53fe42ba8804","Type":"ContainerStarted","Data":"ab295f8a064265deaeb11257ed7f6ede96a799494cd71178930d9896a6eb9eae"}
Jul 18 01:52:01.830989 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:52:01.830958    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-rnjvv" event={"ID":"fbe4651f-95a2-44de-b5d9-53fe42ba8804","Type":"ContainerStarted","Data":"99f929095b051e47fdb42ddb3585464dd1745d99d7970928abe4d71ce54720cc"}
Jul 18 01:52:01.853447 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:52:01.853391    2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-rnjvv" podStartSLOduration=1.308361704 podStartE2EDuration="2.853375977s" totalImagesPullingTime="1.545014273s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-18 01:51:59 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-18 01:52:01.851276857 +0000 UTC m=+253.540004306" watchObservedRunningTime="2026-07-18 01:52:01.853375977 +0000 UTC m=+253.542103423"
Jul 18 01:52:03.083585 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:52:03.083550    2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87flth4k"]
Jul 18 01:52:03.087071 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:52:03.087052    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87flth4k"
Jul 18 01:52:03.089650 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:52:03.089606    2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\""
Jul 18 01:52:03.089650 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:52:03.089636    2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\""
Jul 18 01:52:03.090599 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:52:03.090582    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-pgpkr\""
Jul 18 01:52:03.096576 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:52:03.096558    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87flth4k"]
Jul 18 01:52:03.213177 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:52:03.213144    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/438abce0-299b-47fb-b4a9-f922cdb198c0-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87flth4k\" (UID: \"438abce0-299b-47fb-b4a9-f922cdb198c0\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87flth4k"
Jul 18 01:52:03.213364 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:52:03.213184    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/438abce0-299b-47fb-b4a9-f922cdb198c0-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87flth4k\" (UID: \"438abce0-299b-47fb-b4a9-f922cdb198c0\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87flth4k"
Jul 18 01:52:03.213364 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:52:03.213209    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wnxpc\" (UniqueName: \"kubernetes.io/projected/438abce0-299b-47fb-b4a9-f922cdb198c0-kube-api-access-wnxpc\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87flth4k\" (UID: \"438abce0-299b-47fb-b4a9-f922cdb198c0\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87flth4k"
Jul 18 01:52:03.314421 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:52:03.314391    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/438abce0-299b-47fb-b4a9-f922cdb198c0-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87flth4k\" (UID: \"438abce0-299b-47fb-b4a9-f922cdb198c0\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87flth4k"
Jul 18 01:52:03.314571 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:52:03.314431    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wnxpc\" (UniqueName: \"kubernetes.io/projected/438abce0-299b-47fb-b4a9-f922cdb198c0-kube-api-access-wnxpc\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87flth4k\" (UID: \"438abce0-299b-47fb-b4a9-f922cdb198c0\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87flth4k"
Jul 18 01:52:03.314571 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:52:03.314502    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/438abce0-299b-47fb-b4a9-f922cdb198c0-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87flth4k\" (UID: \"438abce0-299b-47fb-b4a9-f922cdb198c0\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87flth4k"
Jul 18 01:52:03.314890 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:52:03.314868    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/438abce0-299b-47fb-b4a9-f922cdb198c0-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87flth4k\" (UID: \"438abce0-299b-47fb-b4a9-f922cdb198c0\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87flth4k"
Jul 18 01:52:03.314940 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:52:03.314920    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/438abce0-299b-47fb-b4a9-f922cdb198c0-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87flth4k\" (UID: \"438abce0-299b-47fb-b4a9-f922cdb198c0\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87flth4k"
Jul 18 01:52:03.322773 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:52:03.322746    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wnxpc\" (UniqueName: \"kubernetes.io/projected/438abce0-299b-47fb-b4a9-f922cdb198c0-kube-api-access-wnxpc\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87flth4k\" (UID: \"438abce0-299b-47fb-b4a9-f922cdb198c0\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87flth4k"
Jul 18 01:52:03.395467 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:52:03.395407    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87flth4k"
Jul 18 01:52:03.516535 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:52:03.516507    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87flth4k"]
Jul 18 01:52:03.519195 ip-10-0-142-238 kubenswrapper[2566]: W0718 01:52:03.519167    2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod438abce0_299b_47fb_b4a9_f922cdb198c0.slice/crio-566fccd0b6de3cbeccb131067cc4ee6df4ba656a1938a4b64cb296b76ae1f7c5 WatchSource:0}: Error finding container 566fccd0b6de3cbeccb131067cc4ee6df4ba656a1938a4b64cb296b76ae1f7c5: Status 404 returned error can't find the container with id 566fccd0b6de3cbeccb131067cc4ee6df4ba656a1938a4b64cb296b76ae1f7c5
Jul 18 01:52:03.840466 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:52:03.840433    2566 generic.go:356] "Generic (PLEG): container finished" podID="438abce0-299b-47fb-b4a9-f922cdb198c0" containerID="7e562a7a4325c13dc7c92c4fad523b1622104e995d54b30e2016c5d74e7fb42a" exitCode=0
Jul 18 01:52:03.840584 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:52:03.840468    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87flth4k" event={"ID":"438abce0-299b-47fb-b4a9-f922cdb198c0","Type":"ContainerDied","Data":"7e562a7a4325c13dc7c92c4fad523b1622104e995d54b30e2016c5d74e7fb42a"}
Jul 18 01:52:03.840584 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:52:03.840501    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87flth4k" event={"ID":"438abce0-299b-47fb-b4a9-f922cdb198c0","Type":"ContainerStarted","Data":"566fccd0b6de3cbeccb131067cc4ee6df4ba656a1938a4b64cb296b76ae1f7c5"}
Jul 18 01:52:05.849270 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:52:05.849206    2566 generic.go:356] "Generic (PLEG): container finished" podID="438abce0-299b-47fb-b4a9-f922cdb198c0" containerID="30930d692043936802a0d565912960cd13e36ca72dd0d19d5b72890167f70da0" exitCode=0
Jul 18 01:52:05.849566 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:52:05.849292    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87flth4k" event={"ID":"438abce0-299b-47fb-b4a9-f922cdb198c0","Type":"ContainerDied","Data":"30930d692043936802a0d565912960cd13e36ca72dd0d19d5b72890167f70da0"}
Jul 18 01:52:06.854511 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:52:06.854477    2566 generic.go:356] "Generic (PLEG): container finished" podID="438abce0-299b-47fb-b4a9-f922cdb198c0" containerID="7bfbdb7b3d25bd787adc5e9436de19d088d486f425fda6d623ec4d9cef6a105b" exitCode=0
Jul 18 01:52:06.854921 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:52:06.854524    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87flth4k" event={"ID":"438abce0-299b-47fb-b4a9-f922cdb198c0","Type":"ContainerDied","Data":"7bfbdb7b3d25bd787adc5e9436de19d088d486f425fda6d623ec4d9cef6a105b"}
Jul 18 01:52:07.982116 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:52:07.982093    2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87flth4k"
Jul 18 01:52:08.050178 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:52:08.050142    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-wnxpc\" (UniqueName: \"kubernetes.io/projected/438abce0-299b-47fb-b4a9-f922cdb198c0-kube-api-access-wnxpc\") pod \"438abce0-299b-47fb-b4a9-f922cdb198c0\" (UID: \"438abce0-299b-47fb-b4a9-f922cdb198c0\") "
Jul 18 01:52:08.050313 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:52:08.050189    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/438abce0-299b-47fb-b4a9-f922cdb198c0-bundle\") pod \"438abce0-299b-47fb-b4a9-f922cdb198c0\" (UID: \"438abce0-299b-47fb-b4a9-f922cdb198c0\") "
Jul 18 01:52:08.050313 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:52:08.050242    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/438abce0-299b-47fb-b4a9-f922cdb198c0-util\") pod \"438abce0-299b-47fb-b4a9-f922cdb198c0\" (UID: \"438abce0-299b-47fb-b4a9-f922cdb198c0\") "
Jul 18 01:52:08.050681 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:52:08.050634    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/438abce0-299b-47fb-b4a9-f922cdb198c0-bundle" (OuterVolumeSpecName: "bundle") pod "438abce0-299b-47fb-b4a9-f922cdb198c0" (UID: "438abce0-299b-47fb-b4a9-f922cdb198c0"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 18 01:52:08.051999 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:52:08.051973    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/438abce0-299b-47fb-b4a9-f922cdb198c0-kube-api-access-wnxpc" (OuterVolumeSpecName: "kube-api-access-wnxpc") pod "438abce0-299b-47fb-b4a9-f922cdb198c0" (UID: "438abce0-299b-47fb-b4a9-f922cdb198c0"). InnerVolumeSpecName "kube-api-access-wnxpc". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 18 01:52:08.056107 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:52:08.056081    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/438abce0-299b-47fb-b4a9-f922cdb198c0-util" (OuterVolumeSpecName: "util") pod "438abce0-299b-47fb-b4a9-f922cdb198c0" (UID: "438abce0-299b-47fb-b4a9-f922cdb198c0"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 18 01:52:08.151448 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:52:08.151382    2566 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/438abce0-299b-47fb-b4a9-f922cdb198c0-util\") on node \"ip-10-0-142-238.ec2.internal\" DevicePath \"\""
Jul 18 01:52:08.151448 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:52:08.151409    2566 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-wnxpc\" (UniqueName: \"kubernetes.io/projected/438abce0-299b-47fb-b4a9-f922cdb198c0-kube-api-access-wnxpc\") on node \"ip-10-0-142-238.ec2.internal\" DevicePath \"\""
Jul 18 01:52:08.151448 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:52:08.151420    2566 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/438abce0-299b-47fb-b4a9-f922cdb198c0-bundle\") on node \"ip-10-0-142-238.ec2.internal\" DevicePath \"\""
Jul 18 01:52:08.864113 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:52:08.864076    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87flth4k" event={"ID":"438abce0-299b-47fb-b4a9-f922cdb198c0","Type":"ContainerDied","Data":"566fccd0b6de3cbeccb131067cc4ee6df4ba656a1938a4b64cb296b76ae1f7c5"}
Jul 18 01:52:08.864113 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:52:08.864113    2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87flth4k"
Jul 18 01:52:08.864291 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:52:08.864124    2566 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="566fccd0b6de3cbeccb131067cc4ee6df4ba656a1938a4b64cb296b76ae1f7c5"
Jul 18 01:52:14.358355 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:52:14.358280    2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-55b4d954d5-55sqc"]
Jul 18 01:52:14.358744 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:52:14.358565    2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="438abce0-299b-47fb-b4a9-f922cdb198c0" containerName="util"
Jul 18 01:52:14.358744 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:52:14.358577    2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="438abce0-299b-47fb-b4a9-f922cdb198c0" containerName="util"
Jul 18 01:52:14.358744 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:52:14.358595    2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="438abce0-299b-47fb-b4a9-f922cdb198c0" containerName="pull"
Jul 18 01:52:14.358744 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:52:14.358601    2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="438abce0-299b-47fb-b4a9-f922cdb198c0" containerName="pull"
Jul 18 01:52:14.358744 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:52:14.358622    2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="438abce0-299b-47fb-b4a9-f922cdb198c0" containerName="extract"
Jul 18 01:52:14.358744 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:52:14.358632    2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="438abce0-299b-47fb-b4a9-f922cdb198c0" containerName="extract"
Jul 18 01:52:14.358744 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:52:14.358692    2566 memory_manager.go:368] "RemoveStaleState removing state" podUID="438abce0-299b-47fb-b4a9-f922cdb198c0" containerName="extract"
Jul 18 01:52:14.361608 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:52:14.361593    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-55b4d954d5-55sqc"
Jul 18 01:52:14.364001 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:52:14.363980    2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"openshift-service-ca.crt\""
Jul 18 01:52:14.364093 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:52:14.364002    2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"kube-root-ca.crt\""
Jul 18 01:52:14.364644 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:52:14.364629    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-dockercfg-f7sp8\""
Jul 18 01:52:14.371822 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:52:14.371800    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-55b4d954d5-55sqc"]
Jul 18 01:52:14.500387 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:52:14.500357    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pl85b\" (UniqueName: \"kubernetes.io/projected/c7bdb4b9-6ebc-407f-8a4a-923d55af9da6-kube-api-access-pl85b\") pod \"cert-manager-55b4d954d5-55sqc\" (UID: \"c7bdb4b9-6ebc-407f-8a4a-923d55af9da6\") " pod="cert-manager/cert-manager-55b4d954d5-55sqc"
Jul 18 01:52:14.500530 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:52:14.500395    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/c7bdb4b9-6ebc-407f-8a4a-923d55af9da6-bound-sa-token\") pod \"cert-manager-55b4d954d5-55sqc\" (UID: \"c7bdb4b9-6ebc-407f-8a4a-923d55af9da6\") " pod="cert-manager/cert-manager-55b4d954d5-55sqc"
Jul 18 01:52:14.601724 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:52:14.601689    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pl85b\" (UniqueName: \"kubernetes.io/projected/c7bdb4b9-6ebc-407f-8a4a-923d55af9da6-kube-api-access-pl85b\") pod \"cert-manager-55b4d954d5-55sqc\" (UID: \"c7bdb4b9-6ebc-407f-8a4a-923d55af9da6\") " pod="cert-manager/cert-manager-55b4d954d5-55sqc"
Jul 18 01:52:14.601864 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:52:14.601731    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/c7bdb4b9-6ebc-407f-8a4a-923d55af9da6-bound-sa-token\") pod \"cert-manager-55b4d954d5-55sqc\" (UID: \"c7bdb4b9-6ebc-407f-8a4a-923d55af9da6\") " pod="cert-manager/cert-manager-55b4d954d5-55sqc"
Jul 18 01:52:14.609851 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:52:14.609793    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/c7bdb4b9-6ebc-407f-8a4a-923d55af9da6-bound-sa-token\") pod \"cert-manager-55b4d954d5-55sqc\" (UID: \"c7bdb4b9-6ebc-407f-8a4a-923d55af9da6\") " pod="cert-manager/cert-manager-55b4d954d5-55sqc"
Jul 18 01:52:14.610102 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:52:14.610079    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pl85b\" (UniqueName: \"kubernetes.io/projected/c7bdb4b9-6ebc-407f-8a4a-923d55af9da6-kube-api-access-pl85b\") pod \"cert-manager-55b4d954d5-55sqc\" (UID: \"c7bdb4b9-6ebc-407f-8a4a-923d55af9da6\") " pod="cert-manager/cert-manager-55b4d954d5-55sqc"
Jul 18 01:52:14.686055 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:52:14.686032    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-55b4d954d5-55sqc"
Jul 18 01:52:14.803319 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:52:14.803257    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-55b4d954d5-55sqc"]
Jul 18 01:52:14.805925 ip-10-0-142-238 kubenswrapper[2566]: W0718 01:52:14.805892    2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podc7bdb4b9_6ebc_407f_8a4a_923d55af9da6.slice/crio-187681c474087c8789ec63865b04b9ded6ede04a8a7a8b10d5420eb205dc8e67 WatchSource:0}: Error finding container 187681c474087c8789ec63865b04b9ded6ede04a8a7a8b10d5420eb205dc8e67: Status 404 returned error can't find the container with id 187681c474087c8789ec63865b04b9ded6ede04a8a7a8b10d5420eb205dc8e67
Jul 18 01:52:14.886288 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:52:14.886208    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-55b4d954d5-55sqc" event={"ID":"c7bdb4b9-6ebc-407f-8a4a-923d55af9da6","Type":"ContainerStarted","Data":"187681c474087c8789ec63865b04b9ded6ede04a8a7a8b10d5420eb205dc8e67"}
Jul 18 01:52:17.901238 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:52:17.901205    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-55b4d954d5-55sqc" event={"ID":"c7bdb4b9-6ebc-407f-8a4a-923d55af9da6","Type":"ContainerStarted","Data":"5c5da08bd722ca44b38f7c780a836e35d33f3201a3ddd3be7b54de32f8308ff4"}
Jul 18 01:52:17.916871 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:52:17.916831    2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-55b4d954d5-55sqc" podStartSLOduration=1.424330253 podStartE2EDuration="3.916816332s" totalImagesPullingTime="2.492486079s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-18 01:52:14 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-18 01:52:17.916777147 +0000 UTC m=+269.605504596" watchObservedRunningTime="2026-07-18 01:52:17.916816332 +0000 UTC m=+269.605543777"
Jul 18 01:52:23.910857 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:52:23.910824    2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afb88v5"]
Jul 18 01:52:23.928766 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:52:23.928742    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afb88v5"]
Jul 18 01:52:23.928918 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:52:23.928842    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afb88v5"
Jul 18 01:52:23.931111 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:52:23.931086    2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\""
Jul 18 01:52:23.931878 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:52:23.931859    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-pgpkr\""
Jul 18 01:52:23.931974 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:52:23.931863    2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\""
Jul 18 01:52:24.068845 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:52:24.068811    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/5ccd4a72-cd79-48f5-9a43-3fe9efe782d1-bundle\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afb88v5\" (UID: \"5ccd4a72-cd79-48f5-9a43-3fe9efe782d1\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afb88v5"
Jul 18 01:52:24.069025 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:52:24.068871    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qtlkn\" (UniqueName: \"kubernetes.io/projected/5ccd4a72-cd79-48f5-9a43-3fe9efe782d1-kube-api-access-qtlkn\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afb88v5\" (UID: \"5ccd4a72-cd79-48f5-9a43-3fe9efe782d1\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afb88v5"
Jul 18 01:52:24.069025 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:52:24.068905    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/5ccd4a72-cd79-48f5-9a43-3fe9efe782d1-util\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afb88v5\" (UID: \"5ccd4a72-cd79-48f5-9a43-3fe9efe782d1\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afb88v5"
Jul 18 01:52:24.169473 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:52:24.169402    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qtlkn\" (UniqueName: \"kubernetes.io/projected/5ccd4a72-cd79-48f5-9a43-3fe9efe782d1-kube-api-access-qtlkn\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afb88v5\" (UID: \"5ccd4a72-cd79-48f5-9a43-3fe9efe782d1\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afb88v5"
Jul 18 01:52:24.169473 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:52:24.169441    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/5ccd4a72-cd79-48f5-9a43-3fe9efe782d1-util\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afb88v5\" (UID: \"5ccd4a72-cd79-48f5-9a43-3fe9efe782d1\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afb88v5"
Jul 18 01:52:24.169666 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:52:24.169495    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/5ccd4a72-cd79-48f5-9a43-3fe9efe782d1-bundle\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afb88v5\" (UID: \"5ccd4a72-cd79-48f5-9a43-3fe9efe782d1\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afb88v5"
Jul 18 01:52:24.169859 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:52:24.169838    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/5ccd4a72-cd79-48f5-9a43-3fe9efe782d1-util\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afb88v5\" (UID: \"5ccd4a72-cd79-48f5-9a43-3fe9efe782d1\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afb88v5"
Jul 18 01:52:24.169925 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:52:24.169870    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/5ccd4a72-cd79-48f5-9a43-3fe9efe782d1-bundle\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afb88v5\" (UID: \"5ccd4a72-cd79-48f5-9a43-3fe9efe782d1\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afb88v5"
Jul 18 01:52:24.177823 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:52:24.177795    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qtlkn\" (UniqueName: \"kubernetes.io/projected/5ccd4a72-cd79-48f5-9a43-3fe9efe782d1-kube-api-access-qtlkn\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afb88v5\" (UID: \"5ccd4a72-cd79-48f5-9a43-3fe9efe782d1\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afb88v5"
Jul 18 01:52:24.237366 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:52:24.237343    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afb88v5"
Jul 18 01:52:24.378362 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:52:24.378305    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afb88v5"]
Jul 18 01:52:24.380547 ip-10-0-142-238 kubenswrapper[2566]: W0718 01:52:24.380522    2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5ccd4a72_cd79_48f5_9a43_3fe9efe782d1.slice/crio-bc2f87c427fe36f8500fa84fe07e760f5fbe3a7e99f35251697bc12a178be3e9 WatchSource:0}: Error finding container bc2f87c427fe36f8500fa84fe07e760f5fbe3a7e99f35251697bc12a178be3e9: Status 404 returned error can't find the container with id bc2f87c427fe36f8500fa84fe07e760f5fbe3a7e99f35251697bc12a178be3e9
Jul 18 01:52:24.933428 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:52:24.933388    2566 generic.go:356] "Generic (PLEG): container finished" podID="5ccd4a72-cd79-48f5-9a43-3fe9efe782d1" containerID="97e3f87567ad9806fd3e7f56600bf4a37c790a36e17010d4a6669446ca0dc4a0" exitCode=0
Jul 18 01:52:24.933912 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:52:24.933460    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afb88v5" event={"ID":"5ccd4a72-cd79-48f5-9a43-3fe9efe782d1","Type":"ContainerDied","Data":"97e3f87567ad9806fd3e7f56600bf4a37c790a36e17010d4a6669446ca0dc4a0"}
Jul 18 01:52:24.933912 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:52:24.933501    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afb88v5" event={"ID":"5ccd4a72-cd79-48f5-9a43-3fe9efe782d1","Type":"ContainerStarted","Data":"bc2f87c427fe36f8500fa84fe07e760f5fbe3a7e99f35251697bc12a178be3e9"}
Jul 18 01:52:25.939330 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:52:25.939255    2566 generic.go:356] "Generic (PLEG): container finished" podID="5ccd4a72-cd79-48f5-9a43-3fe9efe782d1" containerID="3cb0ffd6e58c78f3e700011036c4182b2a0f246fce9cd120efb3a908b4cc0334" exitCode=0
Jul 18 01:52:25.939330 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:52:25.939290    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afb88v5" event={"ID":"5ccd4a72-cd79-48f5-9a43-3fe9efe782d1","Type":"ContainerDied","Data":"3cb0ffd6e58c78f3e700011036c4182b2a0f246fce9cd120efb3a908b4cc0334"}
Jul 18 01:52:26.944474 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:52:26.944440    2566 generic.go:356] "Generic (PLEG): container finished" podID="5ccd4a72-cd79-48f5-9a43-3fe9efe782d1" containerID="859423ceb7924f773457b272974c0bbc4e0417cfa26ff8c72391a3254c3b483f" exitCode=0
Jul 18 01:52:26.944928 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:52:26.944522    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afb88v5" event={"ID":"5ccd4a72-cd79-48f5-9a43-3fe9efe782d1","Type":"ContainerDied","Data":"859423ceb7924f773457b272974c0bbc4e0417cfa26ff8c72391a3254c3b483f"}
Jul 18 01:52:28.061287 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:52:28.061266    2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afb88v5"
Jul 18 01:52:28.199126 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:52:28.199030    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/5ccd4a72-cd79-48f5-9a43-3fe9efe782d1-bundle\") pod \"5ccd4a72-cd79-48f5-9a43-3fe9efe782d1\" (UID: \"5ccd4a72-cd79-48f5-9a43-3fe9efe782d1\") "
Jul 18 01:52:28.199126 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:52:28.199104    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/5ccd4a72-cd79-48f5-9a43-3fe9efe782d1-util\") pod \"5ccd4a72-cd79-48f5-9a43-3fe9efe782d1\" (UID: \"5ccd4a72-cd79-48f5-9a43-3fe9efe782d1\") "
Jul 18 01:52:28.199311 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:52:28.199172    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-qtlkn\" (UniqueName: \"kubernetes.io/projected/5ccd4a72-cd79-48f5-9a43-3fe9efe782d1-kube-api-access-qtlkn\") pod \"5ccd4a72-cd79-48f5-9a43-3fe9efe782d1\" (UID: \"5ccd4a72-cd79-48f5-9a43-3fe9efe782d1\") "
Jul 18 01:52:28.199806 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:52:28.199781    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5ccd4a72-cd79-48f5-9a43-3fe9efe782d1-bundle" (OuterVolumeSpecName: "bundle") pod "5ccd4a72-cd79-48f5-9a43-3fe9efe782d1" (UID: "5ccd4a72-cd79-48f5-9a43-3fe9efe782d1"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 18 01:52:28.201355 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:52:28.201334    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5ccd4a72-cd79-48f5-9a43-3fe9efe782d1-kube-api-access-qtlkn" (OuterVolumeSpecName: "kube-api-access-qtlkn") pod "5ccd4a72-cd79-48f5-9a43-3fe9efe782d1" (UID: "5ccd4a72-cd79-48f5-9a43-3fe9efe782d1"). InnerVolumeSpecName "kube-api-access-qtlkn". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 18 01:52:28.207101 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:52:28.207077    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5ccd4a72-cd79-48f5-9a43-3fe9efe782d1-util" (OuterVolumeSpecName: "util") pod "5ccd4a72-cd79-48f5-9a43-3fe9efe782d1" (UID: "5ccd4a72-cd79-48f5-9a43-3fe9efe782d1"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 18 01:52:28.299764 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:52:28.299722    2566 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-qtlkn\" (UniqueName: \"kubernetes.io/projected/5ccd4a72-cd79-48f5-9a43-3fe9efe782d1-kube-api-access-qtlkn\") on node \"ip-10-0-142-238.ec2.internal\" DevicePath \"\""
Jul 18 01:52:28.299764 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:52:28.299761    2566 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/5ccd4a72-cd79-48f5-9a43-3fe9efe782d1-bundle\") on node \"ip-10-0-142-238.ec2.internal\" DevicePath \"\""
Jul 18 01:52:28.299764 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:52:28.299770    2566 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/5ccd4a72-cd79-48f5-9a43-3fe9efe782d1-util\") on node \"ip-10-0-142-238.ec2.internal\" DevicePath \"\""
Jul 18 01:52:28.953830 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:52:28.953801    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afb88v5" event={"ID":"5ccd4a72-cd79-48f5-9a43-3fe9efe782d1","Type":"ContainerDied","Data":"bc2f87c427fe36f8500fa84fe07e760f5fbe3a7e99f35251697bc12a178be3e9"}
Jul 18 01:52:28.953830 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:52:28.953822    2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afb88v5"
Jul 18 01:52:28.954006 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:52:28.953842    2566 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="bc2f87c427fe36f8500fa84fe07e760f5fbe3a7e99f35251697bc12a178be3e9"
Jul 18 01:52:35.462756 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:52:35.462726    2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-6667d74d96-c9z7s"]
Jul 18 01:52:35.463186 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:52:35.463001    2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5ccd4a72-cd79-48f5-9a43-3fe9efe782d1" containerName="pull"
Jul 18 01:52:35.463186 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:52:35.463015    2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="5ccd4a72-cd79-48f5-9a43-3fe9efe782d1" containerName="pull"
Jul 18 01:52:35.463186 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:52:35.463032    2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5ccd4a72-cd79-48f5-9a43-3fe9efe782d1" containerName="extract"
Jul 18 01:52:35.463186 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:52:35.463041    2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="5ccd4a72-cd79-48f5-9a43-3fe9efe782d1" containerName="extract"
Jul 18 01:52:35.463186 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:52:35.463053    2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5ccd4a72-cd79-48f5-9a43-3fe9efe782d1" containerName="util"
Jul 18 01:52:35.463186 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:52:35.463062    2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="5ccd4a72-cd79-48f5-9a43-3fe9efe782d1" containerName="util"
Jul 18 01:52:35.463186 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:52:35.463139    2566 memory_manager.go:368] "RemoveStaleState removing state" podUID="5ccd4a72-cd79-48f5-9a43-3fe9efe782d1" containerName="extract"
Jul 18 01:52:35.465874 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:52:35.465855    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-6667d74d96-c9z7s"
Jul 18 01:52:35.468858 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:52:35.468838    2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\""
Jul 18 01:52:35.468858 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:52:35.468851    2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\""
Jul 18 01:52:35.469907 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:52:35.469893    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-8xwps\""
Jul 18 01:52:35.470010 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:52:35.469995    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\""
Jul 18 01:52:35.475061 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:52:35.475043    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\""
Jul 18 01:52:35.481768 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:52:35.481744    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-6667d74d96-c9z7s"]
Jul 18 01:52:35.550480 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:52:35.550455    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/d57e2773-94d5-4fd3-b96f-22b243255ca8-manifests\") pod \"opendatahub-operator-controller-manager-6667d74d96-c9z7s\" (UID: \"d57e2773-94d5-4fd3-b96f-22b243255ca8\") " pod="opendatahub/opendatahub-operator-controller-manager-6667d74d96-c9z7s"
Jul 18 01:52:35.550602 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:52:35.550489    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/d57e2773-94d5-4fd3-b96f-22b243255ca8-apiservice-cert\") pod \"opendatahub-operator-controller-manager-6667d74d96-c9z7s\" (UID: \"d57e2773-94d5-4fd3-b96f-22b243255ca8\") " pod="opendatahub/opendatahub-operator-controller-manager-6667d74d96-c9z7s"
Jul 18 01:52:35.550602 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:52:35.550509    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/d57e2773-94d5-4fd3-b96f-22b243255ca8-webhook-cert\") pod \"opendatahub-operator-controller-manager-6667d74d96-c9z7s\" (UID: \"d57e2773-94d5-4fd3-b96f-22b243255ca8\") " pod="opendatahub/opendatahub-operator-controller-manager-6667d74d96-c9z7s"
Jul 18 01:52:35.550702 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:52:35.550597    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/d57e2773-94d5-4fd3-b96f-22b243255ca8-tmp\") pod \"opendatahub-operator-controller-manager-6667d74d96-c9z7s\" (UID: \"d57e2773-94d5-4fd3-b96f-22b243255ca8\") " pod="opendatahub/opendatahub-operator-controller-manager-6667d74d96-c9z7s"
Jul 18 01:52:35.550702 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:52:35.550662    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qqxbd\" (UniqueName: \"kubernetes.io/projected/d57e2773-94d5-4fd3-b96f-22b243255ca8-kube-api-access-qqxbd\") pod \"opendatahub-operator-controller-manager-6667d74d96-c9z7s\" (UID: \"d57e2773-94d5-4fd3-b96f-22b243255ca8\") " pod="opendatahub/opendatahub-operator-controller-manager-6667d74d96-c9z7s"
Jul 18 01:52:35.651286 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:52:35.651258    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/d57e2773-94d5-4fd3-b96f-22b243255ca8-tmp\") pod \"opendatahub-operator-controller-manager-6667d74d96-c9z7s\" (UID: \"d57e2773-94d5-4fd3-b96f-22b243255ca8\") " pod="opendatahub/opendatahub-operator-controller-manager-6667d74d96-c9z7s"
Jul 18 01:52:35.651381 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:52:35.651291    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qqxbd\" (UniqueName: \"kubernetes.io/projected/d57e2773-94d5-4fd3-b96f-22b243255ca8-kube-api-access-qqxbd\") pod \"opendatahub-operator-controller-manager-6667d74d96-c9z7s\" (UID: \"d57e2773-94d5-4fd3-b96f-22b243255ca8\") " pod="opendatahub/opendatahub-operator-controller-manager-6667d74d96-c9z7s"
Jul 18 01:52:35.651381 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:52:35.651330    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/d57e2773-94d5-4fd3-b96f-22b243255ca8-manifests\") pod \"opendatahub-operator-controller-manager-6667d74d96-c9z7s\" (UID: \"d57e2773-94d5-4fd3-b96f-22b243255ca8\") " pod="opendatahub/opendatahub-operator-controller-manager-6667d74d96-c9z7s"
Jul 18 01:52:35.651381 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:52:35.651353    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/d57e2773-94d5-4fd3-b96f-22b243255ca8-apiservice-cert\") pod \"opendatahub-operator-controller-manager-6667d74d96-c9z7s\" (UID: \"d57e2773-94d5-4fd3-b96f-22b243255ca8\") " pod="opendatahub/opendatahub-operator-controller-manager-6667d74d96-c9z7s"
Jul 18 01:52:35.651381 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:52:35.651372    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/d57e2773-94d5-4fd3-b96f-22b243255ca8-webhook-cert\") pod \"opendatahub-operator-controller-manager-6667d74d96-c9z7s\" (UID: \"d57e2773-94d5-4fd3-b96f-22b243255ca8\") " pod="opendatahub/opendatahub-operator-controller-manager-6667d74d96-c9z7s"
Jul 18 01:52:35.651753 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:52:35.651733    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/d57e2773-94d5-4fd3-b96f-22b243255ca8-manifests\") pod \"opendatahub-operator-controller-manager-6667d74d96-c9z7s\" (UID: \"d57e2773-94d5-4fd3-b96f-22b243255ca8\") " pod="opendatahub/opendatahub-operator-controller-manager-6667d74d96-c9z7s"
Jul 18 01:52:35.653583 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:52:35.653558    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/d57e2773-94d5-4fd3-b96f-22b243255ca8-tmp\") pod \"opendatahub-operator-controller-manager-6667d74d96-c9z7s\" (UID: \"d57e2773-94d5-4fd3-b96f-22b243255ca8\") " pod="opendatahub/opendatahub-operator-controller-manager-6667d74d96-c9z7s"
Jul 18 01:52:35.653748 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:52:35.653733    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/d57e2773-94d5-4fd3-b96f-22b243255ca8-webhook-cert\") pod \"opendatahub-operator-controller-manager-6667d74d96-c9z7s\" (UID: \"d57e2773-94d5-4fd3-b96f-22b243255ca8\") " pod="opendatahub/opendatahub-operator-controller-manager-6667d74d96-c9z7s"
Jul 18 01:52:35.653898 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:52:35.653877    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/d57e2773-94d5-4fd3-b96f-22b243255ca8-apiservice-cert\") pod \"opendatahub-operator-controller-manager-6667d74d96-c9z7s\" (UID: \"d57e2773-94d5-4fd3-b96f-22b243255ca8\") " pod="opendatahub/opendatahub-operator-controller-manager-6667d74d96-c9z7s"
Jul 18 01:52:35.658281 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:52:35.658258    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qqxbd\" (UniqueName: \"kubernetes.io/projected/d57e2773-94d5-4fd3-b96f-22b243255ca8-kube-api-access-qqxbd\") pod \"opendatahub-operator-controller-manager-6667d74d96-c9z7s\" (UID: \"d57e2773-94d5-4fd3-b96f-22b243255ca8\") " pod="opendatahub/opendatahub-operator-controller-manager-6667d74d96-c9z7s"
Jul 18 01:52:35.775566 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:52:35.775499    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-6667d74d96-c9z7s"
Jul 18 01:52:35.903033 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:52:35.903004    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-6667d74d96-c9z7s"]
Jul 18 01:52:35.905697 ip-10-0-142-238 kubenswrapper[2566]: W0718 01:52:35.905666    2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd57e2773_94d5_4fd3_b96f_22b243255ca8.slice/crio-3a7a8453ab65d5670343beea3fd7ef37eaa81e5954be3a615b144412563cf6cb WatchSource:0}: Error finding container 3a7a8453ab65d5670343beea3fd7ef37eaa81e5954be3a615b144412563cf6cb: Status 404 returned error can't find the container with id 3a7a8453ab65d5670343beea3fd7ef37eaa81e5954be3a615b144412563cf6cb
Jul 18 01:52:35.981607 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:52:35.981575    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-6667d74d96-c9z7s" event={"ID":"d57e2773-94d5-4fd3-b96f-22b243255ca8","Type":"ContainerStarted","Data":"3a7a8453ab65d5670343beea3fd7ef37eaa81e5954be3a615b144412563cf6cb"}
Jul 18 01:52:38.995105 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:52:38.995073    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-6667d74d96-c9z7s" event={"ID":"d57e2773-94d5-4fd3-b96f-22b243255ca8","Type":"ContainerStarted","Data":"3851a13be4894d1845bc5e553f8a07412e4822cc344aa58feb6bad8413b20c4e"}
Jul 18 01:52:40.000925 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:52:40.000893    2566 generic.go:356] "Generic (PLEG): container finished" podID="d57e2773-94d5-4fd3-b96f-22b243255ca8" containerID="3851a13be4894d1845bc5e553f8a07412e4822cc344aa58feb6bad8413b20c4e" exitCode=0
Jul 18 01:52:40.001303 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:52:40.000979    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-6667d74d96-c9z7s" event={"ID":"d57e2773-94d5-4fd3-b96f-22b243255ca8","Type":"ContainerDied","Data":"3851a13be4894d1845bc5e553f8a07412e4822cc344aa58feb6bad8413b20c4e"}
Jul 18 01:52:41.006667 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:52:41.006606    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-6667d74d96-c9z7s" event={"ID":"d57e2773-94d5-4fd3-b96f-22b243255ca8","Type":"ContainerStarted","Data":"f30415a2ae8fb9b70a934c031a0cb3506dab87f0b3e13adfc9e1ec539c49ac2d"}
Jul 18 01:52:41.007074 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:52:41.006735    2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-6667d74d96-c9z7s"
Jul 18 01:52:41.026058 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:52:41.026003    2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-6667d74d96-c9z7s" podStartSLOduration=1.72069973 podStartE2EDuration="6.025987852s" totalImagesPullingTime="3.232361093s" totalInitContainerRuntime="1.072927029s" isStatefulPod=false podCreationTimestamp="2026-07-18 01:52:35 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-18 01:52:41.025744323 +0000 UTC m=+292.714471783" watchObservedRunningTime="2026-07-18 01:52:41.025987852 +0000 UTC m=+292.714715299"
Jul 18 01:52:48.774405 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:52:48.774379    2566 kubelet.go:1648] "Image garbage collection succeeded"
Jul 18 01:52:52.013772 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:52:52.013744    2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-6667d74d96-c9z7s"
Jul 18 01:52:54.143490 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:52:54.143460    2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/lws-controller-manager-5b6fc5d786-t4876"]
Jul 18 01:52:54.146654 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:52:54.146632    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-5b6fc5d786-t4876"
Jul 18 01:52:54.149664 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:52:54.149641    2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"kube-root-ca.crt\""
Jul 18 01:52:54.149906 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:52:54.149888    2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"lws-manager-config\""
Jul 18 01:52:54.149957 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:52:54.149923    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"lws-controller-manager-dockercfg-jkpsg\""
Jul 18 01:52:54.150728 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:52:54.150711    2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"openshift-service-ca.crt\""
Jul 18 01:52:54.150828 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:52:54.150731    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"webhook-server-cert\""
Jul 18 01:52:54.150828 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:52:54.150737    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"metrics-server-cert\""
Jul 18 01:52:54.167797 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:52:54.167771    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-5b6fc5d786-t4876"]
Jul 18 01:52:54.192425 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:52:54.192396    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/9e5a47bc-c1d4-4b4d-abfc-24cc1d1596b2-cert\") pod \"lws-controller-manager-5b6fc5d786-t4876\" (UID: \"9e5a47bc-c1d4-4b4d-abfc-24cc1d1596b2\") " pod="openshift-lws-operator/lws-controller-manager-5b6fc5d786-t4876"
Jul 18 01:52:54.192547 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:52:54.192433    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/9e5a47bc-c1d4-4b4d-abfc-24cc1d1596b2-manager-config\") pod \"lws-controller-manager-5b6fc5d786-t4876\" (UID: \"9e5a47bc-c1d4-4b4d-abfc-24cc1d1596b2\") " pod="openshift-lws-operator/lws-controller-manager-5b6fc5d786-t4876"
Jul 18 01:52:54.192547 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:52:54.192457    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rdpxz\" (UniqueName: \"kubernetes.io/projected/9e5a47bc-c1d4-4b4d-abfc-24cc1d1596b2-kube-api-access-rdpxz\") pod \"lws-controller-manager-5b6fc5d786-t4876\" (UID: \"9e5a47bc-c1d4-4b4d-abfc-24cc1d1596b2\") " pod="openshift-lws-operator/lws-controller-manager-5b6fc5d786-t4876"
Jul 18 01:52:54.192547 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:52:54.192510    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/9e5a47bc-c1d4-4b4d-abfc-24cc1d1596b2-metrics-cert\") pod \"lws-controller-manager-5b6fc5d786-t4876\" (UID: \"9e5a47bc-c1d4-4b4d-abfc-24cc1d1596b2\") " pod="openshift-lws-operator/lws-controller-manager-5b6fc5d786-t4876"
Jul 18 01:52:54.292883 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:52:54.292853    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rdpxz\" (UniqueName: \"kubernetes.io/projected/9e5a47bc-c1d4-4b4d-abfc-24cc1d1596b2-kube-api-access-rdpxz\") pod \"lws-controller-manager-5b6fc5d786-t4876\" (UID: \"9e5a47bc-c1d4-4b4d-abfc-24cc1d1596b2\") " pod="openshift-lws-operator/lws-controller-manager-5b6fc5d786-t4876"
Jul 18 01:52:54.293018 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:52:54.292890    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/9e5a47bc-c1d4-4b4d-abfc-24cc1d1596b2-metrics-cert\") pod \"lws-controller-manager-5b6fc5d786-t4876\" (UID: \"9e5a47bc-c1d4-4b4d-abfc-24cc1d1596b2\") " pod="openshift-lws-operator/lws-controller-manager-5b6fc5d786-t4876"
Jul 18 01:52:54.293018 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:52:54.293009    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/9e5a47bc-c1d4-4b4d-abfc-24cc1d1596b2-cert\") pod \"lws-controller-manager-5b6fc5d786-t4876\" (UID: \"9e5a47bc-c1d4-4b4d-abfc-24cc1d1596b2\") " pod="openshift-lws-operator/lws-controller-manager-5b6fc5d786-t4876"
Jul 18 01:52:54.293104 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:52:54.293057    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/9e5a47bc-c1d4-4b4d-abfc-24cc1d1596b2-manager-config\") pod \"lws-controller-manager-5b6fc5d786-t4876\" (UID: \"9e5a47bc-c1d4-4b4d-abfc-24cc1d1596b2\") " pod="openshift-lws-operator/lws-controller-manager-5b6fc5d786-t4876"
Jul 18 01:52:54.293669 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:52:54.293642    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/9e5a47bc-c1d4-4b4d-abfc-24cc1d1596b2-manager-config\") pod \"lws-controller-manager-5b6fc5d786-t4876\" (UID: \"9e5a47bc-c1d4-4b4d-abfc-24cc1d1596b2\") " pod="openshift-lws-operator/lws-controller-manager-5b6fc5d786-t4876"
Jul 18 01:52:54.295477 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:52:54.295456    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/9e5a47bc-c1d4-4b4d-abfc-24cc1d1596b2-cert\") pod \"lws-controller-manager-5b6fc5d786-t4876\" (UID: \"9e5a47bc-c1d4-4b4d-abfc-24cc1d1596b2\") " pod="openshift-lws-operator/lws-controller-manager-5b6fc5d786-t4876"
Jul 18 01:52:54.295477 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:52:54.295470    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/9e5a47bc-c1d4-4b4d-abfc-24cc1d1596b2-metrics-cert\") pod \"lws-controller-manager-5b6fc5d786-t4876\" (UID: \"9e5a47bc-c1d4-4b4d-abfc-24cc1d1596b2\") " pod="openshift-lws-operator/lws-controller-manager-5b6fc5d786-t4876"
Jul 18 01:52:54.322048 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:52:54.322027    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rdpxz\" (UniqueName: \"kubernetes.io/projected/9e5a47bc-c1d4-4b4d-abfc-24cc1d1596b2-kube-api-access-rdpxz\") pod \"lws-controller-manager-5b6fc5d786-t4876\" (UID: \"9e5a47bc-c1d4-4b4d-abfc-24cc1d1596b2\") " pod="openshift-lws-operator/lws-controller-manager-5b6fc5d786-t4876"
Jul 18 01:52:54.455345 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:52:54.455270    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-5b6fc5d786-t4876"
Jul 18 01:52:54.611036 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:52:54.611012    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-5b6fc5d786-t4876"]
Jul 18 01:52:54.612686 ip-10-0-142-238 kubenswrapper[2566]: W0718 01:52:54.612661    2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9e5a47bc_c1d4_4b4d_abfc_24cc1d1596b2.slice/crio-ddf8c6bef134e96f7768a5f629a06a03ef1300e3c5309105bd6acf703aa9b311 WatchSource:0}: Error finding container ddf8c6bef134e96f7768a5f629a06a03ef1300e3c5309105bd6acf703aa9b311: Status 404 returned error can't find the container with id ddf8c6bef134e96f7768a5f629a06a03ef1300e3c5309105bd6acf703aa9b311
Jul 18 01:52:54.614574 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:52:54.614558    2566 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 18 01:52:55.066926 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:52:55.066889    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-5b6fc5d786-t4876" event={"ID":"9e5a47bc-c1d4-4b4d-abfc-24cc1d1596b2","Type":"ContainerStarted","Data":"ddf8c6bef134e96f7768a5f629a06a03ef1300e3c5309105bd6acf703aa9b311"}
Jul 18 01:52:56.073028 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:52:56.072992    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-5b6fc5d786-t4876" event={"ID":"9e5a47bc-c1d4-4b4d-abfc-24cc1d1596b2","Type":"ContainerStarted","Data":"545d020f1e0935bc9eaa82bf321470d693c89aacf7289c39024e7ea77b9a54da"}
Jul 18 01:52:56.073494 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:52:56.073113    2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-lws-operator/lws-controller-manager-5b6fc5d786-t4876"
Jul 18 01:52:56.099858 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:52:56.099815    2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/lws-controller-manager-5b6fc5d786-t4876" podStartSLOduration=0.822073777 podStartE2EDuration="2.099798823s" totalImagesPullingTime="1.277725046s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-18 01:52:54 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-18 01:52:56.097310031 +0000 UTC m=+307.786037478" watchObservedRunningTime="2026-07-18 01:52:56.099798823 +0000 UTC m=+307.788526605"
Jul 18 01:53:02.538830 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:53:02.538793    2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/istiod-openshift-gateway-94bb8fbfd-cs62j"]
Jul 18 01:53:02.543431 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:53:02.543406    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-cs62j"
Jul 18 01:53:02.546080 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:53:02.546061    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-tls\""
Jul 18 01:53:02.546388 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:53:02.546369    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"cacerts\""
Jul 18 01:53:02.547093 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:53:02.547073    2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\""
Jul 18 01:53:02.547218 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:53:02.547111    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-openshift-gateway-dockercfg-kph2k\""
Jul 18 01:53:02.547218 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:53:02.547209    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istio-kubeconfig\""
Jul 18 01:53:02.564710 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:53:02.564685    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-94bb8fbfd-cs62j"]
Jul 18 01:53:02.665657 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:53:02.665630    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qfvxr\" (UniqueName: \"kubernetes.io/projected/f3a49d60-42c3-4776-aa91-b437ecdc9a19-kube-api-access-qfvxr\") pod \"istiod-openshift-gateway-94bb8fbfd-cs62j\" (UID: \"f3a49d60-42c3-4776-aa91-b437ecdc9a19\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-cs62j"
Jul 18 01:53:02.665769 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:53:02.665660    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/f3a49d60-42c3-4776-aa91-b437ecdc9a19-local-certs\") pod \"istiod-openshift-gateway-94bb8fbfd-cs62j\" (UID: \"f3a49d60-42c3-4776-aa91-b437ecdc9a19\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-cs62j"
Jul 18 01:53:02.665769 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:53:02.665683    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f3a49d60-42c3-4776-aa91-b437ecdc9a19-istio-token\") pod \"istiod-openshift-gateway-94bb8fbfd-cs62j\" (UID: \"f3a49d60-42c3-4776-aa91-b437ecdc9a19\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-cs62j"
Jul 18 01:53:02.665769 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:53:02.665701    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/f3a49d60-42c3-4776-aa91-b437ecdc9a19-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-94bb8fbfd-cs62j\" (UID: \"f3a49d60-42c3-4776-aa91-b437ecdc9a19\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-cs62j"
Jul 18 01:53:02.665769 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:53:02.665753    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/f3a49d60-42c3-4776-aa91-b437ecdc9a19-cacerts\") pod \"istiod-openshift-gateway-94bb8fbfd-cs62j\" (UID: \"f3a49d60-42c3-4776-aa91-b437ecdc9a19\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-cs62j"
Jul 18 01:53:02.665892 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:53:02.665789    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/f3a49d60-42c3-4776-aa91-b437ecdc9a19-istio-kubeconfig\") pod \"istiod-openshift-gateway-94bb8fbfd-cs62j\" (UID: \"f3a49d60-42c3-4776-aa91-b437ecdc9a19\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-cs62j"
Jul 18 01:53:02.665892 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:53:02.665817    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/f3a49d60-42c3-4776-aa91-b437ecdc9a19-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-94bb8fbfd-cs62j\" (UID: \"f3a49d60-42c3-4776-aa91-b437ecdc9a19\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-cs62j"
Jul 18 01:53:02.766086 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:53:02.766058    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/f3a49d60-42c3-4776-aa91-b437ecdc9a19-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-94bb8fbfd-cs62j\" (UID: \"f3a49d60-42c3-4776-aa91-b437ecdc9a19\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-cs62j"
Jul 18 01:53:02.766200 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:53:02.766092    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/f3a49d60-42c3-4776-aa91-b437ecdc9a19-cacerts\") pod \"istiod-openshift-gateway-94bb8fbfd-cs62j\" (UID: \"f3a49d60-42c3-4776-aa91-b437ecdc9a19\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-cs62j"
Jul 18 01:53:02.766200 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:53:02.766122    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/f3a49d60-42c3-4776-aa91-b437ecdc9a19-istio-kubeconfig\") pod \"istiod-openshift-gateway-94bb8fbfd-cs62j\" (UID: \"f3a49d60-42c3-4776-aa91-b437ecdc9a19\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-cs62j"
Jul 18 01:53:02.766200 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:53:02.766164    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/f3a49d60-42c3-4776-aa91-b437ecdc9a19-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-94bb8fbfd-cs62j\" (UID: \"f3a49d60-42c3-4776-aa91-b437ecdc9a19\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-cs62j"
Jul 18 01:53:02.766358 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:53:02.766237    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qfvxr\" (UniqueName: \"kubernetes.io/projected/f3a49d60-42c3-4776-aa91-b437ecdc9a19-kube-api-access-qfvxr\") pod \"istiod-openshift-gateway-94bb8fbfd-cs62j\" (UID: \"f3a49d60-42c3-4776-aa91-b437ecdc9a19\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-cs62j"
Jul 18 01:53:02.766358 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:53:02.766288    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/f3a49d60-42c3-4776-aa91-b437ecdc9a19-local-certs\") pod \"istiod-openshift-gateway-94bb8fbfd-cs62j\" (UID: \"f3a49d60-42c3-4776-aa91-b437ecdc9a19\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-cs62j"
Jul 18 01:53:02.766444 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:53:02.766418    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f3a49d60-42c3-4776-aa91-b437ecdc9a19-istio-token\") pod \"istiod-openshift-gateway-94bb8fbfd-cs62j\" (UID: \"f3a49d60-42c3-4776-aa91-b437ecdc9a19\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-cs62j"
Jul 18 01:53:02.766854 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:53:02.766835    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/f3a49d60-42c3-4776-aa91-b437ecdc9a19-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-94bb8fbfd-cs62j\" (UID: \"f3a49d60-42c3-4776-aa91-b437ecdc9a19\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-cs62j"
Jul 18 01:53:02.768433 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:53:02.768408    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/f3a49d60-42c3-4776-aa91-b437ecdc9a19-istio-kubeconfig\") pod \"istiod-openshift-gateway-94bb8fbfd-cs62j\" (UID: \"f3a49d60-42c3-4776-aa91-b437ecdc9a19\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-cs62j"
Jul 18 01:53:02.768529 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:53:02.768449    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/f3a49d60-42c3-4776-aa91-b437ecdc9a19-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-94bb8fbfd-cs62j\" (UID: \"f3a49d60-42c3-4776-aa91-b437ecdc9a19\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-cs62j"
Jul 18 01:53:02.768599 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:53:02.768585    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/f3a49d60-42c3-4776-aa91-b437ecdc9a19-local-certs\") pod \"istiod-openshift-gateway-94bb8fbfd-cs62j\" (UID: \"f3a49d60-42c3-4776-aa91-b437ecdc9a19\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-cs62j"
Jul 18 01:53:02.768785 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:53:02.768768    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/f3a49d60-42c3-4776-aa91-b437ecdc9a19-cacerts\") pod \"istiod-openshift-gateway-94bb8fbfd-cs62j\" (UID: \"f3a49d60-42c3-4776-aa91-b437ecdc9a19\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-cs62j"
Jul 18 01:53:02.776927 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:53:02.776909    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qfvxr\" (UniqueName: \"kubernetes.io/projected/f3a49d60-42c3-4776-aa91-b437ecdc9a19-kube-api-access-qfvxr\") pod \"istiod-openshift-gateway-94bb8fbfd-cs62j\" (UID: \"f3a49d60-42c3-4776-aa91-b437ecdc9a19\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-cs62j"
Jul 18 01:53:02.777039 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:53:02.777022    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f3a49d60-42c3-4776-aa91-b437ecdc9a19-istio-token\") pod \"istiod-openshift-gateway-94bb8fbfd-cs62j\" (UID: \"f3a49d60-42c3-4776-aa91-b437ecdc9a19\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-cs62j"
Jul 18 01:53:02.855298 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:53:02.855248    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-cs62j"
Jul 18 01:53:03.019243 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:53:03.019207    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-94bb8fbfd-cs62j"]
Jul 18 01:53:03.022216 ip-10-0-142-238 kubenswrapper[2566]: W0718 01:53:03.022187    2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf3a49d60_42c3_4776_aa91_b437ecdc9a19.slice/crio-3e7780bad1eed87e060d37b94f94c04069dc775a447c7dce5763e954c8570161 WatchSource:0}: Error finding container 3e7780bad1eed87e060d37b94f94c04069dc775a447c7dce5763e954c8570161: Status 404 returned error can't find the container with id 3e7780bad1eed87e060d37b94f94c04069dc775a447c7dce5763e954c8570161
Jul 18 01:53:03.108241 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:53:03.108149    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-cs62j" event={"ID":"f3a49d60-42c3-4776-aa91-b437ecdc9a19","Type":"ContainerStarted","Data":"3e7780bad1eed87e060d37b94f94c04069dc775a447c7dce5763e954c8570161"}
Jul 18 01:53:05.460408 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:53:05.460367    2566 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 18 01:53:05.460736 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:53:05.460438    2566 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 18 01:53:06.122886 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:53:06.122846    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-cs62j" event={"ID":"f3a49d60-42c3-4776-aa91-b437ecdc9a19","Type":"ContainerStarted","Data":"9d012b813cd06d7bae437eb384a2ec718a8d69f91d72dd392a453d8323fa2efc"}
Jul 18 01:53:06.123064 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:53:06.123036    2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-cs62j"
Jul 18 01:53:06.124745 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:53:06.124719    2566 patch_prober.go:28] interesting pod/istiod-openshift-gateway-94bb8fbfd-cs62j container/discovery namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Jul 18 01:53:06.124877 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:53:06.124769    2566 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-cs62j" podUID="f3a49d60-42c3-4776-aa91-b437ecdc9a19" containerName="discovery" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 18 01:53:06.146667 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:53:06.146591    2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-cs62j" podStartSLOduration=1.710523336 podStartE2EDuration="4.146577191s" totalImagesPullingTime="2.436053855s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-18 01:53:02 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-18 01:53:06.144940362 +0000 UTC m=+317.833667804" watchObservedRunningTime="2026-07-18 01:53:06.146577191 +0000 UTC m=+317.835304637"
Jul 18 01:53:07.079707 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:53:07.079678    2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-lws-operator/lws-controller-manager-5b6fc5d786-t4876"
Jul 18 01:53:07.128006 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:53:07.127978    2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-cs62j"
Jul 18 01:54:12.249348 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:54:12.249269    2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0xqbk8"]
Jul 18 01:54:12.252408 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:54:12.252392    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0xqbk8"
Jul 18 01:54:12.254780 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:54:12.254756    2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\""
Jul 18 01:54:12.255053 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:54:12.254784    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-vq2tw\""
Jul 18 01:54:12.255053 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:54:12.254759    2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\""
Jul 18 01:54:12.261209 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:54:12.261185    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0xqbk8"]
Jul 18 01:54:12.301136 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:54:12.301103    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/705bf56e-32ea-4869-93bc-d6c47279ecee-util\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0xqbk8\" (UID: \"705bf56e-32ea-4869-93bc-d6c47279ecee\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0xqbk8"
Jul 18 01:54:12.301280 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:54:12.301159    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/705bf56e-32ea-4869-93bc-d6c47279ecee-bundle\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0xqbk8\" (UID: \"705bf56e-32ea-4869-93bc-d6c47279ecee\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0xqbk8"
Jul 18 01:54:12.301280 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:54:12.301200    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-l9r5x\" (UniqueName: \"kubernetes.io/projected/705bf56e-32ea-4869-93bc-d6c47279ecee-kube-api-access-l9r5x\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0xqbk8\" (UID: \"705bf56e-32ea-4869-93bc-d6c47279ecee\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0xqbk8"
Jul 18 01:54:12.401688 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:54:12.401655    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/705bf56e-32ea-4869-93bc-d6c47279ecee-util\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0xqbk8\" (UID: \"705bf56e-32ea-4869-93bc-d6c47279ecee\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0xqbk8"
Jul 18 01:54:12.401827 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:54:12.401719    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/705bf56e-32ea-4869-93bc-d6c47279ecee-bundle\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0xqbk8\" (UID: \"705bf56e-32ea-4869-93bc-d6c47279ecee\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0xqbk8"
Jul 18 01:54:12.401827 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:54:12.401753    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-l9r5x\" (UniqueName: \"kubernetes.io/projected/705bf56e-32ea-4869-93bc-d6c47279ecee-kube-api-access-l9r5x\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0xqbk8\" (UID: \"705bf56e-32ea-4869-93bc-d6c47279ecee\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0xqbk8"
Jul 18 01:54:12.402093 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:54:12.402071    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/705bf56e-32ea-4869-93bc-d6c47279ecee-util\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0xqbk8\" (UID: \"705bf56e-32ea-4869-93bc-d6c47279ecee\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0xqbk8"
Jul 18 01:54:12.402132 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:54:12.402084    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/705bf56e-32ea-4869-93bc-d6c47279ecee-bundle\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0xqbk8\" (UID: \"705bf56e-32ea-4869-93bc-d6c47279ecee\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0xqbk8"
Jul 18 01:54:12.410403 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:54:12.410374    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-l9r5x\" (UniqueName: \"kubernetes.io/projected/705bf56e-32ea-4869-93bc-d6c47279ecee-kube-api-access-l9r5x\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0xqbk8\" (UID: \"705bf56e-32ea-4869-93bc-d6c47279ecee\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0xqbk8"
Jul 18 01:54:12.561464 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:54:12.561441    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0xqbk8"
Jul 18 01:54:12.707328 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:54:12.707301    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0xqbk8"]
Jul 18 01:54:12.709396 ip-10-0-142-238 kubenswrapper[2566]: W0718 01:54:12.709368    2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod705bf56e_32ea_4869_93bc_d6c47279ecee.slice/crio-54d7150f887c018f850b3b060838ed7510ce61197e549a41c73c6fba02c9e3ab WatchSource:0}: Error finding container 54d7150f887c018f850b3b060838ed7510ce61197e549a41c73c6fba02c9e3ab: Status 404 returned error can't find the container with id 54d7150f887c018f850b3b060838ed7510ce61197e549a41c73c6fba02c9e3ab
Jul 18 01:54:13.122823 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:54:13.122729    2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1kb4sj"]
Jul 18 01:54:13.125960 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:54:13.125944    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1kb4sj"
Jul 18 01:54:13.146577 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:54:13.146548    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1kb4sj"]
Jul 18 01:54:13.209356 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:54:13.209328    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/6cbfcdd3-6983-41ee-ae84-8682939ff7de-bundle\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1kb4sj\" (UID: \"6cbfcdd3-6983-41ee-ae84-8682939ff7de\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1kb4sj"
Jul 18 01:54:13.209525 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:54:13.209363    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/6cbfcdd3-6983-41ee-ae84-8682939ff7de-util\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1kb4sj\" (UID: \"6cbfcdd3-6983-41ee-ae84-8682939ff7de\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1kb4sj"
Jul 18 01:54:13.209525 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:54:13.209391    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pfbmd\" (UniqueName: \"kubernetes.io/projected/6cbfcdd3-6983-41ee-ae84-8682939ff7de-kube-api-access-pfbmd\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1kb4sj\" (UID: \"6cbfcdd3-6983-41ee-ae84-8682939ff7de\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1kb4sj"
Jul 18 01:54:13.309734 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:54:13.309708    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/6cbfcdd3-6983-41ee-ae84-8682939ff7de-bundle\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1kb4sj\" (UID: \"6cbfcdd3-6983-41ee-ae84-8682939ff7de\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1kb4sj"
Jul 18 01:54:13.310066 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:54:13.309742    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/6cbfcdd3-6983-41ee-ae84-8682939ff7de-util\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1kb4sj\" (UID: \"6cbfcdd3-6983-41ee-ae84-8682939ff7de\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1kb4sj"
Jul 18 01:54:13.310066 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:54:13.309767    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pfbmd\" (UniqueName: \"kubernetes.io/projected/6cbfcdd3-6983-41ee-ae84-8682939ff7de-kube-api-access-pfbmd\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1kb4sj\" (UID: \"6cbfcdd3-6983-41ee-ae84-8682939ff7de\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1kb4sj"
Jul 18 01:54:13.310145 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:54:13.310064    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/6cbfcdd3-6983-41ee-ae84-8682939ff7de-bundle\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1kb4sj\" (UID: \"6cbfcdd3-6983-41ee-ae84-8682939ff7de\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1kb4sj"
Jul 18 01:54:13.310145 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:54:13.310124    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/6cbfcdd3-6983-41ee-ae84-8682939ff7de-util\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1kb4sj\" (UID: \"6cbfcdd3-6983-41ee-ae84-8682939ff7de\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1kb4sj"
Jul 18 01:54:13.317449 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:54:13.317421    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pfbmd\" (UniqueName: \"kubernetes.io/projected/6cbfcdd3-6983-41ee-ae84-8682939ff7de-kube-api-access-pfbmd\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1kb4sj\" (UID: \"6cbfcdd3-6983-41ee-ae84-8682939ff7de\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1kb4sj"
Jul 18 01:54:13.407481 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:54:13.407424    2566 generic.go:356] "Generic (PLEG): container finished" podID="705bf56e-32ea-4869-93bc-d6c47279ecee" containerID="2aec48ec3e6f6398c3b10533a4a842d7db906de0f76d48be28e60f929cafb0f1" exitCode=0
Jul 18 01:54:13.407568 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:54:13.407514    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0xqbk8" event={"ID":"705bf56e-32ea-4869-93bc-d6c47279ecee","Type":"ContainerDied","Data":"2aec48ec3e6f6398c3b10533a4a842d7db906de0f76d48be28e60f929cafb0f1"}
Jul 18 01:54:13.407626 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:54:13.407569    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0xqbk8" event={"ID":"705bf56e-32ea-4869-93bc-d6c47279ecee","Type":"ContainerStarted","Data":"54d7150f887c018f850b3b060838ed7510ce61197e549a41c73c6fba02c9e3ab"}
Jul 18 01:54:13.434278 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:54:13.434256    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1kb4sj"
Jul 18 01:54:13.445409 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:54:13.445390    2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759cjfmt"]
Jul 18 01:54:13.455475 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:54:13.455453    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759cjfmt"
Jul 18 01:54:13.456014 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:54:13.455976    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759cjfmt"]
Jul 18 01:54:13.511515 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:54:13.511492    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/4c6603cb-ac41-4dee-9847-e4cdcdc9baa6-bundle\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759cjfmt\" (UID: \"4c6603cb-ac41-4dee-9847-e4cdcdc9baa6\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759cjfmt"
Jul 18 01:54:13.511651 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:54:13.511521    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/4c6603cb-ac41-4dee-9847-e4cdcdc9baa6-util\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759cjfmt\" (UID: \"4c6603cb-ac41-4dee-9847-e4cdcdc9baa6\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759cjfmt"
Jul 18 01:54:13.511651 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:54:13.511562    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vqgvw\" (UniqueName: \"kubernetes.io/projected/4c6603cb-ac41-4dee-9847-e4cdcdc9baa6-kube-api-access-vqgvw\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759cjfmt\" (UID: \"4c6603cb-ac41-4dee-9847-e4cdcdc9baa6\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759cjfmt"
Jul 18 01:54:13.559971 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:54:13.559950    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1kb4sj"]
Jul 18 01:54:13.561766 ip-10-0-142-238 kubenswrapper[2566]: W0718 01:54:13.561740    2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6cbfcdd3_6983_41ee_ae84_8682939ff7de.slice/crio-e8239d3e37ff3bb296def335f2a5764fb41ad17a29d7fa05c7e20120fee7f63f WatchSource:0}: Error finding container e8239d3e37ff3bb296def335f2a5764fb41ad17a29d7fa05c7e20120fee7f63f: Status 404 returned error can't find the container with id e8239d3e37ff3bb296def335f2a5764fb41ad17a29d7fa05c7e20120fee7f63f
Jul 18 01:54:13.612204 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:54:13.612185    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/4c6603cb-ac41-4dee-9847-e4cdcdc9baa6-bundle\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759cjfmt\" (UID: \"4c6603cb-ac41-4dee-9847-e4cdcdc9baa6\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759cjfmt"
Jul 18 01:54:13.612272 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:54:13.612213    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/4c6603cb-ac41-4dee-9847-e4cdcdc9baa6-util\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759cjfmt\" (UID: \"4c6603cb-ac41-4dee-9847-e4cdcdc9baa6\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759cjfmt"
Jul 18 01:54:13.612272 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:54:13.612248    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vqgvw\" (UniqueName: \"kubernetes.io/projected/4c6603cb-ac41-4dee-9847-e4cdcdc9baa6-kube-api-access-vqgvw\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759cjfmt\" (UID: \"4c6603cb-ac41-4dee-9847-e4cdcdc9baa6\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759cjfmt"
Jul 18 01:54:13.612558 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:54:13.612542    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/4c6603cb-ac41-4dee-9847-e4cdcdc9baa6-util\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759cjfmt\" (UID: \"4c6603cb-ac41-4dee-9847-e4cdcdc9baa6\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759cjfmt"
Jul 18 01:54:13.612630 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:54:13.612598    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/4c6603cb-ac41-4dee-9847-e4cdcdc9baa6-bundle\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759cjfmt\" (UID: \"4c6603cb-ac41-4dee-9847-e4cdcdc9baa6\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759cjfmt"
Jul 18 01:54:13.619955 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:54:13.619936    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vqgvw\" (UniqueName: \"kubernetes.io/projected/4c6603cb-ac41-4dee-9847-e4cdcdc9baa6-kube-api-access-vqgvw\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759cjfmt\" (UID: \"4c6603cb-ac41-4dee-9847-e4cdcdc9baa6\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759cjfmt"
Jul 18 01:54:13.766130 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:54:13.766071    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759cjfmt"
Jul 18 01:54:13.849822 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:54:13.849791    2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73w7pjw"]
Jul 18 01:54:13.853802 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:54:13.853781    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73w7pjw"
Jul 18 01:54:13.862205 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:54:13.862012    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73w7pjw"]
Jul 18 01:54:13.896003 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:54:13.895973    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759cjfmt"]
Jul 18 01:54:13.914999 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:54:13.914972    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/fcc9b86e-50bc-4250-b400-6828c3a3da67-bundle\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73w7pjw\" (UID: \"fcc9b86e-50bc-4250-b400-6828c3a3da67\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73w7pjw"
Jul 18 01:54:13.915093 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:54:13.915041    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/fcc9b86e-50bc-4250-b400-6828c3a3da67-util\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73w7pjw\" (UID: \"fcc9b86e-50bc-4250-b400-6828c3a3da67\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73w7pjw"
Jul 18 01:54:13.915093 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:54:13.915086    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jvzbq\" (UniqueName: \"kubernetes.io/projected/fcc9b86e-50bc-4250-b400-6828c3a3da67-kube-api-access-jvzbq\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73w7pjw\" (UID: \"fcc9b86e-50bc-4250-b400-6828c3a3da67\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73w7pjw"
Jul 18 01:54:14.015950 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:54:14.015925    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/fcc9b86e-50bc-4250-b400-6828c3a3da67-bundle\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73w7pjw\" (UID: \"fcc9b86e-50bc-4250-b400-6828c3a3da67\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73w7pjw"
Jul 18 01:54:14.016042 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:54:14.015967    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/fcc9b86e-50bc-4250-b400-6828c3a3da67-util\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73w7pjw\" (UID: \"fcc9b86e-50bc-4250-b400-6828c3a3da67\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73w7pjw"
Jul 18 01:54:14.016042 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:54:14.016001    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jvzbq\" (UniqueName: \"kubernetes.io/projected/fcc9b86e-50bc-4250-b400-6828c3a3da67-kube-api-access-jvzbq\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73w7pjw\" (UID: \"fcc9b86e-50bc-4250-b400-6828c3a3da67\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73w7pjw"
Jul 18 01:54:14.016299 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:54:14.016258    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/fcc9b86e-50bc-4250-b400-6828c3a3da67-bundle\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73w7pjw\" (UID: \"fcc9b86e-50bc-4250-b400-6828c3a3da67\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73w7pjw"
Jul 18 01:54:14.016337 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:54:14.016306    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/fcc9b86e-50bc-4250-b400-6828c3a3da67-util\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73w7pjw\" (UID: \"fcc9b86e-50bc-4250-b400-6828c3a3da67\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73w7pjw"
Jul 18 01:54:14.024263 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:54:14.024242    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jvzbq\" (UniqueName: \"kubernetes.io/projected/fcc9b86e-50bc-4250-b400-6828c3a3da67-kube-api-access-jvzbq\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73w7pjw\" (UID: \"fcc9b86e-50bc-4250-b400-6828c3a3da67\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73w7pjw"
Jul 18 01:54:14.165370 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:54:14.165336    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73w7pjw"
Jul 18 01:54:14.289394 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:54:14.289359    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73w7pjw"]
Jul 18 01:54:14.304295 ip-10-0-142-238 kubenswrapper[2566]: W0718 01:54:14.304267    2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfcc9b86e_50bc_4250_b400_6828c3a3da67.slice/crio-a9ddcaef67c089bf2c5c5b04e846820a22d1eed5986b5663a90fc70860a36f1e WatchSource:0}: Error finding container a9ddcaef67c089bf2c5c5b04e846820a22d1eed5986b5663a90fc70860a36f1e: Status 404 returned error can't find the container with id a9ddcaef67c089bf2c5c5b04e846820a22d1eed5986b5663a90fc70860a36f1e
Jul 18 01:54:14.413455 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:54:14.413427    2566 generic.go:356] "Generic (PLEG): container finished" podID="fcc9b86e-50bc-4250-b400-6828c3a3da67" containerID="37b4c539809a63ed208161e0050c98d7f8e51284867b373774659c33e5109bb2" exitCode=0
Jul 18 01:54:14.413803 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:54:14.413480    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73w7pjw" event={"ID":"fcc9b86e-50bc-4250-b400-6828c3a3da67","Type":"ContainerDied","Data":"37b4c539809a63ed208161e0050c98d7f8e51284867b373774659c33e5109bb2"}
Jul 18 01:54:14.413803 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:54:14.413546    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73w7pjw" event={"ID":"fcc9b86e-50bc-4250-b400-6828c3a3da67","Type":"ContainerStarted","Data":"a9ddcaef67c089bf2c5c5b04e846820a22d1eed5986b5663a90fc70860a36f1e"}
Jul 18 01:54:14.415152 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:54:14.415132    2566 generic.go:356] "Generic (PLEG): container finished" podID="4c6603cb-ac41-4dee-9847-e4cdcdc9baa6" containerID="f6c323b8e034be0a5d5e09c059db36bcc13d248bf3e9a985d73e37b4fa9fb43a" exitCode=0
Jul 18 01:54:14.415243 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:54:14.415218    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759cjfmt" event={"ID":"4c6603cb-ac41-4dee-9847-e4cdcdc9baa6","Type":"ContainerDied","Data":"f6c323b8e034be0a5d5e09c059db36bcc13d248bf3e9a985d73e37b4fa9fb43a"}
Jul 18 01:54:14.415292 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:54:14.415268    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759cjfmt" event={"ID":"4c6603cb-ac41-4dee-9847-e4cdcdc9baa6","Type":"ContainerStarted","Data":"5099e9c832a91dd4a07154499d99ba0d63116c85382c9cbaea630e0cb4b9af5c"}
Jul 18 01:54:14.416924 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:54:14.416904    2566 generic.go:356] "Generic (PLEG): container finished" podID="6cbfcdd3-6983-41ee-ae84-8682939ff7de" containerID="48a1bf827896678b87233afb38b28c67386c2c4b08ad68889b6b7d243208b198" exitCode=0
Jul 18 01:54:14.417054 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:54:14.416994    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1kb4sj" event={"ID":"6cbfcdd3-6983-41ee-ae84-8682939ff7de","Type":"ContainerDied","Data":"48a1bf827896678b87233afb38b28c67386c2c4b08ad68889b6b7d243208b198"}
Jul 18 01:54:14.417054 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:54:14.417030    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1kb4sj" event={"ID":"6cbfcdd3-6983-41ee-ae84-8682939ff7de","Type":"ContainerStarted","Data":"e8239d3e37ff3bb296def335f2a5764fb41ad17a29d7fa05c7e20120fee7f63f"}
Jul 18 01:54:14.419206 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:54:14.419109    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0xqbk8" event={"ID":"705bf56e-32ea-4869-93bc-d6c47279ecee","Type":"ContainerStarted","Data":"1dc706329d8924f0799c3c330278e9a2ec43a79416bcf7edb0859006b5579cf7"}
Jul 18 01:54:15.425278 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:54:15.425245    2566 generic.go:356] "Generic (PLEG): container finished" podID="6cbfcdd3-6983-41ee-ae84-8682939ff7de" containerID="ebc2ab6498e9cf740cf87ca085552660dbda2000a2b7405298b862d043cb0da7" exitCode=0
Jul 18 01:54:15.425632 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:54:15.425303    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1kb4sj" event={"ID":"6cbfcdd3-6983-41ee-ae84-8682939ff7de","Type":"ContainerDied","Data":"ebc2ab6498e9cf740cf87ca085552660dbda2000a2b7405298b862d043cb0da7"}
Jul 18 01:54:15.427149 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:54:15.427128    2566 generic.go:356] "Generic (PLEG): container finished" podID="705bf56e-32ea-4869-93bc-d6c47279ecee" containerID="1dc706329d8924f0799c3c330278e9a2ec43a79416bcf7edb0859006b5579cf7" exitCode=0
Jul 18 01:54:15.427278 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:54:15.427211    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0xqbk8" event={"ID":"705bf56e-32ea-4869-93bc-d6c47279ecee","Type":"ContainerDied","Data":"1dc706329d8924f0799c3c330278e9a2ec43a79416bcf7edb0859006b5579cf7"}
Jul 18 01:54:16.433811 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:54:16.433776    2566 generic.go:356] "Generic (PLEG): container finished" podID="6cbfcdd3-6983-41ee-ae84-8682939ff7de" containerID="462fc6a5fe4284353e3777b252236977d78a7ef695330c3d148c1c930fc779f5" exitCode=0
Jul 18 01:54:16.434191 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:54:16.433867    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1kb4sj" event={"ID":"6cbfcdd3-6983-41ee-ae84-8682939ff7de","Type":"ContainerDied","Data":"462fc6a5fe4284353e3777b252236977d78a7ef695330c3d148c1c930fc779f5"}
Jul 18 01:54:16.435688 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:54:16.435667    2566 generic.go:356] "Generic (PLEG): container finished" podID="705bf56e-32ea-4869-93bc-d6c47279ecee" containerID="8c4d86b70a2ade79d8702c7f1e9226bd6dc793c61189a4fc1cb76d5a93c8613e" exitCode=0
Jul 18 01:54:16.435803 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:54:16.435735    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0xqbk8" event={"ID":"705bf56e-32ea-4869-93bc-d6c47279ecee","Type":"ContainerDied","Data":"8c4d86b70a2ade79d8702c7f1e9226bd6dc793c61189a4fc1cb76d5a93c8613e"}
Jul 18 01:54:16.442755 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:54:16.437728    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73w7pjw" event={"ID":"fcc9b86e-50bc-4250-b400-6828c3a3da67","Type":"ContainerDied","Data":"548c3ceca6cd2b60e613780545edf8e1e5a16b164eb029daf08b21cd6b76502f"}
Jul 18 01:54:16.442755 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:54:16.437748    2566 generic.go:356] "Generic (PLEG): container finished" podID="fcc9b86e-50bc-4250-b400-6828c3a3da67" containerID="548c3ceca6cd2b60e613780545edf8e1e5a16b164eb029daf08b21cd6b76502f" exitCode=0
Jul 18 01:54:16.444281 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:54:16.444262    2566 generic.go:356] "Generic (PLEG): container finished" podID="4c6603cb-ac41-4dee-9847-e4cdcdc9baa6" containerID="90e6d31f050245ad73829c681b46caf4927035e1df6c03b6eea2537da13511fa" exitCode=0
Jul 18 01:54:16.444376 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:54:16.444341    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759cjfmt" event={"ID":"4c6603cb-ac41-4dee-9847-e4cdcdc9baa6","Type":"ContainerDied","Data":"90e6d31f050245ad73829c681b46caf4927035e1df6c03b6eea2537da13511fa"}
Jul 18 01:54:17.453661 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:54:17.453626    2566 generic.go:356] "Generic (PLEG): container finished" podID="fcc9b86e-50bc-4250-b400-6828c3a3da67" containerID="ee16691975e62a5883319c6e47eebd48d88c15e31f104a16dd995851e3d4a4be" exitCode=0
Jul 18 01:54:17.454070 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:54:17.453707    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73w7pjw" event={"ID":"fcc9b86e-50bc-4250-b400-6828c3a3da67","Type":"ContainerDied","Data":"ee16691975e62a5883319c6e47eebd48d88c15e31f104a16dd995851e3d4a4be"}
Jul 18 01:54:17.455406 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:54:17.455382    2566 generic.go:356] "Generic (PLEG): container finished" podID="4c6603cb-ac41-4dee-9847-e4cdcdc9baa6" containerID="e0412ecedb95e383ad41b45e882da4929dbfd4304f20a6eb3e82f49e424350a1" exitCode=0
Jul 18 01:54:17.455555 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:54:17.455457    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759cjfmt" event={"ID":"4c6603cb-ac41-4dee-9847-e4cdcdc9baa6","Type":"ContainerDied","Data":"e0412ecedb95e383ad41b45e882da4929dbfd4304f20a6eb3e82f49e424350a1"}
Jul 18 01:54:17.603530 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:54:17.603507    2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1kb4sj"
Jul 18 01:54:17.605976 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:54:17.605954    2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0xqbk8"
Jul 18 01:54:17.745059 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:54:17.744979    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/6cbfcdd3-6983-41ee-ae84-8682939ff7de-util\") pod \"6cbfcdd3-6983-41ee-ae84-8682939ff7de\" (UID: \"6cbfcdd3-6983-41ee-ae84-8682939ff7de\") "
Jul 18 01:54:17.745059 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:54:17.745021    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/705bf56e-32ea-4869-93bc-d6c47279ecee-bundle\") pod \"705bf56e-32ea-4869-93bc-d6c47279ecee\" (UID: \"705bf56e-32ea-4869-93bc-d6c47279ecee\") "
Jul 18 01:54:17.745059 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:54:17.745051    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/6cbfcdd3-6983-41ee-ae84-8682939ff7de-bundle\") pod \"6cbfcdd3-6983-41ee-ae84-8682939ff7de\" (UID: \"6cbfcdd3-6983-41ee-ae84-8682939ff7de\") "
Jul 18 01:54:17.745326 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:54:17.745087    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/705bf56e-32ea-4869-93bc-d6c47279ecee-util\") pod \"705bf56e-32ea-4869-93bc-d6c47279ecee\" (UID: \"705bf56e-32ea-4869-93bc-d6c47279ecee\") "
Jul 18 01:54:17.745326 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:54:17.745119    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-l9r5x\" (UniqueName: \"kubernetes.io/projected/705bf56e-32ea-4869-93bc-d6c47279ecee-kube-api-access-l9r5x\") pod \"705bf56e-32ea-4869-93bc-d6c47279ecee\" (UID: \"705bf56e-32ea-4869-93bc-d6c47279ecee\") "
Jul 18 01:54:17.745326 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:54:17.745136    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-pfbmd\" (UniqueName: \"kubernetes.io/projected/6cbfcdd3-6983-41ee-ae84-8682939ff7de-kube-api-access-pfbmd\") pod \"6cbfcdd3-6983-41ee-ae84-8682939ff7de\" (UID: \"6cbfcdd3-6983-41ee-ae84-8682939ff7de\") "
Jul 18 01:54:17.745576 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:54:17.745547    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/705bf56e-32ea-4869-93bc-d6c47279ecee-bundle" (OuterVolumeSpecName: "bundle") pod "705bf56e-32ea-4869-93bc-d6c47279ecee" (UID: "705bf56e-32ea-4869-93bc-d6c47279ecee"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 18 01:54:17.745719 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:54:17.745668    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6cbfcdd3-6983-41ee-ae84-8682939ff7de-bundle" (OuterVolumeSpecName: "bundle") pod "6cbfcdd3-6983-41ee-ae84-8682939ff7de" (UID: "6cbfcdd3-6983-41ee-ae84-8682939ff7de"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 18 01:54:17.747847 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:54:17.747812    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/705bf56e-32ea-4869-93bc-d6c47279ecee-kube-api-access-l9r5x" (OuterVolumeSpecName: "kube-api-access-l9r5x") pod "705bf56e-32ea-4869-93bc-d6c47279ecee" (UID: "705bf56e-32ea-4869-93bc-d6c47279ecee"). InnerVolumeSpecName "kube-api-access-l9r5x". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 18 01:54:17.747847 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:54:17.747831    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6cbfcdd3-6983-41ee-ae84-8682939ff7de-kube-api-access-pfbmd" (OuterVolumeSpecName: "kube-api-access-pfbmd") pod "6cbfcdd3-6983-41ee-ae84-8682939ff7de" (UID: "6cbfcdd3-6983-41ee-ae84-8682939ff7de"). InnerVolumeSpecName "kube-api-access-pfbmd". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 18 01:54:17.750584 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:54:17.750557    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6cbfcdd3-6983-41ee-ae84-8682939ff7de-util" (OuterVolumeSpecName: "util") pod "6cbfcdd3-6983-41ee-ae84-8682939ff7de" (UID: "6cbfcdd3-6983-41ee-ae84-8682939ff7de"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 18 01:54:17.750857 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:54:17.750838    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/705bf56e-32ea-4869-93bc-d6c47279ecee-util" (OuterVolumeSpecName: "util") pod "705bf56e-32ea-4869-93bc-d6c47279ecee" (UID: "705bf56e-32ea-4869-93bc-d6c47279ecee"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 18 01:54:17.846431 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:54:17.846398    2566 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/705bf56e-32ea-4869-93bc-d6c47279ecee-util\") on node \"ip-10-0-142-238.ec2.internal\" DevicePath \"\""
Jul 18 01:54:17.846431 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:54:17.846429    2566 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-l9r5x\" (UniqueName: \"kubernetes.io/projected/705bf56e-32ea-4869-93bc-d6c47279ecee-kube-api-access-l9r5x\") on node \"ip-10-0-142-238.ec2.internal\" DevicePath \"\""
Jul 18 01:54:17.846431 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:54:17.846439    2566 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-pfbmd\" (UniqueName: \"kubernetes.io/projected/6cbfcdd3-6983-41ee-ae84-8682939ff7de-kube-api-access-pfbmd\") on node \"ip-10-0-142-238.ec2.internal\" DevicePath \"\""
Jul 18 01:54:17.846575 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:54:17.846448    2566 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/6cbfcdd3-6983-41ee-ae84-8682939ff7de-util\") on node \"ip-10-0-142-238.ec2.internal\" DevicePath \"\""
Jul 18 01:54:17.846575 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:54:17.846456    2566 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/705bf56e-32ea-4869-93bc-d6c47279ecee-bundle\") on node \"ip-10-0-142-238.ec2.internal\" DevicePath \"\""
Jul 18 01:54:17.846575 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:54:17.846462    2566 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/6cbfcdd3-6983-41ee-ae84-8682939ff7de-bundle\") on node \"ip-10-0-142-238.ec2.internal\" DevicePath \"\""
Jul 18 01:54:18.461632 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:54:18.461577    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1kb4sj" event={"ID":"6cbfcdd3-6983-41ee-ae84-8682939ff7de","Type":"ContainerDied","Data":"e8239d3e37ff3bb296def335f2a5764fb41ad17a29d7fa05c7e20120fee7f63f"}
Jul 18 01:54:18.462037 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:54:18.461644    2566 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="e8239d3e37ff3bb296def335f2a5764fb41ad17a29d7fa05c7e20120fee7f63f"
Jul 18 01:54:18.462037 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:54:18.461581    2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1kb4sj"
Jul 18 01:54:18.463500 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:54:18.463482    2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0xqbk8"
Jul 18 01:54:18.463638 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:54:18.463530    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0xqbk8" event={"ID":"705bf56e-32ea-4869-93bc-d6c47279ecee","Type":"ContainerDied","Data":"54d7150f887c018f850b3b060838ed7510ce61197e549a41c73c6fba02c9e3ab"}
Jul 18 01:54:18.463638 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:54:18.463576    2566 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="54d7150f887c018f850b3b060838ed7510ce61197e549a41c73c6fba02c9e3ab"
Jul 18 01:54:18.593997 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:54:18.593975    2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73w7pjw"
Jul 18 01:54:18.618683 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:54:18.618582    2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759cjfmt"
Jul 18 01:54:18.653073 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:54:18.653050    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-jvzbq\" (UniqueName: \"kubernetes.io/projected/fcc9b86e-50bc-4250-b400-6828c3a3da67-kube-api-access-jvzbq\") pod \"fcc9b86e-50bc-4250-b400-6828c3a3da67\" (UID: \"fcc9b86e-50bc-4250-b400-6828c3a3da67\") "
Jul 18 01:54:18.653197 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:54:18.653113    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/fcc9b86e-50bc-4250-b400-6828c3a3da67-bundle\") pod \"fcc9b86e-50bc-4250-b400-6828c3a3da67\" (UID: \"fcc9b86e-50bc-4250-b400-6828c3a3da67\") "
Jul 18 01:54:18.653197 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:54:18.653170    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/fcc9b86e-50bc-4250-b400-6828c3a3da67-util\") pod \"fcc9b86e-50bc-4250-b400-6828c3a3da67\" (UID: \"fcc9b86e-50bc-4250-b400-6828c3a3da67\") "
Jul 18 01:54:18.653854 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:54:18.653829    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/fcc9b86e-50bc-4250-b400-6828c3a3da67-bundle" (OuterVolumeSpecName: "bundle") pod "fcc9b86e-50bc-4250-b400-6828c3a3da67" (UID: "fcc9b86e-50bc-4250-b400-6828c3a3da67"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 18 01:54:18.655039 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:54:18.655014    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/fcc9b86e-50bc-4250-b400-6828c3a3da67-kube-api-access-jvzbq" (OuterVolumeSpecName: "kube-api-access-jvzbq") pod "fcc9b86e-50bc-4250-b400-6828c3a3da67" (UID: "fcc9b86e-50bc-4250-b400-6828c3a3da67"). InnerVolumeSpecName "kube-api-access-jvzbq". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 18 01:54:18.659145 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:54:18.659122    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/fcc9b86e-50bc-4250-b400-6828c3a3da67-util" (OuterVolumeSpecName: "util") pod "fcc9b86e-50bc-4250-b400-6828c3a3da67" (UID: "fcc9b86e-50bc-4250-b400-6828c3a3da67"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 18 01:54:18.753760 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:54:18.753696    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/4c6603cb-ac41-4dee-9847-e4cdcdc9baa6-util\") pod \"4c6603cb-ac41-4dee-9847-e4cdcdc9baa6\" (UID: \"4c6603cb-ac41-4dee-9847-e4cdcdc9baa6\") "
Jul 18 01:54:18.753760 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:54:18.753756    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-vqgvw\" (UniqueName: \"kubernetes.io/projected/4c6603cb-ac41-4dee-9847-e4cdcdc9baa6-kube-api-access-vqgvw\") pod \"4c6603cb-ac41-4dee-9847-e4cdcdc9baa6\" (UID: \"4c6603cb-ac41-4dee-9847-e4cdcdc9baa6\") "
Jul 18 01:54:18.753911 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:54:18.753788    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/4c6603cb-ac41-4dee-9847-e4cdcdc9baa6-bundle\") pod \"4c6603cb-ac41-4dee-9847-e4cdcdc9baa6\" (UID: \"4c6603cb-ac41-4dee-9847-e4cdcdc9baa6\") "
Jul 18 01:54:18.753990 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:54:18.753974    2566 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/fcc9b86e-50bc-4250-b400-6828c3a3da67-bundle\") on node \"ip-10-0-142-238.ec2.internal\" DevicePath \"\""
Jul 18 01:54:18.754027 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:54:18.753997    2566 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/fcc9b86e-50bc-4250-b400-6828c3a3da67-util\") on node \"ip-10-0-142-238.ec2.internal\" DevicePath \"\""
Jul 18 01:54:18.754027 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:54:18.754012    2566 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-jvzbq\" (UniqueName: \"kubernetes.io/projected/fcc9b86e-50bc-4250-b400-6828c3a3da67-kube-api-access-jvzbq\") on node \"ip-10-0-142-238.ec2.internal\" DevicePath \"\""
Jul 18 01:54:18.754240 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:54:18.754210    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4c6603cb-ac41-4dee-9847-e4cdcdc9baa6-bundle" (OuterVolumeSpecName: "bundle") pod "4c6603cb-ac41-4dee-9847-e4cdcdc9baa6" (UID: "4c6603cb-ac41-4dee-9847-e4cdcdc9baa6"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 18 01:54:18.755858 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:54:18.755837    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4c6603cb-ac41-4dee-9847-e4cdcdc9baa6-kube-api-access-vqgvw" (OuterVolumeSpecName: "kube-api-access-vqgvw") pod "4c6603cb-ac41-4dee-9847-e4cdcdc9baa6" (UID: "4c6603cb-ac41-4dee-9847-e4cdcdc9baa6"). InnerVolumeSpecName "kube-api-access-vqgvw". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 18 01:54:18.758712 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:54:18.758686    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4c6603cb-ac41-4dee-9847-e4cdcdc9baa6-util" (OuterVolumeSpecName: "util") pod "4c6603cb-ac41-4dee-9847-e4cdcdc9baa6" (UID: "4c6603cb-ac41-4dee-9847-e4cdcdc9baa6"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 18 01:54:18.855004 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:54:18.854978    2566 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-vqgvw\" (UniqueName: \"kubernetes.io/projected/4c6603cb-ac41-4dee-9847-e4cdcdc9baa6-kube-api-access-vqgvw\") on node \"ip-10-0-142-238.ec2.internal\" DevicePath \"\""
Jul 18 01:54:18.855004 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:54:18.855001    2566 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/4c6603cb-ac41-4dee-9847-e4cdcdc9baa6-bundle\") on node \"ip-10-0-142-238.ec2.internal\" DevicePath \"\""
Jul 18 01:54:18.855117 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:54:18.855010    2566 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/4c6603cb-ac41-4dee-9847-e4cdcdc9baa6-util\") on node \"ip-10-0-142-238.ec2.internal\" DevicePath \"\""
Jul 18 01:54:19.469938 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:54:19.469913    2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73w7pjw"
Jul 18 01:54:19.470344 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:54:19.469913    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73w7pjw" event={"ID":"fcc9b86e-50bc-4250-b400-6828c3a3da67","Type":"ContainerDied","Data":"a9ddcaef67c089bf2c5c5b04e846820a22d1eed5986b5663a90fc70860a36f1e"}
Jul 18 01:54:19.470344 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:54:19.470058    2566 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="a9ddcaef67c089bf2c5c5b04e846820a22d1eed5986b5663a90fc70860a36f1e"
Jul 18 01:54:19.471903 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:54:19.471875    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759cjfmt" event={"ID":"4c6603cb-ac41-4dee-9847-e4cdcdc9baa6","Type":"ContainerDied","Data":"5099e9c832a91dd4a07154499d99ba0d63116c85382c9cbaea630e0cb4b9af5c"}
Jul 18 01:54:19.471903 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:54:19.471890    2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759cjfmt"
Jul 18 01:54:19.472144 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:54:19.471919    2566 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="5099e9c832a91dd4a07154499d99ba0d63116c85382c9cbaea630e0cb4b9af5c"
Jul 18 01:54:57.686760 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:54:57.686070    2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-gxssk"]
Jul 18 01:54:57.686760 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:54:57.686680    2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6cbfcdd3-6983-41ee-ae84-8682939ff7de" containerName="pull"
Jul 18 01:54:57.686760 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:54:57.686705    2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="6cbfcdd3-6983-41ee-ae84-8682939ff7de" containerName="pull"
Jul 18 01:54:57.686760 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:54:57.686716    2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="fcc9b86e-50bc-4250-b400-6828c3a3da67" containerName="pull"
Jul 18 01:54:57.686760 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:54:57.686724    2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="fcc9b86e-50bc-4250-b400-6828c3a3da67" containerName="pull"
Jul 18 01:54:57.686760 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:54:57.686744    2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="705bf56e-32ea-4869-93bc-d6c47279ecee" containerName="pull"
Jul 18 01:54:57.686760 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:54:57.686753    2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="705bf56e-32ea-4869-93bc-d6c47279ecee" containerName="pull"
Jul 18 01:54:57.686760 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:54:57.686771    2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="705bf56e-32ea-4869-93bc-d6c47279ecee" containerName="extract"
Jul 18 01:54:57.687771 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:54:57.686781    2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="705bf56e-32ea-4869-93bc-d6c47279ecee" containerName="extract"
Jul 18 01:54:57.687771 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:54:57.686800    2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6cbfcdd3-6983-41ee-ae84-8682939ff7de" containerName="util"
Jul 18 01:54:57.687771 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:54:57.686808    2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="6cbfcdd3-6983-41ee-ae84-8682939ff7de" containerName="util"
Jul 18 01:54:57.687771 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:54:57.686826    2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4c6603cb-ac41-4dee-9847-e4cdcdc9baa6" containerName="pull"
Jul 18 01:54:57.687771 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:54:57.686834    2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="4c6603cb-ac41-4dee-9847-e4cdcdc9baa6" containerName="pull"
Jul 18 01:54:57.687771 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:54:57.686843    2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6cbfcdd3-6983-41ee-ae84-8682939ff7de" containerName="extract"
Jul 18 01:54:57.687771 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:54:57.686851    2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="6cbfcdd3-6983-41ee-ae84-8682939ff7de" containerName="extract"
Jul 18 01:54:57.687771 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:54:57.686866    2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="fcc9b86e-50bc-4250-b400-6828c3a3da67" containerName="util"
Jul 18 01:54:57.687771 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:54:57.686873    2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="fcc9b86e-50bc-4250-b400-6828c3a3da67" containerName="util"
Jul 18 01:54:57.687771 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:54:57.686883    2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="fcc9b86e-50bc-4250-b400-6828c3a3da67" containerName="extract"
Jul 18 01:54:57.687771 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:54:57.686890    2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="fcc9b86e-50bc-4250-b400-6828c3a3da67" containerName="extract"
Jul 18 01:54:57.687771 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:54:57.686905    2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4c6603cb-ac41-4dee-9847-e4cdcdc9baa6" containerName="extract"
Jul 18 01:54:57.687771 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:54:57.686913    2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="4c6603cb-ac41-4dee-9847-e4cdcdc9baa6" containerName="extract"
Jul 18 01:54:57.687771 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:54:57.686933    2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4c6603cb-ac41-4dee-9847-e4cdcdc9baa6" containerName="util"
Jul 18 01:54:57.687771 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:54:57.686941    2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="4c6603cb-ac41-4dee-9847-e4cdcdc9baa6" containerName="util"
Jul 18 01:54:57.687771 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:54:57.686954    2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="705bf56e-32ea-4869-93bc-d6c47279ecee" containerName="util"
Jul 18 01:54:57.687771 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:54:57.686962    2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="705bf56e-32ea-4869-93bc-d6c47279ecee" containerName="util"
Jul 18 01:54:57.687771 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:54:57.687088    2566 memory_manager.go:368] "RemoveStaleState removing state" podUID="705bf56e-32ea-4869-93bc-d6c47279ecee" containerName="extract"
Jul 18 01:54:57.687771 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:54:57.687102    2566 memory_manager.go:368] "RemoveStaleState removing state" podUID="4c6603cb-ac41-4dee-9847-e4cdcdc9baa6" containerName="extract"
Jul 18 01:54:57.687771 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:54:57.687111    2566 memory_manager.go:368] "RemoveStaleState removing state" podUID="fcc9b86e-50bc-4250-b400-6828c3a3da67" containerName="extract"
Jul 18 01:54:57.687771 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:54:57.687127    2566 memory_manager.go:368] "RemoveStaleState removing state" podUID="6cbfcdd3-6983-41ee-ae84-8682939ff7de" containerName="extract"
Jul 18 01:54:57.692696 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:54:57.692673    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-gxssk"
Jul 18 01:54:57.695062 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:54:57.694917    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-4g74j\""
Jul 18 01:54:57.695349 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:54:57.695329    2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\""
Jul 18 01:54:57.695457 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:54:57.695418    2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\""
Jul 18 01:54:57.701319 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:54:57.701299    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-gxssk"]
Jul 18 01:54:57.753070 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:54:57.753035    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/d0e7d1c2-ae04-4ba0-8de3-e6fd1c470e99-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-gxssk\" (UID: \"d0e7d1c2-ae04-4ba0-8de3-e6fd1c470e99\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-gxssk"
Jul 18 01:54:57.753278 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:54:57.753110    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-89nnz\" (UniqueName: \"kubernetes.io/projected/d0e7d1c2-ae04-4ba0-8de3-e6fd1c470e99-kube-api-access-89nnz\") pod \"kuadrant-operator-controller-manager-8684c9ff49-gxssk\" (UID: \"d0e7d1c2-ae04-4ba0-8de3-e6fd1c470e99\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-gxssk"
Jul 18 01:54:57.853462 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:54:57.853428    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-89nnz\" (UniqueName: \"kubernetes.io/projected/d0e7d1c2-ae04-4ba0-8de3-e6fd1c470e99-kube-api-access-89nnz\") pod \"kuadrant-operator-controller-manager-8684c9ff49-gxssk\" (UID: \"d0e7d1c2-ae04-4ba0-8de3-e6fd1c470e99\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-gxssk"
Jul 18 01:54:57.853634 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:54:57.853498    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/d0e7d1c2-ae04-4ba0-8de3-e6fd1c470e99-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-gxssk\" (UID: \"d0e7d1c2-ae04-4ba0-8de3-e6fd1c470e99\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-gxssk"
Jul 18 01:54:57.853845 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:54:57.853828    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/d0e7d1c2-ae04-4ba0-8de3-e6fd1c470e99-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-gxssk\" (UID: \"d0e7d1c2-ae04-4ba0-8de3-e6fd1c470e99\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-gxssk"
Jul 18 01:54:57.862245 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:54:57.862218    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-89nnz\" (UniqueName: \"kubernetes.io/projected/d0e7d1c2-ae04-4ba0-8de3-e6fd1c470e99-kube-api-access-89nnz\") pod \"kuadrant-operator-controller-manager-8684c9ff49-gxssk\" (UID: \"d0e7d1c2-ae04-4ba0-8de3-e6fd1c470e99\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-gxssk"
Jul 18 01:54:58.004979 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:54:58.004901    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-gxssk"
Jul 18 01:54:58.160199 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:54:58.160176    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-gxssk"]
Jul 18 01:54:58.163023 ip-10-0-142-238 kubenswrapper[2566]: W0718 01:54:58.162995    2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd0e7d1c2_ae04_4ba0_8de3_e6fd1c470e99.slice/crio-ad8aa4956d5e59ed1fc75c1c3d67e56c65a86e95c2958d5a38fd98f928754ae7 WatchSource:0}: Error finding container ad8aa4956d5e59ed1fc75c1c3d67e56c65a86e95c2958d5a38fd98f928754ae7: Status 404 returned error can't find the container with id ad8aa4956d5e59ed1fc75c1c3d67e56c65a86e95c2958d5a38fd98f928754ae7
Jul 18 01:54:58.651825 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:54:58.651795    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-gxssk" event={"ID":"d0e7d1c2-ae04-4ba0-8de3-e6fd1c470e99","Type":"ContainerStarted","Data":"ad8aa4956d5e59ed1fc75c1c3d67e56c65a86e95c2958d5a38fd98f928754ae7"}
Jul 18 01:55:02.680371 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:55:02.680280    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-gxssk" event={"ID":"d0e7d1c2-ae04-4ba0-8de3-e6fd1c470e99","Type":"ContainerStarted","Data":"5117a9ff22f403076f8c1e31ab42a3b37dad4233ea2f42abdc78d9d6e8c58d3e"}
Jul 18 01:55:02.680809 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:55:02.680375    2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-gxssk"
Jul 18 01:55:02.699990 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:55:02.699949    2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-gxssk" podStartSLOduration=1.454776476 podStartE2EDuration="5.699936049s" totalImagesPullingTime="4.245159573s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-18 01:54:57 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-18 01:55:02.698190425 +0000 UTC m=+434.386917873" watchObservedRunningTime="2026-07-18 01:55:02.699936049 +0000 UTC m=+434.388663495"
Jul 18 01:55:10.056409 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:55:10.056374    2566 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-gxssk"]
Jul 18 01:55:10.056902 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:55:10.056574    2566 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-gxssk" podUID="d0e7d1c2-ae04-4ba0-8de3-e6fd1c470e99" containerName="manager" containerID="cri-o://5117a9ff22f403076f8c1e31ab42a3b37dad4233ea2f42abdc78d9d6e8c58d3e" gracePeriod=10
Jul 18 01:55:10.058578 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:55:10.058553    2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-gxssk"
Jul 18 01:55:10.314892 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:55:10.314836    2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-gxssk"
Jul 18 01:55:10.347688 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:55:10.347664    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/d0e7d1c2-ae04-4ba0-8de3-e6fd1c470e99-extensions-socket-volume\") pod \"d0e7d1c2-ae04-4ba0-8de3-e6fd1c470e99\" (UID: \"d0e7d1c2-ae04-4ba0-8de3-e6fd1c470e99\") "
Jul 18 01:55:10.347688 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:55:10.347695    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-89nnz\" (UniqueName: \"kubernetes.io/projected/d0e7d1c2-ae04-4ba0-8de3-e6fd1c470e99-kube-api-access-89nnz\") pod \"d0e7d1c2-ae04-4ba0-8de3-e6fd1c470e99\" (UID: \"d0e7d1c2-ae04-4ba0-8de3-e6fd1c470e99\") "
Jul 18 01:55:10.348200 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:55:10.348176    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d0e7d1c2-ae04-4ba0-8de3-e6fd1c470e99-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "d0e7d1c2-ae04-4ba0-8de3-e6fd1c470e99" (UID: "d0e7d1c2-ae04-4ba0-8de3-e6fd1c470e99"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 18 01:55:10.350027 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:55:10.349999    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d0e7d1c2-ae04-4ba0-8de3-e6fd1c470e99-kube-api-access-89nnz" (OuterVolumeSpecName: "kube-api-access-89nnz") pod "d0e7d1c2-ae04-4ba0-8de3-e6fd1c470e99" (UID: "d0e7d1c2-ae04-4ba0-8de3-e6fd1c470e99"). InnerVolumeSpecName "kube-api-access-89nnz". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 18 01:55:10.448460 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:55:10.448437    2566 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/d0e7d1c2-ae04-4ba0-8de3-e6fd1c470e99-extensions-socket-volume\") on node \"ip-10-0-142-238.ec2.internal\" DevicePath \"\""
Jul 18 01:55:10.448460 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:55:10.448459    2566 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-89nnz\" (UniqueName: \"kubernetes.io/projected/d0e7d1c2-ae04-4ba0-8de3-e6fd1c470e99-kube-api-access-89nnz\") on node \"ip-10-0-142-238.ec2.internal\" DevicePath \"\""
Jul 18 01:55:10.718577 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:55:10.718507    2566 generic.go:356] "Generic (PLEG): container finished" podID="d0e7d1c2-ae04-4ba0-8de3-e6fd1c470e99" containerID="5117a9ff22f403076f8c1e31ab42a3b37dad4233ea2f42abdc78d9d6e8c58d3e" exitCode=0
Jul 18 01:55:10.718577 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:55:10.718545    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-gxssk" event={"ID":"d0e7d1c2-ae04-4ba0-8de3-e6fd1c470e99","Type":"ContainerDied","Data":"5117a9ff22f403076f8c1e31ab42a3b37dad4233ea2f42abdc78d9d6e8c58d3e"}
Jul 18 01:55:10.718577 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:55:10.718552    2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-gxssk"
Jul 18 01:55:10.718789 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:55:10.718591    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-gxssk" event={"ID":"d0e7d1c2-ae04-4ba0-8de3-e6fd1c470e99","Type":"ContainerDied","Data":"ad8aa4956d5e59ed1fc75c1c3d67e56c65a86e95c2958d5a38fd98f928754ae7"}
Jul 18 01:55:10.718789 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:55:10.718632    2566 scope.go:117] "RemoveContainer" containerID="5117a9ff22f403076f8c1e31ab42a3b37dad4233ea2f42abdc78d9d6e8c58d3e"
Jul 18 01:55:10.727284 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:55:10.727267    2566 scope.go:117] "RemoveContainer" containerID="5117a9ff22f403076f8c1e31ab42a3b37dad4233ea2f42abdc78d9d6e8c58d3e"
Jul 18 01:55:10.727508 ip-10-0-142-238 kubenswrapper[2566]: E0718 01:55:10.727491    2566 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5117a9ff22f403076f8c1e31ab42a3b37dad4233ea2f42abdc78d9d6e8c58d3e\": container with ID starting with 5117a9ff22f403076f8c1e31ab42a3b37dad4233ea2f42abdc78d9d6e8c58d3e not found: ID does not exist" containerID="5117a9ff22f403076f8c1e31ab42a3b37dad4233ea2f42abdc78d9d6e8c58d3e"
Jul 18 01:55:10.727553 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:55:10.727516    2566 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5117a9ff22f403076f8c1e31ab42a3b37dad4233ea2f42abdc78d9d6e8c58d3e"} err="failed to get container status \"5117a9ff22f403076f8c1e31ab42a3b37dad4233ea2f42abdc78d9d6e8c58d3e\": rpc error: code = NotFound desc = could not find container \"5117a9ff22f403076f8c1e31ab42a3b37dad4233ea2f42abdc78d9d6e8c58d3e\": container with ID starting with 5117a9ff22f403076f8c1e31ab42a3b37dad4233ea2f42abdc78d9d6e8c58d3e not found: ID does not exist"
Jul 18 01:55:10.746981 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:55:10.746960    2566 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-gxssk"]
Jul 18 01:55:10.750964 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:55:10.750947    2566 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-gxssk"]
Jul 18 01:55:10.815190 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:55:10.815167    2566 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d0e7d1c2-ae04-4ba0-8de3-e6fd1c470e99" path="/var/lib/kubelet/pods/d0e7d1c2-ae04-4ba0-8de3-e6fd1c470e99/volumes"
Jul 18 01:55:39.656437 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:55:39.656395    2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-lmjk9"]
Jul 18 01:55:39.656936 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:55:39.656754    2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d0e7d1c2-ae04-4ba0-8de3-e6fd1c470e99" containerName="manager"
Jul 18 01:55:39.656936 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:55:39.656770    2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="d0e7d1c2-ae04-4ba0-8de3-e6fd1c470e99" containerName="manager"
Jul 18 01:55:39.656936 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:55:39.656839    2566 memory_manager.go:368] "RemoveStaleState removing state" podUID="d0e7d1c2-ae04-4ba0-8de3-e6fd1c470e99" containerName="manager"
Jul 18 01:55:39.662710 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:55:39.662686    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-54d6d988d5-lmjk9"
Jul 18 01:55:39.665069 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:55:39.665048    2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\""
Jul 18 01:55:39.665179 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:55:39.665102    2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\""
Jul 18 01:55:39.665179 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:55:39.665139    2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"limitador-limits-config-limitador\""
Jul 18 01:55:39.665887 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:55:39.665870    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-vq2tw\""
Jul 18 01:55:39.668850 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:55:39.668782    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-lmjk9"]
Jul 18 01:55:39.701747 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:55:39.701719    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-lmjk9"]
Jul 18 01:55:39.765853 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:55:39.765824    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/45d987b6-ee81-442a-98de-70e5a1917c2d-config-file\") pod \"limitador-limitador-54d6d988d5-lmjk9\" (UID: \"45d987b6-ee81-442a-98de-70e5a1917c2d\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-lmjk9"
Jul 18 01:55:39.765853 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:55:39.765856    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-984j2\" (UniqueName: \"kubernetes.io/projected/45d987b6-ee81-442a-98de-70e5a1917c2d-kube-api-access-984j2\") pod \"limitador-limitador-54d6d988d5-lmjk9\" (UID: \"45d987b6-ee81-442a-98de-70e5a1917c2d\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-lmjk9"
Jul 18 01:55:39.866756 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:55:39.866728    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/45d987b6-ee81-442a-98de-70e5a1917c2d-config-file\") pod \"limitador-limitador-54d6d988d5-lmjk9\" (UID: \"45d987b6-ee81-442a-98de-70e5a1917c2d\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-lmjk9"
Jul 18 01:55:39.866756 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:55:39.866758    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-984j2\" (UniqueName: \"kubernetes.io/projected/45d987b6-ee81-442a-98de-70e5a1917c2d-kube-api-access-984j2\") pod \"limitador-limitador-54d6d988d5-lmjk9\" (UID: \"45d987b6-ee81-442a-98de-70e5a1917c2d\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-lmjk9"
Jul 18 01:55:39.867347 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:55:39.867331    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/45d987b6-ee81-442a-98de-70e5a1917c2d-config-file\") pod \"limitador-limitador-54d6d988d5-lmjk9\" (UID: \"45d987b6-ee81-442a-98de-70e5a1917c2d\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-lmjk9"
Jul 18 01:55:39.875177 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:55:39.875156    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-984j2\" (UniqueName: \"kubernetes.io/projected/45d987b6-ee81-442a-98de-70e5a1917c2d-kube-api-access-984j2\") pod \"limitador-limitador-54d6d988d5-lmjk9\" (UID: \"45d987b6-ee81-442a-98de-70e5a1917c2d\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-lmjk9"
Jul 18 01:55:39.974396 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:55:39.974340    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-54d6d988d5-lmjk9"
Jul 18 01:55:40.102704 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:55:40.102675    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-lmjk9"]
Jul 18 01:55:40.104578 ip-10-0-142-238 kubenswrapper[2566]: W0718 01:55:40.104545    2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod45d987b6_ee81_442a_98de_70e5a1917c2d.slice/crio-b48b4dc90497f414e9171e8289a30ae7c98297ae9968aa969b396af7198b9f6c WatchSource:0}: Error finding container b48b4dc90497f414e9171e8289a30ae7c98297ae9968aa969b396af7198b9f6c: Status 404 returned error can't find the container with id b48b4dc90497f414e9171e8289a30ae7c98297ae9968aa969b396af7198b9f6c
Jul 18 01:55:40.857664 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:55:40.857514    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-54d6d988d5-lmjk9" event={"ID":"45d987b6-ee81-442a-98de-70e5a1917c2d","Type":"ContainerStarted","Data":"b48b4dc90497f414e9171e8289a30ae7c98297ae9968aa969b396af7198b9f6c"}
Jul 18 01:55:42.867421 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:55:42.867392    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-54d6d988d5-lmjk9" event={"ID":"45d987b6-ee81-442a-98de-70e5a1917c2d","Type":"ContainerStarted","Data":"7f01b2088d6d1639489891df397a175eafebd4cb37aa00d1289b1385b3ba538f"}
Jul 18 01:55:42.867815 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:55:42.867511    2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-limitador-54d6d988d5-lmjk9"
Jul 18 01:55:42.885413 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:55:42.885372    2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-limitador-54d6d988d5-lmjk9" podStartSLOduration=1.479336541 podStartE2EDuration="3.885359454s" totalImagesPullingTime="2.406022913s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-18 01:55:39 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-18 01:55:42.883587761 +0000 UTC m=+474.572315207" watchObservedRunningTime="2026-07-18 01:55:42.885359454 +0000 UTC m=+474.574086900"
Jul 18 01:55:53.873760 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:55:53.873726    2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-limitador-54d6d988d5-lmjk9"
Jul 18 01:56:55.959354 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:56:55.959271    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-lmjk9"]
Jul 18 01:57:11.878896 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:57:11.878859    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-lmjk9"]
Jul 18 01:57:15.384141 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:57:15.384110    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-lmjk9"]
Jul 18 01:57:38.501928 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:57:38.501893    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-lmjk9"]
Jul 18 01:57:45.080811 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:57:45.080774    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-lmjk9"]
Jul 18 01:57:54.470324 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:57:54.470294    2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-74b68447df-gvh6g"]
Jul 18 01:57:54.473833 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:57:54.473813    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-gvh6g"
Jul 18 01:57:54.476223 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:57:54.476199    2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\""
Jul 18 01:57:54.476981 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:57:54.476960    2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\""
Jul 18 01:57:54.477223 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:57:54.477040    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-dghpp\""
Jul 18 01:57:54.477223 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:57:54.477095    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"facebook-opt-125m-simulated-kserve-self-signed-certs\""
Jul 18 01:57:54.485949 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:57:54.485927    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-74b68447df-gvh6g"]
Jul 18 01:57:54.565761 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:57:54.565734    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/63b9bbfd-41bb-4166-b986-8990b4a08544-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-gvh6g\" (UID: \"63b9bbfd-41bb-4166-b986-8990b4a08544\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-gvh6g"
Jul 18 01:57:54.565906 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:57:54.565773    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wnkms\" (UniqueName: \"kubernetes.io/projected/63b9bbfd-41bb-4166-b986-8990b4a08544-kube-api-access-wnkms\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-gvh6g\" (UID: \"63b9bbfd-41bb-4166-b986-8990b4a08544\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-gvh6g"
Jul 18 01:57:54.565906 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:57:54.565796    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/63b9bbfd-41bb-4166-b986-8990b4a08544-dshm\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-gvh6g\" (UID: \"63b9bbfd-41bb-4166-b986-8990b4a08544\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-gvh6g"
Jul 18 01:57:54.565906 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:57:54.565859    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/63b9bbfd-41bb-4166-b986-8990b4a08544-model-cache\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-gvh6g\" (UID: \"63b9bbfd-41bb-4166-b986-8990b4a08544\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-gvh6g"
Jul 18 01:57:54.565906 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:57:54.565883    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/63b9bbfd-41bb-4166-b986-8990b4a08544-tmp-dir\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-gvh6g\" (UID: \"63b9bbfd-41bb-4166-b986-8990b4a08544\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-gvh6g"
Jul 18 01:57:54.566092 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:57:54.565955    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/63b9bbfd-41bb-4166-b986-8990b4a08544-home\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-gvh6g\" (UID: \"63b9bbfd-41bb-4166-b986-8990b4a08544\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-gvh6g"
Jul 18 01:57:54.667061 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:57:54.667023    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wnkms\" (UniqueName: \"kubernetes.io/projected/63b9bbfd-41bb-4166-b986-8990b4a08544-kube-api-access-wnkms\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-gvh6g\" (UID: \"63b9bbfd-41bb-4166-b986-8990b4a08544\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-gvh6g"
Jul 18 01:57:54.667061 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:57:54.667063    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/63b9bbfd-41bb-4166-b986-8990b4a08544-dshm\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-gvh6g\" (UID: \"63b9bbfd-41bb-4166-b986-8990b4a08544\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-gvh6g"
Jul 18 01:57:54.667296 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:57:54.667097    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/63b9bbfd-41bb-4166-b986-8990b4a08544-model-cache\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-gvh6g\" (UID: \"63b9bbfd-41bb-4166-b986-8990b4a08544\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-gvh6g"
Jul 18 01:57:54.667296 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:57:54.667210    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/63b9bbfd-41bb-4166-b986-8990b4a08544-tmp-dir\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-gvh6g\" (UID: \"63b9bbfd-41bb-4166-b986-8990b4a08544\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-gvh6g"
Jul 18 01:57:54.667296 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:57:54.667254    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/63b9bbfd-41bb-4166-b986-8990b4a08544-home\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-gvh6g\" (UID: \"63b9bbfd-41bb-4166-b986-8990b4a08544\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-gvh6g"
Jul 18 01:57:54.667296 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:57:54.667294    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/63b9bbfd-41bb-4166-b986-8990b4a08544-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-gvh6g\" (UID: \"63b9bbfd-41bb-4166-b986-8990b4a08544\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-gvh6g"
Jul 18 01:57:54.667558 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:57:54.667537    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/63b9bbfd-41bb-4166-b986-8990b4a08544-model-cache\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-gvh6g\" (UID: \"63b9bbfd-41bb-4166-b986-8990b4a08544\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-gvh6g"
Jul 18 01:57:54.667597 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:57:54.667581    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/63b9bbfd-41bb-4166-b986-8990b4a08544-tmp-dir\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-gvh6g\" (UID: \"63b9bbfd-41bb-4166-b986-8990b4a08544\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-gvh6g"
Jul 18 01:57:54.667664 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:57:54.667591    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/63b9bbfd-41bb-4166-b986-8990b4a08544-home\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-gvh6g\" (UID: \"63b9bbfd-41bb-4166-b986-8990b4a08544\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-gvh6g"
Jul 18 01:57:54.669203 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:57:54.669187    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/63b9bbfd-41bb-4166-b986-8990b4a08544-dshm\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-gvh6g\" (UID: \"63b9bbfd-41bb-4166-b986-8990b4a08544\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-gvh6g"
Jul 18 01:57:54.669496 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:57:54.669478    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/63b9bbfd-41bb-4166-b986-8990b4a08544-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-gvh6g\" (UID: \"63b9bbfd-41bb-4166-b986-8990b4a08544\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-gvh6g"
Jul 18 01:57:54.674627 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:57:54.674591    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wnkms\" (UniqueName: \"kubernetes.io/projected/63b9bbfd-41bb-4166-b986-8990b4a08544-kube-api-access-wnkms\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-gvh6g\" (UID: \"63b9bbfd-41bb-4166-b986-8990b4a08544\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-gvh6g"
Jul 18 01:57:54.784307 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:57:54.784270    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-gvh6g"
Jul 18 01:57:54.912268 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:57:54.912246    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-74b68447df-gvh6g"]
Jul 18 01:57:54.914286 ip-10-0-142-238 kubenswrapper[2566]: W0718 01:57:54.914248    2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod63b9bbfd_41bb_4166_b986_8990b4a08544.slice/crio-dcb217b93ae4aef01de33c93da49e36d451b57f334b06098b532d33f0b940270 WatchSource:0}: Error finding container dcb217b93ae4aef01de33c93da49e36d451b57f334b06098b532d33f0b940270: Status 404 returned error can't find the container with id dcb217b93ae4aef01de33c93da49e36d451b57f334b06098b532d33f0b940270
Jul 18 01:57:54.915709 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:57:54.915690    2566 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 18 01:57:55.477625 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:57:55.477572    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-gvh6g" event={"ID":"63b9bbfd-41bb-4166-b986-8990b4a08544","Type":"ContainerStarted","Data":"dcb217b93ae4aef01de33c93da49e36d451b57f334b06098b532d33f0b940270"}
Jul 18 01:57:56.485897 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:57:56.485853    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-gvh6g" event={"ID":"63b9bbfd-41bb-4166-b986-8990b4a08544","Type":"ContainerStarted","Data":"b5b8cd77c70521551c77d163ba180468ef0300b834311af1d7e9c33eab9fad58"}
Jul 18 01:57:56.504415 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:57:56.504366    2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-gvh6g" podStartSLOduration=1.53903615 podStartE2EDuration="2.504352239s" totalImagesPullingTime="965.316089ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-18 01:57:54 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-18 01:57:56.502160737 +0000 UTC m=+608.190888184" watchObservedRunningTime="2026-07-18 01:57:56.504352239 +0000 UTC m=+608.193079738"
Jul 18 01:57:56.581954 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:57:56.581920    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-lmjk9"]
Jul 18 01:58:04.785363 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:58:04.785327    2566 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-gvh6g"
Jul 18 01:58:04.785799 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:58:04.785408    2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-gvh6g"
Jul 18 01:58:04.797261 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:58:04.797237    2566 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-gvh6g"
Jul 18 01:58:05.537964 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:58:05.537932    2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-gvh6g"
Jul 18 01:58:35.583347 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:58:35.583315    2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-xhk2r"]
Jul 18 01:58:35.587301 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:58:35.587283    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-xhk2r"
Jul 18 01:58:35.589365 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:58:35.589347    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"premium-simulated-simulated-premium-kserve-self-signed-certs\""
Jul 18 01:58:35.596195 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:58:35.596175    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-xhk2r"]
Jul 18 01:58:35.683346 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:58:35.683318    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/5635a15f-a823-4e81-915e-afe36a182f68-model-cache\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-xhk2r\" (UID: \"5635a15f-a823-4e81-915e-afe36a182f68\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-xhk2r"
Jul 18 01:58:35.683346 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:58:35.683346    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/5635a15f-a823-4e81-915e-afe36a182f68-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-xhk2r\" (UID: \"5635a15f-a823-4e81-915e-afe36a182f68\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-xhk2r"
Jul 18 01:58:35.683484 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:58:35.683380    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/5635a15f-a823-4e81-915e-afe36a182f68-home\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-xhk2r\" (UID: \"5635a15f-a823-4e81-915e-afe36a182f68\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-xhk2r"
Jul 18 01:58:35.683484 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:58:35.683418    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xschd\" (UniqueName: \"kubernetes.io/projected/5635a15f-a823-4e81-915e-afe36a182f68-kube-api-access-xschd\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-xhk2r\" (UID: \"5635a15f-a823-4e81-915e-afe36a182f68\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-xhk2r"
Jul 18 01:58:35.683484 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:58:35.683458    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/5635a15f-a823-4e81-915e-afe36a182f68-dshm\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-xhk2r\" (UID: \"5635a15f-a823-4e81-915e-afe36a182f68\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-xhk2r"
Jul 18 01:58:35.683484 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:58:35.683474    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/5635a15f-a823-4e81-915e-afe36a182f68-tmp-dir\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-xhk2r\" (UID: \"5635a15f-a823-4e81-915e-afe36a182f68\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-xhk2r"
Jul 18 01:58:35.784551 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:58:35.784525    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/5635a15f-a823-4e81-915e-afe36a182f68-model-cache\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-xhk2r\" (UID: \"5635a15f-a823-4e81-915e-afe36a182f68\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-xhk2r"
Jul 18 01:58:35.784669 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:58:35.784553    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/5635a15f-a823-4e81-915e-afe36a182f68-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-xhk2r\" (UID: \"5635a15f-a823-4e81-915e-afe36a182f68\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-xhk2r"
Jul 18 01:58:35.784669 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:58:35.784583    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/5635a15f-a823-4e81-915e-afe36a182f68-home\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-xhk2r\" (UID: \"5635a15f-a823-4e81-915e-afe36a182f68\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-xhk2r"
Jul 18 01:58:35.784669 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:58:35.784631    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xschd\" (UniqueName: \"kubernetes.io/projected/5635a15f-a823-4e81-915e-afe36a182f68-kube-api-access-xschd\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-xhk2r\" (UID: \"5635a15f-a823-4e81-915e-afe36a182f68\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-xhk2r"
Jul 18 01:58:35.784669 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:58:35.784663    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/5635a15f-a823-4e81-915e-afe36a182f68-dshm\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-xhk2r\" (UID: \"5635a15f-a823-4e81-915e-afe36a182f68\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-xhk2r"
Jul 18 01:58:35.784866 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:58:35.784689    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/5635a15f-a823-4e81-915e-afe36a182f68-tmp-dir\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-xhk2r\" (UID: \"5635a15f-a823-4e81-915e-afe36a182f68\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-xhk2r"
Jul 18 01:58:35.784968 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:58:35.784946    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/5635a15f-a823-4e81-915e-afe36a182f68-model-cache\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-xhk2r\" (UID: \"5635a15f-a823-4e81-915e-afe36a182f68\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-xhk2r"
Jul 18 01:58:35.785027 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:58:35.784998    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/5635a15f-a823-4e81-915e-afe36a182f68-home\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-xhk2r\" (UID: \"5635a15f-a823-4e81-915e-afe36a182f68\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-xhk2r"
Jul 18 01:58:35.785067 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:58:35.785044    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/5635a15f-a823-4e81-915e-afe36a182f68-tmp-dir\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-xhk2r\" (UID: \"5635a15f-a823-4e81-915e-afe36a182f68\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-xhk2r"
Jul 18 01:58:35.786835 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:58:35.786816    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/5635a15f-a823-4e81-915e-afe36a182f68-dshm\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-xhk2r\" (UID: \"5635a15f-a823-4e81-915e-afe36a182f68\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-xhk2r"
Jul 18 01:58:35.786963 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:58:35.786946    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/5635a15f-a823-4e81-915e-afe36a182f68-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-xhk2r\" (UID: \"5635a15f-a823-4e81-915e-afe36a182f68\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-xhk2r"
Jul 18 01:58:35.791997 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:58:35.791974    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xschd\" (UniqueName: \"kubernetes.io/projected/5635a15f-a823-4e81-915e-afe36a182f68-kube-api-access-xschd\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-xhk2r\" (UID: \"5635a15f-a823-4e81-915e-afe36a182f68\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-xhk2r"
Jul 18 01:58:35.895671 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:58:35.895602    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-xhk2r"
Jul 18 01:58:36.017246 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:58:36.017221    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-xhk2r"]
Jul 18 01:58:36.019128 ip-10-0-142-238 kubenswrapper[2566]: W0718 01:58:36.019100    2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod5635a15f_a823_4e81_915e_afe36a182f68.slice/crio-77877057df2e65b681d1e566ff71162317d233db3dba479dd360c8d853a32df0 WatchSource:0}: Error finding container 77877057df2e65b681d1e566ff71162317d233db3dba479dd360c8d853a32df0: Status 404 returned error can't find the container with id 77877057df2e65b681d1e566ff71162317d233db3dba479dd360c8d853a32df0
Jul 18 01:58:36.668359 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:58:36.668327    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-xhk2r" event={"ID":"5635a15f-a823-4e81-915e-afe36a182f68","Type":"ContainerStarted","Data":"e45ac60f4fa52a62ed8625514a077249f5f8d15b050d1fbe30578238d616579b"}
Jul 18 01:58:36.668761 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:58:36.668375    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-xhk2r" event={"ID":"5635a15f-a823-4e81-915e-afe36a182f68","Type":"ContainerStarted","Data":"77877057df2e65b681d1e566ff71162317d233db3dba479dd360c8d853a32df0"}
Jul 18 01:58:36.688095 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:58:36.688043    2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-xhk2r" podStartSLOduration=1.502116424 podStartE2EDuration="1.688028823s" totalImagesPullingTime="185.912399ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-18 01:58:35 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-18 01:58:36.686096284 +0000 UTC m=+648.374823731" watchObservedRunningTime="2026-07-18 01:58:36.688028823 +0000 UTC m=+648.376756269"
Jul 18 01:58:38.087178 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:58:38.087139    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-lmjk9"]
Jul 18 01:58:45.896450 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:58:45.896415    2566 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-xhk2r"
Jul 18 01:58:45.896948 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:58:45.896467    2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-xhk2r"
Jul 18 01:58:45.908451 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:58:45.908427    2566 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-xhk2r"
Jul 18 01:58:46.724455 ip-10-0-142-238 kubenswrapper[2566]: I0718 01:58:46.724427    2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-xhk2r"
Jul 18 02:00:40.716597 ip-10-0-142-238 kubenswrapper[2566]: I0718 02:00:40.716561    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-lmjk9"]
Jul 18 02:00:50.287019 ip-10-0-142-238 kubenswrapper[2566]: I0718 02:00:50.286981    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-lmjk9"]
Jul 18 02:01:01.289304 ip-10-0-142-238 kubenswrapper[2566]: I0718 02:01:01.289268    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-lmjk9"]
Jul 18 02:02:43.480397 ip-10-0-142-238 kubenswrapper[2566]: I0718 02:02:43.480314    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-lmjk9"]
Jul 18 02:02:57.576327 ip-10-0-142-238 kubenswrapper[2566]: I0718 02:02:57.576294    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-lmjk9"]
Jul 18 02:03:31.181921 ip-10-0-142-238 kubenswrapper[2566]: I0718 02:03:31.181884    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-lmjk9"]
Jul 18 02:03:44.380307 ip-10-0-142-238 kubenswrapper[2566]: I0718 02:03:44.380273    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-lmjk9"]
Jul 18 02:03:55.282497 ip-10-0-142-238 kubenswrapper[2566]: I0718 02:03:55.282465    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-lmjk9"]
Jul 18 02:04:07.481122 ip-10-0-142-238 kubenswrapper[2566]: I0718 02:04:07.481085    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-lmjk9"]
Jul 18 02:04:16.383410 ip-10-0-142-238 kubenswrapper[2566]: I0718 02:04:16.383336    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-lmjk9"]
Jul 18 02:04:25.880694 ip-10-0-142-238 kubenswrapper[2566]: I0718 02:04:25.880652    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-lmjk9"]
Jul 18 02:04:37.778433 ip-10-0-142-238 kubenswrapper[2566]: I0718 02:04:37.778396    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-lmjk9"]
Jul 18 02:04:48.076109 ip-10-0-142-238 kubenswrapper[2566]: I0718 02:04:48.076075    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-lmjk9"]
Jul 18 02:05:09.575557 ip-10-0-142-238 kubenswrapper[2566]: I0718 02:05:09.575525    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-lmjk9"]
Jul 18 02:05:21.670964 ip-10-0-142-238 kubenswrapper[2566]: I0718 02:05:21.670930    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-lmjk9"]
Jul 18 02:05:44.689196 ip-10-0-142-238 kubenswrapper[2566]: I0718 02:05:44.689114    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-lmjk9"]
Jul 18 02:05:55.879742 ip-10-0-142-238 kubenswrapper[2566]: I0718 02:05:55.879700    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-lmjk9"]
Jul 18 02:06:09.723400 ip-10-0-142-238 kubenswrapper[2566]: I0718 02:06:09.723362    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-lmjk9"]
Jul 18 02:06:21.986202 ip-10-0-142-238 kubenswrapper[2566]: I0718 02:06:21.986162    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-lmjk9"]
Jul 18 02:06:31.279357 ip-10-0-142-238 kubenswrapper[2566]: I0718 02:06:31.279321    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-lmjk9"]
Jul 18 02:06:41.179994 ip-10-0-142-238 kubenswrapper[2566]: I0718 02:06:41.179957    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-lmjk9"]
Jul 18 02:06:51.185679 ip-10-0-142-238 kubenswrapper[2566]: I0718 02:06:51.185649    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-lmjk9"]
Jul 18 02:08:37.076991 ip-10-0-142-238 kubenswrapper[2566]: I0718 02:08:37.076957    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-lmjk9"]
Jul 18 02:08:46.686880 ip-10-0-142-238 kubenswrapper[2566]: I0718 02:08:46.686800    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-lmjk9"]
Jul 18 02:08:58.788624 ip-10-0-142-238 kubenswrapper[2566]: I0718 02:08:58.788575    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-lmjk9"]
Jul 18 02:09:11.484274 ip-10-0-142-238 kubenswrapper[2566]: I0718 02:09:11.484237    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-lmjk9"]
Jul 18 02:09:21.478461 ip-10-0-142-238 kubenswrapper[2566]: I0718 02:09:21.478426    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-lmjk9"]
Jul 18 02:09:32.113757 ip-10-0-142-238 kubenswrapper[2566]: I0718 02:09:32.113719    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-lmjk9"]
Jul 18 02:09:40.679857 ip-10-0-142-238 kubenswrapper[2566]: I0718 02:09:40.679812    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-lmjk9"]
Jul 18 02:09:51.977968 ip-10-0-142-238 kubenswrapper[2566]: I0718 02:09:51.977937    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-lmjk9"]
Jul 18 02:10:02.874516 ip-10-0-142-238 kubenswrapper[2566]: I0718 02:10:02.874480    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-lmjk9"]
Jul 18 02:10:11.482964 ip-10-0-142-238 kubenswrapper[2566]: I0718 02:10:11.482876    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-lmjk9"]
Jul 18 02:10:22.378894 ip-10-0-142-238 kubenswrapper[2566]: I0718 02:10:22.378853    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-lmjk9"]
Jul 18 02:10:44.280510 ip-10-0-142-238 kubenswrapper[2566]: I0718 02:10:44.280476    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-lmjk9"]
Jul 18 02:10:53.782521 ip-10-0-142-238 kubenswrapper[2566]: I0718 02:10:53.782480    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-lmjk9"]
Jul 18 02:11:03.981076 ip-10-0-142-238 kubenswrapper[2566]: I0718 02:11:03.981038    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-lmjk9"]
Jul 18 02:11:14.086695 ip-10-0-142-238 kubenswrapper[2566]: I0718 02:11:14.086653    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-lmjk9"]
Jul 18 02:11:24.686604 ip-10-0-142-238 kubenswrapper[2566]: I0718 02:11:24.686559    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-lmjk9"]
Jul 18 02:11:36.082892 ip-10-0-142-238 kubenswrapper[2566]: I0718 02:11:36.082848    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-lmjk9"]
Jul 18 02:11:45.880951 ip-10-0-142-238 kubenswrapper[2566]: I0718 02:11:45.880867    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-lmjk9"]
Jul 18 02:11:55.876776 ip-10-0-142-238 kubenswrapper[2566]: I0718 02:11:55.876740    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-lmjk9"]
Jul 18 02:12:03.680154 ip-10-0-142-238 kubenswrapper[2566]: I0718 02:12:03.680115    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-lmjk9"]
Jul 18 02:12:13.482241 ip-10-0-142-238 kubenswrapper[2566]: I0718 02:12:13.482205    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-lmjk9"]
Jul 18 02:12:23.276758 ip-10-0-142-238 kubenswrapper[2566]: I0718 02:12:23.276720    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-lmjk9"]
Jul 18 02:12:36.785158 ip-10-0-142-238 kubenswrapper[2566]: I0718 02:12:36.785115    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-lmjk9"]
Jul 18 02:12:46.789518 ip-10-0-142-238 kubenswrapper[2566]: I0718 02:12:46.789476    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-lmjk9"]
Jul 18 02:13:01.980434 ip-10-0-142-238 kubenswrapper[2566]: I0718 02:13:01.980397    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-lmjk9"]
Jul 18 02:13:10.781067 ip-10-0-142-238 kubenswrapper[2566]: I0718 02:13:10.781031    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-lmjk9"]
Jul 18 02:13:22.982451 ip-10-0-142-238 kubenswrapper[2566]: I0718 02:13:22.982406    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-lmjk9"]
Jul 18 02:13:40.288550 ip-10-0-142-238 kubenswrapper[2566]: I0718 02:13:40.288506    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-lmjk9"]
Jul 18 02:13:52.585963 ip-10-0-142-238 kubenswrapper[2566]: I0718 02:13:52.585929    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-lmjk9"]
Jul 18 02:14:07.274363 ip-10-0-142-238 kubenswrapper[2566]: I0718 02:14:07.274321    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-lmjk9"]
Jul 18 02:14:18.386629 ip-10-0-142-238 kubenswrapper[2566]: I0718 02:14:18.386584    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-lmjk9"]
Jul 18 02:14:35.290292 ip-10-0-142-238 kubenswrapper[2566]: I0718 02:14:35.290254    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-lmjk9"]
Jul 18 02:14:45.979371 ip-10-0-142-238 kubenswrapper[2566]: I0718 02:14:45.979286    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-lmjk9"]
Jul 18 02:15:22.778372 ip-10-0-142-238 kubenswrapper[2566]: I0718 02:15:22.778333    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-lmjk9"]
Jul 18 02:15:34.083717 ip-10-0-142-238 kubenswrapper[2566]: I0718 02:15:34.083679    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-lmjk9"]
Jul 18 02:16:09.279733 ip-10-0-142-238 kubenswrapper[2566]: I0718 02:16:09.279697    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-lmjk9"]
Jul 18 02:16:20.670558 ip-10-0-142-238 kubenswrapper[2566]: I0718 02:16:20.670520    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-lmjk9"]
Jul 18 02:16:53.277327 ip-10-0-142-238 kubenswrapper[2566]: I0718 02:16:53.277289    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-lmjk9"]
Jul 18 02:17:02.181804 ip-10-0-142-238 kubenswrapper[2566]: I0718 02:17:02.181765    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-lmjk9"]
Jul 18 02:17:24.174990 ip-10-0-142-238 kubenswrapper[2566]: I0718 02:17:24.174959    2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-c0b236f4-w267g"]
Jul 18 02:17:24.178064 ip-10-0-142-238 kubenswrapper[2566]: I0718 02:17:24.178043    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-c0b236f4-w267g"
Jul 18 02:17:24.180122 ip-10-0-142-238 kubenswrapper[2566]: I0718 02:17:24.180104    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-5chqh\""
Jul 18 02:17:24.180178 ip-10-0-142-238 kubenswrapper[2566]: I0718 02:17:24.180127    2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 18 02:17:24.185869 ip-10-0-142-238 kubenswrapper[2566]: I0718 02:17:24.185834    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-c0b236f4-w267g"]
Jul 18 02:17:24.220850 ip-10-0-142-238 kubenswrapper[2566]: I0718 02:17:24.220814    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/4d04d820-28e2-4b32-9012-ed133dd4c825-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-derive-c0b236f4-w267g\" (UID: \"4d04d820-28e2-4b32-9012-ed133dd4c825\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-c0b236f4-w267g"
Jul 18 02:17:24.321440 ip-10-0-142-238 kubenswrapper[2566]: I0718 02:17:24.321405    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/4d04d820-28e2-4b32-9012-ed133dd4c825-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-derive-c0b236f4-w267g\" (UID: \"4d04d820-28e2-4b32-9012-ed133dd4c825\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-c0b236f4-w267g"
Jul 18 02:17:24.322057 ip-10-0-142-238 kubenswrapper[2566]: I0718 02:17:24.322036    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/4d04d820-28e2-4b32-9012-ed133dd4c825-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-derive-c0b236f4-w267g\" (UID: \"4d04d820-28e2-4b32-9012-ed133dd4c825\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-c0b236f4-w267g"
Jul 18 02:17:24.489822 ip-10-0-142-238 kubenswrapper[2566]: I0718 02:17:24.489738    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-c0b236f4-w267g"
Jul 18 02:17:24.616133 ip-10-0-142-238 kubenswrapper[2566]: I0718 02:17:24.616109    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-c0b236f4-w267g"]
Jul 18 02:17:24.617714 ip-10-0-142-238 kubenswrapper[2566]: W0718 02:17:24.617684    2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4d04d820_28e2_4b32_9012_ed133dd4c825.slice/crio-f53020f360d67396e683127231508de2f65d1a3d8300d0a2b60f410935d63d71 WatchSource:0}: Error finding container f53020f360d67396e683127231508de2f65d1a3d8300d0a2b60f410935d63d71: Status 404 returned error can't find the container with id f53020f360d67396e683127231508de2f65d1a3d8300d0a2b60f410935d63d71
Jul 18 02:17:24.619600 ip-10-0-142-238 kubenswrapper[2566]: I0718 02:17:24.619579    2566 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 18 02:17:24.911362 ip-10-0-142-238 kubenswrapper[2566]: I0718 02:17:24.911323    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-c0b236f4-w267g" event={"ID":"4d04d820-28e2-4b32-9012-ed133dd4c825","Type":"ContainerStarted","Data":"f53020f360d67396e683127231508de2f65d1a3d8300d0a2b60f410935d63d71"}
Jul 18 02:17:27.928209 ip-10-0-142-238 kubenswrapper[2566]: I0718 02:17:27.928171    2566 generic.go:356] "Generic (PLEG): container finished" podID="4d04d820-28e2-4b32-9012-ed133dd4c825" containerID="61d15ac7a441d47a3cd4904fa795d81e0e61d4ae52edd482d9c59bdbf73f8469" exitCode=0
Jul 18 02:17:27.928601 ip-10-0-142-238 kubenswrapper[2566]: I0718 02:17:27.928237    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-c0b236f4-w267g" event={"ID":"4d04d820-28e2-4b32-9012-ed133dd4c825","Type":"ContainerDied","Data":"61d15ac7a441d47a3cd4904fa795d81e0e61d4ae52edd482d9c59bdbf73f8469"}
Jul 18 02:17:29.063822 ip-10-0-142-238 kubenswrapper[2566]: I0718 02:17:29.063795    2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-c0b236f4-w267g"
Jul 18 02:17:29.164394 ip-10-0-142-238 kubenswrapper[2566]: I0718 02:17:29.164357    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/4d04d820-28e2-4b32-9012-ed133dd4c825-maas-api-service-ca\") pod \"4d04d820-28e2-4b32-9012-ed133dd4c825\" (UID: \"4d04d820-28e2-4b32-9012-ed133dd4c825\") "
Jul 18 02:17:29.164712 ip-10-0-142-238 kubenswrapper[2566]: I0718 02:17:29.164692    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4d04d820-28e2-4b32-9012-ed133dd4c825-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "4d04d820-28e2-4b32-9012-ed133dd4c825" (UID: "4d04d820-28e2-4b32-9012-ed133dd4c825"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 18 02:17:29.265181 ip-10-0-142-238 kubenswrapper[2566]: I0718 02:17:29.265100    2566 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/4d04d820-28e2-4b32-9012-ed133dd4c825-maas-api-service-ca\") on node \"ip-10-0-142-238.ec2.internal\" DevicePath \"\""
Jul 18 02:17:29.939071 ip-10-0-142-238 kubenswrapper[2566]: I0718 02:17:29.939043    2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-c0b236f4-w267g"
Jul 18 02:17:29.939247 ip-10-0-142-238 kubenswrapper[2566]: I0718 02:17:29.939041    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-c0b236f4-w267g" event={"ID":"4d04d820-28e2-4b32-9012-ed133dd4c825","Type":"ContainerDied","Data":"f53020f360d67396e683127231508de2f65d1a3d8300d0a2b60f410935d63d71"}
Jul 18 02:17:29.939247 ip-10-0-142-238 kubenswrapper[2566]: I0718 02:17:29.939172    2566 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="f53020f360d67396e683127231508de2f65d1a3d8300d0a2b60f410935d63d71"
Jul 18 02:17:37.192587 ip-10-0-142-238 kubenswrapper[2566]: I0718 02:17:37.192549    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-lmjk9"]
Jul 18 02:17:39.254563 ip-10-0-142-238 kubenswrapper[2566]: I0718 02:17:39.254524    2566 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-c0b236f4-w267g"]
Jul 18 02:17:39.256988 ip-10-0-142-238 kubenswrapper[2566]: I0718 02:17:39.256964    2566 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-c0b236f4-w267g"]
Jul 18 02:17:40.815935 ip-10-0-142-238 kubenswrapper[2566]: I0718 02:17:40.815901    2566 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="4d04d820-28e2-4b32-9012-ed133dd4c825" path="/var/lib/kubelet/pods/4d04d820-28e2-4b32-9012-ed133dd4c825/volumes"
Jul 18 02:19:04.879380 ip-10-0-142-238 kubenswrapper[2566]: I0718 02:19:04.879343    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-lmjk9"]
Jul 18 02:19:14.861851 ip-10-0-142-238 kubenswrapper[2566]: I0718 02:19:14.861778    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-lmjk9"]
Jul 18 02:19:25.294249 ip-10-0-142-238 kubenswrapper[2566]: I0718 02:19:25.294212    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-lmjk9"]
Jul 18 02:19:32.301814 ip-10-0-142-238 kubenswrapper[2566]: I0718 02:19:32.301775    2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-59ca50e9-wqc6k"]
Jul 18 02:19:32.302199 ip-10-0-142-238 kubenswrapper[2566]: I0718 02:19:32.302071    2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4d04d820-28e2-4b32-9012-ed133dd4c825" containerName="revoke-keys"
Jul 18 02:19:32.302199 ip-10-0-142-238 kubenswrapper[2566]: I0718 02:19:32.302092    2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="4d04d820-28e2-4b32-9012-ed133dd4c825" containerName="revoke-keys"
Jul 18 02:19:32.302199 ip-10-0-142-238 kubenswrapper[2566]: I0718 02:19:32.302178    2566 memory_manager.go:368] "RemoveStaleState removing state" podUID="4d04d820-28e2-4b32-9012-ed133dd4c825" containerName="revoke-keys"
Jul 18 02:19:32.305227 ip-10-0-142-238 kubenswrapper[2566]: I0718 02:19:32.305207    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-59ca50e9-wqc6k"
Jul 18 02:19:32.307575 ip-10-0-142-238 kubenswrapper[2566]: I0718 02:19:32.307554    2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 18 02:19:32.307699 ip-10-0-142-238 kubenswrapper[2566]: I0718 02:19:32.307594    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-5chqh\""
Jul 18 02:19:32.313277 ip-10-0-142-238 kubenswrapper[2566]: I0718 02:19:32.313255    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-59ca50e9-wqc6k"]
Jul 18 02:19:32.338673 ip-10-0-142-238 kubenswrapper[2566]: I0718 02:19:32.338641    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/c58d7aae-aa70-4aaa-955a-2c538fd2b570-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-mt-59ca50e9-wqc6k\" (UID: \"c58d7aae-aa70-4aaa-955a-2c538fd2b570\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-59ca50e9-wqc6k"
Jul 18 02:19:32.439406 ip-10-0-142-238 kubenswrapper[2566]: I0718 02:19:32.439376    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/c58d7aae-aa70-4aaa-955a-2c538fd2b570-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-mt-59ca50e9-wqc6k\" (UID: \"c58d7aae-aa70-4aaa-955a-2c538fd2b570\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-59ca50e9-wqc6k"
Jul 18 02:19:32.439997 ip-10-0-142-238 kubenswrapper[2566]: I0718 02:19:32.439976    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/c58d7aae-aa70-4aaa-955a-2c538fd2b570-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-mt-59ca50e9-wqc6k\" (UID: \"c58d7aae-aa70-4aaa-955a-2c538fd2b570\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-59ca50e9-wqc6k"
Jul 18 02:19:32.617050 ip-10-0-142-238 kubenswrapper[2566]: I0718 02:19:32.616965    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-59ca50e9-wqc6k"
Jul 18 02:19:32.743426 ip-10-0-142-238 kubenswrapper[2566]: I0718 02:19:32.743401    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-59ca50e9-wqc6k"]
Jul 18 02:19:32.744396 ip-10-0-142-238 kubenswrapper[2566]: W0718 02:19:32.744371    2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc58d7aae_aa70_4aaa_955a_2c538fd2b570.slice/crio-5b9d134d9c20db3e6e745203af3e5a52806a218a98292bf3b452b8831794e83c WatchSource:0}: Error finding container 5b9d134d9c20db3e6e745203af3e5a52806a218a98292bf3b452b8831794e83c: Status 404 returned error can't find the container with id 5b9d134d9c20db3e6e745203af3e5a52806a218a98292bf3b452b8831794e83c
Jul 18 02:19:33.525558 ip-10-0-142-238 kubenswrapper[2566]: I0718 02:19:33.525518    2566 generic.go:356] "Generic (PLEG): container finished" podID="c58d7aae-aa70-4aaa-955a-2c538fd2b570" containerID="c0ed9d40f1ff0832c3c7fcccfae8c28c0d494d58561e1065d0cafa29a11a5a21" exitCode=0
Jul 18 02:19:33.525945 ip-10-0-142-238 kubenswrapper[2566]: I0718 02:19:33.525599    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-59ca50e9-wqc6k" event={"ID":"c58d7aae-aa70-4aaa-955a-2c538fd2b570","Type":"ContainerDied","Data":"c0ed9d40f1ff0832c3c7fcccfae8c28c0d494d58561e1065d0cafa29a11a5a21"}
Jul 18 02:19:33.525945 ip-10-0-142-238 kubenswrapper[2566]: I0718 02:19:33.525666    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-59ca50e9-wqc6k" event={"ID":"c58d7aae-aa70-4aaa-955a-2c538fd2b570","Type":"ContainerStarted","Data":"5b9d134d9c20db3e6e745203af3e5a52806a218a98292bf3b452b8831794e83c"}
Jul 18 02:19:34.649104 ip-10-0-142-238 kubenswrapper[2566]: I0718 02:19:34.649080    2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-59ca50e9-wqc6k"
Jul 18 02:19:34.652897 ip-10-0-142-238 kubenswrapper[2566]: I0718 02:19:34.652874    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/c58d7aae-aa70-4aaa-955a-2c538fd2b570-maas-api-service-ca\") pod \"c58d7aae-aa70-4aaa-955a-2c538fd2b570\" (UID: \"c58d7aae-aa70-4aaa-955a-2c538fd2b570\") "
Jul 18 02:19:34.653190 ip-10-0-142-238 kubenswrapper[2566]: I0718 02:19:34.653169    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c58d7aae-aa70-4aaa-955a-2c538fd2b570-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "c58d7aae-aa70-4aaa-955a-2c538fd2b570" (UID: "c58d7aae-aa70-4aaa-955a-2c538fd2b570"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 18 02:19:34.753418 ip-10-0-142-238 kubenswrapper[2566]: I0718 02:19:34.753392    2566 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/c58d7aae-aa70-4aaa-955a-2c538fd2b570-maas-api-service-ca\") on node \"ip-10-0-142-238.ec2.internal\" DevicePath \"\""
Jul 18 02:19:35.538047 ip-10-0-142-238 kubenswrapper[2566]: I0718 02:19:35.538002    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-59ca50e9-wqc6k" event={"ID":"c58d7aae-aa70-4aaa-955a-2c538fd2b570","Type":"ContainerDied","Data":"5b9d134d9c20db3e6e745203af3e5a52806a218a98292bf3b452b8831794e83c"}
Jul 18 02:19:35.538047 ip-10-0-142-238 kubenswrapper[2566]: I0718 02:19:35.538024    2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-59ca50e9-wqc6k"
Jul 18 02:19:35.538296 ip-10-0-142-238 kubenswrapper[2566]: I0718 02:19:35.538065    2566 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="5b9d134d9c20db3e6e745203af3e5a52806a218a98292bf3b452b8831794e83c"
Jul 18 02:19:45.681111 ip-10-0-142-238 kubenswrapper[2566]: I0718 02:19:45.681080    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-lmjk9"]
Jul 18 02:19:47.392203 ip-10-0-142-238 kubenswrapper[2566]: I0718 02:19:47.392164    2566 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-59ca50e9-wqc6k"]
Jul 18 02:19:47.395689 ip-10-0-142-238 kubenswrapper[2566]: I0718 02:19:47.395657    2566 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-59ca50e9-wqc6k"]
Jul 18 02:19:48.815266 ip-10-0-142-238 kubenswrapper[2566]: I0718 02:19:48.815235    2566 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c58d7aae-aa70-4aaa-955a-2c538fd2b570" path="/var/lib/kubelet/pods/c58d7aae-aa70-4aaa-955a-2c538fd2b570/volumes"
Jul 18 02:20:21.027580 ip-10-0-142-238 kubenswrapper[2566]: I0718 02:20:21.027543    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-lmjk9"]
Jul 18 02:20:32.588413 ip-10-0-142-238 kubenswrapper[2566]: I0718 02:20:32.588376    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-lmjk9"]
Jul 18 02:20:44.886061 ip-10-0-142-238 kubenswrapper[2566]: I0718 02:20:44.885989    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-lmjk9"]
Jul 18 02:20:48.645831 ip-10-0-142-238 kubenswrapper[2566]: I0718 02:20:48.645792    2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-e9b53c5b-qbpjc"]
Jul 18 02:20:48.646283 ip-10-0-142-238 kubenswrapper[2566]: I0718 02:20:48.646242    2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c58d7aae-aa70-4aaa-955a-2c538fd2b570" containerName="revoke-keys"
Jul 18 02:20:48.646283 ip-10-0-142-238 kubenswrapper[2566]: I0718 02:20:48.646259    2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="c58d7aae-aa70-4aaa-955a-2c538fd2b570" containerName="revoke-keys"
Jul 18 02:20:48.646391 ip-10-0-142-238 kubenswrapper[2566]: I0718 02:20:48.646335    2566 memory_manager.go:368] "RemoveStaleState removing state" podUID="c58d7aae-aa70-4aaa-955a-2c538fd2b570" containerName="revoke-keys"
Jul 18 02:20:48.649412 ip-10-0-142-238 kubenswrapper[2566]: I0718 02:20:48.649390    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-e9b53c5b-qbpjc"
Jul 18 02:20:48.651509 ip-10-0-142-238 kubenswrapper[2566]: I0718 02:20:48.651490    2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 18 02:20:48.652784 ip-10-0-142-238 kubenswrapper[2566]: I0718 02:20:48.652746    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-5chqh\""
Jul 18 02:20:48.655414 ip-10-0-142-238 kubenswrapper[2566]: I0718 02:20:48.655395    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-e9b53c5b-qbpjc"]
Jul 18 02:20:48.725857 ip-10-0-142-238 kubenswrapper[2566]: I0718 02:20:48.725831    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/18268e20-46d9-4e95-bbc5-5456187866e4-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-mt-e9b53c5b-qbpjc\" (UID: \"18268e20-46d9-4e95-bbc5-5456187866e4\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-e9b53c5b-qbpjc"
Jul 18 02:20:48.827063 ip-10-0-142-238 kubenswrapper[2566]: I0718 02:20:48.827039    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/18268e20-46d9-4e95-bbc5-5456187866e4-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-mt-e9b53c5b-qbpjc\" (UID: \"18268e20-46d9-4e95-bbc5-5456187866e4\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-e9b53c5b-qbpjc"
Jul 18 02:20:48.829146 ip-10-0-142-238 kubenswrapper[2566]: I0718 02:20:48.829127    2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 18 02:20:48.838339 ip-10-0-142-238 kubenswrapper[2566]: I0718 02:20:48.838310    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/18268e20-46d9-4e95-bbc5-5456187866e4-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-mt-e9b53c5b-qbpjc\" (UID: \"18268e20-46d9-4e95-bbc5-5456187866e4\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-e9b53c5b-qbpjc"
Jul 18 02:20:48.963926 ip-10-0-142-238 kubenswrapper[2566]: I0718 02:20:48.963860    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-5chqh\""
Jul 18 02:20:48.972493 ip-10-0-142-238 kubenswrapper[2566]: I0718 02:20:48.972475    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-e9b53c5b-qbpjc"
Jul 18 02:20:49.096813 ip-10-0-142-238 kubenswrapper[2566]: I0718 02:20:49.096791    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-e9b53c5b-qbpjc"]
Jul 18 02:20:49.098575 ip-10-0-142-238 kubenswrapper[2566]: W0718 02:20:49.098548    2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod18268e20_46d9_4e95_bbc5_5456187866e4.slice/crio-e9baec91be1b4faf8c9bc2264a0841afcd70a1b30cb04b8c2a72641df906d232 WatchSource:0}: Error finding container e9baec91be1b4faf8c9bc2264a0841afcd70a1b30cb04b8c2a72641df906d232: Status 404 returned error can't find the container with id e9baec91be1b4faf8c9bc2264a0841afcd70a1b30cb04b8c2a72641df906d232
Jul 18 02:20:49.881961 ip-10-0-142-238 kubenswrapper[2566]: I0718 02:20:49.881932    2566 generic.go:356] "Generic (PLEG): container finished" podID="18268e20-46d9-4e95-bbc5-5456187866e4" containerID="d8c9a1d80171e08df3b2c394caabc47c87bd571ff7474403a6e636f2d08ecc58" exitCode=0
Jul 18 02:20:49.882264 ip-10-0-142-238 kubenswrapper[2566]: I0718 02:20:49.882009    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-e9b53c5b-qbpjc" event={"ID":"18268e20-46d9-4e95-bbc5-5456187866e4","Type":"ContainerDied","Data":"d8c9a1d80171e08df3b2c394caabc47c87bd571ff7474403a6e636f2d08ecc58"}
Jul 18 02:20:49.882264 ip-10-0-142-238 kubenswrapper[2566]: I0718 02:20:49.882054    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-e9b53c5b-qbpjc" event={"ID":"18268e20-46d9-4e95-bbc5-5456187866e4","Type":"ContainerStarted","Data":"e9baec91be1b4faf8c9bc2264a0841afcd70a1b30cb04b8c2a72641df906d232"}
Jul 18 02:20:51.009169 ip-10-0-142-238 kubenswrapper[2566]: I0718 02:20:51.009145    2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-e9b53c5b-qbpjc"
Jul 18 02:20:51.043321 ip-10-0-142-238 kubenswrapper[2566]: I0718 02:20:51.043237    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/18268e20-46d9-4e95-bbc5-5456187866e4-maas-api-service-ca\") pod \"18268e20-46d9-4e95-bbc5-5456187866e4\" (UID: \"18268e20-46d9-4e95-bbc5-5456187866e4\") "
Jul 18 02:20:51.043488 ip-10-0-142-238 kubenswrapper[2566]: I0718 02:20:51.043470    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/18268e20-46d9-4e95-bbc5-5456187866e4-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "18268e20-46d9-4e95-bbc5-5456187866e4" (UID: "18268e20-46d9-4e95-bbc5-5456187866e4"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 18 02:20:51.043543 ip-10-0-142-238 kubenswrapper[2566]: I0718 02:20:51.043531    2566 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/18268e20-46d9-4e95-bbc5-5456187866e4-maas-api-service-ca\") on node \"ip-10-0-142-238.ec2.internal\" DevicePath \"\""
Jul 18 02:20:51.892247 ip-10-0-142-238 kubenswrapper[2566]: I0718 02:20:51.892218    2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-e9b53c5b-qbpjc"
Jul 18 02:20:51.892420 ip-10-0-142-238 kubenswrapper[2566]: I0718 02:20:51.892221    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-e9b53c5b-qbpjc" event={"ID":"18268e20-46d9-4e95-bbc5-5456187866e4","Type":"ContainerDied","Data":"e9baec91be1b4faf8c9bc2264a0841afcd70a1b30cb04b8c2a72641df906d232"}
Jul 18 02:20:51.892420 ip-10-0-142-238 kubenswrapper[2566]: I0718 02:20:51.892341    2566 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="e9baec91be1b4faf8c9bc2264a0841afcd70a1b30cb04b8c2a72641df906d232"
Jul 18 02:21:02.479573 ip-10-0-142-238 kubenswrapper[2566]: I0718 02:21:02.479537    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-lmjk9"]
Jul 18 02:21:08.739413 ip-10-0-142-238 kubenswrapper[2566]: I0718 02:21:08.739376    2566 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-e9b53c5b-qbpjc"]
Jul 18 02:21:08.742332 ip-10-0-142-238 kubenswrapper[2566]: I0718 02:21:08.742309    2566 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-e9b53c5b-qbpjc"]
Jul 18 02:21:08.815573 ip-10-0-142-238 kubenswrapper[2566]: I0718 02:21:08.815549    2566 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="18268e20-46d9-4e95-bbc5-5456187866e4" path="/var/lib/kubelet/pods/18268e20-46d9-4e95-bbc5-5456187866e4/volumes"
Jul 18 02:21:11.082355 ip-10-0-142-238 kubenswrapper[2566]: I0718 02:21:11.082313    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-lmjk9"]
Jul 18 02:22:02.884600 ip-10-0-142-238 kubenswrapper[2566]: I0718 02:22:02.884565    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-lmjk9"]
Jul 18 02:22:14.488073 ip-10-0-142-238 kubenswrapper[2566]: I0718 02:22:14.487992    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-lmjk9"]
Jul 18 02:23:04.983673 ip-10-0-142-238 kubenswrapper[2566]: I0718 02:23:04.983637    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-lmjk9"]
Jul 18 02:23:15.984397 ip-10-0-142-238 kubenswrapper[2566]: I0718 02:23:15.984364    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-lmjk9"]
Jul 18 02:23:34.885350 ip-10-0-142-238 kubenswrapper[2566]: I0718 02:23:34.882381    2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-inf-a-289d75/test-model-289d75-kserve-649874c887-bqrl7"]
Jul 18 02:23:34.885350 ip-10-0-142-238 kubenswrapper[2566]: I0718 02:23:34.883152    2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="18268e20-46d9-4e95-bbc5-5456187866e4" containerName="revoke-keys"
Jul 18 02:23:34.885350 ip-10-0-142-238 kubenswrapper[2566]: I0718 02:23:34.883178    2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="18268e20-46d9-4e95-bbc5-5456187866e4" containerName="revoke-keys"
Jul 18 02:23:34.885350 ip-10-0-142-238 kubenswrapper[2566]: I0718 02:23:34.883341    2566 memory_manager.go:368] "RemoveStaleState removing state" podUID="18268e20-46d9-4e95-bbc5-5456187866e4" containerName="revoke-keys"
Jul 18 02:23:34.889910 ip-10-0-142-238 kubenswrapper[2566]: I0718 02:23:34.889888    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-a-289d75/test-model-289d75-kserve-649874c887-bqrl7"
Jul 18 02:23:34.894456 ip-10-0-142-238 kubenswrapper[2566]: I0718 02:23:34.894434    2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-inf-a-289d75\"/\"openshift-service-ca.crt\""
Jul 18 02:23:34.894591 ip-10-0-142-238 kubenswrapper[2566]: I0718 02:23:34.894470    2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-inf-a-289d75\"/\"kube-root-ca.crt\""
Jul 18 02:23:34.894591 ip-10-0-142-238 kubenswrapper[2566]: I0718 02:23:34.894436    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-inf-a-289d75\"/\"default-dockercfg-7r97w\""
Jul 18 02:23:34.894591 ip-10-0-142-238 kubenswrapper[2566]: I0718 02:23:34.894536    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-inf-a-289d75\"/\"test-model-289d75-kserve-self-signed-certs\""
Jul 18 02:23:34.903582 ip-10-0-142-238 kubenswrapper[2566]: I0718 02:23:34.903555    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-inf-a-289d75/test-model-289d75-kserve-649874c887-bqrl7"]
Jul 18 02:23:34.999003 ip-10-0-142-238 kubenswrapper[2566]: I0718 02:23:34.998979    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d462b93f-0fa8-48f3-92d8-405e75761f3d-tmp-dir\") pod \"test-model-289d75-kserve-649874c887-bqrl7\" (UID: \"d462b93f-0fa8-48f3-92d8-405e75761f3d\") " pod="ai-tenant-e2e-inf-a-289d75/test-model-289d75-kserve-649874c887-bqrl7"
Jul 18 02:23:34.999170 ip-10-0-142-238 kubenswrapper[2566]: I0718 02:23:34.999010    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d462b93f-0fa8-48f3-92d8-405e75761f3d-tls-certs\") pod \"test-model-289d75-kserve-649874c887-bqrl7\" (UID: \"d462b93f-0fa8-48f3-92d8-405e75761f3d\") " pod="ai-tenant-e2e-inf-a-289d75/test-model-289d75-kserve-649874c887-bqrl7"
Jul 18 02:23:34.999170 ip-10-0-142-238 kubenswrapper[2566]: I0718 02:23:34.999032    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/d462b93f-0fa8-48f3-92d8-405e75761f3d-model-cache\") pod \"test-model-289d75-kserve-649874c887-bqrl7\" (UID: \"d462b93f-0fa8-48f3-92d8-405e75761f3d\") " pod="ai-tenant-e2e-inf-a-289d75/test-model-289d75-kserve-649874c887-bqrl7"
Jul 18 02:23:34.999170 ip-10-0-142-238 kubenswrapper[2566]: I0718 02:23:34.999065    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hx276\" (UniqueName: \"kubernetes.io/projected/d462b93f-0fa8-48f3-92d8-405e75761f3d-kube-api-access-hx276\") pod \"test-model-289d75-kserve-649874c887-bqrl7\" (UID: \"d462b93f-0fa8-48f3-92d8-405e75761f3d\") " pod="ai-tenant-e2e-inf-a-289d75/test-model-289d75-kserve-649874c887-bqrl7"
Jul 18 02:23:34.999170 ip-10-0-142-238 kubenswrapper[2566]: I0718 02:23:34.999119    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/d462b93f-0fa8-48f3-92d8-405e75761f3d-home\") pod \"test-model-289d75-kserve-649874c887-bqrl7\" (UID: \"d462b93f-0fa8-48f3-92d8-405e75761f3d\") " pod="ai-tenant-e2e-inf-a-289d75/test-model-289d75-kserve-649874c887-bqrl7"
Jul 18 02:23:34.999170 ip-10-0-142-238 kubenswrapper[2566]: I0718 02:23:34.999165    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/d462b93f-0fa8-48f3-92d8-405e75761f3d-dshm\") pod \"test-model-289d75-kserve-649874c887-bqrl7\" (UID: \"d462b93f-0fa8-48f3-92d8-405e75761f3d\") " pod="ai-tenant-e2e-inf-a-289d75/test-model-289d75-kserve-649874c887-bqrl7"
Jul 18 02:23:35.100354 ip-10-0-142-238 kubenswrapper[2566]: I0718 02:23:35.100312    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d462b93f-0fa8-48f3-92d8-405e75761f3d-tmp-dir\") pod \"test-model-289d75-kserve-649874c887-bqrl7\" (UID: \"d462b93f-0fa8-48f3-92d8-405e75761f3d\") " pod="ai-tenant-e2e-inf-a-289d75/test-model-289d75-kserve-649874c887-bqrl7"
Jul 18 02:23:35.100354 ip-10-0-142-238 kubenswrapper[2566]: I0718 02:23:35.100362    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d462b93f-0fa8-48f3-92d8-405e75761f3d-tls-certs\") pod \"test-model-289d75-kserve-649874c887-bqrl7\" (UID: \"d462b93f-0fa8-48f3-92d8-405e75761f3d\") " pod="ai-tenant-e2e-inf-a-289d75/test-model-289d75-kserve-649874c887-bqrl7"
Jul 18 02:23:35.100568 ip-10-0-142-238 kubenswrapper[2566]: I0718 02:23:35.100391    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/d462b93f-0fa8-48f3-92d8-405e75761f3d-model-cache\") pod \"test-model-289d75-kserve-649874c887-bqrl7\" (UID: \"d462b93f-0fa8-48f3-92d8-405e75761f3d\") " pod="ai-tenant-e2e-inf-a-289d75/test-model-289d75-kserve-649874c887-bqrl7"
Jul 18 02:23:35.100568 ip-10-0-142-238 kubenswrapper[2566]: I0718 02:23:35.100430    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hx276\" (UniqueName: \"kubernetes.io/projected/d462b93f-0fa8-48f3-92d8-405e75761f3d-kube-api-access-hx276\") pod \"test-model-289d75-kserve-649874c887-bqrl7\" (UID: \"d462b93f-0fa8-48f3-92d8-405e75761f3d\") " pod="ai-tenant-e2e-inf-a-289d75/test-model-289d75-kserve-649874c887-bqrl7"
Jul 18 02:23:35.100568 ip-10-0-142-238 kubenswrapper[2566]: I0718 02:23:35.100469    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/d462b93f-0fa8-48f3-92d8-405e75761f3d-home\") pod \"test-model-289d75-kserve-649874c887-bqrl7\" (UID: \"d462b93f-0fa8-48f3-92d8-405e75761f3d\") " pod="ai-tenant-e2e-inf-a-289d75/test-model-289d75-kserve-649874c887-bqrl7"
Jul 18 02:23:35.100568 ip-10-0-142-238 kubenswrapper[2566]: I0718 02:23:35.100509    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/d462b93f-0fa8-48f3-92d8-405e75761f3d-dshm\") pod \"test-model-289d75-kserve-649874c887-bqrl7\" (UID: \"d462b93f-0fa8-48f3-92d8-405e75761f3d\") " pod="ai-tenant-e2e-inf-a-289d75/test-model-289d75-kserve-649874c887-bqrl7"
Jul 18 02:23:35.100794 ip-10-0-142-238 kubenswrapper[2566]: I0718 02:23:35.100755    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d462b93f-0fa8-48f3-92d8-405e75761f3d-tmp-dir\") pod \"test-model-289d75-kserve-649874c887-bqrl7\" (UID: \"d462b93f-0fa8-48f3-92d8-405e75761f3d\") " pod="ai-tenant-e2e-inf-a-289d75/test-model-289d75-kserve-649874c887-bqrl7"
Jul 18 02:23:35.100849 ip-10-0-142-238 kubenswrapper[2566]: I0718 02:23:35.100800    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/d462b93f-0fa8-48f3-92d8-405e75761f3d-model-cache\") pod \"test-model-289d75-kserve-649874c887-bqrl7\" (UID: \"d462b93f-0fa8-48f3-92d8-405e75761f3d\") " pod="ai-tenant-e2e-inf-a-289d75/test-model-289d75-kserve-649874c887-bqrl7"
Jul 18 02:23:35.100849 ip-10-0-142-238 kubenswrapper[2566]: I0718 02:23:35.100832    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/d462b93f-0fa8-48f3-92d8-405e75761f3d-home\") pod \"test-model-289d75-kserve-649874c887-bqrl7\" (UID: \"d462b93f-0fa8-48f3-92d8-405e75761f3d\") " pod="ai-tenant-e2e-inf-a-289d75/test-model-289d75-kserve-649874c887-bqrl7"
Jul 18 02:23:35.102744 ip-10-0-142-238 kubenswrapper[2566]: I0718 02:23:35.102722    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/d462b93f-0fa8-48f3-92d8-405e75761f3d-dshm\") pod \"test-model-289d75-kserve-649874c887-bqrl7\" (UID: \"d462b93f-0fa8-48f3-92d8-405e75761f3d\") " pod="ai-tenant-e2e-inf-a-289d75/test-model-289d75-kserve-649874c887-bqrl7"
Jul 18 02:23:35.102959 ip-10-0-142-238 kubenswrapper[2566]: I0718 02:23:35.102942    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d462b93f-0fa8-48f3-92d8-405e75761f3d-tls-certs\") pod \"test-model-289d75-kserve-649874c887-bqrl7\" (UID: \"d462b93f-0fa8-48f3-92d8-405e75761f3d\") " pod="ai-tenant-e2e-inf-a-289d75/test-model-289d75-kserve-649874c887-bqrl7"
Jul 18 02:23:35.108042 ip-10-0-142-238 kubenswrapper[2566]: I0718 02:23:35.108018    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hx276\" (UniqueName: \"kubernetes.io/projected/d462b93f-0fa8-48f3-92d8-405e75761f3d-kube-api-access-hx276\") pod \"test-model-289d75-kserve-649874c887-bqrl7\" (UID: \"d462b93f-0fa8-48f3-92d8-405e75761f3d\") " pod="ai-tenant-e2e-inf-a-289d75/test-model-289d75-kserve-649874c887-bqrl7"
Jul 18 02:23:35.199359 ip-10-0-142-238 kubenswrapper[2566]: I0718 02:23:35.199305    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-a-289d75/test-model-289d75-kserve-649874c887-bqrl7"
Jul 18 02:23:35.324562 ip-10-0-142-238 kubenswrapper[2566]: I0718 02:23:35.324530    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-inf-a-289d75/test-model-289d75-kserve-649874c887-bqrl7"]
Jul 18 02:23:35.326968 ip-10-0-142-238 kubenswrapper[2566]: W0718 02:23:35.326940    2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podd462b93f_0fa8_48f3_92d8_405e75761f3d.slice/crio-6604b399eb31771928c306c4535c4648e84d9d5dc30ea661fbdf0548a6e1d048 WatchSource:0}: Error finding container 6604b399eb31771928c306c4535c4648e84d9d5dc30ea661fbdf0548a6e1d048: Status 404 returned error can't find the container with id 6604b399eb31771928c306c4535c4648e84d9d5dc30ea661fbdf0548a6e1d048
Jul 18 02:23:35.682996 ip-10-0-142-238 kubenswrapper[2566]: I0718 02:23:35.682957    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-a-289d75/test-model-289d75-kserve-649874c887-bqrl7" event={"ID":"d462b93f-0fa8-48f3-92d8-405e75761f3d","Type":"ContainerStarted","Data":"a8da49a458011bd4ea6f79be669d7ba46fdd18ddb0134addcade45dbb6d30428"}
Jul 18 02:23:35.682996 ip-10-0-142-238 kubenswrapper[2566]: I0718 02:23:35.682999    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-a-289d75/test-model-289d75-kserve-649874c887-bqrl7" event={"ID":"d462b93f-0fa8-48f3-92d8-405e75761f3d","Type":"ContainerStarted","Data":"6604b399eb31771928c306c4535c4648e84d9d5dc30ea661fbdf0548a6e1d048"}
Jul 18 02:23:35.704074 ip-10-0-142-238 kubenswrapper[2566]: I0718 02:23:35.704005    2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-inf-a-289d75/test-model-289d75-kserve-649874c887-bqrl7" podStartSLOduration=1.7039920579999999 podStartE2EDuration="1.703992058s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-18 02:23:34 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-18 02:23:35.702564287 +0000 UTC m=+2147.391291733" watchObservedRunningTime="2026-07-18 02:23:35.703992058 +0000 UTC m=+2147.392719503"
Jul 18 02:23:38.984152 ip-10-0-142-238 kubenswrapper[2566]: I0718 02:23:38.984091    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-lmjk9"]
Jul 18 02:23:45.199670 ip-10-0-142-238 kubenswrapper[2566]: I0718 02:23:45.199566    2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-inf-a-289d75/test-model-289d75-kserve-649874c887-bqrl7"
Jul 18 02:23:45.199670 ip-10-0-142-238 kubenswrapper[2566]: I0718 02:23:45.199641    2566 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-inf-a-289d75/test-model-289d75-kserve-649874c887-bqrl7"
Jul 18 02:23:45.212024 ip-10-0-142-238 kubenswrapper[2566]: I0718 02:23:45.211993    2566 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-inf-a-289d75/test-model-289d75-kserve-649874c887-bqrl7"
Jul 18 02:23:45.746087 ip-10-0-142-238 kubenswrapper[2566]: I0718 02:23:45.746058    2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-inf-a-289d75/test-model-289d75-kserve-649874c887-bqrl7"
Jul 18 02:23:48.976378 ip-10-0-142-238 kubenswrapper[2566]: I0718 02:23:48.976347    2566 scope.go:117] "RemoveContainer" containerID="61d15ac7a441d47a3cd4904fa795d81e0e61d4ae52edd482d9c59bdbf73f8469"
Jul 18 02:23:51.383759 ip-10-0-142-238 kubenswrapper[2566]: I0718 02:23:51.383721    2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-inf-b-5eb23f/test-model-5eb23f-kserve-7756577dff-pqv9g"]
Jul 18 02:23:51.388174 ip-10-0-142-238 kubenswrapper[2566]: I0718 02:23:51.388155    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-b-5eb23f/test-model-5eb23f-kserve-7756577dff-pqv9g"
Jul 18 02:23:51.390479 ip-10-0-142-238 kubenswrapper[2566]: I0718 02:23:51.390457    2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-inf-b-5eb23f\"/\"kube-root-ca.crt\""
Jul 18 02:23:51.391221 ip-10-0-142-238 kubenswrapper[2566]: I0718 02:23:51.391196    2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-inf-b-5eb23f\"/\"openshift-service-ca.crt\""
Jul 18 02:23:51.391337 ip-10-0-142-238 kubenswrapper[2566]: I0718 02:23:51.391317    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-inf-b-5eb23f\"/\"test-model-5eb23f-kserve-self-signed-certs\""
Jul 18 02:23:51.391386 ip-10-0-142-238 kubenswrapper[2566]: I0718 02:23:51.391365    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-inf-b-5eb23f\"/\"default-dockercfg-cjdz2\""
Jul 18 02:23:51.396412 ip-10-0-142-238 kubenswrapper[2566]: I0718 02:23:51.396390    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-inf-b-5eb23f/test-model-5eb23f-kserve-7756577dff-pqv9g"]
Jul 18 02:23:51.531170 ip-10-0-142-238 kubenswrapper[2566]: I0718 02:23:51.531136    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/470ffb3f-c8b5-4607-b5e6-8701cdcfadcd-model-cache\") pod \"test-model-5eb23f-kserve-7756577dff-pqv9g\" (UID: \"470ffb3f-c8b5-4607-b5e6-8701cdcfadcd\") " pod="ai-tenant-e2e-inf-b-5eb23f/test-model-5eb23f-kserve-7756577dff-pqv9g"
Jul 18 02:23:51.531170 ip-10-0-142-238 kubenswrapper[2566]: I0718 02:23:51.531170    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/470ffb3f-c8b5-4607-b5e6-8701cdcfadcd-tmp-dir\") pod \"test-model-5eb23f-kserve-7756577dff-pqv9g\" (UID: \"470ffb3f-c8b5-4607-b5e6-8701cdcfadcd\") " pod="ai-tenant-e2e-inf-b-5eb23f/test-model-5eb23f-kserve-7756577dff-pqv9g"
Jul 18 02:23:51.531371 ip-10-0-142-238 kubenswrapper[2566]: I0718 02:23:51.531194    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/470ffb3f-c8b5-4607-b5e6-8701cdcfadcd-home\") pod \"test-model-5eb23f-kserve-7756577dff-pqv9g\" (UID: \"470ffb3f-c8b5-4607-b5e6-8701cdcfadcd\") " pod="ai-tenant-e2e-inf-b-5eb23f/test-model-5eb23f-kserve-7756577dff-pqv9g"
Jul 18 02:23:51.531371 ip-10-0-142-238 kubenswrapper[2566]: I0718 02:23:51.531222    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/470ffb3f-c8b5-4607-b5e6-8701cdcfadcd-dshm\") pod \"test-model-5eb23f-kserve-7756577dff-pqv9g\" (UID: \"470ffb3f-c8b5-4607-b5e6-8701cdcfadcd\") " pod="ai-tenant-e2e-inf-b-5eb23f/test-model-5eb23f-kserve-7756577dff-pqv9g"
Jul 18 02:23:51.531371 ip-10-0-142-238 kubenswrapper[2566]: I0718 02:23:51.531264    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/470ffb3f-c8b5-4607-b5e6-8701cdcfadcd-tls-certs\") pod \"test-model-5eb23f-kserve-7756577dff-pqv9g\" (UID: \"470ffb3f-c8b5-4607-b5e6-8701cdcfadcd\") " pod="ai-tenant-e2e-inf-b-5eb23f/test-model-5eb23f-kserve-7756577dff-pqv9g"
Jul 18 02:23:51.531371 ip-10-0-142-238 kubenswrapper[2566]: I0718 02:23:51.531294    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wgxhg\" (UniqueName: \"kubernetes.io/projected/470ffb3f-c8b5-4607-b5e6-8701cdcfadcd-kube-api-access-wgxhg\") pod \"test-model-5eb23f-kserve-7756577dff-pqv9g\" (UID: \"470ffb3f-c8b5-4607-b5e6-8701cdcfadcd\") " pod="ai-tenant-e2e-inf-b-5eb23f/test-model-5eb23f-kserve-7756577dff-pqv9g"
Jul 18 02:23:51.632556 ip-10-0-142-238 kubenswrapper[2566]: I0718 02:23:51.632521    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/470ffb3f-c8b5-4607-b5e6-8701cdcfadcd-tls-certs\") pod \"test-model-5eb23f-kserve-7756577dff-pqv9g\" (UID: \"470ffb3f-c8b5-4607-b5e6-8701cdcfadcd\") " pod="ai-tenant-e2e-inf-b-5eb23f/test-model-5eb23f-kserve-7756577dff-pqv9g"
Jul 18 02:23:51.632760 ip-10-0-142-238 kubenswrapper[2566]: I0718 02:23:51.632565    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wgxhg\" (UniqueName: \"kubernetes.io/projected/470ffb3f-c8b5-4607-b5e6-8701cdcfadcd-kube-api-access-wgxhg\") pod \"test-model-5eb23f-kserve-7756577dff-pqv9g\" (UID: \"470ffb3f-c8b5-4607-b5e6-8701cdcfadcd\") " pod="ai-tenant-e2e-inf-b-5eb23f/test-model-5eb23f-kserve-7756577dff-pqv9g"
Jul 18 02:23:51.632760 ip-10-0-142-238 kubenswrapper[2566]: I0718 02:23:51.632644    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/470ffb3f-c8b5-4607-b5e6-8701cdcfadcd-model-cache\") pod \"test-model-5eb23f-kserve-7756577dff-pqv9g\" (UID: \"470ffb3f-c8b5-4607-b5e6-8701cdcfadcd\") " pod="ai-tenant-e2e-inf-b-5eb23f/test-model-5eb23f-kserve-7756577dff-pqv9g"
Jul 18 02:23:51.632760 ip-10-0-142-238 kubenswrapper[2566]: I0718 02:23:51.632665    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/470ffb3f-c8b5-4607-b5e6-8701cdcfadcd-tmp-dir\") pod \"test-model-5eb23f-kserve-7756577dff-pqv9g\" (UID: \"470ffb3f-c8b5-4607-b5e6-8701cdcfadcd\") " pod="ai-tenant-e2e-inf-b-5eb23f/test-model-5eb23f-kserve-7756577dff-pqv9g"
Jul 18 02:23:51.632760 ip-10-0-142-238 kubenswrapper[2566]: I0718 02:23:51.632703    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/470ffb3f-c8b5-4607-b5e6-8701cdcfadcd-home\") pod \"test-model-5eb23f-kserve-7756577dff-pqv9g\" (UID: \"470ffb3f-c8b5-4607-b5e6-8701cdcfadcd\") " pod="ai-tenant-e2e-inf-b-5eb23f/test-model-5eb23f-kserve-7756577dff-pqv9g"
Jul 18 02:23:51.632760 ip-10-0-142-238 kubenswrapper[2566]: I0718 02:23:51.632720    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/470ffb3f-c8b5-4607-b5e6-8701cdcfadcd-dshm\") pod \"test-model-5eb23f-kserve-7756577dff-pqv9g\" (UID: \"470ffb3f-c8b5-4607-b5e6-8701cdcfadcd\") " pod="ai-tenant-e2e-inf-b-5eb23f/test-model-5eb23f-kserve-7756577dff-pqv9g"
Jul 18 02:23:51.633117 ip-10-0-142-238 kubenswrapper[2566]: I0718 02:23:51.633083    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/470ffb3f-c8b5-4607-b5e6-8701cdcfadcd-model-cache\") pod \"test-model-5eb23f-kserve-7756577dff-pqv9g\" (UID: \"470ffb3f-c8b5-4607-b5e6-8701cdcfadcd\") " pod="ai-tenant-e2e-inf-b-5eb23f/test-model-5eb23f-kserve-7756577dff-pqv9g"
Jul 18 02:23:51.633117 ip-10-0-142-238 kubenswrapper[2566]: I0718 02:23:51.633108    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/470ffb3f-c8b5-4607-b5e6-8701cdcfadcd-home\") pod \"test-model-5eb23f-kserve-7756577dff-pqv9g\" (UID: \"470ffb3f-c8b5-4607-b5e6-8701cdcfadcd\") " pod="ai-tenant-e2e-inf-b-5eb23f/test-model-5eb23f-kserve-7756577dff-pqv9g"
Jul 18 02:23:51.633286 ip-10-0-142-238 kubenswrapper[2566]: I0718 02:23:51.633187    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/470ffb3f-c8b5-4607-b5e6-8701cdcfadcd-tmp-dir\") pod \"test-model-5eb23f-kserve-7756577dff-pqv9g\" (UID: \"470ffb3f-c8b5-4607-b5e6-8701cdcfadcd\") " pod="ai-tenant-e2e-inf-b-5eb23f/test-model-5eb23f-kserve-7756577dff-pqv9g"
Jul 18 02:23:51.634862 ip-10-0-142-238 kubenswrapper[2566]: I0718 02:23:51.634812    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/470ffb3f-c8b5-4607-b5e6-8701cdcfadcd-dshm\") pod \"test-model-5eb23f-kserve-7756577dff-pqv9g\" (UID: \"470ffb3f-c8b5-4607-b5e6-8701cdcfadcd\") " pod="ai-tenant-e2e-inf-b-5eb23f/test-model-5eb23f-kserve-7756577dff-pqv9g"
Jul 18 02:23:51.635093 ip-10-0-142-238 kubenswrapper[2566]: I0718 02:23:51.635077    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/470ffb3f-c8b5-4607-b5e6-8701cdcfadcd-tls-certs\") pod \"test-model-5eb23f-kserve-7756577dff-pqv9g\" (UID: \"470ffb3f-c8b5-4607-b5e6-8701cdcfadcd\") " pod="ai-tenant-e2e-inf-b-5eb23f/test-model-5eb23f-kserve-7756577dff-pqv9g"
Jul 18 02:23:51.640565 ip-10-0-142-238 kubenswrapper[2566]: I0718 02:23:51.640545    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wgxhg\" (UniqueName: \"kubernetes.io/projected/470ffb3f-c8b5-4607-b5e6-8701cdcfadcd-kube-api-access-wgxhg\") pod \"test-model-5eb23f-kserve-7756577dff-pqv9g\" (UID: \"470ffb3f-c8b5-4607-b5e6-8701cdcfadcd\") " pod="ai-tenant-e2e-inf-b-5eb23f/test-model-5eb23f-kserve-7756577dff-pqv9g"
Jul 18 02:23:51.697194 ip-10-0-142-238 kubenswrapper[2566]: I0718 02:23:51.697171    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-b-5eb23f/test-model-5eb23f-kserve-7756577dff-pqv9g"
Jul 18 02:23:51.821271 ip-10-0-142-238 kubenswrapper[2566]: I0718 02:23:51.821248    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-inf-b-5eb23f/test-model-5eb23f-kserve-7756577dff-pqv9g"]
Jul 18 02:23:51.823037 ip-10-0-142-238 kubenswrapper[2566]: W0718 02:23:51.823002    2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod470ffb3f_c8b5_4607_b5e6_8701cdcfadcd.slice/crio-d71ed58946933d27fac33a97232cbe12b43928d721729d4c3f1c2646838115ec WatchSource:0}: Error finding container d71ed58946933d27fac33a97232cbe12b43928d721729d4c3f1c2646838115ec: Status 404 returned error can't find the container with id d71ed58946933d27fac33a97232cbe12b43928d721729d4c3f1c2646838115ec
Jul 18 02:23:52.772406 ip-10-0-142-238 kubenswrapper[2566]: I0718 02:23:52.772371    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-b-5eb23f/test-model-5eb23f-kserve-7756577dff-pqv9g" event={"ID":"470ffb3f-c8b5-4607-b5e6-8701cdcfadcd","Type":"ContainerStarted","Data":"edb7e4d90f0aa4a56f11c0d90541835c327cc01c053be54e3cd99cb7104e2d95"}
Jul 18 02:23:52.772406 ip-10-0-142-238 kubenswrapper[2566]: I0718 02:23:52.772409    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-b-5eb23f/test-model-5eb23f-kserve-7756577dff-pqv9g" event={"ID":"470ffb3f-c8b5-4607-b5e6-8701cdcfadcd","Type":"ContainerStarted","Data":"d71ed58946933d27fac33a97232cbe12b43928d721729d4c3f1c2646838115ec"}
Jul 18 02:23:52.787414 ip-10-0-142-238 kubenswrapper[2566]: I0718 02:23:52.787367    2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-inf-b-5eb23f/test-model-5eb23f-kserve-7756577dff-pqv9g" podStartSLOduration=1.7873530720000002 podStartE2EDuration="1.787353072s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-18 02:23:51 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-18 02:23:52.786702726 +0000 UTC m=+2164.475430172" watchObservedRunningTime="2026-07-18 02:23:52.787353072 +0000 UTC m=+2164.476080518"
Jul 18 02:23:59.783526 ip-10-0-142-238 kubenswrapper[2566]: I0718 02:23:59.783489    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-lmjk9"]
Jul 18 02:24:01.697292 ip-10-0-142-238 kubenswrapper[2566]: I0718 02:24:01.697260    2566 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-inf-b-5eb23f/test-model-5eb23f-kserve-7756577dff-pqv9g"
Jul 18 02:24:01.697739 ip-10-0-142-238 kubenswrapper[2566]: I0718 02:24:01.697507    2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-inf-b-5eb23f/test-model-5eb23f-kserve-7756577dff-pqv9g"
Jul 18 02:24:01.709387 ip-10-0-142-238 kubenswrapper[2566]: I0718 02:24:01.709365    2566 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-inf-b-5eb23f/test-model-5eb23f-kserve-7756577dff-pqv9g"
Jul 18 02:24:01.832486 ip-10-0-142-238 kubenswrapper[2566]: I0718 02:24:01.832466    2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-inf-b-5eb23f/test-model-5eb23f-kserve-7756577dff-pqv9g"
Jul 18 02:24:08.687858 ip-10-0-142-238 kubenswrapper[2566]: I0718 02:24:08.687819    2566 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-inf-a-289d75/test-model-289d75-kserve-649874c887-bqrl7"]
Jul 18 02:24:09.725445 ip-10-0-142-238 kubenswrapper[2566]: I0718 02:24:09.725411    2566 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-inf-b-5eb23f/test-model-5eb23f-kserve-7756577dff-pqv9g"]
Jul 18 02:24:09.851598 ip-10-0-142-238 kubenswrapper[2566]: I0718 02:24:09.851567    2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-289d75-rpvn8"]
Jul 18 02:24:09.854788 ip-10-0-142-238 kubenswrapper[2566]: I0718 02:24:09.854766    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-289d75-rpvn8"
Jul 18 02:24:09.856944 ip-10-0-142-238 kubenswrapper[2566]: I0718 02:24:09.856917    2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 18 02:24:09.857049 ip-10-0-142-238 kubenswrapper[2566]: I0718 02:24:09.856951    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-5chqh\""
Jul 18 02:24:09.861809 ip-10-0-142-238 kubenswrapper[2566]: I0718 02:24:09.861787    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-289d75-rpvn8"]
Jul 18 02:24:09.977958 ip-10-0-142-238 kubenswrapper[2566]: I0718 02:24:09.977885    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/aa606c36-b5c9-4a29-8047-ff4f4b10364a-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-inf-a-289d75-rpvn8\" (UID: \"aa606c36-b5c9-4a29-8047-ff4f4b10364a\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-289d75-rpvn8"
Jul 18 02:24:10.078720 ip-10-0-142-238 kubenswrapper[2566]: I0718 02:24:10.078683    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/aa606c36-b5c9-4a29-8047-ff4f4b10364a-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-inf-a-289d75-rpvn8\" (UID: \"aa606c36-b5c9-4a29-8047-ff4f4b10364a\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-289d75-rpvn8"
Jul 18 02:24:10.079235 ip-10-0-142-238 kubenswrapper[2566]: I0718 02:24:10.079219    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/aa606c36-b5c9-4a29-8047-ff4f4b10364a-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-inf-a-289d75-rpvn8\" (UID: \"aa606c36-b5c9-4a29-8047-ff4f4b10364a\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-289d75-rpvn8"
Jul 18 02:24:10.166474 ip-10-0-142-238 kubenswrapper[2566]: I0718 02:24:10.166453    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-289d75-rpvn8"
Jul 18 02:24:10.497108 ip-10-0-142-238 kubenswrapper[2566]: I0718 02:24:10.497081    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-289d75-rpvn8"]
Jul 18 02:24:10.499257 ip-10-0-142-238 kubenswrapper[2566]: W0718 02:24:10.499218    2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podaa606c36_b5c9_4a29_8047_ff4f4b10364a.slice/crio-9f17685622e8d96eac394f1621313f5a71cbfad7fe78a58e8bfbce0a641eb5d2 WatchSource:0}: Error finding container 9f17685622e8d96eac394f1621313f5a71cbfad7fe78a58e8bfbce0a641eb5d2: Status 404 returned error can't find the container with id 9f17685622e8d96eac394f1621313f5a71cbfad7fe78a58e8bfbce0a641eb5d2
Jul 18 02:24:10.869735 ip-10-0-142-238 kubenswrapper[2566]: I0718 02:24:10.869699    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-289d75-rpvn8" event={"ID":"aa606c36-b5c9-4a29-8047-ff4f4b10364a","Type":"ContainerStarted","Data":"6bdf9c0e84d6fababaaf62c22ad5081549c23c4dcb3043315cccd9e504d0a3aa"}
Jul 18 02:24:10.870108 ip-10-0-142-238 kubenswrapper[2566]: I0718 02:24:10.869786    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-289d75-rpvn8" event={"ID":"aa606c36-b5c9-4a29-8047-ff4f4b10364a","Type":"ContainerStarted","Data":"9f17685622e8d96eac394f1621313f5a71cbfad7fe78a58e8bfbce0a641eb5d2"}
Jul 18 02:24:10.885491 ip-10-0-142-238 kubenswrapper[2566]: I0718 02:24:10.885442    2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-289d75-rpvn8" podStartSLOduration=1.8854278469999999 podStartE2EDuration="1.885427847s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-18 02:24:09 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-18 02:24:10.883505614 +0000 UTC m=+2182.572233058" watchObservedRunningTime="2026-07-18 02:24:10.885427847 +0000 UTC m=+2182.574155293"
Jul 18 02:24:11.875674 ip-10-0-142-238 kubenswrapper[2566]: I0718 02:24:11.875640    2566 generic.go:356] "Generic (PLEG): container finished" podID="aa606c36-b5c9-4a29-8047-ff4f4b10364a" containerID="6bdf9c0e84d6fababaaf62c22ad5081549c23c4dcb3043315cccd9e504d0a3aa" exitCode=0
Jul 18 02:24:11.876063 ip-10-0-142-238 kubenswrapper[2566]: I0718 02:24:11.875687    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-289d75-rpvn8" event={"ID":"aa606c36-b5c9-4a29-8047-ff4f4b10364a","Type":"ContainerDied","Data":"6bdf9c0e84d6fababaaf62c22ad5081549c23c4dcb3043315cccd9e504d0a3aa"}
Jul 18 02:24:13.004869 ip-10-0-142-238 kubenswrapper[2566]: I0718 02:24:13.004845    2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-289d75-rpvn8"
Jul 18 02:24:13.104697 ip-10-0-142-238 kubenswrapper[2566]: I0718 02:24:13.104667    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/aa606c36-b5c9-4a29-8047-ff4f4b10364a-maas-api-service-ca\") pod \"aa606c36-b5c9-4a29-8047-ff4f4b10364a\" (UID: \"aa606c36-b5c9-4a29-8047-ff4f4b10364a\") "
Jul 18 02:24:13.104994 ip-10-0-142-238 kubenswrapper[2566]: I0718 02:24:13.104974    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/aa606c36-b5c9-4a29-8047-ff4f4b10364a-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "aa606c36-b5c9-4a29-8047-ff4f4b10364a" (UID: "aa606c36-b5c9-4a29-8047-ff4f4b10364a"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 18 02:24:13.205541 ip-10-0-142-238 kubenswrapper[2566]: I0718 02:24:13.205465    2566 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/aa606c36-b5c9-4a29-8047-ff4f4b10364a-maas-api-service-ca\") on node \"ip-10-0-142-238.ec2.internal\" DevicePath \"\""
Jul 18 02:24:13.886351 ip-10-0-142-238 kubenswrapper[2566]: I0718 02:24:13.886323    2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-289d75-rpvn8"
Jul 18 02:24:13.886512 ip-10-0-142-238 kubenswrapper[2566]: I0718 02:24:13.886323    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-289d75-rpvn8" event={"ID":"aa606c36-b5c9-4a29-8047-ff4f4b10364a","Type":"ContainerDied","Data":"9f17685622e8d96eac394f1621313f5a71cbfad7fe78a58e8bfbce0a641eb5d2"}
Jul 18 02:24:13.886512 ip-10-0-142-238 kubenswrapper[2566]: I0718 02:24:13.886439    2566 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="9f17685622e8d96eac394f1621313f5a71cbfad7fe78a58e8bfbce0a641eb5d2"
Jul 18 02:24:14.884927 ip-10-0-142-238 kubenswrapper[2566]: I0718 02:24:14.884892    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-lmjk9"]
Jul 18 02:24:23.708461 ip-10-0-142-238 kubenswrapper[2566]: I0718 02:24:23.708422    2566 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-inf-a-289d75/test-model-289d75-kserve-649874c887-bqrl7" podUID="d462b93f-0fa8-48f3-92d8-405e75761f3d" containerName="main" containerID="cri-o://a8da49a458011bd4ea6f79be669d7ba46fdd18ddb0134addcade45dbb6d30428" gracePeriod=45
Jul 18 02:24:23.937565 ip-10-0-142-238 kubenswrapper[2566]: I0718 02:24:23.937538    2566 generic.go:356] "Generic (PLEG): container finished" podID="d462b93f-0fa8-48f3-92d8-405e75761f3d" containerID="a8da49a458011bd4ea6f79be669d7ba46fdd18ddb0134addcade45dbb6d30428" exitCode=0
Jul 18 02:24:23.937710 ip-10-0-142-238 kubenswrapper[2566]: I0718 02:24:23.937606    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-a-289d75/test-model-289d75-kserve-649874c887-bqrl7" event={"ID":"d462b93f-0fa8-48f3-92d8-405e75761f3d","Type":"ContainerDied","Data":"a8da49a458011bd4ea6f79be669d7ba46fdd18ddb0134addcade45dbb6d30428"}
Jul 18 02:24:23.951467 ip-10-0-142-238 kubenswrapper[2566]: I0718 02:24:23.951446    2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-a-289d75/test-model-289d75-kserve-649874c887-bqrl7"
Jul 18 02:24:23.992325 ip-10-0-142-238 kubenswrapper[2566]: I0718 02:24:23.992259    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/d462b93f-0fa8-48f3-92d8-405e75761f3d-model-cache\") pod \"d462b93f-0fa8-48f3-92d8-405e75761f3d\" (UID: \"d462b93f-0fa8-48f3-92d8-405e75761f3d\") "
Jul 18 02:24:23.992325 ip-10-0-142-238 kubenswrapper[2566]: I0718 02:24:23.992295    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-hx276\" (UniqueName: \"kubernetes.io/projected/d462b93f-0fa8-48f3-92d8-405e75761f3d-kube-api-access-hx276\") pod \"d462b93f-0fa8-48f3-92d8-405e75761f3d\" (UID: \"d462b93f-0fa8-48f3-92d8-405e75761f3d\") "
Jul 18 02:24:23.992325 ip-10-0-142-238 kubenswrapper[2566]: I0718 02:24:23.992321    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d462b93f-0fa8-48f3-92d8-405e75761f3d-tmp-dir\") pod \"d462b93f-0fa8-48f3-92d8-405e75761f3d\" (UID: \"d462b93f-0fa8-48f3-92d8-405e75761f3d\") "
Jul 18 02:24:23.992572 ip-10-0-142-238 kubenswrapper[2566]: I0718 02:24:23.992345    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d462b93f-0fa8-48f3-92d8-405e75761f3d-tls-certs\") pod \"d462b93f-0fa8-48f3-92d8-405e75761f3d\" (UID: \"d462b93f-0fa8-48f3-92d8-405e75761f3d\") "
Jul 18 02:24:23.992572 ip-10-0-142-238 kubenswrapper[2566]: I0718 02:24:23.992402    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/d462b93f-0fa8-48f3-92d8-405e75761f3d-home\") pod \"d462b93f-0fa8-48f3-92d8-405e75761f3d\" (UID: \"d462b93f-0fa8-48f3-92d8-405e75761f3d\") "
Jul 18 02:24:23.992572 ip-10-0-142-238 kubenswrapper[2566]: I0718 02:24:23.992420    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/d462b93f-0fa8-48f3-92d8-405e75761f3d-dshm\") pod \"d462b93f-0fa8-48f3-92d8-405e75761f3d\" (UID: \"d462b93f-0fa8-48f3-92d8-405e75761f3d\") "
Jul 18 02:24:23.992572 ip-10-0-142-238 kubenswrapper[2566]: I0718 02:24:23.992546    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d462b93f-0fa8-48f3-92d8-405e75761f3d-model-cache" (OuterVolumeSpecName: "model-cache") pod "d462b93f-0fa8-48f3-92d8-405e75761f3d" (UID: "d462b93f-0fa8-48f3-92d8-405e75761f3d"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 18 02:24:23.992786 ip-10-0-142-238 kubenswrapper[2566]: I0718 02:24:23.992575    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d462b93f-0fa8-48f3-92d8-405e75761f3d-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "d462b93f-0fa8-48f3-92d8-405e75761f3d" (UID: "d462b93f-0fa8-48f3-92d8-405e75761f3d"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 18 02:24:23.992786 ip-10-0-142-238 kubenswrapper[2566]: I0718 02:24:23.992721    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d462b93f-0fa8-48f3-92d8-405e75761f3d-home" (OuterVolumeSpecName: "home") pod "d462b93f-0fa8-48f3-92d8-405e75761f3d" (UID: "d462b93f-0fa8-48f3-92d8-405e75761f3d"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 18 02:24:23.992859 ip-10-0-142-238 kubenswrapper[2566]: I0718 02:24:23.992799    2566 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/d462b93f-0fa8-48f3-92d8-405e75761f3d-model-cache\") on node \"ip-10-0-142-238.ec2.internal\" DevicePath \"\""
Jul 18 02:24:23.992859 ip-10-0-142-238 kubenswrapper[2566]: I0718 02:24:23.992816    2566 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d462b93f-0fa8-48f3-92d8-405e75761f3d-tmp-dir\") on node \"ip-10-0-142-238.ec2.internal\" DevicePath \"\""
Jul 18 02:24:23.994407 ip-10-0-142-238 kubenswrapper[2566]: I0718 02:24:23.994373    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d462b93f-0fa8-48f3-92d8-405e75761f3d-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "d462b93f-0fa8-48f3-92d8-405e75761f3d" (UID: "d462b93f-0fa8-48f3-92d8-405e75761f3d"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 18 02:24:23.994507 ip-10-0-142-238 kubenswrapper[2566]: I0718 02:24:23.994430    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d462b93f-0fa8-48f3-92d8-405e75761f3d-kube-api-access-hx276" (OuterVolumeSpecName: "kube-api-access-hx276") pod "d462b93f-0fa8-48f3-92d8-405e75761f3d" (UID: "d462b93f-0fa8-48f3-92d8-405e75761f3d"). InnerVolumeSpecName "kube-api-access-hx276". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 18 02:24:23.994507 ip-10-0-142-238 kubenswrapper[2566]: I0718 02:24:23.994435    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d462b93f-0fa8-48f3-92d8-405e75761f3d-dshm" (OuterVolumeSpecName: "dshm") pod "d462b93f-0fa8-48f3-92d8-405e75761f3d" (UID: "d462b93f-0fa8-48f3-92d8-405e75761f3d"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 18 02:24:24.094104 ip-10-0-142-238 kubenswrapper[2566]: I0718 02:24:24.094060    2566 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-hx276\" (UniqueName: \"kubernetes.io/projected/d462b93f-0fa8-48f3-92d8-405e75761f3d-kube-api-access-hx276\") on node \"ip-10-0-142-238.ec2.internal\" DevicePath \"\""
Jul 18 02:24:24.094104 ip-10-0-142-238 kubenswrapper[2566]: I0718 02:24:24.094099    2566 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d462b93f-0fa8-48f3-92d8-405e75761f3d-tls-certs\") on node \"ip-10-0-142-238.ec2.internal\" DevicePath \"\""
Jul 18 02:24:24.094104 ip-10-0-142-238 kubenswrapper[2566]: I0718 02:24:24.094109    2566 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/d462b93f-0fa8-48f3-92d8-405e75761f3d-home\") on node \"ip-10-0-142-238.ec2.internal\" DevicePath \"\""
Jul 18 02:24:24.094104 ip-10-0-142-238 kubenswrapper[2566]: I0718 02:24:24.094118    2566 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/d462b93f-0fa8-48f3-92d8-405e75761f3d-dshm\") on node \"ip-10-0-142-238.ec2.internal\" DevicePath \"\""
Jul 18 02:24:24.677490 ip-10-0-142-238 kubenswrapper[2566]: I0718 02:24:24.677458    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-lmjk9"]
Jul 18 02:24:24.744813 ip-10-0-142-238 kubenswrapper[2566]: I0718 02:24:24.744775    2566 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-inf-b-5eb23f/test-model-5eb23f-kserve-7756577dff-pqv9g" podUID="470ffb3f-c8b5-4607-b5e6-8701cdcfadcd" containerName="main" containerID="cri-o://edb7e4d90f0aa4a56f11c0d90541835c327cc01c053be54e3cd99cb7104e2d95" gracePeriod=45
Jul 18 02:24:24.919296 ip-10-0-142-238 kubenswrapper[2566]: I0718 02:24:24.919254    2566 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-289d75-rpvn8"]
Jul 18 02:24:24.922040 ip-10-0-142-238 kubenswrapper[2566]: I0718 02:24:24.922016    2566 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-289d75-rpvn8"]
Jul 18 02:24:24.944122 ip-10-0-142-238 kubenswrapper[2566]: I0718 02:24:24.944060    2566 generic.go:356] "Generic (PLEG): container finished" podID="470ffb3f-c8b5-4607-b5e6-8701cdcfadcd" containerID="edb7e4d90f0aa4a56f11c0d90541835c327cc01c053be54e3cd99cb7104e2d95" exitCode=0
Jul 18 02:24:24.944237 ip-10-0-142-238 kubenswrapper[2566]: I0718 02:24:24.944132    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-b-5eb23f/test-model-5eb23f-kserve-7756577dff-pqv9g" event={"ID":"470ffb3f-c8b5-4607-b5e6-8701cdcfadcd","Type":"ContainerDied","Data":"edb7e4d90f0aa4a56f11c0d90541835c327cc01c053be54e3cd99cb7104e2d95"}
Jul 18 02:24:24.945554 ip-10-0-142-238 kubenswrapper[2566]: I0718 02:24:24.945527    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-a-289d75/test-model-289d75-kserve-649874c887-bqrl7" event={"ID":"d462b93f-0fa8-48f3-92d8-405e75761f3d","Type":"ContainerDied","Data":"6604b399eb31771928c306c4535c4648e84d9d5dc30ea661fbdf0548a6e1d048"}
Jul 18 02:24:24.945554 ip-10-0-142-238 kubenswrapper[2566]: I0718 02:24:24.945563    2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-a-289d75/test-model-289d75-kserve-649874c887-bqrl7"
Jul 18 02:24:24.945746 ip-10-0-142-238 kubenswrapper[2566]: I0718 02:24:24.945569    2566 scope.go:117] "RemoveContainer" containerID="a8da49a458011bd4ea6f79be669d7ba46fdd18ddb0134addcade45dbb6d30428"
Jul 18 02:24:24.963695 ip-10-0-142-238 kubenswrapper[2566]: I0718 02:24:24.963675    2566 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-inf-a-289d75/test-model-289d75-kserve-649874c887-bqrl7"]
Jul 18 02:24:24.968101 ip-10-0-142-238 kubenswrapper[2566]: I0718 02:24:24.968071    2566 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-inf-a-289d75/test-model-289d75-kserve-649874c887-bqrl7"]
Jul 18 02:24:24.988196 ip-10-0-142-238 kubenswrapper[2566]: I0718 02:24:24.988178    2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-b-5eb23f/test-model-5eb23f-kserve-7756577dff-pqv9g"
Jul 18 02:24:25.001667 ip-10-0-142-238 kubenswrapper[2566]: I0718 02:24:25.001647    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-wgxhg\" (UniqueName: \"kubernetes.io/projected/470ffb3f-c8b5-4607-b5e6-8701cdcfadcd-kube-api-access-wgxhg\") pod \"470ffb3f-c8b5-4607-b5e6-8701cdcfadcd\" (UID: \"470ffb3f-c8b5-4607-b5e6-8701cdcfadcd\") "
Jul 18 02:24:25.001774 ip-10-0-142-238 kubenswrapper[2566]: I0718 02:24:25.001694    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/470ffb3f-c8b5-4607-b5e6-8701cdcfadcd-tmp-dir\") pod \"470ffb3f-c8b5-4607-b5e6-8701cdcfadcd\" (UID: \"470ffb3f-c8b5-4607-b5e6-8701cdcfadcd\") "
Jul 18 02:24:25.001774 ip-10-0-142-238 kubenswrapper[2566]: I0718 02:24:25.001723    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/470ffb3f-c8b5-4607-b5e6-8701cdcfadcd-dshm\") pod \"470ffb3f-c8b5-4607-b5e6-8701cdcfadcd\" (UID: \"470ffb3f-c8b5-4607-b5e6-8701cdcfadcd\") "
Jul 18 02:24:25.001774 ip-10-0-142-238 kubenswrapper[2566]: I0718 02:24:25.001747    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/470ffb3f-c8b5-4607-b5e6-8701cdcfadcd-tls-certs\") pod \"470ffb3f-c8b5-4607-b5e6-8701cdcfadcd\" (UID: \"470ffb3f-c8b5-4607-b5e6-8701cdcfadcd\") "
Jul 18 02:24:25.001774 ip-10-0-142-238 kubenswrapper[2566]: I0718 02:24:25.001771    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/470ffb3f-c8b5-4607-b5e6-8701cdcfadcd-model-cache\") pod \"470ffb3f-c8b5-4607-b5e6-8701cdcfadcd\" (UID: \"470ffb3f-c8b5-4607-b5e6-8701cdcfadcd\") "
Jul 18 02:24:25.001976 ip-10-0-142-238 kubenswrapper[2566]: I0718 02:24:25.001805    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/470ffb3f-c8b5-4607-b5e6-8701cdcfadcd-home\") pod \"470ffb3f-c8b5-4607-b5e6-8701cdcfadcd\" (UID: \"470ffb3f-c8b5-4607-b5e6-8701cdcfadcd\") "
Jul 18 02:24:25.002041 ip-10-0-142-238 kubenswrapper[2566]: I0718 02:24:25.002016    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/470ffb3f-c8b5-4607-b5e6-8701cdcfadcd-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "470ffb3f-c8b5-4607-b5e6-8701cdcfadcd" (UID: "470ffb3f-c8b5-4607-b5e6-8701cdcfadcd"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 18 02:24:25.002152 ip-10-0-142-238 kubenswrapper[2566]: I0718 02:24:25.002112    2566 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/470ffb3f-c8b5-4607-b5e6-8701cdcfadcd-tmp-dir\") on node \"ip-10-0-142-238.ec2.internal\" DevicePath \"\""
Jul 18 02:24:25.002255 ip-10-0-142-238 kubenswrapper[2566]: I0718 02:24:25.002164    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/470ffb3f-c8b5-4607-b5e6-8701cdcfadcd-home" (OuterVolumeSpecName: "home") pod "470ffb3f-c8b5-4607-b5e6-8701cdcfadcd" (UID: "470ffb3f-c8b5-4607-b5e6-8701cdcfadcd"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 18 02:24:25.002255 ip-10-0-142-238 kubenswrapper[2566]: I0718 02:24:25.002218    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/470ffb3f-c8b5-4607-b5e6-8701cdcfadcd-model-cache" (OuterVolumeSpecName: "model-cache") pod "470ffb3f-c8b5-4607-b5e6-8701cdcfadcd" (UID: "470ffb3f-c8b5-4607-b5e6-8701cdcfadcd"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 18 02:24:25.003918 ip-10-0-142-238 kubenswrapper[2566]: I0718 02:24:25.003900    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/470ffb3f-c8b5-4607-b5e6-8701cdcfadcd-kube-api-access-wgxhg" (OuterVolumeSpecName: "kube-api-access-wgxhg") pod "470ffb3f-c8b5-4607-b5e6-8701cdcfadcd" (UID: "470ffb3f-c8b5-4607-b5e6-8701cdcfadcd"). InnerVolumeSpecName "kube-api-access-wgxhg". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 18 02:24:25.004182 ip-10-0-142-238 kubenswrapper[2566]: I0718 02:24:25.004158    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/470ffb3f-c8b5-4607-b5e6-8701cdcfadcd-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "470ffb3f-c8b5-4607-b5e6-8701cdcfadcd" (UID: "470ffb3f-c8b5-4607-b5e6-8701cdcfadcd"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 18 02:24:25.004182 ip-10-0-142-238 kubenswrapper[2566]: I0718 02:24:25.004163    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/470ffb3f-c8b5-4607-b5e6-8701cdcfadcd-dshm" (OuterVolumeSpecName: "dshm") pod "470ffb3f-c8b5-4607-b5e6-8701cdcfadcd" (UID: "470ffb3f-c8b5-4607-b5e6-8701cdcfadcd"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 18 02:24:25.103400 ip-10-0-142-238 kubenswrapper[2566]: I0718 02:24:25.103375    2566 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-wgxhg\" (UniqueName: \"kubernetes.io/projected/470ffb3f-c8b5-4607-b5e6-8701cdcfadcd-kube-api-access-wgxhg\") on node \"ip-10-0-142-238.ec2.internal\" DevicePath \"\""
Jul 18 02:24:25.103400 ip-10-0-142-238 kubenswrapper[2566]: I0718 02:24:25.103400    2566 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/470ffb3f-c8b5-4607-b5e6-8701cdcfadcd-dshm\") on node \"ip-10-0-142-238.ec2.internal\" DevicePath \"\""
Jul 18 02:24:25.103576 ip-10-0-142-238 kubenswrapper[2566]: I0718 02:24:25.103410    2566 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/470ffb3f-c8b5-4607-b5e6-8701cdcfadcd-tls-certs\") on node \"ip-10-0-142-238.ec2.internal\" DevicePath \"\""
Jul 18 02:24:25.103576 ip-10-0-142-238 kubenswrapper[2566]: I0718 02:24:25.103418    2566 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/470ffb3f-c8b5-4607-b5e6-8701cdcfadcd-model-cache\") on node \"ip-10-0-142-238.ec2.internal\" DevicePath \"\""
Jul 18 02:24:25.103576 ip-10-0-142-238 kubenswrapper[2566]: I0718 02:24:25.103425    2566 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/470ffb3f-c8b5-4607-b5e6-8701cdcfadcd-home\") on node \"ip-10-0-142-238.ec2.internal\" DevicePath \"\""
Jul 18 02:24:25.952209 ip-10-0-142-238 kubenswrapper[2566]: I0718 02:24:25.952181    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-b-5eb23f/test-model-5eb23f-kserve-7756577dff-pqv9g" event={"ID":"470ffb3f-c8b5-4607-b5e6-8701cdcfadcd","Type":"ContainerDied","Data":"d71ed58946933d27fac33a97232cbe12b43928d721729d4c3f1c2646838115ec"}
Jul 18 02:24:25.952632 ip-10-0-142-238 kubenswrapper[2566]: I0718 02:24:25.952215    2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-b-5eb23f/test-model-5eb23f-kserve-7756577dff-pqv9g"
Jul 18 02:24:25.952632 ip-10-0-142-238 kubenswrapper[2566]: I0718 02:24:25.952224    2566 scope.go:117] "RemoveContainer" containerID="edb7e4d90f0aa4a56f11c0d90541835c327cc01c053be54e3cd99cb7104e2d95"
Jul 18 02:24:25.973075 ip-10-0-142-238 kubenswrapper[2566]: I0718 02:24:25.973052    2566 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-inf-b-5eb23f/test-model-5eb23f-kserve-7756577dff-pqv9g"]
Jul 18 02:24:25.976220 ip-10-0-142-238 kubenswrapper[2566]: I0718 02:24:25.976202    2566 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-inf-b-5eb23f/test-model-5eb23f-kserve-7756577dff-pqv9g"]
Jul 18 02:24:26.816178 ip-10-0-142-238 kubenswrapper[2566]: I0718 02:24:26.816143    2566 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="470ffb3f-c8b5-4607-b5e6-8701cdcfadcd" path="/var/lib/kubelet/pods/470ffb3f-c8b5-4607-b5e6-8701cdcfadcd/volumes"
Jul 18 02:24:26.816562 ip-10-0-142-238 kubenswrapper[2566]: I0718 02:24:26.816537    2566 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="aa606c36-b5c9-4a29-8047-ff4f4b10364a" path="/var/lib/kubelet/pods/aa606c36-b5c9-4a29-8047-ff4f4b10364a/volumes"
Jul 18 02:24:26.816980 ip-10-0-142-238 kubenswrapper[2566]: I0718 02:24:26.816959    2566 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d462b93f-0fa8-48f3-92d8-405e75761f3d" path="/var/lib/kubelet/pods/d462b93f-0fa8-48f3-92d8-405e75761f3d/volumes"
Jul 18 02:24:31.530119 ip-10-0-142-238 kubenswrapper[2566]: I0718 02:24:31.530085    2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-5eb23f-lbw54"]
Jul 18 02:24:31.530482 ip-10-0-142-238 kubenswrapper[2566]: I0718 02:24:31.530384    2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="470ffb3f-c8b5-4607-b5e6-8701cdcfadcd" containerName="main"
Jul 18 02:24:31.530482 ip-10-0-142-238 kubenswrapper[2566]: I0718 02:24:31.530394    2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="470ffb3f-c8b5-4607-b5e6-8701cdcfadcd" containerName="main"
Jul 18 02:24:31.530482 ip-10-0-142-238 kubenswrapper[2566]: I0718 02:24:31.530406    2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d462b93f-0fa8-48f3-92d8-405e75761f3d" containerName="main"
Jul 18 02:24:31.530482 ip-10-0-142-238 kubenswrapper[2566]: I0718 02:24:31.530411    2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="d462b93f-0fa8-48f3-92d8-405e75761f3d" containerName="main"
Jul 18 02:24:31.530482 ip-10-0-142-238 kubenswrapper[2566]: I0718 02:24:31.530419    2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="aa606c36-b5c9-4a29-8047-ff4f4b10364a" containerName="revoke-keys"
Jul 18 02:24:31.530482 ip-10-0-142-238 kubenswrapper[2566]: I0718 02:24:31.530425    2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="aa606c36-b5c9-4a29-8047-ff4f4b10364a" containerName="revoke-keys"
Jul 18 02:24:31.530482 ip-10-0-142-238 kubenswrapper[2566]: I0718 02:24:31.530475    2566 memory_manager.go:368] "RemoveStaleState removing state" podUID="d462b93f-0fa8-48f3-92d8-405e75761f3d" containerName="main"
Jul 18 02:24:31.530482 ip-10-0-142-238 kubenswrapper[2566]: I0718 02:24:31.530481    2566 memory_manager.go:368] "RemoveStaleState removing state" podUID="470ffb3f-c8b5-4607-b5e6-8701cdcfadcd" containerName="main"
Jul 18 02:24:31.530763 ip-10-0-142-238 kubenswrapper[2566]: I0718 02:24:31.530490    2566 memory_manager.go:368] "RemoveStaleState removing state" podUID="aa606c36-b5c9-4a29-8047-ff4f4b10364a" containerName="revoke-keys"
Jul 18 02:24:31.534737 ip-10-0-142-238 kubenswrapper[2566]: I0718 02:24:31.534717    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-5eb23f-lbw54"
Jul 18 02:24:31.538290 ip-10-0-142-238 kubenswrapper[2566]: I0718 02:24:31.538271    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-5chqh\""
Jul 18 02:24:31.538423 ip-10-0-142-238 kubenswrapper[2566]: I0718 02:24:31.538312    2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 18 02:24:31.542085 ip-10-0-142-238 kubenswrapper[2566]: I0718 02:24:31.541907    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-5eb23f-lbw54"]
Jul 18 02:24:31.548044 ip-10-0-142-238 kubenswrapper[2566]: I0718 02:24:31.548022    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/f26a44bd-208e-4cf7-99e3-2d2257695cfa-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-inf-b-5eb23f-lbw54\" (UID: \"f26a44bd-208e-4cf7-99e3-2d2257695cfa\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-5eb23f-lbw54"
Jul 18 02:24:31.648961 ip-10-0-142-238 kubenswrapper[2566]: I0718 02:24:31.648932    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/f26a44bd-208e-4cf7-99e3-2d2257695cfa-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-inf-b-5eb23f-lbw54\" (UID: \"f26a44bd-208e-4cf7-99e3-2d2257695cfa\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-5eb23f-lbw54"
Jul 18 02:24:31.649506 ip-10-0-142-238 kubenswrapper[2566]: I0718 02:24:31.649489    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/f26a44bd-208e-4cf7-99e3-2d2257695cfa-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-inf-b-5eb23f-lbw54\" (UID: \"f26a44bd-208e-4cf7-99e3-2d2257695cfa\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-5eb23f-lbw54"
Jul 18 02:24:31.846112 ip-10-0-142-238 kubenswrapper[2566]: I0718 02:24:31.846054    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-5eb23f-lbw54"
Jul 18 02:24:31.972154 ip-10-0-142-238 kubenswrapper[2566]: I0718 02:24:31.972126    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-5eb23f-lbw54"]
Jul 18 02:24:31.976088 ip-10-0-142-238 kubenswrapper[2566]: W0718 02:24:31.976056    2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf26a44bd_208e_4cf7_99e3_2d2257695cfa.slice/crio-673a4987ca982c08e5d9d26651ed259dd91de98902531b35afcca175ced56ca7 WatchSource:0}: Error finding container 673a4987ca982c08e5d9d26651ed259dd91de98902531b35afcca175ced56ca7: Status 404 returned error can't find the container with id 673a4987ca982c08e5d9d26651ed259dd91de98902531b35afcca175ced56ca7
Jul 18 02:24:31.987009 ip-10-0-142-238 kubenswrapper[2566]: I0718 02:24:31.986983    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-5eb23f-lbw54" event={"ID":"f26a44bd-208e-4cf7-99e3-2d2257695cfa","Type":"ContainerStarted","Data":"673a4987ca982c08e5d9d26651ed259dd91de98902531b35afcca175ced56ca7"}
Jul 18 02:24:32.992930 ip-10-0-142-238 kubenswrapper[2566]: I0718 02:24:32.992865    2566 generic.go:356] "Generic (PLEG): container finished" podID="f26a44bd-208e-4cf7-99e3-2d2257695cfa" containerID="675d12dafd82560e5a0dc14b9fc6905b9c5be10d7ccadf328aa729f5190f8cd6" exitCode=0
Jul 18 02:24:32.993250 ip-10-0-142-238 kubenswrapper[2566]: I0718 02:24:32.992944    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-5eb23f-lbw54" event={"ID":"f26a44bd-208e-4cf7-99e3-2d2257695cfa","Type":"ContainerDied","Data":"675d12dafd82560e5a0dc14b9fc6905b9c5be10d7ccadf328aa729f5190f8cd6"}
Jul 18 02:24:34.117557 ip-10-0-142-238 kubenswrapper[2566]: I0718 02:24:34.117532    2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-5eb23f-lbw54"
Jul 18 02:24:34.168797 ip-10-0-142-238 kubenswrapper[2566]: I0718 02:24:34.168771    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/f26a44bd-208e-4cf7-99e3-2d2257695cfa-maas-api-service-ca\") pod \"f26a44bd-208e-4cf7-99e3-2d2257695cfa\" (UID: \"f26a44bd-208e-4cf7-99e3-2d2257695cfa\") "
Jul 18 02:24:34.169113 ip-10-0-142-238 kubenswrapper[2566]: I0718 02:24:34.169093    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f26a44bd-208e-4cf7-99e3-2d2257695cfa-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "f26a44bd-208e-4cf7-99e3-2d2257695cfa" (UID: "f26a44bd-208e-4cf7-99e3-2d2257695cfa"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 18 02:24:34.269966 ip-10-0-142-238 kubenswrapper[2566]: I0718 02:24:34.269893    2566 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/f26a44bd-208e-4cf7-99e3-2d2257695cfa-maas-api-service-ca\") on node \"ip-10-0-142-238.ec2.internal\" DevicePath \"\""
Jul 18 02:24:35.002886 ip-10-0-142-238 kubenswrapper[2566]: I0718 02:24:35.002854    2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-5eb23f-lbw54"
Jul 18 02:24:35.003048 ip-10-0-142-238 kubenswrapper[2566]: I0718 02:24:35.002861    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-5eb23f-lbw54" event={"ID":"f26a44bd-208e-4cf7-99e3-2d2257695cfa","Type":"ContainerDied","Data":"673a4987ca982c08e5d9d26651ed259dd91de98902531b35afcca175ced56ca7"}
Jul 18 02:24:35.003048 ip-10-0-142-238 kubenswrapper[2566]: I0718 02:24:35.003015    2566 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="673a4987ca982c08e5d9d26651ed259dd91de98902531b35afcca175ced56ca7"
Jul 18 02:24:45.183440 ip-10-0-142-238 kubenswrapper[2566]: I0718 02:24:45.183405    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-lmjk9"]
Jul 18 02:24:46.600567 ip-10-0-142-238 kubenswrapper[2566]: I0718 02:24:46.600533    2566 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-5eb23f-lbw54"]
Jul 18 02:24:46.603180 ip-10-0-142-238 kubenswrapper[2566]: I0718 02:24:46.603155    2566 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-5eb23f-lbw54"]
Jul 18 02:24:46.816151 ip-10-0-142-238 kubenswrapper[2566]: I0718 02:24:46.816118    2566 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f26a44bd-208e-4cf7-99e3-2d2257695cfa" path="/var/lib/kubelet/pods/f26a44bd-208e-4cf7-99e3-2d2257695cfa/volumes"
Jul 18 02:25:03.386433 ip-10-0-142-238 kubenswrapper[2566]: I0718 02:25:03.386395    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-lmjk9"]
Jul 18 02:25:17.189264 ip-10-0-142-238 kubenswrapper[2566]: I0718 02:25:17.189186    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-lmjk9"]
Jul 18 02:25:17.998082 ip-10-0-142-238 kubenswrapper[2566]: I0718 02:25:17.998048    2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-c9ff0e-zwlfw"]
Jul 18 02:25:17.998358 ip-10-0-142-238 kubenswrapper[2566]: I0718 02:25:17.998347    2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f26a44bd-208e-4cf7-99e3-2d2257695cfa" containerName="revoke-keys"
Jul 18 02:25:17.998402 ip-10-0-142-238 kubenswrapper[2566]: I0718 02:25:17.998360    2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="f26a44bd-208e-4cf7-99e3-2d2257695cfa" containerName="revoke-keys"
Jul 18 02:25:17.998441 ip-10-0-142-238 kubenswrapper[2566]: I0718 02:25:17.998414    2566 memory_manager.go:368] "RemoveStaleState removing state" podUID="f26a44bd-208e-4cf7-99e3-2d2257695cfa" containerName="revoke-keys"
Jul 18 02:25:18.001658 ip-10-0-142-238 kubenswrapper[2566]: I0718 02:25:18.001635    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-c9ff0e-zwlfw"
Jul 18 02:25:18.004778 ip-10-0-142-238 kubenswrapper[2566]: I0718 02:25:18.004757    2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 18 02:25:18.006738 ip-10-0-142-238 kubenswrapper[2566]: I0718 02:25:18.006720    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-5chqh\""
Jul 18 02:25:18.018605 ip-10-0-142-238 kubenswrapper[2566]: I0718 02:25:18.018585    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-c9ff0e-zwlfw"]
Jul 18 02:25:18.121243 ip-10-0-142-238 kubenswrapper[2566]: I0718 02:25:18.121210    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/8795cafa-05d4-4c81-988b-49ed3fdffc5b-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-api-a-c9ff0e-zwlfw\" (UID: \"8795cafa-05d4-4c81-988b-49ed3fdffc5b\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-c9ff0e-zwlfw"
Jul 18 02:25:18.222333 ip-10-0-142-238 kubenswrapper[2566]: I0718 02:25:18.222304    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/8795cafa-05d4-4c81-988b-49ed3fdffc5b-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-api-a-c9ff0e-zwlfw\" (UID: \"8795cafa-05d4-4c81-988b-49ed3fdffc5b\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-c9ff0e-zwlfw"
Jul 18 02:25:18.222952 ip-10-0-142-238 kubenswrapper[2566]: I0718 02:25:18.222934    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/8795cafa-05d4-4c81-988b-49ed3fdffc5b-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-api-a-c9ff0e-zwlfw\" (UID: \"8795cafa-05d4-4c81-988b-49ed3fdffc5b\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-c9ff0e-zwlfw"
Jul 18 02:25:18.312021 ip-10-0-142-238 kubenswrapper[2566]: I0718 02:25:18.311996    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-c9ff0e-zwlfw"
Jul 18 02:25:18.646274 ip-10-0-142-238 kubenswrapper[2566]: I0718 02:25:18.646251    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-c9ff0e-zwlfw"]
Jul 18 02:25:18.648489 ip-10-0-142-238 kubenswrapper[2566]: W0718 02:25:18.648464    2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8795cafa_05d4_4c81_988b_49ed3fdffc5b.slice/crio-b022792a9e52d645f596d3fcb5cbfbd7c30fb6a74a7637e63c89f8c7440a0c0a WatchSource:0}: Error finding container b022792a9e52d645f596d3fcb5cbfbd7c30fb6a74a7637e63c89f8c7440a0c0a: Status 404 returned error can't find the container with id b022792a9e52d645f596d3fcb5cbfbd7c30fb6a74a7637e63c89f8c7440a0c0a
Jul 18 02:25:19.217327 ip-10-0-142-238 kubenswrapper[2566]: I0718 02:25:19.217235    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-c9ff0e-zwlfw" event={"ID":"8795cafa-05d4-4c81-988b-49ed3fdffc5b","Type":"ContainerStarted","Data":"2cf2babf8ca1a44698c32a8fa8746627d212aeca52fac6ff78d569fc16403956"}
Jul 18 02:25:19.217327 ip-10-0-142-238 kubenswrapper[2566]: I0718 02:25:19.217290    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-c9ff0e-zwlfw" event={"ID":"8795cafa-05d4-4c81-988b-49ed3fdffc5b","Type":"ContainerStarted","Data":"b022792a9e52d645f596d3fcb5cbfbd7c30fb6a74a7637e63c89f8c7440a0c0a"}
Jul 18 02:25:19.233396 ip-10-0-142-238 kubenswrapper[2566]: I0718 02:25:19.233337    2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-c9ff0e-zwlfw" podStartSLOduration=2.233320732 podStartE2EDuration="2.233320732s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-18 02:25:17 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-18 02:25:19.233137936 +0000 UTC m=+2250.921865405" watchObservedRunningTime="2026-07-18 02:25:19.233320732 +0000 UTC m=+2250.922048180"
Jul 18 02:25:20.223141 ip-10-0-142-238 kubenswrapper[2566]: I0718 02:25:20.223105    2566 generic.go:356] "Generic (PLEG): container finished" podID="8795cafa-05d4-4c81-988b-49ed3fdffc5b" containerID="2cf2babf8ca1a44698c32a8fa8746627d212aeca52fac6ff78d569fc16403956" exitCode=0
Jul 18 02:25:20.223312 ip-10-0-142-238 kubenswrapper[2566]: I0718 02:25:20.223192    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-c9ff0e-zwlfw" event={"ID":"8795cafa-05d4-4c81-988b-49ed3fdffc5b","Type":"ContainerDied","Data":"2cf2babf8ca1a44698c32a8fa8746627d212aeca52fac6ff78d569fc16403956"}
Jul 18 02:25:21.351311 ip-10-0-142-238 kubenswrapper[2566]: I0718 02:25:21.351290    2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-c9ff0e-zwlfw"
Jul 18 02:25:21.447530 ip-10-0-142-238 kubenswrapper[2566]: I0718 02:25:21.447502    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/8795cafa-05d4-4c81-988b-49ed3fdffc5b-maas-api-service-ca\") pod \"8795cafa-05d4-4c81-988b-49ed3fdffc5b\" (UID: \"8795cafa-05d4-4c81-988b-49ed3fdffc5b\") "
Jul 18 02:25:21.447877 ip-10-0-142-238 kubenswrapper[2566]: I0718 02:25:21.447857    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8795cafa-05d4-4c81-988b-49ed3fdffc5b-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "8795cafa-05d4-4c81-988b-49ed3fdffc5b" (UID: "8795cafa-05d4-4c81-988b-49ed3fdffc5b"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 18 02:25:21.548320 ip-10-0-142-238 kubenswrapper[2566]: I0718 02:25:21.548298    2566 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/8795cafa-05d4-4c81-988b-49ed3fdffc5b-maas-api-service-ca\") on node \"ip-10-0-142-238.ec2.internal\" DevicePath \"\""
Jul 18 02:25:22.235657 ip-10-0-142-238 kubenswrapper[2566]: I0718 02:25:22.235627    2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-c9ff0e-zwlfw"
Jul 18 02:25:22.235657 ip-10-0-142-238 kubenswrapper[2566]: I0718 02:25:22.235639    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-c9ff0e-zwlfw" event={"ID":"8795cafa-05d4-4c81-988b-49ed3fdffc5b","Type":"ContainerDied","Data":"b022792a9e52d645f596d3fcb5cbfbd7c30fb6a74a7637e63c89f8c7440a0c0a"}
Jul 18 02:25:22.235864 ip-10-0-142-238 kubenswrapper[2566]: I0718 02:25:22.235696    2566 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="b022792a9e52d645f596d3fcb5cbfbd7c30fb6a74a7637e63c89f8c7440a0c0a"
Jul 18 02:25:36.586183 ip-10-0-142-238 kubenswrapper[2566]: I0718 02:25:36.586148    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-lmjk9"]
Jul 18 02:25:38.081701 ip-10-0-142-238 kubenswrapper[2566]: I0718 02:25:38.081666    2566 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-c9ff0e-zwlfw"]
Jul 18 02:25:38.086193 ip-10-0-142-238 kubenswrapper[2566]: I0718 02:25:38.086168    2566 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-c9ff0e-zwlfw"]
Jul 18 02:25:38.815965 ip-10-0-142-238 kubenswrapper[2566]: I0718 02:25:38.815932    2566 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="8795cafa-05d4-4c81-988b-49ed3fdffc5b" path="/var/lib/kubelet/pods/8795cafa-05d4-4c81-988b-49ed3fdffc5b/volumes"
Jul 18 02:25:44.708970 ip-10-0-142-238 kubenswrapper[2566]: I0718 02:25:44.708932    2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-21cdac-knxhc"]
Jul 18 02:25:44.709433 ip-10-0-142-238 kubenswrapper[2566]: I0718 02:25:44.709362    2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8795cafa-05d4-4c81-988b-49ed3fdffc5b" containerName="revoke-keys"
Jul 18 02:25:44.709433 ip-10-0-142-238 kubenswrapper[2566]: I0718 02:25:44.709380    2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="8795cafa-05d4-4c81-988b-49ed3fdffc5b" containerName="revoke-keys"
Jul 18 02:25:44.709541 ip-10-0-142-238 kubenswrapper[2566]: I0718 02:25:44.709464    2566 memory_manager.go:368] "RemoveStaleState removing state" podUID="8795cafa-05d4-4c81-988b-49ed3fdffc5b" containerName="revoke-keys"
Jul 18 02:25:44.712627 ip-10-0-142-238 kubenswrapper[2566]: I0718 02:25:44.712586    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-21cdac-knxhc"
Jul 18 02:25:44.714877 ip-10-0-142-238 kubenswrapper[2566]: I0718 02:25:44.714858    2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 18 02:25:44.714991 ip-10-0-142-238 kubenswrapper[2566]: I0718 02:25:44.714954    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-5chqh\""
Jul 18 02:25:44.719780 ip-10-0-142-238 kubenswrapper[2566]: I0718 02:25:44.719756    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-21cdac-knxhc"]
Jul 18 02:25:44.729554 ip-10-0-142-238 kubenswrapper[2566]: I0718 02:25:44.729532    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/c625b686-b50b-4623-a9cc-0a6816a9e19a-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-api-b-21cdac-knxhc\" (UID: \"c625b686-b50b-4623-a9cc-0a6816a9e19a\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-21cdac-knxhc"
Jul 18 02:25:44.830308 ip-10-0-142-238 kubenswrapper[2566]: I0718 02:25:44.830267    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/c625b686-b50b-4623-a9cc-0a6816a9e19a-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-api-b-21cdac-knxhc\" (UID: \"c625b686-b50b-4623-a9cc-0a6816a9e19a\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-21cdac-knxhc"
Jul 18 02:25:44.831033 ip-10-0-142-238 kubenswrapper[2566]: I0718 02:25:44.831010    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/c625b686-b50b-4623-a9cc-0a6816a9e19a-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-api-b-21cdac-knxhc\" (UID: \"c625b686-b50b-4623-a9cc-0a6816a9e19a\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-21cdac-knxhc"
Jul 18 02:25:45.024740 ip-10-0-142-238 kubenswrapper[2566]: I0718 02:25:45.024654    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-21cdac-knxhc"
Jul 18 02:25:45.151562 ip-10-0-142-238 kubenswrapper[2566]: I0718 02:25:45.151539    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-21cdac-knxhc"]
Jul 18 02:25:45.153841 ip-10-0-142-238 kubenswrapper[2566]: W0718 02:25:45.153814    2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc625b686_b50b_4623_a9cc_0a6816a9e19a.slice/crio-82d4d694da90c5ba8df57ef5e2b5ecede9f88e6639dc5f0293e9a97aba3368a9 WatchSource:0}: Error finding container 82d4d694da90c5ba8df57ef5e2b5ecede9f88e6639dc5f0293e9a97aba3368a9: Status 404 returned error can't find the container with id 82d4d694da90c5ba8df57ef5e2b5ecede9f88e6639dc5f0293e9a97aba3368a9
Jul 18 02:25:45.353080 ip-10-0-142-238 kubenswrapper[2566]: I0718 02:25:45.353048    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-21cdac-knxhc" event={"ID":"c625b686-b50b-4623-a9cc-0a6816a9e19a","Type":"ContainerStarted","Data":"82d4d694da90c5ba8df57ef5e2b5ecede9f88e6639dc5f0293e9a97aba3368a9"}
Jul 18 02:25:46.364361 ip-10-0-142-238 kubenswrapper[2566]: I0718 02:25:46.364322    2566 generic.go:356] "Generic (PLEG): container finished" podID="c625b686-b50b-4623-a9cc-0a6816a9e19a" containerID="45424b7ded8dc8b89659e3fa938ac5b186c063d77e07e58ccf0824071202321e" exitCode=0
Jul 18 02:25:46.364748 ip-10-0-142-238 kubenswrapper[2566]: I0718 02:25:46.364404    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-21cdac-knxhc" event={"ID":"c625b686-b50b-4623-a9cc-0a6816a9e19a","Type":"ContainerDied","Data":"45424b7ded8dc8b89659e3fa938ac5b186c063d77e07e58ccf0824071202321e"}
Jul 18 02:25:47.494178 ip-10-0-142-238 kubenswrapper[2566]: I0718 02:25:47.494156    2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-21cdac-knxhc"
Jul 18 02:25:47.550677 ip-10-0-142-238 kubenswrapper[2566]: I0718 02:25:47.550650    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/c625b686-b50b-4623-a9cc-0a6816a9e19a-maas-api-service-ca\") pod \"c625b686-b50b-4623-a9cc-0a6816a9e19a\" (UID: \"c625b686-b50b-4623-a9cc-0a6816a9e19a\") "
Jul 18 02:25:47.550973 ip-10-0-142-238 kubenswrapper[2566]: I0718 02:25:47.550952    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c625b686-b50b-4623-a9cc-0a6816a9e19a-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "c625b686-b50b-4623-a9cc-0a6816a9e19a" (UID: "c625b686-b50b-4623-a9cc-0a6816a9e19a"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 18 02:25:47.651684 ip-10-0-142-238 kubenswrapper[2566]: I0718 02:25:47.651590    2566 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/c625b686-b50b-4623-a9cc-0a6816a9e19a-maas-api-service-ca\") on node \"ip-10-0-142-238.ec2.internal\" DevicePath \"\""
Jul 18 02:25:48.375219 ip-10-0-142-238 kubenswrapper[2566]: I0718 02:25:48.375189    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-21cdac-knxhc" event={"ID":"c625b686-b50b-4623-a9cc-0a6816a9e19a","Type":"ContainerDied","Data":"82d4d694da90c5ba8df57ef5e2b5ecede9f88e6639dc5f0293e9a97aba3368a9"}
Jul 18 02:25:48.375454 ip-10-0-142-238 kubenswrapper[2566]: I0718 02:25:48.375234    2566 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="82d4d694da90c5ba8df57ef5e2b5ecede9f88e6639dc5f0293e9a97aba3368a9"
Jul 18 02:25:48.375454 ip-10-0-142-238 kubenswrapper[2566]: I0718 02:25:48.375201    2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-21cdac-knxhc"
Jul 18 02:25:49.009252 ip-10-0-142-238 kubenswrapper[2566]: I0718 02:25:49.009225    2566 scope.go:117] "RemoveContainer" containerID="c0ed9d40f1ff0832c3c7fcccfae8c28c0d494d58561e1065d0cafa29a11a5a21"
Jul 18 02:26:04.780058 ip-10-0-142-238 kubenswrapper[2566]: I0718 02:26:04.780024    2566 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-21cdac-knxhc"]
Jul 18 02:26:04.782447 ip-10-0-142-238 kubenswrapper[2566]: I0718 02:26:04.782420    2566 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-21cdac-knxhc"]
Jul 18 02:26:04.815695 ip-10-0-142-238 kubenswrapper[2566]: I0718 02:26:04.815666    2566 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c625b686-b50b-4623-a9cc-0a6816a9e19a" path="/var/lib/kubelet/pods/c625b686-b50b-4623-a9cc-0a6816a9e19a/volumes"
Jul 18 02:26:05.179583 ip-10-0-142-238 kubenswrapper[2566]: I0718 02:26:05.179518    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-lmjk9"]
Jul 18 02:26:22.786312 ip-10-0-142-238 kubenswrapper[2566]: I0718 02:26:22.786271    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-lmjk9"]
Jul 18 02:26:34.180792 ip-10-0-142-238 kubenswrapper[2566]: I0718 02:26:34.180755    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-lmjk9"]
Jul 18 02:26:40.689531 ip-10-0-142-238 kubenswrapper[2566]: I0718 02:26:40.689498    2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-a-2cb736/auth-test-model-2cb736-kserve-855788787f-gbwpx"]
Jul 18 02:26:40.690012 ip-10-0-142-238 kubenswrapper[2566]: I0718 02:26:40.689966    2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c625b686-b50b-4623-a9cc-0a6816a9e19a" containerName="revoke-keys"
Jul 18 02:26:40.690012 ip-10-0-142-238 kubenswrapper[2566]: I0718 02:26:40.689985    2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="c625b686-b50b-4623-a9cc-0a6816a9e19a" containerName="revoke-keys"
Jul 18 02:26:40.690132 ip-10-0-142-238 kubenswrapper[2566]: I0718 02:26:40.690078    2566 memory_manager.go:368] "RemoveStaleState removing state" podUID="c625b686-b50b-4623-a9cc-0a6816a9e19a" containerName="revoke-keys"
Jul 18 02:26:40.693082 ip-10-0-142-238 kubenswrapper[2566]: I0718 02:26:40.693062    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-2cb736/auth-test-model-2cb736-kserve-855788787f-gbwpx"
Jul 18 02:26:40.696337 ip-10-0-142-238 kubenswrapper[2566]: I0718 02:26:40.696315    2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-a-2cb736\"/\"openshift-service-ca.crt\""
Jul 18 02:26:40.702792 ip-10-0-142-238 kubenswrapper[2566]: I0718 02:26:40.696731    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-a-2cb736\"/\"auth-test-model-2cb736-kserve-self-signed-certs\""
Jul 18 02:26:40.702792 ip-10-0-142-238 kubenswrapper[2566]: I0718 02:26:40.697023    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-a-2cb736\"/\"default-dockercfg-nxh2s\""
Jul 18 02:26:40.702792 ip-10-0-142-238 kubenswrapper[2566]: I0718 02:26:40.697426    2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-a-2cb736\"/\"kube-root-ca.crt\""
Jul 18 02:26:40.708975 ip-10-0-142-238 kubenswrapper[2566]: I0718 02:26:40.708953    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-2cb736/auth-test-model-2cb736-kserve-855788787f-gbwpx"]
Jul 18 02:26:40.763596 ip-10-0-142-238 kubenswrapper[2566]: I0718 02:26:40.763571    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/fac2c300-348f-42c8-97fc-809d4e5fc87c-tmp-dir\") pod \"auth-test-model-2cb736-kserve-855788787f-gbwpx\" (UID: \"fac2c300-348f-42c8-97fc-809d4e5fc87c\") " pod="ai-tenant-e2e-shared-a-2cb736/auth-test-model-2cb736-kserve-855788787f-gbwpx"
Jul 18 02:26:40.763736 ip-10-0-142-238 kubenswrapper[2566]: I0718 02:26:40.763607    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/fac2c300-348f-42c8-97fc-809d4e5fc87c-dshm\") pod \"auth-test-model-2cb736-kserve-855788787f-gbwpx\" (UID: \"fac2c300-348f-42c8-97fc-809d4e5fc87c\") " pod="ai-tenant-e2e-shared-a-2cb736/auth-test-model-2cb736-kserve-855788787f-gbwpx"
Jul 18 02:26:40.763736 ip-10-0-142-238 kubenswrapper[2566]: I0718 02:26:40.763698    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/fac2c300-348f-42c8-97fc-809d4e5fc87c-model-cache\") pod \"auth-test-model-2cb736-kserve-855788787f-gbwpx\" (UID: \"fac2c300-348f-42c8-97fc-809d4e5fc87c\") " pod="ai-tenant-e2e-shared-a-2cb736/auth-test-model-2cb736-kserve-855788787f-gbwpx"
Jul 18 02:26:40.763736 ip-10-0-142-238 kubenswrapper[2566]: I0718 02:26:40.763728    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/fac2c300-348f-42c8-97fc-809d4e5fc87c-home\") pod \"auth-test-model-2cb736-kserve-855788787f-gbwpx\" (UID: \"fac2c300-348f-42c8-97fc-809d4e5fc87c\") " pod="ai-tenant-e2e-shared-a-2cb736/auth-test-model-2cb736-kserve-855788787f-gbwpx"
Jul 18 02:26:40.763853 ip-10-0-142-238 kubenswrapper[2566]: I0718 02:26:40.763779    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rdsl9\" (UniqueName: \"kubernetes.io/projected/fac2c300-348f-42c8-97fc-809d4e5fc87c-kube-api-access-rdsl9\") pod \"auth-test-model-2cb736-kserve-855788787f-gbwpx\" (UID: \"fac2c300-348f-42c8-97fc-809d4e5fc87c\") " pod="ai-tenant-e2e-shared-a-2cb736/auth-test-model-2cb736-kserve-855788787f-gbwpx"
Jul 18 02:26:40.763853 ip-10-0-142-238 kubenswrapper[2566]: I0718 02:26:40.763805    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/fac2c300-348f-42c8-97fc-809d4e5fc87c-tls-certs\") pod \"auth-test-model-2cb736-kserve-855788787f-gbwpx\" (UID: \"fac2c300-348f-42c8-97fc-809d4e5fc87c\") " pod="ai-tenant-e2e-shared-a-2cb736/auth-test-model-2cb736-kserve-855788787f-gbwpx"
Jul 18 02:26:40.864172 ip-10-0-142-238 kubenswrapper[2566]: I0718 02:26:40.864146    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/fac2c300-348f-42c8-97fc-809d4e5fc87c-tmp-dir\") pod \"auth-test-model-2cb736-kserve-855788787f-gbwpx\" (UID: \"fac2c300-348f-42c8-97fc-809d4e5fc87c\") " pod="ai-tenant-e2e-shared-a-2cb736/auth-test-model-2cb736-kserve-855788787f-gbwpx"
Jul 18 02:26:40.864308 ip-10-0-142-238 kubenswrapper[2566]: I0718 02:26:40.864184    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/fac2c300-348f-42c8-97fc-809d4e5fc87c-dshm\") pod \"auth-test-model-2cb736-kserve-855788787f-gbwpx\" (UID: \"fac2c300-348f-42c8-97fc-809d4e5fc87c\") " pod="ai-tenant-e2e-shared-a-2cb736/auth-test-model-2cb736-kserve-855788787f-gbwpx"
Jul 18 02:26:40.864308 ip-10-0-142-238 kubenswrapper[2566]: I0718 02:26:40.864203    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/fac2c300-348f-42c8-97fc-809d4e5fc87c-model-cache\") pod \"auth-test-model-2cb736-kserve-855788787f-gbwpx\" (UID: \"fac2c300-348f-42c8-97fc-809d4e5fc87c\") " pod="ai-tenant-e2e-shared-a-2cb736/auth-test-model-2cb736-kserve-855788787f-gbwpx"
Jul 18 02:26:40.864381 ip-10-0-142-238 kubenswrapper[2566]: I0718 02:26:40.864311    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/fac2c300-348f-42c8-97fc-809d4e5fc87c-home\") pod \"auth-test-model-2cb736-kserve-855788787f-gbwpx\" (UID: \"fac2c300-348f-42c8-97fc-809d4e5fc87c\") " pod="ai-tenant-e2e-shared-a-2cb736/auth-test-model-2cb736-kserve-855788787f-gbwpx"
Jul 18 02:26:40.864381 ip-10-0-142-238 kubenswrapper[2566]: I0718 02:26:40.864351    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rdsl9\" (UniqueName: \"kubernetes.io/projected/fac2c300-348f-42c8-97fc-809d4e5fc87c-kube-api-access-rdsl9\") pod \"auth-test-model-2cb736-kserve-855788787f-gbwpx\" (UID: \"fac2c300-348f-42c8-97fc-809d4e5fc87c\") " pod="ai-tenant-e2e-shared-a-2cb736/auth-test-model-2cb736-kserve-855788787f-gbwpx"
Jul 18 02:26:40.864381 ip-10-0-142-238 kubenswrapper[2566]: I0718 02:26:40.864370    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/fac2c300-348f-42c8-97fc-809d4e5fc87c-tls-certs\") pod \"auth-test-model-2cb736-kserve-855788787f-gbwpx\" (UID: \"fac2c300-348f-42c8-97fc-809d4e5fc87c\") " pod="ai-tenant-e2e-shared-a-2cb736/auth-test-model-2cb736-kserve-855788787f-gbwpx"
Jul 18 02:26:40.864598 ip-10-0-142-238 kubenswrapper[2566]: I0718 02:26:40.864573    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/fac2c300-348f-42c8-97fc-809d4e5fc87c-tmp-dir\") pod \"auth-test-model-2cb736-kserve-855788787f-gbwpx\" (UID: \"fac2c300-348f-42c8-97fc-809d4e5fc87c\") " pod="ai-tenant-e2e-shared-a-2cb736/auth-test-model-2cb736-kserve-855788787f-gbwpx"
Jul 18 02:26:40.864735 ip-10-0-142-238 kubenswrapper[2566]: I0718 02:26:40.864638    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/fac2c300-348f-42c8-97fc-809d4e5fc87c-model-cache\") pod \"auth-test-model-2cb736-kserve-855788787f-gbwpx\" (UID: \"fac2c300-348f-42c8-97fc-809d4e5fc87c\") " pod="ai-tenant-e2e-shared-a-2cb736/auth-test-model-2cb736-kserve-855788787f-gbwpx"
Jul 18 02:26:40.864783 ip-10-0-142-238 kubenswrapper[2566]: I0718 02:26:40.864756    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/fac2c300-348f-42c8-97fc-809d4e5fc87c-home\") pod \"auth-test-model-2cb736-kserve-855788787f-gbwpx\" (UID: \"fac2c300-348f-42c8-97fc-809d4e5fc87c\") " pod="ai-tenant-e2e-shared-a-2cb736/auth-test-model-2cb736-kserve-855788787f-gbwpx"
Jul 18 02:26:40.866454 ip-10-0-142-238 kubenswrapper[2566]: I0718 02:26:40.866434    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/fac2c300-348f-42c8-97fc-809d4e5fc87c-dshm\") pod \"auth-test-model-2cb736-kserve-855788787f-gbwpx\" (UID: \"fac2c300-348f-42c8-97fc-809d4e5fc87c\") " pod="ai-tenant-e2e-shared-a-2cb736/auth-test-model-2cb736-kserve-855788787f-gbwpx"
Jul 18 02:26:40.866660 ip-10-0-142-238 kubenswrapper[2566]: I0718 02:26:40.866644    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/fac2c300-348f-42c8-97fc-809d4e5fc87c-tls-certs\") pod \"auth-test-model-2cb736-kserve-855788787f-gbwpx\" (UID: \"fac2c300-348f-42c8-97fc-809d4e5fc87c\") " pod="ai-tenant-e2e-shared-a-2cb736/auth-test-model-2cb736-kserve-855788787f-gbwpx"
Jul 18 02:26:40.871933 ip-10-0-142-238 kubenswrapper[2566]: I0718 02:26:40.871916    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rdsl9\" (UniqueName: \"kubernetes.io/projected/fac2c300-348f-42c8-97fc-809d4e5fc87c-kube-api-access-rdsl9\") pod \"auth-test-model-2cb736-kserve-855788787f-gbwpx\" (UID: \"fac2c300-348f-42c8-97fc-809d4e5fc87c\") " pod="ai-tenant-e2e-shared-a-2cb736/auth-test-model-2cb736-kserve-855788787f-gbwpx"
Jul 18 02:26:41.008817 ip-10-0-142-238 kubenswrapper[2566]: I0718 02:26:41.008740    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-2cb736/auth-test-model-2cb736-kserve-855788787f-gbwpx"
Jul 18 02:26:41.137082 ip-10-0-142-238 kubenswrapper[2566]: I0718 02:26:41.137056    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-2cb736/auth-test-model-2cb736-kserve-855788787f-gbwpx"]
Jul 18 02:26:41.139041 ip-10-0-142-238 kubenswrapper[2566]: W0718 02:26:41.139010    2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podfac2c300_348f_42c8_97fc_809d4e5fc87c.slice/crio-972b04e0c073a4d2564c3ba68113fc076048998fe8655ebfc924e87b44ae8a28 WatchSource:0}: Error finding container 972b04e0c073a4d2564c3ba68113fc076048998fe8655ebfc924e87b44ae8a28: Status 404 returned error can't find the container with id 972b04e0c073a4d2564c3ba68113fc076048998fe8655ebfc924e87b44ae8a28
Jul 18 02:26:41.639366 ip-10-0-142-238 kubenswrapper[2566]: I0718 02:26:41.639290    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-2cb736/auth-test-model-2cb736-kserve-855788787f-gbwpx" event={"ID":"fac2c300-348f-42c8-97fc-809d4e5fc87c","Type":"ContainerStarted","Data":"19700dc6645003eae001553106454e9b3d442a99c519e9a8d6dc6aad6f1230fb"}
Jul 18 02:26:41.639366 ip-10-0-142-238 kubenswrapper[2566]: I0718 02:26:41.639336    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-2cb736/auth-test-model-2cb736-kserve-855788787f-gbwpx" event={"ID":"fac2c300-348f-42c8-97fc-809d4e5fc87c","Type":"ContainerStarted","Data":"972b04e0c073a4d2564c3ba68113fc076048998fe8655ebfc924e87b44ae8a28"}
Jul 18 02:26:41.659463 ip-10-0-142-238 kubenswrapper[2566]: I0718 02:26:41.659421    2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-a-2cb736/auth-test-model-2cb736-kserve-855788787f-gbwpx" podStartSLOduration=1.65940789 podStartE2EDuration="1.65940789s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-18 02:26:40 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-18 02:26:41.656919728 +0000 UTC m=+2333.345647188" watchObservedRunningTime="2026-07-18 02:26:41.65940789 +0000 UTC m=+2333.348135365"
Jul 18 02:26:45.590125 ip-10-0-142-238 kubenswrapper[2566]: I0718 02:26:45.590088    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-lmjk9"]
Jul 18 02:26:51.009189 ip-10-0-142-238 kubenswrapper[2566]: I0718 02:26:51.009156    2566 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-a-2cb736/auth-test-model-2cb736-kserve-855788787f-gbwpx"
Jul 18 02:26:51.009565 ip-10-0-142-238 kubenswrapper[2566]: I0718 02:26:51.009200    2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-a-2cb736/auth-test-model-2cb736-kserve-855788787f-gbwpx"
Jul 18 02:26:51.021687 ip-10-0-142-238 kubenswrapper[2566]: I0718 02:26:51.021656    2566 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-a-2cb736/auth-test-model-2cb736-kserve-855788787f-gbwpx"
Jul 18 02:26:51.701261 ip-10-0-142-238 kubenswrapper[2566]: I0718 02:26:51.701232    2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-a-2cb736/auth-test-model-2cb736-kserve-855788787f-gbwpx"
Jul 18 02:27:25.388326 ip-10-0-142-238 kubenswrapper[2566]: I0718 02:27:25.388289    2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-b-16c040/auth-test-model-16c040-kserve-9857b867f-75gws"]
Jul 18 02:27:25.391826 ip-10-0-142-238 kubenswrapper[2566]: I0718 02:27:25.391808    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-16c040/auth-test-model-16c040-kserve-9857b867f-75gws"
Jul 18 02:27:25.394964 ip-10-0-142-238 kubenswrapper[2566]: I0718 02:27:25.394933    2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-16c040\"/\"openshift-service-ca.crt\""
Jul 18 02:27:25.394964 ip-10-0-142-238 kubenswrapper[2566]: I0718 02:27:25.394955    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-16c040\"/\"default-dockercfg-drv94\""
Jul 18 02:27:25.395127 ip-10-0-142-238 kubenswrapper[2566]: I0718 02:27:25.394955    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-16c040\"/\"auth-test-model-16c040-kserve-self-signed-certs\""
Jul 18 02:27:25.395127 ip-10-0-142-238 kubenswrapper[2566]: I0718 02:27:25.395014    2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-16c040\"/\"kube-root-ca.crt\""
Jul 18 02:27:25.398941 ip-10-0-142-238 kubenswrapper[2566]: I0718 02:27:25.398603    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-16c040/auth-test-model-16c040-kserve-9857b867f-75gws"]
Jul 18 02:27:25.514120 ip-10-0-142-238 kubenswrapper[2566]: I0718 02:27:25.514098    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/3e2ac82c-cbf4-45e5-accc-428653e5d6ab-tmp-dir\") pod \"auth-test-model-16c040-kserve-9857b867f-75gws\" (UID: \"3e2ac82c-cbf4-45e5-accc-428653e5d6ab\") " pod="ai-tenant-e2e-shared-b-16c040/auth-test-model-16c040-kserve-9857b867f-75gws"
Jul 18 02:27:25.514251 ip-10-0-142-238 kubenswrapper[2566]: I0718 02:27:25.514125    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lvq87\" (UniqueName: \"kubernetes.io/projected/3e2ac82c-cbf4-45e5-accc-428653e5d6ab-kube-api-access-lvq87\") pod \"auth-test-model-16c040-kserve-9857b867f-75gws\" (UID: \"3e2ac82c-cbf4-45e5-accc-428653e5d6ab\") " pod="ai-tenant-e2e-shared-b-16c040/auth-test-model-16c040-kserve-9857b867f-75gws"
Jul 18 02:27:25.514251 ip-10-0-142-238 kubenswrapper[2566]: I0718 02:27:25.514149    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/3e2ac82c-cbf4-45e5-accc-428653e5d6ab-home\") pod \"auth-test-model-16c040-kserve-9857b867f-75gws\" (UID: \"3e2ac82c-cbf4-45e5-accc-428653e5d6ab\") " pod="ai-tenant-e2e-shared-b-16c040/auth-test-model-16c040-kserve-9857b867f-75gws"
Jul 18 02:27:25.514251 ip-10-0-142-238 kubenswrapper[2566]: I0718 02:27:25.514167    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/3e2ac82c-cbf4-45e5-accc-428653e5d6ab-tls-certs\") pod \"auth-test-model-16c040-kserve-9857b867f-75gws\" (UID: \"3e2ac82c-cbf4-45e5-accc-428653e5d6ab\") " pod="ai-tenant-e2e-shared-b-16c040/auth-test-model-16c040-kserve-9857b867f-75gws"
Jul 18 02:27:25.514251 ip-10-0-142-238 kubenswrapper[2566]: I0718 02:27:25.514237    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/3e2ac82c-cbf4-45e5-accc-428653e5d6ab-model-cache\") pod \"auth-test-model-16c040-kserve-9857b867f-75gws\" (UID: \"3e2ac82c-cbf4-45e5-accc-428653e5d6ab\") " pod="ai-tenant-e2e-shared-b-16c040/auth-test-model-16c040-kserve-9857b867f-75gws"
Jul 18 02:27:25.514402 ip-10-0-142-238 kubenswrapper[2566]: I0718 02:27:25.514294    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/3e2ac82c-cbf4-45e5-accc-428653e5d6ab-dshm\") pod \"auth-test-model-16c040-kserve-9857b867f-75gws\" (UID: \"3e2ac82c-cbf4-45e5-accc-428653e5d6ab\") " pod="ai-tenant-e2e-shared-b-16c040/auth-test-model-16c040-kserve-9857b867f-75gws"
Jul 18 02:27:25.615076 ip-10-0-142-238 kubenswrapper[2566]: I0718 02:27:25.615048    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/3e2ac82c-cbf4-45e5-accc-428653e5d6ab-tmp-dir\") pod \"auth-test-model-16c040-kserve-9857b867f-75gws\" (UID: \"3e2ac82c-cbf4-45e5-accc-428653e5d6ab\") " pod="ai-tenant-e2e-shared-b-16c040/auth-test-model-16c040-kserve-9857b867f-75gws"
Jul 18 02:27:25.615192 ip-10-0-142-238 kubenswrapper[2566]: I0718 02:27:25.615079    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lvq87\" (UniqueName: \"kubernetes.io/projected/3e2ac82c-cbf4-45e5-accc-428653e5d6ab-kube-api-access-lvq87\") pod \"auth-test-model-16c040-kserve-9857b867f-75gws\" (UID: \"3e2ac82c-cbf4-45e5-accc-428653e5d6ab\") " pod="ai-tenant-e2e-shared-b-16c040/auth-test-model-16c040-kserve-9857b867f-75gws"
Jul 18 02:27:25.615192 ip-10-0-142-238 kubenswrapper[2566]: I0718 02:27:25.615103    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/3e2ac82c-cbf4-45e5-accc-428653e5d6ab-home\") pod \"auth-test-model-16c040-kserve-9857b867f-75gws\" (UID: \"3e2ac82c-cbf4-45e5-accc-428653e5d6ab\") " pod="ai-tenant-e2e-shared-b-16c040/auth-test-model-16c040-kserve-9857b867f-75gws"
Jul 18 02:27:25.615469 ip-10-0-142-238 kubenswrapper[2566]: I0718 02:27:25.615225    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/3e2ac82c-cbf4-45e5-accc-428653e5d6ab-tls-certs\") pod \"auth-test-model-16c040-kserve-9857b867f-75gws\" (UID: \"3e2ac82c-cbf4-45e5-accc-428653e5d6ab\") " pod="ai-tenant-e2e-shared-b-16c040/auth-test-model-16c040-kserve-9857b867f-75gws"
Jul 18 02:27:25.615469 ip-10-0-142-238 kubenswrapper[2566]: I0718 02:27:25.615260    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/3e2ac82c-cbf4-45e5-accc-428653e5d6ab-model-cache\") pod \"auth-test-model-16c040-kserve-9857b867f-75gws\" (UID: \"3e2ac82c-cbf4-45e5-accc-428653e5d6ab\") " pod="ai-tenant-e2e-shared-b-16c040/auth-test-model-16c040-kserve-9857b867f-75gws"
Jul 18 02:27:25.615469 ip-10-0-142-238 kubenswrapper[2566]: I0718 02:27:25.615318    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/3e2ac82c-cbf4-45e5-accc-428653e5d6ab-dshm\") pod \"auth-test-model-16c040-kserve-9857b867f-75gws\" (UID: \"3e2ac82c-cbf4-45e5-accc-428653e5d6ab\") " pod="ai-tenant-e2e-shared-b-16c040/auth-test-model-16c040-kserve-9857b867f-75gws"
Jul 18 02:27:25.615469 ip-10-0-142-238 kubenswrapper[2566]: I0718 02:27:25.615415    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/3e2ac82c-cbf4-45e5-accc-428653e5d6ab-home\") pod \"auth-test-model-16c040-kserve-9857b867f-75gws\" (UID: \"3e2ac82c-cbf4-45e5-accc-428653e5d6ab\") " pod="ai-tenant-e2e-shared-b-16c040/auth-test-model-16c040-kserve-9857b867f-75gws"
Jul 18 02:27:25.615701 ip-10-0-142-238 kubenswrapper[2566]: I0718 02:27:25.615466    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/3e2ac82c-cbf4-45e5-accc-428653e5d6ab-tmp-dir\") pod \"auth-test-model-16c040-kserve-9857b867f-75gws\" (UID: \"3e2ac82c-cbf4-45e5-accc-428653e5d6ab\") " pod="ai-tenant-e2e-shared-b-16c040/auth-test-model-16c040-kserve-9857b867f-75gws"
Jul 18 02:27:25.615701 ip-10-0-142-238 kubenswrapper[2566]: I0718 02:27:25.615541    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/3e2ac82c-cbf4-45e5-accc-428653e5d6ab-model-cache\") pod \"auth-test-model-16c040-kserve-9857b867f-75gws\" (UID: \"3e2ac82c-cbf4-45e5-accc-428653e5d6ab\") " pod="ai-tenant-e2e-shared-b-16c040/auth-test-model-16c040-kserve-9857b867f-75gws"
Jul 18 02:27:25.617428 ip-10-0-142-238 kubenswrapper[2566]: I0718 02:27:25.617407    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/3e2ac82c-cbf4-45e5-accc-428653e5d6ab-dshm\") pod \"auth-test-model-16c040-kserve-9857b867f-75gws\" (UID: \"3e2ac82c-cbf4-45e5-accc-428653e5d6ab\") " pod="ai-tenant-e2e-shared-b-16c040/auth-test-model-16c040-kserve-9857b867f-75gws"
Jul 18 02:27:25.617732 ip-10-0-142-238 kubenswrapper[2566]: I0718 02:27:25.617715    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/3e2ac82c-cbf4-45e5-accc-428653e5d6ab-tls-certs\") pod \"auth-test-model-16c040-kserve-9857b867f-75gws\" (UID: \"3e2ac82c-cbf4-45e5-accc-428653e5d6ab\") " pod="ai-tenant-e2e-shared-b-16c040/auth-test-model-16c040-kserve-9857b867f-75gws"
Jul 18 02:27:25.622926 ip-10-0-142-238 kubenswrapper[2566]: I0718 02:27:25.622908    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lvq87\" (UniqueName: \"kubernetes.io/projected/3e2ac82c-cbf4-45e5-accc-428653e5d6ab-kube-api-access-lvq87\") pod \"auth-test-model-16c040-kserve-9857b867f-75gws\" (UID: \"3e2ac82c-cbf4-45e5-accc-428653e5d6ab\") " pod="ai-tenant-e2e-shared-b-16c040/auth-test-model-16c040-kserve-9857b867f-75gws"
Jul 18 02:27:25.702010 ip-10-0-142-238 kubenswrapper[2566]: I0718 02:27:25.701955    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-16c040/auth-test-model-16c040-kserve-9857b867f-75gws"
Jul 18 02:27:25.830837 ip-10-0-142-238 kubenswrapper[2566]: I0718 02:27:25.830802    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-16c040/auth-test-model-16c040-kserve-9857b867f-75gws"]
Jul 18 02:27:25.833143 ip-10-0-142-238 kubenswrapper[2566]: W0718 02:27:25.833116    2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod3e2ac82c_cbf4_45e5_accc_428653e5d6ab.slice/crio-a87d3e3d8f770c12da322af69d656bf6e23e2563f5ef8394b59d9266267312eb WatchSource:0}: Error finding container a87d3e3d8f770c12da322af69d656bf6e23e2563f5ef8394b59d9266267312eb: Status 404 returned error can't find the container with id a87d3e3d8f770c12da322af69d656bf6e23e2563f5ef8394b59d9266267312eb
Jul 18 02:27:25.852346 ip-10-0-142-238 kubenswrapper[2566]: I0718 02:27:25.852321    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-16c040/auth-test-model-16c040-kserve-9857b867f-75gws" event={"ID":"3e2ac82c-cbf4-45e5-accc-428653e5d6ab","Type":"ContainerStarted","Data":"a87d3e3d8f770c12da322af69d656bf6e23e2563f5ef8394b59d9266267312eb"}
Jul 18 02:27:26.859018 ip-10-0-142-238 kubenswrapper[2566]: I0718 02:27:26.858977    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-16c040/auth-test-model-16c040-kserve-9857b867f-75gws" event={"ID":"3e2ac82c-cbf4-45e5-accc-428653e5d6ab","Type":"ContainerStarted","Data":"87c128d84ba846adb765bd483560731982ffb62529e58f56ef25683fb3b16e3d"}
Jul 18 02:27:26.875680 ip-10-0-142-238 kubenswrapper[2566]: I0718 02:27:26.875633    2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-b-16c040/auth-test-model-16c040-kserve-9857b867f-75gws" podStartSLOduration=1.875600865 podStartE2EDuration="1.875600865s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-18 02:27:25 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-18 02:27:26.874340927 +0000 UTC m=+2378.563068373" watchObservedRunningTime="2026-07-18 02:27:26.875600865 +0000 UTC m=+2378.564328308"
Jul 18 02:27:29.183268 ip-10-0-142-238 kubenswrapper[2566]: I0718 02:27:29.183237    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-lmjk9"]
Jul 18 02:27:35.702576 ip-10-0-142-238 kubenswrapper[2566]: I0718 02:27:35.702545    2566 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-b-16c040/auth-test-model-16c040-kserve-9857b867f-75gws"
Jul 18 02:27:35.702576 ip-10-0-142-238 kubenswrapper[2566]: I0718 02:27:35.702583    2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-b-16c040/auth-test-model-16c040-kserve-9857b867f-75gws"
Jul 18 02:27:35.714518 ip-10-0-142-238 kubenswrapper[2566]: I0718 02:27:35.714497    2566 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-b-16c040/auth-test-model-16c040-kserve-9857b867f-75gws"
Jul 18 02:27:35.914355 ip-10-0-142-238 kubenswrapper[2566]: I0718 02:27:35.914326    2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-b-16c040/auth-test-model-16c040-kserve-9857b867f-75gws"
Jul 18 02:27:44.882751 ip-10-0-142-238 kubenswrapper[2566]: I0718 02:27:44.882719    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-lmjk9"]
Jul 18 02:27:49.037135 ip-10-0-142-238 kubenswrapper[2566]: I0718 02:27:49.037103    2566 scope.go:117] "RemoveContainer" containerID="d8c9a1d80171e08df3b2c394caabc47c87bd571ff7474403a6e636f2d08ecc58"
Jul 18 02:28:04.478337 ip-10-0-142-238 kubenswrapper[2566]: I0718 02:28:04.478300    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-lmjk9"]
Jul 18 02:28:21.790088 ip-10-0-142-238 kubenswrapper[2566]: I0718 02:28:21.790052    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-lmjk9"]
Jul 18 02:28:36.081900 ip-10-0-142-238 kubenswrapper[2566]: I0718 02:28:36.081856    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-lmjk9"]
Jul 18 02:28:52.777271 ip-10-0-142-238 kubenswrapper[2566]: I0718 02:28:52.777234    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-lmjk9"]
Jul 18 02:29:07.596221 ip-10-0-142-238 kubenswrapper[2566]: I0718 02:29:07.596183    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-lmjk9"]
Jul 18 02:29:25.082111 ip-10-0-142-238 kubenswrapper[2566]: I0718 02:29:25.082073    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-lmjk9"]
Jul 18 02:29:35.853476 ip-10-0-142-238 kubenswrapper[2566]: I0718 02:29:35.853430    2566 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-2cb736/auth-test-model-2cb736-kserve-855788787f-gbwpx"]
Jul 18 02:29:36.789661 ip-10-0-142-238 kubenswrapper[2566]: I0718 02:29:36.789630    2566 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-16c040/auth-test-model-16c040-kserve-9857b867f-75gws"]
Jul 18 02:29:39.779812 ip-10-0-142-238 kubenswrapper[2566]: I0718 02:29:39.779778    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-lmjk9"]
Jul 18 02:29:50.872371 ip-10-0-142-238 kubenswrapper[2566]: I0718 02:29:50.872330    2566 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-shared-a-2cb736/auth-test-model-2cb736-kserve-855788787f-gbwpx" podUID="fac2c300-348f-42c8-97fc-809d4e5fc87c" containerName="main" containerID="cri-o://19700dc6645003eae001553106454e9b3d442a99c519e9a8d6dc6aad6f1230fb" gracePeriod=45
Jul 18 02:29:51.113044 ip-10-0-142-238 kubenswrapper[2566]: I0718 02:29:51.113019    2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-2cb736/auth-test-model-2cb736-kserve-855788787f-gbwpx"
Jul 18 02:29:51.178158 ip-10-0-142-238 kubenswrapper[2566]: I0718 02:29:51.178080    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/fac2c300-348f-42c8-97fc-809d4e5fc87c-model-cache\") pod \"fac2c300-348f-42c8-97fc-809d4e5fc87c\" (UID: \"fac2c300-348f-42c8-97fc-809d4e5fc87c\") "
Jul 18 02:29:51.178158 ip-10-0-142-238 kubenswrapper[2566]: I0718 02:29:51.178118    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/fac2c300-348f-42c8-97fc-809d4e5fc87c-tmp-dir\") pod \"fac2c300-348f-42c8-97fc-809d4e5fc87c\" (UID: \"fac2c300-348f-42c8-97fc-809d4e5fc87c\") "
Jul 18 02:29:51.178158 ip-10-0-142-238 kubenswrapper[2566]: I0718 02:29:51.178141    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/fac2c300-348f-42c8-97fc-809d4e5fc87c-tls-certs\") pod \"fac2c300-348f-42c8-97fc-809d4e5fc87c\" (UID: \"fac2c300-348f-42c8-97fc-809d4e5fc87c\") "
Jul 18 02:29:51.178399 ip-10-0-142-238 kubenswrapper[2566]: I0718 02:29:51.178200    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/fac2c300-348f-42c8-97fc-809d4e5fc87c-dshm\") pod \"fac2c300-348f-42c8-97fc-809d4e5fc87c\" (UID: \"fac2c300-348f-42c8-97fc-809d4e5fc87c\") "
Jul 18 02:29:51.178399 ip-10-0-142-238 kubenswrapper[2566]: I0718 02:29:51.178239    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-rdsl9\" (UniqueName: \"kubernetes.io/projected/fac2c300-348f-42c8-97fc-809d4e5fc87c-kube-api-access-rdsl9\") pod \"fac2c300-348f-42c8-97fc-809d4e5fc87c\" (UID: \"fac2c300-348f-42c8-97fc-809d4e5fc87c\") "
Jul 18 02:29:51.178399 ip-10-0-142-238 kubenswrapper[2566]: I0718 02:29:51.178277    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/fac2c300-348f-42c8-97fc-809d4e5fc87c-home\") pod \"fac2c300-348f-42c8-97fc-809d4e5fc87c\" (UID: \"fac2c300-348f-42c8-97fc-809d4e5fc87c\") "
Jul 18 02:29:51.178399 ip-10-0-142-238 kubenswrapper[2566]: I0718 02:29:51.178327    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/fac2c300-348f-42c8-97fc-809d4e5fc87c-model-cache" (OuterVolumeSpecName: "model-cache") pod "fac2c300-348f-42c8-97fc-809d4e5fc87c" (UID: "fac2c300-348f-42c8-97fc-809d4e5fc87c"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 18 02:29:51.178399 ip-10-0-142-238 kubenswrapper[2566]: I0718 02:29:51.178354    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/fac2c300-348f-42c8-97fc-809d4e5fc87c-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "fac2c300-348f-42c8-97fc-809d4e5fc87c" (UID: "fac2c300-348f-42c8-97fc-809d4e5fc87c"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 18 02:29:51.178672 ip-10-0-142-238 kubenswrapper[2566]: I0718 02:29:51.178549    2566 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/fac2c300-348f-42c8-97fc-809d4e5fc87c-model-cache\") on node \"ip-10-0-142-238.ec2.internal\" DevicePath \"\""
Jul 18 02:29:51.178672 ip-10-0-142-238 kubenswrapper[2566]: I0718 02:29:51.178559    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/fac2c300-348f-42c8-97fc-809d4e5fc87c-home" (OuterVolumeSpecName: "home") pod "fac2c300-348f-42c8-97fc-809d4e5fc87c" (UID: "fac2c300-348f-42c8-97fc-809d4e5fc87c"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 18 02:29:51.178672 ip-10-0-142-238 kubenswrapper[2566]: I0718 02:29:51.178567    2566 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/fac2c300-348f-42c8-97fc-809d4e5fc87c-tmp-dir\") on node \"ip-10-0-142-238.ec2.internal\" DevicePath \"\""
Jul 18 02:29:51.180415 ip-10-0-142-238 kubenswrapper[2566]: I0718 02:29:51.180389    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/fac2c300-348f-42c8-97fc-809d4e5fc87c-dshm" (OuterVolumeSpecName: "dshm") pod "fac2c300-348f-42c8-97fc-809d4e5fc87c" (UID: "fac2c300-348f-42c8-97fc-809d4e5fc87c"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 18 02:29:51.180415 ip-10-0-142-238 kubenswrapper[2566]: I0718 02:29:51.180397    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/fac2c300-348f-42c8-97fc-809d4e5fc87c-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "fac2c300-348f-42c8-97fc-809d4e5fc87c" (UID: "fac2c300-348f-42c8-97fc-809d4e5fc87c"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 18 02:29:51.180581 ip-10-0-142-238 kubenswrapper[2566]: I0718 02:29:51.180498    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/fac2c300-348f-42c8-97fc-809d4e5fc87c-kube-api-access-rdsl9" (OuterVolumeSpecName: "kube-api-access-rdsl9") pod "fac2c300-348f-42c8-97fc-809d4e5fc87c" (UID: "fac2c300-348f-42c8-97fc-809d4e5fc87c"). InnerVolumeSpecName "kube-api-access-rdsl9". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 18 02:29:51.279066 ip-10-0-142-238 kubenswrapper[2566]: I0718 02:29:51.279039    2566 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/fac2c300-348f-42c8-97fc-809d4e5fc87c-tls-certs\") on node \"ip-10-0-142-238.ec2.internal\" DevicePath \"\""
Jul 18 02:29:51.279066 ip-10-0-142-238 kubenswrapper[2566]: I0718 02:29:51.279061    2566 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/fac2c300-348f-42c8-97fc-809d4e5fc87c-dshm\") on node \"ip-10-0-142-238.ec2.internal\" DevicePath \"\""
Jul 18 02:29:51.279066 ip-10-0-142-238 kubenswrapper[2566]: I0718 02:29:51.279070    2566 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-rdsl9\" (UniqueName: \"kubernetes.io/projected/fac2c300-348f-42c8-97fc-809d4e5fc87c-kube-api-access-rdsl9\") on node \"ip-10-0-142-238.ec2.internal\" DevicePath \"\""
Jul 18 02:29:51.279259 ip-10-0-142-238 kubenswrapper[2566]: I0718 02:29:51.279079    2566 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/fac2c300-348f-42c8-97fc-809d4e5fc87c-home\") on node \"ip-10-0-142-238.ec2.internal\" DevicePath \"\""
Jul 18 02:29:51.557309 ip-10-0-142-238 kubenswrapper[2566]: I0718 02:29:51.557273    2566 generic.go:356] "Generic (PLEG): container finished" podID="fac2c300-348f-42c8-97fc-809d4e5fc87c" containerID="19700dc6645003eae001553106454e9b3d442a99c519e9a8d6dc6aad6f1230fb" exitCode=0
Jul 18 02:29:51.557488 ip-10-0-142-238 kubenswrapper[2566]: I0718 02:29:51.557317    2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-2cb736/auth-test-model-2cb736-kserve-855788787f-gbwpx"
Jul 18 02:29:51.557488 ip-10-0-142-238 kubenswrapper[2566]: I0718 02:29:51.557349    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-2cb736/auth-test-model-2cb736-kserve-855788787f-gbwpx" event={"ID":"fac2c300-348f-42c8-97fc-809d4e5fc87c","Type":"ContainerDied","Data":"19700dc6645003eae001553106454e9b3d442a99c519e9a8d6dc6aad6f1230fb"}
Jul 18 02:29:51.557488 ip-10-0-142-238 kubenswrapper[2566]: I0718 02:29:51.557392    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-2cb736/auth-test-model-2cb736-kserve-855788787f-gbwpx" event={"ID":"fac2c300-348f-42c8-97fc-809d4e5fc87c","Type":"ContainerDied","Data":"972b04e0c073a4d2564c3ba68113fc076048998fe8655ebfc924e87b44ae8a28"}
Jul 18 02:29:51.557488 ip-10-0-142-238 kubenswrapper[2566]: I0718 02:29:51.557410    2566 scope.go:117] "RemoveContainer" containerID="19700dc6645003eae001553106454e9b3d442a99c519e9a8d6dc6aad6f1230fb"
Jul 18 02:29:51.566234 ip-10-0-142-238 kubenswrapper[2566]: I0718 02:29:51.566217    2566 scope.go:117] "RemoveContainer" containerID="19700dc6645003eae001553106454e9b3d442a99c519e9a8d6dc6aad6f1230fb"
Jul 18 02:29:51.566471 ip-10-0-142-238 kubenswrapper[2566]: E0718 02:29:51.566452    2566 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"19700dc6645003eae001553106454e9b3d442a99c519e9a8d6dc6aad6f1230fb\": container with ID starting with 19700dc6645003eae001553106454e9b3d442a99c519e9a8d6dc6aad6f1230fb not found: ID does not exist" containerID="19700dc6645003eae001553106454e9b3d442a99c519e9a8d6dc6aad6f1230fb"
Jul 18 02:29:51.566524 ip-10-0-142-238 kubenswrapper[2566]: I0718 02:29:51.566480    2566 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"19700dc6645003eae001553106454e9b3d442a99c519e9a8d6dc6aad6f1230fb"} err="failed to get container status \"19700dc6645003eae001553106454e9b3d442a99c519e9a8d6dc6aad6f1230fb\": rpc error: code = NotFound desc = could not find container \"19700dc6645003eae001553106454e9b3d442a99c519e9a8d6dc6aad6f1230fb\": container with ID starting with 19700dc6645003eae001553106454e9b3d442a99c519e9a8d6dc6aad6f1230fb not found: ID does not exist"
Jul 18 02:29:51.578291 ip-10-0-142-238 kubenswrapper[2566]: I0718 02:29:51.578269    2566 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-2cb736/auth-test-model-2cb736-kserve-855788787f-gbwpx"]
Jul 18 02:29:51.581891 ip-10-0-142-238 kubenswrapper[2566]: I0718 02:29:51.581872    2566 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-a-2cb736/auth-test-model-2cb736-kserve-855788787f-gbwpx"]
Jul 18 02:29:51.809538 ip-10-0-142-238 kubenswrapper[2566]: I0718 02:29:51.809449    2566 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-shared-b-16c040/auth-test-model-16c040-kserve-9857b867f-75gws" podUID="3e2ac82c-cbf4-45e5-accc-428653e5d6ab" containerName="main" containerID="cri-o://87c128d84ba846adb765bd483560731982ffb62529e58f56ef25683fb3b16e3d" gracePeriod=45
Jul 18 02:29:52.064923 ip-10-0-142-238 kubenswrapper[2566]: I0718 02:29:52.064861    2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-16c040/auth-test-model-16c040-kserve-9857b867f-75gws"
Jul 18 02:29:52.083771 ip-10-0-142-238 kubenswrapper[2566]: I0718 02:29:52.083746    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/3e2ac82c-cbf4-45e5-accc-428653e5d6ab-tmp-dir\") pod \"3e2ac82c-cbf4-45e5-accc-428653e5d6ab\" (UID: \"3e2ac82c-cbf4-45e5-accc-428653e5d6ab\") "
Jul 18 02:29:52.083920 ip-10-0-142-238 kubenswrapper[2566]: I0718 02:29:52.083795    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/3e2ac82c-cbf4-45e5-accc-428653e5d6ab-home\") pod \"3e2ac82c-cbf4-45e5-accc-428653e5d6ab\" (UID: \"3e2ac82c-cbf4-45e5-accc-428653e5d6ab\") "
Jul 18 02:29:52.083920 ip-10-0-142-238 kubenswrapper[2566]: I0718 02:29:52.083814    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-lvq87\" (UniqueName: \"kubernetes.io/projected/3e2ac82c-cbf4-45e5-accc-428653e5d6ab-kube-api-access-lvq87\") pod \"3e2ac82c-cbf4-45e5-accc-428653e5d6ab\" (UID: \"3e2ac82c-cbf4-45e5-accc-428653e5d6ab\") "
Jul 18 02:29:52.083920 ip-10-0-142-238 kubenswrapper[2566]: I0718 02:29:52.083881    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/3e2ac82c-cbf4-45e5-accc-428653e5d6ab-tls-certs\") pod \"3e2ac82c-cbf4-45e5-accc-428653e5d6ab\" (UID: \"3e2ac82c-cbf4-45e5-accc-428653e5d6ab\") "
Jul 18 02:29:52.083920 ip-10-0-142-238 kubenswrapper[2566]: I0718 02:29:52.083902    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/3e2ac82c-cbf4-45e5-accc-428653e5d6ab-model-cache\") pod \"3e2ac82c-cbf4-45e5-accc-428653e5d6ab\" (UID: \"3e2ac82c-cbf4-45e5-accc-428653e5d6ab\") "
Jul 18 02:29:52.084152 ip-10-0-142-238 kubenswrapper[2566]: I0718 02:29:52.083950    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/3e2ac82c-cbf4-45e5-accc-428653e5d6ab-dshm\") pod \"3e2ac82c-cbf4-45e5-accc-428653e5d6ab\" (UID: \"3e2ac82c-cbf4-45e5-accc-428653e5d6ab\") "
Jul 18 02:29:52.084152 ip-10-0-142-238 kubenswrapper[2566]: I0718 02:29:52.084013    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3e2ac82c-cbf4-45e5-accc-428653e5d6ab-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "3e2ac82c-cbf4-45e5-accc-428653e5d6ab" (UID: "3e2ac82c-cbf4-45e5-accc-428653e5d6ab"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 18 02:29:52.084152 ip-10-0-142-238 kubenswrapper[2566]: I0718 02:29:52.084087    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3e2ac82c-cbf4-45e5-accc-428653e5d6ab-home" (OuterVolumeSpecName: "home") pod "3e2ac82c-cbf4-45e5-accc-428653e5d6ab" (UID: "3e2ac82c-cbf4-45e5-accc-428653e5d6ab"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 18 02:29:52.084308 ip-10-0-142-238 kubenswrapper[2566]: I0718 02:29:52.084218    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3e2ac82c-cbf4-45e5-accc-428653e5d6ab-model-cache" (OuterVolumeSpecName: "model-cache") pod "3e2ac82c-cbf4-45e5-accc-428653e5d6ab" (UID: "3e2ac82c-cbf4-45e5-accc-428653e5d6ab"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 18 02:29:52.084308 ip-10-0-142-238 kubenswrapper[2566]: I0718 02:29:52.084234    2566 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/3e2ac82c-cbf4-45e5-accc-428653e5d6ab-tmp-dir\") on node \"ip-10-0-142-238.ec2.internal\" DevicePath \"\""
Jul 18 02:29:52.084308 ip-10-0-142-238 kubenswrapper[2566]: I0718 02:29:52.084254    2566 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/3e2ac82c-cbf4-45e5-accc-428653e5d6ab-home\") on node \"ip-10-0-142-238.ec2.internal\" DevicePath \"\""
Jul 18 02:29:52.086591 ip-10-0-142-238 kubenswrapper[2566]: I0718 02:29:52.086559    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3e2ac82c-cbf4-45e5-accc-428653e5d6ab-dshm" (OuterVolumeSpecName: "dshm") pod "3e2ac82c-cbf4-45e5-accc-428653e5d6ab" (UID: "3e2ac82c-cbf4-45e5-accc-428653e5d6ab"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 18 02:29:52.086721 ip-10-0-142-238 kubenswrapper[2566]: I0718 02:29:52.086632    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3e2ac82c-cbf4-45e5-accc-428653e5d6ab-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "3e2ac82c-cbf4-45e5-accc-428653e5d6ab" (UID: "3e2ac82c-cbf4-45e5-accc-428653e5d6ab"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 18 02:29:52.086795 ip-10-0-142-238 kubenswrapper[2566]: I0718 02:29:52.086741    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3e2ac82c-cbf4-45e5-accc-428653e5d6ab-kube-api-access-lvq87" (OuterVolumeSpecName: "kube-api-access-lvq87") pod "3e2ac82c-cbf4-45e5-accc-428653e5d6ab" (UID: "3e2ac82c-cbf4-45e5-accc-428653e5d6ab"). InnerVolumeSpecName "kube-api-access-lvq87". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 18 02:29:52.185032 ip-10-0-142-238 kubenswrapper[2566]: I0718 02:29:52.185002    2566 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/3e2ac82c-cbf4-45e5-accc-428653e5d6ab-tls-certs\") on node \"ip-10-0-142-238.ec2.internal\" DevicePath \"\""
Jul 18 02:29:52.185032 ip-10-0-142-238 kubenswrapper[2566]: I0718 02:29:52.185026    2566 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/3e2ac82c-cbf4-45e5-accc-428653e5d6ab-model-cache\") on node \"ip-10-0-142-238.ec2.internal\" DevicePath \"\""
Jul 18 02:29:52.185032 ip-10-0-142-238 kubenswrapper[2566]: I0718 02:29:52.185035    2566 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/3e2ac82c-cbf4-45e5-accc-428653e5d6ab-dshm\") on node \"ip-10-0-142-238.ec2.internal\" DevicePath \"\""
Jul 18 02:29:52.185231 ip-10-0-142-238 kubenswrapper[2566]: I0718 02:29:52.185043    2566 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-lvq87\" (UniqueName: \"kubernetes.io/projected/3e2ac82c-cbf4-45e5-accc-428653e5d6ab-kube-api-access-lvq87\") on node \"ip-10-0-142-238.ec2.internal\" DevicePath \"\""
Jul 18 02:29:52.564482 ip-10-0-142-238 kubenswrapper[2566]: I0718 02:29:52.564449    2566 generic.go:356] "Generic (PLEG): container finished" podID="3e2ac82c-cbf4-45e5-accc-428653e5d6ab" containerID="87c128d84ba846adb765bd483560731982ffb62529e58f56ef25683fb3b16e3d" exitCode=0
Jul 18 02:29:52.564672 ip-10-0-142-238 kubenswrapper[2566]: I0718 02:29:52.564496    2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-16c040/auth-test-model-16c040-kserve-9857b867f-75gws"
Jul 18 02:29:52.564672 ip-10-0-142-238 kubenswrapper[2566]: I0718 02:29:52.564543    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-16c040/auth-test-model-16c040-kserve-9857b867f-75gws" event={"ID":"3e2ac82c-cbf4-45e5-accc-428653e5d6ab","Type":"ContainerDied","Data":"87c128d84ba846adb765bd483560731982ffb62529e58f56ef25683fb3b16e3d"}
Jul 18 02:29:52.564672 ip-10-0-142-238 kubenswrapper[2566]: I0718 02:29:52.564584    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-16c040/auth-test-model-16c040-kserve-9857b867f-75gws" event={"ID":"3e2ac82c-cbf4-45e5-accc-428653e5d6ab","Type":"ContainerDied","Data":"a87d3e3d8f770c12da322af69d656bf6e23e2563f5ef8394b59d9266267312eb"}
Jul 18 02:29:52.564672 ip-10-0-142-238 kubenswrapper[2566]: I0718 02:29:52.564601    2566 scope.go:117] "RemoveContainer" containerID="87c128d84ba846adb765bd483560731982ffb62529e58f56ef25683fb3b16e3d"
Jul 18 02:29:52.573171 ip-10-0-142-238 kubenswrapper[2566]: I0718 02:29:52.573152    2566 scope.go:117] "RemoveContainer" containerID="87c128d84ba846adb765bd483560731982ffb62529e58f56ef25683fb3b16e3d"
Jul 18 02:29:52.573399 ip-10-0-142-238 kubenswrapper[2566]: E0718 02:29:52.573383    2566 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"87c128d84ba846adb765bd483560731982ffb62529e58f56ef25683fb3b16e3d\": container with ID starting with 87c128d84ba846adb765bd483560731982ffb62529e58f56ef25683fb3b16e3d not found: ID does not exist" containerID="87c128d84ba846adb765bd483560731982ffb62529e58f56ef25683fb3b16e3d"
Jul 18 02:29:52.573458 ip-10-0-142-238 kubenswrapper[2566]: I0718 02:29:52.573411    2566 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"87c128d84ba846adb765bd483560731982ffb62529e58f56ef25683fb3b16e3d"} err="failed to get container status \"87c128d84ba846adb765bd483560731982ffb62529e58f56ef25683fb3b16e3d\": rpc error: code = NotFound desc = could not find container \"87c128d84ba846adb765bd483560731982ffb62529e58f56ef25683fb3b16e3d\": container with ID starting with 87c128d84ba846adb765bd483560731982ffb62529e58f56ef25683fb3b16e3d not found: ID does not exist"
Jul 18 02:29:52.586296 ip-10-0-142-238 kubenswrapper[2566]: I0718 02:29:52.586266    2566 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-16c040/auth-test-model-16c040-kserve-9857b867f-75gws"]
Jul 18 02:29:52.590116 ip-10-0-142-238 kubenswrapper[2566]: I0718 02:29:52.590096    2566 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-b-16c040/auth-test-model-16c040-kserve-9857b867f-75gws"]
Jul 18 02:29:52.815374 ip-10-0-142-238 kubenswrapper[2566]: I0718 02:29:52.815294    2566 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="3e2ac82c-cbf4-45e5-accc-428653e5d6ab" path="/var/lib/kubelet/pods/3e2ac82c-cbf4-45e5-accc-428653e5d6ab/volumes"
Jul 18 02:29:52.815688 ip-10-0-142-238 kubenswrapper[2566]: I0718 02:29:52.815674    2566 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="fac2c300-348f-42c8-97fc-809d4e5fc87c" path="/var/lib/kubelet/pods/fac2c300-348f-42c8-97fc-809d4e5fc87c/volumes"
Jul 18 02:29:56.476017 ip-10-0-142-238 kubenswrapper[2566]: I0718 02:29:56.475987    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-lmjk9"]
Jul 18 02:30:00.141903 ip-10-0-142-238 kubenswrapper[2566]: I0718 02:30:00.141864    2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-16c040-29739030-qvngd"]
Jul 18 02:30:00.142359 ip-10-0-142-238 kubenswrapper[2566]: I0718 02:30:00.142180    2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="fac2c300-348f-42c8-97fc-809d4e5fc87c" containerName="main"
Jul 18 02:30:00.142359 ip-10-0-142-238 kubenswrapper[2566]: I0718 02:30:00.142192    2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="fac2c300-348f-42c8-97fc-809d4e5fc87c" containerName="main"
Jul 18 02:30:00.142359 ip-10-0-142-238 kubenswrapper[2566]: I0718 02:30:00.142200    2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3e2ac82c-cbf4-45e5-accc-428653e5d6ab" containerName="main"
Jul 18 02:30:00.142359 ip-10-0-142-238 kubenswrapper[2566]: I0718 02:30:00.142205    2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="3e2ac82c-cbf4-45e5-accc-428653e5d6ab" containerName="main"
Jul 18 02:30:00.142359 ip-10-0-142-238 kubenswrapper[2566]: I0718 02:30:00.142258    2566 memory_manager.go:368] "RemoveStaleState removing state" podUID="fac2c300-348f-42c8-97fc-809d4e5fc87c" containerName="main"
Jul 18 02:30:00.142359 ip-10-0-142-238 kubenswrapper[2566]: I0718 02:30:00.142265    2566 memory_manager.go:368] "RemoveStaleState removing state" podUID="3e2ac82c-cbf4-45e5-accc-428653e5d6ab" containerName="main"
Jul 18 02:30:00.145251 ip-10-0-142-238 kubenswrapper[2566]: I0718 02:30:00.145228    2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29739030-2bwnv"]
Jul 18 02:30:00.145384 ip-10-0-142-238 kubenswrapper[2566]: I0718 02:30:00.145363    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-16c040-29739030-qvngd"
Jul 18 02:30:00.148469 ip-10-0-142-238 kubenswrapper[2566]: I0718 02:30:00.148451    2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-2cb736-29739030-lg4z5"]
Jul 18 02:30:00.148573 ip-10-0-142-238 kubenswrapper[2566]: I0718 02:30:00.148552    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29739030-2bwnv"
Jul 18 02:30:00.149136 ip-10-0-142-238 kubenswrapper[2566]: I0718 02:30:00.149113    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-5chqh\""
Jul 18 02:30:00.151280 ip-10-0-142-238 kubenswrapper[2566]: I0718 02:30:00.151263    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-2cb736-29739030-lg4z5"
Jul 18 02:30:00.154772 ip-10-0-142-238 kubenswrapper[2566]: I0718 02:30:00.154746    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-16c040-29739030-qvngd"]
Jul 18 02:30:00.157192 ip-10-0-142-238 kubenswrapper[2566]: I0718 02:30:00.157163    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-16c040-29739030-qvngd"
Jul 18 02:30:00.157293 ip-10-0-142-238 kubenswrapper[2566]: I0718 02:30:00.157245    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29739030-2bwnv"]
Jul 18 02:30:00.160264 ip-10-0-142-238 kubenswrapper[2566]: I0718 02:30:00.160242    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-2cb736-29739030-lg4z5"]
Jul 18 02:30:00.169233 ip-10-0-142-238 kubenswrapper[2566]: I0718 02:30:00.169214    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29739030-2bwnv"
Jul 18 02:30:00.196688 ip-10-0-142-238 kubenswrapper[2566]: I0718 02:30:00.196665    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-2cb736-29739030-lg4z5"
Jul 18 02:30:00.315022 ip-10-0-142-238 kubenswrapper[2566]: I0718 02:30:00.314998    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-16c040-29739030-qvngd"]
Jul 18 02:30:00.316762 ip-10-0-142-238 kubenswrapper[2566]: W0718 02:30:00.316710    2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod720308a0_a394_4ac6_b5ff_11d2809f4dde.slice/crio-548ec9af2e77d65e5a9a2613cc12862e015cfb6a370e684a3b82bfae708b8620 WatchSource:0}: Error finding container 548ec9af2e77d65e5a9a2613cc12862e015cfb6a370e684a3b82bfae708b8620: Status 404 returned error can't find the container with id 548ec9af2e77d65e5a9a2613cc12862e015cfb6a370e684a3b82bfae708b8620
Jul 18 02:30:00.538944 ip-10-0-142-238 kubenswrapper[2566]: I0718 02:30:00.538920    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29739030-2bwnv"]
Jul 18 02:30:00.540405 ip-10-0-142-238 kubenswrapper[2566]: W0718 02:30:00.540379    2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod86a10295_ae0e_43c3_9b2a_10dbd9f63667.slice/crio-4cf2a7760d17227308c81ad79efdb14d0cc5a66a40235ede41f940841bd21553 WatchSource:0}: Error finding container 4cf2a7760d17227308c81ad79efdb14d0cc5a66a40235ede41f940841bd21553: Status 404 returned error can't find the container with id 4cf2a7760d17227308c81ad79efdb14d0cc5a66a40235ede41f940841bd21553
Jul 18 02:30:00.569025 ip-10-0-142-238 kubenswrapper[2566]: I0718 02:30:00.569003    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-2cb736-29739030-lg4z5"]
Jul 18 02:30:00.571275 ip-10-0-142-238 kubenswrapper[2566]: W0718 02:30:00.571247    2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbcd83a10_f86b_4831_8abe_88bc9c5d1738.slice/crio-0daedb6d73bd01a809169341ff3b1dbfd1df3667e601240a031073e8d0b71a6d WatchSource:0}: Error finding container 0daedb6d73bd01a809169341ff3b1dbfd1df3667e601240a031073e8d0b71a6d: Status 404 returned error can't find the container with id 0daedb6d73bd01a809169341ff3b1dbfd1df3667e601240a031073e8d0b71a6d
Jul 18 02:30:00.606996 ip-10-0-142-238 kubenswrapper[2566]: I0718 02:30:00.606858    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-2cb736-29739030-lg4z5" event={"ID":"bcd83a10-f86b-4831-8abe-88bc9c5d1738","Type":"ContainerStarted","Data":"0daedb6d73bd01a809169341ff3b1dbfd1df3667e601240a031073e8d0b71a6d"}
Jul 18 02:30:00.608524 ip-10-0-142-238 kubenswrapper[2566]: I0718 02:30:00.608501    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-16c040-29739030-qvngd" event={"ID":"720308a0-a394-4ac6-b5ff-11d2809f4dde","Type":"ContainerStarted","Data":"548ec9af2e77d65e5a9a2613cc12862e015cfb6a370e684a3b82bfae708b8620"}
Jul 18 02:30:00.609840 ip-10-0-142-238 kubenswrapper[2566]: I0718 02:30:00.609817    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29739030-2bwnv" event={"ID":"86a10295-ae0e-43c3-9b2a-10dbd9f63667","Type":"ContainerStarted","Data":"4cf2a7760d17227308c81ad79efdb14d0cc5a66a40235ede41f940841bd21553"}
Jul 18 02:30:01.617418 ip-10-0-142-238 kubenswrapper[2566]: I0718 02:30:01.617390    2566 generic.go:356] "Generic (PLEG): container finished" podID="86a10295-ae0e-43c3-9b2a-10dbd9f63667" containerID="3872f4a6aa0efaae046fc8945e681cb2233faa4477cb2ecdc808e58a9ab93432" exitCode=0
Jul 18 02:30:01.617846 ip-10-0-142-238 kubenswrapper[2566]: I0718 02:30:01.617480    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29739030-2bwnv" event={"ID":"86a10295-ae0e-43c3-9b2a-10dbd9f63667","Type":"ContainerDied","Data":"3872f4a6aa0efaae046fc8945e681cb2233faa4477cb2ecdc808e58a9ab93432"}
Jul 18 02:30:01.618928 ip-10-0-142-238 kubenswrapper[2566]: I0718 02:30:01.618906    2566 generic.go:356] "Generic (PLEG): container finished" podID="bcd83a10-f86b-4831-8abe-88bc9c5d1738" containerID="ca43e8cd8d8f2ee2bc1c368fe58e44d75e0ce537840265f94f11051788340b17" exitCode=0
Jul 18 02:30:01.619028 ip-10-0-142-238 kubenswrapper[2566]: I0718 02:30:01.618983    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-2cb736-29739030-lg4z5" event={"ID":"bcd83a10-f86b-4831-8abe-88bc9c5d1738","Type":"ContainerDied","Data":"ca43e8cd8d8f2ee2bc1c368fe58e44d75e0ce537840265f94f11051788340b17"}
Jul 18 02:30:01.620351 ip-10-0-142-238 kubenswrapper[2566]: I0718 02:30:01.620331    2566 generic.go:356] "Generic (PLEG): container finished" podID="720308a0-a394-4ac6-b5ff-11d2809f4dde" containerID="fc335d3144fef48c02d1bc43f95ffe75917a1668070cd87496bc94150456c72e" exitCode=0
Jul 18 02:30:01.620430 ip-10-0-142-238 kubenswrapper[2566]: I0718 02:30:01.620410    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-16c040-29739030-qvngd" event={"ID":"720308a0-a394-4ac6-b5ff-11d2809f4dde","Type":"ContainerDied","Data":"fc335d3144fef48c02d1bc43f95ffe75917a1668070cd87496bc94150456c72e"}
Jul 18 02:30:02.760504 ip-10-0-142-238 kubenswrapper[2566]: I0718 02:30:02.760476    2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29739030-2bwnv"
Jul 18 02:30:02.803244 ip-10-0-142-238 kubenswrapper[2566]: I0718 02:30:02.803220    2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-16c040-29739030-qvngd"
Jul 18 02:30:02.805757 ip-10-0-142-238 kubenswrapper[2566]: I0718 02:30:02.805738    2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-2cb736-29739030-lg4z5"
Jul 18 02:30:03.631036 ip-10-0-142-238 kubenswrapper[2566]: I0718 02:30:03.631006    2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29739030-2bwnv"
Jul 18 02:30:03.631211 ip-10-0-142-238 kubenswrapper[2566]: I0718 02:30:03.631010    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29739030-2bwnv" event={"ID":"86a10295-ae0e-43c3-9b2a-10dbd9f63667","Type":"ContainerDied","Data":"4cf2a7760d17227308c81ad79efdb14d0cc5a66a40235ede41f940841bd21553"}
Jul 18 02:30:03.631211 ip-10-0-142-238 kubenswrapper[2566]: I0718 02:30:03.631120    2566 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="4cf2a7760d17227308c81ad79efdb14d0cc5a66a40235ede41f940841bd21553"
Jul 18 02:30:03.632245 ip-10-0-142-238 kubenswrapper[2566]: I0718 02:30:03.632221    2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-2cb736-29739030-lg4z5"
Jul 18 02:30:03.632245 ip-10-0-142-238 kubenswrapper[2566]: I0718 02:30:03.632235    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-2cb736-29739030-lg4z5" event={"ID":"bcd83a10-f86b-4831-8abe-88bc9c5d1738","Type":"ContainerDied","Data":"0daedb6d73bd01a809169341ff3b1dbfd1df3667e601240a031073e8d0b71a6d"}
Jul 18 02:30:03.632403 ip-10-0-142-238 kubenswrapper[2566]: I0718 02:30:03.632270    2566 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="0daedb6d73bd01a809169341ff3b1dbfd1df3667e601240a031073e8d0b71a6d"
Jul 18 02:30:03.633606 ip-10-0-142-238 kubenswrapper[2566]: I0718 02:30:03.633585    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-16c040-29739030-qvngd" event={"ID":"720308a0-a394-4ac6-b5ff-11d2809f4dde","Type":"ContainerDied","Data":"548ec9af2e77d65e5a9a2613cc12862e015cfb6a370e684a3b82bfae708b8620"}
Jul 18 02:30:03.633728 ip-10-0-142-238 kubenswrapper[2566]: I0718 02:30:03.633595    2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-16c040-29739030-qvngd"
Jul 18 02:30:03.633728 ip-10-0-142-238 kubenswrapper[2566]: I0718 02:30:03.633639    2566 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="548ec9af2e77d65e5a9a2613cc12862e015cfb6a370e684a3b82bfae708b8620"
Jul 18 02:30:09.180408 ip-10-0-142-238 kubenswrapper[2566]: I0718 02:30:09.180377    2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-b-16c040/sub-test-model-16c040-kserve-6754dfb6f5-424kq"]
Jul 18 02:30:09.180832 ip-10-0-142-238 kubenswrapper[2566]: I0718 02:30:09.180676    2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="bcd83a10-f86b-4831-8abe-88bc9c5d1738" containerName="cleanup"
Jul 18 02:30:09.180832 ip-10-0-142-238 kubenswrapper[2566]: I0718 02:30:09.180687    2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="bcd83a10-f86b-4831-8abe-88bc9c5d1738" containerName="cleanup"
Jul 18 02:30:09.180832 ip-10-0-142-238 kubenswrapper[2566]: I0718 02:30:09.180697    2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="86a10295-ae0e-43c3-9b2a-10dbd9f63667" containerName="cleanup"
Jul 18 02:30:09.180832 ip-10-0-142-238 kubenswrapper[2566]: I0718 02:30:09.180703    2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="86a10295-ae0e-43c3-9b2a-10dbd9f63667" containerName="cleanup"
Jul 18 02:30:09.180832 ip-10-0-142-238 kubenswrapper[2566]: I0718 02:30:09.180721    2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="720308a0-a394-4ac6-b5ff-11d2809f4dde" containerName="cleanup"
Jul 18 02:30:09.180832 ip-10-0-142-238 kubenswrapper[2566]: I0718 02:30:09.180726    2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="720308a0-a394-4ac6-b5ff-11d2809f4dde" containerName="cleanup"
Jul 18 02:30:09.180832 ip-10-0-142-238 kubenswrapper[2566]: I0718 02:30:09.180787    2566 memory_manager.go:368] "RemoveStaleState removing state" podUID="bcd83a10-f86b-4831-8abe-88bc9c5d1738" containerName="cleanup"
Jul 18 02:30:09.180832 ip-10-0-142-238 kubenswrapper[2566]: I0718 02:30:09.180797    2566 memory_manager.go:368] "RemoveStaleState removing state" podUID="720308a0-a394-4ac6-b5ff-11d2809f4dde" containerName="cleanup"
Jul 18 02:30:09.180832 ip-10-0-142-238 kubenswrapper[2566]: I0718 02:30:09.180804    2566 memory_manager.go:368] "RemoveStaleState removing state" podUID="86a10295-ae0e-43c3-9b2a-10dbd9f63667" containerName="cleanup"
Jul 18 02:30:09.183678 ip-10-0-142-238 kubenswrapper[2566]: I0718 02:30:09.183663    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-16c040/sub-test-model-16c040-kserve-6754dfb6f5-424kq"
Jul 18 02:30:09.186874 ip-10-0-142-238 kubenswrapper[2566]: I0718 02:30:09.186851    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-16c040\"/\"sub-test-model-16c040-kserve-self-signed-certs\""
Jul 18 02:30:09.186990 ip-10-0-142-238 kubenswrapper[2566]: I0718 02:30:09.186851    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-16c040\"/\"default-dockercfg-drv94\""
Jul 18 02:30:09.186990 ip-10-0-142-238 kubenswrapper[2566]: I0718 02:30:09.186876    2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-16c040\"/\"kube-root-ca.crt\""
Jul 18 02:30:09.186990 ip-10-0-142-238 kubenswrapper[2566]: I0718 02:30:09.186885    2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-16c040\"/\"openshift-service-ca.crt\""
Jul 18 02:30:09.192027 ip-10-0-142-238 kubenswrapper[2566]: I0718 02:30:09.192005    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-16c040/sub-test-model-16c040-kserve-6754dfb6f5-424kq"]
Jul 18 02:30:09.318926 ip-10-0-142-238 kubenswrapper[2566]: I0718 02:30:09.318895    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/9a08a522-8ddf-4e85-89a5-c3d6ff0eba53-tmp-dir\") pod \"sub-test-model-16c040-kserve-6754dfb6f5-424kq\" (UID: \"9a08a522-8ddf-4e85-89a5-c3d6ff0eba53\") " pod="ai-tenant-e2e-shared-b-16c040/sub-test-model-16c040-kserve-6754dfb6f5-424kq"
Jul 18 02:30:09.319076 ip-10-0-142-238 kubenswrapper[2566]: I0718 02:30:09.318928    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7779c\" (UniqueName: \"kubernetes.io/projected/9a08a522-8ddf-4e85-89a5-c3d6ff0eba53-kube-api-access-7779c\") pod \"sub-test-model-16c040-kserve-6754dfb6f5-424kq\" (UID: \"9a08a522-8ddf-4e85-89a5-c3d6ff0eba53\") " pod="ai-tenant-e2e-shared-b-16c040/sub-test-model-16c040-kserve-6754dfb6f5-424kq"
Jul 18 02:30:09.319076 ip-10-0-142-238 kubenswrapper[2566]: I0718 02:30:09.318953    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/9a08a522-8ddf-4e85-89a5-c3d6ff0eba53-tls-certs\") pod \"sub-test-model-16c040-kserve-6754dfb6f5-424kq\" (UID: \"9a08a522-8ddf-4e85-89a5-c3d6ff0eba53\") " pod="ai-tenant-e2e-shared-b-16c040/sub-test-model-16c040-kserve-6754dfb6f5-424kq"
Jul 18 02:30:09.319076 ip-10-0-142-238 kubenswrapper[2566]: I0718 02:30:09.318969    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/9a08a522-8ddf-4e85-89a5-c3d6ff0eba53-home\") pod \"sub-test-model-16c040-kserve-6754dfb6f5-424kq\" (UID: \"9a08a522-8ddf-4e85-89a5-c3d6ff0eba53\") " pod="ai-tenant-e2e-shared-b-16c040/sub-test-model-16c040-kserve-6754dfb6f5-424kq"
Jul 18 02:30:09.319076 ip-10-0-142-238 kubenswrapper[2566]: I0718 02:30:09.319024    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/9a08a522-8ddf-4e85-89a5-c3d6ff0eba53-model-cache\") pod \"sub-test-model-16c040-kserve-6754dfb6f5-424kq\" (UID: \"9a08a522-8ddf-4e85-89a5-c3d6ff0eba53\") " pod="ai-tenant-e2e-shared-b-16c040/sub-test-model-16c040-kserve-6754dfb6f5-424kq"
Jul 18 02:30:09.319076 ip-10-0-142-238 kubenswrapper[2566]: I0718 02:30:09.319075    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/9a08a522-8ddf-4e85-89a5-c3d6ff0eba53-dshm\") pod \"sub-test-model-16c040-kserve-6754dfb6f5-424kq\" (UID: \"9a08a522-8ddf-4e85-89a5-c3d6ff0eba53\") " pod="ai-tenant-e2e-shared-b-16c040/sub-test-model-16c040-kserve-6754dfb6f5-424kq"
Jul 18 02:30:09.420247 ip-10-0-142-238 kubenswrapper[2566]: I0718 02:30:09.420210    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/9a08a522-8ddf-4e85-89a5-c3d6ff0eba53-tmp-dir\") pod \"sub-test-model-16c040-kserve-6754dfb6f5-424kq\" (UID: \"9a08a522-8ddf-4e85-89a5-c3d6ff0eba53\") " pod="ai-tenant-e2e-shared-b-16c040/sub-test-model-16c040-kserve-6754dfb6f5-424kq"
Jul 18 02:30:09.420247 ip-10-0-142-238 kubenswrapper[2566]: I0718 02:30:09.420251    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7779c\" (UniqueName: \"kubernetes.io/projected/9a08a522-8ddf-4e85-89a5-c3d6ff0eba53-kube-api-access-7779c\") pod \"sub-test-model-16c040-kserve-6754dfb6f5-424kq\" (UID: \"9a08a522-8ddf-4e85-89a5-c3d6ff0eba53\") " pod="ai-tenant-e2e-shared-b-16c040/sub-test-model-16c040-kserve-6754dfb6f5-424kq"
Jul 18 02:30:09.420388 ip-10-0-142-238 kubenswrapper[2566]: I0718 02:30:09.420273    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/9a08a522-8ddf-4e85-89a5-c3d6ff0eba53-tls-certs\") pod \"sub-test-model-16c040-kserve-6754dfb6f5-424kq\" (UID: \"9a08a522-8ddf-4e85-89a5-c3d6ff0eba53\") " pod="ai-tenant-e2e-shared-b-16c040/sub-test-model-16c040-kserve-6754dfb6f5-424kq"
Jul 18 02:30:09.420388 ip-10-0-142-238 kubenswrapper[2566]: I0718 02:30:09.420288    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/9a08a522-8ddf-4e85-89a5-c3d6ff0eba53-home\") pod \"sub-test-model-16c040-kserve-6754dfb6f5-424kq\" (UID: \"9a08a522-8ddf-4e85-89a5-c3d6ff0eba53\") " pod="ai-tenant-e2e-shared-b-16c040/sub-test-model-16c040-kserve-6754dfb6f5-424kq"
Jul 18 02:30:09.420388 ip-10-0-142-238 kubenswrapper[2566]: I0718 02:30:09.420314    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/9a08a522-8ddf-4e85-89a5-c3d6ff0eba53-model-cache\") pod \"sub-test-model-16c040-kserve-6754dfb6f5-424kq\" (UID: \"9a08a522-8ddf-4e85-89a5-c3d6ff0eba53\") " pod="ai-tenant-e2e-shared-b-16c040/sub-test-model-16c040-kserve-6754dfb6f5-424kq"
Jul 18 02:30:09.420388 ip-10-0-142-238 kubenswrapper[2566]: I0718 02:30:09.420366    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/9a08a522-8ddf-4e85-89a5-c3d6ff0eba53-dshm\") pod \"sub-test-model-16c040-kserve-6754dfb6f5-424kq\" (UID: \"9a08a522-8ddf-4e85-89a5-c3d6ff0eba53\") " pod="ai-tenant-e2e-shared-b-16c040/sub-test-model-16c040-kserve-6754dfb6f5-424kq"
Jul 18 02:30:09.420697 ip-10-0-142-238 kubenswrapper[2566]: I0718 02:30:09.420673    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/9a08a522-8ddf-4e85-89a5-c3d6ff0eba53-tmp-dir\") pod \"sub-test-model-16c040-kserve-6754dfb6f5-424kq\" (UID: \"9a08a522-8ddf-4e85-89a5-c3d6ff0eba53\") " pod="ai-tenant-e2e-shared-b-16c040/sub-test-model-16c040-kserve-6754dfb6f5-424kq"
Jul 18 02:30:09.420748 ip-10-0-142-238 kubenswrapper[2566]: I0718 02:30:09.420701    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/9a08a522-8ddf-4e85-89a5-c3d6ff0eba53-home\") pod \"sub-test-model-16c040-kserve-6754dfb6f5-424kq\" (UID: \"9a08a522-8ddf-4e85-89a5-c3d6ff0eba53\") " pod="ai-tenant-e2e-shared-b-16c040/sub-test-model-16c040-kserve-6754dfb6f5-424kq"
Jul 18 02:30:09.420748 ip-10-0-142-238 kubenswrapper[2566]: I0718 02:30:09.420735    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/9a08a522-8ddf-4e85-89a5-c3d6ff0eba53-model-cache\") pod \"sub-test-model-16c040-kserve-6754dfb6f5-424kq\" (UID: \"9a08a522-8ddf-4e85-89a5-c3d6ff0eba53\") " pod="ai-tenant-e2e-shared-b-16c040/sub-test-model-16c040-kserve-6754dfb6f5-424kq"
Jul 18 02:30:09.422572 ip-10-0-142-238 kubenswrapper[2566]: I0718 02:30:09.422548    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/9a08a522-8ddf-4e85-89a5-c3d6ff0eba53-dshm\") pod \"sub-test-model-16c040-kserve-6754dfb6f5-424kq\" (UID: \"9a08a522-8ddf-4e85-89a5-c3d6ff0eba53\") " pod="ai-tenant-e2e-shared-b-16c040/sub-test-model-16c040-kserve-6754dfb6f5-424kq"
Jul 18 02:30:09.422811 ip-10-0-142-238 kubenswrapper[2566]: I0718 02:30:09.422793    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/9a08a522-8ddf-4e85-89a5-c3d6ff0eba53-tls-certs\") pod \"sub-test-model-16c040-kserve-6754dfb6f5-424kq\" (UID: \"9a08a522-8ddf-4e85-89a5-c3d6ff0eba53\") " pod="ai-tenant-e2e-shared-b-16c040/sub-test-model-16c040-kserve-6754dfb6f5-424kq"
Jul 18 02:30:09.428381 ip-10-0-142-238 kubenswrapper[2566]: I0718 02:30:09.428358    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7779c\" (UniqueName: \"kubernetes.io/projected/9a08a522-8ddf-4e85-89a5-c3d6ff0eba53-kube-api-access-7779c\") pod \"sub-test-model-16c040-kserve-6754dfb6f5-424kq\" (UID: \"9a08a522-8ddf-4e85-89a5-c3d6ff0eba53\") " pod="ai-tenant-e2e-shared-b-16c040/sub-test-model-16c040-kserve-6754dfb6f5-424kq"
Jul 18 02:30:09.493608 ip-10-0-142-238 kubenswrapper[2566]: I0718 02:30:09.493542    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-16c040/sub-test-model-16c040-kserve-6754dfb6f5-424kq"
Jul 18 02:30:09.621104 ip-10-0-142-238 kubenswrapper[2566]: I0718 02:30:09.621080    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-16c040/sub-test-model-16c040-kserve-6754dfb6f5-424kq"]
Jul 18 02:30:09.622968 ip-10-0-142-238 kubenswrapper[2566]: W0718 02:30:09.622932    2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod9a08a522_8ddf_4e85_89a5_c3d6ff0eba53.slice/crio-d0f3dbc84671c229e85c22bdb242d2c055c2680083825c43af34188e755bbe0d WatchSource:0}: Error finding container d0f3dbc84671c229e85c22bdb242d2c055c2680083825c43af34188e755bbe0d: Status 404 returned error can't find the container with id d0f3dbc84671c229e85c22bdb242d2c055c2680083825c43af34188e755bbe0d
Jul 18 02:30:09.666607 ip-10-0-142-238 kubenswrapper[2566]: I0718 02:30:09.666579    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-16c040/sub-test-model-16c040-kserve-6754dfb6f5-424kq" event={"ID":"9a08a522-8ddf-4e85-89a5-c3d6ff0eba53","Type":"ContainerStarted","Data":"d0f3dbc84671c229e85c22bdb242d2c055c2680083825c43af34188e755bbe0d"}
Jul 18 02:30:10.673402 ip-10-0-142-238 kubenswrapper[2566]: I0718 02:30:10.673363    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-16c040/sub-test-model-16c040-kserve-6754dfb6f5-424kq" event={"ID":"9a08a522-8ddf-4e85-89a5-c3d6ff0eba53","Type":"ContainerStarted","Data":"d74d9ad59e5cdd8e5c8233d54b98c20ac909fc0d13cb134c2c02ba3d621cccb2"}
Jul 18 02:30:10.690210 ip-10-0-142-238 kubenswrapper[2566]: I0718 02:30:10.690166    2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-b-16c040/sub-test-model-16c040-kserve-6754dfb6f5-424kq" podStartSLOduration=1.690150752 podStartE2EDuration="1.690150752s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-18 02:30:09 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-18 02:30:10.688093662 +0000 UTC m=+2542.376821120" watchObservedRunningTime="2026-07-18 02:30:10.690150752 +0000 UTC m=+2542.378878199"
Jul 18 02:30:13.280140 ip-10-0-142-238 kubenswrapper[2566]: I0718 02:30:13.280098    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-lmjk9"]
Jul 18 02:30:19.494260 ip-10-0-142-238 kubenswrapper[2566]: I0718 02:30:19.494235    2566 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-b-16c040/sub-test-model-16c040-kserve-6754dfb6f5-424kq"
Jul 18 02:30:19.494260 ip-10-0-142-238 kubenswrapper[2566]: I0718 02:30:19.494277    2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-b-16c040/sub-test-model-16c040-kserve-6754dfb6f5-424kq"
Jul 18 02:30:19.506439 ip-10-0-142-238 kubenswrapper[2566]: I0718 02:30:19.506391    2566 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-b-16c040/sub-test-model-16c040-kserve-6754dfb6f5-424kq"
Jul 18 02:30:19.729627 ip-10-0-142-238 kubenswrapper[2566]: I0718 02:30:19.729594    2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-b-16c040/sub-test-model-16c040-kserve-6754dfb6f5-424kq"
Jul 18 02:30:27.286866 ip-10-0-142-238 kubenswrapper[2566]: I0718 02:30:27.286830    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-lmjk9"]
Jul 18 02:30:44.089140 ip-10-0-142-238 kubenswrapper[2566]: I0718 02:30:44.089105    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-lmjk9"]
Jul 18 02:30:49.078082 ip-10-0-142-238 kubenswrapper[2566]: I0718 02:30:49.078050    2566 scope.go:117] "RemoveContainer" containerID="6bdf9c0e84d6fababaaf62c22ad5081549c23c4dcb3043315cccd9e504d0a3aa"
Jul 18 02:30:49.085750 ip-10-0-142-238 kubenswrapper[2566]: I0718 02:30:49.085731    2566 scope.go:117] "RemoveContainer" containerID="675d12dafd82560e5a0dc14b9fc6905b9c5be10d7ccadf328aa729f5190f8cd6"
Jul 18 02:31:00.896359 ip-10-0-142-238 kubenswrapper[2566]: I0718 02:31:00.896326    2566 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-16c040/sub-test-model-16c040-kserve-6754dfb6f5-424kq"]
Jul 18 02:31:03.877806 ip-10-0-142-238 kubenswrapper[2566]: I0718 02:31:03.877772    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-lmjk9"]
Jul 18 02:31:15.915643 ip-10-0-142-238 kubenswrapper[2566]: I0718 02:31:15.915515    2566 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-shared-b-16c040/sub-test-model-16c040-kserve-6754dfb6f5-424kq" podUID="9a08a522-8ddf-4e85-89a5-c3d6ff0eba53" containerName="main" containerID="cri-o://d74d9ad59e5cdd8e5c8233d54b98c20ac909fc0d13cb134c2c02ba3d621cccb2" gracePeriod=45
Jul 18 02:31:16.155016 ip-10-0-142-238 kubenswrapper[2566]: I0718 02:31:16.154993    2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-16c040/sub-test-model-16c040-kserve-6754dfb6f5-424kq"
Jul 18 02:31:16.228992 ip-10-0-142-238 kubenswrapper[2566]: I0718 02:31:16.228923    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/9a08a522-8ddf-4e85-89a5-c3d6ff0eba53-tls-certs\") pod \"9a08a522-8ddf-4e85-89a5-c3d6ff0eba53\" (UID: \"9a08a522-8ddf-4e85-89a5-c3d6ff0eba53\") "
Jul 18 02:31:16.228992 ip-10-0-142-238 kubenswrapper[2566]: I0718 02:31:16.228975    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-7779c\" (UniqueName: \"kubernetes.io/projected/9a08a522-8ddf-4e85-89a5-c3d6ff0eba53-kube-api-access-7779c\") pod \"9a08a522-8ddf-4e85-89a5-c3d6ff0eba53\" (UID: \"9a08a522-8ddf-4e85-89a5-c3d6ff0eba53\") "
Jul 18 02:31:16.229155 ip-10-0-142-238 kubenswrapper[2566]: I0718 02:31:16.229000    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/9a08a522-8ddf-4e85-89a5-c3d6ff0eba53-home\") pod \"9a08a522-8ddf-4e85-89a5-c3d6ff0eba53\" (UID: \"9a08a522-8ddf-4e85-89a5-c3d6ff0eba53\") "
Jul 18 02:31:16.229194 ip-10-0-142-238 kubenswrapper[2566]: I0718 02:31:16.229152    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/9a08a522-8ddf-4e85-89a5-c3d6ff0eba53-tmp-dir\") pod \"9a08a522-8ddf-4e85-89a5-c3d6ff0eba53\" (UID: \"9a08a522-8ddf-4e85-89a5-c3d6ff0eba53\") "
Jul 18 02:31:16.229251 ip-10-0-142-238 kubenswrapper[2566]: I0718 02:31:16.229191    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/9a08a522-8ddf-4e85-89a5-c3d6ff0eba53-model-cache\") pod \"9a08a522-8ddf-4e85-89a5-c3d6ff0eba53\" (UID: \"9a08a522-8ddf-4e85-89a5-c3d6ff0eba53\") "
Jul 18 02:31:16.229251 ip-10-0-142-238 kubenswrapper[2566]: I0718 02:31:16.229215    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/9a08a522-8ddf-4e85-89a5-c3d6ff0eba53-dshm\") pod \"9a08a522-8ddf-4e85-89a5-c3d6ff0eba53\" (UID: \"9a08a522-8ddf-4e85-89a5-c3d6ff0eba53\") "
Jul 18 02:31:16.229251 ip-10-0-142-238 kubenswrapper[2566]: I0718 02:31:16.229226    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9a08a522-8ddf-4e85-89a5-c3d6ff0eba53-home" (OuterVolumeSpecName: "home") pod "9a08a522-8ddf-4e85-89a5-c3d6ff0eba53" (UID: "9a08a522-8ddf-4e85-89a5-c3d6ff0eba53"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 18 02:31:16.229456 ip-10-0-142-238 kubenswrapper[2566]: I0718 02:31:16.229437    2566 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/9a08a522-8ddf-4e85-89a5-c3d6ff0eba53-home\") on node \"ip-10-0-142-238.ec2.internal\" DevicePath \"\""
Jul 18 02:31:16.229511 ip-10-0-142-238 kubenswrapper[2566]: I0718 02:31:16.229437    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9a08a522-8ddf-4e85-89a5-c3d6ff0eba53-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "9a08a522-8ddf-4e85-89a5-c3d6ff0eba53" (UID: "9a08a522-8ddf-4e85-89a5-c3d6ff0eba53"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 18 02:31:16.229511 ip-10-0-142-238 kubenswrapper[2566]: I0718 02:31:16.229451    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9a08a522-8ddf-4e85-89a5-c3d6ff0eba53-model-cache" (OuterVolumeSpecName: "model-cache") pod "9a08a522-8ddf-4e85-89a5-c3d6ff0eba53" (UID: "9a08a522-8ddf-4e85-89a5-c3d6ff0eba53"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 18 02:31:16.230958 ip-10-0-142-238 kubenswrapper[2566]: I0718 02:31:16.230930    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9a08a522-8ddf-4e85-89a5-c3d6ff0eba53-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "9a08a522-8ddf-4e85-89a5-c3d6ff0eba53" (UID: "9a08a522-8ddf-4e85-89a5-c3d6ff0eba53"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 18 02:31:16.231058 ip-10-0-142-238 kubenswrapper[2566]: I0718 02:31:16.231026    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9a08a522-8ddf-4e85-89a5-c3d6ff0eba53-kube-api-access-7779c" (OuterVolumeSpecName: "kube-api-access-7779c") pod "9a08a522-8ddf-4e85-89a5-c3d6ff0eba53" (UID: "9a08a522-8ddf-4e85-89a5-c3d6ff0eba53"). InnerVolumeSpecName "kube-api-access-7779c". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 18 02:31:16.231118 ip-10-0-142-238 kubenswrapper[2566]: I0718 02:31:16.231100    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9a08a522-8ddf-4e85-89a5-c3d6ff0eba53-dshm" (OuterVolumeSpecName: "dshm") pod "9a08a522-8ddf-4e85-89a5-c3d6ff0eba53" (UID: "9a08a522-8ddf-4e85-89a5-c3d6ff0eba53"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 18 02:31:16.330382 ip-10-0-142-238 kubenswrapper[2566]: I0718 02:31:16.330352    2566 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-7779c\" (UniqueName: \"kubernetes.io/projected/9a08a522-8ddf-4e85-89a5-c3d6ff0eba53-kube-api-access-7779c\") on node \"ip-10-0-142-238.ec2.internal\" DevicePath \"\""
Jul 18 02:31:16.330382 ip-10-0-142-238 kubenswrapper[2566]: I0718 02:31:16.330379    2566 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/9a08a522-8ddf-4e85-89a5-c3d6ff0eba53-tmp-dir\") on node \"ip-10-0-142-238.ec2.internal\" DevicePath \"\""
Jul 18 02:31:16.330382 ip-10-0-142-238 kubenswrapper[2566]: I0718 02:31:16.330390    2566 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/9a08a522-8ddf-4e85-89a5-c3d6ff0eba53-model-cache\") on node \"ip-10-0-142-238.ec2.internal\" DevicePath \"\""
Jul 18 02:31:16.330580 ip-10-0-142-238 kubenswrapper[2566]: I0718 02:31:16.330398    2566 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/9a08a522-8ddf-4e85-89a5-c3d6ff0eba53-dshm\") on node \"ip-10-0-142-238.ec2.internal\" DevicePath \"\""
Jul 18 02:31:16.330580 ip-10-0-142-238 kubenswrapper[2566]: I0718 02:31:16.330406    2566 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/9a08a522-8ddf-4e85-89a5-c3d6ff0eba53-tls-certs\") on node \"ip-10-0-142-238.ec2.internal\" DevicePath \"\""
Jul 18 02:31:17.002549 ip-10-0-142-238 kubenswrapper[2566]: I0718 02:31:17.002517    2566 generic.go:356] "Generic (PLEG): container finished" podID="9a08a522-8ddf-4e85-89a5-c3d6ff0eba53" containerID="d74d9ad59e5cdd8e5c8233d54b98c20ac909fc0d13cb134c2c02ba3d621cccb2" exitCode=0
Jul 18 02:31:17.003000 ip-10-0-142-238 kubenswrapper[2566]: I0718 02:31:17.002561    2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-16c040/sub-test-model-16c040-kserve-6754dfb6f5-424kq"
Jul 18 02:31:17.003000 ip-10-0-142-238 kubenswrapper[2566]: I0718 02:31:17.002597    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-16c040/sub-test-model-16c040-kserve-6754dfb6f5-424kq" event={"ID":"9a08a522-8ddf-4e85-89a5-c3d6ff0eba53","Type":"ContainerDied","Data":"d74d9ad59e5cdd8e5c8233d54b98c20ac909fc0d13cb134c2c02ba3d621cccb2"}
Jul 18 02:31:17.003000 ip-10-0-142-238 kubenswrapper[2566]: I0718 02:31:17.002647    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-16c040/sub-test-model-16c040-kserve-6754dfb6f5-424kq" event={"ID":"9a08a522-8ddf-4e85-89a5-c3d6ff0eba53","Type":"ContainerDied","Data":"d0f3dbc84671c229e85c22bdb242d2c055c2680083825c43af34188e755bbe0d"}
Jul 18 02:31:17.003000 ip-10-0-142-238 kubenswrapper[2566]: I0718 02:31:17.002666    2566 scope.go:117] "RemoveContainer" containerID="d74d9ad59e5cdd8e5c8233d54b98c20ac909fc0d13cb134c2c02ba3d621cccb2"
Jul 18 02:31:17.011167 ip-10-0-142-238 kubenswrapper[2566]: I0718 02:31:17.011150    2566 scope.go:117] "RemoveContainer" containerID="d74d9ad59e5cdd8e5c8233d54b98c20ac909fc0d13cb134c2c02ba3d621cccb2"
Jul 18 02:31:17.011417 ip-10-0-142-238 kubenswrapper[2566]: E0718 02:31:17.011391    2566 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d74d9ad59e5cdd8e5c8233d54b98c20ac909fc0d13cb134c2c02ba3d621cccb2\": container with ID starting with d74d9ad59e5cdd8e5c8233d54b98c20ac909fc0d13cb134c2c02ba3d621cccb2 not found: ID does not exist" containerID="d74d9ad59e5cdd8e5c8233d54b98c20ac909fc0d13cb134c2c02ba3d621cccb2"
Jul 18 02:31:17.011470 ip-10-0-142-238 kubenswrapper[2566]: I0718 02:31:17.011416    2566 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d74d9ad59e5cdd8e5c8233d54b98c20ac909fc0d13cb134c2c02ba3d621cccb2"} err="failed to get container status \"d74d9ad59e5cdd8e5c8233d54b98c20ac909fc0d13cb134c2c02ba3d621cccb2\": rpc error: code = NotFound desc = could not find container \"d74d9ad59e5cdd8e5c8233d54b98c20ac909fc0d13cb134c2c02ba3d621cccb2\": container with ID starting with d74d9ad59e5cdd8e5c8233d54b98c20ac909fc0d13cb134c2c02ba3d621cccb2 not found: ID does not exist"
Jul 18 02:31:17.019230 ip-10-0-142-238 kubenswrapper[2566]: I0718 02:31:17.019207    2566 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-16c040/sub-test-model-16c040-kserve-6754dfb6f5-424kq"]
Jul 18 02:31:17.025591 ip-10-0-142-238 kubenswrapper[2566]: I0718 02:31:17.025571    2566 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-b-16c040/sub-test-model-16c040-kserve-6754dfb6f5-424kq"]
Jul 18 02:31:18.814922 ip-10-0-142-238 kubenswrapper[2566]: I0718 02:31:18.814890    2566 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="9a08a522-8ddf-4e85-89a5-c3d6ff0eba53" path="/var/lib/kubelet/pods/9a08a522-8ddf-4e85-89a5-c3d6ff0eba53/volumes"
Jul 18 02:31:37.899461 ip-10-0-142-238 kubenswrapper[2566]: I0718 02:31:37.899432    2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-a-2cb736/rate-test-model-2cb736-kserve-6954c45b8c-9lll7"]
Jul 18 02:31:37.899907 ip-10-0-142-238 kubenswrapper[2566]: I0718 02:31:37.899727    2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9a08a522-8ddf-4e85-89a5-c3d6ff0eba53" containerName="main"
Jul 18 02:31:37.899907 ip-10-0-142-238 kubenswrapper[2566]: I0718 02:31:37.899738    2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="9a08a522-8ddf-4e85-89a5-c3d6ff0eba53" containerName="main"
Jul 18 02:31:37.899907 ip-10-0-142-238 kubenswrapper[2566]: I0718 02:31:37.899794    2566 memory_manager.go:368] "RemoveStaleState removing state" podUID="9a08a522-8ddf-4e85-89a5-c3d6ff0eba53" containerName="main"
Jul 18 02:31:37.902672 ip-10-0-142-238 kubenswrapper[2566]: I0718 02:31:37.902654    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-2cb736/rate-test-model-2cb736-kserve-6954c45b8c-9lll7"
Jul 18 02:31:37.908214 ip-10-0-142-238 kubenswrapper[2566]: I0718 02:31:37.908195    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-a-2cb736\"/\"default-dockercfg-nxh2s\""
Jul 18 02:31:37.908333 ip-10-0-142-238 kubenswrapper[2566]: I0718 02:31:37.908225    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-a-2cb736\"/\"rate-test-model-2cb736-kserve-self-signed-certs\""
Jul 18 02:31:37.908400 ip-10-0-142-238 kubenswrapper[2566]: I0718 02:31:37.908389    2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-a-2cb736\"/\"openshift-service-ca.crt\""
Jul 18 02:31:37.908456 ip-10-0-142-238 kubenswrapper[2566]: I0718 02:31:37.908389    2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-a-2cb736\"/\"kube-root-ca.crt\""
Jul 18 02:31:37.916873 ip-10-0-142-238 kubenswrapper[2566]: I0718 02:31:37.916850    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-2cb736/rate-test-model-2cb736-kserve-6954c45b8c-9lll7"]
Jul 18 02:31:38.017798 ip-10-0-142-238 kubenswrapper[2566]: I0718 02:31:38.017768    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/849f00de-de76-4e9f-b9b1-cafe5a182e4b-dshm\") pod \"rate-test-model-2cb736-kserve-6954c45b8c-9lll7\" (UID: \"849f00de-de76-4e9f-b9b1-cafe5a182e4b\") " pod="ai-tenant-e2e-shared-a-2cb736/rate-test-model-2cb736-kserve-6954c45b8c-9lll7"
Jul 18 02:31:38.017944 ip-10-0-142-238 kubenswrapper[2566]: I0718 02:31:38.017823    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wfdpf\" (UniqueName: \"kubernetes.io/projected/849f00de-de76-4e9f-b9b1-cafe5a182e4b-kube-api-access-wfdpf\") pod \"rate-test-model-2cb736-kserve-6954c45b8c-9lll7\" (UID: \"849f00de-de76-4e9f-b9b1-cafe5a182e4b\") " pod="ai-tenant-e2e-shared-a-2cb736/rate-test-model-2cb736-kserve-6954c45b8c-9lll7"
Jul 18 02:31:38.017944 ip-10-0-142-238 kubenswrapper[2566]: I0718 02:31:38.017856    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/849f00de-de76-4e9f-b9b1-cafe5a182e4b-tls-certs\") pod \"rate-test-model-2cb736-kserve-6954c45b8c-9lll7\" (UID: \"849f00de-de76-4e9f-b9b1-cafe5a182e4b\") " pod="ai-tenant-e2e-shared-a-2cb736/rate-test-model-2cb736-kserve-6954c45b8c-9lll7"
Jul 18 02:31:38.017944 ip-10-0-142-238 kubenswrapper[2566]: I0718 02:31:38.017894    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/849f00de-de76-4e9f-b9b1-cafe5a182e4b-model-cache\") pod \"rate-test-model-2cb736-kserve-6954c45b8c-9lll7\" (UID: \"849f00de-de76-4e9f-b9b1-cafe5a182e4b\") " pod="ai-tenant-e2e-shared-a-2cb736/rate-test-model-2cb736-kserve-6954c45b8c-9lll7"
Jul 18 02:31:38.017944 ip-10-0-142-238 kubenswrapper[2566]: I0718 02:31:38.017916    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/849f00de-de76-4e9f-b9b1-cafe5a182e4b-tmp-dir\") pod \"rate-test-model-2cb736-kserve-6954c45b8c-9lll7\" (UID: \"849f00de-de76-4e9f-b9b1-cafe5a182e4b\") " pod="ai-tenant-e2e-shared-a-2cb736/rate-test-model-2cb736-kserve-6954c45b8c-9lll7"
Jul 18 02:31:38.018078 ip-10-0-142-238 kubenswrapper[2566]: I0718 02:31:38.017972    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/849f00de-de76-4e9f-b9b1-cafe5a182e4b-home\") pod \"rate-test-model-2cb736-kserve-6954c45b8c-9lll7\" (UID: \"849f00de-de76-4e9f-b9b1-cafe5a182e4b\") " pod="ai-tenant-e2e-shared-a-2cb736/rate-test-model-2cb736-kserve-6954c45b8c-9lll7"
Jul 18 02:31:38.119158 ip-10-0-142-238 kubenswrapper[2566]: I0718 02:31:38.119128    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/849f00de-de76-4e9f-b9b1-cafe5a182e4b-model-cache\") pod \"rate-test-model-2cb736-kserve-6954c45b8c-9lll7\" (UID: \"849f00de-de76-4e9f-b9b1-cafe5a182e4b\") " pod="ai-tenant-e2e-shared-a-2cb736/rate-test-model-2cb736-kserve-6954c45b8c-9lll7"
Jul 18 02:31:38.119158 ip-10-0-142-238 kubenswrapper[2566]: I0718 02:31:38.119162    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/849f00de-de76-4e9f-b9b1-cafe5a182e4b-tmp-dir\") pod \"rate-test-model-2cb736-kserve-6954c45b8c-9lll7\" (UID: \"849f00de-de76-4e9f-b9b1-cafe5a182e4b\") " pod="ai-tenant-e2e-shared-a-2cb736/rate-test-model-2cb736-kserve-6954c45b8c-9lll7"
Jul 18 02:31:38.119371 ip-10-0-142-238 kubenswrapper[2566]: I0718 02:31:38.119177    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/849f00de-de76-4e9f-b9b1-cafe5a182e4b-home\") pod \"rate-test-model-2cb736-kserve-6954c45b8c-9lll7\" (UID: \"849f00de-de76-4e9f-b9b1-cafe5a182e4b\") " pod="ai-tenant-e2e-shared-a-2cb736/rate-test-model-2cb736-kserve-6954c45b8c-9lll7"
Jul 18 02:31:38.119371 ip-10-0-142-238 kubenswrapper[2566]: I0718 02:31:38.119224    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/849f00de-de76-4e9f-b9b1-cafe5a182e4b-dshm\") pod \"rate-test-model-2cb736-kserve-6954c45b8c-9lll7\" (UID: \"849f00de-de76-4e9f-b9b1-cafe5a182e4b\") " pod="ai-tenant-e2e-shared-a-2cb736/rate-test-model-2cb736-kserve-6954c45b8c-9lll7"
Jul 18 02:31:38.119371 ip-10-0-142-238 kubenswrapper[2566]: I0718 02:31:38.119261    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wfdpf\" (UniqueName: \"kubernetes.io/projected/849f00de-de76-4e9f-b9b1-cafe5a182e4b-kube-api-access-wfdpf\") pod \"rate-test-model-2cb736-kserve-6954c45b8c-9lll7\" (UID: \"849f00de-de76-4e9f-b9b1-cafe5a182e4b\") " pod="ai-tenant-e2e-shared-a-2cb736/rate-test-model-2cb736-kserve-6954c45b8c-9lll7"
Jul 18 02:31:38.119371 ip-10-0-142-238 kubenswrapper[2566]: I0718 02:31:38.119303    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/849f00de-de76-4e9f-b9b1-cafe5a182e4b-tls-certs\") pod \"rate-test-model-2cb736-kserve-6954c45b8c-9lll7\" (UID: \"849f00de-de76-4e9f-b9b1-cafe5a182e4b\") " pod="ai-tenant-e2e-shared-a-2cb736/rate-test-model-2cb736-kserve-6954c45b8c-9lll7"
Jul 18 02:31:38.119593 ip-10-0-142-238 kubenswrapper[2566]: I0718 02:31:38.119569    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/849f00de-de76-4e9f-b9b1-cafe5a182e4b-model-cache\") pod \"rate-test-model-2cb736-kserve-6954c45b8c-9lll7\" (UID: \"849f00de-de76-4e9f-b9b1-cafe5a182e4b\") " pod="ai-tenant-e2e-shared-a-2cb736/rate-test-model-2cb736-kserve-6954c45b8c-9lll7"
Jul 18 02:31:38.119674 ip-10-0-142-238 kubenswrapper[2566]: I0718 02:31:38.119603    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/849f00de-de76-4e9f-b9b1-cafe5a182e4b-tmp-dir\") pod \"rate-test-model-2cb736-kserve-6954c45b8c-9lll7\" (UID: \"849f00de-de76-4e9f-b9b1-cafe5a182e4b\") " pod="ai-tenant-e2e-shared-a-2cb736/rate-test-model-2cb736-kserve-6954c45b8c-9lll7"
Jul 18 02:31:38.119674 ip-10-0-142-238 kubenswrapper[2566]: I0718 02:31:38.119652    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/849f00de-de76-4e9f-b9b1-cafe5a182e4b-home\") pod \"rate-test-model-2cb736-kserve-6954c45b8c-9lll7\" (UID: \"849f00de-de76-4e9f-b9b1-cafe5a182e4b\") " pod="ai-tenant-e2e-shared-a-2cb736/rate-test-model-2cb736-kserve-6954c45b8c-9lll7"
Jul 18 02:31:38.121507 ip-10-0-142-238 kubenswrapper[2566]: I0718 02:31:38.121480    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/849f00de-de76-4e9f-b9b1-cafe5a182e4b-dshm\") pod \"rate-test-model-2cb736-kserve-6954c45b8c-9lll7\" (UID: \"849f00de-de76-4e9f-b9b1-cafe5a182e4b\") " pod="ai-tenant-e2e-shared-a-2cb736/rate-test-model-2cb736-kserve-6954c45b8c-9lll7"
Jul 18 02:31:38.121919 ip-10-0-142-238 kubenswrapper[2566]: I0718 02:31:38.121900    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/849f00de-de76-4e9f-b9b1-cafe5a182e4b-tls-certs\") pod \"rate-test-model-2cb736-kserve-6954c45b8c-9lll7\" (UID: \"849f00de-de76-4e9f-b9b1-cafe5a182e4b\") " pod="ai-tenant-e2e-shared-a-2cb736/rate-test-model-2cb736-kserve-6954c45b8c-9lll7"
Jul 18 02:31:38.126875 ip-10-0-142-238 kubenswrapper[2566]: I0718 02:31:38.126855    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wfdpf\" (UniqueName: \"kubernetes.io/projected/849f00de-de76-4e9f-b9b1-cafe5a182e4b-kube-api-access-wfdpf\") pod \"rate-test-model-2cb736-kserve-6954c45b8c-9lll7\" (UID: \"849f00de-de76-4e9f-b9b1-cafe5a182e4b\") " pod="ai-tenant-e2e-shared-a-2cb736/rate-test-model-2cb736-kserve-6954c45b8c-9lll7"
Jul 18 02:31:38.211546 ip-10-0-142-238 kubenswrapper[2566]: I0718 02:31:38.211467    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-2cb736/rate-test-model-2cb736-kserve-6954c45b8c-9lll7"
Jul 18 02:31:38.339086 ip-10-0-142-238 kubenswrapper[2566]: I0718 02:31:38.339062    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-2cb736/rate-test-model-2cb736-kserve-6954c45b8c-9lll7"]
Jul 18 02:31:38.341554 ip-10-0-142-238 kubenswrapper[2566]: W0718 02:31:38.341524    2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod849f00de_de76_4e9f_b9b1_cafe5a182e4b.slice/crio-f0aa608e475e00dc25d135029c9f0fedef71ab889f38150b57007c0807de8220 WatchSource:0}: Error finding container f0aa608e475e00dc25d135029c9f0fedef71ab889f38150b57007c0807de8220: Status 404 returned error can't find the container with id f0aa608e475e00dc25d135029c9f0fedef71ab889f38150b57007c0807de8220
Jul 18 02:31:39.121041 ip-10-0-142-238 kubenswrapper[2566]: I0718 02:31:39.121004    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-2cb736/rate-test-model-2cb736-kserve-6954c45b8c-9lll7" event={"ID":"849f00de-de76-4e9f-b9b1-cafe5a182e4b","Type":"ContainerStarted","Data":"e3bf6c849161b226c3c230a2bba755b2ed25290e3989cae356795c38522dd298"}
Jul 18 02:31:39.121041 ip-10-0-142-238 kubenswrapper[2566]: I0718 02:31:39.121047    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-2cb736/rate-test-model-2cb736-kserve-6954c45b8c-9lll7" event={"ID":"849f00de-de76-4e9f-b9b1-cafe5a182e4b","Type":"ContainerStarted","Data":"f0aa608e475e00dc25d135029c9f0fedef71ab889f38150b57007c0807de8220"}
Jul 18 02:31:39.140639 ip-10-0-142-238 kubenswrapper[2566]: I0718 02:31:39.139824    2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-a-2cb736/rate-test-model-2cb736-kserve-6954c45b8c-9lll7" podStartSLOduration=2.139805328 podStartE2EDuration="2.139805328s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-18 02:31:37 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-18 02:31:39.135889844 +0000 UTC m=+2630.824617290" watchObservedRunningTime="2026-07-18 02:31:39.139805328 +0000 UTC m=+2630.828532775"
Jul 18 02:31:41.479299 ip-10-0-142-238 kubenswrapper[2566]: I0718 02:31:41.479265    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-lmjk9"]
Jul 18 02:31:48.212289 ip-10-0-142-238 kubenswrapper[2566]: I0718 02:31:48.212255    2566 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-a-2cb736/rate-test-model-2cb736-kserve-6954c45b8c-9lll7"
Jul 18 02:31:48.212712 ip-10-0-142-238 kubenswrapper[2566]: I0718 02:31:48.212303    2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-a-2cb736/rate-test-model-2cb736-kserve-6954c45b8c-9lll7"
Jul 18 02:31:48.224466 ip-10-0-142-238 kubenswrapper[2566]: I0718 02:31:48.224441    2566 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-a-2cb736/rate-test-model-2cb736-kserve-6954c45b8c-9lll7"
Jul 18 02:31:49.112730 ip-10-0-142-238 kubenswrapper[2566]: I0718 02:31:49.112699    2566 scope.go:117] "RemoveContainer" containerID="45424b7ded8dc8b89659e3fa938ac5b186c063d77e07e58ccf0824071202321e"
Jul 18 02:31:49.120995 ip-10-0-142-238 kubenswrapper[2566]: I0718 02:31:49.120968    2566 scope.go:117] "RemoveContainer" containerID="2cf2babf8ca1a44698c32a8fa8746627d212aeca52fac6ff78d569fc16403956"
Jul 18 02:31:49.184381 ip-10-0-142-238 kubenswrapper[2566]: I0718 02:31:49.184362    2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-a-2cb736/rate-test-model-2cb736-kserve-6954c45b8c-9lll7"
Jul 18 02:32:38.686475 ip-10-0-142-238 kubenswrapper[2566]: I0718 02:32:38.686438    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-lmjk9"]
Jul 18 02:32:59.078114 ip-10-0-142-238 kubenswrapper[2566]: I0718 02:32:59.078078    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-lmjk9"]
Jul 18 02:33:15.276087 ip-10-0-142-238 kubenswrapper[2566]: I0718 02:33:15.276049    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-lmjk9"]
Jul 18 02:33:21.522202 ip-10-0-142-238 kubenswrapper[2566]: I0718 02:33:21.522167    2566 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-2cb736/rate-test-model-2cb736-kserve-6954c45b8c-9lll7"]
Jul 18 02:33:29.579853 ip-10-0-142-238 kubenswrapper[2566]: I0718 02:33:29.579819    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-lmjk9"]
Jul 18 02:33:36.540943 ip-10-0-142-238 kubenswrapper[2566]: I0718 02:33:36.540883    2566 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-shared-a-2cb736/rate-test-model-2cb736-kserve-6954c45b8c-9lll7" podUID="849f00de-de76-4e9f-b9b1-cafe5a182e4b" containerName="main" containerID="cri-o://e3bf6c849161b226c3c230a2bba755b2ed25290e3989cae356795c38522dd298" gracePeriod=45
Jul 18 02:33:36.690696 ip-10-0-142-238 kubenswrapper[2566]: I0718 02:33:36.690659    2566 generic.go:356] "Generic (PLEG): container finished" podID="849f00de-de76-4e9f-b9b1-cafe5a182e4b" containerID="e3bf6c849161b226c3c230a2bba755b2ed25290e3989cae356795c38522dd298" exitCode=0
Jul 18 02:33:36.690842 ip-10-0-142-238 kubenswrapper[2566]: I0718 02:33:36.690722    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-2cb736/rate-test-model-2cb736-kserve-6954c45b8c-9lll7" event={"ID":"849f00de-de76-4e9f-b9b1-cafe5a182e4b","Type":"ContainerDied","Data":"e3bf6c849161b226c3c230a2bba755b2ed25290e3989cae356795c38522dd298"}
Jul 18 02:33:36.783791 ip-10-0-142-238 kubenswrapper[2566]: I0718 02:33:36.783769    2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-2cb736/rate-test-model-2cb736-kserve-6954c45b8c-9lll7"
Jul 18 02:33:36.839938 ip-10-0-142-238 kubenswrapper[2566]: I0718 02:33:36.839881    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-wfdpf\" (UniqueName: \"kubernetes.io/projected/849f00de-de76-4e9f-b9b1-cafe5a182e4b-kube-api-access-wfdpf\") pod \"849f00de-de76-4e9f-b9b1-cafe5a182e4b\" (UID: \"849f00de-de76-4e9f-b9b1-cafe5a182e4b\") "
Jul 18 02:33:36.839938 ip-10-0-142-238 kubenswrapper[2566]: I0718 02:33:36.839923    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/849f00de-de76-4e9f-b9b1-cafe5a182e4b-dshm\") pod \"849f00de-de76-4e9f-b9b1-cafe5a182e4b\" (UID: \"849f00de-de76-4e9f-b9b1-cafe5a182e4b\") "
Jul 18 02:33:36.839938 ip-10-0-142-238 kubenswrapper[2566]: I0718 02:33:36.839939    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/849f00de-de76-4e9f-b9b1-cafe5a182e4b-model-cache\") pod \"849f00de-de76-4e9f-b9b1-cafe5a182e4b\" (UID: \"849f00de-de76-4e9f-b9b1-cafe5a182e4b\") "
Jul 18 02:33:36.840123 ip-10-0-142-238 kubenswrapper[2566]: I0718 02:33:36.839981    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/849f00de-de76-4e9f-b9b1-cafe5a182e4b-home\") pod \"849f00de-de76-4e9f-b9b1-cafe5a182e4b\" (UID: \"849f00de-de76-4e9f-b9b1-cafe5a182e4b\") "
Jul 18 02:33:36.840123 ip-10-0-142-238 kubenswrapper[2566]: I0718 02:33:36.840013    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/849f00de-de76-4e9f-b9b1-cafe5a182e4b-tmp-dir\") pod \"849f00de-de76-4e9f-b9b1-cafe5a182e4b\" (UID: \"849f00de-de76-4e9f-b9b1-cafe5a182e4b\") "
Jul 18 02:33:36.840123 ip-10-0-142-238 kubenswrapper[2566]: I0718 02:33:36.840049    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/849f00de-de76-4e9f-b9b1-cafe5a182e4b-tls-certs\") pod \"849f00de-de76-4e9f-b9b1-cafe5a182e4b\" (UID: \"849f00de-de76-4e9f-b9b1-cafe5a182e4b\") "
Jul 18 02:33:36.840278 ip-10-0-142-238 kubenswrapper[2566]: I0718 02:33:36.840229    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/849f00de-de76-4e9f-b9b1-cafe5a182e4b-home" (OuterVolumeSpecName: "home") pod "849f00de-de76-4e9f-b9b1-cafe5a182e4b" (UID: "849f00de-de76-4e9f-b9b1-cafe5a182e4b"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 18 02:33:36.840278 ip-10-0-142-238 kubenswrapper[2566]: I0718 02:33:36.840242    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/849f00de-de76-4e9f-b9b1-cafe5a182e4b-model-cache" (OuterVolumeSpecName: "model-cache") pod "849f00de-de76-4e9f-b9b1-cafe5a182e4b" (UID: "849f00de-de76-4e9f-b9b1-cafe5a182e4b"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 18 02:33:36.840278 ip-10-0-142-238 kubenswrapper[2566]: I0718 02:33:36.840261    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/849f00de-de76-4e9f-b9b1-cafe5a182e4b-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "849f00de-de76-4e9f-b9b1-cafe5a182e4b" (UID: "849f00de-de76-4e9f-b9b1-cafe5a182e4b"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 18 02:33:36.841975 ip-10-0-142-238 kubenswrapper[2566]: I0718 02:33:36.841952    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/849f00de-de76-4e9f-b9b1-cafe5a182e4b-dshm" (OuterVolumeSpecName: "dshm") pod "849f00de-de76-4e9f-b9b1-cafe5a182e4b" (UID: "849f00de-de76-4e9f-b9b1-cafe5a182e4b"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 18 02:33:36.842094 ip-10-0-142-238 kubenswrapper[2566]: I0718 02:33:36.842002    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/849f00de-de76-4e9f-b9b1-cafe5a182e4b-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "849f00de-de76-4e9f-b9b1-cafe5a182e4b" (UID: "849f00de-de76-4e9f-b9b1-cafe5a182e4b"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 18 02:33:36.842094 ip-10-0-142-238 kubenswrapper[2566]: I0718 02:33:36.842028    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/849f00de-de76-4e9f-b9b1-cafe5a182e4b-kube-api-access-wfdpf" (OuterVolumeSpecName: "kube-api-access-wfdpf") pod "849f00de-de76-4e9f-b9b1-cafe5a182e4b" (UID: "849f00de-de76-4e9f-b9b1-cafe5a182e4b"). InnerVolumeSpecName "kube-api-access-wfdpf". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 18 02:33:36.941086 ip-10-0-142-238 kubenswrapper[2566]: I0718 02:33:36.941064    2566 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-wfdpf\" (UniqueName: \"kubernetes.io/projected/849f00de-de76-4e9f-b9b1-cafe5a182e4b-kube-api-access-wfdpf\") on node \"ip-10-0-142-238.ec2.internal\" DevicePath \"\""
Jul 18 02:33:36.941086 ip-10-0-142-238 kubenswrapper[2566]: I0718 02:33:36.941085    2566 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/849f00de-de76-4e9f-b9b1-cafe5a182e4b-dshm\") on node \"ip-10-0-142-238.ec2.internal\" DevicePath \"\""
Jul 18 02:33:36.941204 ip-10-0-142-238 kubenswrapper[2566]: I0718 02:33:36.941093    2566 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/849f00de-de76-4e9f-b9b1-cafe5a182e4b-model-cache\") on node \"ip-10-0-142-238.ec2.internal\" DevicePath \"\""
Jul 18 02:33:36.941204 ip-10-0-142-238 kubenswrapper[2566]: I0718 02:33:36.941102    2566 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/849f00de-de76-4e9f-b9b1-cafe5a182e4b-home\") on node \"ip-10-0-142-238.ec2.internal\" DevicePath \"\""
Jul 18 02:33:36.941204 ip-10-0-142-238 kubenswrapper[2566]: I0718 02:33:36.941110    2566 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/849f00de-de76-4e9f-b9b1-cafe5a182e4b-tmp-dir\") on node \"ip-10-0-142-238.ec2.internal\" DevicePath \"\""
Jul 18 02:33:36.941204 ip-10-0-142-238 kubenswrapper[2566]: I0718 02:33:36.941117    2566 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/849f00de-de76-4e9f-b9b1-cafe5a182e4b-tls-certs\") on node \"ip-10-0-142-238.ec2.internal\" DevicePath \"\""
Jul 18 02:33:37.696928 ip-10-0-142-238 kubenswrapper[2566]: I0718 02:33:37.696902    2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-2cb736/rate-test-model-2cb736-kserve-6954c45b8c-9lll7"
Jul 18 02:33:37.696928 ip-10-0-142-238 kubenswrapper[2566]: I0718 02:33:37.696910    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-2cb736/rate-test-model-2cb736-kserve-6954c45b8c-9lll7" event={"ID":"849f00de-de76-4e9f-b9b1-cafe5a182e4b","Type":"ContainerDied","Data":"f0aa608e475e00dc25d135029c9f0fedef71ab889f38150b57007c0807de8220"}
Jul 18 02:33:37.697434 ip-10-0-142-238 kubenswrapper[2566]: I0718 02:33:37.696959    2566 scope.go:117] "RemoveContainer" containerID="e3bf6c849161b226c3c230a2bba755b2ed25290e3989cae356795c38522dd298"
Jul 18 02:33:37.718501 ip-10-0-142-238 kubenswrapper[2566]: I0718 02:33:37.718477    2566 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-2cb736/rate-test-model-2cb736-kserve-6954c45b8c-9lll7"]
Jul 18 02:33:37.724632 ip-10-0-142-238 kubenswrapper[2566]: I0718 02:33:37.724597    2566 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-a-2cb736/rate-test-model-2cb736-kserve-6954c45b8c-9lll7"]
Jul 18 02:33:38.815840 ip-10-0-142-238 kubenswrapper[2566]: I0718 02:33:38.815800    2566 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="849f00de-de76-4e9f-b9b1-cafe5a182e4b" path="/var/lib/kubelet/pods/849f00de-de76-4e9f-b9b1-cafe5a182e4b/volumes"
Jul 18 02:33:41.349268 ip-10-0-142-238 kubenswrapper[2566]: I0718 02:33:41.349229    2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-2cb736-xdfpf"]
Jul 18 02:33:41.349761 ip-10-0-142-238 kubenswrapper[2566]: I0718 02:33:41.349705    2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="849f00de-de76-4e9f-b9b1-cafe5a182e4b" containerName="main"
Jul 18 02:33:41.349761 ip-10-0-142-238 kubenswrapper[2566]: I0718 02:33:41.349725    2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="849f00de-de76-4e9f-b9b1-cafe5a182e4b" containerName="main"
Jul 18 02:33:41.349872 ip-10-0-142-238 kubenswrapper[2566]: I0718 02:33:41.349818    2566 memory_manager.go:368] "RemoveStaleState removing state" podUID="849f00de-de76-4e9f-b9b1-cafe5a182e4b" containerName="main"
Jul 18 02:33:41.354105 ip-10-0-142-238 kubenswrapper[2566]: I0718 02:33:41.354085    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-2cb736-xdfpf"
Jul 18 02:33:41.356285 ip-10-0-142-238 kubenswrapper[2566]: I0718 02:33:41.356266    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-5chqh\""
Jul 18 02:33:41.356390 ip-10-0-142-238 kubenswrapper[2566]: I0718 02:33:41.356307    2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 18 02:33:41.360156 ip-10-0-142-238 kubenswrapper[2566]: I0718 02:33:41.360136    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-2cb736-xdfpf"]
Jul 18 02:33:41.476354 ip-10-0-142-238 kubenswrapper[2566]: I0718 02:33:41.476320    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/586ec9ce-5488-4f83-a38d-f26a2b73fb96-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-a-2cb736-xdfpf\" (UID: \"586ec9ce-5488-4f83-a38d-f26a2b73fb96\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-2cb736-xdfpf"
Jul 18 02:33:41.577064 ip-10-0-142-238 kubenswrapper[2566]: I0718 02:33:41.577028    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/586ec9ce-5488-4f83-a38d-f26a2b73fb96-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-a-2cb736-xdfpf\" (UID: \"586ec9ce-5488-4f83-a38d-f26a2b73fb96\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-2cb736-xdfpf"
Jul 18 02:33:41.577704 ip-10-0-142-238 kubenswrapper[2566]: I0718 02:33:41.577682    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/586ec9ce-5488-4f83-a38d-f26a2b73fb96-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-a-2cb736-xdfpf\" (UID: \"586ec9ce-5488-4f83-a38d-f26a2b73fb96\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-2cb736-xdfpf"
Jul 18 02:33:41.665634 ip-10-0-142-238 kubenswrapper[2566]: I0718 02:33:41.665559    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-2cb736-xdfpf"
Jul 18 02:33:41.795092 ip-10-0-142-238 kubenswrapper[2566]: I0718 02:33:41.795065    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-2cb736-xdfpf"]
Jul 18 02:33:41.797183 ip-10-0-142-238 kubenswrapper[2566]: W0718 02:33:41.797155    2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod586ec9ce_5488_4f83_a38d_f26a2b73fb96.slice/crio-833e631356c2398a5306dd723d64809fda4c42b5306aeff513aea871e245f425 WatchSource:0}: Error finding container 833e631356c2398a5306dd723d64809fda4c42b5306aeff513aea871e245f425: Status 404 returned error can't find the container with id 833e631356c2398a5306dd723d64809fda4c42b5306aeff513aea871e245f425
Jul 18 02:33:42.722371 ip-10-0-142-238 kubenswrapper[2566]: I0718 02:33:42.722341    2566 generic.go:356] "Generic (PLEG): container finished" podID="586ec9ce-5488-4f83-a38d-f26a2b73fb96" containerID="b3fd9e72657fc9f45b1182c5ac3deb546f17a9a5746a7955873e8586a259e1e4" exitCode=0
Jul 18 02:33:42.722721 ip-10-0-142-238 kubenswrapper[2566]: I0718 02:33:42.722383    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-2cb736-xdfpf" event={"ID":"586ec9ce-5488-4f83-a38d-f26a2b73fb96","Type":"ContainerDied","Data":"b3fd9e72657fc9f45b1182c5ac3deb546f17a9a5746a7955873e8586a259e1e4"}
Jul 18 02:33:42.722721 ip-10-0-142-238 kubenswrapper[2566]: I0718 02:33:42.722444    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-2cb736-xdfpf" event={"ID":"586ec9ce-5488-4f83-a38d-f26a2b73fb96","Type":"ContainerStarted","Data":"833e631356c2398a5306dd723d64809fda4c42b5306aeff513aea871e245f425"}
Jul 18 02:33:43.848154 ip-10-0-142-238 kubenswrapper[2566]: I0718 02:33:43.848131    2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-2cb736-xdfpf"
Jul 18 02:33:43.997041 ip-10-0-142-238 kubenswrapper[2566]: I0718 02:33:43.996959    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/586ec9ce-5488-4f83-a38d-f26a2b73fb96-maas-api-service-ca\") pod \"586ec9ce-5488-4f83-a38d-f26a2b73fb96\" (UID: \"586ec9ce-5488-4f83-a38d-f26a2b73fb96\") "
Jul 18 02:33:43.997299 ip-10-0-142-238 kubenswrapper[2566]: I0718 02:33:43.997277    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/586ec9ce-5488-4f83-a38d-f26a2b73fb96-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "586ec9ce-5488-4f83-a38d-f26a2b73fb96" (UID: "586ec9ce-5488-4f83-a38d-f26a2b73fb96"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 18 02:33:44.098422 ip-10-0-142-238 kubenswrapper[2566]: I0718 02:33:44.098387    2566 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/586ec9ce-5488-4f83-a38d-f26a2b73fb96-maas-api-service-ca\") on node \"ip-10-0-142-238.ec2.internal\" DevicePath \"\""
Jul 18 02:33:44.733909 ip-10-0-142-238 kubenswrapper[2566]: I0718 02:33:44.733880    2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-2cb736-xdfpf"
Jul 18 02:33:44.734080 ip-10-0-142-238 kubenswrapper[2566]: I0718 02:33:44.733921    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-2cb736-xdfpf" event={"ID":"586ec9ce-5488-4f83-a38d-f26a2b73fb96","Type":"ContainerDied","Data":"833e631356c2398a5306dd723d64809fda4c42b5306aeff513aea871e245f425"}
Jul 18 02:33:44.734080 ip-10-0-142-238 kubenswrapper[2566]: I0718 02:33:44.733968    2566 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="833e631356c2398a5306dd723d64809fda4c42b5306aeff513aea871e245f425"
Jul 18 02:33:51.919235 ip-10-0-142-238 kubenswrapper[2566]: I0718 02:33:51.919199    2566 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-2cb736-29739030-lg4z5"]
Jul 18 02:33:51.921926 ip-10-0-142-238 kubenswrapper[2566]: I0718 02:33:51.921903    2566 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-2cb736-29739030-lg4z5"]
Jul 18 02:33:52.815306 ip-10-0-142-238 kubenswrapper[2566]: I0718 02:33:52.815273    2566 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="bcd83a10-f86b-4831-8abe-88bc9c5d1738" path="/var/lib/kubelet/pods/bcd83a10-f86b-4831-8abe-88bc9c5d1738/volumes"
Jul 18 02:33:55.081245 ip-10-0-142-238 kubenswrapper[2566]: I0718 02:33:55.081200    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-lmjk9"]
Jul 18 02:33:56.491115 ip-10-0-142-238 kubenswrapper[2566]: I0718 02:33:56.491086    2566 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-2cb736-xdfpf"]
Jul 18 02:33:56.494075 ip-10-0-142-238 kubenswrapper[2566]: I0718 02:33:56.494052    2566 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-2cb736-xdfpf"]
Jul 18 02:33:56.815163 ip-10-0-142-238 kubenswrapper[2566]: I0718 02:33:56.815133    2566 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="586ec9ce-5488-4f83-a38d-f26a2b73fb96" path="/var/lib/kubelet/pods/586ec9ce-5488-4f83-a38d-f26a2b73fb96/volumes"
Jul 18 02:34:03.308953 ip-10-0-142-238 kubenswrapper[2566]: I0718 02:34:03.308916    2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-16c040-npv2l"]
Jul 18 02:34:03.309368 ip-10-0-142-238 kubenswrapper[2566]: I0718 02:34:03.309211    2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="586ec9ce-5488-4f83-a38d-f26a2b73fb96" containerName="revoke-keys"
Jul 18 02:34:03.309368 ip-10-0-142-238 kubenswrapper[2566]: I0718 02:34:03.309221    2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="586ec9ce-5488-4f83-a38d-f26a2b73fb96" containerName="revoke-keys"
Jul 18 02:34:03.309368 ip-10-0-142-238 kubenswrapper[2566]: I0718 02:34:03.309296    2566 memory_manager.go:368] "RemoveStaleState removing state" podUID="586ec9ce-5488-4f83-a38d-f26a2b73fb96" containerName="revoke-keys"
Jul 18 02:34:03.312305 ip-10-0-142-238 kubenswrapper[2566]: I0718 02:34:03.312286    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-16c040-npv2l"
Jul 18 02:34:03.314336 ip-10-0-142-238 kubenswrapper[2566]: I0718 02:34:03.314309    2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 18 02:34:03.314445 ip-10-0-142-238 kubenswrapper[2566]: I0718 02:34:03.314378    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-5chqh\""
Jul 18 02:34:03.318510 ip-10-0-142-238 kubenswrapper[2566]: I0718 02:34:03.318485    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-16c040-npv2l"]
Jul 18 02:34:03.438833 ip-10-0-142-238 kubenswrapper[2566]: I0718 02:34:03.438811    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/f17361b8-b0f4-49b5-b6fd-211896c886b7-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-b-16c040-npv2l\" (UID: \"f17361b8-b0f4-49b5-b6fd-211896c886b7\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-16c040-npv2l"
Jul 18 02:34:03.539908 ip-10-0-142-238 kubenswrapper[2566]: I0718 02:34:03.539881    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/f17361b8-b0f4-49b5-b6fd-211896c886b7-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-b-16c040-npv2l\" (UID: \"f17361b8-b0f4-49b5-b6fd-211896c886b7\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-16c040-npv2l"
Jul 18 02:34:03.540433 ip-10-0-142-238 kubenswrapper[2566]: I0718 02:34:03.540416    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/f17361b8-b0f4-49b5-b6fd-211896c886b7-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-b-16c040-npv2l\" (UID: \"f17361b8-b0f4-49b5-b6fd-211896c886b7\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-16c040-npv2l"
Jul 18 02:34:03.623483 ip-10-0-142-238 kubenswrapper[2566]: I0718 02:34:03.623427    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-16c040-npv2l"
Jul 18 02:34:03.747829 ip-10-0-142-238 kubenswrapper[2566]: I0718 02:34:03.747751    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-16c040-npv2l"]
Jul 18 02:34:03.750203 ip-10-0-142-238 kubenswrapper[2566]: W0718 02:34:03.750177    2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf17361b8_b0f4_49b5_b6fd_211896c886b7.slice/crio-9e1ba1e3073a277542ebb3ee64fb5f53062652a38533c82bfe091e105d8cb581 WatchSource:0}: Error finding container 9e1ba1e3073a277542ebb3ee64fb5f53062652a38533c82bfe091e105d8cb581: Status 404 returned error can't find the container with id 9e1ba1e3073a277542ebb3ee64fb5f53062652a38533c82bfe091e105d8cb581
Jul 18 02:34:03.829398 ip-10-0-142-238 kubenswrapper[2566]: I0718 02:34:03.829371    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-16c040-npv2l" event={"ID":"f17361b8-b0f4-49b5-b6fd-211896c886b7","Type":"ContainerStarted","Data":"9e1ba1e3073a277542ebb3ee64fb5f53062652a38533c82bfe091e105d8cb581"}
Jul 18 02:34:04.835341 ip-10-0-142-238 kubenswrapper[2566]: I0718 02:34:04.835301    2566 generic.go:356] "Generic (PLEG): container finished" podID="f17361b8-b0f4-49b5-b6fd-211896c886b7" containerID="bd75a53d44102f5dd87b32dd9f5e02b522b8cae30ff7c6275ef0c9e585ad2b11" exitCode=0
Jul 18 02:34:04.835746 ip-10-0-142-238 kubenswrapper[2566]: I0718 02:34:04.835382    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-16c040-npv2l" event={"ID":"f17361b8-b0f4-49b5-b6fd-211896c886b7","Type":"ContainerDied","Data":"bd75a53d44102f5dd87b32dd9f5e02b522b8cae30ff7c6275ef0c9e585ad2b11"}
Jul 18 02:34:05.963436 ip-10-0-142-238 kubenswrapper[2566]: I0718 02:34:05.963405    2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-16c040-npv2l"
Jul 18 02:34:06.060619 ip-10-0-142-238 kubenswrapper[2566]: I0718 02:34:06.060592    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/f17361b8-b0f4-49b5-b6fd-211896c886b7-maas-api-service-ca\") pod \"f17361b8-b0f4-49b5-b6fd-211896c886b7\" (UID: \"f17361b8-b0f4-49b5-b6fd-211896c886b7\") "
Jul 18 02:34:06.060917 ip-10-0-142-238 kubenswrapper[2566]: I0718 02:34:06.060896    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f17361b8-b0f4-49b5-b6fd-211896c886b7-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "f17361b8-b0f4-49b5-b6fd-211896c886b7" (UID: "f17361b8-b0f4-49b5-b6fd-211896c886b7"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 18 02:34:06.162121 ip-10-0-142-238 kubenswrapper[2566]: I0718 02:34:06.162048    2566 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/f17361b8-b0f4-49b5-b6fd-211896c886b7-maas-api-service-ca\") on node \"ip-10-0-142-238.ec2.internal\" DevicePath \"\""
Jul 18 02:34:06.845516 ip-10-0-142-238 kubenswrapper[2566]: I0718 02:34:06.845487    2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-16c040-npv2l"
Jul 18 02:34:06.845667 ip-10-0-142-238 kubenswrapper[2566]: I0718 02:34:06.845526    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-16c040-npv2l" event={"ID":"f17361b8-b0f4-49b5-b6fd-211896c886b7","Type":"ContainerDied","Data":"9e1ba1e3073a277542ebb3ee64fb5f53062652a38533c82bfe091e105d8cb581"}
Jul 18 02:34:06.845667 ip-10-0-142-238 kubenswrapper[2566]: I0718 02:34:06.845572    2566 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="9e1ba1e3073a277542ebb3ee64fb5f53062652a38533c82bfe091e105d8cb581"
Jul 18 02:34:13.716579 ip-10-0-142-238 kubenswrapper[2566]: I0718 02:34:13.716485    2566 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-16c040-29739030-qvngd"]
Jul 18 02:34:13.719414 ip-10-0-142-238 kubenswrapper[2566]: I0718 02:34:13.719389    2566 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-16c040-29739030-qvngd"]
Jul 18 02:34:14.815948 ip-10-0-142-238 kubenswrapper[2566]: I0718 02:34:14.815915    2566 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="720308a0-a394-4ac6-b5ff-11d2809f4dde" path="/var/lib/kubelet/pods/720308a0-a394-4ac6-b5ff-11d2809f4dde/volumes"
Jul 18 02:34:16.579700 ip-10-0-142-238 kubenswrapper[2566]: I0718 02:34:16.579666    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-lmjk9"]
Jul 18 02:34:18.381592 ip-10-0-142-238 kubenswrapper[2566]: I0718 02:34:18.381556    2566 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-16c040-npv2l"]
Jul 18 02:34:18.384987 ip-10-0-142-238 kubenswrapper[2566]: I0718 02:34:18.384957    2566 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-16c040-npv2l"]
Jul 18 02:34:18.815395 ip-10-0-142-238 kubenswrapper[2566]: I0718 02:34:18.815365    2566 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f17361b8-b0f4-49b5-b6fd-211896c886b7" path="/var/lib/kubelet/pods/f17361b8-b0f4-49b5-b6fd-211896c886b7/volumes"
Jul 18 02:34:31.708260 ip-10-0-142-238 kubenswrapper[2566]: I0718 02:34:31.708231    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-6667d74d96-c9z7s_d57e2773-94d5-4fd3-b96f-22b243255ca8/copy-manifests/0.log"
Jul 18 02:34:31.721452 ip-10-0-142-238 kubenswrapper[2566]: I0718 02:34:31.721430    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-6667d74d96-c9z7s_d57e2773-94d5-4fd3-b96f-22b243255ca8/manager/0.log"
Jul 18 02:34:32.515096 ip-10-0-142-238 kubenswrapper[2566]: I0718 02:34:32.515067    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-key-cleanup-29739030-2bwnv_86a10295-ae0e-43c3-9b2a-10dbd9f63667/cleanup/0.log"
Jul 18 02:34:33.373649 ip-10-0-142-238 kubenswrapper[2566]: I0718 02:34:33.373599    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759cjfmt_4c6603cb-ac41-4dee-9847-e4cdcdc9baa6/util/0.log"
Jul 18 02:34:33.379973 ip-10-0-142-238 kubenswrapper[2566]: I0718 02:34:33.379949    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759cjfmt_4c6603cb-ac41-4dee-9847-e4cdcdc9baa6/pull/0.log"
Jul 18 02:34:33.388371 ip-10-0-142-238 kubenswrapper[2566]: I0718 02:34:33.388354    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759cjfmt_4c6603cb-ac41-4dee-9847-e4cdcdc9baa6/extract/0.log"
Jul 18 02:34:33.496144 ip-10-0-142-238 kubenswrapper[2566]: I0718 02:34:33.496116    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0xqbk8_705bf56e-32ea-4869-93bc-d6c47279ecee/util/0.log"
Jul 18 02:34:33.501999 ip-10-0-142-238 kubenswrapper[2566]: I0718 02:34:33.501981    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0xqbk8_705bf56e-32ea-4869-93bc-d6c47279ecee/pull/0.log"
Jul 18 02:34:33.513059 ip-10-0-142-238 kubenswrapper[2566]: I0718 02:34:33.513029    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0xqbk8_705bf56e-32ea-4869-93bc-d6c47279ecee/extract/0.log"
Jul 18 02:34:33.619483 ip-10-0-142-238 kubenswrapper[2566]: I0718 02:34:33.619452    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73w7pjw_fcc9b86e-50bc-4250-b400-6828c3a3da67/extract/0.log"
Jul 18 02:34:33.625454 ip-10-0-142-238 kubenswrapper[2566]: I0718 02:34:33.625409    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73w7pjw_fcc9b86e-50bc-4250-b400-6828c3a3da67/util/0.log"
Jul 18 02:34:33.631219 ip-10-0-142-238 kubenswrapper[2566]: I0718 02:34:33.631198    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73w7pjw_fcc9b86e-50bc-4250-b400-6828c3a3da67/pull/0.log"
Jul 18 02:34:33.743072 ip-10-0-142-238 kubenswrapper[2566]: I0718 02:34:33.743050    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1kb4sj_6cbfcdd3-6983-41ee-ae84-8682939ff7de/util/0.log"
Jul 18 02:34:33.750177 ip-10-0-142-238 kubenswrapper[2566]: I0718 02:34:33.750160    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1kb4sj_6cbfcdd3-6983-41ee-ae84-8682939ff7de/pull/0.log"
Jul 18 02:34:33.756496 ip-10-0-142-238 kubenswrapper[2566]: I0718 02:34:33.756483    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1kb4sj_6cbfcdd3-6983-41ee-ae84-8682939ff7de/extract/0.log"
Jul 18 02:34:34.569214 ip-10-0-142-238 kubenswrapper[2566]: I0718 02:34:34.569187    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-limitador-54d6d988d5-lmjk9_45d987b6-ee81-442a-98de-70e5a1917c2d/limitador/0.log"
Jul 18 02:34:35.136229 ip-10-0-142-238 kubenswrapper[2566]: I0718 02:34:35.136205    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-94bb8fbfd-cs62j_f3a49d60-42c3-4776-aa91-b437ecdc9a19/discovery/0.log"
Jul 18 02:34:35.823202 ip-10-0-142-238 kubenswrapper[2566]: I0718 02:34:35.823170    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-57ff4ffb64-8n2hs_f34b225d-0b2f-474f-9b87-40443dba791b/router/0.log"
Jul 18 02:34:36.594198 ip-10-0-142-238 kubenswrapper[2566]: I0718 02:34:36.594175    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_facebook-opt-125m-simulated-kserve-74b68447df-gvh6g_63b9bbfd-41bb-4166-b986-8990b4a08544/main/0.log"
Jul 18 02:34:36.705134 ip-10-0-142-238 kubenswrapper[2566]: I0718 02:34:36.705107    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_premium-simulated-simulated-premium-kserve-5fc6fb456f-xhk2r_5635a15f-a823-4e81-915e-afe36a182f68/main/0.log"
Jul 18 02:34:44.925739 ip-10-0-142-238 kubenswrapper[2566]: I0718 02:34:44.925713    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-2jzkc_26d75b92-43d7-43e7-96c8-dd42a5288953/global-pull-secret-syncer/0.log"
Jul 18 02:34:45.093396 ip-10-0-142-238 kubenswrapper[2566]: I0718 02:34:45.093366    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-l28dd_44aa7f9e-049a-45bc-98bc-ff1d4309f5de/konnectivity-agent/0.log"
Jul 18 02:34:45.200730 ip-10-0-142-238 kubenswrapper[2566]: I0718 02:34:45.200655    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-142-238.ec2.internal_780b86b12592a8e7c650c0643a729f9d/haproxy/0.log"
Jul 18 02:34:49.341620 ip-10-0-142-238 kubenswrapper[2566]: I0718 02:34:49.341588    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759cjfmt_4c6603cb-ac41-4dee-9847-e4cdcdc9baa6/extract/0.log"
Jul 18 02:34:49.362638 ip-10-0-142-238 kubenswrapper[2566]: I0718 02:34:49.362585    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759cjfmt_4c6603cb-ac41-4dee-9847-e4cdcdc9baa6/util/0.log"
Jul 18 02:34:49.383162 ip-10-0-142-238 kubenswrapper[2566]: I0718 02:34:49.383137    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759cjfmt_4c6603cb-ac41-4dee-9847-e4cdcdc9baa6/pull/0.log"
Jul 18 02:34:49.419784 ip-10-0-142-238 kubenswrapper[2566]: I0718 02:34:49.419763    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0xqbk8_705bf56e-32ea-4869-93bc-d6c47279ecee/extract/0.log"
Jul 18 02:34:49.446438 ip-10-0-142-238 kubenswrapper[2566]: I0718 02:34:49.446417    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0xqbk8_705bf56e-32ea-4869-93bc-d6c47279ecee/util/0.log"
Jul 18 02:34:49.472702 ip-10-0-142-238 kubenswrapper[2566]: I0718 02:34:49.472640    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0xqbk8_705bf56e-32ea-4869-93bc-d6c47279ecee/pull/0.log"
Jul 18 02:34:49.497453 ip-10-0-142-238 kubenswrapper[2566]: I0718 02:34:49.497431    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73w7pjw_fcc9b86e-50bc-4250-b400-6828c3a3da67/extract/0.log"
Jul 18 02:34:49.521906 ip-10-0-142-238 kubenswrapper[2566]: I0718 02:34:49.521887    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73w7pjw_fcc9b86e-50bc-4250-b400-6828c3a3da67/util/0.log"
Jul 18 02:34:49.549541 ip-10-0-142-238 kubenswrapper[2566]: I0718 02:34:49.549523    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73w7pjw_fcc9b86e-50bc-4250-b400-6828c3a3da67/pull/0.log"
Jul 18 02:34:49.587943 ip-10-0-142-238 kubenswrapper[2566]: I0718 02:34:49.587923    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1kb4sj_6cbfcdd3-6983-41ee-ae84-8682939ff7de/extract/0.log"
Jul 18 02:34:49.615138 ip-10-0-142-238 kubenswrapper[2566]: I0718 02:34:49.615117    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1kb4sj_6cbfcdd3-6983-41ee-ae84-8682939ff7de/util/0.log"
Jul 18 02:34:49.636041 ip-10-0-142-238 kubenswrapper[2566]: I0718 02:34:49.636021    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1kb4sj_6cbfcdd3-6983-41ee-ae84-8682939ff7de/pull/0.log"
Jul 18 02:34:50.760516 ip-10-0-142-238 kubenswrapper[2566]: I0718 02:34:50.760484    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-limitador-54d6d988d5-lmjk9_45d987b6-ee81-442a-98de-70e5a1917c2d/limitador/0.log"
Jul 18 02:34:53.488079 ip-10-0-142-238 kubenswrapper[2566]: I0718 02:34:53.488052    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-kf4kl_dbcde2ae-53a4-41b6-b1b9-5b39eadd9820/node-exporter/0.log"
Jul 18 02:34:53.506635 ip-10-0-142-238 kubenswrapper[2566]: I0718 02:34:53.506589    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-kf4kl_dbcde2ae-53a4-41b6-b1b9-5b39eadd9820/kube-rbac-proxy/0.log"
Jul 18 02:34:53.526312 ip-10-0-142-238 kubenswrapper[2566]: I0718 02:34:53.526283    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-kf4kl_dbcde2ae-53a4-41b6-b1b9-5b39eadd9820/init-textfile/0.log"
Jul 18 02:34:55.839828 ip-10-0-142-238 kubenswrapper[2566]: I0718 02:34:55.839794    2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-4d8sb/perf-node-gather-daemonset-ln5wx"]
Jul 18 02:34:55.840198 ip-10-0-142-238 kubenswrapper[2566]: I0718 02:34:55.840092    2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f17361b8-b0f4-49b5-b6fd-211896c886b7" containerName="revoke-keys"
Jul 18 02:34:55.840198 ip-10-0-142-238 kubenswrapper[2566]: I0718 02:34:55.840101    2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="f17361b8-b0f4-49b5-b6fd-211896c886b7" containerName="revoke-keys"
Jul 18 02:34:55.840198 ip-10-0-142-238 kubenswrapper[2566]: I0718 02:34:55.840150    2566 memory_manager.go:368] "RemoveStaleState removing state" podUID="f17361b8-b0f4-49b5-b6fd-211896c886b7" containerName="revoke-keys"
Jul 18 02:34:55.844154 ip-10-0-142-238 kubenswrapper[2566]: I0718 02:34:55.844132    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-4d8sb/perf-node-gather-daemonset-ln5wx"
Jul 18 02:34:55.846443 ip-10-0-142-238 kubenswrapper[2566]: I0718 02:34:55.846423    2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-4d8sb\"/\"openshift-service-ca.crt\""
Jul 18 02:34:55.846705 ip-10-0-142-238 kubenswrapper[2566]: I0718 02:34:55.846686    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-4d8sb\"/\"default-dockercfg-6ncht\""
Jul 18 02:34:55.847221 ip-10-0-142-238 kubenswrapper[2566]: I0718 02:34:55.847205    2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-4d8sb\"/\"kube-root-ca.crt\""
Jul 18 02:34:55.850920 ip-10-0-142-238 kubenswrapper[2566]: I0718 02:34:55.850900    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-4d8sb/perf-node-gather-daemonset-ln5wx"]
Jul 18 02:34:55.933187 ip-10-0-142-238 kubenswrapper[2566]: I0718 02:34:55.933155    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/5dc7c385-1d78-4ea9-b40c-850cba0799b4-proc\") pod \"perf-node-gather-daemonset-ln5wx\" (UID: \"5dc7c385-1d78-4ea9-b40c-850cba0799b4\") " pod="openshift-must-gather-4d8sb/perf-node-gather-daemonset-ln5wx"
Jul 18 02:34:55.933344 ip-10-0-142-238 kubenswrapper[2566]: I0718 02:34:55.933217    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/5dc7c385-1d78-4ea9-b40c-850cba0799b4-podres\") pod \"perf-node-gather-daemonset-ln5wx\" (UID: \"5dc7c385-1d78-4ea9-b40c-850cba0799b4\") " pod="openshift-must-gather-4d8sb/perf-node-gather-daemonset-ln5wx"
Jul 18 02:34:55.933344 ip-10-0-142-238 kubenswrapper[2566]: I0718 02:34:55.933269    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4m6w7\" (UniqueName: \"kubernetes.io/projected/5dc7c385-1d78-4ea9-b40c-850cba0799b4-kube-api-access-4m6w7\") pod \"perf-node-gather-daemonset-ln5wx\" (UID: \"5dc7c385-1d78-4ea9-b40c-850cba0799b4\") " pod="openshift-must-gather-4d8sb/perf-node-gather-daemonset-ln5wx"
Jul 18 02:34:55.933344 ip-10-0-142-238 kubenswrapper[2566]: I0718 02:34:55.933299    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/5dc7c385-1d78-4ea9-b40c-850cba0799b4-sys\") pod \"perf-node-gather-daemonset-ln5wx\" (UID: \"5dc7c385-1d78-4ea9-b40c-850cba0799b4\") " pod="openshift-must-gather-4d8sb/perf-node-gather-daemonset-ln5wx"
Jul 18 02:34:55.933344 ip-10-0-142-238 kubenswrapper[2566]: I0718 02:34:55.933321    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/5dc7c385-1d78-4ea9-b40c-850cba0799b4-lib-modules\") pod \"perf-node-gather-daemonset-ln5wx\" (UID: \"5dc7c385-1d78-4ea9-b40c-850cba0799b4\") " pod="openshift-must-gather-4d8sb/perf-node-gather-daemonset-ln5wx"
Jul 18 02:34:56.033963 ip-10-0-142-238 kubenswrapper[2566]: I0718 02:34:56.033931    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/5dc7c385-1d78-4ea9-b40c-850cba0799b4-lib-modules\") pod \"perf-node-gather-daemonset-ln5wx\" (UID: \"5dc7c385-1d78-4ea9-b40c-850cba0799b4\") " pod="openshift-must-gather-4d8sb/perf-node-gather-daemonset-ln5wx"
Jul 18 02:34:56.034124 ip-10-0-142-238 kubenswrapper[2566]: I0718 02:34:56.033972    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/5dc7c385-1d78-4ea9-b40c-850cba0799b4-proc\") pod \"perf-node-gather-daemonset-ln5wx\" (UID: \"5dc7c385-1d78-4ea9-b40c-850cba0799b4\") " pod="openshift-must-gather-4d8sb/perf-node-gather-daemonset-ln5wx"
Jul 18 02:34:56.034124 ip-10-0-142-238 kubenswrapper[2566]: I0718 02:34:56.034023    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/5dc7c385-1d78-4ea9-b40c-850cba0799b4-podres\") pod \"perf-node-gather-daemonset-ln5wx\" (UID: \"5dc7c385-1d78-4ea9-b40c-850cba0799b4\") " pod="openshift-must-gather-4d8sb/perf-node-gather-daemonset-ln5wx"
Jul 18 02:34:56.034124 ip-10-0-142-238 kubenswrapper[2566]: I0718 02:34:56.034052    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4m6w7\" (UniqueName: \"kubernetes.io/projected/5dc7c385-1d78-4ea9-b40c-850cba0799b4-kube-api-access-4m6w7\") pod \"perf-node-gather-daemonset-ln5wx\" (UID: \"5dc7c385-1d78-4ea9-b40c-850cba0799b4\") " pod="openshift-must-gather-4d8sb/perf-node-gather-daemonset-ln5wx"
Jul 18 02:34:56.034124 ip-10-0-142-238 kubenswrapper[2566]: I0718 02:34:56.034072    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/5dc7c385-1d78-4ea9-b40c-850cba0799b4-sys\") pod \"perf-node-gather-daemonset-ln5wx\" (UID: \"5dc7c385-1d78-4ea9-b40c-850cba0799b4\") " pod="openshift-must-gather-4d8sb/perf-node-gather-daemonset-ln5wx"
Jul 18 02:34:56.034124 ip-10-0-142-238 kubenswrapper[2566]: I0718 02:34:56.034109    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/5dc7c385-1d78-4ea9-b40c-850cba0799b4-lib-modules\") pod \"perf-node-gather-daemonset-ln5wx\" (UID: \"5dc7c385-1d78-4ea9-b40c-850cba0799b4\") " pod="openshift-must-gather-4d8sb/perf-node-gather-daemonset-ln5wx"
Jul 18 02:34:56.034326 ip-10-0-142-238 kubenswrapper[2566]: I0718 02:34:56.034143    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/5dc7c385-1d78-4ea9-b40c-850cba0799b4-proc\") pod \"perf-node-gather-daemonset-ln5wx\" (UID: \"5dc7c385-1d78-4ea9-b40c-850cba0799b4\") " pod="openshift-must-gather-4d8sb/perf-node-gather-daemonset-ln5wx"
Jul 18 02:34:56.034326 ip-10-0-142-238 kubenswrapper[2566]: I0718 02:34:56.034148    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/5dc7c385-1d78-4ea9-b40c-850cba0799b4-podres\") pod \"perf-node-gather-daemonset-ln5wx\" (UID: \"5dc7c385-1d78-4ea9-b40c-850cba0799b4\") " pod="openshift-must-gather-4d8sb/perf-node-gather-daemonset-ln5wx"
Jul 18 02:34:56.034326 ip-10-0-142-238 kubenswrapper[2566]: I0718 02:34:56.034193    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/5dc7c385-1d78-4ea9-b40c-850cba0799b4-sys\") pod \"perf-node-gather-daemonset-ln5wx\" (UID: \"5dc7c385-1d78-4ea9-b40c-850cba0799b4\") " pod="openshift-must-gather-4d8sb/perf-node-gather-daemonset-ln5wx"
Jul 18 02:34:56.042800 ip-10-0-142-238 kubenswrapper[2566]: I0718 02:34:56.042780    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4m6w7\" (UniqueName: \"kubernetes.io/projected/5dc7c385-1d78-4ea9-b40c-850cba0799b4-kube-api-access-4m6w7\") pod \"perf-node-gather-daemonset-ln5wx\" (UID: \"5dc7c385-1d78-4ea9-b40c-850cba0799b4\") " pod="openshift-must-gather-4d8sb/perf-node-gather-daemonset-ln5wx"
Jul 18 02:34:56.154379 ip-10-0-142-238 kubenswrapper[2566]: I0718 02:34:56.154304    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-4d8sb/perf-node-gather-daemonset-ln5wx"
Jul 18 02:34:56.286638 ip-10-0-142-238 kubenswrapper[2566]: I0718 02:34:56.286586    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-4d8sb/perf-node-gather-daemonset-ln5wx"]
Jul 18 02:34:56.288271 ip-10-0-142-238 kubenswrapper[2566]: W0718 02:34:56.288247    2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod5dc7c385_1d78_4ea9_b40c_850cba0799b4.slice/crio-ca9120a2d4233e7f036d69ed1bd932d8236a2edc4483b7668dd124066952476c WatchSource:0}: Error finding container ca9120a2d4233e7f036d69ed1bd932d8236a2edc4483b7668dd124066952476c: Status 404 returned error can't find the container with id ca9120a2d4233e7f036d69ed1bd932d8236a2edc4483b7668dd124066952476c
Jul 18 02:34:57.081286 ip-10-0-142-238 kubenswrapper[2566]: I0718 02:34:57.081257    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-4d8sb/perf-node-gather-daemonset-ln5wx" event={"ID":"5dc7c385-1d78-4ea9-b40c-850cba0799b4","Type":"ContainerStarted","Data":"070ab285324738d67ba5bfc2d76edee8e9edd814adf90e721ace8cff1e9fb587"}
Jul 18 02:34:57.081690 ip-10-0-142-238 kubenswrapper[2566]: I0718 02:34:57.081303    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-4d8sb/perf-node-gather-daemonset-ln5wx" event={"ID":"5dc7c385-1d78-4ea9-b40c-850cba0799b4","Type":"ContainerStarted","Data":"ca9120a2d4233e7f036d69ed1bd932d8236a2edc4483b7668dd124066952476c"}
Jul 18 02:34:57.081690 ip-10-0-142-238 kubenswrapper[2566]: I0718 02:34:57.081390    2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-4d8sb/perf-node-gather-daemonset-ln5wx"
Jul 18 02:34:57.094160 ip-10-0-142-238 kubenswrapper[2566]: I0718 02:34:57.094144    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-storage-operator_volume-data-source-validator-78cf4c6f6-thdcg_01816298-697d-4189-96fd-d961c5e530ac/volume-data-source-validator/0.log"
Jul 18 02:34:57.098550 ip-10-0-142-238 kubenswrapper[2566]: I0718 02:34:57.098513    2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-4d8sb/perf-node-gather-daemonset-ln5wx" podStartSLOduration=2.098501213 podStartE2EDuration="2.098501213s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-18 02:34:55 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-18 02:34:57.096947215 +0000 UTC m=+2828.785674663" watchObservedRunningTime="2026-07-18 02:34:57.098501213 +0000 UTC m=+2828.787228639"
Jul 18 02:34:58.154170 ip-10-0-142-238 kubenswrapper[2566]: I0718 02:34:58.154144    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-lh5mf_bf30ad74-8679-41d3-aa9d-19b3cea07be7/dns/0.log"
Jul 18 02:34:58.173851 ip-10-0-142-238 kubenswrapper[2566]: I0718 02:34:58.173827    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-lh5mf_bf30ad74-8679-41d3-aa9d-19b3cea07be7/kube-rbac-proxy/0.log"
Jul 18 02:34:58.269224 ip-10-0-142-238 kubenswrapper[2566]: I0718 02:34:58.269204    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-cpp62_ddbb4203-0f8f-4799-a645-184ca2236211/dns-node-resolver/0.log"
Jul 18 02:34:58.817639 ip-10-0-142-238 kubenswrapper[2566]: I0718 02:34:58.817597    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_image-registry-6bc57544c9-t2bd8_381b3b1f-2d24-47ba-99dd-0c27bc36fa5c/registry/0.log"
Jul 18 02:34:58.881926 ip-10-0-142-238 kubenswrapper[2566]: I0718 02:34:58.881906    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-lt6hj_573bdc5a-3cb5-4729-9426-270ba59b0d02/node-ca/0.log"
Jul 18 02:34:59.933571 ip-10-0-142-238 kubenswrapper[2566]: I0718 02:34:59.933540    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-94bb8fbfd-cs62j_f3a49d60-42c3-4776-aa91-b437ecdc9a19/discovery/0.log"
Jul 18 02:35:00.161391 ip-10-0-142-238 kubenswrapper[2566]: I0718 02:35:00.161368    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-57ff4ffb64-8n2hs_f34b225d-0b2f-474f-9b87-40443dba791b/router/0.log"
Jul 18 02:35:00.865633 ip-10-0-142-238 kubenswrapper[2566]: I0718 02:35:00.865595    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-pz72j_fdf6ac26-5f24-480c-ad15-d6dbb18adc78/serve-healthcheck-canary/0.log"
Jul 18 02:35:01.356932 ip-10-0-142-238 kubenswrapper[2566]: I0718 02:35:01.356900    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-555d9d7885-d2pwt_efcaba5e-5f68-4e32-9930-0e11bc9f9363/insights-operator/0.log"
Jul 18 02:35:01.357394 ip-10-0-142-238 kubenswrapper[2566]: I0718 02:35:01.357276    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-555d9d7885-d2pwt_efcaba5e-5f68-4e32-9930-0e11bc9f9363/insights-operator/1.log"
Jul 18 02:35:01.376721 ip-10-0-142-238 kubenswrapper[2566]: I0718 02:35:01.376697    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-gfxbj_a313b3f0-c006-44fc-8b93-d5a250b450ef/kube-rbac-proxy/0.log"
Jul 18 02:35:01.395535 ip-10-0-142-238 kubenswrapper[2566]: I0718 02:35:01.395514    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-gfxbj_a313b3f0-c006-44fc-8b93-d5a250b450ef/exporter/0.log"
Jul 18 02:35:01.416982 ip-10-0-142-238 kubenswrapper[2566]: I0718 02:35:01.416962    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-gfxbj_a313b3f0-c006-44fc-8b93-d5a250b450ef/extractor/0.log"
Jul 18 02:35:03.095686 ip-10-0-142-238 kubenswrapper[2566]: I0718 02:35:03.095658    2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-4d8sb/perf-node-gather-daemonset-ln5wx"
Jul 18 02:35:04.424092 ip-10-0-142-238 kubenswrapper[2566]: I0718 02:35:04.424064    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-6667d74d96-c9z7s_d57e2773-94d5-4fd3-b96f-22b243255ca8/manager/0.log"
Jul 18 02:35:04.441990 ip-10-0-142-238 kubenswrapper[2566]: I0718 02:35:04.441970    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-6667d74d96-c9z7s_d57e2773-94d5-4fd3-b96f-22b243255ca8/copy-manifests/0.log"
Jul 18 02:35:06.018991 ip-10-0-142-238 kubenswrapper[2566]: I0718 02:35:06.018925    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_lws-controller-manager-5b6fc5d786-t4876_9e5a47bc-c1d4-4b4d-abfc-24cc1d1596b2/manager/0.log"
Jul 18 02:35:06.613820 ip-10-0-142-238 kubenswrapper[2566]: I0718 02:35:06.613792    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-94bb8fbfd-cs62j_f3a49d60-42c3-4776-aa91-b437ecdc9a19/discovery/0.log"
Jul 18 02:35:06.800826 ip-10-0-142-238 kubenswrapper[2566]: I0718 02:35:06.800797    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-57ff4ffb64-8n2hs_f34b225d-0b2f-474f-9b87-40443dba791b/router/0.log"
Jul 18 02:35:08.087356 ip-10-0-142-238 kubenswrapper[2566]: I0718 02:35:08.087325    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-94bb8fbfd-cs62j_f3a49d60-42c3-4776-aa91-b437ecdc9a19/discovery/0.log"
Jul 18 02:35:08.306803 ip-10-0-142-238 kubenswrapper[2566]: I0718 02:35:08.306773    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-57ff4ffb64-8n2hs_f34b225d-0b2f-474f-9b87-40443dba791b/router/0.log"
Jul 18 02:35:10.927907 ip-10-0-142-238 kubenswrapper[2566]: I0718 02:35:10.927877    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-7cc9c7ffd7-7zb86_4b0102b2-4cdc-49e1-b67e-95cde3bf129a/migrator/0.log"
Jul 18 02:35:10.947021 ip-10-0-142-238 kubenswrapper[2566]: I0718 02:35:10.946996    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-7cc9c7ffd7-7zb86_4b0102b2-4cdc-49e1-b67e-95cde3bf129a/graceful-termination/0.log"
Jul 18 02:35:11.282688 ip-10-0-142-238 kubenswrapper[2566]: I0718 02:35:11.282656    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-7658d9b749-zldws_26d03adb-3892-4d46-a693-735f83aee367/kube-storage-version-migrator-operator/1.log"
Jul 18 02:35:11.283658 ip-10-0-142-238 kubenswrapper[2566]: I0718 02:35:11.283602    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-7658d9b749-zldws_26d03adb-3892-4d46-a693-735f83aee367/kube-storage-version-migrator-operator/0.log"
Jul 18 02:35:12.542739 ip-10-0-142-238 kubenswrapper[2566]: I0718 02:35:12.542710    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-smml7_fae2962e-4ef0-41af-a49e-d6216d1aa7c9/kube-multus-additional-cni-plugins/0.log"
Jul 18 02:35:12.564008 ip-10-0-142-238 kubenswrapper[2566]: I0718 02:35:12.563982    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-smml7_fae2962e-4ef0-41af-a49e-d6216d1aa7c9/egress-router-binary-copy/0.log"
Jul 18 02:35:12.584716 ip-10-0-142-238 kubenswrapper[2566]: I0718 02:35:12.584692    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-smml7_fae2962e-4ef0-41af-a49e-d6216d1aa7c9/cni-plugins/0.log"
Jul 18 02:35:12.605131 ip-10-0-142-238 kubenswrapper[2566]: I0718 02:35:12.605110    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-smml7_fae2962e-4ef0-41af-a49e-d6216d1aa7c9/bond-cni-plugin/0.log"
Jul 18 02:35:12.624093 ip-10-0-142-238 kubenswrapper[2566]: I0718 02:35:12.624070    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-smml7_fae2962e-4ef0-41af-a49e-d6216d1aa7c9/routeoverride-cni/0.log"
Jul 18 02:35:12.642816 ip-10-0-142-238 kubenswrapper[2566]: I0718 02:35:12.642796    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-smml7_fae2962e-4ef0-41af-a49e-d6216d1aa7c9/whereabouts-cni-bincopy/0.log"
Jul 18 02:35:12.661338 ip-10-0-142-238 kubenswrapper[2566]: I0718 02:35:12.661317    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-smml7_fae2962e-4ef0-41af-a49e-d6216d1aa7c9/whereabouts-cni/0.log"
Jul 18 02:35:12.779179 ip-10-0-142-238 kubenswrapper[2566]: I0718 02:35:12.779153    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-z6hz2_d43cde0e-8b28-405b-a229-dedf1d9c4435/kube-multus/0.log"
Jul 18 02:35:12.850431 ip-10-0-142-238 kubenswrapper[2566]: I0718 02:35:12.850366    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-pdflp_7c91433e-b6e6-47a8-8df6-2231cbc7d28c/network-metrics-daemon/0.log"
Jul 18 02:35:12.867654 ip-10-0-142-238 kubenswrapper[2566]: I0718 02:35:12.867632    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-pdflp_7c91433e-b6e6-47a8-8df6-2231cbc7d28c/kube-rbac-proxy/0.log"